2024-09-10T07:23:54.759 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T07:23:54.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T07:23:54.912 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866 branch: wip-rishabh-testing-20240909.165402-squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-full} email: null first_in_suite: false job_id: '7898866' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPPC2a1nqcYoj002jU8wuuKXC0DJjNfM/CIiKQ4z1JyQYrtNhgHFYllnHct2fTf6B3uBpYB0gk5qkGXMrg7WWh0= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdXCcqiT98bblNXKltK2RO1pr6sSPwAIU4iIkEr1cEJTCAyuNmRJXNmvAkg+8FrxTnF1AMYf3p6QyWe/TGcweo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T07:23:54.913 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T07:23:54.913 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T07:23:54.914 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T07:23:54.915 INFO:teuthology.task.internal:Checking packages... 2024-09-10T07:23:54.936 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T07:23:54.937 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T07:23:54.937 INFO:teuthology.packaging:ref: None 2024-09-10T07:23:54.937 INFO:teuthology.packaging:tag: None 2024-09-10T07:23:54.937 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T07:23:54.937 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:23:54.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T07:23:55.083 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T07:23:55.084 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T07:23:55.090 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T07:23:55.091 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T07:23:55.097 INFO:teuthology.task.internal:Saving configuration 2024-09-10T07:23:55.114 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T07:23:55.121 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T07:23:55.138 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 07:18:53.352608', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPPC2a1nqcYoj002jU8wuuKXC0DJjNfM/CIiKQ4z1JyQYrtNhgHFYllnHct2fTf6B3uBpYB0gk5qkGXMrg7WWh0='} 2024-09-10T07:23:55.155 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 07:18:53.353683', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdXCcqiT98bblNXKltK2RO1pr6sSPwAIU4iIkEr1cEJTCAyuNmRJXNmvAkg+8FrxTnF1AMYf3p6QyWe/TGcweo='} 2024-09-10T07:23:55.155 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T07:23:55.162 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T07:23:55.162 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T07:23:55.162 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T07:23:55.200 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fabd3f3bf40>, signals=[15]) 2024-09-10T07:23:55.200 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T07:23:55.206 INFO:teuthology.task.internal:Opening connections... 2024-09-10T07:23:55.206 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:23:55.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:23:55.282 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:23:55.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:23:55.355 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T07:23:55.362 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-09-10T07:23:55.380 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-09-10T07:23:55.381 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-09-10T07:23:55.437 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T07:23:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T07:23:55.439 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-09-10T07:23:55.457 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-09-10T07:23:55.475 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-09-10T07:23:55.475 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-09-10T07:23:55.533 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-09-10T07:23:55.533 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T07:23:55.534 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T07:23:55.535 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-09-10T07:23:55.557 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T07:23:55.566 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T07:23:55.618 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T07:23:55.618 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-09-10T07:23:55.621 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2024-09-10T07:23:55.638 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T07:23:55.644 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T07:23:55.644 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-09-10T07:23:55.678 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2024-09-10T07:23:55.890 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T07:23:55.942 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T07:23:55.957 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T07:23:55.957 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-10T07:23:55.957 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-10T07:23:55.957 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T07:23:55.958 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T07:23:55.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:23:55.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-10T07:23:55.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:23:55.978 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-10T07:23:56.175 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T07:23:56.175 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T07:23:56.175 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-10T07:23:56.190 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T07:23:56.190 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T07:23:56.190 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-09-10T07:23:56.193 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-503.el9.x86_64 2024-09-10T07:23:56.193 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T07:23:56.194 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T07:23:56.194 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum upgrade -y linux-firmware 2024-09-10T07:23:56.207 INFO:teuthology.orchestra.run.smithi187.stdout:5.14.0-503.el9.x86_64 2024-09-10T07:23:56.208 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T07:23:56.208 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T07:23:56.208 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum upgrade -y linux-firmware 2024-09-10T07:23:59.710 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-10T07:23:59.719 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-10T07:24:02.944 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-09-10T07:24:03.778 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 20 MB 00:02 2024-09-10T07:24:08.844 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-10T07:24:09.487 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-10T07:24:10.402 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 19 kB 00:00 2024-09-10T07:24:10.929 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-10T07:24:11.258 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-10T07:24:11.700 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-10T07:24:16.695 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-10T07:24:17.164 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-10T07:24:18.741 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-10T07:24:18.742 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-10T07:24:18.742 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-10T07:24:18.848 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-10T07:24:18.849 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T07:24:18.986 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T07:24:18.987 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T07:24:18.989 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi099.front.sepia.ceph.com to complete... 2024-09-10T07:24:19.252 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-10T07:24:19.253 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2024-09-10T07:24:19.253 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-10T07:24:19.372 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-10T07:24:19.373 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T07:24:19.517 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T07:24:19.517 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T07:24:19.520 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi187.front.sepia.ceph.com to complete... 2024-09-10T07:24:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10 07:24:29 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T07:24:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:FINISHED --2024-09-10 07:24:29-- 2024-09-10T07:24:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:Total wall clock time: 10s 2024-09-10T07:24:29.239 INFO:teuthology.orchestra.run.smithi099.stderr:Downloaded: 1 files, 343M in 9.9s (34.6 MB/s) 2024-09-10T07:24:29.241 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-10T07:24:29.242 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T07:24:31.216 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10 07:24:31 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T07:24:31.216 INFO:teuthology.orchestra.run.smithi187.stderr:FINISHED --2024-09-10 07:24:31-- 2024-09-10T07:24:31.216 INFO:teuthology.orchestra.run.smithi187.stderr:Total wall clock time: 12s 2024-09-10T07:24:31.217 INFO:teuthology.orchestra.run.smithi187.stderr:Downloaded: 1 files, 343M in 11s (30.5 MB/s) 2024-09-10T07:24:31.219 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-10T07:24:31.219 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T07:24:31.349 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying... ######################################## 2024-09-10T07:24:31.575 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing... ######################################## 2024-09-10T07:24:31.704 INFO:teuthology.orchestra.run.smithi099.stdout:Updating / installing... 2024-09-10T07:24:33.333 INFO:teuthology.orchestra.run.smithi187.stdout:Verifying... ######################################## 2024-09-10T07:24:33.621 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing... ######################################## 2024-09-10T07:24:33.734 INFO:teuthology.orchestra.run.smithi187.stdout:Updating / installing... 2024-09-10T07:24:39.689 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T07:24:41.756 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T07:25:19.485 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T07:25:19.486 DEBUG:teuthology.orchestra.run.smithi099:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T07:25:19.589 INFO:teuthology.orchestra.run.smithi099.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:19.589 INFO:teuthology.orchestra.run.smithi099.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:19.589 INFO:teuthology.orchestra.run.smithi099.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:19.589 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:19.589 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T07:25:19.589 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T07:25:19.589 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T07:25:19.589 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T07:25:19.589 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T07:25:19.590 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T07:25:19.591 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T07:25:19.591 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T07:25:19.591 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T07:25:19.591 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T07:25:19.591 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T07:25:19.591 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T07:25:19.591 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T07:25:19.591 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T07:25:19.591 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T07:25:19.591 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T07:25:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T07:25:19.593 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T07:25:19.594 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T07:25:19.595 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T07:25:19.595 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T07:25:19.595 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T07:25:19.595 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T07:25:19.595 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T07:25:19.595 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T07:25:19.595 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T07:25:19.595 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T07:25:19.595 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T07:25:19.596 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T07:25:19.596 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T07:25:19.596 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T07:25:19.596 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T07:25:19.596 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T07:25:19.596 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T07:25:19.596 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T07:25:19.596 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T07:25:19.597 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T07:25:19.598 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T07:25:19.599 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T07:25:19.600 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T07:25:19.601 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T07:25:19.602 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T07:25:19.603 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T07:25:19.604 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T07:25:19.605 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T07:25:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T07:25:19.607 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T07:25:19.608 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T07:25:19.609 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T07:25:19.610 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T07:25:19.611 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T07:25:19.612 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T07:25:19.613 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T07:25:19.614 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T07:25:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T07:25:19.616 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T07:25:19.617 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T07:25:19.618 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T07:25:19.619 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T07:25:19.620 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T07:25:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T07:25:19.622 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T07:25:19.623 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T07:25:19.624 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T07:25:19.625 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T07:25:19.626 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T07:25:19.627 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T07:25:19.628 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T07:25:19.629 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T07:25:19.630 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T07:25:19.631 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T07:25:19.631 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T07:25:19.631 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T07:25:19.631 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T07:25:19.631 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T07:25:19.631 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T07:25:19.631 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T07:25:19.631 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T07:25:19.631 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T07:25:19.631 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T07:25:19.632 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T07:25:19.633 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T07:25:19.633 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T07:25:19.633 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T07:25:19.633 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T07:25:19.633 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T07:25:19.633 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T07:25:19.633 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T07:25:19.634 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T07:25:19.635 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T07:25:19.636 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T07:25:19.637 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T07:25:19.637 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T07:25:19.637 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T07:25:19.637 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T07:25:19.637 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T07:25:19.637 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T07:25:19.637 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T07:25:19.637 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T07:25:19.637 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T07:25:19.637 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T07:25:19.638 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T07:25:19.639 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T07:25:19.640 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T07:25:19.641 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T07:25:19.642 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T07:25:19.643 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T07:25:19.644 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T07:25:19.644 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T07:25:19.644 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T07:25:19.644 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T07:25:19.644 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T07:25:19.644 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T07:25:19.644 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T07:25:19.644 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T07:25:19.644 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T07:25:19.644 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T07:25:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T07:25:19.646 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T07:25:19.647 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T07:25:19.648 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T07:25:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T07:25:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T07:25:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T07:25:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T07:25:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T07:25:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T07:25:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T07:25:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T07:25:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T07:25:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T07:25:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T07:25:19.651 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T07:25:19.652 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T07:25:19.653 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T07:25:19.654 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T07:25:19.655 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T07:25:19.656 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T07:25:19.657 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T07:25:19.657 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T07:25:19.657 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T07:25:19.657 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T07:25:19.657 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T07:25:19.657 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T07:25:19.657 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T07:25:19.657 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T07:25:19.657 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T07:25:19.657 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T07:25:19.658 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T07:25:19.659 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T07:25:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T07:25:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T07:25:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T07:25:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T07:25:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T07:25:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T07:25:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T07:25:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T07:25:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T07:25:19.660 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T07:25:19.661 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T07:25:19.662 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T07:25:19.663 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T07:25:19.664 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T07:25:19.665 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T07:25:19.666 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T07:25:19.667 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T07:25:19.667 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T07:25:19.667 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T07:25:19.667 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T07:25:19.667 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T07:25:19.667 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T07:25:19.667 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T07:25:19.667 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T07:25:19.667 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T07:25:19.667 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T07:25:19.668 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T07:25:19.669 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T07:25:19.670 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T07:25:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T07:25:19.672 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T07:25:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T07:25:19.674 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T07:25:19.675 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T07:25:19.676 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T07:25:19.677 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T07:25:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T07:25:19.679 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T07:25:19.680 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T07:25:19.681 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T07:25:19.682 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T07:25:19.683 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T07:25:19.684 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T07:25:19.685 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T07:25:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T07:25:19.687 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T07:25:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T07:25:19.689 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T07:25:19.690 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T07:25:19.691 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T07:25:19.692 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T07:25:19.693 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T07:25:19.694 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T07:25:19.695 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T07:25:19.695 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T07:25:19.695 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T07:25:19.695 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T07:25:19.695 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T07:25:19.695 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T07:25:19.695 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T07:25:19.695 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T07:25:19.695 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T07:25:19.695 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T07:25:19.696 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T07:25:19.696 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T07:25:19.696 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T07:25:19.696 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T07:25:19.696 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T07:25:19.696 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T07:25:19.696 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T07:25:19.696 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T07:25:19.696 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T07:25:19.696 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T07:25:19.697 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T07:25:19.698 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T07:25:19.698 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T07:25:19.698 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T07:25:19.698 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T07:25:19.698 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T07:25:19.698 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T07:25:19.698 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T07:25:19.698 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T07:25:19.698 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T07:25:19.698 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T07:25:19.699 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T07:25:19.700 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T07:25:19.701 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T07:25:19.702 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T07:25:19.703 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T07:25:19.704 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T07:25:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T07:25:19.706 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T07:25:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T07:25:19.708 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T07:25:19.709 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T07:25:19.710 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T07:25:19.711 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T07:25:19.712 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T07:25:19.713 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T07:25:19.714 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T07:25:19.715 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T07:25:19.716 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T07:25:19.717 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T07:25:19.718 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T07:25:19.719 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T07:25:19.720 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T07:25:19.721 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T07:25:19.722 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T07:25:19.723 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T07:25:19.724 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T07:25:19.725 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T07:25:19.726 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T07:25:19.727 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T07:25:19.728 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T07:25:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T07:25:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T07:25:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T07:25:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T07:25:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T07:25:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T07:25:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T07:25:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T07:25:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T07:25:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T07:25:19.730 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T07:25:19.730 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T07:25:19.730 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T07:25:19.730 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T07:25:19.730 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T07:25:19.730 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T07:25:19.730 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T07:25:19.730 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T07:25:19.730 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T07:25:19.730 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T07:25:19.731 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T07:25:19.732 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T07:25:19.732 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T07:25:19.732 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T07:25:19.732 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T07:25:19.732 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T07:25:19.732 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T07:25:19.732 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T07:25:19.732 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T07:25:19.732 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T07:25:19.732 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T07:25:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T07:25:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T07:25:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T07:25:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T07:25:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T07:25:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T07:25:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T07:25:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T07:25:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T07:25:19.733 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T07:25:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T07:25:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T07:25:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T07:25:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T07:25:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T07:25:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T07:25:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T07:25:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T07:25:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T07:25:19.734 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T07:25:19.735 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T07:25:19.736 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T07:25:19.737 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T07:25:19.738 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T07:25:19.739 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T07:25:19.740 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T07:25:19.741 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T07:25:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T07:25:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T07:25:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T07:25:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T07:25:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T07:25:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T07:25:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T07:25:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T07:25:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T07:25:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T07:25:19.743 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T07:25:19.744 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T07:25:19.744 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T07:25:19.744 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T07:25:19.744 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T07:25:19.744 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T07:25:19.744 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T07:25:19.744 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T07:25:19.744 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T07:25:19.744 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T07:25:19.744 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T07:25:19.745 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T07:25:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T07:25:19.747 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T07:25:19.748 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T07:25:19.749 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T07:25:19.750 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T07:25:19.751 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T07:25:19.752 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T07:25:19.753 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T07:25:19.754 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T07:25:19.754 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T07:25:19.754 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T07:25:19.758 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:19.759 DEBUG:teuthology.orchestra.run.smithi099:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T07:25:19.782 INFO:teuthology.orchestra.run.smithi099.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T07:25:19.782 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T07:25:19.782 INFO:teuthology.orchestra.run.smithi099.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T07:25:19.782 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2024-09-10T07:25:19.782 INFO:teuthology.orchestra.run.smithi099.stdout:for file in vmlinuz System.map config; do 2024-09-10T07:25:19.782 INFO:teuthology.orchestra.run.smithi099.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout: fi 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout:done 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2024-09-10T07:25:19.783 INFO:teuthology.orchestra.run.smithi099.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T07:25:19.784 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T07:25:19.784 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:19.784 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2024-09-10T07:25:19.785 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-09-10T07:25:19.867 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-09-10T07:25:19.867 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-09-10T07:25:19.867 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2024-09-10T07:25:19.867 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 82.el9 2024-09-10T07:25:19.867 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-09-10T07:25:19.867 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T07:25:19.867 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8274670 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-09-10T07:25:19.868 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:25:19.869 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T07:25:19.869 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T07:25:19.869 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T07:25:19.869 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-09-10T07:25:19.869 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:25:19.869 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T07:25:19.870 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T07:25:19.870 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:19.870 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T07:25:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-09-10T07:25:21.746 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T07:25:21.788 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-09-10T07:25:21.790 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-10T07:25:21.805 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.8GxWZNch1t 2024-09-10T07:25:21.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8GxWZNch1t 2024-09-10T07:25:21.873 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.8GxWZNch1t 2024-09-10T07:25:22.014 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.8GxWZNch1t is 6KB 2024-09-10T07:25:22.063 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.8GxWZNch1t 2024-09-10T07:25:22.078 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T07:25:22.082 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T07:25:22.082 DEBUG:teuthology.orchestra.run.smithi187:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T07:25:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T07:25:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T07:25:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T07:25:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T07:25:22.142 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:22.181 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T07:25:22.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T07:25:22.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T07:25:22.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T07:25:22.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T07:25:22.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T07:25:22.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T07:25:22.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T07:25:22.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T07:25:22.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T07:25:22.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T07:25:22.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T07:25:22.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T07:25:22.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T07:25:22.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T07:25:22.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T07:25:22.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T07:25:22.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T07:25:22.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T07:25:22.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T07:25:22.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T07:25:22.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T07:25:22.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T07:25:22.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T07:25:22.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T07:25:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T07:25:22.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T07:25:22.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T07:25:22.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T07:25:22.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T07:25:22.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T07:25:22.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T07:25:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T07:25:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T07:25:22.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T07:25:22.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T07:25:22.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T07:25:22.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T07:25:22.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T07:25:22.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T07:25:22.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T07:25:22.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T07:25:22.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T07:25:22.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T07:25:22.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T07:25:22.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T07:25:22.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T07:25:22.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T07:25:22.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T07:25:22.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T07:25:22.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T07:25:22.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T07:25:22.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T07:25:22.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T07:25:22.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T07:25:22.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T07:25:22.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T07:25:22.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T07:25:22.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T07:25:22.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T07:25:22.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T07:25:22.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T07:25:22.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T07:25:22.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T07:25:22.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T07:25:22.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T07:25:22.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T07:25:22.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T07:25:22.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T07:25:22.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T07:25:22.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T07:25:22.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T07:25:22.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T07:25:22.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T07:25:22.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T07:25:22.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T07:25:22.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T07:25:22.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T07:25:22.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T07:25:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T07:25:22.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T07:25:22.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T07:25:22.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T07:25:22.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T07:25:22.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T07:25:22.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T07:25:22.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T07:25:22.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T07:25:22.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T07:25:22.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T07:25:22.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T07:25:22.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T07:25:22.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T07:25:22.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T07:25:22.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T07:25:22.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T07:25:22.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T07:25:22.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T07:25:22.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T07:25:22.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T07:25:22.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T07:25:22.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T07:25:22.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T07:25:22.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T07:25:22.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T07:25:22.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T07:25:22.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T07:25:22.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T07:25:22.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T07:25:22.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T07:25:22.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T07:25:22.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T07:25:22.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T07:25:22.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T07:25:22.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T07:25:22.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T07:25:22.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T07:25:22.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T07:25:22.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T07:25:22.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T07:25:22.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T07:25:22.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T07:25:22.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T07:25:22.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T07:25:22.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T07:25:22.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T07:25:22.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T07:25:22.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T07:25:22.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T07:25:22.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T07:25:22.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T07:25:22.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T07:25:22.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T07:25:22.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T07:25:22.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T07:25:22.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T07:25:22.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T07:25:22.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T07:25:22.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T07:25:22.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T07:25:22.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T07:25:22.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T07:25:22.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T07:25:22.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T07:25:22.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T07:25:22.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T07:25:22.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T07:25:22.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T07:25:22.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T07:25:22.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T07:25:22.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T07:25:22.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T07:25:22.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T07:25:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T07:25:22.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T07:25:22.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T07:25:22.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T07:25:22.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T07:25:22.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T07:25:22.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T07:25:22.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T07:25:22.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T07:25:22.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T07:25:22.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T07:25:22.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T07:25:22.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T07:25:22.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T07:25:22.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T07:25:22.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T07:25:22.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T07:25:22.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T07:25:22.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T07:25:22.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T07:25:22.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T07:25:22.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T07:25:22.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T07:25:22.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T07:25:22.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T07:25:22.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T07:25:22.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T07:25:22.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T07:25:22.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T07:25:22.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T07:25:22.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T07:25:22.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T07:25:22.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T07:25:22.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T07:25:22.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T07:25:22.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T07:25:22.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T07:25:22.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T07:25:22.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T07:25:22.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T07:25:22.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T07:25:22.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T07:25:22.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T07:25:22.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T07:25:22.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T07:25:22.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T07:25:22.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T07:25:22.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T07:25:22.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T07:25:22.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T07:25:22.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T07:25:22.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T07:25:22.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T07:25:22.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T07:25:22.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T07:25:22.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T07:25:22.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T07:25:22.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T07:25:22.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T07:25:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T07:25:22.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T07:25:22.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T07:25:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T07:25:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T07:25:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T07:25:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T07:25:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T07:25:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T07:25:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T07:25:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T07:25:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T07:25:22.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T07:25:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T07:25:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T07:25:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T07:25:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T07:25:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T07:25:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T07:25:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T07:25:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T07:25:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T07:25:22.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T07:25:22.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T07:25:22.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T07:25:22.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T07:25:22.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T07:25:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T07:25:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T07:25:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T07:25:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T07:25:22.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T07:25:22.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T07:25:22.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T07:25:22.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T07:25:22.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T07:25:22.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T07:25:22.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T07:25:22.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T07:25:22.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T07:25:22.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T07:25:22.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T07:25:22.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T07:25:22.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T07:25:22.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T07:25:22.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T07:25:22.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T07:25:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T07:25:22.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T07:25:22.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T07:25:22.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T07:25:22.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T07:25:22.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T07:25:22.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T07:25:22.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T07:25:22.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T07:25:22.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T07:25:22.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T07:25:22.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T07:25:22.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T07:25:22.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T07:25:22.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T07:25:22.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T07:25:22.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T07:25:22.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T07:25:22.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T07:25:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T07:25:22.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T07:25:22.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T07:25:22.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T07:25:22.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T07:25:22.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T07:25:22.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T07:25:22.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T07:25:22.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T07:25:22.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T07:25:22.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T07:25:22.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T07:25:22.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T07:25:22.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T07:25:22.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T07:25:22.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T07:25:22.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T07:25:22.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T07:25:22.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T07:25:22.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T07:25:22.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T07:25:22.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T07:25:22.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T07:25:22.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T07:25:22.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T07:25:22.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T07:25:22.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T07:25:22.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T07:25:22.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T07:25:22.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T07:25:22.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T07:25:22.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T07:25:22.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T07:25:22.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T07:25:22.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T07:25:22.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T07:25:22.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T07:25:22.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T07:25:22.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T07:25:22.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T07:25:22.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T07:25:22.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T07:25:22.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T07:25:22.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T07:25:22.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T07:25:22.338 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:22.338 DEBUG:teuthology.orchestra.run.smithi187:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T07:25:22.362 INFO:teuthology.orchestra.run.smithi187.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T07:25:22.362 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T07:25:22.362 INFO:teuthology.orchestra.run.smithi187.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T07:25:22.362 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2024-09-10T07:25:22.362 INFO:teuthology.orchestra.run.smithi187.stdout:for file in vmlinuz System.map config; do 2024-09-10T07:25:22.362 INFO:teuthology.orchestra.run.smithi187.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout: fi 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout:done 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T07:25:22.363 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:22.364 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2024-09-10T07:25:22.364 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -qi grub2-tools 2024-09-10T07:25:22.438 INFO:teuthology.orchestra.run.smithi187.stdout:Name : grub2-tools 2024-09-10T07:25:22.439 INFO:teuthology.orchestra.run.smithi187.stdout:Epoch : 1 2024-09-10T07:25:22.439 INFO:teuthology.orchestra.run.smithi187.stdout:Version : 2.06 2024-09-10T07:25:22.439 INFO:teuthology.orchestra.run.smithi187.stdout:Release : 82.el9 2024-09-10T07:25:22.439 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: x86_64 2024-09-10T07:25:22.439 INFO:teuthology.orchestra.run.smithi187.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T07:25:22.439 INFO:teuthology.orchestra.run.smithi187.stdout:Group : Unspecified 2024-09-10T07:25:22.440 INFO:teuthology.orchestra.run.smithi187.stdout:Size : 8274670 2024-09-10T07:25:22.440 INFO:teuthology.orchestra.run.smithi187.stdout:License : GPLv3+ 2024-09-10T07:25:22.440 INFO:teuthology.orchestra.run.smithi187.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T07:25:22.440 INFO:teuthology.orchestra.run.smithi187.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T07:25:22.440 INFO:teuthology.orchestra.run.smithi187.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T07:25:22.440 INFO:teuthology.orchestra.run.smithi187.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T07:25:22.440 INFO:teuthology.orchestra.run.smithi187.stdout:Packager : builder@centos.org 2024-09-10T07:25:22.440 INFO:teuthology.orchestra.run.smithi187.stdout:Vendor : CentOS 2024-09-10T07:25:22.441 INFO:teuthology.orchestra.run.smithi187.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T07:25:22.441 INFO:teuthology.orchestra.run.smithi187.stdout:Summary : Support tools for GRUB. 2024-09-10T07:25:22.441 INFO:teuthology.orchestra.run.smithi187.stdout:Description : 2024-09-10T07:25:22.441 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:25:22.441 INFO:teuthology.orchestra.run.smithi187.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T07:25:22.441 INFO:teuthology.orchestra.run.smithi187.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T07:25:22.442 INFO:teuthology.orchestra.run.smithi187.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T07:25:22.442 INFO:teuthology.orchestra.run.smithi187.stdout:hardware devices. 2024-09-10T07:25:22.442 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:25:22.442 INFO:teuthology.orchestra.run.smithi187.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T07:25:22.444 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-09-10T07:25:22.445 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T07:25:22.445 INFO:teuthology.task.kernel:Updating grub on smithi187 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:22.445 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T07:25:23.012 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2024-09-10T07:25:24.433 INFO:teuthology.orchestra.run.smithi187.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T07:25:24.464 INFO:teuthology.orchestra.run.smithi187.stderr:done 2024-09-10T07:25:24.467 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-09-10T07:25:24.502 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.UMJWy7WQqm 2024-09-10T07:25:24.502 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UMJWy7WQqm 2024-09-10T07:25:24.569 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.UMJWy7WQqm 2024-09-10T07:25:24.709 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.UMJWy7WQqm is 6KB 2024-09-10T07:25:24.756 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.UMJWy7WQqm 2024-09-10T07:25:24.771 DEBUG:teuthology.orchestra.run.smithi187:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T07:25:24.833 INFO:teuthology.orchestra.run.smithi187.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T07:25:24.833 INFO:teuthology.orchestra.run.smithi187.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T07:25:24.833 INFO:teuthology.orchestra.run.smithi187.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T07:25:24.834 INFO:teuthology.orchestra.run.smithi187.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T07:25:24.835 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:25:25.007 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2024-09-10T07:25:52.469 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T07:25:52.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T07:25:52.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:25:55.013 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-10T07:25:55.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-10T07:25:55.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:26:27.134 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-10T07:26:36.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T07:26:36.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:26:54.525 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-10T07:26:55.016 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T07:27:04.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-10T07:27:04.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:27:04.857 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-10T07:27:05.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-10T07:27:05.405 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T07:27:05.406 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-09-10T07:27:05.441 INFO:teuthology.orchestra.run.smithi187.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:27:05.442 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:27:05.442 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T07:27:05.442 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T07:27:06.446 DEBUG:teuthology.parallel:result is None 2024-09-10T07:27:06.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T07:27:06.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:27:08.061 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-10T07:27:08.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T07:27:08.605 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T07:27:08.606 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-10T07:27:08.641 INFO:teuthology.orchestra.run.smithi099.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:27:08.641 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T07:27:08.641 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T07:27:08.641 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T07:27:09.642 DEBUG:teuthology.parallel:result is None 2024-09-10T07:27:09.643 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T07:27:09.651 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T07:27:09.651 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T07:27:09.655 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T07:27:09.691 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T07:27:09.702 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T07:27:09.708 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T07:27:09.708 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T07:27:09.732 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T07:27:09.776 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T07:27:09.783 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T07:27:09.783 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T07:27:09.815 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T07:27:09.961 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:27:09.985 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:27:09.986 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:27:10.012 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T07:27:10.019 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T07:27:10.019 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T07:27:10.024 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T07:27:10.080 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T07:27:10.089 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T07:27:10.090 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T07:27:10.094 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T07:27:10.130 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:27:10.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:27:10.333 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:27:10.395 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:27:10.469 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:27:10.469 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T07:27:10.540 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:27:10.602 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:27:10.688 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:27:10.752 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:27:10.828 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:27:10.828 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T07:27:10.920 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-09-10T07:27:10.924 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2024-09-10T07:27:11.015 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T07:27:11.015 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T07:27:11.360 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T07:27:11.368 INFO:teuthology.task.internal:Starting timer... 2024-09-10T07:27:11.368 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T07:27:11.445 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T07:27:11.454 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-10T07:27:11.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-09-10T07:27:11.558 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-09-10T07:27:11.561 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2024-09-10T07:27:11.637 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2024-09-10T07:27:11.640 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T07:27:11.641 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-09-10T07:27:11.695 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-09-10T07:27:11.695 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2024-09-10T07:27:11.736 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2024-09-10T07:27:11.736 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive'} 2024-09-10T07:27:11.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T07:27:11.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:27:11.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T07:27:11.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:27:11.852 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T07:27:11.852 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-09-10T07:27:11.949 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2024-09-10T07:27:12.010 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T07:27:12.019 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T07:27:12.023 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T07:27:12.131 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T07:27:12.141 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T07:27:12.143 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T07:31:51.315 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2024-09-10T07:31:51.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T07:31:51.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:31:51.404 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-10T07:31:51.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T07:31:51.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-10T07:31:51.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:31:51.609 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-10T07:31:51.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-10T07:31:51.719 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T07:31:51.731 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T07:31:51.731 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T07:31:51.732 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T07:31:51.736 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T07:31:51.736 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T07:31:51.791 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T07:31:51.820 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T07:31:51.821 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T07:31:51.850 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T07:31:51.872 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-09-10T07:31:51.896 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-09-10T07:31:51.902 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2024-09-10T07:31:51.925 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T07:31:51.926 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2024-09-10T07:31:51.955 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T07:31:51.955 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T07:31:51.985 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T07:31:52.054 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-10T07:31:52.061 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T07:31:52.061 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-10T07:31:52.061 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:31:52.061 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:31:52.061 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:31:52.061 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:31:52.076 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: ntpq: command not found 2024-09-10T07:31:52.082 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T07:31:52.082 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2024-09-10T07:31:52.082 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:31:52.082 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:31:52.082 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:31:52.083 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:31:52.084 INFO:teuthology.run_tasks:Running task install... 2024-09-10T07:31:52.092 DEBUG:teuthology.task.install:project ceph 2024-09-10T07:31:52.092 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T07:31:52.092 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T07:31:52.092 INFO:teuthology.task.install:Using flavor: default 2024-09-10T07:31:52.098 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T07:31:52.098 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T07:31:52.099 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T07:31:52.099 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:31:52.102 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T07:31:52.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:31:52.260 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T07:31:52.260 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T07:31:52.264 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T07:31:52.265 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T07:31:52.373 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T07:31:52.373 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:31:52.373 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T07:31:52.381 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T07:31:52.381 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:31:52.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T07:31:52.430 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T07:31:52.431 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T07:31:52.437 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T07:31:52.437 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T07:31:52.528 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T07:31:52.533 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T07:31:52.607 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T07:31:52.612 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T07:31:52.662 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2024-09-10T07:31:52.665 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2024-09-10T07:31:52.668 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-09-10T07:31:52.671 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-09-10T07:31:52.931 INFO:teuthology.orchestra.run.smithi187.stdout:45 files removed 2024-09-10T07:31:52.940 INFO:teuthology.orchestra.run.smithi099.stdout:45 files removed 2024-09-10T07:31:52.963 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T07:31:52.972 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T07:31:53.647 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 288 kB/s | 84 kB 00:00 2024-09-10T07:31:53.677 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 267 kB/s | 84 kB 00:00 2024-09-10T07:31:53.939 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-10T07:31:53.969 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-10T07:31:54.223 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-10T07:31:54.270 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 7.2 kB/s | 1.9 kB 00:00 2024-09-10T07:31:54.820 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-10T07:31:55.957 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-10T07:31:56.679 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-10T07:31:58.083 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-10T07:32:02.625 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-10T07:32:03.263 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-10T07:32:04.442 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-10T07:32:04.905 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-10T07:32:05.605 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-10T07:32:06.217 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-10T07:32:11.894 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-10T07:32:12.573 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-09-10T07:32:14.427 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:32:14.428 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:32:14.439 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T07:32:14.440 INFO:teuthology.orchestra.run.smithi187.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T07:32:14.441 INFO:teuthology.orchestra.run.smithi187.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T07:32:14.442 INFO:teuthology.orchestra.run.smithi187.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T07:32:14.444 INFO:teuthology.orchestra.run.smithi187.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T07:32:14.446 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T07:32:14.447 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T07:32:14.511 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-10T07:32:14.528 INFO:teuthology.orchestra.run.smithi187.stdout:====================================================================================== 2024-09-10T07:32:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-10T07:32:14.528 INFO:teuthology.orchestra.run.smithi187.stdout:====================================================================================== 2024-09-10T07:32:14.528 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-10T07:32:14.528 INFO:teuthology.orchestra.run.smithi187.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T07:32:14.529 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T07:32:14.530 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T07:32:14.531 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T07:32:14.532 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T07:32:14.533 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T07:32:14.534 INFO:teuthology.orchestra.run.smithi187.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T07:32:14.535 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T07:32:14.536 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T07:32:14.537 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T07:32:14.538 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T07:32:14.539 INFO:teuthology.orchestra.run.smithi187.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T07:32:14.540 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T07:32:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T07:32:14.541 INFO:teuthology.orchestra.run.smithi187.stdout:Installing weak dependencies: 2024-09-10T07:32:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T07:32:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:32:14.541 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-10T07:32:14.541 INFO:teuthology.orchestra.run.smithi187.stdout:====================================================================================== 2024-09-10T07:32:14.541 INFO:teuthology.orchestra.run.smithi187.stdout:Install 148 Packages 2024-09-10T07:32:14.541 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 8 Packages 2024-09-10T07:32:14.541 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:32:14.542 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 226 M 2024-09-10T07:32:14.542 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-10T07:32:15.086 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:32:15.086 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:32:15.098 INFO:teuthology.orchestra.run.smithi099.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T07:32:15.099 INFO:teuthology.orchestra.run.smithi099.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T07:32:15.100 INFO:teuthology.orchestra.run.smithi099.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T07:32:15.101 INFO:teuthology.orchestra.run.smithi099.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T07:32:15.103 INFO:teuthology.orchestra.run.smithi099.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T07:32:15.105 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T07:32:15.106 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T07:32:15.129 INFO:teuthology.orchestra.run.smithi187.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 46 kB/s | 6.5 kB 00:00 2024-09-10T07:32:15.171 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-10T07:32:15.200 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T07:32:15.201 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T07:32:15.202 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T07:32:15.203 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T07:32:15.204 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T07:32:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T07:32:15.206 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T07:32:15.207 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T07:32:15.208 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T07:32:15.209 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T07:32:15.210 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T07:32:15.211 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T07:32:15.212 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-10T07:32:15.213 INFO:teuthology.orchestra.run.smithi099.stdout:Install 148 Packages 2024-09-10T07:32:15.214 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 8 Packages 2024-09-10T07:32:15.214 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:32:15.214 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 226 M 2024-09-10T07:32:15.214 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-10T07:32:15.304 INFO:teuthology.orchestra.run.smithi187.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 5.0 MB/s | 897 kB 00:00 2024-09-10T07:32:15.446 INFO:teuthology.orchestra.run.smithi187.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.0 MB/s | 145 kB 00:00 2024-09-10T07:32:15.521 INFO:teuthology.orchestra.run.smithi187.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-10T07:32:15.597 INFO:teuthology.orchestra.run.smithi187.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 20 MB/s | 1.5 MB 00:00 2024-09-10T07:32:15.641 INFO:teuthology.orchestra.run.smithi099.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 35 kB/s | 6.5 kB 00:00 2024-09-10T07:32:15.655 INFO:teuthology.orchestra.run.smithi187.stdout:(6/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-10T07:32:15.897 INFO:teuthology.orchestra.run.smithi187.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-09-10T07:32:16.241 INFO:teuthology.orchestra.run.smithi099.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.5 MB/s | 897 kB 00:00 2024-09-10T07:32:16.256 INFO:teuthology.orchestra.run.smithi187.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 17 MB/s | 21 MB 00:01 2024-09-10T07:32:16.306 INFO:teuthology.orchestra.run.smithi187.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 505 kB/s | 25 kB 00:00 2024-09-10T07:32:16.325 INFO:teuthology.orchestra.run.smithi099.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.7 MB/s | 145 kB 00:00 2024-09-10T07:32:16.698 INFO:teuthology.orchestra.run.smithi187.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 13 MB/s | 11 MB 00:00 2024-09-10T07:32:16.873 INFO:teuthology.orchestra.run.smithi187.stdout:(11/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 14 MB/s | 17 MB 00:01 2024-09-10T07:32:16.898 INFO:teuthology.orchestra.run.smithi187.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.1 MB/s | 228 kB 00:00 2024-09-10T07:32:16.900 INFO:teuthology.orchestra.run.smithi099.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 3.7 MB/s | 5.4 MB 00:01 2024-09-10T07:32:16.924 INFO:teuthology.orchestra.run.smithi187.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 540 kB/s | 27 kB 00:00 2024-09-10T07:32:16.949 INFO:teuthology.orchestra.run.smithi187.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 631 kB/s | 32 kB 00:00 2024-09-10T07:32:16.950 INFO:teuthology.orchestra.run.smithi099.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 3.8 MB/s | 2.4 MB 00:00 2024-09-10T07:32:16.999 INFO:teuthology.orchestra.run.smithi187.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 3.2 MB/s | 164 kB 00:00 2024-09-10T07:32:17.025 INFO:teuthology.orchestra.run.smithi187.stdout:(16/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 7.3 MB/s | 751 kB 00:00 2024-09-10T07:32:17.067 INFO:teuthology.orchestra.run.smithi187.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 1.9 MB/s | 127 kB 00:00 2024-09-10T07:32:17.117 INFO:teuthology.orchestra.run.smithi187.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 5.4 MB/s | 506 kB 00:00 2024-09-10T07:32:17.150 INFO:teuthology.orchestra.run.smithi099.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 6.1 MB/s | 1.5 MB 00:00 2024-09-10T07:32:17.192 INFO:teuthology.orchestra.run.smithi187.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 602 kB/s | 45 kB 00:00 2024-09-10T07:32:17.284 INFO:teuthology.orchestra.run.smithi187.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.4 MB/s | 136 kB 00:00 2024-09-10T07:32:17.376 INFO:teuthology.orchestra.run.smithi187.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.7 MB/s | 161 kB 00:00 2024-09-10T07:32:17.529 INFO:teuthology.orchestra.run.smithi187.stdout:(22/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-10T07:32:17.562 INFO:teuthology.orchestra.run.smithi187.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 1.7 MB/s | 320 kB 00:00 2024-09-10T07:32:17.621 INFO:teuthology.orchestra.run.smithi187.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 3.2 MB/s | 301 kB 00:00 2024-09-10T07:32:17.646 INFO:teuthology.orchestra.run.smithi187.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.2 MB/s | 99 kB 00:00 2024-09-10T07:32:17.696 INFO:teuthology.orchestra.run.smithi187.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-10T07:32:17.788 INFO:teuthology.orchestra.run.smithi187.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 1.8 MB/s | 170 kB 00:00 2024-09-10T07:32:17.792 INFO:teuthology.orchestra.run.smithi099.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 5.6 MB/s | 4.7 MB 00:00 2024-09-10T07:32:17.872 INFO:teuthology.orchestra.run.smithi187.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 381 kB/s | 32 kB 00:00 2024-09-10T07:32:17.930 INFO:teuthology.orchestra.run.smithi187.stdout:(29/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-10T07:32:17.956 INFO:teuthology.orchestra.run.smithi187.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.7 MB/s | 146 kB 00:00 2024-09-10T07:32:18.304 INFO:teuthology.orchestra.run.smithi187.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 9.5 MB/s | 3.6 MB 00:00 2024-09-10T07:32:18.365 INFO:teuthology.orchestra.run.smithi187.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 4.0 MB/s | 249 kB 00:00 2024-09-10T07:32:18.431 INFO:teuthology.orchestra.run.smithi187.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 742 kB/s | 49 kB 00:00 2024-09-10T07:32:18.484 INFO:teuthology.orchestra.run.smithi099.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 7.0 MB/s | 21 MB 00:03 2024-09-10T07:32:18.490 INFO:teuthology.orchestra.run.smithi187.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 282 kB/s | 16 kB 00:00 2024-09-10T07:32:18.574 INFO:teuthology.orchestra.run.smithi187.stdout:(35/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 3.3 MB/s | 285 kB 00:00 2024-09-10T07:32:18.576 INFO:teuthology.orchestra.run.smithi099.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 274 kB/s | 25 kB 00:00 2024-09-10T07:32:18.674 INFO:teuthology.orchestra.run.smithi187.stdout:(36/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 7.5 MB/s | 766 kB 00:00 2024-09-10T07:32:18.766 INFO:teuthology.orchestra.run.smithi187.stdout:(37/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 200 kB/s | 18 kB 00:00 2024-09-10T07:32:18.891 INFO:teuthology.orchestra.run.smithi187.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 7.9 MB/s | 7.4 MB 00:00 2024-09-10T07:32:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:(10/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 9.4 MB/s | 17 MB 00:01 2024-09-10T07:32:19.002 INFO:teuthology.orchestra.run.smithi099.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 4.5 MB/s | 228 kB 00:00 2024-09-10T07:32:19.085 INFO:teuthology.orchestra.run.smithi099.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 325 kB/s | 27 kB 00:00 2024-09-10T07:32:19.169 INFO:teuthology.orchestra.run.smithi099.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 380 kB/s | 32 kB 00:00 2024-09-10T07:32:19.319 INFO:teuthology.orchestra.run.smithi099.stdout:(14/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 6.9 MB/s | 11 MB 00:01 2024-09-10T07:32:19.361 INFO:teuthology.orchestra.run.smithi099.stdout:(15/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 3.8 MB/s | 751 kB 00:00 2024-09-10T07:32:19.387 INFO:teuthology.orchestra.run.smithi099.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.4 MB/s | 164 kB 00:00 2024-09-10T07:32:19.412 INFO:teuthology.orchestra.run.smithi099.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.5 MB/s | 127 kB 00:00 2024-09-10T07:32:19.425 INFO:teuthology.orchestra.run.smithi187.stdout:(39/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 16 MB/s | 49 MB 00:03 2024-09-10T07:32:19.450 INFO:teuthology.orchestra.run.smithi187.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 117 kB/s | 80 kB 00:00 2024-09-10T07:32:19.462 INFO:teuthology.orchestra.run.smithi099.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 6.6 MB/s | 506 kB 00:00 2024-09-10T07:32:19.571 INFO:teuthology.orchestra.run.smithi099.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 417 kB/s | 45 kB 00:00 2024-09-10T07:32:19.584 INFO:teuthology.orchestra.run.smithi187.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-10T07:32:19.609 INFO:teuthology.orchestra.run.smithi187.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-10T07:32:19.621 INFO:teuthology.orchestra.run.smithi099.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.7 MB/s | 136 kB 00:00 2024-09-10T07:32:19.643 INFO:teuthology.orchestra.run.smithi187.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 881 kB/s | 191 kB 00:00 2024-09-10T07:32:19.668 INFO:teuthology.orchestra.run.smithi187.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T07:32:19.688 INFO:teuthology.orchestra.run.smithi099.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.4 MB/s | 161 kB 00:00 2024-09-10T07:32:19.710 INFO:teuthology.orchestra.run.smithi187.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-10T07:32:19.735 INFO:teuthology.orchestra.run.smithi187.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-10T07:32:19.769 INFO:teuthology.orchestra.run.smithi187.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-10T07:32:19.794 INFO:teuthology.orchestra.run.smithi187.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-10T07:32:19.813 INFO:teuthology.orchestra.run.smithi099.stdout:(22/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-10T07:32:19.838 INFO:teuthology.orchestra.run.smithi099.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 2.1 MB/s | 320 kB 00:00 2024-09-10T07:32:19.872 INFO:teuthology.orchestra.run.smithi099.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 5.0 MB/s | 301 kB 00:00 2024-09-10T07:32:19.897 INFO:teuthology.orchestra.run.smithi099.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T07:32:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-10T07:32:19.990 INFO:teuthology.orchestra.run.smithi099.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-10T07:32:20.073 INFO:teuthology.orchestra.run.smithi099.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 383 kB/s | 32 kB 00:00 2024-09-10T07:32:20.132 INFO:teuthology.orchestra.run.smithi099.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.4 MB/s | 146 kB 00:00 2024-09-10T07:32:20.219 INFO:teuthology.orchestra.run.smithi187.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 251 kB/s | 107 kB 00:00 2024-09-10T07:32:20.224 INFO:teuthology.orchestra.run.smithi099.stdout:(30/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 9.5 MB/s | 3.1 MB 00:00 2024-09-10T07:32:20.328 INFO:teuthology.orchestra.run.smithi187.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-10T07:32:20.407 INFO:teuthology.orchestra.run.smithi099.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 13 MB/s | 3.6 MB 00:00 2024-09-10T07:32:20.437 INFO:teuthology.orchestra.run.smithi187.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 983 kB/s | 689 kB 00:00 2024-09-10T07:32:20.466 INFO:teuthology.orchestra.run.smithi099.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 4.2 MB/s | 249 kB 00:00 2024-09-10T07:32:20.529 INFO:teuthology.orchestra.run.smithi187.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-09-10T07:32:20.541 INFO:teuthology.orchestra.run.smithi099.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 657 kB/s | 49 kB 00:00 2024-09-10T07:32:20.554 INFO:teuthology.orchestra.run.smithi187.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-10T07:32:20.604 INFO:teuthology.orchestra.run.smithi187.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-10T07:32:20.617 INFO:teuthology.orchestra.run.smithi099.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 220 kB/s | 16 kB 00:00 2024-09-10T07:32:20.654 INFO:teuthology.orchestra.run.smithi187.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-09-10T07:32:20.683 INFO:teuthology.orchestra.run.smithi099.stdout:(35/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 4.2 MB/s | 285 kB 00:00 2024-09-10T07:32:20.705 INFO:teuthology.orchestra.run.smithi187.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-10T07:32:20.772 INFO:teuthology.orchestra.run.smithi187.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-10T07:32:20.792 INFO:teuthology.orchestra.run.smithi099.stdout:(36/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 6.9 MB/s | 766 kB 00:00 2024-09-10T07:32:20.814 INFO:teuthology.orchestra.run.smithi187.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-10T07:32:20.926 INFO:teuthology.orchestra.run.smithi099.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-10T07:32:20.968 INFO:teuthology.orchestra.run.smithi099.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 104 kB/s | 18 kB 00:00 2024-09-10T07:32:21.122 INFO:teuthology.orchestra.run.smithi187.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 1.8 MB/s | 581 kB 00:00 2024-09-10T07:32:21.214 INFO:teuthology.orchestra.run.smithi187.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 1.5 MB/s | 662 kB 00:00 2024-09-10T07:32:21.231 INFO:teuthology.orchestra.run.smithi187.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-10T07:32:21.307 INFO:teuthology.orchestra.run.smithi187.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-09-10T07:32:21.340 INFO:teuthology.orchestra.run.smithi187.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-10T07:32:21.407 INFO:teuthology.orchestra.run.smithi187.stdout:(64/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2024-09-10T07:32:21.440 INFO:teuthology.orchestra.run.smithi187.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-10T07:32:21.460 INFO:teuthology.orchestra.run.smithi099.stdout:(39/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 17 MB/s | 49 MB 00:02 2024-09-10T07:32:21.465 INFO:teuthology.orchestra.run.smithi187.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 307 kB/s | 38 kB 00:00 2024-09-10T07:32:22.010 INFO:teuthology.orchestra.run.smithi099.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 74 kB/s | 80 kB 00:01 2024-09-10T07:32:22.177 INFO:teuthology.orchestra.run.smithi099.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 267 kB/s | 191 kB 00:00 2024-09-10T07:32:22.286 INFO:teuthology.orchestra.run.smithi099.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 608 kB/s | 801 kB 00:01 2024-09-10T07:32:22.836 INFO:teuthology.orchestra.run.smithi099.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 307 kB/s | 253 kB 00:00 2024-09-10T07:32:22.953 INFO:teuthology.orchestra.run.smithi099.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-10T07:32:23.228 INFO:teuthology.orchestra.run.smithi099.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-09-10T07:32:23.562 INFO:teuthology.orchestra.run.smithi099.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 186 kB/s | 135 kB 00:00 2024-09-10T07:32:23.607 INFO:teuthology.orchestra.run.smithi187.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.2 MB/s | 4.9 MB 00:02 2024-09-10T07:32:23.645 INFO:teuthology.orchestra.run.smithi099.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 180 kB/s | 125 kB 00:00 2024-09-10T07:32:23.674 INFO:teuthology.orchestra.run.smithi187.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-10T07:32:23.716 INFO:teuthology.orchestra.run.smithi187.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 722 kB/s | 1.6 MB 00:02 2024-09-10T07:32:23.771 INFO:teuthology.orchestra.run.smithi099.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.3 MB/s | 689 kB 00:00 2024-09-10T07:32:23.783 INFO:teuthology.orchestra.run.smithi187.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-10T07:32:23.821 INFO:teuthology.orchestra.run.smithi099.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-10T07:32:23.879 INFO:teuthology.orchestra.run.smithi099.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 374 kB/s | 22 kB 00:00 2024-09-10T07:32:23.938 INFO:teuthology.orchestra.run.smithi099.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-10T07:32:23.963 INFO:teuthology.orchestra.run.smithi099.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-10T07:32:24.005 INFO:teuthology.orchestra.run.smithi099.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-10T07:32:24.039 INFO:teuthology.orchestra.run.smithi099.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 548 kB/s | 18 kB 00:00 2024-09-10T07:32:24.064 INFO:teuthology.orchestra.run.smithi099.stdout:(55/156): python3-urllib3-1.26.5-6.el9.noarch.r 257 kB/s | 215 kB 00:00 2024-09-10T07:32:24.089 INFO:teuthology.orchestra.run.smithi099.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-10T07:32:24.115 INFO:teuthology.orchestra.run.smithi099.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-10T07:32:24.173 INFO:teuthology.orchestra.run.smithi099.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-10T07:32:24.207 INFO:teuthology.orchestra.run.smithi099.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-09-10T07:32:24.232 INFO:teuthology.orchestra.run.smithi099.stdout:(60/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 318 kB/s | 45 kB 00:00 2024-09-10T07:32:24.257 INFO:teuthology.orchestra.run.smithi099.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-10T07:32:24.259 INFO:teuthology.orchestra.run.smithi187.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.1 MB/s | 1.0 MB 00:00 2024-09-10T07:32:24.299 INFO:teuthology.orchestra.run.smithi099.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-10T07:32:24.349 INFO:teuthology.orchestra.run.smithi099.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-10T07:32:24.367 INFO:teuthology.orchestra.run.smithi187.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 809 kB/s | 87 kB 00:00 2024-09-10T07:32:24.374 INFO:teuthology.orchestra.run.smithi099.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-10T07:32:24.408 INFO:teuthology.orchestra.run.smithi099.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-10T07:32:24.434 INFO:teuthology.orchestra.run.smithi099.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 458 kB/s | 38 kB 00:00 2024-09-10T07:32:24.551 INFO:teuthology.orchestra.run.smithi099.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 28 MB/s | 4.9 MB 00:00 2024-09-10T07:32:24.635 INFO:teuthology.orchestra.run.smithi099.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-10T07:32:24.676 INFO:teuthology.orchestra.run.smithi099.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-10T07:32:24.693 INFO:teuthology.orchestra.run.smithi099.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T07:32:24.752 INFO:teuthology.orchestra.run.smithi099.stdout:(71/156): postgresql-13.16-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-10T07:32:24.794 INFO:teuthology.orchestra.run.smithi099.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-10T07:32:24.819 INFO:teuthology.orchestra.run.smithi099.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T07:32:24.894 INFO:teuthology.orchestra.run.smithi099.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 817 kB/s | 61 kB 00:00 2024-09-10T07:32:24.918 INFO:teuthology.orchestra.run.smithi187.stdout:(73/156): postgresql-contrib-13.16-1.el9.x86_64 695 kB/s | 910 kB 00:01 2024-09-10T07:32:25.003 INFO:teuthology.orchestra.run.smithi099.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 18 MB/s | 5.8 MB 00:00 2024-09-10T07:32:25.026 INFO:teuthology.orchestra.run.smithi187.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 567 kB/s | 61 kB 00:00 2024-09-10T07:32:25.028 INFO:teuthology.orchestra.run.smithi099.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-10T07:32:25.053 INFO:teuthology.orchestra.run.smithi099.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-10T07:32:25.104 INFO:teuthology.orchestra.run.smithi099.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-10T07:32:25.171 INFO:teuthology.orchestra.run.smithi099.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-09-10T07:32:25.196 INFO:teuthology.orchestra.run.smithi099.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-10T07:32:25.246 INFO:teuthology.orchestra.run.smithi099.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 463 kB/s | 35 kB 00:00 2024-09-10T07:32:25.346 INFO:teuthology.orchestra.run.smithi099.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-09-10T07:32:25.372 INFO:teuthology.orchestra.run.smithi099.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-10T07:32:25.397 INFO:teuthology.orchestra.run.smithi099.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-10T07:32:25.409 INFO:teuthology.orchestra.run.smithi187.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 639 kB/s | 245 kB 00:00 2024-09-10T07:32:25.422 INFO:teuthology.orchestra.run.smithi099.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T07:32:25.464 INFO:teuthology.orchestra.run.smithi099.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 633 kB/s | 42 kB 00:00 2024-09-10T07:32:25.489 INFO:teuthology.orchestra.run.smithi099.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-10T07:32:25.515 INFO:teuthology.orchestra.run.smithi099.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-10T07:32:25.567 INFO:teuthology.orchestra.run.smithi099.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.5 MB/s | 279 kB 00:00 2024-09-10T07:32:25.616 INFO:teuthology.orchestra.run.smithi099.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-09-10T07:32:25.674 INFO:teuthology.orchestra.run.smithi099.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 502 kB/s | 54 kB 00:00 2024-09-10T07:32:25.716 INFO:teuthology.orchestra.run.smithi099.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-10T07:32:25.777 INFO:teuthology.orchestra.run.smithi187.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 677 kB/s | 248 kB 00:00 2024-09-10T07:32:25.817 INFO:teuthology.orchestra.run.smithi099.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.2 MB/s | 5.1 MB 00:00 2024-09-10T07:32:25.834 INFO:teuthology.orchestra.run.smithi099.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 378 kB/s | 44 kB 00:00 2024-09-10T07:32:25.867 INFO:teuthology.orchestra.run.smithi099.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T07:32:25.884 INFO:teuthology.orchestra.run.smithi099.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-10T07:32:25.885 INFO:teuthology.orchestra.run.smithi187.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-09-10T07:32:25.901 INFO:teuthology.orchestra.run.smithi099.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-10T07:32:25.935 INFO:teuthology.orchestra.run.smithi099.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-10T07:32:25.977 INFO:teuthology.orchestra.run.smithi099.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-09-10T07:32:25.994 INFO:teuthology.orchestra.run.smithi187.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-10T07:32:26.002 INFO:teuthology.orchestra.run.smithi099.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-10T07:32:26.019 INFO:teuthology.orchestra.run.smithi099.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-10T07:32:26.036 INFO:teuthology.orchestra.run.smithi099.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-10T07:32:26.086 INFO:teuthology.orchestra.run.smithi099.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 334 kB/s | 22 kB 00:00 2024-09-10T07:32:26.278 INFO:teuthology.orchestra.run.smithi187.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.1 MB/s | 6.0 MB 00:01 2024-09-10T07:32:26.303 INFO:teuthology.orchestra.run.smithi099.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-10T07:32:26.311 INFO:teuthology.orchestra.run.smithi187.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 543 kB/s | 172 kB 00:00 2024-09-10T07:32:26.345 INFO:teuthology.orchestra.run.smithi099.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-09-10T07:32:26.395 INFO:teuthology.orchestra.run.smithi187.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-09-10T07:32:26.403 INFO:teuthology.orchestra.run.smithi099.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 345 kB/s | 19 kB 00:00 2024-09-10T07:32:26.437 INFO:teuthology.orchestra.run.smithi099.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-10T07:32:26.479 INFO:teuthology.orchestra.run.smithi099.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.7 MB/s | 309 kB 00:00 2024-09-10T07:32:26.496 INFO:teuthology.orchestra.run.smithi099.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 3.2 MB/s | 49 kB 00:00 2024-09-10T07:32:26.513 INFO:teuthology.orchestra.run.smithi099.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-09-10T07:32:26.520 INFO:teuthology.orchestra.run.smithi187.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-10T07:32:26.538 INFO:teuthology.orchestra.run.smithi099.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-10T07:32:26.563 INFO:teuthology.orchestra.run.smithi099.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-10T07:32:26.605 INFO:teuthology.orchestra.run.smithi099.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-10T07:32:26.629 INFO:teuthology.orchestra.run.smithi187.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-10T07:32:26.630 INFO:teuthology.orchestra.run.smithi099.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-10T07:32:26.656 INFO:teuthology.orchestra.run.smithi099.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-09-10T07:32:26.681 INFO:teuthology.orchestra.run.smithi099.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-10T07:32:26.706 INFO:teuthology.orchestra.run.smithi099.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-10T07:32:26.729 INFO:teuthology.orchestra.run.smithi187.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 772 kB/s | 77 kB 00:00 2024-09-10T07:32:26.732 INFO:teuthology.orchestra.run.smithi099.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T07:32:26.790 INFO:teuthology.orchestra.run.smithi099.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-10T07:32:26.841 INFO:teuthology.orchestra.run.smithi099.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-10T07:32:26.854 INFO:teuthology.orchestra.run.smithi187.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 338 kB/s | 42 kB 00:00 2024-09-10T07:32:26.866 INFO:teuthology.orchestra.run.smithi099.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-10T07:32:26.900 INFO:teuthology.orchestra.run.smithi099.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T07:32:26.925 INFO:teuthology.orchestra.run.smithi099.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-10T07:32:26.959 INFO:teuthology.orchestra.run.smithi099.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 524 kB/s | 18 kB 00:00 2024-09-10T07:32:26.963 INFO:teuthology.orchestra.run.smithi187.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-10T07:32:26.984 INFO:teuthology.orchestra.run.smithi099.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 941 kB/s | 23 kB 00:00 2024-09-10T07:32:27.001 INFO:teuthology.orchestra.run.smithi099.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-10T07:32:27.018 INFO:teuthology.orchestra.run.smithi099.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.1 MB/s | 20 kB 00:00 2024-09-10T07:32:27.072 INFO:teuthology.orchestra.run.smithi187.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-10T07:32:27.093 INFO:teuthology.orchestra.run.smithi099.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-10T07:32:27.127 INFO:teuthology.orchestra.run.smithi099.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-09-10T07:32:27.144 INFO:teuthology.orchestra.run.smithi099.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 924 kB/s | 46 kB 00:00 2024-09-10T07:32:27.169 INFO:teuthology.orchestra.run.smithi099.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-09-10T07:32:27.188 INFO:teuthology.orchestra.run.smithi187.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-10T07:32:27.211 INFO:teuthology.orchestra.run.smithi099.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 858 kB/s | 58 kB 00:00 2024-09-10T07:32:27.278 INFO:teuthology.orchestra.run.smithi099.stdout:(133/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-09-10T07:32:27.295 INFO:teuthology.orchestra.run.smithi099.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 197 kB/s | 16 kB 00:00 2024-09-10T07:32:27.312 INFO:teuthology.orchestra.run.smithi099.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-10T07:32:27.322 INFO:teuthology.orchestra.run.smithi187.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 383 kB/s | 51 kB 00:00 2024-09-10T07:32:27.337 INFO:teuthology.orchestra.run.smithi099.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-10T07:32:27.354 INFO:teuthology.orchestra.run.smithi099.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 734 kB/s | 31 kB 00:00 2024-09-10T07:32:27.388 INFO:teuthology.orchestra.run.smithi099.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-09-10T07:32:27.405 INFO:teuthology.orchestra.run.smithi099.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T07:32:27.421 INFO:teuthology.orchestra.run.smithi099.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-10T07:32:27.447 INFO:teuthology.orchestra.run.smithi099.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-10T07:32:27.447 INFO:teuthology.orchestra.run.smithi187.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 429 kB/s | 54 kB 00:00 2024-09-10T07:32:27.472 INFO:teuthology.orchestra.run.smithi099.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-10T07:32:27.497 INFO:teuthology.orchestra.run.smithi099.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T07:32:27.531 INFO:teuthology.orchestra.run.smithi099.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-10T07:32:27.548 INFO:teuthology.orchestra.run.smithi099.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-10T07:32:27.573 INFO:teuthology.orchestra.run.smithi099.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-10T07:32:27.615 INFO:teuthology.orchestra.run.smithi099.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-10T07:32:27.665 INFO:teuthology.orchestra.run.smithi099.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T07:32:27.882 INFO:teuthology.orchestra.run.smithi099.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-10T07:32:27.941 INFO:teuthology.orchestra.run.smithi099.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 9.7 MB/s | 3.2 MB 00:00 2024-09-10T07:32:28.516 INFO:teuthology.orchestra.run.smithi099.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 71 kB/s | 41 kB 00:00 2024-09-10T07:32:28.792 INFO:teuthology.orchestra.run.smithi099.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 2.1 MB/s | 2.3 MB 00:01 2024-09-10T07:32:28.867 INFO:teuthology.orchestra.run.smithi099.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:00 2024-09-10T07:32:29.342 INFO:teuthology.orchestra.run.smithi099.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 301 kB/s | 249 kB 00:00 2024-09-10T07:32:29.826 INFO:teuthology.orchestra.run.smithi099.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-09-10T07:32:29.875 INFO:teuthology.orchestra.run.smithi099.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:01 2024-09-10T07:32:29.881 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:32:29.881 INFO:teuthology.orchestra.run.smithi099.stdout:Total 15 MB/s | 226 MB 00:14 2024-09-10T07:32:30.265 INFO:teuthology.orchestra.run.smithi187.stdout:(91/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.8 MB/s | 16 MB 00:02 2024-09-10T07:32:30.398 INFO:teuthology.orchestra.run.smithi187.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 314 kB/s | 42 kB 00:00 2024-09-10T07:32:30.532 INFO:teuthology.orchestra.run.smithi187.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 331 kB/s | 44 kB 00:00 2024-09-10T07:32:30.640 INFO:teuthology.orchestra.run.smithi187.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-10T07:32:30.766 INFO:teuthology.orchestra.run.smithi187.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 287 kB/s | 36 kB 00:00 2024-09-10T07:32:30.891 INFO:teuthology.orchestra.run.smithi187.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 380 kB/s | 47 kB 00:00 2024-09-10T07:32:31.008 INFO:teuthology.orchestra.run.smithi187.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-10T07:32:31.142 INFO:teuthology.orchestra.run.smithi187.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 433 kB/s | 58 kB 00:00 2024-09-10T07:32:31.250 INFO:teuthology.orchestra.run.smithi187.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 888 kB/s | 96 kB 00:00 2024-09-10T07:32:31.375 INFO:teuthology.orchestra.run.smithi187.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 509 kB/s | 64 kB 00:00 2024-09-10T07:32:31.501 INFO:teuthology.orchestra.run.smithi187.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 358 kB/s | 45 kB 00:00 2024-09-10T07:32:31.601 INFO:teuthology.orchestra.run.smithi187.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 224 kB/s | 22 kB 00:00 2024-09-10T07:32:31.685 INFO:teuthology.orchestra.run.smithi187.stdout:(103/156): postgresql-server-13.16-1.el9.x86_64 742 kB/s | 5.8 MB 00:07 2024-09-10T07:32:31.752 INFO:teuthology.orchestra.run.smithi187.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-10T07:32:31.785 INFO:teuthology.orchestra.run.smithi187.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-09-10T07:32:31.811 INFO:teuthology.orchestra.run.smithi187.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 5.2 MB/s | 309 kB 00:00 2024-09-10T07:32:31.861 INFO:teuthology.orchestra.run.smithi187.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2024-09-10T07:32:31.886 INFO:teuthology.orchestra.run.smithi187.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T07:32:31.911 INFO:teuthology.orchestra.run.smithi187.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T07:32:31.926 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-10T07:32:31.937 INFO:teuthology.orchestra.run.smithi187.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T07:32:31.962 INFO:teuthology.orchestra.run.smithi187.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-10T07:32:32.012 INFO:teuthology.orchestra.run.smithi187.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T07:32:32.071 INFO:teuthology.orchestra.run.smithi187.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-10T07:32:32.096 INFO:teuthology.orchestra.run.smithi187.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T07:32:32.106 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-10T07:32:32.106 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-10T07:32:32.130 INFO:teuthology.orchestra.run.smithi187.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 965 kB/s | 32 kB 00:00 2024-09-10T07:32:32.155 INFO:teuthology.orchestra.run.smithi187.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-10T07:32:32.180 INFO:teuthology.orchestra.run.smithi187.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-10T07:32:32.214 INFO:teuthology.orchestra.run.smithi187.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-10T07:32:32.273 INFO:teuthology.orchestra.run.smithi187.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 4.4 MB 00:00 2024-09-10T07:32:32.315 INFO:teuthology.orchestra.run.smithi187.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-09-10T07:32:32.340 INFO:teuthology.orchestra.run.smithi187.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-10T07:32:32.374 INFO:teuthology.orchestra.run.smithi187.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T07:32:32.407 INFO:teuthology.orchestra.run.smithi187.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 323 kB/s | 11 kB 00:00 2024-09-10T07:32:32.432 INFO:teuthology.orchestra.run.smithi187.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-10T07:32:32.460 INFO:teuthology.orchestra.run.smithi187.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-10T07:32:32.483 INFO:teuthology.orchestra.run.smithi187.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-10T07:32:32.508 INFO:teuthology.orchestra.run.smithi187.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-09-10T07:32:32.575 INFO:teuthology.orchestra.run.smithi187.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-09-10T07:32:32.609 INFO:teuthology.orchestra.run.smithi187.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-09-10T07:32:32.634 INFO:teuthology.orchestra.run.smithi187.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 791 kB/s | 46 kB 00:00 2024-09-10T07:32:32.659 INFO:teuthology.orchestra.run.smithi187.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-10T07:32:32.684 INFO:teuthology.orchestra.run.smithi187.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-10T07:32:32.710 INFO:teuthology.orchestra.run.smithi187.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 652 kB/s | 16 kB 00:00 2024-09-10T07:32:32.736 INFO:teuthology.orchestra.run.smithi187.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T07:32:32.761 INFO:teuthology.orchestra.run.smithi187.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-10T07:32:32.786 INFO:teuthology.orchestra.run.smithi187.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-10T07:32:32.803 INFO:teuthology.orchestra.run.smithi187.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 741 kB/s | 31 kB 00:00 2024-09-10T07:32:32.828 INFO:teuthology.orchestra.run.smithi187.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T07:32:32.845 INFO:teuthology.orchestra.run.smithi187.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-10T07:32:32.871 INFO:teuthology.orchestra.run.smithi187.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-10T07:32:32.896 INFO:teuthology.orchestra.run.smithi187.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T07:32:32.921 INFO:teuthology.orchestra.run.smithi187.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T07:32:32.947 INFO:teuthology.orchestra.run.smithi187.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T07:32:32.972 INFO:teuthology.orchestra.run.smithi187.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 808 kB/s | 20 kB 00:00 2024-09-10T07:32:33.015 INFO:teuthology.orchestra.run.smithi187.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 4.4 MB/s | 191 kB 00:00 2024-09-10T07:32:33.047 INFO:teuthology.orchestra.run.smithi187.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T07:32:33.106 INFO:teuthology.orchestra.run.smithi187.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 18 MB/s | 1.6 MB 00:00 2024-09-10T07:32:33.373 INFO:teuthology.orchestra.run.smithi187.stdout:(148/156): librados2-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-10T07:32:33.432 INFO:teuthology.orchestra.run.smithi187.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 9.7 MB/s | 3.2 MB 00:00 2024-09-10T07:32:33.690 INFO:teuthology.orchestra.run.smithi187.stdout:(150/156): python3-numpy-1.20.1-5.el9.x86_64.rp 707 kB/s | 5.1 MB 00:07 2024-09-10T07:32:34.049 INFO:teuthology.orchestra.run.smithi187.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 114 kB/s | 41 kB 00:00 2024-09-10T07:32:34.091 INFO:teuthology.orchestra.run.smithi187.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 2.7 MB/s | 1.8 MB 00:00 2024-09-10T07:32:34.158 INFO:teuthology.orchestra.run.smithi187.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 3.0 MB/s | 2.3 MB 00:00 2024-09-10T07:32:34.200 INFO:teuthology.orchestra.run.smithi187.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 1.6 MB/s | 249 kB 00:00 2024-09-10T07:32:34.554 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-10T07:32:34.555 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-10T07:32:34.784 INFO:teuthology.orchestra.run.smithi187.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 1.4 MB 00:00 2024-09-10T07:32:35.350 INFO:teuthology.orchestra.run.smithi187.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-10T07:32:35.355 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:32:35.355 INFO:teuthology.orchestra.run.smithi187.stdout:Total 11 MB/s | 226 MB 00:20 2024-09-10T07:32:37.418 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-10T07:32:37.597 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-10T07:32:37.597 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-10T07:32:39.959 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-10T07:32:39.959 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-10T07:32:41.222 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-10T07:32:41.413 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T07:32:41.622 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T07:32:41.838 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T07:32:41.882 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T07:32:41.914 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T07:32:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T07:32:42.358 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T07:32:42.456 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:32:42.600 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:32:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:32:42.745 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:32:42.779 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:32:42.983 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T07:32:43.067 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T07:32:43.095 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:32:43.194 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:32:43.220 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:32:43.301 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:32:43.329 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:32:43.372 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:32:43.614 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:32:43.850 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:32:44.061 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T07:32:44.198 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:32:44.296 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:32:44.580 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:32:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T07:32:44.844 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T07:32:44.885 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T07:32:44.929 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T07:32:45.012 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T07:32:45.082 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T07:32:45.121 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T07:32:45.175 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T07:32:45.214 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T07:32:45.247 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T07:32:45.336 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T07:32:45.433 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T07:32:45.468 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T07:32:45.514 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T07:32:45.594 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T07:32:45.630 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T07:32:45.677 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T07:32:45.710 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T07:32:45.798 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T07:32:45.854 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T07:32:45.944 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T07:32:46.104 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T07:32:46.165 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T07:32:46.574 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-10T07:32:46.738 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T07:32:46.819 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T07:32:46.915 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T07:32:47.003 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T07:32:47.022 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T07:32:47.070 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T07:32:47.109 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T07:32:47.111 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T07:32:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T07:32:47.161 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T07:32:47.180 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T07:32:47.239 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T07:32:47.342 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T07:32:47.437 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T07:32:47.488 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T07:32:47.571 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T07:32:47.598 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T07:32:47.612 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T07:32:47.648 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T07:32:47.715 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T07:32:47.745 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:32:47.756 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T07:32:47.801 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T07:32:47.859 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T07:32:47.924 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:32:47.956 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:32:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T07:32:48.076 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T07:32:48.103 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:32:48.118 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T07:32:48.143 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:32:48.237 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T07:32:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T07:32:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T07:32:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T07:32:48.364 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T07:32:48.384 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T07:32:48.425 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T07:32:48.452 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:32:48.511 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T07:32:48.629 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:32:48.659 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T07:32:48.662 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:32:48.701 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T07:32:48.729 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T07:32:48.746 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:32:48.767 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T07:32:48.796 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:32:48.812 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T07:32:48.841 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:32:48.852 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T07:32:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T07:32:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T07:32:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T07:32:48.999 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T07:32:49.049 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T07:32:49.107 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:32:49.138 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T07:32:49.207 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T07:32:49.244 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T07:32:49.305 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:32:49.366 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T07:32:49.445 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T07:32:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T07:32:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:32:49.673 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:32:49.965 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:32:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T07:32:50.246 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T07:32:50.294 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T07:32:50.326 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T07:32:50.337 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T07:32:50.383 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T07:32:50.419 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T07:32:50.425 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T07:32:50.490 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T07:32:50.537 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T07:32:50.548 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T07:32:50.600 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T07:32:50.616 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T07:32:50.639 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T07:32:50.686 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T07:32:50.698 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T07:32:50.782 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T07:32:50.786 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T07:32:50.827 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T07:32:50.849 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T07:32:50.885 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T07:32:50.931 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T07:32:51.015 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T07:32:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T07:32:51.080 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T07:32:51.099 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T07:32:51.133 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T07:32:51.169 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T07:32:51.192 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T07:32:51.248 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T07:32:51.305 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T07:32:51.394 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T07:32:51.563 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T07:32:51.640 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T07:32:51.988 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T07:32:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T07:32:52.272 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T07:32:52.366 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T07:32:52.428 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T07:32:52.479 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T07:32:52.517 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T07:32:52.570 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T07:32:52.753 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T07:32:52.821 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T07:32:52.888 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T07:32:52.981 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T07:32:53.021 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T07:32:53.058 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T07:32:53.116 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T07:32:53.157 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T07:32:53.202 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T07:32:53.252 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T07:32:53.421 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T07:32:53.477 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T07:32:53.528 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T07:32:53.645 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T07:32:53.682 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T07:32:53.697 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T07:32:53.739 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T07:32:53.769 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T07:32:53.794 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T07:32:53.909 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T07:32:54.070 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T07:32:54.110 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T07:32:54.136 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T07:32:54.146 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T07:32:54.173 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T07:32:54.186 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T07:32:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T07:32:54.230 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T07:32:54.291 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T07:32:54.332 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T07:32:54.366 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T07:32:54.399 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T07:32:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T07:32:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T07:32:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T07:32:54.576 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T07:32:54.594 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:32:54.634 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T07:32:54.670 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T07:32:54.705 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:32:54.750 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T07:32:54.798 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T07:32:54.799 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T07:32:54.874 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T07:32:55.312 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T07:32:55.346 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:32:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:32:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T07:32:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T07:32:55.802 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T07:32:55.835 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T07:32:55.951 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T07:32:56.026 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T07:32:56.080 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T07:32:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T07:32:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T07:32:56.446 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T07:32:56.475 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T07:32:56.574 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T07:32:57.368 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T07:32:57.504 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T07:32:57.943 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:32:57.987 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:32:58.611 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:32:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:32:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:32:58.872 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T07:32:58.872 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T07:32:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:32:58.916 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:32:59.070 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T07:32:59.172 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T07:32:59.207 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T07:32:59.241 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T07:32:59.576 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T07:32:59.619 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:32:59.731 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:32:59.767 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T07:32:59.815 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T07:33:00.327 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T07:33:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:33:00.513 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:33:00.548 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T07:33:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:33:03.296 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:33:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:33:03.983 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:33:04.115 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:33:04.116 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T07:33:04.116 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T07:33:04.116 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:04.167 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:33:11.666 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:33:11.666 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-09-10T07:33:11.666 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-09-10T07:33:11.666 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-09-10T07:33:11.666 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-09-10T07:33:11.666 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-09-10T07:33:11.666 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2024-09-10T07:33:11.666 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-09-10T07:33:11.667 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:11.877 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:33:11.919 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:33:11.919 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:11.919 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T07:33:11.919 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:13.511 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:33:13.569 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:33:13.569 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:13.569 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T07:33:13.569 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:33:13.570 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:33:13.570 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:13.845 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:33:13.896 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:33:13.896 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:13.896 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T07:33:13.896 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:33:13.896 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:33:13.896 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:14.379 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:33:14.430 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:33:14.430 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:14.430 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T07:33:14.430 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:33:14.431 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:33:14.431 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:14.562 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T07:33:14.622 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T07:33:14.712 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T07:33:14.934 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T07:33:15.000 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T07:33:15.118 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T07:33:15.218 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T07:33:15.390 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T07:33:15.447 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T07:33:15.506 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T07:33:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T07:33:16.113 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:33:16.147 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:33:16.188 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T07:33:16.256 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T07:33:16.303 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:33:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:33:16.766 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2024-09-10T07:33:16.766 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2024-09-10T07:33:16.766 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2024-09-10T07:33:16.766 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2024-09-10T07:33:16.766 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2024-09-10T07:33:16.766 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /root 2024-09-10T07:33:16.767 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2024-09-10T07:33:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:16.989 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:33:17.024 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:33:17.024 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:17.025 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T07:33:17.025 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:17.539 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:33:17.588 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:33:18.598 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:33:18.656 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:33:18.656 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:18.656 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T07:33:18.656 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:33:18.656 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:33:18.657 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:18.688 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:33:18.721 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:33:18.859 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:33:18.899 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:33:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:33:18.951 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:18.951 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T07:33:18.951 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:33:18.951 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:33:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:19.037 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T07:33:19.102 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:33:19.153 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:33:19.153 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:19.153 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T07:33:19.153 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:33:19.153 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:33:19.154 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:19.206 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:33:19.232 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:33:19.339 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T07:33:19.399 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T07:33:19.433 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T07:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:19.642 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T07:33:19.700 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T07:33:19.766 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T07:33:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T07:33:20.053 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T07:33:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T07:33:20.256 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T07:33:20.401 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T07:33:20.437 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T07:33:20.442 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:33:20.492 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:33:20.493 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:20.493 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T07:33:20.493 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:33:20.493 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:33:20.493 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:20.502 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T07:33:20.543 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:33:20.543 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T07:33:20.568 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T07:33:20.591 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:33:20.591 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:20.591 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T07:33:20.591 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:20.644 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:33:20.694 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:33:20.694 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:20.694 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T07:33:20.694 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:33:20.694 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:33:20.695 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:21.036 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:33:21.086 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:33:21.086 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:21.087 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T07:33:21.087 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:33:21.087 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:33:21.087 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:21.092 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:33:21.126 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:33:21.167 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T07:33:21.234 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T07:33:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:33:22.473 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:33:22.517 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:33:23.599 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:33:23.634 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:33:23.770 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:33:23.947 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T07:33:23.986 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:33:24.036 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:33:24.036 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:24.036 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T07:33:24.037 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:33:24.037 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:33:24.037 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:24.103 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:33:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:33:24.235 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T07:33:24.301 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T07:33:25.308 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T07:33:25.347 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:33:25.398 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:33:25.398 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:25.398 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T07:33:25.398 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:33:25.399 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:33:25.399 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:25.448 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:33:25.498 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:33:25.498 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:25.499 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T07:33:25.499 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:25.548 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:33:25.598 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:33:25.598 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:25.598 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T07:33:25.598 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:33:25.598 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:33:25.598 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:25.932 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:33:25.983 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:33:25.983 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:33:25.983 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T07:33:25.983 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:33:25.983 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:33:25.983 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:26.057 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T07:33:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T07:33:26.142 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T07:33:26.180 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T07:33:26.215 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T07:33:26.445 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T07:33:26.553 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T07:33:26.583 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T07:33:26.614 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T07:33:26.650 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T07:33:27.475 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:33:27.581 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:33:27.623 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:33:28.893 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T07:33:28.995 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T07:33:29.060 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T07:33:29.166 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T07:33:29.214 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T07:33:29.239 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T07:33:29.276 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T07:33:29.276 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:33:29.383 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:33:29.383 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:33:29.559 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:33:29.583 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T07:33:29.598 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:33:29.598 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:33:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:33:29.852 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:33:30.037 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:33:30.148 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:33:30.362 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:33:30.363 INFO:teuthology.orchestra.run.smithi099.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T07:33:30.363 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:30.929 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T07:33:30.971 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T07:33:31.014 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T07:33:31.043 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T07:33:31.079 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T07:33:31.334 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T07:33:31.384 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T07:33:31.414 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T07:33:31.445 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T07:33:31.498 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T07:33:32.263 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:33:32.321 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:33:32.364 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:33:33.644 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T07:33:33.743 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T07:33:33.795 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T07:33:33.911 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T07:33:33.945 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T07:33:33.979 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T07:33:34.015 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T07:33:34.016 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:33:34.131 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:33:34.131 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:33:34.249 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:33:34.273 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T07:33:34.288 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:33:34.289 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:33:34.550 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:33:34.550 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:33:34.643 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:33:34.717 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:33:34.912 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:33:34.912 INFO:teuthology.orchestra.run.smithi187.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T07:33:34.912 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:36.243 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T07:33:36.243 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T07:33:36.243 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T07:33:36.243 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T07:33:36.243 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T07:33:36.243 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T07:33:36.243 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T07:33:36.243 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:33:36.243 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T07:33:36.244 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T07:33:36.245 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T07:33:36.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T07:33:36.247 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T07:33:36.248 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T07:33:36.249 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T07:33:36.250 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T07:33:36.251 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T07:33:36.252 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T07:33:36.253 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T07:33:36.254 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T07:33:36.255 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T07:33:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:33:38.501 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T07:33:38.502 INFO:teuthology.orchestra.run.smithi099.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:38.503 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T07:33:38.504 INFO:teuthology.orchestra.run.smithi099.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.505 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T07:33:38.506 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T07:33:38.507 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.508 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T07:33:38.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T07:33:38.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T07:33:38.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T07:33:38.512 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T07:33:38.513 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T07:33:38.514 INFO:teuthology.orchestra.run.smithi099.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T07:33:38.514 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T07:33:38.514 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T07:33:38.514 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T07:33:38.514 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:38.514 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-10T07:33:39.084 DEBUG:teuthology.parallel:result is None 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:33:40.907 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T07:33:40.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T07:33:40.909 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T07:33:40.909 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T07:33:40.920 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T07:33:40.920 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T07:33:40.920 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T07:33:40.920 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T07:33:40.921 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T07:33:40.922 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T07:33:40.923 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T07:33:40.924 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T07:33:40.925 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T07:33:40.926 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T07:33:40.927 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T07:33:40.928 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T07:33:40.929 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T07:33:40.930 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T07:33:43.093 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:33:43.093 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:43.093 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2024-09-10T07:33:43.093 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T07:33:43.093 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T07:33:43.093 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T07:33:43.093 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T07:33:43.093 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.093 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.094 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:43.095 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T07:33:43.096 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T07:33:43.097 INFO:teuthology.orchestra.run.smithi187.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T07:33:43.098 INFO:teuthology.orchestra.run.smithi187.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T07:33:43.099 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T07:33:43.100 INFO:teuthology.orchestra.run.smithi187.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T07:33:43.101 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T07:33:43.102 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T07:33:43.104 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T07:33:43.104 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T07:33:43.104 INFO:teuthology.orchestra.run.smithi187.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T07:33:43.104 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T07:33:43.104 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T07:33:43.105 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T07:33:43.106 INFO:teuthology.orchestra.run.smithi187.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T07:33:43.107 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.107 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.107 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:33:43.107 INFO:teuthology.orchestra.run.smithi187.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T07:33:43.107 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T07:33:43.107 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T07:33:43.107 INFO:teuthology.orchestra.run.smithi187.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T07:33:43.107 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T07:33:43.107 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T07:33:43.108 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T07:33:43.108 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:43.108 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-10T07:33:43.730 DEBUG:teuthology.parallel:result is None 2024-09-10T07:33:43.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:33:43.881 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T07:33:43.932 INFO:teuthology.orchestra.run.smithi099.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T07:33:43.933 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T07:33:43.933 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T07:33:43.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:33:44.074 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T07:33:44.121 INFO:teuthology.orchestra.run.smithi187.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T07:33:44.121 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T07:33:44.121 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T07:33:44.123 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T07:33:44.123 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:44.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T07:33:44.187 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:44.187 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T07:33:44.247 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T07:33:44.247 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:44.248 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T07:33:44.304 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T07:33:44.400 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:44.400 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T07:33:44.456 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T07:33:44.553 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T07:33:44.553 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:44.554 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T07:33:44.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T07:33:44.703 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:44.704 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T07:33:44.766 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T07:33:44.863 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T07:33:44.863 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:44.863 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T07:33:44.918 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T07:33:45.013 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:45.014 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T07:33:45.070 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T07:33:45.167 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T07:33:45.253 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T07:33:45.253 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-09-10T07:33:45.257 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2024-09-10T07:33:45.315 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T07:33:45.315 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T07:33:45.319 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T07:33:45.375 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T07:33:45.375 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T07:33:45.379 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T07:33:45.443 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T07:33:45.443 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T07:33:45.443 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T07:33:45.443 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:45.443 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T07:33:45.477 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T07:33:45.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T07:33:45.696 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:45.696 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T07:33:45.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T07:33:45.896 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T07:33:45.958 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T07:33:45.958 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T07:33:45.959 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866', 'branch': 'wip-rishabh-testing-20240909.165402-squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7898866', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240909.165402-squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240909.165402-squid', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9893, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'sleep_before_teardown': 0, 'subset': '197/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240909.165402-squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPPC2a1nqcYoj002jU8wuuKXC0DJjNfM/CIiKQ4z1JyQYrtNhgHFYllnHct2fTf6B3uBpYB0gk5qkGXMrg7WWh0=', 'smithi187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdXCcqiT98bblNXKltK2RO1pr6sSPwAIU4iIkEr1cEJTCAyuNmRJXNmvAkg+8FrxTnF1AMYf3p6QyWe/TGcweo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_06:58:10', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T07:33:45.959 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T07:33:45.963 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T07:33:45.998 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T07:33:46.040 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T07:33:46.096 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:46.096 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T07:33:46.131 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T07:33:46.131 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-09-10T07:33:46.205 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T07:33:46.205 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:33:46.206 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-10T07:33:46.206 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:33:46.206 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:33:46.206 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-10 07:33:30.710055107 +0000 2024-09-10T07:33:46.206 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-10 07:31:25.154893229 +0000 2024-09-10T07:33:46.206 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-10 07:31:25.154893229 +0000 2024-09-10T07:33:46.206 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-10 07:31:25.154893229 +0000 2024-09-10T07:33:46.206 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T07:33:46.298 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-10T07:33:46.298 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-10T07:33:46.298 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000283607 s, 1.8 MB/s 2024-09-10T07:33:46.301 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T07:33:46.337 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-09-10T07:33:46.412 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T07:33:46.412 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:33:46.412 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-10T07:33:46.413 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:33:46.413 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:33:46.413 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-10 07:33:30.711055084 +0000 2024-09-10T07:33:46.413 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-10 07:31:25.587883232 +0000 2024-09-10T07:33:46.413 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-10 07:31:25.587883232 +0000 2024-09-10T07:33:46.413 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-10 07:31:25.587883232 +0000 2024-09-10T07:33:46.413 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T07:33:46.506 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-10T07:33:46.506 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-10T07:33:46.506 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000505109 s, 1.0 MB/s 2024-09-10T07:33:46.508 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T07:33:46.545 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-09-10T07:33:46.620 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T07:33:46.621 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:33:46.621 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-09-10T07:33:46.621 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:33:46.621 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:33:46.621 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-10 07:33:30.712055061 +0000 2024-09-10T07:33:46.621 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-10 07:31:26.081871827 +0000 2024-09-10T07:33:46.621 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-10 07:31:26.081871827 +0000 2024-09-10T07:33:46.621 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-10 07:31:26.081871827 +0000 2024-09-10T07:33:46.621 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T07:33:46.713 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-10T07:33:46.713 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-10T07:33:46.714 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000295425 s, 1.7 MB/s 2024-09-10T07:33:46.716 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T07:33:46.752 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-09-10T07:33:46.826 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T07:33:46.827 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:33:46.827 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-09-10T07:33:46.827 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:33:46.827 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:33:46.827 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-10 07:33:30.712055061 +0000 2024-09-10T07:33:46.827 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-10 07:31:26.556860861 +0000 2024-09-10T07:33:46.827 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-10 07:31:26.556860861 +0000 2024-09-10T07:33:46.827 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-10 07:31:26.556860861 +0000 2024-09-10T07:33:46.827 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T07:33:46.919 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-10T07:33:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-10T07:33:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000514717 s, 995 kB/s 2024-09-10T07:33:46.922 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T07:33:46.959 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T07:33:46.959 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:46.959 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T07:33:46.996 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T07:33:46.997 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2024-09-10T07:33:47.073 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T07:33:47.073 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:33:47.073 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 637 Links: 1 2024-09-10T07:33:47.073 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:33:47.073 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:33:47.073 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-10 07:33:35.272222943 +0000 2024-09-10T07:33:47.073 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-10 07:31:24.035320410 +0000 2024-09-10T07:33:47.073 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-10 07:31:24.035320410 +0000 2024-09-10T07:33:47.073 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-10 07:31:24.035320410 +0000 2024-09-10T07:33:47.074 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T07:33:47.166 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-10T07:33:47.166 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-10T07:33:47.166 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000288236 s, 1.8 MB/s 2024-09-10T07:33:47.169 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T07:33:47.205 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2024-09-10T07:33:47.281 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T07:33:47.281 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:33:47.281 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 656 Links: 1 2024-09-10T07:33:47.281 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:33:47.281 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:33:47.281 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-10 07:33:35.273222927 +0000 2024-09-10T07:33:47.281 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-10 07:31:24.509313180 +0000 2024-09-10T07:33:47.281 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-10 07:31:24.509313180 +0000 2024-09-10T07:33:47.281 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-10 07:31:24.509313180 +0000 2024-09-10T07:33:47.282 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T07:33:47.374 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-10T07:33:47.374 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-10T07:33:47.374 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000267041 s, 1.9 MB/s 2024-09-10T07:33:47.377 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T07:33:47.413 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2024-09-10T07:33:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T07:33:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:33:47.489 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-09-10T07:33:47.489 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:33:47.489 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:33:47.489 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-10 07:33:35.274222911 +0000 2024-09-10T07:33:47.489 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-10 07:31:24.973306101 +0000 2024-09-10T07:33:47.489 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-10 07:31:24.973306101 +0000 2024-09-10T07:33:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-10 07:31:24.973306101 +0000 2024-09-10T07:33:47.490 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T07:33:47.581 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-10T07:33:47.581 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-10T07:33:47.581 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000303683 s, 1.7 MB/s 2024-09-10T07:33:47.584 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T07:33:47.620 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2024-09-10T07:33:47.695 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T07:33:47.696 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T07:33:47.696 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 694 Links: 1 2024-09-10T07:33:47.696 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T07:33:47.696 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T07:33:47.696 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-10 07:33:35.275222895 +0000 2024-09-10T07:33:47.696 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-10 07:31:25.434299069 +0000 2024-09-10T07:33:47.696 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-10 07:31:25.434299069 +0000 2024-09-10T07:33:47.696 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-10 07:31:25.434299069 +0000 2024-09-10T07:33:47.697 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T07:33:47.787 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-10T07:33:47.788 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-10T07:33:47.788 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000262251 s, 2.0 MB/s 2024-09-10T07:33:47.790 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T07:33:47.827 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T07:33:47.828 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T07:33:47.828 INFO:tasks.ceph:Generating config... 2024-09-10T07:33:47.830 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-10T07:33:47.831 INFO:tasks.ceph:[client] debug client = 20 2024-09-10T07:33:47.831 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T07:33:47.831 INFO:tasks.ceph:[client] pid file = 2024-09-10T07:33:47.831 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-10T07:33:47.831 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-10T07:33:47.832 INFO:tasks.ceph:[client.0] debug client = 20 2024-09-10T07:33:47.832 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2024-09-10T07:33:47.832 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-10T07:33:47.832 INFO:tasks.ceph:[client.1] debug client = 20 2024-09-10T07:33:47.832 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2024-09-10T07:33:47.833 INFO:tasks.ceph:[client.1] debug objecter = 20 2024-09-10T07:33:47.833 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-10T07:33:47.833 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-10T07:33:47.833 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-10T07:33:47.833 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-10T07:33:47.834 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-10T07:33:47.834 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-10T07:33:47.834 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-10T07:33:47.834 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-10T07:33:47.834 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-10T07:33:47.835 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-10T07:33:47.835 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-10T07:33:47.835 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T07:33:47.835 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T07:33:47.835 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T07:33:47.835 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T07:33:47.836 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T07:33:47.836 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T07:33:47.836 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T07:33:47.836 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-10T07:33:47.837 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2024-09-10T07:33:47.837 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2024-09-10T07:33:47.837 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2024-09-10T07:33:47.837 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-10T07:33:47.837 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T07:33:47.837 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T07:33:47.838 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-10T07:33:47.838 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-10T07:33:47.838 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T07:33:47.838 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T07:33:47.838 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-10T07:33:47.838 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2024-09-10T07:33:47.839 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T07:33:47.839 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T07:33:47.839 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T07:33:47.839 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2024-09-10T07:33:47.839 INFO:tasks.ceph:[osd] osd mon report interval = 5 2024-09-10T07:33:47.839 INFO:tasks.ceph:[osd] osd objectstore = memstore 2024-09-10T07:33:47.840 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-10T07:33:47.840 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T07:33:47.840 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T07:33:47.933 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T07:33:47.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T07:33:48.026 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T07:33:48.152 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.99'), ('mon.b', '172.21.15.187'), ('mon.c', '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]')] 2024-09-10T07:33:48.153 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.99,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-10T07:33:48.154 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:48.154 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T07:33:48.189 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.99 --add b 172.21.15.187 --addv c '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:48.307 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:48.307 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: generated fsid d4ff4b75-2329-4b44-969c-780f31c4e94e 2024-09-10T07:33:48.307 INFO:teuthology.orchestra.run.smithi099.stdout:setting min_mon_release = quincy 2024-09-10T07:33:48.307 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 0 2024-09-10T07:33:48.307 INFO:teuthology.orchestra.run.smithi099.stdout:fsid d4ff4b75-2329-4b44-969c-780f31c4e94e 2024-09-10T07:33:48.307 INFO:teuthology.orchestra.run.smithi099.stdout:last_changed 2024-09-10T07:33:48.308623+0000 2024-09-10T07:33:48.307 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-10T07:33:48.308623+0000 2024-09-10T07:33:48.308 INFO:teuthology.orchestra.run.smithi099.stdout:min_mon_release 17 (quincy) 2024-09-10T07:33:48.308 INFO:teuthology.orchestra.run.smithi099.stdout:election_strategy: 1 2024-09-10T07:33:48.308 INFO:teuthology.orchestra.run.smithi099.stdout:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-10T07:33:48.308 INFO:teuthology.orchestra.run.smithi099.stdout:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-10T07:33:48.308 INFO:teuthology.orchestra.run.smithi099.stdout:2: [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] mon.c 2024-09-10T07:33:48.308 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T07:33:48.310 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T07:33:48.344 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d4ff4b75-2329-4b44-969c-780f31c4e94e... 2024-09-10T07:33:48.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T07:33:48.389 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T07:33:48.481 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-09-10T07:33:48.481 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-09-10T07:33:48.481 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T07:33:48.481 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-09-10T07:33:48.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.481 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-09-10T07:33:48.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T07:33:48.482 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.483 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.99,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on skipped message = False 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = d4ff4b75-2329-4b44-969c-780f31c4e94e 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-09-10T07:33:48.484 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2024-09-10T07:33:48.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-09-10T07:33:48.486 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 20 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 20 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 10 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: memstore device bytes = 200000000 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 1.0 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: osd mon report interval = 5 2024-09-10T07:33:48.487 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = memstore 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-09-10T07:33:48.488 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T07:33:48.489 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: mon down mkfs grace = 300 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: mon op complaint time = 120 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull ratio = 0.6 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.7 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.6 2024-09-10T07:33:48.490 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on pool no app = False 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: client mount timeout = 600 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = "" 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-09-10T07:33:48.491 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout: debug objectcacher = 20 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout: debug objecter = 20 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout: debug objectcacher = 20 2024-09-10T07:33:48.492 INFO:teuthology.orchestra.run.smithi099.stdout: debug objecter = 20 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout:[mds] 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds = 20 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds balancer = 20 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug frag = True 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug scatterstat = True 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout: mds op complaint time = 180 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout: mds verify scatter = True 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2024-09-10T07:33:48.493 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2024-09-10T07:33:48.494 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2024-09-10T07:33:48.495 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.99,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on skipped message = False 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = d4ff4b75-2329-4b44-969c-780f31c4e94e 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2024-09-10T07:33:48.497 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug trim objects = true 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 20 2024-09-10T07:33:48.499 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 20 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 10 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: memstore device bytes = 200000000 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 1.0 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: osd mon report interval = 5 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = memstore 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2024-09-10T07:33:48.500 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2024-09-10T07:33:48.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T07:33:48.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: mon down mkfs grace = 300 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: mon op complaint time = 120 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull ratio = 0.6 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.7 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.6 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on pool no app = False 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-10T07:33:48.503 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: client mount timeout = 600 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = "" 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2024-09-10T07:33:48.504 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout: debug objectcacher = 20 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout: debug objecter = 20 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout: debug objectcacher = 20 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout: debug objecter = 20 2024-09-10T07:33:48.505 INFO:teuthology.orchestra.run.smithi187.stdout:[mds] 2024-09-10T07:33:48.506 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds = 20 2024-09-10T07:33:48.506 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds balancer = 20 2024-09-10T07:33:48.506 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-10T07:33:48.506 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug frag = True 2024-09-10T07:33:48.506 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug scatterstat = True 2024-09-10T07:33:48.506 INFO:teuthology.orchestra.run.smithi187.stdout: mds op complaint time = 180 2024-09-10T07:33:48.506 INFO:teuthology.orchestra.run.smithi187.stdout: mds verify scatter = True 2024-09-10T07:33:48.506 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2024-09-10T07:33:48.506 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2024-09-10T07:33:48.506 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2024-09-10T07:33:48.514 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T07:33:48.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T07:33:48.611 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T07:33:48.611 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:48.611 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T07:33:48.646 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:48.646 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T07:33:48.721 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:33:48.721 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:48.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T07:33:48.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T07:33:48.839 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:48.839 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:48.913 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:33:48.914 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:48.914 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T07:33:48.914 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T07:33:48.991 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:48.991 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:49.065 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T07:33:49.065 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T07:33:49.065 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T07:33:49.168 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T07:33:49.174 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T07:33:49.317 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T07:33:49.324 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T07:33:49.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T07:33:49.427 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T07:33:49.432 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T07:33:49.488 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T07:33:49.591 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T07:33:49.596 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T07:33:49.651 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T07:33:49.753 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T07:33:49.758 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T07:33:49.814 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T07:33:49.917 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T07:33:49.922 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T07:33:49.978 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T07:33:49.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T07:33:50.060 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T07:33:50.087 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T07:33:50.167 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T07:33:50.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T07:33:50.274 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T07:33:50.302 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T07:33:50.382 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T07:33:50.410 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T07:33:50.410 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T07:33:50.411 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T07:33:50.466 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T07:33:50.466 INFO:tasks.ceph:role: osd.0 2024-09-10T07:33:50.466 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:33:50.466 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T07:33:50.528 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T07:33:50.528 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T07:33:50.529 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T07:33:50.529 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T07:33:50.529 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T07:33:50.529 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-10T07:33:50.529 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T07:33:50.529 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T07:33:50.529 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T07:33:50.529 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T07:33:50.944 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-10T07:33:50.948 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-10T07:33:50.948 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T07:33:51.091 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T07:33:51.158 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T07:33:51.215 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T07:33:51.215 INFO:tasks.ceph:role: osd.1 2024-09-10T07:33:51.215 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:33:51.215 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T07:33:51.279 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T07:33:51.279 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T07:33:51.279 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T07:33:51.279 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T07:33:51.279 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T07:33:51.279 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-10T07:33:51.279 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T07:33:51.279 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T07:33:51.279 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T07:33:51.279 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T07:33:51.645 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-10T07:33:51.648 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-10T07:33:51.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T07:33:51.734 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T07:33:51.799 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T07:33:51.857 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T07:33:51.857 INFO:tasks.ceph:role: osd.2 2024-09-10T07:33:51.857 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:33:51.858 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T07:33:51.920 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T07:33:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T07:33:51.920 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T07:33:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T07:33:51.921 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T07:33:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-10T07:33:51.921 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T07:33:51.921 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T07:33:51.921 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T07:33:51.921 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T07:33:52.310 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-10T07:33:52.315 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-10T07:33:52.315 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T07:33:52.408 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T07:33:52.470 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T07:33:52.525 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T07:33:52.526 INFO:tasks.ceph:role: osd.3 2024-09-10T07:33:52.526 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:33:52.526 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T07:33:52.589 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T07:33:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T07:33:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T07:33:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T07:33:52.590 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T07:33:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-10T07:33:52.590 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T07:33:52.590 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T07:33:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T07:33:52.590 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T07:33:52.985 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-10T07:33:52.990 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-10T07:33:52.990 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T07:33:53.107 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T07:33:53.170 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:53.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.273+0000 7f0b6bca5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T07:33:53.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.276+0000 7f0b6bca5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T07:33:53.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.285+0000 7f0b6bca5640 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2024-09-10T07:33:53.316 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T07:33:53.372 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:53.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.462+0000 7ff71de0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T07:33:53.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.466+0000 7ff71de0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T07:33:53.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.476+0000 7ff71de0b640 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2024-09-10T07:33:53.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T07:33:53.552 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:53.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.642+0000 7f30eda13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T07:33:53.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.642+0000 7f30eda13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T07:33:53.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.644+0000 7f30eda13640 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2024-09-10T07:33:53.659 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T07:33:53.714 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:53.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.804+0000 7f6579431640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T07:33:53.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.804+0000 7f6579431640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T07:33:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:33:53.806+0000 7f6579431640 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2024-09-10T07:33:53.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T07:33:53.875 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T07:33:53.937 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T07:33:53.937 INFO:tasks.ceph:role: osd.4 2024-09-10T07:33:53.938 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:33:53.938 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T07:33:54.002 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T07:33:54.002 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T07:33:54.002 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T07:33:54.002 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T07:33:54.002 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T07:33:54.002 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-10T07:33:54.003 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T07:33:54.003 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T07:33:54.003 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T07:33:54.003 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T07:33:54.412 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-10T07:33:54.416 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-10T07:33:54.417 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T07:33:54.564 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T07:33:54.628 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T07:33:54.684 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T07:33:54.684 INFO:tasks.ceph:role: osd.5 2024-09-10T07:33:54.684 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:33:54.685 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T07:33:54.748 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T07:33:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T07:33:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T07:33:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T07:33:54.749 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T07:33:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-10T07:33:54.749 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T07:33:54.749 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T07:33:54.749 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T07:33:54.750 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T07:33:55.103 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-10T07:33:55.106 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-10T07:33:55.107 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T07:33:55.190 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T07:33:55.255 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T07:33:55.333 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T07:33:55.333 INFO:tasks.ceph:role: osd.6 2024-09-10T07:33:55.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:33:55.334 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T07:33:55.397 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T07:33:55.398 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T07:33:55.398 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T07:33:55.398 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T07:33:55.398 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T07:33:55.398 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-10T07:33:55.398 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T07:33:55.398 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T07:33:55.398 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T07:33:55.398 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T07:33:55.788 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-10T07:33:55.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-10T07:33:55.791 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T07:33:55.887 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T07:33:55.950 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T07:33:56.005 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T07:33:56.005 INFO:tasks.ceph:role: osd.7 2024-09-10T07:33:56.006 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:33:56.006 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T07:33:56.069 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T07:33:56.069 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T07:33:56.069 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T07:33:56.069 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T07:33:56.070 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T07:33:56.070 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-10T07:33:56.070 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T07:33:56.070 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T07:33:56.070 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T07:33:56.070 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T07:33:56.497 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-10T07:33:56.501 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-10T07:33:56.501 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T07:33:56.645 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T07:33:56.709 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:56.809 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:56.809+0000 7fc2d3151640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T07:33:56.810 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:56.811+0000 7fc2d3151640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T07:33:56.819 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:56.819+0000 7fc2d3151640 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2024-09-10T07:33:56.852 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T07:33:56.908 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:56.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:56.997+0000 7f79d5662640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T07:33:56.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:56.998+0000 7f79d5662640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T07:33:56.999 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:57.000+0000 7f79d5662640 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2024-09-10T07:33:57.013 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T07:33:57.070 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:57.159 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:57.159+0000 7f9cf8018640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T07:33:57.160 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:57.160+0000 7f9cf8018640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T07:33:57.161 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:57.161+0000 7f9cf8018640 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2024-09-10T07:33:57.177 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T07:33:57.234 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:33:57.324 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:57.324+0000 7f77cea0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T07:33:57.325 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:57.325+0000 7f77cea0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T07:33:57.327 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:33:57.327+0000 7f77cea0e640 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2024-09-10T07:33:57.340 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T07:33:57.396 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T07:33:57.396 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:57.396 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T07:33:57.459 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:57.459 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T07:33:57.559 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:57.559 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T07:33:57.656 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:57.657 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T07:33:57.752 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:57.752 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T07:33:57.848 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:57.848 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T07:33:57.944 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:57.944 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T07:33:58.039 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:58.039 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T07:33:58.099 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:58.099 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T07:33:58.194 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:58.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T07:33:58.290 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:58.290 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T07:33:58.386 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:58.387 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T07:33:58.482 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:58.482 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T07:33:58.576 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:58.576 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T07:33:58.672 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:58.672 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T07:33:58.708 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:33:58.709 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T07:33:58.785 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:58.785 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T07:33:58.821 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:33:58.821 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T07:33:58.895 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T07:33:58.895 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T07:33:58.899 DEBUG:teuthology.orchestra.run.smithi187:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T07:33:58.948 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.y] 2024-09-10T07:33:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw== 2024-09-10T07:33:58.948 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-09-10T07:33:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw== 2024-09-10T07:33:58.949 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2024-09-10T07:33:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw== 2024-09-10T07:33:58.949 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2024-09-10T07:33:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA== 2024-09-10T07:33:58.949 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2024-09-10T07:33:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A== 2024-09-10T07:33:58.949 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2024-09-10T07:33:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w== 2024-09-10T07:33:58.949 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA== 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q== 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ== 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw== 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.4] 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w== 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.5] 2024-09-10T07:33:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw== 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.6] 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw== 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.7] 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg== 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout:[client.2] 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A== 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ== 2024-09-10T07:33:58.951 INFO:teuthology.orchestra.run.smithi099.stdout:[client.3] 2024-09-10T07:33:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw== 2024-09-10T07:33:58.987 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.y] 2024-09-10T07:33:58.987 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw== 2024-09-10T07:33:58.987 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2024-09-10T07:33:58.987 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw== 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw== 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.0] 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA== 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.1] 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A== 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.2] 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w== 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.3] 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA== 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.x] 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q== 2024-09-10T07:33:58.988 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ== 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw== 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.4] 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w== 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.5] 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw== 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.6] 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw== 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.7] 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg== 2024-09-10T07:33:58.989 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2024-09-10T07:33:58.990 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:33:58.990 INFO:teuthology.orchestra.run.smithi187.stdout:[client.2] 2024-09-10T07:33:58.990 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A== 2024-09-10T07:33:58.990 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2024-09-10T07:33:58.990 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ== 2024-09-10T07:33:58.990 INFO:teuthology.orchestra.run.smithi187.stdout:[client.3] 2024-09-10T07:33:58.990 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw== 2024-09-10T07:33:58.991 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T07:33:58.998 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T07:33:59.125 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T07:33:59.129 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T07:33:59.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T07:33:59.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T07:33:59.328 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:33:59.332 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:33:59.425 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:33:59.430 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:33:59.523 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:33:59.527 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:33:59.620 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:33:59.624 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:33:59.717 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T07:33:59.721 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T07:33:59.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T07:33:59.818 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T07:33:59.914 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T07:33:59.918 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T07:34:00.013 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:34:00.017 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:34:00.111 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:34:00.115 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:34:00.209 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:34:00.214 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:34:00.309 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:34:00.313 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T07:34:00.406 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T07:34:00.410 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T07:34:00.506 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T07:34:00.510 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T07:34:00.606 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T07:34:00.610 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T07:34:00.707 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T07:34:00.711 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T07:34:00.806 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T07:34:00.807 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T07:34:00.862 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T07:34:00.970 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T07:34:01.025 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T07:34:01.081 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T07:34:01.190 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T07:34:01.249 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T07:34:01.304 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T07:34:01.410 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T07:34:01.466 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:34:01.470 DEBUG:teuthology.orchestra.run.smithi187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T07:34:01.504 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T07:34:01.505 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T07:34:01.505 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T07:34:01.546 INFO:tasks.ceph.mon.a:Started 2024-09-10T07:34:01.546 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T07:34:01.546 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T07:34:01.550 INFO:tasks.ceph.mon.b:Started 2024-09-10T07:34:01.550 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T07:34:01.550 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T07:34:01.554 INFO:tasks.ceph.mon.c:Started 2024-09-10T07:34:01.554 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T07:34:01.554 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T07:34:01.554 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T07:34:01.558 INFO:tasks.ceph.mgr.y:Started 2024-09-10T07:34:01.558 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T07:34:01.558 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T07:34:01.562 INFO:tasks.ceph.mgr.x:Started 2024-09-10T07:34:01.562 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T07:34:01.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T07:34:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.721+0000 7fc848a00640 1 Processor -- start 2024-09-10T07:34:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.721+0000 7fc848a00640 1 -- start start 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc848a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 0x7fc8440b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc848a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 0x7fc8440d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc848a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 0x7fc8440d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc848a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc8440d21a0 con 0x7fc8440d0a50 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc848a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fc8440d0080 con 0x7fc8441623c0 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc848a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc8440d3700 con 0x7fc8440d56b0 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc842800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 0x7fc8440d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc842800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 0x7fc8440d1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46046/0 (socket says 172.21.15.99:46046) 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc842800640 1 -- 172.21.15.99:0/969273944 learned_addr learned my addr 172.21.15.99:0/969273944 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc842800640 1 -- 172.21.15.99:0/969273944 >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 msgr2=0x7fc8440d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T07:34:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc842800640 1 -- 172.21.15.99:0/969273944 >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 msgr2=0x7fc8440d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc842800640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 0x7fc8440d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.722+0000 7fc842800640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 0x7fc8440d1470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.723+0000 7fc841400640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 0x7fc8440d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.723+0000 7fc841e00640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 0x7fc8440b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.723+0000 7fc841e00640 1 -- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 msgr2=0x7fc8440b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.723+0000 7fc841e00640 1 -- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 msgr2=0x7fc8440b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.723+0000 7fc841e00640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 0x7fc8440b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.723+0000 7fc841400640 1 -- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 msgr2=0x7fc8440d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.723+0000 7fc841400640 1 -- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 msgr2=0x7fc8440d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.723+0000 7fc841400640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 0x7fc8440d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.723+0000 7fc841e00640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 0x7fc8440b6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:34:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.723+0000 7fc841400640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 0x7fc8440d0510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:34:01.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.923+0000 7fc842800640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 0x7fc8440d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:01.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.923+0000 7fc842800640 1 -- 172.21.15.99:0/969273944 >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 msgr2=0x7fc8440d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T07:34:01.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.923+0000 7fc842800640 1 -- 172.21.15.99:0/969273944 >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 msgr2=0x7fc8440d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T07:34:01.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.923+0000 7fc842800640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 0x7fc8440d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:34:01.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.923+0000 7fc842800640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 0x7fc8440d1470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:34:01.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.924+0000 7fc841400640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 0x7fc8440d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:01.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.924+0000 7fc841e00640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 0x7fc8440b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:01.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.924+0000 7fc841400640 1 -- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 msgr2=0x7fc8440d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T07:34:01.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.924+0000 7fc841400640 1 -- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 msgr2=0x7fc8440d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T07:34:01.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.924+0000 7fc841400640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 0x7fc8440d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:34:01.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.924+0000 7fc841400640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 0x7fc8440d0510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:34:01.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.924+0000 7fc841e00640 1 -- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 msgr2=0x7fc8440b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T07:34:01.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.924+0000 7fc841e00640 1 -- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 msgr2=0x7fc8440b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T07:34:01.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.924+0000 7fc841e00640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 0x7fc8440b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T07:34:01.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:01.924+0000 7fc841e00640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 0x7fc8440b6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:34:02.048 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:02.048+0000 7f63d305c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:34:02.066 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:02.066+0000 7ff210e15040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:34:02.095 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:02.095+0000 7f63d305c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:34:02.116 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:02.116+0000 7ff210e15040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:34:02.263 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:02.263+0000 7f63d305c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:34:02.292 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:02.289+0000 7ff210e15040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:34:02.321 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:02.321+0000 7f63d305c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:34:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.324+0000 7fc842800640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.99:3300/0 conn(0x7fc8440d0a50 0x7fc8440d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.324+0000 7fc842800640 1 -- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 msgr2=0x7fc8440d0510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T07:34:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.324+0000 7fc842800640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 0x7fc8440d0510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.324+0000 7fc842800640 1 -- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 msgr2=0x7fc8440b6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T07:34:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.324+0000 7fc842800640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 0x7fc8440b6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.324+0000 7fc842800640 1 -- 172.21.15.99:0/969273944 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8440cfa70 con 0x7fc8440d0a50 2024-09-10T07:34:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.325+0000 7fc842800640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d0a50 0x7fc8440d1470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc84408daf0 tx=0x7fc83c02a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ceafea0fc3b5309 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.325+0000 7fc840a00640 1 -- 172.21.15.99:0/969273944 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0317e0 con 0x7fc8440d0a50 2024-09-10T07:34:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc840a00640 1 -- 172.21.15.99:0/969273944 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c037070 con 0x7fc8440d0a50 2024-09-10T07:34:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc840a00640 1 -- 172.21.15.99:0/969273944 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c031ba0 con 0x7fc8440d0a50 2024-09-10T07:34:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc848a00640 1 -- 172.21.15.99:0/969273944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d0a50 msgr2=0x7fc8440d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc848a00640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d0a50 0x7fc8440d1470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc84408daf0 tx=0x7fc83c02a9b0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc848a00640 1 -- 172.21.15.99:0/969273944 shutdown_connections 2024-09-10T07:34:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc848a00640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8440d56b0 0x7fc8440d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc848a00640 1 --2- 172.21.15.99:0/969273944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d0a50 0x7fc8440d1470 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc848a00640 1 --2- 172.21.15.99:0/969273944 >> v2:172.21.15.187:3300/0 conn(0x7fc8441623c0 0x7fc8440b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc848a00640 1 -- 172.21.15.99:0/969273944 >> 172.21.15.99:0/969273944 conn(0x7fc84409df30 msgr2=0x7fc8440d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc848a00640 1 -- 172.21.15.99:0/969273944 shutdown_connections 2024-09-10T07:34:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.326+0000 7fc848a00640 1 -- 172.21.15.99:0/969273944 wait complete. 2024-09-10T07:34:02.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.328+0000 7fc848a00640 1 Processor -- start 2024-09-10T07:34:02.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.328+0000 7fc848a00640 1 -- start start 2024-09-10T07:34:02.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.329+0000 7fc848a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d56b0 0x7fc8440c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:02.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.329+0000 7fc848a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8441623c0 0x7fc8440cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.329+0000 7fc848a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8440cd080 0x7fc8441f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.329+0000 7fc848a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc8441627a0 con 0x7fc8440d56b0 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.329+0000 7fc848a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc8440cfd10 con 0x7fc8440cd080 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.329+0000 7fc848a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc8440d3c80 con 0x7fc8441623c0 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.329+0000 7fc841e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d56b0 0x7fc8440c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.329+0000 7fc841e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d56b0 0x7fc8440c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46084/0 (socket says 172.21.15.99:46084) 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.329+0000 7fc841e00640 1 -- 172.21.15.99:0/1040573144 learned_addr learned my addr 172.21.15.99:0/1040573144 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc841400640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8441623c0 0x7fc8440cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc842800640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8440cd080 0x7fc8441f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc841e00640 1 -- 172.21.15.99:0/1040573144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8441623c0 msgr2=0x7fc8440cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:02.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc841e00640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8441623c0 0x7fc8440cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc841e00640 1 -- 172.21.15.99:0/1040573144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8440cd080 msgr2=0x7fc8441f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc841e00640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8440cd080 0x7fc8441f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc841e00640 1 -- 172.21.15.99:0/1040573144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8440cbfe0 con 0x7fc8440d56b0 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc841400640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8441623c0 0x7fc8440cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc842800640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8440cd080 0x7fc8441f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc841e00640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d56b0 0x7fc8440c9fd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc83400f580 tx=0x7fc83400fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc83a000640 1 -- 172.21.15.99:0/1040573144 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834019020 con 0x7fc8440d56b0 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc83a000640 1 -- 172.21.15.99:0/1040573144 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc834014870 con 0x7fc8440d56b0 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc848a00640 1 -- 172.21.15.99:0/1040573144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8440cc2c0 con 0x7fc8440d56b0 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc83a000640 1 -- 172.21.15.99:0/1040573144 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834014c60 con 0x7fc8440d56b0 2024-09-10T07:34:02.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.330+0000 7fc848a00640 1 -- 172.21.15.99:0/1040573144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8440cc880 con 0x7fc8440d56b0 2024-09-10T07:34:02.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.331+0000 7fc83a000640 1 -- 172.21.15.99:0/1040573144 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc83401c020 con 0x7fc8440d56b0 2024-09-10T07:34:02.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.331+0000 7fc83a000640 1 -- 172.21.15.99:0/1040573144 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc83401e400 con 0x7fc8440d56b0 2024-09-10T07:34:02.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.331+0000 7fc848a00640 1 -- 172.21.15.99:0/1040573144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8440d0510 con 0x7fc8440d56b0 2024-09-10T07:34:02.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.334+0000 7fc83a000640 1 -- 172.21.15.99:0/1040573144 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc834023020 con 0x7fc8440d56b0 2024-09-10T07:34:02.349 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:02.349+0000 7ff210e15040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:34:02.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.399+0000 7fc848a00640 1 -- 172.21.15.99:0/1040573144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc8440d2340 con 0x7fc8440d56b0 2024-09-10T07:34:02.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.401+0000 7fc83a000640 1 -- 172.21.15.99:0/1040573144 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fc834015410 con 0x7fc8440d56b0 2024-09-10T07:34:02.401 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-09-10T07:34:02.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.402+0000 7fc848a00640 1 -- 172.21.15.99:0/1040573144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d56b0 msgr2=0x7fc8440c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:02.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.402+0000 7fc848a00640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d56b0 0x7fc8440c9fd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc83400f580 tx=0x7fc83400fa40 comp rx=0 tx=0).stop 2024-09-10T07:34:02.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.402+0000 7fc848a00640 1 -- 172.21.15.99:0/1040573144 shutdown_connections 2024-09-10T07:34:02.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.402+0000 7fc848a00640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8440cd080 0x7fc8441f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.402+0000 7fc848a00640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8441623c0 0x7fc8440cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.402+0000 7fc848a00640 1 --2- 172.21.15.99:0/1040573144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8440d56b0 0x7fc8440c9fd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:02.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.402+0000 7fc848a00640 1 -- 172.21.15.99:0/1040573144 >> 172.21.15.99:0/1040573144 conn(0x7fc84409df30 msgr2=0x7fc8440b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:02.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.403+0000 7fc848a00640 1 -- 172.21.15.99:0/1040573144 shutdown_connections 2024-09-10T07:34:02.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:02.403+0000 7fc848a00640 1 -- 172.21.15.99:0/1040573144 wait complete. 2024-09-10T07:34:02.417 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T07:34:02.417 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T07:34:02.418 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:02.418 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T07:34:02.474 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:02.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T07:34:02.516 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:02.516+0000 7f63d305c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:34:02.539 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:02.539+0000 7ff210e15040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:34:02.571 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:02.571 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T07:34:02.648 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:02.649+0000 7f63d305c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:34:02.665 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:02.665+0000 7ff210e15040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:34:02.667 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:02.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T07:34:02.763 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:02.763 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T07:34:02.818 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:02.818 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T07:34:02.915 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:02.915 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T07:34:03.010 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:03.010 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T07:34:03.011 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:03.011+0000 7f63d305c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:34:03.047 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:03.047+0000 7ff210e15040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:34:03.082 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:03.082+0000 7f63d305c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:34:03.102 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2024-09-10T07:34:03.106 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:03.106+0000 7ff210e15040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:34:03.248 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:03.248+0000 7f63d305c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:34:03.255 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.255+0000 7f17fe800640 1 Processor -- start 2024-09-10T07:34:03.255 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.255+0000 7f17fe800640 1 -- start start 2024-09-10T07:34:03.256 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.256+0000 7f17fe800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.256 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.256+0000 7f17fe800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f80d3700 con 0x7f17f80d56b0 2024-09-10T07:34:03.256 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.256+0000 7f17fe800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f80cfa70 con 0x7f17f81623c0 2024-09-10T07:34:03.256 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.256+0000 7f17fe800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f17f80d21a0 con 0x7f17f80d1b80 2024-09-10T07:34:03.257 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.256+0000 7f17f7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.257 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.256+0000 7f17f7400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f17f81623c0 0x7f17f80d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:57822/0 (socket says 172.21.15.187:57822) 2024-09-10T07:34:03.257 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.256+0000 7f17f7400640 1 -- 172.21.15.187:0/1397081096 learned_addr learned my addr 172.21.15.187:0/1397081096 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-09-10T07:34:03.257 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.257+0000 7f17f6000640 1 -- 172.21.15.187:0/1397081096 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579607574 0 0) 0x7f17f80cfa70 con 0x7f17f81623c0 2024-09-10T07:34:03.258 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.257+0000 7f17f6000640 1 -- 172.21.15.187:0/1397081096 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17dc003520 con 0x7f17f81623c0 2024-09-10T07:34:03.258 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.257+0000 7f17f6000640 1 -- 172.21.15.187:0/1397081096 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396029074 0 0) 0x7f17f80d3700 con 0x7f17f80d56b0 2024-09-10T07:34:03.258 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.257+0000 7f17f7e00640 1 -- 172.21.15.187:0/1397081096 >> v1:172.21.15.187:6789/0 conn(0x7f17f81623c0 legacy=0x7f17f80d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.258 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.257+0000 7f17f7e00640 1 -- 172.21.15.187:0/1397081096 >> v1:172.21.15.99:6789/0 conn(0x7f17f80d56b0 legacy=0x7f17f80d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.258 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.257+0000 7f17f7e00640 1 -- 172.21.15.187:0/1397081096 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f80d0c20 con 0x7f17f80d1b80 2024-09-10T07:34:03.258 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.259+0000 7f17f7e00640 1 --2- 172.21.15.187:0/1397081096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f80b6260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009dc0 tx=0x7f17f002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=632dc0c894e2016f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:03.259 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.259+0000 7f17f6000640 1 -- 172.21.15.187:0/1397081096 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0007740 con 0x7f17f80d1b80 2024-09-10T07:34:03.259 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.259+0000 7f17f6000640 1 -- 172.21.15.187:0/1397081096 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f00078e0 con 0x7f17f80d1b80 2024-09-10T07:34:03.259 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.259+0000 7f17f6000640 1 -- 172.21.15.187:0/1397081096 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0007cb0 con 0x7f17f80d1b80 2024-09-10T07:34:03.260 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.260+0000 7f17fe800640 1 -- 172.21.15.187:0/1397081096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 msgr2=0x7f17f80b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.260 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.260+0000 7f17fe800640 1 --2- 172.21.15.187:0/1397081096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f80b6260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009dc0 tx=0x7f17f002a6d0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.260 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.260+0000 7f17fe800640 1 -- 172.21.15.187:0/1397081096 shutdown_connections 2024-09-10T07:34:03.260 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.260+0000 7f17fe800640 1 --2- 172.21.15.187:0/1397081096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f80b6260 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.260 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.260+0000 7f17fe800640 1 -- 172.21.15.187:0/1397081096 >> 172.21.15.187:0/1397081096 conn(0x7f17f809df30 msgr2=0x7f17f80d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:03.260 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.260+0000 7f17fe800640 1 -- 172.21.15.187:0/1397081096 shutdown_connections 2024-09-10T07:34:03.260 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.260+0000 7f17fe800640 1 -- 172.21.15.187:0/1397081096 wait complete. 2024-09-10T07:34:03.261 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.261+0000 7f17fe800640 1 Processor -- start 2024-09-10T07:34:03.261 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.261+0000 7f17fe800640 1 -- start start 2024-09-10T07:34:03.264 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.262+0000 7f17fe800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f815db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.264 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.262+0000 7f17fe800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f80d56b0 0x7f17f814e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.264 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.262+0000 7f17fe800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f81623c0 0x7f17f814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.264 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.262+0000 7f17fe800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f17f80cfd10 con 0x7f17f80d56b0 2024-09-10T07:34:03.264 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.262+0000 7f17fe800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f17f80d0080 con 0x7f17f81623c0 2024-09-10T07:34:03.264 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.262+0000 7f17fe800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f17f81627a0 con 0x7f17f80d1b80 2024-09-10T07:34:03.264 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.262+0000 7f17f7400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.264 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f7400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f815db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:37786/0 (socket says 172.21.15.187:37786) 2024-09-10T07:34:03.265 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f7400640 1 -- 172.21.15.187:0/2356209689 learned_addr learned my addr 172.21.15.187:0/2356209689 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:03.265 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f7e00640 1 --2- 172.21.15.187:0/2356209689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f81623c0 0x7f17f814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.265 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f6a00640 1 --2- 172.21.15.187:0/2356209689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f80d56b0 0x7f17f814e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.268 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f7400640 1 -- 172.21.15.187:0/2356209689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f81623c0 msgr2=0x7f17f814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.268 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f7400640 1 --2- 172.21.15.187:0/2356209689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f81623c0 0x7f17f814e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.268 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f7400640 1 -- 172.21.15.187:0/2356209689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f80d56b0 msgr2=0x7f17f814e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.268 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f7400640 1 --2- 172.21.15.187:0/2356209689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f80d56b0 0x7f17f814e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.268 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f7400640 1 -- 172.21.15.187:0/2356209689 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f815e580 con 0x7f17f80d1b80 2024-09-10T07:34:03.269 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f6a00640 1 --2- 172.21.15.187:0/2356209689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f80d56b0 0x7f17f814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:03.269 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.263+0000 7f17f7400640 1 --2- 172.21.15.187:0/2356209689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f815db30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f17e80010e0 tx=0x7f17e800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:03.269 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.264+0000 7f17ef400640 1 -- 172.21.15.187:0/2356209689 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8017070 con 0x7f17f80d1b80 2024-09-10T07:34:03.269 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.264+0000 7f17ef400640 1 -- 172.21.15.187:0/2356209689 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e8005d00 con 0x7f17f80d1b80 2024-09-10T07:34:03.269 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.264+0000 7f17ef400640 1 -- 172.21.15.187:0/2356209689 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8007310 con 0x7f17f80d1b80 2024-09-10T07:34:03.269 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.264+0000 7f17fe800640 1 -- 172.21.15.187:0/2356209689 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f815e860 con 0x7f17f80d1b80 2024-09-10T07:34:03.269 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.264+0000 7f17fe800640 1 -- 172.21.15.187:0/2356209689 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f815ee20 con 0x7f17f80d1b80 2024-09-10T07:34:03.269 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.264+0000 7f17ef400640 1 -- 172.21.15.187:0/2356209689 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f17e801a070 con 0x7f17f80d1b80 2024-09-10T07:34:03.269 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.264+0000 7f17ef400640 1 -- 172.21.15.187:0/2356209689 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f17e8012740 con 0x7f17f80d1b80 2024-09-10T07:34:03.270 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.265+0000 7f17fe800640 1 -- 172.21.15.187:0/2356209689 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f80d3c80 con 0x7f17f80d1b80 2024-09-10T07:34:03.270 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.268+0000 7f17ef400640 1 -- 172.21.15.187:0/2356209689 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f17e8021020 con 0x7f17f80d1b80 2024-09-10T07:34:03.287 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:03.287+0000 7ff210e15040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:34:03.340 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.340+0000 7f17fe800640 1 -- 172.21.15.187:0/2356209689 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) -- 0x7f17f80b3810 con 0x7f17f80d1b80 2024-09-10T07:34:03.347 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.347+0000 7f17ef400640 1 -- 172.21.15.187:0/2356209689 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f17e8007620 con 0x7f17f80d1b80 2024-09-10T07:34:03.347 INFO:teuthology.orchestra.run.smithi187.stdout:0 2024-09-10T07:34:03.349 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.349+0000 7f17fe800640 1 -- 172.21.15.187:0/2356209689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 msgr2=0x7f17f815db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.349 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.349+0000 7f17fe800640 1 --2- 172.21.15.187:0/2356209689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f815db30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f17e80010e0 tx=0x7f17e800c890 comp rx=0 tx=0).stop 2024-09-10T07:34:03.349 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.349+0000 7f17fe800640 1 -- 172.21.15.187:0/2356209689 shutdown_connections 2024-09-10T07:34:03.349 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.349+0000 7f17fe800640 1 --2- 172.21.15.187:0/2356209689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f81623c0 0x7f17f814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.349 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.349+0000 7f17fe800640 1 --2- 172.21.15.187:0/2356209689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f80d56b0 0x7f17f814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.350 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.349+0000 7f17fe800640 1 --2- 172.21.15.187:0/2356209689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80d1b80 0x7f17f815db30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.350 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.349+0000 7f17fe800640 1 -- 172.21.15.187:0/2356209689 >> 172.21.15.187:0/2356209689 conn(0x7f17f809df30 msgr2=0x7f17f80b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:03.350 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.349+0000 7f17fe800640 1 -- 172.21.15.187:0/2356209689 shutdown_connections 2024-09-10T07:34:03.350 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.349+0000 7f17fe800640 1 -- 172.21.15.187:0/2356209689 wait complete. 2024-09-10T07:34:03.364 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2024-09-10T07:34:03.514 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.514+0000 7f057ba00640 1 Processor -- start 2024-09-10T07:34:03.514 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.514+0000 7f057ba00640 1 -- start start 2024-09-10T07:34:03.515 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.515+0000 7f057ba00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f05740d56b0 0x7f05740b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.515 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.515+0000 7f057ba00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05740d3700 con 0x7f05741623c0 2024-09-10T07:34:03.515 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.515+0000 7f057ba00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05740cfa70 con 0x7f05740d1470 2024-09-10T07:34:03.515 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.515+0000 7f057ba00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f05740d21a0 con 0x7f05740d56b0 2024-09-10T07:34:03.515 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.515+0000 7f0573e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f05740d56b0 0x7f05740b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.515 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.515+0000 7f0573e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f05740d56b0 0x7f05740b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:41794/0 (socket says 172.21.15.187:41794) 2024-09-10T07:34:03.515 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.515+0000 7f0573e00640 1 -- 172.21.15.187:0/2890219418 learned_addr learned my addr 172.21.15.187:0/2890219418 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:03.516 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.516+0000 7f0573e00640 1 -- 172.21.15.187:0/2890219418 >> v1:172.21.15.187:6789/0 conn(0x7f05740d1470 legacy=0x7f05740b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.516 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.516+0000 7f0573e00640 1 -- 172.21.15.187:0/2890219418 >> v1:172.21.15.99:6789/0 conn(0x7f05741623c0 legacy=0x7f05740d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.516 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.516+0000 7f0573e00640 1 -- 172.21.15.187:0/2890219418 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05740d0c20 con 0x7f05740d56b0 2024-09-10T07:34:03.516 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.516+0000 7f0573400640 1 -- 172.21.15.187:0/2890219418 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3208988778 0 0) 0x7f05740d3700 con 0x7f05741623c0 2024-09-10T07:34:03.517 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.517+0000 7f0573e00640 1 --2- 172.21.15.187:0/2890219418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d56b0 0x7f05740b6260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0560009870 tx=0x7f056002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=584111b34edf5983 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:03.517 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.517+0000 7f0573400640 1 -- 172.21.15.187:0/2890219418 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560037070 con 0x7f05740d56b0 2024-09-10T07:34:03.517 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.517+0000 7f0573400640 1 -- 172.21.15.187:0/2890219418 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f056002ae50 con 0x7f05740d56b0 2024-09-10T07:34:03.517 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.517+0000 7f0573400640 1 -- 172.21.15.187:0/2890219418 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560032860 con 0x7f05740d56b0 2024-09-10T07:34:03.518 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.518+0000 7f057ba00640 1 -- 172.21.15.187:0/2890219418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d56b0 msgr2=0x7f05740b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.518 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.518+0000 7f057ba00640 1 --2- 172.21.15.187:0/2890219418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d56b0 0x7f05740b6260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0560009870 tx=0x7f056002a300 comp rx=0 tx=0).stop 2024-09-10T07:34:03.518 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.518+0000 7f057ba00640 1 -- 172.21.15.187:0/2890219418 shutdown_connections 2024-09-10T07:34:03.519 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.518+0000 7f057ba00640 1 --2- 172.21.15.187:0/2890219418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d56b0 0x7f05740b6260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.519 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.518+0000 7f057ba00640 1 -- 172.21.15.187:0/2890219418 >> 172.21.15.187:0/2890219418 conn(0x7f057409df30 msgr2=0x7f05740d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:03.519 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.518+0000 7f057ba00640 1 -- 172.21.15.187:0/2890219418 shutdown_connections 2024-09-10T07:34:03.519 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.518+0000 7f057ba00640 1 -- 172.21.15.187:0/2890219418 wait complete. 2024-09-10T07:34:03.520 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.520+0000 7f057ba00640 1 Processor -- start 2024-09-10T07:34:03.520 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.520+0000 7f057ba00640 1 -- start start 2024-09-10T07:34:03.525 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f057ba00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d1470 0x7f057415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.525 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f057ba00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05740d56b0 0x7f05740b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.525 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f057ba00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05741623c0 0x7f057415bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.525 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f057ba00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f05740cfd10 con 0x7f05740d56b0 2024-09-10T07:34:03.525 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f057ba00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f05740d0080 con 0x7f05740d1470 2024-09-10T07:34:03.525 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f057ba00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f05741627a0 con 0x7f05741623c0 2024-09-10T07:34:03.525 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f0579000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d1470 0x7f057415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.525 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f0579a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05741623c0 0x7f057415bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.525 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f0579000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d1470 0x7f057415ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:41808/0 (socket says 172.21.15.187:41808) 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f0579a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05741623c0 0x7f057415bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:37802/0 (socket says 172.21.15.187:37802) 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f0579000640 1 -- 172.21.15.187:0/2972388452 learned_addr learned my addr 172.21.15.187:0/2972388452 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.521+0000 7f0573e00640 1 --2- 172.21.15.187:0/2972388452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05740d56b0 0x7f05740b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.522+0000 7f0579000640 1 -- 172.21.15.187:0/2972388452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05741623c0 msgr2=0x7f057415bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.522+0000 7f0579000640 1 --2- 172.21.15.187:0/2972388452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05741623c0 0x7f057415bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.522+0000 7f0579000640 1 -- 172.21.15.187:0/2972388452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05740d56b0 msgr2=0x7f05740b8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.522+0000 7f0579000640 1 --2- 172.21.15.187:0/2972388452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05740d56b0 0x7f05740b8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.522+0000 7f0579000640 1 -- 172.21.15.187:0/2972388452 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05740ba430 con 0x7f05740d1470 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.522+0000 7f0579000640 1 --2- 172.21.15.187:0/2972388452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d1470 0x7f057415ec40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f056800c3c0 tx=0x7f056800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.522+0000 7f0570c00640 1 -- 172.21.15.187:0/2972388452 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568017070 con 0x7f05740d1470 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.522+0000 7f0570c00640 1 -- 172.21.15.187:0/2972388452 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05680035f0 con 0x7f05740d1470 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.522+0000 7f0570c00640 1 -- 172.21.15.187:0/2972388452 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05680039e0 con 0x7f05740d1470 2024-09-10T07:34:03.526 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.522+0000 7f057ba00640 1 -- 172.21.15.187:0/2972388452 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05740b9390 con 0x7f05740d1470 2024-09-10T07:34:03.527 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.523+0000 7f057ba00640 1 -- 172.21.15.187:0/2972388452 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05740b9950 con 0x7f05740d1470 2024-09-10T07:34:03.527 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.523+0000 7f0570c00640 1 -- 172.21.15.187:0/2972388452 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f056801a070 con 0x7f05740d1470 2024-09-10T07:34:03.527 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.523+0000 7f0570c00640 1 -- 172.21.15.187:0/2972388452 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f05680127b0 con 0x7f05740d1470 2024-09-10T07:34:03.527 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.524+0000 7f057ba00640 1 -- 172.21.15.187:0/2972388452 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05740d3c80 con 0x7f05740d1470 2024-09-10T07:34:03.527 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.527+0000 7f0570c00640 1 -- 172.21.15.187:0/2972388452 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0568021070 con 0x7f05740d1470 2024-09-10T07:34:03.599 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.599+0000 7f057ba00640 1 -- 172.21.15.187:0/2972388452 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) -- 0x7f0574161720 con 0x7f05740d1470 2024-09-10T07:34:03.605 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.605+0000 7f0570c00640 1 -- 172.21.15.187:0/2972388452 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f0568003d10 con 0x7f05740d1470 2024-09-10T07:34:03.605 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:34:03.606 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.606+0000 7f057ba00640 1 -- 172.21.15.187:0/2972388452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d1470 msgr2=0x7f057415ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.607 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.606+0000 7f057ba00640 1 --2- 172.21.15.187:0/2972388452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d1470 0x7f057415ec40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f056800c3c0 tx=0x7f056800c880 comp rx=0 tx=0).stop 2024-09-10T07:34:03.607 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.606+0000 7f057ba00640 1 -- 172.21.15.187:0/2972388452 shutdown_connections 2024-09-10T07:34:03.607 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.606+0000 7f057ba00640 1 --2- 172.21.15.187:0/2972388452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05741623c0 0x7f057415bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.607 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.606+0000 7f057ba00640 1 --2- 172.21.15.187:0/2972388452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05740d56b0 0x7f05740b8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.607 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.606+0000 7f057ba00640 1 --2- 172.21.15.187:0/2972388452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05740d1470 0x7f057415ec40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.607 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.606+0000 7f057ba00640 1 -- 172.21.15.187:0/2972388452 >> 172.21.15.187:0/2972388452 conn(0x7f057409df30 msgr2=0x7f05740d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:03.607 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.606+0000 7f057ba00640 1 -- 172.21.15.187:0/2972388452 shutdown_connections 2024-09-10T07:34:03.607 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.606+0000 7f057ba00640 1 -- 172.21.15.187:0/2972388452 wait complete. 2024-09-10T07:34:03.621 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2024-09-10T07:34:03.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.771+0000 7fac57e00640 1 Processor -- start 2024-09-10T07:34:03.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.771+0000 7fac57e00640 1 -- start start 2024-09-10T07:34:03.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.772+0000 7fac57e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fac5815e970 0x7fac580d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.772+0000 7fac57e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fac580d2680 0x7fac580cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.772+0000 7fac57e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac580d2bd0 con 0x7fac580cfac0 2024-09-10T07:34:03.776 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.772+0000 7fac57e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fac580d37e0 con 0x7fac5815e970 2024-09-10T07:34:03.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.772+0000 7fac57e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fac580d2eb0 con 0x7fac580d2680 2024-09-10T07:34:03.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.772+0000 7fac56000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fac580d2680 0x7fac580cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.772+0000 7fac56000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fac580d2680 0x7fac580cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:41818/0 (socket says 172.21.15.187:41818) 2024-09-10T07:34:03.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.772+0000 7fac56000640 1 -- 172.21.15.187:0/928074466 learned_addr learned my addr 172.21.15.187:0/928074466 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:03.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.772+0000 7fac57400640 1 --1- 172.21.15.187:0/928074466 >> v1:172.21.15.187:6789/0 conn(0x7fac580cfac0 0x7fac580d0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:57838/0 (socket says 172.21.15.187:57838) 2024-09-10T07:34:03.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.772+0000 7fac56a00640 1 --2- 172.21.15.187:0/928074466 >> v2:172.21.15.99:3300/0 conn(0x7fac5815e970 0x7fac580d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.773+0000 7fac56000640 1 -- 172.21.15.187:0/928074466 >> v2:172.21.15.99:3300/0 conn(0x7fac5815e970 msgr2=0x7fac580d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:03.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.773+0000 7fac56000640 1 --2- 172.21.15.187:0/928074466 >> v2:172.21.15.99:3300/0 conn(0x7fac5815e970 0x7fac580d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.777 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.773+0000 7fac56000640 1 -- 172.21.15.187:0/928074466 >> v1:172.21.15.187:6789/0 conn(0x7fac580cfac0 legacy=0x7fac580d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.778 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.773+0000 7fac56000640 1 -- 172.21.15.187:0/928074466 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac580d3190 con 0x7fac580d2680 2024-09-10T07:34:03.778 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.774+0000 7fac56000640 1 --2- 172.21.15.187:0/928074466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580d2680 0x7fac580cf580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fac5809e530 tx=0x7fac4402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adcc509c4a522234 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:03.778 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.774+0000 7fac55600640 1 -- 172.21.15.187:0/928074466 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44037070 con 0x7fac580d2680 2024-09-10T07:34:03.778 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.774+0000 7fac55600640 1 -- 172.21.15.187:0/928074466 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4402ae50 con 0x7fac580d2680 2024-09-10T07:34:03.778 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.774+0000 7fac55600640 1 -- 172.21.15.187:0/928074466 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44032860 con 0x7fac580d2680 2024-09-10T07:34:03.778 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.775+0000 7fac57e00640 1 -- 172.21.15.187:0/928074466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580d2680 msgr2=0x7fac580cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.779 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.775+0000 7fac57e00640 1 --2- 172.21.15.187:0/928074466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580d2680 0x7fac580cf580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fac5809e530 tx=0x7fac4402a300 comp rx=0 tx=0).stop 2024-09-10T07:34:03.779 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.775+0000 7fac57e00640 1 -- 172.21.15.187:0/928074466 shutdown_connections 2024-09-10T07:34:03.779 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.775+0000 7fac57e00640 1 --2- 172.21.15.187:0/928074466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580d2680 0x7fac580cf580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.779 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.775+0000 7fac57e00640 1 --2- 172.21.15.187:0/928074466 >> v2:172.21.15.99:3300/0 conn(0x7fac5815e970 0x7fac580d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.779 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.775+0000 7fac57e00640 1 -- 172.21.15.187:0/928074466 >> 172.21.15.187:0/928074466 conn(0x7fac5809de00 msgr2=0x7fac580d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:03.779 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.775+0000 7fac57e00640 1 -- 172.21.15.187:0/928074466 shutdown_connections 2024-09-10T07:34:03.779 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.775+0000 7fac57e00640 1 -- 172.21.15.187:0/928074466 wait complete. 2024-09-10T07:34:03.782 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.776+0000 7fac57e00640 1 Processor -- start 2024-09-10T07:34:03.783 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.776+0000 7fac57e00640 1 -- start start 2024-09-10T07:34:03.783 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.777+0000 7fac57e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580cfac0 0x7fac58154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.783 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.777+0000 7fac57e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac580d2680 0x7fac580b9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.783 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.777+0000 7fac57e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac5815e970 0x7fac580cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:03.783 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.777+0000 7fac57e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fac580d0840 con 0x7fac5815e970 2024-09-10T07:34:03.783 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.777+0000 7fac57e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fac580cff10 con 0x7fac580cfac0 2024-09-10T07:34:03.783 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.777+0000 7fac57e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fac5815ed50 con 0x7fac580d2680 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.777+0000 7fac56a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580cfac0 0x7fac58154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.777+0000 7fac56000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac580d2680 0x7fac580b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.777+0000 7fac56000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac580d2680 0x7fac580b9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:37818/0 (socket says 172.21.15.187:37818) 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac56000640 1 -- 172.21.15.187:0/316341724 learned_addr learned my addr 172.21.15.187:0/316341724 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac56a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580cfac0 0x7fac58154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:41834/0 (socket says 172.21.15.187:41834) 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac57400640 1 --2- 172.21.15.187:0/316341724 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac5815e970 0x7fac580cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac56000640 1 -- 172.21.15.187:0/316341724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580cfac0 msgr2=0x7fac58154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac56000640 1 --2- 172.21.15.187:0/316341724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580cfac0 0x7fac58154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac56000640 1 -- 172.21.15.187:0/316341724 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac5815e970 msgr2=0x7fac580cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac56000640 1 --2- 172.21.15.187:0/316341724 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac5815e970 0x7fac580cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac56000640 1 -- 172.21.15.187:0/316341724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac581551f0 con 0x7fac580d2680 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac56a00640 1 --2- 172.21.15.187:0/316341724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580cfac0 0x7fac58154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:03.784 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac57400640 1 --2- 172.21.15.187:0/316341724 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac5815e970 0x7fac580cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:03.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac56000640 1 --2- 172.21.15.187:0/316341724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac580d2680 0x7fac580b9570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fac4402a340 tx=0x7fac440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:03.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.778+0000 7fac4ea00640 1 -- 172.21.15.187:0/316341724 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44041070 con 0x7fac580d2680 2024-09-10T07:34:03.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.779+0000 7fac4ea00640 1 -- 172.21.15.187:0/316341724 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4403c680 con 0x7fac580d2680 2024-09-10T07:34:03.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.779+0000 7fac57e00640 1 -- 172.21.15.187:0/316341724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac580b9e50 con 0x7fac580d2680 2024-09-10T07:34:03.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.779+0000 7fac4ea00640 1 -- 172.21.15.187:0/316341724 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44037040 con 0x7fac580d2680 2024-09-10T07:34:03.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.779+0000 7fac57e00640 1 -- 172.21.15.187:0/316341724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac580cbe60 con 0x7fac580d2680 2024-09-10T07:34:03.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.779+0000 7fac4ea00640 1 -- 172.21.15.187:0/316341724 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fac44044070 con 0x7fac580d2680 2024-09-10T07:34:03.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.779+0000 7fac4ea00640 1 -- 172.21.15.187:0/316341724 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fac44046450 con 0x7fac580d2680 2024-09-10T07:34:03.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.780+0000 7fac57e00640 1 -- 172.21.15.187:0/316341724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac580cf580 con 0x7fac580d2680 2024-09-10T07:34:03.785 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.782+0000 7fac4ea00640 1 -- 172.21.15.187:0/316341724 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fac4403ca70 con 0x7fac580d2680 2024-09-10T07:34:03.853 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.853+0000 7fac57e00640 1 -- 172.21.15.187:0/316341724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) -- 0x7fac5806e1c0 con 0x7fac580d2680 2024-09-10T07:34:03.859 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.859+0000 7fac4ea00640 1 -- 172.21.15.187:0/316341724 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fac4403cd10 con 0x7fac580d2680 2024-09-10T07:34:03.859 INFO:teuthology.orchestra.run.smithi187.stdout:2 2024-09-10T07:34:03.860 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.860+0000 7fac57e00640 1 -- 172.21.15.187:0/316341724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac580d2680 msgr2=0x7fac580b9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:03.860 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.860+0000 7fac57e00640 1 --2- 172.21.15.187:0/316341724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac580d2680 0x7fac580b9570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fac4402a340 tx=0x7fac440046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.860 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.860+0000 7fac57e00640 1 -- 172.21.15.187:0/316341724 shutdown_connections 2024-09-10T07:34:03.860 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.860+0000 7fac57e00640 1 --2- 172.21.15.187:0/316341724 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac5815e970 0x7fac580cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.860 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.860+0000 7fac57e00640 1 --2- 172.21.15.187:0/316341724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac580d2680 0x7fac580b9570 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.861 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.860+0000 7fac57e00640 1 --2- 172.21.15.187:0/316341724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac580cfac0 0x7fac58154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:03.861 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.860+0000 7fac57e00640 1 -- 172.21.15.187:0/316341724 >> 172.21.15.187:0/316341724 conn(0x7fac5809de00 msgr2=0x7fac580c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:03.861 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.860+0000 7fac57e00640 1 -- 172.21.15.187:0/316341724 shutdown_connections 2024-09-10T07:34:03.861 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:03.860+0000 7fac57e00640 1 -- 172.21.15.187:0/316341724 wait complete. 2024-09-10T07:34:03.874 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2024-09-10T07:34:04.026 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.026+0000 7f167b200640 1 Processor -- start 2024-09-10T07:34:04.026 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.026+0000 7f167b200640 1 -- start start 2024-09-10T07:34:04.027 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.027+0000 7f167b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f167c15eb30 0x7f167c0d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.027 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.027+0000 7f167b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.027 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.027+0000 7f167b200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167c0d5430 con 0x7f167c0d3750 2024-09-10T07:34:04.027 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.027+0000 7f167b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f167c0d32c0 con 0x7f167c15eb30 2024-09-10T07:34:04.027 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.027+0000 7f167b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f167c0d26b0 con 0x7f167c0d1b40 2024-09-10T07:34:04.028 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.027+0000 7f1679400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f167c0d3750 0x7f167c0d1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:57846/0 (socket says 172.21.15.187:57846) 2024-09-10T07:34:04.028 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.027+0000 7f1679400640 1 -- 172.21.15.187:0/3743333526 learned_addr learned my addr 172.21.15.187:0/3743333526 (peer_addr_for_me v1:172.21.15.187:0/0) 2024-09-10T07:34:04.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.028+0000 7f1679e00640 1 --2- 172.21.15.187:0/3743333526 >> v2:172.21.15.99:3300/0 conn(0x7f167c15eb30 0x7f167c0d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.028+0000 7f167a800640 1 --2- 172.21.15.187:0/3743333526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.028+0000 7f1678a00640 1 -- 172.21.15.187:0/3743333526 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65711220 0 0) 0x7f167c0d5430 con 0x7f167c0d3750 2024-09-10T07:34:04.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.028+0000 7f1678a00640 1 -- 172.21.15.187:0/3743333526 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1660003520 con 0x7f167c0d3750 2024-09-10T07:34:04.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.028+0000 7f1679e00640 1 -- 172.21.15.187:0/3743333526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 msgr2=0x7f167c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:04.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.028+0000 7f1679e00640 1 --2- 172.21.15.187:0/3743333526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.028+0000 7f1679e00640 1 -- 172.21.15.187:0/3743333526 >> v1:172.21.15.187:6789/0 conn(0x7f167c0d3750 legacy=0x7f167c0d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.028+0000 7f1679e00640 1 -- 172.21.15.187:0/3743333526 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167c0d2990 con 0x7f167c15eb30 2024-09-10T07:34:04.029 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.028+0000 7f167a800640 1 --2- 172.21.15.187:0/3743333526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:04.030 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.029+0000 7f1679e00640 1 --2- 172.21.15.187:0/3743333526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f167c15eb30 0x7f167c0d00d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f166c0097a0 tx=0x7f166c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c3ca85633ead6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f1678a00640 1 -- 172.21.15.187:0/3743333526 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c037070 con 0x7f167c15eb30 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f1678a00640 1 -- 172.21.15.187:0/3743333526 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f166c032440 con 0x7f167c15eb30 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f1678a00640 1 -- 172.21.15.187:0/3743333526 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c032810 con 0x7f167c15eb30 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f167b200640 1 -- 172.21.15.187:0/3743333526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f167c15eb30 msgr2=0x7f167c0d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f167b200640 1 --2- 172.21.15.187:0/3743333526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f167c15eb30 0x7f167c0d00d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f166c0097a0 tx=0x7f166c02a180 comp rx=0 tx=0).stop 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f167b200640 1 -- 172.21.15.187:0/3743333526 shutdown_connections 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f167b200640 1 --2- 172.21.15.187:0/3743333526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f167b200640 1 --2- 172.21.15.187:0/3743333526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f167c15eb30 0x7f167c0d00d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f167b200640 1 -- 172.21.15.187:0/3743333526 >> 172.21.15.187:0/3743333526 conn(0x7f167c09dd10 msgr2=0x7f167c0d4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f167b200640 1 -- 172.21.15.187:0/3743333526 shutdown_connections 2024-09-10T07:34:04.031 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.030+0000 7f167b200640 1 -- 172.21.15.187:0/3743333526 wait complete. 2024-09-10T07:34:04.032 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.032+0000 7f167b200640 1 Processor -- start 2024-09-10T07:34:04.032 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.032+0000 7f167b200640 1 -- start start 2024-09-10T07:34:04.035 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f167b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.035 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f167b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f167c0d3750 0x7f167c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.035 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f167b200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f167c15eb30 0x7f167c0cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.035 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f167b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f167c15ef10 con 0x7f167c0d3750 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f167b200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f167c0d2f50 con 0x7f167c15eb30 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f167b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f167c15f090 con 0x7f167c0d1b40 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f1679e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f167a800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f167c15eb30 0x7f167c0cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f1679e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:37846/0 (socket says 172.21.15.187:37846) 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f1679e00640 1 -- 172.21.15.187:0/1947799111 learned_addr learned my addr 172.21.15.187:0/1947799111 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.033+0000 7f1679400640 1 --2- 172.21.15.187:0/1947799111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f167c0d3750 0x7f167c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.034+0000 7f1679e00640 1 -- 172.21.15.187:0/1947799111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f167c15eb30 msgr2=0x7f167c0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.034+0000 7f1679e00640 1 --2- 172.21.15.187:0/1947799111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f167c15eb30 0x7f167c0cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.034+0000 7f1679e00640 1 -- 172.21.15.187:0/1947799111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f167c0d3750 msgr2=0x7f167c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.036 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.034+0000 7f1679e00640 1 --2- 172.21.15.187:0/1947799111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f167c0d3750 0x7f167c0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.037 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.034+0000 7f1679e00640 1 -- 172.21.15.187:0/1947799111 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167c0ccf50 con 0x7f167c0d1b40 2024-09-10T07:34:04.037 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.034+0000 7f1679e00640 1 --2- 172.21.15.187:0/1947799111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0cbd40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f166c035040 tx=0x7f166c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:04.037 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.034+0000 7f1672000640 1 -- 172.21.15.187:0/1947799111 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c041030 con 0x7f167c0d1b40 2024-09-10T07:34:04.037 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.034+0000 7f1672000640 1 -- 172.21.15.187:0/1947799111 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f166c03d420 con 0x7f167c0d1b40 2024-09-10T07:34:04.037 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.034+0000 7f1672000640 1 -- 172.21.15.187:0/1947799111 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c037040 con 0x7f167c0d1b40 2024-09-10T07:34:04.037 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.034+0000 7f167b200640 1 -- 172.21.15.187:0/1947799111 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f167c0c8560 con 0x7f167c0d1b40 2024-09-10T07:34:04.037 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.035+0000 7f167b200640 1 -- 172.21.15.187:0/1947799111 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f167c0c8b20 con 0x7f167c0d1b40 2024-09-10T07:34:04.037 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.035+0000 7f1672000640 1 -- 172.21.15.187:0/1947799111 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f166c044070 con 0x7f167c0d1b40 2024-09-10T07:34:04.037 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.035+0000 7f1672000640 1 -- 172.21.15.187:0/1947799111 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f166c03dcc0 con 0x7f167c0d1b40 2024-09-10T07:34:04.038 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.036+0000 7f167b200640 1 -- 172.21.15.187:0/1947799111 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f167c0d1430 con 0x7f167c0d1b40 2024-09-10T07:34:04.038 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.038+0000 7f1672000640 1 -- 172.21.15.187:0/1947799111 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f166c03d830 con 0x7f167c0d1b40 2024-09-10T07:34:04.109 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.109+0000 7f167b200640 1 -- 172.21.15.187:0/1947799111 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) -- 0x7f167c0d1ff0 con 0x7f167c0d1b40 2024-09-10T07:34:04.114 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.115+0000 7f1672000640 1 -- 172.21.15.187:0/1947799111 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f166c03dab0 con 0x7f167c0d1b40 2024-09-10T07:34:04.115 INFO:teuthology.orchestra.run.smithi187.stdout:3 2024-09-10T07:34:04.116 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.116+0000 7f167b200640 1 -- 172.21.15.187:0/1947799111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 msgr2=0x7f167c0cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.116 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.116+0000 7f167b200640 1 --2- 172.21.15.187:0/1947799111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0cbd40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f166c035040 tx=0x7f166c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.116 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.116+0000 7f167b200640 1 -- 172.21.15.187:0/1947799111 shutdown_connections 2024-09-10T07:34:04.116 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.116+0000 7f167b200640 1 --2- 172.21.15.187:0/1947799111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f167c15eb30 0x7f167c0cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.116 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.116+0000 7f167b200640 1 --2- 172.21.15.187:0/1947799111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f167c0d3750 0x7f167c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.116 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.116+0000 7f167b200640 1 --2- 172.21.15.187:0/1947799111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f167c0d1b40 0x7f167c0cbd40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.116 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.116+0000 7f167b200640 1 -- 172.21.15.187:0/1947799111 >> 172.21.15.187:0/1947799111 conn(0x7f167c09dd10 msgr2=0x7f167c06c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:04.116 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.116+0000 7f167b200640 1 -- 172.21.15.187:0/1947799111 shutdown_connections 2024-09-10T07:34:04.117 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.116+0000 7f167b200640 1 -- 172.21.15.187:0/1947799111 wait complete. 2024-09-10T07:34:04.131 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2024-09-10T07:34:04.281 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.281+0000 7f73c1400640 1 Processor -- start 2024-09-10T07:34:04.281 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.281+0000 7f73c1400640 1 -- start start 2024-09-10T07:34:04.283 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.282+0000 7f73c1400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f73bc1623c0 0x7f73bc0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.283 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.282+0000 7f73c1400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f73bc0d56b0 0x7f73bc0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.283 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.282+0000 7f73c1400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d0a50 0x7f73bc0d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.283 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.282+0000 7f73c1400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f73bc0d21a0 con 0x7f73bc1623c0 2024-09-10T07:34:04.283 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.282+0000 7f73c1400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f73bc0d0080 con 0x7f73bc0d56b0 2024-09-10T07:34:04.283 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.282+0000 7f73c1400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f73bc0d3700 con 0x7f73bc0d0a50 2024-09-10T07:34:04.283 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.282+0000 7f73b9e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f73bc0d56b0 0x7f73bc0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.282+0000 7f73b9e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f73bc0d56b0 0x7f73bc0d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:41860/0 (socket says 172.21.15.187:41860) 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.282+0000 7f73b9e00640 1 -- 172.21.15.187:0/3498872027 learned_addr learned my addr 172.21.15.187:0/3498872027 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.282+0000 7f73ba800640 1 --2- 172.21.15.187:0/3498872027 >> v2:172.21.15.99:3300/0 conn(0x7f73bc1623c0 0x7f73bc0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.283+0000 7f73bb200640 1 --2- 172.21.15.187:0/3498872027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d0a50 0x7f73bc0d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.283+0000 7f73b9e00640 1 -- 172.21.15.187:0/3498872027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d0a50 msgr2=0x7f73bc0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.283+0000 7f73b9e00640 1 --2- 172.21.15.187:0/3498872027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d0a50 0x7f73bc0d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.283+0000 7f73b9e00640 1 -- 172.21.15.187:0/3498872027 >> v2:172.21.15.99:3300/0 conn(0x7f73bc1623c0 msgr2=0x7f73bc0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.283+0000 7f73b9e00640 1 --2- 172.21.15.187:0/3498872027 >> v2:172.21.15.99:3300/0 conn(0x7f73bc1623c0 0x7f73bc0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.283+0000 7f73b9e00640 1 -- 172.21.15.187:0/3498872027 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc0cfa70 con 0x7f73bc0d56b0 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.283+0000 7f73ba800640 1 --2- 172.21.15.187:0/3498872027 >> v2:172.21.15.99:3300/0 conn(0x7f73bc1623c0 0x7f73bc0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:04.284 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.283+0000 7f73bb200640 1 --2- 172.21.15.187:0/3498872027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d0a50 0x7f73bc0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:04.285 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.284+0000 7f73b9e00640 1 --2- 172.21.15.187:0/3498872027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73bc0d56b0 0x7f73bc0d0510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0b44e0 tx=0x7f73a802a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e4f36550bb4386e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.284+0000 7f73b9400640 1 -- 172.21.15.187:0/3498872027 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8037070 con 0x7f73bc0d56b0 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.284+0000 7f73b9400640 1 -- 172.21.15.187:0/3498872027 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a8032440 con 0x7f73bc0d56b0 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.284+0000 7f73b9400640 1 -- 172.21.15.187:0/3498872027 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8032810 con 0x7f73bc0d56b0 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.285+0000 7f73c1400640 1 -- 172.21.15.187:0/3498872027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73bc0d56b0 msgr2=0x7f73bc0d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.285+0000 7f73c1400640 1 --2- 172.21.15.187:0/3498872027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73bc0d56b0 0x7f73bc0d0510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0b44e0 tx=0x7f73a802a1d0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.285+0000 7f73c1400640 1 -- 172.21.15.187:0/3498872027 shutdown_connections 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.285+0000 7f73c1400640 1 --2- 172.21.15.187:0/3498872027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d0a50 0x7f73bc0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.285+0000 7f73c1400640 1 --2- 172.21.15.187:0/3498872027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73bc0d56b0 0x7f73bc0d0510 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.285+0000 7f73c1400640 1 --2- 172.21.15.187:0/3498872027 >> v2:172.21.15.99:3300/0 conn(0x7f73bc1623c0 0x7f73bc0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.285+0000 7f73c1400640 1 -- 172.21.15.187:0/3498872027 >> 172.21.15.187:0/3498872027 conn(0x7f73bc09df30 msgr2=0x7f73bc0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.285+0000 7f73c1400640 1 -- 172.21.15.187:0/3498872027 shutdown_connections 2024-09-10T07:34:04.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.285+0000 7f73c1400640 1 -- 172.21.15.187:0/3498872027 wait complete. 2024-09-10T07:34:04.287 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.286+0000 7f73c1400640 1 Processor -- start 2024-09-10T07:34:04.287 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.287+0000 7f73c1400640 1 -- start start 2024-09-10T07:34:04.288 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.287+0000 7f73c1400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d56b0 0x7f73bc158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.288 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.287+0000 7f73c1400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73bc1623c0 0x7f73bc0b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.288 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.287+0000 7f73c1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc0ba340 0x7f73bc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.288 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.287+0000 7f73c1400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc1627a0 con 0x7f73bc0ba340 2024-09-10T07:34:04.288 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.287+0000 7f73c1400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc0cfd10 con 0x7f73bc1623c0 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.287+0000 7f73c1400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f73bc0d3c80 con 0x7f73bc0d56b0 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.288+0000 7f73ba800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d56b0 0x7f73bc158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.288+0000 7f73b9e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73bc1623c0 0x7f73bc0b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.288+0000 7f73ba800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d56b0 0x7f73bc158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:37870/0 (socket says 172.21.15.187:37870) 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.288+0000 7f73ba800640 1 -- 172.21.15.187:0/4228106375 learned_addr learned my addr 172.21.15.187:0/4228106375 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.288+0000 7f73bb200640 1 --2- 172.21.15.187:0/4228106375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc0ba340 0x7f73bc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.288+0000 7f73b9e00640 1 -- 172.21.15.187:0/4228106375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d56b0 msgr2=0x7f73bc158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.288+0000 7f73b9e00640 1 --2- 172.21.15.187:0/4228106375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d56b0 0x7f73bc158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.288+0000 7f73b9e00640 1 -- 172.21.15.187:0/4228106375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc0ba340 msgr2=0x7f73bc0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.288+0000 7f73b9e00640 1 --2- 172.21.15.187:0/4228106375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc0ba340 0x7f73bc0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.288+0000 7f73b9e00640 1 -- 172.21.15.187:0/4228106375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc0ba7d0 con 0x7f73bc1623c0 2024-09-10T07:34:04.289 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.289+0000 7f73b9e00640 1 --2- 172.21.15.187:0/4228106375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73bc1623c0 0x7f73bc0b9e00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f73a8031000 tx=0x7f73a80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:04.290 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.289+0000 7f73b2a00640 1 -- 172.21.15.187:0/4228106375 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8041020 con 0x7f73bc1623c0 2024-09-10T07:34:04.290 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.289+0000 7f73b2a00640 1 -- 172.21.15.187:0/4228106375 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a8030700 con 0x7f73bc1623c0 2024-09-10T07:34:04.291 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.289+0000 7f73b2a00640 1 -- 172.21.15.187:0/4228106375 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8037040 con 0x7f73bc1623c0 2024-09-10T07:34:04.291 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.289+0000 7f73c1400640 1 -- 172.21.15.187:0/4228106375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73bc0c9730 con 0x7f73bc1623c0 2024-09-10T07:34:04.291 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.289+0000 7f73c1400640 1 -- 172.21.15.187:0/4228106375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73bc0c9cf0 con 0x7f73bc1623c0 2024-09-10T07:34:04.291 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.289+0000 7f73b2a00640 1 -- 172.21.15.187:0/4228106375 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f73a8044020 con 0x7f73bc1623c0 2024-09-10T07:34:04.291 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.289+0000 7f73b2a00640 1 -- 172.21.15.187:0/4228106375 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f73a803dc40 con 0x7f73bc1623c0 2024-09-10T07:34:04.291 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.290+0000 7f73c1400640 1 -- 172.21.15.187:0/4228106375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73bc0d2340 con 0x7f73bc1623c0 2024-09-10T07:34:04.293 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.293+0000 7f73b2a00640 1 -- 172.21.15.187:0/4228106375 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f73a804b030 con 0x7f73bc1623c0 2024-09-10T07:34:04.364 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.363+0000 7f73c1400640 1 -- 172.21.15.187:0/4228106375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) -- 0x7f73bc1f4be0 con 0x7f73bc1623c0 2024-09-10T07:34:04.368 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.368+0000 7f73b2a00640 1 -- 172.21.15.187:0/4228106375 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f73a803d420 con 0x7f73bc1623c0 2024-09-10T07:34:04.368 INFO:teuthology.orchestra.run.smithi187.stdout:4 2024-09-10T07:34:04.369 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.369+0000 7f73c1400640 1 -- 172.21.15.187:0/4228106375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73bc1623c0 msgr2=0x7f73bc0b9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.369 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.369+0000 7f73c1400640 1 --2- 172.21.15.187:0/4228106375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73bc1623c0 0x7f73bc0b9e00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f73a8031000 tx=0x7f73a80046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.369 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.369+0000 7f73c1400640 1 -- 172.21.15.187:0/4228106375 shutdown_connections 2024-09-10T07:34:04.369 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.369+0000 7f73c1400640 1 --2- 172.21.15.187:0/4228106375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73bc0ba340 0x7f73bc0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.369 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.369+0000 7f73c1400640 1 --2- 172.21.15.187:0/4228106375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73bc1623c0 0x7f73bc0b9e00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.369 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.369+0000 7f73c1400640 1 --2- 172.21.15.187:0/4228106375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73bc0d56b0 0x7f73bc158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.369 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.369+0000 7f73c1400640 1 -- 172.21.15.187:0/4228106375 >> 172.21.15.187:0/4228106375 conn(0x7f73bc09df30 msgr2=0x7f73bc0b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:04.370 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.369+0000 7f73c1400640 1 -- 172.21.15.187:0/4228106375 shutdown_connections 2024-09-10T07:34:04.370 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.369+0000 7f73c1400640 1 -- 172.21.15.187:0/4228106375 wait complete. 2024-09-10T07:34:04.383 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2024-09-10T07:34:04.393 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:04.394+0000 7f63d305c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:34:04.454 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:04.454+0000 7f63d305c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:34:04.479 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:04.479+0000 7ff210e15040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:34:04.534 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.534+0000 7fe60d800640 1 Processor -- start 2024-09-10T07:34:04.535 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.534+0000 7fe60d800640 1 -- start start 2024-09-10T07:34:04.536 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.535+0000 7fe60d800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe60815eb30 0x7fe6080d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.536 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.535+0000 7fe60d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d3750 0x7fe6080d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.536 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.535+0000 7fe60d800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6080d5430 con 0x7fe6080d1430 2024-09-10T07:34:04.536 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.535+0000 7fe60d800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe6080d32c0 con 0x7fe60815eb30 2024-09-10T07:34:04.536 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.535+0000 7fe60d800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe6080d26b0 con 0x7fe6080d3750 2024-09-10T07:34:04.536 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.535+0000 7fe5ffe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d3750 0x7fe6080d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.536 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.536+0000 7fe607e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe60815eb30 0x7fe6080d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.536 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.536+0000 7fe5ffe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d3750 0x7fe6080d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:37874/0 (socket says 172.21.15.187:37874) 2024-09-10T07:34:04.537 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.536+0000 7fe5ffe00640 1 -- 172.21.15.187:0/2566754556 learned_addr learned my addr 172.21.15.187:0/2566754556 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:04.537 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.536+0000 7fe5ffe00640 1 -- 172.21.15.187:0/2566754556 >> v2:172.21.15.99:3300/0 conn(0x7fe60815eb30 msgr2=0x7fe6080d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:04.537 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.536+0000 7fe5ffe00640 1 --2- 172.21.15.187:0/2566754556 >> v2:172.21.15.99:3300/0 conn(0x7fe60815eb30 0x7fe6080d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.537 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.536+0000 7fe5ffe00640 1 -- 172.21.15.187:0/2566754556 >> v1:172.21.15.99:6789/0 conn(0x7fe6080d1430 legacy=0x7fe608162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.537 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.536+0000 7fe5ffe00640 1 -- 172.21.15.187:0/2566754556 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6080d2990 con 0x7fe6080d3750 2024-09-10T07:34:04.538 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.537+0000 7fe5ffe00640 1 --2- 172.21.15.187:0/2566754556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d3750 0x7fe6080d0610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009870 tx=0x7fe5f002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9db121e339b5217 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:04.538 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.537+0000 7fe607400640 1 -- 172.21.15.187:0/2566754556 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0037070 con 0x7fe6080d3750 2024-09-10T07:34:04.538 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.537+0000 7fe607400640 1 -- 172.21.15.187:0/2566754556 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f0032440 con 0x7fe6080d3750 2024-09-10T07:34:04.538 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.537+0000 7fe607400640 1 -- 172.21.15.187:0/2566754556 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0032810 con 0x7fe6080d3750 2024-09-10T07:34:04.538 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.538+0000 7fe60d800640 1 -- 172.21.15.187:0/2566754556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d3750 msgr2=0x7fe6080d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.538 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.538+0000 7fe60d800640 1 --2- 172.21.15.187:0/2566754556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d3750 0x7fe6080d0610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009870 tx=0x7fe5f002a250 comp rx=0 tx=0).stop 2024-09-10T07:34:04.538 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.538+0000 7fe60d800640 1 -- 172.21.15.187:0/2566754556 shutdown_connections 2024-09-10T07:34:04.539 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.538+0000 7fe60d800640 1 --2- 172.21.15.187:0/2566754556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d3750 0x7fe6080d0610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.539 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.538+0000 7fe60d800640 1 --2- 172.21.15.187:0/2566754556 >> v2:172.21.15.99:3300/0 conn(0x7fe60815eb30 0x7fe6080d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.539 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.538+0000 7fe60d800640 1 -- 172.21.15.187:0/2566754556 >> 172.21.15.187:0/2566754556 conn(0x7fe60809dd10 msgr2=0x7fe6080d4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:04.539 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.538+0000 7fe60d800640 1 -- 172.21.15.187:0/2566754556 shutdown_connections 2024-09-10T07:34:04.539 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.538+0000 7fe60d800640 1 -- 172.21.15.187:0/2566754556 wait complete. 2024-09-10T07:34:04.539 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.540+0000 7fe60d800640 1 Processor -- start 2024-09-10T07:34:04.539 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.540+0000 7fe60d800640 1 -- start start 2024-09-10T07:34:04.546 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe60d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d1430 0x7fe608150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.546 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe60d800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6080d3750 0x7fe608161980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.546 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe60d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe60815eb30 0x7fe608161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.546 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe60d800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe60815ef10 con 0x7fe60815eb30 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe60d800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe6080d2f50 con 0x7fe6080d3750 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe60d800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe60815f090 con 0x7fe6080d1430 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe5ffe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6080d3750 0x7fe608161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe607e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d1430 0x7fe608150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe5ffe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6080d3750 0x7fe608161980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:41878/0 (socket says 172.21.15.187:41878) 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe5ffe00640 1 -- 172.21.15.187:0/1558850296 learned_addr learned my addr 172.21.15.187:0/1558850296 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe60ce00640 1 --2- 172.21.15.187:0/1558850296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe60815eb30 0x7fe608161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe607e00640 1 -- 172.21.15.187:0/1558850296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6080d3750 msgr2=0x7fe608161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe607e00640 1 --2- 172.21.15.187:0/1558850296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6080d3750 0x7fe608161980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe607e00640 1 -- 172.21.15.187:0/1558850296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe60815eb30 msgr2=0x7fe608161ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe607e00640 1 --2- 172.21.15.187:0/1558850296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe60815eb30 0x7fe608161ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.547 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe607e00640 1 -- 172.21.15.187:0/1558850296 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6080a1fb0 con 0x7fe6080d1430 2024-09-10T07:34:04.548 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.541+0000 7fe5ffe00640 1 --2- 172.21.15.187:0/1558850296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6080d3750 0x7fe608161980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:04.548 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.542+0000 7fe607e00640 1 --2- 172.21.15.187:0/1558850296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d1430 0x7fe608150f30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800e870 tx=0x7fe5f800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:04.548 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.542+0000 7fe604c00640 1 -- 172.21.15.187:0/1558850296 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8017070 con 0x7fe6080d1430 2024-09-10T07:34:04.548 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.542+0000 7fe604c00640 1 -- 172.21.15.187:0/1558850296 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f800ee60 con 0x7fe6080d1430 2024-09-10T07:34:04.548 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.542+0000 7fe60d800640 1 -- 172.21.15.187:0/1558850296 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6080a2290 con 0x7fe6080d1430 2024-09-10T07:34:04.548 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.542+0000 7fe604c00640 1 -- 172.21.15.187:0/1558850296 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800cb60 con 0x7fe6080d1430 2024-09-10T07:34:04.548 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.542+0000 7fe60d800640 1 -- 172.21.15.187:0/1558850296 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6080a1180 con 0x7fe6080d1430 2024-09-10T07:34:04.548 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.542+0000 7fe604c00640 1 -- 172.21.15.187:0/1558850296 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe5f801a070 con 0x7fe6080d1430 2024-09-10T07:34:04.548 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.542+0000 7fe604c00640 1 -- 172.21.15.187:0/1558850296 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe5f80139f0 con 0x7fe6080d1430 2024-09-10T07:34:04.549 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.543+0000 7fe60d800640 1 -- 172.21.15.187:0/1558850296 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6080b99b0 con 0x7fe6080d1430 2024-09-10T07:34:04.549 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:04.547+0000 7ff210e15040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:34:04.549 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.547+0000 7fe604c00640 1 -- 172.21.15.187:0/1558850296 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe6080b99b0 con 0x7fe6080d1430 2024-09-10T07:34:04.619 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.619+0000 7fe60d800640 1 -- 172.21.15.187:0/1558850296 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) -- 0x7fe6080d4a40 con 0x7fe6080d1430 2024-09-10T07:34:04.624 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.624+0000 7fe604c00640 1 -- 172.21.15.187:0/1558850296 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe6080d4a40 con 0x7fe6080d1430 2024-09-10T07:34:04.624 INFO:teuthology.orchestra.run.smithi187.stdout:5 2024-09-10T07:34:04.625 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.625+0000 7fe60d800640 1 -- 172.21.15.187:0/1558850296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d1430 msgr2=0x7fe608150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.625 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.625+0000 7fe60d800640 1 --2- 172.21.15.187:0/1558850296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d1430 0x7fe608150f30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800e870 tx=0x7fe5f800ed30 comp rx=0 tx=0).stop 2024-09-10T07:34:04.625 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.625+0000 7fe60d800640 1 -- 172.21.15.187:0/1558850296 shutdown_connections 2024-09-10T07:34:04.625 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.625+0000 7fe60d800640 1 --2- 172.21.15.187:0/1558850296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe60815eb30 0x7fe608161ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.626 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.625+0000 7fe60d800640 1 --2- 172.21.15.187:0/1558850296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6080d3750 0x7fe608161980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.626 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.625+0000 7fe60d800640 1 --2- 172.21.15.187:0/1558850296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6080d1430 0x7fe608150f30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.626 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.625+0000 7fe60d800640 1 -- 172.21.15.187:0/1558850296 >> 172.21.15.187:0/1558850296 conn(0x7fe60809dd10 msgr2=0x7fe6080cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:04.626 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.625+0000 7fe60d800640 1 -- 172.21.15.187:0/1558850296 shutdown_connections 2024-09-10T07:34:04.626 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.625+0000 7fe60d800640 1 -- 172.21.15.187:0/1558850296 wait complete. 2024-09-10T07:34:04.645 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2024-09-10T07:34:04.795 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.794+0000 7fd97e400640 1 Processor -- start 2024-09-10T07:34:04.795 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.795+0000 7fd97e400640 1 -- start start 2024-09-10T07:34:04.796 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd97e400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd9780d56b0 0x7fd9780b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.796 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd97e400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd9780d1470 0x7fd9780d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.796 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd97e400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9780d3700 con 0x7fd9781623c0 2024-09-10T07:34:04.797 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd97e400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd9780d21a0 con 0x7fd9780d56b0 2024-09-10T07:34:04.797 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd97e400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd9780d0080 con 0x7fd9780d1470 2024-09-10T07:34:04.797 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd977e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd9780d1470 0x7fd9780d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.797 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd977e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd9780d1470 0x7fd9780d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:41880/0 (socket says 172.21.15.187:41880) 2024-09-10T07:34:04.797 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd977e00640 1 -- 172.21.15.187:0/890050222 learned_addr learned my addr 172.21.15.187:0/890050222 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:04.797 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd976a00640 1 --2- 172.21.15.187:0/890050222 >> v2:172.21.15.99:3300/0 conn(0x7fd9780d56b0 0x7fd9780b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.797 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd977e00640 1 -- 172.21.15.187:0/890050222 >> v2:172.21.15.99:3300/0 conn(0x7fd9780d56b0 msgr2=0x7fd9780b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:04.797 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd977e00640 1 --2- 172.21.15.187:0/890050222 >> v2:172.21.15.99:3300/0 conn(0x7fd9780d56b0 0x7fd9780b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.797 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd977e00640 1 -- 172.21.15.187:0/890050222 >> v1:172.21.15.99:6789/0 conn(0x7fd9781623c0 legacy=0x7fd9780d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.797 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.796+0000 7fd977e00640 1 -- 172.21.15.187:0/890050222 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9780cfa70 con 0x7fd9780d1470 2024-09-10T07:34:04.798 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.798+0000 7fd977e00640 1 --2- 172.21.15.187:0/890050222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9780d1470 0x7fd9780d1900 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd9780cbcc0 tx=0x7fd97002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=418268c62b50e507 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:04.798 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.798+0000 7fd976000640 1 -- 172.21.15.187:0/890050222 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970036070 con 0x7fd9780d1470 2024-09-10T07:34:04.798 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.798+0000 7fd976000640 1 -- 172.21.15.187:0/890050222 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd970031600 con 0x7fd9780d1470 2024-09-10T07:34:04.798 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.798+0000 7fd976000640 1 -- 172.21.15.187:0/890050222 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9700319d0 con 0x7fd9780d1470 2024-09-10T07:34:04.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.799+0000 7fd97e400640 1 -- 172.21.15.187:0/890050222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9780d1470 msgr2=0x7fd9780d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.799+0000 7fd97e400640 1 --2- 172.21.15.187:0/890050222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9780d1470 0x7fd9780d1900 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd9780cbcc0 tx=0x7fd97002a730 comp rx=0 tx=0).stop 2024-09-10T07:34:04.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.799+0000 7fd97e400640 1 -- 172.21.15.187:0/890050222 shutdown_connections 2024-09-10T07:34:04.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.799+0000 7fd97e400640 1 --2- 172.21.15.187:0/890050222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9780d1470 0x7fd9780d1900 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.799 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.799+0000 7fd97e400640 1 --2- 172.21.15.187:0/890050222 >> v2:172.21.15.99:3300/0 conn(0x7fd9780d56b0 0x7fd9780b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.800 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.799+0000 7fd97e400640 1 -- 172.21.15.187:0/890050222 >> 172.21.15.187:0/890050222 conn(0x7fd97809df30 msgr2=0x7fd9780d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:04.800 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.799+0000 7fd97e400640 1 -- 172.21.15.187:0/890050222 shutdown_connections 2024-09-10T07:34:04.800 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.799+0000 7fd97e400640 1 -- 172.21.15.187:0/890050222 wait complete. 2024-09-10T07:34:04.800 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.801+0000 7fd97e400640 1 Processor -- start 2024-09-10T07:34:04.801 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.801+0000 7fd97e400640 1 -- start start 2024-09-10T07:34:04.802 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd97e400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9780d1470 0x7fd9780c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd97e400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9780d56b0 0x7fd97815acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd97e400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9781623c0 0x7fd97814e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd97e400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd9780cfd10 con 0x7fd9781623c0 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd97e400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd9780d39a0 con 0x7fd9780d56b0 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd97e400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd9781627a0 con 0x7fd9780d1470 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd977400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9780d1470 0x7fd9780c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd977400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9780d1470 0x7fd9780c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:37892/0 (socket says 172.21.15.187:37892) 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd977400640 1 -- 172.21.15.187:0/18179587 learned_addr learned my addr 172.21.15.187:0/18179587 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd976a00640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9780d56b0 0x7fd97815acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd977e00640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9781623c0 0x7fd97814e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd976a00640 1 -- 172.21.15.187:0/18179587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9780d1470 msgr2=0x7fd9780c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.802+0000 7fd976a00640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9780d1470 0x7fd9780c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.803 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd976a00640 1 -- 172.21.15.187:0/18179587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9781623c0 msgr2=0x7fd97814e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.804 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd976a00640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9781623c0 0x7fd97814e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.804 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd976a00640 1 -- 172.21.15.187:0/18179587 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9780c9040 con 0x7fd9780d56b0 2024-09-10T07:34:04.804 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd977400640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9780d1470 0x7fd9780c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:04.804 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd977e00640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9781623c0 0x7fd97814e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:04.804 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd976a00640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9780d56b0 0x7fd97815acc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd96400e850 tx=0x7fd96400ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:04.805 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd96f400640 1 -- 172.21.15.187:0/18179587 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964017070 con 0x7fd9780d56b0 2024-09-10T07:34:04.805 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd96f400640 1 -- 172.21.15.187:0/18179587 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96400c940 con 0x7fd9780d56b0 2024-09-10T07:34:04.805 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd96f400640 1 -- 172.21.15.187:0/18179587 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96400cd10 con 0x7fd9780d56b0 2024-09-10T07:34:04.805 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd97e400640 1 -- 172.21.15.187:0/18179587 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9780ce750 con 0x7fd9780d56b0 2024-09-10T07:34:04.806 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd97e400640 1 -- 172.21.15.187:0/18179587 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9780cdc70 con 0x7fd9780d56b0 2024-09-10T07:34:04.806 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.803+0000 7fd96f400640 1 -- 172.21.15.187:0/18179587 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd96401a070 con 0x7fd9780d56b0 2024-09-10T07:34:04.806 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.804+0000 7fd96f400640 1 -- 172.21.15.187:0/18179587 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fd964006020 con 0x7fd9780d56b0 2024-09-10T07:34:04.806 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.804+0000 7fd97e400640 1 -- 172.21.15.187:0/18179587 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9780d3c80 con 0x7fd9780d56b0 2024-09-10T07:34:04.806 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.807+0000 7fd96f400640 1 -- 172.21.15.187:0/18179587 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd964006520 con 0x7fd9780d56b0 2024-09-10T07:34:04.879 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.879+0000 7fd97e400640 1 -- 172.21.15.187:0/18179587 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) -- 0x7fd9780d2340 con 0x7fd9780d56b0 2024-09-10T07:34:04.883 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.883+0000 7fd96f400640 1 -- 172.21.15.187:0/18179587 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fd964006700 con 0x7fd9780d56b0 2024-09-10T07:34:04.883 INFO:teuthology.orchestra.run.smithi187.stdout:6 2024-09-10T07:34:04.884 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.884+0000 7fd97e400640 1 -- 172.21.15.187:0/18179587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9780d56b0 msgr2=0x7fd97815acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:04.884 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.884+0000 7fd97e400640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9780d56b0 0x7fd97815acc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd96400e850 tx=0x7fd96400ed10 comp rx=0 tx=0).stop 2024-09-10T07:34:04.884 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.884+0000 7fd97e400640 1 -- 172.21.15.187:0/18179587 shutdown_connections 2024-09-10T07:34:04.884 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.884+0000 7fd97e400640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9781623c0 0x7fd97814e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.885 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.884+0000 7fd97e400640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9780d56b0 0x7fd97815acc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.885 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.884+0000 7fd97e400640 1 --2- 172.21.15.187:0/18179587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9780d1470 0x7fd9780c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:04.885 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.884+0000 7fd97e400640 1 -- 172.21.15.187:0/18179587 >> 172.21.15.187:0/18179587 conn(0x7fd97809df30 msgr2=0x7fd9780b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:04.885 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.884+0000 7fd97e400640 1 -- 172.21.15.187:0/18179587 shutdown_connections 2024-09-10T07:34:04.885 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:04.884+0000 7fd97e400640 1 -- 172.21.15.187:0/18179587 wait complete. 2024-09-10T07:34:04.889 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:04.889+0000 7f63d305c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:34:04.899 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2024-09-10T07:34:04.988 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:04.988+0000 7f63d305c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:34:05.016 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.016+0000 7ff210e15040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:34:05.049 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.049+0000 7fd24dc00640 1 Processor -- start 2024-09-10T07:34:05.049 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.049+0000 7fd24dc00640 1 -- start start 2024-09-10T07:34:05.051 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.050+0000 7fd24dc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2480c9710 0x7fd2481695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:05.051 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.050+0000 7fd24dc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2480d2bd0 con 0x7fd2480d2680 2024-09-10T07:34:05.051 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.050+0000 7fd24dc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2480d2eb0 con 0x7fd24815e970 2024-09-10T07:34:05.051 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.050+0000 7fd24dc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd2480d37e0 con 0x7fd2480c9710 2024-09-10T07:34:05.051 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.051+0000 7fd24d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2480c9710 0x7fd2481695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:05.051 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.051+0000 7fd24d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2480c9710 0x7fd2481695e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:37908/0 (socket says 172.21.15.187:37908) 2024-09-10T07:34:05.051 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.051+0000 7fd24d200640 1 -- 172.21.15.187:0/212279199 learned_addr learned my addr 172.21.15.187:0/212279199 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:05.051 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.051+0000 7fd24d200640 1 -- 172.21.15.187:0/212279199 >> v1:172.21.15.187:6789/0 conn(0x7fd24815e970 legacy=0x7fd2480d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.051 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.051+0000 7fd24d200640 1 -- 172.21.15.187:0/212279199 >> v1:172.21.15.99:6789/0 conn(0x7fd2480d2680 legacy=0x7fd2480cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.051 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.051+0000 7fd24d200640 1 -- 172.21.15.187:0/212279199 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2480d3190 con 0x7fd2480c9710 2024-09-10T07:34:05.052 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.052+0000 7fd24d200640 1 --2- 172.21.15.187:0/212279199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2480c9710 0x7fd2481695e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd240009e80 tx=0x7fd24002a820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7d46f84b87bc324 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:05.052 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.052+0000 7fd246a00640 1 -- 172.21.15.187:0/212279199 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240037070 con 0x7fd2480c9710 2024-09-10T07:34:05.052 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.052+0000 7fd246a00640 1 -- 172.21.15.187:0/212279199 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd240032410 con 0x7fd2480c9710 2024-09-10T07:34:05.052 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.052+0000 7fd246a00640 1 -- 172.21.15.187:0/212279199 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2400327e0 con 0x7fd2480c9710 2024-09-10T07:34:05.053 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.053+0000 7fd24dc00640 1 -- 172.21.15.187:0/212279199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2480c9710 msgr2=0x7fd2481695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.053 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.053+0000 7fd24dc00640 1 --2- 172.21.15.187:0/212279199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2480c9710 0x7fd2481695e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd240009e80 tx=0x7fd24002a820 comp rx=0 tx=0).stop 2024-09-10T07:34:05.053 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.053+0000 7fd24dc00640 1 -- 172.21.15.187:0/212279199 shutdown_connections 2024-09-10T07:34:05.053 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.053+0000 7fd24dc00640 1 --2- 172.21.15.187:0/212279199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2480c9710 0x7fd2481695e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.053 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.053+0000 7fd24dc00640 1 -- 172.21.15.187:0/212279199 >> 172.21.15.187:0/212279199 conn(0x7fd24809de00 msgr2=0x7fd2480d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:05.053 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.053+0000 7fd24dc00640 1 -- 172.21.15.187:0/212279199 shutdown_connections 2024-09-10T07:34:05.053 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.053+0000 7fd24dc00640 1 -- 172.21.15.187:0/212279199 wait complete. 2024-09-10T07:34:05.055 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.055+0000 7fd24dc00640 1 Processor -- start 2024-09-10T07:34:05.055 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.055+0000 7fd24dc00640 1 -- start start 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.055+0000 7fd24dc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2480c9710 0x7fd2480b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.055+0000 7fd24dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2480d2680 0x7fd248156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.055+0000 7fd24dc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd24815e970 0x7fd2480cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24dc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd24815eed0 con 0x7fd2480d2680 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24dc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd24815ed50 con 0x7fd2480c9710 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24dc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd2480cfc90 con 0x7fd24815e970 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd24815e970 0x7fd2480cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd24815e970 0x7fd2480cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:37918/0 (socket says 172.21.15.187:37918) 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24d200640 1 -- 172.21.15.187:0/1621888489 learned_addr learned my addr 172.21.15.187:0/1621888489 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd247e00640 1 --2- 172.21.15.187:0/1621888489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2480c9710 0x7fd2480b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:05.057 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd247400640 1 --2- 172.21.15.187:0/1621888489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2480d2680 0x7fd248156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24d200640 1 -- 172.21.15.187:0/1621888489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2480c9710 msgr2=0x7fd2480b9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24d200640 1 --2- 172.21.15.187:0/1621888489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2480c9710 0x7fd2480b9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24d200640 1 -- 172.21.15.187:0/1621888489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2480d2680 msgr2=0x7fd248156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24d200640 1 --2- 172.21.15.187:0/1621888489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2480d2680 0x7fd248156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.056+0000 7fd24d200640 1 -- 172.21.15.187:0/1621888489 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd248157560 con 0x7fd24815e970 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.057+0000 7fd24d200640 1 --2- 172.21.15.187:0/1621888489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd24815e970 0x7fd2480cdeb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd240009fa0 tx=0x7fd240004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.057+0000 7fd23fe00640 1 -- 172.21.15.187:0/1621888489 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240037050 con 0x7fd24815e970 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.057+0000 7fd23fe00640 1 -- 172.21.15.187:0/1621888489 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd240043070 con 0x7fd24815e970 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.057+0000 7fd23fe00640 1 -- 172.21.15.187:0/1621888489 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240009510 con 0x7fd24815e970 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.057+0000 7fd24dc00640 1 -- 172.21.15.187:0/1621888489 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd248157840 con 0x7fd24815e970 2024-09-10T07:34:05.058 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.057+0000 7fd24dc00640 1 -- 172.21.15.187:0/1621888489 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd248157e00 con 0x7fd24815e970 2024-09-10T07:34:05.059 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.057+0000 7fd23fe00640 1 -- 172.21.15.187:0/1621888489 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd24003ca90 con 0x7fd24815e970 2024-09-10T07:34:05.059 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.057+0000 7fd23fe00640 1 -- 172.21.15.187:0/1621888489 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fd24003cd80 con 0x7fd24815e970 2024-09-10T07:34:05.059 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.058+0000 7fd24dc00640 1 -- 172.21.15.187:0/1621888489 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2480cf580 con 0x7fd24815e970 2024-09-10T07:34:05.060 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.060+0000 7fd23fe00640 1 -- 172.21.15.187:0/1621888489 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd240048460 con 0x7fd24815e970 2024-09-10T07:34:05.109 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.109+0000 7f63d305c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:34:05.119 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.119+0000 7ff210e15040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:34:05.132 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.132+0000 7fd24dc00640 1 -- 172.21.15.187:0/1621888489 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) -- 0x7fd24806d0c0 con 0x7fd24815e970 2024-09-10T07:34:05.142 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.142+0000 7fd23fe00640 1 -- 172.21.15.187:0/1621888489 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fd240048640 con 0x7fd24815e970 2024-09-10T07:34:05.142 INFO:teuthology.orchestra.run.smithi187.stdout:7 2024-09-10T07:34:05.143 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.143+0000 7fd24dc00640 1 -- 172.21.15.187:0/1621888489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd24815e970 msgr2=0x7fd2480cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.143 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.143+0000 7fd24dc00640 1 --2- 172.21.15.187:0/1621888489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd24815e970 0x7fd2480cdeb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd240009fa0 tx=0x7fd240004a40 comp rx=0 tx=0).stop 2024-09-10T07:34:05.143 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.143+0000 7fd24dc00640 1 -- 172.21.15.187:0/1621888489 shutdown_connections 2024-09-10T07:34:05.143 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.143+0000 7fd24dc00640 1 --2- 172.21.15.187:0/1621888489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd24815e970 0x7fd2480cdeb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.144 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.143+0000 7fd24dc00640 1 --2- 172.21.15.187:0/1621888489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2480d2680 0x7fd248156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.144 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.143+0000 7fd24dc00640 1 --2- 172.21.15.187:0/1621888489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2480c9710 0x7fd2480b9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.144 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.143+0000 7fd24dc00640 1 -- 172.21.15.187:0/1621888489 >> 172.21.15.187:0/1621888489 conn(0x7fd24809de00 msgr2=0x7fd2480c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:05.144 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.143+0000 7fd24dc00640 1 -- 172.21.15.187:0/1621888489 shutdown_connections 2024-09-10T07:34:05.144 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:05.143+0000 7fd24dc00640 1 -- 172.21.15.187:0/1621888489 wait complete. 2024-09-10T07:34:05.158 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T07:34:05.158 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T07:34:05.162 INFO:tasks.ceph.osd.0:Started 2024-09-10T07:34:05.162 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T07:34:05.162 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T07:34:05.166 INFO:tasks.ceph.osd.1:Started 2024-09-10T07:34:05.166 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T07:34:05.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T07:34:05.166 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.164+0000 7f63d305c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:34:05.171 INFO:tasks.ceph.osd.2:Started 2024-09-10T07:34:05.171 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T07:34:05.172 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T07:34:05.176 INFO:tasks.ceph.osd.3:Started 2024-09-10T07:34:05.177 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T07:34:05.177 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T07:34:05.181 INFO:tasks.ceph.osd.4:Started 2024-09-10T07:34:05.182 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T07:34:05.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T07:34:05.188 INFO:tasks.ceph.osd.5:Started 2024-09-10T07:34:05.188 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T07:34:05.188 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T07:34:05.192 INFO:tasks.ceph.osd.6:Started 2024-09-10T07:34:05.192 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T07:34:05.192 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T07:34:05.197 INFO:tasks.ceph.osd.7:Started 2024-09-10T07:34:05.197 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:05.284 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.281+0000 7ff210e15040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:34:05.329 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-10T07:34:05.329+0000 7f2b0eee0640 -1 Falling back to public interface 2024-09-10T07:34:05.334 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T07:34:05.334+0000 7f8afe9dd640 -1 Falling back to public interface 2024-09-10T07:34:05.337 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-10T07:34:05.337+0000 7fb77581c640 -1 Falling back to public interface 2024-09-10T07:34:05.339 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-10T07:34:05.340+0000 7f4015c28640 -1 Falling back to public interface 2024-09-10T07:34:05.342 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-10T07:34:05.342+0000 7fb773e00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6814/0: (98) Address already in use 2024-09-10T07:34:05.347 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T07:34:05.347+0000 7f725ac33640 -1 Falling back to public interface 2024-09-10T07:34:05.348 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T07:34:05.348+0000 7f74e42b0640 -1 Falling back to public interface 2024-09-10T07:34:05.350 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-10T07:34:05.351+0000 7f2b0eee0640 -1 osd.5 0 log_to_monitors true 2024-09-10T07:34:05.352 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T07:34:05.352+0000 7f0ab6589640 -1 Falling back to public interface 2024-09-10T07:34:05.353 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T07:34:05.354+0000 7f8afe9dd640 -1 osd.0 0 log_to_monitors true 2024-09-10T07:34:05.361 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.361+0000 7f63d305c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:34:05.362 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-10T07:34:05.362+0000 7f4015c28640 -1 osd.7 0 log_to_monitors true 2024-09-10T07:34:05.363 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.363+0000 7ff210e15040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:34:05.363 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-10T07:34:05.364+0000 7fb77581c640 -1 osd.6 0 log_to_monitors true 2024-09-10T07:34:05.369 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-10T07:34:05.368+0000 7ff2d3e1e640 -1 Falling back to public interface 2024-09-10T07:34:05.371 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T07:34:05.372+0000 7f74e42b0640 -1 osd.1 0 log_to_monitors true 2024-09-10T07:34:05.376 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T07:34:05.376+0000 7f725ac33640 -1 osd.2 0 log_to_monitors true 2024-09-10T07:34:05.390 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T07:34:05.391+0000 7f0ab6589640 -1 osd.3 0 log_to_monitors true 2024-09-10T07:34:05.400 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-10T07:34:05.400+0000 7ff2d3e1e640 -1 osd.4 0 log_to_monitors true 2024-09-10T07:34:05.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.410+0000 7f6cfb000640 1 Processor -- start 2024-09-10T07:34:05.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.411+0000 7f6cfb000640 1 -- start start 2024-09-10T07:34:05.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cfb000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6cf415ef50 0x7f6cf40d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:05.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cfb000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6cf40d3240 0x7f6cf40d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cfb000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf40b7a90 con 0x7f6cf40d5780 2024-09-10T07:34:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cfb000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf40d3740 con 0x7f6cf40d3240 2024-09-10T07:34:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cfb000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf40d3a20 con 0x7f6cf415ef50 2024-09-10T07:34:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cf3e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6cf415ef50 0x7f6cf40d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cf3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6cf40d3240 0x7f6cf40d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cf9000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6cf40d5780 0x7f6cf40cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59544/0 (socket says 172.21.15.99:59544) 2024-09-10T07:34:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cf9000640 1 -- 172.21.15.99:0/2212600949 learned_addr learned my addr 172.21.15.99:0/2212600949 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cf3400640 1 -- 172.21.15.99:0/2212600949 >> v2:172.21.15.187:3300/0 conn(0x7f6cf415ef50 msgr2=0x7f6cf40d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cf3400640 1 --2- 172.21.15.99:0/2212600949 >> v2:172.21.15.187:3300/0 conn(0x7f6cf415ef50 0x7f6cf40d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cf3400640 1 -- 172.21.15.99:0/2212600949 >> v1:172.21.15.99:6789/0 conn(0x7f6cf40d5780 legacy=0x7f6cf40cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.412+0000 7f6cf3400640 1 -- 172.21.15.99:0/2212600949 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf40b7d00 con 0x7f6cf40d3240 2024-09-10T07:34:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.413+0000 7f6cf3400640 1 --2- 172.21.15.99:0/2212600949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf40d3240 0x7f6cf40d18e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40b7850 tx=0x7f6ce002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732c5cb67e45eea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.414+0000 7f6cf2a00640 1 -- 172.21.15.99:0/2212600949 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0037070 con 0x7f6cf40d3240 2024-09-10T07:34:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.414+0000 7f6cf2a00640 1 -- 172.21.15.99:0/2212600949 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce0032440 con 0x7f6cf40d3240 2024-09-10T07:34:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.414+0000 7f6cf2a00640 1 -- 172.21.15.99:0/2212600949 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce002ae60 con 0x7f6cf40d3240 2024-09-10T07:34:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.414+0000 7f6cfb000640 1 -- 172.21.15.99:0/2212600949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf40d3240 msgr2=0x7f6cf40d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.414+0000 7f6cfb000640 1 --2- 172.21.15.99:0/2212600949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf40d3240 0x7f6cf40d18e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40b7850 tx=0x7f6ce002a110 comp rx=0 tx=0).stop 2024-09-10T07:34:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.414+0000 7f6cfb000640 1 -- 172.21.15.99:0/2212600949 shutdown_connections 2024-09-10T07:34:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.414+0000 7f6cfb000640 1 --2- 172.21.15.99:0/2212600949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf40d3240 0x7f6cf40d18e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.414+0000 7f6cfb000640 1 --2- 172.21.15.99:0/2212600949 >> v2:172.21.15.187:3300/0 conn(0x7f6cf415ef50 0x7f6cf40d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.414+0000 7f6cfb000640 1 -- 172.21.15.99:0/2212600949 >> 172.21.15.99:0/2212600949 conn(0x7f6cf40d4c60 msgr2=0x7f6cf40d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.415+0000 7f6cfb000640 1 -- 172.21.15.99:0/2212600949 shutdown_connections 2024-09-10T07:34:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.415+0000 7f6cfb000640 1 -- 172.21.15.99:0/2212600949 wait complete. 2024-09-10T07:34:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.416+0000 7f6cfb000640 1 Processor -- start 2024-09-10T07:34:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.416+0000 7f6cfb000640 1 -- start start 2024-09-10T07:34:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.417+0000 7f6cfb000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf40d3240 0x7f6cf40c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.417+0000 7f6cfb000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf40d5780 0x7f6cf40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.417+0000 7f6cfb000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf415ef50 0x7f6cf41f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.417+0000 7f6cfb000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf40d21a0 con 0x7f6cf415ef50 2024-09-10T07:34:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.417+0000 7f6cfb000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf40d2020 con 0x7f6cf40d5780 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.417+0000 7f6cfb000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf40b9510 con 0x7f6cf40d3240 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.417+0000 7f6cf9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf415ef50 0x7f6cf41f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.417+0000 7f6cf9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf415ef50 0x7f6cf41f8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46162/0 (socket says 172.21.15.99:46162) 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.417+0000 7f6cf9000640 1 -- 172.21.15.99:0/1388397016 learned_addr learned my addr 172.21.15.99:0/1388397016 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.417+0000 7f6cf3400640 1 --2- 172.21.15.99:0/1388397016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf40d5780 0x7f6cf40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cf3e00640 1 --2- 172.21.15.99:0/1388397016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf40d3240 0x7f6cf40c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cf9000640 1 -- 172.21.15.99:0/1388397016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf40d3240 msgr2=0x7f6cf40c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cf9000640 1 --2- 172.21.15.99:0/1388397016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf40d3240 0x7f6cf40c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cf9000640 1 -- 172.21.15.99:0/1388397016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf40d5780 msgr2=0x7f6cf40cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cf9000640 1 --2- 172.21.15.99:0/1388397016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf40d5780 0x7f6cf40cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cf9000640 1 -- 172.21.15.99:0/1388397016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf40c8850 con 0x7f6cf415ef50 2024-09-10T07:34:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cf3400640 1 --2- 172.21.15.99:0/1388397016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf40d5780 0x7f6cf40cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cf9000640 1 --2- 172.21.15.99:0/1388397016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf415ef50 0x7f6cf41f8570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00caa0 tx=0x7f6cec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cebe00640 1 -- 172.21.15.99:0/1388397016 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec017070 con 0x7f6cf415ef50 2024-09-10T07:34:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cebe00640 1 -- 172.21.15.99:0/1388397016 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec00ac00 con 0x7f6cf415ef50 2024-09-10T07:34:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cebe00640 1 -- 172.21.15.99:0/1388397016 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec012620 con 0x7f6cf415ef50 2024-09-10T07:34:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.418+0000 7f6cfb000640 1 -- 172.21.15.99:0/1388397016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf40c8b10 con 0x7f6cf415ef50 2024-09-10T07:34:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.419+0000 7f6cfb000640 1 -- 172.21.15.99:0/1388397016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf40c90d0 con 0x7f6cf415ef50 2024-09-10T07:34:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.419+0000 7f6cebe00640 1 -- 172.21.15.99:0/1388397016 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6cec01a070 con 0x7f6cf415ef50 2024-09-10T07:34:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.419+0000 7f6cebe00640 1 -- 172.21.15.99:0/1388397016 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6cec007610 con 0x7f6cf415ef50 2024-09-10T07:34:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.420+0000 7f6cfb000640 1 -- 172.21.15.99:0/1388397016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf40d13a0 con 0x7f6cf415ef50 2024-09-10T07:34:05.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.422+0000 7f6cebe00640 1 -- 172.21.15.99:0/1388397016 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6cec007810 con 0x7f6cf415ef50 2024-09-10T07:34:05.441 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.441+0000 7f63d305c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:34:05.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.484+0000 7f6cfb000640 1 -- 172.21.15.99:0/1388397016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cf40d02b0 con 0x7f6cf415ef50 2024-09-10T07:34:05.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.485+0000 7f6cebe00640 1 -- 172.21.15.99:0/1388397016 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6cec0079f0 con 0x7f6cf415ef50 2024-09-10T07:34:05.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:05.485 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":10,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:05.134938+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:05.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.486+0000 7f6cfb000640 1 -- 172.21.15.99:0/1388397016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf415ef50 msgr2=0x7f6cf41f8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:05.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.486+0000 7f6cfb000640 1 --2- 172.21.15.99:0/1388397016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf415ef50 0x7f6cf41f8570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00caa0 tx=0x7f6cec00cf60 comp rx=0 tx=0).stop 2024-09-10T07:34:05.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.486+0000 7f6cfb000640 1 -- 172.21.15.99:0/1388397016 shutdown_connections 2024-09-10T07:34:05.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.486+0000 7f6cfb000640 1 --2- 172.21.15.99:0/1388397016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cf415ef50 0x7f6cf41f8570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.486+0000 7f6cfb000640 1 --2- 172.21.15.99:0/1388397016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf40d5780 0x7f6cf40cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.486+0000 7f6cfb000640 1 --2- 172.21.15.99:0/1388397016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf40d3240 0x7f6cf40c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:05.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.486+0000 7f6cfb000640 1 -- 172.21.15.99:0/1388397016 >> 172.21.15.99:0/1388397016 conn(0x7f6cf40d4c60 msgr2=0x7f6cf40d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:05.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.486+0000 7f6cfb000640 1 -- 172.21.15.99:0/1388397016 shutdown_connections 2024-09-10T07:34:05.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:05.486+0000 7f6cfb000640 1 -- 172.21.15.99:0/1388397016 wait complete. 2024-09-10T07:34:05.497 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.497+0000 7f63d305c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:34:05.502 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T07:34:05.502 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T07:34:05.507 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.507+0000 7ff210e15040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:34:05.569 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.568+0000 7ff210e15040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:34:05.621 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.621+0000 7ff210e15040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:34:05.623 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.624+0000 7f63d305c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:34:05.681 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.681+0000 7f63d305c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:34:05.741 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.741+0000 7f63d305c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:34:05.745 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.746+0000 7ff210e15040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:34:05.803 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.803+0000 7ff210e15040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:34:05.816 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.817+0000 7f63d305c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:34:05.863 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.863+0000 7ff210e15040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:34:05.868 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.868+0000 7f63d305c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:34:05.919 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:05.920+0000 7f63d305c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:34:05.942 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.942+0000 7ff210e15040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:34:05.994 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:05.994+0000 7ff210e15040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:34:06.045 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:06.045+0000 7ff210e15040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:34:06.308 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:06.445 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.445+0000 7ff57be00640 1 Processor -- start 2024-09-10T07:34:06.445 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.445+0000 7ff57be00640 1 -- start start 2024-09-10T07:34:06.446 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.446+0000 7ff57be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff57c06f5b0 0x7ff57c06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:06.446 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.446+0000 7ff57be00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff57c09c190 con 0x7ff57c15cd40 2024-09-10T07:34:06.446 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.446+0000 7ff57be00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff57c0b4e90 con 0x7ff57c15c960 2024-09-10T07:34:06.446 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.446+0000 7ff57be00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff57c0cda20 con 0x7ff57c06f5b0 2024-09-10T07:34:06.446 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.446+0000 7ff57b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff57c06f5b0 0x7ff57c06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:06.446 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.446+0000 7ff57b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff57c06f5b0 0x7ff57c06fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46168/0 (socket says 172.21.15.99:46168) 2024-09-10T07:34:06.447 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.446+0000 7ff57b400640 1 -- 172.21.15.99:0/2119525293 learned_addr learned my addr 172.21.15.99:0/2119525293 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:06.447 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.446+0000 7ff57aa00640 1 --1- 172.21.15.99:0/2119525293 >> v1:172.21.15.187:6789/0 conn(0x7ff57c15c960 0x7ff57c0d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:38528/0 (socket says 172.21.15.99:38528) 2024-09-10T07:34:06.447 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.447+0000 7ff579600640 1 -- 172.21.15.99:0/2119525293 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435305548 0 0) 0x7ff568001110 con 0x7ff57c15cd40 2024-09-10T07:34:06.447 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.447+0000 7ff57b400640 1 -- 172.21.15.99:0/2119525293 >> v1:172.21.15.187:6789/0 conn(0x7ff57c15c960 legacy=0x7ff57c0d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:06.447 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.447+0000 7ff57b400640 1 -- 172.21.15.99:0/2119525293 >> v1:172.21.15.99:6789/0 conn(0x7ff57c15cd40 legacy=0x7ff57c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:06.447 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.447+0000 7ff57b400640 1 -- 172.21.15.99:0/2119525293 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c0b5170 con 0x7ff57c06f5b0 2024-09-10T07:34:06.448 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.448+0000 7ff57b400640 1 --2- 172.21.15.99:0/2119525293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 0x7ff57c06fa00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0cdba0 tx=0x7ff57402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c93cf73a605b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:06.448 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.449+0000 7ff579600640 1 -- 172.21.15.99:0/2119525293 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574036070 con 0x7ff57c06f5b0 2024-09-10T07:34:06.448 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.449+0000 7ff579600640 1 -- 172.21.15.99:0/2119525293 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff574031600 con 0x7ff57c06f5b0 2024-09-10T07:34:06.448 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.449+0000 7ff579600640 1 -- 172.21.15.99:0/2119525293 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5740319d0 con 0x7ff57c06f5b0 2024-09-10T07:34:06.449 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.449+0000 7ff57be00640 1 -- 172.21.15.99:0/2119525293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 msgr2=0x7ff57c06fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:06.449 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.449+0000 7ff57be00640 1 --2- 172.21.15.99:0/2119525293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 0x7ff57c06fa00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0cdba0 tx=0x7ff57402a6c0 comp rx=0 tx=0).stop 2024-09-10T07:34:06.449 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.449+0000 7ff57be00640 1 -- 172.21.15.99:0/2119525293 shutdown_connections 2024-09-10T07:34:06.450 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.449+0000 7ff57be00640 1 --2- 172.21.15.99:0/2119525293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 0x7ff57c06fa00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:06.450 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.449+0000 7ff57be00640 1 -- 172.21.15.99:0/2119525293 >> 172.21.15.99:0/2119525293 conn(0x7ff57c09ba50 msgr2=0x7ff57c0b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:06.450 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.449+0000 7ff57be00640 1 -- 172.21.15.99:0/2119525293 shutdown_connections 2024-09-10T07:34:06.450 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.450+0000 7ff57be00640 1 -- 172.21.15.99:0/2119525293 wait complete. 2024-09-10T07:34:06.451 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.451+0000 7ff57be00640 1 Processor -- start 2024-09-10T07:34:06.451 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.451+0000 7ff57be00640 1 -- start start 2024-09-10T07:34:06.453 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 0x7ff57c155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:06.453 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57be00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff57c15c960 0x7ff57c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57c15cd40 0x7ff57c157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57be00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c0cd490 con 0x7ff57c06f5b0 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57be00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c0cd310 con 0x7ff57c15c960 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57be00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff57c0ce5c0 con 0x7ff57c15cd40 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 0x7ff57c155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 0x7ff57c155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46172/0 (socket says 172.21.15.99:46172) 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57aa00640 1 -- 172.21.15.99:0/728668469 learned_addr learned my addr 172.21.15.99:0/728668469 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57b400640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57c15cd40 0x7ff57c157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.452+0000 7ff57a000640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff57c15c960 0x7ff57c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff57aa00640 1 -- 172.21.15.99:0/728668469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57c15cd40 msgr2=0x7ff57c157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff57aa00640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57c15cd40 0x7ff57c157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff57aa00640 1 -- 172.21.15.99:0/728668469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff57c15c960 msgr2=0x7ff57c0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:06.454 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff57aa00640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff57c15c960 0x7ff57c0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff57aa00640 1 -- 172.21.15.99:0/728668469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c1f5260 con 0x7ff57c06f5b0 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff57a000640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff57c15c960 0x7ff57c0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff57b400640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57c15cd40 0x7ff57c157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff57aa00640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 0x7ff57c155a10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c780 tx=0x7ff56c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff572a00640 1 -- 172.21.15.99:0/728668469 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c018070 con 0x7ff57c06f5b0 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff572a00640 1 -- 172.21.15.99:0/728668469 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56c0072d0 con 0x7ff57c06f5b0 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff572a00640 1 -- 172.21.15.99:0/728668469 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0047e0 con 0x7ff57c06f5b0 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff57be00640 1 -- 172.21.15.99:0/728668469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57c1f5540 con 0x7ff57c06f5b0 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.453+0000 7ff57be00640 1 -- 172.21.15.99:0/728668469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57c1f5b00 con 0x7ff57c06f5b0 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.454+0000 7ff572a00640 1 -- 172.21.15.99:0/728668469 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff56c004980 con 0x7ff57c06f5b0 2024-09-10T07:34:06.455 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.454+0000 7ff572a00640 1 -- 172.21.15.99:0/728668469 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1883+0+0 (secure 0 0 0) 0x7ff56c004c70 con 0x7ff57c06f5b0 2024-09-10T07:34:06.456 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.454+0000 7ff57be00640 1 -- 172.21.15.99:0/728668469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57c0b4ab0 con 0x7ff57c06f5b0 2024-09-10T07:34:06.456 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.457+0000 7ff572a00640 1 -- 172.21.15.99:0/728668469 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff56c021020 con 0x7ff57c06f5b0 2024-09-10T07:34:06.518 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.518+0000 7ff57be00640 1 -- 172.21.15.99:0/728668469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff57c0b7900 con 0x7ff57c06f5b0 2024-09-10T07:34:06.518 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.519+0000 7ff572a00640 1 -- 172.21.15.99:0/728668469 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+7058 (secure 0 0 0) 0x7ff56c00ae10 con 0x7ff57c06f5b0 2024-09-10T07:34:06.519 INFO:teuthology.misc.health.smithi099.stdout: 2024-09-10T07:34:06.519 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":11,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:06.136880+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:06.520 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.520+0000 7ff57be00640 1 -- 172.21.15.99:0/728668469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 msgr2=0x7ff57c155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:06.520 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.520+0000 7ff57be00640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 0x7ff57c155a10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c780 tx=0x7ff56c00cc40 comp rx=0 tx=0).stop 2024-09-10T07:34:06.520 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.520+0000 7ff57be00640 1 -- 172.21.15.99:0/728668469 shutdown_connections 2024-09-10T07:34:06.520 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.520+0000 7ff57be00640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57c15cd40 0x7ff57c157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:06.520 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.520+0000 7ff57be00640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff57c15c960 0x7ff57c0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:06.520 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.520+0000 7ff57be00640 1 --2- 172.21.15.99:0/728668469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff57c06f5b0 0x7ff57c155a10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:06.520 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.520+0000 7ff57be00640 1 -- 172.21.15.99:0/728668469 >> 172.21.15.99:0/728668469 conn(0x7ff57c09ba50 msgr2=0x7ff57c15f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:06.520 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.520+0000 7ff57be00640 1 -- 172.21.15.99:0/728668469 shutdown_connections 2024-09-10T07:34:06.520 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:06.520+0000 7ff57be00640 1 -- 172.21.15.99:0/728668469 wait complete. 2024-09-10T07:34:06.532 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T07:34:06.675 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:06.676+0000 7f63d305c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:34:06.792 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-10T07:34:06.790+0000 7ff210e15040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:34:07.144 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T07:34:07.144+0000 7f7255a00640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T07:34:07.144 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T07:34:07.144+0000 7f8af9800640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T07:34:07.144 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T07:34:07.144+0000 7f0ab1e00640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T07:34:07.146 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T07:34:07.147+0000 7f8af1600640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:34:07.147 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T07:34:07.147+0000 7f724d800640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:34:07.149 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T07:34:07.149+0000 7f74dfc00640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T07:34:07.149 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-10T07:34:07.149+0000 7ff2cf200640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T07:34:07.149 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-10T07:34:07.149+0000 7f2b09e00640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T07:34:07.150 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-10T07:34:07.149+0000 7fb770c00640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T07:34:07.150 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-10T07:34:07.149+0000 7f4011400640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T07:34:07.150 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T07:34:07.150+0000 7f0aa9200640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:34:07.151 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T07:34:07.151+0000 7f74d7000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:34:07.152 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-10T07:34:07.152+0000 7ff2c6600640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:34:07.152 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-10T07:34:07.152+0000 7f2b01c00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:34:07.152 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-10T07:34:07.152+0000 7f4008800640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:34:07.153 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-10T07:34:07.152+0000 7fb768000640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T07:34:07.703 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:07.703+0000 7f6373400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T07:34:07.703 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T07:34:07.703+0000 7f6373400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T07:34:13.339 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:13.484 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.485+0000 7fb0cfe00640 1 Processor -- start 2024-09-10T07:34:13.484 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.485+0000 7fb0cfe00640 1 -- start start 2024-09-10T07:34:13.486 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.486+0000 7fb0cfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb0d015eb00 0x7fb0d00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.486 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.486+0000 7fb0cfe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0d00b6ba0 0x7fb0d00b8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.486 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.486+0000 7fb0cfe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d00d3cd0 con 0x7fb0d00d3510 2024-09-10T07:34:13.486 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.486+0000 7fb0cfe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d00d3fb0 con 0x7fb0d015eb00 2024-09-10T07:34:13.486 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.486+0000 7fb0cfe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d00d4290 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.487 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.486+0000 7fb0cea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb0d015eb00 0x7fb0d00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:13.487 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.486+0000 7fb0cea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb0d015eb00 0x7fb0d00cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54066/0 (socket says 172.21.15.99:54066) 2024-09-10T07:34:13.487 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.486+0000 7fb0cea00640 1 -- 172.21.15.99:0/1763188600 learned_addr learned my addr 172.21.15.99:0/1763188600 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:13.487 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.487+0000 7fb0cf400640 1 --2- 172.21.15.99:0/1763188600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0d00b6ba0 0x7fb0d00b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:13.487 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.487+0000 7fb0cea00640 1 -- 172.21.15.99:0/1763188600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0d00b6ba0 msgr2=0x7fb0d00b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:13.487 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.487+0000 7fb0cea00640 1 --2- 172.21.15.99:0/1763188600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0d00b6ba0 0x7fb0d00b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.487 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.487+0000 7fb0cea00640 1 -- 172.21.15.99:0/1763188600 >> v1:172.21.15.99:6789/0 conn(0x7fb0d00d3510 legacy=0x7fb0d00b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.487 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.487+0000 7fb0cea00640 1 -- 172.21.15.99:0/1763188600 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d00d4570 con 0x7fb0d015eb00 2024-09-10T07:34:13.487 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.487+0000 7fb0cf400640 1 --2- 172.21.15.99:0/1763188600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0d00b6ba0 0x7fb0d00b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:13.489 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.488+0000 7fb0cea00640 1 --2- 172.21.15.99:0/1763188600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d015eb00 0x7fb0d00cfd70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009870 tx=0x7fb0c002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754fb1f9311ddf33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:13.489 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.488+0000 7fb0cd600640 1 -- 172.21.15.99:0/1763188600 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0037070 con 0x7fb0d015eb00 2024-09-10T07:34:13.489 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.488+0000 7fb0cd600640 1 -- 172.21.15.99:0/1763188600 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c0032440 con 0x7fb0d015eb00 2024-09-10T07:34:13.489 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.488+0000 7fb0cd600640 1 -- 172.21.15.99:0/1763188600 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0032810 con 0x7fb0d015eb00 2024-09-10T07:34:13.489 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.489+0000 7fb0cfe00640 1 -- 172.21.15.99:0/1763188600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d015eb00 msgr2=0x7fb0d00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.490 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.489+0000 7fb0cfe00640 1 --2- 172.21.15.99:0/1763188600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d015eb00 0x7fb0d00cfd70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009870 tx=0x7fb0c002a1c0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.490 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.489+0000 7fb0cfe00640 1 -- 172.21.15.99:0/1763188600 shutdown_connections 2024-09-10T07:34:13.490 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.489+0000 7fb0cfe00640 1 --2- 172.21.15.99:0/1763188600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0d00b6ba0 0x7fb0d00b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.490 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.489+0000 7fb0cfe00640 1 --2- 172.21.15.99:0/1763188600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d015eb00 0x7fb0d00cfd70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.490 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.489+0000 7fb0cfe00640 1 -- 172.21.15.99:0/1763188600 >> 172.21.15.99:0/1763188600 conn(0x7fb0d00d1490 msgr2=0x7fb0d00d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:13.490 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.489+0000 7fb0cfe00640 1 -- 172.21.15.99:0/1763188600 shutdown_connections 2024-09-10T07:34:13.490 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.489+0000 7fb0cfe00640 1 -- 172.21.15.99:0/1763188600 wait complete. 2024-09-10T07:34:13.492 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.490+0000 7fb0cfe00640 1 Processor -- start 2024-09-10T07:34:13.492 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.491+0000 7fb0cfe00640 1 -- start start 2024-09-10T07:34:13.492 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.491+0000 7fb0cfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d00b6ba0 0x7fb0d015dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.492 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.491+0000 7fb0cfe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0d00d3510 0x7fb0d0160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.492 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cfe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0d015eb00 0x7fb0d0160f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.492 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cfe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d00d3950 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.492 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cfe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d015eee0 con 0x7fb0d015eb00 2024-09-10T07:34:13.492 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cfe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d00b8640 con 0x7fb0d00d3510 2024-09-10T07:34:13.492 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d00b6ba0 0x7fb0d015dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d00b6ba0 0x7fb0d015dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54076/0 (socket says 172.21.15.99:54076) 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cea00640 1 -- 172.21.15.99:0/3516625473 learned_addr learned my addr 172.21.15.99:0/3516625473 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cea00640 1 -- 172.21.15.99:0/3516625473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0d00d3510 msgr2=0x7fb0d0160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cea00640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0d00d3510 0x7fb0d0160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cea00640 1 -- 172.21.15.99:0/3516625473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0d015eb00 msgr2=0x7fb0d0160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cea00640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0d015eb00 0x7fb0d0160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cea00640 1 -- 172.21.15.99:0/3516625473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d01f5380 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.492+0000 7fb0cea00640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d00b6ba0 0x7fb0d015dc80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0000c00 tx=0x7fb0c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.493+0000 7fb0c6a00640 1 -- 172.21.15.99:0/3516625473 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0041020 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.493+0000 7fb0c6a00640 1 -- 172.21.15.99:0/3516625473 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c00306c0 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.493+0000 7fb0cfe00640 1 -- 172.21.15.99:0/3516625473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d00cd3f0 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.493 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.493+0000 7fb0c6a00640 1 -- 172.21.15.99:0/3516625473 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0037040 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.494 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.493+0000 7fb0cfe00640 1 -- 172.21.15.99:0/3516625473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d00cd9b0 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.495 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.494+0000 7fb0cfe00640 1 -- 172.21.15.99:0/3516625473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d00b8100 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.495 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.495+0000 7fb0c6a00640 1 -- 172.21.15.99:0/3516625473 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0c0044020 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.495 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.495+0000 7fb0c6a00640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb0b006be30 0x7fb0b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.495 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.496+0000 7fb0c6a00640 1 -- 172.21.15.99:0/3516625473 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb0c00ab370 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.495 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.496+0000 7fb0ce000640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb0b006be30 0x7fb0b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:13.495 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.496+0000 7fb0ce000640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb0b006be30 0x7fb0b006e2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc000f60 tx=0x7fb0bc0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:13.499 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.501+0000 7fb0c6a00640 1 -- 172.21.15.99:0/3516625473 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0c004b030 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.675 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.676+0000 7fb0cfe00640 1 -- 172.21.15.99:0/3516625473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0d00d19e0 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.676 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.677+0000 7fb0c6a00640 1 -- 172.21.15.99:0/3516625473 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7fb0c007a070 con 0x7fb0d00b6ba0 2024-09-10T07:34:13.676 INFO:teuthology.misc.health.smithi099.stdout: 2024-09-10T07:34:13.677 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":16,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:11.175560+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:13.679 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 -- 172.21.15.99:0/3516625473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb0b006be30 msgr2=0x7fb0b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.679 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb0b006be30 0x7fb0b006e2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc000f60 tx=0x7fb0bc0079d0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.679 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 -- 172.21.15.99:0/3516625473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d00b6ba0 msgr2=0x7fb0d015dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.679 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d00b6ba0 0x7fb0d015dc80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0000c00 tx=0x7fb0c00046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.679 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 -- 172.21.15.99:0/3516625473 shutdown_connections 2024-09-10T07:34:13.679 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0d015eb00 0x7fb0d0160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.679 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0d00d3510 0x7fb0d0160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.679 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb0b006be30 0x7fb0b006e2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.679 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 --2- 172.21.15.99:0/3516625473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0d00b6ba0 0x7fb0d015dc80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.680 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 -- 172.21.15.99:0/3516625473 >> 172.21.15.99:0/3516625473 conn(0x7fb0d00d1490 msgr2=0x7fb0d00b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:13.680 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 -- 172.21.15.99:0/3516625473 shutdown_connections 2024-09-10T07:34:13.680 INFO:teuthology.misc.health.smithi099.stderr:2024-09-10T07:34:13.680+0000 7fb0cfe00640 1 -- 172.21.15.99:0/3516625473 wait complete. 2024-09-10T07:34:13.692 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T07:34:13.692 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T07:34:13.692 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:34:13.693 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:34:13.697 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:34:13.697 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:34:13.697 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:34:13.701 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:34:13.701 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:34:13.701 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:34:13.705 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:34:13.706 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:34:13.706 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:34:13.709 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:34:13.710 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T07:34:13.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:34:13.827 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:34:13.829 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:34:13.845 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:34:13.845 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:34:13.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.874+0000 7fc0ada00640 1 Processor -- start 2024-09-10T07:34:13.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.874+0000 7fc0ada00640 1 -- start start 2024-09-10T07:34:13.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0ada00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc0a8160c50 0x7fc0a8167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0ada00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a8142650 con 0x7fc0a813fae0 2024-09-10T07:34:13.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0ada00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a8142930 con 0x7fc0a8142150 2024-09-10T07:34:13.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0ada00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fc0a80ce780 con 0x7fc0a8160c50 2024-09-10T07:34:13.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0a6a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc0a813fae0 0x7fc0a806f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58302/0 (socket says 172.21.15.99:58302) 2024-09-10T07:34:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0a6a00640 1 -- 172.21.15.99:0/2802612518 learned_addr learned my addr 172.21.15.99:0/2802612518 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0a7400640 1 --2- 172.21.15.99:0/2802612518 >> v2:172.21.15.187:3300/0 conn(0x7fc0a8160c50 0x7fc0a8167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0a5600640 1 -- 172.21.15.99:0/2802612518 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 643371858 0 0) 0x7fc0a8142650 con 0x7fc0a813fae0 2024-09-10T07:34:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0a5600640 1 -- 172.21.15.99:0/2802612518 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc08c003520 con 0x7fc0a813fae0 2024-09-10T07:34:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0a7400640 1 -- 172.21.15.99:0/2802612518 >> v1:172.21.15.187:6789/0 conn(0x7fc0a8142150 legacy=0x7fc0a8160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0a5600640 1 -- 172.21.15.99:0/2802612518 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398265158 0 0) 0x7fc0a8142930 con 0x7fc0a8142150 2024-09-10T07:34:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.876+0000 7fc0a7400640 1 -- 172.21.15.99:0/2802612518 >> v1:172.21.15.99:6789/0 conn(0x7fc0a813fae0 legacy=0x7fc0a806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.877+0000 7fc0a7400640 1 -- 172.21.15.99:0/2802612518 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a8142c10 con 0x7fc0a8160c50 2024-09-10T07:34:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.878+0000 7fc0a7400640 1 --2- 172.21.15.99:0/2802612518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a8160c50 0x7fc0a8167680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009d90 tx=0x7fc0a002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b367600fc20cb9d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.878+0000 7fc0a5600640 1 -- 172.21.15.99:0/2802612518 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0007740 con 0x7fc0a8160c50 2024-09-10T07:34:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.878+0000 7fc0a5600640 1 -- 172.21.15.99:0/2802612518 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a00078e0 con 0x7fc0a8160c50 2024-09-10T07:34:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.878+0000 7fc0a5600640 1 -- 172.21.15.99:0/2802612518 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0007cb0 con 0x7fc0a8160c50 2024-09-10T07:34:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.878+0000 7fc0ada00640 1 -- 172.21.15.99:0/2802612518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a8160c50 msgr2=0x7fc0a8167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.878+0000 7fc0ada00640 1 --2- 172.21.15.99:0/2802612518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a8160c50 0x7fc0a8167680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009d90 tx=0x7fc0a002a660 comp rx=0 tx=0).stop 2024-09-10T07:34:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.878+0000 7fc0ada00640 1 -- 172.21.15.99:0/2802612518 shutdown_connections 2024-09-10T07:34:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.878+0000 7fc0ada00640 1 --2- 172.21.15.99:0/2802612518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a8160c50 0x7fc0a8167680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.878+0000 7fc0ada00640 1 -- 172.21.15.99:0/2802612518 >> 172.21.15.99:0/2802612518 conn(0x7fc0a806bc10 msgr2=0x7fc0a806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.879+0000 7fc0ada00640 1 -- 172.21.15.99:0/2802612518 shutdown_connections 2024-09-10T07:34:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.879+0000 7fc0ada00640 1 -- 172.21.15.99:0/2802612518 wait complete. 2024-09-10T07:34:13.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.880+0000 7fc0ada00640 1 Processor -- start 2024-09-10T07:34:13.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.880+0000 7fc0ada00640 1 -- start start 2024-09-10T07:34:13.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.881+0000 7fc0ada00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0a813fae0 0x7fc0a8159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.881+0000 7fc0ada00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0a8142150 0x7fc0a813b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.881+0000 7fc0ada00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a8160c50 0x7fc0a8157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.881+0000 7fc0ada00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a80cfda0 con 0x7fc0a813fae0 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.881+0000 7fc0ada00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a80cfc20 con 0x7fc0a8160c50 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.881+0000 7fc0ada00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a80cff20 con 0x7fc0a8142150 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.881+0000 7fc0a6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0a813fae0 0x7fc0a8159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.881+0000 7fc0a6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0a813fae0 0x7fc0a8159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54092/0 (socket says 172.21.15.99:54092) 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.881+0000 7fc0a6a00640 1 -- 172.21.15.99:0/1350342179 learned_addr learned my addr 172.21.15.99:0/1350342179 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0a7400640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a8160c50 0x7fc0a8157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0a6000640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0a8142150 0x7fc0a813b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0a6a00640 1 -- 172.21.15.99:0/1350342179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0a8142150 msgr2=0x7fc0a813b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0a6a00640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0a8142150 0x7fc0a813b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0a6a00640 1 -- 172.21.15.99:0/1350342179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a8160c50 msgr2=0x7fc0a8157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:13.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0a6a00640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a8160c50 0x7fc0a8157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:13.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0a6a00640 1 -- 172.21.15.99:0/1350342179 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a8159ab0 con 0x7fc0a813fae0 2024-09-10T07:34:13.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0a7400640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a8160c50 0x7fc0a8157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:13.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0a6a00640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0a813fae0 0x7fc0a8159570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc09800c430 tx=0x7fc09800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:13.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc09ea00640 1 -- 172.21.15.99:0/1350342179 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098017070 con 0x7fc0a813fae0 2024-09-10T07:34:13.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc09ea00640 1 -- 172.21.15.99:0/1350342179 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc098005ce0 con 0x7fc0a813fae0 2024-09-10T07:34:13.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0ada00640 1 -- 172.21.15.99:0/1350342179 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a8159d70 con 0x7fc0a813fae0 2024-09-10T07:34:13.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc09ea00640 1 -- 172.21.15.99:0/1350342179 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0980072f0 con 0x7fc0a813fae0 2024-09-10T07:34:13.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.882+0000 7fc0ada00640 1 -- 172.21.15.99:0/1350342179 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a815a330 con 0x7fc0a813fae0 2024-09-10T07:34:13.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.883+0000 7fc0ada00640 1 -- 172.21.15.99:0/1350342179 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a8160540 con 0x7fc0a813fae0 2024-09-10T07:34:13.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.884+0000 7fc09ea00640 1 -- 172.21.15.99:0/1350342179 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc09801a070 con 0x7fc0a813fae0 2024-09-10T07:34:13.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.885+0000 7fc09ea00640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc08806be30 0x7fc08806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:13.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.885+0000 7fc09ea00640 1 -- 172.21.15.99:0/1350342179 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc09808a0b0 con 0x7fc0a813fae0 2024-09-10T07:34:13.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.885+0000 7fc0a6000640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc08806be30 0x7fc08806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:13.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.886+0000 7fc0a6000640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc08806be30 0x7fc08806e2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80cd2f0 tx=0x7fc094009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:13.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:13.890+0000 7fc09ea00640 1 -- 172.21.15.99:0/1350342179 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc098058d10 con 0x7fc0a813fae0 2024-09-10T07:34:14.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.097+0000 7fc0ada00640 1 -- 172.21.15.99:0/1350342179 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0a80b1400 con 0x7fc0a813fae0 2024-09-10T07:34:14.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.097+0000 7fc09ea00640 1 -- 172.21.15.99:0/1350342179 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fc098058610 con 0x7fc0a813fae0 2024-09-10T07:34:14.096 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:14.096 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":2,"btime":"2024-09-10T07:34:13:836386+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3627151667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3627151667},{"type":"v1","addr":"172.21.15.99:6835","nonce":3627151667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T07:34:14.097 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 2 2024-09-10T07:34:14.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 -- 172.21.15.99:0/1350342179 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc08806be30 msgr2=0x7fc08806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:14.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc08806be30 0x7fc08806e2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80cd2f0 tx=0x7fc094009040 comp rx=0 tx=0).stop 2024-09-10T07:34:14.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 -- 172.21.15.99:0/1350342179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0a813fae0 msgr2=0x7fc0a8159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:14.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0a813fae0 0x7fc0a8159570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc09800c430 tx=0x7fc09800c8f0 comp rx=0 tx=0).stop 2024-09-10T07:34:14.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 -- 172.21.15.99:0/1350342179 shutdown_connections 2024-09-10T07:34:14.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a8160c50 0x7fc0a8157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:14.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0a8142150 0x7fc0a813b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:14.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc08806be30 0x7fc08806e2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:14.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 --2- 172.21.15.99:0/1350342179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0a813fae0 0x7fc0a8159570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:14.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 -- 172.21.15.99:0/1350342179 >> 172.21.15.99:0/1350342179 conn(0x7fc0a806bc10 msgr2=0x7fc0a815e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:14.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 -- 172.21.15.99:0/1350342179 shutdown_connections 2024-09-10T07:34:14.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:14.099+0000 7fc0ada00640 1 -- 172.21.15.99:0/1350342179 wait complete. 2024-09-10T07:34:15.961 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:34:15.965 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:34:16.114 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:34:16.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.276+0000 7f23e1800640 1 Processor -- start 2024-09-10T07:34:16.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.276+0000 7f23e1800640 1 -- start start 2024-09-10T07:34:16.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23e1800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f23dc145290 0x7f23dc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23e1800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc072f40 0x7f23dc0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23e1800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc06e3d0 con 0x7f23dc0ce780 2024-09-10T07:34:16.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23e1800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f23dc06efe0 con 0x7f23dc145290 2024-09-10T07:34:16.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23e1800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc06e6b0 con 0x7f23dc072f40 2024-09-10T07:34:16.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23d2000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f23dc0ce780 0x7f23dc072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58310/0 (socket says 172.21.15.99:58310) 2024-09-10T07:34:16.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23d2000640 1 -- 172.21.15.99:0/2527555802 learned_addr learned my addr 172.21.15.99:0/2527555802 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:16.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23daa00640 1 --2- 172.21.15.99:0/2527555802 >> v2:172.21.15.187:3300/0 conn(0x7f23dc145290 0x7f23dc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23db400640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc072f40 0x7f23dc0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3974158391 0 0) 0x7f23dc06e3d0 con 0x7f23dc0ce780 2024-09-10T07:34:16.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.278+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23c0005730 con 0x7f23dc0ce780 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2532754935 0 0) 0x7f23c0005730 con 0x7f23dc0ce780 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc072f40 msgr2=0x7f23dc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc072f40 0x7f23dc0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 >> v2:172.21.15.187:3300/0 conn(0x7f23dc145290 msgr2=0x7f23dc06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 --2- 172.21.15.99:0/2527555802 >> v2:172.21.15.187:3300/0 conn(0x7f23dc145290 0x7f23dc06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc06e990 con 0x7f23dc0ce780 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f23c4001670 con 0x7f23dc0ce780 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 >> v1:172.21.15.99:6789/0 conn(0x7f23dc0ce780 legacy=0x7f23dc072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 0x7f23c0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23c0006a10 0x7f23c0006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc072f40 0x7f23c00073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc06efe0 con 0x7f23c0005bc0 2024-09-10T07:34:16.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc06e6b0 con 0x7f23c0006a10 2024-09-10T07:34:16.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f23c000dbd0 con 0x7f23dc072f40 2024-09-10T07:34:16.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23daa00640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 0x7f23c0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23d2000640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23c0006a10 0x7f23c0006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.279+0000 7f23db400640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc072f40 0x7f23c00073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.280+0000 7f23daa00640 1 -- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc072f40 msgr2=0x7f23c00073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:16.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.280+0000 7f23daa00640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc072f40 0x7f23c00073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.280+0000 7f23daa00640 1 -- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23c0006a10 msgr2=0x7f23c0006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:16.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.280+0000 7f23daa00640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23c0006a10 0x7f23c0006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.280+0000 7f23daa00640 1 -- 172.21.15.99:0/2527555802 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c0005730 con 0x7f23c0005bc0 2024-09-10T07:34:16.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.280+0000 7f23daa00640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 0x7f23c0005fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009ac0 tx=0x7f23c0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1531dd5a24af6168 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:16.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.281+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc036070 con 0x7f23c0005bc0 2024-09-10T07:34:16.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.281+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23cc031400 con 0x7f23c0005bc0 2024-09-10T07:34:16.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.281+0000 7f23da000640 1 -- 172.21.15.99:0/2527555802 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc009690 con 0x7f23c0005bc0 2024-09-10T07:34:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.281+0000 7f23e1800640 1 -- 172.21.15.99:0/2527555802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 msgr2=0x7f23c0005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.281+0000 7f23e1800640 1 --2- 172.21.15.99:0/2527555802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 0x7f23c0005fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009ac0 tx=0x7f23c0007a40 comp rx=0 tx=0).stop 2024-09-10T07:34:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.281+0000 7f23db400640 1 -- 172.21.15.99:0/2527555802 reap_dead start 2024-09-10T07:34:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.281+0000 7f23e1800640 1 -- 172.21.15.99:0/2527555802 shutdown_connections 2024-09-10T07:34:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.281+0000 7f23e1800640 1 -- 172.21.15.99:0/2527555802 >> 172.21.15.99:0/2527555802 conn(0x7f23dc06bc10 msgr2=0x7f23dc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.281+0000 7f23e1800640 1 -- 172.21.15.99:0/2527555802 shutdown_connections 2024-09-10T07:34:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.281+0000 7f23e1800640 1 -- 172.21.15.99:0/2527555802 wait complete. 2024-09-10T07:34:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.283+0000 7f23e1800640 1 Processor -- start 2024-09-10T07:34:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.283+0000 7f23e1800640 1 -- start start 2024-09-10T07:34:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23e1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 0x7f23dc13c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23e1800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc0cc950 0x7f23dc150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23e1800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23dc0ccdd0 0x7f23dc1418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23e1800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc06df80 con 0x7f23c0005bc0 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23e1800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc145670 con 0x7f23dc0ccdd0 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23e1800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc06e100 con 0x7f23dc0cc950 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23daa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 0x7f23dc13c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23daa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 0x7f23dc13c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54120/0 (socket says 172.21.15.99:54120) 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23daa00640 1 -- 172.21.15.99:0/1245717442 learned_addr learned my addr 172.21.15.99:0/1245717442 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23d2000640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc0cc950 0x7f23dc150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.284+0000 7f23db400640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23dc0ccdd0 0x7f23dc1418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23daa00640 1 -- 172.21.15.99:0/1245717442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc0cc950 msgr2=0x7f23dc150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23daa00640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc0cc950 0x7f23dc150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23daa00640 1 -- 172.21.15.99:0/1245717442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23dc0ccdd0 msgr2=0x7f23dc1418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23daa00640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23dc0ccdd0 0x7f23dc1418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23daa00640 1 -- 172.21.15.99:0/1245717442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc140840 con 0x7f23c0005bc0 2024-09-10T07:34:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23daa00640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 0x7f23dc13c2b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23cc034040 tx=0x7f23cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23d3400640 1 -- 172.21.15.99:0/1245717442 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc040020 con 0x7f23c0005bc0 2024-09-10T07:34:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23d3400640 1 -- 172.21.15.99:0/1245717442 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23cc003b40 con 0x7f23c0005bc0 2024-09-10T07:34:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23d3400640 1 -- 172.21.15.99:0/1245717442 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc036040 con 0x7f23c0005bc0 2024-09-10T07:34:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23e1800640 1 -- 172.21.15.99:0/1245717442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc140b20 con 0x7f23c0005bc0 2024-09-10T07:34:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.285+0000 7f23e1800640 1 -- 172.21.15.99:0/1245717442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23dc1410e0 con 0x7f23c0005bc0 2024-09-10T07:34:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.286+0000 7f23e1800640 1 -- 172.21.15.99:0/1245717442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23dc071510 con 0x7f23c0005bc0 2024-09-10T07:34:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.287+0000 7f23d3400640 1 -- 172.21.15.99:0/1245717442 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23cc043020 con 0x7f23c0005bc0 2024-09-10T07:34:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.288+0000 7f23d3400640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f23b806be60 0x7f23b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.288+0000 7f23d3400640 1 -- 172.21.15.99:0/1245717442 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f23cc0aaa90 con 0x7f23c0005bc0 2024-09-10T07:34:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.288+0000 7f23d2000640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f23b806be60 0x7f23b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.289+0000 7f23d2000640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f23b806be60 0x7f23b806e320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f23c4001050 tx=0x7f23c40078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.292+0000 7f23d3400640 1 -- 172.21.15.99:0/1245717442 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23cc04a070 con 0x7f23c0005bc0 2024-09-10T07:34:16.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.499+0000 7f23e1800640 1 -- 172.21.15.99:0/1245717442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23dc0690c0 con 0x7f23c0005bc0 2024-09-10T07:34:16.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.500+0000 7f23d3400640 1 -- 172.21.15.99:0/1245717442 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7f23cc0044e0 con 0x7f23c0005bc0 2024-09-10T07:34:16.500 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:16.501 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":3,"btime":"2024-09-10T07:34:14:837770+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3627151667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3627151667},{"type":"v1","addr":"172.21.15.99:6835","nonce":3627151667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/72768681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":72768681},{"type":"v1","addr":"172.21.15.99:6837","nonce":72768681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3327861481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3327861481},{"type":"v1","addr":"172.21.15.187:6834","nonce":3327861481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/4184584284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4184584284},{"type":"v1","addr":"172.21.15.187:6835","nonce":4184584284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T07:34:16.501 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 3 2024-09-10T07:34:16.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 -- 172.21.15.99:0/1245717442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f23b806be60 msgr2=0x7f23b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f23b806be60 0x7f23b806e320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f23c4001050 tx=0x7f23c40078f0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 -- 172.21.15.99:0/1245717442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 msgr2=0x7f23dc13c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 0x7f23dc13c2b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23cc034040 tx=0x7f23cc004730 comp rx=0 tx=0).stop 2024-09-10T07:34:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 -- 172.21.15.99:0/1245717442 shutdown_connections 2024-09-10T07:34:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23dc0ccdd0 0x7f23dc1418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23dc0cc950 0x7f23dc150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f23b806be60 0x7f23b806e320 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 --2- 172.21.15.99:0/1245717442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23c0005bc0 0x7f23dc13c2b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 -- 172.21.15.99:0/1245717442 >> 172.21.15.99:0/1245717442 conn(0x7f23dc06bc10 msgr2=0x7f23dc0b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 -- 172.21.15.99:0/1245717442 shutdown_connections 2024-09-10T07:34:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.502+0000 7f23e1800640 1 -- 172.21.15.99:0/1245717442 wait complete. 2024-09-10T07:34:16.518 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:34:16.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.673+0000 7f1938400640 1 Processor -- start 2024-09-10T07:34:16.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.673+0000 7f1938400640 1 -- start start 2024-09-10T07:34:16.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.674+0000 7f1938400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f193015ef50 0x7f19300d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.674+0000 7f1938400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f19300d3240 0x7f19300d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.674+0000 7f1938400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19300b7a90 con 0x7f19300d5780 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.674+0000 7f1938400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f19300d3740 con 0x7f193015ef50 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.674+0000 7f1938400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f19300d3a20 con 0x7f19300d3240 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.674+0000 7f1935a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f193015ef50 0x7f19300d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.674+0000 7f1935a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f193015ef50 0x7f19300d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54124/0 (socket says 172.21.15.99:54124) 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.674+0000 7f1935a00640 1 -- 172.21.15.99:0/2607087088 learned_addr learned my addr 172.21.15.99:0/2607087088 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.675+0000 7f1935000640 1 --2- 172.21.15.99:0/2607087088 >> v2:172.21.15.187:3300/0 conn(0x7f19300d3240 0x7f19300d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.675+0000 7f1935a00640 1 -- 172.21.15.99:0/2607087088 >> v2:172.21.15.187:3300/0 conn(0x7f19300d3240 msgr2=0x7f19300d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.675+0000 7f1935a00640 1 --2- 172.21.15.99:0/2607087088 >> v2:172.21.15.187:3300/0 conn(0x7f19300d3240 0x7f19300d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.675+0000 7f1935a00640 1 -- 172.21.15.99:0/2607087088 >> v1:172.21.15.187:6789/0 conn(0x7f19300d5780 legacy=0x7f19300cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:16.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.675+0000 7f1935a00640 1 -- 172.21.15.99:0/2607087088 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19300b7d00 con 0x7f193015ef50 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.676+0000 7f1935a00640 1 --2- 172.21.15.99:0/2607087088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f193015ef50 0x7f19300d13a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f193008df60 tx=0x7f192402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d51662fc0d28a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.676+0000 7f192fe00640 1 -- 172.21.15.99:0/2607087088 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924037070 con 0x7f193015ef50 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.676+0000 7f192fe00640 1 -- 172.21.15.99:0/2607087088 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1924032440 con 0x7f193015ef50 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.676+0000 7f192fe00640 1 -- 172.21.15.99:0/2607087088 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924032810 con 0x7f193015ef50 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.677+0000 7f1938400640 1 -- 172.21.15.99:0/2607087088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f193015ef50 msgr2=0x7f19300d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.677+0000 7f1938400640 1 --2- 172.21.15.99:0/2607087088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f193015ef50 0x7f19300d13a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f193008df60 tx=0x7f192402a1a0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.677+0000 7f1938400640 1 -- 172.21.15.99:0/2607087088 shutdown_connections 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.677+0000 7f1938400640 1 --2- 172.21.15.99:0/2607087088 >> v2:172.21.15.187:3300/0 conn(0x7f19300d3240 0x7f19300d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.677+0000 7f1938400640 1 --2- 172.21.15.99:0/2607087088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f193015ef50 0x7f19300d13a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.677+0000 7f1938400640 1 -- 172.21.15.99:0/2607087088 >> 172.21.15.99:0/2607087088 conn(0x7f19300d4c60 msgr2=0x7f19300d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.677+0000 7f1938400640 1 -- 172.21.15.99:0/2607087088 shutdown_connections 2024-09-10T07:34:16.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.677+0000 7f1938400640 1 -- 172.21.15.99:0/2607087088 wait complete. 2024-09-10T07:34:16.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.678+0000 7f1938400640 1 Processor -- start 2024-09-10T07:34:16.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.678+0000 7f1938400640 1 -- start start 2024-09-10T07:34:16.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.679+0000 7f1938400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19300d3240 0x7f1930158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.679+0000 7f1938400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19300d5780 0x7f1930159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.679+0000 7f1938400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f193015ef50 0x7f193014b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.679+0000 7f1938400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f19300d21a0 con 0x7f19300d5780 2024-09-10T07:34:16.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.679+0000 7f1938400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f19300d2020 con 0x7f193015ef50 2024-09-10T07:34:16.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.679+0000 7f1938400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f19300b9510 con 0x7f19300d3240 2024-09-10T07:34:16.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1935000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19300d5780 0x7f1930159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1935000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19300d5780 0x7f1930159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54130/0 (socket says 172.21.15.99:54130) 2024-09-10T07:34:16.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1935000640 1 -- 172.21.15.99:0/3832552035 learned_addr learned my addr 172.21.15.99:0/3832552035 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:16.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1935a00640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19300d3240 0x7f1930158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1936400640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f193015ef50 0x7f193014b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1935000640 1 -- 172.21.15.99:0/3832552035 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19300d3240 msgr2=0x7f1930158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1935000640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19300d3240 0x7f1930158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1935000640 1 -- 172.21.15.99:0/3832552035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f193015ef50 msgr2=0x7f193014b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1935000640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f193015ef50 0x7f193014b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1935000640 1 -- 172.21.15.99:0/3832552035 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193014c430 con 0x7f19300d5780 2024-09-10T07:34:16.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f1935000640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19300d5780 0x7f1930159580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f191c00d800 tx=0x7f191c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:16.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.680+0000 7f192d600640 1 -- 172.21.15.99:0/3832552035 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c00b6c0 con 0x7f19300d5780 2024-09-10T07:34:16.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.681+0000 7f192d600640 1 -- 172.21.15.99:0/3832552035 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c019070 con 0x7f19300d5780 2024-09-10T07:34:16.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.681+0000 7f192d600640 1 -- 172.21.15.99:0/3832552035 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c00ba80 con 0x7f19300d5780 2024-09-10T07:34:16.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.681+0000 7f1938400640 1 -- 172.21.15.99:0/3832552035 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193014c710 con 0x7f19300d5780 2024-09-10T07:34:16.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.681+0000 7f1938400640 1 -- 172.21.15.99:0/3832552035 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193014ccd0 con 0x7f19300d5780 2024-09-10T07:34:16.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.682+0000 7f1938400640 1 -- 172.21.15.99:0/3832552035 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19300d13a0 con 0x7f19300d5780 2024-09-10T07:34:16.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.683+0000 7f192d600640 1 -- 172.21.15.99:0/3832552035 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f191c00bc20 con 0x7f19300d5780 2024-09-10T07:34:16.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.683+0000 7f192d600640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f191006be30 0x7f191006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:16.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.683+0000 7f192d600640 1 -- 172.21.15.99:0/3832552035 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f191c08ae40 con 0x7f19300d5780 2024-09-10T07:34:16.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.684+0000 7f1935a00640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f191006be30 0x7f191006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:16.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.684+0000 7f1935a00640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f191006be30 0x7f191006e2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1924034000 tx=0x7f192402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:16.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.688+0000 7f192d600640 1 -- 172.21.15.99:0/3832552035 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f191c0594e0 con 0x7f19300d5780 2024-09-10T07:34:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.866+0000 7f1938400640 1 -- 172.21.15.99:0/3832552035 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f19300b6450 con 0x7f19300d5780 2024-09-10T07:34:16.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.867+0000 7f192d600640 1 -- 172.21.15.99:0/3832552035 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f191c05d7e0 con 0x7f19300d5780 2024-09-10T07:34:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:16.867 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:34:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:34:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:34:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:34:16.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:34:16.867 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:34:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 -- 172.21.15.99:0/3832552035 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f191006be30 msgr2=0x7f191006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f191006be30 0x7f191006e2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1924034000 tx=0x7f192402e000 comp rx=0 tx=0).stop 2024-09-10T07:34:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 -- 172.21.15.99:0/3832552035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19300d5780 msgr2=0x7f1930159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19300d5780 0x7f1930159580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f191c00d800 tx=0x7f191c00dcc0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 -- 172.21.15.99:0/3832552035 shutdown_connections 2024-09-10T07:34:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f193015ef50 0x7f193014b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f191006be30 0x7f191006e2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19300d5780 0x7f1930159580 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 --2- 172.21.15.99:0/3832552035 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19300d3240 0x7f1930158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:16.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 -- 172.21.15.99:0/3832552035 >> 172.21.15.99:0/3832552035 conn(0x7f19300d4c60 msgr2=0x7f19300b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:16.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 -- 172.21.15.99:0/3832552035 shutdown_connections 2024-09-10T07:34:16.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:16.869+0000 7f1938400640 1 -- 172.21.15.99:0/3832552035 wait complete. 2024-09-10T07:34:16.885 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:34:16.885 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:34:17.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.044+0000 7fcf48a00640 1 Processor -- start 2024-09-10T07:34:17.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.044+0000 7fcf48a00640 1 -- start start 2024-09-10T07:34:17.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf48a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf4415eb60 0x7fcf440d3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:17.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf48a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 0x7fcf440b8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:17.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf48a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf440d0520 con 0x7fcf440d3590 2024-09-10T07:34:17.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf48a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fcf440d3a00 con 0x7fcf4415eb60 2024-09-10T07:34:17.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf48a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcf440d0800 con 0x7fcf440cff00 2024-09-10T07:34:17.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf3aa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcf440d3590 0x7fcf440cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58326/0 (socket says 172.21.15.99:58326) 2024-09-10T07:34:17.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf3aa00640 1 -- 172.21.15.99:0/2053321175 learned_addr learned my addr 172.21.15.99:0/2053321175 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:17.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf43400640 1 --2- 172.21.15.99:0/2053321175 >> v2:172.21.15.187:3300/0 conn(0x7fcf4415eb60 0x7fcf440d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:17.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf43e00640 1 --2- 172.21.15.99:0/2053321175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 0x7fcf440b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:17.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf42a00640 1 -- 172.21.15.99:0/2053321175 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001148719 0 0) 0x7fcf440d0520 con 0x7fcf440d3590 2024-09-10T07:34:17.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.046+0000 7fcf42a00640 1 -- 172.21.15.99:0/2053321175 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf28003520 con 0x7fcf440d3590 2024-09-10T07:34:17.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.047+0000 7fcf43e00640 1 -- 172.21.15.99:0/2053321175 >> v2:172.21.15.187:3300/0 conn(0x7fcf4415eb60 msgr2=0x7fcf440d3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:17.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.047+0000 7fcf43e00640 1 --2- 172.21.15.99:0/2053321175 >> v2:172.21.15.187:3300/0 conn(0x7fcf4415eb60 0x7fcf440d3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.047+0000 7fcf43e00640 1 -- 172.21.15.99:0/2053321175 >> v1:172.21.15.99:6789/0 conn(0x7fcf440d3590 legacy=0x7fcf440cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:17.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.047+0000 7fcf43e00640 1 -- 172.21.15.99:0/2053321175 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf440b7a60 con 0x7fcf440cff00 2024-09-10T07:34:17.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.047+0000 7fcf43400640 1 --2- 172.21.15.99:0/2053321175 >> v2:172.21.15.187:3300/0 conn(0x7fcf4415eb60 0x7fcf440d3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:17.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.048+0000 7fcf43e00640 1 --2- 172.21.15.99:0/2053321175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 0x7fcf440b8260 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009d90 tx=0x7fcf3c02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8382829a4c90e0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.048+0000 7fcf42a00640 1 -- 172.21.15.99:0/2053321175 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c007740 con 0x7fcf440cff00 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.048+0000 7fcf42a00640 1 -- 172.21.15.99:0/2053321175 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3c0078e0 con 0x7fcf440cff00 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.048+0000 7fcf42a00640 1 -- 172.21.15.99:0/2053321175 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c007c90 con 0x7fcf440cff00 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.048+0000 7fcf48a00640 1 -- 172.21.15.99:0/2053321175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 msgr2=0x7fcf440b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.048+0000 7fcf48a00640 1 --2- 172.21.15.99:0/2053321175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 0x7fcf440b8260 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009d90 tx=0x7fcf3c02a6f0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.048+0000 7fcf48a00640 1 -- 172.21.15.99:0/2053321175 shutdown_connections 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.048+0000 7fcf48a00640 1 --2- 172.21.15.99:0/2053321175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 0x7fcf440b8260 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.049+0000 7fcf48a00640 1 --2- 172.21.15.99:0/2053321175 >> v2:172.21.15.187:3300/0 conn(0x7fcf4415eb60 0x7fcf440d3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.049+0000 7fcf48a00640 1 -- 172.21.15.99:0/2053321175 >> 172.21.15.99:0/2053321175 conn(0x7fcf440d4a70 msgr2=0x7fcf440d4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.049+0000 7fcf48a00640 1 -- 172.21.15.99:0/2053321175 shutdown_connections 2024-09-10T07:34:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.049+0000 7fcf48a00640 1 -- 172.21.15.99:0/2053321175 wait complete. 2024-09-10T07:34:17.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.050+0000 7fcf48a00640 1 Processor -- start 2024-09-10T07:34:17.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.050+0000 7fcf48a00640 1 -- start start 2024-09-10T07:34:17.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.051+0000 7fcf48a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 0x7fcf44159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:17.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.051+0000 7fcf48a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf440d3590 0x7fcf441f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:17.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.051+0000 7fcf48a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415eb60 0x7fcf441f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:17.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.051+0000 7fcf48a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4415f0c0 con 0x7fcf440d3590 2024-09-10T07:34:17.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.051+0000 7fcf48a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4415ef40 con 0x7fcf4415eb60 2024-09-10T07:34:17.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.051+0000 7fcf48a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcf440b87a0 con 0x7fcf440cff00 2024-09-10T07:34:17.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.051+0000 7fcf3aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf440d3590 0x7fcf441f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:17.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.051+0000 7fcf3aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf440d3590 0x7fcf441f4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54138/0 (socket says 172.21.15.99:54138) 2024-09-10T07:34:17.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.051+0000 7fcf3aa00640 1 -- 172.21.15.99:0/1062034949 learned_addr learned my addr 172.21.15.99:0/1062034949 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:17.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf43400640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 0x7fcf44159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:17.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf43e00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415eb60 0x7fcf441f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:17.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf3aa00640 1 -- 172.21.15.99:0/1062034949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 msgr2=0x7fcf44159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:17.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf3aa00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 0x7fcf44159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf3aa00640 1 -- 172.21.15.99:0/1062034949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415eb60 msgr2=0x7fcf441f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:17.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf3aa00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415eb60 0x7fcf441f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf3aa00640 1 -- 172.21.15.99:0/1062034949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf44156cd0 con 0x7fcf440d3590 2024-09-10T07:34:17.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf43e00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415eb60 0x7fcf441f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:17.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf3aa00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf440d3590 0x7fcf441f4b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00c430 tx=0x7fcf2c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:17.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf3be00640 1 -- 172.21.15.99:0/1062034949 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c017070 con 0x7fcf440d3590 2024-09-10T07:34:17.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf3be00640 1 -- 172.21.15.99:0/1062034949 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c005ce0 con 0x7fcf440d3590 2024-09-10T07:34:17.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf48a00640 1 -- 172.21.15.99:0/1062034949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf44156fb0 con 0x7fcf440d3590 2024-09-10T07:34:17.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf3be00640 1 -- 172.21.15.99:0/1062034949 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0072f0 con 0x7fcf440d3590 2024-09-10T07:34:17.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.052+0000 7fcf48a00640 1 -- 172.21.15.99:0/1062034949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf44157570 con 0x7fcf440d3590 2024-09-10T07:34:17.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.053+0000 7fcf48a00640 1 -- 172.21.15.99:0/1062034949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf440b8260 con 0x7fcf440d3590 2024-09-10T07:34:17.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.054+0000 7fcf3be00640 1 -- 172.21.15.99:0/1062034949 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf2c01a070 con 0x7fcf440d3590 2024-09-10T07:34:17.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.055+0000 7fcf3be00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf2006be30 0x7fcf2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:17.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.055+0000 7fcf3be00640 1 -- 172.21.15.99:0/1062034949 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fcf2c089ef0 con 0x7fcf440d3590 2024-09-10T07:34:17.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.055+0000 7fcf43400640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf2006be30 0x7fcf2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:17.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.056+0000 7fcf43400640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf2006be30 0x7fcf2006e2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009560 tx=0x7fcf34009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:17.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.060+0000 7fcf3be00640 1 -- 172.21.15.99:0/1062034949 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf2c058590 con 0x7fcf440d3590 2024-09-10T07:34:17.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.234+0000 7fcf48a00640 1 -- 172.21.15.99:0/1062034949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcf441566b0 con 0x7fcf440d3590 2024-09-10T07:34:17.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.858+0000 7fcf3be00640 1 -- 172.21.15.99:0/1062034949 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fcf2c05c890 con 0x7fcf440d3590 2024-09-10T07:34:17.858 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:34:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.861+0000 7fcf48a00640 1 -- 172.21.15.99:0/1062034949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf2006be30 msgr2=0x7fcf2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.861+0000 7fcf48a00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf2006be30 0x7fcf2006e2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009560 tx=0x7fcf34009190 comp rx=0 tx=0).stop 2024-09-10T07:34:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.861+0000 7fcf48a00640 1 -- 172.21.15.99:0/1062034949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf440d3590 msgr2=0x7fcf441f4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.861+0000 7fcf48a00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf440d3590 0x7fcf441f4b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00c430 tx=0x7fcf2c00c8f0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.861+0000 7fcf48a00640 1 -- 172.21.15.99:0/1062034949 shutdown_connections 2024-09-10T07:34:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.861+0000 7fcf48a00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415eb60 0x7fcf441f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.861+0000 7fcf48a00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf2006be30 0x7fcf2006e2f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.861+0000 7fcf48a00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf440d3590 0x7fcf441f4b60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.861+0000 7fcf48a00640 1 --2- 172.21.15.99:0/1062034949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cff00 0x7fcf44159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:17.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.861+0000 7fcf48a00640 1 -- 172.21.15.99:0/1062034949 >> 172.21.15.99:0/1062034949 conn(0x7fcf440d4a70 msgr2=0x7fcf440b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:17.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.862+0000 7fcf48a00640 1 -- 172.21.15.99:0/1062034949 shutdown_connections 2024-09-10T07:34:17.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:17.862+0000 7fcf48a00640 1 -- 172.21.15.99:0/1062034949 wait complete. 2024-09-10T07:34:17.882 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:34:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.046+0000 7faffb000640 1 Processor -- start 2024-09-10T07:34:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.046+0000 7faffb000640 1 -- start start 2024-09-10T07:34:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.047+0000 7faffb000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faff40d56b0 0x7faff40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.047+0000 7faffb000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff40d3700 con 0x7faff40d1470 2024-09-10T07:34:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.047+0000 7faffb000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff40cfa70 con 0x7faff41623c0 2024-09-10T07:34:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.047+0000 7faffb000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7faff40d21a0 con 0x7faff40d56b0 2024-09-10T07:34:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.047+0000 7faff9000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faff40d1470 0x7faff40b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58342/0 (socket says 172.21.15.99:58342) 2024-09-10T07:34:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.047+0000 7faff9000640 1 -- 172.21.15.99:0/2259487872 learned_addr learned my addr 172.21.15.99:0/2259487872 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.047+0000 7fafeb400640 1 --2- 172.21.15.99:0/2259487872 >> v2:172.21.15.187:3300/0 conn(0x7faff40d56b0 0x7faff40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.048+0000 7faff3400640 1 -- 172.21.15.99:0/2259487872 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706401363 0 0) 0x7faff40d3700 con 0x7faff40d1470 2024-09-10T07:34:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.048+0000 7faff3400640 1 -- 172.21.15.99:0/2259487872 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd8003520 con 0x7faff40d1470 2024-09-10T07:34:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.048+0000 7faff3400640 1 -- 172.21.15.99:0/2259487872 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953311777 0 0) 0x7faff40cfa70 con 0x7faff41623c0 2024-09-10T07:34:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.048+0000 7faff3400640 1 -- 172.21.15.99:0/2259487872 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faff40d3700 con 0x7faff41623c0 2024-09-10T07:34:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.048+0000 7fafeb400640 1 -- 172.21.15.99:0/2259487872 >> v1:172.21.15.187:6789/0 conn(0x7faff41623c0 legacy=0x7faff40d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.048+0000 7fafeb400640 1 -- 172.21.15.99:0/2259487872 >> v1:172.21.15.99:6789/0 conn(0x7faff40d1470 legacy=0x7faff40b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.048+0000 7fafeb400640 1 -- 172.21.15.99:0/2259487872 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff40d0c20 con 0x7faff40d56b0 2024-09-10T07:34:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.049+0000 7fafeb400640 1 --2- 172.21.15.99:0/2259487872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40d56b0 0x7faff40b6260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0097a0 tx=0x7fafdc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be2d418f21a4323f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.049+0000 7faff3400640 1 -- 172.21.15.99:0/2259487872 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc037070 con 0x7faff40d56b0 2024-09-10T07:34:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.049+0000 7faff3400640 1 -- 172.21.15.99:0/2259487872 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafdc032440 con 0x7faff40d56b0 2024-09-10T07:34:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.049+0000 7faff3400640 1 -- 172.21.15.99:0/2259487872 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0327f0 con 0x7faff40d56b0 2024-09-10T07:34:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.050+0000 7faffb000640 1 -- 172.21.15.99:0/2259487872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40d56b0 msgr2=0x7faff40b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.050+0000 7faffb000640 1 --2- 172.21.15.99:0/2259487872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40d56b0 0x7faff40b6260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0097a0 tx=0x7fafdc02a230 comp rx=0 tx=0).stop 2024-09-10T07:34:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.050+0000 7faffb000640 1 -- 172.21.15.99:0/2259487872 shutdown_connections 2024-09-10T07:34:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.050+0000 7faffb000640 1 --2- 172.21.15.99:0/2259487872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40d56b0 0x7faff40b6260 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.050+0000 7faffb000640 1 -- 172.21.15.99:0/2259487872 >> 172.21.15.99:0/2259487872 conn(0x7faff409df30 msgr2=0x7faff40d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.050+0000 7faffb000640 1 -- 172.21.15.99:0/2259487872 shutdown_connections 2024-09-10T07:34:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.050+0000 7faffb000640 1 -- 172.21.15.99:0/2259487872 wait complete. 2024-09-10T07:34:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.052+0000 7faffb000640 1 Processor -- start 2024-09-10T07:34:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.052+0000 7faffb000640 1 -- start start 2024-09-10T07:34:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7faffb000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40d1470 0x7faff4156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7faffb000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faff40d56b0 0x7faff40cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7faffb000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faff41623c0 0x7faff40ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7faffb000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faff40cfd10 con 0x7faff40d56b0 2024-09-10T07:34:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7faffb000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faff40d0080 con 0x7faff40d1470 2024-09-10T07:34:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7faffb000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faff41627a0 con 0x7faff41623c0 2024-09-10T07:34:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7fafeb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faff40d56b0 0x7faff40cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7fafeb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faff40d56b0 0x7faff40cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54144/0 (socket says 172.21.15.99:54144) 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7fafeb400640 1 -- 172.21.15.99:0/2591307223 learned_addr learned my addr 172.21.15.99:0/2591307223 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7fafeb400640 1 -- 172.21.15.99:0/2591307223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faff41623c0 msgr2=0x7faff40ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7faff9000640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faff41623c0 0x7faff40ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7fafeb400640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faff41623c0 0x7faff40ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7faff3e00640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40d1470 0x7faff4156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7fafeb400640 1 -- 172.21.15.99:0/2591307223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40d1470 msgr2=0x7faff4156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7fafeb400640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40d1470 0x7faff4156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7fafeb400640 1 -- 172.21.15.99:0/2591307223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff40b8f30 con 0x7faff40d56b0 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.053+0000 7faff3e00640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40d1470 0x7faff4156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.054+0000 7fafeb400640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faff40d56b0 0x7faff40cc730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafdc02a270 tx=0x7fafdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.054+0000 7faff0c00640 1 -- 172.21.15.99:0/2591307223 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc037040 con 0x7faff40d56b0 2024-09-10T07:34:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.054+0000 7faff0c00640 1 -- 172.21.15.99:0/2591307223 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafdc042070 con 0x7faff40d56b0 2024-09-10T07:34:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.054+0000 7faff0c00640 1 -- 172.21.15.99:0/2591307223 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc032830 con 0x7faff40d56b0 2024-09-10T07:34:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.054+0000 7faffb000640 1 -- 172.21.15.99:0/2591307223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff40b91d0 con 0x7faff40d56b0 2024-09-10T07:34:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.054+0000 7faffb000640 1 -- 172.21.15.99:0/2591307223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff40b9790 con 0x7faff40d56b0 2024-09-10T07:34:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.055+0000 7faffb000640 1 -- 172.21.15.99:0/2591307223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff415f6c0 con 0x7faff40d56b0 2024-09-10T07:34:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.056+0000 7faff0c00640 1 -- 172.21.15.99:0/2591307223 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafdc0329d0 con 0x7faff40d56b0 2024-09-10T07:34:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.057+0000 7faff0c00640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafd006be30 0x7fafd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.057+0000 7faff0c00640 1 -- 172.21.15.99:0/2591307223 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fafdc0ab600 con 0x7faff40d56b0 2024-09-10T07:34:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.057+0000 7faff3e00640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafd006be30 0x7fafd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.058+0000 7faff3e00640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafd006be30 0x7fafd006e2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafe4007fd0 tx=0x7fafe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:18.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.062+0000 7faff0c00640 1 -- 172.21.15.99:0/2591307223 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafdc07a0f0 con 0x7faff40d56b0 2024-09-10T07:34:18.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.239+0000 7faffb000640 1 -- 172.21.15.99:0/2591307223 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7faff40d2340 con 0x7faff40d56b0 2024-09-10T07:34:18.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.866+0000 7faff0c00640 1 -- 172.21.15.99:0/2591307223 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fafdc0799f0 con 0x7faff40d56b0 2024-09-10T07:34:18.866 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.869+0000 7faffb000640 1 -- 172.21.15.99:0/2591307223 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafd006be30 msgr2=0x7fafd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.869+0000 7faffb000640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafd006be30 0x7fafd006e2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fafe4007fd0 tx=0x7fafe4009040 comp rx=0 tx=0).stop 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.869+0000 7faffb000640 1 -- 172.21.15.99:0/2591307223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faff40d56b0 msgr2=0x7faff40cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.869+0000 7faffb000640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faff40d56b0 0x7faff40cc730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafdc02a270 tx=0x7fafdc0046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.869+0000 7faffb000640 1 -- 172.21.15.99:0/2591307223 shutdown_connections 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.869+0000 7faffb000640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faff41623c0 0x7faff40ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.869+0000 7faffb000640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafd006be30 0x7fafd006e2f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.869+0000 7faffb000640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faff40d56b0 0x7faff40cc730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.869+0000 7faffb000640 1 --2- 172.21.15.99:0/2591307223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40d1470 0x7faff4156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.869+0000 7faffb000640 1 -- 172.21.15.99:0/2591307223 >> 172.21.15.99:0/2591307223 conn(0x7faff409df30 msgr2=0x7faff40b6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.870+0000 7faffb000640 1 -- 172.21.15.99:0/2591307223 shutdown_connections 2024-09-10T07:34:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:18.870+0000 7faffb000640 1 -- 172.21.15.99:0/2591307223 wait complete. 2024-09-10T07:34:18.895 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:34:19.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.051+0000 7fbef7200640 1 Processor -- start 2024-09-10T07:34:19.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.051+0000 7fbef7200640 1 -- start start 2024-09-10T07:34:19.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbef7200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbef015b760 0x7fbef00afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:19.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbef7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef00d0630 0x7fbef00d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:19.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbef7200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef00b4300 con 0x7fbef00b4a90 2024-09-10T07:34:19.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbef7200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbef00d0fa0 con 0x7fbef015b760 2024-09-10T07:34:19.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbef7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbef006d700 con 0x7fbef00d0630 2024-09-10T07:34:19.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbeefe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbef015b760 0x7fbef00afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:19.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbeefe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbef015b760 0x7fbef00afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54152/0 (socket says 172.21.15.99:54152) 2024-09-10T07:34:19.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbeefe00640 1 -- 172.21.15.99:0/123424634 learned_addr learned my addr 172.21.15.99:0/123424634 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:19.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbef5200640 1 --2- 172.21.15.99:0/123424634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef00d0630 0x7fbef00d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:19.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbeefe00640 1 -- 172.21.15.99:0/123424634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef00d0630 msgr2=0x7fbef00d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:19.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbeefe00640 1 --2- 172.21.15.99:0/123424634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef00d0630 0x7fbef00d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:19.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbeefe00640 1 -- 172.21.15.99:0/123424634 >> v1:172.21.15.187:6789/0 conn(0x7fbef00b4a90 legacy=0x7fbef006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:19.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.053+0000 7fbeefe00640 1 -- 172.21.15.99:0/123424634 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef006d9e0 con 0x7fbef015b760 2024-09-10T07:34:19.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.054+0000 7fbeefe00640 1 --2- 172.21.15.99:0/123424634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef015b760 0x7fbef00afa90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbee0009870 tx=0x7fbee002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758e30383dc89aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:19.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbeeea00640 1 -- 172.21.15.99:0/123424634 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee0037070 con 0x7fbef015b760 2024-09-10T07:34:19.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbeeea00640 1 -- 172.21.15.99:0/123424634 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee0032440 con 0x7fbef015b760 2024-09-10T07:34:19.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbeeea00640 1 -- 172.21.15.99:0/123424634 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee0032810 con 0x7fbef015b760 2024-09-10T07:34:19.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbef7200640 1 -- 172.21.15.99:0/123424634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef015b760 msgr2=0x7fbef00afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:19.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbef7200640 1 --2- 172.21.15.99:0/123424634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef015b760 0x7fbef00afa90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbee0009870 tx=0x7fbee002a130 comp rx=0 tx=0).stop 2024-09-10T07:34:19.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbef7200640 1 -- 172.21.15.99:0/123424634 shutdown_connections 2024-09-10T07:34:19.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbef7200640 1 --2- 172.21.15.99:0/123424634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef00d0630 0x7fbef00d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:19.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbef7200640 1 --2- 172.21.15.99:0/123424634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef015b760 0x7fbef00afa90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:19.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbef7200640 1 -- 172.21.15.99:0/123424634 >> 172.21.15.99:0/123424634 conn(0x7fbef006bc10 msgr2=0x7fbef006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:19.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbef7200640 1 -- 172.21.15.99:0/123424634 shutdown_connections 2024-09-10T07:34:19.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.055+0000 7fbef7200640 1 -- 172.21.15.99:0/123424634 wait complete. 2024-09-10T07:34:19.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.057+0000 7fbef7200640 1 Processor -- start 2024-09-10T07:34:19.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.057+0000 7fbef7200640 1 -- start start 2024-09-10T07:34:19.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.058+0000 7fbef7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef00b4a90 0x7fbef01514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:19.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.058+0000 7fbef7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef00d0630 0x7fbef01598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:19.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.058+0000 7fbef7200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbef015b760 0x7fbef0159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:19.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.058+0000 7fbef7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbef00b4f20 con 0x7fbef00b4a90 2024-09-10T07:34:19.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.058+0000 7fbef7200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbef015bb40 con 0x7fbef015b760 2024-09-10T07:34:19.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.058+0000 7fbef7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbef0071470 con 0x7fbef00d0630 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.058+0000 7fbeefe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef00b4a90 0x7fbef01514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.058+0000 7fbeefe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef00b4a90 0x7fbef01514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54162/0 (socket says 172.21.15.99:54162) 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.058+0000 7fbeefe00640 1 -- 172.21.15.99:0/3831799820 learned_addr learned my addr 172.21.15.99:0/3831799820 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbeef400640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef00d0630 0x7fbef01598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbef5200640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbef015b760 0x7fbef0159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbeefe00640 1 -- 172.21.15.99:0/3831799820 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef00d0630 msgr2=0x7fbef01598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbeefe00640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef00d0630 0x7fbef01598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbeefe00640 1 -- 172.21.15.99:0/3831799820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbef015b760 msgr2=0x7fbef0159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbeefe00640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbef015b760 0x7fbef0159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbeefe00640 1 -- 172.21.15.99:0/3831799820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef00716c0 con 0x7fbef00b4a90 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbeefe00640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef00b4a90 0x7fbef01514c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbee0000c00 tx=0x7fbee00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbee7e00640 1 -- 172.21.15.99:0/3831799820 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee0037040 con 0x7fbef00b4a90 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbee7e00640 1 -- 172.21.15.99:0/3831799820 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee0042070 con 0x7fbef00b4a90 2024-09-10T07:34:19.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbee7e00640 1 -- 172.21.15.99:0/3831799820 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee0030980 con 0x7fbef00b4a90 2024-09-10T07:34:19.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbef7200640 1 -- 172.21.15.99:0/3831799820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef00719a0 con 0x7fbef00b4a90 2024-09-10T07:34:19.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.059+0000 7fbef7200640 1 -- 172.21.15.99:0/3831799820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef0071f60 con 0x7fbef00b4a90 2024-09-10T07:34:19.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.060+0000 7fbef7200640 1 -- 172.21.15.99:0/3831799820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef006dcc0 con 0x7fbef00b4a90 2024-09-10T07:34:19.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.061+0000 7fbee7e00640 1 -- 172.21.15.99:0/3831799820 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbee0030b20 con 0x7fbef00b4a90 2024-09-10T07:34:19.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.062+0000 7fbee7e00640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 0x7fbed006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:19.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.062+0000 7fbee7e00640 1 -- 172.21.15.99:0/3831799820 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fbee00ab860 con 0x7fbef00b4a90 2024-09-10T07:34:19.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.062+0000 7fbeef400640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 0x7fbed006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:19.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.063+0000 7fbeef400640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 0x7fbed006e2f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbedc007fd0 tx=0x7fbedc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:19.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.067+0000 7fbee7e00640 1 -- 172.21.15.99:0/3831799820 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbee007a1d0 con 0x7fbef00b4a90 2024-09-10T07:34:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.274+0000 7fbef7200640 1 -- 172.21.15.99:0/3831799820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbef00b16d0 con 0x7fbef00b4a90 2024-09-10T07:34:19.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.869+0000 7fbee7e00640 1 -- 172.21.15.99:0/3831799820 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fbee0079ad0 con 0x7fbef00b4a90 2024-09-10T07:34:19.869 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T07:34:19.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.872+0000 7fbef7200640 1 -- 172.21.15.99:0/3831799820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 msgr2=0x7fbed006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:19.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.872+0000 7fbef7200640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 0x7fbed006e2f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbedc007fd0 tx=0x7fbedc009040 comp rx=0 tx=0).stop 2024-09-10T07:34:19.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.872+0000 7fbef7200640 1 -- 172.21.15.99:0/3831799820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef00b4a90 msgr2=0x7fbef01514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.872+0000 7fbef7200640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef00b4a90 0x7fbef01514c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbee0000c00 tx=0x7fbee00046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:19.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.873+0000 7fbef7200640 1 -- 172.21.15.99:0/3831799820 shutdown_connections 2024-09-10T07:34:19.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.873+0000 7fbef7200640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbef015b760 0x7fbef0159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:19.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.873+0000 7fbef7200640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef00d0630 0x7fbef01598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:19.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.873+0000 7fbef7200640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 0x7fbed006e2f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:19.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.873+0000 7fbef7200640 1 --2- 172.21.15.99:0/3831799820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef00b4a90 0x7fbef01514c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:19.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.873+0000 7fbef7200640 1 -- 172.21.15.99:0/3831799820 >> 172.21.15.99:0/3831799820 conn(0x7fbef006bc10 msgr2=0x7fbef00b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:19.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.874+0000 7fbef7200640 1 -- 172.21.15.99:0/3831799820 shutdown_connections 2024-09-10T07:34:19.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:19.874+0000 7fbef7200640 1 -- 172.21.15.99:0/3831799820 wait complete. 2024-09-10T07:34:19.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:20.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.064+0000 7f944a600640 1 Processor -- start 2024-09-10T07:34:20.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.064+0000 7f944a600640 1 -- start start 2024-09-10T07:34:20.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.065+0000 7f944a600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d2ea0 0x7f94440d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.065+0000 7f944a600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f94440d37c0 0x7f9444161e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.065+0000 7f944a600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94440d04e0 con 0x7f94440d56d0 2024-09-10T07:34:20.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.065+0000 7f944a600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f94440b45a0 con 0x7f94440d37c0 2024-09-10T07:34:20.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.065+0000 7f944a600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f94440d07c0 con 0x7f94440d2ea0 2024-09-10T07:34:20.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9442a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f94440d37c0 0x7f9444161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9443400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d2ea0 0x7f94440d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9442a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f94440d37c0 0x7f9444161e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:60368/0 (socket says 172.21.15.99:60368) 2024-09-10T07:34:20.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9442a00640 1 -- 172.21.15.99:0/262538314 learned_addr learned my addr 172.21.15.99:0/262538314 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:20.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9443e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f94440d56d0 0x7f94440d1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:33734/0 (socket says 172.21.15.99:33734) 2024-09-10T07:34:20.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9443400640 1 -- 172.21.15.99:0/262538314 >> v2:172.21.15.187:3300/0 conn(0x7f94440d37c0 msgr2=0x7f9444161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:20.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9443400640 1 --2- 172.21.15.99:0/262538314 >> v2:172.21.15.187:3300/0 conn(0x7f94440d37c0 0x7f9444161e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9443400640 1 -- 172.21.15.99:0/262538314 >> v1:172.21.15.187:6789/0 conn(0x7f94440d56d0 legacy=0x7f94440d1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9443400640 1 -- 172.21.15.99:0/262538314 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94440d0aa0 con 0x7f94440d2ea0 2024-09-10T07:34:20.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9442a00640 1 --2- 172.21.15.99:0/262538314 >> v2:172.21.15.187:3300/0 conn(0x7f94440d37c0 0x7f9444161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:20.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.066+0000 7f9442000640 1 -- 172.21.15.99:0/262538314 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073278192 0 0) 0x7f94440d04e0 con 0x7f94440d56d0 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.067+0000 7f9443400640 1 --2- 172.21.15.99:0/262538314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d2ea0 0x7f94440d3280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f94340097d0 tx=0x7f943402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ee24a31d98b889 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f9442000640 1 -- 172.21.15.99:0/262538314 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434037070 con 0x7f94440d2ea0 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f9442000640 1 -- 172.21.15.99:0/262538314 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9434032440 con 0x7f94440d2ea0 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f9442000640 1 -- 172.21.15.99:0/262538314 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434032810 con 0x7f94440d2ea0 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f944a600640 1 -- 172.21.15.99:0/262538314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d2ea0 msgr2=0x7f94440d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f944a600640 1 --2- 172.21.15.99:0/262538314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d2ea0 0x7f94440d3280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f94340097d0 tx=0x7f943402a1c0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f944a600640 1 -- 172.21.15.99:0/262538314 shutdown_connections 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f944a600640 1 --2- 172.21.15.99:0/262538314 >> v2:172.21.15.187:3300/0 conn(0x7f94440d37c0 0x7f9444161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f944a600640 1 --2- 172.21.15.99:0/262538314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d2ea0 0x7f94440d3280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f944a600640 1 -- 172.21.15.99:0/262538314 >> 172.21.15.99:0/262538314 conn(0x7f94440d4bb0 msgr2=0x7f94440d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f944a600640 1 -- 172.21.15.99:0/262538314 shutdown_connections 2024-09-10T07:34:20.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.068+0000 7f944a600640 1 -- 172.21.15.99:0/262538314 wait complete. 2024-09-10T07:34:20.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.070+0000 7f944a600640 1 Processor -- start 2024-09-10T07:34:20.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.070+0000 7f944a600640 1 -- start start 2024-09-10T07:34:20.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f944a600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94440d2ea0 0x7f94440b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f944a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94440d37c0 0x7f94440b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f944a600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d56d0 0x7f94441f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f944a600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f94440b5bc0 con 0x7f94440d37c0 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f944a600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f94440b5a40 con 0x7f94440d2ea0 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f944a600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f94440b5d40 con 0x7f94440d56d0 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f9442a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94440d37c0 0x7f94440b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f9442a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94440d37c0 0x7f94440b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34164/0 (socket says 172.21.15.99:34164) 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f9442a00640 1 -- 172.21.15.99:0/3779649165 learned_addr learned my addr 172.21.15.99:0/3779649165 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f9443400640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94440d2ea0 0x7f94440b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.071+0000 7f9443e00640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d56d0 0x7f94441f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f9442a00640 1 -- 172.21.15.99:0/3779649165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d56d0 msgr2=0x7f94441f4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f9442a00640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d56d0 0x7f94441f4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f9442a00640 1 -- 172.21.15.99:0/3779649165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94440d2ea0 msgr2=0x7f94440b96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f9442a00640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94440d2ea0 0x7f94440b96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f9442a00640 1 -- 172.21.15.99:0/3779649165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94440b7b80 con 0x7f94440d37c0 2024-09-10T07:34:20.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f9443400640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94440d2ea0 0x7f94440b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:20.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f9442a00640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94440d37c0 0x7f94440b3090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f943000e9b0 tx=0x7f943000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:20.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f943b400640 1 -- 172.21.15.99:0/3779649165 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9430017070 con 0x7f94440d37c0 2024-09-10T07:34:20.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f943b400640 1 -- 172.21.15.99:0/3779649165 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943000ca00 con 0x7f94440d37c0 2024-09-10T07:34:20.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f944a600640 1 -- 172.21.15.99:0/3779649165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94440b7e60 con 0x7f94440d37c0 2024-09-10T07:34:20.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f943b400640 1 -- 172.21.15.99:0/3779649165 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943000cdf0 con 0x7f94440d37c0 2024-09-10T07:34:20.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.072+0000 7f944a600640 1 -- 172.21.15.99:0/3779649165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94440b8420 con 0x7f94440d37c0 2024-09-10T07:34:20.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.073+0000 7f944a600640 1 -- 172.21.15.99:0/3779649165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94440d3280 con 0x7f94440d37c0 2024-09-10T07:34:20.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.074+0000 7f943b400640 1 -- 172.21.15.99:0/3779649165 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f943001a070 con 0x7f94440d37c0 2024-09-10T07:34:20.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.076+0000 7f943b400640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f942406be30 0x7f942406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.076+0000 7f943b400640 1 -- 172.21.15.99:0/3779649165 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f943008b0c0 con 0x7f94440d37c0 2024-09-10T07:34:20.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.076+0000 7f9443400640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f942406be30 0x7f942406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.076+0000 7f9443400640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f942406be30 0x7f942406e2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9434034000 tx=0x7f943402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:20.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.080+0000 7f943b400640 1 -- 172.21.15.99:0/3779649165 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9430059410 con 0x7f94440d37c0 2024-09-10T07:34:20.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.254+0000 7f944a600640 1 -- 172.21.15.99:0/3779649165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94440b5530 con 0x7f94440d37c0 2024-09-10T07:34:20.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.255+0000 7f943b400640 1 -- 172.21.15.99:0/3779649165 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16654 (secure 0 0 0) 0x7f943005d710 con 0x7f94440d37c0 2024-09-10T07:34:20.255 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:20.255 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":19,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:19.275665+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:34:17.274179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:34:18.279150+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.257+0000 7f944a600640 1 -- 172.21.15.99:0/3779649165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f942406be30 msgr2=0x7f942406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.257+0000 7f944a600640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f942406be30 0x7f942406e2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9434034000 tx=0x7f943402e000 comp rx=0 tx=0).stop 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.257+0000 7f944a600640 1 -- 172.21.15.99:0/3779649165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94440d37c0 msgr2=0x7f94440b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.257+0000 7f944a600640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94440d37c0 0x7f94440b3090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f943000e9b0 tx=0x7f943000ee70 comp rx=0 tx=0).stop 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.257+0000 7f944a600640 1 -- 172.21.15.99:0/3779649165 shutdown_connections 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.257+0000 7f944a600640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94440d56d0 0x7f94441f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.257+0000 7f944a600640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f942406be30 0x7f942406e2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.257+0000 7f944a600640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94440d37c0 0x7f94440b3090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.257+0000 7f944a600640 1 --2- 172.21.15.99:0/3779649165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94440d2ea0 0x7f94440b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.257+0000 7f944a600640 1 -- 172.21.15.99:0/3779649165 >> 172.21.15.99:0/3779649165 conn(0x7f94440d4bb0 msgr2=0x7f94440b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:20.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.258+0000 7f944a600640 1 -- 172.21.15.99:0/3779649165 shutdown_connections 2024-09-10T07:34:20.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.258+0000 7f944a600640 1 -- 172.21.15.99:0/3779649165 wait complete. 2024-09-10T07:34:20.274 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.427+0000 7f8375c00640 1 Processor -- start 2024-09-10T07:34:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.427+0000 7f8375c00640 1 -- start start 2024-09-10T07:34:20.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.428+0000 7f8375c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700d3240 0x7f83700b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.428+0000 7f8375c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83700b7a90 con 0x7f83700d1ab0 2024-09-10T07:34:20.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.428+0000 7f8375c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83700d3740 con 0x7f837015ef50 2024-09-10T07:34:20.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.428+0000 7f8375c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f83700d3a20 con 0x7f83700d3240 2024-09-10T07:34:20.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836e000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f83700d1ab0 0x7f83700b8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51846/0 (socket says 172.21.15.99:51846) 2024-09-10T07:34:20.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836e000640 1 -- 172.21.15.99:0/1584741049 learned_addr learned my addr 172.21.15.99:0/1584741049 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836f400640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700d3240 0x7f83700b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965647837 0 0) 0x7f83700b7a90 con 0x7f83700d1ab0 2024-09-10T07:34:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8354003520 con 0x7f83700d1ab0 2024-09-10T07:34:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3944606202 0 0) 0x7f8354003520 con 0x7f83700d1ab0 2024-09-10T07:34:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700d3240 msgr2=0x7f83700b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836d600640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700d3240 0x7f83700b8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 >> v1:172.21.15.187:6789/0 conn(0x7f837015ef50 legacy=0x7f83700d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83700b7d00 con 0x7f83700d1ab0 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f835c001670 con 0x7f83700d1ab0 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.429+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 >> v1:172.21.15.99:6789/0 conn(0x7f83700d1ab0 legacy=0x7f83700b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836d600640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83540039e0 0x7f8354003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836d600640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700d3240 0x7f8354004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836d600640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8354004d40 0x7f83540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f83700d3a20 con 0x7f8354004d40 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f835400baf0 con 0x7f83540039e0 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f835400bcf0 con 0x7f83700d3240 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836f400640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8354004d40 0x7f83540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836ea00640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83540039e0 0x7f8354003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836e000640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700d3240 0x7f8354004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836f400640 1 -- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700d3240 msgr2=0x7f8354004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836f400640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700d3240 0x7f8354004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836f400640 1 -- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83540039e0 msgr2=0x7f8354003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836f400640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83540039e0 0x7f8354003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.430+0000 7f836f400640 1 -- 172.21.15.99:0/1584741049 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8354003520 con 0x7f8354004d40 2024-09-10T07:34:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.431+0000 7f836f400640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8354004d40 0x7f83540051c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8368009a90 tx=0x7f8354005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f68fb6e4d03605 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.431+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368036070 con 0x7f8354004d40 2024-09-10T07:34:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.431+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368031400 con 0x7f8354004d40 2024-09-10T07:34:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.431+0000 7f836d600640 1 -- 172.21.15.99:0/1584741049 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368009690 con 0x7f8354004d40 2024-09-10T07:34:20.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.432+0000 7f8375c00640 1 -- 172.21.15.99:0/1584741049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8354004d40 msgr2=0x7f83540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.432+0000 7f8375c00640 1 --2- 172.21.15.99:0/1584741049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8354004d40 0x7f83540051c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8368009a90 tx=0x7f8354005830 comp rx=0 tx=0).stop 2024-09-10T07:34:20.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.432+0000 7f836f400640 1 -- 172.21.15.99:0/1584741049 reap_dead start 2024-09-10T07:34:20.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.432+0000 7f8375c00640 1 -- 172.21.15.99:0/1584741049 shutdown_connections 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.432+0000 7f8375c00640 1 -- 172.21.15.99:0/1584741049 >> 172.21.15.99:0/1584741049 conn(0x7f83700d4c60 msgr2=0x7f83700d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.432+0000 7f8375c00640 1 -- 172.21.15.99:0/1584741049 shutdown_connections 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.432+0000 7f8375c00640 1 -- 172.21.15.99:0/1584741049 wait complete. 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.434+0000 7f8375c00640 1 Processor -- start 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.434+0000 7f8375c00640 1 -- start start 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f8375c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f837014aff0 0x7f83700c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f8375c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700cb1b0 0x7f83700b9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f8375c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83700b97d0 0x7f837015f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f8375c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f83700d21a0 con 0x7f83700b97d0 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f8375c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f83700d2020 con 0x7f837014aff0 2024-09-10T07:34:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f8375c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f83700d5780 con 0x7f83700cb1b0 2024-09-10T07:34:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83700b97d0 0x7f837015f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83700b97d0 0x7f837015f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34184/0 (socket says 172.21.15.99:34184) 2024-09-10T07:34:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836f400640 1 -- 172.21.15.99:0/1366020118 learned_addr learned my addr 172.21.15.99:0/1366020118 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836ea00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f837014aff0 0x7f83700c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836e000640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700cb1b0 0x7f83700b9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836f400640 1 -- 172.21.15.99:0/1366020118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700cb1b0 msgr2=0x7f83700b9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836f400640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700cb1b0 0x7f83700b9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836f400640 1 -- 172.21.15.99:0/1366020118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f837014aff0 msgr2=0x7f83700c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836f400640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f837014aff0 0x7f83700c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836f400640 1 -- 172.21.15.99:0/1366020118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8370162180 con 0x7f83700b97d0 2024-09-10T07:34:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836e000640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700cb1b0 0x7f83700b9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.435+0000 7f836ea00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f837014aff0 0x7f83700c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.436+0000 7f836f400640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83700b97d0 0x7f837015f3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8368009a90 tx=0x7f8368004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.436+0000 7f8366a00640 1 -- 172.21.15.99:0/1366020118 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368036040 con 0x7f83700b97d0 2024-09-10T07:34:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.436+0000 7f8366a00640 1 -- 172.21.15.99:0/1366020118 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368041070 con 0x7f83700b97d0 2024-09-10T07:34:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.436+0000 7f8366a00640 1 -- 172.21.15.99:0/1366020118 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368009690 con 0x7f83700b97d0 2024-09-10T07:34:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.436+0000 7f8375c00640 1 -- 172.21.15.99:0/1366020118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83700c8d00 con 0x7f83700b97d0 2024-09-10T07:34:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.436+0000 7f8375c00640 1 -- 172.21.15.99:0/1366020118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8370162460 con 0x7f83700b97d0 2024-09-10T07:34:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.437+0000 7f8375c00640 1 -- 172.21.15.99:0/1366020118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83700d13a0 con 0x7f83700b97d0 2024-09-10T07:34:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.438+0000 7f8366a00640 1 -- 172.21.15.99:0/1366020118 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8368003c40 con 0x7f83700b97d0 2024-09-10T07:34:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.439+0000 7f8366a00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f835006be60 0x7f835006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.439+0000 7f8366a00640 1 -- 172.21.15.99:0/1366020118 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f83680aa090 con 0x7f83700b97d0 2024-09-10T07:34:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.439+0000 7f836ea00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f835006be60 0x7f835006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.440+0000 7f836ea00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f835006be60 0x7f835006e320 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83600019f0 tx=0x7f8360009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:20.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.444+0000 7f8366a00640 1 -- 172.21.15.99:0/1366020118 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83680044e0 con 0x7f83700b97d0 2024-09-10T07:34:20.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.623+0000 7f8375c00640 1 -- 172.21.15.99:0/1366020118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83700c9220 con 0x7f83700b97d0 2024-09-10T07:34:20.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.624+0000 7f8366a00640 1 -- 172.21.15.99:0/1366020118 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16654 (secure 0 0 0) 0x7f8368078a30 con 0x7f83700b97d0 2024-09-10T07:34:20.625 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:20.625 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":19,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:19.275665+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:34:17.274179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:34:18.279150+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 -- 172.21.15.99:0/1366020118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f835006be60 msgr2=0x7f835006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f835006be60 0x7f835006e320 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83600019f0 tx=0x7f8360009040 comp rx=0 tx=0).stop 2024-09-10T07:34:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 -- 172.21.15.99:0/1366020118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83700b97d0 msgr2=0x7f837015f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83700b97d0 0x7f837015f3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8368009a90 tx=0x7f8368004730 comp rx=0 tx=0).stop 2024-09-10T07:34:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 -- 172.21.15.99:0/1366020118 shutdown_connections 2024-09-10T07:34:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f835006be60 0x7f835006e320 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83700b97d0 0x7f837015f3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83700cb1b0 0x7f83700b9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 --2- 172.21.15.99:0/1366020118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f837014aff0 0x7f83700c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 -- 172.21.15.99:0/1366020118 >> 172.21.15.99:0/1366020118 conn(0x7f83700d4c60 msgr2=0x7f83700d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 -- 172.21.15.99:0/1366020118 shutdown_connections 2024-09-10T07:34:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.627+0000 7f8375c00640 1 -- 172.21.15.99:0/1366020118 wait complete. 2024-09-10T07:34:20.642 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:34:20.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.798+0000 7fd5a4200640 1 Processor -- start 2024-09-10T07:34:20.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.799+0000 7fd5a4200640 1 -- start start 2024-09-10T07:34:20.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd5a4200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd59c0d1b80 0x7fd59c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd5a4200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59c0d3700 con 0x7fd59c1623c0 2024-09-10T07:34:20.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd5a4200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59c0cfa70 con 0x7fd59c0d56b0 2024-09-10T07:34:20.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd5a4200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd59c0d21a0 con 0x7fd59c0d1b80 2024-09-10T07:34:20.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd5a1800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd59c1623c0 0x7fd59c0d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51854/0 (socket says 172.21.15.99:51854) 2024-09-10T07:34:20.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd5a1800640 1 -- 172.21.15.99:0/2350052460 learned_addr learned my addr 172.21.15.99:0/2350052460 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:20.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd5a2200640 1 --2- 172.21.15.99:0/2350052460 >> v2:172.21.15.187:3300/0 conn(0x7fd59c0d1b80 0x7fd59c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd59be00640 1 -- 172.21.15.99:0/2350052460 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 274027523 0 0) 0x7fd59c0d3700 con 0x7fd59c1623c0 2024-09-10T07:34:20.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd59be00640 1 -- 172.21.15.99:0/2350052460 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd584003520 con 0x7fd59c1623c0 2024-09-10T07:34:20.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd59be00640 1 -- 172.21.15.99:0/2350052460 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1302682107 0 0) 0x7fd59c0cfa70 con 0x7fd59c0d56b0 2024-09-10T07:34:20.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.800+0000 7fd59be00640 1 -- 172.21.15.99:0/2350052460 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd59c0d3700 con 0x7fd59c0d56b0 2024-09-10T07:34:20.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.801+0000 7fd5a2200640 1 -- 172.21.15.99:0/2350052460 >> v1:172.21.15.187:6789/0 conn(0x7fd59c0d56b0 legacy=0x7fd59c0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.801+0000 7fd5a2200640 1 -- 172.21.15.99:0/2350052460 >> v1:172.21.15.99:6789/0 conn(0x7fd59c1623c0 legacy=0x7fd59c0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.801+0000 7fd5a2200640 1 -- 172.21.15.99:0/2350052460 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c0d0c20 con 0x7fd59c0d1b80 2024-09-10T07:34:20.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.802+0000 7fd5a2200640 1 --2- 172.21.15.99:0/2350052460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd59c0d1b80 0x7fd59c0b6260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd594009d90 tx=0x7fd59402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd6848af5d5a44d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:20.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.802+0000 7fd59be00640 1 -- 172.21.15.99:0/2350052460 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594007740 con 0x7fd59c0d1b80 2024-09-10T07:34:20.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.802+0000 7fd59be00640 1 -- 172.21.15.99:0/2350052460 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5940078e0 con 0x7fd59c0d1b80 2024-09-10T07:34:20.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.802+0000 7fd59be00640 1 -- 172.21.15.99:0/2350052460 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594007cb0 con 0x7fd59c0d1b80 2024-09-10T07:34:20.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.802+0000 7fd5a4200640 1 -- 172.21.15.99:0/2350052460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd59c0d1b80 msgr2=0x7fd59c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.802+0000 7fd5a4200640 1 --2- 172.21.15.99:0/2350052460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd59c0d1b80 0x7fd59c0b6260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd594009d90 tx=0x7fd59402a6f0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.802+0000 7fd5a4200640 1 -- 172.21.15.99:0/2350052460 shutdown_connections 2024-09-10T07:34:20.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.802+0000 7fd5a4200640 1 --2- 172.21.15.99:0/2350052460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd59c0d1b80 0x7fd59c0b6260 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.802+0000 7fd5a4200640 1 -- 172.21.15.99:0/2350052460 >> 172.21.15.99:0/2350052460 conn(0x7fd59c09df30 msgr2=0x7fd59c0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:20.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.803+0000 7fd5a4200640 1 -- 172.21.15.99:0/2350052460 shutdown_connections 2024-09-10T07:34:20.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.803+0000 7fd5a4200640 1 -- 172.21.15.99:0/2350052460 wait complete. 2024-09-10T07:34:20.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.804+0000 7fd5a4200640 1 Processor -- start 2024-09-10T07:34:20.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.804+0000 7fd5a4200640 1 -- start start 2024-09-10T07:34:20.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.805+0000 7fd5a4200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd59c0d1b80 0x7fd59c09f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.805+0000 7fd5a4200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd59c0d56b0 0x7fd59c0ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.805+0000 7fd5a4200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd59c1623c0 0x7fd59c1603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.805+0000 7fd5a4200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c0cfd10 con 0x7fd59c0d56b0 2024-09-10T07:34:20.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.805+0000 7fd5a4200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c0d0080 con 0x7fd59c1623c0 2024-09-10T07:34:20.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.805+0000 7fd5a4200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd59c1627a0 con 0x7fd59c0d1b80 2024-09-10T07:34:20.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.805+0000 7fd5a0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd59c0d56b0 0x7fd59c0ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd59c0d56b0 0x7fd59c0ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34198/0 (socket says 172.21.15.99:34198) 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a0e00640 1 -- 172.21.15.99:0/1460070928 learned_addr learned my addr 172.21.15.99:0/1460070928 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a2200640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd59c1623c0 0x7fd59c1603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a1800640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd59c0d1b80 0x7fd59c09f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a0e00640 1 -- 172.21.15.99:0/1460070928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd59c0d1b80 msgr2=0x7fd59c09f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a0e00640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd59c0d1b80 0x7fd59c09f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a0e00640 1 -- 172.21.15.99:0/1460070928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd59c1623c0 msgr2=0x7fd59c1603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a0e00640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd59c1623c0 0x7fd59c1603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a0e00640 1 -- 172.21.15.99:0/1460070928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c0cc0c0 con 0x7fd59c0d56b0 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a0e00640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd59c0d56b0 0x7fd59c0ce2a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd58800c530 tx=0x7fd58800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd599600640 1 -- 172.21.15.99:0/1460070928 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5880052d0 con 0x7fd59c0d56b0 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd599600640 1 -- 172.21.15.99:0/1460070928 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd588005490 con 0x7fd59c0d56b0 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd599600640 1 -- 172.21.15.99:0/1460070928 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588012870 con 0x7fd59c0d56b0 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.806+0000 7fd5a4200640 1 -- 172.21.15.99:0/1460070928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c0cc3a0 con 0x7fd59c0d56b0 2024-09-10T07:34:20.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.807+0000 7fd5a4200640 1 -- 172.21.15.99:0/1460070928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c0ccc40 con 0x7fd59c0d56b0 2024-09-10T07:34:20.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.808+0000 7fd5a4200640 1 -- 172.21.15.99:0/1460070928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59c0cc570 con 0x7fd59c0d56b0 2024-09-10T07:34:20.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.808+0000 7fd599600640 1 -- 172.21.15.99:0/1460070928 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd588012a10 con 0x7fd59c0d56b0 2024-09-10T07:34:20.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.809+0000 7fd599600640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd57c06be30 0x7fd57c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:20.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.809+0000 7fd599600640 1 -- 172.21.15.99:0/1460070928 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fd58808ab20 con 0x7fd59c0d56b0 2024-09-10T07:34:20.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.810+0000 7fd5a1800640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd57c06be30 0x7fd57c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:20.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.810+0000 7fd5a1800640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd57c06be30 0x7fd57c06e2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd590005880 tx=0x7fd590009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:20.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:20.813+0000 7fd599600640 1 -- 172.21.15.99:0/1460070928 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd588059440 con 0x7fd59c0d56b0 2024-09-10T07:34:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.024+0000 7fd5a4200640 1 -- 172.21.15.99:0/1460070928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd59c0cce40 con 0x7fd59c0d56b0 2024-09-10T07:34:21.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.898+0000 7fd599600640 1 -- 172.21.15.99:0/1460070928 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fd59c0cce40 con 0x7fd59c0d56b0 2024-09-10T07:34:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 -- 172.21.15.99:0/1460070928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd57c06be30 msgr2=0x7fd57c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd57c06be30 0x7fd57c06e2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd590005880 tx=0x7fd590009040 comp rx=0 tx=0).stop 2024-09-10T07:34:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 -- 172.21.15.99:0/1460070928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd59c0d56b0 msgr2=0x7fd59c0ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd59c0d56b0 0x7fd59c0ce2a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd58800c530 tx=0x7fd58800c9f0 comp rx=0 tx=0).stop 2024-09-10T07:34:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 -- 172.21.15.99:0/1460070928 shutdown_connections 2024-09-10T07:34:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd59c1623c0 0x7fd59c1603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd57c06be30 0x7fd57c06e2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd59c0d56b0 0x7fd59c0ce2a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 --2- 172.21.15.99:0/1460070928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd59c0d1b80 0x7fd59c09f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:21.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 -- 172.21.15.99:0/1460070928 >> 172.21.15.99:0/1460070928 conn(0x7fd59c09df30 msgr2=0x7fd59c0d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:21.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 -- 172.21.15.99:0/1460070928 shutdown_connections 2024-09-10T07:34:21.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:21.902+0000 7fd5a4200640 1 -- 172.21.15.99:0/1460070928 wait complete. 2024-09-10T07:34:21.919 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']} 2024-09-10T07:34:21.920 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:34:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.078+0000 7f29e7200640 1 Processor -- start 2024-09-10T07:34:22.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.078+0000 7f29e7200640 1 -- start start 2024-09-10T07:34:22.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e815c580 0x7f29e806d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:22.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e7200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29e80b5960 0x7f29e806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:22.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e7200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e806d920 con 0x7f29e815c960 2024-09-10T07:34:22.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e7200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f29e80b3930 con 0x7f29e80b5960 2024-09-10T07:34:22.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f29e806dc00 con 0x7f29e815c580 2024-09-10T07:34:22.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29e80b5960 0x7f29e806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:22.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29dd400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f29e815c960 0x7f29e80cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51858/0 (socket says 172.21.15.99:51858) 2024-09-10T07:34:22.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29dd400640 1 -- 172.21.15.99:0/1273592038 learned_addr learned my addr 172.21.15.99:0/1273592038 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:22.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e5e00640 1 --2- 172.21.15.99:0/1273592038 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e815c580 0x7f29e806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:22.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e6800640 1 -- 172.21.15.99:0/1273592038 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e815c580 msgr2=0x7f29e806d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:22.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e6800640 1 --2- 172.21.15.99:0/1273592038 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e815c580 0x7f29e806d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e6800640 1 -- 172.21.15.99:0/1273592038 >> v1:172.21.15.99:6789/0 conn(0x7f29e815c960 legacy=0x7f29e80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:22.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e6800640 1 -- 172.21.15.99:0/1273592038 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e806dee0 con 0x7f29e80b5960 2024-09-10T07:34:22.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e5400640 1 -- 172.21.15.99:0/1273592038 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897784505 0 0) 0x7f29e806d920 con 0x7f29e815c960 2024-09-10T07:34:22.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.080+0000 7f29e5e00640 1 --2- 172.21.15.99:0/1273592038 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e815c580 0x7f29e806d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:22.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.081+0000 7f29e6800640 1 --2- 172.21.15.99:0/1273592038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 0x7f29e806bc10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009d90 tx=0x7f29e002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c253609cd692bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:22.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.081+0000 7f29e5400640 1 -- 172.21.15.99:0/1273592038 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0007740 con 0x7f29e80b5960 2024-09-10T07:34:22.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.082+0000 7f29e5400640 1 -- 172.21.15.99:0/1273592038 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e00078e0 con 0x7f29e80b5960 2024-09-10T07:34:22.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.082+0000 7f29e5400640 1 -- 172.21.15.99:0/1273592038 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0007cb0 con 0x7f29e80b5960 2024-09-10T07:34:22.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.082+0000 7f29e7200640 1 -- 172.21.15.99:0/1273592038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 msgr2=0x7f29e806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.082+0000 7f29e7200640 1 --2- 172.21.15.99:0/1273592038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 0x7f29e806bc10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009d90 tx=0x7f29e002a660 comp rx=0 tx=0).stop 2024-09-10T07:34:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.082+0000 7f29e7200640 1 -- 172.21.15.99:0/1273592038 shutdown_connections 2024-09-10T07:34:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.082+0000 7f29e7200640 1 --2- 172.21.15.99:0/1273592038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 0x7f29e806bc10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.082+0000 7f29e7200640 1 --2- 172.21.15.99:0/1273592038 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e815c580 0x7f29e806d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.082+0000 7f29e7200640 1 -- 172.21.15.99:0/1273592038 >> 172.21.15.99:0/1273592038 conn(0x7f29e80b2810 msgr2=0x7f29e80b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.082+0000 7f29e7200640 1 -- 172.21.15.99:0/1273592038 shutdown_connections 2024-09-10T07:34:22.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.082+0000 7f29e7200640 1 -- 172.21.15.99:0/1273592038 wait complete. 2024-09-10T07:34:22.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.084+0000 7f29e7200640 1 Processor -- start 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.084+0000 7f29e7200640 1 -- start start 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 0x7f29e815ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e7200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29e815c580 0x7f29e814a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e8146800 0x7f29e8151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f29e806c150 con 0x7f29e80b5960 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e7200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f29e80b5d60 con 0x7f29e815c580 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f29e806c2d0 con 0x7f29e8146800 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 0x7f29e815ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 0x7f29e815ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34220/0 (socket says 172.21.15.99:34220) 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e5e00640 1 -- 172.21.15.99:0/1373411341 learned_addr learned my addr 172.21.15.99:0/1373411341 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29dd400640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29e815c580 0x7f29e814a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e6800640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e8146800 0x7f29e8151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e5e00640 1 -- 172.21.15.99:0/1373411341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e8146800 msgr2=0x7f29e8151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e5e00640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e8146800 0x7f29e8151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e5e00640 1 -- 172.21.15.99:0/1373411341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29e815c580 msgr2=0x7f29e814a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e5e00640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29e815c580 0x7f29e814a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e5e00640 1 -- 172.21.15.99:0/1373411341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e814ac60 con 0x7f29e80b5960 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.085+0000 7f29e6800640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e8146800 0x7f29e8151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.086+0000 7f29e5e00640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 0x7f29e815ef80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f29d800e730 tx=0x7f29d800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.086+0000 7f29dea00640 1 -- 172.21.15.99:0/1373411341 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d800f040 con 0x7f29e80b5960 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.086+0000 7f29dea00640 1 -- 172.21.15.99:0/1373411341 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d8004230 con 0x7f29e80b5960 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.086+0000 7f29e7200640 1 -- 172.21.15.99:0/1373411341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e814af40 con 0x7f29e80b5960 2024-09-10T07:34:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.086+0000 7f29dea00640 1 -- 172.21.15.99:0/1373411341 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d800ee40 con 0x7f29e80b5960 2024-09-10T07:34:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.086+0000 7f29e7200640 1 -- 172.21.15.99:0/1373411341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e814b500 con 0x7f29e80b5960 2024-09-10T07:34:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.087+0000 7f29e7200640 1 -- 172.21.15.99:0/1373411341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e806bc10 con 0x7f29e80b5960 2024-09-10T07:34:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.088+0000 7f29dea00640 1 -- 172.21.15.99:0/1373411341 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29d800c670 con 0x7f29e80b5960 2024-09-10T07:34:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.089+0000 7f29dea00640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29c406be30 0x7f29c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.089+0000 7f29dea00640 1 -- 172.21.15.99:0/1373411341 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f29d808ab50 con 0x7f29e80b5960 2024-09-10T07:34:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.089+0000 7f29dd400640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29c406be30 0x7f29c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.089+0000 7f29dd400640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29c406be30 0x7f29c406e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29e8151c50 tx=0x7f29d0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.093+0000 7f29dea00640 1 -- 172.21.15.99:0/1373411341 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29d8017020 con 0x7f29e80b5960 2024-09-10T07:34:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.300+0000 7f29e7200640 1 -- 172.21.15.99:0/1373411341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f29e815f610 con 0x7f29e80b5960 2024-09-10T07:34:22.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.906+0000 7f29dea00640 1 -- 172.21.15.99:0/1373411341 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f29d8058e10 con 0x7f29e80b5960 2024-09-10T07:34:22.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 -- 172.21.15.99:0/1373411341 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29c406be30 msgr2=0x7f29c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:22.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29c406be30 0x7f29c406e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f29e8151c50 tx=0x7f29d0007de0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 -- 172.21.15.99:0/1373411341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 msgr2=0x7f29e815ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:22.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 0x7f29e815ef80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f29d800e730 tx=0x7f29d800ebf0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 -- 172.21.15.99:0/1373411341 shutdown_connections 2024-09-10T07:34:22.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29e8146800 0x7f29e8151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29e815c580 0x7f29e814a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29c406be30 0x7f29c406e2f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 --2- 172.21.15.99:0/1373411341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e80b5960 0x7f29e815ef80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:22.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 -- 172.21.15.99:0/1373411341 >> 172.21.15.99:0/1373411341 conn(0x7f29e80b2810 msgr2=0x7f29e80721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:22.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 -- 172.21.15.99:0/1373411341 shutdown_connections 2024-09-10T07:34:22.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:22.909+0000 7f29e7200640 1 -- 172.21.15.99:0/1373411341 wait complete. 2024-09-10T07:34:22.928 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:34:22.928 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:34:23.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.085+0000 7fba0e400640 1 Processor -- start 2024-09-10T07:34:23.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.085+0000 7fba0e400640 1 -- start start 2024-09-10T07:34:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.086+0000 7fba0e400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fba0815ef50 0x7fba080d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.086+0000 7fba0e400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fba080b9510 0x7fba080d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.086+0000 7fba0e400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba080b7a90 con 0x7fba080d3240 2024-09-10T07:34:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.086+0000 7fba0e400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fba080d3740 con 0x7fba0815ef50 2024-09-10T07:34:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.086+0000 7fba0e400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fba080d3a20 con 0x7fba080b9510 2024-09-10T07:34:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.087+0000 7fba07400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fba0815ef50 0x7fba080d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.087+0000 7fba07400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fba0815ef50 0x7fba080d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34236/0 (socket says 172.21.15.99:34236) 2024-09-10T07:34:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.087+0000 7fba07400640 1 -- 172.21.15.99:0/3907761208 learned_addr learned my addr 172.21.15.99:0/3907761208 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.087+0000 7fba07e00640 1 --2- 172.21.15.99:0/3907761208 >> v2:172.21.15.187:3300/0 conn(0x7fba080b9510 0x7fba080d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.087+0000 7fba07400640 1 -- 172.21.15.99:0/3907761208 >> v2:172.21.15.187:3300/0 conn(0x7fba080b9510 msgr2=0x7fba080d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:23.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.087+0000 7fba07400640 1 --2- 172.21.15.99:0/3907761208 >> v2:172.21.15.187:3300/0 conn(0x7fba080b9510 0x7fba080d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.087+0000 7fba07400640 1 -- 172.21.15.99:0/3907761208 >> v1:172.21.15.187:6789/0 conn(0x7fba080d3240 legacy=0x7fba080cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:23.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.087+0000 7fba07400640 1 -- 172.21.15.99:0/3907761208 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba080b7d00 con 0x7fba0815ef50 2024-09-10T07:34:23.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.087+0000 7fba07e00640 1 --2- 172.21.15.99:0/3907761208 >> v2:172.21.15.187:3300/0 conn(0x7fba080b9510 0x7fba080d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:23.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.088+0000 7fba07400640 1 --2- 172.21.15.99:0/3907761208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0815ef50 0x7fba080d13a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba0808ea60 tx=0x7fb9f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5477b2572add6f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:23.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.088+0000 7fba06000640 1 -- 172.21.15.99:0/3907761208 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8037070 con 0x7fba0815ef50 2024-09-10T07:34:23.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.088+0000 7fba06000640 1 -- 172.21.15.99:0/3907761208 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f8032440 con 0x7fba0815ef50 2024-09-10T07:34:23.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.088+0000 7fba06000640 1 -- 172.21.15.99:0/3907761208 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8032810 con 0x7fba0815ef50 2024-09-10T07:34:23.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.089+0000 7fba0e400640 1 -- 172.21.15.99:0/3907761208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0815ef50 msgr2=0x7fba080d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.089+0000 7fba0e400640 1 --2- 172.21.15.99:0/3907761208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0815ef50 0x7fba080d13a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fba0808ea60 tx=0x7fb9f802a1a0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.089+0000 7fba0e400640 1 -- 172.21.15.99:0/3907761208 shutdown_connections 2024-09-10T07:34:23.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.089+0000 7fba0e400640 1 --2- 172.21.15.99:0/3907761208 >> v2:172.21.15.187:3300/0 conn(0x7fba080b9510 0x7fba080d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.089+0000 7fba0e400640 1 --2- 172.21.15.99:0/3907761208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba0815ef50 0x7fba080d13a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.089+0000 7fba0e400640 1 -- 172.21.15.99:0/3907761208 >> 172.21.15.99:0/3907761208 conn(0x7fba080d4c60 msgr2=0x7fba080d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:23.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.089+0000 7fba0e400640 1 -- 172.21.15.99:0/3907761208 shutdown_connections 2024-09-10T07:34:23.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.089+0000 7fba0e400640 1 -- 172.21.15.99:0/3907761208 wait complete. 2024-09-10T07:34:23.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.091+0000 7fba0e400640 1 Processor -- start 2024-09-10T07:34:23.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.091+0000 7fba0e400640 1 -- start start 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba0e400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba080b9510 0x7fba080b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba0e400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080d3240 0x7fba080c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba0e400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba0815ef50 0x7fba080b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba0e400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fba080d21a0 con 0x7fba080d3240 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba0e400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fba080d2020 con 0x7fba080b9510 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba0e400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fba080d5780 con 0x7fba0815ef50 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba06a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080d3240 0x7fba080c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba06a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080d3240 0x7fba080c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34252/0 (socket says 172.21.15.99:34252) 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba06a00640 1 -- 172.21.15.99:0/2835609805 learned_addr learned my addr 172.21.15.99:0/2835609805 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba07400640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba080b9510 0x7fba080b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba07e00640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba0815ef50 0x7fba080b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba06a00640 1 -- 172.21.15.99:0/2835609805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba0815ef50 msgr2=0x7fba080b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba06a00640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba0815ef50 0x7fba080b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba06a00640 1 -- 172.21.15.99:0/2835609805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba080b9510 msgr2=0x7fba080b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba06a00640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba080b9510 0x7fba080b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.092+0000 7fba06a00640 1 -- 172.21.15.99:0/2835609805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba080ca7d0 con 0x7fba080d3240 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.093+0000 7fba06a00640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080d3240 0x7fba080c9d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400c460 tx=0x7fb9f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.093+0000 7fb9ff400640 1 -- 172.21.15.99:0/2835609805 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4016020 con 0x7fba080d3240 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.093+0000 7fb9ff400640 1 -- 172.21.15.99:0/2835609805 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f4012870 con 0x7fba080d3240 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.093+0000 7fb9ff400640 1 -- 172.21.15.99:0/2835609805 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4012c60 con 0x7fba080d3240 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.093+0000 7fba0e400640 1 -- 172.21.15.99:0/2835609805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba080caab0 con 0x7fba080d3240 2024-09-10T07:34:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.093+0000 7fba0e400640 1 -- 172.21.15.99:0/2835609805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba080b3a80 con 0x7fba080d3240 2024-09-10T07:34:23.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.094+0000 7fba0e400640 1 -- 172.21.15.99:0/2835609805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba080d1b60 con 0x7fba080d3240 2024-09-10T07:34:23.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.095+0000 7fb9ff400640 1 -- 172.21.15.99:0/2835609805 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb9f4019020 con 0x7fba080d3240 2024-09-10T07:34:23.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.096+0000 7fb9ff400640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9e806be60 0x7fb9e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.096+0000 7fb9ff400640 1 -- 172.21.15.99:0/2835609805 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb9f408aab0 con 0x7fba080d3240 2024-09-10T07:34:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.096+0000 7fba07400640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9e806be60 0x7fb9e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.096+0000 7fba07400640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9e806be60 0x7fb9e806e320 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8034000 tx=0x7fb9f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:23.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.100+0000 7fb9ff400640 1 -- 172.21.15.99:0/2835609805 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9f4020030 con 0x7fba080d3240 2024-09-10T07:34:23.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.304+0000 7fba0e400640 1 -- 172.21.15.99:0/2835609805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba080d53c0 con 0x7fba080d3240 2024-09-10T07:34:23.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.305+0000 7fb9ff400640 1 -- 172.21.15.99:0/2835609805 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7fb9f4058d70 con 0x7fba080d3240 2024-09-10T07:34:23.305 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:23.305 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"btime":"2024-09-10T07:34:22:900404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3627151667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3627151667},{"type":"v1","addr":"172.21.15.99:6835","nonce":3627151667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/72768681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":72768681},{"type":"v1","addr":"172.21.15.99:6837","nonce":72768681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3327861481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3327861481},{"type":"v1","addr":"172.21.15.187:6834","nonce":3327861481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:34:19.275989+0000","modified":"2024-09-10T07:34:22.302078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/4184584284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4184584284},{"type":"v1","addr":"172.21.15.187:6835","nonce":4184584284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-10T07:34:23.306 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-09-10T07:34:23.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 -- 172.21.15.99:0/2835609805 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9e806be60 msgr2=0x7fb9e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9e806be60 0x7fb9e806e320 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8034000 tx=0x7fb9f802e000 comp rx=0 tx=0).stop 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 -- 172.21.15.99:0/2835609805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080d3240 msgr2=0x7fba080c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080d3240 0x7fba080c9d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400c460 tx=0x7fb9f400c920 comp rx=0 tx=0).stop 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 -- 172.21.15.99:0/2835609805 shutdown_connections 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba0815ef50 0x7fba080b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9e806be60 0x7fb9e806e320 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080d3240 0x7fba080c9d50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 --2- 172.21.15.99:0/2835609805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba080b9510 0x7fba080b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 -- 172.21.15.99:0/2835609805 >> 172.21.15.99:0/2835609805 conn(0x7fba080d4c60 msgr2=0x7fba080cb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.307+0000 7fba0e400640 1 -- 172.21.15.99:0/2835609805 shutdown_connections 2024-09-10T07:34:23.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.308+0000 7fba0e400640 1 -- 172.21.15.99:0/2835609805 wait complete. 2024-09-10T07:34:23.323 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:23.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.476+0000 7f2e4ee00640 1 Processor -- start 2024-09-10T07:34:23.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.476+0000 7f2e4ee00640 1 -- start start 2024-09-10T07:34:23.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e4ee00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e480ce780 0x7f2e4806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e4ee00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4806e3d0 con 0x7f2e48072f40 2024-09-10T07:34:23.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e4ee00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4806e6b0 con 0x7f2e48145290 2024-09-10T07:34:23.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e4ee00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4806efe0 con 0x7f2e480ce780 2024-09-10T07:34:23.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e47400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2e48072f40 0x7f2e480b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51868/0 (socket says 172.21.15.99:51868) 2024-09-10T07:34:23.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e47400640 1 -- 172.21.15.99:0/3315991339 learned_addr learned my addr 172.21.15.99:0/3315991339 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:23.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e4ce00640 1 --2- 172.21.15.99:0/3315991339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e480ce780 0x7f2e4806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e46a00640 1 -- 172.21.15.99:0/3315991339 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807845816 0 0) 0x7f2e4806e3d0 con 0x7f2e48072f40 2024-09-10T07:34:23.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e46a00640 1 -- 172.21.15.99:0/3315991339 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e2c003520 con 0x7f2e48072f40 2024-09-10T07:34:23.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e46a00640 1 -- 172.21.15.99:0/3315991339 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2603158314 0 0) 0x7f2e4806e6b0 con 0x7f2e48145290 2024-09-10T07:34:23.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e46a00640 1 -- 172.21.15.99:0/3315991339 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e4806e3d0 con 0x7f2e48145290 2024-09-10T07:34:23.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e4ce00640 1 -- 172.21.15.99:0/3315991339 >> v1:172.21.15.187:6789/0 conn(0x7f2e48145290 legacy=0x7f2e48072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.478+0000 7f2e4ce00640 1 -- 172.21.15.99:0/3315991339 >> v1:172.21.15.99:6789/0 conn(0x7f2e48072f40 legacy=0x7f2e480b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.479+0000 7f2e4ce00640 1 -- 172.21.15.99:0/3315991339 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4806e990 con 0x7f2e480ce780 2024-09-10T07:34:23.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.480+0000 7f2e4ce00640 1 --2- 172.21.15.99:0/3315991339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e480ce780 0x7f2e4806f470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009dc0 tx=0x7f2e4002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=251f0d269eb52a01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.480+0000 7f2e46a00640 1 -- 172.21.15.99:0/3315991339 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40007740 con 0x7f2e480ce780 2024-09-10T07:34:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.480+0000 7f2e46a00640 1 -- 172.21.15.99:0/3315991339 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e400078e0 con 0x7f2e480ce780 2024-09-10T07:34:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.480+0000 7f2e46a00640 1 -- 172.21.15.99:0/3315991339 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40007cb0 con 0x7f2e480ce780 2024-09-10T07:34:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.480+0000 7f2e4ee00640 1 -- 172.21.15.99:0/3315991339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e480ce780 msgr2=0x7f2e4806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.480+0000 7f2e4ee00640 1 --2- 172.21.15.99:0/3315991339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e480ce780 0x7f2e4806f470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009dc0 tx=0x7f2e4002a6d0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.480+0000 7f2e4ee00640 1 -- 172.21.15.99:0/3315991339 shutdown_connections 2024-09-10T07:34:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.480+0000 7f2e4ee00640 1 --2- 172.21.15.99:0/3315991339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e480ce780 0x7f2e4806f470 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.480+0000 7f2e4ee00640 1 -- 172.21.15.99:0/3315991339 >> 172.21.15.99:0/3315991339 conn(0x7f2e4806bc10 msgr2=0x7f2e4806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.481+0000 7f2e4ee00640 1 -- 172.21.15.99:0/3315991339 shutdown_connections 2024-09-10T07:34:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.481+0000 7f2e4ee00640 1 -- 172.21.15.99:0/3315991339 wait complete. 2024-09-10T07:34:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.482+0000 7f2e4ee00640 1 Processor -- start 2024-09-10T07:34:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.482+0000 7f2e4ee00640 1 -- start start 2024-09-10T07:34:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.483+0000 7f2e4ee00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e48072f40 0x7f2e481f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.483+0000 7f2e4ee00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e480ce780 0x7f2e48137640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.483+0000 7f2e4ee00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e48145290 0x7f2e48137b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.483+0000 7f2e4ee00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4806df80 con 0x7f2e480ce780 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.483+0000 7f2e4ee00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2e48145670 con 0x7f2e48145290 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.483+0000 7f2e4ee00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4806e100 con 0x7f2e48072f40 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.483+0000 7f2e47400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e480ce780 0x7f2e48137640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.483+0000 7f2e47400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e480ce780 0x7f2e48137640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34260/0 (socket says 172.21.15.99:34260) 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.483+0000 7f2e47400640 1 -- 172.21.15.99:0/1695172293 learned_addr learned my addr 172.21.15.99:0/1695172293 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e47e00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e48072f40 0x7f2e481f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e47400640 1 -- 172.21.15.99:0/1695172293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e48072f40 msgr2=0x7f2e481f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e4ce00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e48145290 0x7f2e48137b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e47400640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e48072f40 0x7f2e481f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e47400640 1 -- 172.21.15.99:0/1695172293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e48145290 msgr2=0x7f2e48137b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e47400640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e48145290 0x7f2e48137b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e47400640 1 -- 172.21.15.99:0/1695172293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e480c5c60 con 0x7f2e480ce780 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e47e00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e48072f40 0x7f2e481f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e4ce00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e48145290 0x7f2e48137b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e47400640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e480ce780 0x7f2e48137640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400c460 tx=0x7f2e3400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e3fe00640 1 -- 172.21.15.99:0/1695172293 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34017070 con 0x7f2e480ce780 2024-09-10T07:34:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e3fe00640 1 -- 172.21.15.99:0/1695172293 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e34005ce0 con 0x7f2e480ce780 2024-09-10T07:34:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e3fe00640 1 -- 172.21.15.99:0/1695172293 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34007290 con 0x7f2e480ce780 2024-09-10T07:34:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.484+0000 7f2e4ee00640 1 -- 172.21.15.99:0/1695172293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e480af530 con 0x7f2e480ce780 2024-09-10T07:34:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.485+0000 7f2e4ee00640 1 -- 172.21.15.99:0/1695172293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e480af220 con 0x7f2e480ce780 2024-09-10T07:34:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.486+0000 7f2e4ee00640 1 -- 172.21.15.99:0/1695172293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e480715a0 con 0x7f2e480ce780 2024-09-10T07:34:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.486+0000 7f2e3fe00640 1 -- 172.21.15.99:0/1695172293 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e3401a070 con 0x7f2e480ce780 2024-09-10T07:34:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.488+0000 7f2e3fe00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2e2806be30 0x7f2e2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.488+0000 7f2e3fe00640 1 -- 172.21.15.99:0/1695172293 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2e3408a230 con 0x7f2e480ce780 2024-09-10T07:34:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.488+0000 7f2e47e00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2e2806be30 0x7f2e2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.488+0000 7f2e47e00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2e2806be30 0x7f2e2806e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2e380016b0 tx=0x7f2e38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.492+0000 7f2e3fe00640 1 -- 172.21.15.99:0/1695172293 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e34058bd0 con 0x7f2e480ce780 2024-09-10T07:34:23.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.667+0000 7f2e4ee00640 1 -- 172.21.15.99:0/1695172293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e4815ec80 con 0x7f2e480ce780 2024-09-10T07:34:23.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.669+0000 7f2e3fe00640 1 -- 172.21.15.99:0/1695172293 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f2e340584d0 con 0x7f2e480ce780 2024-09-10T07:34:23.669 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:23.669 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:20.870081+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:34:17.274179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:34:18.279150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:23.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 -- 172.21.15.99:0/1695172293 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2e2806be30 msgr2=0x7f2e2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2e2806be30 0x7f2e2806e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2e380016b0 tx=0x7f2e38009040 comp rx=0 tx=0).stop 2024-09-10T07:34:23.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 -- 172.21.15.99:0/1695172293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e480ce780 msgr2=0x7f2e48137640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e480ce780 0x7f2e48137640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400c460 tx=0x7f2e3400c920 comp rx=0 tx=0).stop 2024-09-10T07:34:23.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 -- 172.21.15.99:0/1695172293 shutdown_connections 2024-09-10T07:34:23.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e48145290 0x7f2e48137b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2e2806be30 0x7f2e2806e2f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e480ce780 0x7f2e48137640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 --2- 172.21.15.99:0/1695172293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e48072f40 0x7f2e481f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 -- 172.21.15.99:0/1695172293 >> 172.21.15.99:0/1695172293 conn(0x7f2e4806bc10 msgr2=0x7f2e4815dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:23.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 -- 172.21.15.99:0/1695172293 shutdown_connections 2024-09-10T07:34:23.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.671+0000 7f2e4ee00640 1 -- 172.21.15.99:0/1695172293 wait complete. 2024-09-10T07:34:23.687 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:34:23.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:34:23.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.841+0000 7f2ef4a00640 1 Processor -- start 2024-09-10T07:34:23.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.842+0000 7f2ef4a00640 1 -- start start 2024-09-10T07:34:23.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2ef4a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ef0145290 0x7f2ef006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2ef4a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 0x7f2ef0072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2ef4a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef006e3d0 con 0x7f2ef0071510 2024-09-10T07:34:23.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2ef4a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef006efe0 con 0x7f2ef0145290 2024-09-10T07:34:23.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2ef4a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef006e6b0 con 0x7f2ef00ce780 2024-09-10T07:34:23.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2eede00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ef0145290 0x7f2ef006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2eede00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2ef0145290 0x7f2ef006f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34262/0 (socket says 172.21.15.99:34262) 2024-09-10T07:34:23.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2eede00640 1 -- 172.21.15.99:0/2253904918 learned_addr learned my addr 172.21.15.99:0/2253904918 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:23.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2ee5400640 1 --2- 172.21.15.99:0/2253904918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 0x7f2ef0072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2eede00640 1 -- 172.21.15.99:0/2253904918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 msgr2=0x7f2ef0072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:23.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2eede00640 1 --2- 172.21.15.99:0/2253904918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 0x7f2ef0072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2eede00640 1 -- 172.21.15.99:0/2253904918 >> v1:172.21.15.187:6789/0 conn(0x7f2ef0071510 legacy=0x7f2ef00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2eede00640 1 -- 172.21.15.99:0/2253904918 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef006e990 con 0x7f2ef0145290 2024-09-10T07:34:23.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.843+0000 7f2ee5400640 1 --2- 172.21.15.99:0/2253904918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 0x7f2ef0072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:23.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.844+0000 7f2eede00640 1 --2- 172.21.15.99:0/2253904918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 0x7f2ef006f470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009870 tx=0x7f2ee002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107d72d6f60789b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:23.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2eed400640 1 -- 172.21.15.99:0/2253904918 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0037070 con 0x7f2ef0145290 2024-09-10T07:34:23.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2eed400640 1 -- 172.21.15.99:0/2253904918 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee0032440 con 0x7f2ef0145290 2024-09-10T07:34:23.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2eed400640 1 -- 172.21.15.99:0/2253904918 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0032810 con 0x7f2ef0145290 2024-09-10T07:34:23.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2ef4a00640 1 -- 172.21.15.99:0/2253904918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 msgr2=0x7f2ef006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2ef4a00640 1 --2- 172.21.15.99:0/2253904918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 0x7f2ef006f470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009870 tx=0x7f2ee002a250 comp rx=0 tx=0).stop 2024-09-10T07:34:23.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2ef4a00640 1 -- 172.21.15.99:0/2253904918 shutdown_connections 2024-09-10T07:34:23.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2ef4a00640 1 --2- 172.21.15.99:0/2253904918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 0x7f2ef0072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2ef4a00640 1 --2- 172.21.15.99:0/2253904918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 0x7f2ef006f470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2ef4a00640 1 -- 172.21.15.99:0/2253904918 >> 172.21.15.99:0/2253904918 conn(0x7f2ef006bc10 msgr2=0x7f2ef006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:23.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2ef4a00640 1 -- 172.21.15.99:0/2253904918 shutdown_connections 2024-09-10T07:34:23.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.845+0000 7f2ef4a00640 1 -- 172.21.15.99:0/2253904918 wait complete. 2024-09-10T07:34:23.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.847+0000 7f2ef4a00640 1 Processor -- start 2024-09-10T07:34:23.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.847+0000 7f2ef4a00640 1 -- start start 2024-09-10T07:34:23.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2ef4a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ef0071510 0x7f2ef00c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2ef4a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 0x7f2ef015f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2ef4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 0x7f2ef015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2ef4a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef006df80 con 0x7f2ef0145290 2024-09-10T07:34:23.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2ef4a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef0145670 con 0x7f2ef0071510 2024-09-10T07:34:23.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2ef4a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef006e100 con 0x7f2ef00ce780 2024-09-10T07:34:23.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2eee800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 0x7f2ef015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2eee800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 0x7f2ef015b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34274/0 (socket says 172.21.15.99:34274) 2024-09-10T07:34:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2eee800640 1 -- 172.21.15.99:0/3163506894 learned_addr learned my addr 172.21.15.99:0/3163506894 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2ee5400640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 0x7f2ef015f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.848+0000 7f2eede00640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ef0071510 0x7f2ef00c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2eee800640 1 -- 172.21.15.99:0/3163506894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 msgr2=0x7f2ef015f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2eee800640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 0x7f2ef015f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2eee800640 1 -- 172.21.15.99:0/3163506894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ef0071510 msgr2=0x7f2ef00c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2eee800640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ef0071510 0x7f2ef00c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2eee800640 1 -- 172.21.15.99:0/3163506894 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef013e610 con 0x7f2ef0145290 2024-09-10T07:34:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2eee800640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 0x7f2ef015b4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c680 tx=0x7f2ee800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2ee6a00640 1 -- 172.21.15.99:0/3163506894 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8003b70 con 0x7f2ef0145290 2024-09-10T07:34:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2ee6a00640 1 -- 172.21.15.99:0/3163506894 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee8003d10 con 0x7f2ef0145290 2024-09-10T07:34:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2ef4a00640 1 -- 172.21.15.99:0/3163506894 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef00c5e80 con 0x7f2ef0145290 2024-09-10T07:34:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2ee6a00640 1 -- 172.21.15.99:0/3163506894 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8005310 con 0x7f2ef0145290 2024-09-10T07:34:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.849+0000 7f2ef4a00640 1 -- 172.21.15.99:0/3163506894 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef00c6440 con 0x7f2ef0145290 2024-09-10T07:34:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.850+0000 7f2ef4a00640 1 -- 172.21.15.99:0/3163506894 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef006f450 con 0x7f2ef0145290 2024-09-10T07:34:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.851+0000 7f2ee6a00640 1 -- 172.21.15.99:0/3163506894 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ee80054b0 con 0x7f2ef0145290 2024-09-10T07:34:23.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.852+0000 7f2ee6a00640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:23.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.852+0000 7f2ee6a00640 1 -- 172.21.15.99:0/3163506894 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2ee808ac00 con 0x7f2ef0145290 2024-09-10T07:34:23.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.852+0000 7f2eede00640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:23.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.853+0000 7f2eede00640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0034000 tx=0x7f2ee002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:23.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:23.856+0000 7f2ee6a00640 1 -- 172.21.15.99:0/3163506894 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ef013e610 con 0x7f2ef0145290 2024-09-10T07:34:24.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.026+0000 7f2ef4a00640 1 -- 172.21.15.99:0/3163506894 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ef0141ed0 con 0x7f2ecc06be30 2024-09-10T07:34:24.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.033+0000 7f2ee6a00640 1 -- 172.21.15.99:0/3163506894 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237403 (secure 0 0 0) 0x7f2ef0141ed0 con 0x7f2ecc06be30 2024-09-10T07:34:24.039 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:24.041 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:34:24.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 -- 172.21.15.99:0/3163506894 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2ecc06be30 msgr2=0x7f2ecc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0034000 tx=0x7f2ee002e000 comp rx=0 tx=0).stop 2024-09-10T07:34:24.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 -- 172.21.15.99:0/3163506894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 msgr2=0x7f2ef015b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 0x7f2ef015b4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c680 tx=0x7f2ee800cb40 comp rx=0 tx=0).stop 2024-09-10T07:34:24.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 -- 172.21.15.99:0/3163506894 shutdown_connections 2024-09-10T07:34:24.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2ecc06be30 0x7f2ecc06e2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ef0145290 0x7f2ef015b4e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ef00ce780 0x7f2ef015f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 --2- 172.21.15.99:0/3163506894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ef0071510 0x7f2ef00c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 -- 172.21.15.99:0/3163506894 >> 172.21.15.99:0/3163506894 conn(0x7f2ef006bc10 msgr2=0x7f2ef00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:24.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 -- 172.21.15.99:0/3163506894 shutdown_connections 2024-09-10T07:34:24.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.037+0000 7f2ef4a00640 1 -- 172.21.15.99:0/3163506894 wait complete. 2024-09-10T07:34:24.053 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-10T07:34:22.692958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560945,"statfs":{"total":1600000000,"available":1598407872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.830336"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.867404+0000","last_change":"2024-09-10T07:34:17.867404+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.867404+0000","last_undegraded":"2024-09-10T07:34:17.867404+0000","last_fullsized":"2024-09-10T07:34:17.867404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866337+0000","last_change":"2024-09-10T07:34:17.866337+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866337+0000","last_undegraded":"2024-09-10T07:34:17.866337+0000","last_fullsized":"2024-09-10T07:34:17.866337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866645+0000","last_change":"2024-09-10T07:34:17.866645+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866645+0000","last_undegraded":"2024-09-10T07:34:17.866645+0000","last_fullsized":"2024-09-10T07:34:17.866645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.865386+0000","last_change":"2024-09-10T07:34:17.865386+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.865386+0000","last_undegraded":"2024-09-10T07:34:17.865386+0000","last_fullsized":"2024-09-10T07:34:17.865386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866270+0000","last_change":"2024-09-10T07:34:17.866270+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866270+0000","last_undegraded":"2024-09-10T07:34:17.866270+0000","last_fullsized":"2024-09-10T07:34:17.866270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.864432+0000","last_change":"2024-09-10T07:34:17.864432+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.864432+0000","last_undegraded":"2024-09-10T07:34:17.864432+0000","last_fullsized":"2024-09-10T07:34:17.864432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.865191+0000","last_change":"2024-09-10T07:34:17.865191+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.865191+0000","last_undegraded":"2024-09-10T07:34:17.865191+0000","last_fullsized":"2024-09-10T07:34:17.865191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.865564+0000","last_change":"2024-09-10T07:34:17.865564+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.865564+0000","last_undegraded":"2024-09-10T07:34:17.865564+0000","last_fullsized":"2024-09-10T07:34:17.865564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866380+0000","last_change":"2024-09-10T07:34:17.866380+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866380+0000","last_undegraded":"2024-09-10T07:34:17.866380+0000","last_fullsized":"2024-09-10T07:34:17.866380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863431+0000","last_change":"2024-09-10T07:34:17.863431+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863431+0000","last_undegraded":"2024-09-10T07:34:17.863431+0000","last_fullsized":"2024-09-10T07:34:17.863431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.867282+0000","last_change":"2024-09-10T07:34:17.867282+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.867282+0000","last_undegraded":"2024-09-10T07:34:17.867282+0000","last_fullsized":"2024-09-10T07:34:17.867282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.867874+0000","last_change":"2024-09-10T07:34:17.867874+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.867874+0000","last_undegraded":"2024-09-10T07:34:17.867874+0000","last_fullsized":"2024-09-10T07:34:17.867874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.864487+0000","last_change":"2024-09-10T07:34:17.864487+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.864487+0000","last_undegraded":"2024-09-10T07:34:17.864487+0000","last_fullsized":"2024-09-10T07:34:17.864487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.867466+0000","last_change":"2024-09-10T07:34:17.867466+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.867466+0000","last_undegraded":"2024-09-10T07:34:17.867466+0000","last_fullsized":"2024-09-10T07:34:17.867466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863724+0000","last_change":"2024-09-10T07:34:17.863724+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863724+0000","last_undegraded":"2024-09-10T07:34:17.863724+0000","last_fullsized":"2024-09-10T07:34:17.863724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.867701+0000","last_change":"2024-09-10T07:34:17.867701+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.867701+0000","last_undegraded":"2024-09-10T07:34:17.867701+0000","last_fullsized":"2024-09-10T07:34:17.867701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T07:34:17.862467+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:34:17.862467+0000","last_peered":"2024-09-10T07:34:17.862467+0000","last_clean":"2024-09-10T07:34:17.862467+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:34:17.862467+0000","last_undegraded":"2024-09-10T07:34:17.862467+0000","last_fullsized":"2024-09-10T07:34:17.862467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.862874+0000","last_change":"2024-09-10T07:34:17.862874+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.862874+0000","last_undegraded":"2024-09-10T07:34:17.862874+0000","last_fullsized":"2024-09-10T07:34:17.862874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.862192+0000","last_change":"2024-09-10T07:34:17.862192+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.862192+0000","last_undegraded":"2024-09-10T07:34:17.862192+0000","last_fullsized":"2024-09-10T07:34:17.862192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866953+0000","last_change":"2024-09-10T07:34:17.866953+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866953+0000","last_undegraded":"2024-09-10T07:34:17.866953+0000","last_fullsized":"2024-09-10T07:34:17.866953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863835+0000","last_change":"2024-09-10T07:34:17.863835+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863835+0000","last_undegraded":"2024-09-10T07:34:17.863835+0000","last_fullsized":"2024-09-10T07:34:17.863835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863854+0000","last_change":"2024-09-10T07:34:17.863854+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863854+0000","last_undegraded":"2024-09-10T07:34:17.863854+0000","last_fullsized":"2024-09-10T07:34:17.863854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.862872+0000","last_change":"2024-09-10T07:34:17.862872+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.862872+0000","last_undegraded":"2024-09-10T07:34:17.862872+0000","last_fullsized":"2024-09-10T07:34:17.862872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863795+0000","last_change":"2024-09-10T07:34:17.863795+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863795+0000","last_undegraded":"2024-09-10T07:34:17.863795+0000","last_fullsized":"2024-09-10T07:34:17.863795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866531+0000","last_change":"2024-09-10T07:34:17.866531+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866531+0000","last_undegraded":"2024-09-10T07:34:17.866531+0000","last_fullsized":"2024-09-10T07:34:17.866531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863735+0000","last_change":"2024-09-10T07:34:17.863735+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863735+0000","last_undegraded":"2024-09-10T07:34:17.863735+0000","last_fullsized":"2024-09-10T07:34:17.863735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.864833+0000","last_change":"2024-09-10T07:34:17.864833+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.864833+0000","last_undegraded":"2024-09-10T07:34:17.864833+0000","last_fullsized":"2024-09-10T07:34:17.864833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863724+0000","last_change":"2024-09-10T07:34:17.863724+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863724+0000","last_undegraded":"2024-09-10T07:34:17.863724+0000","last_fullsized":"2024-09-10T07:34:17.863724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863104+0000","last_change":"2024-09-10T07:34:17.863104+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863104+0000","last_undegraded":"2024-09-10T07:34:17.863104+0000","last_fullsized":"2024-09-10T07:34:17.863104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.864172+0000","last_change":"2024-09-10T07:34:17.864172+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.864172+0000","last_undegraded":"2024-09-10T07:34:17.864172+0000","last_fullsized":"2024-09-10T07:34:17.864172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863757+0000","last_change":"2024-09-10T07:34:17.863757+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863757+0000","last_undegraded":"2024-09-10T07:34:17.863757+0000","last_fullsized":"2024-09-10T07:34:17.863757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.868084+0000","last_change":"2024-09-10T07:34:17.868084+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.868084+0000","last_undegraded":"2024-09-10T07:34:17.868084+0000","last_fullsized":"2024-09-10T07:34:17.868084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866777+0000","last_change":"2024-09-10T07:34:17.866777+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866777+0000","last_undegraded":"2024-09-10T07:34:17.866777+0000","last_fullsized":"2024-09-10T07:34:17.866777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:34:24.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:34:24.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.247+0000 7f47fa800640 1 Processor -- start 2024-09-10T07:34:24.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.247+0000 7f47fa800640 1 -- start start 2024-09-10T07:34:24.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.248+0000 7f47fa800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47f4145290 0x7f47f406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.248+0000 7f47fa800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f47f40ce780 0x7f47f4072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.248+0000 7f47fa800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f406e3d0 con 0x7f47f4071510 2024-09-10T07:34:24.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.248+0000 7f47fa800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f47f406efe0 con 0x7f47f4145290 2024-09-10T07:34:24.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.248+0000 7f47fa800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f47f406e6b0 con 0x7f47f40ce780 2024-09-10T07:34:24.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.248+0000 7f47f3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47f4145290 0x7f47f406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.249+0000 7f47f3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47f4145290 0x7f47f406f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34280/0 (socket says 172.21.15.99:34280) 2024-09-10T07:34:24.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.249+0000 7f47f3400640 1 -- 172.21.15.99:0/3566040024 learned_addr learned my addr 172.21.15.99:0/3566040024 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:24.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.249+0000 7f47f2a00640 1 --2- 172.21.15.99:0/3566040024 >> v2:172.21.15.187:3300/0 conn(0x7f47f40ce780 0x7f47f4072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.249+0000 7f47f3400640 1 -- 172.21.15.99:0/3566040024 >> v2:172.21.15.187:3300/0 conn(0x7f47f40ce780 msgr2=0x7f47f4072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:24.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.249+0000 7f47f3400640 1 --2- 172.21.15.99:0/3566040024 >> v2:172.21.15.187:3300/0 conn(0x7f47f40ce780 0x7f47f4072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.249+0000 7f47f3400640 1 -- 172.21.15.99:0/3566040024 >> v1:172.21.15.187:6789/0 conn(0x7f47f4071510 legacy=0x7f47f40b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:24.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.249+0000 7f47f3400640 1 -- 172.21.15.99:0/3566040024 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f406e990 con 0x7f47f4145290 2024-09-10T07:34:24.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.250+0000 7f47f3400640 1 --2- 172.21.15.99:0/3566040024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f4145290 0x7f47f406f470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47f406d450 tx=0x7f47e402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d466fbb19894002b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:24.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.250+0000 7f47f2000640 1 -- 172.21.15.99:0/3566040024 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4037070 con 0x7f47f4145290 2024-09-10T07:34:24.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.250+0000 7f47f2000640 1 -- 172.21.15.99:0/3566040024 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e4032440 con 0x7f47f4145290 2024-09-10T07:34:24.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.250+0000 7f47f2000640 1 -- 172.21.15.99:0/3566040024 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4032810 con 0x7f47f4145290 2024-09-10T07:34:24.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.251+0000 7f47fa800640 1 -- 172.21.15.99:0/3566040024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f4145290 msgr2=0x7f47f406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.251+0000 7f47fa800640 1 --2- 172.21.15.99:0/3566040024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f4145290 0x7f47f406f470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47f406d450 tx=0x7f47e402a230 comp rx=0 tx=0).stop 2024-09-10T07:34:24.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.251+0000 7f47fa800640 1 -- 172.21.15.99:0/3566040024 shutdown_connections 2024-09-10T07:34:24.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.251+0000 7f47fa800640 1 --2- 172.21.15.99:0/3566040024 >> v2:172.21.15.187:3300/0 conn(0x7f47f40ce780 0x7f47f4072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.251+0000 7f47fa800640 1 --2- 172.21.15.99:0/3566040024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f4145290 0x7f47f406f470 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.251+0000 7f47fa800640 1 -- 172.21.15.99:0/3566040024 >> 172.21.15.99:0/3566040024 conn(0x7f47f406bc10 msgr2=0x7f47f406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:24.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.251+0000 7f47fa800640 1 -- 172.21.15.99:0/3566040024 shutdown_connections 2024-09-10T07:34:24.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.251+0000 7f47fa800640 1 -- 172.21.15.99:0/3566040024 wait complete. 2024-09-10T07:34:24.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.252+0000 7f47fa800640 1 Processor -- start 2024-09-10T07:34:24.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.253+0000 7f47fa800640 1 -- start start 2024-09-10T07:34:24.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.253+0000 7f47fa800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47f4071510 0x7f47f415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.253+0000 7f47fa800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f40ce780 0x7f47f4141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.253+0000 7f47fa800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47f4145290 0x7f47f4143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.253+0000 7f47fa800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f47f406df80 con 0x7f47f40ce780 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.253+0000 7f47fa800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4145670 con 0x7f47f4071510 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.253+0000 7f47fa800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f47f406e100 con 0x7f47f4145290 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f40ce780 0x7f47f4141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f40ce780 0x7f47f4141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34286/0 (socket says 172.21.15.99:34286) 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f2a00640 1 -- 172.21.15.99:0/206581624 learned_addr learned my addr 172.21.15.99:0/206581624 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f3e00640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47f4145290 0x7f47f4143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f3400640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47f4071510 0x7f47f415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f2a00640 1 -- 172.21.15.99:0/206581624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47f4145290 msgr2=0x7f47f4143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f2a00640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47f4145290 0x7f47f4143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f2a00640 1 -- 172.21.15.99:0/206581624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47f4071510 msgr2=0x7f47f415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f2a00640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47f4071510 0x7f47f415a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f2a00640 1 -- 172.21.15.99:0/206581624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f4142790 con 0x7f47f40ce780 2024-09-10T07:34:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f3400640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47f4071510 0x7f47f415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47f2a00640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f40ce780 0x7f47f4141db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47e000d7d0 tx=0x7f47e000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.254+0000 7f47eb400640 1 -- 172.21.15.99:0/206581624 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0004020 con 0x7f47f40ce780 2024-09-10T07:34:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.255+0000 7f47eb400640 1 -- 172.21.15.99:0/206581624 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e00041e0 con 0x7f47f40ce780 2024-09-10T07:34:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.255+0000 7f47eb400640 1 -- 172.21.15.99:0/206581624 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00043d0 con 0x7f47f40ce780 2024-09-10T07:34:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.255+0000 7f47fa800640 1 -- 172.21.15.99:0/206581624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f4142a70 con 0x7f47f40ce780 2024-09-10T07:34:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.255+0000 7f47fa800640 1 -- 172.21.15.99:0/206581624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f4143030 con 0x7f47f40ce780 2024-09-10T07:34:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.256+0000 7f47fa800640 1 -- 172.21.15.99:0/206581624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f406f450 con 0x7f47f40ce780 2024-09-10T07:34:24.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.256+0000 7f47eb400640 1 -- 172.21.15.99:0/206581624 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47e001b020 con 0x7f47f40ce780 2024-09-10T07:34:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.258+0000 7f47eb400640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47d406be60 0x7f47d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.258+0000 7f47eb400640 1 -- 172.21.15.99:0/206581624 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f47e008ab00 con 0x7f47f40ce780 2024-09-10T07:34:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.258+0000 7f47f3400640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47d406be60 0x7f47d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.259+0000 7f47f3400640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47d406be60 0x7f47d406e320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47e4034000 tx=0x7f47e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:24.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.262+0000 7f47eb400640 1 -- 172.21.15.99:0/206581624 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47e00594a0 con 0x7f47f40ce780 2024-09-10T07:34:24.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.430+0000 7f47fa800640 1 -- 172.21.15.99:0/206581624 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47f40ceda0 con 0x7f47d406be60 2024-09-10T07:34:24.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.437+0000 7f47eb400640 1 -- 172.21.15.99:0/206581624 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237403 (secure 0 0 0) 0x7f47e407bf70 con 0x7f47d406be60 2024-09-10T07:34:24.439 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:24.440 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:34:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 -- 172.21.15.99:0/206581624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47d406be60 msgr2=0x7f47d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47d406be60 0x7f47d406e320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47e4034000 tx=0x7f47e402e000 comp rx=0 tx=0).stop 2024-09-10T07:34:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 -- 172.21.15.99:0/206581624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f40ce780 msgr2=0x7f47f4141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f40ce780 0x7f47f4141db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47e000d7d0 tx=0x7f47e000dc90 comp rx=0 tx=0).stop 2024-09-10T07:34:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 -- 172.21.15.99:0/206581624 shutdown_connections 2024-09-10T07:34:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47f4145290 0x7f47f4143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47d406be60 0x7f47d406e320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47f40ce780 0x7f47f4141db0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 --2- 172.21.15.99:0/206581624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47f4071510 0x7f47f415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 -- 172.21.15.99:0/206581624 >> 172.21.15.99:0/206581624 conn(0x7f47f406bc10 msgr2=0x7f47f40b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:24.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 -- 172.21.15.99:0/206581624 shutdown_connections 2024-09-10T07:34:24.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.440+0000 7f47fa800640 1 -- 172.21.15.99:0/206581624 wait complete. 2024-09-10T07:34:24.456 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-10T07:34:22.692958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560945,"statfs":{"total":1600000000,"available":1598407872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.830336"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.867404+0000","last_change":"2024-09-10T07:34:17.867404+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.867404+0000","last_undegraded":"2024-09-10T07:34:17.867404+0000","last_fullsized":"2024-09-10T07:34:17.867404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866337+0000","last_change":"2024-09-10T07:34:17.866337+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866337+0000","last_undegraded":"2024-09-10T07:34:17.866337+0000","last_fullsized":"2024-09-10T07:34:17.866337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866645+0000","last_change":"2024-09-10T07:34:17.866645+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866645+0000","last_undegraded":"2024-09-10T07:34:17.866645+0000","last_fullsized":"2024-09-10T07:34:17.866645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.865386+0000","last_change":"2024-09-10T07:34:17.865386+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.865386+0000","last_undegraded":"2024-09-10T07:34:17.865386+0000","last_fullsized":"2024-09-10T07:34:17.865386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866270+0000","last_change":"2024-09-10T07:34:17.866270+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866270+0000","last_undegraded":"2024-09-10T07:34:17.866270+0000","last_fullsized":"2024-09-10T07:34:17.866270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.864432+0000","last_change":"2024-09-10T07:34:17.864432+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.864432+0000","last_undegraded":"2024-09-10T07:34:17.864432+0000","last_fullsized":"2024-09-10T07:34:17.864432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.865191+0000","last_change":"2024-09-10T07:34:17.865191+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.865191+0000","last_undegraded":"2024-09-10T07:34:17.865191+0000","last_fullsized":"2024-09-10T07:34:17.865191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.865564+0000","last_change":"2024-09-10T07:34:17.865564+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.865564+0000","last_undegraded":"2024-09-10T07:34:17.865564+0000","last_fullsized":"2024-09-10T07:34:17.865564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866380+0000","last_change":"2024-09-10T07:34:17.866380+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866380+0000","last_undegraded":"2024-09-10T07:34:17.866380+0000","last_fullsized":"2024-09-10T07:34:17.866380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863431+0000","last_change":"2024-09-10T07:34:17.863431+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863431+0000","last_undegraded":"2024-09-10T07:34:17.863431+0000","last_fullsized":"2024-09-10T07:34:17.863431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.867282+0000","last_change":"2024-09-10T07:34:17.867282+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.867282+0000","last_undegraded":"2024-09-10T07:34:17.867282+0000","last_fullsized":"2024-09-10T07:34:17.867282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.867874+0000","last_change":"2024-09-10T07:34:17.867874+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.867874+0000","last_undegraded":"2024-09-10T07:34:17.867874+0000","last_fullsized":"2024-09-10T07:34:17.867874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.864487+0000","last_change":"2024-09-10T07:34:17.864487+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.864487+0000","last_undegraded":"2024-09-10T07:34:17.864487+0000","last_fullsized":"2024-09-10T07:34:17.864487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.867466+0000","last_change":"2024-09-10T07:34:17.867466+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.867466+0000","last_undegraded":"2024-09-10T07:34:17.867466+0000","last_fullsized":"2024-09-10T07:34:17.867466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863724+0000","last_change":"2024-09-10T07:34:17.863724+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863724+0000","last_undegraded":"2024-09-10T07:34:17.863724+0000","last_fullsized":"2024-09-10T07:34:17.863724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.867701+0000","last_change":"2024-09-10T07:34:17.867701+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.867701+0000","last_undegraded":"2024-09-10T07:34:17.867701+0000","last_fullsized":"2024-09-10T07:34:17.867701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-10T07:34:17.862467+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:34:17.862467+0000","last_peered":"2024-09-10T07:34:17.862467+0000","last_clean":"2024-09-10T07:34:17.862467+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:34:17.862467+0000","last_undegraded":"2024-09-10T07:34:17.862467+0000","last_fullsized":"2024-09-10T07:34:17.862467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.862874+0000","last_change":"2024-09-10T07:34:17.862874+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.862874+0000","last_undegraded":"2024-09-10T07:34:17.862874+0000","last_fullsized":"2024-09-10T07:34:17.862874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.862192+0000","last_change":"2024-09-10T07:34:17.862192+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.862192+0000","last_undegraded":"2024-09-10T07:34:17.862192+0000","last_fullsized":"2024-09-10T07:34:17.862192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866953+0000","last_change":"2024-09-10T07:34:17.866953+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866953+0000","last_undegraded":"2024-09-10T07:34:17.866953+0000","last_fullsized":"2024-09-10T07:34:17.866953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863835+0000","last_change":"2024-09-10T07:34:17.863835+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863835+0000","last_undegraded":"2024-09-10T07:34:17.863835+0000","last_fullsized":"2024-09-10T07:34:17.863835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863854+0000","last_change":"2024-09-10T07:34:17.863854+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863854+0000","last_undegraded":"2024-09-10T07:34:17.863854+0000","last_fullsized":"2024-09-10T07:34:17.863854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.862872+0000","last_change":"2024-09-10T07:34:17.862872+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.862872+0000","last_undegraded":"2024-09-10T07:34:17.862872+0000","last_fullsized":"2024-09-10T07:34:17.862872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863795+0000","last_change":"2024-09-10T07:34:17.863795+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863795+0000","last_undegraded":"2024-09-10T07:34:17.863795+0000","last_fullsized":"2024-09-10T07:34:17.863795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866531+0000","last_change":"2024-09-10T07:34:17.866531+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866531+0000","last_undegraded":"2024-09-10T07:34:17.866531+0000","last_fullsized":"2024-09-10T07:34:17.866531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863735+0000","last_change":"2024-09-10T07:34:17.863735+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863735+0000","last_undegraded":"2024-09-10T07:34:17.863735+0000","last_fullsized":"2024-09-10T07:34:17.863735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.864833+0000","last_change":"2024-09-10T07:34:17.864833+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.864833+0000","last_undegraded":"2024-09-10T07:34:17.864833+0000","last_fullsized":"2024-09-10T07:34:17.864833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863724+0000","last_change":"2024-09-10T07:34:17.863724+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863724+0000","last_undegraded":"2024-09-10T07:34:17.863724+0000","last_fullsized":"2024-09-10T07:34:17.863724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863104+0000","last_change":"2024-09-10T07:34:17.863104+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863104+0000","last_undegraded":"2024-09-10T07:34:17.863104+0000","last_fullsized":"2024-09-10T07:34:17.863104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.864172+0000","last_change":"2024-09-10T07:34:17.864172+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.864172+0000","last_undegraded":"2024-09-10T07:34:17.864172+0000","last_fullsized":"2024-09-10T07:34:17.864172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.863757+0000","last_change":"2024-09-10T07:34:17.863757+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.863757+0000","last_undegraded":"2024-09-10T07:34:17.863757+0000","last_fullsized":"2024-09-10T07:34:17.863757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.868084+0000","last_change":"2024-09-10T07:34:17.868084+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.868084+0000","last_undegraded":"2024-09-10T07:34:17.868084+0000","last_fullsized":"2024-09-10T07:34:17.868084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:34:18.860341+0000","last_change":"2024-09-10T07:34:18.860341+0000","last_active":"2024-09-10T07:34:18.860341+0000","last_peered":"2024-09-10T07:34:18.860341+0000","last_clean":"2024-09-10T07:34:18.860341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:18.860341+0000","last_undegraded":"2024-09-10T07:34:18.860341+0000","last_fullsized":"2024-09-10T07:34:18.860341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-10T07:34:17.866777+0000","last_change":"2024-09-10T07:34:17.866777+0000","last_active":"2024-09-10T07:34:17.849283+0000","last_peered":"2024-09-10T07:34:17.849283+0000","last_clean":"2024-09-10T07:34:17.849283+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:34:17.866777+0000","last_undegraded":"2024-09-10T07:34:17.866777+0000","last_fullsized":"2024-09-10T07:34:17.866777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:34:24.459 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:34:24.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.649+0000 7f8738c00640 1 Processor -- start 2024-09-10T07:34:24.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.649+0000 7f8738c00640 1 -- start start 2024-09-10T07:34:24.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8738c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873413fae0 0x7f873406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8738c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8734160c50 0x7f87340cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8738c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8734142650 con 0x7f8734142150 2024-09-10T07:34:24.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8738c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f87340ce780 con 0x7f8734160c50 2024-09-10T07:34:24.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8738c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8734142930 con 0x7f873413fae0 2024-09-10T07:34:24.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8732800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8734160c50 0x7f87340cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8732800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8734160c50 0x7f87340cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34288/0 (socket says 172.21.15.99:34288) 2024-09-10T07:34:24.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8732800640 1 -- 172.21.15.99:0/2904286551 learned_addr learned my addr 172.21.15.99:0/2904286551 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:24.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8731e00640 1 --2- 172.21.15.99:0/2904286551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873413fae0 0x7f873406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8732800640 1 -- 172.21.15.99:0/2904286551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873413fae0 msgr2=0x7f873406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:24.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8732800640 1 --2- 172.21.15.99:0/2904286551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873413fae0 0x7f873406f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8732800640 1 -- 172.21.15.99:0/2904286551 >> v1:172.21.15.187:6789/0 conn(0x7f8734142150 legacy=0x7f8734160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:24.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.651+0000 7f8732800640 1 -- 172.21.15.99:0/2904286551 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8734142c10 con 0x7f8734160c50 2024-09-10T07:34:24.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.652+0000 7f8732800640 1 --2- 172.21.15.99:0/2904286551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734160c50 0x7f87340cec10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f872c009e50 tx=0x7f872c02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f180c580344d60db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:24.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.652+0000 7f8731400640 1 -- 172.21.15.99:0/2904286551 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c036070 con 0x7f8734160c50 2024-09-10T07:34:24.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.652+0000 7f8731400640 1 -- 172.21.15.99:0/2904286551 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f872c031600 con 0x7f8734160c50 2024-09-10T07:34:24.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.652+0000 7f8731400640 1 -- 172.21.15.99:0/2904286551 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c0319d0 con 0x7f8734160c50 2024-09-10T07:34:24.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.653+0000 7f8738c00640 1 -- 172.21.15.99:0/2904286551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734160c50 msgr2=0x7f87340cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.653+0000 7f8738c00640 1 --2- 172.21.15.99:0/2904286551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734160c50 0x7f87340cec10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f872c009e50 tx=0x7f872c02a630 comp rx=0 tx=0).stop 2024-09-10T07:34:24.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.653+0000 7f8738c00640 1 -- 172.21.15.99:0/2904286551 shutdown_connections 2024-09-10T07:34:24.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.653+0000 7f8738c00640 1 --2- 172.21.15.99:0/2904286551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734160c50 0x7f87340cec10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.653+0000 7f8738c00640 1 --2- 172.21.15.99:0/2904286551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873413fae0 0x7f873406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.653+0000 7f8738c00640 1 -- 172.21.15.99:0/2904286551 >> 172.21.15.99:0/2904286551 conn(0x7f873406bc10 msgr2=0x7f873406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:24.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.653+0000 7f8738c00640 1 -- 172.21.15.99:0/2904286551 shutdown_connections 2024-09-10T07:34:24.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.653+0000 7f8738c00640 1 -- 172.21.15.99:0/2904286551 wait complete. 2024-09-10T07:34:24.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.655+0000 7f8738c00640 1 Processor -- start 2024-09-10T07:34:24.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.655+0000 7f8738c00640 1 -- start start 2024-09-10T07:34:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.655+0000 7f8738c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873413fae0 0x7f8734139260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8738c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734142150 0x7f873413a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8738c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8734160c50 0x7f8734143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8738c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f873406f870 con 0x7f8734142150 2024-09-10T07:34:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8738c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f873406f6f0 con 0x7f873413fae0 2024-09-10T07:34:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8738c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f87340cf150 con 0x7f8734160c50 2024-09-10T07:34:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8729400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734142150 0x7f873413a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8729400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734142150 0x7f873413a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34296/0 (socket says 172.21.15.99:34296) 2024-09-10T07:34:24.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8729400640 1 -- 172.21.15.99:0/3920917624 learned_addr learned my addr 172.21.15.99:0/3920917624 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8731e00640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873413fae0 0x7f8734139260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8732800640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8734160c50 0x7f8734143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8729400640 1 -- 172.21.15.99:0/3920917624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8734160c50 msgr2=0x7f8734143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8729400640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8734160c50 0x7f8734143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8729400640 1 -- 172.21.15.99:0/3920917624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873413fae0 msgr2=0x7f8734139260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8729400640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873413fae0 0x7f8734139260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.656+0000 7f8729400640 1 -- 172.21.15.99:0/3920917624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87341443a0 con 0x7f8734142150 2024-09-10T07:34:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.657+0000 7f8729400640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734142150 0x7f873413a340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f871c00c3f0 tx=0x7f871c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.657+0000 7f872aa00640 1 -- 172.21.15.99:0/3920917624 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c007020 con 0x7f8734142150 2024-09-10T07:34:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.657+0000 7f872aa00640 1 -- 172.21.15.99:0/3920917624 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c0071c0 con 0x7f8734142150 2024-09-10T07:34:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.657+0000 7f872aa00640 1 -- 172.21.15.99:0/3920917624 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c007590 con 0x7f8734142150 2024-09-10T07:34:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.657+0000 7f8738c00640 1 -- 172.21.15.99:0/3920917624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8734144680 con 0x7f8734142150 2024-09-10T07:34:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.657+0000 7f8738c00640 1 -- 172.21.15.99:0/3920917624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8734144d80 con 0x7f8734142150 2024-09-10T07:34:24.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.658+0000 7f8738c00640 1 -- 172.21.15.99:0/3920917624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f873406f1b0 con 0x7f8734142150 2024-09-10T07:34:24.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.659+0000 7f872aa00640 1 -- 172.21.15.99:0/3920917624 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f871c019020 con 0x7f8734142150 2024-09-10T07:34:24.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.660+0000 7f872aa00640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f871006be30 0x7f871006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:24.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.660+0000 7f872aa00640 1 -- 172.21.15.99:0/3920917624 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f871c08a530 con 0x7f8734142150 2024-09-10T07:34:24.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.660+0000 7f8731e00640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f871006be30 0x7f871006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:24.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.660+0000 7f8731e00640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f871006be30 0x7f871006e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8724006fd0 tx=0x7f8724008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:24.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.664+0000 7f872aa00640 1 -- 172.21.15.99:0/3920917624 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f871c058880 con 0x7f8734142150 2024-09-10T07:34:24.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.833+0000 7f8738c00640 1 -- 172.21.15.99:0/3920917624 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f873415fb60 con 0x7f871006be30 2024-09-10T07:34:24.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.840+0000 7f872aa00640 1 -- 172.21.15.99:0/3920917624 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247484 (secure 0 0 0) 0x7f873415fb60 con 0x7f871006be30 2024-09-10T07:34:24.844 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 -- 172.21.15.99:0/3920917624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f871006be30 msgr2=0x7f871006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f871006be30 0x7f871006e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8724006fd0 tx=0x7f8724008040 comp rx=0 tx=0).stop 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 -- 172.21.15.99:0/3920917624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734142150 msgr2=0x7f873413a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734142150 0x7f873413a340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f871c00c3f0 tx=0x7f871c00c8b0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 -- 172.21.15.99:0/3920917624 shutdown_connections 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8734160c50 0x7f8734143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f871006be30 0x7f871006e2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8734142150 0x7f873413a340 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 --2- 172.21.15.99:0/3920917624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873413fae0 0x7f8734139260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 -- 172.21.15.99:0/3920917624 >> 172.21.15.99:0/3920917624 conn(0x7f873406bc10 msgr2=0x7f87340b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:24.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 -- 172.21.15.99:0/3920917624 shutdown_connections 2024-09-10T07:34:24.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:24.844+0000 7f8738c00640 1 -- 172.21.15.99:0/3920917624 wait complete. 2024-09-10T07:34:24.848 INFO:tasks.ceph.mds.d.smithi187.stderr:2024-09-10T07:34:24.846+0000 7f73ef200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:34:24.860 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-10T07:34:24.693336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001058"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662085+0000","last_change":"2024-09-10T07:34:19.892617+0000","last_active":"2024-09-10T07:34:21.662085+0000","last_peered":"2024-09-10T07:34:21.662085+0000","last_clean":"2024-09-10T07:34:21.662085+0000","last_became_active":"2024-09-10T07:34:19.892309+0000","last_became_peered":"2024-09-10T07:34:19.892309+0000","last_unstale":"2024-09-10T07:34:21.662085+0000","last_undegraded":"2024-09-10T07:34:21.662085+0000","last_fullsized":"2024-09-10T07:34:21.662085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:08.745649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874030+0000","last_change":"2024-09-10T07:34:19.888537+0000","last_active":"2024-09-10T07:34:20.874030+0000","last_peered":"2024-09-10T07:34:20.874030+0000","last_clean":"2024-09-10T07:34:20.874030+0000","last_became_active":"2024-09-10T07:34:19.888035+0000","last_became_peered":"2024-09-10T07:34:19.888035+0000","last_unstale":"2024-09-10T07:34:20.874030+0000","last_undegraded":"2024-09-10T07:34:20.874030+0000","last_fullsized":"2024-09-10T07:34:20.874030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.614677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661256+0000","last_change":"2024-09-10T07:34:19.878583+0000","last_active":"2024-09-10T07:34:21.661256+0000","last_peered":"2024-09-10T07:34:21.661256+0000","last_clean":"2024-09-10T07:34:21.661256+0000","last_became_active":"2024-09-10T07:34:19.877749+0000","last_became_peered":"2024-09-10T07:34:19.877749+0000","last_unstale":"2024-09-10T07:34:21.661256+0000","last_undegraded":"2024-09-10T07:34:21.661256+0000","last_fullsized":"2024-09-10T07:34:21.661256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:05.290210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874227+0000","last_change":"2024-09-10T07:34:19.902236+0000","last_active":"2024-09-10T07:34:20.874227+0000","last_peered":"2024-09-10T07:34:20.874227+0000","last_clean":"2024-09-10T07:34:20.874227+0000","last_became_active":"2024-09-10T07:34:19.890752+0000","last_became_peered":"2024-09-10T07:34:19.890752+0000","last_unstale":"2024-09-10T07:34:20.874227+0000","last_undegraded":"2024-09-10T07:34:20.874227+0000","last_fullsized":"2024-09-10T07:34:20.874227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:05.551601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662087+0000","last_change":"2024-09-10T07:34:19.887506+0000","last_active":"2024-09-10T07:34:21.662087+0000","last_peered":"2024-09-10T07:34:21.662087+0000","last_clean":"2024-09-10T07:34:21.662087+0000","last_became_active":"2024-09-10T07:34:19.887222+0000","last_became_peered":"2024-09-10T07:34:19.887222+0000","last_unstale":"2024-09-10T07:34:21.662087+0000","last_undegraded":"2024-09-10T07:34:21.662087+0000","last_fullsized":"2024-09-10T07:34:21.662087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:23.722211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874811+0000","last_change":"2024-09-10T07:34:19.903919+0000","last_active":"2024-09-10T07:34:20.874811+0000","last_peered":"2024-09-10T07:34:20.874811+0000","last_clean":"2024-09-10T07:34:20.874811+0000","last_became_active":"2024-09-10T07:34:19.899806+0000","last_became_peered":"2024-09-10T07:34:19.899806+0000","last_unstale":"2024-09-10T07:34:20.874811+0000","last_undegraded":"2024-09-10T07:34:20.874811+0000","last_fullsized":"2024-09-10T07:34:20.874811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:25.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662215+0000","last_change":"2024-09-10T07:34:19.893722+0000","last_active":"2024-09-10T07:34:21.662215+0000","last_peered":"2024-09-10T07:34:21.662215+0000","last_clean":"2024-09-10T07:34:21.662215+0000","last_became_active":"2024-09-10T07:34:19.892593+0000","last_became_peered":"2024-09-10T07:34:19.892593+0000","last_unstale":"2024-09-10T07:34:21.662215+0000","last_undegraded":"2024-09-10T07:34:21.662215+0000","last_fullsized":"2024-09-10T07:34:21.662215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:59.649735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670073+0000","last_change":"2024-09-10T07:34:19.898847+0000","last_active":"2024-09-10T07:34:21.670073+0000","last_peered":"2024-09-10T07:34:21.670073+0000","last_clean":"2024-09-10T07:34:21.670073+0000","last_became_active":"2024-09-10T07:34:19.898631+0000","last_became_peered":"2024-09-10T07:34:19.898631+0000","last_unstale":"2024-09-10T07:34:21.670073+0000","last_undegraded":"2024-09-10T07:34:21.670073+0000","last_fullsized":"2024-09-10T07:34:21.670073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:44.898089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661639+0000","last_change":"2024-09-10T07:34:19.903205+0000","last_active":"2024-09-10T07:34:21.661639+0000","last_peered":"2024-09-10T07:34:21.661639+0000","last_clean":"2024-09-10T07:34:21.661639+0000","last_became_active":"2024-09-10T07:34:19.902878+0000","last_became_peered":"2024-09-10T07:34:19.902878+0000","last_unstale":"2024-09-10T07:34:21.661639+0000","last_undegraded":"2024-09-10T07:34:21.661639+0000","last_fullsized":"2024-09-10T07:34:21.661639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:52.348207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662586+0000","last_change":"2024-09-10T07:34:19.897459+0000","last_active":"2024-09-10T07:34:21.662586+0000","last_peered":"2024-09-10T07:34:21.662586+0000","last_clean":"2024-09-10T07:34:21.662586+0000","last_became_active":"2024-09-10T07:34:19.897101+0000","last_became_peered":"2024-09-10T07:34:19.897101+0000","last_unstale":"2024-09-10T07:34:21.662586+0000","last_undegraded":"2024-09-10T07:34:21.662586+0000","last_fullsized":"2024-09-10T07:34:21.662586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:26.495286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662204+0000","last_change":"2024-09-10T07:34:19.905217+0000","last_active":"2024-09-10T07:34:21.662204+0000","last_peered":"2024-09-10T07:34:21.662204+0000","last_clean":"2024-09-10T07:34:21.662204+0000","last_became_active":"2024-09-10T07:34:19.904996+0000","last_became_peered":"2024-09-10T07:34:19.904996+0000","last_unstale":"2024-09-10T07:34:21.662204+0000","last_undegraded":"2024-09-10T07:34:21.662204+0000","last_fullsized":"2024-09-10T07:34:21.662204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:02.976787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662067+0000","last_change":"2024-09-10T07:34:19.891107+0000","last_active":"2024-09-10T07:34:21.662067+0000","last_peered":"2024-09-10T07:34:21.662067+0000","last_clean":"2024-09-10T07:34:21.662067+0000","last_became_active":"2024-09-10T07:34:19.890867+0000","last_became_peered":"2024-09-10T07:34:19.890867+0000","last_unstale":"2024-09-10T07:34:21.662067+0000","last_undegraded":"2024-09-10T07:34:21.662067+0000","last_fullsized":"2024-09-10T07:34:21.662067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:38.421462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670678+0000","last_change":"2024-09-10T07:34:19.886282+0000","last_active":"2024-09-10T07:34:21.670678+0000","last_peered":"2024-09-10T07:34:21.670678+0000","last_clean":"2024-09-10T07:34:21.670678+0000","last_became_active":"2024-09-10T07:34:19.885882+0000","last_became_peered":"2024-09-10T07:34:19.885882+0000","last_unstale":"2024-09-10T07:34:21.670678+0000","last_undegraded":"2024-09-10T07:34:21.670678+0000","last_fullsized":"2024-09-10T07:34:21.670678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:43.173752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661181+0000","last_change":"2024-09-10T07:34:19.891694+0000","last_active":"2024-09-10T07:34:21.661181+0000","last_peered":"2024-09-10T07:34:21.661181+0000","last_clean":"2024-09-10T07:34:21.661181+0000","last_became_active":"2024-09-10T07:34:19.891459+0000","last_became_peered":"2024-09-10T07:34:19.891459+0000","last_unstale":"2024-09-10T07:34:21.661181+0000","last_undegraded":"2024-09-10T07:34:21.661181+0000","last_fullsized":"2024-09-10T07:34:21.661181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:16.090201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874232+0000","last_change":"2024-09-10T07:34:19.893542+0000","last_active":"2024-09-10T07:34:20.874232+0000","last_peered":"2024-09-10T07:34:20.874232+0000","last_clean":"2024-09-10T07:34:20.874232+0000","last_became_active":"2024-09-10T07:34:19.893322+0000","last_became_peered":"2024-09-10T07:34:19.893322+0000","last_unstale":"2024-09-10T07:34:20.874232+0000","last_undegraded":"2024-09-10T07:34:20.874232+0000","last_fullsized":"2024-09-10T07:34:20.874232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:22.545813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874654+0000","last_change":"2024-09-10T07:34:19.903722+0000","last_active":"2024-09-10T07:34:20.874654+0000","last_peered":"2024-09-10T07:34:20.874654+0000","last_clean":"2024-09-10T07:34:20.874654+0000","last_became_active":"2024-09-10T07:34:19.898533+0000","last_became_peered":"2024-09-10T07:34:19.898533+0000","last_unstale":"2024-09-10T07:34:20.874654+0000","last_undegraded":"2024-09-10T07:34:20.874654+0000","last_fullsized":"2024-09-10T07:34:20.874654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:05.242981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874283+0000","last_change":"2024-09-10T07:34:19.899921+0000","last_active":"2024-09-10T07:34:20.874283+0000","last_peered":"2024-09-10T07:34:20.874283+0000","last_clean":"2024-09-10T07:34:20.874283+0000","last_became_active":"2024-09-10T07:34:19.898724+0000","last_became_peered":"2024-09-10T07:34:19.898724+0000","last_unstale":"2024-09-10T07:34:20.874283+0000","last_undegraded":"2024-09-10T07:34:20.874283+0000","last_fullsized":"2024-09-10T07:34:20.874283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:41.761384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876568+0000","last_change":"2024-09-10T07:34:19.885766+0000","last_active":"2024-09-10T07:34:20.876568+0000","last_peered":"2024-09-10T07:34:20.876568+0000","last_clean":"2024-09-10T07:34:20.876568+0000","last_became_active":"2024-09-10T07:34:19.885527+0000","last_became_peered":"2024-09-10T07:34:19.885527+0000","last_unstale":"2024-09-10T07:34:20.876568+0000","last_undegraded":"2024-09-10T07:34:20.876568+0000","last_fullsized":"2024-09-10T07:34:20.876568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:00.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661947+0000","last_change":"2024-09-10T07:34:19.893683+0000","last_active":"2024-09-10T07:34:21.661947+0000","last_peered":"2024-09-10T07:34:21.661947+0000","last_clean":"2024-09-10T07:34:21.661947+0000","last_became_active":"2024-09-10T07:34:19.893434+0000","last_became_peered":"2024-09-10T07:34:19.893434+0000","last_unstale":"2024-09-10T07:34:21.661947+0000","last_undegraded":"2024-09-10T07:34:21.661947+0000","last_fullsized":"2024-09-10T07:34:21.661947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:51.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662731+0000","last_change":"2024-09-10T07:34:19.887710+0000","last_active":"2024-09-10T07:34:21.662731+0000","last_peered":"2024-09-10T07:34:21.662731+0000","last_clean":"2024-09-10T07:34:21.662731+0000","last_became_active":"2024-09-10T07:34:19.885828+0000","last_became_peered":"2024-09-10T07:34:19.885828+0000","last_unstale":"2024-09-10T07:34:21.662731+0000","last_undegraded":"2024-09-10T07:34:21.662731+0000","last_fullsized":"2024-09-10T07:34:21.662731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:04.667930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661631+0000","last_change":"2024-09-10T07:34:19.892283+0000","last_active":"2024-09-10T07:34:21.661631+0000","last_peered":"2024-09-10T07:34:21.661631+0000","last_clean":"2024-09-10T07:34:21.661631+0000","last_became_active":"2024-09-10T07:34:19.891053+0000","last_became_peered":"2024-09-10T07:34:19.891053+0000","last_unstale":"2024-09-10T07:34:21.661631+0000","last_undegraded":"2024-09-10T07:34:21.661631+0000","last_fullsized":"2024-09-10T07:34:21.661631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:29.348905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874600+0000","last_change":"2024-09-10T07:34:19.902111+0000","last_active":"2024-09-10T07:34:20.874600+0000","last_peered":"2024-09-10T07:34:20.874600+0000","last_clean":"2024-09-10T07:34:20.874600+0000","last_became_active":"2024-09-10T07:34:19.899428+0000","last_became_peered":"2024-09-10T07:34:19.899428+0000","last_unstale":"2024-09-10T07:34:20.874600+0000","last_undegraded":"2024-09-10T07:34:20.874600+0000","last_fullsized":"2024-09-10T07:34:20.874600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:20.251420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670807+0000","last_change":"2024-09-10T07:34:19.897707+0000","last_active":"2024-09-10T07:34:21.670807+0000","last_peered":"2024-09-10T07:34:21.670807+0000","last_clean":"2024-09-10T07:34:21.670807+0000","last_became_active":"2024-09-10T07:34:19.897224+0000","last_became_peered":"2024-09-10T07:34:19.897224+0000","last_unstale":"2024-09-10T07:34:21.670807+0000","last_undegraded":"2024-09-10T07:34:21.670807+0000","last_fullsized":"2024-09-10T07:34:21.670807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:55.118641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874389+0000","last_change":"2024-09-10T07:34:19.902882+0000","last_active":"2024-09-10T07:34:20.874389+0000","last_peered":"2024-09-10T07:34:20.874389+0000","last_clean":"2024-09-10T07:34:20.874389+0000","last_became_active":"2024-09-10T07:34:19.902613+0000","last_became_peered":"2024-09-10T07:34:19.902613+0000","last_unstale":"2024-09-10T07:34:20.874389+0000","last_undegraded":"2024-09-10T07:34:20.874389+0000","last_fullsized":"2024-09-10T07:34:20.874389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:32.482791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670154+0000","last_change":"2024-09-10T07:34:19.894790+0000","last_active":"2024-09-10T07:34:21.670154+0000","last_peered":"2024-09-10T07:34:21.670154+0000","last_clean":"2024-09-10T07:34:21.670154+0000","last_became_active":"2024-09-10T07:34:19.894561+0000","last_became_peered":"2024-09-10T07:34:19.894561+0000","last_unstale":"2024-09-10T07:34:21.670154+0000","last_undegraded":"2024-09-10T07:34:21.670154+0000","last_fullsized":"2024-09-10T07:34:21.670154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:03.238025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662344+0000","last_change":"2024-09-10T07:34:19.892319+0000","last_active":"2024-09-10T07:34:21.662344+0000","last_peered":"2024-09-10T07:34:21.662344+0000","last_clean":"2024-09-10T07:34:21.662344+0000","last_became_active":"2024-09-10T07:34:19.890032+0000","last_became_peered":"2024-09-10T07:34:19.890032+0000","last_unstale":"2024-09-10T07:34:21.662344+0000","last_undegraded":"2024-09-10T07:34:21.662344+0000","last_fullsized":"2024-09-10T07:34:21.662344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:11:11.464486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874146+0000","last_change":"2024-09-10T07:34:19.888281+0000","last_active":"2024-09-10T07:34:20.874146+0000","last_peered":"2024-09-10T07:34:20.874146+0000","last_clean":"2024-09-10T07:34:20.874146+0000","last_became_active":"2024-09-10T07:34:19.887727+0000","last_became_peered":"2024-09-10T07:34:19.887727+0000","last_unstale":"2024-09-10T07:34:20.874146+0000","last_undegraded":"2024-09-10T07:34:20.874146+0000","last_fullsized":"2024-09-10T07:34:20.874146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:55.524958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670292+0000","last_change":"2024-09-10T07:34:19.897389+0000","last_active":"2024-09-10T07:34:21.670292+0000","last_peered":"2024-09-10T07:34:21.670292+0000","last_clean":"2024-09-10T07:34:21.670292+0000","last_became_active":"2024-09-10T07:34:19.893934+0000","last_became_peered":"2024-09-10T07:34:19.893934+0000","last_unstale":"2024-09-10T07:34:21.670292+0000","last_undegraded":"2024-09-10T07:34:21.670292+0000","last_fullsized":"2024-09-10T07:34:21.670292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:41.808586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661356+0000","last_change":"2024-09-10T07:34:19.889846+0000","last_active":"2024-09-10T07:34:21.661356+0000","last_peered":"2024-09-10T07:34:21.661356+0000","last_clean":"2024-09-10T07:34:21.661356+0000","last_became_active":"2024-09-10T07:34:19.887187+0000","last_became_peered":"2024-09-10T07:34:19.887187+0000","last_unstale":"2024-09-10T07:34:21.661356+0000","last_undegraded":"2024-09-10T07:34:21.661356+0000","last_fullsized":"2024-09-10T07:34:21.661356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.175246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874425+0000","last_change":"2024-09-10T07:34:19.896912+0000","last_active":"2024-09-10T07:34:20.874425+0000","last_peered":"2024-09-10T07:34:20.874425+0000","last_clean":"2024-09-10T07:34:20.874425+0000","last_became_active":"2024-09-10T07:34:19.888502+0000","last_became_peered":"2024-09-10T07:34:19.888502+0000","last_unstale":"2024-09-10T07:34:20.874425+0000","last_undegraded":"2024-09-10T07:34:20.874425+0000","last_fullsized":"2024-09-10T07:34:20.874425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:44.356761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876566+0000","last_change":"2024-09-10T07:34:19.905306+0000","last_active":"2024-09-10T07:34:20.876566+0000","last_peered":"2024-09-10T07:34:20.876566+0000","last_clean":"2024-09-10T07:34:20.876566+0000","last_became_active":"2024-09-10T07:34:19.905152+0000","last_became_peered":"2024-09-10T07:34:19.905152+0000","last_unstale":"2024-09-10T07:34:20.876566+0000","last_undegraded":"2024-09-10T07:34:20.876566+0000","last_fullsized":"2024-09-10T07:34:20.876566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:21.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662983+0000","last_change":"2024-09-10T07:34:19.886696+0000","last_active":"2024-09-10T07:34:21.662983+0000","last_peered":"2024-09-10T07:34:21.662983+0000","last_clean":"2024-09-10T07:34:21.662983+0000","last_became_active":"2024-09-10T07:34:19.886407+0000","last_became_peered":"2024-09-10T07:34:19.886407+0000","last_unstale":"2024-09-10T07:34:21.662983+0000","last_undegraded":"2024-09-10T07:34:21.662983+0000","last_fullsized":"2024-09-10T07:34:21.662983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:24.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662493+0000","last_change":"2024-09-10T07:34:19.887443+0000","last_active":"2024-09-10T07:34:21.662493+0000","last_peered":"2024-09-10T07:34:21.662493+0000","last_clean":"2024-09-10T07:34:21.662493+0000","last_became_active":"2024-09-10T07:34:19.887205+0000","last_became_peered":"2024-09-10T07:34:19.887205+0000","last_unstale":"2024-09-10T07:34:21.662493+0000","last_undegraded":"2024-09-10T07:34:21.662493+0000","last_fullsized":"2024-09-10T07:34:21.662493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:12.040516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670544+0000","last_change":"2024-09-10T07:34:18.889171+0000","last_active":"2024-09-10T07:34:21.670544+0000","last_peered":"2024-09-10T07:34:21.670544+0000","last_clean":"2024-09-10T07:34:21.670544+0000","last_became_active":"2024-09-10T07:34:18.888923+0000","last_became_peered":"2024-09-10T07:34:18.888923+0000","last_unstale":"2024-09-10T07:34:21.670544+0000","last_undegraded":"2024-09-10T07:34:21.670544+0000","last_fullsized":"2024-09-10T07:34:21.670544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:20.349301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661390+0000","last_change":"2024-09-10T07:34:19.890336+0000","last_active":"2024-09-10T07:34:21.661390+0000","last_peered":"2024-09-10T07:34:21.661390+0000","last_clean":"2024-09-10T07:34:21.661390+0000","last_became_active":"2024-09-10T07:34:19.890049+0000","last_became_peered":"2024-09-10T07:34:19.890049+0000","last_unstale":"2024-09-10T07:34:21.661390+0000","last_undegraded":"2024-09-10T07:34:21.661390+0000","last_fullsized":"2024-09-10T07:34:21.661390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:48.240115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661973+0000","last_change":"2024-09-10T07:34:18.890244+0000","last_active":"2024-09-10T07:34:21.661973+0000","last_peered":"2024-09-10T07:34:21.661973+0000","last_clean":"2024-09-10T07:34:21.661973+0000","last_became_active":"2024-09-10T07:34:18.889613+0000","last_became_peered":"2024-09-10T07:34:18.889613+0000","last_unstale":"2024-09-10T07:34:21.661973+0000","last_undegraded":"2024-09-10T07:34:21.661973+0000","last_fullsized":"2024-09-10T07:34:21.661973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:11.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670521+0000","last_change":"2024-09-10T07:34:18.889534+0000","last_active":"2024-09-10T07:34:21.670521+0000","last_peered":"2024-09-10T07:34:21.670521+0000","last_clean":"2024-09-10T07:34:21.670521+0000","last_became_active":"2024-09-10T07:34:18.889242+0000","last_became_peered":"2024-09-10T07:34:18.889242+0000","last_unstale":"2024-09-10T07:34:21.670521+0000","last_undegraded":"2024-09-10T07:34:21.670521+0000","last_fullsized":"2024-09-10T07:34:21.670521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:18.829274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670327+0000","last_change":"2024-09-10T07:34:19.884510+0000","last_active":"2024-09-10T07:34:21.670327+0000","last_peered":"2024-09-10T07:34:21.670327+0000","last_clean":"2024-09-10T07:34:21.670327+0000","last_became_active":"2024-09-10T07:34:19.884235+0000","last_became_peered":"2024-09-10T07:34:19.884235+0000","last_unstale":"2024-09-10T07:34:21.670327+0000","last_undegraded":"2024-09-10T07:34:21.670327+0000","last_fullsized":"2024-09-10T07:34:21.670327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:31.685537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874642+0000","last_change":"2024-09-10T07:34:18.884543+0000","last_active":"2024-09-10T07:34:20.874642+0000","last_peered":"2024-09-10T07:34:20.874642+0000","last_clean":"2024-09-10T07:34:20.874642+0000","last_became_active":"2024-09-10T07:34:18.884298+0000","last_became_peered":"2024-09-10T07:34:18.884298+0000","last_unstale":"2024-09-10T07:34:20.874642+0000","last_undegraded":"2024-09-10T07:34:20.874642+0000","last_fullsized":"2024-09-10T07:34:20.874642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:11.804692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874177+0000","last_change":"2024-09-10T07:34:19.888708+0000","last_active":"2024-09-10T07:34:20.874177+0000","last_peered":"2024-09-10T07:34:20.874177+0000","last_clean":"2024-09-10T07:34:20.874177+0000","last_became_active":"2024-09-10T07:34:19.888434+0000","last_became_peered":"2024-09-10T07:34:19.888434+0000","last_unstale":"2024-09-10T07:34:20.874177+0000","last_undegraded":"2024-09-10T07:34:20.874177+0000","last_fullsized":"2024-09-10T07:34:20.874177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:41.986776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662474+0000","last_change":"2024-09-10T07:34:18.888024+0000","last_active":"2024-09-10T07:34:21.662474+0000","last_peered":"2024-09-10T07:34:21.662474+0000","last_clean":"2024-09-10T07:34:21.662474+0000","last_became_active":"2024-09-10T07:34:18.886888+0000","last_became_peered":"2024-09-10T07:34:18.886888+0000","last_unstale":"2024-09-10T07:34:21.662474+0000","last_undegraded":"2024-09-10T07:34:21.662474+0000","last_fullsized":"2024-09-10T07:34:21.662474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:27.884742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874439+0000","last_change":"2024-09-10T07:34:19.901075+0000","last_active":"2024-09-10T07:34:20.874439+0000","last_peered":"2024-09-10T07:34:20.874439+0000","last_clean":"2024-09-10T07:34:20.874439+0000","last_became_active":"2024-09-10T07:34:19.899090+0000","last_became_peered":"2024-09-10T07:34:19.899090+0000","last_unstale":"2024-09-10T07:34:20.874439+0000","last_undegraded":"2024-09-10T07:34:20.874439+0000","last_fullsized":"2024-09-10T07:34:20.874439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:12.703010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874850+0000","last_change":"2024-09-10T07:34:18.890112+0000","last_active":"2024-09-10T07:34:20.874850+0000","last_peered":"2024-09-10T07:34:20.874850+0000","last_clean":"2024-09-10T07:34:20.874850+0000","last_became_active":"2024-09-10T07:34:18.888701+0000","last_became_peered":"2024-09-10T07:34:18.888701+0000","last_unstale":"2024-09-10T07:34:20.874850+0000","last_undegraded":"2024-09-10T07:34:20.874850+0000","last_fullsized":"2024-09-10T07:34:20.874850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:36.214403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661712+0000","last_change":"2024-09-10T07:34:19.904217+0000","last_active":"2024-09-10T07:34:21.661712+0000","last_peered":"2024-09-10T07:34:21.661712+0000","last_clean":"2024-09-10T07:34:21.661712+0000","last_became_active":"2024-09-10T07:34:19.903931+0000","last_became_peered":"2024-09-10T07:34:19.903931+0000","last_unstale":"2024-09-10T07:34:21.661712+0000","last_undegraded":"2024-09-10T07:34:21.661712+0000","last_fullsized":"2024-09-10T07:34:21.661712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:15.824093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874133+0000","last_change":"2024-09-10T07:34:18.880938+0000","last_active":"2024-09-10T07:34:20.874133+0000","last_peered":"2024-09-10T07:34:20.874133+0000","last_clean":"2024-09-10T07:34:20.874133+0000","last_became_active":"2024-09-10T07:34:18.880624+0000","last_became_peered":"2024-09-10T07:34:18.880624+0000","last_unstale":"2024-09-10T07:34:20.874133+0000","last_undegraded":"2024-09-10T07:34:20.874133+0000","last_fullsized":"2024-09-10T07:34:20.874133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:54.148440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661856+0000","last_change":"2024-09-10T07:34:19.892359+0000","last_active":"2024-09-10T07:34:21.661856+0000","last_peered":"2024-09-10T07:34:21.661856+0000","last_clean":"2024-09-10T07:34:21.661856+0000","last_became_active":"2024-09-10T07:34:19.892071+0000","last_became_peered":"2024-09-10T07:34:19.892071+0000","last_unstale":"2024-09-10T07:34:21.661856+0000","last_undegraded":"2024-09-10T07:34:21.661856+0000","last_fullsized":"2024-09-10T07:34:21.661856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:35.384674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662593+0000","last_change":"2024-09-10T07:34:18.890452+0000","last_active":"2024-09-10T07:34:21.662593+0000","last_peered":"2024-09-10T07:34:21.662593+0000","last_clean":"2024-09-10T07:34:21.662593+0000","last_became_active":"2024-09-10T07:34:18.890105+0000","last_became_peered":"2024-09-10T07:34:18.890105+0000","last_unstale":"2024-09-10T07:34:21.662593+0000","last_undegraded":"2024-09-10T07:34:21.662593+0000","last_fullsized":"2024-09-10T07:34:21.662593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:38.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663586+0000","last_change":"2024-09-10T07:34:19.890697+0000","last_active":"2024-09-10T07:34:21.663586+0000","last_peered":"2024-09-10T07:34:21.663586+0000","last_clean":"2024-09-10T07:34:21.663586+0000","last_became_active":"2024-09-10T07:34:19.890402+0000","last_became_peered":"2024-09-10T07:34:19.890402+0000","last_unstale":"2024-09-10T07:34:21.663586+0000","last_undegraded":"2024-09-10T07:34:21.663586+0000","last_fullsized":"2024-09-10T07:34:21.663586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:53.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661353+0000","last_change":"2024-09-10T07:34:18.888006+0000","last_active":"2024-09-10T07:34:21.661353+0000","last_peered":"2024-09-10T07:34:21.661353+0000","last_clean":"2024-09-10T07:34:21.661353+0000","last_became_active":"2024-09-10T07:34:18.887741+0000","last_became_peered":"2024-09-10T07:34:18.887741+0000","last_unstale":"2024-09-10T07:34:21.661353+0000","last_undegraded":"2024-09-10T07:34:21.661353+0000","last_fullsized":"2024-09-10T07:34:21.661353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:54.559172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661790+0000","last_change":"2024-09-10T07:34:19.889260+0000","last_active":"2024-09-10T07:34:21.661790+0000","last_peered":"2024-09-10T07:34:21.661790+0000","last_clean":"2024-09-10T07:34:21.661790+0000","last_became_active":"2024-09-10T07:34:19.887143+0000","last_became_peered":"2024-09-10T07:34:19.887143+0000","last_unstale":"2024-09-10T07:34:21.661790+0000","last_undegraded":"2024-09-10T07:34:21.661790+0000","last_fullsized":"2024-09-10T07:34:21.661790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:16.774984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.875016+0000","last_change":"2024-09-10T07:34:18.882643+0000","last_active":"2024-09-10T07:34:20.875016+0000","last_peered":"2024-09-10T07:34:20.875016+0000","last_clean":"2024-09-10T07:34:20.875016+0000","last_became_active":"2024-09-10T07:34:18.880714+0000","last_became_peered":"2024-09-10T07:34:18.880714+0000","last_unstale":"2024-09-10T07:34:20.875016+0000","last_undegraded":"2024-09-10T07:34:20.875016+0000","last_fullsized":"2024-09-10T07:34:20.875016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:45.258127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662259+0000","last_change":"2024-09-10T07:34:19.896855+0000","last_active":"2024-09-10T07:34:21.662259+0000","last_peered":"2024-09-10T07:34:21.662259+0000","last_clean":"2024-09-10T07:34:21.662259+0000","last_became_active":"2024-09-10T07:34:19.896238+0000","last_became_peered":"2024-09-10T07:34:19.896238+0000","last_unstale":"2024-09-10T07:34:21.662259+0000","last_undegraded":"2024-09-10T07:34:21.662259+0000","last_fullsized":"2024-09-10T07:34:21.662259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:16.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663121+0000","last_change":"2024-09-10T07:34:18.888390+0000","last_active":"2024-09-10T07:34:21.663121+0000","last_peered":"2024-09-10T07:34:21.663121+0000","last_clean":"2024-09-10T07:34:21.663121+0000","last_became_active":"2024-09-10T07:34:18.888118+0000","last_became_peered":"2024-09-10T07:34:18.888118+0000","last_unstale":"2024-09-10T07:34:21.663121+0000","last_undegraded":"2024-09-10T07:34:21.663121+0000","last_fullsized":"2024-09-10T07:34:21.663121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:56.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661915+0000","last_change":"2024-09-10T07:34:19.883697+0000","last_active":"2024-09-10T07:34:21.661915+0000","last_peered":"2024-09-10T07:34:21.661915+0000","last_clean":"2024-09-10T07:34:21.661915+0000","last_became_active":"2024-09-10T07:34:19.883431+0000","last_became_peered":"2024-09-10T07:34:19.883431+0000","last_unstale":"2024-09-10T07:34:21.661915+0000","last_undegraded":"2024-09-10T07:34:21.661915+0000","last_fullsized":"2024-09-10T07:34:21.661915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:20.019093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876623+0000","last_change":"2024-09-10T07:34:18.883206+0000","last_active":"2024-09-10T07:34:20.876623+0000","last_peered":"2024-09-10T07:34:20.876623+0000","last_clean":"2024-09-10T07:34:20.876623+0000","last_became_active":"2024-09-10T07:34:18.882158+0000","last_became_peered":"2024-09-10T07:34:18.882158+0000","last_unstale":"2024-09-10T07:34:20.876623+0000","last_undegraded":"2024-09-10T07:34:20.876623+0000","last_fullsized":"2024-09-10T07:34:20.876623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663793+0000","last_change":"2024-09-10T07:34:19.894056+0000","last_active":"2024-09-10T07:34:21.663793+0000","last_peered":"2024-09-10T07:34:21.663793+0000","last_clean":"2024-09-10T07:34:21.663793+0000","last_became_active":"2024-09-10T07:34:19.892962+0000","last_became_peered":"2024-09-10T07:34:19.892962+0000","last_unstale":"2024-09-10T07:34:21.663793+0000","last_undegraded":"2024-09-10T07:34:21.663793+0000","last_fullsized":"2024-09-10T07:34:21.663793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:09.600142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661937+0000","last_change":"2024-09-10T07:34:18.874857+0000","last_active":"2024-09-10T07:34:21.661937+0000","last_peered":"2024-09-10T07:34:21.661937+0000","last_clean":"2024-09-10T07:34:21.661937+0000","last_became_active":"2024-09-10T07:34:18.874552+0000","last_became_peered":"2024-09-10T07:34:18.874552+0000","last_unstale":"2024-09-10T07:34:21.661937+0000","last_undegraded":"2024-09-10T07:34:21.661937+0000","last_fullsized":"2024-09-10T07:34:21.661937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:23.855683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662517+0000","last_change":"2024-09-10T07:34:19.897112+0000","last_active":"2024-09-10T07:34:21.662517+0000","last_peered":"2024-09-10T07:34:21.662517+0000","last_clean":"2024-09-10T07:34:21.662517+0000","last_became_active":"2024-09-10T07:34:19.896629+0000","last_became_peered":"2024-09-10T07:34:19.896629+0000","last_unstale":"2024-09-10T07:34:21.662517+0000","last_undegraded":"2024-09-10T07:34:21.662517+0000","last_fullsized":"2024-09-10T07:34:21.662517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:55.574984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876617+0000","last_change":"2024-09-10T07:34:18.881651+0000","last_active":"2024-09-10T07:34:20.876617+0000","last_peered":"2024-09-10T07:34:20.876617+0000","last_clean":"2024-09-10T07:34:20.876617+0000","last_became_active":"2024-09-10T07:34:18.880881+0000","last_became_peered":"2024-09-10T07:34:18.880881+0000","last_unstale":"2024-09-10T07:34:20.876617+0000","last_undegraded":"2024-09-10T07:34:20.876617+0000","last_fullsized":"2024-09-10T07:34:20.876617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:25.241480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661793+0000","last_change":"2024-09-10T07:34:19.897357+0000","last_active":"2024-09-10T07:34:21.661793+0000","last_peered":"2024-09-10T07:34:21.661793+0000","last_clean":"2024-09-10T07:34:21.661793+0000","last_became_active":"2024-09-10T07:34:19.896933+0000","last_became_peered":"2024-09-10T07:34:19.896933+0000","last_unstale":"2024-09-10T07:34:21.661793+0000","last_undegraded":"2024-09-10T07:34:21.661793+0000","last_fullsized":"2024-09-10T07:34:21.661793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:34.757810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874058+0000","last_change":"2024-09-10T07:34:18.889958+0000","last_active":"2024-09-10T07:34:20.874058+0000","last_peered":"2024-09-10T07:34:20.874058+0000","last_clean":"2024-09-10T07:34:20.874058+0000","last_became_active":"2024-09-10T07:34:18.889736+0000","last_became_peered":"2024-09-10T07:34:18.889736+0000","last_unstale":"2024-09-10T07:34:20.874058+0000","last_undegraded":"2024-09-10T07:34:20.874058+0000","last_fullsized":"2024-09-10T07:34:20.874058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:24.746910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874732+0000","last_change":"2024-09-10T07:34:19.897928+0000","last_active":"2024-09-10T07:34:20.874732+0000","last_peered":"2024-09-10T07:34:20.874732+0000","last_clean":"2024-09-10T07:34:20.874732+0000","last_became_active":"2024-09-10T07:34:19.896221+0000","last_became_peered":"2024-09-10T07:34:19.896221+0000","last_unstale":"2024-09-10T07:34:20.874732+0000","last_undegraded":"2024-09-10T07:34:20.874732+0000","last_fullsized":"2024-09-10T07:34:20.874732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:06.456252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876363+0000","last_change":"2024-09-10T07:34:18.877131+0000","last_active":"2024-09-10T07:34:20.876363+0000","last_peered":"2024-09-10T07:34:20.876363+0000","last_clean":"2024-09-10T07:34:20.876363+0000","last_became_active":"2024-09-10T07:34:18.876023+0000","last_became_peered":"2024-09-10T07:34:18.876023+0000","last_unstale":"2024-09-10T07:34:20.876363+0000","last_undegraded":"2024-09-10T07:34:20.876363+0000","last_fullsized":"2024-09-10T07:34:20.876363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:12:08.297705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663613+0000","last_change":"2024-09-10T07:34:19.905847+0000","last_active":"2024-09-10T07:34:21.663613+0000","last_peered":"2024-09-10T07:34:21.663613+0000","last_clean":"2024-09-10T07:34:21.663613+0000","last_became_active":"2024-09-10T07:34:19.905522+0000","last_became_peered":"2024-09-10T07:34:19.905522+0000","last_unstale":"2024-09-10T07:34:21.663613+0000","last_undegraded":"2024-09-10T07:34:21.663613+0000","last_fullsized":"2024-09-10T07:34:21.663613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:07.869122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663659+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:34:21.663659+0000","last_peered":"2024-09-10T07:34:21.663659+0000","last_clean":"2024-09-10T07:34:21.663659+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:34:21.663659+0000","last_undegraded":"2024-09-10T07:34:21.663659+0000","last_fullsized":"2024-09-10T07:34:21.663659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.875200+0000","last_change":"2024-09-10T07:34:18.881565+0000","last_active":"2024-09-10T07:34:20.875200+0000","last_peered":"2024-09-10T07:34:20.875200+0000","last_clean":"2024-09-10T07:34:20.875200+0000","last_became_active":"2024-09-10T07:34:18.879618+0000","last_became_peered":"2024-09-10T07:34:18.879618+0000","last_unstale":"2024-09-10T07:34:20.875200+0000","last_undegraded":"2024-09-10T07:34:20.875200+0000","last_fullsized":"2024-09-10T07:34:20.875200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:43.934312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670323+0000","last_change":"2024-09-10T07:34:19.899451+0000","last_active":"2024-09-10T07:34:21.670323+0000","last_peered":"2024-09-10T07:34:21.670323+0000","last_clean":"2024-09-10T07:34:21.670323+0000","last_became_active":"2024-09-10T07:34:19.899171+0000","last_became_peered":"2024-09-10T07:34:19.899171+0000","last_unstale":"2024-09-10T07:34:21.670323+0000","last_undegraded":"2024-09-10T07:34:21.670323+0000","last_fullsized":"2024-09-10T07:34:21.670323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:00.427217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663563+0000","last_change":"2024-09-10T07:34:18.886056+0000","last_active":"2024-09-10T07:34:21.663563+0000","last_peered":"2024-09-10T07:34:21.663563+0000","last_clean":"2024-09-10T07:34:21.663563+0000","last_became_active":"2024-09-10T07:34:18.884743+0000","last_became_peered":"2024-09-10T07:34:18.884743+0000","last_unstale":"2024-09-10T07:34:21.663563+0000","last_undegraded":"2024-09-10T07:34:21.663563+0000","last_fullsized":"2024-09-10T07:34:21.663563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:47.912136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661759+0000","last_change":"2024-09-10T07:34:19.890527+0000","last_active":"2024-09-10T07:34:21.661759+0000","last_peered":"2024-09-10T07:34:21.661759+0000","last_clean":"2024-09-10T07:34:21.661759+0000","last_became_active":"2024-09-10T07:34:19.888669+0000","last_became_peered":"2024-09-10T07:34:19.888669+0000","last_unstale":"2024-09-10T07:34:21.661759+0000","last_undegraded":"2024-09-10T07:34:21.661759+0000","last_fullsized":"2024-09-10T07:34:21.661759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:16.766074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876721+0000","last_change":"2024-09-10T07:34:18.880716+0000","last_active":"2024-09-10T07:34:20.876721+0000","last_peered":"2024-09-10T07:34:20.876721+0000","last_clean":"2024-09-10T07:34:20.876721+0000","last_became_active":"2024-09-10T07:34:18.880464+0000","last_became_peered":"2024-09-10T07:34:18.880464+0000","last_unstale":"2024-09-10T07:34:20.876721+0000","last_undegraded":"2024-09-10T07:34:20.876721+0000","last_fullsized":"2024-09-10T07:34:20.876721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:16.502080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874334+0000","last_change":"2024-09-10T07:34:19.886246+0000","last_active":"2024-09-10T07:34:20.874334+0000","last_peered":"2024-09-10T07:34:20.874334+0000","last_clean":"2024-09-10T07:34:20.874334+0000","last_became_active":"2024-09-10T07:34:19.886011+0000","last_became_peered":"2024-09-10T07:34:19.886011+0000","last_unstale":"2024-09-10T07:34:20.874334+0000","last_undegraded":"2024-09-10T07:34:20.874334+0000","last_fullsized":"2024-09-10T07:34:20.874334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:38.325753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874907+0000","last_change":"2024-09-10T07:34:18.884016+0000","last_active":"2024-09-10T07:34:20.874907+0000","last_peered":"2024-09-10T07:34:20.874907+0000","last_clean":"2024-09-10T07:34:20.874907+0000","last_became_active":"2024-09-10T07:34:18.883371+0000","last_became_peered":"2024-09-10T07:34:18.883371+0000","last_unstale":"2024-09-10T07:34:20.874907+0000","last_undegraded":"2024-09-10T07:34:20.874907+0000","last_fullsized":"2024-09-10T07:34:20.874907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:30.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662521+0000","last_change":"2024-09-10T07:34:19.886349+0000","last_active":"2024-09-10T07:34:21.662521+0000","last_peered":"2024-09-10T07:34:21.662521+0000","last_clean":"2024-09-10T07:34:21.662521+0000","last_became_active":"2024-09-10T07:34:19.886096+0000","last_became_peered":"2024-09-10T07:34:19.886096+0000","last_unstale":"2024-09-10T07:34:21.662521+0000","last_undegraded":"2024-09-10T07:34:21.662521+0000","last_fullsized":"2024-09-10T07:34:21.662521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:08.446221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874348+0000","last_change":"2024-09-10T07:34:18.881982+0000","last_active":"2024-09-10T07:34:20.874348+0000","last_peered":"2024-09-10T07:34:20.874348+0000","last_clean":"2024-09-10T07:34:20.874348+0000","last_became_active":"2024-09-10T07:34:18.881585+0000","last_became_peered":"2024-09-10T07:34:18.881585+0000","last_unstale":"2024-09-10T07:34:20.874348+0000","last_undegraded":"2024-09-10T07:34:20.874348+0000","last_fullsized":"2024-09-10T07:34:20.874348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:17.622849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874496+0000","last_change":"2024-09-10T07:34:19.901907+0000","last_active":"2024-09-10T07:34:20.874496+0000","last_peered":"2024-09-10T07:34:20.874496+0000","last_clean":"2024-09-10T07:34:20.874496+0000","last_became_active":"2024-09-10T07:34:19.889125+0000","last_became_peered":"2024-09-10T07:34:19.889125+0000","last_unstale":"2024-09-10T07:34:20.874496+0000","last_undegraded":"2024-09-10T07:34:20.874496+0000","last_fullsized":"2024-09-10T07:34:20.874496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:22.996650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662632+0000","last_change":"2024-09-10T07:34:18.886286+0000","last_active":"2024-09-10T07:34:21.662632+0000","last_peered":"2024-09-10T07:34:21.662632+0000","last_clean":"2024-09-10T07:34:21.662632+0000","last_became_active":"2024-09-10T07:34:18.885859+0000","last_became_peered":"2024-09-10T07:34:18.885859+0000","last_unstale":"2024-09-10T07:34:21.662632+0000","last_undegraded":"2024-09-10T07:34:21.662632+0000","last_fullsized":"2024-09-10T07:34:21.662632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:31.802025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874083+0000","last_change":"2024-09-10T07:34:19.892610+0000","last_active":"2024-09-10T07:34:20.874083+0000","last_peered":"2024-09-10T07:34:20.874083+0000","last_clean":"2024-09-10T07:34:20.874083+0000","last_became_active":"2024-09-10T07:34:19.892379+0000","last_became_peered":"2024-09-10T07:34:19.892379+0000","last_unstale":"2024-09-10T07:34:20.874083+0000","last_undegraded":"2024-09-10T07:34:20.874083+0000","last_fullsized":"2024-09-10T07:34:20.874083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:15.254184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874282+0000","last_change":"2024-09-10T07:34:18.888415+0000","last_active":"2024-09-10T07:34:20.874282+0000","last_peered":"2024-09-10T07:34:20.874282+0000","last_clean":"2024-09-10T07:34:20.874282+0000","last_became_active":"2024-09-10T07:34:18.888207+0000","last_became_peered":"2024-09-10T07:34:18.888207+0000","last_unstale":"2024-09-10T07:34:20.874282+0000","last_undegraded":"2024-09-10T07:34:20.874282+0000","last_fullsized":"2024-09-10T07:34:20.874282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:22.188010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670152+0000","last_change":"2024-09-10T07:34:19.889874+0000","last_active":"2024-09-10T07:34:21.670152+0000","last_peered":"2024-09-10T07:34:21.670152+0000","last_clean":"2024-09-10T07:34:21.670152+0000","last_became_active":"2024-09-10T07:34:19.889625+0000","last_became_peered":"2024-09-10T07:34:19.889625+0000","last_unstale":"2024-09-10T07:34:21.670152+0000","last_undegraded":"2024-09-10T07:34:21.670152+0000","last_fullsized":"2024-09-10T07:34:21.670152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:51.968652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663254+0000","last_change":"2024-09-10T07:34:18.887039+0000","last_active":"2024-09-10T07:34:21.663254+0000","last_peered":"2024-09-10T07:34:21.663254+0000","last_clean":"2024-09-10T07:34:21.663254+0000","last_became_active":"2024-09-10T07:34:18.886635+0000","last_became_peered":"2024-09-10T07:34:18.886635+0000","last_unstale":"2024-09-10T07:34:21.663254+0000","last_undegraded":"2024-09-10T07:34:21.663254+0000","last_fullsized":"2024-09-10T07:34:21.663254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:17.740947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661497+0000","last_change":"2024-09-10T07:34:19.890736+0000","last_active":"2024-09-10T07:34:21.661497+0000","last_peered":"2024-09-10T07:34:21.661497+0000","last_clean":"2024-09-10T07:34:21.661497+0000","last_became_active":"2024-09-10T07:34:19.890272+0000","last_became_peered":"2024-09-10T07:34:19.890272+0000","last_unstale":"2024-09-10T07:34:21.661497+0000","last_undegraded":"2024-09-10T07:34:21.661497+0000","last_fullsized":"2024-09-10T07:34:21.661497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:31.679112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.664026+0000","last_change":"2024-09-10T07:34:18.885652+0000","last_active":"2024-09-10T07:34:21.664026+0000","last_peered":"2024-09-10T07:34:21.664026+0000","last_clean":"2024-09-10T07:34:21.664026+0000","last_became_active":"2024-09-10T07:34:18.885417+0000","last_became_peered":"2024-09-10T07:34:18.885417+0000","last_unstale":"2024-09-10T07:34:21.664026+0000","last_undegraded":"2024-09-10T07:34:21.664026+0000","last_fullsized":"2024-09-10T07:34:21.664026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:01.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663356+0000","last_change":"2024-09-10T07:34:19.884641+0000","last_active":"2024-09-10T07:34:21.663356+0000","last_peered":"2024-09-10T07:34:21.663356+0000","last_clean":"2024-09-10T07:34:21.663356+0000","last_became_active":"2024-09-10T07:34:19.884423+0000","last_became_peered":"2024-09-10T07:34:19.884423+0000","last_unstale":"2024-09-10T07:34:21.663356+0000","last_undegraded":"2024-09-10T07:34:21.663356+0000","last_fullsized":"2024-09-10T07:34:21.663356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:26.638115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874278+0000","last_change":"2024-09-10T07:34:18.882863+0000","last_active":"2024-09-10T07:34:20.874278+0000","last_peered":"2024-09-10T07:34:20.874278+0000","last_clean":"2024-09-10T07:34:20.874278+0000","last_became_active":"2024-09-10T07:34:18.882249+0000","last_became_peered":"2024-09-10T07:34:18.882249+0000","last_unstale":"2024-09-10T07:34:20.874278+0000","last_undegraded":"2024-09-10T07:34:20.874278+0000","last_fullsized":"2024-09-10T07:34:20.874278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:35.318539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670150+0000","last_change":"2024-09-10T07:34:19.893265+0000","last_active":"2024-09-10T07:34:21.670150+0000","last_peered":"2024-09-10T07:34:21.670150+0000","last_clean":"2024-09-10T07:34:21.670150+0000","last_became_active":"2024-09-10T07:34:19.893020+0000","last_became_peered":"2024-09-10T07:34:19.893020+0000","last_unstale":"2024-09-10T07:34:21.670150+0000","last_undegraded":"2024-09-10T07:34:21.670150+0000","last_fullsized":"2024-09-10T07:34:21.670150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:52.734126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874384+0000","last_change":"2024-09-10T07:34:18.887226+0000","last_active":"2024-09-10T07:34:20.874384+0000","last_peered":"2024-09-10T07:34:20.874384+0000","last_clean":"2024-09-10T07:34:20.874384+0000","last_became_active":"2024-09-10T07:34:18.886984+0000","last_became_peered":"2024-09-10T07:34:18.886984+0000","last_unstale":"2024-09-10T07:34:20.874384+0000","last_undegraded":"2024-09-10T07:34:20.874384+0000","last_fullsized":"2024-09-10T07:34:20.874384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:36.473754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670462+0000","last_change":"2024-09-10T07:34:19.884817+0000","last_active":"2024-09-10T07:34:21.670462+0000","last_peered":"2024-09-10T07:34:21.670462+0000","last_clean":"2024-09-10T07:34:21.670462+0000","last_became_active":"2024-09-10T07:34:19.884124+0000","last_became_peered":"2024-09-10T07:34:19.884124+0000","last_unstale":"2024-09-10T07:34:21.670462+0000","last_undegraded":"2024-09-10T07:34:21.670462+0000","last_fullsized":"2024-09-10T07:34:21.670462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:24.641374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663662+0000","last_change":"2024-09-10T07:34:18.889841+0000","last_active":"2024-09-10T07:34:21.663662+0000","last_peered":"2024-09-10T07:34:21.663662+0000","last_clean":"2024-09-10T07:34:21.663662+0000","last_became_active":"2024-09-10T07:34:18.889570+0000","last_became_peered":"2024-09-10T07:34:18.889570+0000","last_unstale":"2024-09-10T07:34:21.663662+0000","last_undegraded":"2024-09-10T07:34:21.663662+0000","last_fullsized":"2024-09-10T07:34:21.663662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:47.841495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662534+0000","last_change":"2024-09-10T07:34:19.884838+0000","last_active":"2024-09-10T07:34:21.662534+0000","last_peered":"2024-09-10T07:34:21.662534+0000","last_clean":"2024-09-10T07:34:21.662534+0000","last_became_active":"2024-09-10T07:34:19.884573+0000","last_became_peered":"2024-09-10T07:34:19.884573+0000","last_unstale":"2024-09-10T07:34:21.662534+0000","last_undegraded":"2024-09-10T07:34:21.662534+0000","last_fullsized":"2024-09-10T07:34:21.662534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:02.551067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874582+0000","last_change":"2024-09-10T07:34:19.895850+0000","last_active":"2024-09-10T07:34:20.874582+0000","last_peered":"2024-09-10T07:34:20.874582+0000","last_clean":"2024-09-10T07:34:20.874582+0000","last_became_active":"2024-09-10T07:34:19.888211+0000","last_became_peered":"2024-09-10T07:34:19.888211+0000","last_unstale":"2024-09-10T07:34:20.874582+0000","last_undegraded":"2024-09-10T07:34:20.874582+0000","last_fullsized":"2024-09-10T07:34:20.874582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:06.898516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663878+0000","last_change":"2024-09-10T07:34:18.884883+0000","last_active":"2024-09-10T07:34:21.663878+0000","last_peered":"2024-09-10T07:34:21.663878+0000","last_clean":"2024-09-10T07:34:21.663878+0000","last_became_active":"2024-09-10T07:34:18.884636+0000","last_became_peered":"2024-09-10T07:34:18.884636+0000","last_unstale":"2024-09-10T07:34:21.663878+0000","last_undegraded":"2024-09-10T07:34:21.663878+0000","last_fullsized":"2024-09-10T07:34:21.663878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:12.480770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874965+0000","last_change":"2024-09-10T07:34:19.904494+0000","last_active":"2024-09-10T07:34:20.874965+0000","last_peered":"2024-09-10T07:34:20.874965+0000","last_clean":"2024-09-10T07:34:20.874965+0000","last_became_active":"2024-09-10T07:34:19.903127+0000","last_became_peered":"2024-09-10T07:34:19.903127+0000","last_unstale":"2024-09-10T07:34:20.874965+0000","last_undegraded":"2024-09-10T07:34:20.874965+0000","last_fullsized":"2024-09-10T07:34:20.874965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:57.196611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662754+0000","last_change":"2024-09-10T07:34:18.889220+0000","last_active":"2024-09-10T07:34:21.662754+0000","last_peered":"2024-09-10T07:34:21.662754+0000","last_clean":"2024-09-10T07:34:21.662754+0000","last_became_active":"2024-09-10T07:34:18.888214+0000","last_became_peered":"2024-09-10T07:34:18.888214+0000","last_unstale":"2024-09-10T07:34:21.662754+0000","last_undegraded":"2024-09-10T07:34:21.662754+0000","last_fullsized":"2024-09-10T07:34:21.662754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:48.684795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661677+0000","last_change":"2024-09-10T07:34:19.878000+0000","last_active":"2024-09-10T07:34:21.661677+0000","last_peered":"2024-09-10T07:34:21.661677+0000","last_clean":"2024-09-10T07:34:21.661677+0000","last_became_active":"2024-09-10T07:34:19.877411+0000","last_became_peered":"2024-09-10T07:34:19.877411+0000","last_unstale":"2024-09-10T07:34:21.661677+0000","last_undegraded":"2024-09-10T07:34:21.661677+0000","last_fullsized":"2024-09-10T07:34:21.661677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:12.088477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670408+0000","last_change":"2024-09-10T07:34:18.888882+0000","last_active":"2024-09-10T07:34:21.670408+0000","last_peered":"2024-09-10T07:34:21.670408+0000","last_clean":"2024-09-10T07:34:21.670408+0000","last_became_active":"2024-09-10T07:34:18.888507+0000","last_became_peered":"2024-09-10T07:34:18.888507+0000","last_unstale":"2024-09-10T07:34:21.670408+0000","last_undegraded":"2024-09-10T07:34:21.670408+0000","last_fullsized":"2024-09-10T07:34:21.670408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:18.761910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670172+0000","last_change":"2024-09-10T07:34:19.887622+0000","last_active":"2024-09-10T07:34:21.670172+0000","last_peered":"2024-09-10T07:34:21.670172+0000","last_clean":"2024-09-10T07:34:21.670172+0000","last_became_active":"2024-09-10T07:34:19.887211+0000","last_became_peered":"2024-09-10T07:34:19.887211+0000","last_unstale":"2024-09-10T07:34:21.670172+0000","last_undegraded":"2024-09-10T07:34:21.670172+0000","last_fullsized":"2024-09-10T07:34:21.670172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661793+0000","last_change":"2024-09-10T07:34:18.882907+0000","last_active":"2024-09-10T07:34:21.661793+0000","last_peered":"2024-09-10T07:34:21.661793+0000","last_clean":"2024-09-10T07:34:21.661793+0000","last_became_active":"2024-09-10T07:34:18.882653+0000","last_became_peered":"2024-09-10T07:34:18.882653+0000","last_unstale":"2024-09-10T07:34:21.661793+0000","last_undegraded":"2024-09-10T07:34:21.661793+0000","last_fullsized":"2024-09-10T07:34:21.661793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.380676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:34:24.864 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T07:34:25.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.054+0000 7f7dcf200640 1 Processor -- start 2024-09-10T07:34:25.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.054+0000 7f7dcf200640 1 -- start start 2024-09-10T07:34:25.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.055+0000 7f7dcf200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7dd015e970 0x7f7dd00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.055+0000 7f7dcf200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7dd00d2680 0x7f7dd00cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.055+0000 7f7dcf200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd00d2bd0 con 0x7f7dd00cfac0 2024-09-10T07:34:25.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.055+0000 7f7dcf200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd00d37e0 con 0x7f7dd015e970 2024-09-10T07:34:25.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.055+0000 7f7dcf200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd00d2eb0 con 0x7f7dd00d2680 2024-09-10T07:34:25.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.055+0000 7f7dcde00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7dd015e970 0x7f7dd00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.055+0000 7f7dcde00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7dd015e970 0x7f7dd00d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34312/0 (socket says 172.21.15.99:34312) 2024-09-10T07:34:25.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.055+0000 7f7dcde00640 1 -- 172.21.15.99:0/404105873 learned_addr learned my addr 172.21.15.99:0/404105873 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:25.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.056+0000 7f7dcd400640 1 --2- 172.21.15.99:0/404105873 >> v2:172.21.15.187:3300/0 conn(0x7f7dd00d2680 0x7f7dd00cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.056+0000 7f7dcde00640 1 -- 172.21.15.99:0/404105873 >> v2:172.21.15.187:3300/0 conn(0x7f7dd00d2680 msgr2=0x7f7dd00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:25.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.056+0000 7f7dcde00640 1 --2- 172.21.15.99:0/404105873 >> v2:172.21.15.187:3300/0 conn(0x7f7dd00d2680 0x7f7dd00cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.056+0000 7f7dcde00640 1 -- 172.21.15.99:0/404105873 >> v1:172.21.15.187:6789/0 conn(0x7f7dd00cfac0 legacy=0x7f7dd00d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.056+0000 7f7dcde00640 1 -- 172.21.15.99:0/404105873 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd00d3190 con 0x7f7dd015e970 2024-09-10T07:34:25.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.056+0000 7f7dcd400640 1 --2- 172.21.15.99:0/404105873 >> v2:172.21.15.187:3300/0 conn(0x7f7dd00d2680 0x7f7dd00cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:25.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.057+0000 7f7dcde00640 1 --2- 172.21.15.99:0/404105873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd015e970 0x7f7dd00d0300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7dd009e530 tx=0x7f7dc002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d5c377f2d3b065 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.057+0000 7f7dcca00640 1 -- 172.21.15.99:0/404105873 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0037070 con 0x7f7dd015e970 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.057+0000 7f7dcca00640 1 -- 172.21.15.99:0/404105873 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc002ae50 con 0x7f7dd015e970 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.057+0000 7f7dcca00640 1 -- 172.21.15.99:0/404105873 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0032860 con 0x7f7dd015e970 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.058+0000 7f7dcf200640 1 -- 172.21.15.99:0/404105873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd015e970 msgr2=0x7f7dd00d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.058+0000 7f7dcf200640 1 --2- 172.21.15.99:0/404105873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd015e970 0x7f7dd00d0300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7dd009e530 tx=0x7f7dc002a300 comp rx=0 tx=0).stop 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.058+0000 7f7dcf200640 1 -- 172.21.15.99:0/404105873 shutdown_connections 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.058+0000 7f7dcf200640 1 --2- 172.21.15.99:0/404105873 >> v2:172.21.15.187:3300/0 conn(0x7f7dd00d2680 0x7f7dd00cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.058+0000 7f7dcf200640 1 --2- 172.21.15.99:0/404105873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd015e970 0x7f7dd00d0300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.058+0000 7f7dcf200640 1 -- 172.21.15.99:0/404105873 >> 172.21.15.99:0/404105873 conn(0x7f7dd009de00 msgr2=0x7f7dd00d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.058+0000 7f7dcf200640 1 -- 172.21.15.99:0/404105873 shutdown_connections 2024-09-10T07:34:25.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.058+0000 7f7dcf200640 1 -- 172.21.15.99:0/404105873 wait complete. 2024-09-10T07:34:25.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.059+0000 7f7dcf200640 1 Processor -- start 2024-09-10T07:34:25.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.060+0000 7f7dcf200640 1 -- start start 2024-09-10T07:34:25.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.060+0000 7f7dcf200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd00cfac0 0x7f7dd00ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.060+0000 7f7dcf200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7dd00d2680 0x7f7dd00cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.060+0000 7f7dcf200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7dd015e970 0x7f7dd0148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcf200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd00d0840 con 0x7f7dd00cfac0 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcf200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd00cff10 con 0x7f7dd00d2680 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcf200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd015ed50 con 0x7f7dd015e970 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd00cfac0 0x7f7dd00ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd00cfac0 0x7f7dd00ba4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34324/0 (socket says 172.21.15.99:34324) 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcde00640 1 -- 172.21.15.99:0/3893424277 learned_addr learned my addr 172.21.15.99:0/3893424277 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcd400640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7dd00d2680 0x7f7dd00cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dce800640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7dd015e970 0x7f7dd0148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcde00640 1 -- 172.21.15.99:0/3893424277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7dd015e970 msgr2=0x7f7dd0148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcde00640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7dd015e970 0x7f7dd0148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcde00640 1 -- 172.21.15.99:0/3893424277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7dd00d2680 msgr2=0x7f7dd00cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcde00640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7dd00d2680 0x7f7dd00cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcde00640 1 -- 172.21.15.99:0/3893424277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd00cc0c0 con 0x7f7dd00cfac0 2024-09-10T07:34:25.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcd400640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7dd00d2680 0x7f7dd00cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:25.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.061+0000 7f7dcde00640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd00cfac0 0x7f7dd00ba4c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0000c00 tx=0x7f7dc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:25.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.062+0000 7f7dc6000640 1 -- 172.21.15.99:0/3893424277 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0041020 con 0x7f7dd00cfac0 2024-09-10T07:34:25.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.062+0000 7f7dc6000640 1 -- 172.21.15.99:0/3893424277 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc003c670 con 0x7f7dd00cfac0 2024-09-10T07:34:25.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.062+0000 7f7dc6000640 1 -- 172.21.15.99:0/3893424277 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0037040 con 0x7f7dd00cfac0 2024-09-10T07:34:25.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.062+0000 7f7dcf200640 1 -- 172.21.15.99:0/3893424277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd01f4250 con 0x7f7dd00cfac0 2024-09-10T07:34:25.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.062+0000 7f7dcf200640 1 -- 172.21.15.99:0/3893424277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd00cc340 con 0x7f7dd00cfac0 2024-09-10T07:34:25.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.063+0000 7f7dcf200640 1 -- 172.21.15.99:0/3893424277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd00cf580 con 0x7f7dd00cfac0 2024-09-10T07:34:25.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.064+0000 7f7dc6000640 1 -- 172.21.15.99:0/3893424277 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7dc0044020 con 0x7f7dd00cfac0 2024-09-10T07:34:25.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.064+0000 7f7dc6000640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7db006be30 0x7f7db006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.064+0000 7f7dc6000640 1 -- 172.21.15.99:0/3893424277 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7dc00ab600 con 0x7f7dd00cfac0 2024-09-10T07:34:25.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.065+0000 7f7dcd400640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7db006be30 0x7f7db006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.065+0000 7f7dcd400640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7db006be30 0x7f7db006e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7dd006c4a0 tx=0x7f7dbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:25.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.069+0000 7f7dc6000640 1 -- 172.21.15.99:0/3893424277 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7dc004b030 con 0x7f7dd00cfac0 2024-09-10T07:34:25.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.305+0000 7f7dcf200640 1 -- 172.21.15.99:0/3893424277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7dd0075500 con 0x7f7dd00cfac0 2024-09-10T07:34:25.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.305+0000 7f7dc6000640 1 -- 172.21.15.99:0/3893424277 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1047 (secure 0 0 0) 0x7f7dd00cc0c0 con 0x7f7dd00cfac0 2024-09-10T07:34:25.305 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:25.306 INFO:teuthology.orchestra.run.smithi099.stdout:{"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1725953648,"num_in_osds":8,"osd_in_since":1725953645,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":1751748,"bytes_avail":1598248252,"bytes_total":1600000000,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"btime":"2024-09-10T07:34:22:900404+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4284}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-10T07:34:01.910299+0000","services":{}},"progress_events":{}} 2024-09-10T07:34:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.307+0000 7f7dcf200640 1 -- 172.21.15.99:0/3893424277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7db006be30 msgr2=0x7f7db006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.307+0000 7f7dcf200640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7db006be30 0x7f7db006e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7dd006c4a0 tx=0x7f7dbc008040 comp rx=0 tx=0).stop 2024-09-10T07:34:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.307+0000 7f7dcf200640 1 -- 172.21.15.99:0/3893424277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd00cfac0 msgr2=0x7f7dd00ba4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.307+0000 7f7dcf200640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd00cfac0 0x7f7dd00ba4c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0000c00 tx=0x7f7dc00046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.307+0000 7f7dcf200640 1 -- 172.21.15.99:0/3893424277 shutdown_connections 2024-09-10T07:34:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.307+0000 7f7dcf200640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7dd015e970 0x7f7dd0148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.307+0000 7f7dcf200640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7dd00d2680 0x7f7dd00cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.308+0000 7f7dcf200640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7db006be30 0x7f7db006e2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.308+0000 7f7dcf200640 1 --2- 172.21.15.99:0/3893424277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dd00cfac0 0x7f7dd00ba4c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.308+0000 7f7dcf200640 1 -- 172.21.15.99:0/3893424277 >> 172.21.15.99:0/3893424277 conn(0x7f7dd009de00 msgr2=0x7f7dd00d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:25.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.308+0000 7f7dcf200640 1 -- 172.21.15.99:0/3893424277 shutdown_connections 2024-09-10T07:34:25.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.308+0000 7f7dcf200640 1 -- 172.21.15.99:0/3893424277 wait complete. 2024-09-10T07:34:25.324 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T07:34:25.325 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:34:25.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.479+0000 7fca66a00640 1 Processor -- start 2024-09-10T07:34:25.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.479+0000 7fca66a00640 1 -- start start 2024-09-10T07:34:25.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca66a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca600b1180 0x7fca600cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca66a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca6006e730 con 0x7fca6015eb00 2024-09-10T07:34:25.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca66a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca6006ea10 con 0x7fca6015fef0 2024-09-10T07:34:25.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca66a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fca601637e0 con 0x7fca600b1180 2024-09-10T07:34:25.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca5fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fca6015eb00 0x7fca601630d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51870/0 (socket says 172.21.15.99:51870) 2024-09-10T07:34:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca5fe00640 1 -- 172.21.15.99:0/2036964348 learned_addr learned my addr 172.21.15.99:0/2036964348 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca64a00640 1 --2- 172.21.15.99:0/2036964348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca600b1180 0x7fca600cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca5f400640 1 -- 172.21.15.99:0/2036964348 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312895524 0 0) 0x7fca6006e730 con 0x7fca6015eb00 2024-09-10T07:34:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca5f400640 1 -- 172.21.15.99:0/2036964348 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca44003520 con 0x7fca6015eb00 2024-09-10T07:34:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca5f400640 1 -- 172.21.15.99:0/2036964348 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825409745 0 0) 0x7fca6006ea10 con 0x7fca6015fef0 2024-09-10T07:34:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca5f400640 1 -- 172.21.15.99:0/2036964348 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca6006e730 con 0x7fca6015fef0 2024-09-10T07:34:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca64a00640 1 -- 172.21.15.99:0/2036964348 >> v1:172.21.15.187:6789/0 conn(0x7fca6015fef0 legacy=0x7fca600b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca64a00640 1 -- 172.21.15.99:0/2036964348 >> v1:172.21.15.99:6789/0 conn(0x7fca6015eb00 legacy=0x7fca601630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.481+0000 7fca64a00640 1 -- 172.21.15.99:0/2036964348 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca601628d0 con 0x7fca600b1180 2024-09-10T07:34:25.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.483+0000 7fca64a00640 1 --2- 172.21.15.99:0/2036964348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca600b1180 0x7fca600cf870 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fca58009dc0 tx=0x7fca5802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c16e8844f9b1c833 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:25.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.483+0000 7fca5f400640 1 -- 172.21.15.99:0/2036964348 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5802ae60 con 0x7fca600b1180 2024-09-10T07:34:25.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.483+0000 7fca5f400640 1 -- 172.21.15.99:0/2036964348 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca58007740 con 0x7fca600b1180 2024-09-10T07:34:25.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.483+0000 7fca5f400640 1 -- 172.21.15.99:0/2036964348 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58007b10 con 0x7fca600b1180 2024-09-10T07:34:25.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.483+0000 7fca66a00640 1 -- 172.21.15.99:0/2036964348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca600b1180 msgr2=0x7fca600cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.483+0000 7fca66a00640 1 --2- 172.21.15.99:0/2036964348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca600b1180 0x7fca600cf870 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fca58009dc0 tx=0x7fca5802a640 comp rx=0 tx=0).stop 2024-09-10T07:34:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.483+0000 7fca66a00640 1 -- 172.21.15.99:0/2036964348 shutdown_connections 2024-09-10T07:34:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.483+0000 7fca66a00640 1 --2- 172.21.15.99:0/2036964348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca600b1180 0x7fca600cf870 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.483+0000 7fca66a00640 1 -- 172.21.15.99:0/2036964348 >> 172.21.15.99:0/2036964348 conn(0x7fca6006cd20 msgr2=0x7fca6006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.484+0000 7fca66a00640 1 -- 172.21.15.99:0/2036964348 shutdown_connections 2024-09-10T07:34:25.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.484+0000 7fca66a00640 1 -- 172.21.15.99:0/2036964348 wait complete. 2024-09-10T07:34:25.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.485+0000 7fca66a00640 1 Processor -- start 2024-09-10T07:34:25.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.485+0000 7fca66a00640 1 -- start start 2024-09-10T07:34:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.486+0000 7fca66a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca600b1180 0x7fca600afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.486+0000 7fca66a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6015eb00 0x7fca60150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.486+0000 7fca66a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca60158e90 0x7fca60159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.486+0000 7fca66a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fca6006d990 con 0x7fca600b1180 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.486+0000 7fca66a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fca6006d810 con 0x7fca6015eb00 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.486+0000 7fca66a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fca6006ffd0 con 0x7fca60158e90 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.486+0000 7fca5fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca600b1180 0x7fca600afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.486+0000 7fca5fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca600b1180 0x7fca600afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34326/0 (socket says 172.21.15.99:34326) 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.486+0000 7fca5fe00640 1 -- 172.21.15.99:0/4149580858 learned_addr learned my addr 172.21.15.99:0/4149580858 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca64a00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca60158e90 0x7fca60159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca57400640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6015eb00 0x7fca60150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca5fe00640 1 -- 172.21.15.99:0/4149580858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca60158e90 msgr2=0x7fca60159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca5fe00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca60158e90 0x7fca60159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca5fe00640 1 -- 172.21.15.99:0/4149580858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6015eb00 msgr2=0x7fca60150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca5fe00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6015eb00 0x7fca60150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca5fe00640 1 -- 172.21.15.99:0/4149580858 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6015cf20 con 0x7fca600b1180 2024-09-10T07:34:25.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca57400640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6015eb00 0x7fca60150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:25.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca5fe00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca600b1180 0x7fca600afbb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca5000c530 tx=0x7fca5000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:25.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca5cc00640 1 -- 172.21.15.99:0/4149580858 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50017070 con 0x7fca600b1180 2024-09-10T07:34:25.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca5cc00640 1 -- 172.21.15.99:0/4149580858 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca50005ce0 con 0x7fca600b1180 2024-09-10T07:34:25.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca5cc00640 1 -- 172.21.15.99:0/4149580858 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50007270 con 0x7fca600b1180 2024-09-10T07:34:25.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.487+0000 7fca66a00640 1 -- 172.21.15.99:0/4149580858 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6015c960 con 0x7fca600b1180 2024-09-10T07:34:25.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.488+0000 7fca66a00640 1 -- 172.21.15.99:0/4149580858 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca60151210 con 0x7fca600b1180 2024-09-10T07:34:25.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.489+0000 7fca66a00640 1 -- 172.21.15.99:0/4149580858 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca600d1460 con 0x7fca600b1180 2024-09-10T07:34:25.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.489+0000 7fca5cc00640 1 -- 172.21.15.99:0/4149580858 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca5001a070 con 0x7fca600b1180 2024-09-10T07:34:25.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.490+0000 7fca5cc00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca3c06be30 0x7fca3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:25.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.490+0000 7fca5cc00640 1 -- 172.21.15.99:0/4149580858 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fca5008a150 con 0x7fca600b1180 2024-09-10T07:34:25.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.490+0000 7fca57400640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca3c06be30 0x7fca3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:25.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.491+0000 7fca57400640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca3c06be30 0x7fca3c06e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca601f8450 tx=0x7fca48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.495+0000 7fca5cc00640 1 -- 172.21.15.99:0/4149580858 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca500584a0 con 0x7fca600b1180 2024-09-10T07:34:25.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.670+0000 7fca66a00640 1 -- 172.21.15.99:0/4149580858 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca6006c8f0 con 0x7fca3c06be30 2024-09-10T07:34:25.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.677+0000 7fca5cc00640 1 -- 172.21.15.99:0/4149580858 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247484 (secure 0 0 0) 0x7fca6006c8f0 con 0x7fca3c06be30 2024-09-10T07:34:25.679 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:25.680 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:34:25.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.680+0000 7fca66a00640 1 -- 172.21.15.99:0/4149580858 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca3c06be30 msgr2=0x7fca3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.680+0000 7fca66a00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca3c06be30 0x7fca3c06e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca601f8450 tx=0x7fca48009040 comp rx=0 tx=0).stop 2024-09-10T07:34:25.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.680+0000 7fca66a00640 1 -- 172.21.15.99:0/4149580858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca600b1180 msgr2=0x7fca600afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:25.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.680+0000 7fca66a00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca600b1180 0x7fca600afbb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca5000c530 tx=0x7fca5000c9f0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.680+0000 7fca66a00640 1 -- 172.21.15.99:0/4149580858 shutdown_connections 2024-09-10T07:34:25.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.680+0000 7fca66a00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca60158e90 0x7fca60159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.680+0000 7fca66a00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6015eb00 0x7fca60150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.680+0000 7fca66a00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca3c06be30 0x7fca3c06e2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.680+0000 7fca66a00640 1 --2- 172.21.15.99:0/4149580858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca600b1180 0x7fca600afbb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:25.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.680+0000 7fca66a00640 1 -- 172.21.15.99:0/4149580858 >> 172.21.15.99:0/4149580858 conn(0x7fca6006cd20 msgr2=0x7fca60072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:25.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.681+0000 7fca66a00640 1 -- 172.21.15.99:0/4149580858 shutdown_connections 2024-09-10T07:34:25.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:25.681+0000 7fca66a00640 1 -- 172.21.15.99:0/4149580858 wait complete. 2024-09-10T07:34:25.697 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-10T07:34:24.693336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001058"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662085+0000","last_change":"2024-09-10T07:34:19.892617+0000","last_active":"2024-09-10T07:34:21.662085+0000","last_peered":"2024-09-10T07:34:21.662085+0000","last_clean":"2024-09-10T07:34:21.662085+0000","last_became_active":"2024-09-10T07:34:19.892309+0000","last_became_peered":"2024-09-10T07:34:19.892309+0000","last_unstale":"2024-09-10T07:34:21.662085+0000","last_undegraded":"2024-09-10T07:34:21.662085+0000","last_fullsized":"2024-09-10T07:34:21.662085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:08.745649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874030+0000","last_change":"2024-09-10T07:34:19.888537+0000","last_active":"2024-09-10T07:34:20.874030+0000","last_peered":"2024-09-10T07:34:20.874030+0000","last_clean":"2024-09-10T07:34:20.874030+0000","last_became_active":"2024-09-10T07:34:19.888035+0000","last_became_peered":"2024-09-10T07:34:19.888035+0000","last_unstale":"2024-09-10T07:34:20.874030+0000","last_undegraded":"2024-09-10T07:34:20.874030+0000","last_fullsized":"2024-09-10T07:34:20.874030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.614677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661256+0000","last_change":"2024-09-10T07:34:19.878583+0000","last_active":"2024-09-10T07:34:21.661256+0000","last_peered":"2024-09-10T07:34:21.661256+0000","last_clean":"2024-09-10T07:34:21.661256+0000","last_became_active":"2024-09-10T07:34:19.877749+0000","last_became_peered":"2024-09-10T07:34:19.877749+0000","last_unstale":"2024-09-10T07:34:21.661256+0000","last_undegraded":"2024-09-10T07:34:21.661256+0000","last_fullsized":"2024-09-10T07:34:21.661256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:05.290210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874227+0000","last_change":"2024-09-10T07:34:19.902236+0000","last_active":"2024-09-10T07:34:20.874227+0000","last_peered":"2024-09-10T07:34:20.874227+0000","last_clean":"2024-09-10T07:34:20.874227+0000","last_became_active":"2024-09-10T07:34:19.890752+0000","last_became_peered":"2024-09-10T07:34:19.890752+0000","last_unstale":"2024-09-10T07:34:20.874227+0000","last_undegraded":"2024-09-10T07:34:20.874227+0000","last_fullsized":"2024-09-10T07:34:20.874227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:05.551601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662087+0000","last_change":"2024-09-10T07:34:19.887506+0000","last_active":"2024-09-10T07:34:21.662087+0000","last_peered":"2024-09-10T07:34:21.662087+0000","last_clean":"2024-09-10T07:34:21.662087+0000","last_became_active":"2024-09-10T07:34:19.887222+0000","last_became_peered":"2024-09-10T07:34:19.887222+0000","last_unstale":"2024-09-10T07:34:21.662087+0000","last_undegraded":"2024-09-10T07:34:21.662087+0000","last_fullsized":"2024-09-10T07:34:21.662087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:23.722211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874811+0000","last_change":"2024-09-10T07:34:19.903919+0000","last_active":"2024-09-10T07:34:20.874811+0000","last_peered":"2024-09-10T07:34:20.874811+0000","last_clean":"2024-09-10T07:34:20.874811+0000","last_became_active":"2024-09-10T07:34:19.899806+0000","last_became_peered":"2024-09-10T07:34:19.899806+0000","last_unstale":"2024-09-10T07:34:20.874811+0000","last_undegraded":"2024-09-10T07:34:20.874811+0000","last_fullsized":"2024-09-10T07:34:20.874811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:25.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662215+0000","last_change":"2024-09-10T07:34:19.893722+0000","last_active":"2024-09-10T07:34:21.662215+0000","last_peered":"2024-09-10T07:34:21.662215+0000","last_clean":"2024-09-10T07:34:21.662215+0000","last_became_active":"2024-09-10T07:34:19.892593+0000","last_became_peered":"2024-09-10T07:34:19.892593+0000","last_unstale":"2024-09-10T07:34:21.662215+0000","last_undegraded":"2024-09-10T07:34:21.662215+0000","last_fullsized":"2024-09-10T07:34:21.662215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:59.649735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670073+0000","last_change":"2024-09-10T07:34:19.898847+0000","last_active":"2024-09-10T07:34:21.670073+0000","last_peered":"2024-09-10T07:34:21.670073+0000","last_clean":"2024-09-10T07:34:21.670073+0000","last_became_active":"2024-09-10T07:34:19.898631+0000","last_became_peered":"2024-09-10T07:34:19.898631+0000","last_unstale":"2024-09-10T07:34:21.670073+0000","last_undegraded":"2024-09-10T07:34:21.670073+0000","last_fullsized":"2024-09-10T07:34:21.670073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:44.898089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661639+0000","last_change":"2024-09-10T07:34:19.903205+0000","last_active":"2024-09-10T07:34:21.661639+0000","last_peered":"2024-09-10T07:34:21.661639+0000","last_clean":"2024-09-10T07:34:21.661639+0000","last_became_active":"2024-09-10T07:34:19.902878+0000","last_became_peered":"2024-09-10T07:34:19.902878+0000","last_unstale":"2024-09-10T07:34:21.661639+0000","last_undegraded":"2024-09-10T07:34:21.661639+0000","last_fullsized":"2024-09-10T07:34:21.661639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:52.348207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662586+0000","last_change":"2024-09-10T07:34:19.897459+0000","last_active":"2024-09-10T07:34:21.662586+0000","last_peered":"2024-09-10T07:34:21.662586+0000","last_clean":"2024-09-10T07:34:21.662586+0000","last_became_active":"2024-09-10T07:34:19.897101+0000","last_became_peered":"2024-09-10T07:34:19.897101+0000","last_unstale":"2024-09-10T07:34:21.662586+0000","last_undegraded":"2024-09-10T07:34:21.662586+0000","last_fullsized":"2024-09-10T07:34:21.662586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:26.495286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662204+0000","last_change":"2024-09-10T07:34:19.905217+0000","last_active":"2024-09-10T07:34:21.662204+0000","last_peered":"2024-09-10T07:34:21.662204+0000","last_clean":"2024-09-10T07:34:21.662204+0000","last_became_active":"2024-09-10T07:34:19.904996+0000","last_became_peered":"2024-09-10T07:34:19.904996+0000","last_unstale":"2024-09-10T07:34:21.662204+0000","last_undegraded":"2024-09-10T07:34:21.662204+0000","last_fullsized":"2024-09-10T07:34:21.662204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:02.976787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662067+0000","last_change":"2024-09-10T07:34:19.891107+0000","last_active":"2024-09-10T07:34:21.662067+0000","last_peered":"2024-09-10T07:34:21.662067+0000","last_clean":"2024-09-10T07:34:21.662067+0000","last_became_active":"2024-09-10T07:34:19.890867+0000","last_became_peered":"2024-09-10T07:34:19.890867+0000","last_unstale":"2024-09-10T07:34:21.662067+0000","last_undegraded":"2024-09-10T07:34:21.662067+0000","last_fullsized":"2024-09-10T07:34:21.662067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:38.421462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670678+0000","last_change":"2024-09-10T07:34:19.886282+0000","last_active":"2024-09-10T07:34:21.670678+0000","last_peered":"2024-09-10T07:34:21.670678+0000","last_clean":"2024-09-10T07:34:21.670678+0000","last_became_active":"2024-09-10T07:34:19.885882+0000","last_became_peered":"2024-09-10T07:34:19.885882+0000","last_unstale":"2024-09-10T07:34:21.670678+0000","last_undegraded":"2024-09-10T07:34:21.670678+0000","last_fullsized":"2024-09-10T07:34:21.670678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:43.173752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661181+0000","last_change":"2024-09-10T07:34:19.891694+0000","last_active":"2024-09-10T07:34:21.661181+0000","last_peered":"2024-09-10T07:34:21.661181+0000","last_clean":"2024-09-10T07:34:21.661181+0000","last_became_active":"2024-09-10T07:34:19.891459+0000","last_became_peered":"2024-09-10T07:34:19.891459+0000","last_unstale":"2024-09-10T07:34:21.661181+0000","last_undegraded":"2024-09-10T07:34:21.661181+0000","last_fullsized":"2024-09-10T07:34:21.661181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:16.090201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874232+0000","last_change":"2024-09-10T07:34:19.893542+0000","last_active":"2024-09-10T07:34:20.874232+0000","last_peered":"2024-09-10T07:34:20.874232+0000","last_clean":"2024-09-10T07:34:20.874232+0000","last_became_active":"2024-09-10T07:34:19.893322+0000","last_became_peered":"2024-09-10T07:34:19.893322+0000","last_unstale":"2024-09-10T07:34:20.874232+0000","last_undegraded":"2024-09-10T07:34:20.874232+0000","last_fullsized":"2024-09-10T07:34:20.874232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:22.545813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874654+0000","last_change":"2024-09-10T07:34:19.903722+0000","last_active":"2024-09-10T07:34:20.874654+0000","last_peered":"2024-09-10T07:34:20.874654+0000","last_clean":"2024-09-10T07:34:20.874654+0000","last_became_active":"2024-09-10T07:34:19.898533+0000","last_became_peered":"2024-09-10T07:34:19.898533+0000","last_unstale":"2024-09-10T07:34:20.874654+0000","last_undegraded":"2024-09-10T07:34:20.874654+0000","last_fullsized":"2024-09-10T07:34:20.874654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:05.242981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874283+0000","last_change":"2024-09-10T07:34:19.899921+0000","last_active":"2024-09-10T07:34:20.874283+0000","last_peered":"2024-09-10T07:34:20.874283+0000","last_clean":"2024-09-10T07:34:20.874283+0000","last_became_active":"2024-09-10T07:34:19.898724+0000","last_became_peered":"2024-09-10T07:34:19.898724+0000","last_unstale":"2024-09-10T07:34:20.874283+0000","last_undegraded":"2024-09-10T07:34:20.874283+0000","last_fullsized":"2024-09-10T07:34:20.874283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:41.761384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876568+0000","last_change":"2024-09-10T07:34:19.885766+0000","last_active":"2024-09-10T07:34:20.876568+0000","last_peered":"2024-09-10T07:34:20.876568+0000","last_clean":"2024-09-10T07:34:20.876568+0000","last_became_active":"2024-09-10T07:34:19.885527+0000","last_became_peered":"2024-09-10T07:34:19.885527+0000","last_unstale":"2024-09-10T07:34:20.876568+0000","last_undegraded":"2024-09-10T07:34:20.876568+0000","last_fullsized":"2024-09-10T07:34:20.876568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:00.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661947+0000","last_change":"2024-09-10T07:34:19.893683+0000","last_active":"2024-09-10T07:34:21.661947+0000","last_peered":"2024-09-10T07:34:21.661947+0000","last_clean":"2024-09-10T07:34:21.661947+0000","last_became_active":"2024-09-10T07:34:19.893434+0000","last_became_peered":"2024-09-10T07:34:19.893434+0000","last_unstale":"2024-09-10T07:34:21.661947+0000","last_undegraded":"2024-09-10T07:34:21.661947+0000","last_fullsized":"2024-09-10T07:34:21.661947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:51.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662731+0000","last_change":"2024-09-10T07:34:19.887710+0000","last_active":"2024-09-10T07:34:21.662731+0000","last_peered":"2024-09-10T07:34:21.662731+0000","last_clean":"2024-09-10T07:34:21.662731+0000","last_became_active":"2024-09-10T07:34:19.885828+0000","last_became_peered":"2024-09-10T07:34:19.885828+0000","last_unstale":"2024-09-10T07:34:21.662731+0000","last_undegraded":"2024-09-10T07:34:21.662731+0000","last_fullsized":"2024-09-10T07:34:21.662731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:04.667930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661631+0000","last_change":"2024-09-10T07:34:19.892283+0000","last_active":"2024-09-10T07:34:21.661631+0000","last_peered":"2024-09-10T07:34:21.661631+0000","last_clean":"2024-09-10T07:34:21.661631+0000","last_became_active":"2024-09-10T07:34:19.891053+0000","last_became_peered":"2024-09-10T07:34:19.891053+0000","last_unstale":"2024-09-10T07:34:21.661631+0000","last_undegraded":"2024-09-10T07:34:21.661631+0000","last_fullsized":"2024-09-10T07:34:21.661631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:29.348905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874600+0000","last_change":"2024-09-10T07:34:19.902111+0000","last_active":"2024-09-10T07:34:20.874600+0000","last_peered":"2024-09-10T07:34:20.874600+0000","last_clean":"2024-09-10T07:34:20.874600+0000","last_became_active":"2024-09-10T07:34:19.899428+0000","last_became_peered":"2024-09-10T07:34:19.899428+0000","last_unstale":"2024-09-10T07:34:20.874600+0000","last_undegraded":"2024-09-10T07:34:20.874600+0000","last_fullsized":"2024-09-10T07:34:20.874600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:20.251420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670807+0000","last_change":"2024-09-10T07:34:19.897707+0000","last_active":"2024-09-10T07:34:21.670807+0000","last_peered":"2024-09-10T07:34:21.670807+0000","last_clean":"2024-09-10T07:34:21.670807+0000","last_became_active":"2024-09-10T07:34:19.897224+0000","last_became_peered":"2024-09-10T07:34:19.897224+0000","last_unstale":"2024-09-10T07:34:21.670807+0000","last_undegraded":"2024-09-10T07:34:21.670807+0000","last_fullsized":"2024-09-10T07:34:21.670807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:55.118641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874389+0000","last_change":"2024-09-10T07:34:19.902882+0000","last_active":"2024-09-10T07:34:20.874389+0000","last_peered":"2024-09-10T07:34:20.874389+0000","last_clean":"2024-09-10T07:34:20.874389+0000","last_became_active":"2024-09-10T07:34:19.902613+0000","last_became_peered":"2024-09-10T07:34:19.902613+0000","last_unstale":"2024-09-10T07:34:20.874389+0000","last_undegraded":"2024-09-10T07:34:20.874389+0000","last_fullsized":"2024-09-10T07:34:20.874389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:32.482791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670154+0000","last_change":"2024-09-10T07:34:19.894790+0000","last_active":"2024-09-10T07:34:21.670154+0000","last_peered":"2024-09-10T07:34:21.670154+0000","last_clean":"2024-09-10T07:34:21.670154+0000","last_became_active":"2024-09-10T07:34:19.894561+0000","last_became_peered":"2024-09-10T07:34:19.894561+0000","last_unstale":"2024-09-10T07:34:21.670154+0000","last_undegraded":"2024-09-10T07:34:21.670154+0000","last_fullsized":"2024-09-10T07:34:21.670154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:03.238025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662344+0000","last_change":"2024-09-10T07:34:19.892319+0000","last_active":"2024-09-10T07:34:21.662344+0000","last_peered":"2024-09-10T07:34:21.662344+0000","last_clean":"2024-09-10T07:34:21.662344+0000","last_became_active":"2024-09-10T07:34:19.890032+0000","last_became_peered":"2024-09-10T07:34:19.890032+0000","last_unstale":"2024-09-10T07:34:21.662344+0000","last_undegraded":"2024-09-10T07:34:21.662344+0000","last_fullsized":"2024-09-10T07:34:21.662344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:11:11.464486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874146+0000","last_change":"2024-09-10T07:34:19.888281+0000","last_active":"2024-09-10T07:34:20.874146+0000","last_peered":"2024-09-10T07:34:20.874146+0000","last_clean":"2024-09-10T07:34:20.874146+0000","last_became_active":"2024-09-10T07:34:19.887727+0000","last_became_peered":"2024-09-10T07:34:19.887727+0000","last_unstale":"2024-09-10T07:34:20.874146+0000","last_undegraded":"2024-09-10T07:34:20.874146+0000","last_fullsized":"2024-09-10T07:34:20.874146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:55.524958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670292+0000","last_change":"2024-09-10T07:34:19.897389+0000","last_active":"2024-09-10T07:34:21.670292+0000","last_peered":"2024-09-10T07:34:21.670292+0000","last_clean":"2024-09-10T07:34:21.670292+0000","last_became_active":"2024-09-10T07:34:19.893934+0000","last_became_peered":"2024-09-10T07:34:19.893934+0000","last_unstale":"2024-09-10T07:34:21.670292+0000","last_undegraded":"2024-09-10T07:34:21.670292+0000","last_fullsized":"2024-09-10T07:34:21.670292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:41.808586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661356+0000","last_change":"2024-09-10T07:34:19.889846+0000","last_active":"2024-09-10T07:34:21.661356+0000","last_peered":"2024-09-10T07:34:21.661356+0000","last_clean":"2024-09-10T07:34:21.661356+0000","last_became_active":"2024-09-10T07:34:19.887187+0000","last_became_peered":"2024-09-10T07:34:19.887187+0000","last_unstale":"2024-09-10T07:34:21.661356+0000","last_undegraded":"2024-09-10T07:34:21.661356+0000","last_fullsized":"2024-09-10T07:34:21.661356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.175246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874425+0000","last_change":"2024-09-10T07:34:19.896912+0000","last_active":"2024-09-10T07:34:20.874425+0000","last_peered":"2024-09-10T07:34:20.874425+0000","last_clean":"2024-09-10T07:34:20.874425+0000","last_became_active":"2024-09-10T07:34:19.888502+0000","last_became_peered":"2024-09-10T07:34:19.888502+0000","last_unstale":"2024-09-10T07:34:20.874425+0000","last_undegraded":"2024-09-10T07:34:20.874425+0000","last_fullsized":"2024-09-10T07:34:20.874425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:44.356761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876566+0000","last_change":"2024-09-10T07:34:19.905306+0000","last_active":"2024-09-10T07:34:20.876566+0000","last_peered":"2024-09-10T07:34:20.876566+0000","last_clean":"2024-09-10T07:34:20.876566+0000","last_became_active":"2024-09-10T07:34:19.905152+0000","last_became_peered":"2024-09-10T07:34:19.905152+0000","last_unstale":"2024-09-10T07:34:20.876566+0000","last_undegraded":"2024-09-10T07:34:20.876566+0000","last_fullsized":"2024-09-10T07:34:20.876566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:21.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662983+0000","last_change":"2024-09-10T07:34:19.886696+0000","last_active":"2024-09-10T07:34:21.662983+0000","last_peered":"2024-09-10T07:34:21.662983+0000","last_clean":"2024-09-10T07:34:21.662983+0000","last_became_active":"2024-09-10T07:34:19.886407+0000","last_became_peered":"2024-09-10T07:34:19.886407+0000","last_unstale":"2024-09-10T07:34:21.662983+0000","last_undegraded":"2024-09-10T07:34:21.662983+0000","last_fullsized":"2024-09-10T07:34:21.662983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:24.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662493+0000","last_change":"2024-09-10T07:34:19.887443+0000","last_active":"2024-09-10T07:34:21.662493+0000","last_peered":"2024-09-10T07:34:21.662493+0000","last_clean":"2024-09-10T07:34:21.662493+0000","last_became_active":"2024-09-10T07:34:19.887205+0000","last_became_peered":"2024-09-10T07:34:19.887205+0000","last_unstale":"2024-09-10T07:34:21.662493+0000","last_undegraded":"2024-09-10T07:34:21.662493+0000","last_fullsized":"2024-09-10T07:34:21.662493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:12.040516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670544+0000","last_change":"2024-09-10T07:34:18.889171+0000","last_active":"2024-09-10T07:34:21.670544+0000","last_peered":"2024-09-10T07:34:21.670544+0000","last_clean":"2024-09-10T07:34:21.670544+0000","last_became_active":"2024-09-10T07:34:18.888923+0000","last_became_peered":"2024-09-10T07:34:18.888923+0000","last_unstale":"2024-09-10T07:34:21.670544+0000","last_undegraded":"2024-09-10T07:34:21.670544+0000","last_fullsized":"2024-09-10T07:34:21.670544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:20.349301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661390+0000","last_change":"2024-09-10T07:34:19.890336+0000","last_active":"2024-09-10T07:34:21.661390+0000","last_peered":"2024-09-10T07:34:21.661390+0000","last_clean":"2024-09-10T07:34:21.661390+0000","last_became_active":"2024-09-10T07:34:19.890049+0000","last_became_peered":"2024-09-10T07:34:19.890049+0000","last_unstale":"2024-09-10T07:34:21.661390+0000","last_undegraded":"2024-09-10T07:34:21.661390+0000","last_fullsized":"2024-09-10T07:34:21.661390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:48.240115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661973+0000","last_change":"2024-09-10T07:34:18.890244+0000","last_active":"2024-09-10T07:34:21.661973+0000","last_peered":"2024-09-10T07:34:21.661973+0000","last_clean":"2024-09-10T07:34:21.661973+0000","last_became_active":"2024-09-10T07:34:18.889613+0000","last_became_peered":"2024-09-10T07:34:18.889613+0000","last_unstale":"2024-09-10T07:34:21.661973+0000","last_undegraded":"2024-09-10T07:34:21.661973+0000","last_fullsized":"2024-09-10T07:34:21.661973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:11.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670521+0000","last_change":"2024-09-10T07:34:18.889534+0000","last_active":"2024-09-10T07:34:21.670521+0000","last_peered":"2024-09-10T07:34:21.670521+0000","last_clean":"2024-09-10T07:34:21.670521+0000","last_became_active":"2024-09-10T07:34:18.889242+0000","last_became_peered":"2024-09-10T07:34:18.889242+0000","last_unstale":"2024-09-10T07:34:21.670521+0000","last_undegraded":"2024-09-10T07:34:21.670521+0000","last_fullsized":"2024-09-10T07:34:21.670521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:18.829274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670327+0000","last_change":"2024-09-10T07:34:19.884510+0000","last_active":"2024-09-10T07:34:21.670327+0000","last_peered":"2024-09-10T07:34:21.670327+0000","last_clean":"2024-09-10T07:34:21.670327+0000","last_became_active":"2024-09-10T07:34:19.884235+0000","last_became_peered":"2024-09-10T07:34:19.884235+0000","last_unstale":"2024-09-10T07:34:21.670327+0000","last_undegraded":"2024-09-10T07:34:21.670327+0000","last_fullsized":"2024-09-10T07:34:21.670327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:31.685537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874642+0000","last_change":"2024-09-10T07:34:18.884543+0000","last_active":"2024-09-10T07:34:20.874642+0000","last_peered":"2024-09-10T07:34:20.874642+0000","last_clean":"2024-09-10T07:34:20.874642+0000","last_became_active":"2024-09-10T07:34:18.884298+0000","last_became_peered":"2024-09-10T07:34:18.884298+0000","last_unstale":"2024-09-10T07:34:20.874642+0000","last_undegraded":"2024-09-10T07:34:20.874642+0000","last_fullsized":"2024-09-10T07:34:20.874642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:11.804692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874177+0000","last_change":"2024-09-10T07:34:19.888708+0000","last_active":"2024-09-10T07:34:20.874177+0000","last_peered":"2024-09-10T07:34:20.874177+0000","last_clean":"2024-09-10T07:34:20.874177+0000","last_became_active":"2024-09-10T07:34:19.888434+0000","last_became_peered":"2024-09-10T07:34:19.888434+0000","last_unstale":"2024-09-10T07:34:20.874177+0000","last_undegraded":"2024-09-10T07:34:20.874177+0000","last_fullsized":"2024-09-10T07:34:20.874177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:41.986776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662474+0000","last_change":"2024-09-10T07:34:18.888024+0000","last_active":"2024-09-10T07:34:21.662474+0000","last_peered":"2024-09-10T07:34:21.662474+0000","last_clean":"2024-09-10T07:34:21.662474+0000","last_became_active":"2024-09-10T07:34:18.886888+0000","last_became_peered":"2024-09-10T07:34:18.886888+0000","last_unstale":"2024-09-10T07:34:21.662474+0000","last_undegraded":"2024-09-10T07:34:21.662474+0000","last_fullsized":"2024-09-10T07:34:21.662474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:27.884742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874439+0000","last_change":"2024-09-10T07:34:19.901075+0000","last_active":"2024-09-10T07:34:20.874439+0000","last_peered":"2024-09-10T07:34:20.874439+0000","last_clean":"2024-09-10T07:34:20.874439+0000","last_became_active":"2024-09-10T07:34:19.899090+0000","last_became_peered":"2024-09-10T07:34:19.899090+0000","last_unstale":"2024-09-10T07:34:20.874439+0000","last_undegraded":"2024-09-10T07:34:20.874439+0000","last_fullsized":"2024-09-10T07:34:20.874439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:12.703010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874850+0000","last_change":"2024-09-10T07:34:18.890112+0000","last_active":"2024-09-10T07:34:20.874850+0000","last_peered":"2024-09-10T07:34:20.874850+0000","last_clean":"2024-09-10T07:34:20.874850+0000","last_became_active":"2024-09-10T07:34:18.888701+0000","last_became_peered":"2024-09-10T07:34:18.888701+0000","last_unstale":"2024-09-10T07:34:20.874850+0000","last_undegraded":"2024-09-10T07:34:20.874850+0000","last_fullsized":"2024-09-10T07:34:20.874850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:36.214403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661712+0000","last_change":"2024-09-10T07:34:19.904217+0000","last_active":"2024-09-10T07:34:21.661712+0000","last_peered":"2024-09-10T07:34:21.661712+0000","last_clean":"2024-09-10T07:34:21.661712+0000","last_became_active":"2024-09-10T07:34:19.903931+0000","last_became_peered":"2024-09-10T07:34:19.903931+0000","last_unstale":"2024-09-10T07:34:21.661712+0000","last_undegraded":"2024-09-10T07:34:21.661712+0000","last_fullsized":"2024-09-10T07:34:21.661712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:15.824093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874133+0000","last_change":"2024-09-10T07:34:18.880938+0000","last_active":"2024-09-10T07:34:20.874133+0000","last_peered":"2024-09-10T07:34:20.874133+0000","last_clean":"2024-09-10T07:34:20.874133+0000","last_became_active":"2024-09-10T07:34:18.880624+0000","last_became_peered":"2024-09-10T07:34:18.880624+0000","last_unstale":"2024-09-10T07:34:20.874133+0000","last_undegraded":"2024-09-10T07:34:20.874133+0000","last_fullsized":"2024-09-10T07:34:20.874133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:54.148440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661856+0000","last_change":"2024-09-10T07:34:19.892359+0000","last_active":"2024-09-10T07:34:21.661856+0000","last_peered":"2024-09-10T07:34:21.661856+0000","last_clean":"2024-09-10T07:34:21.661856+0000","last_became_active":"2024-09-10T07:34:19.892071+0000","last_became_peered":"2024-09-10T07:34:19.892071+0000","last_unstale":"2024-09-10T07:34:21.661856+0000","last_undegraded":"2024-09-10T07:34:21.661856+0000","last_fullsized":"2024-09-10T07:34:21.661856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:35.384674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662593+0000","last_change":"2024-09-10T07:34:18.890452+0000","last_active":"2024-09-10T07:34:21.662593+0000","last_peered":"2024-09-10T07:34:21.662593+0000","last_clean":"2024-09-10T07:34:21.662593+0000","last_became_active":"2024-09-10T07:34:18.890105+0000","last_became_peered":"2024-09-10T07:34:18.890105+0000","last_unstale":"2024-09-10T07:34:21.662593+0000","last_undegraded":"2024-09-10T07:34:21.662593+0000","last_fullsized":"2024-09-10T07:34:21.662593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:38.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663586+0000","last_change":"2024-09-10T07:34:19.890697+0000","last_active":"2024-09-10T07:34:21.663586+0000","last_peered":"2024-09-10T07:34:21.663586+0000","last_clean":"2024-09-10T07:34:21.663586+0000","last_became_active":"2024-09-10T07:34:19.890402+0000","last_became_peered":"2024-09-10T07:34:19.890402+0000","last_unstale":"2024-09-10T07:34:21.663586+0000","last_undegraded":"2024-09-10T07:34:21.663586+0000","last_fullsized":"2024-09-10T07:34:21.663586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:53.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661353+0000","last_change":"2024-09-10T07:34:18.888006+0000","last_active":"2024-09-10T07:34:21.661353+0000","last_peered":"2024-09-10T07:34:21.661353+0000","last_clean":"2024-09-10T07:34:21.661353+0000","last_became_active":"2024-09-10T07:34:18.887741+0000","last_became_peered":"2024-09-10T07:34:18.887741+0000","last_unstale":"2024-09-10T07:34:21.661353+0000","last_undegraded":"2024-09-10T07:34:21.661353+0000","last_fullsized":"2024-09-10T07:34:21.661353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:54.559172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661790+0000","last_change":"2024-09-10T07:34:19.889260+0000","last_active":"2024-09-10T07:34:21.661790+0000","last_peered":"2024-09-10T07:34:21.661790+0000","last_clean":"2024-09-10T07:34:21.661790+0000","last_became_active":"2024-09-10T07:34:19.887143+0000","last_became_peered":"2024-09-10T07:34:19.887143+0000","last_unstale":"2024-09-10T07:34:21.661790+0000","last_undegraded":"2024-09-10T07:34:21.661790+0000","last_fullsized":"2024-09-10T07:34:21.661790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:16.774984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.875016+0000","last_change":"2024-09-10T07:34:18.882643+0000","last_active":"2024-09-10T07:34:20.875016+0000","last_peered":"2024-09-10T07:34:20.875016+0000","last_clean":"2024-09-10T07:34:20.875016+0000","last_became_active":"2024-09-10T07:34:18.880714+0000","last_became_peered":"2024-09-10T07:34:18.880714+0000","last_unstale":"2024-09-10T07:34:20.875016+0000","last_undegraded":"2024-09-10T07:34:20.875016+0000","last_fullsized":"2024-09-10T07:34:20.875016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:45.258127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662259+0000","last_change":"2024-09-10T07:34:19.896855+0000","last_active":"2024-09-10T07:34:21.662259+0000","last_peered":"2024-09-10T07:34:21.662259+0000","last_clean":"2024-09-10T07:34:21.662259+0000","last_became_active":"2024-09-10T07:34:19.896238+0000","last_became_peered":"2024-09-10T07:34:19.896238+0000","last_unstale":"2024-09-10T07:34:21.662259+0000","last_undegraded":"2024-09-10T07:34:21.662259+0000","last_fullsized":"2024-09-10T07:34:21.662259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:16.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663121+0000","last_change":"2024-09-10T07:34:18.888390+0000","last_active":"2024-09-10T07:34:21.663121+0000","last_peered":"2024-09-10T07:34:21.663121+0000","last_clean":"2024-09-10T07:34:21.663121+0000","last_became_active":"2024-09-10T07:34:18.888118+0000","last_became_peered":"2024-09-10T07:34:18.888118+0000","last_unstale":"2024-09-10T07:34:21.663121+0000","last_undegraded":"2024-09-10T07:34:21.663121+0000","last_fullsized":"2024-09-10T07:34:21.663121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:56.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661915+0000","last_change":"2024-09-10T07:34:19.883697+0000","last_active":"2024-09-10T07:34:21.661915+0000","last_peered":"2024-09-10T07:34:21.661915+0000","last_clean":"2024-09-10T07:34:21.661915+0000","last_became_active":"2024-09-10T07:34:19.883431+0000","last_became_peered":"2024-09-10T07:34:19.883431+0000","last_unstale":"2024-09-10T07:34:21.661915+0000","last_undegraded":"2024-09-10T07:34:21.661915+0000","last_fullsized":"2024-09-10T07:34:21.661915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:20.019093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876623+0000","last_change":"2024-09-10T07:34:18.883206+0000","last_active":"2024-09-10T07:34:20.876623+0000","last_peered":"2024-09-10T07:34:20.876623+0000","last_clean":"2024-09-10T07:34:20.876623+0000","last_became_active":"2024-09-10T07:34:18.882158+0000","last_became_peered":"2024-09-10T07:34:18.882158+0000","last_unstale":"2024-09-10T07:34:20.876623+0000","last_undegraded":"2024-09-10T07:34:20.876623+0000","last_fullsized":"2024-09-10T07:34:20.876623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663793+0000","last_change":"2024-09-10T07:34:19.894056+0000","last_active":"2024-09-10T07:34:21.663793+0000","last_peered":"2024-09-10T07:34:21.663793+0000","last_clean":"2024-09-10T07:34:21.663793+0000","last_became_active":"2024-09-10T07:34:19.892962+0000","last_became_peered":"2024-09-10T07:34:19.892962+0000","last_unstale":"2024-09-10T07:34:21.663793+0000","last_undegraded":"2024-09-10T07:34:21.663793+0000","last_fullsized":"2024-09-10T07:34:21.663793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:09.600142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661937+0000","last_change":"2024-09-10T07:34:18.874857+0000","last_active":"2024-09-10T07:34:21.661937+0000","last_peered":"2024-09-10T07:34:21.661937+0000","last_clean":"2024-09-10T07:34:21.661937+0000","last_became_active":"2024-09-10T07:34:18.874552+0000","last_became_peered":"2024-09-10T07:34:18.874552+0000","last_unstale":"2024-09-10T07:34:21.661937+0000","last_undegraded":"2024-09-10T07:34:21.661937+0000","last_fullsized":"2024-09-10T07:34:21.661937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:23.855683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662517+0000","last_change":"2024-09-10T07:34:19.897112+0000","last_active":"2024-09-10T07:34:21.662517+0000","last_peered":"2024-09-10T07:34:21.662517+0000","last_clean":"2024-09-10T07:34:21.662517+0000","last_became_active":"2024-09-10T07:34:19.896629+0000","last_became_peered":"2024-09-10T07:34:19.896629+0000","last_unstale":"2024-09-10T07:34:21.662517+0000","last_undegraded":"2024-09-10T07:34:21.662517+0000","last_fullsized":"2024-09-10T07:34:21.662517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:55.574984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876617+0000","last_change":"2024-09-10T07:34:18.881651+0000","last_active":"2024-09-10T07:34:20.876617+0000","last_peered":"2024-09-10T07:34:20.876617+0000","last_clean":"2024-09-10T07:34:20.876617+0000","last_became_active":"2024-09-10T07:34:18.880881+0000","last_became_peered":"2024-09-10T07:34:18.880881+0000","last_unstale":"2024-09-10T07:34:20.876617+0000","last_undegraded":"2024-09-10T07:34:20.876617+0000","last_fullsized":"2024-09-10T07:34:20.876617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:25.241480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661793+0000","last_change":"2024-09-10T07:34:19.897357+0000","last_active":"2024-09-10T07:34:21.661793+0000","last_peered":"2024-09-10T07:34:21.661793+0000","last_clean":"2024-09-10T07:34:21.661793+0000","last_became_active":"2024-09-10T07:34:19.896933+0000","last_became_peered":"2024-09-10T07:34:19.896933+0000","last_unstale":"2024-09-10T07:34:21.661793+0000","last_undegraded":"2024-09-10T07:34:21.661793+0000","last_fullsized":"2024-09-10T07:34:21.661793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:34.757810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874058+0000","last_change":"2024-09-10T07:34:18.889958+0000","last_active":"2024-09-10T07:34:20.874058+0000","last_peered":"2024-09-10T07:34:20.874058+0000","last_clean":"2024-09-10T07:34:20.874058+0000","last_became_active":"2024-09-10T07:34:18.889736+0000","last_became_peered":"2024-09-10T07:34:18.889736+0000","last_unstale":"2024-09-10T07:34:20.874058+0000","last_undegraded":"2024-09-10T07:34:20.874058+0000","last_fullsized":"2024-09-10T07:34:20.874058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:24.746910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874732+0000","last_change":"2024-09-10T07:34:19.897928+0000","last_active":"2024-09-10T07:34:20.874732+0000","last_peered":"2024-09-10T07:34:20.874732+0000","last_clean":"2024-09-10T07:34:20.874732+0000","last_became_active":"2024-09-10T07:34:19.896221+0000","last_became_peered":"2024-09-10T07:34:19.896221+0000","last_unstale":"2024-09-10T07:34:20.874732+0000","last_undegraded":"2024-09-10T07:34:20.874732+0000","last_fullsized":"2024-09-10T07:34:20.874732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:06.456252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876363+0000","last_change":"2024-09-10T07:34:18.877131+0000","last_active":"2024-09-10T07:34:20.876363+0000","last_peered":"2024-09-10T07:34:20.876363+0000","last_clean":"2024-09-10T07:34:20.876363+0000","last_became_active":"2024-09-10T07:34:18.876023+0000","last_became_peered":"2024-09-10T07:34:18.876023+0000","last_unstale":"2024-09-10T07:34:20.876363+0000","last_undegraded":"2024-09-10T07:34:20.876363+0000","last_fullsized":"2024-09-10T07:34:20.876363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:12:08.297705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663613+0000","last_change":"2024-09-10T07:34:19.905847+0000","last_active":"2024-09-10T07:34:21.663613+0000","last_peered":"2024-09-10T07:34:21.663613+0000","last_clean":"2024-09-10T07:34:21.663613+0000","last_became_active":"2024-09-10T07:34:19.905522+0000","last_became_peered":"2024-09-10T07:34:19.905522+0000","last_unstale":"2024-09-10T07:34:21.663613+0000","last_undegraded":"2024-09-10T07:34:21.663613+0000","last_fullsized":"2024-09-10T07:34:21.663613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:07.869122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663659+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:34:21.663659+0000","last_peered":"2024-09-10T07:34:21.663659+0000","last_clean":"2024-09-10T07:34:21.663659+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:34:21.663659+0000","last_undegraded":"2024-09-10T07:34:21.663659+0000","last_fullsized":"2024-09-10T07:34:21.663659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.875200+0000","last_change":"2024-09-10T07:34:18.881565+0000","last_active":"2024-09-10T07:34:20.875200+0000","last_peered":"2024-09-10T07:34:20.875200+0000","last_clean":"2024-09-10T07:34:20.875200+0000","last_became_active":"2024-09-10T07:34:18.879618+0000","last_became_peered":"2024-09-10T07:34:18.879618+0000","last_unstale":"2024-09-10T07:34:20.875200+0000","last_undegraded":"2024-09-10T07:34:20.875200+0000","last_fullsized":"2024-09-10T07:34:20.875200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:43.934312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670323+0000","last_change":"2024-09-10T07:34:19.899451+0000","last_active":"2024-09-10T07:34:21.670323+0000","last_peered":"2024-09-10T07:34:21.670323+0000","last_clean":"2024-09-10T07:34:21.670323+0000","last_became_active":"2024-09-10T07:34:19.899171+0000","last_became_peered":"2024-09-10T07:34:19.899171+0000","last_unstale":"2024-09-10T07:34:21.670323+0000","last_undegraded":"2024-09-10T07:34:21.670323+0000","last_fullsized":"2024-09-10T07:34:21.670323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:00.427217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663563+0000","last_change":"2024-09-10T07:34:18.886056+0000","last_active":"2024-09-10T07:34:21.663563+0000","last_peered":"2024-09-10T07:34:21.663563+0000","last_clean":"2024-09-10T07:34:21.663563+0000","last_became_active":"2024-09-10T07:34:18.884743+0000","last_became_peered":"2024-09-10T07:34:18.884743+0000","last_unstale":"2024-09-10T07:34:21.663563+0000","last_undegraded":"2024-09-10T07:34:21.663563+0000","last_fullsized":"2024-09-10T07:34:21.663563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:47.912136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661759+0000","last_change":"2024-09-10T07:34:19.890527+0000","last_active":"2024-09-10T07:34:21.661759+0000","last_peered":"2024-09-10T07:34:21.661759+0000","last_clean":"2024-09-10T07:34:21.661759+0000","last_became_active":"2024-09-10T07:34:19.888669+0000","last_became_peered":"2024-09-10T07:34:19.888669+0000","last_unstale":"2024-09-10T07:34:21.661759+0000","last_undegraded":"2024-09-10T07:34:21.661759+0000","last_fullsized":"2024-09-10T07:34:21.661759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:16.766074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876721+0000","last_change":"2024-09-10T07:34:18.880716+0000","last_active":"2024-09-10T07:34:20.876721+0000","last_peered":"2024-09-10T07:34:20.876721+0000","last_clean":"2024-09-10T07:34:20.876721+0000","last_became_active":"2024-09-10T07:34:18.880464+0000","last_became_peered":"2024-09-10T07:34:18.880464+0000","last_unstale":"2024-09-10T07:34:20.876721+0000","last_undegraded":"2024-09-10T07:34:20.876721+0000","last_fullsized":"2024-09-10T07:34:20.876721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:16.502080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874334+0000","last_change":"2024-09-10T07:34:19.886246+0000","last_active":"2024-09-10T07:34:20.874334+0000","last_peered":"2024-09-10T07:34:20.874334+0000","last_clean":"2024-09-10T07:34:20.874334+0000","last_became_active":"2024-09-10T07:34:19.886011+0000","last_became_peered":"2024-09-10T07:34:19.886011+0000","last_unstale":"2024-09-10T07:34:20.874334+0000","last_undegraded":"2024-09-10T07:34:20.874334+0000","last_fullsized":"2024-09-10T07:34:20.874334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:38.325753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874907+0000","last_change":"2024-09-10T07:34:18.884016+0000","last_active":"2024-09-10T07:34:20.874907+0000","last_peered":"2024-09-10T07:34:20.874907+0000","last_clean":"2024-09-10T07:34:20.874907+0000","last_became_active":"2024-09-10T07:34:18.883371+0000","last_became_peered":"2024-09-10T07:34:18.883371+0000","last_unstale":"2024-09-10T07:34:20.874907+0000","last_undegraded":"2024-09-10T07:34:20.874907+0000","last_fullsized":"2024-09-10T07:34:20.874907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:30.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662521+0000","last_change":"2024-09-10T07:34:19.886349+0000","last_active":"2024-09-10T07:34:21.662521+0000","last_peered":"2024-09-10T07:34:21.662521+0000","last_clean":"2024-09-10T07:34:21.662521+0000","last_became_active":"2024-09-10T07:34:19.886096+0000","last_became_peered":"2024-09-10T07:34:19.886096+0000","last_unstale":"2024-09-10T07:34:21.662521+0000","last_undegraded":"2024-09-10T07:34:21.662521+0000","last_fullsized":"2024-09-10T07:34:21.662521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:08.446221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874348+0000","last_change":"2024-09-10T07:34:18.881982+0000","last_active":"2024-09-10T07:34:20.874348+0000","last_peered":"2024-09-10T07:34:20.874348+0000","last_clean":"2024-09-10T07:34:20.874348+0000","last_became_active":"2024-09-10T07:34:18.881585+0000","last_became_peered":"2024-09-10T07:34:18.881585+0000","last_unstale":"2024-09-10T07:34:20.874348+0000","last_undegraded":"2024-09-10T07:34:20.874348+0000","last_fullsized":"2024-09-10T07:34:20.874348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:17.622849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874496+0000","last_change":"2024-09-10T07:34:19.901907+0000","last_active":"2024-09-10T07:34:20.874496+0000","last_peered":"2024-09-10T07:34:20.874496+0000","last_clean":"2024-09-10T07:34:20.874496+0000","last_became_active":"2024-09-10T07:34:19.889125+0000","last_became_peered":"2024-09-10T07:34:19.889125+0000","last_unstale":"2024-09-10T07:34:20.874496+0000","last_undegraded":"2024-09-10T07:34:20.874496+0000","last_fullsized":"2024-09-10T07:34:20.874496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:22.996650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662632+0000","last_change":"2024-09-10T07:34:18.886286+0000","last_active":"2024-09-10T07:34:21.662632+0000","last_peered":"2024-09-10T07:34:21.662632+0000","last_clean":"2024-09-10T07:34:21.662632+0000","last_became_active":"2024-09-10T07:34:18.885859+0000","last_became_peered":"2024-09-10T07:34:18.885859+0000","last_unstale":"2024-09-10T07:34:21.662632+0000","last_undegraded":"2024-09-10T07:34:21.662632+0000","last_fullsized":"2024-09-10T07:34:21.662632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:31.802025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874083+0000","last_change":"2024-09-10T07:34:19.892610+0000","last_active":"2024-09-10T07:34:20.874083+0000","last_peered":"2024-09-10T07:34:20.874083+0000","last_clean":"2024-09-10T07:34:20.874083+0000","last_became_active":"2024-09-10T07:34:19.892379+0000","last_became_peered":"2024-09-10T07:34:19.892379+0000","last_unstale":"2024-09-10T07:34:20.874083+0000","last_undegraded":"2024-09-10T07:34:20.874083+0000","last_fullsized":"2024-09-10T07:34:20.874083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:15.254184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874282+0000","last_change":"2024-09-10T07:34:18.888415+0000","last_active":"2024-09-10T07:34:20.874282+0000","last_peered":"2024-09-10T07:34:20.874282+0000","last_clean":"2024-09-10T07:34:20.874282+0000","last_became_active":"2024-09-10T07:34:18.888207+0000","last_became_peered":"2024-09-10T07:34:18.888207+0000","last_unstale":"2024-09-10T07:34:20.874282+0000","last_undegraded":"2024-09-10T07:34:20.874282+0000","last_fullsized":"2024-09-10T07:34:20.874282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:22.188010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670152+0000","last_change":"2024-09-10T07:34:19.889874+0000","last_active":"2024-09-10T07:34:21.670152+0000","last_peered":"2024-09-10T07:34:21.670152+0000","last_clean":"2024-09-10T07:34:21.670152+0000","last_became_active":"2024-09-10T07:34:19.889625+0000","last_became_peered":"2024-09-10T07:34:19.889625+0000","last_unstale":"2024-09-10T07:34:21.670152+0000","last_undegraded":"2024-09-10T07:34:21.670152+0000","last_fullsized":"2024-09-10T07:34:21.670152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:51.968652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663254+0000","last_change":"2024-09-10T07:34:18.887039+0000","last_active":"2024-09-10T07:34:21.663254+0000","last_peered":"2024-09-10T07:34:21.663254+0000","last_clean":"2024-09-10T07:34:21.663254+0000","last_became_active":"2024-09-10T07:34:18.886635+0000","last_became_peered":"2024-09-10T07:34:18.886635+0000","last_unstale":"2024-09-10T07:34:21.663254+0000","last_undegraded":"2024-09-10T07:34:21.663254+0000","last_fullsized":"2024-09-10T07:34:21.663254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:17.740947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661497+0000","last_change":"2024-09-10T07:34:19.890736+0000","last_active":"2024-09-10T07:34:21.661497+0000","last_peered":"2024-09-10T07:34:21.661497+0000","last_clean":"2024-09-10T07:34:21.661497+0000","last_became_active":"2024-09-10T07:34:19.890272+0000","last_became_peered":"2024-09-10T07:34:19.890272+0000","last_unstale":"2024-09-10T07:34:21.661497+0000","last_undegraded":"2024-09-10T07:34:21.661497+0000","last_fullsized":"2024-09-10T07:34:21.661497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:31.679112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.664026+0000","last_change":"2024-09-10T07:34:18.885652+0000","last_active":"2024-09-10T07:34:21.664026+0000","last_peered":"2024-09-10T07:34:21.664026+0000","last_clean":"2024-09-10T07:34:21.664026+0000","last_became_active":"2024-09-10T07:34:18.885417+0000","last_became_peered":"2024-09-10T07:34:18.885417+0000","last_unstale":"2024-09-10T07:34:21.664026+0000","last_undegraded":"2024-09-10T07:34:21.664026+0000","last_fullsized":"2024-09-10T07:34:21.664026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:01.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663356+0000","last_change":"2024-09-10T07:34:19.884641+0000","last_active":"2024-09-10T07:34:21.663356+0000","last_peered":"2024-09-10T07:34:21.663356+0000","last_clean":"2024-09-10T07:34:21.663356+0000","last_became_active":"2024-09-10T07:34:19.884423+0000","last_became_peered":"2024-09-10T07:34:19.884423+0000","last_unstale":"2024-09-10T07:34:21.663356+0000","last_undegraded":"2024-09-10T07:34:21.663356+0000","last_fullsized":"2024-09-10T07:34:21.663356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:26.638115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874278+0000","last_change":"2024-09-10T07:34:18.882863+0000","last_active":"2024-09-10T07:34:20.874278+0000","last_peered":"2024-09-10T07:34:20.874278+0000","last_clean":"2024-09-10T07:34:20.874278+0000","last_became_active":"2024-09-10T07:34:18.882249+0000","last_became_peered":"2024-09-10T07:34:18.882249+0000","last_unstale":"2024-09-10T07:34:20.874278+0000","last_undegraded":"2024-09-10T07:34:20.874278+0000","last_fullsized":"2024-09-10T07:34:20.874278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:35.318539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670150+0000","last_change":"2024-09-10T07:34:19.893265+0000","last_active":"2024-09-10T07:34:21.670150+0000","last_peered":"2024-09-10T07:34:21.670150+0000","last_clean":"2024-09-10T07:34:21.670150+0000","last_became_active":"2024-09-10T07:34:19.893020+0000","last_became_peered":"2024-09-10T07:34:19.893020+0000","last_unstale":"2024-09-10T07:34:21.670150+0000","last_undegraded":"2024-09-10T07:34:21.670150+0000","last_fullsized":"2024-09-10T07:34:21.670150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:52.734126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874384+0000","last_change":"2024-09-10T07:34:18.887226+0000","last_active":"2024-09-10T07:34:20.874384+0000","last_peered":"2024-09-10T07:34:20.874384+0000","last_clean":"2024-09-10T07:34:20.874384+0000","last_became_active":"2024-09-10T07:34:18.886984+0000","last_became_peered":"2024-09-10T07:34:18.886984+0000","last_unstale":"2024-09-10T07:34:20.874384+0000","last_undegraded":"2024-09-10T07:34:20.874384+0000","last_fullsized":"2024-09-10T07:34:20.874384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:36.473754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670462+0000","last_change":"2024-09-10T07:34:19.884817+0000","last_active":"2024-09-10T07:34:21.670462+0000","last_peered":"2024-09-10T07:34:21.670462+0000","last_clean":"2024-09-10T07:34:21.670462+0000","last_became_active":"2024-09-10T07:34:19.884124+0000","last_became_peered":"2024-09-10T07:34:19.884124+0000","last_unstale":"2024-09-10T07:34:21.670462+0000","last_undegraded":"2024-09-10T07:34:21.670462+0000","last_fullsized":"2024-09-10T07:34:21.670462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:24.641374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663662+0000","last_change":"2024-09-10T07:34:18.889841+0000","last_active":"2024-09-10T07:34:21.663662+0000","last_peered":"2024-09-10T07:34:21.663662+0000","last_clean":"2024-09-10T07:34:21.663662+0000","last_became_active":"2024-09-10T07:34:18.889570+0000","last_became_peered":"2024-09-10T07:34:18.889570+0000","last_unstale":"2024-09-10T07:34:21.663662+0000","last_undegraded":"2024-09-10T07:34:21.663662+0000","last_fullsized":"2024-09-10T07:34:21.663662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:47.841495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662534+0000","last_change":"2024-09-10T07:34:19.884838+0000","last_active":"2024-09-10T07:34:21.662534+0000","last_peered":"2024-09-10T07:34:21.662534+0000","last_clean":"2024-09-10T07:34:21.662534+0000","last_became_active":"2024-09-10T07:34:19.884573+0000","last_became_peered":"2024-09-10T07:34:19.884573+0000","last_unstale":"2024-09-10T07:34:21.662534+0000","last_undegraded":"2024-09-10T07:34:21.662534+0000","last_fullsized":"2024-09-10T07:34:21.662534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:02.551067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874582+0000","last_change":"2024-09-10T07:34:19.895850+0000","last_active":"2024-09-10T07:34:20.874582+0000","last_peered":"2024-09-10T07:34:20.874582+0000","last_clean":"2024-09-10T07:34:20.874582+0000","last_became_active":"2024-09-10T07:34:19.888211+0000","last_became_peered":"2024-09-10T07:34:19.888211+0000","last_unstale":"2024-09-10T07:34:20.874582+0000","last_undegraded":"2024-09-10T07:34:20.874582+0000","last_fullsized":"2024-09-10T07:34:20.874582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:06.898516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663878+0000","last_change":"2024-09-10T07:34:18.884883+0000","last_active":"2024-09-10T07:34:21.663878+0000","last_peered":"2024-09-10T07:34:21.663878+0000","last_clean":"2024-09-10T07:34:21.663878+0000","last_became_active":"2024-09-10T07:34:18.884636+0000","last_became_peered":"2024-09-10T07:34:18.884636+0000","last_unstale":"2024-09-10T07:34:21.663878+0000","last_undegraded":"2024-09-10T07:34:21.663878+0000","last_fullsized":"2024-09-10T07:34:21.663878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:12.480770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874965+0000","last_change":"2024-09-10T07:34:19.904494+0000","last_active":"2024-09-10T07:34:20.874965+0000","last_peered":"2024-09-10T07:34:20.874965+0000","last_clean":"2024-09-10T07:34:20.874965+0000","last_became_active":"2024-09-10T07:34:19.903127+0000","last_became_peered":"2024-09-10T07:34:19.903127+0000","last_unstale":"2024-09-10T07:34:20.874965+0000","last_undegraded":"2024-09-10T07:34:20.874965+0000","last_fullsized":"2024-09-10T07:34:20.874965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:57.196611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662754+0000","last_change":"2024-09-10T07:34:18.889220+0000","last_active":"2024-09-10T07:34:21.662754+0000","last_peered":"2024-09-10T07:34:21.662754+0000","last_clean":"2024-09-10T07:34:21.662754+0000","last_became_active":"2024-09-10T07:34:18.888214+0000","last_became_peered":"2024-09-10T07:34:18.888214+0000","last_unstale":"2024-09-10T07:34:21.662754+0000","last_undegraded":"2024-09-10T07:34:21.662754+0000","last_fullsized":"2024-09-10T07:34:21.662754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:48.684795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661677+0000","last_change":"2024-09-10T07:34:19.878000+0000","last_active":"2024-09-10T07:34:21.661677+0000","last_peered":"2024-09-10T07:34:21.661677+0000","last_clean":"2024-09-10T07:34:21.661677+0000","last_became_active":"2024-09-10T07:34:19.877411+0000","last_became_peered":"2024-09-10T07:34:19.877411+0000","last_unstale":"2024-09-10T07:34:21.661677+0000","last_undegraded":"2024-09-10T07:34:21.661677+0000","last_fullsized":"2024-09-10T07:34:21.661677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:12.088477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670408+0000","last_change":"2024-09-10T07:34:18.888882+0000","last_active":"2024-09-10T07:34:21.670408+0000","last_peered":"2024-09-10T07:34:21.670408+0000","last_clean":"2024-09-10T07:34:21.670408+0000","last_became_active":"2024-09-10T07:34:18.888507+0000","last_became_peered":"2024-09-10T07:34:18.888507+0000","last_unstale":"2024-09-10T07:34:21.670408+0000","last_undegraded":"2024-09-10T07:34:21.670408+0000","last_fullsized":"2024-09-10T07:34:21.670408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:18.761910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670172+0000","last_change":"2024-09-10T07:34:19.887622+0000","last_active":"2024-09-10T07:34:21.670172+0000","last_peered":"2024-09-10T07:34:21.670172+0000","last_clean":"2024-09-10T07:34:21.670172+0000","last_became_active":"2024-09-10T07:34:19.887211+0000","last_became_peered":"2024-09-10T07:34:19.887211+0000","last_unstale":"2024-09-10T07:34:21.670172+0000","last_undegraded":"2024-09-10T07:34:21.670172+0000","last_fullsized":"2024-09-10T07:34:21.670172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661793+0000","last_change":"2024-09-10T07:34:18.882907+0000","last_active":"2024-09-10T07:34:21.661793+0000","last_peered":"2024-09-10T07:34:21.661793+0000","last_clean":"2024-09-10T07:34:21.661793+0000","last_became_active":"2024-09-10T07:34:18.882653+0000","last_became_peered":"2024-09-10T07:34:18.882653+0000","last_unstale":"2024-09-10T07:34:21.661793+0000","last_undegraded":"2024-09-10T07:34:21.661793+0000","last_fullsized":"2024-09-10T07:34:21.661793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.380676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:34:28.701 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:34:28.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.866+0000 7fd835000640 1 Processor -- start 2024-09-10T07:34:28.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.866+0000 7fd835000640 1 -- start start 2024-09-10T07:34:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd835000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd83015e970 0x7fd8300d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd835000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd8300d2680 0x7fd8300cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd835000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8300d2bd0 con 0x7fd8300cfac0 2024-09-10T07:34:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd835000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd8300d37e0 con 0x7fd83015e970 2024-09-10T07:34:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd835000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd8300d2eb0 con 0x7fd8300d2680 2024-09-10T07:34:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd82f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd83015e970 0x7fd8300d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:28.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd82f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd83015e970 0x7fd8300d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34328/0 (socket says 172.21.15.99:34328) 2024-09-10T07:34:28.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd82f400640 1 -- 172.21.15.99:0/2494896080 learned_addr learned my addr 172.21.15.99:0/2494896080 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:28.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd826a00640 1 --2- 172.21.15.99:0/2494896080 >> v2:172.21.15.187:3300/0 conn(0x7fd8300d2680 0x7fd8300cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:28.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd82f400640 1 -- 172.21.15.99:0/2494896080 >> v2:172.21.15.187:3300/0 conn(0x7fd8300d2680 msgr2=0x7fd8300cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:28.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.867+0000 7fd82f400640 1 --2- 172.21.15.99:0/2494896080 >> v2:172.21.15.187:3300/0 conn(0x7fd8300d2680 0x7fd8300cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:28.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.868+0000 7fd82f400640 1 -- 172.21.15.99:0/2494896080 >> v1:172.21.15.187:6789/0 conn(0x7fd8300cfac0 legacy=0x7fd8300d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:28.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.868+0000 7fd82f400640 1 -- 172.21.15.99:0/2494896080 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8300d3190 con 0x7fd83015e970 2024-09-10T07:34:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.869+0000 7fd82f400640 1 --2- 172.21.15.99:0/2494896080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd83015e970 0x7fd8300d0300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd83009e530 tx=0x7fd82002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c047e0da5cf6181 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.869+0000 7fd82ea00640 1 -- 172.21.15.99:0/2494896080 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820037070 con 0x7fd83015e970 2024-09-10T07:34:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.869+0000 7fd82ea00640 1 -- 172.21.15.99:0/2494896080 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd82002ae50 con 0x7fd83015e970 2024-09-10T07:34:28.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.869+0000 7fd82ea00640 1 -- 172.21.15.99:0/2494896080 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820032860 con 0x7fd83015e970 2024-09-10T07:34:28.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.869+0000 7fd835000640 1 -- 172.21.15.99:0/2494896080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd83015e970 msgr2=0x7fd8300d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:28.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.869+0000 7fd835000640 1 --2- 172.21.15.99:0/2494896080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd83015e970 0x7fd8300d0300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd83009e530 tx=0x7fd82002a300 comp rx=0 tx=0).stop 2024-09-10T07:34:28.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.870+0000 7fd835000640 1 -- 172.21.15.99:0/2494896080 shutdown_connections 2024-09-10T07:34:28.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.870+0000 7fd835000640 1 --2- 172.21.15.99:0/2494896080 >> v2:172.21.15.187:3300/0 conn(0x7fd8300d2680 0x7fd8300cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:28.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.870+0000 7fd835000640 1 --2- 172.21.15.99:0/2494896080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd83015e970 0x7fd8300d0300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:28.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.870+0000 7fd835000640 1 -- 172.21.15.99:0/2494896080 >> 172.21.15.99:0/2494896080 conn(0x7fd83009de00 msgr2=0x7fd8300d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:28.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.870+0000 7fd835000640 1 -- 172.21.15.99:0/2494896080 shutdown_connections 2024-09-10T07:34:28.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.870+0000 7fd835000640 1 -- 172.21.15.99:0/2494896080 wait complete. 2024-09-10T07:34:28.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.871+0000 7fd835000640 1 Processor -- start 2024-09-10T07:34:28.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.871+0000 7fd835000640 1 -- start start 2024-09-10T07:34:28.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.872+0000 7fd835000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8300cfac0 0x7fd8300ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:28.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.872+0000 7fd835000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8300d2680 0x7fd830160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:28.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.872+0000 7fd835000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd83015e970 0x7fd830160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.872+0000 7fd835000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300d0840 con 0x7fd8300d2680 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.872+0000 7fd835000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300cff10 con 0x7fd8300cfac0 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.872+0000 7fd835000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd83015ed50 con 0x7fd83015e970 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.872+0000 7fd826a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8300d2680 0x7fd830160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.872+0000 7fd826a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8300d2680 0x7fd830160110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34342/0 (socket says 172.21.15.99:34342) 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.872+0000 7fd826a00640 1 -- 172.21.15.99:0/1751213165 learned_addr learned my addr 172.21.15.99:0/1751213165 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd82f400640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8300cfac0 0x7fd8300ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd82fe00640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd83015e970 0x7fd830160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd826a00640 1 -- 172.21.15.99:0/1751213165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd83015e970 msgr2=0x7fd830160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd826a00640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd83015e970 0x7fd830160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd826a00640 1 -- 172.21.15.99:0/1751213165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8300cfac0 msgr2=0x7fd8300ba1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd826a00640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8300cfac0 0x7fd8300ba1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd826a00640 1 -- 172.21.15.99:0/1751213165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8301f49b0 con 0x7fd8300d2680 2024-09-10T07:34:28.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd826a00640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8300d2680 0x7fd830160110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd81800d830 tx=0x7fd81800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:28.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd827e00640 1 -- 172.21.15.99:0/1751213165 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81800b6c0 con 0x7fd8300d2680 2024-09-10T07:34:28.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd827e00640 1 -- 172.21.15.99:0/1751213165 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd818019070 con 0x7fd8300d2680 2024-09-10T07:34:28.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.873+0000 7fd835000640 1 -- 172.21.15.99:0/1751213165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8301f4c90 con 0x7fd8300d2680 2024-09-10T07:34:28.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.874+0000 7fd827e00640 1 -- 172.21.15.99:0/1751213165 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81800ba80 con 0x7fd8300d2680 2024-09-10T07:34:28.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.874+0000 7fd835000640 1 -- 172.21.15.99:0/1751213165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8301f5250 con 0x7fd8300d2680 2024-09-10T07:34:28.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.875+0000 7fd835000640 1 -- 172.21.15.99:0/1751213165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8300cf580 con 0x7fd8300d2680 2024-09-10T07:34:28.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.876+0000 7fd827e00640 1 -- 172.21.15.99:0/1751213165 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd81801e460 con 0x7fd8300d2680 2024-09-10T07:34:28.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.876+0000 7fd827e00640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80c06be30 0x7fd80c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:28.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.876+0000 7fd827e00640 1 -- 172.21.15.99:0/1751213165 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd81808b550 con 0x7fd8300d2680 2024-09-10T07:34:28.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.877+0000 7fd82f400640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80c06be30 0x7fd80c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:28.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.877+0000 7fd82f400640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80c06be30 0x7fd80c06e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd820034000 tx=0x7fd82002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:28.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:28.881+0000 7fd827e00640 1 -- 172.21.15.99:0/1751213165 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd818059f00 con 0x7fd8300d2680 2024-09-10T07:34:29.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.053+0000 7fd835000640 1 -- 172.21.15.99:0/1751213165 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8300cb300 con 0x7fd80c06be30 2024-09-10T07:34:29.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.059+0000 7fd827e00640 1 -- 172.21.15.99:0/1751213165 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247484 (secure 0 0 0) 0x7fd82007e6d0 con 0x7fd80c06be30 2024-09-10T07:34:29.062 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:29.063 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:34:29.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 -- 172.21.15.99:0/1751213165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80c06be30 msgr2=0x7fd80c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80c06be30 0x7fd80c06e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd820034000 tx=0x7fd82002e000 comp rx=0 tx=0).stop 2024-09-10T07:34:29.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 -- 172.21.15.99:0/1751213165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8300d2680 msgr2=0x7fd830160110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8300d2680 0x7fd830160110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd81800d830 tx=0x7fd81800dcf0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 -- 172.21.15.99:0/1751213165 shutdown_connections 2024-09-10T07:34:29.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd83015e970 0x7fd830160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80c06be30 0x7fd80c06e2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8300d2680 0x7fd830160110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 --2- 172.21.15.99:0/1751213165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8300cfac0 0x7fd8300ba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 -- 172.21.15.99:0/1751213165 >> 172.21.15.99:0/1751213165 conn(0x7fd83009de00 msgr2=0x7fd8300c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:29.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 -- 172.21.15.99:0/1751213165 shutdown_connections 2024-09-10T07:34:29.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.063+0000 7fd835000640 1 -- 172.21.15.99:0/1751213165 wait complete. 2024-09-10T07:34:29.079 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-10T07:34:28.694215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.823186"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662085+0000","last_change":"2024-09-10T07:34:19.892617+0000","last_active":"2024-09-10T07:34:21.662085+0000","last_peered":"2024-09-10T07:34:21.662085+0000","last_clean":"2024-09-10T07:34:21.662085+0000","last_became_active":"2024-09-10T07:34:19.892309+0000","last_became_peered":"2024-09-10T07:34:19.892309+0000","last_unstale":"2024-09-10T07:34:21.662085+0000","last_undegraded":"2024-09-10T07:34:21.662085+0000","last_fullsized":"2024-09-10T07:34:21.662085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:08.745649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874030+0000","last_change":"2024-09-10T07:34:19.888537+0000","last_active":"2024-09-10T07:34:20.874030+0000","last_peered":"2024-09-10T07:34:20.874030+0000","last_clean":"2024-09-10T07:34:20.874030+0000","last_became_active":"2024-09-10T07:34:19.888035+0000","last_became_peered":"2024-09-10T07:34:19.888035+0000","last_unstale":"2024-09-10T07:34:20.874030+0000","last_undegraded":"2024-09-10T07:34:20.874030+0000","last_fullsized":"2024-09-10T07:34:20.874030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.614677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661256+0000","last_change":"2024-09-10T07:34:19.878583+0000","last_active":"2024-09-10T07:34:21.661256+0000","last_peered":"2024-09-10T07:34:21.661256+0000","last_clean":"2024-09-10T07:34:21.661256+0000","last_became_active":"2024-09-10T07:34:19.877749+0000","last_became_peered":"2024-09-10T07:34:19.877749+0000","last_unstale":"2024-09-10T07:34:21.661256+0000","last_undegraded":"2024-09-10T07:34:21.661256+0000","last_fullsized":"2024-09-10T07:34:21.661256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:05.290210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874227+0000","last_change":"2024-09-10T07:34:19.902236+0000","last_active":"2024-09-10T07:34:20.874227+0000","last_peered":"2024-09-10T07:34:20.874227+0000","last_clean":"2024-09-10T07:34:20.874227+0000","last_became_active":"2024-09-10T07:34:19.890752+0000","last_became_peered":"2024-09-10T07:34:19.890752+0000","last_unstale":"2024-09-10T07:34:20.874227+0000","last_undegraded":"2024-09-10T07:34:20.874227+0000","last_fullsized":"2024-09-10T07:34:20.874227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:05.551601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662087+0000","last_change":"2024-09-10T07:34:19.887506+0000","last_active":"2024-09-10T07:34:21.662087+0000","last_peered":"2024-09-10T07:34:21.662087+0000","last_clean":"2024-09-10T07:34:21.662087+0000","last_became_active":"2024-09-10T07:34:19.887222+0000","last_became_peered":"2024-09-10T07:34:19.887222+0000","last_unstale":"2024-09-10T07:34:21.662087+0000","last_undegraded":"2024-09-10T07:34:21.662087+0000","last_fullsized":"2024-09-10T07:34:21.662087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:23.722211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874811+0000","last_change":"2024-09-10T07:34:19.903919+0000","last_active":"2024-09-10T07:34:20.874811+0000","last_peered":"2024-09-10T07:34:20.874811+0000","last_clean":"2024-09-10T07:34:20.874811+0000","last_became_active":"2024-09-10T07:34:19.899806+0000","last_became_peered":"2024-09-10T07:34:19.899806+0000","last_unstale":"2024-09-10T07:34:20.874811+0000","last_undegraded":"2024-09-10T07:34:20.874811+0000","last_fullsized":"2024-09-10T07:34:20.874811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:25.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662215+0000","last_change":"2024-09-10T07:34:19.893722+0000","last_active":"2024-09-10T07:34:21.662215+0000","last_peered":"2024-09-10T07:34:21.662215+0000","last_clean":"2024-09-10T07:34:21.662215+0000","last_became_active":"2024-09-10T07:34:19.892593+0000","last_became_peered":"2024-09-10T07:34:19.892593+0000","last_unstale":"2024-09-10T07:34:21.662215+0000","last_undegraded":"2024-09-10T07:34:21.662215+0000","last_fullsized":"2024-09-10T07:34:21.662215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:59.649735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670073+0000","last_change":"2024-09-10T07:34:19.898847+0000","last_active":"2024-09-10T07:34:21.670073+0000","last_peered":"2024-09-10T07:34:21.670073+0000","last_clean":"2024-09-10T07:34:21.670073+0000","last_became_active":"2024-09-10T07:34:19.898631+0000","last_became_peered":"2024-09-10T07:34:19.898631+0000","last_unstale":"2024-09-10T07:34:21.670073+0000","last_undegraded":"2024-09-10T07:34:21.670073+0000","last_fullsized":"2024-09-10T07:34:21.670073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:44.898089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661639+0000","last_change":"2024-09-10T07:34:19.903205+0000","last_active":"2024-09-10T07:34:21.661639+0000","last_peered":"2024-09-10T07:34:21.661639+0000","last_clean":"2024-09-10T07:34:21.661639+0000","last_became_active":"2024-09-10T07:34:19.902878+0000","last_became_peered":"2024-09-10T07:34:19.902878+0000","last_unstale":"2024-09-10T07:34:21.661639+0000","last_undegraded":"2024-09-10T07:34:21.661639+0000","last_fullsized":"2024-09-10T07:34:21.661639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:52.348207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662586+0000","last_change":"2024-09-10T07:34:19.897459+0000","last_active":"2024-09-10T07:34:21.662586+0000","last_peered":"2024-09-10T07:34:21.662586+0000","last_clean":"2024-09-10T07:34:21.662586+0000","last_became_active":"2024-09-10T07:34:19.897101+0000","last_became_peered":"2024-09-10T07:34:19.897101+0000","last_unstale":"2024-09-10T07:34:21.662586+0000","last_undegraded":"2024-09-10T07:34:21.662586+0000","last_fullsized":"2024-09-10T07:34:21.662586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:26.495286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662204+0000","last_change":"2024-09-10T07:34:19.905217+0000","last_active":"2024-09-10T07:34:21.662204+0000","last_peered":"2024-09-10T07:34:21.662204+0000","last_clean":"2024-09-10T07:34:21.662204+0000","last_became_active":"2024-09-10T07:34:19.904996+0000","last_became_peered":"2024-09-10T07:34:19.904996+0000","last_unstale":"2024-09-10T07:34:21.662204+0000","last_undegraded":"2024-09-10T07:34:21.662204+0000","last_fullsized":"2024-09-10T07:34:21.662204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:02.976787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662067+0000","last_change":"2024-09-10T07:34:19.891107+0000","last_active":"2024-09-10T07:34:21.662067+0000","last_peered":"2024-09-10T07:34:21.662067+0000","last_clean":"2024-09-10T07:34:21.662067+0000","last_became_active":"2024-09-10T07:34:19.890867+0000","last_became_peered":"2024-09-10T07:34:19.890867+0000","last_unstale":"2024-09-10T07:34:21.662067+0000","last_undegraded":"2024-09-10T07:34:21.662067+0000","last_fullsized":"2024-09-10T07:34:21.662067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:38.421462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670678+0000","last_change":"2024-09-10T07:34:19.886282+0000","last_active":"2024-09-10T07:34:21.670678+0000","last_peered":"2024-09-10T07:34:21.670678+0000","last_clean":"2024-09-10T07:34:21.670678+0000","last_became_active":"2024-09-10T07:34:19.885882+0000","last_became_peered":"2024-09-10T07:34:19.885882+0000","last_unstale":"2024-09-10T07:34:21.670678+0000","last_undegraded":"2024-09-10T07:34:21.670678+0000","last_fullsized":"2024-09-10T07:34:21.670678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:43.173752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661181+0000","last_change":"2024-09-10T07:34:19.891694+0000","last_active":"2024-09-10T07:34:21.661181+0000","last_peered":"2024-09-10T07:34:21.661181+0000","last_clean":"2024-09-10T07:34:21.661181+0000","last_became_active":"2024-09-10T07:34:19.891459+0000","last_became_peered":"2024-09-10T07:34:19.891459+0000","last_unstale":"2024-09-10T07:34:21.661181+0000","last_undegraded":"2024-09-10T07:34:21.661181+0000","last_fullsized":"2024-09-10T07:34:21.661181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:16.090201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874232+0000","last_change":"2024-09-10T07:34:19.893542+0000","last_active":"2024-09-10T07:34:20.874232+0000","last_peered":"2024-09-10T07:34:20.874232+0000","last_clean":"2024-09-10T07:34:20.874232+0000","last_became_active":"2024-09-10T07:34:19.893322+0000","last_became_peered":"2024-09-10T07:34:19.893322+0000","last_unstale":"2024-09-10T07:34:20.874232+0000","last_undegraded":"2024-09-10T07:34:20.874232+0000","last_fullsized":"2024-09-10T07:34:20.874232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:22.545813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874654+0000","last_change":"2024-09-10T07:34:19.903722+0000","last_active":"2024-09-10T07:34:20.874654+0000","last_peered":"2024-09-10T07:34:20.874654+0000","last_clean":"2024-09-10T07:34:20.874654+0000","last_became_active":"2024-09-10T07:34:19.898533+0000","last_became_peered":"2024-09-10T07:34:19.898533+0000","last_unstale":"2024-09-10T07:34:20.874654+0000","last_undegraded":"2024-09-10T07:34:20.874654+0000","last_fullsized":"2024-09-10T07:34:20.874654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:05.242981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874283+0000","last_change":"2024-09-10T07:34:19.899921+0000","last_active":"2024-09-10T07:34:20.874283+0000","last_peered":"2024-09-10T07:34:20.874283+0000","last_clean":"2024-09-10T07:34:20.874283+0000","last_became_active":"2024-09-10T07:34:19.898724+0000","last_became_peered":"2024-09-10T07:34:19.898724+0000","last_unstale":"2024-09-10T07:34:20.874283+0000","last_undegraded":"2024-09-10T07:34:20.874283+0000","last_fullsized":"2024-09-10T07:34:20.874283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:41.761384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876568+0000","last_change":"2024-09-10T07:34:19.885766+0000","last_active":"2024-09-10T07:34:20.876568+0000","last_peered":"2024-09-10T07:34:20.876568+0000","last_clean":"2024-09-10T07:34:20.876568+0000","last_became_active":"2024-09-10T07:34:19.885527+0000","last_became_peered":"2024-09-10T07:34:19.885527+0000","last_unstale":"2024-09-10T07:34:20.876568+0000","last_undegraded":"2024-09-10T07:34:20.876568+0000","last_fullsized":"2024-09-10T07:34:20.876568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:00.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661947+0000","last_change":"2024-09-10T07:34:19.893683+0000","last_active":"2024-09-10T07:34:21.661947+0000","last_peered":"2024-09-10T07:34:21.661947+0000","last_clean":"2024-09-10T07:34:21.661947+0000","last_became_active":"2024-09-10T07:34:19.893434+0000","last_became_peered":"2024-09-10T07:34:19.893434+0000","last_unstale":"2024-09-10T07:34:21.661947+0000","last_undegraded":"2024-09-10T07:34:21.661947+0000","last_fullsized":"2024-09-10T07:34:21.661947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:51.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662731+0000","last_change":"2024-09-10T07:34:19.887710+0000","last_active":"2024-09-10T07:34:21.662731+0000","last_peered":"2024-09-10T07:34:21.662731+0000","last_clean":"2024-09-10T07:34:21.662731+0000","last_became_active":"2024-09-10T07:34:19.885828+0000","last_became_peered":"2024-09-10T07:34:19.885828+0000","last_unstale":"2024-09-10T07:34:21.662731+0000","last_undegraded":"2024-09-10T07:34:21.662731+0000","last_fullsized":"2024-09-10T07:34:21.662731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:04.667930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661631+0000","last_change":"2024-09-10T07:34:19.892283+0000","last_active":"2024-09-10T07:34:21.661631+0000","last_peered":"2024-09-10T07:34:21.661631+0000","last_clean":"2024-09-10T07:34:21.661631+0000","last_became_active":"2024-09-10T07:34:19.891053+0000","last_became_peered":"2024-09-10T07:34:19.891053+0000","last_unstale":"2024-09-10T07:34:21.661631+0000","last_undegraded":"2024-09-10T07:34:21.661631+0000","last_fullsized":"2024-09-10T07:34:21.661631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:29.348905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874600+0000","last_change":"2024-09-10T07:34:19.902111+0000","last_active":"2024-09-10T07:34:20.874600+0000","last_peered":"2024-09-10T07:34:20.874600+0000","last_clean":"2024-09-10T07:34:20.874600+0000","last_became_active":"2024-09-10T07:34:19.899428+0000","last_became_peered":"2024-09-10T07:34:19.899428+0000","last_unstale":"2024-09-10T07:34:20.874600+0000","last_undegraded":"2024-09-10T07:34:20.874600+0000","last_fullsized":"2024-09-10T07:34:20.874600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:20.251420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670807+0000","last_change":"2024-09-10T07:34:19.897707+0000","last_active":"2024-09-10T07:34:21.670807+0000","last_peered":"2024-09-10T07:34:21.670807+0000","last_clean":"2024-09-10T07:34:21.670807+0000","last_became_active":"2024-09-10T07:34:19.897224+0000","last_became_peered":"2024-09-10T07:34:19.897224+0000","last_unstale":"2024-09-10T07:34:21.670807+0000","last_undegraded":"2024-09-10T07:34:21.670807+0000","last_fullsized":"2024-09-10T07:34:21.670807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:55.118641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874389+0000","last_change":"2024-09-10T07:34:19.902882+0000","last_active":"2024-09-10T07:34:20.874389+0000","last_peered":"2024-09-10T07:34:20.874389+0000","last_clean":"2024-09-10T07:34:20.874389+0000","last_became_active":"2024-09-10T07:34:19.902613+0000","last_became_peered":"2024-09-10T07:34:19.902613+0000","last_unstale":"2024-09-10T07:34:20.874389+0000","last_undegraded":"2024-09-10T07:34:20.874389+0000","last_fullsized":"2024-09-10T07:34:20.874389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:32.482791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670154+0000","last_change":"2024-09-10T07:34:19.894790+0000","last_active":"2024-09-10T07:34:21.670154+0000","last_peered":"2024-09-10T07:34:21.670154+0000","last_clean":"2024-09-10T07:34:21.670154+0000","last_became_active":"2024-09-10T07:34:19.894561+0000","last_became_peered":"2024-09-10T07:34:19.894561+0000","last_unstale":"2024-09-10T07:34:21.670154+0000","last_undegraded":"2024-09-10T07:34:21.670154+0000","last_fullsized":"2024-09-10T07:34:21.670154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:03.238025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662344+0000","last_change":"2024-09-10T07:34:19.892319+0000","last_active":"2024-09-10T07:34:21.662344+0000","last_peered":"2024-09-10T07:34:21.662344+0000","last_clean":"2024-09-10T07:34:21.662344+0000","last_became_active":"2024-09-10T07:34:19.890032+0000","last_became_peered":"2024-09-10T07:34:19.890032+0000","last_unstale":"2024-09-10T07:34:21.662344+0000","last_undegraded":"2024-09-10T07:34:21.662344+0000","last_fullsized":"2024-09-10T07:34:21.662344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:11:11.464486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874146+0000","last_change":"2024-09-10T07:34:19.888281+0000","last_active":"2024-09-10T07:34:20.874146+0000","last_peered":"2024-09-10T07:34:20.874146+0000","last_clean":"2024-09-10T07:34:20.874146+0000","last_became_active":"2024-09-10T07:34:19.887727+0000","last_became_peered":"2024-09-10T07:34:19.887727+0000","last_unstale":"2024-09-10T07:34:20.874146+0000","last_undegraded":"2024-09-10T07:34:20.874146+0000","last_fullsized":"2024-09-10T07:34:20.874146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:55.524958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670292+0000","last_change":"2024-09-10T07:34:19.897389+0000","last_active":"2024-09-10T07:34:21.670292+0000","last_peered":"2024-09-10T07:34:21.670292+0000","last_clean":"2024-09-10T07:34:21.670292+0000","last_became_active":"2024-09-10T07:34:19.893934+0000","last_became_peered":"2024-09-10T07:34:19.893934+0000","last_unstale":"2024-09-10T07:34:21.670292+0000","last_undegraded":"2024-09-10T07:34:21.670292+0000","last_fullsized":"2024-09-10T07:34:21.670292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:41.808586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661356+0000","last_change":"2024-09-10T07:34:19.889846+0000","last_active":"2024-09-10T07:34:21.661356+0000","last_peered":"2024-09-10T07:34:21.661356+0000","last_clean":"2024-09-10T07:34:21.661356+0000","last_became_active":"2024-09-10T07:34:19.887187+0000","last_became_peered":"2024-09-10T07:34:19.887187+0000","last_unstale":"2024-09-10T07:34:21.661356+0000","last_undegraded":"2024-09-10T07:34:21.661356+0000","last_fullsized":"2024-09-10T07:34:21.661356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.175246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874425+0000","last_change":"2024-09-10T07:34:19.896912+0000","last_active":"2024-09-10T07:34:20.874425+0000","last_peered":"2024-09-10T07:34:20.874425+0000","last_clean":"2024-09-10T07:34:20.874425+0000","last_became_active":"2024-09-10T07:34:19.888502+0000","last_became_peered":"2024-09-10T07:34:19.888502+0000","last_unstale":"2024-09-10T07:34:20.874425+0000","last_undegraded":"2024-09-10T07:34:20.874425+0000","last_fullsized":"2024-09-10T07:34:20.874425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:44.356761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876566+0000","last_change":"2024-09-10T07:34:19.905306+0000","last_active":"2024-09-10T07:34:20.876566+0000","last_peered":"2024-09-10T07:34:20.876566+0000","last_clean":"2024-09-10T07:34:20.876566+0000","last_became_active":"2024-09-10T07:34:19.905152+0000","last_became_peered":"2024-09-10T07:34:19.905152+0000","last_unstale":"2024-09-10T07:34:20.876566+0000","last_undegraded":"2024-09-10T07:34:20.876566+0000","last_fullsized":"2024-09-10T07:34:20.876566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:21.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662983+0000","last_change":"2024-09-10T07:34:19.886696+0000","last_active":"2024-09-10T07:34:21.662983+0000","last_peered":"2024-09-10T07:34:21.662983+0000","last_clean":"2024-09-10T07:34:21.662983+0000","last_became_active":"2024-09-10T07:34:19.886407+0000","last_became_peered":"2024-09-10T07:34:19.886407+0000","last_unstale":"2024-09-10T07:34:21.662983+0000","last_undegraded":"2024-09-10T07:34:21.662983+0000","last_fullsized":"2024-09-10T07:34:21.662983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:24.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662493+0000","last_change":"2024-09-10T07:34:19.887443+0000","last_active":"2024-09-10T07:34:21.662493+0000","last_peered":"2024-09-10T07:34:21.662493+0000","last_clean":"2024-09-10T07:34:21.662493+0000","last_became_active":"2024-09-10T07:34:19.887205+0000","last_became_peered":"2024-09-10T07:34:19.887205+0000","last_unstale":"2024-09-10T07:34:21.662493+0000","last_undegraded":"2024-09-10T07:34:21.662493+0000","last_fullsized":"2024-09-10T07:34:21.662493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:12.040516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670544+0000","last_change":"2024-09-10T07:34:18.889171+0000","last_active":"2024-09-10T07:34:21.670544+0000","last_peered":"2024-09-10T07:34:21.670544+0000","last_clean":"2024-09-10T07:34:21.670544+0000","last_became_active":"2024-09-10T07:34:18.888923+0000","last_became_peered":"2024-09-10T07:34:18.888923+0000","last_unstale":"2024-09-10T07:34:21.670544+0000","last_undegraded":"2024-09-10T07:34:21.670544+0000","last_fullsized":"2024-09-10T07:34:21.670544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:20.349301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661390+0000","last_change":"2024-09-10T07:34:19.890336+0000","last_active":"2024-09-10T07:34:21.661390+0000","last_peered":"2024-09-10T07:34:21.661390+0000","last_clean":"2024-09-10T07:34:21.661390+0000","last_became_active":"2024-09-10T07:34:19.890049+0000","last_became_peered":"2024-09-10T07:34:19.890049+0000","last_unstale":"2024-09-10T07:34:21.661390+0000","last_undegraded":"2024-09-10T07:34:21.661390+0000","last_fullsized":"2024-09-10T07:34:21.661390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:48.240115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661973+0000","last_change":"2024-09-10T07:34:18.890244+0000","last_active":"2024-09-10T07:34:21.661973+0000","last_peered":"2024-09-10T07:34:21.661973+0000","last_clean":"2024-09-10T07:34:21.661973+0000","last_became_active":"2024-09-10T07:34:18.889613+0000","last_became_peered":"2024-09-10T07:34:18.889613+0000","last_unstale":"2024-09-10T07:34:21.661973+0000","last_undegraded":"2024-09-10T07:34:21.661973+0000","last_fullsized":"2024-09-10T07:34:21.661973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:11.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670521+0000","last_change":"2024-09-10T07:34:18.889534+0000","last_active":"2024-09-10T07:34:21.670521+0000","last_peered":"2024-09-10T07:34:21.670521+0000","last_clean":"2024-09-10T07:34:21.670521+0000","last_became_active":"2024-09-10T07:34:18.889242+0000","last_became_peered":"2024-09-10T07:34:18.889242+0000","last_unstale":"2024-09-10T07:34:21.670521+0000","last_undegraded":"2024-09-10T07:34:21.670521+0000","last_fullsized":"2024-09-10T07:34:21.670521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:18.829274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670327+0000","last_change":"2024-09-10T07:34:19.884510+0000","last_active":"2024-09-10T07:34:21.670327+0000","last_peered":"2024-09-10T07:34:21.670327+0000","last_clean":"2024-09-10T07:34:21.670327+0000","last_became_active":"2024-09-10T07:34:19.884235+0000","last_became_peered":"2024-09-10T07:34:19.884235+0000","last_unstale":"2024-09-10T07:34:21.670327+0000","last_undegraded":"2024-09-10T07:34:21.670327+0000","last_fullsized":"2024-09-10T07:34:21.670327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:31.685537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874642+0000","last_change":"2024-09-10T07:34:18.884543+0000","last_active":"2024-09-10T07:34:20.874642+0000","last_peered":"2024-09-10T07:34:20.874642+0000","last_clean":"2024-09-10T07:34:20.874642+0000","last_became_active":"2024-09-10T07:34:18.884298+0000","last_became_peered":"2024-09-10T07:34:18.884298+0000","last_unstale":"2024-09-10T07:34:20.874642+0000","last_undegraded":"2024-09-10T07:34:20.874642+0000","last_fullsized":"2024-09-10T07:34:20.874642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:11.804692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874177+0000","last_change":"2024-09-10T07:34:19.888708+0000","last_active":"2024-09-10T07:34:20.874177+0000","last_peered":"2024-09-10T07:34:20.874177+0000","last_clean":"2024-09-10T07:34:20.874177+0000","last_became_active":"2024-09-10T07:34:19.888434+0000","last_became_peered":"2024-09-10T07:34:19.888434+0000","last_unstale":"2024-09-10T07:34:20.874177+0000","last_undegraded":"2024-09-10T07:34:20.874177+0000","last_fullsized":"2024-09-10T07:34:20.874177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:41.986776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662474+0000","last_change":"2024-09-10T07:34:18.888024+0000","last_active":"2024-09-10T07:34:21.662474+0000","last_peered":"2024-09-10T07:34:21.662474+0000","last_clean":"2024-09-10T07:34:21.662474+0000","last_became_active":"2024-09-10T07:34:18.886888+0000","last_became_peered":"2024-09-10T07:34:18.886888+0000","last_unstale":"2024-09-10T07:34:21.662474+0000","last_undegraded":"2024-09-10T07:34:21.662474+0000","last_fullsized":"2024-09-10T07:34:21.662474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:27.884742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874439+0000","last_change":"2024-09-10T07:34:19.901075+0000","last_active":"2024-09-10T07:34:20.874439+0000","last_peered":"2024-09-10T07:34:20.874439+0000","last_clean":"2024-09-10T07:34:20.874439+0000","last_became_active":"2024-09-10T07:34:19.899090+0000","last_became_peered":"2024-09-10T07:34:19.899090+0000","last_unstale":"2024-09-10T07:34:20.874439+0000","last_undegraded":"2024-09-10T07:34:20.874439+0000","last_fullsized":"2024-09-10T07:34:20.874439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:12.703010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874850+0000","last_change":"2024-09-10T07:34:18.890112+0000","last_active":"2024-09-10T07:34:20.874850+0000","last_peered":"2024-09-10T07:34:20.874850+0000","last_clean":"2024-09-10T07:34:20.874850+0000","last_became_active":"2024-09-10T07:34:18.888701+0000","last_became_peered":"2024-09-10T07:34:18.888701+0000","last_unstale":"2024-09-10T07:34:20.874850+0000","last_undegraded":"2024-09-10T07:34:20.874850+0000","last_fullsized":"2024-09-10T07:34:20.874850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:36.214403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661712+0000","last_change":"2024-09-10T07:34:19.904217+0000","last_active":"2024-09-10T07:34:21.661712+0000","last_peered":"2024-09-10T07:34:21.661712+0000","last_clean":"2024-09-10T07:34:21.661712+0000","last_became_active":"2024-09-10T07:34:19.903931+0000","last_became_peered":"2024-09-10T07:34:19.903931+0000","last_unstale":"2024-09-10T07:34:21.661712+0000","last_undegraded":"2024-09-10T07:34:21.661712+0000","last_fullsized":"2024-09-10T07:34:21.661712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:15.824093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874133+0000","last_change":"2024-09-10T07:34:18.880938+0000","last_active":"2024-09-10T07:34:20.874133+0000","last_peered":"2024-09-10T07:34:20.874133+0000","last_clean":"2024-09-10T07:34:20.874133+0000","last_became_active":"2024-09-10T07:34:18.880624+0000","last_became_peered":"2024-09-10T07:34:18.880624+0000","last_unstale":"2024-09-10T07:34:20.874133+0000","last_undegraded":"2024-09-10T07:34:20.874133+0000","last_fullsized":"2024-09-10T07:34:20.874133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:54.148440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661856+0000","last_change":"2024-09-10T07:34:19.892359+0000","last_active":"2024-09-10T07:34:21.661856+0000","last_peered":"2024-09-10T07:34:21.661856+0000","last_clean":"2024-09-10T07:34:21.661856+0000","last_became_active":"2024-09-10T07:34:19.892071+0000","last_became_peered":"2024-09-10T07:34:19.892071+0000","last_unstale":"2024-09-10T07:34:21.661856+0000","last_undegraded":"2024-09-10T07:34:21.661856+0000","last_fullsized":"2024-09-10T07:34:21.661856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:35.384674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662593+0000","last_change":"2024-09-10T07:34:18.890452+0000","last_active":"2024-09-10T07:34:21.662593+0000","last_peered":"2024-09-10T07:34:21.662593+0000","last_clean":"2024-09-10T07:34:21.662593+0000","last_became_active":"2024-09-10T07:34:18.890105+0000","last_became_peered":"2024-09-10T07:34:18.890105+0000","last_unstale":"2024-09-10T07:34:21.662593+0000","last_undegraded":"2024-09-10T07:34:21.662593+0000","last_fullsized":"2024-09-10T07:34:21.662593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:38.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663586+0000","last_change":"2024-09-10T07:34:19.890697+0000","last_active":"2024-09-10T07:34:21.663586+0000","last_peered":"2024-09-10T07:34:21.663586+0000","last_clean":"2024-09-10T07:34:21.663586+0000","last_became_active":"2024-09-10T07:34:19.890402+0000","last_became_peered":"2024-09-10T07:34:19.890402+0000","last_unstale":"2024-09-10T07:34:21.663586+0000","last_undegraded":"2024-09-10T07:34:21.663586+0000","last_fullsized":"2024-09-10T07:34:21.663586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:53.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661353+0000","last_change":"2024-09-10T07:34:18.888006+0000","last_active":"2024-09-10T07:34:21.661353+0000","last_peered":"2024-09-10T07:34:21.661353+0000","last_clean":"2024-09-10T07:34:21.661353+0000","last_became_active":"2024-09-10T07:34:18.887741+0000","last_became_peered":"2024-09-10T07:34:18.887741+0000","last_unstale":"2024-09-10T07:34:21.661353+0000","last_undegraded":"2024-09-10T07:34:21.661353+0000","last_fullsized":"2024-09-10T07:34:21.661353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:54.559172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661790+0000","last_change":"2024-09-10T07:34:19.889260+0000","last_active":"2024-09-10T07:34:21.661790+0000","last_peered":"2024-09-10T07:34:21.661790+0000","last_clean":"2024-09-10T07:34:21.661790+0000","last_became_active":"2024-09-10T07:34:19.887143+0000","last_became_peered":"2024-09-10T07:34:19.887143+0000","last_unstale":"2024-09-10T07:34:21.661790+0000","last_undegraded":"2024-09-10T07:34:21.661790+0000","last_fullsized":"2024-09-10T07:34:21.661790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:16.774984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.875016+0000","last_change":"2024-09-10T07:34:18.882643+0000","last_active":"2024-09-10T07:34:20.875016+0000","last_peered":"2024-09-10T07:34:20.875016+0000","last_clean":"2024-09-10T07:34:20.875016+0000","last_became_active":"2024-09-10T07:34:18.880714+0000","last_became_peered":"2024-09-10T07:34:18.880714+0000","last_unstale":"2024-09-10T07:34:20.875016+0000","last_undegraded":"2024-09-10T07:34:20.875016+0000","last_fullsized":"2024-09-10T07:34:20.875016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:45.258127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662259+0000","last_change":"2024-09-10T07:34:19.896855+0000","last_active":"2024-09-10T07:34:21.662259+0000","last_peered":"2024-09-10T07:34:21.662259+0000","last_clean":"2024-09-10T07:34:21.662259+0000","last_became_active":"2024-09-10T07:34:19.896238+0000","last_became_peered":"2024-09-10T07:34:19.896238+0000","last_unstale":"2024-09-10T07:34:21.662259+0000","last_undegraded":"2024-09-10T07:34:21.662259+0000","last_fullsized":"2024-09-10T07:34:21.662259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:16.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663121+0000","last_change":"2024-09-10T07:34:18.888390+0000","last_active":"2024-09-10T07:34:21.663121+0000","last_peered":"2024-09-10T07:34:21.663121+0000","last_clean":"2024-09-10T07:34:21.663121+0000","last_became_active":"2024-09-10T07:34:18.888118+0000","last_became_peered":"2024-09-10T07:34:18.888118+0000","last_unstale":"2024-09-10T07:34:21.663121+0000","last_undegraded":"2024-09-10T07:34:21.663121+0000","last_fullsized":"2024-09-10T07:34:21.663121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:56.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661915+0000","last_change":"2024-09-10T07:34:19.883697+0000","last_active":"2024-09-10T07:34:21.661915+0000","last_peered":"2024-09-10T07:34:21.661915+0000","last_clean":"2024-09-10T07:34:21.661915+0000","last_became_active":"2024-09-10T07:34:19.883431+0000","last_became_peered":"2024-09-10T07:34:19.883431+0000","last_unstale":"2024-09-10T07:34:21.661915+0000","last_undegraded":"2024-09-10T07:34:21.661915+0000","last_fullsized":"2024-09-10T07:34:21.661915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:20.019093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876623+0000","last_change":"2024-09-10T07:34:18.883206+0000","last_active":"2024-09-10T07:34:20.876623+0000","last_peered":"2024-09-10T07:34:20.876623+0000","last_clean":"2024-09-10T07:34:20.876623+0000","last_became_active":"2024-09-10T07:34:18.882158+0000","last_became_peered":"2024-09-10T07:34:18.882158+0000","last_unstale":"2024-09-10T07:34:20.876623+0000","last_undegraded":"2024-09-10T07:34:20.876623+0000","last_fullsized":"2024-09-10T07:34:20.876623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663793+0000","last_change":"2024-09-10T07:34:19.894056+0000","last_active":"2024-09-10T07:34:21.663793+0000","last_peered":"2024-09-10T07:34:21.663793+0000","last_clean":"2024-09-10T07:34:21.663793+0000","last_became_active":"2024-09-10T07:34:19.892962+0000","last_became_peered":"2024-09-10T07:34:19.892962+0000","last_unstale":"2024-09-10T07:34:21.663793+0000","last_undegraded":"2024-09-10T07:34:21.663793+0000","last_fullsized":"2024-09-10T07:34:21.663793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:09.600142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661937+0000","last_change":"2024-09-10T07:34:18.874857+0000","last_active":"2024-09-10T07:34:21.661937+0000","last_peered":"2024-09-10T07:34:21.661937+0000","last_clean":"2024-09-10T07:34:21.661937+0000","last_became_active":"2024-09-10T07:34:18.874552+0000","last_became_peered":"2024-09-10T07:34:18.874552+0000","last_unstale":"2024-09-10T07:34:21.661937+0000","last_undegraded":"2024-09-10T07:34:21.661937+0000","last_fullsized":"2024-09-10T07:34:21.661937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:23.855683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662517+0000","last_change":"2024-09-10T07:34:19.897112+0000","last_active":"2024-09-10T07:34:21.662517+0000","last_peered":"2024-09-10T07:34:21.662517+0000","last_clean":"2024-09-10T07:34:21.662517+0000","last_became_active":"2024-09-10T07:34:19.896629+0000","last_became_peered":"2024-09-10T07:34:19.896629+0000","last_unstale":"2024-09-10T07:34:21.662517+0000","last_undegraded":"2024-09-10T07:34:21.662517+0000","last_fullsized":"2024-09-10T07:34:21.662517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:55.574984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876617+0000","last_change":"2024-09-10T07:34:18.881651+0000","last_active":"2024-09-10T07:34:20.876617+0000","last_peered":"2024-09-10T07:34:20.876617+0000","last_clean":"2024-09-10T07:34:20.876617+0000","last_became_active":"2024-09-10T07:34:18.880881+0000","last_became_peered":"2024-09-10T07:34:18.880881+0000","last_unstale":"2024-09-10T07:34:20.876617+0000","last_undegraded":"2024-09-10T07:34:20.876617+0000","last_fullsized":"2024-09-10T07:34:20.876617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:25.241480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661793+0000","last_change":"2024-09-10T07:34:19.897357+0000","last_active":"2024-09-10T07:34:21.661793+0000","last_peered":"2024-09-10T07:34:21.661793+0000","last_clean":"2024-09-10T07:34:21.661793+0000","last_became_active":"2024-09-10T07:34:19.896933+0000","last_became_peered":"2024-09-10T07:34:19.896933+0000","last_unstale":"2024-09-10T07:34:21.661793+0000","last_undegraded":"2024-09-10T07:34:21.661793+0000","last_fullsized":"2024-09-10T07:34:21.661793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:34.757810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874058+0000","last_change":"2024-09-10T07:34:18.889958+0000","last_active":"2024-09-10T07:34:20.874058+0000","last_peered":"2024-09-10T07:34:20.874058+0000","last_clean":"2024-09-10T07:34:20.874058+0000","last_became_active":"2024-09-10T07:34:18.889736+0000","last_became_peered":"2024-09-10T07:34:18.889736+0000","last_unstale":"2024-09-10T07:34:20.874058+0000","last_undegraded":"2024-09-10T07:34:20.874058+0000","last_fullsized":"2024-09-10T07:34:20.874058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:24.746910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874732+0000","last_change":"2024-09-10T07:34:19.897928+0000","last_active":"2024-09-10T07:34:20.874732+0000","last_peered":"2024-09-10T07:34:20.874732+0000","last_clean":"2024-09-10T07:34:20.874732+0000","last_became_active":"2024-09-10T07:34:19.896221+0000","last_became_peered":"2024-09-10T07:34:19.896221+0000","last_unstale":"2024-09-10T07:34:20.874732+0000","last_undegraded":"2024-09-10T07:34:20.874732+0000","last_fullsized":"2024-09-10T07:34:20.874732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:06.456252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876363+0000","last_change":"2024-09-10T07:34:18.877131+0000","last_active":"2024-09-10T07:34:20.876363+0000","last_peered":"2024-09-10T07:34:20.876363+0000","last_clean":"2024-09-10T07:34:20.876363+0000","last_became_active":"2024-09-10T07:34:18.876023+0000","last_became_peered":"2024-09-10T07:34:18.876023+0000","last_unstale":"2024-09-10T07:34:20.876363+0000","last_undegraded":"2024-09-10T07:34:20.876363+0000","last_fullsized":"2024-09-10T07:34:20.876363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:12:08.297705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663613+0000","last_change":"2024-09-10T07:34:19.905847+0000","last_active":"2024-09-10T07:34:21.663613+0000","last_peered":"2024-09-10T07:34:21.663613+0000","last_clean":"2024-09-10T07:34:21.663613+0000","last_became_active":"2024-09-10T07:34:19.905522+0000","last_became_peered":"2024-09-10T07:34:19.905522+0000","last_unstale":"2024-09-10T07:34:21.663613+0000","last_undegraded":"2024-09-10T07:34:21.663613+0000","last_fullsized":"2024-09-10T07:34:21.663613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:07.869122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663659+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:34:21.663659+0000","last_peered":"2024-09-10T07:34:21.663659+0000","last_clean":"2024-09-10T07:34:21.663659+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:34:21.663659+0000","last_undegraded":"2024-09-10T07:34:21.663659+0000","last_fullsized":"2024-09-10T07:34:21.663659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.875200+0000","last_change":"2024-09-10T07:34:18.881565+0000","last_active":"2024-09-10T07:34:20.875200+0000","last_peered":"2024-09-10T07:34:20.875200+0000","last_clean":"2024-09-10T07:34:20.875200+0000","last_became_active":"2024-09-10T07:34:18.879618+0000","last_became_peered":"2024-09-10T07:34:18.879618+0000","last_unstale":"2024-09-10T07:34:20.875200+0000","last_undegraded":"2024-09-10T07:34:20.875200+0000","last_fullsized":"2024-09-10T07:34:20.875200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:43.934312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670323+0000","last_change":"2024-09-10T07:34:19.899451+0000","last_active":"2024-09-10T07:34:21.670323+0000","last_peered":"2024-09-10T07:34:21.670323+0000","last_clean":"2024-09-10T07:34:21.670323+0000","last_became_active":"2024-09-10T07:34:19.899171+0000","last_became_peered":"2024-09-10T07:34:19.899171+0000","last_unstale":"2024-09-10T07:34:21.670323+0000","last_undegraded":"2024-09-10T07:34:21.670323+0000","last_fullsized":"2024-09-10T07:34:21.670323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:00.427217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663563+0000","last_change":"2024-09-10T07:34:18.886056+0000","last_active":"2024-09-10T07:34:21.663563+0000","last_peered":"2024-09-10T07:34:21.663563+0000","last_clean":"2024-09-10T07:34:21.663563+0000","last_became_active":"2024-09-10T07:34:18.884743+0000","last_became_peered":"2024-09-10T07:34:18.884743+0000","last_unstale":"2024-09-10T07:34:21.663563+0000","last_undegraded":"2024-09-10T07:34:21.663563+0000","last_fullsized":"2024-09-10T07:34:21.663563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:47.912136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661759+0000","last_change":"2024-09-10T07:34:19.890527+0000","last_active":"2024-09-10T07:34:21.661759+0000","last_peered":"2024-09-10T07:34:21.661759+0000","last_clean":"2024-09-10T07:34:21.661759+0000","last_became_active":"2024-09-10T07:34:19.888669+0000","last_became_peered":"2024-09-10T07:34:19.888669+0000","last_unstale":"2024-09-10T07:34:21.661759+0000","last_undegraded":"2024-09-10T07:34:21.661759+0000","last_fullsized":"2024-09-10T07:34:21.661759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:16.766074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876721+0000","last_change":"2024-09-10T07:34:18.880716+0000","last_active":"2024-09-10T07:34:20.876721+0000","last_peered":"2024-09-10T07:34:20.876721+0000","last_clean":"2024-09-10T07:34:20.876721+0000","last_became_active":"2024-09-10T07:34:18.880464+0000","last_became_peered":"2024-09-10T07:34:18.880464+0000","last_unstale":"2024-09-10T07:34:20.876721+0000","last_undegraded":"2024-09-10T07:34:20.876721+0000","last_fullsized":"2024-09-10T07:34:20.876721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:16.502080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874334+0000","last_change":"2024-09-10T07:34:19.886246+0000","last_active":"2024-09-10T07:34:20.874334+0000","last_peered":"2024-09-10T07:34:20.874334+0000","last_clean":"2024-09-10T07:34:20.874334+0000","last_became_active":"2024-09-10T07:34:19.886011+0000","last_became_peered":"2024-09-10T07:34:19.886011+0000","last_unstale":"2024-09-10T07:34:20.874334+0000","last_undegraded":"2024-09-10T07:34:20.874334+0000","last_fullsized":"2024-09-10T07:34:20.874334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:38.325753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874907+0000","last_change":"2024-09-10T07:34:18.884016+0000","last_active":"2024-09-10T07:34:20.874907+0000","last_peered":"2024-09-10T07:34:20.874907+0000","last_clean":"2024-09-10T07:34:20.874907+0000","last_became_active":"2024-09-10T07:34:18.883371+0000","last_became_peered":"2024-09-10T07:34:18.883371+0000","last_unstale":"2024-09-10T07:34:20.874907+0000","last_undegraded":"2024-09-10T07:34:20.874907+0000","last_fullsized":"2024-09-10T07:34:20.874907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:30.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662521+0000","last_change":"2024-09-10T07:34:19.886349+0000","last_active":"2024-09-10T07:34:21.662521+0000","last_peered":"2024-09-10T07:34:21.662521+0000","last_clean":"2024-09-10T07:34:21.662521+0000","last_became_active":"2024-09-10T07:34:19.886096+0000","last_became_peered":"2024-09-10T07:34:19.886096+0000","last_unstale":"2024-09-10T07:34:21.662521+0000","last_undegraded":"2024-09-10T07:34:21.662521+0000","last_fullsized":"2024-09-10T07:34:21.662521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:08.446221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874348+0000","last_change":"2024-09-10T07:34:18.881982+0000","last_active":"2024-09-10T07:34:20.874348+0000","last_peered":"2024-09-10T07:34:20.874348+0000","last_clean":"2024-09-10T07:34:20.874348+0000","last_became_active":"2024-09-10T07:34:18.881585+0000","last_became_peered":"2024-09-10T07:34:18.881585+0000","last_unstale":"2024-09-10T07:34:20.874348+0000","last_undegraded":"2024-09-10T07:34:20.874348+0000","last_fullsized":"2024-09-10T07:34:20.874348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:17.622849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874496+0000","last_change":"2024-09-10T07:34:19.901907+0000","last_active":"2024-09-10T07:34:20.874496+0000","last_peered":"2024-09-10T07:34:20.874496+0000","last_clean":"2024-09-10T07:34:20.874496+0000","last_became_active":"2024-09-10T07:34:19.889125+0000","last_became_peered":"2024-09-10T07:34:19.889125+0000","last_unstale":"2024-09-10T07:34:20.874496+0000","last_undegraded":"2024-09-10T07:34:20.874496+0000","last_fullsized":"2024-09-10T07:34:20.874496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:22.996650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662632+0000","last_change":"2024-09-10T07:34:18.886286+0000","last_active":"2024-09-10T07:34:21.662632+0000","last_peered":"2024-09-10T07:34:21.662632+0000","last_clean":"2024-09-10T07:34:21.662632+0000","last_became_active":"2024-09-10T07:34:18.885859+0000","last_became_peered":"2024-09-10T07:34:18.885859+0000","last_unstale":"2024-09-10T07:34:21.662632+0000","last_undegraded":"2024-09-10T07:34:21.662632+0000","last_fullsized":"2024-09-10T07:34:21.662632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:31.802025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874083+0000","last_change":"2024-09-10T07:34:19.892610+0000","last_active":"2024-09-10T07:34:20.874083+0000","last_peered":"2024-09-10T07:34:20.874083+0000","last_clean":"2024-09-10T07:34:20.874083+0000","last_became_active":"2024-09-10T07:34:19.892379+0000","last_became_peered":"2024-09-10T07:34:19.892379+0000","last_unstale":"2024-09-10T07:34:20.874083+0000","last_undegraded":"2024-09-10T07:34:20.874083+0000","last_fullsized":"2024-09-10T07:34:20.874083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:15.254184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874282+0000","last_change":"2024-09-10T07:34:18.888415+0000","last_active":"2024-09-10T07:34:20.874282+0000","last_peered":"2024-09-10T07:34:20.874282+0000","last_clean":"2024-09-10T07:34:20.874282+0000","last_became_active":"2024-09-10T07:34:18.888207+0000","last_became_peered":"2024-09-10T07:34:18.888207+0000","last_unstale":"2024-09-10T07:34:20.874282+0000","last_undegraded":"2024-09-10T07:34:20.874282+0000","last_fullsized":"2024-09-10T07:34:20.874282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:22.188010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670152+0000","last_change":"2024-09-10T07:34:19.889874+0000","last_active":"2024-09-10T07:34:21.670152+0000","last_peered":"2024-09-10T07:34:21.670152+0000","last_clean":"2024-09-10T07:34:21.670152+0000","last_became_active":"2024-09-10T07:34:19.889625+0000","last_became_peered":"2024-09-10T07:34:19.889625+0000","last_unstale":"2024-09-10T07:34:21.670152+0000","last_undegraded":"2024-09-10T07:34:21.670152+0000","last_fullsized":"2024-09-10T07:34:21.670152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:51.968652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663254+0000","last_change":"2024-09-10T07:34:18.887039+0000","last_active":"2024-09-10T07:34:21.663254+0000","last_peered":"2024-09-10T07:34:21.663254+0000","last_clean":"2024-09-10T07:34:21.663254+0000","last_became_active":"2024-09-10T07:34:18.886635+0000","last_became_peered":"2024-09-10T07:34:18.886635+0000","last_unstale":"2024-09-10T07:34:21.663254+0000","last_undegraded":"2024-09-10T07:34:21.663254+0000","last_fullsized":"2024-09-10T07:34:21.663254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:17.740947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661497+0000","last_change":"2024-09-10T07:34:19.890736+0000","last_active":"2024-09-10T07:34:21.661497+0000","last_peered":"2024-09-10T07:34:21.661497+0000","last_clean":"2024-09-10T07:34:21.661497+0000","last_became_active":"2024-09-10T07:34:19.890272+0000","last_became_peered":"2024-09-10T07:34:19.890272+0000","last_unstale":"2024-09-10T07:34:21.661497+0000","last_undegraded":"2024-09-10T07:34:21.661497+0000","last_fullsized":"2024-09-10T07:34:21.661497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:31.679112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.664026+0000","last_change":"2024-09-10T07:34:18.885652+0000","last_active":"2024-09-10T07:34:21.664026+0000","last_peered":"2024-09-10T07:34:21.664026+0000","last_clean":"2024-09-10T07:34:21.664026+0000","last_became_active":"2024-09-10T07:34:18.885417+0000","last_became_peered":"2024-09-10T07:34:18.885417+0000","last_unstale":"2024-09-10T07:34:21.664026+0000","last_undegraded":"2024-09-10T07:34:21.664026+0000","last_fullsized":"2024-09-10T07:34:21.664026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:01.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663356+0000","last_change":"2024-09-10T07:34:19.884641+0000","last_active":"2024-09-10T07:34:21.663356+0000","last_peered":"2024-09-10T07:34:21.663356+0000","last_clean":"2024-09-10T07:34:21.663356+0000","last_became_active":"2024-09-10T07:34:19.884423+0000","last_became_peered":"2024-09-10T07:34:19.884423+0000","last_unstale":"2024-09-10T07:34:21.663356+0000","last_undegraded":"2024-09-10T07:34:21.663356+0000","last_fullsized":"2024-09-10T07:34:21.663356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:26.638115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874278+0000","last_change":"2024-09-10T07:34:18.882863+0000","last_active":"2024-09-10T07:34:20.874278+0000","last_peered":"2024-09-10T07:34:20.874278+0000","last_clean":"2024-09-10T07:34:20.874278+0000","last_became_active":"2024-09-10T07:34:18.882249+0000","last_became_peered":"2024-09-10T07:34:18.882249+0000","last_unstale":"2024-09-10T07:34:20.874278+0000","last_undegraded":"2024-09-10T07:34:20.874278+0000","last_fullsized":"2024-09-10T07:34:20.874278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:35.318539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670150+0000","last_change":"2024-09-10T07:34:19.893265+0000","last_active":"2024-09-10T07:34:21.670150+0000","last_peered":"2024-09-10T07:34:21.670150+0000","last_clean":"2024-09-10T07:34:21.670150+0000","last_became_active":"2024-09-10T07:34:19.893020+0000","last_became_peered":"2024-09-10T07:34:19.893020+0000","last_unstale":"2024-09-10T07:34:21.670150+0000","last_undegraded":"2024-09-10T07:34:21.670150+0000","last_fullsized":"2024-09-10T07:34:21.670150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:52.734126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874384+0000","last_change":"2024-09-10T07:34:18.887226+0000","last_active":"2024-09-10T07:34:20.874384+0000","last_peered":"2024-09-10T07:34:20.874384+0000","last_clean":"2024-09-10T07:34:20.874384+0000","last_became_active":"2024-09-10T07:34:18.886984+0000","last_became_peered":"2024-09-10T07:34:18.886984+0000","last_unstale":"2024-09-10T07:34:20.874384+0000","last_undegraded":"2024-09-10T07:34:20.874384+0000","last_fullsized":"2024-09-10T07:34:20.874384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:36.473754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670462+0000","last_change":"2024-09-10T07:34:19.884817+0000","last_active":"2024-09-10T07:34:21.670462+0000","last_peered":"2024-09-10T07:34:21.670462+0000","last_clean":"2024-09-10T07:34:21.670462+0000","last_became_active":"2024-09-10T07:34:19.884124+0000","last_became_peered":"2024-09-10T07:34:19.884124+0000","last_unstale":"2024-09-10T07:34:21.670462+0000","last_undegraded":"2024-09-10T07:34:21.670462+0000","last_fullsized":"2024-09-10T07:34:21.670462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:24.641374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663662+0000","last_change":"2024-09-10T07:34:18.889841+0000","last_active":"2024-09-10T07:34:21.663662+0000","last_peered":"2024-09-10T07:34:21.663662+0000","last_clean":"2024-09-10T07:34:21.663662+0000","last_became_active":"2024-09-10T07:34:18.889570+0000","last_became_peered":"2024-09-10T07:34:18.889570+0000","last_unstale":"2024-09-10T07:34:21.663662+0000","last_undegraded":"2024-09-10T07:34:21.663662+0000","last_fullsized":"2024-09-10T07:34:21.663662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:47.841495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662534+0000","last_change":"2024-09-10T07:34:19.884838+0000","last_active":"2024-09-10T07:34:21.662534+0000","last_peered":"2024-09-10T07:34:21.662534+0000","last_clean":"2024-09-10T07:34:21.662534+0000","last_became_active":"2024-09-10T07:34:19.884573+0000","last_became_peered":"2024-09-10T07:34:19.884573+0000","last_unstale":"2024-09-10T07:34:21.662534+0000","last_undegraded":"2024-09-10T07:34:21.662534+0000","last_fullsized":"2024-09-10T07:34:21.662534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:02.551067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874582+0000","last_change":"2024-09-10T07:34:19.895850+0000","last_active":"2024-09-10T07:34:20.874582+0000","last_peered":"2024-09-10T07:34:20.874582+0000","last_clean":"2024-09-10T07:34:20.874582+0000","last_became_active":"2024-09-10T07:34:19.888211+0000","last_became_peered":"2024-09-10T07:34:19.888211+0000","last_unstale":"2024-09-10T07:34:20.874582+0000","last_undegraded":"2024-09-10T07:34:20.874582+0000","last_fullsized":"2024-09-10T07:34:20.874582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:06.898516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663878+0000","last_change":"2024-09-10T07:34:18.884883+0000","last_active":"2024-09-10T07:34:21.663878+0000","last_peered":"2024-09-10T07:34:21.663878+0000","last_clean":"2024-09-10T07:34:21.663878+0000","last_became_active":"2024-09-10T07:34:18.884636+0000","last_became_peered":"2024-09-10T07:34:18.884636+0000","last_unstale":"2024-09-10T07:34:21.663878+0000","last_undegraded":"2024-09-10T07:34:21.663878+0000","last_fullsized":"2024-09-10T07:34:21.663878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:12.480770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874965+0000","last_change":"2024-09-10T07:34:19.904494+0000","last_active":"2024-09-10T07:34:20.874965+0000","last_peered":"2024-09-10T07:34:20.874965+0000","last_clean":"2024-09-10T07:34:20.874965+0000","last_became_active":"2024-09-10T07:34:19.903127+0000","last_became_peered":"2024-09-10T07:34:19.903127+0000","last_unstale":"2024-09-10T07:34:20.874965+0000","last_undegraded":"2024-09-10T07:34:20.874965+0000","last_fullsized":"2024-09-10T07:34:20.874965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:57.196611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662754+0000","last_change":"2024-09-10T07:34:18.889220+0000","last_active":"2024-09-10T07:34:21.662754+0000","last_peered":"2024-09-10T07:34:21.662754+0000","last_clean":"2024-09-10T07:34:21.662754+0000","last_became_active":"2024-09-10T07:34:18.888214+0000","last_became_peered":"2024-09-10T07:34:18.888214+0000","last_unstale":"2024-09-10T07:34:21.662754+0000","last_undegraded":"2024-09-10T07:34:21.662754+0000","last_fullsized":"2024-09-10T07:34:21.662754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:48.684795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661677+0000","last_change":"2024-09-10T07:34:19.878000+0000","last_active":"2024-09-10T07:34:21.661677+0000","last_peered":"2024-09-10T07:34:21.661677+0000","last_clean":"2024-09-10T07:34:21.661677+0000","last_became_active":"2024-09-10T07:34:19.877411+0000","last_became_peered":"2024-09-10T07:34:19.877411+0000","last_unstale":"2024-09-10T07:34:21.661677+0000","last_undegraded":"2024-09-10T07:34:21.661677+0000","last_fullsized":"2024-09-10T07:34:21.661677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:12.088477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670408+0000","last_change":"2024-09-10T07:34:18.888882+0000","last_active":"2024-09-10T07:34:21.670408+0000","last_peered":"2024-09-10T07:34:21.670408+0000","last_clean":"2024-09-10T07:34:21.670408+0000","last_became_active":"2024-09-10T07:34:18.888507+0000","last_became_peered":"2024-09-10T07:34:18.888507+0000","last_unstale":"2024-09-10T07:34:21.670408+0000","last_undegraded":"2024-09-10T07:34:21.670408+0000","last_fullsized":"2024-09-10T07:34:21.670408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:18.761910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670172+0000","last_change":"2024-09-10T07:34:19.887622+0000","last_active":"2024-09-10T07:34:21.670172+0000","last_peered":"2024-09-10T07:34:21.670172+0000","last_clean":"2024-09-10T07:34:21.670172+0000","last_became_active":"2024-09-10T07:34:19.887211+0000","last_became_peered":"2024-09-10T07:34:19.887211+0000","last_unstale":"2024-09-10T07:34:21.670172+0000","last_undegraded":"2024-09-10T07:34:21.670172+0000","last_fullsized":"2024-09-10T07:34:21.670172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661793+0000","last_change":"2024-09-10T07:34:18.882907+0000","last_active":"2024-09-10T07:34:21.661793+0000","last_peered":"2024-09-10T07:34:21.661793+0000","last_clean":"2024-09-10T07:34:21.661793+0000","last_became_active":"2024-09-10T07:34:18.882653+0000","last_became_peered":"2024-09-10T07:34:18.882653+0000","last_unstale":"2024-09-10T07:34:21.661793+0000","last_undegraded":"2024-09-10T07:34:21.661793+0000","last_fullsized":"2024-09-10T07:34:21.661793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.380676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:34:29.083 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:34:29.083 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T07:34:29.083 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T07:34:29.083 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T07:34:29.084 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T07:34:29.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.275+0000 7fabe2200640 1 Processor -- start 2024-09-10T07:34:29.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.275+0000 7fabe2200640 1 -- start start 2024-09-10T07:34:29.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.276+0000 7fabe2200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc15ef50 0x7fabdc0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.276+0000 7fabe2200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabdc0b7a90 con 0x7fabdc0d3240 2024-09-10T07:34:29.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.276+0000 7fabe2200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabdc0d3740 con 0x7fabdc0b9510 2024-09-10T07:34:29.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.276+0000 7fabe2200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc0d3a20 con 0x7fabdc15ef50 2024-09-10T07:34:29.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.276+0000 7fabdaa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fabdc0d3240 0x7fabdc0cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51876/0 (socket says 172.21.15.99:51876) 2024-09-10T07:34:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.276+0000 7fabdaa00640 1 -- 172.21.15.99:0/1815772692 learned_addr learned my addr 172.21.15.99:0/1815772692 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.277+0000 7fabdb400640 1 --2- 172.21.15.99:0/1815772692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc15ef50 0x7fabdc0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.277+0000 7fabda000640 1 -- 172.21.15.99:0/1815772692 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696897680 0 0) 0x7fabdc0b7a90 con 0x7fabdc0d3240 2024-09-10T07:34:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.277+0000 7fabda000640 1 -- 172.21.15.99:0/1815772692 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabc0003520 con 0x7fabdc0d3240 2024-09-10T07:34:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.277+0000 7fabda000640 1 -- 172.21.15.99:0/1815772692 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829703116 0 0) 0x7fabdc0d3740 con 0x7fabdc0b9510 2024-09-10T07:34:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.277+0000 7fabda000640 1 -- 172.21.15.99:0/1815772692 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabdc0b7a90 con 0x7fabdc0b9510 2024-09-10T07:34:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.277+0000 7fabdb400640 1 -- 172.21.15.99:0/1815772692 >> v1:172.21.15.187:6789/0 conn(0x7fabdc0b9510 legacy=0x7fabdc0cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.277+0000 7fabdb400640 1 -- 172.21.15.99:0/1815772692 >> v1:172.21.15.99:6789/0 conn(0x7fabdc0d3240 legacy=0x7fabdc0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.277+0000 7fabdb400640 1 -- 172.21.15.99:0/1815772692 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc0b7d00 con 0x7fabdc15ef50 2024-09-10T07:34:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.278+0000 7fabdb400640 1 --2- 172.21.15.99:0/1815772692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc15ef50 0x7fabdc0d13a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0097d0 tx=0x7fabcc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=437774d4a151ceba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:29.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.278+0000 7fabda000640 1 -- 172.21.15.99:0/1815772692 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc037070 con 0x7fabdc15ef50 2024-09-10T07:34:29.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.278+0000 7fabda000640 1 -- 172.21.15.99:0/1815772692 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabcc032440 con 0x7fabdc15ef50 2024-09-10T07:34:29.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.278+0000 7fabda000640 1 -- 172.21.15.99:0/1815772692 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0327f0 con 0x7fabdc15ef50 2024-09-10T07:34:29.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.279+0000 7fabe2200640 1 -- 172.21.15.99:0/1815772692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc15ef50 msgr2=0x7fabdc0d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.279+0000 7fabe2200640 1 --2- 172.21.15.99:0/1815772692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc15ef50 0x7fabdc0d13a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0097d0 tx=0x7fabcc02a180 comp rx=0 tx=0).stop 2024-09-10T07:34:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.279+0000 7fabe2200640 1 -- 172.21.15.99:0/1815772692 shutdown_connections 2024-09-10T07:34:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.279+0000 7fabe2200640 1 --2- 172.21.15.99:0/1815772692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc15ef50 0x7fabdc0d13a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.279+0000 7fabe2200640 1 -- 172.21.15.99:0/1815772692 >> 172.21.15.99:0/1815772692 conn(0x7fabdc0d4c60 msgr2=0x7fabdc0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.279+0000 7fabe2200640 1 -- 172.21.15.99:0/1815772692 shutdown_connections 2024-09-10T07:34:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.279+0000 7fabe2200640 1 -- 172.21.15.99:0/1815772692 wait complete. 2024-09-10T07:34:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.281+0000 7fabe2200640 1 Processor -- start 2024-09-10T07:34:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.281+0000 7fabe2200640 1 -- start start 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabe2200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc0b9510 0x7fabdc14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabe2200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabdc0d3240 0x7fabdc161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabe2200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabdc15ef50 0x7fabdc15d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabe2200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc0d2020 con 0x7fabdc15ef50 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabe2200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc0d0590 con 0x7fabdc0d3240 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabe2200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc0d21a0 con 0x7fabdc0b9510 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc0b9510 0x7fabdc14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabdc15ef50 0x7fabdc15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc0b9510 0x7fabdc14f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:53348/0 (socket says 172.21.15.99:53348) 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdb400640 1 -- 172.21.15.99:0/2991720290 learned_addr learned my addr 172.21.15.99:0/2991720290 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:29.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabdc15ef50 0x7fabdc15d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34352/0 (socket says 172.21.15.99:34352) 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdaa00640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabdc0d3240 0x7fabdc161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdbe00640 1 -- 172.21.15.99:0/2991720290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc0b9510 msgr2=0x7fabdc14f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdbe00640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc0b9510 0x7fabdc14f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdbe00640 1 -- 172.21.15.99:0/2991720290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabdc0d3240 msgr2=0x7fabdc161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdbe00640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabdc0d3240 0x7fabdc161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdbe00640 1 -- 172.21.15.99:0/2991720290 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc158fe0 con 0x7fabdc15ef50 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.282+0000 7fabdb400640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc0b9510 0x7fabdc14f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.283+0000 7fabdbe00640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabdc15ef50 0x7fabdc15d170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabd400c700 tx=0x7fabd400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.283+0000 7fabd3400640 1 -- 172.21.15.99:0/2991720290 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd4003b70 con 0x7fabdc15ef50 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.283+0000 7fabd3400640 1 -- 172.21.15.99:0/2991720290 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd4003d30 con 0x7fabdc15ef50 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.283+0000 7fabd3400640 1 -- 172.21.15.99:0/2991720290 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd4005310 con 0x7fabdc15ef50 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.283+0000 7fabe2200640 1 -- 172.21.15.99:0/2991720290 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabdc1592c0 con 0x7fabdc15ef50 2024-09-10T07:34:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.283+0000 7fabe2200640 1 -- 172.21.15.99:0/2991720290 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabdc159880 con 0x7fabdc15ef50 2024-09-10T07:34:29.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.284+0000 7fabe2200640 1 -- 172.21.15.99:0/2991720290 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabdc0d5780 con 0x7fabdc15ef50 2024-09-10T07:34:29.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.285+0000 7fabd3400640 1 -- 172.21.15.99:0/2991720290 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabd40054b0 con 0x7fabdc15ef50 2024-09-10T07:34:29.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.286+0000 7fabd3400640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fabbc06be30 0x7fabbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.286+0000 7fabd3400640 1 -- 172.21.15.99:0/2991720290 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fabd408ab20 con 0x7fabdc15ef50 2024-09-10T07:34:29.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.286+0000 7fabdb400640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fabbc06be30 0x7fabbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.287+0000 7fabdb400640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fabbc06be30 0x7fabbc06e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0097d0 tx=0x7fabcc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:29.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.290+0000 7fabd3400640 1 -- 172.21.15.99:0/2991720290 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabd4058e70 con 0x7fabdc15ef50 2024-09-10T07:34:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.507+0000 7fabe2200640 1 -- 172.21.15.99:0/2991720290 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fabdc0b6a40 con 0x7fabdc15ef50 2024-09-10T07:34:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.510+0000 7fabd3400640 1 -- 172.21.15.99:0/2991720290 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172937 (secure 0 0 0) 0x7fabd405d170 con 0x7fabdc15ef50 2024-09-10T07:34:29.512 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 -- 172.21.15.99:0/2991720290 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fabbc06be30 msgr2=0x7fabbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fabbc06be30 0x7fabbc06e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0097d0 tx=0x7fabcc02e000 comp rx=0 tx=0).stop 2024-09-10T07:34:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 -- 172.21.15.99:0/2991720290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabdc15ef50 msgr2=0x7fabdc15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabdc15ef50 0x7fabdc15d170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabd400c700 tx=0x7fabd400cbc0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 -- 172.21.15.99:0/2991720290 shutdown_connections 2024-09-10T07:34:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fabbc06be30 0x7fabbc06e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabdc15ef50 0x7fabdc15d170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabdc0d3240 0x7fabdc161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 --2- 172.21.15.99:0/2991720290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabdc0b9510 0x7fabdc14f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 -- 172.21.15.99:0/2991720290 >> 172.21.15.99:0/2991720290 conn(0x7fabdc0d4c60 msgr2=0x7fabdc0b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 -- 172.21.15.99:0/2991720290 shutdown_connections 2024-09-10T07:34:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.513+0000 7fabe2200640 1 -- 172.21.15.99:0/2991720290 wait complete. 2024-09-10T07:34:29.530 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3417513811},{"type":"v1","addr":"172.21.15.99:6833","nonce":3417513811}]},"active_addr":"172.21.15.99:6833/3417513811","active_change":"2024-09-10T07:34:06.680131+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":3325201923}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1223845892}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":99682718}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":2884258051}]}]} 2024-09-10T07:34:29.533 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T07:34:29.534 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T07:34:29.534 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:29.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.686+0000 7f9e2fe00640 1 Processor -- start 2024-09-10T07:34:29.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.686+0000 7f9e2fe00640 1 -- start start 2024-09-10T07:34:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.687+0000 7f9e2fe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9e2813fae0 0x7f9e2806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.687+0000 7f9e2fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9e28142150 0x7f9e28160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.687+0000 7f9e2fe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e28142650 con 0x7f9e28160a80 2024-09-10T07:34:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.687+0000 7f9e2fe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9e280ce780 con 0x7f9e28142150 2024-09-10T07:34:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.687+0000 7f9e2fe00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f9e28142930 con 0x7f9e2813fae0 2024-09-10T07:34:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.688+0000 7f9e2ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9e28142150 0x7f9e28160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.688+0000 7f9e2ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9e28142150 0x7f9e28160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34356/0 (socket says 172.21.15.99:34356) 2024-09-10T07:34:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.688+0000 7f9e2ca00640 1 -- 172.21.15.99:0/183976983 learned_addr learned my addr 172.21.15.99:0/183976983 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.688+0000 7f9e2d400640 1 --2- 172.21.15.99:0/183976983 >> v2:172.21.15.187:3300/0 conn(0x7f9e2813fae0 0x7f9e2806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.688+0000 7f9e2ca00640 1 -- 172.21.15.99:0/183976983 >> v2:172.21.15.187:3300/0 conn(0x7f9e2813fae0 msgr2=0x7f9e2806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:29.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.688+0000 7f9e2ca00640 1 --2- 172.21.15.99:0/183976983 >> v2:172.21.15.187:3300/0 conn(0x7f9e2813fae0 0x7f9e2806f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.688+0000 7f9e2ca00640 1 -- 172.21.15.99:0/183976983 >> v1:172.21.15.187:6789/0 conn(0x7f9e28160a80 legacy=0x7f9e2815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.688+0000 7f9e2ca00640 1 -- 172.21.15.99:0/183976983 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e28142c10 con 0x7f9e28142150 2024-09-10T07:34:29.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.689+0000 7f9e2ca00640 1 --2- 172.21.15.99:0/183976983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e28142150 0x7f9e28160540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e28050590 tx=0x7f9e1402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e71b7f2de34a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:29.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.689+0000 7f9e27e00640 1 -- 172.21.15.99:0/183976983 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14037070 con 0x7f9e28142150 2024-09-10T07:34:29.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.689+0000 7f9e27e00640 1 -- 172.21.15.99:0/183976983 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e14032440 con 0x7f9e28142150 2024-09-10T07:34:29.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.689+0000 7f9e27e00640 1 -- 172.21.15.99:0/183976983 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14032810 con 0x7f9e28142150 2024-09-10T07:34:29.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.690+0000 7f9e2fe00640 1 -- 172.21.15.99:0/183976983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e28142150 msgr2=0x7f9e28160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.690+0000 7f9e2fe00640 1 --2- 172.21.15.99:0/183976983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e28142150 0x7f9e28160540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e28050590 tx=0x7f9e1402a1e0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.690+0000 7f9e2fe00640 1 -- 172.21.15.99:0/183976983 shutdown_connections 2024-09-10T07:34:29.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.690+0000 7f9e2fe00640 1 --2- 172.21.15.99:0/183976983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e28142150 0x7f9e28160540 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.690+0000 7f9e2fe00640 1 --2- 172.21.15.99:0/183976983 >> v2:172.21.15.187:3300/0 conn(0x7f9e2813fae0 0x7f9e2806f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.690+0000 7f9e2fe00640 1 -- 172.21.15.99:0/183976983 >> 172.21.15.99:0/183976983 conn(0x7f9e2806bc10 msgr2=0x7f9e2806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.690+0000 7f9e2fe00640 1 -- 172.21.15.99:0/183976983 shutdown_connections 2024-09-10T07:34:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.690+0000 7f9e2fe00640 1 -- 172.21.15.99:0/183976983 wait complete. 2024-09-10T07:34:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.691+0000 7f9e2fe00640 1 Processor -- start 2024-09-10T07:34:29.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.692+0000 7f9e2fe00640 1 -- start start 2024-09-10T07:34:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.692+0000 7f9e2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e2813fae0 0x7f9e2813ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.692+0000 7f9e2fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e28142150 0x7f9e281ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.692+0000 7f9e2fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e28160a80 0x7f9e280b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.692+0000 7f9e2fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2806f870 con 0x7f9e2813fae0 2024-09-10T07:34:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.692+0000 7f9e2fe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2806f6f0 con 0x7f9e28160a80 2024-09-10T07:34:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.692+0000 7f9e2fe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9e280cfc20 con 0x7f9e28142150 2024-09-10T07:34:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e2813fae0 0x7f9e2813ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e2813fae0 0x7f9e2813ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34370/0 (socket says 172.21.15.99:34370) 2024-09-10T07:34:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2d400640 1 -- 172.21.15.99:0/1964520516 learned_addr learned my addr 172.21.15.99:0/1964520516 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2de00640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e28160a80 0x7f9e280b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2ca00640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e28142150 0x7f9e281ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2d400640 1 -- 172.21.15.99:0/1964520516 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e28142150 msgr2=0x7f9e281ee9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2d400640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e28142150 0x7f9e281ee9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2d400640 1 -- 172.21.15.99:0/1964520516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e28160a80 msgr2=0x7f9e280b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2d400640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e28160a80 0x7f9e280b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2d400640 1 -- 172.21.15.99:0/1964520516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e28144250 con 0x7f9e2813fae0 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e2d400640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e2813fae0 0x7f9e2813ceb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00e9b0 tx=0x7f9e1c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.693+0000 7f9e25600640 1 -- 172.21.15.99:0/1964520516 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c017070 con 0x7f9e2813fae0 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.694+0000 7f9e25600640 1 -- 172.21.15.99:0/1964520516 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1c00c9a0 con 0x7f9e2813fae0 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.694+0000 7f9e25600640 1 -- 172.21.15.99:0/1964520516 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00cd90 con 0x7f9e2813fae0 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.694+0000 7f9e2fe00640 1 -- 172.21.15.99:0/1964520516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e281444f0 con 0x7f9e2813fae0 2024-09-10T07:34:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.694+0000 7f9e2fe00640 1 -- 172.21.15.99:0/1964520516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e280b5500 con 0x7f9e2813fae0 2024-09-10T07:34:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.695+0000 7f9e2fe00640 1 -- 172.21.15.99:0/1964520516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e2806f1b0 con 0x7f9e2813fae0 2024-09-10T07:34:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.696+0000 7f9e25600640 1 -- 172.21.15.99:0/1964520516 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e1c01a070 con 0x7f9e2813fae0 2024-09-10T07:34:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.696+0000 7f9e25600640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e0806be30 0x7f9e0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.696+0000 7f9e25600640 1 -- 172.21.15.99:0/1964520516 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9e1c08af40 con 0x7f9e2813fae0 2024-09-10T07:34:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.697+0000 7f9e2ca00640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e0806be30 0x7f9e0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.697+0000 7f9e2ca00640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e0806be30 0x7f9e0806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9e14034000 tx=0x7f9e1402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:29.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.701+0000 7f9e25600640 1 -- 172.21.15.99:0/1964520516 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e1c059200 con 0x7f9e2813fae0 2024-09-10T07:34:29.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.877+0000 7f9e2fe00640 1 -- 172.21.15.99:0/1964520516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e2815e620 con 0x7f9e2813fae0 2024-09-10T07:34:29.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.878+0000 7f9e25600640 1 -- 172.21.15.99:0/1964520516 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f9e1c05d500 con 0x7f9e2813fae0 2024-09-10T07:34:29.878 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:29.878 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:20.870081+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:34:17.274179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:34:18.279150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:29.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.880+0000 7f9e2fe00640 1 -- 172.21.15.99:0/1964520516 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e0806be30 msgr2=0x7f9e0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.880+0000 7f9e2fe00640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e0806be30 0x7f9e0806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9e14034000 tx=0x7f9e1402e000 comp rx=0 tx=0).stop 2024-09-10T07:34:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.880+0000 7f9e2fe00640 1 -- 172.21.15.99:0/1964520516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e2813fae0 msgr2=0x7f9e2813ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.880+0000 7f9e2fe00640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e2813fae0 0x7f9e2813ceb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00e9b0 tx=0x7f9e1c00ee70 comp rx=0 tx=0).stop 2024-09-10T07:34:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.880+0000 7f9e2fe00640 1 -- 172.21.15.99:0/1964520516 shutdown_connections 2024-09-10T07:34:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.880+0000 7f9e2fe00640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e28160a80 0x7f9e280b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.880+0000 7f9e2fe00640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e28142150 0x7f9e281ee9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.880+0000 7f9e2fe00640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e0806be30 0x7f9e0806e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.880+0000 7f9e2fe00640 1 --2- 172.21.15.99:0/1964520516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e2813fae0 0x7f9e2813ceb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.880+0000 7f9e2fe00640 1 -- 172.21.15.99:0/1964520516 >> 172.21.15.99:0/1964520516 conn(0x7f9e2806bc10 msgr2=0x7f9e280cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.881+0000 7f9e2fe00640 1 -- 172.21.15.99:0/1964520516 shutdown_connections 2024-09-10T07:34:29.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:29.881+0000 7f9e2fe00640 1 -- 172.21.15.99:0/1964520516 wait complete. 2024-09-10T07:34:29.898 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T07:34:29.898 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:30.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.051+0000 7f5d16e00640 1 Processor -- start 2024-09-10T07:34:30.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.051+0000 7f5d16e00640 1 -- start start 2024-09-10T07:34:30.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.052+0000 7f5d16e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5d100cf830 0x7f5d100b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.052+0000 7f5d16e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d100cfc80 0x7f5d100b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.052+0000 7f5d16e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d100aec20 con 0x7f5d1015ede0 2024-09-10T07:34:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.052+0000 7f5d16e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f5d100aef00 con 0x7f5d100cf830 2024-09-10T07:34:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.052+0000 7f5d16e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5d100af1e0 con 0x7f5d100cfc80 2024-09-10T07:34:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.053+0000 7f5d0f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5d100cf830 0x7f5d100b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.053+0000 7f5d0f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5d100cf830 0x7f5d100b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52260/0 (socket says 172.21.15.99:52260) 2024-09-10T07:34:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.053+0000 7f5d0f400640 1 -- 172.21.15.99:0/2563897698 learned_addr learned my addr 172.21.15.99:0/2563897698 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.053+0000 7f5d14e00640 1 --2- 172.21.15.99:0/2563897698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d100cfc80 0x7f5d100b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.053+0000 7f5d0f400640 1 -- 172.21.15.99:0/2563897698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d100cfc80 msgr2=0x7f5d100b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.053+0000 7f5d0f400640 1 --2- 172.21.15.99:0/2563897698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d100cfc80 0x7f5d100b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.053+0000 7f5d0f400640 1 -- 172.21.15.99:0/2563897698 >> v1:172.21.15.187:6789/0 conn(0x7f5d1015ede0 legacy=0x7f5d100afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.053+0000 7f5d0f400640 1 -- 172.21.15.99:0/2563897698 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d100af4c0 con 0x7f5d100cf830 2024-09-10T07:34:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.054+0000 7f5d0f400640 1 --2- 172.21.15.99:0/2563897698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d100cf830 0x7f5d100b43b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009870 tx=0x7f5cfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52adf99aed05d336 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.054+0000 7f5d0ea00640 1 -- 172.21.15.99:0/2563897698 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc037070 con 0x7f5d100cf830 2024-09-10T07:34:30.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.054+0000 7f5d0ea00640 1 -- 172.21.15.99:0/2563897698 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc032440 con 0x7f5d100cf830 2024-09-10T07:34:30.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.054+0000 7f5d0ea00640 1 -- 172.21.15.99:0/2563897698 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc032810 con 0x7f5d100cf830 2024-09-10T07:34:30.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.055+0000 7f5d16e00640 1 -- 172.21.15.99:0/2563897698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d100cf830 msgr2=0x7f5d100b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.055+0000 7f5d16e00640 1 --2- 172.21.15.99:0/2563897698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d100cf830 0x7f5d100b43b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009870 tx=0x7f5cfc02a270 comp rx=0 tx=0).stop 2024-09-10T07:34:30.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.055+0000 7f5d16e00640 1 -- 172.21.15.99:0/2563897698 shutdown_connections 2024-09-10T07:34:30.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.055+0000 7f5d16e00640 1 --2- 172.21.15.99:0/2563897698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d100cfc80 0x7f5d100b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.055+0000 7f5d16e00640 1 --2- 172.21.15.99:0/2563897698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d100cf830 0x7f5d100b43b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.055+0000 7f5d16e00640 1 -- 172.21.15.99:0/2563897698 >> 172.21.15.99:0/2563897698 conn(0x7f5d1006bc10 msgr2=0x7f5d1006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.055+0000 7f5d16e00640 1 -- 172.21.15.99:0/2563897698 shutdown_connections 2024-09-10T07:34:30.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.055+0000 7f5d16e00640 1 -- 172.21.15.99:0/2563897698 wait complete. 2024-09-10T07:34:30.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.057+0000 7f5d16e00640 1 Processor -- start 2024-09-10T07:34:30.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.057+0000 7f5d16e00640 1 -- start start 2024-09-10T07:34:30.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d16e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d100cf830 0x7f5d10161b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d16e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d100cfc80 0x7f5d1015b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d16e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1015ede0 0x7f5d1015b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d16e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5d100ae9c0 con 0x7f5d1015ede0 2024-09-10T07:34:30.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d16e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5d100ae840 con 0x7f5d100cf830 2024-09-10T07:34:30.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d16e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5d10071960 con 0x7f5d100cfc80 2024-09-10T07:34:30.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d14e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1015ede0 0x7f5d1015b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d0fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d100cf830 0x7f5d10161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d14e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1015ede0 0x7f5d1015b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52274/0 (socket says 172.21.15.99:52274) 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d14e00640 1 -- 172.21.15.99:0/2469547594 learned_addr learned my addr 172.21.15.99:0/2469547594 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d0f400640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d100cfc80 0x7f5d1015b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d14e00640 1 -- 172.21.15.99:0/2469547594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d100cfc80 msgr2=0x7f5d1015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d14e00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d100cfc80 0x7f5d1015b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d14e00640 1 -- 172.21.15.99:0/2469547594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d100cf830 msgr2=0x7f5d10161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d14e00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d100cf830 0x7f5d10161b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.058+0000 7f5d14e00640 1 -- 172.21.15.99:0/2469547594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d10151990 con 0x7f5d1015ede0 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.059+0000 7f5d14e00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1015ede0 0x7f5d1015b670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5d08007e30 tx=0x7f5d0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.059+0000 7f5d07e00640 1 -- 172.21.15.99:0/2469547594 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08014620 con 0x7f5d1015ede0 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.059+0000 7f5d07e00640 1 -- 172.21.15.99:0/2469547594 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d08019070 con 0x7f5d1015ede0 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.059+0000 7f5d07e00640 1 -- 172.21.15.99:0/2469547594 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08014a00 con 0x7f5d1015ede0 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.059+0000 7f5d16e00640 1 -- 172.21.15.99:0/2469547594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d10160160 con 0x7f5d1015ede0 2024-09-10T07:34:30.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.059+0000 7f5d16e00640 1 -- 172.21.15.99:0/2469547594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d10160720 con 0x7f5d1015ede0 2024-09-10T07:34:30.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.060+0000 7f5d16e00640 1 -- 172.21.15.99:0/2469547594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d10151b60 con 0x7f5d1015ede0 2024-09-10T07:34:30.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.061+0000 7f5d07e00640 1 -- 172.21.15.99:0/2469547594 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d08014ba0 con 0x7f5d1015ede0 2024-09-10T07:34:30.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.062+0000 7f5d07e00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cf006be30 0x7f5cf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.062+0000 7f5d07e00640 1 -- 172.21.15.99:0/2469547594 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5d0808b6e0 con 0x7f5d1015ede0 2024-09-10T07:34:30.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.062+0000 7f5d0fe00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cf006be30 0x7f5cf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.063+0000 7f5d0fe00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cf006be30 0x7f5cf006e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d000016e0 tx=0x7f5d00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.066+0000 7f5d07e00640 1 -- 172.21.15.99:0/2469547594 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d08059920 con 0x7f5d1015ede0 2024-09-10T07:34:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.239+0000 7f5d16e00640 1 -- 172.21.15.99:0/2469547594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d1006f2a0 con 0x7f5d1015ede0 2024-09-10T07:34:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.240+0000 7f5d07e00640 1 -- 172.21.15.99:0/2469547594 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f5d0805dc20 con 0x7f5d1015ede0 2024-09-10T07:34:30.240 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:30.240 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:20.870081+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:34:17.274179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:34:18.279150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 -- 172.21.15.99:0/2469547594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cf006be30 msgr2=0x7f5cf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cf006be30 0x7f5cf006e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d000016e0 tx=0x7f5d00009040 comp rx=0 tx=0).stop 2024-09-10T07:34:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 -- 172.21.15.99:0/2469547594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1015ede0 msgr2=0x7f5d1015b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1015ede0 0x7f5d1015b670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5d08007e30 tx=0x7f5d0800e4b0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 -- 172.21.15.99:0/2469547594 shutdown_connections 2024-09-10T07:34:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cf006be30 0x7f5cf006e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1015ede0 0x7f5d1015b670 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d100cfc80 0x7f5d1015b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 --2- 172.21.15.99:0/2469547594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d100cf830 0x7f5d10161b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 -- 172.21.15.99:0/2469547594 >> 172.21.15.99:0/2469547594 conn(0x7f5d1006bc10 msgr2=0x7f5d100b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 -- 172.21.15.99:0/2469547594 shutdown_connections 2024-09-10T07:34:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.242+0000 7f5d16e00640 1 -- 172.21.15.99:0/2469547594 wait complete. 2024-09-10T07:34:30.259 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T07:34:30.259 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T07:34:30.259 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T07:34:30.260 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T07:34:30.260 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T07:34:30.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T07:34:30.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T07:34:30.262 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T07:34:30.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.530+0000 7ff606400640 1 Processor -- start 2024-09-10T07:34:30.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.530+0000 7ff606400640 1 -- start start 2024-09-10T07:34:30.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.531+0000 7ff22e200640 1 Processor -- start 2024-09-10T07:34:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.533+0000 7ff606400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f80dec70 0x7ff5f8006500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.533+0000 7ff606400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff5f8009af0 0x7ff5f8009f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.533+0000 7ff606400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f801c5c0 con 0x7ff5f80323c0 2024-09-10T07:34:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.533+0000 7ff606400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f801c830 con 0x7ff5f8009af0 2024-09-10T07:34:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.534+0000 7ff606400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f801cb10 con 0x7ff5f80dec70 2024-09-10T07:34:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.534+0000 7ff5fea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff5f80323c0 0x7ff5f8052350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38240/0 (socket says 172.21.15.99:38240) 2024-09-10T07:34:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.534+0000 7ff5fea00640 1 -- 172.21.15.99:0/1944267086 learned_addr learned my addr 172.21.15.99:0/1944267086 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.534+0000 7ff5ff400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f80dec70 0x7ff5f8006500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.535+0000 7ff5ffe00640 1 --2- 172.21.15.99:0/1944267086 >> v2:172.21.15.99:3300/0 conn(0x7ff5f8009af0 0x7ff5f8009f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.532+0000 7ff22e200640 1 -- start start 2024-09-10T07:34:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.533+0000 7ff22e200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff22000a4f0 0x7ff220036020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.533+0000 7ff22e200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff2200551b0 0x7ff220036560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.533+0000 7ff22e200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff220039630 con 0x7ff220007070 2024-09-10T07:34:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.533+0000 7ff22e200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff220039910 con 0x7ff22000a4f0 2024-09-10T07:34:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.533+0000 7ff22e200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff220039bf0 con 0x7ff2200551b0 2024-09-10T07:34:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.534+0000 7ff227e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff2200551b0 0x7ff220036560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.534+0000 7ff227e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff2200551b0 0x7ff220036560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53614/0 (socket says 172.21.15.99:53614) 2024-09-10T07:34:30.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.534+0000 7ff227e00640 1 -- 172.21.15.99:0/3281426554 learned_addr learned my addr 172.21.15.99:0/3281426554 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.535+0000 7ff227e00640 1 -- 172.21.15.99:0/3281426554 >> v2:172.21.15.99:3300/0 conn(0x7ff22000a4f0 msgr2=0x7ff220036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.535+0000 7ff227e00640 1 --2- 172.21.15.99:0/3281426554 >> v2:172.21.15.99:3300/0 conn(0x7ff22000a4f0 0x7ff220036020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.535+0000 7ff227e00640 1 -- 172.21.15.99:0/3281426554 >> v1:172.21.15.99:6789/0 conn(0x7ff220007070 legacy=0x7ff220005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.535+0000 7ff227e00640 1 -- 172.21.15.99:0/3281426554 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff220039ed0 con 0x7ff2200551b0 2024-09-10T07:34:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.535+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333156569 0 0) 0x7ff5f801c5c0 con 0x7ff5f80323c0 2024-09-10T07:34:30.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.535+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5e8005730 con 0x7ff5f80323c0 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.536+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 173252008 0 0) 0x7ff5e8005730 con 0x7ff5f80323c0 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.536+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f80dec70 msgr2=0x7ff5f8006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.536+0000 7ff5fe000640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f80dec70 0x7ff5f8006500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.536+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 >> v2:172.21.15.99:3300/0 conn(0x7ff5f8009af0 msgr2=0x7ff5f8009f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.536+0000 7ff5fe000640 1 --2- 172.21.15.99:0/1944267086 >> v2:172.21.15.99:3300/0 conn(0x7ff5f8009af0 0x7ff5f8009f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.536+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f801cdf0 con 0x7ff5f80323c0 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.536+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7ff5ec001670 con 0x7ff5f80323c0 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.536+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 >> v1:172.21.15.99:6789/0 conn(0x7ff5f80323c0 legacy=0x7ff5f8052350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.536+0000 7ff5fe000640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5e8005bc0 0x7ff5e8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.536+0000 7ff5fe000640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5e8006a10 0x7ff5e8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.537+0000 7ff5fe000640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f80dec70 0x7ff5e80073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.537+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f801c830 con 0x7ff5e8005bc0 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.537+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f801cb10 con 0x7ff5e8006a10 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.537+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e80035a0 con 0x7ff5f80dec70 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.537+0000 7ff5ffe00640 1 --2- 172.21.15.99:0/1944267086 >> v2:172.21.15.99:3300/0 conn(0x7ff5f8009af0 0x7ff5f8009f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.537+0000 7ff5ff400640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5e8005bc0 0x7ff5e8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.538+0000 7ff5ffe00640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f80dec70 0x7ff5e80073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.538+0000 7ff5fea00640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5e8006a10 0x7ff5e8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.538+0000 7ff5ff400640 1 -- 172.21.15.99:0/1944267086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f80dec70 msgr2=0x7ff5e80073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.538+0000 7ff5ff400640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f80dec70 0x7ff5e80073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.538+0000 7ff5ff400640 1 -- 172.21.15.99:0/1944267086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5e8006a10 msgr2=0x7ff5e8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.538+0000 7ff5ff400640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5e8006a10 0x7ff5e8006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.538+0000 7ff5ff400640 1 -- 172.21.15.99:0/1944267086 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f801cdf0 con 0x7ff5e8005bc0 2024-09-10T07:34:30.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.538+0000 7f8b61c00640 1 Processor -- start 2024-09-10T07:34:30.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.539+0000 7f8b61c00640 1 -- start start 2024-09-10T07:34:30.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.539+0000 7fe848a00640 1 Processor -- start 2024-09-10T07:34:30.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.538+0000 7fa870000640 1 Processor -- start 2024-09-10T07:34:30.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.538+0000 7fa870000640 1 -- start start 2024-09-10T07:34:30.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.539+0000 7fe848a00640 1 -- start start 2024-09-10T07:34:30.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.540+0000 7ff227e00640 1 --2- 172.21.15.99:0/3281426554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2200551b0 0x7ff220036560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2200374c0 tx=0x7ff21c02a280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dea74e22f95bf3fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.540+0000 7fa870000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8680cd310 0x7fa8680cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.540+0000 7fa870000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa868163240 0x7fa8680cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.540+0000 7fa870000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8680cdc30 con 0x7fa8680b5990 2024-09-10T07:34:30.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.540+0000 7fa870000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa8680b5500 con 0x7fa868163240 2024-09-10T07:34:30.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.540+0000 7fa870000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa8680b48f0 con 0x7fa8680cd310 2024-09-10T07:34:30.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.540+0000 7ff227400640 1 -- 172.21.15.99:0/3281426554 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c037070 con 0x7ff2200551b0 2024-09-10T07:34:30.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7ff227400640 1 -- 172.21.15.99:0/3281426554 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21c032440 con 0x7ff2200551b0 2024-09-10T07:34:30.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fa86e000640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fa8680b5990 0x7fa868166ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:47766/0 (socket says 172.21.15.99:47766) 2024-09-10T07:34:30.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fa86e000640 1 -- 172.21.15.99:0/3584617298 learned_addr learned my addr 172.21.15.99:0/3584617298 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:30.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7ff227400640 1 -- 172.21.15.99:0/3281426554 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c032810 con 0x7ff2200551b0 2024-09-10T07:34:30.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fe848a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe844072a30 0x7fe844072ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fe848a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe844073400 0x7fe84415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fe842800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe84406c3c0 0x7fe84406d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38260/0 (socket says 172.21.15.99:38260) 2024-09-10T07:34:30.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fa86cc00640 1 --2- 172.21.15.99:0/3584617298 >> v2:172.21.15.99:3300/0 conn(0x7fa868163240 0x7fa8680cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fa86d600640 1 --2- 172.21.15.99:0/3584617298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8680cd310 0x7fa8680cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7f8b61c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8b5c15abb0 0x7f8b5c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fa86d600640 1 -- 172.21.15.99:0/3584617298 >> v2:172.21.15.99:3300/0 conn(0x7fa868163240 msgr2=0x7fa8680cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fe848a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe84415bbb0 con 0x7fe84406c3c0 2024-09-10T07:34:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fe848a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe844071f50 con 0x7fe844072a30 2024-09-10T07:34:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fe848a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe844072230 con 0x7fe844073400 2024-09-10T07:34:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.541+0000 7fe842800640 1 -- 172.21.15.99:0/3152175779 learned_addr learned my addr 172.21.15.99:0/3152175779 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7fe843200640 1 --2- 172.21.15.99:0/3152175779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe844073400 0x7fe84415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7f8b61c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8b5c072ab0 0x7f8b5c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7f8b5aa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8b5c15abb0 0x7f8b5c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7f8b5aa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8b5c15abb0 0x7f8b5c0b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53628/0 (socket says 172.21.15.99:53628) 2024-09-10T07:34:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7fe841e00640 1 --2- 172.21.15.99:0/3152175779 >> v2:172.21.15.99:3300/0 conn(0x7fe844072a30 0x7fe844072ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7fe843200640 1 -- 172.21.15.99:0/3152175779 >> v2:172.21.15.99:3300/0 conn(0x7fe844072a30 msgr2=0x7fe844072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7f8b61c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5c0b5720 con 0x7f8b5c0b5270 2024-09-10T07:34:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7f8b61c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8b5c0b5a00 con 0x7f8b5c072ab0 2024-09-10T07:34:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7f8b61c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8b5c0b5ce0 con 0x7f8b5c15abb0 2024-09-10T07:34:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7f8b52000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8b5c0b5270 0x7f8b5c0723a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38268/0 (socket says 172.21.15.99:38268) 2024-09-10T07:34:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7f8b52000640 1 -- 172.21.15.99:0/277194298 learned_addr learned my addr 172.21.15.99:0/277194298 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7f8b5b400640 1 --2- 172.21.15.99:0/277194298 >> v2:172.21.15.99:3300/0 conn(0x7f8b5c072ab0 0x7f8b5c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7ff5ff400640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5e8005bc0 0x7ff5e8005fe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009ce0 tx=0x7ff5e8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6794cd5096153d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.544+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4036070 con 0x7ff5e8005bc0 2024-09-10T07:34:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.544+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f4005990 con 0x7ff5e8005bc0 2024-09-10T07:34:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.544+0000 7ff5fe000640 1 -- 172.21.15.99:0/1944267086 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4009680 con 0x7ff5e8005bc0 2024-09-10T07:34:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7ff22e200640 1 -- 172.21.15.99:0/3281426554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2200551b0 msgr2=0x7ff220036560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7ff22e200640 1 --2- 172.21.15.99:0/3281426554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2200551b0 0x7ff220036560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2200374c0 tx=0x7ff21c02a280 comp rx=0 tx=0).stop 2024-09-10T07:34:30.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7ff22e200640 1 -- 172.21.15.99:0/3281426554 shutdown_connections 2024-09-10T07:34:30.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7ff22e200640 1 --2- 172.21.15.99:0/3281426554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2200551b0 0x7ff220036560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7ff22e200640 1 --2- 172.21.15.99:0/3281426554 >> v2:172.21.15.99:3300/0 conn(0x7ff22000a4f0 0x7ff220036020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7ff22e200640 1 -- 172.21.15.99:0/3281426554 >> 172.21.15.99:0/3281426554 conn(0x7ff22001d930 msgr2=0x7ff2200545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7ff22e200640 1 -- 172.21.15.99:0/3281426554 shutdown_connections 2024-09-10T07:34:30.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7ff22e200640 1 -- 172.21.15.99:0/3281426554 wait complete. 2024-09-10T07:34:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.545+0000 7f8b5aa00640 1 -- 172.21.15.99:0/277194298 >> v2:172.21.15.99:3300/0 conn(0x7f8b5c072ab0 msgr2=0x7f8b5c06e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.545+0000 7f8b5aa00640 1 --2- 172.21.15.99:0/277194298 >> v2:172.21.15.99:3300/0 conn(0x7f8b5c072ab0 0x7f8b5c06e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.545+0000 7f8b5aa00640 1 -- 172.21.15.99:0/277194298 >> v1:172.21.15.99:6789/0 conn(0x7f8b5c0b5270 legacy=0x7f8b5c0723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.545+0000 7f8b5aa00640 1 -- 172.21.15.99:0/277194298 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c0b5fc0 con 0x7f8b5c15abb0 2024-09-10T07:34:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7fa86d600640 1 --2- 172.21.15.99:0/3584617298 >> v2:172.21.15.99:3300/0 conn(0x7fa868163240 0x7fa8680cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7fa86d600640 1 -- 172.21.15.99:0/3584617298 >> v1:172.21.15.187:6789/0 conn(0x7fa8680b5990 legacy=0x7fa868166ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.542+0000 7fa86d600640 1 -- 172.21.15.99:0/3584617298 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8680b4bd0 con 0x7fa8680cd310 2024-09-10T07:34:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7fa86cc00640 1 --2- 172.21.15.99:0/3584617298 >> v2:172.21.15.99:3300/0 conn(0x7fa868163240 0x7fa8680cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7fa86d600640 1 --2- 172.21.15.99:0/3584617298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8680cd310 0x7fa8680cd6f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0097a0 tx=0x7fa85c02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb00291a23173e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.544+0000 7fa867e00640 1 -- 172.21.15.99:0/3584617298 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c037070 con 0x7fa8680cd310 2024-09-10T07:34:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.544+0000 7fa867e00640 1 -- 172.21.15.99:0/3584617298 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85c02ad10 con 0x7fa8680cd310 2024-09-10T07:34:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.544+0000 7fa867e00640 1 -- 172.21.15.99:0/3584617298 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c032660 con 0x7fa8680cd310 2024-09-10T07:34:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.545+0000 7fa870000640 1 -- 172.21.15.99:0/3584617298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8680cd310 msgr2=0x7fa8680cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.545+0000 7fa870000640 1 --2- 172.21.15.99:0/3584617298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8680cd310 0x7fa8680cd6f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0097a0 tx=0x7fa85c02a080 comp rx=0 tx=0).stop 2024-09-10T07:34:30.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.545+0000 7ff606400640 1 -- 172.21.15.99:0/1944267086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5e8005bc0 msgr2=0x7ff5e8005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.545+0000 7ff606400640 1 --2- 172.21.15.99:0/1944267086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5e8005bc0 0x7ff5e8005fe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009ce0 tx=0x7ff5e8007a40 comp rx=0 tx=0).stop 2024-09-10T07:34:30.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.545+0000 7ff5ffe00640 1 -- 172.21.15.99:0/1944267086 reap_dead start 2024-09-10T07:34:30.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7ff606400640 1 -- 172.21.15.99:0/1944267086 shutdown_connections 2024-09-10T07:34:30.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7ff606400640 1 -- 172.21.15.99:0/1944267086 >> 172.21.15.99:0/1944267086 conn(0x7ff5f8036090 msgr2=0x7ff5f80364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7ff22e200640 1 Processor -- start 2024-09-10T07:34:30.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7fa870000640 1 -- 172.21.15.99:0/3584617298 shutdown_connections 2024-09-10T07:34:30.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7fa870000640 1 --2- 172.21.15.99:0/3584617298 >> v2:172.21.15.99:3300/0 conn(0x7fa868163240 0x7fa8680cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7fa870000640 1 --2- 172.21.15.99:0/3584617298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8680cd310 0x7fa8680cd6f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7fa870000640 1 -- 172.21.15.99:0/3584617298 >> 172.21.15.99:0/3584617298 conn(0x7fa8680b2630 msgr2=0x7fa8680b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7fe843200640 1 --2- 172.21.15.99:0/3152175779 >> v2:172.21.15.99:3300/0 conn(0x7fe844072a30 0x7fe844072ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7fe843200640 1 -- 172.21.15.99:0/3152175779 >> v1:172.21.15.99:6789/0 conn(0x7fe84406c3c0 legacy=0x7fe84406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.543+0000 7fe843200640 1 -- 172.21.15.99:0/3152175779 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe844072510 con 0x7fe844073400 2024-09-10T07:34:30.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7ff606400640 1 -- 172.21.15.99:0/1944267086 shutdown_connections 2024-09-10T07:34:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7ff22e200640 1 -- start start 2024-09-10T07:34:30.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7f8b5aa00640 1 --2- 172.21.15.99:0/277194298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b5c15abb0 0x7f8b5c0b4d30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0719d0 tx=0x7f8b4402b2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b45e96948a684aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7ff606400640 1 -- 172.21.15.99:0/1944267086 wait complete. 2024-09-10T07:34:30.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7fa870000640 1 -- 172.21.15.99:0/3584617298 shutdown_connections 2024-09-10T07:34:30.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.546+0000 7fa870000640 1 -- 172.21.15.99:0/3584617298 wait complete. 2024-09-10T07:34:30.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.547+0000 7f8b5a000640 1 -- 172.21.15.99:0/277194298 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44038070 con 0x7f8b5c15abb0 2024-09-10T07:34:30.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.547+0000 7f8b5a000640 1 -- 172.21.15.99:0/277194298 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b44033440 con 0x7f8b5c15abb0 2024-09-10T07:34:30.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.547+0000 7f8b5a000640 1 -- 172.21.15.99:0/277194298 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44033810 con 0x7f8b5c15abb0 2024-09-10T07:34:30.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.547+0000 7fe843200640 1 --2- 172.21.15.99:0/3152175779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe844073400 0x7fe84415aa20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009d90 tx=0x7fe83c02a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc088f1fbbba93e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.547+0000 7ff22e200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff220007070 0x7ff220180930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.547+0000 7ff22e200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2200551b0 0x7ff2200d9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7ff22e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22004dc30 0x7ff220052a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7ff22e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff220054e30 con 0x7ff22004dc30 2024-09-10T07:34:30.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7ff22e200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff220054cb0 con 0x7ff220007070 2024-09-10T07:34:30.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7ff22e200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff22004ff50 con 0x7ff2200551b0 2024-09-10T07:34:30.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.547+0000 7fe841400640 1 -- 172.21.15.99:0/3152175779 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c031600 con 0x7fe844073400 2024-09-10T07:34:30.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.547+0000 7fe841400640 1 -- 172.21.15.99:0/3152175779 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe83c0317a0 con 0x7fe844073400 2024-09-10T07:34:30.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.547+0000 7fe841400640 1 -- 172.21.15.99:0/3152175779 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c031b70 con 0x7fe844073400 2024-09-10T07:34:30.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7f8b61c00640 1 -- 172.21.15.99:0/277194298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b5c15abb0 msgr2=0x7f8b5c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7f8b61c00640 1 --2- 172.21.15.99:0/277194298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b5c15abb0 0x7f8b5c0b4d30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0719d0 tx=0x7f8b4402b2b0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7ff227e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2200551b0 0x7ff2200d9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7f8b61c00640 1 -- 172.21.15.99:0/277194298 shutdown_connections 2024-09-10T07:34:30.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7f8b61c00640 1 --2- 172.21.15.99:0/277194298 >> v2:172.21.15.99:3300/0 conn(0x7f8b5c072ab0 0x7f8b5c06e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7f8b61c00640 1 --2- 172.21.15.99:0/277194298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b5c15abb0 0x7f8b5c0b4d30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7f8b61c00640 1 -- 172.21.15.99:0/277194298 >> 172.21.15.99:0/277194298 conn(0x7f8b5c0b2bc0 msgr2=0x7f8b5c0b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7f8b61c00640 1 -- 172.21.15.99:0/277194298 shutdown_connections 2024-09-10T07:34:30.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7fe848a00640 1 -- 172.21.15.99:0/3152175779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe844073400 msgr2=0x7fe84415aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7fe848a00640 1 --2- 172.21.15.99:0/3152175779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe844073400 0x7fe84415aa20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009d90 tx=0x7fe83c02a610 comp rx=0 tx=0).stop 2024-09-10T07:34:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7ff227e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2200551b0 0x7ff2200d9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:33836/0 (socket says 172.21.15.99:33836) 2024-09-10T07:34:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7ff227e00640 1 -- 172.21.15.99:0/655563071 learned_addr learned my addr 172.21.15.99:0/655563071 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7ff22d800640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22004dc30 0x7ff220052a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.548+0000 7ff22ce00640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff220007070 0x7ff220180930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.549+0000 7f8b61c00640 1 -- 172.21.15.99:0/277194298 wait complete. 2024-09-10T07:34:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.549+0000 7fe848a00640 1 -- 172.21.15.99:0/3152175779 shutdown_connections 2024-09-10T07:34:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.549+0000 7fe848a00640 1 --2- 172.21.15.99:0/3152175779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe844073400 0x7fe84415aa20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.549+0000 7fe848a00640 1 --2- 172.21.15.99:0/3152175779 >> v2:172.21.15.99:3300/0 conn(0x7fe844072a30 0x7fe844072ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.549+0000 7fe848a00640 1 -- 172.21.15.99:0/3152175779 >> 172.21.15.99:0/3152175779 conn(0x7fe844068070 msgr2=0x7fe84406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.549+0000 7fa870000640 1 Processor -- start 2024-09-10T07:34:30.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.549+0000 7fe848a00640 1 -- 172.21.15.99:0/3152175779 shutdown_connections 2024-09-10T07:34:30.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.549+0000 7ff22ce00640 1 -- 172.21.15.99:0/655563071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2200551b0 msgr2=0x7ff2200d9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.550+0000 7ff22ce00640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2200551b0 0x7ff2200d9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.550+0000 7ff22ce00640 1 -- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22004dc30 msgr2=0x7ff220052a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.550+0000 7ff22ce00640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22004dc30 0x7ff220052a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.550+0000 7ff22ce00640 1 -- 172.21.15.99:0/655563071 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff220180e70 con 0x7ff220007070 2024-09-10T07:34:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.549+0000 7fe848a00640 1 -- 172.21.15.99:0/3152175779 wait complete. 2024-09-10T07:34:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.549+0000 7fa870000640 1 -- start start 2024-09-10T07:34:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.551+0000 7fa870000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8680b5990 0x7fa86815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.551+0000 7fa870000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8680cd310 0x7fa868162410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.551+0000 7fa870000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa868163240 0x7fa8680abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.551+0000 7fa870000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa8680ce160 con 0x7fa8680cd310 2024-09-10T07:34:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.551+0000 7fa870000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa8680b5190 con 0x7fa8680b5990 2024-09-10T07:34:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.551+0000 7fa870000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa8680cf6d0 con 0x7fa868163240 2024-09-10T07:34:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.550+0000 7fe069600640 1 Processor -- start 2024-09-10T07:34:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.550+0000 7fe069600640 1 -- start start 2024-09-10T07:34:30.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.551+0000 7ff606400640 1 Processor -- start 2024-09-10T07:34:30.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.551+0000 7f8b61c00640 1 Processor -- start 2024-09-10T07:34:30.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7f8b61c00640 1 -- start start 2024-09-10T07:34:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fe848a00640 1 Processor -- start 2024-09-10T07:34:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7ff22ce00640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff220007070 0x7ff220180930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff21400b410 tx=0x7ff21400b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fe069600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe0640d1c90 0x7fe0640cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fe069600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0640d56f0 0x7fe0640cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fe069600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0640b50a0 con 0x7fe064162460 2024-09-10T07:34:30.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fe069600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe0640b5940 con 0x7fe0640d1c90 2024-09-10T07:34:30.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fe069600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe0640b5380 con 0x7fe0640d56f0 2024-09-10T07:34:30.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7ff606400640 1 -- start start 2024-09-10T07:34:30.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fe848a00640 1 -- start start 2024-09-10T07:34:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7ff224c00640 1 -- 172.21.15.99:0/655563071 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214015030 con 0x7ff220007070 2024-09-10T07:34:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2200da040 con 0x7ff220007070 2024-09-10T07:34:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7ff224c00640 1 -- 172.21.15.99:0/655563071 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff214005a10 con 0x7ff220007070 2024-09-10T07:34:30.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fe063400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0640d56f0 0x7fe0640cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22004ce70 con 0x7ff220007070 2024-09-10T07:34:30.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fe063400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0640d56f0 0x7fe0640cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:33838/0 (socket says 172.21.15.99:33838) 2024-09-10T07:34:30.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fe063400640 1 -- 172.21.15.99:0/2604600753 learned_addr learned my addr 172.21.15.99:0/2604600753 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7ff224c00640 1 -- 172.21.15.99:0/655563071 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214015030 con 0x7ff220007070 2024-09-10T07:34:30.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.552+0000 7fa86d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8680b5990 0x7fa86815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fa86d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8680b5990 0x7fa86815dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53646/0 (socket says 172.21.15.99:53646) 2024-09-10T07:34:30.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fa86d600640 1 -- 172.21.15.99:0/375584017 learned_addr learned my addr 172.21.15.99:0/375584017 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fa86e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa868163240 0x7fa8680abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fa86cc00640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8680cd310 0x7fa868162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fe063400640 1 -- 172.21.15.99:0/2604600753 >> v2:172.21.15.99:3300/0 conn(0x7fe0640d1c90 msgr2=0x7fe0640cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fe063400640 1 --2- 172.21.15.99:0/2604600753 >> v2:172.21.15.99:3300/0 conn(0x7fe0640d1c90 0x7fe0640cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fe063400640 1 -- 172.21.15.99:0/2604600753 >> v1:172.21.15.99:6789/0 conn(0x7fe064162460 legacy=0x7fe0640d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fe063400640 1 -- 172.21.15.99:0/2604600753 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0640b5660 con 0x7fe0640d56f0 2024-09-10T07:34:30.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7f8b61c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b5c072ab0 0x7f8b5c0afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7f8b61c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b5c0b5270 0x7f8b5c146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7f8b61c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b5c15abb0 0x7f8b5c0aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fa86e000640 1 -- 172.21.15.99:0/375584017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8680b5990 msgr2=0x7fa86815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fa86e000640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8680b5990 0x7fa86815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fa86e000640 1 -- 172.21.15.99:0/375584017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8680cd310 msgr2=0x7fa868162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fa86e000640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8680cd310 0x7fa868162410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fa86e000640 1 -- 172.21.15.99:0/375584017 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa868160410 con 0x7fa868163240 2024-09-10T07:34:30.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fe848a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe84406c3c0 0x7fe844152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fe848a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe844072a30 0x7fe8441e4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fe848a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe844073400 0x7fe84413edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fe848a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe8440afa20 con 0x7fe844073400 2024-09-10T07:34:30.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fe848a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe8440af8a0 con 0x7fe844072a30 2024-09-10T07:34:30.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7fe848a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe8440afba0 con 0x7fe84406c3c0 2024-09-10T07:34:30.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7fe842800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe84406c3c0 0x7fe844152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7f8b61c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c0d0060 con 0x7f8b5c072ab0 2024-09-10T07:34:30.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7f8b61c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c0cfee0 con 0x7f8b5c0b5270 2024-09-10T07:34:30.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7fe842800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe84406c3c0 0x7fe844152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:33854/0 (socket says 172.21.15.99:33854) 2024-09-10T07:34:30.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7fe842800640 1 -- 172.21.15.99:0/2170977068 learned_addr learned my addr 172.21.15.99:0/2170977068 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.553+0000 7f8b61c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5c15af90 con 0x7f8b5c15abb0 2024-09-10T07:34:30.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7fe841e00640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe844072a30 0x7fe8441e4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7f8b52000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b5c0b5270 0x7f8b5c146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7fe063400640 1 --2- 172.21.15.99:0/2604600753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0640d56f0 0x7fe0640cfd20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009e50 tx=0x7fe05c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=987afd2f031ea489 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7ff606400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5f80d73f0 0x7ff5f804da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7ff606400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5f804b5e0 0x7ff5f817cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7ff606400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f817d1c0 0x7ff5f80e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7ff606400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f800bb70 con 0x7ff5f80d73f0 2024-09-10T07:34:30.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7ff606400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f8032980 con 0x7ff5f804b5e0 2024-09-10T07:34:30.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7ff606400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f800bcf0 con 0x7ff5f817d1c0 2024-09-10T07:34:30.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7fe843200640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe844073400 0x7fe84413edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7fa86e000640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa868163240 0x7fa8680abd30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa86000c890 tx=0x7fa86000cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7f8b52000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b5c0b5270 0x7f8b5c146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53652/0 (socket says 172.21.15.99:53652) 2024-09-10T07:34:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7f8b52000640 1 -- 172.21.15.99:0/2876995475 learned_addr learned my addr 172.21.15.99:0/2876995475 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7f8b5aa00640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b5c072ab0 0x7f8b5c0afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7f8b5b400640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b5c15abb0 0x7f8b5c0aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7f8b52000640 1 -- 172.21.15.99:0/2876995475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b5c15abb0 msgr2=0x7f8b5c0aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7f8b52000640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b5c15abb0 0x7f8b5c0aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7f8b52000640 1 -- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b5c072ab0 msgr2=0x7f8b5c0afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.554+0000 7f8b52000640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b5c072ab0 0x7f8b5c0afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7f8b52000640 1 -- 172.21.15.99:0/2876995475 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c148720 con 0x7f8b5c0b5270 2024-09-10T07:34:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7f8b5b400640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b5c15abb0 0x7f8b5c0aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fa865600640 1 -- 172.21.15.99:0/375584017 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860018070 con 0x7fa868163240 2024-09-10T07:34:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fa865600640 1 -- 172.21.15.99:0/375584017 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa86000a640 con 0x7fa868163240 2024-09-10T07:34:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fa865600640 1 -- 172.21.15.99:0/375584017 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86000aa30 con 0x7fa868163240 2024-09-10T07:34:30.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7ff5fea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5f804b5e0 0x7ff5f817cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fe842800640 1 -- 172.21.15.99:0/2170977068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe844072a30 msgr2=0x7fe8441e4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fe842800640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe844072a30 0x7fe8441e4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fe842800640 1 -- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe844073400 msgr2=0x7fe84413edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fe842800640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe844073400 0x7fe84413edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fe842800640 1 -- 172.21.15.99:0/2170977068 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8441561a0 con 0x7fe84406c3c0 2024-09-10T07:34:30.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8681606f0 con 0x7fa868163240 2024-09-10T07:34:30.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fe843200640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe844073400 0x7fe84413edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:30.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7ff5fea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5f804b5e0 0x7ff5f817cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53670/0 (socket says 172.21.15.99:53670) 2024-09-10T07:34:30.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7ff5fea00640 1 -- 172.21.15.99:0/3438822954 learned_addr learned my addr 172.21.15.99:0/3438822954 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa868160cb0 con 0x7fa868163240 2024-09-10T07:34:30.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7fe842800640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe84406c3c0 0x7fe844152bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe83400c460 tx=0x7fe83400c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7ff5ffe00640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f817d1c0 0x7ff5f80e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7ff5ff400640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5f80d73f0 0x7ff5f804da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.555+0000 7f8b52000640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b5c0b5270 0x7f8b5c146650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c430 tx=0x7f8b4c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7fe062000640 1 -- 172.21.15.99:0/2604600753 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c036070 con 0x7fe0640d56f0 2024-09-10T07:34:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7fe062000640 1 -- 172.21.15.99:0/2604600753 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05c031600 con 0x7fe0640d56f0 2024-09-10T07:34:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7fe062000640 1 -- 172.21.15.99:0/2604600753 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0319d0 con 0x7fe0640d56f0 2024-09-10T07:34:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7f8b53400640 1 -- 172.21.15.99:0/2876995475 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c017070 con 0x7f8b5c0b5270 2024-09-10T07:34:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7f8b53400640 1 -- 172.21.15.99:0/2876995475 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b4c005ce0 con 0x7f8b5c0b5270 2024-09-10T07:34:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7f8b53400640 1 -- 172.21.15.99:0/2876995475 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c0072f0 con 0x7f8b5c0b5270 2024-09-10T07:34:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c148a00 con 0x7f8b5c0b5270 2024-09-10T07:34:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff204001030 con 0x7ff220007070 2024-09-10T07:34:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.557+0000 7fe83aa00640 1 -- 172.21.15.99:0/2170977068 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834005ce0 con 0x7fe84406c3c0 2024-09-10T07:34:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.557+0000 7fe83aa00640 1 -- 172.21.15.99:0/2170977068 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe834007070 con 0x7fe84406c3c0 2024-09-10T07:34:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.557+0000 7fe83aa00640 1 -- 172.21.15.99:0/2170977068 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834007460 con 0x7fe84406c3c0 2024-09-10T07:34:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.557+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c148fc0 con 0x7f8b5c0b5270 2024-09-10T07:34:30.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.557+0000 7fe069600640 1 -- 172.21.15.99:0/2604600753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0640d56f0 msgr2=0x7fe0640cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.557+0000 7fe069600640 1 --2- 172.21.15.99:0/2604600753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0640d56f0 0x7fe0640cfd20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009e50 tx=0x7fe05c02a6d0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.557+0000 7fe069600640 1 -- 172.21.15.99:0/2604600753 shutdown_connections 2024-09-10T07:34:30.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.557+0000 7fe069600640 1 --2- 172.21.15.99:0/2604600753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0640d56f0 0x7fe0640cfd20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.557+0000 7fe069600640 1 --2- 172.21.15.99:0/2604600753 >> v2:172.21.15.99:3300/0 conn(0x7fe0640d1c90 0x7fe0640cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.558+0000 7fe069600640 1 -- 172.21.15.99:0/2604600753 >> 172.21.15.99:0/2604600753 conn(0x7fe0640d4bd0 msgr2=0x7fe0640d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7ff5ffe00640 1 -- 172.21.15.99:0/3438822954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5f804b5e0 msgr2=0x7ff5f817cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7ff5ffe00640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5f804b5e0 0x7ff5f817cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.556+0000 7ff5ffe00640 1 -- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5f80d73f0 msgr2=0x7ff5f804da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.558+0000 7f0b8c600640 1 Processor -- start 2024-09-10T07:34:30.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.558+0000 7ff5ffe00640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5f80d73f0 0x7ff5f804da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.558+0000 7ff5ffe00640 1 -- 172.21.15.99:0/3438822954 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f804e700 con 0x7ff5f817d1c0 2024-09-10T07:34:30.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.558+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe844156480 con 0x7fe84406c3c0 2024-09-10T07:34:30.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.558+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe844156a40 con 0x7fe84406c3c0 2024-09-10T07:34:30.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.558+0000 7fe069600640 1 -- 172.21.15.99:0/2604600753 shutdown_connections 2024-09-10T07:34:30.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.558+0000 7ff5ff400640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5f80d73f0 0x7ff5f804da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:30.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.557+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa8680cd6f0 con 0x7fa868163240 2024-09-10T07:34:30.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.559+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b30001030 con 0x7f8b5c0b5270 2024-09-10T07:34:30.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.559+0000 7fe069600640 1 -- 172.21.15.99:0/2604600753 wait complete. 2024-09-10T07:34:30.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.559+0000 7ff224c00640 1 -- 172.21.15.99:0/655563071 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff214018070 con 0x7ff220007070 2024-09-10T07:34:30.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.558+0000 7f0b8c600640 1 -- start start 2024-09-10T07:34:30.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.559+0000 7fa865600640 1 -- 172.21.15.99:0/375584017 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa86001b070 con 0x7fa868163240 2024-09-10T07:34:30.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.559+0000 7f7e6a200640 1 Processor -- start 2024-09-10T07:34:30.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.559+0000 7ff5ffe00640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f817d1c0 0x7ff5f80e0be0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff600051220 tx=0x7ff600076560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.560+0000 7f7e6a200640 1 -- start start 2024-09-10T07:34:30.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.560+0000 7ff5f3400640 1 -- 172.21.15.99:0/3438822954 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60009a070 con 0x7ff5f817d1c0 2024-09-10T07:34:30.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.560+0000 7ff5f3400640 1 -- 172.21.15.99:0/3438822954 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff600050520 con 0x7ff5f817d1c0 2024-09-10T07:34:30.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.560+0000 7ff5f3400640 1 -- 172.21.15.99:0/3438822954 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6000709f0 con 0x7ff5f817d1c0 2024-09-10T07:34:30.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.560+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8440697e0 con 0x7fe84406c3c0 2024-09-10T07:34:30.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.560+0000 7ff224c00640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff20806c030 0x7ff20806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.560+0000 7ff224c00640 1 -- 172.21.15.99:0/655563071 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff21408a400 con 0x7ff220007070 2024-09-10T07:34:30.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7ff224c00640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] conn(0x7ff2080741d0 0x7ff2080765f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7ff224c00640 1 -- 172.21.15.99:0/655563071 --> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff21400fe50 con 0x7ff2080741d0 2024-09-10T07:34:30.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7ff224c00640 1 -- 172.21.15.99:0/655563071 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff214091050 con 0x7ff220007070 2024-09-10T07:34:30.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.560+0000 7fa865600640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa84806bf00 0x7fa84806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7fa865600640 1 -- 172.21.15.99:0/375584017 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa86008a4e0 con 0x7fa868163240 2024-09-10T07:34:30.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7fa865600640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] conn(0x7fa848074100 0x7fa848076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7fa865600640 1 -- 172.21.15.99:0/375584017 --> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa848076bd0 con 0x7fa848074100 2024-09-10T07:34:30.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7ff227e00640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff20806c030 0x7ff20806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7f8b53400640 1 -- 172.21.15.99:0/2876995475 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b4c01a070 con 0x7f8b5c0b5270 2024-09-10T07:34:30.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7ff22d800640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] conn(0x7ff2080741d0 0x7ff2080765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7f7e6a200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e640d1b50 0x7f7e640cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7f7e6a200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e640b91d0 0x7f7e640cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7f7e6a200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e640d3530 con 0x7f7e64162270 2024-09-10T07:34:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7f7e6a200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7e640b7a50 con 0x7f7e640d1b50 2024-09-10T07:34:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7f7e6a200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7e640b7d30 con 0x7f7e640b91d0 2024-09-10T07:34:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7f0b8c600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b8406e890 0x7f0b840ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7f0b8c600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b840716b0 con 0x7f0b8414cc40 2024-09-10T07:34:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7f0b8c600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b84071990 con 0x7f0b840b47d0 2024-09-10T07:34:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7f0b8c600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0b840cecc0 con 0x7f0b8406e890 2024-09-10T07:34:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f804e140 con 0x7ff5f817d1c0 2024-09-10T07:34:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f80e03e0 con 0x7ff5f817d1c0 2024-09-10T07:34:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7ff227e00640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff20806c030 0x7ff20806e4f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff220006c30 tx=0x7ff21c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7fe83aa00640 1 -- 172.21.15.99:0/2170977068 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe834007600 con 0x7fe84406c3c0 2024-09-10T07:34:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.561+0000 7fa86d600640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa84806bf00 0x7fa84806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7fa86cc00640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] conn(0x7fa848074100 0x7fa848076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7fa86d600640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa84806bf00 0x7fa84806e3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa85c02a0c0 tx=0x7fa85c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7fa865600640 1 -- 172.21.15.99:0/375584017 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa860091050 con 0x7fa868163240 2024-09-10T07:34:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7f7e62a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e640d1b50 0x7f7e640cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7f7e63400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7e64162270 0x7f7e640d1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38284/0 (socket says 172.21.15.99:38284) 2024-09-10T07:34:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7f7e63400640 1 -- 172.21.15.99:0/1380597463 learned_addr learned my addr 172.21.15.99:0/1380597463 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5f817d670 con 0x7ff5f817d1c0 2024-09-10T07:34:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7f7e63e00640 1 --2- 172.21.15.99:0/1380597463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e640b91d0 0x7f7e640cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7f0b89200640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f0b840b47d0 0x7f0b8406e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:47782/0 (socket says 172.21.15.99:47782) 2024-09-10T07:34:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7f0b8a600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b8406e890 0x7f0b840ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.562+0000 7f0b89200640 1 -- 172.21.15.99:0/1599151752 learned_addr learned my addr 172.21.15.99:0/1599151752 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7fe83aa00640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe82406bf00 0x7fe82406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7fa86cc00640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] conn(0x7fa848074100 0x7fa848076520 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7f7e62000640 1 -- 172.21.15.99:0/1380597463 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4145080845 0 0) 0x7f7e640d3530 con 0x7f7e64162270 2024-09-10T07:34:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7ff22d800640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] conn(0x7ff2080741d0 0x7ff2080765f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7f0b83e00640 1 -- 172.21.15.99:0/1599151752 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768703836 0 0) 0x7f0b84071990 con 0x7f0b840b47d0 2024-09-10T07:34:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7f0b83e00640 1 -- 172.21.15.99:0/1599151752 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b6c003520 con 0x7f0b840b47d0 2024-09-10T07:34:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7f0b8a600640 1 -- 172.21.15.99:0/1599151752 >> v1:172.21.15.187:6789/0 conn(0x7f0b840b47d0 legacy=0x7f0b8406e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7f0b8a600640 1 -- 172.21.15.99:0/1599151752 >> v1:172.21.15.99:6789/0 conn(0x7f0b8414cc40 legacy=0x7f0b840b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7f0b8a600640 1 -- 172.21.15.99:0/1599151752 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b84071c70 con 0x7f0b8406e890 2024-09-10T07:34:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7fe83aa00640 1 -- 172.21.15.99:0/2170977068 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe83408ab10 con 0x7fe84406c3c0 2024-09-10T07:34:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.563+0000 7f7e62000640 1 -- 172.21.15.99:0/1380597463 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e48003520 con 0x7f7e64162270 2024-09-10T07:34:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7f7e62a00640 1 -- 172.21.15.99:0/1380597463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e640b91d0 msgr2=0x7f7e640cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7f7e62a00640 1 --2- 172.21.15.99:0/1380597463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e640b91d0 0x7f7e640cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7f7e62a00640 1 -- 172.21.15.99:0/1380597463 >> v1:172.21.15.99:6789/0 conn(0x7f7e64162270 legacy=0x7f7e640d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7f7e62a00640 1 -- 172.21.15.99:0/1380597463 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e640d3810 con 0x7f7e640d1b50 2024-09-10T07:34:30.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7fe069600640 1 Processor -- start 2024-09-10T07:34:30.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7fe841e00640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe82406bf00 0x7fe82406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7fe83aa00640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] conn(0x7fe824074120 0x7fe824076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.565+0000 7fa865600640 1 -- 172.21.15.99:0/375584017 <== osd.4 v2:172.21.15.187:6824/3032215980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fa848076bd0 con 0x7fa848074100 2024-09-10T07:34:30.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7f8b53400640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8b3806bf00 0x7f8b3806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.565+0000 7f8b5aa00640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8b3806bf00 0x7f8b3806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.565+0000 7f8b53400640 1 -- 172.21.15.99:0/2876995475 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8b4c08a700 con 0x7f8b5c0b5270 2024-09-10T07:34:30.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.565+0000 7f0b8a600640 1 --2- 172.21.15.99:0/1599151752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8406e890 0x7f0b840ce780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009d90 tx=0x7f0b7c02a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64e5d4e5c662aa94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.565+0000 7fe069600640 1 -- start start 2024-09-10T07:34:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.565+0000 7f8b53400640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] conn(0x7f8b38074120 0x7f8b38076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.565+0000 7f8b53400640 1 -- 172.21.15.99:0/2876995475 --> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b38076bf0 con 0x7f8b38074120 2024-09-10T07:34:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.565+0000 7f8b53400640 1 -- 172.21.15.99:0/2876995475 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8b4c08aaf0 con 0x7f8b5c0b5270 2024-09-10T07:34:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7f8b5b400640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] conn(0x7f8b38074120 0x7f8b38076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.565+0000 7f0b83e00640 1 -- 172.21.15.99:0/1599151752 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c007740 con 0x7f0b8406e890 2024-09-10T07:34:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7f0b83e00640 1 -- 172.21.15.99:0/1599151752 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7c0078e0 con 0x7f0b8406e890 2024-09-10T07:34:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7f0b83e00640 1 -- 172.21.15.99:0/1599151752 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c007cb0 con 0x7f0b8406e890 2024-09-10T07:34:30.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7fe83aa00640 1 -- 172.21.15.99:0/2170977068 --> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe824076bf0 con 0x7fe824074120 2024-09-10T07:34:30.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.564+0000 7fe83aa00640 1 -- 172.21.15.99:0/2170977068 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe83408f2a0 con 0x7fe84406c3c0 2024-09-10T07:34:30.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.565+0000 7fe843200640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] conn(0x7fe824074120 0x7fe824076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7fe843200640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] conn(0x7fe824074120 0x7fe824076540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7ff224c00640 1 -- 172.21.15.99:0/655563071 <== osd.1 v2:172.21.15.99:6810/452352031 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7ff21400fe50 con 0x7ff2080741d0 2024-09-10T07:34:30.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7fe069600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0640d1c90 0x7fe0641f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7fe069600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0640d56f0 0x7fe0640ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7fe069600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe064162460 0x7fe0640ba020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7fe069600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe0640b5cc0 con 0x7fe0640d56f0 2024-09-10T07:34:30.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7fe069600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe0640b17a0 con 0x7fe0640d1c90 2024-09-10T07:34:30.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7fe069600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe0640b5e40 con 0x7fe064162460 2024-09-10T07:34:30.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.566+0000 7f7e62a00640 1 --2- 172.21.15.99:0/1380597463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e640d1b50 0x7f7e640cf810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e500097a0 tx=0x7f7e5002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=591467ed3115f520 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7f8b5aa00640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8b3806bf00 0x7f8b3806e3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b44035000 tx=0x7f8b4402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7f0b8c600640 1 -- 172.21.15.99:0/1599151752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8406e890 msgr2=0x7f0b840ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7f0b8c600640 1 --2- 172.21.15.99:0/1599151752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8406e890 0x7f0b840ce780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009d90 tx=0x7f0b7c02a6a0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7f8b5b400640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] conn(0x7f8b38074120 0x7f8b38076540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7f0b8c600640 1 -- 172.21.15.99:0/1599151752 shutdown_connections 2024-09-10T07:34:30.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7f0b8c600640 1 --2- 172.21.15.99:0/1599151752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8406e890 0x7f0b840ce780 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7f0b8c600640 1 -- 172.21.15.99:0/1599151752 >> 172.21.15.99:0/1599151752 conn(0x7f0b840b2630 msgr2=0x7f0b840b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7fe841e00640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe82406bf00 0x7fe82406e3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe84415f0b0 tx=0x7fe830008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7fe062a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0640d1c90 0x7fe0641f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7fe062a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0640d1c90 0x7fe0641f54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53692/0 (socket says 172.21.15.99:53692) 2024-09-10T07:34:30.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7fe062a00640 1 -- 172.21.15.99:0/3969264063 learned_addr learned my addr 172.21.15.99:0/3969264063 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7fe063400640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe064162460 0x7fe0640ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7fe05a000640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0640d56f0 0x7fe0640ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7f7e62000640 1 -- 172.21.15.99:0/1380597463 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e50037070 con 0x7f7e640d1b50 2024-09-10T07:34:30.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7f7e62000640 1 -- 172.21.15.99:0/1380597463 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e50032440 con 0x7f7e640d1b50 2024-09-10T07:34:30.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7f7e62000640 1 -- 172.21.15.99:0/1380597463 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e50032810 con 0x7f7e640d1b50 2024-09-10T07:34:30.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.567+0000 7fe83aa00640 1 -- 172.21.15.99:0/2170977068 <== osd.2 v2:172.21.15.99:6808/229492178 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fe824076bf0 con 0x7fe824074120 2024-09-10T07:34:30.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7ff5f3400640 1 -- 172.21.15.99:0/3438822954 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff60009d070 con 0x7ff5f817d1c0 2024-09-10T07:34:30.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7f0b8c600640 1 -- 172.21.15.99:0/1599151752 shutdown_connections 2024-09-10T07:34:30.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7fe062a00640 1 -- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe064162460 msgr2=0x7fe0640ba020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7fe062a00640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe064162460 0x7fe0640ba020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7fe062a00640 1 -- 172.21.15.99:0/3969264063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0640d56f0 msgr2=0x7fe0640ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7f8b53400640 1 -- 172.21.15.99:0/2876995475 <== osd.3 v2:172.21.15.99:6818/1992812983 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f8b38076bf0 con 0x7f8b38074120 2024-09-10T07:34:30.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7f7e6a200640 1 -- 172.21.15.99:0/1380597463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e640d1b50 msgr2=0x7f7e640cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7f7e6a200640 1 --2- 172.21.15.99:0/1380597463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e640d1b50 0x7f7e640cf810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e500097a0 tx=0x7f7e5002a180 comp rx=0 tx=0).stop 2024-09-10T07:34:30.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7fe062a00640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0640d56f0 0x7fe0640ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7fe062a00640 1 -- 172.21.15.99:0/3969264063 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0640c9bd0 con 0x7fe0640d1c90 2024-09-10T07:34:30.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.569+0000 7ff5f3400640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e006bf00 0x7ff5e006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.569+0000 7ff5f3400640 1 -- 172.21.15.99:0/3438822954 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff600106cd0 con 0x7ff5f817d1c0 2024-09-10T07:34:30.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.569+0000 7fe05a000640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0640d56f0 0x7fe0640ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:30.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.569+0000 7fe062a00640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0640d1c90 0x7fe0641f54e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe05400c410 tx=0x7fe05400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.569+0000 7f7e6a200640 1 -- 172.21.15.99:0/1380597463 shutdown_connections 2024-09-10T07:34:30.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.569+0000 7f7e6a200640 1 --2- 172.21.15.99:0/1380597463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e640b91d0 0x7f7e640cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.569+0000 7f7e6a200640 1 --2- 172.21.15.99:0/1380597463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e640d1b50 0x7f7e640cf810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.569+0000 7f7e6a200640 1 -- 172.21.15.99:0/1380597463 >> 172.21.15.99:0/1380597463 conn(0x7f7e640d4c00 msgr2=0x7f7e640d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7ff5f3400640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] conn(0x7ff5e0074120 0x7ff5e0076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7ff5f3400640 1 -- 172.21.15.99:0/3438822954 --> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff600072e50 con 0x7ff5e0074120 2024-09-10T07:34:30.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7ff5f3400640 1 -- 172.21.15.99:0/3438822954 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff6001070c0 con 0x7ff5f817d1c0 2024-09-10T07:34:30.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7ff5ff400640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e006bf00 0x7ff5e006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7f7e6a200640 1 -- 172.21.15.99:0/1380597463 shutdown_connections 2024-09-10T07:34:30.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7f7e6a200640 1 -- 172.21.15.99:0/1380597463 wait complete. 2024-09-10T07:34:30.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7fe05b400640 1 -- 172.21.15.99:0/3969264063 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054017070 con 0x7fe0640d1c90 2024-09-10T07:34:30.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0640ba560 con 0x7fe0640d1c90 2024-09-10T07:34:30.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0640c9e90 con 0x7fe0640d1c90 2024-09-10T07:34:30.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.568+0000 7f0b8c600640 1 -- 172.21.15.99:0/1599151752 wait complete. 2024-09-10T07:34:30.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7fe05b400640 1 -- 172.21.15.99:0/3969264063 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0540035f0 con 0x7fe0640d1c90 2024-09-10T07:34:30.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7f0b8c600640 1 Processor -- start 2024-09-10T07:34:30.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.571+0000 7f0b8c600640 1 -- start start 2024-09-10T07:34:30.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.570+0000 7fe05b400640 1 -- 172.21.15.99:0/3969264063 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054003a20 con 0x7fe0640d1c90 2024-09-10T07:34:30.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.571+0000 7ff5ff400640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e006bf00 0x7ff5e006e3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4033000 tx=0x7ff5f4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.571+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe03c001030 con 0x7fe0640d1c90 2024-09-10T07:34:30.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.572+0000 7f7e6a200640 1 Processor -- start 2024-09-10T07:34:30.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.572+0000 7f0b8c600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b8406e890 0x7f0b84162950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.573+0000 7f0b8c600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840b47d0 0x7f0b841485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.573+0000 7ff5fea00640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] conn(0x7ff5e0074120 0x7ff5e0076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.573+0000 7fe05b400640 1 -- 172.21.15.99:0/3969264063 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe05401a070 con 0x7fe0640d1c90 2024-09-10T07:34:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.573+0000 7f0b8c600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8414cc40 0x7f0b84148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.573+0000 7f0b8c600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b840728d0 con 0x7f0b8406e890 2024-09-10T07:34:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.573+0000 7f0b8c600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0b84072750 con 0x7f0b8414cc40 2024-09-10T07:34:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.573+0000 7f0b89200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840b47d0 0x7f0b841485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.573+0000 7f0b89200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840b47d0 0x7f0b841485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:33898/0 (socket says 172.21.15.99:33898) 2024-09-10T07:34:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.573+0000 7f0b89200640 1 -- 172.21.15.99:0/590729682 learned_addr learned my addr 172.21.15.99:0/590729682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.574+0000 7f0b8a600640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8414cc40 0x7f0b84148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.574+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0b84072a50 con 0x7f0b840b47d0 2024-09-10T07:34:30.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.574+0000 7f0b89c00640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b8406e890 0x7f0b84162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.574+0000 7ff5fea00640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] conn(0x7ff5e0074120 0x7ff5e0076540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.574+0000 7fe05b400640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe04006be60 0x7fe04006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.574+0000 7f7e6a200640 1 -- start start 2024-09-10T07:34:30.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7f0b8a600640 1 -- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840b47d0 msgr2=0x7f0b841485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.574+0000 7fe05b400640 1 -- 172.21.15.99:0/3969264063 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe05408a5d0 con 0x7fe0640d1c90 2024-09-10T07:34:30.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7fe05b400640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] conn(0x7fe040074080 0x7fe0400764a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7fe05b400640 1 -- 172.21.15.99:0/3969264063 --> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe054015e70 con 0x7fe040074080 2024-09-10T07:34:30.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7fe05b400640 1 -- 172.21.15.99:0/3969264063 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe05408a9c0 con 0x7fe0640d1c90 2024-09-10T07:34:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7f0b8a600640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840b47d0 0x7f0b841485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7f0b8a600640 1 -- 172.21.15.99:0/590729682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b8406e890 msgr2=0x7f0b84162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7f0b8a600640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b8406e890 0x7f0b84162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7f0b8a600640 1 -- 172.21.15.99:0/590729682 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b841482c0 con 0x7f0b8414cc40 2024-09-10T07:34:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7fe05a000640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe04006be60 0x7fe04006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7f0b89c00640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b8406e890 0x7f0b84162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:30.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7f0b89200640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840b47d0 0x7f0b841485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:30.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.575+0000 7f0b8a600640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8414cc40 0x7f0b84148b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c031000 tx=0x7f0b7c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7fe063400640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] conn(0x7fe040074080 0x7fe0400764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7fe05a000640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe04006be60 0x7fe04006e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0640b9ec0 tx=0x7fe04c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7ff5f3400640 1 -- 172.21.15.99:0/3438822954 <== osd.0 v2:172.21.15.99:6800/687905162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7ff600072e50 con 0x7ff5e0074120 2024-09-10T07:34:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e6a200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e640b91d0 0x7f7e64072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e6a200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e640d1b50 0x7f7e641f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e6a200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e64162270 0x7f7e640a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e6a200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7e64162650 con 0x7f7e64162270 2024-09-10T07:34:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e6a200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7e640d31e0 con 0x7f7e640b91d0 2024-09-10T07:34:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e6a200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7e641627d0 con 0x7f7e640d1b50 2024-09-10T07:34:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e62a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e640d1b50 0x7f7e641f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e63400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e640b91d0 0x7f7e64072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e63400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e640b91d0 0x7f7e64072cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53706/0 (socket says 172.21.15.99:53706) 2024-09-10T07:34:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e62a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e640d1b50 0x7f7e641f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:33904/0 (socket says 172.21.15.99:33904) 2024-09-10T07:34:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f7e63400640 1 -- 172.21.15.99:0/206491605 learned_addr learned my addr 172.21.15.99:0/206491605 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7fe063400640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] conn(0x7fe040074080 0x7fe0400764a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.576+0000 7f0b81600640 1 -- 172.21.15.99:0/590729682 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c040070 con 0x7f0b8414cc40 2024-09-10T07:34:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f0b81600640 1 -- 172.21.15.99:0/590729682 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7c031ac0 con 0x7f0b8414cc40 2024-09-10T07:34:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f0b81600640 1 -- 172.21.15.99:0/590729682 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c045460 con 0x7f0b8414cc40 2024-09-10T07:34:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f7e63e00640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e64162270 0x7f7e640a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f7e63400640 1 -- 172.21.15.99:0/206491605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e640d1b50 msgr2=0x7f7e641f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f7e63400640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e640d1b50 0x7f7e641f9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f7e63400640 1 -- 172.21.15.99:0/206491605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e64162270 msgr2=0x7f7e640a23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b84162e90 con 0x7f0b8414cc40 2024-09-10T07:34:30.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b84147990 con 0x7f0b8414cc40 2024-09-10T07:34:30.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f7e63400640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e64162270 0x7f7e640a23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.578+0000 7fe05b400640 1 -- 172.21.15.99:0/3969264063 <== osd.5 v2:172.21.15.187:6800/3936971942 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fe054015e70 con 0x7fe040074080 2024-09-10T07:34:30.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f7e63400640 1 -- 172.21.15.99:0/206491605 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e641f98d0 con 0x7f7e640b91d0 2024-09-10T07:34:30.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.577+0000 7f7e63e00640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e64162270 0x7f7e640a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:30.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.579+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b840ce780 con 0x7f0b8414cc40 2024-09-10T07:34:30.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.579+0000 7f7e63400640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e640b91d0 0x7f7e64072cb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400c500 tx=0x7f7e5400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.581+0000 7f0b81600640 1 -- 172.21.15.99:0/590729682 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b7c039040 con 0x7f0b8414cc40 2024-09-10T07:34:30.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.582+0000 7f7e5b400640 1 -- 172.21.15.99:0/206491605 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54017070 con 0x7f7e640b91d0 2024-09-10T07:34:30.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.582+0000 7f7e5b400640 1 -- 172.21.15.99:0/206491605 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e54005ce0 con 0x7f7e640b91d0 2024-09-10T07:34:30.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.582+0000 7f7e5b400640 1 -- 172.21.15.99:0/206491605 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54007330 con 0x7f7e640b91d0 2024-09-10T07:34:30.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.582+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e641f9bb0 con 0x7f7e640b91d0 2024-09-10T07:34:30.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.582+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e641fa4a0 con 0x7f7e640b91d0 2024-09-10T07:34:30.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.583+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e641fa0d0 con 0x7f7e640b91d0 2024-09-10T07:34:30.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.584+0000 7f0b81600640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b6406be80 0x7f0b6406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.584+0000 7f0b81600640 1 -- 172.21.15.99:0/590729682 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0b7c0ac520 con 0x7f0b8414cc40 2024-09-10T07:34:30.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.584+0000 7f0b81600640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] conn(0x7f0b640740a0 0x7f0b640764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.584+0000 7f0b81600640 1 -- 172.21.15.99:0/590729682 --> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b7c0020b0 con 0x7f0b640740a0 2024-09-10T07:34:30.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.584+0000 7f0b81600640 1 -- 172.21.15.99:0/590729682 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0b7c0b3050 con 0x7f0b8414cc40 2024-09-10T07:34:30.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.585+0000 7f0b89c00640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b6406be80 0x7f0b6406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.585+0000 7f0b89200640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] conn(0x7f0b640740a0 0x7f0b640764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.586+0000 7f7e5b400640 1 -- 172.21.15.99:0/206491605 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e5401a070 con 0x7f7e640b91d0 2024-09-10T07:34:30.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.586+0000 7f0b89c00640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b6406be80 0x7f0b6406e340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b841fc1a0 tx=0x7f0b78009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.586+0000 7f0b89200640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] conn(0x7f0b640740a0 0x7f0b640764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.588+0000 7f7e5b400640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e4406bf00 0x7f7e4406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.588+0000 7f0b81600640 1 -- 172.21.15.99:0/590729682 <== osd.7 v2:172.21.15.187:6811/303826834 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f0b7c0020b0 con 0x7f0b640740a0 2024-09-10T07:34:30.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.588+0000 7f7e62a00640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e4406bf00 0x7f7e4406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.590+0000 7f7e5b400640 1 -- 172.21.15.99:0/206491605 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7e5408a990 con 0x7f7e640b91d0 2024-09-10T07:34:30.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.590+0000 7f7e62a00640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e4406bf00 0x7f7e4406e3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e50034000 tx=0x7f7e5002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.590+0000 7f7e5b400640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] conn(0x7f7e44074180 0x7f7e440765a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.590+0000 7f7e5b400640 1 -- 172.21.15.99:0/206491605 --> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e44076c50 con 0x7f7e44074180 2024-09-10T07:34:30.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.590+0000 7f7e5b400640 1 -- 172.21.15.99:0/206491605 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7e5408ad80 con 0x7f7e640b91d0 2024-09-10T07:34:30.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.591+0000 7f7e63e00640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] conn(0x7f7e44074180 0x7f7e440765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.591+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 --> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff204002dd0 con 0x7ff2080741d0 2024-09-10T07:34:30.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.592+0000 7ff224c00640 1 -- 172.21.15.99:0/655563071 <== osd.1 v2:172.21.15.99:6810/452352031 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff204002dd0 con 0x7ff2080741d0 2024-09-10T07:34:30.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.592+0000 7f7e63e00640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] conn(0x7f7e44074180 0x7f7e440765a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.592+0000 7f7e5b400640 1 -- 172.21.15.99:0/206491605 <== osd.6 v2:172.21.15.187:6808/2894508630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f7e44076c50 con 0x7f7e44074180 2024-09-10T07:34:30.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.593+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] conn(0x7ff2080741d0 msgr2=0x7ff2080765f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.593+0000 7ff22e200640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] conn(0x7ff2080741d0 0x7ff2080765f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.594+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff20806c030 msgr2=0x7ff20806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.594+0000 7ff22e200640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff20806c030 0x7ff20806e4f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff220006c30 tx=0x7ff21c02e000 comp rx=0 tx=0).stop 2024-09-10T07:34:30.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.594+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff220007070 msgr2=0x7ff220180930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.594+0000 7ff22e200640 1 --2- 172.21.15.99:0/655563071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff220007070 0x7ff220180930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff21400b410 tx=0x7ff21400b810 comp rx=0 tx=0).stop 2024-09-10T07:34:30.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.594+0000 7ff22d800640 1 -- 172.21.15.99:0/655563071 reap_dead start 2024-09-10T07:34:30.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.594+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 --> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe84415a1d0 con 0x7fe824074120 2024-09-10T07:34:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.594+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 shutdown_connections 2024-09-10T07:34:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.594+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 >> 172.21.15.99:0/655563071 conn(0x7ff22001d930 msgr2=0x7ff2200331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.594+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 shutdown_connections 2024-09-10T07:34:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.594+0000 7ff22e200640 1 -- 172.21.15.99:0/655563071 wait complete. 2024-09-10T07:34:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.595+0000 7fe83aa00640 1 -- 172.21.15.99:0/2170977068 <== osd.2 v2:172.21.15.99:6808/229492178 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe84415a1d0 con 0x7fe824074120 2024-09-10T07:34:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.598+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 --> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b30002dd0 con 0x7f8b38074120 2024-09-10T07:34:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7f8b53400640 1 -- 172.21.15.99:0/2876995475 <== osd.3 v2:172.21.15.99:6818/1992812983 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8b30002dd0 con 0x7f8b38074120 2024-09-10T07:34:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.598+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] conn(0x7fe824074120 msgr2=0x7fe824076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.598+0000 7fe848a00640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] conn(0x7fe824074120 0x7fe824076540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe82406bf00 msgr2=0x7fe82406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7fe848a00640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe82406bf00 0x7fe82406e3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe84415f0b0 tx=0x7fe830008040 comp rx=0 tx=0).stop 2024-09-10T07:34:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe84406c3c0 msgr2=0x7fe844152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7fe848a00640 1 --2- 172.21.15.99:0/2170977068 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe84406c3c0 0x7fe844152bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe83400c460 tx=0x7fe83400c920 comp rx=0 tx=0).stop 2024-09-10T07:34:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7fe843200640 1 -- 172.21.15.99:0/2170977068 reap_dead start 2024-09-10T07:34:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 shutdown_connections 2024-09-10T07:34:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 >> 172.21.15.99:0/2170977068 conn(0x7fe844068070 msgr2=0x7fe84406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 shutdown_connections 2024-09-10T07:34:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7fe848a00640 1 -- 172.21.15.99:0/2170977068 wait complete. 2024-09-10T07:34:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.599+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 --> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa8680addf0 con 0x7fa848074100 2024-09-10T07:34:30.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.600+0000 7fa865600640 1 -- 172.21.15.99:0/375584017 <== osd.4 v2:172.21.15.187:6824/3032215980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa8680addf0 con 0x7fa848074100 2024-09-10T07:34:30.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.600+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] conn(0x7f8b38074120 msgr2=0x7f8b38076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.600+0000 7f8b61c00640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] conn(0x7f8b38074120 0x7f8b38076540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8b3806bf00 msgr2=0x7f8b3806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7f8b61c00640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8b3806bf00 0x7f8b3806e3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b44035000 tx=0x7f8b4402f000 comp rx=0 tx=0).stop 2024-09-10T07:34:30.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b5c0b5270 msgr2=0x7f8b5c146650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7f8b61c00640 1 --2- 172.21.15.99:0/2876995475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b5c0b5270 0x7f8b5c146650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c430 tx=0x7f8b4c00c8f0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 >> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] conn(0x7fa848074100 msgr2=0x7fa848076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7fa870000640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] conn(0x7fa848074100 0x7fa848076520 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7f8b5b400640 1 -- 172.21.15.99:0/2876995475 reap_dead start 2024-09-10T07:34:30.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa84806bf00 msgr2=0x7fa84806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7fa870000640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa84806bf00 0x7fa84806e3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa85c02a0c0 tx=0x7fa85c02e000 comp rx=0 tx=0).stop 2024-09-10T07:34:30.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa868163240 msgr2=0x7fa8680abd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7fa870000640 1 --2- 172.21.15.99:0/375584017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa868163240 0x7fa8680abd30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa86000c890 tx=0x7fa86000cd50 comp rx=0 tx=0).stop 2024-09-10T07:34:30.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 shutdown_connections 2024-09-10T07:34:30.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 >> 172.21.15.99:0/2876995475 conn(0x7f8b5c0b2bc0 msgr2=0x7f8b5c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 shutdown_connections 2024-09-10T07:34:30.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7fa86e000640 1 -- 172.21.15.99:0/375584017 reap_dead start 2024-09-10T07:34:30.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7f8b61c00640 1 -- 172.21.15.99:0/2876995475 wait complete. 2024-09-10T07:34:30.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 shutdown_connections 2024-09-10T07:34:30.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.601+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 >> 172.21.15.99:0/375584017 conn(0x7fa8680b2630 msgr2=0x7fa8680725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.602+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 shutdown_connections 2024-09-10T07:34:30.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.602+0000 7fa870000640 1 -- 172.21.15.99:0/375584017 wait complete. 2024-09-10T07:34:30.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.606+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 --> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5f8009f80 con 0x7ff5e0074120 2024-09-10T07:34:30.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.607+0000 7ff5f3400640 1 -- 172.21.15.99:0/3438822954 <== osd.0 v2:172.21.15.99:6800/687905162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff5f8009f80 con 0x7ff5e0074120 2024-09-10T07:34:30.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.607+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] conn(0x7ff5e0074120 msgr2=0x7ff5e0076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.607+0000 7ff606400640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] conn(0x7ff5e0074120 0x7ff5e0076540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.609+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 --> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe03c002dd0 con 0x7fe040074080 2024-09-10T07:34:30.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.610+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e006bf00 msgr2=0x7ff5e006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.610+0000 7ff606400640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e006bf00 0x7ff5e006e3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4033000 tx=0x7ff5f4008030 comp rx=0 tx=0).stop 2024-09-10T07:34:30.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.610+0000 7fe05b400640 1 -- 172.21.15.99:0/3969264063 <== osd.5 v2:172.21.15.187:6800/3936971942 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe03c002dd0 con 0x7fe040074080 2024-09-10T07:34:30.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.610+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f817d1c0 msgr2=0x7ff5f80e0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.610+0000 7ff606400640 1 --2- 172.21.15.99:0/3438822954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5f817d1c0 0x7ff5f80e0be0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff600051220 tx=0x7ff600076560 comp rx=0 tx=0).stop 2024-09-10T07:34:30.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.610+0000 7ff5ffe00640 1 -- 172.21.15.99:0/3438822954 reap_dead start 2024-09-10T07:34:30.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.610+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 shutdown_connections 2024-09-10T07:34:30.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.610+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 >> 172.21.15.99:0/3438822954 conn(0x7ff5f8036090 msgr2=0x7ff5f80356d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.611+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] conn(0x7fe040074080 msgr2=0x7fe0400764a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.611+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 shutdown_connections 2024-09-10T07:34:30.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.611+0000 7ff606400640 1 -- 172.21.15.99:0/3438822954 wait complete. 2024-09-10T07:34:30.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.611+0000 7fe069600640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] conn(0x7fe040074080 0x7fe0400764a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.612+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe04006be60 msgr2=0x7fe04006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.612+0000 7fe069600640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe04006be60 0x7fe04006e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe0640b9ec0 tx=0x7fe04c008040 comp rx=0 tx=0).stop 2024-09-10T07:34:30.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.612+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0640d1c90 msgr2=0x7fe0641f54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.612+0000 7fe069600640 1 --2- 172.21.15.99:0/3969264063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0640d1c90 0x7fe0641f54e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe05400c410 tx=0x7fe05400c8d0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.612+0000 7fe063400640 1 -- 172.21.15.99:0/3969264063 reap_dead start 2024-09-10T07:34:30.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.614+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 --> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0b84147e20 con 0x7f0b640740a0 2024-09-10T07:34:30.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.614+0000 7f0b81600640 1 -- 172.21.15.99:0/590729682 <== osd.7 v2:172.21.15.187:6811/303826834 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0b84147e20 con 0x7f0b640740a0 2024-09-10T07:34:30.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.614+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 shutdown_connections 2024-09-10T07:34:30.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.614+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 >> 172.21.15.99:0/3969264063 conn(0x7fe0640d4bd0 msgr2=0x7fe0640d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.660 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:30.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.615+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 shutdown_connections 2024-09-10T07:34:30.661 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T07:34:30.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.616+0000 7fe069600640 1 -- 172.21.15.99:0/3969264063 wait complete. 2024-09-10T07:34:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.616+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] conn(0x7f0b640740a0 msgr2=0x7f0b640764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.616+0000 7f0b8c600640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] conn(0x7f0b640740a0 0x7f0b640764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.616+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b6406be80 msgr2=0x7f0b6406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.616+0000 7f0b8c600640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b6406be80 0x7f0b6406e340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b841fc1a0 tx=0x7f0b78009060 comp rx=0 tx=0).stop 2024-09-10T07:34:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.616+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8414cc40 msgr2=0x7f0b84148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.616+0000 7f0b8c600640 1 --2- 172.21.15.99:0/590729682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8414cc40 0x7f0b84148b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c031000 tx=0x7f0b7c004a40 comp rx=0 tx=0).stop 2024-09-10T07:34:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.617+0000 7f0b8a600640 1 -- 172.21.15.99:0/590729682 reap_dead start 2024-09-10T07:34:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.617+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 shutdown_connections 2024-09-10T07:34:30.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.617+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 >> 172.21.15.99:0/590729682 conn(0x7f0b840b2630 msgr2=0x7f0b840b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.617+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 shutdown_connections 2024-09-10T07:34:30.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.617+0000 7f0b8c600640 1 -- 172.21.15.99:0/590729682 wait complete. 2024-09-10T07:34:30.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.618+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 --> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e6408e6d0 con 0x7f7e44074180 2024-09-10T07:34:30.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.619+0000 7f7e5b400640 1 -- 172.21.15.99:0/206491605 <== osd.6 v2:172.21.15.187:6808/2894508630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7e6408e6d0 con 0x7f7e44074180 2024-09-10T07:34:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.620+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 >> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] conn(0x7f7e44074180 msgr2=0x7f7e440765a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.620+0000 7f7e6a200640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] conn(0x7f7e44074180 0x7f7e440765a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.620+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e4406bf00 msgr2=0x7f7e4406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.620+0000 7f7e6a200640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e4406bf00 0x7f7e4406e3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e50034000 tx=0x7f7e5002e000 comp rx=0 tx=0).stop 2024-09-10T07:34:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.620+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e640b91d0 msgr2=0x7f7e64072cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.620+0000 7f7e6a200640 1 --2- 172.21.15.99:0/206491605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e640b91d0 0x7f7e64072cb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400c500 tx=0x7f7e5400c9c0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.620+0000 7f7e63e00640 1 -- 172.21.15.99:0/206491605 reap_dead start 2024-09-10T07:34:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.620+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 shutdown_connections 2024-09-10T07:34:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.620+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 >> 172.21.15.99:0/206491605 conn(0x7f7e640d4c00 msgr2=0x7f7e640d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.621+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 shutdown_connections 2024-09-10T07:34:30.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.621+0000 7f7e6a200640 1 -- 172.21.15.99:0/206491605 wait complete. 2024-09-10T07:34:30.666 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:30.666 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T07:34:30.667 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:30.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T07:34:30.668 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:30.668 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T07:34:30.669 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:30.669 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T07:34:30.670 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:30.670 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T07:34:30.671 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:30.671 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T07:34:30.672 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:30.672 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T07:34:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.976+0000 7f884be00640 1 Processor -- start 2024-09-10T07:34:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.977+0000 7f5d81c00640 1 Processor -- start 2024-09-10T07:34:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.977+0000 7f884be00640 1 -- start start 2024-09-10T07:34:30.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.977+0000 7f5d81c00640 1 -- start start 2024-09-10T07:34:30.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.980+0000 7f5d81c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d7c15aa20 0x7f5d7c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.979+0000 7f884be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f884403ce50 0x7f8844005d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.979+0000 7f884be00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8844006270 0x7f88440066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.979+0000 7f884be00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88440e2f70 con 0x7f88440e2b90 2024-09-10T07:34:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.979+0000 7f884be00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f88440577a0 con 0x7f884403ce50 2024-09-10T07:34:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.979+0000 7f884be00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8844057a60 con 0x7f8844006270 2024-09-10T07:34:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.980+0000 7f884b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8844006270 0x7f88440066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.978+0000 7fe9dce00640 1 Processor -- start 2024-09-10T07:34:30.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.978+0000 7fe9dce00640 1 -- start start 2024-09-10T07:34:30.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.980+0000 7fe9dce00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe9d806f4b0 0x7fe9d81581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.980+0000 7f884b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8844006270 0x7f88440066a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53708/0 (socket says 172.21.15.99:53708) 2024-09-10T07:34:30.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.980+0000 7f884b400640 1 -- 172.21.15.99:0/2893492519 learned_addr learned my addr 172.21.15.99:0/2893492519 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.980+0000 7f884a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f884403ce50 0x7f8844005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.980+0000 7fe9dce00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d8072070 con 0x7fe9d806d140 2024-09-10T07:34:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.980+0000 7fe9dce00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d8072350 con 0x7fe9d80afda0 2024-09-10T07:34:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.980+0000 7fe9dce00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d8071e20 con 0x7fe9d806f4b0 2024-09-10T07:34:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.981+0000 7fe9d7400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe9d806f4b0 0x7fe9d81581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.981+0000 7f5d81c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5d7c15b510 0x7f5d7c0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.981+0000 7f884a000640 1 -- 172.21.15.99:0/2893492519 >> v2:172.21.15.187:3300/0 conn(0x7f8844006270 msgr2=0x7f88440066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7fe9cea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe9d806d140 0x7fe9d80af690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38292/0 (socket says 172.21.15.99:38292) 2024-09-10T07:34:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.981+0000 7f884a000640 1 --2- 172.21.15.99:0/2893492519 >> v2:172.21.15.187:3300/0 conn(0x7f8844006270 0x7f88440066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7fe9d7e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fe9d80afda0 0x7fe9d8072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:47802/0 (socket says 172.21.15.99:47802) 2024-09-10T07:34:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7fe9d7400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe9d806f4b0 0x7fe9d81581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53724/0 (socket says 172.21.15.99:53724) 2024-09-10T07:34:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7fe9d7400640 1 -- 172.21.15.99:0/1968760056 learned_addr learned my addr 172.21.15.99:0/1968760056 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7f884a000640 1 -- 172.21.15.99:0/2893492519 >> v1:172.21.15.99:6789/0 conn(0x7f88440e2b90 legacy=0x7f8844053a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7fe9d7400640 1 -- 172.21.15.99:0/1968760056 >> v1:172.21.15.187:6789/0 conn(0x7fe9d80afda0 legacy=0x7fe9d8072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7f5d7b400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f5d7c0af690 0x7f5d7c15ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:47798/0 (socket says 172.21.15.99:47798) 2024-09-10T07:34:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7f5d7b400640 1 -- 172.21.15.99:0/2064951897 learned_addr learned my addr 172.21.15.99:0/2064951897 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7f5d81c00640 1 -- 172.21.15.99:0/2064951897 --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d7c06d680 con 0x7f5d7c0af690 2024-09-10T07:34:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7f5d81c00640 1 -- 172.21.15.99:0/2064951897 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f5d7c0b0030 con 0x7f5d7c15b510 2024-09-10T07:34:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7f5d81c00640 1 -- 172.21.15.99:0/2064951897 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7c15bbb0 con 0x7f5d7c15aa20 2024-09-10T07:34:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7f5d81200640 1 --2- 172.21.15.99:0/2064951897 >> v2:172.21.15.187:3300/0 conn(0x7f5d7c15b510 0x7f5d7c0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.981+0000 7f5d7be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d7c15aa20 0x7f5d7c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7fe9d7400640 1 -- 172.21.15.99:0/1968760056 >> v1:172.21.15.99:6789/0 conn(0x7fe9d806d140 legacy=0x7fe9d80af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.982+0000 7f8849600640 1 -- 172.21.15.99:0/2893492519 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829577543 0 0) 0x7f88440e2f70 con 0x7f88440e2b90 2024-09-10T07:34:30.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.983+0000 7fe9d7400640 1 -- 172.21.15.99:0/1968760056 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d81625c0 con 0x7fe9d806f4b0 2024-09-10T07:34:30.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.983+0000 7f5d7aa00640 1 -- 172.21.15.99:0/2064951897 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509030685 0 0) 0x7f5d7c06d680 con 0x7f5d7c0af690 2024-09-10T07:34:30.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.983+0000 7f884a000640 1 -- 172.21.15.99:0/2893492519 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8844057d40 con 0x7f884403ce50 2024-09-10T07:34:30.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.983+0000 7f5d7aa00640 1 -- 172.21.15.99:0/2064951897 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d60004630 con 0x7f5d7c0af690 2024-09-10T07:34:30.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.983+0000 7f5d81200640 1 -- 172.21.15.99:0/2064951897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d7c15aa20 msgr2=0x7f5d7c06d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:30.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.983+0000 7f5d81200640 1 --2- 172.21.15.99:0/2064951897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d7c15aa20 0x7f5d7c06d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.983+0000 7f5d81200640 1 -- 172.21.15.99:0/2064951897 >> v1:172.21.15.187:6789/0 conn(0x7f5d7c0af690 legacy=0x7f5d7c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.983+0000 7f5d81200640 1 -- 172.21.15.99:0/2064951897 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c071f50 con 0x7f5d7c15b510 2024-09-10T07:34:30.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.984+0000 7f884a000640 1 --2- 172.21.15.99:0/2893492519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f884403ce50 0x7f8844005d30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f884c065710 tx=0x7f884c0a6860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ae74c5c8322fed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.985+0000 7f8849600640 1 -- 172.21.15.99:0/2893492519 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0ac620 con 0x7f884403ce50 2024-09-10T07:34:30.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.985+0000 7f5d81200640 1 --2- 172.21.15.99:0/2064951897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d7c15b510 0x7f5d7c0afaf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009d90 tx=0x7f5d7402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4de0eecc9d60c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.985+0000 7f5d7aa00640 1 -- 172.21.15.99:0/2064951897 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74007740 con 0x7f5d7c15b510 2024-09-10T07:34:30.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.986+0000 7f5d7aa00640 1 -- 172.21.15.99:0/2064951897 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d740078e0 con 0x7f5d7c15b510 2024-09-10T07:34:30.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.986+0000 7f5d7aa00640 1 -- 172.21.15.99:0/2064951897 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74007cb0 con 0x7f5d7c15b510 2024-09-10T07:34:30.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.985+0000 7f8849600640 1 -- 172.21.15.99:0/2893492519 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884c0ac800 con 0x7f884403ce50 2024-09-10T07:34:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.986+0000 7f884be00640 1 -- 172.21.15.99:0/2893492519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f884403ce50 msgr2=0x7f8844005d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.986+0000 7f884be00640 1 --2- 172.21.15.99:0/2893492519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f884403ce50 0x7f8844005d30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f884c065710 tx=0x7f884c0a6860 comp rx=0 tx=0).stop 2024-09-10T07:34:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.986+0000 7f884be00640 1 -- 172.21.15.99:0/2893492519 shutdown_connections 2024-09-10T07:34:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.986+0000 7f884be00640 1 --2- 172.21.15.99:0/2893492519 >> v2:172.21.15.187:3300/0 conn(0x7f8844006270 0x7f88440066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f884be00640 1 --2- 172.21.15.99:0/2893492519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f884403ce50 0x7f8844005d30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f884be00640 1 -- 172.21.15.99:0/2893492519 >> 172.21.15.99:0/2893492519 conn(0x7f884403a520 msgr2=0x7f884403a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f5d81c00640 1 -- 172.21.15.99:0/2064951897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d7c15b510 msgr2=0x7f5d7c0afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f5d81c00640 1 --2- 172.21.15.99:0/2064951897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d7c15b510 0x7f5d7c0afaf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009d90 tx=0x7f5d7402a660 comp rx=0 tx=0).stop 2024-09-10T07:34:30.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f884be00640 1 -- 172.21.15.99:0/2893492519 shutdown_connections 2024-09-10T07:34:30.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f5d81c00640 1 -- 172.21.15.99:0/2064951897 shutdown_connections 2024-09-10T07:34:30.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f5d81c00640 1 --2- 172.21.15.99:0/2064951897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d7c15b510 0x7f5d7c0afaf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f5d81c00640 1 --2- 172.21.15.99:0/2064951897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d7c15aa20 0x7f5d7c06d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:30.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f5d81c00640 1 -- 172.21.15.99:0/2064951897 >> 172.21.15.99:0/2064951897 conn(0x7f5d7c068070 msgr2=0x7f5d7c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:30.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f5d81c00640 1 -- 172.21.15.99:0/2064951897 shutdown_connections 2024-09-10T07:34:30.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.988+0000 7f5d81c00640 1 -- 172.21.15.99:0/2064951897 wait complete. 2024-09-10T07:34:30.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7fe9d7400640 1 --2- 172.21.15.99:0/1968760056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d806f4b0 0x7fe9d81581b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009870 tx=0x7fe9c002a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfe9bdd995ba4110 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:30.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.988+0000 7f982a200640 1 Processor -- start 2024-09-10T07:34:30.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.988+0000 7f982a200640 1 -- start start 2024-09-10T07:34:30.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.987+0000 7f884be00640 1 -- 172.21.15.99:0/2893492519 wait complete. 2024-09-10T07:34:30.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.989+0000 7f884be00640 1 Processor -- start 2024-09-10T07:34:30.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.990+0000 7f884be00640 1 -- start start 2024-09-10T07:34:30.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.990+0000 7fe9d6a00640 1 -- 172.21.15.99:0/1968760056 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0037070 con 0x7fe9d806f4b0 2024-09-10T07:34:30.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.990+0000 7fe9d6a00640 1 -- 172.21.15.99:0/1968760056 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c0032640 con 0x7fe9d806f4b0 2024-09-10T07:34:30.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.990+0000 7fe9d6a00640 1 -- 172.21.15.99:0/1968760056 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0037070 con 0x7fe9d806f4b0 2024-09-10T07:34:30.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.990+0000 7f5d81c00640 1 Processor -- start 2024-09-10T07:34:30.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.991+0000 7f5d81c00640 1 -- start start 2024-09-10T07:34:30.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.991+0000 7f982a200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f98240d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.991+0000 7fe9dce00640 1 -- 172.21.15.99:0/1968760056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d806f4b0 msgr2=0x7fe9d81581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.991+0000 7fe9dce00640 1 --2- 172.21.15.99:0/1968760056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d806f4b0 0x7fe9d81581b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009870 tx=0x7fe9c002a330 comp rx=0 tx=0).stop 2024-09-10T07:34:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7f982a200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98240718b0 con 0x7f982406d870 2024-09-10T07:34:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7f981be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f98240d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7f884be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8844006270 0x7f884404eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7f982a200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982406e530 con 0x7f982415a970 2024-09-10T07:34:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7f981be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f98240d0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:33932/0 (socket says 172.21.15.99:33932) 2024-09-10T07:34:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7f981be00640 1 -- 172.21.15.99:0/1601500384 learned_addr learned my addr 172.21.15.99:0/1601500384 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7f982a200640 1 -- 172.21.15.99:0/1601500384 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f982406e810 con 0x7f98240d0990 2024-09-10T07:34:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7f884be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f884403ce50 0x7f884400c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7f884aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8844006270 0x7f884404eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7fe9dce00640 1 -- 172.21.15.99:0/1968760056 shutdown_connections 2024-09-10T07:34:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7fe9dce00640 1 --2- 172.21.15.99:0/1968760056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d806f4b0 0x7fe9d81581b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.992+0000 7fe9dce00640 1 -- 172.21.15.99:0/1968760056 >> 172.21.15.99:0/1968760056 conn(0x7fe9d806bdf0 msgr2=0x7fe9d806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.993+0000 7fe9dce00640 1 -- 172.21.15.99:0/1968760056 shutdown_connections 2024-09-10T07:34:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.993+0000 7fe9dce00640 1 -- 172.21.15.99:0/1968760056 wait complete. 2024-09-10T07:34:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.993+0000 7fbd2e200640 1 Processor -- start 2024-09-10T07:34:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.993+0000 7f5d81c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d7c0af690 0x7f5d7c1f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.993+0000 7f884aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8844006270 0x7f884404eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:33940/0 (socket says 172.21.15.99:33940) 2024-09-10T07:34:31.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.993+0000 7f884be00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440e2b90 0x7f88440cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.993+0000 7f981be00640 1 -- 172.21.15.99:0/1601500384 >> v1:172.21.15.187:6789/0 conn(0x7f982415a970 legacy=0x7f982415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:31.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.993+0000 7f981be00640 1 -- 172.21.15.99:0/1601500384 >> v1:172.21.15.99:6789/0 conn(0x7f982406d870 legacy=0x7f982406dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.993+0000 7f981be00640 1 -- 172.21.15.99:0/1601500384 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9824071b50 con 0x7f98240d0990 2024-09-10T07:34:31.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.993+0000 7fbd2e200640 1 -- start start 2024-09-10T07:34:31.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.994+0000 7f5d81c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d7c15aa20 0x7f5d7c2046d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.994+0000 7f5d81c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d7c15b510 0x7f5d7c204c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.994+0000 7f884b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440e2b90 0x7f88440cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.994+0000 7f884b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440e2b90 0x7f88440cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53732/0 (socket says 172.21.15.99:53732) 2024-09-10T07:34:31.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.994+0000 7f884be00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8844054110 con 0x7f884403ce50 2024-09-10T07:34:31.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.994+0000 7f884aa00640 1 -- 172.21.15.99:0/1094011487 learned_addr learned my addr 172.21.15.99:0/1094011487 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:31.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8844058300 con 0x7f88440e2b90 2024-09-10T07:34:31.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f5d81c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c06c3c0 con 0x7f5d7c15aa20 2024-09-10T07:34:31.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8844054290 con 0x7f8844006270 2024-09-10T07:34:31.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f884a000640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f884403ce50 0x7f884400c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f981be00640 1 --2- 172.21.15.99:0/1601500384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f98240d0dd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98140098a0 tx=0x7f981402a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e009b5793aaf17eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7fbd2e200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd2814cc40 0x7fbd280ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7fbd2e200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd280b47d0 0x7fbd280b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f5d7be00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d7c0af690 0x7f5d7c1f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f5d7be00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d7c0af690 0x7f5d7c1f78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53746/0 (socket says 172.21.15.99:53746) 2024-09-10T07:34:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f5d7be00640 1 -- 172.21.15.99:0/1967735267 learned_addr learned my addr 172.21.15.99:0/1967735267 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7fbd2e200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd280716b0 con 0x7fbd2806e180 2024-09-10T07:34:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7fbd2e200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbd280cecc0 con 0x7fbd2814cc40 2024-09-10T07:34:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7fbd2e200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbd28071990 con 0x7fbd280b47d0 2024-09-10T07:34:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f5d7b400640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d7c15aa20 0x7f5d7c2046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c072510 con 0x7f5d7c0af690 2024-09-10T07:34:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7c06c540 con 0x7f5d7c15b510 2024-09-10T07:34:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7f4887a00640 1 Processor -- start 2024-09-10T07:34:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.995+0000 7fbd27400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd2814cc40 0x7fbd280ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7f9823e00640 1 -- 172.21.15.99:0/1601500384 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814037070 con 0x7f98240d0990 2024-09-10T07:34:31.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7fbd27e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fbd2806e180 0x7fbd28072750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:47822/0 (socket says 172.21.15.99:47822) 2024-09-10T07:34:31.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7fbd27400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd2814cc40 0x7fbd280ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53760/0 (socket says 172.21.15.99:53760) 2024-09-10T07:34:31.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7fbd27e00640 1 -- 172.21.15.99:0/2178087066 learned_addr learned my addr 172.21.15.99:0/2178087066 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:31.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7f9823e00640 1 -- 172.21.15.99:0/1601500384 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9814032440 con 0x7f98240d0990 2024-09-10T07:34:31.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7f9823e00640 1 -- 172.21.15.99:0/1601500384 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814032810 con 0x7f98240d0990 2024-09-10T07:34:31.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7fbd26a00640 1 --2- 172.21.15.99:0/2178087066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd280b47d0 0x7fbd280b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7f4887a00640 1 -- start start 2024-09-10T07:34:31.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7fe9dce00640 1 Processor -- start 2024-09-10T07:34:31.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7fbd26a00640 1 -- 172.21.15.99:0/2178087066 >> v2:172.21.15.187:3300/0 conn(0x7fbd2814cc40 msgr2=0x7fbd280ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:31.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7fbd26a00640 1 --2- 172.21.15.99:0/2178087066 >> v2:172.21.15.187:3300/0 conn(0x7fbd2814cc40 0x7fbd280ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7f5d81200640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d7c15b510 0x7f5d7c204c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7fe9dce00640 1 -- start start 2024-09-10T07:34:31.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f5d7b400640 1 -- 172.21.15.99:0/1967735267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d7c15b510 msgr2=0x7f5d7c204c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f5d7b400640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d7c15b510 0x7f5d7c204c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f5d7b400640 1 -- 172.21.15.99:0/1967735267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d7c0af690 msgr2=0x7f5d7c1f78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f5d7b400640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d7c0af690 0x7f5d7c1f78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f5d7b400640 1 -- 172.21.15.99:0/1967735267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c0b04f0 con 0x7f5d7c15aa20 2024-09-10T07:34:31.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f982a200640 1 -- 172.21.15.99:0/1601500384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 msgr2=0x7f98240d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f982a200640 1 --2- 172.21.15.99:0/1601500384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f98240d0dd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98140098a0 tx=0x7f981402a2a0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7f884b400640 1 -- 172.21.15.99:0/1094011487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8844006270 msgr2=0x7f884404eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7f884b400640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8844006270 0x7f884404eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f884b400640 1 -- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f884403ce50 msgr2=0x7f884400c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f884b400640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f884403ce50 0x7f884400c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7fbd26a00640 1 -- 172.21.15.99:0/2178087066 >> v1:172.21.15.187:6789/0 conn(0x7fbd2806e180 legacy=0x7fbd28072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7fbd26a00640 1 -- 172.21.15.99:0/2178087066 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd28071c70 con 0x7fbd280b47d0 2024-09-10T07:34:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.996+0000 7fbd27400640 1 --2- 172.21.15.99:0/2178087066 >> v2:172.21.15.187:3300/0 conn(0x7fbd2814cc40 0x7fbd280ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f884b400640 1 -- 172.21.15.99:0/1094011487 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884404f410 con 0x7f88440e2b90 2024-09-10T07:34:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f884a000640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f884403ce50 0x7f884400c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.997+0000 7f5d7b400640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d7c15aa20 0x7f5d7c2046d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c071640 tx=0x7f5d6800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f4887a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4880162270 0x7f48800d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f884b400640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440e2b90 0x7f88440cc370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f883c00e640 tx=0x7f883c00eb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f982a200640 1 -- 172.21.15.99:0/1601500384 shutdown_connections 2024-09-10T07:34:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f982a200640 1 --2- 172.21.15.99:0/1601500384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f98240d0dd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f982a200640 1 -- 172.21.15.99:0/1601500384 >> 172.21.15.99:0/1601500384 conn(0x7f982406bc10 msgr2=0x7f982406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f4887a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4880162650 0x7f48800d1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f4887a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48800d3530 con 0x7f48800d5720 2024-09-10T07:34:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f4887a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f48800b7a50 con 0x7f4880162270 2024-09-10T07:34:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f4887a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f48800b7d30 con 0x7f4880162650 2024-09-10T07:34:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f5d73e00640 1 -- 172.21.15.99:0/1967735267 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68017070 con 0x7f5d7c15aa20 2024-09-10T07:34:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f5d73e00640 1 -- 172.21.15.99:0/1967735267 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d68005ce0 con 0x7f5d7c15aa20 2024-09-10T07:34:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f5d73e00640 1 -- 172.21.15.99:0/1967735267 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d680072f0 con 0x7f5d7c15aa20 2024-09-10T07:34:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f4885000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4880162270 0x7f48800d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f4885000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4880162270 0x7f48800d1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52440/0 (socket says 172.21.15.99:52440) 2024-09-10T07:34:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f4885000640 1 -- 172.21.15.99:0/759737932 learned_addr learned my addr 172.21.15.99:0/759737932 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f8842a00640 1 -- 172.21.15.99:0/1094011487 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c017070 con 0x7f88440e2b90 2024-09-10T07:34:31.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f982a200640 1 -- 172.21.15.99:0/1601500384 shutdown_connections 2024-09-10T07:34:31.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7fbd26a00640 1 --2- 172.21.15.99:0/2178087066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd280b47d0 0x7fbd280b5680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbd180097a0 tx=0x7fbd1802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d0f053ef63df11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7c0b07d0 con 0x7f5d7c15aa20 2024-09-10T07:34:31.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7fe9dce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9d806d140 0x7fe9d815f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7fe9dce00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d806f4b0 0x7fe9d81617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7fe9dce00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9d80afda0 0x7fe9d8156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7fe9dce00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d806d590 con 0x7fe9d806d140 2024-09-10T07:34:31.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7fe9dce00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d80726c0 con 0x7fe9d806f4b0 2024-09-10T07:34:31.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7fe9dce00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d806d710 con 0x7fe9d80afda0 2024-09-10T07:34:31.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7c0b0d90 con 0x7f5d7c15aa20 2024-09-10T07:34:31.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f8842a00640 1 -- 172.21.15.99:0/1094011487 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883c013680 con 0x7f88440e2b90 2024-09-10T07:34:31.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.998+0000 7f8842a00640 1 -- 172.21.15.99:0/1094011487 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c017070 con 0x7f88440e2b90 2024-09-10T07:34:31.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884400bc00 con 0x7f88440e2b90 2024-09-10T07:34:31.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7fbd26000640 1 -- 172.21.15.99:0/2178087066 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18037070 con 0x7fbd280b47d0 2024-09-10T07:34:31.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7fbd26000640 1 -- 172.21.15.99:0/2178087066 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd18032440 con 0x7fbd280b47d0 2024-09-10T07:34:31.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7fbd26000640 1 -- 172.21.15.99:0/2178087066 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18032810 con 0x7fbd280b47d0 2024-09-10T07:34:31.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7f4877e00640 1 --2- 172.21.15.99:0/759737932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4880162650 0x7f48800d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7f982a200640 1 -- 172.21.15.99:0/1601500384 wait complete. 2024-09-10T07:34:31.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9d80afda0 0x7fe9d8156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9d80afda0 0x7fe9d8156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:33988/0 (socket says 172.21.15.99:33988) 2024-09-10T07:34:31.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7fe9d7e00640 1 -- 172.21.15.99:0/2468219794 learned_addr learned my addr 172.21.15.99:0/2468219794 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:31.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7f4877e00640 1 -- 172.21.15.99:0/759737932 >> v2:172.21.15.99:3300/0 conn(0x7f4880162270 msgr2=0x7f48800d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:31.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7f4877e00640 1 --2- 172.21.15.99:0/759737932 >> v2:172.21.15.99:3300/0 conn(0x7f4880162270 0x7f48800d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7f4877e00640 1 -- 172.21.15.99:0/759737932 >> v1:172.21.15.99:6789/0 conn(0x7f48800d5720 legacy=0x7f48800b81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:31.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:30.999+0000 7f4877e00640 1 -- 172.21.15.99:0/759737932 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48800d3810 con 0x7f4880162650 2024-09-10T07:34:31.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7fe9d7e00640 1 -- 172.21.15.99:0/2468219794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d806f4b0 msgr2=0x7fe9d81617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T07:34:31.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7fe9d7e00640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d806f4b0 0x7fe9d81617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7fe9d7e00640 1 -- 172.21.15.99:0/2468219794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9d806d140 msgr2=0x7fe9d815f590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:34:31.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7fe9d7e00640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9d806d140 0x7fe9d815f590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7fe9d7e00640 1 -- 172.21.15.99:0/2468219794 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d815fb70 con 0x7fe9d80afda0 2024-09-10T07:34:31.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.000+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884400c4a0 con 0x7f88440e2b90 2024-09-10T07:34:31.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.002+0000 7fe9d7e00640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9d80afda0 0x7fe9d8156750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c730 tx=0x7fe9d000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.002+0000 7f982a200640 1 Processor -- start 2024-09-10T07:34:31.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.002+0000 7fbd2e200640 1 -- 172.21.15.99:0/2178087066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd280b47d0 msgr2=0x7fbd280b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.002+0000 7fbd2e200640 1 --2- 172.21.15.99:0/2178087066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd280b47d0 0x7fbd280b5680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbd180097a0 tx=0x7fbd1802a180 comp rx=0 tx=0).stop 2024-09-10T07:34:31.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.002+0000 7f982a200640 1 -- start start 2024-09-10T07:34:31.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.002+0000 7fe9cfe00640 1 -- 172.21.15.99:0/2468219794 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0018070 con 0x7fe9d80afda0 2024-09-10T07:34:31.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.001+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7c0afaf0 con 0x7f5d7c15aa20 2024-09-10T07:34:31.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7fe9cfe00640 1 -- 172.21.15.99:0/2468219794 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d0004d60 con 0x7fe9d80afda0 2024-09-10T07:34:31.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.002+0000 7f4877e00640 1 --2- 172.21.15.99:0/759737932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4880162650 0x7f48800d1980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48800b7bd0 tx=0x7f4868032970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0fc1f0e6cc8cc8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.002+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f884400bdd0 con 0x7f88440e2b90 2024-09-10T07:34:31.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7f487fe00640 1 -- 172.21.15.99:0/759737932 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486803c020 con 0x7f4880162650 2024-09-10T07:34:31.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7f487fe00640 1 -- 172.21.15.99:0/759737932 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4868038830 con 0x7f4880162650 2024-09-10T07:34:31.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7f487fe00640 1 -- 172.21.15.99:0/759737932 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868038c00 con 0x7f4880162650 2024-09-10T07:34:31.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7f4c0c400640 1 Processor -- start 2024-09-10T07:34:31.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7fe9cfe00640 1 -- 172.21.15.99:0/2468219794 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d000a800 con 0x7fe9d80afda0 2024-09-10T07:34:31.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7fe9dce00640 1 -- 172.21.15.99:0/2468219794 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d815fe50 con 0x7fe9d80afda0 2024-09-10T07:34:31.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7fbd2e200640 1 -- 172.21.15.99:0/2178087066 shutdown_connections 2024-09-10T07:34:31.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7fbd2e200640 1 --2- 172.21.15.99:0/2178087066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd280b47d0 0x7fbd280b5680 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7fbd2e200640 1 --2- 172.21.15.99:0/2178087066 >> v2:172.21.15.187:3300/0 conn(0x7fbd2814cc40 0x7fbd280ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7fbd2e200640 1 -- 172.21.15.99:0/2178087066 >> 172.21.15.99:0/2178087066 conn(0x7fbd280b2630 msgr2=0x7fbd280b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7fe9dce00640 1 -- 172.21.15.99:0/2468219794 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d8160410 con 0x7fe9d80afda0 2024-09-10T07:34:31.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7f4c0c400640 1 -- start start 2024-09-10T07:34:31.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.004+0000 7f982a200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982406d870 0x7f9824141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.004+0000 7f982a200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f982414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.004+0000 7f982a200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f982415a970 0x7f98241475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.004+0000 7f982a200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9824068d90 con 0x7f982415a970 2024-09-10T07:34:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.004+0000 7f982a200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f98240d1310 con 0x7f982406d870 2024-09-10T07:34:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.004+0000 7f982a200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9824068f10 con 0x7f98240d0990 2024-09-10T07:34:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.003+0000 7fbd2e200640 1 -- 172.21.15.99:0/2178087066 shutdown_connections 2024-09-10T07:34:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.004+0000 7fbd2e200640 1 -- 172.21.15.99:0/2178087066 wait complete. 2024-09-10T07:34:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.004+0000 7f32d4200640 1 Processor -- start 2024-09-10T07:34:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f32d4200640 1 -- start start 2024-09-10T07:34:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f8842a00640 1 -- 172.21.15.99:0/1094011487 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f883c01a070 con 0x7f88440e2b90 2024-09-10T07:34:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f9828e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982406d870 0x7f9824141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f9828e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982406d870 0x7f9824141de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53776/0 (socket says 172.21.15.99:53776) 2024-09-10T07:34:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f9828e00640 1 -- 172.21.15.99:0/2965617957 learned_addr learned my addr 172.21.15.99:0/2965617957 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f9829800640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f982415a970 0x7f98241475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.004+0000 7f5d73e00640 1 -- 172.21.15.99:0/1967735267 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d6801a070 con 0x7f5d7c15aa20 2024-09-10T07:34:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f5d73e00640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5d5c06bf00 0x7f5d5c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f4c0c400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4c040b47d0 0x7f4c040ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f4c0c400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 0x7f4c0406e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f4c0c400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c040716b0 con 0x7f4c0414cc40 2024-09-10T07:34:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f4c0c400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0406eb30 con 0x7f4c040b47d0 2024-09-10T07:34:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f4c0c400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4c040cecc0 con 0x7f4c0406e180 2024-09-10T07:34:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f5d73e00640 1 -- 172.21.15.99:0/1967735267 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5d6808a140 con 0x7f5d7c15aa20 2024-09-10T07:34:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f5d7be00640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5d5c06bf00 0x7f5d5c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f4c09a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4c0414cc40 0x7f4c040b5680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38310/0 (socket says 172.21.15.99:38310) 2024-09-10T07:34:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f4c09a00640 1 -- 172.21.15.99:0/1966543201 learned_addr learned my addr 172.21.15.99:0/1966543201 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7fe9dce00640 1 -- 172.21.15.99:0/2468219794 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b0005290 con 0x7fe9d80afda0 2024-09-10T07:34:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f4c0a400640 1 --2- 172.21.15.99:0/1966543201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 0x7f4c0406e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f4c09000640 1 --2- 172.21.15.99:0/1966543201 >> v2:172.21.15.187:3300/0 conn(0x7f4c040b47d0 0x7f4c040ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f4887a00640 1 -- 172.21.15.99:0/759737932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4880162650 msgr2=0x7f48800d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.005+0000 7f4887a00640 1 --2- 172.21.15.99:0/759737932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4880162650 0x7f48800d1980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48800b7bd0 tx=0x7f4868032970 comp rx=0 tx=0).stop 2024-09-10T07:34:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f4887a00640 1 -- 172.21.15.99:0/759737932 shutdown_connections 2024-09-10T07:34:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f4887a00640 1 --2- 172.21.15.99:0/759737932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4880162650 0x7f48800d1980 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48800b7bd0 tx=0x7f4868032970 comp rx=0 tx=0).stop 2024-09-10T07:34:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f4887a00640 1 --2- 172.21.15.99:0/759737932 >> v2:172.21.15.99:3300/0 conn(0x7f4880162270 0x7f48800d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f4887a00640 1 -- 172.21.15.99:0/759737932 >> 172.21.15.99:0/759737932 conn(0x7f48800d4c00 msgr2=0x7f48800d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f4887a00640 1 -- 172.21.15.99:0/759737932 shutdown_connections 2024-09-10T07:34:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f4c0a400640 1 -- 172.21.15.99:0/1966543201 >> v2:172.21.15.187:3300/0 conn(0x7f4c040b47d0 msgr2=0x7f4c040ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f4c0a400640 1 --2- 172.21.15.99:0/1966543201 >> v2:172.21.15.187:3300/0 conn(0x7f4c040b47d0 0x7f4c040ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f4c0a400640 1 -- 172.21.15.99:0/1966543201 >> v1:172.21.15.99:6789/0 conn(0x7f4c0414cc40 legacy=0x7f4c040b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7fbd2e200640 1 Processor -- start 2024-09-10T07:34:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f32d4200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f32cc0c6130 0x7f32cc167660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f32d4200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32cc06f960 con 0x7f32cc163080 2024-09-10T07:34:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f32d4200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32cc06fc40 con 0x7f32cc0b1d20 2024-09-10T07:34:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f32d4200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f32cc0cf590 con 0x7f32cc0c6130 2024-09-10T07:34:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f4887a00640 1 -- 172.21.15.99:0/759737932 wait complete. 2024-09-10T07:34:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f4c0a400640 1 -- 172.21.15.99:0/1966543201 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c04071990 con 0x7f4c0406e180 2024-09-10T07:34:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f32d0e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f32cc0b1d20 0x7f32cc0c5a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:47830/0 (socket says 172.21.15.99:47830) 2024-09-10T07:34:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f32d0e00640 1 -- 172.21.15.99:0/2598715419 learned_addr learned my addr 172.21.15.99:0/2598715419 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7f32d1800640 1 --1- 172.21.15.99:0/2598715419 >> v1:172.21.15.99:6789/0 conn(0x7f32cc163080 0x7f32cc06dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38326/0 (socket says 172.21.15.99:38326) 2024-09-10T07:34:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.008+0000 7fe9cfe00640 1 -- 172.21.15.99:0/2468219794 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9d001b070 con 0x7fe9d80afda0 2024-09-10T07:34:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.007+0000 7fbd2e200640 1 -- start start 2024-09-10T07:34:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7fbd2e200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd2806e180 0x7fbd28162690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f5d7be00640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5d5c06bf00 0x7f5d5c06e3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0094f0 tx=0x7f5d6c009a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7fbd2e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd280b47d0 0x7fbd28162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7fbd2e200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd2814cc40 0x7fbd2813a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.008+0000 7f9828e00640 1 -- 172.21.15.99:0/2965617957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 msgr2=0x7f982414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f4c0a400640 1 --2- 172.21.15.99:0/1966543201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 0x7f4c0406e5f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0097a0 tx=0x7f4bfc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db42fc2aa86a56d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.006+0000 7f981be00640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f982414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f4887a00640 1 Processor -- start 2024-09-10T07:34:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7fbd2e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2806e630 con 0x7fbd280b47d0 2024-09-10T07:34:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7fbd2e200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280b5bc0 con 0x7fbd2806e180 2024-09-10T07:34:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7fbd2e200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2806e7b0 con 0x7fbd2814cc40 2024-09-10T07:34:31.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f32d2200640 1 --2- 172.21.15.99:0/2598715419 >> v2:172.21.15.187:3300/0 conn(0x7f32cc0c6130 0x7f32cc167660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.008+0000 7f8842a00640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f882c06c030 0x7f882c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.008+0000 7f8842a00640 1 -- 172.21.15.99:0/1094011487 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f883c089ef0 con 0x7f88440e2b90 2024-09-10T07:34:31.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f884aa00640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f882c06c030 0x7f882c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7fbd27e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd2814cc40 0x7fbd2813a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f9828e00640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f982414d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f9828e00640 1 -- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f982415a970 msgr2=0x7f98241475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f9828e00640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f982415a970 0x7f98241475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f9828e00640 1 -- 172.21.15.99:0/2965617957 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98241507f0 con 0x7f982406d870 2024-09-10T07:34:31.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f9829800640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f982415a970 0x7f98241475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:31.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f981be00640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f982414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:31.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.009+0000 7f4887a00640 1 -- start start 2024-09-10T07:34:31.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7fbd27e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd2814cc40 0x7fbd2813a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:34020/0 (socket says 172.21.15.99:34020) 2024-09-10T07:34:31.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7fbd27e00640 1 -- 172.21.15.99:0/1493124107 learned_addr learned my addr 172.21.15.99:0/1493124107 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:31.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7f32d2200640 1 -- 172.21.15.99:0/2598715419 >> v1:172.21.15.187:6789/0 conn(0x7f32cc0b1d20 legacy=0x7f32cc0c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7f32d2200640 1 -- 172.21.15.99:0/2598715419 >> v1:172.21.15.99:6789/0 conn(0x7f32cc163080 legacy=0x7f32cc06dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7f9828e00640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982406d870 0x7f9824141de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f980c00c430 tx=0x7f980c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7f32d2200640 1 -- 172.21.15.99:0/2598715419 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc06e4b0 con 0x7f32cc0c6130 2024-09-10T07:34:31.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7fe9cfe00640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9b406bf00 0x7fe9b406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7f884aa00640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f882c06c030 0x7f882c06e4f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8838007fd0 tx=0x7f8838009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7f9821600640 1 -- 172.21.15.99:0/2965617957 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c011790 con 0x7f982406d870 2024-09-10T07:34:31.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7f9821600640 1 -- 172.21.15.99:0/2965617957 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c017070 con 0x7f982406d870 2024-09-10T07:34:31.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7f9821600640 1 -- 172.21.15.99:0/2965617957 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c011b70 con 0x7f982406d870 2024-09-10T07:34:31.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7fbd26a00640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd280b47d0 0x7fbd28162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7f8842a00640 1 -- 172.21.15.99:0/1094011487 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f883c058250 con 0x7f88440e2b90 2024-09-10T07:34:31.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.010+0000 7fe9cfe00640 1 -- 172.21.15.99:0/2468219794 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe9d008a600 con 0x7fe9d80afda0 2024-09-10T07:34:31.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7fbd27e00640 1 -- 172.21.15.99:0/1493124107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd2806e180 msgr2=0x7fbd28162690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T07:34:31.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7fbd27e00640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd2806e180 0x7fbd28162690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7fbd27e00640 1 -- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd280b47d0 msgr2=0x7fbd28162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7fbd27e00640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd280b47d0 0x7fbd28162bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7f982a200640 1 -- 172.21.15.99:0/2965617957 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9824150ad0 con 0x7f982406d870 2024-09-10T07:34:31.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7f982a200640 1 -- 172.21.15.99:0/2965617957 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9824151090 con 0x7f982406d870 2024-09-10T07:34:31.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7fe9d7400640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9b406bf00 0x7fe9b406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7f4887a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48800d5720 0x7f488015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7f4887a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4880162270 0x7f4880160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7f4887a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4880161150 0x7f488015e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7f4887a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f48800d0820 con 0x7f4880161150 2024-09-10T07:34:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7f4887a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f48800d31e0 con 0x7f48800d5720 2024-09-10T07:34:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7f4887a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f48800d09a0 con 0x7f4880162270 2024-09-10T07:34:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7fbd27e00640 1 -- 172.21.15.99:0/1493124107 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd280b12c0 con 0x7fbd2814cc40 2024-09-10T07:34:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7fbd26a00640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd280b47d0 0x7fbd28162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.011+0000 7fbd27e00640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd2814cc40 0x7fbd2813a5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000cbc0 tx=0x7fbd2000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.012+0000 7f32d2200640 1 --2- 172.21.15.99:0/2598715419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc0c6130 0x7f32cc167660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f32b80097a0 tx=0x7f32b802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9c1bb09b4b8a890 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.012+0000 7f4885000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48800d5720 0x7f488015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.012+0000 7f4885000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48800d5720 0x7f488015a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53812/0 (socket says 172.21.15.99:53812) 2024-09-10T07:34:31.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.012+0000 7f4885000640 1 -- 172.21.15.99:0/3715432654 learned_addr learned my addr 172.21.15.99:0/3715432654 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:31.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.012+0000 7f4885a00640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4880161150 0x7f488015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.012+0000 7f32cbe00640 1 -- 172.21.15.99:0/2598715419 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8037070 con 0x7f32cc0c6130 2024-09-10T07:34:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f982a200640 1 -- 172.21.15.99:0/2965617957 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98240d0dd0 con 0x7f982406d870 2024-09-10T07:34:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.012+0000 7f32cbe00640 1 -- 172.21.15.99:0/2598715419 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b8032440 con 0x7f32cc0c6130 2024-09-10T07:34:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.012+0000 7f32cbe00640 1 -- 172.21.15.99:0/2598715419 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8032810 con 0x7f32cc0c6130 2024-09-10T07:34:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7fe9d7400640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9b406bf00 0x7fe9b406e3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0034000 tx=0x7fe9c002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f4885a00640 1 -- 172.21.15.99:0/3715432654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4880162270 msgr2=0x7f4880160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f4885a00640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4880162270 0x7f4880160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f32d4200640 1 -- 172.21.15.99:0/2598715419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc0c6130 msgr2=0x7f32cc167660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f32d4200640 1 --2- 172.21.15.99:0/2598715419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc0c6130 0x7f32cc167660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f32b80097a0 tx=0x7f32b802a230 comp rx=0 tx=0).stop 2024-09-10T07:34:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f4885a00640 1 -- 172.21.15.99:0/3715432654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48800d5720 msgr2=0x7f488015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f4885a00640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48800d5720 0x7f488015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f4885a00640 1 -- 172.21.15.99:0/3715432654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48800ce370 con 0x7f4880161150 2024-09-10T07:34:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f4885000640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48800d5720 0x7f488015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f32d4200640 1 -- 172.21.15.99:0/2598715419 shutdown_connections 2024-09-10T07:34:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f32d4200640 1 --2- 172.21.15.99:0/2598715419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc0c6130 0x7f32cc167660 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.013+0000 7f32d4200640 1 -- 172.21.15.99:0/2598715419 >> 172.21.15.99:0/2598715419 conn(0x7f32cc0b4560 msgr2=0x7f32cc0b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.014+0000 7f4885a00640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4880161150 0x7f488015e930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f487800be20 tx=0x7f487800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.014+0000 7f9821600640 1 -- 172.21.15.99:0/2965617957 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f980c011d10 con 0x7f982406d870 2024-09-10T07:34:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.014+0000 7f32d4200640 1 -- 172.21.15.99:0/2598715419 shutdown_connections 2024-09-10T07:34:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.014+0000 7f32d4200640 1 -- 172.21.15.99:0/2598715419 wait complete. 2024-09-10T07:34:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.014+0000 7f487d600640 1 -- 172.21.15.99:0/3715432654 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878019070 con 0x7f4880161150 2024-09-10T07:34:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.014+0000 7f487d600640 1 -- 172.21.15.99:0/3715432654 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4878014440 con 0x7f4880161150 2024-09-10T07:34:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.014+0000 7f5d73e00640 1 -- 172.21.15.99:0/1967735267 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d68058510 con 0x7f5d7c15aa20 2024-09-10T07:34:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.014+0000 7f487d600640 1 -- 172.21.15.99:0/3715432654 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4878014830 con 0x7f4880161150 2024-09-10T07:34:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.014+0000 7f4887a00640 1 -- 172.21.15.99:0/3715432654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48800ce650 con 0x7f4880161150 2024-09-10T07:34:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.015+0000 7f4887a00640 1 -- 172.21.15.99:0/3715432654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488015e410 con 0x7f4880161150 2024-09-10T07:34:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.015+0000 7fbd1f400640 1 -- 172.21.15.99:0/1493124107 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20017070 con 0x7fbd2814cc40 2024-09-10T07:34:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.015+0000 7fbd1f400640 1 -- 172.21.15.99:0/1493124107 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2000ad40 con 0x7fbd2814cc40 2024-09-10T07:34:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.015+0000 7fbd1f400640 1 -- 172.21.15.99:0/1493124107 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20012600 con 0x7fbd2814cc40 2024-09-10T07:34:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.015+0000 7fbd2e200640 1 -- 172.21.15.99:0/1493124107 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd280b15a0 con 0x7fbd2814cc40 2024-09-10T07:34:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.015+0000 7fbd2e200640 1 -- 172.21.15.99:0/1493124107 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2813bb20 con 0x7fbd2814cc40 2024-09-10T07:34:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.016+0000 7fe9cfe00640 1 -- 172.21.15.99:0/2468219794 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9d0058f90 con 0x7fe9d80afda0 2024-09-10T07:34:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.015+0000 7f4c03e00640 1 -- 172.21.15.99:0/1966543201 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc037070 con 0x7f4c0406e180 2024-09-10T07:34:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.015+0000 7f9821600640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f980006be30 0x7f980006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.015+0000 7f9821600640 1 -- 172.21.15.99:0/2965617957 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f980c08add0 con 0x7f982406d870 2024-09-10T07:34:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.016+0000 7f4c03e00640 1 -- 172.21.15.99:0/1966543201 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc032440 con 0x7f4c0406e180 2024-09-10T07:34:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.016+0000 7f4c03e00640 1 -- 172.21.15.99:0/1966543201 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc032810 con 0x7f4c0406e180 2024-09-10T07:34:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.016+0000 7f32d4200640 1 Processor -- start 2024-09-10T07:34:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.017+0000 7f4c0c400640 1 -- 172.21.15.99:0/1966543201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 msgr2=0x7f4c0406e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.017+0000 7f4c0c400640 1 --2- 172.21.15.99:0/1966543201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 0x7f4c0406e5f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0097a0 tx=0x7f4bfc02a180 comp rx=0 tx=0).stop 2024-09-10T07:34:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.018+0000 7f4887a00640 1 -- 172.21.15.99:0/3715432654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488015e610 con 0x7f4880161150 2024-09-10T07:34:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.017+0000 7f32d4200640 1 -- start start 2024-09-10T07:34:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.018+0000 7f981be00640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f980006be30 0x7f980006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.018+0000 7f4c0c400640 1 -- 172.21.15.99:0/1966543201 shutdown_connections 2024-09-10T07:34:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.019+0000 7f32d4200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32cc0b1d20 0x7f32cc161b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.019+0000 7f487d600640 1 -- 172.21.15.99:0/3715432654 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f487801c360 con 0x7f4880161150 2024-09-10T07:34:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.018+0000 7f4c0c400640 1 --2- 172.21.15.99:0/1966543201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 0x7f4c0406e5f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.018+0000 7f4c0c400640 1 --2- 172.21.15.99:0/1966543201 >> v2:172.21.15.187:3300/0 conn(0x7f4c040b47d0 0x7f4c040ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.018+0000 7f4c0c400640 1 -- 172.21.15.99:0/1966543201 >> 172.21.15.99:0/1966543201 conn(0x7f4c040b2630 msgr2=0x7f4c040b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.018+0000 7fbd2e200640 1 -- 172.21.15.99:0/1493124107 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd00005290 con 0x7fbd2814cc40 2024-09-10T07:34:31.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.019+0000 7f32d4200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0c6130 0x7f32cc1ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.019+0000 7f32d4200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc163080 0x7f32cc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.019+0000 7f32d4200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc071740 con 0x7f32cc0c6130 2024-09-10T07:34:31.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.019+0000 7f32d4200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc163460 con 0x7f32cc163080 2024-09-10T07:34:31.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.019+0000 7f32d1800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32cc0b1d20 0x7f32cc161b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.019+0000 7f32d4200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f32cc0718c0 con 0x7f32cc0b1d20 2024-09-10T07:34:31.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.019+0000 7f4c0c400640 1 -- 172.21.15.99:0/1966543201 shutdown_connections 2024-09-10T07:34:31.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.020+0000 7f4c0c400640 1 -- 172.21.15.99:0/1966543201 wait complete. 2024-09-10T07:34:31.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.020+0000 7f981be00640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f980006be30 0x7f980006e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9814034000 tx=0x7f981402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.019+0000 7f32d1800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32cc0b1d20 0x7f32cc161b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:34038/0 (socket says 172.21.15.99:34038) 2024-09-10T07:34:31.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.020+0000 7f32d0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0c6130 0x7f32cc1ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.020+0000 7f32d2200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc163080 0x7f32cc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.020+0000 7f32d2200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc163080 0x7f32cc06d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53828/0 (socket says 172.21.15.99:53828) 2024-09-10T07:34:31.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.020+0000 7f32d2200640 1 -- 172.21.15.99:0/2051888695 learned_addr learned my addr 172.21.15.99:0/2051888695 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:31.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.020+0000 7f32d0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0c6130 0x7f32cc1ed8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52482/0 (socket says 172.21.15.99:52482) 2024-09-10T07:34:31.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.021+0000 7f9821600640 1 -- 172.21.15.99:0/2965617957 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f980c0596e0 con 0x7f982406d870 2024-09-10T07:34:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.021+0000 7f32d0e00640 1 -- 172.21.15.99:0/2051888695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32cc0b1d20 msgr2=0x7f32cc161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.021+0000 7f32d0e00640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32cc0b1d20 0x7f32cc161b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.021+0000 7f32d0e00640 1 -- 172.21.15.99:0/2051888695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc163080 msgr2=0x7f32cc06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.021+0000 7f32d0e00640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc163080 0x7f32cc06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.021+0000 7f32d0e00640 1 -- 172.21.15.99:0/2051888695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc1624c0 con 0x7f32cc0c6130 2024-09-10T07:34:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.020+0000 7f487d600640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f485c06beb0 0x7f485c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.020+0000 7f487d600640 1 -- 172.21.15.99:0/3715432654 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f487808ac60 con 0x7f4880161150 2024-09-10T07:34:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.021+0000 7f4885000640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f485c06beb0 0x7f485c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.022+0000 7f32d0e00640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0c6130 0x7f32cc1ed8b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c800 tx=0x7f32c000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.022+0000 7f32d1800640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32cc0b1d20 0x7f32cc161b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.022+0000 7f4885000640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f485c06beb0 0x7f485c06e370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48700094a0 tx=0x7f4870008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.024+0000 7fbd1f400640 1 -- 172.21.15.99:0/1493124107 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd2001a070 con 0x7fbd2814cc40 2024-09-10T07:34:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.024+0000 7f4c0c400640 1 Processor -- start 2024-09-10T07:34:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.024+0000 7fbd1f400640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd0806bf00 0x7fbd0806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.025+0000 7f4c0c400640 1 -- start start 2024-09-10T07:34:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.025+0000 7fbd1f400640 1 -- 172.21.15.99:0/1493124107 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbd2008ab40 con 0x7fbd2814cc40 2024-09-10T07:34:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.026+0000 7fbd27400640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd0806bf00 0x7fbd0806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.027+0000 7f4c0c400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 0x7f4c040ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.027+0000 7f4c0c400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c040b47d0 0x7f4c041fbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.027+0000 7fbd1f400640 1 -- 172.21.15.99:0/1493124107 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd20058e80 con 0x7fbd2814cc40 2024-09-10T07:34:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.027+0000 7fbd27400640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd0806bf00 0x7fbd0806e3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd14006fd0 tx=0x7fbd14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.027+0000 7f4c09a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 0x7f4c040ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.028+0000 7f4c0c400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c0414cc40 0x7f4c041fc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.028+0000 7f4c0c400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4c04072750 con 0x7f4c040b47d0 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.028+0000 7f4c0c400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4c04071f50 con 0x7f4c0414cc40 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.028+0000 7f4c0c400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4c040728d0 con 0x7f4c0406e180 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.028+0000 7f4c0a400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c0414cc40 0x7f4c041fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.028+0000 7f4c0a400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c0414cc40 0x7f4c041fc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53844/0 (socket says 172.21.15.99:53844) 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.028+0000 7f4c0a400640 1 -- 172.21.15.99:0/3678252380 learned_addr learned my addr 172.21.15.99:0/3678252380 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.028+0000 7f4c09000640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c040b47d0 0x7f4c041fbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f4c0a400640 1 -- 172.21.15.99:0/3678252380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 msgr2=0x7f4c040ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f4c0a400640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 0x7f4c040ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f4c0a400640 1 -- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c040b47d0 msgr2=0x7f4c041fbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f4c0a400640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c040b47d0 0x7f4c041fbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f4c0a400640 1 -- 172.21.15.99:0/3678252380 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c041fc3c0 con 0x7f4c0414cc40 2024-09-10T07:34:31.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f32c9600640 1 -- 172.21.15.99:0/2051888695 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0017070 con 0x7f32cc0c6130 2024-09-10T07:34:31.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f32c9600640 1 -- 172.21.15.99:0/2051888695 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c00058b0 con 0x7f32cc0c6130 2024-09-10T07:34:31.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f32c9600640 1 -- 172.21.15.99:0/2051888695 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0005c60 con 0x7f32cc0c6130 2024-09-10T07:34:31.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f487d600640 1 -- 172.21.15.99:0/3715432654 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f488015e610 con 0x7f4880161150 2024-09-10T07:34:31.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f4c09000640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c040b47d0 0x7f4c041fbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:31.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f4c0a400640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c0414cc40 0x7f4c041fc620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0098c0 tx=0x7f4bfc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f32d4200640 1 -- 172.21.15.99:0/2051888695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32cc1ecaf0 con 0x7f32cc0c6130 2024-09-10T07:34:31.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.029+0000 7f32d4200640 1 -- 172.21.15.99:0/2051888695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32cc1ed0b0 con 0x7f32cc0c6130 2024-09-10T07:34:31.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.030+0000 7f4c01600640 1 -- 172.21.15.99:0/3678252380 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc037050 con 0x7f4c0414cc40 2024-09-10T07:34:31.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.030+0000 7f4c01600640 1 -- 172.21.15.99:0/3678252380 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc038040 con 0x7f4c0414cc40 2024-09-10T07:34:31.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.030+0000 7f4c01600640 1 -- 172.21.15.99:0/3678252380 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc03cb50 con 0x7f4c0414cc40 2024-09-10T07:34:31.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.030+0000 7f4c0c400640 1 -- 172.21.15.99:0/3678252380 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c040ab8f0 con 0x7f4c0414cc40 2024-09-10T07:34:31.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.030+0000 7f4c0c400640 1 -- 172.21.15.99:0/3678252380 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c040abeb0 con 0x7f4c0414cc40 2024-09-10T07:34:31.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.032+0000 7f4c0c400640 1 -- 172.21.15.99:0/3678252380 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c040cfe80 con 0x7f4c0414cc40 2024-09-10T07:34:31.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.033+0000 7f32d4200640 1 -- 172.21.15.99:0/2051888695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a8005290 con 0x7f32cc0c6130 2024-09-10T07:34:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.033+0000 7f4c01600640 1 -- 172.21.15.99:0/3678252380 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bfc03ccf0 con 0x7f4c0414cc40 2024-09-10T07:34:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.035+0000 7f4c01600640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4be406bf00 0x7f4be406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.035+0000 7f4c01600640 1 -- 172.21.15.99:0/3678252380 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4bfc0ab8c0 con 0x7f4c0414cc40 2024-09-10T07:34:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.035+0000 7f32c9600640 1 -- 172.21.15.99:0/2051888695 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32c001a070 con 0x7f32cc0c6130 2024-09-10T07:34:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.036+0000 7f4c09a00640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4be406bf00 0x7f4be406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.039+0000 7f4c09a00640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4be406bf00 0x7f4be406e3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80012e0 tx=0x7f4bf8001990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.037+0000 7f32c9600640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32ac06beb0 0x7f32ac06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.039+0000 7f4c01600640 1 -- 172.21.15.99:0/3678252380 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c040cfe80 con 0x7f4c0414cc40 2024-09-10T07:34:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.037+0000 7f32c9600640 1 -- 172.21.15.99:0/2051888695 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f32c0089fe0 con 0x7f32cc0c6130 2024-09-10T07:34:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.038+0000 7f32d1800640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32ac06beb0 0x7f32ac06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.038+0000 7f32d1800640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32ac06beb0 0x7f32ac06e370 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f32c40012e0 tx=0x7f32c4001650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.050+0000 7f32c9600640 1 -- 172.21.15.99:0/2051888695 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32cc1624c0 con 0x7f32cc0c6130 2024-09-10T07:34:31.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.404+0000 7fe9dce00640 1 -- 172.21.15.99:0/2468219794 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe9b0005580 con 0x7fe9d80afda0 2024-09-10T07:34:31.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.405+0000 7fe9cfe00640 1 -- 172.21.15.99:0/2468219794 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9d0058890 con 0x7fe9d80afda0 2024-09-10T07:34:31.405 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:31.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.409+0000 7fe9dce00640 1 -- 172.21.15.99:0/2468219794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9b406bf00 msgr2=0x7fe9b406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.409+0000 7fe9dce00640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9b406bf00 0x7fe9b406e3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0034000 tx=0x7fe9c002e000 comp rx=0 tx=0).stop 2024-09-10T07:34:31.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.409+0000 7fe9dce00640 1 -- 172.21.15.99:0/2468219794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9d80afda0 msgr2=0x7fe9d8156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.410+0000 7fe9dce00640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9d80afda0 0x7fe9d8156750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c730 tx=0x7fe9d000cbf0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.410+0000 7fe9dce00640 1 -- 172.21.15.99:0/2468219794 shutdown_connections 2024-09-10T07:34:31.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.410+0000 7fe9dce00640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9d80afda0 0x7fe9d8156750 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.410+0000 7fe9dce00640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d806f4b0 0x7fe9d81617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.410+0000 7fe9dce00640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9b406bf00 0x7fe9b406e3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.410+0000 7fe9dce00640 1 --2- 172.21.15.99:0/2468219794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9d806d140 0x7fe9d815f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.410+0000 7fe9dce00640 1 -- 172.21.15.99:0/2468219794 >> 172.21.15.99:0/2468219794 conn(0x7fe9d806bdf0 msgr2=0x7fe9d8157690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.411+0000 7fe9dce00640 1 -- 172.21.15.99:0/2468219794 shutdown_connections 2024-09-10T07:34:31.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.411+0000 7fe9dce00640 1 -- 172.21.15.99:0/2468219794 wait complete. 2024-09-10T07:34:31.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.420+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8844007a90 con 0x7f88440e2b90 2024-09-10T07:34:31.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.421+0000 7f8842a00640 1 -- 172.21.15.99:0/1094011487 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f883c05c550 con 0x7f88440e2b90 2024-09-10T07:34:31.424 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:31.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.422+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5d7c075500 con 0x7f5d7c15aa20 2024-09-10T07:34:31.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.423+0000 7f5d73e00640 1 -- 172.21.15.99:0/1967735267 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d6805c810 con 0x7f5d7c15aa20 2024-09-10T07:34:31.425 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:31.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.425+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f882c06c030 msgr2=0x7f882c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.425+0000 7f884be00640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f882c06c030 0x7f882c06e4f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8838007fd0 tx=0x7f8838009040 comp rx=0 tx=0).stop 2024-09-10T07:34:31.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.425+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440e2b90 msgr2=0x7f88440cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.425+0000 7f884be00640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440e2b90 0x7f88440cc370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f883c00e640 tx=0x7f883c00eb00 comp rx=0 tx=0).stop 2024-09-10T07:34:31.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.426+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 shutdown_connections 2024-09-10T07:34:31.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.426+0000 7f884be00640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440e2b90 0x7f88440cc370 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.426+0000 7f884be00640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f882c06c030 0x7f882c06e4f0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8838007fd0 tx=0x7f8838009040 comp rx=0 tx=0).stop 2024-09-10T07:34:31.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.426+0000 7f884be00640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f884403ce50 0x7f884400c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.426+0000 7f884be00640 1 --2- 172.21.15.99:0/1094011487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8844006270 0x7f884404eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.426+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 >> 172.21.15.99:0/1094011487 conn(0x7f884403a520 msgr2=0x7f884403e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.427+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5d5c06bf00 msgr2=0x7f5d5c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.427+0000 7f5d81c00640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5d5c06bf00 0x7f5d5c06e3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0094f0 tx=0x7f5d6c009a20 comp rx=0 tx=0).stop 2024-09-10T07:34:31.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.427+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d7c15aa20 msgr2=0x7f5d7c2046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.427+0000 7f5d81c00640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d7c15aa20 0x7f5d7c2046d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c071640 tx=0x7f5d6800c890 comp rx=0 tx=0).stop 2024-09-10T07:34:31.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.428+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 shutdown_connections 2024-09-10T07:34:31.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.428+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 shutdown_connections 2024-09-10T07:34:31.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.428+0000 7f5d81c00640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d7c15b510 0x7f5d7c204c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.428+0000 7f5d81c00640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5d5c06bf00 0x7f5d5c06e3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.428+0000 7f5d81c00640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d7c15aa20 0x7f5d7c2046d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.428+0000 7f5d81c00640 1 --2- 172.21.15.99:0/1967735267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d7c0af690 0x7f5d7c1f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.428+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 >> 172.21.15.99:0/1967735267 conn(0x7f5d7c068070 msgr2=0x7f5d7c15d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.428+0000 7f884be00640 1 -- 172.21.15.99:0/1094011487 wait complete. 2024-09-10T07:34:31.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.428+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 shutdown_connections 2024-09-10T07:34:31.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.428+0000 7f5d81c00640 1 -- 172.21.15.99:0/1967735267 wait complete. 2024-09-10T07:34:31.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.437+0000 7f982a200640 1 -- 172.21.15.99:0/2965617957 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f982415e680 con 0x7f982406d870 2024-09-10T07:34:31.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.437+0000 7fbd2e200640 1 -- 172.21.15.99:0/1493124107 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbd00005580 con 0x7fbd2814cc40 2024-09-10T07:34:31.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.438+0000 7fbd1f400640 1 -- 172.21.15.99:0/1493124107 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbd2005d180 con 0x7fbd2814cc40 2024-09-10T07:34:31.439 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:31.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-10T07:34:31.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.438+0000 7f9821600640 1 -- 172.21.15.99:0/2965617957 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f980c058fe0 con 0x7f982406d870 2024-09-10T07:34:31.440 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:31.440 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.441+0000 7fbd2e200640 1 -- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd0806bf00 msgr2=0x7fbd0806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.442+0000 7fbd2e200640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd0806bf00 0x7fbd0806e3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd14006fd0 tx=0x7fbd14008040 comp rx=0 tx=0).stop 2024-09-10T07:34:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.442+0000 7fbd2e200640 1 -- 172.21.15.99:0/1493124107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd2814cc40 msgr2=0x7fbd2813a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.442+0000 7fbd2e200640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd2814cc40 0x7fbd2813a5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000cbc0 tx=0x7fbd2000a430 comp rx=0 tx=0).stop 2024-09-10T07:34:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.442+0000 7f982a200640 1 -- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f980006be30 msgr2=0x7f980006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.442+0000 7f982a200640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f980006be30 0x7f980006e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9814034000 tx=0x7f981402e000 comp rx=0 tx=0).stop 2024-09-10T07:34:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7f982a200640 1 -- 172.21.15.99:0/2965617957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982406d870 msgr2=0x7f9824141de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.442+0000 7fbd2e200640 1 -- 172.21.15.99:0/1493124107 shutdown_connections 2024-09-10T07:34:31.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7f982a200640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982406d870 0x7f9824141de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f980c00c430 tx=0x7f980c00c8f0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7f982a200640 1 -- 172.21.15.99:0/2965617957 shutdown_connections 2024-09-10T07:34:31.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7fbd2e200640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd2814cc40 0x7fbd2813a5b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7fbd2e200640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd0806bf00 0x7fbd0806e3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7fbd2e200640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd280b47d0 0x7fbd28162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7fbd2e200640 1 --2- 172.21.15.99:0/1493124107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd2806e180 0x7fbd28162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7fbd2e200640 1 -- 172.21.15.99:0/1493124107 >> 172.21.15.99:0/1493124107 conn(0x7fbd280b2630 msgr2=0x7fbd28164a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7f982a200640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f980006be30 0x7f980006e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7f982a200640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f982415a970 0x7f98241475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7fbd2e200640 1 -- 172.21.15.99:0/1493124107 shutdown_connections 2024-09-10T07:34:31.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7f982a200640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98240d0990 0x7f982414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7f982a200640 1 --2- 172.21.15.99:0/2965617957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982406d870 0x7f9824141de0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7f982a200640 1 -- 172.21.15.99:0/2965617957 >> 172.21.15.99:0/2965617957 conn(0x7f982406bc10 msgr2=0x7f982406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7f982a200640 1 -- 172.21.15.99:0/2965617957 shutdown_connections 2024-09-10T07:34:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7f982a200640 1 -- 172.21.15.99:0/2965617957 wait complete. 2024-09-10T07:34:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.443+0000 7fbd2e200640 1 -- 172.21.15.99:0/1493124107 wait complete. 2024-09-10T07:34:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.446+0000 7f4887a00640 1 -- 172.21.15.99:0/3715432654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f48800d1440 con 0x7f4880161150 2024-09-10T07:34:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.447+0000 7f487d600640 1 -- 172.21.15.99:0/3715432654 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4878059680 con 0x7f4880161150 2024-09-10T07:34:31.448 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:31.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-09-10T07:34:31.450 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:31.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4c0c400640 1 -- 172.21.15.99:0/3678252380 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f4c0406e5f0 con 0x7f4c0414cc40 2024-09-10T07:34:31.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 -- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f485c06beb0 msgr2=0x7f485c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f485c06beb0 0x7f485c06e370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48700094a0 tx=0x7f4870008040 comp rx=0 tx=0).stop 2024-09-10T07:34:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 -- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4880161150 msgr2=0x7f488015e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4880161150 0x7f488015e930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f487800be20 tx=0x7f487800bf10 comp rx=0 tx=0).stop 2024-09-10T07:34:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 -- 172.21.15.99:0/3715432654 shutdown_connections 2024-09-10T07:34:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f485c06beb0 0x7f485c06e370 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4880161150 0x7f488015e930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4880162270 0x7f4880160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 --2- 172.21.15.99:0/3715432654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48800d5720 0x7f488015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 -- 172.21.15.99:0/3715432654 >> 172.21.15.99:0/3715432654 conn(0x7f48800d4c00 msgr2=0x7f48800b9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4c01600640 1 -- 172.21.15.99:0/3678252380 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4bfc07a250 con 0x7f4c0414cc40 2024-09-10T07:34:31.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.451+0000 7f4887a00640 1 -- 172.21.15.99:0/3715432654 shutdown_connections 2024-09-10T07:34:31.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.452+0000 7f4887a00640 1 -- 172.21.15.99:0/3715432654 wait complete. 2024-09-10T07:34:31.453 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:31.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 -- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4be406bf00 msgr2=0x7f4be406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4be406bf00 0x7f4be406e3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80012e0 tx=0x7f4bf8001990 comp rx=0 tx=0).stop 2024-09-10T07:34:31.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 -- 172.21.15.99:0/3678252380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c0414cc40 msgr2=0x7f4c041fc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c0414cc40 0x7f4c041fc620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0098c0 tx=0x7f4bfc0046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 -- 172.21.15.99:0/3678252380 shutdown_connections 2024-09-10T07:34:31.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c0414cc40 0x7f4c041fc620 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4be406bf00 0x7f4be406e3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c040b47d0 0x7f4c041fbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 --2- 172.21.15.99:0/3678252380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c0406e180 0x7f4c040ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 -- 172.21.15.99:0/3678252380 >> 172.21.15.99:0/3678252380 conn(0x7f4c040b2630 msgr2=0x7f4c04164e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 -- 172.21.15.99:0/3678252380 shutdown_connections 2024-09-10T07:34:31.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.455+0000 7f4c0c400640 1 -- 172.21.15.99:0/3678252380 wait complete. 2024-09-10T07:34:31.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-09-10T07:34:31.457 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.457+0000 7f32d4200640 1 -- 172.21.15.99:0/2051888695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f32a8005580 con 0x7f32cc0c6130 2024-09-10T07:34:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.458+0000 7f32c9600640 1 -- 172.21.15.99:0/2051888695 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32c0058320 con 0x7f32cc0c6130 2024-09-10T07:34:31.458 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T07:34:31.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.462+0000 7f32d4200640 1 -- 172.21.15.99:0/2051888695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32ac06beb0 msgr2=0x7f32ac06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.462+0000 7f32d4200640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32ac06beb0 0x7f32ac06e370 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f32c40012e0 tx=0x7f32c4001650 comp rx=0 tx=0).stop 2024-09-10T07:34:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.462+0000 7f32d4200640 1 -- 172.21.15.99:0/2051888695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0c6130 msgr2=0x7f32cc1ed8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.462+0000 7f32d4200640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0c6130 0x7f32cc1ed8b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c800 tx=0x7f32c000ccc0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.462+0000 7f32d4200640 1 -- 172.21.15.99:0/2051888695 shutdown_connections 2024-09-10T07:34:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.462+0000 7f32d4200640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc163080 0x7f32cc06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.462+0000 7f32d4200640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32ac06beb0 0x7f32ac06e370 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.462+0000 7f32d4200640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0c6130 0x7f32cc1ed8b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.462+0000 7f32d4200640 1 --2- 172.21.15.99:0/2051888695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32cc0b1d20 0x7f32cc161b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.462+0000 7f32d4200640 1 -- 172.21.15.99:0/2051888695 >> 172.21.15.99:0/2051888695 conn(0x7f32cc0b4560 msgr2=0x7f32cc0b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.463+0000 7f32d4200640 1 -- 172.21.15.99:0/2051888695 shutdown_connections 2024-09-10T07:34:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.463+0000 7f32d4200640 1 -- 172.21.15.99:0/2051888695 wait complete. 2024-09-10T07:34:31.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-10T07:34:31.466 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:31.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-10T07:34:31.473 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:31.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-09-10T07:34:31.476 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:31.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-09-10T07:34:31.478 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:31.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-09-10T07:34:31.481 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:31.481 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:34:31.481 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:34:31.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.675+0000 7fe195a00640 1 Processor -- start 2024-09-10T07:34:31.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.675+0000 7fe195a00640 1 -- start start 2024-09-10T07:34:31.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.676+0000 7fe195a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe19015e970 0x7fe1900d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.676+0000 7fe195a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1900d2bd0 con 0x7fe1900d2680 2024-09-10T07:34:31.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.676+0000 7fe195a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1900d2eb0 con 0x7fe1900cfc90 2024-09-10T07:34:31.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.676+0000 7fe195a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe1900d37e0 con 0x7fe19015e970 2024-09-10T07:34:31.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.676+0000 7fe18f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe1900d2680 0x7fe1900cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38332/0 (socket says 172.21.15.99:38332) 2024-09-10T07:34:31.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.676+0000 7fe18f400640 1 -- 172.21.15.99:0/3270583591 learned_addr learned my addr 172.21.15.99:0/3270583591 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:31.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.676+0000 7fe18fe00640 1 --2- 172.21.15.99:0/3270583591 >> v2:172.21.15.187:3300/0 conn(0x7fe19015e970 0x7fe1900d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.677+0000 7fe18ea00640 1 -- 172.21.15.99:0/3270583591 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2127067471 0 0) 0x7fe1900d2bd0 con 0x7fe1900d2680 2024-09-10T07:34:31.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.677+0000 7fe18ea00640 1 -- 172.21.15.99:0/3270583591 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe174003520 con 0x7fe1900d2680 2024-09-10T07:34:31.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.677+0000 7fe18fe00640 1 -- 172.21.15.99:0/3270583591 >> v1:172.21.15.187:6789/0 conn(0x7fe1900cfc90 legacy=0x7fe1900c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.677+0000 7fe18fe00640 1 -- 172.21.15.99:0/3270583591 >> v1:172.21.15.99:6789/0 conn(0x7fe1900d2680 legacy=0x7fe1900cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.677+0000 7fe18fe00640 1 -- 172.21.15.99:0/3270583591 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1900d3190 con 0x7fe19015e970 2024-09-10T07:34:31.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.678+0000 7fe18fe00640 1 --2- 172.21.15.99:0/3270583591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe19015e970 0x7fe1900d0300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1900d3960 tx=0x7fe18002a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21c16742b9bf86a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.678+0000 7fe18ea00640 1 -- 172.21.15.99:0/3270583591 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe180037070 con 0x7fe19015e970 2024-09-10T07:34:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.678+0000 7fe18ea00640 1 -- 172.21.15.99:0/3270583591 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe180032440 con 0x7fe19015e970 2024-09-10T07:34:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.678+0000 7fe18ea00640 1 -- 172.21.15.99:0/3270583591 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe180032810 con 0x7fe19015e970 2024-09-10T07:34:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.679+0000 7fe195a00640 1 -- 172.21.15.99:0/3270583591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe19015e970 msgr2=0x7fe1900d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.679+0000 7fe195a00640 1 --2- 172.21.15.99:0/3270583591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe19015e970 0x7fe1900d0300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1900d3960 tx=0x7fe18002a2a0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.679+0000 7fe195a00640 1 -- 172.21.15.99:0/3270583591 shutdown_connections 2024-09-10T07:34:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.679+0000 7fe195a00640 1 --2- 172.21.15.99:0/3270583591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe19015e970 0x7fe1900d0300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.679+0000 7fe195a00640 1 -- 172.21.15.99:0/3270583591 >> 172.21.15.99:0/3270583591 conn(0x7fe19009de00 msgr2=0x7fe1900d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.679+0000 7fe195a00640 1 -- 172.21.15.99:0/3270583591 shutdown_connections 2024-09-10T07:34:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.679+0000 7fe195a00640 1 -- 172.21.15.99:0/3270583591 wait complete. 2024-09-10T07:34:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.681+0000 7fe195a00640 1 Processor -- start 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.681+0000 7fe195a00640 1 -- start start 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1900cfc90 0x7fe190157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1900d2680 0x7fe1900ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe19015e970 0x7fe190157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe19015ed50 con 0x7fe19015e970 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900d0840 con 0x7fe1900cfc90 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe19015eed0 con 0x7fe1900d2680 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe19015e970 0x7fe190157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe19015e970 0x7fe190157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52498/0 (socket says 172.21.15.99:52498) 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195000640 1 -- 172.21.15.99:0/2096115652 learned_addr learned my addr 172.21.15.99:0/2096115652 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe18f400640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1900d2680 0x7fe1900ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe18fe00640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1900cfc90 0x7fe190157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195000640 1 -- 172.21.15.99:0/2096115652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1900d2680 msgr2=0x7fe1900ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195000640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1900d2680 0x7fe1900ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195000640 1 -- 172.21.15.99:0/2096115652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1900cfc90 msgr2=0x7fe190157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195000640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1900cfc90 0x7fe190157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195000640 1 -- 172.21.15.99:0/2096115652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1901581e0 con 0x7fe19015e970 2024-09-10T07:34:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.682+0000 7fe195000640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe19015e970 0x7fe190157290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c7a0 tx=0x7fe18800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.683+0000 7fe187e00640 1 -- 172.21.15.99:0/2096115652 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188003b70 con 0x7fe19015e970 2024-09-10T07:34:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.683+0000 7fe187e00640 1 -- 172.21.15.99:0/2096115652 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe188003d30 con 0x7fe19015e970 2024-09-10T07:34:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.683+0000 7fe195a00640 1 -- 172.21.15.99:0/2096115652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1901584c0 con 0x7fe19015e970 2024-09-10T07:34:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.683+0000 7fe187e00640 1 -- 172.21.15.99:0/2096115652 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18800aa90 con 0x7fe19015e970 2024-09-10T07:34:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.683+0000 7fe195a00640 1 -- 172.21.15.99:0/2096115652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1901577d0 con 0x7fe19015e970 2024-09-10T07:34:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.684+0000 7fe195a00640 1 -- 172.21.15.99:0/2096115652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1900d0300 con 0x7fe19015e970 2024-09-10T07:34:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.685+0000 7fe187e00640 1 -- 172.21.15.99:0/2096115652 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe18800ac30 con 0x7fe19015e970 2024-09-10T07:34:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.686+0000 7fe187e00640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe17006be30 0x7fe17006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.686+0000 7fe187e00640 1 -- 172.21.15.99:0/2096115652 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe18808af20 con 0x7fe19015e970 2024-09-10T07:34:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.686+0000 7fe18fe00640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe17006be30 0x7fe17006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:31.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.686+0000 7fe18fe00640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe17006be30 0x7fe17006e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe180034000 tx=0x7fe18002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:31.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.690+0000 7fe187e00640 1 -- 172.21.15.99:0/2096115652 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1880597a0 con 0x7fe19015e970 2024-09-10T07:34:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.860+0000 7fe195a00640 1 -- 172.21.15.99:0/2096115652 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe19006d150 con 0x7fe17006be30 2024-09-10T07:34:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.865+0000 7fe187e00640 1 -- 172.21.15.99:0/2096115652 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247486 (secure 0 0 0) 0x7fe19006d150 con 0x7fe17006be30 2024-09-10T07:34:31.868 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:31.869 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:34:31.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.869+0000 7fe195a00640 1 -- 172.21.15.99:0/2096115652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe17006be30 msgr2=0x7fe17006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.869+0000 7fe195a00640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe17006be30 0x7fe17006e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe180034000 tx=0x7fe18002e000 comp rx=0 tx=0).stop 2024-09-10T07:34:31.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.869+0000 7fe195a00640 1 -- 172.21.15.99:0/2096115652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe19015e970 msgr2=0x7fe190157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:31.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.869+0000 7fe195a00640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe19015e970 0x7fe190157290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c7a0 tx=0x7fe18800cc60 comp rx=0 tx=0).stop 2024-09-10T07:34:31.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.869+0000 7fe195a00640 1 -- 172.21.15.99:0/2096115652 shutdown_connections 2024-09-10T07:34:31.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.869+0000 7fe195a00640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe17006be30 0x7fe17006e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.869+0000 7fe195a00640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe19015e970 0x7fe190157290 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.869+0000 7fe195a00640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1900d2680 0x7fe1900ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.869+0000 7fe195a00640 1 --2- 172.21.15.99:0/2096115652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1900cfc90 0x7fe190157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:31.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.869+0000 7fe195a00640 1 -- 172.21.15.99:0/2096115652 >> 172.21.15.99:0/2096115652 conn(0x7fe19009de00 msgr2=0x7fe19006d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:31.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.870+0000 7fe195a00640 1 -- 172.21.15.99:0/2096115652 shutdown_connections 2024-09-10T07:34:31.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:31.870+0000 7fe195a00640 1 -- 172.21.15.99:0/2096115652 wait complete. 2024-09-10T07:34:31.885 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T07:34:30.694718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002146"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662085+0000","last_change":"2024-09-10T07:34:19.892617+0000","last_active":"2024-09-10T07:34:21.662085+0000","last_peered":"2024-09-10T07:34:21.662085+0000","last_clean":"2024-09-10T07:34:21.662085+0000","last_became_active":"2024-09-10T07:34:19.892309+0000","last_became_peered":"2024-09-10T07:34:19.892309+0000","last_unstale":"2024-09-10T07:34:21.662085+0000","last_undegraded":"2024-09-10T07:34:21.662085+0000","last_fullsized":"2024-09-10T07:34:21.662085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:08.745649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874030+0000","last_change":"2024-09-10T07:34:19.888537+0000","last_active":"2024-09-10T07:34:20.874030+0000","last_peered":"2024-09-10T07:34:20.874030+0000","last_clean":"2024-09-10T07:34:20.874030+0000","last_became_active":"2024-09-10T07:34:19.888035+0000","last_became_peered":"2024-09-10T07:34:19.888035+0000","last_unstale":"2024-09-10T07:34:20.874030+0000","last_undegraded":"2024-09-10T07:34:20.874030+0000","last_fullsized":"2024-09-10T07:34:20.874030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.614677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661256+0000","last_change":"2024-09-10T07:34:19.878583+0000","last_active":"2024-09-10T07:34:21.661256+0000","last_peered":"2024-09-10T07:34:21.661256+0000","last_clean":"2024-09-10T07:34:21.661256+0000","last_became_active":"2024-09-10T07:34:19.877749+0000","last_became_peered":"2024-09-10T07:34:19.877749+0000","last_unstale":"2024-09-10T07:34:21.661256+0000","last_undegraded":"2024-09-10T07:34:21.661256+0000","last_fullsized":"2024-09-10T07:34:21.661256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:05.290210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874227+0000","last_change":"2024-09-10T07:34:19.902236+0000","last_active":"2024-09-10T07:34:20.874227+0000","last_peered":"2024-09-10T07:34:20.874227+0000","last_clean":"2024-09-10T07:34:20.874227+0000","last_became_active":"2024-09-10T07:34:19.890752+0000","last_became_peered":"2024-09-10T07:34:19.890752+0000","last_unstale":"2024-09-10T07:34:20.874227+0000","last_undegraded":"2024-09-10T07:34:20.874227+0000","last_fullsized":"2024-09-10T07:34:20.874227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:05.551601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662087+0000","last_change":"2024-09-10T07:34:19.887506+0000","last_active":"2024-09-10T07:34:21.662087+0000","last_peered":"2024-09-10T07:34:21.662087+0000","last_clean":"2024-09-10T07:34:21.662087+0000","last_became_active":"2024-09-10T07:34:19.887222+0000","last_became_peered":"2024-09-10T07:34:19.887222+0000","last_unstale":"2024-09-10T07:34:21.662087+0000","last_undegraded":"2024-09-10T07:34:21.662087+0000","last_fullsized":"2024-09-10T07:34:21.662087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:23.722211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874811+0000","last_change":"2024-09-10T07:34:19.903919+0000","last_active":"2024-09-10T07:34:20.874811+0000","last_peered":"2024-09-10T07:34:20.874811+0000","last_clean":"2024-09-10T07:34:20.874811+0000","last_became_active":"2024-09-10T07:34:19.899806+0000","last_became_peered":"2024-09-10T07:34:19.899806+0000","last_unstale":"2024-09-10T07:34:20.874811+0000","last_undegraded":"2024-09-10T07:34:20.874811+0000","last_fullsized":"2024-09-10T07:34:20.874811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:25.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662215+0000","last_change":"2024-09-10T07:34:19.893722+0000","last_active":"2024-09-10T07:34:21.662215+0000","last_peered":"2024-09-10T07:34:21.662215+0000","last_clean":"2024-09-10T07:34:21.662215+0000","last_became_active":"2024-09-10T07:34:19.892593+0000","last_became_peered":"2024-09-10T07:34:19.892593+0000","last_unstale":"2024-09-10T07:34:21.662215+0000","last_undegraded":"2024-09-10T07:34:21.662215+0000","last_fullsized":"2024-09-10T07:34:21.662215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:59.649735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670073+0000","last_change":"2024-09-10T07:34:19.898847+0000","last_active":"2024-09-10T07:34:21.670073+0000","last_peered":"2024-09-10T07:34:21.670073+0000","last_clean":"2024-09-10T07:34:21.670073+0000","last_became_active":"2024-09-10T07:34:19.898631+0000","last_became_peered":"2024-09-10T07:34:19.898631+0000","last_unstale":"2024-09-10T07:34:21.670073+0000","last_undegraded":"2024-09-10T07:34:21.670073+0000","last_fullsized":"2024-09-10T07:34:21.670073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:44.898089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661639+0000","last_change":"2024-09-10T07:34:19.903205+0000","last_active":"2024-09-10T07:34:21.661639+0000","last_peered":"2024-09-10T07:34:21.661639+0000","last_clean":"2024-09-10T07:34:21.661639+0000","last_became_active":"2024-09-10T07:34:19.902878+0000","last_became_peered":"2024-09-10T07:34:19.902878+0000","last_unstale":"2024-09-10T07:34:21.661639+0000","last_undegraded":"2024-09-10T07:34:21.661639+0000","last_fullsized":"2024-09-10T07:34:21.661639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:52.348207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662586+0000","last_change":"2024-09-10T07:34:19.897459+0000","last_active":"2024-09-10T07:34:21.662586+0000","last_peered":"2024-09-10T07:34:21.662586+0000","last_clean":"2024-09-10T07:34:21.662586+0000","last_became_active":"2024-09-10T07:34:19.897101+0000","last_became_peered":"2024-09-10T07:34:19.897101+0000","last_unstale":"2024-09-10T07:34:21.662586+0000","last_undegraded":"2024-09-10T07:34:21.662586+0000","last_fullsized":"2024-09-10T07:34:21.662586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:26.495286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662204+0000","last_change":"2024-09-10T07:34:19.905217+0000","last_active":"2024-09-10T07:34:21.662204+0000","last_peered":"2024-09-10T07:34:21.662204+0000","last_clean":"2024-09-10T07:34:21.662204+0000","last_became_active":"2024-09-10T07:34:19.904996+0000","last_became_peered":"2024-09-10T07:34:19.904996+0000","last_unstale":"2024-09-10T07:34:21.662204+0000","last_undegraded":"2024-09-10T07:34:21.662204+0000","last_fullsized":"2024-09-10T07:34:21.662204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:02.976787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662067+0000","last_change":"2024-09-10T07:34:19.891107+0000","last_active":"2024-09-10T07:34:21.662067+0000","last_peered":"2024-09-10T07:34:21.662067+0000","last_clean":"2024-09-10T07:34:21.662067+0000","last_became_active":"2024-09-10T07:34:19.890867+0000","last_became_peered":"2024-09-10T07:34:19.890867+0000","last_unstale":"2024-09-10T07:34:21.662067+0000","last_undegraded":"2024-09-10T07:34:21.662067+0000","last_fullsized":"2024-09-10T07:34:21.662067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:38.421462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670678+0000","last_change":"2024-09-10T07:34:19.886282+0000","last_active":"2024-09-10T07:34:21.670678+0000","last_peered":"2024-09-10T07:34:21.670678+0000","last_clean":"2024-09-10T07:34:21.670678+0000","last_became_active":"2024-09-10T07:34:19.885882+0000","last_became_peered":"2024-09-10T07:34:19.885882+0000","last_unstale":"2024-09-10T07:34:21.670678+0000","last_undegraded":"2024-09-10T07:34:21.670678+0000","last_fullsized":"2024-09-10T07:34:21.670678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:43.173752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661181+0000","last_change":"2024-09-10T07:34:19.891694+0000","last_active":"2024-09-10T07:34:21.661181+0000","last_peered":"2024-09-10T07:34:21.661181+0000","last_clean":"2024-09-10T07:34:21.661181+0000","last_became_active":"2024-09-10T07:34:19.891459+0000","last_became_peered":"2024-09-10T07:34:19.891459+0000","last_unstale":"2024-09-10T07:34:21.661181+0000","last_undegraded":"2024-09-10T07:34:21.661181+0000","last_fullsized":"2024-09-10T07:34:21.661181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:16.090201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874232+0000","last_change":"2024-09-10T07:34:19.893542+0000","last_active":"2024-09-10T07:34:20.874232+0000","last_peered":"2024-09-10T07:34:20.874232+0000","last_clean":"2024-09-10T07:34:20.874232+0000","last_became_active":"2024-09-10T07:34:19.893322+0000","last_became_peered":"2024-09-10T07:34:19.893322+0000","last_unstale":"2024-09-10T07:34:20.874232+0000","last_undegraded":"2024-09-10T07:34:20.874232+0000","last_fullsized":"2024-09-10T07:34:20.874232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:22.545813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874654+0000","last_change":"2024-09-10T07:34:19.903722+0000","last_active":"2024-09-10T07:34:20.874654+0000","last_peered":"2024-09-10T07:34:20.874654+0000","last_clean":"2024-09-10T07:34:20.874654+0000","last_became_active":"2024-09-10T07:34:19.898533+0000","last_became_peered":"2024-09-10T07:34:19.898533+0000","last_unstale":"2024-09-10T07:34:20.874654+0000","last_undegraded":"2024-09-10T07:34:20.874654+0000","last_fullsized":"2024-09-10T07:34:20.874654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:05.242981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874283+0000","last_change":"2024-09-10T07:34:19.899921+0000","last_active":"2024-09-10T07:34:20.874283+0000","last_peered":"2024-09-10T07:34:20.874283+0000","last_clean":"2024-09-10T07:34:20.874283+0000","last_became_active":"2024-09-10T07:34:19.898724+0000","last_became_peered":"2024-09-10T07:34:19.898724+0000","last_unstale":"2024-09-10T07:34:20.874283+0000","last_undegraded":"2024-09-10T07:34:20.874283+0000","last_fullsized":"2024-09-10T07:34:20.874283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:41.761384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876568+0000","last_change":"2024-09-10T07:34:19.885766+0000","last_active":"2024-09-10T07:34:20.876568+0000","last_peered":"2024-09-10T07:34:20.876568+0000","last_clean":"2024-09-10T07:34:20.876568+0000","last_became_active":"2024-09-10T07:34:19.885527+0000","last_became_peered":"2024-09-10T07:34:19.885527+0000","last_unstale":"2024-09-10T07:34:20.876568+0000","last_undegraded":"2024-09-10T07:34:20.876568+0000","last_fullsized":"2024-09-10T07:34:20.876568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:00.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661947+0000","last_change":"2024-09-10T07:34:19.893683+0000","last_active":"2024-09-10T07:34:21.661947+0000","last_peered":"2024-09-10T07:34:21.661947+0000","last_clean":"2024-09-10T07:34:21.661947+0000","last_became_active":"2024-09-10T07:34:19.893434+0000","last_became_peered":"2024-09-10T07:34:19.893434+0000","last_unstale":"2024-09-10T07:34:21.661947+0000","last_undegraded":"2024-09-10T07:34:21.661947+0000","last_fullsized":"2024-09-10T07:34:21.661947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:51.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662731+0000","last_change":"2024-09-10T07:34:19.887710+0000","last_active":"2024-09-10T07:34:21.662731+0000","last_peered":"2024-09-10T07:34:21.662731+0000","last_clean":"2024-09-10T07:34:21.662731+0000","last_became_active":"2024-09-10T07:34:19.885828+0000","last_became_peered":"2024-09-10T07:34:19.885828+0000","last_unstale":"2024-09-10T07:34:21.662731+0000","last_undegraded":"2024-09-10T07:34:21.662731+0000","last_fullsized":"2024-09-10T07:34:21.662731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:04.667930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661631+0000","last_change":"2024-09-10T07:34:19.892283+0000","last_active":"2024-09-10T07:34:21.661631+0000","last_peered":"2024-09-10T07:34:21.661631+0000","last_clean":"2024-09-10T07:34:21.661631+0000","last_became_active":"2024-09-10T07:34:19.891053+0000","last_became_peered":"2024-09-10T07:34:19.891053+0000","last_unstale":"2024-09-10T07:34:21.661631+0000","last_undegraded":"2024-09-10T07:34:21.661631+0000","last_fullsized":"2024-09-10T07:34:21.661631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:29.348905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874600+0000","last_change":"2024-09-10T07:34:19.902111+0000","last_active":"2024-09-10T07:34:20.874600+0000","last_peered":"2024-09-10T07:34:20.874600+0000","last_clean":"2024-09-10T07:34:20.874600+0000","last_became_active":"2024-09-10T07:34:19.899428+0000","last_became_peered":"2024-09-10T07:34:19.899428+0000","last_unstale":"2024-09-10T07:34:20.874600+0000","last_undegraded":"2024-09-10T07:34:20.874600+0000","last_fullsized":"2024-09-10T07:34:20.874600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:20.251420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670807+0000","last_change":"2024-09-10T07:34:19.897707+0000","last_active":"2024-09-10T07:34:21.670807+0000","last_peered":"2024-09-10T07:34:21.670807+0000","last_clean":"2024-09-10T07:34:21.670807+0000","last_became_active":"2024-09-10T07:34:19.897224+0000","last_became_peered":"2024-09-10T07:34:19.897224+0000","last_unstale":"2024-09-10T07:34:21.670807+0000","last_undegraded":"2024-09-10T07:34:21.670807+0000","last_fullsized":"2024-09-10T07:34:21.670807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:55.118641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874389+0000","last_change":"2024-09-10T07:34:19.902882+0000","last_active":"2024-09-10T07:34:20.874389+0000","last_peered":"2024-09-10T07:34:20.874389+0000","last_clean":"2024-09-10T07:34:20.874389+0000","last_became_active":"2024-09-10T07:34:19.902613+0000","last_became_peered":"2024-09-10T07:34:19.902613+0000","last_unstale":"2024-09-10T07:34:20.874389+0000","last_undegraded":"2024-09-10T07:34:20.874389+0000","last_fullsized":"2024-09-10T07:34:20.874389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:32.482791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670154+0000","last_change":"2024-09-10T07:34:19.894790+0000","last_active":"2024-09-10T07:34:21.670154+0000","last_peered":"2024-09-10T07:34:21.670154+0000","last_clean":"2024-09-10T07:34:21.670154+0000","last_became_active":"2024-09-10T07:34:19.894561+0000","last_became_peered":"2024-09-10T07:34:19.894561+0000","last_unstale":"2024-09-10T07:34:21.670154+0000","last_undegraded":"2024-09-10T07:34:21.670154+0000","last_fullsized":"2024-09-10T07:34:21.670154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:03.238025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662344+0000","last_change":"2024-09-10T07:34:19.892319+0000","last_active":"2024-09-10T07:34:21.662344+0000","last_peered":"2024-09-10T07:34:21.662344+0000","last_clean":"2024-09-10T07:34:21.662344+0000","last_became_active":"2024-09-10T07:34:19.890032+0000","last_became_peered":"2024-09-10T07:34:19.890032+0000","last_unstale":"2024-09-10T07:34:21.662344+0000","last_undegraded":"2024-09-10T07:34:21.662344+0000","last_fullsized":"2024-09-10T07:34:21.662344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:11:11.464486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874146+0000","last_change":"2024-09-10T07:34:19.888281+0000","last_active":"2024-09-10T07:34:20.874146+0000","last_peered":"2024-09-10T07:34:20.874146+0000","last_clean":"2024-09-10T07:34:20.874146+0000","last_became_active":"2024-09-10T07:34:19.887727+0000","last_became_peered":"2024-09-10T07:34:19.887727+0000","last_unstale":"2024-09-10T07:34:20.874146+0000","last_undegraded":"2024-09-10T07:34:20.874146+0000","last_fullsized":"2024-09-10T07:34:20.874146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:55.524958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670292+0000","last_change":"2024-09-10T07:34:19.897389+0000","last_active":"2024-09-10T07:34:21.670292+0000","last_peered":"2024-09-10T07:34:21.670292+0000","last_clean":"2024-09-10T07:34:21.670292+0000","last_became_active":"2024-09-10T07:34:19.893934+0000","last_became_peered":"2024-09-10T07:34:19.893934+0000","last_unstale":"2024-09-10T07:34:21.670292+0000","last_undegraded":"2024-09-10T07:34:21.670292+0000","last_fullsized":"2024-09-10T07:34:21.670292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:41.808586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661356+0000","last_change":"2024-09-10T07:34:19.889846+0000","last_active":"2024-09-10T07:34:21.661356+0000","last_peered":"2024-09-10T07:34:21.661356+0000","last_clean":"2024-09-10T07:34:21.661356+0000","last_became_active":"2024-09-10T07:34:19.887187+0000","last_became_peered":"2024-09-10T07:34:19.887187+0000","last_unstale":"2024-09-10T07:34:21.661356+0000","last_undegraded":"2024-09-10T07:34:21.661356+0000","last_fullsized":"2024-09-10T07:34:21.661356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.175246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874425+0000","last_change":"2024-09-10T07:34:19.896912+0000","last_active":"2024-09-10T07:34:20.874425+0000","last_peered":"2024-09-10T07:34:20.874425+0000","last_clean":"2024-09-10T07:34:20.874425+0000","last_became_active":"2024-09-10T07:34:19.888502+0000","last_became_peered":"2024-09-10T07:34:19.888502+0000","last_unstale":"2024-09-10T07:34:20.874425+0000","last_undegraded":"2024-09-10T07:34:20.874425+0000","last_fullsized":"2024-09-10T07:34:20.874425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:44.356761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876566+0000","last_change":"2024-09-10T07:34:19.905306+0000","last_active":"2024-09-10T07:34:20.876566+0000","last_peered":"2024-09-10T07:34:20.876566+0000","last_clean":"2024-09-10T07:34:20.876566+0000","last_became_active":"2024-09-10T07:34:19.905152+0000","last_became_peered":"2024-09-10T07:34:19.905152+0000","last_unstale":"2024-09-10T07:34:20.876566+0000","last_undegraded":"2024-09-10T07:34:20.876566+0000","last_fullsized":"2024-09-10T07:34:20.876566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:21.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662983+0000","last_change":"2024-09-10T07:34:19.886696+0000","last_active":"2024-09-10T07:34:21.662983+0000","last_peered":"2024-09-10T07:34:21.662983+0000","last_clean":"2024-09-10T07:34:21.662983+0000","last_became_active":"2024-09-10T07:34:19.886407+0000","last_became_peered":"2024-09-10T07:34:19.886407+0000","last_unstale":"2024-09-10T07:34:21.662983+0000","last_undegraded":"2024-09-10T07:34:21.662983+0000","last_fullsized":"2024-09-10T07:34:21.662983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:24.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662493+0000","last_change":"2024-09-10T07:34:19.887443+0000","last_active":"2024-09-10T07:34:21.662493+0000","last_peered":"2024-09-10T07:34:21.662493+0000","last_clean":"2024-09-10T07:34:21.662493+0000","last_became_active":"2024-09-10T07:34:19.887205+0000","last_became_peered":"2024-09-10T07:34:19.887205+0000","last_unstale":"2024-09-10T07:34:21.662493+0000","last_undegraded":"2024-09-10T07:34:21.662493+0000","last_fullsized":"2024-09-10T07:34:21.662493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:12.040516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670544+0000","last_change":"2024-09-10T07:34:18.889171+0000","last_active":"2024-09-10T07:34:21.670544+0000","last_peered":"2024-09-10T07:34:21.670544+0000","last_clean":"2024-09-10T07:34:21.670544+0000","last_became_active":"2024-09-10T07:34:18.888923+0000","last_became_peered":"2024-09-10T07:34:18.888923+0000","last_unstale":"2024-09-10T07:34:21.670544+0000","last_undegraded":"2024-09-10T07:34:21.670544+0000","last_fullsized":"2024-09-10T07:34:21.670544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:20.349301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661390+0000","last_change":"2024-09-10T07:34:19.890336+0000","last_active":"2024-09-10T07:34:21.661390+0000","last_peered":"2024-09-10T07:34:21.661390+0000","last_clean":"2024-09-10T07:34:21.661390+0000","last_became_active":"2024-09-10T07:34:19.890049+0000","last_became_peered":"2024-09-10T07:34:19.890049+0000","last_unstale":"2024-09-10T07:34:21.661390+0000","last_undegraded":"2024-09-10T07:34:21.661390+0000","last_fullsized":"2024-09-10T07:34:21.661390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:48.240115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661973+0000","last_change":"2024-09-10T07:34:18.890244+0000","last_active":"2024-09-10T07:34:21.661973+0000","last_peered":"2024-09-10T07:34:21.661973+0000","last_clean":"2024-09-10T07:34:21.661973+0000","last_became_active":"2024-09-10T07:34:18.889613+0000","last_became_peered":"2024-09-10T07:34:18.889613+0000","last_unstale":"2024-09-10T07:34:21.661973+0000","last_undegraded":"2024-09-10T07:34:21.661973+0000","last_fullsized":"2024-09-10T07:34:21.661973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:11.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670521+0000","last_change":"2024-09-10T07:34:18.889534+0000","last_active":"2024-09-10T07:34:21.670521+0000","last_peered":"2024-09-10T07:34:21.670521+0000","last_clean":"2024-09-10T07:34:21.670521+0000","last_became_active":"2024-09-10T07:34:18.889242+0000","last_became_peered":"2024-09-10T07:34:18.889242+0000","last_unstale":"2024-09-10T07:34:21.670521+0000","last_undegraded":"2024-09-10T07:34:21.670521+0000","last_fullsized":"2024-09-10T07:34:21.670521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:18.829274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670327+0000","last_change":"2024-09-10T07:34:19.884510+0000","last_active":"2024-09-10T07:34:21.670327+0000","last_peered":"2024-09-10T07:34:21.670327+0000","last_clean":"2024-09-10T07:34:21.670327+0000","last_became_active":"2024-09-10T07:34:19.884235+0000","last_became_peered":"2024-09-10T07:34:19.884235+0000","last_unstale":"2024-09-10T07:34:21.670327+0000","last_undegraded":"2024-09-10T07:34:21.670327+0000","last_fullsized":"2024-09-10T07:34:21.670327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:31.685537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874642+0000","last_change":"2024-09-10T07:34:18.884543+0000","last_active":"2024-09-10T07:34:20.874642+0000","last_peered":"2024-09-10T07:34:20.874642+0000","last_clean":"2024-09-10T07:34:20.874642+0000","last_became_active":"2024-09-10T07:34:18.884298+0000","last_became_peered":"2024-09-10T07:34:18.884298+0000","last_unstale":"2024-09-10T07:34:20.874642+0000","last_undegraded":"2024-09-10T07:34:20.874642+0000","last_fullsized":"2024-09-10T07:34:20.874642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:11.804692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874177+0000","last_change":"2024-09-10T07:34:19.888708+0000","last_active":"2024-09-10T07:34:20.874177+0000","last_peered":"2024-09-10T07:34:20.874177+0000","last_clean":"2024-09-10T07:34:20.874177+0000","last_became_active":"2024-09-10T07:34:19.888434+0000","last_became_peered":"2024-09-10T07:34:19.888434+0000","last_unstale":"2024-09-10T07:34:20.874177+0000","last_undegraded":"2024-09-10T07:34:20.874177+0000","last_fullsized":"2024-09-10T07:34:20.874177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:41.986776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662474+0000","last_change":"2024-09-10T07:34:18.888024+0000","last_active":"2024-09-10T07:34:21.662474+0000","last_peered":"2024-09-10T07:34:21.662474+0000","last_clean":"2024-09-10T07:34:21.662474+0000","last_became_active":"2024-09-10T07:34:18.886888+0000","last_became_peered":"2024-09-10T07:34:18.886888+0000","last_unstale":"2024-09-10T07:34:21.662474+0000","last_undegraded":"2024-09-10T07:34:21.662474+0000","last_fullsized":"2024-09-10T07:34:21.662474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:27.884742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874439+0000","last_change":"2024-09-10T07:34:19.901075+0000","last_active":"2024-09-10T07:34:20.874439+0000","last_peered":"2024-09-10T07:34:20.874439+0000","last_clean":"2024-09-10T07:34:20.874439+0000","last_became_active":"2024-09-10T07:34:19.899090+0000","last_became_peered":"2024-09-10T07:34:19.899090+0000","last_unstale":"2024-09-10T07:34:20.874439+0000","last_undegraded":"2024-09-10T07:34:20.874439+0000","last_fullsized":"2024-09-10T07:34:20.874439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:12.703010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874850+0000","last_change":"2024-09-10T07:34:18.890112+0000","last_active":"2024-09-10T07:34:20.874850+0000","last_peered":"2024-09-10T07:34:20.874850+0000","last_clean":"2024-09-10T07:34:20.874850+0000","last_became_active":"2024-09-10T07:34:18.888701+0000","last_became_peered":"2024-09-10T07:34:18.888701+0000","last_unstale":"2024-09-10T07:34:20.874850+0000","last_undegraded":"2024-09-10T07:34:20.874850+0000","last_fullsized":"2024-09-10T07:34:20.874850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:36.214403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661712+0000","last_change":"2024-09-10T07:34:19.904217+0000","last_active":"2024-09-10T07:34:21.661712+0000","last_peered":"2024-09-10T07:34:21.661712+0000","last_clean":"2024-09-10T07:34:21.661712+0000","last_became_active":"2024-09-10T07:34:19.903931+0000","last_became_peered":"2024-09-10T07:34:19.903931+0000","last_unstale":"2024-09-10T07:34:21.661712+0000","last_undegraded":"2024-09-10T07:34:21.661712+0000","last_fullsized":"2024-09-10T07:34:21.661712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:15.824093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874133+0000","last_change":"2024-09-10T07:34:18.880938+0000","last_active":"2024-09-10T07:34:20.874133+0000","last_peered":"2024-09-10T07:34:20.874133+0000","last_clean":"2024-09-10T07:34:20.874133+0000","last_became_active":"2024-09-10T07:34:18.880624+0000","last_became_peered":"2024-09-10T07:34:18.880624+0000","last_unstale":"2024-09-10T07:34:20.874133+0000","last_undegraded":"2024-09-10T07:34:20.874133+0000","last_fullsized":"2024-09-10T07:34:20.874133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:54.148440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661856+0000","last_change":"2024-09-10T07:34:19.892359+0000","last_active":"2024-09-10T07:34:21.661856+0000","last_peered":"2024-09-10T07:34:21.661856+0000","last_clean":"2024-09-10T07:34:21.661856+0000","last_became_active":"2024-09-10T07:34:19.892071+0000","last_became_peered":"2024-09-10T07:34:19.892071+0000","last_unstale":"2024-09-10T07:34:21.661856+0000","last_undegraded":"2024-09-10T07:34:21.661856+0000","last_fullsized":"2024-09-10T07:34:21.661856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:35.384674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662593+0000","last_change":"2024-09-10T07:34:18.890452+0000","last_active":"2024-09-10T07:34:21.662593+0000","last_peered":"2024-09-10T07:34:21.662593+0000","last_clean":"2024-09-10T07:34:21.662593+0000","last_became_active":"2024-09-10T07:34:18.890105+0000","last_became_peered":"2024-09-10T07:34:18.890105+0000","last_unstale":"2024-09-10T07:34:21.662593+0000","last_undegraded":"2024-09-10T07:34:21.662593+0000","last_fullsized":"2024-09-10T07:34:21.662593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:38.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663586+0000","last_change":"2024-09-10T07:34:19.890697+0000","last_active":"2024-09-10T07:34:21.663586+0000","last_peered":"2024-09-10T07:34:21.663586+0000","last_clean":"2024-09-10T07:34:21.663586+0000","last_became_active":"2024-09-10T07:34:19.890402+0000","last_became_peered":"2024-09-10T07:34:19.890402+0000","last_unstale":"2024-09-10T07:34:21.663586+0000","last_undegraded":"2024-09-10T07:34:21.663586+0000","last_fullsized":"2024-09-10T07:34:21.663586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:53.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661353+0000","last_change":"2024-09-10T07:34:18.888006+0000","last_active":"2024-09-10T07:34:21.661353+0000","last_peered":"2024-09-10T07:34:21.661353+0000","last_clean":"2024-09-10T07:34:21.661353+0000","last_became_active":"2024-09-10T07:34:18.887741+0000","last_became_peered":"2024-09-10T07:34:18.887741+0000","last_unstale":"2024-09-10T07:34:21.661353+0000","last_undegraded":"2024-09-10T07:34:21.661353+0000","last_fullsized":"2024-09-10T07:34:21.661353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:54.559172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661790+0000","last_change":"2024-09-10T07:34:19.889260+0000","last_active":"2024-09-10T07:34:21.661790+0000","last_peered":"2024-09-10T07:34:21.661790+0000","last_clean":"2024-09-10T07:34:21.661790+0000","last_became_active":"2024-09-10T07:34:19.887143+0000","last_became_peered":"2024-09-10T07:34:19.887143+0000","last_unstale":"2024-09-10T07:34:21.661790+0000","last_undegraded":"2024-09-10T07:34:21.661790+0000","last_fullsized":"2024-09-10T07:34:21.661790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:16.774984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.875016+0000","last_change":"2024-09-10T07:34:18.882643+0000","last_active":"2024-09-10T07:34:20.875016+0000","last_peered":"2024-09-10T07:34:20.875016+0000","last_clean":"2024-09-10T07:34:20.875016+0000","last_became_active":"2024-09-10T07:34:18.880714+0000","last_became_peered":"2024-09-10T07:34:18.880714+0000","last_unstale":"2024-09-10T07:34:20.875016+0000","last_undegraded":"2024-09-10T07:34:20.875016+0000","last_fullsized":"2024-09-10T07:34:20.875016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:45.258127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662259+0000","last_change":"2024-09-10T07:34:19.896855+0000","last_active":"2024-09-10T07:34:21.662259+0000","last_peered":"2024-09-10T07:34:21.662259+0000","last_clean":"2024-09-10T07:34:21.662259+0000","last_became_active":"2024-09-10T07:34:19.896238+0000","last_became_peered":"2024-09-10T07:34:19.896238+0000","last_unstale":"2024-09-10T07:34:21.662259+0000","last_undegraded":"2024-09-10T07:34:21.662259+0000","last_fullsized":"2024-09-10T07:34:21.662259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:16.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663121+0000","last_change":"2024-09-10T07:34:18.888390+0000","last_active":"2024-09-10T07:34:21.663121+0000","last_peered":"2024-09-10T07:34:21.663121+0000","last_clean":"2024-09-10T07:34:21.663121+0000","last_became_active":"2024-09-10T07:34:18.888118+0000","last_became_peered":"2024-09-10T07:34:18.888118+0000","last_unstale":"2024-09-10T07:34:21.663121+0000","last_undegraded":"2024-09-10T07:34:21.663121+0000","last_fullsized":"2024-09-10T07:34:21.663121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:56.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661915+0000","last_change":"2024-09-10T07:34:19.883697+0000","last_active":"2024-09-10T07:34:21.661915+0000","last_peered":"2024-09-10T07:34:21.661915+0000","last_clean":"2024-09-10T07:34:21.661915+0000","last_became_active":"2024-09-10T07:34:19.883431+0000","last_became_peered":"2024-09-10T07:34:19.883431+0000","last_unstale":"2024-09-10T07:34:21.661915+0000","last_undegraded":"2024-09-10T07:34:21.661915+0000","last_fullsized":"2024-09-10T07:34:21.661915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:20.019093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876623+0000","last_change":"2024-09-10T07:34:18.883206+0000","last_active":"2024-09-10T07:34:20.876623+0000","last_peered":"2024-09-10T07:34:20.876623+0000","last_clean":"2024-09-10T07:34:20.876623+0000","last_became_active":"2024-09-10T07:34:18.882158+0000","last_became_peered":"2024-09-10T07:34:18.882158+0000","last_unstale":"2024-09-10T07:34:20.876623+0000","last_undegraded":"2024-09-10T07:34:20.876623+0000","last_fullsized":"2024-09-10T07:34:20.876623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663793+0000","last_change":"2024-09-10T07:34:19.894056+0000","last_active":"2024-09-10T07:34:21.663793+0000","last_peered":"2024-09-10T07:34:21.663793+0000","last_clean":"2024-09-10T07:34:21.663793+0000","last_became_active":"2024-09-10T07:34:19.892962+0000","last_became_peered":"2024-09-10T07:34:19.892962+0000","last_unstale":"2024-09-10T07:34:21.663793+0000","last_undegraded":"2024-09-10T07:34:21.663793+0000","last_fullsized":"2024-09-10T07:34:21.663793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:09.600142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661937+0000","last_change":"2024-09-10T07:34:18.874857+0000","last_active":"2024-09-10T07:34:21.661937+0000","last_peered":"2024-09-10T07:34:21.661937+0000","last_clean":"2024-09-10T07:34:21.661937+0000","last_became_active":"2024-09-10T07:34:18.874552+0000","last_became_peered":"2024-09-10T07:34:18.874552+0000","last_unstale":"2024-09-10T07:34:21.661937+0000","last_undegraded":"2024-09-10T07:34:21.661937+0000","last_fullsized":"2024-09-10T07:34:21.661937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:23.855683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662517+0000","last_change":"2024-09-10T07:34:19.897112+0000","last_active":"2024-09-10T07:34:21.662517+0000","last_peered":"2024-09-10T07:34:21.662517+0000","last_clean":"2024-09-10T07:34:21.662517+0000","last_became_active":"2024-09-10T07:34:19.896629+0000","last_became_peered":"2024-09-10T07:34:19.896629+0000","last_unstale":"2024-09-10T07:34:21.662517+0000","last_undegraded":"2024-09-10T07:34:21.662517+0000","last_fullsized":"2024-09-10T07:34:21.662517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:55.574984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876617+0000","last_change":"2024-09-10T07:34:18.881651+0000","last_active":"2024-09-10T07:34:20.876617+0000","last_peered":"2024-09-10T07:34:20.876617+0000","last_clean":"2024-09-10T07:34:20.876617+0000","last_became_active":"2024-09-10T07:34:18.880881+0000","last_became_peered":"2024-09-10T07:34:18.880881+0000","last_unstale":"2024-09-10T07:34:20.876617+0000","last_undegraded":"2024-09-10T07:34:20.876617+0000","last_fullsized":"2024-09-10T07:34:20.876617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:25.241480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661793+0000","last_change":"2024-09-10T07:34:19.897357+0000","last_active":"2024-09-10T07:34:21.661793+0000","last_peered":"2024-09-10T07:34:21.661793+0000","last_clean":"2024-09-10T07:34:21.661793+0000","last_became_active":"2024-09-10T07:34:19.896933+0000","last_became_peered":"2024-09-10T07:34:19.896933+0000","last_unstale":"2024-09-10T07:34:21.661793+0000","last_undegraded":"2024-09-10T07:34:21.661793+0000","last_fullsized":"2024-09-10T07:34:21.661793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:34.757810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874058+0000","last_change":"2024-09-10T07:34:18.889958+0000","last_active":"2024-09-10T07:34:20.874058+0000","last_peered":"2024-09-10T07:34:20.874058+0000","last_clean":"2024-09-10T07:34:20.874058+0000","last_became_active":"2024-09-10T07:34:18.889736+0000","last_became_peered":"2024-09-10T07:34:18.889736+0000","last_unstale":"2024-09-10T07:34:20.874058+0000","last_undegraded":"2024-09-10T07:34:20.874058+0000","last_fullsized":"2024-09-10T07:34:20.874058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:24.746910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874732+0000","last_change":"2024-09-10T07:34:19.897928+0000","last_active":"2024-09-10T07:34:20.874732+0000","last_peered":"2024-09-10T07:34:20.874732+0000","last_clean":"2024-09-10T07:34:20.874732+0000","last_became_active":"2024-09-10T07:34:19.896221+0000","last_became_peered":"2024-09-10T07:34:19.896221+0000","last_unstale":"2024-09-10T07:34:20.874732+0000","last_undegraded":"2024-09-10T07:34:20.874732+0000","last_fullsized":"2024-09-10T07:34:20.874732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:06.456252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876363+0000","last_change":"2024-09-10T07:34:18.877131+0000","last_active":"2024-09-10T07:34:20.876363+0000","last_peered":"2024-09-10T07:34:20.876363+0000","last_clean":"2024-09-10T07:34:20.876363+0000","last_became_active":"2024-09-10T07:34:18.876023+0000","last_became_peered":"2024-09-10T07:34:18.876023+0000","last_unstale":"2024-09-10T07:34:20.876363+0000","last_undegraded":"2024-09-10T07:34:20.876363+0000","last_fullsized":"2024-09-10T07:34:20.876363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:12:08.297705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663613+0000","last_change":"2024-09-10T07:34:19.905847+0000","last_active":"2024-09-10T07:34:21.663613+0000","last_peered":"2024-09-10T07:34:21.663613+0000","last_clean":"2024-09-10T07:34:21.663613+0000","last_became_active":"2024-09-10T07:34:19.905522+0000","last_became_peered":"2024-09-10T07:34:19.905522+0000","last_unstale":"2024-09-10T07:34:21.663613+0000","last_undegraded":"2024-09-10T07:34:21.663613+0000","last_fullsized":"2024-09-10T07:34:21.663613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:07.869122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663659+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:34:21.663659+0000","last_peered":"2024-09-10T07:34:21.663659+0000","last_clean":"2024-09-10T07:34:21.663659+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:34:21.663659+0000","last_undegraded":"2024-09-10T07:34:21.663659+0000","last_fullsized":"2024-09-10T07:34:21.663659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.875200+0000","last_change":"2024-09-10T07:34:18.881565+0000","last_active":"2024-09-10T07:34:20.875200+0000","last_peered":"2024-09-10T07:34:20.875200+0000","last_clean":"2024-09-10T07:34:20.875200+0000","last_became_active":"2024-09-10T07:34:18.879618+0000","last_became_peered":"2024-09-10T07:34:18.879618+0000","last_unstale":"2024-09-10T07:34:20.875200+0000","last_undegraded":"2024-09-10T07:34:20.875200+0000","last_fullsized":"2024-09-10T07:34:20.875200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:43.934312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670323+0000","last_change":"2024-09-10T07:34:19.899451+0000","last_active":"2024-09-10T07:34:21.670323+0000","last_peered":"2024-09-10T07:34:21.670323+0000","last_clean":"2024-09-10T07:34:21.670323+0000","last_became_active":"2024-09-10T07:34:19.899171+0000","last_became_peered":"2024-09-10T07:34:19.899171+0000","last_unstale":"2024-09-10T07:34:21.670323+0000","last_undegraded":"2024-09-10T07:34:21.670323+0000","last_fullsized":"2024-09-10T07:34:21.670323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:00.427217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663563+0000","last_change":"2024-09-10T07:34:18.886056+0000","last_active":"2024-09-10T07:34:21.663563+0000","last_peered":"2024-09-10T07:34:21.663563+0000","last_clean":"2024-09-10T07:34:21.663563+0000","last_became_active":"2024-09-10T07:34:18.884743+0000","last_became_peered":"2024-09-10T07:34:18.884743+0000","last_unstale":"2024-09-10T07:34:21.663563+0000","last_undegraded":"2024-09-10T07:34:21.663563+0000","last_fullsized":"2024-09-10T07:34:21.663563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:47.912136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661759+0000","last_change":"2024-09-10T07:34:19.890527+0000","last_active":"2024-09-10T07:34:21.661759+0000","last_peered":"2024-09-10T07:34:21.661759+0000","last_clean":"2024-09-10T07:34:21.661759+0000","last_became_active":"2024-09-10T07:34:19.888669+0000","last_became_peered":"2024-09-10T07:34:19.888669+0000","last_unstale":"2024-09-10T07:34:21.661759+0000","last_undegraded":"2024-09-10T07:34:21.661759+0000","last_fullsized":"2024-09-10T07:34:21.661759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:16.766074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876721+0000","last_change":"2024-09-10T07:34:18.880716+0000","last_active":"2024-09-10T07:34:20.876721+0000","last_peered":"2024-09-10T07:34:20.876721+0000","last_clean":"2024-09-10T07:34:20.876721+0000","last_became_active":"2024-09-10T07:34:18.880464+0000","last_became_peered":"2024-09-10T07:34:18.880464+0000","last_unstale":"2024-09-10T07:34:20.876721+0000","last_undegraded":"2024-09-10T07:34:20.876721+0000","last_fullsized":"2024-09-10T07:34:20.876721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:16.502080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874334+0000","last_change":"2024-09-10T07:34:19.886246+0000","last_active":"2024-09-10T07:34:20.874334+0000","last_peered":"2024-09-10T07:34:20.874334+0000","last_clean":"2024-09-10T07:34:20.874334+0000","last_became_active":"2024-09-10T07:34:19.886011+0000","last_became_peered":"2024-09-10T07:34:19.886011+0000","last_unstale":"2024-09-10T07:34:20.874334+0000","last_undegraded":"2024-09-10T07:34:20.874334+0000","last_fullsized":"2024-09-10T07:34:20.874334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:38.325753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874907+0000","last_change":"2024-09-10T07:34:18.884016+0000","last_active":"2024-09-10T07:34:20.874907+0000","last_peered":"2024-09-10T07:34:20.874907+0000","last_clean":"2024-09-10T07:34:20.874907+0000","last_became_active":"2024-09-10T07:34:18.883371+0000","last_became_peered":"2024-09-10T07:34:18.883371+0000","last_unstale":"2024-09-10T07:34:20.874907+0000","last_undegraded":"2024-09-10T07:34:20.874907+0000","last_fullsized":"2024-09-10T07:34:20.874907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:30.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662521+0000","last_change":"2024-09-10T07:34:19.886349+0000","last_active":"2024-09-10T07:34:21.662521+0000","last_peered":"2024-09-10T07:34:21.662521+0000","last_clean":"2024-09-10T07:34:21.662521+0000","last_became_active":"2024-09-10T07:34:19.886096+0000","last_became_peered":"2024-09-10T07:34:19.886096+0000","last_unstale":"2024-09-10T07:34:21.662521+0000","last_undegraded":"2024-09-10T07:34:21.662521+0000","last_fullsized":"2024-09-10T07:34:21.662521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:08.446221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874348+0000","last_change":"2024-09-10T07:34:18.881982+0000","last_active":"2024-09-10T07:34:20.874348+0000","last_peered":"2024-09-10T07:34:20.874348+0000","last_clean":"2024-09-10T07:34:20.874348+0000","last_became_active":"2024-09-10T07:34:18.881585+0000","last_became_peered":"2024-09-10T07:34:18.881585+0000","last_unstale":"2024-09-10T07:34:20.874348+0000","last_undegraded":"2024-09-10T07:34:20.874348+0000","last_fullsized":"2024-09-10T07:34:20.874348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:17.622849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874496+0000","last_change":"2024-09-10T07:34:19.901907+0000","last_active":"2024-09-10T07:34:20.874496+0000","last_peered":"2024-09-10T07:34:20.874496+0000","last_clean":"2024-09-10T07:34:20.874496+0000","last_became_active":"2024-09-10T07:34:19.889125+0000","last_became_peered":"2024-09-10T07:34:19.889125+0000","last_unstale":"2024-09-10T07:34:20.874496+0000","last_undegraded":"2024-09-10T07:34:20.874496+0000","last_fullsized":"2024-09-10T07:34:20.874496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:22.996650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662632+0000","last_change":"2024-09-10T07:34:18.886286+0000","last_active":"2024-09-10T07:34:21.662632+0000","last_peered":"2024-09-10T07:34:21.662632+0000","last_clean":"2024-09-10T07:34:21.662632+0000","last_became_active":"2024-09-10T07:34:18.885859+0000","last_became_peered":"2024-09-10T07:34:18.885859+0000","last_unstale":"2024-09-10T07:34:21.662632+0000","last_undegraded":"2024-09-10T07:34:21.662632+0000","last_fullsized":"2024-09-10T07:34:21.662632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:31.802025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874083+0000","last_change":"2024-09-10T07:34:19.892610+0000","last_active":"2024-09-10T07:34:20.874083+0000","last_peered":"2024-09-10T07:34:20.874083+0000","last_clean":"2024-09-10T07:34:20.874083+0000","last_became_active":"2024-09-10T07:34:19.892379+0000","last_became_peered":"2024-09-10T07:34:19.892379+0000","last_unstale":"2024-09-10T07:34:20.874083+0000","last_undegraded":"2024-09-10T07:34:20.874083+0000","last_fullsized":"2024-09-10T07:34:20.874083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:15.254184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874282+0000","last_change":"2024-09-10T07:34:18.888415+0000","last_active":"2024-09-10T07:34:20.874282+0000","last_peered":"2024-09-10T07:34:20.874282+0000","last_clean":"2024-09-10T07:34:20.874282+0000","last_became_active":"2024-09-10T07:34:18.888207+0000","last_became_peered":"2024-09-10T07:34:18.888207+0000","last_unstale":"2024-09-10T07:34:20.874282+0000","last_undegraded":"2024-09-10T07:34:20.874282+0000","last_fullsized":"2024-09-10T07:34:20.874282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:22.188010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670152+0000","last_change":"2024-09-10T07:34:19.889874+0000","last_active":"2024-09-10T07:34:21.670152+0000","last_peered":"2024-09-10T07:34:21.670152+0000","last_clean":"2024-09-10T07:34:21.670152+0000","last_became_active":"2024-09-10T07:34:19.889625+0000","last_became_peered":"2024-09-10T07:34:19.889625+0000","last_unstale":"2024-09-10T07:34:21.670152+0000","last_undegraded":"2024-09-10T07:34:21.670152+0000","last_fullsized":"2024-09-10T07:34:21.670152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:51.968652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663254+0000","last_change":"2024-09-10T07:34:18.887039+0000","last_active":"2024-09-10T07:34:21.663254+0000","last_peered":"2024-09-10T07:34:21.663254+0000","last_clean":"2024-09-10T07:34:21.663254+0000","last_became_active":"2024-09-10T07:34:18.886635+0000","last_became_peered":"2024-09-10T07:34:18.886635+0000","last_unstale":"2024-09-10T07:34:21.663254+0000","last_undegraded":"2024-09-10T07:34:21.663254+0000","last_fullsized":"2024-09-10T07:34:21.663254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:17.740947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661497+0000","last_change":"2024-09-10T07:34:19.890736+0000","last_active":"2024-09-10T07:34:21.661497+0000","last_peered":"2024-09-10T07:34:21.661497+0000","last_clean":"2024-09-10T07:34:21.661497+0000","last_became_active":"2024-09-10T07:34:19.890272+0000","last_became_peered":"2024-09-10T07:34:19.890272+0000","last_unstale":"2024-09-10T07:34:21.661497+0000","last_undegraded":"2024-09-10T07:34:21.661497+0000","last_fullsized":"2024-09-10T07:34:21.661497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:31.679112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.664026+0000","last_change":"2024-09-10T07:34:18.885652+0000","last_active":"2024-09-10T07:34:21.664026+0000","last_peered":"2024-09-10T07:34:21.664026+0000","last_clean":"2024-09-10T07:34:21.664026+0000","last_became_active":"2024-09-10T07:34:18.885417+0000","last_became_peered":"2024-09-10T07:34:18.885417+0000","last_unstale":"2024-09-10T07:34:21.664026+0000","last_undegraded":"2024-09-10T07:34:21.664026+0000","last_fullsized":"2024-09-10T07:34:21.664026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:01.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663356+0000","last_change":"2024-09-10T07:34:19.884641+0000","last_active":"2024-09-10T07:34:21.663356+0000","last_peered":"2024-09-10T07:34:21.663356+0000","last_clean":"2024-09-10T07:34:21.663356+0000","last_became_active":"2024-09-10T07:34:19.884423+0000","last_became_peered":"2024-09-10T07:34:19.884423+0000","last_unstale":"2024-09-10T07:34:21.663356+0000","last_undegraded":"2024-09-10T07:34:21.663356+0000","last_fullsized":"2024-09-10T07:34:21.663356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:26.638115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874278+0000","last_change":"2024-09-10T07:34:18.882863+0000","last_active":"2024-09-10T07:34:20.874278+0000","last_peered":"2024-09-10T07:34:20.874278+0000","last_clean":"2024-09-10T07:34:20.874278+0000","last_became_active":"2024-09-10T07:34:18.882249+0000","last_became_peered":"2024-09-10T07:34:18.882249+0000","last_unstale":"2024-09-10T07:34:20.874278+0000","last_undegraded":"2024-09-10T07:34:20.874278+0000","last_fullsized":"2024-09-10T07:34:20.874278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:35.318539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670150+0000","last_change":"2024-09-10T07:34:19.893265+0000","last_active":"2024-09-10T07:34:21.670150+0000","last_peered":"2024-09-10T07:34:21.670150+0000","last_clean":"2024-09-10T07:34:21.670150+0000","last_became_active":"2024-09-10T07:34:19.893020+0000","last_became_peered":"2024-09-10T07:34:19.893020+0000","last_unstale":"2024-09-10T07:34:21.670150+0000","last_undegraded":"2024-09-10T07:34:21.670150+0000","last_fullsized":"2024-09-10T07:34:21.670150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:52.734126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874384+0000","last_change":"2024-09-10T07:34:18.887226+0000","last_active":"2024-09-10T07:34:20.874384+0000","last_peered":"2024-09-10T07:34:20.874384+0000","last_clean":"2024-09-10T07:34:20.874384+0000","last_became_active":"2024-09-10T07:34:18.886984+0000","last_became_peered":"2024-09-10T07:34:18.886984+0000","last_unstale":"2024-09-10T07:34:20.874384+0000","last_undegraded":"2024-09-10T07:34:20.874384+0000","last_fullsized":"2024-09-10T07:34:20.874384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:36.473754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670462+0000","last_change":"2024-09-10T07:34:19.884817+0000","last_active":"2024-09-10T07:34:21.670462+0000","last_peered":"2024-09-10T07:34:21.670462+0000","last_clean":"2024-09-10T07:34:21.670462+0000","last_became_active":"2024-09-10T07:34:19.884124+0000","last_became_peered":"2024-09-10T07:34:19.884124+0000","last_unstale":"2024-09-10T07:34:21.670462+0000","last_undegraded":"2024-09-10T07:34:21.670462+0000","last_fullsized":"2024-09-10T07:34:21.670462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:24.641374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663662+0000","last_change":"2024-09-10T07:34:18.889841+0000","last_active":"2024-09-10T07:34:21.663662+0000","last_peered":"2024-09-10T07:34:21.663662+0000","last_clean":"2024-09-10T07:34:21.663662+0000","last_became_active":"2024-09-10T07:34:18.889570+0000","last_became_peered":"2024-09-10T07:34:18.889570+0000","last_unstale":"2024-09-10T07:34:21.663662+0000","last_undegraded":"2024-09-10T07:34:21.663662+0000","last_fullsized":"2024-09-10T07:34:21.663662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:47.841495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662534+0000","last_change":"2024-09-10T07:34:19.884838+0000","last_active":"2024-09-10T07:34:21.662534+0000","last_peered":"2024-09-10T07:34:21.662534+0000","last_clean":"2024-09-10T07:34:21.662534+0000","last_became_active":"2024-09-10T07:34:19.884573+0000","last_became_peered":"2024-09-10T07:34:19.884573+0000","last_unstale":"2024-09-10T07:34:21.662534+0000","last_undegraded":"2024-09-10T07:34:21.662534+0000","last_fullsized":"2024-09-10T07:34:21.662534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:02.551067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874582+0000","last_change":"2024-09-10T07:34:19.895850+0000","last_active":"2024-09-10T07:34:20.874582+0000","last_peered":"2024-09-10T07:34:20.874582+0000","last_clean":"2024-09-10T07:34:20.874582+0000","last_became_active":"2024-09-10T07:34:19.888211+0000","last_became_peered":"2024-09-10T07:34:19.888211+0000","last_unstale":"2024-09-10T07:34:20.874582+0000","last_undegraded":"2024-09-10T07:34:20.874582+0000","last_fullsized":"2024-09-10T07:34:20.874582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:06.898516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663878+0000","last_change":"2024-09-10T07:34:18.884883+0000","last_active":"2024-09-10T07:34:21.663878+0000","last_peered":"2024-09-10T07:34:21.663878+0000","last_clean":"2024-09-10T07:34:21.663878+0000","last_became_active":"2024-09-10T07:34:18.884636+0000","last_became_peered":"2024-09-10T07:34:18.884636+0000","last_unstale":"2024-09-10T07:34:21.663878+0000","last_undegraded":"2024-09-10T07:34:21.663878+0000","last_fullsized":"2024-09-10T07:34:21.663878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:12.480770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874965+0000","last_change":"2024-09-10T07:34:19.904494+0000","last_active":"2024-09-10T07:34:20.874965+0000","last_peered":"2024-09-10T07:34:20.874965+0000","last_clean":"2024-09-10T07:34:20.874965+0000","last_became_active":"2024-09-10T07:34:19.903127+0000","last_became_peered":"2024-09-10T07:34:19.903127+0000","last_unstale":"2024-09-10T07:34:20.874965+0000","last_undegraded":"2024-09-10T07:34:20.874965+0000","last_fullsized":"2024-09-10T07:34:20.874965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:57.196611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662754+0000","last_change":"2024-09-10T07:34:18.889220+0000","last_active":"2024-09-10T07:34:21.662754+0000","last_peered":"2024-09-10T07:34:21.662754+0000","last_clean":"2024-09-10T07:34:21.662754+0000","last_became_active":"2024-09-10T07:34:18.888214+0000","last_became_peered":"2024-09-10T07:34:18.888214+0000","last_unstale":"2024-09-10T07:34:21.662754+0000","last_undegraded":"2024-09-10T07:34:21.662754+0000","last_fullsized":"2024-09-10T07:34:21.662754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:48.684795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661677+0000","last_change":"2024-09-10T07:34:19.878000+0000","last_active":"2024-09-10T07:34:21.661677+0000","last_peered":"2024-09-10T07:34:21.661677+0000","last_clean":"2024-09-10T07:34:21.661677+0000","last_became_active":"2024-09-10T07:34:19.877411+0000","last_became_peered":"2024-09-10T07:34:19.877411+0000","last_unstale":"2024-09-10T07:34:21.661677+0000","last_undegraded":"2024-09-10T07:34:21.661677+0000","last_fullsized":"2024-09-10T07:34:21.661677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:12.088477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670408+0000","last_change":"2024-09-10T07:34:18.888882+0000","last_active":"2024-09-10T07:34:21.670408+0000","last_peered":"2024-09-10T07:34:21.670408+0000","last_clean":"2024-09-10T07:34:21.670408+0000","last_became_active":"2024-09-10T07:34:18.888507+0000","last_became_peered":"2024-09-10T07:34:18.888507+0000","last_unstale":"2024-09-10T07:34:21.670408+0000","last_undegraded":"2024-09-10T07:34:21.670408+0000","last_fullsized":"2024-09-10T07:34:21.670408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:18.761910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670172+0000","last_change":"2024-09-10T07:34:19.887622+0000","last_active":"2024-09-10T07:34:21.670172+0000","last_peered":"2024-09-10T07:34:21.670172+0000","last_clean":"2024-09-10T07:34:21.670172+0000","last_became_active":"2024-09-10T07:34:19.887211+0000","last_became_peered":"2024-09-10T07:34:19.887211+0000","last_unstale":"2024-09-10T07:34:21.670172+0000","last_undegraded":"2024-09-10T07:34:21.670172+0000","last_fullsized":"2024-09-10T07:34:21.670172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661793+0000","last_change":"2024-09-10T07:34:18.882907+0000","last_active":"2024-09-10T07:34:21.661793+0000","last_peered":"2024-09-10T07:34:21.661793+0000","last_clean":"2024-09-10T07:34:21.661793+0000","last_became_active":"2024-09-10T07:34:18.882653+0000","last_became_peered":"2024-09-10T07:34:18.882653+0000","last_unstale":"2024-09-10T07:34:21.661793+0000","last_undegraded":"2024-09-10T07:34:21.661793+0000","last_fullsized":"2024-09-10T07:34:21.661793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.380676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:34:31.889 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:34:32.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.081+0000 7ff8dbe00640 1 Processor -- start 2024-09-10T07:34:32.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.081+0000 7ff8dbe00640 1 -- start start 2024-09-10T07:34:32.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.082+0000 7ff8dbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff8dc0d2680 0x7ff8dc0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.082+0000 7ff8dbe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8dc0d2bd0 con 0x7ff8dc0cfac0 2024-09-10T07:34:32.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.082+0000 7ff8dbe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8dc0d2eb0 con 0x7ff8dc15e970 2024-09-10T07:34:32.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.082+0000 7ff8dbe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff8dc0d37e0 con 0x7ff8dc0d2680 2024-09-10T07:34:32.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.082+0000 7ff8da000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff8dc0d2680 0x7ff8dc0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.082+0000 7ff8db400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff8dc0cfac0 0x7ff8dc0c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38346/0 (socket says 172.21.15.99:38346) 2024-09-10T07:34:32.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.082+0000 7ff8db400640 1 -- 172.21.15.99:0/3530637178 learned_addr learned my addr 172.21.15.99:0/3530637178 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:32.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.082+0000 7ff8da000640 1 --2- 172.21.15.99:0/3530637178 >> v2:172.21.15.99:3300/0 conn(0x7ff8dc0d2680 0x7ff8dc0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52514/0 (socket says 172.21.15.99:52514) 2024-09-10T07:34:32.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.083+0000 7ff8da000640 1 -- 172.21.15.99:0/3530637178 >> v1:172.21.15.187:6789/0 conn(0x7ff8dc15e970 legacy=0x7ff8dc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.083+0000 7ff8da000640 1 -- 172.21.15.99:0/3530637178 >> v1:172.21.15.99:6789/0 conn(0x7ff8dc0cfac0 legacy=0x7ff8dc0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.083+0000 7ff8da000640 1 -- 172.21.15.99:0/3530637178 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8dc0d3190 con 0x7ff8dc0d2680 2024-09-10T07:34:32.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.084+0000 7ff8da000640 1 --2- 172.21.15.99:0/3530637178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 0x7ff8dc0cf580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0d3960 tx=0x7ff8c802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a9bb2355d44b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:32.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.084+0000 7ff8d9600640 1 -- 172.21.15.99:0/3530637178 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8037070 con 0x7ff8dc0d2680 2024-09-10T07:34:32.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.084+0000 7ff8d9600640 1 -- 172.21.15.99:0/3530637178 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c8032640 con 0x7ff8dc0d2680 2024-09-10T07:34:32.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.084+0000 7ff8d9600640 1 -- 172.21.15.99:0/3530637178 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8032a10 con 0x7ff8dc0d2680 2024-09-10T07:34:32.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.084+0000 7ff8dbe00640 1 -- 172.21.15.99:0/3530637178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 msgr2=0x7ff8dc0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.084+0000 7ff8dbe00640 1 --2- 172.21.15.99:0/3530637178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 0x7ff8dc0cf580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0d3960 tx=0x7ff8c802a2c0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.084+0000 7ff8dbe00640 1 -- 172.21.15.99:0/3530637178 shutdown_connections 2024-09-10T07:34:32.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.084+0000 7ff8dbe00640 1 --2- 172.21.15.99:0/3530637178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 0x7ff8dc0cf580 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.084+0000 7ff8dbe00640 1 -- 172.21.15.99:0/3530637178 >> 172.21.15.99:0/3530637178 conn(0x7ff8dc09de00 msgr2=0x7ff8dc0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:32.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.084+0000 7ff8dbe00640 1 -- 172.21.15.99:0/3530637178 shutdown_connections 2024-09-10T07:34:32.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.085+0000 7ff8dbe00640 1 -- 172.21.15.99:0/3530637178 wait complete. 2024-09-10T07:34:32.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.086+0000 7ff8dbe00640 1 Processor -- start 2024-09-10T07:34:32.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.086+0000 7ff8dbe00640 1 -- start start 2024-09-10T07:34:32.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.087+0000 7ff8dbe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0cfac0 0x7ff8dc153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.087+0000 7ff8dbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 0x7ff8dc1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.087+0000 7ff8dbe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8dc15e970 0x7ff8dc15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.087+0000 7ff8dbe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff8dc15ed50 con 0x7ff8dc0d2680 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.087+0000 7ff8dbe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff8dc0cff10 con 0x7ff8dc0cfac0 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.087+0000 7ff8dbe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff8dc15eed0 con 0x7ff8dc15e970 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.087+0000 7ff8da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 0x7ff8dc1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.087+0000 7ff8da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 0x7ff8dc1596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52524/0 (socket says 172.21.15.99:52524) 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.087+0000 7ff8da000640 1 -- 172.21.15.99:0/2940311020 learned_addr learned my addr 172.21.15.99:0/2940311020 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8daa00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0cfac0 0x7ff8dc153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8db400640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8dc15e970 0x7ff8dc15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8da000640 1 -- 172.21.15.99:0/2940311020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8dc15e970 msgr2=0x7ff8dc15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8da000640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8dc15e970 0x7ff8dc15b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8da000640 1 -- 172.21.15.99:0/2940311020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0cfac0 msgr2=0x7ff8dc153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8da000640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0cfac0 0x7ff8dc153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8da000640 1 -- 172.21.15.99:0/2940311020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8dc0b7d70 con 0x7ff8dc0d2680 2024-09-10T07:34:32.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8daa00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0cfac0 0x7ff8dc153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:32.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8db400640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8dc15e970 0x7ff8dc15b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:32.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8da000640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 0x7ff8dc1596c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009890 tx=0x7ff8c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8d2a00640 1 -- 172.21.15.99:0/2940311020 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8041020 con 0x7ff8dc0d2680 2024-09-10T07:34:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8d2a00640 1 -- 172.21.15.99:0/2940311020 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c8030990 con 0x7ff8dc0d2680 2024-09-10T07:34:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8dbe00640 1 -- 172.21.15.99:0/2940311020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8dc0b8050 con 0x7ff8dc0d2680 2024-09-10T07:34:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8d2a00640 1 -- 172.21.15.99:0/2940311020 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8037040 con 0x7ff8dc0d2680 2024-09-10T07:34:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.088+0000 7ff8dbe00640 1 -- 172.21.15.99:0/2940311020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8dc0b8610 con 0x7ff8dc0d2680 2024-09-10T07:34:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.089+0000 7ff8dbe00640 1 -- 172.21.15.99:0/2940311020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8dc0cf580 con 0x7ff8dc0d2680 2024-09-10T07:34:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.090+0000 7ff8d2a00640 1 -- 172.21.15.99:0/2940311020 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8c8044020 con 0x7ff8dc0d2680 2024-09-10T07:34:32.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.092+0000 7ff8d2a00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff8bc06be30 0x7ff8bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.092+0000 7ff8d2a00640 1 -- 172.21.15.99:0/2940311020 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8c80ab780 con 0x7ff8dc0d2680 2024-09-10T07:34:32.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.092+0000 7ff8daa00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff8bc06be30 0x7ff8bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.092+0000 7ff8daa00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff8bc06be30 0x7ff8bc06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc154ea0 tx=0x7ff8cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.096+0000 7ff8d2a00640 1 -- 172.21.15.99:0/2940311020 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8c804b030 con 0x7ff8dc0d2680 2024-09-10T07:34:32.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.266+0000 7ff8dbe00640 1 -- 172.21.15.99:0/2940311020 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8dc06c8f0 con 0x7ff8bc06be30 2024-09-10T07:34:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.272+0000 7ff8d2a00640 1 -- 172.21.15.99:0/2940311020 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247486 (secure 0 0 0) 0x7ff8dc06c8f0 con 0x7ff8bc06be30 2024-09-10T07:34:32.275 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:32.276 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:34:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 -- 172.21.15.99:0/2940311020 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff8bc06be30 msgr2=0x7ff8bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff8bc06be30 0x7ff8bc06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc154ea0 tx=0x7ff8cc009040 comp rx=0 tx=0).stop 2024-09-10T07:34:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 -- 172.21.15.99:0/2940311020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 msgr2=0x7ff8dc1596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 0x7ff8dc1596c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009890 tx=0x7ff8c80046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 -- 172.21.15.99:0/2940311020 shutdown_connections 2024-09-10T07:34:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8dc15e970 0x7ff8dc15b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff8bc06be30 0x7ff8bc06e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8dc0d2680 0x7ff8dc1596c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 --2- 172.21.15.99:0/2940311020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0cfac0 0x7ff8dc153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 -- 172.21.15.99:0/2940311020 >> 172.21.15.99:0/2940311020 conn(0x7ff8dc09de00 msgr2=0x7ff8dc0c8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 -- 172.21.15.99:0/2940311020 shutdown_connections 2024-09-10T07:34:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.276+0000 7ff8dbe00640 1 -- 172.21.15.99:0/2940311020 wait complete. 2024-09-10T07:34:32.292 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T07:34:30.694718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002146"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662085+0000","last_change":"2024-09-10T07:34:19.892617+0000","last_active":"2024-09-10T07:34:21.662085+0000","last_peered":"2024-09-10T07:34:21.662085+0000","last_clean":"2024-09-10T07:34:21.662085+0000","last_became_active":"2024-09-10T07:34:19.892309+0000","last_became_peered":"2024-09-10T07:34:19.892309+0000","last_unstale":"2024-09-10T07:34:21.662085+0000","last_undegraded":"2024-09-10T07:34:21.662085+0000","last_fullsized":"2024-09-10T07:34:21.662085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:08.745649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874030+0000","last_change":"2024-09-10T07:34:19.888537+0000","last_active":"2024-09-10T07:34:20.874030+0000","last_peered":"2024-09-10T07:34:20.874030+0000","last_clean":"2024-09-10T07:34:20.874030+0000","last_became_active":"2024-09-10T07:34:19.888035+0000","last_became_peered":"2024-09-10T07:34:19.888035+0000","last_unstale":"2024-09-10T07:34:20.874030+0000","last_undegraded":"2024-09-10T07:34:20.874030+0000","last_fullsized":"2024-09-10T07:34:20.874030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.614677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661256+0000","last_change":"2024-09-10T07:34:19.878583+0000","last_active":"2024-09-10T07:34:21.661256+0000","last_peered":"2024-09-10T07:34:21.661256+0000","last_clean":"2024-09-10T07:34:21.661256+0000","last_became_active":"2024-09-10T07:34:19.877749+0000","last_became_peered":"2024-09-10T07:34:19.877749+0000","last_unstale":"2024-09-10T07:34:21.661256+0000","last_undegraded":"2024-09-10T07:34:21.661256+0000","last_fullsized":"2024-09-10T07:34:21.661256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:05.290210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874227+0000","last_change":"2024-09-10T07:34:19.902236+0000","last_active":"2024-09-10T07:34:20.874227+0000","last_peered":"2024-09-10T07:34:20.874227+0000","last_clean":"2024-09-10T07:34:20.874227+0000","last_became_active":"2024-09-10T07:34:19.890752+0000","last_became_peered":"2024-09-10T07:34:19.890752+0000","last_unstale":"2024-09-10T07:34:20.874227+0000","last_undegraded":"2024-09-10T07:34:20.874227+0000","last_fullsized":"2024-09-10T07:34:20.874227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:05.551601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662087+0000","last_change":"2024-09-10T07:34:19.887506+0000","last_active":"2024-09-10T07:34:21.662087+0000","last_peered":"2024-09-10T07:34:21.662087+0000","last_clean":"2024-09-10T07:34:21.662087+0000","last_became_active":"2024-09-10T07:34:19.887222+0000","last_became_peered":"2024-09-10T07:34:19.887222+0000","last_unstale":"2024-09-10T07:34:21.662087+0000","last_undegraded":"2024-09-10T07:34:21.662087+0000","last_fullsized":"2024-09-10T07:34:21.662087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:23.722211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874811+0000","last_change":"2024-09-10T07:34:19.903919+0000","last_active":"2024-09-10T07:34:20.874811+0000","last_peered":"2024-09-10T07:34:20.874811+0000","last_clean":"2024-09-10T07:34:20.874811+0000","last_became_active":"2024-09-10T07:34:19.899806+0000","last_became_peered":"2024-09-10T07:34:19.899806+0000","last_unstale":"2024-09-10T07:34:20.874811+0000","last_undegraded":"2024-09-10T07:34:20.874811+0000","last_fullsized":"2024-09-10T07:34:20.874811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:25.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662215+0000","last_change":"2024-09-10T07:34:19.893722+0000","last_active":"2024-09-10T07:34:21.662215+0000","last_peered":"2024-09-10T07:34:21.662215+0000","last_clean":"2024-09-10T07:34:21.662215+0000","last_became_active":"2024-09-10T07:34:19.892593+0000","last_became_peered":"2024-09-10T07:34:19.892593+0000","last_unstale":"2024-09-10T07:34:21.662215+0000","last_undegraded":"2024-09-10T07:34:21.662215+0000","last_fullsized":"2024-09-10T07:34:21.662215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:59.649735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670073+0000","last_change":"2024-09-10T07:34:19.898847+0000","last_active":"2024-09-10T07:34:21.670073+0000","last_peered":"2024-09-10T07:34:21.670073+0000","last_clean":"2024-09-10T07:34:21.670073+0000","last_became_active":"2024-09-10T07:34:19.898631+0000","last_became_peered":"2024-09-10T07:34:19.898631+0000","last_unstale":"2024-09-10T07:34:21.670073+0000","last_undegraded":"2024-09-10T07:34:21.670073+0000","last_fullsized":"2024-09-10T07:34:21.670073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:44.898089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661639+0000","last_change":"2024-09-10T07:34:19.903205+0000","last_active":"2024-09-10T07:34:21.661639+0000","last_peered":"2024-09-10T07:34:21.661639+0000","last_clean":"2024-09-10T07:34:21.661639+0000","last_became_active":"2024-09-10T07:34:19.902878+0000","last_became_peered":"2024-09-10T07:34:19.902878+0000","last_unstale":"2024-09-10T07:34:21.661639+0000","last_undegraded":"2024-09-10T07:34:21.661639+0000","last_fullsized":"2024-09-10T07:34:21.661639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:52.348207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662586+0000","last_change":"2024-09-10T07:34:19.897459+0000","last_active":"2024-09-10T07:34:21.662586+0000","last_peered":"2024-09-10T07:34:21.662586+0000","last_clean":"2024-09-10T07:34:21.662586+0000","last_became_active":"2024-09-10T07:34:19.897101+0000","last_became_peered":"2024-09-10T07:34:19.897101+0000","last_unstale":"2024-09-10T07:34:21.662586+0000","last_undegraded":"2024-09-10T07:34:21.662586+0000","last_fullsized":"2024-09-10T07:34:21.662586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:26.495286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662204+0000","last_change":"2024-09-10T07:34:19.905217+0000","last_active":"2024-09-10T07:34:21.662204+0000","last_peered":"2024-09-10T07:34:21.662204+0000","last_clean":"2024-09-10T07:34:21.662204+0000","last_became_active":"2024-09-10T07:34:19.904996+0000","last_became_peered":"2024-09-10T07:34:19.904996+0000","last_unstale":"2024-09-10T07:34:21.662204+0000","last_undegraded":"2024-09-10T07:34:21.662204+0000","last_fullsized":"2024-09-10T07:34:21.662204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:02.976787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662067+0000","last_change":"2024-09-10T07:34:19.891107+0000","last_active":"2024-09-10T07:34:21.662067+0000","last_peered":"2024-09-10T07:34:21.662067+0000","last_clean":"2024-09-10T07:34:21.662067+0000","last_became_active":"2024-09-10T07:34:19.890867+0000","last_became_peered":"2024-09-10T07:34:19.890867+0000","last_unstale":"2024-09-10T07:34:21.662067+0000","last_undegraded":"2024-09-10T07:34:21.662067+0000","last_fullsized":"2024-09-10T07:34:21.662067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:38.421462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670678+0000","last_change":"2024-09-10T07:34:19.886282+0000","last_active":"2024-09-10T07:34:21.670678+0000","last_peered":"2024-09-10T07:34:21.670678+0000","last_clean":"2024-09-10T07:34:21.670678+0000","last_became_active":"2024-09-10T07:34:19.885882+0000","last_became_peered":"2024-09-10T07:34:19.885882+0000","last_unstale":"2024-09-10T07:34:21.670678+0000","last_undegraded":"2024-09-10T07:34:21.670678+0000","last_fullsized":"2024-09-10T07:34:21.670678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:43.173752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661181+0000","last_change":"2024-09-10T07:34:19.891694+0000","last_active":"2024-09-10T07:34:21.661181+0000","last_peered":"2024-09-10T07:34:21.661181+0000","last_clean":"2024-09-10T07:34:21.661181+0000","last_became_active":"2024-09-10T07:34:19.891459+0000","last_became_peered":"2024-09-10T07:34:19.891459+0000","last_unstale":"2024-09-10T07:34:21.661181+0000","last_undegraded":"2024-09-10T07:34:21.661181+0000","last_fullsized":"2024-09-10T07:34:21.661181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:16.090201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874232+0000","last_change":"2024-09-10T07:34:19.893542+0000","last_active":"2024-09-10T07:34:20.874232+0000","last_peered":"2024-09-10T07:34:20.874232+0000","last_clean":"2024-09-10T07:34:20.874232+0000","last_became_active":"2024-09-10T07:34:19.893322+0000","last_became_peered":"2024-09-10T07:34:19.893322+0000","last_unstale":"2024-09-10T07:34:20.874232+0000","last_undegraded":"2024-09-10T07:34:20.874232+0000","last_fullsized":"2024-09-10T07:34:20.874232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:22.545813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874654+0000","last_change":"2024-09-10T07:34:19.903722+0000","last_active":"2024-09-10T07:34:20.874654+0000","last_peered":"2024-09-10T07:34:20.874654+0000","last_clean":"2024-09-10T07:34:20.874654+0000","last_became_active":"2024-09-10T07:34:19.898533+0000","last_became_peered":"2024-09-10T07:34:19.898533+0000","last_unstale":"2024-09-10T07:34:20.874654+0000","last_undegraded":"2024-09-10T07:34:20.874654+0000","last_fullsized":"2024-09-10T07:34:20.874654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:05.242981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874283+0000","last_change":"2024-09-10T07:34:19.899921+0000","last_active":"2024-09-10T07:34:20.874283+0000","last_peered":"2024-09-10T07:34:20.874283+0000","last_clean":"2024-09-10T07:34:20.874283+0000","last_became_active":"2024-09-10T07:34:19.898724+0000","last_became_peered":"2024-09-10T07:34:19.898724+0000","last_unstale":"2024-09-10T07:34:20.874283+0000","last_undegraded":"2024-09-10T07:34:20.874283+0000","last_fullsized":"2024-09-10T07:34:20.874283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:41.761384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876568+0000","last_change":"2024-09-10T07:34:19.885766+0000","last_active":"2024-09-10T07:34:20.876568+0000","last_peered":"2024-09-10T07:34:20.876568+0000","last_clean":"2024-09-10T07:34:20.876568+0000","last_became_active":"2024-09-10T07:34:19.885527+0000","last_became_peered":"2024-09-10T07:34:19.885527+0000","last_unstale":"2024-09-10T07:34:20.876568+0000","last_undegraded":"2024-09-10T07:34:20.876568+0000","last_fullsized":"2024-09-10T07:34:20.876568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:00.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661947+0000","last_change":"2024-09-10T07:34:19.893683+0000","last_active":"2024-09-10T07:34:21.661947+0000","last_peered":"2024-09-10T07:34:21.661947+0000","last_clean":"2024-09-10T07:34:21.661947+0000","last_became_active":"2024-09-10T07:34:19.893434+0000","last_became_peered":"2024-09-10T07:34:19.893434+0000","last_unstale":"2024-09-10T07:34:21.661947+0000","last_undegraded":"2024-09-10T07:34:21.661947+0000","last_fullsized":"2024-09-10T07:34:21.661947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:51.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662731+0000","last_change":"2024-09-10T07:34:19.887710+0000","last_active":"2024-09-10T07:34:21.662731+0000","last_peered":"2024-09-10T07:34:21.662731+0000","last_clean":"2024-09-10T07:34:21.662731+0000","last_became_active":"2024-09-10T07:34:19.885828+0000","last_became_peered":"2024-09-10T07:34:19.885828+0000","last_unstale":"2024-09-10T07:34:21.662731+0000","last_undegraded":"2024-09-10T07:34:21.662731+0000","last_fullsized":"2024-09-10T07:34:21.662731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:04.667930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661631+0000","last_change":"2024-09-10T07:34:19.892283+0000","last_active":"2024-09-10T07:34:21.661631+0000","last_peered":"2024-09-10T07:34:21.661631+0000","last_clean":"2024-09-10T07:34:21.661631+0000","last_became_active":"2024-09-10T07:34:19.891053+0000","last_became_peered":"2024-09-10T07:34:19.891053+0000","last_unstale":"2024-09-10T07:34:21.661631+0000","last_undegraded":"2024-09-10T07:34:21.661631+0000","last_fullsized":"2024-09-10T07:34:21.661631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:29.348905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874600+0000","last_change":"2024-09-10T07:34:19.902111+0000","last_active":"2024-09-10T07:34:20.874600+0000","last_peered":"2024-09-10T07:34:20.874600+0000","last_clean":"2024-09-10T07:34:20.874600+0000","last_became_active":"2024-09-10T07:34:19.899428+0000","last_became_peered":"2024-09-10T07:34:19.899428+0000","last_unstale":"2024-09-10T07:34:20.874600+0000","last_undegraded":"2024-09-10T07:34:20.874600+0000","last_fullsized":"2024-09-10T07:34:20.874600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:20.251420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670807+0000","last_change":"2024-09-10T07:34:19.897707+0000","last_active":"2024-09-10T07:34:21.670807+0000","last_peered":"2024-09-10T07:34:21.670807+0000","last_clean":"2024-09-10T07:34:21.670807+0000","last_became_active":"2024-09-10T07:34:19.897224+0000","last_became_peered":"2024-09-10T07:34:19.897224+0000","last_unstale":"2024-09-10T07:34:21.670807+0000","last_undegraded":"2024-09-10T07:34:21.670807+0000","last_fullsized":"2024-09-10T07:34:21.670807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:55.118641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874389+0000","last_change":"2024-09-10T07:34:19.902882+0000","last_active":"2024-09-10T07:34:20.874389+0000","last_peered":"2024-09-10T07:34:20.874389+0000","last_clean":"2024-09-10T07:34:20.874389+0000","last_became_active":"2024-09-10T07:34:19.902613+0000","last_became_peered":"2024-09-10T07:34:19.902613+0000","last_unstale":"2024-09-10T07:34:20.874389+0000","last_undegraded":"2024-09-10T07:34:20.874389+0000","last_fullsized":"2024-09-10T07:34:20.874389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:32.482791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670154+0000","last_change":"2024-09-10T07:34:19.894790+0000","last_active":"2024-09-10T07:34:21.670154+0000","last_peered":"2024-09-10T07:34:21.670154+0000","last_clean":"2024-09-10T07:34:21.670154+0000","last_became_active":"2024-09-10T07:34:19.894561+0000","last_became_peered":"2024-09-10T07:34:19.894561+0000","last_unstale":"2024-09-10T07:34:21.670154+0000","last_undegraded":"2024-09-10T07:34:21.670154+0000","last_fullsized":"2024-09-10T07:34:21.670154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:03.238025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662344+0000","last_change":"2024-09-10T07:34:19.892319+0000","last_active":"2024-09-10T07:34:21.662344+0000","last_peered":"2024-09-10T07:34:21.662344+0000","last_clean":"2024-09-10T07:34:21.662344+0000","last_became_active":"2024-09-10T07:34:19.890032+0000","last_became_peered":"2024-09-10T07:34:19.890032+0000","last_unstale":"2024-09-10T07:34:21.662344+0000","last_undegraded":"2024-09-10T07:34:21.662344+0000","last_fullsized":"2024-09-10T07:34:21.662344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:11:11.464486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874146+0000","last_change":"2024-09-10T07:34:19.888281+0000","last_active":"2024-09-10T07:34:20.874146+0000","last_peered":"2024-09-10T07:34:20.874146+0000","last_clean":"2024-09-10T07:34:20.874146+0000","last_became_active":"2024-09-10T07:34:19.887727+0000","last_became_peered":"2024-09-10T07:34:19.887727+0000","last_unstale":"2024-09-10T07:34:20.874146+0000","last_undegraded":"2024-09-10T07:34:20.874146+0000","last_fullsized":"2024-09-10T07:34:20.874146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:55.524958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670292+0000","last_change":"2024-09-10T07:34:19.897389+0000","last_active":"2024-09-10T07:34:21.670292+0000","last_peered":"2024-09-10T07:34:21.670292+0000","last_clean":"2024-09-10T07:34:21.670292+0000","last_became_active":"2024-09-10T07:34:19.893934+0000","last_became_peered":"2024-09-10T07:34:19.893934+0000","last_unstale":"2024-09-10T07:34:21.670292+0000","last_undegraded":"2024-09-10T07:34:21.670292+0000","last_fullsized":"2024-09-10T07:34:21.670292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:41.808586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661356+0000","last_change":"2024-09-10T07:34:19.889846+0000","last_active":"2024-09-10T07:34:21.661356+0000","last_peered":"2024-09-10T07:34:21.661356+0000","last_clean":"2024-09-10T07:34:21.661356+0000","last_became_active":"2024-09-10T07:34:19.887187+0000","last_became_peered":"2024-09-10T07:34:19.887187+0000","last_unstale":"2024-09-10T07:34:21.661356+0000","last_undegraded":"2024-09-10T07:34:21.661356+0000","last_fullsized":"2024-09-10T07:34:21.661356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.175246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874425+0000","last_change":"2024-09-10T07:34:19.896912+0000","last_active":"2024-09-10T07:34:20.874425+0000","last_peered":"2024-09-10T07:34:20.874425+0000","last_clean":"2024-09-10T07:34:20.874425+0000","last_became_active":"2024-09-10T07:34:19.888502+0000","last_became_peered":"2024-09-10T07:34:19.888502+0000","last_unstale":"2024-09-10T07:34:20.874425+0000","last_undegraded":"2024-09-10T07:34:20.874425+0000","last_fullsized":"2024-09-10T07:34:20.874425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:44.356761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876566+0000","last_change":"2024-09-10T07:34:19.905306+0000","last_active":"2024-09-10T07:34:20.876566+0000","last_peered":"2024-09-10T07:34:20.876566+0000","last_clean":"2024-09-10T07:34:20.876566+0000","last_became_active":"2024-09-10T07:34:19.905152+0000","last_became_peered":"2024-09-10T07:34:19.905152+0000","last_unstale":"2024-09-10T07:34:20.876566+0000","last_undegraded":"2024-09-10T07:34:20.876566+0000","last_fullsized":"2024-09-10T07:34:20.876566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:21.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662983+0000","last_change":"2024-09-10T07:34:19.886696+0000","last_active":"2024-09-10T07:34:21.662983+0000","last_peered":"2024-09-10T07:34:21.662983+0000","last_clean":"2024-09-10T07:34:21.662983+0000","last_became_active":"2024-09-10T07:34:19.886407+0000","last_became_peered":"2024-09-10T07:34:19.886407+0000","last_unstale":"2024-09-10T07:34:21.662983+0000","last_undegraded":"2024-09-10T07:34:21.662983+0000","last_fullsized":"2024-09-10T07:34:21.662983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:24.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662493+0000","last_change":"2024-09-10T07:34:19.887443+0000","last_active":"2024-09-10T07:34:21.662493+0000","last_peered":"2024-09-10T07:34:21.662493+0000","last_clean":"2024-09-10T07:34:21.662493+0000","last_became_active":"2024-09-10T07:34:19.887205+0000","last_became_peered":"2024-09-10T07:34:19.887205+0000","last_unstale":"2024-09-10T07:34:21.662493+0000","last_undegraded":"2024-09-10T07:34:21.662493+0000","last_fullsized":"2024-09-10T07:34:21.662493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:12.040516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670544+0000","last_change":"2024-09-10T07:34:18.889171+0000","last_active":"2024-09-10T07:34:21.670544+0000","last_peered":"2024-09-10T07:34:21.670544+0000","last_clean":"2024-09-10T07:34:21.670544+0000","last_became_active":"2024-09-10T07:34:18.888923+0000","last_became_peered":"2024-09-10T07:34:18.888923+0000","last_unstale":"2024-09-10T07:34:21.670544+0000","last_undegraded":"2024-09-10T07:34:21.670544+0000","last_fullsized":"2024-09-10T07:34:21.670544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:20.349301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661390+0000","last_change":"2024-09-10T07:34:19.890336+0000","last_active":"2024-09-10T07:34:21.661390+0000","last_peered":"2024-09-10T07:34:21.661390+0000","last_clean":"2024-09-10T07:34:21.661390+0000","last_became_active":"2024-09-10T07:34:19.890049+0000","last_became_peered":"2024-09-10T07:34:19.890049+0000","last_unstale":"2024-09-10T07:34:21.661390+0000","last_undegraded":"2024-09-10T07:34:21.661390+0000","last_fullsized":"2024-09-10T07:34:21.661390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:48.240115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661973+0000","last_change":"2024-09-10T07:34:18.890244+0000","last_active":"2024-09-10T07:34:21.661973+0000","last_peered":"2024-09-10T07:34:21.661973+0000","last_clean":"2024-09-10T07:34:21.661973+0000","last_became_active":"2024-09-10T07:34:18.889613+0000","last_became_peered":"2024-09-10T07:34:18.889613+0000","last_unstale":"2024-09-10T07:34:21.661973+0000","last_undegraded":"2024-09-10T07:34:21.661973+0000","last_fullsized":"2024-09-10T07:34:21.661973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:11.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670521+0000","last_change":"2024-09-10T07:34:18.889534+0000","last_active":"2024-09-10T07:34:21.670521+0000","last_peered":"2024-09-10T07:34:21.670521+0000","last_clean":"2024-09-10T07:34:21.670521+0000","last_became_active":"2024-09-10T07:34:18.889242+0000","last_became_peered":"2024-09-10T07:34:18.889242+0000","last_unstale":"2024-09-10T07:34:21.670521+0000","last_undegraded":"2024-09-10T07:34:21.670521+0000","last_fullsized":"2024-09-10T07:34:21.670521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:18.829274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670327+0000","last_change":"2024-09-10T07:34:19.884510+0000","last_active":"2024-09-10T07:34:21.670327+0000","last_peered":"2024-09-10T07:34:21.670327+0000","last_clean":"2024-09-10T07:34:21.670327+0000","last_became_active":"2024-09-10T07:34:19.884235+0000","last_became_peered":"2024-09-10T07:34:19.884235+0000","last_unstale":"2024-09-10T07:34:21.670327+0000","last_undegraded":"2024-09-10T07:34:21.670327+0000","last_fullsized":"2024-09-10T07:34:21.670327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:31.685537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874642+0000","last_change":"2024-09-10T07:34:18.884543+0000","last_active":"2024-09-10T07:34:20.874642+0000","last_peered":"2024-09-10T07:34:20.874642+0000","last_clean":"2024-09-10T07:34:20.874642+0000","last_became_active":"2024-09-10T07:34:18.884298+0000","last_became_peered":"2024-09-10T07:34:18.884298+0000","last_unstale":"2024-09-10T07:34:20.874642+0000","last_undegraded":"2024-09-10T07:34:20.874642+0000","last_fullsized":"2024-09-10T07:34:20.874642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:11.804692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874177+0000","last_change":"2024-09-10T07:34:19.888708+0000","last_active":"2024-09-10T07:34:20.874177+0000","last_peered":"2024-09-10T07:34:20.874177+0000","last_clean":"2024-09-10T07:34:20.874177+0000","last_became_active":"2024-09-10T07:34:19.888434+0000","last_became_peered":"2024-09-10T07:34:19.888434+0000","last_unstale":"2024-09-10T07:34:20.874177+0000","last_undegraded":"2024-09-10T07:34:20.874177+0000","last_fullsized":"2024-09-10T07:34:20.874177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:41.986776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662474+0000","last_change":"2024-09-10T07:34:18.888024+0000","last_active":"2024-09-10T07:34:21.662474+0000","last_peered":"2024-09-10T07:34:21.662474+0000","last_clean":"2024-09-10T07:34:21.662474+0000","last_became_active":"2024-09-10T07:34:18.886888+0000","last_became_peered":"2024-09-10T07:34:18.886888+0000","last_unstale":"2024-09-10T07:34:21.662474+0000","last_undegraded":"2024-09-10T07:34:21.662474+0000","last_fullsized":"2024-09-10T07:34:21.662474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:27.884742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874439+0000","last_change":"2024-09-10T07:34:19.901075+0000","last_active":"2024-09-10T07:34:20.874439+0000","last_peered":"2024-09-10T07:34:20.874439+0000","last_clean":"2024-09-10T07:34:20.874439+0000","last_became_active":"2024-09-10T07:34:19.899090+0000","last_became_peered":"2024-09-10T07:34:19.899090+0000","last_unstale":"2024-09-10T07:34:20.874439+0000","last_undegraded":"2024-09-10T07:34:20.874439+0000","last_fullsized":"2024-09-10T07:34:20.874439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:12.703010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874850+0000","last_change":"2024-09-10T07:34:18.890112+0000","last_active":"2024-09-10T07:34:20.874850+0000","last_peered":"2024-09-10T07:34:20.874850+0000","last_clean":"2024-09-10T07:34:20.874850+0000","last_became_active":"2024-09-10T07:34:18.888701+0000","last_became_peered":"2024-09-10T07:34:18.888701+0000","last_unstale":"2024-09-10T07:34:20.874850+0000","last_undegraded":"2024-09-10T07:34:20.874850+0000","last_fullsized":"2024-09-10T07:34:20.874850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:36.214403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661712+0000","last_change":"2024-09-10T07:34:19.904217+0000","last_active":"2024-09-10T07:34:21.661712+0000","last_peered":"2024-09-10T07:34:21.661712+0000","last_clean":"2024-09-10T07:34:21.661712+0000","last_became_active":"2024-09-10T07:34:19.903931+0000","last_became_peered":"2024-09-10T07:34:19.903931+0000","last_unstale":"2024-09-10T07:34:21.661712+0000","last_undegraded":"2024-09-10T07:34:21.661712+0000","last_fullsized":"2024-09-10T07:34:21.661712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:15.824093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874133+0000","last_change":"2024-09-10T07:34:18.880938+0000","last_active":"2024-09-10T07:34:20.874133+0000","last_peered":"2024-09-10T07:34:20.874133+0000","last_clean":"2024-09-10T07:34:20.874133+0000","last_became_active":"2024-09-10T07:34:18.880624+0000","last_became_peered":"2024-09-10T07:34:18.880624+0000","last_unstale":"2024-09-10T07:34:20.874133+0000","last_undegraded":"2024-09-10T07:34:20.874133+0000","last_fullsized":"2024-09-10T07:34:20.874133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:54.148440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661856+0000","last_change":"2024-09-10T07:34:19.892359+0000","last_active":"2024-09-10T07:34:21.661856+0000","last_peered":"2024-09-10T07:34:21.661856+0000","last_clean":"2024-09-10T07:34:21.661856+0000","last_became_active":"2024-09-10T07:34:19.892071+0000","last_became_peered":"2024-09-10T07:34:19.892071+0000","last_unstale":"2024-09-10T07:34:21.661856+0000","last_undegraded":"2024-09-10T07:34:21.661856+0000","last_fullsized":"2024-09-10T07:34:21.661856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:35.384674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662593+0000","last_change":"2024-09-10T07:34:18.890452+0000","last_active":"2024-09-10T07:34:21.662593+0000","last_peered":"2024-09-10T07:34:21.662593+0000","last_clean":"2024-09-10T07:34:21.662593+0000","last_became_active":"2024-09-10T07:34:18.890105+0000","last_became_peered":"2024-09-10T07:34:18.890105+0000","last_unstale":"2024-09-10T07:34:21.662593+0000","last_undegraded":"2024-09-10T07:34:21.662593+0000","last_fullsized":"2024-09-10T07:34:21.662593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:38.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663586+0000","last_change":"2024-09-10T07:34:19.890697+0000","last_active":"2024-09-10T07:34:21.663586+0000","last_peered":"2024-09-10T07:34:21.663586+0000","last_clean":"2024-09-10T07:34:21.663586+0000","last_became_active":"2024-09-10T07:34:19.890402+0000","last_became_peered":"2024-09-10T07:34:19.890402+0000","last_unstale":"2024-09-10T07:34:21.663586+0000","last_undegraded":"2024-09-10T07:34:21.663586+0000","last_fullsized":"2024-09-10T07:34:21.663586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:53.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661353+0000","last_change":"2024-09-10T07:34:18.888006+0000","last_active":"2024-09-10T07:34:21.661353+0000","last_peered":"2024-09-10T07:34:21.661353+0000","last_clean":"2024-09-10T07:34:21.661353+0000","last_became_active":"2024-09-10T07:34:18.887741+0000","last_became_peered":"2024-09-10T07:34:18.887741+0000","last_unstale":"2024-09-10T07:34:21.661353+0000","last_undegraded":"2024-09-10T07:34:21.661353+0000","last_fullsized":"2024-09-10T07:34:21.661353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:54.559172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661790+0000","last_change":"2024-09-10T07:34:19.889260+0000","last_active":"2024-09-10T07:34:21.661790+0000","last_peered":"2024-09-10T07:34:21.661790+0000","last_clean":"2024-09-10T07:34:21.661790+0000","last_became_active":"2024-09-10T07:34:19.887143+0000","last_became_peered":"2024-09-10T07:34:19.887143+0000","last_unstale":"2024-09-10T07:34:21.661790+0000","last_undegraded":"2024-09-10T07:34:21.661790+0000","last_fullsized":"2024-09-10T07:34:21.661790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:16.774984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.875016+0000","last_change":"2024-09-10T07:34:18.882643+0000","last_active":"2024-09-10T07:34:20.875016+0000","last_peered":"2024-09-10T07:34:20.875016+0000","last_clean":"2024-09-10T07:34:20.875016+0000","last_became_active":"2024-09-10T07:34:18.880714+0000","last_became_peered":"2024-09-10T07:34:18.880714+0000","last_unstale":"2024-09-10T07:34:20.875016+0000","last_undegraded":"2024-09-10T07:34:20.875016+0000","last_fullsized":"2024-09-10T07:34:20.875016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:45.258127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662259+0000","last_change":"2024-09-10T07:34:19.896855+0000","last_active":"2024-09-10T07:34:21.662259+0000","last_peered":"2024-09-10T07:34:21.662259+0000","last_clean":"2024-09-10T07:34:21.662259+0000","last_became_active":"2024-09-10T07:34:19.896238+0000","last_became_peered":"2024-09-10T07:34:19.896238+0000","last_unstale":"2024-09-10T07:34:21.662259+0000","last_undegraded":"2024-09-10T07:34:21.662259+0000","last_fullsized":"2024-09-10T07:34:21.662259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:16.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663121+0000","last_change":"2024-09-10T07:34:18.888390+0000","last_active":"2024-09-10T07:34:21.663121+0000","last_peered":"2024-09-10T07:34:21.663121+0000","last_clean":"2024-09-10T07:34:21.663121+0000","last_became_active":"2024-09-10T07:34:18.888118+0000","last_became_peered":"2024-09-10T07:34:18.888118+0000","last_unstale":"2024-09-10T07:34:21.663121+0000","last_undegraded":"2024-09-10T07:34:21.663121+0000","last_fullsized":"2024-09-10T07:34:21.663121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:56.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661915+0000","last_change":"2024-09-10T07:34:19.883697+0000","last_active":"2024-09-10T07:34:21.661915+0000","last_peered":"2024-09-10T07:34:21.661915+0000","last_clean":"2024-09-10T07:34:21.661915+0000","last_became_active":"2024-09-10T07:34:19.883431+0000","last_became_peered":"2024-09-10T07:34:19.883431+0000","last_unstale":"2024-09-10T07:34:21.661915+0000","last_undegraded":"2024-09-10T07:34:21.661915+0000","last_fullsized":"2024-09-10T07:34:21.661915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:20.019093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876623+0000","last_change":"2024-09-10T07:34:18.883206+0000","last_active":"2024-09-10T07:34:20.876623+0000","last_peered":"2024-09-10T07:34:20.876623+0000","last_clean":"2024-09-10T07:34:20.876623+0000","last_became_active":"2024-09-10T07:34:18.882158+0000","last_became_peered":"2024-09-10T07:34:18.882158+0000","last_unstale":"2024-09-10T07:34:20.876623+0000","last_undegraded":"2024-09-10T07:34:20.876623+0000","last_fullsized":"2024-09-10T07:34:20.876623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:47.206483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663793+0000","last_change":"2024-09-10T07:34:19.894056+0000","last_active":"2024-09-10T07:34:21.663793+0000","last_peered":"2024-09-10T07:34:21.663793+0000","last_clean":"2024-09-10T07:34:21.663793+0000","last_became_active":"2024-09-10T07:34:19.892962+0000","last_became_peered":"2024-09-10T07:34:19.892962+0000","last_unstale":"2024-09-10T07:34:21.663793+0000","last_undegraded":"2024-09-10T07:34:21.663793+0000","last_fullsized":"2024-09-10T07:34:21.663793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:09.600142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661937+0000","last_change":"2024-09-10T07:34:18.874857+0000","last_active":"2024-09-10T07:34:21.661937+0000","last_peered":"2024-09-10T07:34:21.661937+0000","last_clean":"2024-09-10T07:34:21.661937+0000","last_became_active":"2024-09-10T07:34:18.874552+0000","last_became_peered":"2024-09-10T07:34:18.874552+0000","last_unstale":"2024-09-10T07:34:21.661937+0000","last_undegraded":"2024-09-10T07:34:21.661937+0000","last_fullsized":"2024-09-10T07:34:21.661937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:23.855683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662517+0000","last_change":"2024-09-10T07:34:19.897112+0000","last_active":"2024-09-10T07:34:21.662517+0000","last_peered":"2024-09-10T07:34:21.662517+0000","last_clean":"2024-09-10T07:34:21.662517+0000","last_became_active":"2024-09-10T07:34:19.896629+0000","last_became_peered":"2024-09-10T07:34:19.896629+0000","last_unstale":"2024-09-10T07:34:21.662517+0000","last_undegraded":"2024-09-10T07:34:21.662517+0000","last_fullsized":"2024-09-10T07:34:21.662517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:55.574984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876617+0000","last_change":"2024-09-10T07:34:18.881651+0000","last_active":"2024-09-10T07:34:20.876617+0000","last_peered":"2024-09-10T07:34:20.876617+0000","last_clean":"2024-09-10T07:34:20.876617+0000","last_became_active":"2024-09-10T07:34:18.880881+0000","last_became_peered":"2024-09-10T07:34:18.880881+0000","last_unstale":"2024-09-10T07:34:20.876617+0000","last_undegraded":"2024-09-10T07:34:20.876617+0000","last_fullsized":"2024-09-10T07:34:20.876617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:25.241480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661793+0000","last_change":"2024-09-10T07:34:19.897357+0000","last_active":"2024-09-10T07:34:21.661793+0000","last_peered":"2024-09-10T07:34:21.661793+0000","last_clean":"2024-09-10T07:34:21.661793+0000","last_became_active":"2024-09-10T07:34:19.896933+0000","last_became_peered":"2024-09-10T07:34:19.896933+0000","last_unstale":"2024-09-10T07:34:21.661793+0000","last_undegraded":"2024-09-10T07:34:21.661793+0000","last_fullsized":"2024-09-10T07:34:21.661793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:34.757810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874058+0000","last_change":"2024-09-10T07:34:18.889958+0000","last_active":"2024-09-10T07:34:20.874058+0000","last_peered":"2024-09-10T07:34:20.874058+0000","last_clean":"2024-09-10T07:34:20.874058+0000","last_became_active":"2024-09-10T07:34:18.889736+0000","last_became_peered":"2024-09-10T07:34:18.889736+0000","last_unstale":"2024-09-10T07:34:20.874058+0000","last_undegraded":"2024-09-10T07:34:20.874058+0000","last_fullsized":"2024-09-10T07:34:20.874058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:24.746910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874732+0000","last_change":"2024-09-10T07:34:19.897928+0000","last_active":"2024-09-10T07:34:20.874732+0000","last_peered":"2024-09-10T07:34:20.874732+0000","last_clean":"2024-09-10T07:34:20.874732+0000","last_became_active":"2024-09-10T07:34:19.896221+0000","last_became_peered":"2024-09-10T07:34:19.896221+0000","last_unstale":"2024-09-10T07:34:20.874732+0000","last_undegraded":"2024-09-10T07:34:20.874732+0000","last_fullsized":"2024-09-10T07:34:20.874732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:06.456252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876363+0000","last_change":"2024-09-10T07:34:18.877131+0000","last_active":"2024-09-10T07:34:20.876363+0000","last_peered":"2024-09-10T07:34:20.876363+0000","last_clean":"2024-09-10T07:34:20.876363+0000","last_became_active":"2024-09-10T07:34:18.876023+0000","last_became_peered":"2024-09-10T07:34:18.876023+0000","last_unstale":"2024-09-10T07:34:20.876363+0000","last_undegraded":"2024-09-10T07:34:20.876363+0000","last_fullsized":"2024-09-10T07:34:20.876363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:12:08.297705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663613+0000","last_change":"2024-09-10T07:34:19.905847+0000","last_active":"2024-09-10T07:34:21.663613+0000","last_peered":"2024-09-10T07:34:21.663613+0000","last_clean":"2024-09-10T07:34:21.663613+0000","last_became_active":"2024-09-10T07:34:19.905522+0000","last_became_peered":"2024-09-10T07:34:19.905522+0000","last_unstale":"2024-09-10T07:34:21.663613+0000","last_undegraded":"2024-09-10T07:34:21.663613+0000","last_fullsized":"2024-09-10T07:34:21.663613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:07.869122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663659+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:34:21.663659+0000","last_peered":"2024-09-10T07:34:21.663659+0000","last_clean":"2024-09-10T07:34:21.663659+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:34:21.663659+0000","last_undegraded":"2024-09-10T07:34:21.663659+0000","last_fullsized":"2024-09-10T07:34:21.663659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.875200+0000","last_change":"2024-09-10T07:34:18.881565+0000","last_active":"2024-09-10T07:34:20.875200+0000","last_peered":"2024-09-10T07:34:20.875200+0000","last_clean":"2024-09-10T07:34:20.875200+0000","last_became_active":"2024-09-10T07:34:18.879618+0000","last_became_peered":"2024-09-10T07:34:18.879618+0000","last_unstale":"2024-09-10T07:34:20.875200+0000","last_undegraded":"2024-09-10T07:34:20.875200+0000","last_fullsized":"2024-09-10T07:34:20.875200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:43.934312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670323+0000","last_change":"2024-09-10T07:34:19.899451+0000","last_active":"2024-09-10T07:34:21.670323+0000","last_peered":"2024-09-10T07:34:21.670323+0000","last_clean":"2024-09-10T07:34:21.670323+0000","last_became_active":"2024-09-10T07:34:19.899171+0000","last_became_peered":"2024-09-10T07:34:19.899171+0000","last_unstale":"2024-09-10T07:34:21.670323+0000","last_undegraded":"2024-09-10T07:34:21.670323+0000","last_fullsized":"2024-09-10T07:34:21.670323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:00.427217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663563+0000","last_change":"2024-09-10T07:34:18.886056+0000","last_active":"2024-09-10T07:34:21.663563+0000","last_peered":"2024-09-10T07:34:21.663563+0000","last_clean":"2024-09-10T07:34:21.663563+0000","last_became_active":"2024-09-10T07:34:18.884743+0000","last_became_peered":"2024-09-10T07:34:18.884743+0000","last_unstale":"2024-09-10T07:34:21.663563+0000","last_undegraded":"2024-09-10T07:34:21.663563+0000","last_fullsized":"2024-09-10T07:34:21.663563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:47.912136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661759+0000","last_change":"2024-09-10T07:34:19.890527+0000","last_active":"2024-09-10T07:34:21.661759+0000","last_peered":"2024-09-10T07:34:21.661759+0000","last_clean":"2024-09-10T07:34:21.661759+0000","last_became_active":"2024-09-10T07:34:19.888669+0000","last_became_peered":"2024-09-10T07:34:19.888669+0000","last_unstale":"2024-09-10T07:34:21.661759+0000","last_undegraded":"2024-09-10T07:34:21.661759+0000","last_fullsized":"2024-09-10T07:34:21.661759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:16.766074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.876721+0000","last_change":"2024-09-10T07:34:18.880716+0000","last_active":"2024-09-10T07:34:20.876721+0000","last_peered":"2024-09-10T07:34:20.876721+0000","last_clean":"2024-09-10T07:34:20.876721+0000","last_became_active":"2024-09-10T07:34:18.880464+0000","last_became_peered":"2024-09-10T07:34:18.880464+0000","last_unstale":"2024-09-10T07:34:20.876721+0000","last_undegraded":"2024-09-10T07:34:20.876721+0000","last_fullsized":"2024-09-10T07:34:20.876721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:16.502080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874334+0000","last_change":"2024-09-10T07:34:19.886246+0000","last_active":"2024-09-10T07:34:20.874334+0000","last_peered":"2024-09-10T07:34:20.874334+0000","last_clean":"2024-09-10T07:34:20.874334+0000","last_became_active":"2024-09-10T07:34:19.886011+0000","last_became_peered":"2024-09-10T07:34:19.886011+0000","last_unstale":"2024-09-10T07:34:20.874334+0000","last_undegraded":"2024-09-10T07:34:20.874334+0000","last_fullsized":"2024-09-10T07:34:20.874334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:38.325753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874907+0000","last_change":"2024-09-10T07:34:18.884016+0000","last_active":"2024-09-10T07:34:20.874907+0000","last_peered":"2024-09-10T07:34:20.874907+0000","last_clean":"2024-09-10T07:34:20.874907+0000","last_became_active":"2024-09-10T07:34:18.883371+0000","last_became_peered":"2024-09-10T07:34:18.883371+0000","last_unstale":"2024-09-10T07:34:20.874907+0000","last_undegraded":"2024-09-10T07:34:20.874907+0000","last_fullsized":"2024-09-10T07:34:20.874907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:30.812500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662521+0000","last_change":"2024-09-10T07:34:19.886349+0000","last_active":"2024-09-10T07:34:21.662521+0000","last_peered":"2024-09-10T07:34:21.662521+0000","last_clean":"2024-09-10T07:34:21.662521+0000","last_became_active":"2024-09-10T07:34:19.886096+0000","last_became_peered":"2024-09-10T07:34:19.886096+0000","last_unstale":"2024-09-10T07:34:21.662521+0000","last_undegraded":"2024-09-10T07:34:21.662521+0000","last_fullsized":"2024-09-10T07:34:21.662521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:08.446221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874348+0000","last_change":"2024-09-10T07:34:18.881982+0000","last_active":"2024-09-10T07:34:20.874348+0000","last_peered":"2024-09-10T07:34:20.874348+0000","last_clean":"2024-09-10T07:34:20.874348+0000","last_became_active":"2024-09-10T07:34:18.881585+0000","last_became_peered":"2024-09-10T07:34:18.881585+0000","last_unstale":"2024-09-10T07:34:20.874348+0000","last_undegraded":"2024-09-10T07:34:20.874348+0000","last_fullsized":"2024-09-10T07:34:20.874348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:17.622849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874496+0000","last_change":"2024-09-10T07:34:19.901907+0000","last_active":"2024-09-10T07:34:20.874496+0000","last_peered":"2024-09-10T07:34:20.874496+0000","last_clean":"2024-09-10T07:34:20.874496+0000","last_became_active":"2024-09-10T07:34:19.889125+0000","last_became_peered":"2024-09-10T07:34:19.889125+0000","last_unstale":"2024-09-10T07:34:20.874496+0000","last_undegraded":"2024-09-10T07:34:20.874496+0000","last_fullsized":"2024-09-10T07:34:20.874496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:22.996650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662632+0000","last_change":"2024-09-10T07:34:18.886286+0000","last_active":"2024-09-10T07:34:21.662632+0000","last_peered":"2024-09-10T07:34:21.662632+0000","last_clean":"2024-09-10T07:34:21.662632+0000","last_became_active":"2024-09-10T07:34:18.885859+0000","last_became_peered":"2024-09-10T07:34:18.885859+0000","last_unstale":"2024-09-10T07:34:21.662632+0000","last_undegraded":"2024-09-10T07:34:21.662632+0000","last_fullsized":"2024-09-10T07:34:21.662632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:31.802025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874083+0000","last_change":"2024-09-10T07:34:19.892610+0000","last_active":"2024-09-10T07:34:20.874083+0000","last_peered":"2024-09-10T07:34:20.874083+0000","last_clean":"2024-09-10T07:34:20.874083+0000","last_became_active":"2024-09-10T07:34:19.892379+0000","last_became_peered":"2024-09-10T07:34:19.892379+0000","last_unstale":"2024-09-10T07:34:20.874083+0000","last_undegraded":"2024-09-10T07:34:20.874083+0000","last_fullsized":"2024-09-10T07:34:20.874083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:15.254184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874282+0000","last_change":"2024-09-10T07:34:18.888415+0000","last_active":"2024-09-10T07:34:20.874282+0000","last_peered":"2024-09-10T07:34:20.874282+0000","last_clean":"2024-09-10T07:34:20.874282+0000","last_became_active":"2024-09-10T07:34:18.888207+0000","last_became_peered":"2024-09-10T07:34:18.888207+0000","last_unstale":"2024-09-10T07:34:20.874282+0000","last_undegraded":"2024-09-10T07:34:20.874282+0000","last_fullsized":"2024-09-10T07:34:20.874282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:22.188010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670152+0000","last_change":"2024-09-10T07:34:19.889874+0000","last_active":"2024-09-10T07:34:21.670152+0000","last_peered":"2024-09-10T07:34:21.670152+0000","last_clean":"2024-09-10T07:34:21.670152+0000","last_became_active":"2024-09-10T07:34:19.889625+0000","last_became_peered":"2024-09-10T07:34:19.889625+0000","last_unstale":"2024-09-10T07:34:21.670152+0000","last_undegraded":"2024-09-10T07:34:21.670152+0000","last_fullsized":"2024-09-10T07:34:21.670152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:51.968652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663254+0000","last_change":"2024-09-10T07:34:18.887039+0000","last_active":"2024-09-10T07:34:21.663254+0000","last_peered":"2024-09-10T07:34:21.663254+0000","last_clean":"2024-09-10T07:34:21.663254+0000","last_became_active":"2024-09-10T07:34:18.886635+0000","last_became_peered":"2024-09-10T07:34:18.886635+0000","last_unstale":"2024-09-10T07:34:21.663254+0000","last_undegraded":"2024-09-10T07:34:21.663254+0000","last_fullsized":"2024-09-10T07:34:21.663254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:17.740947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661497+0000","last_change":"2024-09-10T07:34:19.890736+0000","last_active":"2024-09-10T07:34:21.661497+0000","last_peered":"2024-09-10T07:34:21.661497+0000","last_clean":"2024-09-10T07:34:21.661497+0000","last_became_active":"2024-09-10T07:34:19.890272+0000","last_became_peered":"2024-09-10T07:34:19.890272+0000","last_unstale":"2024-09-10T07:34:21.661497+0000","last_undegraded":"2024-09-10T07:34:21.661497+0000","last_fullsized":"2024-09-10T07:34:21.661497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:31.679112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.664026+0000","last_change":"2024-09-10T07:34:18.885652+0000","last_active":"2024-09-10T07:34:21.664026+0000","last_peered":"2024-09-10T07:34:21.664026+0000","last_clean":"2024-09-10T07:34:21.664026+0000","last_became_active":"2024-09-10T07:34:18.885417+0000","last_became_peered":"2024-09-10T07:34:18.885417+0000","last_unstale":"2024-09-10T07:34:21.664026+0000","last_undegraded":"2024-09-10T07:34:21.664026+0000","last_fullsized":"2024-09-10T07:34:21.664026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:01.010358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663356+0000","last_change":"2024-09-10T07:34:19.884641+0000","last_active":"2024-09-10T07:34:21.663356+0000","last_peered":"2024-09-10T07:34:21.663356+0000","last_clean":"2024-09-10T07:34:21.663356+0000","last_became_active":"2024-09-10T07:34:19.884423+0000","last_became_peered":"2024-09-10T07:34:19.884423+0000","last_unstale":"2024-09-10T07:34:21.663356+0000","last_undegraded":"2024-09-10T07:34:21.663356+0000","last_fullsized":"2024-09-10T07:34:21.663356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:26.638115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874278+0000","last_change":"2024-09-10T07:34:18.882863+0000","last_active":"2024-09-10T07:34:20.874278+0000","last_peered":"2024-09-10T07:34:20.874278+0000","last_clean":"2024-09-10T07:34:20.874278+0000","last_became_active":"2024-09-10T07:34:18.882249+0000","last_became_peered":"2024-09-10T07:34:18.882249+0000","last_unstale":"2024-09-10T07:34:20.874278+0000","last_undegraded":"2024-09-10T07:34:20.874278+0000","last_fullsized":"2024-09-10T07:34:20.874278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:35.318539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670150+0000","last_change":"2024-09-10T07:34:19.893265+0000","last_active":"2024-09-10T07:34:21.670150+0000","last_peered":"2024-09-10T07:34:21.670150+0000","last_clean":"2024-09-10T07:34:21.670150+0000","last_became_active":"2024-09-10T07:34:19.893020+0000","last_became_peered":"2024-09-10T07:34:19.893020+0000","last_unstale":"2024-09-10T07:34:21.670150+0000","last_undegraded":"2024-09-10T07:34:21.670150+0000","last_fullsized":"2024-09-10T07:34:21.670150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:52.734126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874384+0000","last_change":"2024-09-10T07:34:18.887226+0000","last_active":"2024-09-10T07:34:20.874384+0000","last_peered":"2024-09-10T07:34:20.874384+0000","last_clean":"2024-09-10T07:34:20.874384+0000","last_became_active":"2024-09-10T07:34:18.886984+0000","last_became_peered":"2024-09-10T07:34:18.886984+0000","last_unstale":"2024-09-10T07:34:20.874384+0000","last_undegraded":"2024-09-10T07:34:20.874384+0000","last_fullsized":"2024-09-10T07:34:20.874384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:36.473754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670462+0000","last_change":"2024-09-10T07:34:19.884817+0000","last_active":"2024-09-10T07:34:21.670462+0000","last_peered":"2024-09-10T07:34:21.670462+0000","last_clean":"2024-09-10T07:34:21.670462+0000","last_became_active":"2024-09-10T07:34:19.884124+0000","last_became_peered":"2024-09-10T07:34:19.884124+0000","last_unstale":"2024-09-10T07:34:21.670462+0000","last_undegraded":"2024-09-10T07:34:21.670462+0000","last_fullsized":"2024-09-10T07:34:21.670462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:24.641374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663662+0000","last_change":"2024-09-10T07:34:18.889841+0000","last_active":"2024-09-10T07:34:21.663662+0000","last_peered":"2024-09-10T07:34:21.663662+0000","last_clean":"2024-09-10T07:34:21.663662+0000","last_became_active":"2024-09-10T07:34:18.889570+0000","last_became_peered":"2024-09-10T07:34:18.889570+0000","last_unstale":"2024-09-10T07:34:21.663662+0000","last_undegraded":"2024-09-10T07:34:21.663662+0000","last_fullsized":"2024-09-10T07:34:21.663662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:47.841495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662534+0000","last_change":"2024-09-10T07:34:19.884838+0000","last_active":"2024-09-10T07:34:21.662534+0000","last_peered":"2024-09-10T07:34:21.662534+0000","last_clean":"2024-09-10T07:34:21.662534+0000","last_became_active":"2024-09-10T07:34:19.884573+0000","last_became_peered":"2024-09-10T07:34:19.884573+0000","last_unstale":"2024-09-10T07:34:21.662534+0000","last_undegraded":"2024-09-10T07:34:21.662534+0000","last_fullsized":"2024-09-10T07:34:21.662534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:02.551067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874582+0000","last_change":"2024-09-10T07:34:19.895850+0000","last_active":"2024-09-10T07:34:20.874582+0000","last_peered":"2024-09-10T07:34:20.874582+0000","last_clean":"2024-09-10T07:34:20.874582+0000","last_became_active":"2024-09-10T07:34:19.888211+0000","last_became_peered":"2024-09-10T07:34:19.888211+0000","last_unstale":"2024-09-10T07:34:20.874582+0000","last_undegraded":"2024-09-10T07:34:20.874582+0000","last_fullsized":"2024-09-10T07:34:20.874582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:06.898516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.663878+0000","last_change":"2024-09-10T07:34:18.884883+0000","last_active":"2024-09-10T07:34:21.663878+0000","last_peered":"2024-09-10T07:34:21.663878+0000","last_clean":"2024-09-10T07:34:21.663878+0000","last_became_active":"2024-09-10T07:34:18.884636+0000","last_became_peered":"2024-09-10T07:34:18.884636+0000","last_unstale":"2024-09-10T07:34:21.663878+0000","last_undegraded":"2024-09-10T07:34:21.663878+0000","last_fullsized":"2024-09-10T07:34:21.663878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:12.480770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:20.874965+0000","last_change":"2024-09-10T07:34:19.904494+0000","last_active":"2024-09-10T07:34:20.874965+0000","last_peered":"2024-09-10T07:34:20.874965+0000","last_clean":"2024-09-10T07:34:20.874965+0000","last_became_active":"2024-09-10T07:34:19.903127+0000","last_became_peered":"2024-09-10T07:34:19.903127+0000","last_unstale":"2024-09-10T07:34:20.874965+0000","last_undegraded":"2024-09-10T07:34:20.874965+0000","last_fullsized":"2024-09-10T07:34:20.874965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:57.196611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.662754+0000","last_change":"2024-09-10T07:34:18.889220+0000","last_active":"2024-09-10T07:34:21.662754+0000","last_peered":"2024-09-10T07:34:21.662754+0000","last_clean":"2024-09-10T07:34:21.662754+0000","last_became_active":"2024-09-10T07:34:18.888214+0000","last_became_peered":"2024-09-10T07:34:18.888214+0000","last_unstale":"2024-09-10T07:34:21.662754+0000","last_undegraded":"2024-09-10T07:34:21.662754+0000","last_fullsized":"2024-09-10T07:34:21.662754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:48.684795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661677+0000","last_change":"2024-09-10T07:34:19.878000+0000","last_active":"2024-09-10T07:34:21.661677+0000","last_peered":"2024-09-10T07:34:21.661677+0000","last_clean":"2024-09-10T07:34:21.661677+0000","last_became_active":"2024-09-10T07:34:19.877411+0000","last_became_peered":"2024-09-10T07:34:19.877411+0000","last_unstale":"2024-09-10T07:34:21.661677+0000","last_undegraded":"2024-09-10T07:34:21.661677+0000","last_fullsized":"2024-09-10T07:34:21.661677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:12.088477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670408+0000","last_change":"2024-09-10T07:34:18.888882+0000","last_active":"2024-09-10T07:34:21.670408+0000","last_peered":"2024-09-10T07:34:21.670408+0000","last_clean":"2024-09-10T07:34:21.670408+0000","last_became_active":"2024-09-10T07:34:18.888507+0000","last_became_peered":"2024-09-10T07:34:18.888507+0000","last_unstale":"2024-09-10T07:34:21.670408+0000","last_undegraded":"2024-09-10T07:34:21.670408+0000","last_fullsized":"2024-09-10T07:34:21.670408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:18.761910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.670172+0000","last_change":"2024-09-10T07:34:19.887622+0000","last_active":"2024-09-10T07:34:21.670172+0000","last_peered":"2024-09-10T07:34:21.670172+0000","last_clean":"2024-09-10T07:34:21.670172+0000","last_became_active":"2024-09-10T07:34:19.887211+0000","last_became_peered":"2024-09-10T07:34:19.887211+0000","last_unstale":"2024-09-10T07:34:21.670172+0000","last_undegraded":"2024-09-10T07:34:21.670172+0000","last_fullsized":"2024-09-10T07:34:21.670172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:18.860341+0000","last_clean_scrub_stamp":"2024-09-10T07:34:18.860341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:14.909342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T07:34:21.661793+0000","last_change":"2024-09-10T07:34:18.882907+0000","last_active":"2024-09-10T07:34:21.661793+0000","last_peered":"2024-09-10T07:34:21.661793+0000","last_clean":"2024-09-10T07:34:21.661793+0000","last_became_active":"2024-09-10T07:34:18.882653+0000","last_became_peered":"2024-09-10T07:34:18.882653+0000","last_unstale":"2024-09-10T07:34:21.661793+0000","last_undegraded":"2024-09-10T07:34:21.661793+0000","last_fullsized":"2024-09-10T07:34:21.661793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:17.849283+0000","last_clean_scrub_stamp":"2024-09-10T07:34:17.849283+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.380676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929226,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929066,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338220,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:34:32.295 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:34:32.296 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T07:34:32.296 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T07:34:32.296 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T07:34:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.484+0000 7f4f02600640 1 Processor -- start 2024-09-10T07:34:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.484+0000 7f4f02600640 1 -- start start 2024-09-10T07:34:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.485+0000 7f4f02600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4efc0c9710 0x7f4efc1695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.485+0000 7f4f02600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4efc0d2bd0 con 0x7f4efc0d2680 2024-09-10T07:34:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.485+0000 7f4f02600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4efc0d2eb0 con 0x7f4efc15e970 2024-09-10T07:34:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.485+0000 7f4f02600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4efc0d37e0 con 0x7f4efc0c9710 2024-09-10T07:34:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.485+0000 7f4efbe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4efc0d2680 0x7f4efc0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38348/0 (socket says 172.21.15.99:38348) 2024-09-10T07:34:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.485+0000 7f4efbe00640 1 -- 172.21.15.99:0/837096725 learned_addr learned my addr 172.21.15.99:0/837096725 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.485+0000 7f4f01c00640 1 --2- 172.21.15.99:0/837096725 >> v2:172.21.15.99:3300/0 conn(0x7f4efc0c9710 0x7f4efc1695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.486+0000 7f4f01c00640 1 -- 172.21.15.99:0/837096725 >> v1:172.21.15.187:6789/0 conn(0x7f4efc15e970 legacy=0x7f4efc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.486+0000 7f4efb400640 1 -- 172.21.15.99:0/837096725 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185228012 0 0) 0x7f4efc0d2bd0 con 0x7f4efc0d2680 2024-09-10T07:34:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.486+0000 7f4f01c00640 1 -- 172.21.15.99:0/837096725 >> v1:172.21.15.99:6789/0 conn(0x7f4efc0d2680 legacy=0x7f4efc0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.486+0000 7f4f01c00640 1 -- 172.21.15.99:0/837096725 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4efc0d3190 con 0x7f4efc0c9710 2024-09-10T07:34:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.487+0000 7f4f01c00640 1 --2- 172.21.15.99:0/837096725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc0c9710 0x7f4efc1695e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0d3960 tx=0x7f4ef402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14178943da0bcfeb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.487+0000 7f4efb400640 1 -- 172.21.15.99:0/837096725 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4037070 con 0x7f4efc0c9710 2024-09-10T07:34:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.487+0000 7f4efb400640 1 -- 172.21.15.99:0/837096725 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef4007740 con 0x7f4efc0c9710 2024-09-10T07:34:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.487+0000 7f4efb400640 1 -- 172.21.15.99:0/837096725 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4007b10 con 0x7f4efc0c9710 2024-09-10T07:34:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.487+0000 7f4f02600640 1 -- 172.21.15.99:0/837096725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc0c9710 msgr2=0x7f4efc1695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.487+0000 7f4f02600640 1 --2- 172.21.15.99:0/837096725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc0c9710 0x7f4efc1695e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0d3960 tx=0x7f4ef402a780 comp rx=0 tx=0).stop 2024-09-10T07:34:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.487+0000 7f4f02600640 1 -- 172.21.15.99:0/837096725 shutdown_connections 2024-09-10T07:34:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.487+0000 7f4f02600640 1 --2- 172.21.15.99:0/837096725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc0c9710 0x7f4efc1695e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.487+0000 7f4f02600640 1 -- 172.21.15.99:0/837096725 >> 172.21.15.99:0/837096725 conn(0x7f4efc09de00 msgr2=0x7f4efc0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.487+0000 7f4f02600640 1 -- 172.21.15.99:0/837096725 shutdown_connections 2024-09-10T07:34:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.488+0000 7f4f02600640 1 -- 172.21.15.99:0/837096725 wait complete. 2024-09-10T07:34:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.489+0000 7f4f02600640 1 Processor -- start 2024-09-10T07:34:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.489+0000 7f4f02600640 1 -- start start 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4f02600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4efc0c9710 0x7f4efc161c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4f02600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4efc0d2680 0x7f4efc0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4f02600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc15e970 0x7f4efc153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4f02600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc15eed0 con 0x7f4efc15e970 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4f02600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc15ed50 con 0x7f4efc0c9710 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4f02600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4efc0cfc90 con 0x7f4efc0d2680 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4f01c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc15e970 0x7f4efc153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4f01c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc15e970 0x7f4efc153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52548/0 (socket says 172.21.15.99:52548) 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4f01c00640 1 -- 172.21.15.99:0/98738958 learned_addr learned my addr 172.21.15.99:0/98738958 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4f01200640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4efc0c9710 0x7f4efc161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.490+0000 7f4efbe00640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4efc0d2680 0x7f4efc0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4f01c00640 1 -- 172.21.15.99:0/98738958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4efc0d2680 msgr2=0x7f4efc0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4f01c00640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4efc0d2680 0x7f4efc0b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4f01c00640 1 -- 172.21.15.99:0/98738958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4efc0c9710 msgr2=0x7f4efc161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4f01c00640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4efc0c9710 0x7f4efc161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4f01c00640 1 -- 172.21.15.99:0/98738958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4efc15f9d0 con 0x7f4efc15e970 2024-09-10T07:34:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4efbe00640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4efc0d2680 0x7f4efc0b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4f01c00640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc15e970 0x7f4efc153f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009e80 tx=0x7f4ef4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4ef8c00640 1 -- 172.21.15.99:0/98738958 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4042020 con 0x7f4efc15e970 2024-09-10T07:34:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4ef8c00640 1 -- 172.21.15.99:0/98738958 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef4032970 con 0x7f4efc15e970 2024-09-10T07:34:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4ef8c00640 1 -- 172.21.15.99:0/98738958 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4037040 con 0x7f4efc15e970 2024-09-10T07:34:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.491+0000 7f4f02600640 1 -- 172.21.15.99:0/98738958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4efc0b7f70 con 0x7f4efc15e970 2024-09-10T07:34:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.492+0000 7f4f02600640 1 -- 172.21.15.99:0/98738958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4efc0b8530 con 0x7f4efc15e970 2024-09-10T07:34:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.493+0000 7f4f02600640 1 -- 172.21.15.99:0/98738958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4efc0cf580 con 0x7f4efc15e970 2024-09-10T07:34:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.493+0000 7f4ef8c00640 1 -- 172.21.15.99:0/98738958 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ef4045020 con 0x7f4efc15e970 2024-09-10T07:34:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.494+0000 7f4ef8c00640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4edc06be30 0x7f4edc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.494+0000 7f4ef8c00640 1 -- 172.21.15.99:0/98738958 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4ef40ac380 con 0x7f4efc15e970 2024-09-10T07:34:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.494+0000 7f4f01200640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4edc06be30 0x7f4edc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.495+0000 7f4f01200640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4edc06be30 0x7f4edc06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0000f60 tx=0x7f4ef0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:32.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.498+0000 7f4ef8c00640 1 -- 172.21.15.99:0/98738958 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ef404c020 con 0x7f4efc15e970 2024-09-10T07:34:32.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.708+0000 7f4f02600640 1 -- 172.21.15.99:0/98738958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4efc0cb410 con 0x7f4efc15e970 2024-09-10T07:34:32.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.708+0000 7f4ef8c00640 1 -- 172.21.15.99:0/98738958 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4ef407ad20 con 0x7f4efc15e970 2024-09-10T07:34:32.709 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:32.709 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T07:34:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 -- 172.21.15.99:0/98738958 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4edc06be30 msgr2=0x7f4edc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4edc06be30 0x7f4edc06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0000f60 tx=0x7f4ef0009040 comp rx=0 tx=0).stop 2024-09-10T07:34:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 -- 172.21.15.99:0/98738958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc15e970 msgr2=0x7f4efc153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc15e970 0x7f4efc153f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009e80 tx=0x7f4ef4004a40 comp rx=0 tx=0).stop 2024-09-10T07:34:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 -- 172.21.15.99:0/98738958 shutdown_connections 2024-09-10T07:34:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4edc06be30 0x7f4edc06e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4efc15e970 0x7f4efc153f40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4efc0d2680 0x7f4efc0b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 --2- 172.21.15.99:0/98738958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4efc0c9710 0x7f4efc161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 -- 172.21.15.99:0/98738958 >> 172.21.15.99:0/98738958 conn(0x7f4efc09de00 msgr2=0x7f4efc06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:32.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 -- 172.21.15.99:0/98738958 shutdown_connections 2024-09-10T07:34:32.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.711+0000 7f4f02600640 1 -- 172.21.15.99:0/98738958 wait complete. 2024-09-10T07:34:32.726 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T07:34:32.727 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:34:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.880+0000 7ff757200640 1 Processor -- start 2024-09-10T07:34:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.880+0000 7ff757200640 1 -- start start 2024-09-10T07:34:32.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.881+0000 7ff757200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff75015ecc0 0x7ff7500d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.881+0000 7ff757200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 0x7ff7500d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.881+0000 7ff757200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7500d3b20 con 0x7ff7500d1990 2024-09-10T07:34:32.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.881+0000 7ff757200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff7500b42f0 con 0x7ff75015ecc0 2024-09-10T07:34:32.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.881+0000 7ff757200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff7500b45d0 con 0x7ff7500d57a0 2024-09-10T07:34:32.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.882+0000 7ff755200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff7500d1990 0x7ff7500cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38360/0 (socket says 172.21.15.99:38360) 2024-09-10T07:34:32.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.882+0000 7ff755200640 1 -- 172.21.15.99:0/1556374790 learned_addr learned my addr 172.21.15.99:0/1556374790 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:32.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.882+0000 7ff74f400640 1 --2- 172.21.15.99:0/1556374790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 0x7ff7500d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.882+0000 7ff74fe00640 1 --2- 172.21.15.99:0/1556374790 >> v2:172.21.15.187:3300/0 conn(0x7ff75015ecc0 0x7ff7500d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.882+0000 7ff74ea00640 1 -- 172.21.15.99:0/1556374790 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871643354 0 0) 0x7ff7500d3b20 con 0x7ff7500d1990 2024-09-10T07:34:32.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.882+0000 7ff74f400640 1 -- 172.21.15.99:0/1556374790 >> v2:172.21.15.187:3300/0 conn(0x7ff75015ecc0 msgr2=0x7ff7500d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:32.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.882+0000 7ff74f400640 1 --2- 172.21.15.99:0/1556374790 >> v2:172.21.15.187:3300/0 conn(0x7ff75015ecc0 0x7ff7500d3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.882+0000 7ff74f400640 1 -- 172.21.15.99:0/1556374790 >> v1:172.21.15.99:6789/0 conn(0x7ff7500d1990 legacy=0x7ff7500cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.882+0000 7ff74f400640 1 -- 172.21.15.99:0/1556374790 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7500b48b0 con 0x7ff7500d57a0 2024-09-10T07:34:32.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.883+0000 7ff74f400640 1 --2- 172.21.15.99:0/1556374790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 0x7ff7500d1450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0097a0 tx=0x7ff73c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fae8d361ab827d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff74ea00640 1 -- 172.21.15.99:0/1556374790 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c037070 con 0x7ff7500d57a0 2024-09-10T07:34:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff74ea00640 1 -- 172.21.15.99:0/1556374790 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73c032440 con 0x7ff7500d57a0 2024-09-10T07:34:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff74ea00640 1 -- 172.21.15.99:0/1556374790 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c032810 con 0x7ff7500d57a0 2024-09-10T07:34:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff757200640 1 -- 172.21.15.99:0/1556374790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 msgr2=0x7ff7500d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff757200640 1 --2- 172.21.15.99:0/1556374790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 0x7ff7500d1450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0097a0 tx=0x7ff73c02a180 comp rx=0 tx=0).stop 2024-09-10T07:34:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff757200640 1 -- 172.21.15.99:0/1556374790 shutdown_connections 2024-09-10T07:34:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff757200640 1 --2- 172.21.15.99:0/1556374790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 0x7ff7500d1450 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff757200640 1 --2- 172.21.15.99:0/1556374790 >> v2:172.21.15.187:3300/0 conn(0x7ff75015ecc0 0x7ff7500d3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff757200640 1 -- 172.21.15.99:0/1556374790 >> 172.21.15.99:0/1556374790 conn(0x7ff7500d4bd0 msgr2=0x7ff7500d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:32.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff757200640 1 -- 172.21.15.99:0/1556374790 shutdown_connections 2024-09-10T07:34:32.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.884+0000 7ff757200640 1 -- 172.21.15.99:0/1556374790 wait complete. 2024-09-10T07:34:32.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.886+0000 7ff757200640 1 Processor -- start 2024-09-10T07:34:32.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.886+0000 7ff757200640 1 -- start start 2024-09-10T07:34:32.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff757200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7500d1990 0x7ff7500ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff757200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 0x7ff7501530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff757200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff75015ecc0 0x7ff750158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff757200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff75015f220 con 0x7ff75015ecc0 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff757200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff75015f0a0 con 0x7ff7500d1990 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff757200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff7500d36b0 con 0x7ff7500d57a0 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff755200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff75015ecc0 0x7ff750158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff755200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff75015ecc0 0x7ff750158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52564/0 (socket says 172.21.15.99:52564) 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff74fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7500d1990 0x7ff7500ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff755200640 1 -- 172.21.15.99:0/2903696663 learned_addr learned my addr 172.21.15.99:0/2903696663 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.887+0000 7ff74f400640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 0x7ff7501530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.888+0000 7ff755200640 1 -- 172.21.15.99:0/2903696663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 msgr2=0x7ff7501530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.888+0000 7ff755200640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 0x7ff7501530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.888+0000 7ff755200640 1 -- 172.21.15.99:0/2903696663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7500d1990 msgr2=0x7ff7500ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:32.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.888+0000 7ff755200640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7500d1990 0x7ff7500ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:32.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.888+0000 7ff755200640 1 -- 172.21.15.99:0/2903696663 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7501592a0 con 0x7ff75015ecc0 2024-09-10T07:34:32.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.888+0000 7ff755200640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff75015ecc0 0x7ff750158d60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff74800c7a0 tx=0x7ff74800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:32.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.888+0000 7ff747e00640 1 -- 172.21.15.99:0/2903696663 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748018070 con 0x7ff75015ecc0 2024-09-10T07:34:32.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.888+0000 7ff747e00640 1 -- 172.21.15.99:0/2903696663 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74800a640 con 0x7ff75015ecc0 2024-09-10T07:34:32.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.888+0000 7ff747e00640 1 -- 172.21.15.99:0/2903696663 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74800aa70 con 0x7ff75015ecc0 2024-09-10T07:34:32.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.888+0000 7ff757200640 1 -- 172.21.15.99:0/2903696663 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7500ced00 con 0x7ff75015ecc0 2024-09-10T07:34:32.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.889+0000 7ff757200640 1 -- 172.21.15.99:0/2903696663 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7500c9d60 con 0x7ff75015ecc0 2024-09-10T07:34:32.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.889+0000 7ff757200640 1 -- 172.21.15.99:0/2903696663 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7500d1450 con 0x7ff75015ecc0 2024-09-10T07:34:32.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.890+0000 7ff747e00640 1 -- 172.21.15.99:0/2903696663 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff74801b070 con 0x7ff75015ecc0 2024-09-10T07:34:32.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.891+0000 7ff747e00640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff73006be60 0x7ff73006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:32.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.891+0000 7ff747e00640 1 -- 172.21.15.99:0/2903696663 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff74808a3b0 con 0x7ff75015ecc0 2024-09-10T07:34:32.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.891+0000 7ff74fe00640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff73006be60 0x7ff73006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:32.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.892+0000 7ff74fe00640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff73006be60 0x7ff73006e320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff740009aa0 tx=0x7ff740009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:32.895+0000 7ff747e00640 1 -- 172.21.15.99:0/2903696663 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff748058700 con 0x7ff75015ecc0 2024-09-10T07:34:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.108+0000 7ff757200640 1 -- 172.21.15.99:0/2903696663 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff75008e3c0 con 0x7ff75015ecc0 2024-09-10T07:34:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.109+0000 7ff747e00640 1 -- 172.21.15.99:0/2903696663 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7ff74805ca00 con 0x7ff75015ecc0 2024-09-10T07:34:33.109 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:33.109 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"btime":"2024-09-10T07:34:22:900404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3627151667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3627151667},{"type":"v1","addr":"172.21.15.99:6835","nonce":3627151667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/72768681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":72768681},{"type":"v1","addr":"172.21.15.99:6837","nonce":72768681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3327861481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3327861481},{"type":"v1","addr":"172.21.15.187:6834","nonce":3327861481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:34:19.275989+0000","modified":"2024-09-10T07:34:22.302078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/4184584284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4184584284},{"type":"v1","addr":"172.21.15.187:6835","nonce":4184584284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-10T07:34:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-09-10T07:34:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 -- 172.21.15.99:0/2903696663 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff73006be60 msgr2=0x7ff73006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff73006be60 0x7ff73006e320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff740009aa0 tx=0x7ff740009190 comp rx=0 tx=0).stop 2024-09-10T07:34:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 -- 172.21.15.99:0/2903696663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff75015ecc0 msgr2=0x7ff750158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff75015ecc0 0x7ff750158d60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff74800c7a0 tx=0x7ff74800cc60 comp rx=0 tx=0).stop 2024-09-10T07:34:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 -- 172.21.15.99:0/2903696663 shutdown_connections 2024-09-10T07:34:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff73006be60 0x7ff73006e320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff75015ecc0 0x7ff750158d60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7500d57a0 0x7ff7501530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 --2- 172.21.15.99:0/2903696663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7500d1990 0x7ff7500ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 -- 172.21.15.99:0/2903696663 >> 172.21.15.99:0/2903696663 conn(0x7ff7500d4bd0 msgr2=0x7ff7500cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 -- 172.21.15.99:0/2903696663 shutdown_connections 2024-09-10T07:34:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.111+0000 7ff757200640 1 -- 172.21.15.99:0/2903696663 wait complete. 2024-09-10T07:34:33.127 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:34:33.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.279+0000 7f875a000640 1 Processor -- start 2024-09-10T07:34:33.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.280+0000 7f875a000640 1 -- start start 2024-09-10T07:34:33.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f875a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8754142150 0x7f8754160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f875a000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8754142650 con 0x7f875413fae0 2024-09-10T07:34:33.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f875a000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8754142930 con 0x7f8754160a80 2024-09-10T07:34:33.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f875a000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f87540ce780 con 0x7f8754142150 2024-09-10T07:34:33.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f874aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8754142150 0x7f8754160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f874aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8754142150 0x7f8754160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52576/0 (socket says 172.21.15.99:52576) 2024-09-10T07:34:33.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f874aa00640 1 -- 172.21.15.99:0/3744239270 learned_addr learned my addr 172.21.15.99:0/3744239270 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:33.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f8753400640 1 --1- 172.21.15.99:0/3744239270 >> v1:172.21.15.99:6789/0 conn(0x7f875413fae0 0x7f875406f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38370/0 (socket says 172.21.15.99:38370) 2024-09-10T07:34:33.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f874aa00640 1 -- 172.21.15.99:0/3744239270 >> v1:172.21.15.187:6789/0 conn(0x7f8754160a80 legacy=0x7f87540cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:33.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f874aa00640 1 -- 172.21.15.99:0/3744239270 >> v1:172.21.15.99:6789/0 conn(0x7f875413fae0 legacy=0x7f875406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.281+0000 7f874aa00640 1 -- 172.21.15.99:0/3744239270 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8754142c10 con 0x7f8754142150 2024-09-10T07:34:33.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.282+0000 7f874aa00640 1 --2- 172.21.15.99:0/3744239270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8754142150 0x7f8754160540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f873c009870 tx=0x7f873c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543d91115b094091 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:33.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.283+0000 7f8752a00640 1 -- 172.21.15.99:0/3744239270 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c037070 con 0x7f8754142150 2024-09-10T07:34:33.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.283+0000 7f8752a00640 1 -- 172.21.15.99:0/3744239270 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c032440 con 0x7f8754142150 2024-09-10T07:34:33.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.283+0000 7f8752a00640 1 -- 172.21.15.99:0/3744239270 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c032810 con 0x7f8754142150 2024-09-10T07:34:33.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.283+0000 7f875a000640 1 -- 172.21.15.99:0/3744239270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8754142150 msgr2=0x7f8754160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.283+0000 7f875a000640 1 --2- 172.21.15.99:0/3744239270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8754142150 0x7f8754160540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f873c009870 tx=0x7f873c02a210 comp rx=0 tx=0).stop 2024-09-10T07:34:33.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.283+0000 7f875a000640 1 -- 172.21.15.99:0/3744239270 shutdown_connections 2024-09-10T07:34:33.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.283+0000 7f875a000640 1 --2- 172.21.15.99:0/3744239270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8754142150 0x7f8754160540 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.283+0000 7f875a000640 1 -- 172.21.15.99:0/3744239270 >> 172.21.15.99:0/3744239270 conn(0x7f875406bc10 msgr2=0x7f875406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:33.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.283+0000 7f875a000640 1 -- 172.21.15.99:0/3744239270 shutdown_connections 2024-09-10T07:34:33.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.283+0000 7f875a000640 1 -- 172.21.15.99:0/3744239270 wait complete. 2024-09-10T07:34:33.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.285+0000 7f875a000640 1 Processor -- start 2024-09-10T07:34:33.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.285+0000 7f875a000640 1 -- start start 2024-09-10T07:34:33.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f875a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f875413fae0 0x7f875413c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f875a000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8754142150 0x7f8754072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f875a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8754160a80 0x7f87540b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f875a000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f87540cf4a0 con 0x7f875413fae0 2024-09-10T07:34:33.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f875a000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f87540cf320 con 0x7f8754142150 2024-09-10T07:34:33.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f875a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f87540cf620 con 0x7f8754160a80 2024-09-10T07:34:33.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f8753400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f875413fae0 0x7f875413c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f8753400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f875413fae0 0x7f875413c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52580/0 (socket says 172.21.15.99:52580) 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f8753400640 1 -- 172.21.15.99:0/966397878 learned_addr learned my addr 172.21.15.99:0/966397878 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f874aa00640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8754142150 0x7f8754072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f8753e00640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8754160a80 0x7f87540b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f8753400640 1 -- 172.21.15.99:0/966397878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8754160a80 msgr2=0x7f87540b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.286+0000 7f8753400640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8754160a80 0x7f87540b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.287+0000 7f8753400640 1 -- 172.21.15.99:0/966397878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8754142150 msgr2=0x7f8754072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.287+0000 7f8753400640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8754142150 0x7f8754072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.287+0000 7f8753400640 1 -- 172.21.15.99:0/966397878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87541f4f40 con 0x7f875413fae0 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.287+0000 7f8753400640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f875413fae0 0x7f875413c2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f874400c430 tx=0x7f874400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.287+0000 7f874be00640 1 -- 172.21.15.99:0/966397878 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87440074e0 con 0x7f875413fae0 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.287+0000 7f874be00640 1 -- 172.21.15.99:0/966397878 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8744007680 con 0x7f875413fae0 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.287+0000 7f874be00640 1 -- 172.21.15.99:0/966397878 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744004a00 con 0x7f875413fae0 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.287+0000 7f875a000640 1 -- 172.21.15.99:0/966397878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87541f51e0 con 0x7f875413fae0 2024-09-10T07:34:33.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.287+0000 7f875a000640 1 -- 172.21.15.99:0/966397878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87541f57a0 con 0x7f875413fae0 2024-09-10T07:34:33.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.288+0000 7f875a000640 1 -- 172.21.15.99:0/966397878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f875415ea60 con 0x7f875413fae0 2024-09-10T07:34:33.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.289+0000 7f874be00640 1 -- 172.21.15.99:0/966397878 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f874401a020 con 0x7f875413fae0 2024-09-10T07:34:33.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.290+0000 7f874be00640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f873006be30 0x7f873006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.290+0000 7f874be00640 1 -- 172.21.15.99:0/966397878 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f874408a5f0 con 0x7f875413fae0 2024-09-10T07:34:33.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.290+0000 7f874aa00640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f873006be30 0x7f873006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.291+0000 7f874aa00640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f873006be30 0x7f873006e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f873c034000 tx=0x7f873c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:33.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.295+0000 7f874be00640 1 -- 172.21.15.99:0/966397878 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f875415ea60 con 0x7f875413fae0 2024-09-10T07:34:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.499+0000 7f875a000640 1 -- 172.21.15.99:0/966397878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8754160540 con 0x7f875413fae0 2024-09-10T07:34:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.500+0000 7f874be00640 1 -- 172.21.15.99:0/966397878 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f8744058f90 con 0x7f875413fae0 2024-09-10T07:34:33.500 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:33.500 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"btime":"2024-09-10T07:34:22:900404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3627151667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3627151667},{"type":"v1","addr":"172.21.15.99:6835","nonce":3627151667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/72768681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":72768681},{"type":"v1","addr":"172.21.15.99:6837","nonce":72768681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3327861481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3327861481},{"type":"v1","addr":"172.21.15.187:6834","nonce":3327861481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:34:19.275989+0000","modified":"2024-09-10T07:34:22.302078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/4184584284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4184584284},{"type":"v1","addr":"172.21.15.187:6835","nonce":4184584284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-10T07:34:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-09-10T07:34:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 -- 172.21.15.99:0/966397878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f873006be30 msgr2=0x7f873006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f873006be30 0x7f873006e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f873c034000 tx=0x7f873c02e000 comp rx=0 tx=0).stop 2024-09-10T07:34:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 -- 172.21.15.99:0/966397878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f875413fae0 msgr2=0x7f875413c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f875413fae0 0x7f875413c2b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f874400c430 tx=0x7f874400c8f0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 -- 172.21.15.99:0/966397878 shutdown_connections 2024-09-10T07:34:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8754160a80 0x7f87540b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8754142150 0x7f8754072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f873006be30 0x7f873006e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 --2- 172.21.15.99:0/966397878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f875413fae0 0x7f875413c2b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 -- 172.21.15.99:0/966397878 >> 172.21.15.99:0/966397878 conn(0x7f875406bc10 msgr2=0x7f8754160ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 -- 172.21.15.99:0/966397878 shutdown_connections 2024-09-10T07:34:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.502+0000 7f875a000640 1 -- 172.21.15.99:0/966397878 wait complete. 2024-09-10T07:34:33.518 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.670+0000 7ff2cc600640 1 Processor -- start 2024-09-10T07:34:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.670+0000 7ff2cc600640 1 -- start start 2024-09-10T07:34:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.671+0000 7ff2cc600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff2c40d57a0 0x7ff2c40d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.671+0000 7ff2cc600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff2c40d1990 0x7ff2c40b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.671+0000 7ff2cc600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c40d3880 con 0x7ff2c415ecc0 2024-09-10T07:34:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.671+0000 7ff2cc600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c40d3b20 con 0x7ff2c40d57a0 2024-09-10T07:34:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.671+0000 7ff2cc600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c40b42f0 con 0x7ff2c40d1990 2024-09-10T07:34:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.672+0000 7ff2c9200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff2c40d57a0 0x7ff2c40d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.672+0000 7ff2c9200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff2c40d57a0 0x7ff2c40d1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52586/0 (socket says 172.21.15.99:52586) 2024-09-10T07:34:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.672+0000 7ff2c9200640 1 -- 172.21.15.99:0/991854235 learned_addr learned my addr 172.21.15.99:0/991854235 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.672+0000 7ff2ca600640 1 --2- 172.21.15.99:0/991854235 >> v2:172.21.15.187:3300/0 conn(0x7ff2c40d1990 0x7ff2c40b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.672+0000 7ff2c9200640 1 -- 172.21.15.99:0/991854235 >> v2:172.21.15.187:3300/0 conn(0x7ff2c40d1990 msgr2=0x7ff2c40b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.672+0000 7ff2c9200640 1 --2- 172.21.15.99:0/991854235 >> v2:172.21.15.187:3300/0 conn(0x7ff2c40d1990 0x7ff2c40b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.672+0000 7ff2c9200640 1 -- 172.21.15.99:0/991854235 >> v1:172.21.15.187:6789/0 conn(0x7ff2c415ecc0 legacy=0x7ff2c40d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.672+0000 7ff2c9200640 1 -- 172.21.15.99:0/991854235 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c40b45d0 con 0x7ff2c40d57a0 2024-09-10T07:34:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.673+0000 7ff2c9200640 1 --2- 172.21.15.99:0/991854235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d57a0 0x7ff2c40d1450 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40d46b0 tx=0x7ff2b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1757850c888ab93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.673+0000 7ff2c3e00640 1 -- 172.21.15.99:0/991854235 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0037070 con 0x7ff2c40d57a0 2024-09-10T07:34:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.673+0000 7ff2c3e00640 1 -- 172.21.15.99:0/991854235 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b0032440 con 0x7ff2c40d57a0 2024-09-10T07:34:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.673+0000 7ff2c3e00640 1 -- 172.21.15.99:0/991854235 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0032810 con 0x7ff2c40d57a0 2024-09-10T07:34:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.674+0000 7ff2cc600640 1 -- 172.21.15.99:0/991854235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d57a0 msgr2=0x7ff2c40d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.674+0000 7ff2cc600640 1 --2- 172.21.15.99:0/991854235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d57a0 0x7ff2c40d1450 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40d46b0 tx=0x7ff2b002a270 comp rx=0 tx=0).stop 2024-09-10T07:34:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.674+0000 7ff2cc600640 1 -- 172.21.15.99:0/991854235 shutdown_connections 2024-09-10T07:34:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.674+0000 7ff2cc600640 1 --2- 172.21.15.99:0/991854235 >> v2:172.21.15.187:3300/0 conn(0x7ff2c40d1990 0x7ff2c40b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.674+0000 7ff2cc600640 1 --2- 172.21.15.99:0/991854235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d57a0 0x7ff2c40d1450 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.674+0000 7ff2cc600640 1 -- 172.21.15.99:0/991854235 >> 172.21.15.99:0/991854235 conn(0x7ff2c40d4bd0 msgr2=0x7ff2c40d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:33.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.674+0000 7ff2cc600640 1 -- 172.21.15.99:0/991854235 shutdown_connections 2024-09-10T07:34:33.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.674+0000 7ff2cc600640 1 -- 172.21.15.99:0/991854235 wait complete. 2024-09-10T07:34:33.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.675+0000 7ff2cc600640 1 Processor -- start 2024-09-10T07:34:33.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.675+0000 7ff2cc600640 1 -- start start 2024-09-10T07:34:33.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.676+0000 7ff2cc600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d1990 0x7ff2c4158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.676+0000 7ff2cc600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2c40d57a0 0x7ff2c40b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.676+0000 7ff2cc600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2c415ecc0 0x7ff2c415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.676+0000 7ff2cc600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c415f0a0 con 0x7ff2c40d1990 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.676+0000 7ff2cc600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c40b4b90 con 0x7ff2c415ecc0 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.676+0000 7ff2cc600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c415f220 con 0x7ff2c40d57a0 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d1990 0x7ff2c4158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d1990 0x7ff2c4158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52588/0 (socket says 172.21.15.99:52588) 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9c00640 1 -- 172.21.15.99:0/2736004281 learned_addr learned my addr 172.21.15.99:0/2736004281 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9200640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2c40d57a0 0x7ff2c40b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2ca600640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2c415ecc0 0x7ff2c415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9c00640 1 -- 172.21.15.99:0/2736004281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2c40d57a0 msgr2=0x7ff2c40b9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9c00640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2c40d57a0 0x7ff2c40b9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9c00640 1 -- 172.21.15.99:0/2736004281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2c415ecc0 msgr2=0x7ff2c415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9c00640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2c415ecc0 0x7ff2c415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9c00640 1 -- 172.21.15.99:0/2736004281 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c41e7790 con 0x7ff2c40d1990 2024-09-10T07:34:33.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9200640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2c40d57a0 0x7ff2c40b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:33.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c9c00640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d1990 0x7ff2c4158270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c400 tx=0x7ff2b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:33.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.677+0000 7ff2c1600640 1 -- 172.21.15.99:0/2736004281 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8017070 con 0x7ff2c40d1990 2024-09-10T07:34:33.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.678+0000 7ff2c1600640 1 -- 172.21.15.99:0/2736004281 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b80052d0 con 0x7ff2c40d1990 2024-09-10T07:34:33.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.678+0000 7ff2c1600640 1 -- 172.21.15.99:0/2736004281 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8003830 con 0x7ff2c40d1990 2024-09-10T07:34:33.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.678+0000 7ff2cc600640 1 -- 172.21.15.99:0/2736004281 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c41e7a70 con 0x7ff2c40d1990 2024-09-10T07:34:33.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.678+0000 7ff2cc600640 1 -- 172.21.15.99:0/2736004281 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c4157410 con 0x7ff2c40d1990 2024-09-10T07:34:33.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.679+0000 7ff2cc600640 1 -- 172.21.15.99:0/2736004281 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c40d1450 con 0x7ff2c40d1990 2024-09-10T07:34:33.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.680+0000 7ff2c1600640 1 -- 172.21.15.99:0/2736004281 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2b801a070 con 0x7ff2c40d1990 2024-09-10T07:34:33.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.680+0000 7ff2c1600640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff2a406be30 0x7ff2a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:33.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.680+0000 7ff2c1600640 1 -- 172.21.15.99:0/2736004281 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff2b808a1b0 con 0x7ff2c40d1990 2024-09-10T07:34:33.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.681+0000 7ff2c9200640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff2a406be30 0x7ff2a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:33.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.681+0000 7ff2c9200640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff2a406be30 0x7ff2a406e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0034000 tx=0x7ff2b002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:33.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.685+0000 7ff2c1600640 1 -- 172.21.15.99:0/2736004281 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2b8058470 con 0x7ff2c40d1990 2024-09-10T07:34:33.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.860+0000 7ff2cc600640 1 -- 172.21.15.99:0/2736004281 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2c408e3c0 con 0x7ff2c40d1990 2024-09-10T07:34:33.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.861+0000 7ff2c1600640 1 -- 172.21.15.99:0/2736004281 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7ff2b805c770 con 0x7ff2c40d1990 2024-09-10T07:34:33.861 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:33.861 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:20.870081+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:34:17.274179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:34:18.279150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.863+0000 7ff2cc600640 1 -- 172.21.15.99:0/2736004281 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff2a406be30 msgr2=0x7ff2a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.863+0000 7ff2cc600640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff2a406be30 0x7ff2a406e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0034000 tx=0x7ff2b002e000 comp rx=0 tx=0).stop 2024-09-10T07:34:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.863+0000 7ff2cc600640 1 -- 172.21.15.99:0/2736004281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d1990 msgr2=0x7ff2c4158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.863+0000 7ff2cc600640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d1990 0x7ff2c4158270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c400 tx=0x7ff2b800c8c0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.863+0000 7ff2cc600640 1 -- 172.21.15.99:0/2736004281 shutdown_connections 2024-09-10T07:34:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.863+0000 7ff2cc600640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2c415ecc0 0x7ff2c415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.863+0000 7ff2cc600640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2c40d57a0 0x7ff2c40b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.863+0000 7ff2cc600640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff2a406be30 0x7ff2a406e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.863+0000 7ff2cc600640 1 --2- 172.21.15.99:0/2736004281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c40d1990 0x7ff2c4158270 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.863+0000 7ff2cc600640 1 -- 172.21.15.99:0/2736004281 >> 172.21.15.99:0/2736004281 conn(0x7ff2c40d4bd0 msgr2=0x7ff2c40b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.864+0000 7ff2cc600640 1 -- 172.21.15.99:0/2736004281 shutdown_connections 2024-09-10T07:34:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:33.864+0000 7ff2cc600640 1 -- 172.21.15.99:0/2736004281 wait complete. 2024-09-10T07:34:33.880 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:34:34.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.034+0000 7f40c7800640 1 Processor -- start 2024-09-10T07:34:34.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.034+0000 7f40c7800640 1 -- start start 2024-09-10T07:34:34.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.036+0000 7f40c7800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f40c0142150 0x7f40c0160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.036+0000 7f40c7800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c0142650 con 0x7f40c013fae0 2024-09-10T07:34:34.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.036+0000 7f40c7800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c0142930 con 0x7f40c0160a80 2024-09-10T07:34:34.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.036+0000 7f40c7800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f40c00ce780 con 0x7f40c0142150 2024-09-10T07:34:34.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.036+0000 7f40c4e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f40c013fae0 0x7f40c006f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38386/0 (socket says 172.21.15.99:38386) 2024-09-10T07:34:34.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.036+0000 7f40c4e00640 1 -- 172.21.15.99:0/3018336880 learned_addr learned my addr 172.21.15.99:0/3018336880 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:34.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.036+0000 7f40b7e00640 1 --2- 172.21.15.99:0/3018336880 >> v2:172.21.15.187:3300/0 conn(0x7f40c0142150 0x7f40c0160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.036+0000 7f40bfe00640 1 -- 172.21.15.99:0/3018336880 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777540630 0 0) 0x7f40c0142650 con 0x7f40c013fae0 2024-09-10T07:34:34.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.036+0000 7f40bfe00640 1 -- 172.21.15.99:0/3018336880 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40a4003520 con 0x7f40c013fae0 2024-09-10T07:34:34.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.037+0000 7f40bfe00640 1 -- 172.21.15.99:0/3018336880 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2572695834 0 0) 0x7f40a4003520 con 0x7f40c013fae0 2024-09-10T07:34:34.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.037+0000 7f40b7e00640 1 -- 172.21.15.99:0/3018336880 >> v1:172.21.15.187:6789/0 conn(0x7f40c0160a80 legacy=0x7f40c00cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.037+0000 7f40b7e00640 1 -- 172.21.15.99:0/3018336880 >> v1:172.21.15.99:6789/0 conn(0x7f40c013fae0 legacy=0x7f40c006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.037+0000 7f40b7e00640 1 -- 172.21.15.99:0/3018336880 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c0142c10 con 0x7f40c0142150 2024-09-10T07:34:34.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.038+0000 7f40b7e00640 1 --2- 172.21.15.99:0/3018336880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40c0142150 0x7f40c0160540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f40a80097a0 tx=0x7f40a802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa2b8f229b1660 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:34.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.038+0000 7f40bfe00640 1 -- 172.21.15.99:0/3018336880 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8037070 con 0x7f40c0142150 2024-09-10T07:34:34.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.038+0000 7f40bfe00640 1 -- 172.21.15.99:0/3018336880 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a802abc0 con 0x7f40c0142150 2024-09-10T07:34:34.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.038+0000 7f40bfe00640 1 -- 172.21.15.99:0/3018336880 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0001670 con 0x7f40c0142150 2024-09-10T07:34:34.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.038+0000 7f40c7800640 1 -- 172.21.15.99:0/3018336880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40c0142150 msgr2=0x7f40c0160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.038+0000 7f40c7800640 1 --2- 172.21.15.99:0/3018336880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40c0142150 0x7f40c0160540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f40a80097a0 tx=0x7f40a802a130 comp rx=0 tx=0).stop 2024-09-10T07:34:34.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.038+0000 7f40c7800640 1 -- 172.21.15.99:0/3018336880 shutdown_connections 2024-09-10T07:34:34.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.038+0000 7f40c7800640 1 --2- 172.21.15.99:0/3018336880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40c0142150 0x7f40c0160540 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.038+0000 7f40c7800640 1 -- 172.21.15.99:0/3018336880 >> 172.21.15.99:0/3018336880 conn(0x7f40c006bc10 msgr2=0x7f40c006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:34.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.039+0000 7f40c7800640 1 -- 172.21.15.99:0/3018336880 shutdown_connections 2024-09-10T07:34:34.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.039+0000 7f40c7800640 1 -- 172.21.15.99:0/3018336880 wait complete. 2024-09-10T07:34:34.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.040+0000 7f40c7800640 1 Processor -- start 2024-09-10T07:34:34.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.040+0000 7f40c7800640 1 -- start start 2024-09-10T07:34:34.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.041+0000 7f40c7800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c013fae0 0x7f40c015de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.041+0000 7f40c7800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40c0142150 0x7f40c0144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.041+0000 7f40c7800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40c0160a80 0x7f40c0143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.041+0000 7f40c7800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f40c00cf4a0 con 0x7f40c013fae0 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.041+0000 7f40c7800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f40c00cf320 con 0x7f40c0142150 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.041+0000 7f40c7800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f40c00cf620 con 0x7f40c0160a80 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.041+0000 7f40c4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c013fae0 0x7f40c015de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.041+0000 7f40c4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c013fae0 0x7f40c015de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52590/0 (socket says 172.21.15.99:52590) 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.041+0000 7f40c4e00640 1 -- 172.21.15.99:0/2993362001 learned_addr learned my addr 172.21.15.99:0/2993362001 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40b7e00640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40c0142150 0x7f40c0144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40c4e00640 1 -- 172.21.15.99:0/2993362001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40c0160a80 msgr2=0x7f40c0143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40c5800640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40c0160a80 0x7f40c0143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40c4e00640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40c0160a80 0x7f40c0143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40c4e00640 1 -- 172.21.15.99:0/2993362001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40c0142150 msgr2=0x7f40c0144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40c4e00640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40c0142150 0x7f40c0144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40c4e00640 1 -- 172.21.15.99:0/2993362001 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c015d0f0 con 0x7f40c013fae0 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40c5800640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40c0160a80 0x7f40c0143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40b7e00640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40c0142150 0x7f40c0144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40c4e00640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c013fae0 0x7f40c015de70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40b000c750 tx=0x7f40b000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40bd600640 1 -- 172.21.15.99:0/2993362001 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0017070 con 0x7f40c013fae0 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40bd600640 1 -- 172.21.15.99:0/2993362001 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b0005ad0 con 0x7f40c013fae0 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40bd600640 1 -- 172.21.15.99:0/2993362001 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0007070 con 0x7f40c013fae0 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40c7800640 1 -- 172.21.15.99:0/2993362001 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c0144080 con 0x7f40c013fae0 2024-09-10T07:34:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.042+0000 7f40c7800640 1 -- 172.21.15.99:0/2993362001 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c015d670 con 0x7f40c013fae0 2024-09-10T07:34:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.043+0000 7f40c7800640 1 -- 172.21.15.99:0/2993362001 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c0160540 con 0x7f40c013fae0 2024-09-10T07:34:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.044+0000 7f40bd600640 1 -- 172.21.15.99:0/2993362001 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40b001a070 con 0x7f40c013fae0 2024-09-10T07:34:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.045+0000 7f40bd600640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f409c06be30 0x7f409c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.045+0000 7f40bd600640 1 -- 172.21.15.99:0/2993362001 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f40b008a500 con 0x7f40c013fae0 2024-09-10T07:34:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.045+0000 7f40b7e00640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f409c06be30 0x7f409c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.046+0000 7f40b7e00640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f409c06be30 0x7f409c06e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40a8034000 tx=0x7f40a802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.049+0000 7f40bd600640 1 -- 172.21.15.99:0/2993362001 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40b0058d80 con 0x7f40c013fae0 2024-09-10T07:34:34.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.254+0000 7f40c7800640 1 -- 172.21.15.99:0/2993362001 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40c0072260 con 0x7f40c013fae0 2024-09-10T07:34:34.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.255+0000 7f40bd600640 1 -- 172.21.15.99:0/2993362001 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f40b0058680 con 0x7f40c013fae0 2024-09-10T07:34:34.257 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:34.258 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"btime":"2024-09-10T07:34:22:900404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3627151667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3627151667},{"type":"v1","addr":"172.21.15.99:6835","nonce":3627151667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/72768681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":72768681},{"type":"v1","addr":"172.21.15.99:6837","nonce":72768681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3327861481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3327861481},{"type":"v1","addr":"172.21.15.187:6834","nonce":3327861481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:34:19.275989+0000","modified":"2024-09-10T07:34:22.302078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/4184584284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4184584284},{"type":"v1","addr":"172.21.15.187:6835","nonce":4184584284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-10T07:34:34.259 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-09-10T07:34:34.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 -- 172.21.15.99:0/2993362001 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f409c06be30 msgr2=0x7f409c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f409c06be30 0x7f409c06e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40a8034000 tx=0x7f40a802e000 comp rx=0 tx=0).stop 2024-09-10T07:34:34.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 -- 172.21.15.99:0/2993362001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c013fae0 msgr2=0x7f40c015de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c013fae0 0x7f40c015de70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40b000c750 tx=0x7f40b000cc10 comp rx=0 tx=0).stop 2024-09-10T07:34:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 -- 172.21.15.99:0/2993362001 shutdown_connections 2024-09-10T07:34:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40c0160a80 0x7f40c0143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40c0142150 0x7f40c0144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f409c06be30 0x7f409c06e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 --2- 172.21.15.99:0/2993362001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40c013fae0 0x7f40c015de70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 -- 172.21.15.99:0/2993362001 >> 172.21.15.99:0/2993362001 conn(0x7f40c006bc10 msgr2=0x7f40c006e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 -- 172.21.15.99:0/2993362001 shutdown_connections 2024-09-10T07:34:34.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.257+0000 7f40c7800640 1 -- 172.21.15.99:0/2993362001 wait complete. 2024-09-10T07:34:34.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:34:19.275989+0000', 'modified': '2024-09-10T07:34:22.302078+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6835/4184584284', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6833', 'nonce': 4184584284}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 4184584284}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4284, 'qdb_cluster': [4284]} 2024-09-10T07:34:34.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:34:34.675 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T07:34:34.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.832+0000 7f110d800640 1 Processor -- start 2024-09-10T07:34:34.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.833+0000 7f110d800640 1 -- start start 2024-09-10T07:34:34.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f110d800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f11080ce070 0x7f11080b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f110d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11080cf890 0x7f11080cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f110d800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110815d880 con 0x7f110815bfb0 2024-09-10T07:34:34.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f110d800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f11080ce450 con 0x7f11080ce070 2024-09-10T07:34:34.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f110d800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f110815c800 con 0x7f11080cf890 2024-09-10T07:34:34.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f1106a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f11080ce070 0x7f11080b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f1106a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f11080ce070 0x7f11080b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52604/0 (socket says 172.21.15.99:52604) 2024-09-10T07:34:34.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f1106a00640 1 -- 172.21.15.99:0/543014320 learned_addr learned my addr 172.21.15.99:0/543014320 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:34.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f1106000640 1 --1- 172.21.15.99:0/543014320 >> v1:172.21.15.99:6789/0 conn(0x7f110815bfb0 0x7f110815d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38392/0 (socket says 172.21.15.99:38392) 2024-09-10T07:34:34.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f1106a00640 1 -- 172.21.15.99:0/543014320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11080cf890 msgr2=0x7f11080cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:34.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f1106a00640 1 --2- 172.21.15.99:0/543014320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11080cf890 0x7f11080cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f1106a00640 1 -- 172.21.15.99:0/543014320 >> v1:172.21.15.99:6789/0 conn(0x7f110815bfb0 legacy=0x7f110815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f1105600640 1 -- 172.21.15.99:0/543014320 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780664541 0 0) 0x7f110815d880 con 0x7f110815bfb0 2024-09-10T07:34:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.834+0000 7f1106a00640 1 -- 172.21.15.99:0/543014320 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110815cae0 con 0x7f11080ce070 2024-09-10T07:34:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.835+0000 7f1106a00640 1 --2- 172.21.15.99:0/543014320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080ce070 0x7f11080b5750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f10f800bb10 tx=0x7f10f802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b561bff3f37e1fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f1105600640 1 -- 172.21.15.99:0/543014320 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8036020 con 0x7f11080ce070 2024-09-10T07:34:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f1105600640 1 -- 172.21.15.99:0/543014320 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f8032820 con 0x7f11080ce070 2024-09-10T07:34:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f1105600640 1 -- 172.21.15.99:0/543014320 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8032bf0 con 0x7f11080ce070 2024-09-10T07:34:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f110d800640 1 -- 172.21.15.99:0/543014320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080ce070 msgr2=0x7f11080b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f110d800640 1 --2- 172.21.15.99:0/543014320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080ce070 0x7f11080b5750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f10f800bb10 tx=0x7f10f802c920 comp rx=0 tx=0).stop 2024-09-10T07:34:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f110d800640 1 -- 172.21.15.99:0/543014320 shutdown_connections 2024-09-10T07:34:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f110d800640 1 --2- 172.21.15.99:0/543014320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11080cf890 0x7f11080cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f110d800640 1 --2- 172.21.15.99:0/543014320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080ce070 0x7f11080b5750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f110d800640 1 -- 172.21.15.99:0/543014320 >> 172.21.15.99:0/543014320 conn(0x7f11080b2630 msgr2=0x7f11080b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f110d800640 1 -- 172.21.15.99:0/543014320 shutdown_connections 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.836+0000 7f110d800640 1 -- 172.21.15.99:0/543014320 wait complete. 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.838+0000 7f110d800640 1 Processor -- start 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.838+0000 7f110d800640 1 -- start start 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f110d800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11080ce070 0x7f1108146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f110d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080cf890 0x7f11081470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f110d800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110815bfb0 0x7f11080b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f110d800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f110815c590 con 0x7f11080cf890 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f110d800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f110815c410 con 0x7f110815bfb0 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f110d800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f110806e080 con 0x7f11080ce070 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f1106000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080cf890 0x7f11081470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f1106000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080cf890 0x7f11081470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52608/0 (socket says 172.21.15.99:52608) 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f1106000640 1 -- 172.21.15.99:0/853082920 learned_addr learned my addr 172.21.15.99:0/853082920 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f1106a00640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11080ce070 0x7f1108146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f1107400640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110815bfb0 0x7f11080b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f1106000640 1 -- 172.21.15.99:0/853082920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11080ce070 msgr2=0x7f1108146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f1106000640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11080ce070 0x7f1108146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f1106000640 1 -- 172.21.15.99:0/853082920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110815bfb0 msgr2=0x7f11080b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f1106000640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110815bfb0 0x7f11080b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.839+0000 7f1106000640 1 -- 172.21.15.99:0/853082920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1108147a10 con 0x7f11080cf890 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.840+0000 7f1106000640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080cf890 0x7f11081470a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f10f400c460 tx=0x7f10f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.840+0000 7f10fea00640 1 -- 172.21.15.99:0/853082920 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4018070 con 0x7f11080cf890 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.840+0000 7f10fea00640 1 -- 172.21.15.99:0/853082920 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f4007500 con 0x7f11080cf890 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.840+0000 7f110d800640 1 -- 172.21.15.99:0/853082920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1108147cf0 con 0x7f11080cf890 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.840+0000 7f10fea00640 1 -- 172.21.15.99:0/853082920 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4004a20 con 0x7f11080cf890 2024-09-10T07:34:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.840+0000 7f110d800640 1 -- 172.21.15.99:0/853082920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11081482b0 con 0x7f11080cf890 2024-09-10T07:34:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.843+0000 7f10fea00640 1 -- 172.21.15.99:0/853082920 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10f401b070 con 0x7f11080cf890 2024-09-10T07:34:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.844+0000 7f10fea00640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10e806be30 0x7f10e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.844+0000 7f10fea00640 1 -- 172.21.15.99:0/853082920 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f10f408a120 con 0x7f11080cf890 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.844+0000 7f1106a00640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10e806be30 0x7f10e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.844+0000 7f11106b0740 1 Processor -- start 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.844+0000 7f11106b0740 1 -- start start 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.845+0000 7f1106a00640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10e806be30 0x7f10e806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10f8037000 tx=0x7f10f8032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.845+0000 7f11106b0740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 0x55bd9d7a6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.845+0000 7f11106b0740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d75e4b0 0x55bd9d7610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.845+0000 7f11106b0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d762480 0x55bd9d75b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.845+0000 7f11106b0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d6bf3b0 con 0x55bd9d762480 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.845+0000 7f11106b0740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d6c4410 con 0x55bd9d760cf0 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.845+0000 7f11106b0740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55bd9d66c620 con 0x55bd9d75e4b0 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.845+0000 7f1107400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d762480 0x55bd9d75b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.845+0000 7f1107400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d762480 0x55bd9d75b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52620/0 (socket says 172.21.15.99:52620) 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.845+0000 7f1107400640 1 -- 172.21.15.99:0/3680019883 learned_addr learned my addr 172.21.15.99:0/3680019883 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f1106a00640 1 --2- 172.21.15.99:0/3680019883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 0x55bd9d7a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f1106000640 1 --2- 172.21.15.99:0/3680019883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d75e4b0 0x55bd9d7610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f1107400640 1 -- 172.21.15.99:0/3680019883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d75e4b0 msgr2=0x55bd9d7610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f1107400640 1 --2- 172.21.15.99:0/3680019883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d75e4b0 0x55bd9d7610d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f1107400640 1 -- 172.21.15.99:0/3680019883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 msgr2=0x55bd9d7a6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f1107400640 1 --2- 172.21.15.99:0/3680019883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 0x55bd9d7a6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f1107400640 1 -- 172.21.15.99:0/3680019883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd9d3d72d0 con 0x55bd9d762480 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f1106a00640 1 --2- 172.21.15.99:0/3680019883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 0x55bd9d7a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f1107400640 1 --2- 172.21.15.99:0/3680019883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d762480 0x55bd9d75b570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1100009f80 tx=0x7f110000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc337e82e0a2fcd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f10f3400640 1 -- 172.21.15.99:0/3680019883 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100016420 con 0x55bd9d762480 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f10f3400640 1 -- 172.21.15.99:0/3680019883 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11000165c0 con 0x55bd9d762480 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.846+0000 7f10f3400640 1 -- 172.21.15.99:0/3680019883 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11000169b0 con 0x55bd9d762480 2024-09-10T07:34:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.847+0000 7f11106b0740 1 -- 172.21.15.99:0/3680019883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d762480 msgr2=0x55bd9d75b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.847+0000 7f11106b0740 1 --2- 172.21.15.99:0/3680019883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d762480 0x55bd9d75b570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1100009f80 tx=0x7f110000c8b0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.847+0000 7f11106b0740 1 -- 172.21.15.99:0/3680019883 shutdown_connections 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.847+0000 7f11106b0740 1 --2- 172.21.15.99:0/3680019883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d762480 0x55bd9d75b570 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.847+0000 7f11106b0740 1 --2- 172.21.15.99:0/3680019883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d75e4b0 0x55bd9d7610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.847+0000 7f11106b0740 1 --2- 172.21.15.99:0/3680019883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 0x55bd9d7a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.847+0000 7f11106b0740 1 -- 172.21.15.99:0/3680019883 >> 172.21.15.99:0/3680019883 conn(0x55bd9d75d740 msgr2=0x55bd9d7a5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.847+0000 7f11106b0740 1 -- 172.21.15.99:0/3680019883 shutdown_connections 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.847+0000 7f11106b0740 1 -- 172.21.15.99:0/3680019883 wait complete. 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.848+0000 7f11106b0740 1 -- start start 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.848+0000 7f11106b0740 1 Processor -- start 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f11106b0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d760cf0 0x55bd9d78b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f11106b0740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 0x55bd9d7a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f11106b0740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d78b5a0 0x55bd9d7a3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f11106b0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d67f780 con 0x55bd9d760cf0 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f11106b0740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d6c03d0 con 0x55bd9d762480 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f11106b0740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55bd9d75cbe0 con 0x55bd9d78b5a0 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f11106b0740 10 client.0 _ll_register_callbacks cb 0x55bd9d6bd5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1106a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d760cf0 0x55bd9d78b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1106a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d760cf0 0x55bd9d78b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52628/0 (socket says 172.21.15.99:52628) 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1106a00640 1 -- 172.21.15.99:0/716187747 learned_addr learned my addr 172.21.15.99:0/716187747 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1107400640 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d78b5a0 0x55bd9d7a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1106000640 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 0x55bd9d7a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1106a00640 1 -- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d78b5a0 msgr2=0x55bd9d7a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1106a00640 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d78b5a0 0x55bd9d7a3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1106a00640 1 -- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 msgr2=0x55bd9d7a2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1106a00640 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 0x55bd9d7a2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1106a00640 1 -- 172.21.15.99:0/716187747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd9d4a16b0 con 0x55bd9d760cf0 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.849+0000 7f1106000640 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 0x55bd9d7a2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.850+0000 7f1106a00640 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d760cf0 0x55bd9d78b060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10f800bb10 tx=0x7f10f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab66c10b20a6a91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.850+0000 7f10e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.850+0000 7f10e7e00640 1 -- 172.21.15.99:0/716187747 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8036040 con 0x55bd9d760cf0 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.850+0000 7f10e7e00640 1 -- 172.21.15.99:0/716187747 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f10f8052ae0 con 0x55bd9d760cf0 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.850+0000 7f11106b0740 1 -- 172.21.15.99:0/716187747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11000165c0 con 0x55bd9d760cf0 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.850+0000 7f10e7e00640 1 -- 172.21.15.99:0/716187747 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f10f8052ce0 con 0x55bd9d760cf0 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.850+0000 7f11106b0740 10 client.4536 fetch_fsmap learned FSMap version 8 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.850+0000 7f11106b0740 1 -- 172.21.15.99:0/716187747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55bd9d788cd0 con 0x55bd9d760cf0 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.850+0000 7f10e7e00640 1 -- 172.21.15.99:0/716187747 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11000165c0 con 0x55bd9d760cf0 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.851+0000 7f10e7e00640 1 -- 172.21.15.99:0/716187747 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f10f800e040 con 0x55bd9d760cf0 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.851+0000 7f11106b0740 10 client.4536 fetch_fsmap finished waiting for FSMap version 8 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.851+0000 7f11106b0740 10 client.4536 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T07:34:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.851+0000 7f11106b0740 20 client.4536 populate_metadata read hostname 'smithi099' 2024-09-10T07:34:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.851+0000 7f11106b0740 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:6833/4184584284,v1:172.21.15.187:6835/4184584284] conn(0x55bd9d7897e0 0x55bd9d7c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.851+0000 7f11106b0740 4 client.4536 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:34:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.851+0000 7f11106b0740 1 -- 172.21.15.99:0/716187747 --> [v2:172.21.15.187:6833/4184584284,v1:172.21.15.187:6835/4184584284] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd9d6d1b40 con 0x55bd9d7897e0 2024-09-10T07:34:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.851+0000 7f1106000640 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:6833/4184584284,v1:172.21.15.187:6835/4184584284] conn(0x55bd9d7897e0 0x55bd9d7c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.852+0000 7f1106000640 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:6833/4184584284,v1:172.21.15.187:6835/4184584284] conn(0x55bd9d7897e0 0x55bd9d7c3cf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a443c38e28aae6bb server_cookie=fb61702c8695065a in_seq=0 out_seq=0 2024-09-10T07:34:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.852+0000 7f10e7e00640 10 client.4536 ms_handle_connect on v2:172.21.15.187:6833/4184584284 2024-09-10T07:34:34.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f10e7e00640 1 -- 172.21.15.99:0/716187747 <== mds.0 v2:172.21.15.187:6833/4184584284 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd9d6d1b40 con 0x55bd9d7897e0 2024-09-10T07:34:34.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f10e7e00640 10 client.4536 handle_command_reply: tid=0 2024-09-10T07:34:34.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 client.4536 shutdown 2024-09-10T07:34:34.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 -- 172.21.15.99:0/716187747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d760cf0 msgr2=0x55bd9d78b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d760cf0 0x55bd9d78b060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10f800bb10 tx=0x7f10f8004730 comp rx=0 tx=0).stop 2024-09-10T07:34:34.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 -- 172.21.15.99:0/716187747 shutdown_connections 2024-09-10T07:34:34.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:6833/4184584284,v1:172.21.15.187:6835/4184584284] conn(0x55bd9d7897e0 0x55bd9d7c3cf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d78b5a0 0x55bd9d7a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 0x55bd9d7a2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 --2- 172.21.15.99:0/716187747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d760cf0 0x55bd9d78b060 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 -- 172.21.15.99:0/716187747 >> 172.21.15.99:0/716187747 conn(0x55bd9d75e4b0 msgr2=0x55bd9d7a39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:34.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f10e7e00640 0 client.4536 ms_handle_reset on v2:172.21.15.187:6833/4184584284 2024-09-10T07:34:34.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 -- 172.21.15.99:0/716187747 shutdown_connections 2024-09-10T07:34:34.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 1 -- 172.21.15.99:0/716187747 wait complete. 2024-09-10T07:34:34.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.853+0000 7f11106b0740 20 client.4536 trim_cache size 0 max 16384 2024-09-10T07:34:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.872+0000 7f11106b0740 1 Processor -- start 2024-09-10T07:34:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.872+0000 7f11106b0740 1 -- start start 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.872+0000 7f11106b0740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d760cf0 0x55bd9d7a9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.872+0000 7f11106b0740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 0x55bd9d7a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f11106b0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f11106b0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f110814b140 con 0x55bd9d78b5a0 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f11106b0740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f11081493a0 con 0x55bd9d762480 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f11106b0740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f110814aaf0 con 0x55bd9d760cf0 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1107400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1107400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52630/0 (socket says 172.21.15.99:52630) 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1107400640 1 -- 172.21.15.99:0/3223804079 learned_addr learned my addr 172.21.15.99:0/3223804079 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1107400640 1 -- 172.21.15.99:0/3223804079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d760cf0 msgr2=0x55bd9d7a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1107400640 1 --2- 172.21.15.99:0/3223804079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d760cf0 0x55bd9d7a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1107400640 1 -- 172.21.15.99:0/3223804079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 msgr2=0x55bd9d7a3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:34.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1106000640 1 --2- 172.21.15.99:0/3223804079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 0x55bd9d7a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1107400640 1 --2- 172.21.15.99:0/3223804079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 0x55bd9d7a3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1107400640 1 -- 172.21.15.99:0/3223804079 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd9d7ad3e0 con 0x55bd9d78b5a0 2024-09-10T07:34:34.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1106000640 1 --2- 172.21.15.99:0/3223804079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 0x55bd9d7a3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:34.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.873+0000 7f1107400640 1 --2- 172.21.15.99:0/3223804079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a29b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1100013000 tx=0x7f110000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e0dd5d84477fae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:34.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f10f2a00640 1 -- 172.21.15.99:0/3223804079 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100024070 con 0x55bd9d78b5a0 2024-09-10T07:34:34.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f10f2a00640 1 -- 172.21.15.99:0/3223804079 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1100016620 con 0x55bd9d78b5a0 2024-09-10T07:34:34.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f10f2a00640 1 -- 172.21.15.99:0/3223804079 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110001b040 con 0x55bd9d78b5a0 2024-09-10T07:34:34.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f11106b0740 1 -- 172.21.15.99:0/3223804079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 msgr2=0x55bd9d7a29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f11106b0740 1 --2- 172.21.15.99:0/3223804079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a29b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1100013000 tx=0x7f110000e000 comp rx=0 tx=0).stop 2024-09-10T07:34:34.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f11106b0740 1 -- 172.21.15.99:0/3223804079 shutdown_connections 2024-09-10T07:34:34.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f11106b0740 1 --2- 172.21.15.99:0/3223804079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a29b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f11106b0740 1 --2- 172.21.15.99:0/3223804079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d762480 0x55bd9d7a3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f11106b0740 1 --2- 172.21.15.99:0/3223804079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d760cf0 0x55bd9d7a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f11106b0740 1 -- 172.21.15.99:0/3223804079 >> 172.21.15.99:0/3223804079 conn(0x55bd9d75e4b0 msgr2=0x55bd9d7a7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:34.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f11106b0740 1 -- 172.21.15.99:0/3223804079 shutdown_connections 2024-09-10T07:34:34.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.874+0000 7f11106b0740 1 -- 172.21.15.99:0/3223804079 wait complete. 2024-09-10T07:34:34.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.875+0000 7f11106b0740 1 -- start start 2024-09-10T07:34:34.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.875+0000 7f11106b0740 1 Processor -- start 2024-09-10T07:34:34.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.876+0000 7f11106b0740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 0x55bd9d80dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.876+0000 7f11106b0740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d762480 0x55bd9d7a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.876+0000 7f11106b0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.876+0000 7f11106b0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d789660 con 0x55bd9d78b5a0 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.876+0000 7f11106b0740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d7ab1b0 con 0x55bd9d760cf0 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.876+0000 7f11106b0740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55bd9d789bf0 con 0x55bd9d762480 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.876+0000 7f11106b0740 10 client.0 _ll_register_callbacks cb 0x7f10f800b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.876+0000 7f1107400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1107400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52636/0 (socket says 172.21.15.99:52636) 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1107400640 1 -- 172.21.15.99:0/3210055998 learned_addr learned my addr 172.21.15.99:0/3210055998 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1106a00640 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 0x55bd9d80dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1106000640 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d762480 0x55bd9d7a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1107400640 1 -- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d762480 msgr2=0x55bd9d7a2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1107400640 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d762480 0x55bd9d7a2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1107400640 1 -- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 msgr2=0x55bd9d80dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1107400640 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 0x55bd9d80dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1107400640 1 -- 172.21.15.99:0/3210055998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd9d7a9dc0 con 0x55bd9d78b5a0 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1106a00640 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 0x55bd9d80dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f1107400640 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a2fa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f110000cdb0 tx=0x7f1100004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b1a2886d853a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f10e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f10e7e00640 1 -- 172.21.15.99:0/3210055998 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110002d060 con 0x55bd9d78b5a0 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f10e7e00640 1 -- 172.21.15.99:0/3210055998 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1100028430 con 0x55bd9d78b5a0 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.877+0000 7f11106b0740 1 -- 172.21.15.99:0/3210055998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1100016620 con 0x55bd9d78b5a0 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f10e7e00640 1 -- 172.21.15.99:0/3210055998 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f1100024050 con 0x55bd9d78b5a0 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f11106b0740 10 client.4542 fetch_fsmap learned FSMap version 8 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f11106b0740 1 -- 172.21.15.99:0/3210055998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55bd9d782d00 con 0x55bd9d78b5a0 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f10e7e00640 1 -- 172.21.15.99:0/3210055998 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1100016620 con 0x55bd9d78b5a0 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f10e7e00640 1 -- 172.21.15.99:0/3210055998 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f110001e070 con 0x55bd9d78b5a0 2024-09-10T07:34:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f11106b0740 10 client.4542 fetch_fsmap finished waiting for FSMap version 8 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f11106b0740 10 client.4542 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f11106b0740 20 client.4542 populate_metadata read hostname 'smithi099' 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f11106b0740 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:6833/4184584284,v1:172.21.15.187:6835/4184584284] conn(0x55bd9d783350 0x55bd9d783730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f11106b0740 4 client.4542 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f11106b0740 1 -- 172.21.15.99:0/3210055998 --> [v2:172.21.15.187:6833/4184584284,v1:172.21.15.187:6835/4184584284] -- command(tid 0: {"prefix": "status"}) -- 0x55bd9d6cbe90 con 0x55bd9d783350 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.878+0000 7f1106a00640 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:6833/4184584284,v1:172.21.15.187:6835/4184584284] conn(0x55bd9d783350 0x55bd9d783730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.879+0000 7f1106a00640 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:6833/4184584284,v1:172.21.15.187:6835/4184584284] conn(0x55bd9d783350 0x55bd9d783730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38e4abc475fff1f5 server_cookie=3ea97f4ad922f041 in_seq=0 out_seq=0 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.879+0000 7f10e7e00640 10 client.4542 ms_handle_connect on v2:172.21.15.187:6833/4184584284 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.879+0000 7f10e7e00640 1 -- 172.21.15.99:0/3210055998 <== mds.0 v2:172.21.15.187:6833/4184584284 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55bd9d6cbe90 con 0x55bd9d783350 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.879+0000 7f10e7e00640 10 client.4542 handle_command_reply: tid=0 2024-09-10T07:34:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.879+0000 7f11106b0740 1 client.4542 shutdown 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.879+0000 7f11106b0740 1 -- 172.21.15.99:0/3210055998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 msgr2=0x55bd9d7a2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.879+0000 7f11106b0740 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a2fa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f110000cdb0 tx=0x7f1100004a40 comp rx=0 tx=0).stop 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.880+0000 7f11106b0740 1 -- 172.21.15.99:0/3210055998 shutdown_connections 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.880+0000 7f11106b0740 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd9d78b5a0 0x55bd9d7a2fa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.880+0000 7f11106b0740 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:6833/4184584284,v1:172.21.15.187:6835/4184584284] conn(0x55bd9d783350 0x55bd9d783730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.880+0000 7f11106b0740 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55bd9d762480 0x55bd9d7a2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.880+0000 7f11106b0740 1 --2- 172.21.15.99:0/3210055998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bd9d760cf0 0x55bd9d80dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.880+0000 7f11106b0740 1 -- 172.21.15.99:0/3210055998 >> 172.21.15.99:0/3210055998 conn(0x55bd9d75e4b0 msgr2=0x55bd9d783ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.880+0000 7f10e7e00640 0 client.4542 ms_handle_reset on v2:172.21.15.187:6833/4184584284 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.880+0000 7f11106b0740 1 -- 172.21.15.99:0/3210055998 shutdown_connections 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.880+0000 7f11106b0740 1 -- 172.21.15.99:0/3210055998 wait complete. 2024-09-10T07:34:34.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.880+0000 7f11106b0740 20 client.4542 trim_cache size 0 max 16384 2024-09-10T07:34:34.887 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:34:34.887 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:34:34.887 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:34:34.887 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4284, 2024-09-10T07:34:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:34:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:34:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:34:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 15.009478865, 2024-09-10T07:34:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 8, 2024-09-10T07:34:34.888 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 20, 2024-09-10T07:34:34.889 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 20, 2024-09-10T07:34:34.889 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 21.030880540999998 2024-09-10T07:34:34.889 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:34:34.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 -- 172.21.15.99:0/853082920 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10e806be30 msgr2=0x7f10e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10e806be30 0x7f10e806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10f8037000 tx=0x7f10f8032000 comp rx=0 tx=0).stop 2024-09-10T07:34:34.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 -- 172.21.15.99:0/853082920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080cf890 msgr2=0x7f11081470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:34.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080cf890 0x7f11081470a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f10f400c460 tx=0x7f10f400c920 comp rx=0 tx=0).stop 2024-09-10T07:34:34.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 -- 172.21.15.99:0/853082920 shutdown_connections 2024-09-10T07:34:34.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110815bfb0 0x7f11080b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10e806be30 0x7f10e806e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11080cf890 0x7f11081470a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 --2- 172.21.15.99:0/853082920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11080ce070 0x7f1108146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:34.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 -- 172.21.15.99:0/853082920 >> 172.21.15.99:0/853082920 conn(0x7f11080b2630 msgr2=0x7f110815b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:34.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 -- 172.21.15.99:0/853082920 shutdown_connections 2024-09-10T07:34:34.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:34.881+0000 7f110d800640 1 -- 172.21.15.99:0/853082920 wait complete. 2024-09-10T07:34:34.896 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T07:34:34.909 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T07:34:34.909 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T07:34:34.910 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T07:34:34.910 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T07:34:34.950 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T07:34:34.950 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-10T07:34:34.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:34.950 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:34:34.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:34.987 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-09-10T07:34:35.087 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-09-10T07:34:35.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:34:35.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:35.090 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:34:35.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:35.126 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-09-10T07:34:35.223 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-09-10T07:34:35.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:34:35.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:35.226 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:34:35.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:35.267 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2024-09-10T07:34:35.370 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2024-09-10T07:34:35.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:34:35.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:35.374 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:34:35.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:35.410 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2024-09-10T07:34:35.509 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2024-09-10T07:34:35.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:34:35.511 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-10T07:34:35.512 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T07:34:35.512 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:34:35.512 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:34:35.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.664+0000 7f8081a00640 1 Processor -- start 2024-09-10T07:34:35.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.665+0000 7f8081a00640 1 -- start start 2024-09-10T07:34:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.666+0000 7f8081a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 0x7f807c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.666+0000 7f8081a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f807c160c50 0x7f807c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.666+0000 7f8081a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f807c142650 con 0x7f807c142150 2024-09-10T07:34:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.666+0000 7f8081a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f807c0ce780 con 0x7f807c160c50 2024-09-10T07:34:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.666+0000 7f8081a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f807c142930 con 0x7f807c13fae0 2024-09-10T07:34:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.666+0000 7f807aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 0x7f807c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.666+0000 7f807b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f807c160c50 0x7f807c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.666+0000 7f807aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 0x7f807c06f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:34162/0 (socket says 172.21.15.99:34162) 2024-09-10T07:34:35.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.666+0000 7f807b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f807c160c50 0x7f807c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53998/0 (socket says 172.21.15.99:53998) 2024-09-10T07:34:35.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.666+0000 7f807aa00640 1 -- 172.21.15.99:0/484908751 learned_addr learned my addr 172.21.15.99:0/484908751 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.667+0000 7f807aa00640 1 -- 172.21.15.99:0/484908751 >> v2:172.21.15.187:3300/0 conn(0x7f807c160c50 msgr2=0x7f807c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.667+0000 7f807aa00640 1 --2- 172.21.15.99:0/484908751 >> v2:172.21.15.187:3300/0 conn(0x7f807c160c50 0x7f807c0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.667+0000 7f807aa00640 1 -- 172.21.15.99:0/484908751 >> v1:172.21.15.187:6789/0 conn(0x7f807c142150 legacy=0x7f807c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.667+0000 7f807aa00640 1 -- 172.21.15.99:0/484908751 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807c142c10 con 0x7f807c13fae0 2024-09-10T07:34:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.667+0000 7f807aa00640 1 --2- 172.21.15.99:0/484908751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 0x7f807c06f1b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f806c009e50 tx=0x7f806c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56a383b4b7d7afa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f807a000640 1 -- 172.21.15.99:0/484908751 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c036070 con 0x7f807c13fae0 2024-09-10T07:34:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f807a000640 1 -- 172.21.15.99:0/484908751 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806c031600 con 0x7f807c13fae0 2024-09-10T07:34:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f807a000640 1 -- 172.21.15.99:0/484908751 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c0319d0 con 0x7f807c13fae0 2024-09-10T07:34:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f8081a00640 1 -- 172.21.15.99:0/484908751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 msgr2=0x7f807c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f8081a00640 1 --2- 172.21.15.99:0/484908751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 0x7f807c06f1b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f806c009e50 tx=0x7f806c02a680 comp rx=0 tx=0).stop 2024-09-10T07:34:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f8081a00640 1 -- 172.21.15.99:0/484908751 shutdown_connections 2024-09-10T07:34:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f8081a00640 1 --2- 172.21.15.99:0/484908751 >> v2:172.21.15.187:3300/0 conn(0x7f807c160c50 0x7f807c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f8081a00640 1 --2- 172.21.15.99:0/484908751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 0x7f807c06f1b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f8081a00640 1 -- 172.21.15.99:0/484908751 >> 172.21.15.99:0/484908751 conn(0x7f807c06bc10 msgr2=0x7f807c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f8081a00640 1 -- 172.21.15.99:0/484908751 shutdown_connections 2024-09-10T07:34:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.668+0000 7f8081a00640 1 -- 172.21.15.99:0/484908751 wait complete. 2024-09-10T07:34:35.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.670+0000 7f8081a00640 1 Processor -- start 2024-09-10T07:34:35.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.670+0000 7f8081a00640 1 -- start start 2024-09-10T07:34:35.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f8081a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 0x7f807c1460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:35.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f8081a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f807c142150 0x7f807c1f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:35.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f8081a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c160c50 0x7f807c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:35.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f8081a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f807c06f870 con 0x7f807c142150 2024-09-10T07:34:35.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f8081a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f807c06f6f0 con 0x7f807c160c50 2024-09-10T07:34:35.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f8081a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f807c0cf150 con 0x7f807c13fae0 2024-09-10T07:34:35.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f8072000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f807c142150 0x7f807c1f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:35.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f8072000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f807c142150 0x7f807c1f5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52640/0 (socket says 172.21.15.99:52640) 2024-09-10T07:34:35.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f8072000640 1 -- 172.21.15.99:0/1027555720 learned_addr learned my addr 172.21.15.99:0/1027555720 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:35.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f807aa00640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 0x7f807c1460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.671+0000 7f807b400640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c160c50 0x7f807c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8072000640 1 -- 172.21.15.99:0/1027555720 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 msgr2=0x7f807c1460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8072000640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 0x7f807c1460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8072000640 1 -- 172.21.15.99:0/1027555720 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c160c50 msgr2=0x7f807c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8072000640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c160c50 0x7f807c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8072000640 1 -- 172.21.15.99:0/1027555720 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807c1f6510 con 0x7f807c142150 2024-09-10T07:34:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f807b400640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c160c50 0x7f807c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8072000640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f807c142150 0x7f807c1f5b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f806400c3d0 tx=0x7f806400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8073400640 1 -- 172.21.15.99:0/1027555720 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80640052d0 con 0x7f807c142150 2024-09-10T07:34:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8073400640 1 -- 172.21.15.99:0/1027555720 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8064005490 con 0x7f807c142150 2024-09-10T07:34:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8081a00640 1 -- 172.21.15.99:0/1027555720 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807c1f67b0 con 0x7f807c142150 2024-09-10T07:34:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8073400640 1 -- 172.21.15.99:0/1027555720 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8064007260 con 0x7f807c142150 2024-09-10T07:34:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.672+0000 7f8081a00640 1 -- 172.21.15.99:0/1027555720 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807c1f7050 con 0x7f807c142150 2024-09-10T07:34:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.673+0000 7f8081a00640 1 -- 172.21.15.99:0/1027555720 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807c1f7250 con 0x7f807c142150 2024-09-10T07:34:35.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.674+0000 7f8073400640 1 -- 172.21.15.99:0/1027555720 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8064007400 con 0x7f807c142150 2024-09-10T07:34:35.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.675+0000 7f8073400640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f805806be30 0x7f805806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:35.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.675+0000 7f8073400640 1 -- 172.21.15.99:0/1027555720 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f806408a340 con 0x7f807c142150 2024-09-10T07:34:35.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.675+0000 7f807aa00640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f805806be30 0x7f805806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:35.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.676+0000 7f807aa00640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f805806be30 0x7f805806e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f806c033000 tx=0x7f806c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:35.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.679+0000 7f8073400640 1 -- 172.21.15.99:0/1027555720 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f807c1f7250 con 0x7f807c142150 2024-09-10T07:34:35.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.887+0000 7f8081a00640 1 -- 172.21.15.99:0/1027555720 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f807c06f1b0 con 0x7f807c142150 2024-09-10T07:34:35.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.888+0000 7f8073400640 1 -- 172.21.15.99:0/1027555720 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f8064058600 con 0x7f807c142150 2024-09-10T07:34:35.888 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:34:35.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 -- 172.21.15.99:0/1027555720 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f805806be30 msgr2=0x7f805806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:35.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f805806be30 0x7f805806e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f806c033000 tx=0x7f806c009000 comp rx=0 tx=0).stop 2024-09-10T07:34:35.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 -- 172.21.15.99:0/1027555720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f807c142150 msgr2=0x7f807c1f5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:35.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f807c142150 0x7f807c1f5b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f806400c3d0 tx=0x7f806400c890 comp rx=0 tx=0).stop 2024-09-10T07:34:35.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 -- 172.21.15.99:0/1027555720 shutdown_connections 2024-09-10T07:34:35.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c160c50 0x7f807c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:35.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f805806be30 0x7f805806e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:35.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f807c142150 0x7f807c1f5b10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:35.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 --2- 172.21.15.99:0/1027555720 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c13fae0 0x7f807c1460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:35.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 -- 172.21.15.99:0/1027555720 >> 172.21.15.99:0/1027555720 conn(0x7f807c06bc10 msgr2=0x7f807c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:35.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 -- 172.21.15.99:0/1027555720 shutdown_connections 2024-09-10T07:34:35.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:35.890+0000 7f8081a00640 1 -- 172.21.15.99:0/1027555720 wait complete. 2024-09-10T07:34:35.906 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T07:34:35.907 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:34:35.907 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:34:35.907 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:34:35.907 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:34:35.907 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T07:34:35.907 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T07:34:35.907 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:34:35.907 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:34:35.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:35.907 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:34:35.943 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:34:35.944 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:35.945 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:35.945 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:34:35.945 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:35.945 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:34:35.945 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42752sec preferred_lft 42752sec 2024-09-10T07:34:35.945 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:34:35.945 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:35.945 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T07:34:35.946 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:35.946 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:34:35.946 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2024-09-10T07:34:35.946 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2024-09-10T07:34:35.946 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2024-09-10T07:34:35.946 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T07:34:35.946 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:34:36.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:36.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:36.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:36.348 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:34:36.404 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:34:36.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:36.408 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:34:36.471 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:34:36.471 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:34:36.471 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:34:36.471 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:34:36.471 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:34:36.472 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:36.472 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:34:36.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:34:36.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:34:36.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:34:36.472 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:34:36.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:37.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:37.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:37.054 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:34:37.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:37.090 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-09-10T07:34:37.166 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:37.167 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:34:37.167 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:34:37.167 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T07:34:37.167 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:34:37.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:37.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:37.344 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T07:34:37.345 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:37.345 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:34:37.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T07:34:37.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T07:34:37.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T07:34:37.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T07:34:37.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T07:34:37.345 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:34:37.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:37.622 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:37.622 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:34:37.622 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:34:37.622 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T07:34:37.622 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:34:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:37.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:37.788 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:34:37.788 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:34:37.823 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:34:37.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:34:37.823 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:34:37.899 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:34:37.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:37.900 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:38.061 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:38.061 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:34:38.652 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:38.652 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:34:38.652 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:34:38.652 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:34:38.652 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:34:38.653 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:34:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:34:38.653 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:34:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:34:38.654 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:34:38.656 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:34:38.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:38.657 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:34:38.715 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:38.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:38.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:38.816 INFO:teuthology.orchestra.run.smithi099.stdout:client4548 2024-09-10T07:34:38.816 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:38.817 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:38.853 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:38.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:38.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:38.981 INFO:teuthology.orchestra.run.smithi099.stdout:client4548 2024-09-10T07:34:38.982 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:39.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:39.069 INFO:teuthology.orchestra.run.smithi099.stdout:client4548 2024-09-10T07:34:39.070 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client4548/status') 2024-09-10T07:34:39.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:39.170 INFO:teuthology.orchestra.run.smithi099.stdout:instance: client.4548 (3)192.168.0.1:0/812244265 2024-09-10T07:34:39.170 INFO:teuthology.orchestra.run.smithi099.stdout:blocklisted: false 2024-09-10T07:34:39.170 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records in 2024-09-10T07:34:39.170 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records out 2024-09-10T07:34:39.170 INFO:teuthology.orchestra.run.smithi099.stderr:68 bytes copied, 7.3573e-05 s, 924 kB/s 2024-09-10T07:34:39.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:39.181 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-10T07:34:39.182 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T07:34:39.182 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T07:34:39.182 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:34:39.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.335+0000 7f92e5c00640 1 Processor -- start 2024-09-10T07:34:39.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.335+0000 7f92e5c00640 1 -- start start 2024-09-10T07:34:39.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.336+0000 7f92e5c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f92e0072f40 0x7f92e006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:39.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.336+0000 7f92e5c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e006e3d0 con 0x7f92e00ce780 2024-09-10T07:34:39.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.336+0000 7f92e5c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e006e6b0 con 0x7f92e0145290 2024-09-10T07:34:39.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.336+0000 7f92e5c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f92e006efe0 con 0x7f92e0072f40 2024-09-10T07:34:39.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.337+0000 7f92df400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f92e00ce780 0x7f92e00b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38402/0 (socket says 172.21.15.99:38402) 2024-09-10T07:34:39.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.337+0000 7f92df400640 1 -- 172.21.15.99:0/2543461610 learned_addr learned my addr 172.21.15.99:0/2543461610 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:39.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.337+0000 7f92de000640 1 --2- 172.21.15.99:0/2543461610 >> v2:172.21.15.187:3300/0 conn(0x7f92e0072f40 0x7f92e006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:39.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.337+0000 7f92dd600640 1 -- 172.21.15.99:0/2543461610 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448028689 0 0) 0x7f92e006e3d0 con 0x7f92e00ce780 2024-09-10T07:34:39.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.337+0000 7f92dd600640 1 -- 172.21.15.99:0/2543461610 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c4003520 con 0x7f92e00ce780 2024-09-10T07:34:39.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.337+0000 7f92dd600640 1 -- 172.21.15.99:0/2543461610 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2608537124 0 0) 0x7f92e006e6b0 con 0x7f92e0145290 2024-09-10T07:34:39.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.337+0000 7f92dd600640 1 -- 172.21.15.99:0/2543461610 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92e006e3d0 con 0x7f92e0145290 2024-09-10T07:34:39.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.337+0000 7f92de000640 1 -- 172.21.15.99:0/2543461610 >> v1:172.21.15.187:6789/0 conn(0x7f92e0145290 legacy=0x7f92e0072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:39.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.337+0000 7f92de000640 1 -- 172.21.15.99:0/2543461610 >> v1:172.21.15.99:6789/0 conn(0x7f92e00ce780 legacy=0x7f92e00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:39.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.337+0000 7f92de000640 1 -- 172.21.15.99:0/2543461610 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e006e990 con 0x7f92e0072f40 2024-09-10T07:34:39.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.338+0000 7f92de000640 1 --2- 172.21.15.99:0/2543461610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92e0072f40 0x7f92e006f470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0097a0 tx=0x7f92cc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=108edfaae5c17b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:39.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.339+0000 7f92dd600640 1 -- 172.21.15.99:0/2543461610 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc037070 con 0x7f92e0072f40 2024-09-10T07:34:39.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.339+0000 7f92dd600640 1 -- 172.21.15.99:0/2543461610 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc032440 con 0x7f92e0072f40 2024-09-10T07:34:39.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.339+0000 7f92dd600640 1 -- 172.21.15.99:0/2543461610 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0327f0 con 0x7f92e0072f40 2024-09-10T07:34:39.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.339+0000 7f92e5c00640 1 -- 172.21.15.99:0/2543461610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92e0072f40 msgr2=0x7f92e006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:39.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.339+0000 7f92e5c00640 1 --2- 172.21.15.99:0/2543461610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92e0072f40 0x7f92e006f470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0097a0 tx=0x7f92cc02a230 comp rx=0 tx=0).stop 2024-09-10T07:34:39.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.339+0000 7f92e5c00640 1 -- 172.21.15.99:0/2543461610 shutdown_connections 2024-09-10T07:34:39.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.339+0000 7f92e5c00640 1 --2- 172.21.15.99:0/2543461610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92e0072f40 0x7f92e006f470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:39.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.339+0000 7f92e5c00640 1 -- 172.21.15.99:0/2543461610 >> 172.21.15.99:0/2543461610 conn(0x7f92e006bc10 msgr2=0x7f92e006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:39.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.339+0000 7f92e5c00640 1 -- 172.21.15.99:0/2543461610 shutdown_connections 2024-09-10T07:34:39.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.339+0000 7f92e5c00640 1 -- 172.21.15.99:0/2543461610 wait complete. 2024-09-10T07:34:39.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.341+0000 7f92e5c00640 1 Processor -- start 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.341+0000 7f92e5c00640 1 -- start start 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.342+0000 7f92e5c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92e0072f40 0x7f92e015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.342+0000 7f92e5c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92e00ce780 0x7f92e0141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.342+0000 7f92e5c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e0145290 0x7f92e0142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.342+0000 7f92e5c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f92e006df80 con 0x7f92e0145290 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.342+0000 7f92e5c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0145670 con 0x7f92e0072f40 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.342+0000 7f92e5c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f92e006e100 con 0x7f92e00ce780 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.342+0000 7f92df400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e0145290 0x7f92e0142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.342+0000 7f92df400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e0145290 0x7f92e0142400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52656/0 (socket says 172.21.15.99:52656) 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.342+0000 7f92df400640 1 -- 172.21.15.99:0/2485916645 learned_addr learned my addr 172.21.15.99:0/2485916645 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92de000640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92e00ce780 0x7f92e0141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92df400640 1 -- 172.21.15.99:0/2485916645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92e00ce780 msgr2=0x7f92e0141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92df400640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92e00ce780 0x7f92e0141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92dea00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92e0072f40 0x7f92e015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92df400640 1 -- 172.21.15.99:0/2485916645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92e0072f40 msgr2=0x7f92e015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92df400640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92e0072f40 0x7f92e015d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92df400640 1 -- 172.21.15.99:0/2485916645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e0142ad0 con 0x7f92e0145290 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92de000640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92e00ce780 0x7f92e0141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92dea00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92e0072f40 0x7f92e015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92df400640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e0145290 0x7f92e0142400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f92d800cbc0 tx=0x7f92d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92d6a00640 1 -- 172.21.15.99:0/2485916645 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8017070 con 0x7f92e0145290 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92d6a00640 1 -- 172.21.15.99:0/2485916645 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d800ace0 con 0x7f92e0145290 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92d6a00640 1 -- 172.21.15.99:0/2485916645 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8012600 con 0x7f92e0145290 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.343+0000 7f92e5c00640 1 -- 172.21.15.99:0/2485916645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e0142db0 con 0x7f92e0145290 2024-09-10T07:34:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.344+0000 7f92e5c00640 1 -- 172.21.15.99:0/2485916645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e0143370 con 0x7f92e0145290 2024-09-10T07:34:39.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.345+0000 7f92e5c00640 1 -- 172.21.15.99:0/2485916645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e00729d0 con 0x7f92e0145290 2024-09-10T07:34:39.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.346+0000 7f92d6a00640 1 -- 172.21.15.99:0/2485916645 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92d801a070 con 0x7f92e0145290 2024-09-10T07:34:39.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.347+0000 7f92d6a00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f92c006be30 0x7f92c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:39.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.347+0000 7f92d6a00640 1 -- 172.21.15.99:0/2485916645 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f92d808abe0 con 0x7f92e0145290 2024-09-10T07:34:39.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.347+0000 7f92dea00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f92c006be30 0x7f92c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:39.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.348+0000 7f92dea00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f92c006be30 0x7f92c006e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f92e0072c80 tx=0x7f92d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:39.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.352+0000 7f92d6a00640 1 -- 172.21.15.99:0/2485916645 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92d8058f30 con 0x7f92e0145290 2024-09-10T07:34:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.558+0000 7f92e5c00640 1 -- 172.21.15.99:0/2485916645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f92e0075620 con 0x7f92e0145290 2024-09-10T07:34:39.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.559+0000 7f92d6a00640 1 -- 172.21.15.99:0/2485916645 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f92d805d230 con 0x7f92e0145290 2024-09-10T07:34:39.559 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:34:39.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 -- 172.21.15.99:0/2485916645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f92c006be30 msgr2=0x7f92c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:39.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f92c006be30 0x7f92c006e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f92e0072c80 tx=0x7f92d0009040 comp rx=0 tx=0).stop 2024-09-10T07:34:39.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 -- 172.21.15.99:0/2485916645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e0145290 msgr2=0x7f92e0142400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:39.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e0145290 0x7f92e0142400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f92d800cbc0 tx=0x7f92d800a430 comp rx=0 tx=0).stop 2024-09-10T07:34:39.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 -- 172.21.15.99:0/2485916645 shutdown_connections 2024-09-10T07:34:39.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f92c006be30 0x7f92c006e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:39.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92e0145290 0x7f92e0142400 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:39.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92e00ce780 0x7f92e0141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:39.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 --2- 172.21.15.99:0/2485916645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92e0072f40 0x7f92e015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:39.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 -- 172.21.15.99:0/2485916645 >> 172.21.15.99:0/2485916645 conn(0x7f92e006bc10 msgr2=0x7f92e013ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:39.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 -- 172.21.15.99:0/2485916645 shutdown_connections 2024-09-10T07:34:39.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39.561+0000 7f92e5c00640 1 -- 172.21.15.99:0/2485916645 wait complete. 2024-09-10T07:34:39.577 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T07:34:39.577 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:34:39.577 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:34:39.577 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-10T07:34:39.577 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T07:34:39.577 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T07:34:39.577 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T07:34:39.577 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:34:39.577 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-10T07:34:39.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:39.578 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:39.614 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42748sec preferred_lft 42748sec 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:39.615 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:34:39.616 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:39.616 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:34:39.616 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:34:39.616 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link tentative 2024-09-10T07:34:39.616 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:39.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:39.616 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:34:39.707 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:34:39.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:39.710 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:34:39.746 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:34:39.746 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:34:39.746 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:34:39.747 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:34:39.747 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:34:39.747 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:39.747 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:34:39.747 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:34:39.747 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:34:39.747 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:34:39.747 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:34:39.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:39.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:39.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:39.943 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:34:39.978 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:34:39.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:39.979 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-09-10T07:34:40.053 INFO:teuthology.orchestra.run.smithi099.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-10T07:34:40.054 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:40.055 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:34:40.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:34:40.055 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-10T07:34:40.055 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:34:40.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:40.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:40.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:40.230 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T07:34:40.286 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:34:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:34:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:34:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:34:40.286 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:40.286 INFO:teuthology.orchestra.run.smithi099.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:34:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 72:68:9a:59:4c:6c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T07:34:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T07:34:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::7068:9aff:fe59:4c6c/64 scope link 2024-09-10T07:34:40.287 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:40.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:40.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T07:34:40.345 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:34:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:34:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:34:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:34:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:40.346 INFO:teuthology.orchestra.run.smithi099.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:34:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 72:68:9a:59:4c:6c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T07:34:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T07:34:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::7068:9aff:fe59:4c6c/64 scope link 2024-09-10T07:34:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:40.348 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-10T07:34:40.348 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:40.348 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:34:40.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-10T07:34:40.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T07:34:40.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-10T07:34:40.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-10T07:34:40.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-10T07:34:40.349 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:34:40.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:40.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:40.564 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:40.564 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:34:40.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.1 up 2024-09-10T07:34:40.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T07:34:40.564 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:34:40.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:40.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:40.730 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:34:40.730 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-10T07:34:40.765 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-10T07:34:40.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:34:40.766 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-10T07:34:40.840 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-10T07:34:40.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:40.841 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:40.969 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:40.969 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:34:40.996 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:40.996 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:34:40.996 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:34:40.996 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 2@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:34:40.997 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:34:40.998 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-10T07:34:40.998 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:34:40.998 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:34:40.998 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:34:40.998 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:34:41.001 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:34:41.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:41.001 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-10T07:34:41.057 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:41.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:41.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:41.146 INFO:teuthology.orchestra.run.smithi099.stdout:client4570 2024-09-10T07:34:41.146 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:41.146 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:41.182 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:41.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:41.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:41.311 INFO:teuthology.orchestra.run.smithi099.stdout:client4570 2024-09-10T07:34:41.312 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:41.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:41.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:41.401 INFO:teuthology.orchestra.run.smithi099.stdout:client4570 2024-09-10T07:34:41.401 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client4570/status') 2024-09-10T07:34:41.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:41.499 INFO:teuthology.orchestra.run.smithi099.stdout:instance: client.4570 (3)172.21.15.99:0/2649549298 2024-09-10T07:34:41.499 INFO:teuthology.orchestra.run.smithi099.stdout:blocklisted: false 2024-09-10T07:34:41.500 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records in 2024-09-10T07:34:41.500 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records out 2024-09-10T07:34:41.500 INFO:teuthology.orchestra.run.smithi099.stderr:70 bytes copied, 5.9867e-05 s, 1.2 MB/s 2024-09-10T07:34:41.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:41.510 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-10T07:34:41.510 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T07:34:41.511 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:34:41.511 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:34:41.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.663+0000 7f7b03000640 1 Processor -- start 2024-09-10T07:34:41.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.663+0000 7f7b03000640 1 -- start start 2024-09-10T07:34:41.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7b03000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7afc072f40 0x7f7afc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:41.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7b03000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7afc0ce780 0x7f7afc0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:41.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7b03000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7afc06e3d0 con 0x7f7afc145290 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7b03000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7afc06efe0 con 0x7f7afc072f40 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7b03000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7afc06e6b0 con 0x7f7afc0ce780 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7af3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7afc072f40 0x7f7afc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7af3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7afc072f40 0x7f7afc06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55812/0 (socket says 172.21.15.99:55812) 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7af3400640 1 -- 172.21.15.99:0/2236179692 learned_addr learned my addr 172.21.15.99:0/2236179692 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7afbe00640 1 --1- 172.21.15.99:0/2236179692 >> v1:172.21.15.99:6789/0 conn(0x7f7afc145290 0x7f7afc072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58958/0 (socket says 172.21.15.99:58958) 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7b01000640 1 --2- 172.21.15.99:0/2236179692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7afc0ce780 0x7f7afc0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7af3400640 1 -- 172.21.15.99:0/2236179692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7afc0ce780 msgr2=0x7f7afc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7af3400640 1 --2- 172.21.15.99:0/2236179692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7afc0ce780 0x7f7afc0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7af3400640 1 -- 172.21.15.99:0/2236179692 >> v1:172.21.15.99:6789/0 conn(0x7f7afc145290 legacy=0x7f7afc072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:41.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.665+0000 7f7af3400640 1 -- 172.21.15.99:0/2236179692 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc06e990 con 0x7f7afc072f40 2024-09-10T07:34:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.666+0000 7f7af3400640 1 --2- 172.21.15.99:0/2236179692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc072f40 0x7f7afc06f470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7afc06f160 tx=0x7f7ae402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d0adc86d407e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7afb400640 1 -- 172.21.15.99:0/2236179692 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4037070 con 0x7f7afc072f40 2024-09-10T07:34:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7afb400640 1 -- 172.21.15.99:0/2236179692 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae4032440 con 0x7f7afc072f40 2024-09-10T07:34:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7afb400640 1 -- 172.21.15.99:0/2236179692 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4032810 con 0x7f7afc072f40 2024-09-10T07:34:41.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7b03000640 1 -- 172.21.15.99:0/2236179692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc072f40 msgr2=0x7f7afc06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7b03000640 1 --2- 172.21.15.99:0/2236179692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc072f40 0x7f7afc06f470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7afc06f160 tx=0x7f7ae402a250 comp rx=0 tx=0).stop 2024-09-10T07:34:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7b03000640 1 -- 172.21.15.99:0/2236179692 shutdown_connections 2024-09-10T07:34:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7b03000640 1 --2- 172.21.15.99:0/2236179692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7afc0ce780 0x7f7afc0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7b03000640 1 --2- 172.21.15.99:0/2236179692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc072f40 0x7f7afc06f470 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7b03000640 1 -- 172.21.15.99:0/2236179692 >> 172.21.15.99:0/2236179692 conn(0x7f7afc06bc10 msgr2=0x7f7afc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7b03000640 1 -- 172.21.15.99:0/2236179692 shutdown_connections 2024-09-10T07:34:41.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.667+0000 7f7b03000640 1 -- 172.21.15.99:0/2236179692 wait complete. 2024-09-10T07:34:41.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.669+0000 7f7b03000640 1 Processor -- start 2024-09-10T07:34:41.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.669+0000 7f7b03000640 1 -- start start 2024-09-10T07:34:41.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7b03000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7afc072f40 0x7f7afc15b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7b03000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc0ce780 0x7f7afc0b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7b03000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7afc145290 0x7f7afc0b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7b03000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc06df80 con 0x7f7afc0ce780 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7b03000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc145670 con 0x7f7afc072f40 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7b03000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7afc06e100 con 0x7f7afc145290 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7af3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc0ce780 0x7f7afc0b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7af3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc0ce780 0x7f7afc0b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55820/0 (socket says 172.21.15.99:55820) 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7af3400640 1 -- 172.21.15.99:0/1873737220 learned_addr learned my addr 172.21.15.99:0/1873737220 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7b01000640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7afc145290 0x7f7afc0b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.670+0000 7f7afbe00640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7afc072f40 0x7f7afc15b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7af3400640 1 -- 172.21.15.99:0/1873737220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7afc145290 msgr2=0x7f7afc0b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7af3400640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7afc145290 0x7f7afc0b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7af3400640 1 -- 172.21.15.99:0/1873737220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7afc072f40 msgr2=0x7f7afc15b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7af3400640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7afc072f40 0x7f7afc15b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7af3400640 1 -- 172.21.15.99:0/1873737220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc141fd0 con 0x7f7afc0ce780 2024-09-10T07:34:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7af3400640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc0ce780 0x7f7afc0b3c10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ae402a290 tx=0x7f7ae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7af8c00640 1 -- 172.21.15.99:0/1873737220 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4041020 con 0x7f7afc0ce780 2024-09-10T07:34:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7af8c00640 1 -- 172.21.15.99:0/1873737220 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae40306c0 con 0x7f7afc0ce780 2024-09-10T07:34:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7af8c00640 1 -- 172.21.15.99:0/1873737220 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4037040 con 0x7f7afc0ce780 2024-09-10T07:34:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7b03000640 1 -- 172.21.15.99:0/1873737220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc13ffc0 con 0x7f7afc0ce780 2024-09-10T07:34:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.671+0000 7f7b03000640 1 -- 172.21.15.99:0/1873737220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc140580 con 0x7f7afc0ce780 2024-09-10T07:34:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.672+0000 7f7b03000640 1 -- 172.21.15.99:0/1873737220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc1421a0 con 0x7f7afc0ce780 2024-09-10T07:34:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.673+0000 7f7af8c00640 1 -- 172.21.15.99:0/1873737220 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ae4044020 con 0x7f7afc0ce780 2024-09-10T07:34:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.674+0000 7f7af8c00640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ad806be60 0x7f7ad806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.674+0000 7f7af8c00640 1 -- 172.21.15.99:0/1873737220 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7ae40ab640 con 0x7f7afc0ce780 2024-09-10T07:34:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.674+0000 7f7afbe00640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ad806be60 0x7f7ad806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.675+0000 7f7afbe00640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ad806be60 0x7f7ad806e320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7aec000f60 tx=0x7f7aec0011d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:41.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.678+0000 7f7af8c00640 1 -- 172.21.15.99:0/1873737220 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ae404b030 con 0x7f7afc0ce780 2024-09-10T07:34:41.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.889+0000 7f7b03000640 1 -- 172.21.15.99:0/1873737220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7afc071510 con 0x7f7afc0ce780 2024-09-10T07:34:41.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.890+0000 7f7af8c00640 1 -- 172.21.15.99:0/1873737220 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f7ae4079880 con 0x7f7afc0ce780 2024-09-10T07:34:41.890 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:34:41.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.892+0000 7f7b03000640 1 -- 172.21.15.99:0/1873737220 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ad806be60 msgr2=0x7f7ad806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.892+0000 7f7b03000640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ad806be60 0x7f7ad806e320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7aec000f60 tx=0x7f7aec0011d0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.892+0000 7f7b03000640 1 -- 172.21.15.99:0/1873737220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc0ce780 msgr2=0x7f7afc0b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.892+0000 7f7b03000640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc0ce780 0x7f7afc0b3c10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ae402a290 tx=0x7f7ae40046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.892+0000 7f7b03000640 1 -- 172.21.15.99:0/1873737220 shutdown_connections 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.892+0000 7f7b03000640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7afc145290 0x7f7afc0b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.892+0000 7f7b03000640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ad806be60 0x7f7ad806e320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.892+0000 7f7b03000640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7afc0ce780 0x7f7afc0b3c10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.892+0000 7f7b03000640 1 --2- 172.21.15.99:0/1873737220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7afc072f40 0x7f7afc15b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.892+0000 7f7b03000640 1 -- 172.21.15.99:0/1873737220 >> 172.21.15.99:0/1873737220 conn(0x7f7afc06bc10 msgr2=0x7f7afc15f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.893+0000 7f7b03000640 1 -- 172.21.15.99:0/1873737220 shutdown_connections 2024-09-10T07:34:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:41.893+0000 7f7b03000640 1 -- 172.21.15.99:0/1873737220 wait complete. 2024-09-10T07:34:41.908 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T07:34:41.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:34:41.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:34:41.908 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:34:41.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:34:41.908 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T07:34:41.908 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T07:34:41.908 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:34:41.908 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:34:41.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:41.909 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:34:41.949 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:34:41.949 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:34:41.949 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:34:41.949 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:41.949 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:34:41.950 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42742sec preferred_lft 42742sec 2024-09-10T07:34:41.951 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:34:41.951 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:41.951 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T07:34:41.951 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:41.951 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:34:41.951 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add name ceph-brx type bridge 2024-09-10T07:34:41.951 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr flush dev ceph-brx 2024-09-10T07:34:41.951 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set ceph-brx up 2024-09-10T07:34:41.951 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T07:34:41.951 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:34:42.072 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:42.364 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:42.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:42.374 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:34:42.431 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:34:42.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:42.434 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:34:42.483 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:34:42.483 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:34:42.483 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:34:42.483 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:34:42.483 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:34:42.483 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:42.484 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:34:42.484 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:34:42.484 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:34:42.484 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:34:42.484 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:34:42.561 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:43.049 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:43.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:43.057 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:34:43.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:43.092 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2024-09-10T07:34:43.168 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:43.168 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:34:43.168 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:34:43.168 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T07:34:43.168 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:34:43.286 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:43.338 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:43.346 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T07:34:43.347 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:43.347 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:34:43.347 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T07:34:43.347 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T07:34:43.347 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T07:34:43.347 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T07:34:43.347 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T07:34:43.347 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:34:43.425 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:43.572 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:43.580 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:43.581 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:34:43.581 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:34:43.581 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T07:34:43.581 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:34:43.658 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:43.739 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:43.747 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:34:43.747 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:34:43.782 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:34:43.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:34:43.783 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:34:43.857 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:34:43.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:43.857 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:43.998 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:43.998 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:34:44.629 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:44.629 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:34:44.630 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:34:44.630 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:34:44.630 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:34:44.631 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:34:44.631 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:34:44.631 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:34:44.631 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:34:44.631 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:34:44.634 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:34:44.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:44.635 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:34:44.690 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:44.770 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:44.773 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:44.782 INFO:teuthology.orchestra.run.smithi187.stdout:client4566 2024-09-10T07:34:44.782 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:44.782 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:44.818 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:44.934 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:44.937 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:44.945 INFO:teuthology.orchestra.run.smithi187.stdout:client4566 2024-09-10T07:34:44.946 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:45.023 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:45.026 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:45.034 INFO:teuthology.orchestra.run.smithi187.stdout:client4566 2024-09-10T07:34:45.034 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client4566/status') 2024-09-10T07:34:45.111 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:45.132 INFO:teuthology.orchestra.run.smithi187.stdout:instance: client.4566 (3)172.21.15.187:0/1260932419 2024-09-10T07:34:45.133 INFO:teuthology.orchestra.run.smithi187.stdout:blocklisted: false 2024-09-10T07:34:45.133 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records in 2024-09-10T07:34:45.133 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records out 2024-09-10T07:34:45.133 INFO:teuthology.orchestra.run.smithi187.stderr:71 bytes copied, 5.61e-05 s, 1.3 MB/s 2024-09-10T07:34:45.135 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:45.143 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-10T07:34:45.143 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T07:34:45.143 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T07:34:45.144 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:34:45.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.308+0000 7f8681600640 1 Processor -- start 2024-09-10T07:34:45.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.308+0000 7f8681600640 1 -- start start 2024-09-10T07:34:45.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.309+0000 7f8681600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f867c13fae0 0x7f867c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:45.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.309+0000 7f8681600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f867c142150 0x7f867c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.309+0000 7f8681600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f867c142650 con 0x7f867c160a80 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.309+0000 7f8681600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f867c0ce780 con 0x7f867c13fae0 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.309+0000 7f8681600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f867c142930 con 0x7f867c142150 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.309+0000 7f867aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f867c13fae0 0x7f867c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.309+0000 7f867aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f867c13fae0 0x7f867c06f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55828/0 (socket says 172.21.15.99:55828) 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.309+0000 7f867aa00640 1 -- 172.21.15.99:0/4191029696 learned_addr learned my addr 172.21.15.99:0/4191029696 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.309+0000 7f867a000640 1 --2- 172.21.15.99:0/4191029696 >> v2:172.21.15.187:3300/0 conn(0x7f867c142150 0x7f867c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.310+0000 7f867aa00640 1 -- 172.21.15.99:0/4191029696 >> v2:172.21.15.187:3300/0 conn(0x7f867c142150 msgr2=0x7f867c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.310+0000 7f867aa00640 1 --2- 172.21.15.99:0/4191029696 >> v2:172.21.15.187:3300/0 conn(0x7f867c142150 0x7f867c160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.310+0000 7f867aa00640 1 -- 172.21.15.99:0/4191029696 >> v1:172.21.15.187:6789/0 conn(0x7f867c160a80 legacy=0x7f867c15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:45.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.310+0000 7f867aa00640 1 -- 172.21.15.99:0/4191029696 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c142c10 con 0x7f867c13fae0 2024-09-10T07:34:45.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.311+0000 7f867aa00640 1 --2- 172.21.15.99:0/4191029696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c13fae0 0x7f867c06f1b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f867c075560 tx=0x7f866c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7fea32a5d2e137 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:45.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.311+0000 7f8679600640 1 -- 172.21.15.99:0/4191029696 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c036070 con 0x7f867c13fae0 2024-09-10T07:34:45.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.311+0000 7f8679600640 1 -- 172.21.15.99:0/4191029696 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c031600 con 0x7f867c13fae0 2024-09-10T07:34:45.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.311+0000 7f8679600640 1 -- 172.21.15.99:0/4191029696 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c0319d0 con 0x7f867c13fae0 2024-09-10T07:34:45.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.311+0000 7f8681600640 1 -- 172.21.15.99:0/4191029696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c13fae0 msgr2=0x7f867c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:45.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.311+0000 7f8681600640 1 --2- 172.21.15.99:0/4191029696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c13fae0 0x7f867c06f1b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f867c075560 tx=0x7f866c02a6a0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.311+0000 7f8681600640 1 -- 172.21.15.99:0/4191029696 shutdown_connections 2024-09-10T07:34:45.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.311+0000 7f8681600640 1 --2- 172.21.15.99:0/4191029696 >> v2:172.21.15.187:3300/0 conn(0x7f867c142150 0x7f867c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.311+0000 7f8681600640 1 --2- 172.21.15.99:0/4191029696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c13fae0 0x7f867c06f1b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.312+0000 7f8681600640 1 -- 172.21.15.99:0/4191029696 >> 172.21.15.99:0/4191029696 conn(0x7f867c06bc10 msgr2=0x7f867c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:45.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.312+0000 7f8681600640 1 -- 172.21.15.99:0/4191029696 shutdown_connections 2024-09-10T07:34:45.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.312+0000 7f8681600640 1 -- 172.21.15.99:0/4191029696 wait complete. 2024-09-10T07:34:45.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.313+0000 7f8681600640 1 Processor -- start 2024-09-10T07:34:45.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.313+0000 7f8681600640 1 -- start start 2024-09-10T07:34:45.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.314+0000 7f8681600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c13fae0 0x7f867c13d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:45.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.314+0000 7f8681600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c142150 0x7f867c0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:45.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.314+0000 7f8681600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867c160a80 0x7f867c1f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:45.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.314+0000 7f8681600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f867c06f870 con 0x7f867c142150 2024-09-10T07:34:45.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.314+0000 7f8681600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f867c06f6f0 con 0x7f867c13fae0 2024-09-10T07:34:45.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.314+0000 7f8681600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f867c0cfc20 con 0x7f867c160a80 2024-09-10T07:34:45.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.314+0000 7f867a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c142150 0x7f867c0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:45.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.314+0000 7f867aa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c13fae0 0x7f867c13d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:45.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.314+0000 7f867a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c142150 0x7f867c0b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55834/0 (socket says 172.21.15.99:55834) 2024-09-10T07:34:45.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.314+0000 7f867a000640 1 -- 172.21.15.99:0/3715553835 learned_addr learned my addr 172.21.15.99:0/3715553835 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:45.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.315+0000 7f867b400640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867c160a80 0x7f867c1f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:45.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.315+0000 7f867a000640 1 -- 172.21.15.99:0/3715553835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867c160a80 msgr2=0x7f867c1f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:45.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.315+0000 7f867a000640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867c160a80 0x7f867c1f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.315+0000 7f867a000640 1 -- 172.21.15.99:0/3715553835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c13fae0 msgr2=0x7f867c13d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:45.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.315+0000 7f867a000640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c13fae0 0x7f867c13d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.315+0000 7f867a000640 1 -- 172.21.15.99:0/3715553835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867c0b4470 con 0x7f867c142150 2024-09-10T07:34:45.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.315+0000 7f867aa00640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c13fae0 0x7f867c13d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:45.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.315+0000 7f867a000640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c142150 0x7f867c0b5230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f866800e9e0 tx=0x7f866800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:45.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.315+0000 7f8672a00640 1 -- 172.21.15.99:0/3715553835 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668017070 con 0x7f867c142150 2024-09-10T07:34:45.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.315+0000 7f8672a00640 1 -- 172.21.15.99:0/3715553835 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866800c9d0 con 0x7f867c142150 2024-09-10T07:34:45.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.316+0000 7f8672a00640 1 -- 172.21.15.99:0/3715553835 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866800cdc0 con 0x7f867c142150 2024-09-10T07:34:45.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.316+0000 7f8681600640 1 -- 172.21.15.99:0/3715553835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867c0b4750 con 0x7f867c142150 2024-09-10T07:34:45.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.316+0000 7f8681600640 1 -- 172.21.15.99:0/3715553835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867c0b5770 con 0x7f867c142150 2024-09-10T07:34:45.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.317+0000 7f8681600640 1 -- 172.21.15.99:0/3715553835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867c0b5a30 con 0x7f867c142150 2024-09-10T07:34:45.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.318+0000 7f8672a00640 1 -- 172.21.15.99:0/3715553835 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f866801a070 con 0x7f867c142150 2024-09-10T07:34:45.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.318+0000 7f8672a00640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f865c06be30 0x7f865c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:45.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.319+0000 7f8672a00640 1 -- 172.21.15.99:0/3715553835 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f866808b220 con 0x7f867c142150 2024-09-10T07:34:45.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.319+0000 7f867aa00640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f865c06be30 0x7f865c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:45.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.319+0000 7f867aa00640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f865c06be30 0x7f865c06e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f866c033000 tx=0x7f866c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:45.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.323+0000 7f8672a00640 1 -- 172.21.15.99:0/3715553835 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86680594e0 con 0x7f867c142150 2024-09-10T07:34:45.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.528+0000 7f8681600640 1 -- 172.21.15.99:0/3715553835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f867c06f1b0 con 0x7f867c142150 2024-09-10T07:34:45.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.528+0000 7f8672a00640 1 -- 172.21.15.99:0/3715553835 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f866805d7e0 con 0x7f867c142150 2024-09-10T07:34:45.528 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:34:45.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.530+0000 7f8681600640 1 -- 172.21.15.99:0/3715553835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f865c06be30 msgr2=0x7f865c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:45.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.530+0000 7f8681600640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f865c06be30 0x7f865c06e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f866c033000 tx=0x7f866c009000 comp rx=0 tx=0).stop 2024-09-10T07:34:45.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.530+0000 7f8681600640 1 -- 172.21.15.99:0/3715553835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c142150 msgr2=0x7f867c0b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:45.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.530+0000 7f8681600640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c142150 0x7f867c0b5230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f866800e9e0 tx=0x7f866800eea0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.530+0000 7f8681600640 1 -- 172.21.15.99:0/3715553835 shutdown_connections 2024-09-10T07:34:45.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.530+0000 7f8681600640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f867c160a80 0x7f867c1f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.530+0000 7f8681600640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f865c06be30 0x7f865c06e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.530+0000 7f8681600640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c142150 0x7f867c0b5230 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.530+0000 7f8681600640 1 --2- 172.21.15.99:0/3715553835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c13fae0 0x7f867c13d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:45.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.530+0000 7f8681600640 1 -- 172.21.15.99:0/3715553835 >> 172.21.15.99:0/3715553835 conn(0x7f867c06bc10 msgr2=0x7f867c0719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:45.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.531+0000 7f8681600640 1 -- 172.21.15.99:0/3715553835 shutdown_connections 2024-09-10T07:34:45.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:45.531+0000 7f8681600640 1 -- 172.21.15.99:0/3715553835 wait complete. 2024-09-10T07:34:45.546 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T07:34:45.546 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:34:45.546 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:34:45.546 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-10T07:34:45.546 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T07:34:45.546 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T07:34:45.547 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T07:34:45.547 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:34:45.547 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-10T07:34:45.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:45.547 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:34:45.583 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:34:45.583 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:34:45.583 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:34:45.583 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:45.583 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:34:45.583 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:45.583 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:45.583 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42738sec preferred_lft 42738sec 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:34:45.584 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:34:45.585 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:34:45.585 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:45.585 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:34:45.585 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:45.585 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:34:45.585 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:34:45.585 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:34:45.585 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:45.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:45.585 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:34:45.677 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:34:45.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:45.680 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:34:45.715 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:34:45.716 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:34:45.716 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:34:45.716 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:34:45.716 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:34:45.716 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:45.716 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:34:45.716 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:34:45.716 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:34:45.717 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:34:45.717 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:34:45.834 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:45.906 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:45.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:45.914 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:34:45.949 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:34:45.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:45.950 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2024-09-10T07:34:46.024 INFO:teuthology.orchestra.run.smithi187.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-10T07:34:46.025 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:46.025 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:34:46.025 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:34:46.025 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-10T07:34:46.025 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:34:46.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:34:46.101 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:34:46.143 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:46.192 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:46.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:46.201 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T07:34:46.297 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 42:68:df:67:54:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::4068:dfff:fe67:5418/64 scope link 2024-09-10T07:34:46.298 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:46.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:46.300 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T07:34:46.355 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:34:46.355 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:34:46.355 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:34:46.355 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:46.356 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:34:46.356 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:46.356 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:34:46.356 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 42:68:df:67:54:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T07:34:46.356 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T07:34:46.356 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:46.356 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::4068:dfff:fe67:5418/64 scope link 2024-09-10T07:34:46.356 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:34:46.358 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-10T07:34:46.358 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:46.358 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:34:46.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-10T07:34:46.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T07:34:46.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-10T07:34:46.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-10T07:34:46.359 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-10T07:34:46.359 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:34:46.435 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:46.564 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:46.573 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:34:46.573 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:34:46.574 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.1 up 2024-09-10T07:34:46.574 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T07:34:46.574 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:34:46.651 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:46.732 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:46.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:34:46.740 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-10T07:34:46.776 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-10T07:34:46.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:34:46.776 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-10T07:34:46.852 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-10T07:34:46.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:46.853 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:46.980 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:46.980 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:34:47.007 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:34:47.007 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:34:47.007 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:34:47.007 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 3@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:34:47.008 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:34:47.010 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-10T07:34:47.010 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:34:47.010 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:34:47.010 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:34:47.011 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:34:47.013 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:34:47.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:47.013 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-10T07:34:47.070 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:47.148 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:47.152 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:47.159 INFO:teuthology.orchestra.run.smithi187.stdout:client4575 2024-09-10T07:34:47.160 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:47.160 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:47.195 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:47.313 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:47.316 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:47.323 INFO:teuthology.orchestra.run.smithi187.stdout:client4575 2024-09-10T07:34:47.324 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:34:47.402 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:34:47.405 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout:client4575 2024-09-10T07:34:47.414 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client4575/status') 2024-09-10T07:34:47.491 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:34:47.512 INFO:teuthology.orchestra.run.smithi187.stdout:instance: client.4575 (3)172.21.15.187:0/3317418608 2024-09-10T07:34:47.512 INFO:teuthology.orchestra.run.smithi187.stdout:blocklisted: false 2024-09-10T07:34:47.512 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records in 2024-09-10T07:34:47.512 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records out 2024-09-10T07:34:47.512 INFO:teuthology.orchestra.run.smithi187.stderr:71 bytes copied, 7.1441e-05 s, 994 kB/s 2024-09-10T07:34:47.514 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:34:47.522 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-10T07:34:47.585 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-10T07:34:47.585 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2024-09-10T07:34:47.586 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.749+0000 7fcd48e00640 1 Processor -- start 2024-09-10T07:34:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.749+0000 7fcd48e00640 1 -- start start 2024-09-10T07:34:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.750+0000 7fcd48e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd440d2680 0x7fcd440cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.750+0000 7fcd48e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd440d2bd0 con 0x7fcd440cfac0 2024-09-10T07:34:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.750+0000 7fcd48e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd440d2eb0 con 0x7fcd4415e970 2024-09-10T07:34:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.750+0000 7fcd48e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcd440d37e0 con 0x7fcd440d2680 2024-09-10T07:34:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.750+0000 7fcd43e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcd440cfac0 0x7fcd440c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58964/0 (socket says 172.21.15.99:58964) 2024-09-10T07:34:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.750+0000 7fcd43e00640 1 -- 172.21.15.99:0/1288919844 learned_addr learned my addr 172.21.15.99:0/1288919844 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.750+0000 7fcd42a00640 1 --2- 172.21.15.99:0/1288919844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd440d2680 0x7fcd440cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.751+0000 7fcd42000640 1 -- 172.21.15.99:0/1288919844 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211405600 0 0) 0x7fcd440d2bd0 con 0x7fcd440cfac0 2024-09-10T07:34:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.751+0000 7fcd42000640 1 -- 172.21.15.99:0/1288919844 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd28003520 con 0x7fcd440cfac0 2024-09-10T07:34:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.751+0000 7fcd42000640 1 -- 172.21.15.99:0/1288919844 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561395084 0 0) 0x7fcd440d2eb0 con 0x7fcd4415e970 2024-09-10T07:34:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.751+0000 7fcd42000640 1 -- 172.21.15.99:0/1288919844 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd440d2bd0 con 0x7fcd4415e970 2024-09-10T07:34:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.751+0000 7fcd42a00640 1 -- 172.21.15.99:0/1288919844 >> v1:172.21.15.187:6789/0 conn(0x7fcd4415e970 legacy=0x7fcd440d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:47.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.751+0000 7fcd42a00640 1 -- 172.21.15.99:0/1288919844 >> v1:172.21.15.99:6789/0 conn(0x7fcd440cfac0 legacy=0x7fcd440c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:47.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.751+0000 7fcd42a00640 1 -- 172.21.15.99:0/1288919844 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd440d3190 con 0x7fcd440d2680 2024-09-10T07:34:47.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.752+0000 7fcd42a00640 1 --2- 172.21.15.99:0/1288919844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd440d2680 0x7fcd440cf580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcd300097d0 tx=0x7fcd3002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dd2c98d1c121c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.752+0000 7fcd42000640 1 -- 172.21.15.99:0/1288919844 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd30037070 con 0x7fcd440d2680 2024-09-10T07:34:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.752+0000 7fcd42000640 1 -- 172.21.15.99:0/1288919844 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd30032440 con 0x7fcd440d2680 2024-09-10T07:34:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.753+0000 7fcd42000640 1 -- 172.21.15.99:0/1288919844 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd300327f0 con 0x7fcd440d2680 2024-09-10T07:34:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.753+0000 7fcd48e00640 1 -- 172.21.15.99:0/1288919844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd440d2680 msgr2=0x7fcd440cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.753+0000 7fcd48e00640 1 --2- 172.21.15.99:0/1288919844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd440d2680 0x7fcd440cf580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcd300097d0 tx=0x7fcd3002a290 comp rx=0 tx=0).stop 2024-09-10T07:34:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.753+0000 7fcd48e00640 1 -- 172.21.15.99:0/1288919844 shutdown_connections 2024-09-10T07:34:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.753+0000 7fcd48e00640 1 --2- 172.21.15.99:0/1288919844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd440d2680 0x7fcd440cf580 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.753+0000 7fcd48e00640 1 -- 172.21.15.99:0/1288919844 >> 172.21.15.99:0/1288919844 conn(0x7fcd4409de00 msgr2=0x7fcd440d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.753+0000 7fcd48e00640 1 -- 172.21.15.99:0/1288919844 shutdown_connections 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.753+0000 7fcd48e00640 1 -- 172.21.15.99:0/1288919844 wait complete. 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.755+0000 7fcd48e00640 1 Processor -- start 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.755+0000 7fcd48e00640 1 -- start start 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd48e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd440cfac0 0x7fcd441546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd48e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd440d2680 0x7fcd44160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd48e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd4415e970 0x7fcd440b9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd48e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4415ed50 con 0x7fcd440cfac0 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd48e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcd440cff70 con 0x7fcd440d2680 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd48e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4415eed0 con 0x7fcd4415e970 2024-09-10T07:34:47.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd43400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd440cfac0 0x7fcd441546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd43400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd440cfac0 0x7fcd441546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55846/0 (socket says 172.21.15.99:55846) 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd43400640 1 -- 172.21.15.99:0/1021257406 learned_addr learned my addr 172.21.15.99:0/1021257406 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd42a00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd440d2680 0x7fcd44160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd43e00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd4415e970 0x7fcd440b9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd43400640 1 -- 172.21.15.99:0/1021257406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd4415e970 msgr2=0x7fcd440b9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd43400640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd4415e970 0x7fcd440b9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd43400640 1 -- 172.21.15.99:0/1021257406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd440d2680 msgr2=0x7fcd44160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd43400640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd440d2680 0x7fcd44160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd43400640 1 -- 172.21.15.99:0/1021257406 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd440cc590 con 0x7fcd440cfac0 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.756+0000 7fcd42a00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd440d2680 0x7fcd44160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:47.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.757+0000 7fcd43400640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd440cfac0 0x7fcd441546b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400c430 tx=0x7fcd3400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:47.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.757+0000 7fcd3b400640 1 -- 172.21.15.99:0/1021257406 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34017070 con 0x7fcd440cfac0 2024-09-10T07:34:47.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.757+0000 7fcd3b400640 1 -- 172.21.15.99:0/1021257406 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd340052f0 con 0x7fcd440cfac0 2024-09-10T07:34:47.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.757+0000 7fcd3b400640 1 -- 172.21.15.99:0/1021257406 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34003830 con 0x7fcd440cfac0 2024-09-10T07:34:47.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.757+0000 7fcd48e00640 1 -- 172.21.15.99:0/1021257406 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd440cc870 con 0x7fcd440cfac0 2024-09-10T07:34:47.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.757+0000 7fcd48e00640 1 -- 172.21.15.99:0/1021257406 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd440cce30 con 0x7fcd440cfac0 2024-09-10T07:34:47.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.758+0000 7fcd48e00640 1 -- 172.21.15.99:0/1021257406 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd440cf580 con 0x7fcd440cfac0 2024-09-10T07:34:47.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.759+0000 7fcd3b400640 1 -- 172.21.15.99:0/1021257406 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd3401a070 con 0x7fcd440cfac0 2024-09-10T07:34:47.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.760+0000 7fcd3b400640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd2406be60 0x7fcd2406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:47.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.760+0000 7fcd3b400640 1 -- 172.21.15.99:0/1021257406 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcd3408a210 con 0x7fcd440cfac0 2024-09-10T07:34:47.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.760+0000 7fcd42a00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd2406be60 0x7fcd2406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:47.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.761+0000 7fcd42a00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd2406be60 0x7fcd2406e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd30034000 tx=0x7fcd3002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:47.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.765+0000 7fcd3b400640 1 -- 172.21.15.99:0/1021257406 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd340584d0 con 0x7fcd440cfac0 2024-09-10T07:34:47.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.942+0000 7fcd48e00640 1 -- 172.21.15.99:0/1021257406 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd440ca740 con 0x7fcd440cfac0 2024-09-10T07:34:47.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.944+0000 7fcd3b400640 1 -- 172.21.15.99:0/1021257406 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fcd3405c7d0 con 0x7fcd440cfac0 2024-09-10T07:34:47.944 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:47.944 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:20.870081+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:34:17.274179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:34:18.279150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:47.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 -- 172.21.15.99:0/1021257406 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd2406be60 msgr2=0x7fcd2406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:47.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd2406be60 0x7fcd2406e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd30034000 tx=0x7fcd3002e000 comp rx=0 tx=0).stop 2024-09-10T07:34:47.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 -- 172.21.15.99:0/1021257406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd440cfac0 msgr2=0x7fcd441546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:47.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd440cfac0 0x7fcd441546b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400c430 tx=0x7fcd3400c8f0 comp rx=0 tx=0).stop 2024-09-10T07:34:47.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 -- 172.21.15.99:0/1021257406 shutdown_connections 2024-09-10T07:34:47.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd4415e970 0x7fcd440b9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:47.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd440d2680 0x7fcd44160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:47.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd2406be60 0x7fcd2406e320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:47.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 --2- 172.21.15.99:0/1021257406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd440cfac0 0x7fcd441546b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:47.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 -- 172.21.15.99:0/1021257406 >> 172.21.15.99:0/1021257406 conn(0x7fcd4409de00 msgr2=0x7fcd440c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:47.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 -- 172.21.15.99:0/1021257406 shutdown_connections 2024-09-10T07:34:47.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:47.946+0000 7fcd48e00640 1 -- 172.21.15.99:0/1021257406 wait complete. 2024-09-10T07:34:47.964 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:34:08.744575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T07:34:17.274179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T07:34:18.279150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:34:47.964 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:34:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.121+0000 7f0247400640 1 Processor -- start 2024-09-10T07:34:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.121+0000 7f0247400640 1 -- start start 2024-09-10T07:34:48.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0247400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f024006e280 0x7f0240073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0247400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0240071df0 0x7f024006e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0247400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 0x7f02400ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0247400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f02400738b0 con 0x7f024006e280 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0247400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f024006eba0 con 0x7f0240071df0 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0247400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f02400722d0 con 0x7f02400d1010 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0244a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f024006e280 0x7f0240073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0244a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f024006e280 0x7f0240073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55850/0 (socket says 172.21.15.99:55850) 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0244a00640 1 -- 172.21.15.99:0/501601337 learned_addr learned my addr 172.21.15.99:0/501601337 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0245400640 1 --2- 172.21.15.99:0/501601337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 0x7f02400ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0237e00640 1 --2- 172.21.15.99:0/501601337 >> v2:172.21.15.187:3300/0 conn(0x7f0240071df0 0x7f024006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0244a00640 1 -- 172.21.15.99:0/501601337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 msgr2=0x7f02400ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0244a00640 1 --2- 172.21.15.99:0/501601337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 0x7f02400ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0244a00640 1 -- 172.21.15.99:0/501601337 >> v2:172.21.15.187:3300/0 conn(0x7f0240071df0 msgr2=0x7f024006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0244a00640 1 --2- 172.21.15.99:0/501601337 >> v2:172.21.15.187:3300/0 conn(0x7f0240071df0 0x7f024006e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0244a00640 1 -- 172.21.15.99:0/501601337 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02400725b0 con 0x7f024006e280 2024-09-10T07:34:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.123+0000 7f0245400640 1 --2- 172.21.15.99:0/501601337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 0x7f02400ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.124+0000 7f0244a00640 1 --2- 172.21.15.99:0/501601337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 0x7f0240073370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0240050020 tx=0x7f023002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1233e04e4ec75684 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f023fe00640 1 -- 172.21.15.99:0/501601337 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230037070 con 0x7f024006e280 2024-09-10T07:34:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f023fe00640 1 -- 172.21.15.99:0/501601337 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0230032440 con 0x7f024006e280 2024-09-10T07:34:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f023fe00640 1 -- 172.21.15.99:0/501601337 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230032810 con 0x7f024006e280 2024-09-10T07:34:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f0247400640 1 -- 172.21.15.99:0/501601337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 msgr2=0x7f0240073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f0247400640 1 --2- 172.21.15.99:0/501601337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 0x7f0240073370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0240050020 tx=0x7f023002a1e0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f0247400640 1 -- 172.21.15.99:0/501601337 shutdown_connections 2024-09-10T07:34:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f0247400640 1 --2- 172.21.15.99:0/501601337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 0x7f02400ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f0247400640 1 --2- 172.21.15.99:0/501601337 >> v2:172.21.15.187:3300/0 conn(0x7f0240071df0 0x7f024006e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f0247400640 1 --2- 172.21.15.99:0/501601337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 0x7f0240073370 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f0247400640 1 -- 172.21.15.99:0/501601337 >> 172.21.15.99:0/501601337 conn(0x7f024006bc10 msgr2=0x7f024006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f0247400640 1 -- 172.21.15.99:0/501601337 shutdown_connections 2024-09-10T07:34:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.125+0000 7f0247400640 1 -- 172.21.15.99:0/501601337 wait complete. 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.127+0000 7f0247400640 1 Processor -- start 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.127+0000 7f0247400640 1 -- start start 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.128+0000 7f0247400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 0x7f0240158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.128+0000 7f0247400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0240071df0 0x7f0240159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.128+0000 7f0247400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 0x7f024015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.128+0000 7f0247400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0240072e50 con 0x7f024006e280 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.128+0000 7f0247400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0240072b70 con 0x7f0240071df0 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.128+0000 7f0247400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f02400d14c0 con 0x7f02400d1010 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.128+0000 7f0244a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 0x7f0240158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.128+0000 7f0244a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 0x7f0240158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55866/0 (socket says 172.21.15.99:55866) 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.128+0000 7f0244a00640 1 -- 172.21.15.99:0/3286092425 learned_addr learned my addr 172.21.15.99:0/3286092425 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.128+0000 7f0237e00640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0240071df0 0x7f0240159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f0245400640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 0x7f024015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f0244a00640 1 -- 172.21.15.99:0/3286092425 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 msgr2=0x7f024015cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f0244a00640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 0x7f024015cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f0244a00640 1 -- 172.21.15.99:0/3286092425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0240071df0 msgr2=0x7f0240159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f0244a00640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0240071df0 0x7f0240159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f0244a00640 1 -- 172.21.15.99:0/3286092425 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02401e5ed0 con 0x7f024006e280 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f0245400640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 0x7f024015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f0244a00640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 0x7f0240158e40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f023002a220 tx=0x7f02300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f023d600640 1 -- 172.21.15.99:0/3286092425 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230041020 con 0x7f024006e280 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f023d600640 1 -- 172.21.15.99:0/3286092425 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02300306c0 con 0x7f024006e280 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f023d600640 1 -- 172.21.15.99:0/3286092425 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230037040 con 0x7f024006e280 2024-09-10T07:34:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f0247400640 1 -- 172.21.15.99:0/3286092425 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02401e61b0 con 0x7f024006e280 2024-09-10T07:34:48.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.129+0000 7f0247400640 1 -- 172.21.15.99:0/3286092425 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02401e6770 con 0x7f024006e280 2024-09-10T07:34:48.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.130+0000 7f0247400640 1 -- 172.21.15.99:0/3286092425 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0240073370 con 0x7f024006e280 2024-09-10T07:34:48.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.131+0000 7f023d600640 1 -- 172.21.15.99:0/3286092425 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0230044020 con 0x7f024006e280 2024-09-10T07:34:48.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.132+0000 7f023d600640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f021c06be30 0x7f021c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.132+0000 7f023d600640 1 -- 172.21.15.99:0/3286092425 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f02300ab700 con 0x7f024006e280 2024-09-10T07:34:48.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.132+0000 7f0237e00640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f021c06be30 0x7f021c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.133+0000 7f0237e00640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f021c06be30 0x7f021c06e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f024015c0e0 tx=0x7f0228008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:48.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.136+0000 7f023d600640 1 -- 172.21.15.99:0/3286092425 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f023004b030 con 0x7f024006e280 2024-09-10T07:34:48.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.308+0000 7f0247400640 1 -- 172.21.15.99:0/3286092425 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0240075620 con 0x7f024006e280 2024-09-10T07:34:48.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.308+0000 7f023d600640 1 -- 172.21.15.99:0/3286092425 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f023007a010 con 0x7f024006e280 2024-09-10T07:34:48.308 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.310+0000 7f0247400640 1 -- 172.21.15.99:0/3286092425 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f021c06be30 msgr2=0x7f021c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.310+0000 7f0247400640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f021c06be30 0x7f021c06e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f024015c0e0 tx=0x7f0228008040 comp rx=0 tx=0).stop 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.310+0000 7f0247400640 1 -- 172.21.15.99:0/3286092425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 msgr2=0x7f0240158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.310+0000 7f0247400640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 0x7f0240158e40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f023002a220 tx=0x7f02300046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.310+0000 7f0247400640 1 -- 172.21.15.99:0/3286092425 shutdown_connections 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.310+0000 7f0247400640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02400d1010 0x7f024015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.310+0000 7f0247400640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0240071df0 0x7f0240159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.310+0000 7f0247400640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f021c06be30 0x7f021c06e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.310+0000 7f0247400640 1 --2- 172.21.15.99:0/3286092425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f024006e280 0x7f0240158e40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.310+0000 7f0247400640 1 -- 172.21.15.99:0/3286092425 >> 172.21.15.99:0/3286092425 conn(0x7f024006bc10 msgr2=0x7f02400b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.311+0000 7f0247400640 1 -- 172.21.15.99:0/3286092425 shutdown_connections 2024-09-10T07:34:48.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.311+0000 7f0247400640 1 -- 172.21.15.99:0/3286092425 wait complete. 2024-09-10T07:34:48.326 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T07:34:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.483+0000 7f67ce400640 1 Processor -- start 2024-09-10T07:34:48.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.483+0000 7f67ce400640 1 -- start start 2024-09-10T07:34:48.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.484+0000 7f67ce400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f67c815e970 0x7f67c80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.484+0000 7f67ce400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 0x7f67c80c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.484+0000 7f67ce400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67c80d2bd0 con 0x7f67c80d2680 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.484+0000 7f67ce400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f67c80d37e0 con 0x7f67c815e970 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.484+0000 7f67ce400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f67c80d2eb0 con 0x7f67c80cfc90 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.484+0000 7f67cd000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f67c815e970 0x7f67c80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.484+0000 7f67cd000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f67c815e970 0x7f67c80d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55874/0 (socket says 172.21.15.99:55874) 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.484+0000 7f67cd000640 1 -- 172.21.15.99:0/1241471302 learned_addr learned my addr 172.21.15.99:0/1241471302 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.484+0000 7f67cda00640 1 --2- 172.21.15.99:0/1241471302 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 0x7f67c80c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.485+0000 7f67cd000640 1 -- 172.21.15.99:0/1241471302 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 msgr2=0x7f67c80c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.485+0000 7f67cd000640 1 --2- 172.21.15.99:0/1241471302 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 0x7f67c80c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.485+0000 7f67cd000640 1 -- 172.21.15.99:0/1241471302 >> v1:172.21.15.187:6789/0 conn(0x7f67c80d2680 legacy=0x7f67c80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.485+0000 7f67cd000640 1 -- 172.21.15.99:0/1241471302 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c80d3190 con 0x7f67c815e970 2024-09-10T07:34:48.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.485+0000 7f67cda00640 1 --2- 172.21.15.99:0/1241471302 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 0x7f67c80c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:48.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.486+0000 7f67cd000640 1 --2- 172.21.15.99:0/1241471302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c815e970 0x7f67c80d0300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f67b8009870 tx=0x7f67b802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1613f31e97cfd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.486+0000 7f67c7e00640 1 -- 172.21.15.99:0/1241471302 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b8037070 con 0x7f67c815e970 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.486+0000 7f67c7e00640 1 -- 172.21.15.99:0/1241471302 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b8032440 con 0x7f67c815e970 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.486+0000 7f67c7e00640 1 -- 172.21.15.99:0/1241471302 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b8032810 con 0x7f67c815e970 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.487+0000 7f67ce400640 1 -- 172.21.15.99:0/1241471302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c815e970 msgr2=0x7f67c80d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.487+0000 7f67ce400640 1 --2- 172.21.15.99:0/1241471302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c815e970 0x7f67c80d0300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f67b8009870 tx=0x7f67b802a250 comp rx=0 tx=0).stop 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.487+0000 7f67ce400640 1 -- 172.21.15.99:0/1241471302 shutdown_connections 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.487+0000 7f67ce400640 1 --2- 172.21.15.99:0/1241471302 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 0x7f67c80c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.487+0000 7f67ce400640 1 --2- 172.21.15.99:0/1241471302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c815e970 0x7f67c80d0300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.487+0000 7f67ce400640 1 -- 172.21.15.99:0/1241471302 >> 172.21.15.99:0/1241471302 conn(0x7f67c809de00 msgr2=0x7f67c80d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.487+0000 7f67ce400640 1 -- 172.21.15.99:0/1241471302 shutdown_connections 2024-09-10T07:34:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.487+0000 7f67ce400640 1 -- 172.21.15.99:0/1241471302 wait complete. 2024-09-10T07:34:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.488+0000 7f67ce400640 1 Processor -- start 2024-09-10T07:34:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.489+0000 7f67ce400640 1 -- start start 2024-09-10T07:34:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.489+0000 7f67ce400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 0x7f67c8154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.489+0000 7f67ce400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c80d2680 0x7f67c80b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.489+0000 7f67ce400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67c815e970 0x7f67c815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.489+0000 7f67ce400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f67c815ed50 con 0x7f67c80d2680 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.489+0000 7f67ce400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f67c80d0840 con 0x7f67c815e970 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.489+0000 7f67ce400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f67c815eed0 con 0x7f67c80cfc90 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67bfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c80d2680 0x7f67c80b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67bfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c80d2680 0x7f67c80b92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55886/0 (socket says 172.21.15.99:55886) 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67bfe00640 1 -- 172.21.15.99:0/3643045835 learned_addr learned my addr 172.21.15.99:0/3643045835 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67cd000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 0x7f67c8154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67cda00640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67c815e970 0x7f67c815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67bfe00640 1 -- 172.21.15.99:0/3643045835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 msgr2=0x7f67c8154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67bfe00640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 0x7f67c8154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67bfe00640 1 -- 172.21.15.99:0/3643045835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67c815e970 msgr2=0x7f67c815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67bfe00640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67c815e970 0x7f67c815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67bfe00640 1 -- 172.21.15.99:0/3643045835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c81554c0 con 0x7f67c80d2680 2024-09-10T07:34:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.490+0000 7f67cda00640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67c815e970 0x7f67c815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.491+0000 7f67bfe00640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c80d2680 0x7f67c80b92c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f67b000c400 tx=0x7f67b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.491+0000 7f67c5600640 1 -- 172.21.15.99:0/3643045835 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b00052d0 con 0x7f67c80d2680 2024-09-10T07:34:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.491+0000 7f67c5600640 1 -- 172.21.15.99:0/3643045835 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b0005490 con 0x7f67c80d2680 2024-09-10T07:34:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.491+0000 7f67c5600640 1 -- 172.21.15.99:0/3643045835 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b0007260 con 0x7f67c80d2680 2024-09-10T07:34:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.491+0000 7f67ce400640 1 -- 172.21.15.99:0/3643045835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c8155800 con 0x7f67c80d2680 2024-09-10T07:34:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.491+0000 7f67ce400640 1 -- 172.21.15.99:0/3643045835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c81548a0 con 0x7f67c80d2680 2024-09-10T07:34:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.492+0000 7f67ce400640 1 -- 172.21.15.99:0/3643045835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c80d0300 con 0x7f67c80d2680 2024-09-10T07:34:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.493+0000 7f67c5600640 1 -- 172.21.15.99:0/3643045835 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67b0007400 con 0x7f67c80d2680 2024-09-10T07:34:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.494+0000 7f67c5600640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f67a406be30 0x7f67a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.494+0000 7f67c5600640 1 -- 172.21.15.99:0/3643045835 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f67b008a2d0 con 0x7f67c80d2680 2024-09-10T07:34:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.494+0000 7f67cd000640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f67a406be30 0x7f67a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.495+0000 7f67cd000640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f67a406be30 0x7f67a406e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f67b8034000 tx=0x7f67b802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:48.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.498+0000 7f67c5600640 1 -- 172.21.15.99:0/3643045835 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67c8155800 con 0x7f67c80d2680 2024-09-10T07:34:48.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.671+0000 7f67ce400640 1 -- 172.21.15.99:0/3643045835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f67c8069220 con 0x7f67c80d2680 2024-09-10T07:34:48.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.672+0000 7f67c5600640 1 -- 172.21.15.99:0/3643045835 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f67b0058630 con 0x7f67c80d2680 2024-09-10T07:34:48.672 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 -- 172.21.15.99:0/3643045835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f67a406be30 msgr2=0x7f67a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f67a406be30 0x7f67a406e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f67b8034000 tx=0x7f67b802e000 comp rx=0 tx=0).stop 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 -- 172.21.15.99:0/3643045835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c80d2680 msgr2=0x7f67c80b92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c80d2680 0x7f67c80b92c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f67b000c400 tx=0x7f67b000c8c0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 -- 172.21.15.99:0/3643045835 shutdown_connections 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67c815e970 0x7f67c815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f67a406be30 0x7f67a406e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67c80d2680 0x7f67c80b92c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 --2- 172.21.15.99:0/3643045835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67c80cfc90 0x7f67c8154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 -- 172.21.15.99:0/3643045835 >> 172.21.15.99:0/3643045835 conn(0x7f67c809de00 msgr2=0x7f67c80d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:48.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 -- 172.21.15.99:0/3643045835 shutdown_connections 2024-09-10T07:34:48.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.674+0000 7f67ce400640 1 -- 172.21.15.99:0/3643045835 wait complete. 2024-09-10T07:34:48.690 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T07:34:48.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.849+0000 7fb307400640 1 Processor -- start 2024-09-10T07:34:48.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.849+0000 7fb307400640 1 -- start start 2024-09-10T07:34:48.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.850+0000 7fb307400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3000d56b0 0x7fb3000b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.850+0000 7fb307400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3000d3700 con 0x7fb3000d1470 2024-09-10T07:34:48.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.850+0000 7fb307400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3000cfa70 con 0x7fb3001623c0 2024-09-10T07:34:48.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.850+0000 7fb307400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb3000d21a0 con 0x7fb3000d56b0 2024-09-10T07:34:48.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.850+0000 7fb305400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb3000d1470 0x7fb3000b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58978/0 (socket says 172.21.15.99:58978) 2024-09-10T07:34:48.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.850+0000 7fb305400640 1 -- 172.21.15.99:0/2942001984 learned_addr learned my addr 172.21.15.99:0/2942001984 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:48.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 461033990 0 0) 0x7fb3000d3700 con 0x7fb3000d1470 2024-09-10T07:34:48.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ffe00640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3000d56b0 0x7fb3000b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2e8003520 con 0x7fb3000d1470 2024-09-10T07:34:48.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4733403 0 0) 0x7fb2e8003520 con 0x7fb3000d1470 2024-09-10T07:34:48.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3000d56b0 msgr2=0x7fb3000b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:48.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3000d56b0 0x7fb3000b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 >> v1:172.21.15.187:6789/0 conn(0x7fb3001623c0 legacy=0x7fb3000d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3000d0c20 con 0x7fb3000d1470 2024-09-10T07:34:48.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fb2f80019f0 con 0x7fb3000d1470 2024-09-10T07:34:48.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 >> v1:172.21.15.99:6789/0 conn(0x7fb3000d1470 legacy=0x7fb3000b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3000d56b0 0x7fb2e80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2e8003f60 0x7fb2e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2e8004d40 0x7fb2e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb3000d21a0 con 0x7fb2e8004d40 2024-09-10T07:34:48.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e800baa0 con 0x7fb2e8003f60 2024-09-10T07:34:48.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e800bca0 con 0x7fb3000d56b0 2024-09-10T07:34:48.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.851+0000 7fb305400640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2e8004d40 0x7fb2e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.852+0000 7fb2ffe00640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2e8003f60 0x7fb2e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.852+0000 7fb304a00640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3000d56b0 0x7fb2e80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.852+0000 7fb305400640 1 -- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3000d56b0 msgr2=0x7fb2e80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.852+0000 7fb305400640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3000d56b0 0x7fb2e80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.852+0000 7fb305400640 1 -- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2e8003f60 msgr2=0x7fb2e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.852+0000 7fb305400640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2e8003f60 0x7fb2e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.852+0000 7fb305400640 1 -- 172.21.15.99:0/2942001984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e8003520 con 0x7fb2e8004d40 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.852+0000 7fb2ffe00640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2e8003f60 0x7fb2e8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.853+0000 7fb305400640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2e8004d40 0x7fb2e80051c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800a850 tx=0x7fb2e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1afe81dc0b7a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.853+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800a4a0 con 0x7fb2e8004d40 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.853+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f802f070 con 0x7fb2e8004d40 2024-09-10T07:34:48.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.853+0000 7fb2ff400640 1 -- 172.21.15.99:0/2942001984 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f802bd20 con 0x7fb2e8004d40 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.854+0000 7fb307400640 1 -- 172.21.15.99:0/2942001984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2e8004d40 msgr2=0x7fb2e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.854+0000 7fb307400640 1 --2- 172.21.15.99:0/2942001984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2e8004d40 0x7fb2e80051c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800a850 tx=0x7fb2e8005830 comp rx=0 tx=0).stop 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.854+0000 7fb305400640 1 -- 172.21.15.99:0/2942001984 reap_dead start 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.854+0000 7fb307400640 1 -- 172.21.15.99:0/2942001984 shutdown_connections 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.854+0000 7fb307400640 1 -- 172.21.15.99:0/2942001984 >> 172.21.15.99:0/2942001984 conn(0x7fb30009df30 msgr2=0x7fb3000d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.854+0000 7fb307400640 1 -- 172.21.15.99:0/2942001984 shutdown_connections 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.854+0000 7fb307400640 1 -- 172.21.15.99:0/2942001984 wait complete. 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.856+0000 7fb307400640 1 Processor -- start 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.856+0000 7fb307400640 1 -- start start 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb307400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2e8004d40 0x7fb30014ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb307400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30014ee00 0x7fb3000c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb307400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30015bdc0 0x7fb30015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb307400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb3000cfd10 con 0x7fb30014ee00 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb307400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb3000d0080 con 0x7fb30015bdc0 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb307400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb3001627a0 con 0x7fb2e8004d40 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb2ffe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30014ee00 0x7fb3000c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb2ffe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30014ee00 0x7fb3000c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55914/0 (socket says 172.21.15.99:55914) 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb2ffe00640 1 -- 172.21.15.99:0/1614759577 learned_addr learned my addr 172.21.15.99:0/1614759577 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb304a00640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2e8004d40 0x7fb30014ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb305400640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30015bdc0 0x7fb30015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb2ffe00640 1 -- 172.21.15.99:0/1614759577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2e8004d40 msgr2=0x7fb30014ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb2ffe00640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2e8004d40 0x7fb30014ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb2ffe00640 1 -- 172.21.15.99:0/1614759577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30015bdc0 msgr2=0x7fb30015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb2ffe00640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30015bdc0 0x7fb30015c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb2ffe00640 1 -- 172.21.15.99:0/1614759577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30015df10 con 0x7fb30014ee00 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.857+0000 7fb305400640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30015bdc0 0x7fb30015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.858+0000 7fb2ffe00640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30014ee00 0x7fb3000c90c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec011aa0 tx=0x7fb2ec011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.858+0000 7fb2fcc00640 1 -- 172.21.15.99:0/1614759577 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec00fb80 con 0x7fb30014ee00 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.858+0000 7fb2fcc00640 1 -- 172.21.15.99:0/1614759577 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ec00fd20 con 0x7fb30014ee00 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.858+0000 7fb307400640 1 -- 172.21.15.99:0/1614759577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30015e1f0 con 0x7fb30014ee00 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.858+0000 7fb2fcc00640 1 -- 172.21.15.99:0/1614759577 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec014660 con 0x7fb30014ee00 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.858+0000 7fb307400640 1 -- 172.21.15.99:0/1614759577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30015e7b0 con 0x7fb30014ee00 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.859+0000 7fb307400640 1 -- 172.21.15.99:0/1614759577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3000d3c80 con 0x7fb30014ee00 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.860+0000 7fb2fcc00640 1 -- 172.21.15.99:0/1614759577 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2ec012040 con 0x7fb30014ee00 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.861+0000 7fb2fcc00640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e006be30 0x7fb2e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.861+0000 7fb2fcc00640 1 -- 172.21.15.99:0/1614759577 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb2ec08b730 con 0x7fb30014ee00 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.861+0000 7fb304a00640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e006be30 0x7fb2e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:48.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.862+0000 7fb304a00640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e006be30 0x7fb2e006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4005590 tx=0x7fb2f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:48.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:48.865+0000 7fb2fcc00640 1 -- 172.21.15.99:0/1614759577 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2ec019030 con 0x7fb30014ee00 2024-09-10T07:34:49.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.040+0000 7fb307400640 1 -- 172.21.15.99:0/1614759577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb3000d2340 con 0x7fb30014ee00 2024-09-10T07:34:49.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.040+0000 7fb2fcc00640 1 -- 172.21.15.99:0/1614759577 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fb2ec05a040 con 0x7fb30014ee00 2024-09-10T07:34:49.040 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-09-10T07:34:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.042+0000 7fb307400640 1 -- 172.21.15.99:0/1614759577 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e006be30 msgr2=0x7fb2e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.042+0000 7fb307400640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e006be30 0x7fb2e006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4005590 tx=0x7fb2f4009040 comp rx=0 tx=0).stop 2024-09-10T07:34:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.042+0000 7fb307400640 1 -- 172.21.15.99:0/1614759577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30014ee00 msgr2=0x7fb3000c90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.042+0000 7fb307400640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30014ee00 0x7fb3000c90c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec011aa0 tx=0x7fb2ec011f60 comp rx=0 tx=0).stop 2024-09-10T07:34:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.042+0000 7fb307400640 1 -- 172.21.15.99:0/1614759577 shutdown_connections 2024-09-10T07:34:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.042+0000 7fb307400640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30015bdc0 0x7fb30015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.042+0000 7fb307400640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e006be30 0x7fb2e006e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.042+0000 7fb307400640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30014ee00 0x7fb3000c90c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.042+0000 7fb307400640 1 --2- 172.21.15.99:0/1614759577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2e8004d40 0x7fb30014ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.042+0000 7fb307400640 1 -- 172.21.15.99:0/1614759577 >> 172.21.15.99:0/1614759577 conn(0x7fb30009df30 msgr2=0x7fb3000b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:49.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.043+0000 7fb307400640 1 -- 172.21.15.99:0/1614759577 shutdown_connections 2024-09-10T07:34:49.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.043+0000 7fb307400640 1 -- 172.21.15.99:0/1614759577 wait complete. 2024-09-10T07:34:49.059 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-10T07:34:49.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.214+0000 7f8e1ac00640 1 Processor -- start 2024-09-10T07:34:49.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.214+0000 7f8e1ac00640 1 -- start start 2024-09-10T07:34:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.215+0000 7f8e1ac00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8e14142150 0x7f8e14160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.215+0000 7f8e1ac00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e14142650 con 0x7f8e14160a80 2024-09-10T07:34:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.215+0000 7f8e1ac00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e14142930 con 0x7f8e1413fae0 2024-09-10T07:34:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.215+0000 7f8e1ac00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8e140ce780 con 0x7f8e14142150 2024-09-10T07:34:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.215+0000 7f8e18c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8e14160a80 0x7f8e140cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58994/0 (socket says 172.21.15.99:58994) 2024-09-10T07:34:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.215+0000 7f8e18c00640 1 -- 172.21.15.99:0/2203135924 learned_addr learned my addr 172.21.15.99:0/2203135924 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.215+0000 7f8e0b400640 1 --2- 172.21.15.99:0/2203135924 >> v2:172.21.15.187:3300/0 conn(0x7f8e14142150 0x7f8e14160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.216+0000 7f8e13400640 1 -- 172.21.15.99:0/2203135924 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 431280264 0 0) 0x7f8e14142650 con 0x7f8e14160a80 2024-09-10T07:34:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.216+0000 7f8e13400640 1 -- 172.21.15.99:0/2203135924 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df4003520 con 0x7f8e14160a80 2024-09-10T07:34:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.216+0000 7f8e13400640 1 -- 172.21.15.99:0/2203135924 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453609581 0 0) 0x7f8e14142930 con 0x7f8e1413fae0 2024-09-10T07:34:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.216+0000 7f8e13400640 1 -- 172.21.15.99:0/2203135924 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e14142650 con 0x7f8e1413fae0 2024-09-10T07:34:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.216+0000 7f8e0b400640 1 -- 172.21.15.99:0/2203135924 >> v1:172.21.15.187:6789/0 conn(0x7f8e1413fae0 legacy=0x7f8e1406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.216+0000 7f8e0b400640 1 -- 172.21.15.99:0/2203135924 >> v1:172.21.15.99:6789/0 conn(0x7f8e14160a80 legacy=0x7f8e140cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.216+0000 7f8e0b400640 1 -- 172.21.15.99:0/2203135924 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e14142c10 con 0x7f8e14142150 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.217+0000 7f8e0b400640 1 --2- 172.21.15.99:0/2203135924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e14142150 0x7f8e14160540 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0097a0 tx=0x7f8dfc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3b644a177d1e4d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.217+0000 7f8e13400640 1 -- 172.21.15.99:0/2203135924 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc037070 con 0x7f8e14142150 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.217+0000 7f8e13400640 1 -- 172.21.15.99:0/2203135924 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dfc032440 con 0x7f8e14142150 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.217+0000 7f8e13400640 1 -- 172.21.15.99:0/2203135924 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc032810 con 0x7f8e14142150 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.218+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2203135924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e14142150 msgr2=0x7f8e14160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.218+0000 7f8e1ac00640 1 --2- 172.21.15.99:0/2203135924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e14142150 0x7f8e14160540 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0097a0 tx=0x7f8dfc02a1a0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.218+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2203135924 shutdown_connections 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.218+0000 7f8e1ac00640 1 --2- 172.21.15.99:0/2203135924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e14142150 0x7f8e14160540 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.218+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2203135924 >> 172.21.15.99:0/2203135924 conn(0x7f8e1406bc10 msgr2=0x7f8e1406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.218+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2203135924 shutdown_connections 2024-09-10T07:34:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.218+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2203135924 wait complete. 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.220+0000 7f8e1ac00640 1 Processor -- start 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.220+0000 7f8e1ac00640 1 -- start start 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.220+0000 7f8e1ac00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e1413fae0 0x7f8e1413ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e1ac00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e14142150 0x7f8e141e7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e1ac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14160a80 0x7f8e141449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e1ac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8e140cf4a0 con 0x7f8e14160a80 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e1ac00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8e140cf320 con 0x7f8e1413fae0 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e1ac00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8e140cf620 con 0x7f8e14142150 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e18c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14160a80 0x7f8e141449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e18c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14160a80 0x7f8e141449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55918/0 (socket says 172.21.15.99:55918) 2024-09-10T07:34:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e18c00640 1 -- 172.21.15.99:0/2442588745 learned_addr learned my addr 172.21.15.99:0/2442588745 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e13e00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e1413fae0 0x7f8e1413ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e0b400640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e14142150 0x7f8e141e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e18c00640 1 -- 172.21.15.99:0/2442588745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e14142150 msgr2=0x7f8e141e7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e18c00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e14142150 0x7f8e141e7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e18c00640 1 -- 172.21.15.99:0/2442588745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e1413fae0 msgr2=0x7f8e1413ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e18c00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e1413fae0 0x7f8e1413ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e18c00640 1 -- 172.21.15.99:0/2442588745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e141e7ad0 con 0x7f8e14160a80 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e13e00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e1413fae0 0x7f8e1413ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.221+0000 7f8e0b400640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e14142150 0x7f8e141e7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.222+0000 7f8e18c00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14160a80 0x7f8e141449c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00cb40 tx=0x7f8e0c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.222+0000 7f8e10c00640 1 -- 172.21.15.99:0/2442588745 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c017070 con 0x7f8e14160a80 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.222+0000 7f8e10c00640 1 -- 172.21.15.99:0/2442588745 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0c00aca0 con 0x7f8e14160a80 2024-09-10T07:34:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.222+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2442588745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e141f2660 con 0x7f8e14160a80 2024-09-10T07:34:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.222+0000 7f8e10c00640 1 -- 172.21.15.99:0/2442588745 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c012600 con 0x7f8e14160a80 2024-09-10T07:34:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.222+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2442588745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e141e7790 con 0x7f8e14160a80 2024-09-10T07:34:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.223+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2442588745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e141f2470 con 0x7f8e14160a80 2024-09-10T07:34:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.224+0000 7f8e10c00640 1 -- 172.21.15.99:0/2442588745 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e0c01a070 con 0x7f8e14160a80 2024-09-10T07:34:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.225+0000 7f8e10c00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8df006be30 0x7f8df006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.225+0000 7f8e10c00640 1 -- 172.21.15.99:0/2442588745 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8e0c08abc0 con 0x7f8e14160a80 2024-09-10T07:34:49.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.225+0000 7f8e13e00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8df006be30 0x7f8df006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:49.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.226+0000 7f8e13e00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8df006be30 0x7f8df006e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e140ccf60 tx=0x7f8e04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:49.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.230+0000 7f8e10c00640 1 -- 172.21.15.99:0/2442588745 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e0c058e80 con 0x7f8e14160a80 2024-09-10T07:34:49.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.466+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2442588745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) -- 0x7f8e14160540 con 0x7f8e14160a80 2024-09-10T07:34:49.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.773+0000 7f8e10c00640 1 -- 172.21.15.99:0/2442588745 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v42) ==== 133+0+0 (secure 0 0 0) 0x7f8e0c05d180 con 0x7f8e14160a80 2024-09-10T07:34:49.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.775+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2442588745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8df006be30 msgr2=0x7f8df006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.775+0000 7f8e1ac00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8df006be30 0x7f8df006e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e140ccf60 tx=0x7f8e04009040 comp rx=0 tx=0).stop 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.775+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2442588745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14160a80 msgr2=0x7f8e141449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.775+0000 7f8e1ac00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14160a80 0x7f8e141449c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00cb40 tx=0x7f8e0c00a060 comp rx=0 tx=0).stop 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.775+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2442588745 shutdown_connections 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.775+0000 7f8e1ac00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8df006be30 0x7f8df006e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.776+0000 7f8e1ac00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14160a80 0x7f8e141449c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.776+0000 7f8e1ac00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e14142150 0x7f8e141e7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.776+0000 7f8e1ac00640 1 --2- 172.21.15.99:0/2442588745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e1413fae0 0x7f8e1413ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.776+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2442588745 >> 172.21.15.99:0/2442588745 conn(0x7f8e1406bc10 msgr2=0x7f8e1406e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.776+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2442588745 shutdown_connections 2024-09-10T07:34:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:49.776+0000 7f8e1ac00640 1 -- 172.21.15.99:0/2442588745 wait complete. 2024-09-10T07:34:49.792 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-10T07:34:49.960 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_objectstore":"memstore"} 2024-09-10T07:34:49.961 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-10T07:34:49.961 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T07:34:50.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.117+0000 7f9991a00640 1 Processor -- start 2024-09-10T07:34:50.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.117+0000 7f9991a00640 1 -- start start 2024-09-10T07:34:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.118+0000 7f9991a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f998c15e970 0x7f998c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.118+0000 7f9991a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f998c0cfc90 0x7f998c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.118+0000 7f9991a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998c0d2bd0 con 0x7f998c0d2680 2024-09-10T07:34:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.118+0000 7f9991a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f998c0d37e0 con 0x7f998c15e970 2024-09-10T07:34:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.118+0000 7f9991a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f998c0d2eb0 con 0x7f998c0cfc90 2024-09-10T07:34:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.119+0000 7f998be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f998c15e970 0x7f998c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.119+0000 7f998b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f998c0d2680 0x7f998c0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38460/0 (socket says 172.21.15.99:38460) 2024-09-10T07:34:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.119+0000 7f998b400640 1 -- 172.21.15.99:0/1577203085 learned_addr learned my addr 172.21.15.99:0/1577203085 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.119+0000 7f9991000640 1 --2- 172.21.15.99:0/1577203085 >> v2:172.21.15.187:3300/0 conn(0x7f998c0cfc90 0x7f998c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.119+0000 7f998be00640 1 -- 172.21.15.99:0/1577203085 >> v2:172.21.15.187:3300/0 conn(0x7f998c0cfc90 msgr2=0x7f998c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:50.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.119+0000 7f998be00640 1 --2- 172.21.15.99:0/1577203085 >> v2:172.21.15.187:3300/0 conn(0x7f998c0cfc90 0x7f998c0c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.119+0000 7f998be00640 1 -- 172.21.15.99:0/1577203085 >> v1:172.21.15.99:6789/0 conn(0x7f998c0d2680 legacy=0x7f998c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.119+0000 7f998be00640 1 -- 172.21.15.99:0/1577203085 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998c0d3190 con 0x7f998c15e970 2024-09-10T07:34:50.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.119+0000 7f998aa00640 1 -- 172.21.15.99:0/1577203085 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1203764306 0 0) 0x7f998c0d2bd0 con 0x7f998c0d2680 2024-09-10T07:34:50.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.120+0000 7f998be00640 1 --2- 172.21.15.99:0/1577203085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c15e970 0x7f998c0d0300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f998c08e9c0 tx=0x7f997c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1c497663c8530c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:50.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.120+0000 7f998aa00640 1 -- 172.21.15.99:0/1577203085 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c037070 con 0x7f998c15e970 2024-09-10T07:34:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.120+0000 7f998aa00640 1 -- 172.21.15.99:0/1577203085 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997c032440 con 0x7f998c15e970 2024-09-10T07:34:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.120+0000 7f998aa00640 1 -- 172.21.15.99:0/1577203085 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c032810 con 0x7f998c15e970 2024-09-10T07:34:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.121+0000 7f9991a00640 1 -- 172.21.15.99:0/1577203085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c15e970 msgr2=0x7f998c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.121+0000 7f9991a00640 1 --2- 172.21.15.99:0/1577203085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c15e970 0x7f998c0d0300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f998c08e9c0 tx=0x7f997c02a250 comp rx=0 tx=0).stop 2024-09-10T07:34:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.121+0000 7f9991a00640 1 -- 172.21.15.99:0/1577203085 shutdown_connections 2024-09-10T07:34:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.121+0000 7f9991a00640 1 --2- 172.21.15.99:0/1577203085 >> v2:172.21.15.187:3300/0 conn(0x7f998c0cfc90 0x7f998c0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.121+0000 7f9991a00640 1 --2- 172.21.15.99:0/1577203085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c15e970 0x7f998c0d0300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.121+0000 7f9991a00640 1 -- 172.21.15.99:0/1577203085 >> 172.21.15.99:0/1577203085 conn(0x7f998c09de00 msgr2=0x7f998c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.121+0000 7f9991a00640 1 -- 172.21.15.99:0/1577203085 shutdown_connections 2024-09-10T07:34:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.121+0000 7f9991a00640 1 -- 172.21.15.99:0/1577203085 wait complete. 2024-09-10T07:34:50.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.123+0000 7f9991a00640 1 Processor -- start 2024-09-10T07:34:50.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.123+0000 7f9991a00640 1 -- start start 2024-09-10T07:34:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f9991a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c0cfc90 0x7f998c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f9991a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c0d2680 0x7f998c1619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f9991a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f998c15e970 0x7f998c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f9991a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f998c15ed50 con 0x7f998c0cfc90 2024-09-10T07:34:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f9991a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f998c0d0840 con 0x7f998c15e970 2024-09-10T07:34:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f9991a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f998c15eed0 con 0x7f998c0d2680 2024-09-10T07:34:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f998be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c0cfc90 0x7f998c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f998be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c0cfc90 0x7f998c152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53524/0 (socket says 172.21.15.99:53524) 2024-09-10T07:34:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f998be00640 1 -- 172.21.15.99:0/2022090823 learned_addr learned my addr 172.21.15.99:0/2022090823 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f9991000640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f998c15e970 0x7f998c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f998b400640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c0d2680 0x7f998c1619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f998be00640 1 -- 172.21.15.99:0/2022090823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c0d2680 msgr2=0x7f998c1619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f998be00640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c0d2680 0x7f998c1619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f998be00640 1 -- 172.21.15.99:0/2022090823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f998c15e970 msgr2=0x7f998c06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f998be00640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f998c15e970 0x7f998c06d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.124+0000 7f998be00640 1 -- 172.21.15.99:0/2022090823 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998c0cc040 con 0x7f998c0cfc90 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.125+0000 7f998be00640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c0cfc90 0x7f998c152fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f997c000c00 tx=0x7f997c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.125+0000 7f9983e00640 1 -- 172.21.15.99:0/2022090823 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c037050 con 0x7f998c0cfc90 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.125+0000 7f9983e00640 1 -- 172.21.15.99:0/2022090823 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997c038040 con 0x7f998c0cfc90 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.125+0000 7f9983e00640 1 -- 172.21.15.99:0/2022090823 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c004470 con 0x7f998c0cfc90 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.125+0000 7f9991a00640 1 -- 172.21.15.99:0/2022090823 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998c0cc320 con 0x7f998c0cfc90 2024-09-10T07:34:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.125+0000 7f9991a00640 1 -- 172.21.15.99:0/2022090823 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f998c0cc8e0 con 0x7f998c0cfc90 2024-09-10T07:34:50.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.126+0000 7f9991a00640 1 -- 172.21.15.99:0/2022090823 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998c0ccd10 con 0x7f998c0cfc90 2024-09-10T07:34:50.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.127+0000 7f9983e00640 1 -- 172.21.15.99:0/2022090823 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f997c030900 con 0x7f998c0cfc90 2024-09-10T07:34:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.128+0000 7f9983e00640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f996c06be30 0x7f996c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.128+0000 7f9983e00640 1 -- 172.21.15.99:0/2022090823 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f997c0ab920 con 0x7f998c0cfc90 2024-09-10T07:34:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.128+0000 7f998b400640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f996c06be30 0x7f996c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.129+0000 7f998b400640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f996c06be30 0x7f996c06e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f998c15e360 tx=0x7f9978007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:50.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.132+0000 7f9983e00640 1 -- 172.21.15.99:0/2022090823 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f997c07a3e0 con 0x7f998c0cfc90 2024-09-10T07:34:50.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.302+0000 7f9991a00640 1 -- 172.21.15.99:0/2022090823 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f998c0d0300 con 0x7f998c0cfc90 2024-09-10T07:34:50.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.306+0000 7f9983e00640 1 -- 172.21.15.99:0/2022090823 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) ==== 122+0+0 (secure 0 0 0) 0x7f997c079ce0 con 0x7f998c0cfc90 2024-09-10T07:34:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 -- 172.21.15.99:0/2022090823 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f996c06be30 msgr2=0x7f996c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f996c06be30 0x7f996c06e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f998c15e360 tx=0x7f9978007b50 comp rx=0 tx=0).stop 2024-09-10T07:34:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 -- 172.21.15.99:0/2022090823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c0cfc90 msgr2=0x7f998c152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c0cfc90 0x7f998c152fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f997c000c00 tx=0x7f997c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 -- 172.21.15.99:0/2022090823 shutdown_connections 2024-09-10T07:34:50.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f998c15e970 0x7f998c06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c0d2680 0x7f998c1619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f996c06be30 0x7f996c06e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 --2- 172.21.15.99:0/2022090823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f998c0cfc90 0x7f998c152fc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 -- 172.21.15.99:0/2022090823 >> 172.21.15.99:0/2022090823 conn(0x7f998c09de00 msgr2=0x7f998c0c8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:50.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 -- 172.21.15.99:0/2022090823 shutdown_connections 2024-09-10T07:34:50.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.309+0000 7f9991a00640 1 -- 172.21.15.99:0/2022090823 wait complete. 2024-09-10T07:34:50.325 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:34:50.325 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:34:50.417 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:34:50.512 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:34:50.512 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:50.512 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:50.548 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:50.548 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:50.624 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:50.624 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:50.700 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:34:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.895+0000 7f26f5c00640 1 Processor -- start 2024-09-10T07:34:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.895+0000 7f26f5c00640 1 -- start start 2024-09-10T07:34:50.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26f5c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 0x7f26f006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26f5c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f00d0c50 con 0x7f26f00d2a50 2024-09-10T07:34:50.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26f5c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f00d0f30 con 0x7f26f015eb10 2024-09-10T07:34:50.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26f5c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f26f00d1210 con 0x7f26f00d1cf0 2024-09-10T07:34:50.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26e7400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f26f00d2a50 0x7f26f006e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38470/0 (socket says 172.21.15.99:38470) 2024-09-10T07:34:50.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26e7400640 1 -- 172.21.15.99:0/1838763030 learned_addr learned my addr 172.21.15.99:0/1838763030 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:50.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26f5200640 1 --2- 172.21.15.99:0/1838763030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 0x7f26f006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26ef400640 1 -- 172.21.15.99:0/1838763030 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405450477 0 0) 0x7f26f00d0c50 con 0x7f26f00d2a50 2024-09-10T07:34:50.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26ef400640 1 -- 172.21.15.99:0/1838763030 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26d4003520 con 0x7f26f00d2a50 2024-09-10T07:34:50.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26ef400640 1 -- 172.21.15.99:0/1838763030 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1279393856 0 0) 0x7f26f00d0f30 con 0x7f26f015eb10 2024-09-10T07:34:50.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.897+0000 7f26ef400640 1 -- 172.21.15.99:0/1838763030 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26f00d0c50 con 0x7f26f015eb10 2024-09-10T07:34:50.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.898+0000 7f26f5200640 1 -- 172.21.15.99:0/1838763030 >> v1:172.21.15.187:6789/0 conn(0x7f26f015eb10 legacy=0x7f26f00d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.898+0000 7f26f5200640 1 -- 172.21.15.99:0/1838763030 >> v1:172.21.15.99:6789/0 conn(0x7f26f00d2a50 legacy=0x7f26f006e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.898+0000 7f26f5200640 1 -- 172.21.15.99:0/1838763030 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f00d14f0 con 0x7f26f00d1cf0 2024-09-10T07:34:50.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.899+0000 7f26f5200640 1 --2- 172.21.15.99:0/1838763030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 0x7f26f006f5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009dc0 tx=0x7f26e802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae984160e17a4952 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:50.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.899+0000 7f26ef400640 1 -- 172.21.15.99:0/1838763030 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8007740 con 0x7f26f00d1cf0 2024-09-10T07:34:50.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.899+0000 7f26ef400640 1 -- 172.21.15.99:0/1838763030 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e80078e0 con 0x7f26f00d1cf0 2024-09-10T07:34:50.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.899+0000 7f26ef400640 1 -- 172.21.15.99:0/1838763030 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8007cb0 con 0x7f26f00d1cf0 2024-09-10T07:34:50.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.899+0000 7f26f5c00640 1 -- 172.21.15.99:0/1838763030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 msgr2=0x7f26f006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.899+0000 7f26f5c00640 1 --2- 172.21.15.99:0/1838763030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 0x7f26f006f5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009dc0 tx=0x7f26e802a6d0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.899+0000 7f26f5c00640 1 -- 172.21.15.99:0/1838763030 shutdown_connections 2024-09-10T07:34:50.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.899+0000 7f26f5c00640 1 --2- 172.21.15.99:0/1838763030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 0x7f26f006f5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.899+0000 7f26f5c00640 1 -- 172.21.15.99:0/1838763030 >> 172.21.15.99:0/1838763030 conn(0x7f26f009b9d0 msgr2=0x7f26f009bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:50.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.900+0000 7f26f5c00640 1 -- 172.21.15.99:0/1838763030 shutdown_connections 2024-09-10T07:34:50.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.900+0000 7f26f5c00640 1 -- 172.21.15.99:0/1838763030 wait complete. 2024-09-10T07:34:50.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.901+0000 7f26f5c00640 1 Processor -- start 2024-09-10T07:34:50.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.901+0000 7f26f5c00640 1 -- start start 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.902+0000 7f26f5c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 0x7f26f0160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.902+0000 7f26f5c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26f00d2a50 0x7f26f00ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.902+0000 7f26f5c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26f015eb10 0x7f26f01530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.902+0000 7f26f5c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f26f00d0870 con 0x7f26f015eb10 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.902+0000 7f26f5c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f26f00c7db0 con 0x7f26f00d2a50 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.902+0000 7f26f5c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f26f00d09f0 con 0x7f26f00d1cf0 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.902+0000 7f26f5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26f015eb10 0x7f26f01530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.902+0000 7f26f5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26f015eb10 0x7f26f01530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53536/0 (socket says 172.21.15.99:53536) 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.902+0000 7f26f5200640 1 -- 172.21.15.99:0/904213592 learned_addr learned my addr 172.21.15.99:0/904213592 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.903+0000 7f26e7400640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26f00d2a50 0x7f26f00ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.903+0000 7f26efe00640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 0x7f26f0160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.903+0000 7f26f5200640 1 -- 172.21.15.99:0/904213592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 msgr2=0x7f26f0160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.903+0000 7f26f5200640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 0x7f26f0160560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.903+0000 7f26f5200640 1 -- 172.21.15.99:0/904213592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26f00d2a50 msgr2=0x7f26f00ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:50.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.903+0000 7f26f5200640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26f00d2a50 0x7f26f00ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:50.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.903+0000 7f26f5200640 1 -- 172.21.15.99:0/904213592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f0160aa0 con 0x7f26f015eb10 2024-09-10T07:34:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.903+0000 7f26f5200640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26f015eb10 0x7f26f01530c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009ee0 tx=0x7f26e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.903+0000 7f26ecc00640 1 -- 172.21.15.99:0/904213592 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8040070 con 0x7f26f015eb10 2024-09-10T07:34:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.904+0000 7f26ecc00640 1 -- 172.21.15.99:0/904213592 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e8031bc0 con 0x7f26f015eb10 2024-09-10T07:34:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.904+0000 7f26f5c00640 1 -- 172.21.15.99:0/904213592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f00ce5e0 con 0x7f26f015eb10 2024-09-10T07:34:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.904+0000 7f26ecc00640 1 -- 172.21.15.99:0/904213592 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8009450 con 0x7f26f015eb10 2024-09-10T07:34:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.904+0000 7f26f5c00640 1 -- 172.21.15.99:0/904213592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f015f7a0 con 0x7f26f015eb10 2024-09-10T07:34:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.905+0000 7f26f5c00640 1 -- 172.21.15.99:0/904213592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f00b0150 con 0x7f26f015eb10 2024-09-10T07:34:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.906+0000 7f26ecc00640 1 -- 172.21.15.99:0/904213592 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26e8039040 con 0x7f26f015eb10 2024-09-10T07:34:50.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.906+0000 7f26ecc00640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f26cc06be30 0x7f26cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:50.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.907+0000 7f26ecc00640 1 -- 172.21.15.99:0/904213592 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f26e80ac5d0 con 0x7f26f015eb10 2024-09-10T07:34:50.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.907+0000 7f26efe00640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f26cc06be30 0x7f26cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:50.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.907+0000 7f26efe00640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f26cc06be30 0x7f26cc06e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f26e0007fd0 tx=0x7f26e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:50.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:50.911+0000 7f26ecc00640 1 -- 172.21.15.99:0/904213592 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26e807a800 con 0x7f26f015eb10 2024-09-10T07:34:51.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.094+0000 7f26f5c00640 1 -- 172.21.15.99:0/904213592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f26f00afb90 con 0x7f26f015eb10 2024-09-10T07:34:51.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.094+0000 7f26ecc00640 1 -- 172.21.15.99:0/904213592 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f26e807eb00 con 0x7f26f015eb10 2024-09-10T07:34:51.094 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.096+0000 7f26f5c00640 1 -- 172.21.15.99:0/904213592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f26cc06be30 msgr2=0x7f26cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.096+0000 7f26f5c00640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f26cc06be30 0x7f26cc06e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f26e0007fd0 tx=0x7f26e0009040 comp rx=0 tx=0).stop 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.096+0000 7f26f5c00640 1 -- 172.21.15.99:0/904213592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26f015eb10 msgr2=0x7f26f01530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.096+0000 7f26f5c00640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26f015eb10 0x7f26f01530c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009ee0 tx=0x7f26e8004a40 comp rx=0 tx=0).stop 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.096+0000 7f26f5c00640 1 -- 172.21.15.99:0/904213592 shutdown_connections 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.096+0000 7f26f5c00640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f26cc06be30 0x7f26cc06e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.096+0000 7f26f5c00640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26f015eb10 0x7f26f01530c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.096+0000 7f26f5c00640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26f00d2a50 0x7f26f00ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.096+0000 7f26f5c00640 1 --2- 172.21.15.99:0/904213592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26f00d1cf0 0x7f26f0160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.097+0000 7f26f5c00640 1 -- 172.21.15.99:0/904213592 >> 172.21.15.99:0/904213592 conn(0x7f26f009b9d0 msgr2=0x7f26f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.097+0000 7f26f5c00640 1 -- 172.21.15.99:0/904213592 shutdown_connections 2024-09-10T07:34:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.097+0000 7f26f5c00640 1 -- 172.21.15.99:0/904213592 wait complete. 2024-09-10T07:34:51.112 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:34:51.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:51.112 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-10T07:34:51.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:34:51.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:51.175 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:34:51.232 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:51.232 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:51.272 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:51.272 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:51.350 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:51.350 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:51.427 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:34:51.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.582+0000 7ff0b7e00640 1 Processor -- start 2024-09-10T07:34:51.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.583+0000 7ff0b7e00640 1 -- start start 2024-09-10T07:34:51.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff0b80d5150 0x7ff0b80cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:51.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff0b80cfd50 0x7ff0b80b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:51.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b815f0f0 con 0x7ff0b815ed10 2024-09-10T07:34:51.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b80b4c70 con 0x7ff0b80cfd50 2024-09-10T07:34:51.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b80d0580 con 0x7ff0b80d5150 2024-09-10T07:34:51.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff0b80cfd50 0x7ff0b80b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:51.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff0b80cfd50 0x7ff0b80b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53550/0 (socket says 172.21.15.99:53550) 2024-09-10T07:34:51.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7400640 1 -- 172.21.15.99:0/168479104 learned_addr learned my addr 172.21.15.99:0/168479104 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:51.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0ae000640 1 --2- 172.21.15.99:0/168479104 >> v2:172.21.15.187:3300/0 conn(0x7ff0b80d5150 0x7ff0b80cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:51.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7400640 1 -- 172.21.15.99:0/168479104 >> v2:172.21.15.187:3300/0 conn(0x7ff0b80d5150 msgr2=0x7ff0b80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:51.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7400640 1 --2- 172.21.15.99:0/168479104 >> v2:172.21.15.187:3300/0 conn(0x7ff0b80d5150 0x7ff0b80cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7400640 1 -- 172.21.15.99:0/168479104 >> v1:172.21.15.187:6789/0 conn(0x7ff0b815ed10 legacy=0x7ff0b80d4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:51.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.584+0000 7ff0b7400640 1 -- 172.21.15.99:0/168479104 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b80d0860 con 0x7ff0b80cfd50 2024-09-10T07:34:51.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.585+0000 7ff0b7400640 1 --2- 172.21.15.99:0/168479104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b80cfd50 0x7ff0b80b5100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80c8510 tx=0x7ff0b002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec5aa9deb7489aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:51.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b6000640 1 -- 172.21.15.99:0/168479104 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0036070 con 0x7ff0b80cfd50 2024-09-10T07:34:51.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b6000640 1 -- 172.21.15.99:0/168479104 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b0031600 con 0x7ff0b80cfd50 2024-09-10T07:34:51.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b6000640 1 -- 172.21.15.99:0/168479104 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b00319f0 con 0x7ff0b80cfd50 2024-09-10T07:34:51.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b7e00640 1 -- 172.21.15.99:0/168479104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b80cfd50 msgr2=0x7ff0b80b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:51.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b7e00640 1 --2- 172.21.15.99:0/168479104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b80cfd50 0x7ff0b80b5100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80c8510 tx=0x7ff0b002a7c0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b7e00640 1 -- 172.21.15.99:0/168479104 shutdown_connections 2024-09-10T07:34:51.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b7e00640 1 --2- 172.21.15.99:0/168479104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b80cfd50 0x7ff0b80b5100 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b7e00640 1 --2- 172.21.15.99:0/168479104 >> v2:172.21.15.187:3300/0 conn(0x7ff0b80d5150 0x7ff0b80cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b7e00640 1 -- 172.21.15.99:0/168479104 >> 172.21.15.99:0/168479104 conn(0x7ff0b808df60 msgr2=0x7ff0b809dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:51.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b7e00640 1 -- 172.21.15.99:0/168479104 shutdown_connections 2024-09-10T07:34:51.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.586+0000 7ff0b7e00640 1 -- 172.21.15.99:0/168479104 wait complete. 2024-09-10T07:34:51.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.588+0000 7ff0b7e00640 1 Processor -- start 2024-09-10T07:34:51.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.588+0000 7ff0b7e00640 1 -- start start 2024-09-10T07:34:51.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0b7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0b80cfd50 0x7ff0b81530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0b7e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0b80d5150 0x7ff0b815f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b815ed10 0x7ff0b80ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0b7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b80d0360 con 0x7ff0b815ed10 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0b7e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b80d01e0 con 0x7ff0b80d5150 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0b7e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b80b5640 con 0x7ff0b80cfd50 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0b7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b815ed10 0x7ff0b80ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0b7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b815ed10 0x7ff0b80ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53558/0 (socket says 172.21.15.99:53558) 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0b7400640 1 -- 172.21.15.99:0/1944428740 learned_addr learned my addr 172.21.15.99:0/1944428740 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0ae000640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0b80d5150 0x7ff0b815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.589+0000 7ff0b6a00640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0b80cfd50 0x7ff0b81530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0b7400640 1 -- 172.21.15.99:0/1944428740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0b80cfd50 msgr2=0x7ff0b81530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0b7400640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0b80cfd50 0x7ff0b81530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0b7400640 1 -- 172.21.15.99:0/1944428740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0b80d5150 msgr2=0x7ff0b815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0b7400640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0b80d5150 0x7ff0b815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0b7400640 1 -- 172.21.15.99:0/1944428740 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b815fc20 con 0x7ff0b815ed10 2024-09-10T07:34:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0b6a00640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0b80cfd50 0x7ff0b81530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0ae000640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0b80d5150 0x7ff0b815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:51.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0b7400640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b815ed10 0x7ff0b80ca080 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff0b002adb0 tx=0x7ff0b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:51.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0af400640 1 -- 172.21.15.99:0/1944428740 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0036050 con 0x7ff0b815ed10 2024-09-10T07:34:51.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0af400640 1 -- 172.21.15.99:0/1944428740 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b0037040 con 0x7ff0b815ed10 2024-09-10T07:34:51.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0af400640 1 -- 172.21.15.99:0/1944428740 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0009510 con 0x7ff0b815ed10 2024-09-10T07:34:51.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0b7e00640 1 -- 172.21.15.99:0/1944428740 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b815ff00 con 0x7ff0b815ed10 2024-09-10T07:34:51.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.590+0000 7ff0b7e00640 1 -- 172.21.15.99:0/1944428740 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b81607a0 con 0x7ff0b815ed10 2024-09-10T07:34:51.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.591+0000 7ff0b7e00640 1 -- 172.21.15.99:0/1944428740 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b81609a0 con 0x7ff0b815ed10 2024-09-10T07:34:51.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.592+0000 7ff0af400640 1 -- 172.21.15.99:0/1944428740 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0b0044020 con 0x7ff0b815ed10 2024-09-10T07:34:51.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.593+0000 7ff0af400640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff09406be30 0x7ff09406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:51.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.593+0000 7ff0af400640 1 -- 172.21.15.99:0/1944428740 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff0b00ab320 con 0x7ff0b815ed10 2024-09-10T07:34:51.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.593+0000 7ff0b6a00640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff09406be30 0x7ff09406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:51.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.594+0000 7ff0b6a00640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff09406be30 0x7ff09406e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8001660 tx=0x7ff0a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:51.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.597+0000 7ff0af400640 1 -- 172.21.15.99:0/1944428740 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0b81609a0 con 0x7ff0b815ed10 2024-09-10T07:34:51.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.783+0000 7ff0b7e00640 1 -- 172.21.15.99:0/1944428740 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff0b806df60 con 0x7ff0b815ed10 2024-09-10T07:34:51.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.784+0000 7ff0af400640 1 -- 172.21.15.99:0/1944428740 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7ff0b004b020 con 0x7ff0b815ed10 2024-09-10T07:34:51.784 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:34:51.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.786+0000 7ff0b7e00640 1 -- 172.21.15.99:0/1944428740 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff09406be30 msgr2=0x7ff09406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.786+0000 7ff0b7e00640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff09406be30 0x7ff09406e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8001660 tx=0x7ff0a8009040 comp rx=0 tx=0).stop 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.786+0000 7ff0b7e00640 1 -- 172.21.15.99:0/1944428740 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b815ed10 msgr2=0x7ff0b80ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.786+0000 7ff0b7e00640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b815ed10 0x7ff0b80ca080 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff0b002adb0 tx=0x7ff0b0004a40 comp rx=0 tx=0).stop 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.786+0000 7ff0b7e00640 1 -- 172.21.15.99:0/1944428740 shutdown_connections 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.786+0000 7ff0b7e00640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff09406be30 0x7ff09406e2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.786+0000 7ff0b7e00640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0b815ed10 0x7ff0b80ca080 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.786+0000 7ff0b7e00640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0b80d5150 0x7ff0b815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.786+0000 7ff0b7e00640 1 --2- 172.21.15.99:0/1944428740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0b80cfd50 0x7ff0b81530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.786+0000 7ff0b7e00640 1 -- 172.21.15.99:0/1944428740 >> 172.21.15.99:0/1944428740 conn(0x7ff0b808df60 msgr2=0x7ff0b80cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.787+0000 7ff0b7e00640 1 -- 172.21.15.99:0/1944428740 shutdown_connections 2024-09-10T07:34:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:51.787+0000 7ff0b7e00640 1 -- 172.21.15.99:0/1944428740 wait complete. 2024-09-10T07:34:51.802 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:34:51.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:51.803 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-10T07:34:51.868 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:34:51.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:51.868 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:34:51.921 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:51.922 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:51.957 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:51.958 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:52.033 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:34:52.034 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:52.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:34:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.305+0000 7f12cbe00640 1 Processor -- start 2024-09-10T07:34:52.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.305+0000 7f12cbe00640 1 -- start start 2024-09-10T07:34:52.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.306+0000 7f12cbe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0b6110 0x7f12cc0cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.306+0000 7f12cbe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12cc15f0f0 con 0x7f12cc15ed10 2024-09-10T07:34:52.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.306+0000 7f12cbe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12cc0d0580 con 0x7f12cc0d5150 2024-09-10T07:34:52.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.306+0000 7f12cbe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f12cc0b4c70 con 0x7f12cc0b6110 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12caa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f12cc15ed10 0x7f12cc0d4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38482/0 (socket says 172.21.15.99:38482) 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12caa00640 1 -- 172.21.15.99:0/3861618827 learned_addr learned my addr 172.21.15.99:0/3861618827 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12cb400640 1 --2- 172.21.15.99:0/3861618827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0b6110 0x7f12cc0cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12ca000640 1 -- 172.21.15.99:0/3861618827 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291286126 0 0) 0x7f12cc15f0f0 con 0x7f12cc15ed10 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12ca000640 1 -- 172.21.15.99:0/3861618827 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12b0003520 con 0x7f12cc15ed10 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12ca000640 1 -- 172.21.15.99:0/3861618827 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750514701 0 0) 0x7f12cc0d0580 con 0x7f12cc0d5150 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12ca000640 1 -- 172.21.15.99:0/3861618827 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12cc15f0f0 con 0x7f12cc0d5150 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12ca000640 1 -- 172.21.15.99:0/3861618827 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3702394980 0 0) 0x7f12b0003520 con 0x7f12cc15ed10 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12cb400640 1 -- 172.21.15.99:0/3861618827 >> v1:172.21.15.187:6789/0 conn(0x7f12cc0d5150 legacy=0x7f12cc0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12cb400640 1 -- 172.21.15.99:0/3861618827 >> v1:172.21.15.99:6789/0 conn(0x7f12cc15ed10 legacy=0x7f12cc0d4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.307+0000 7f12cb400640 1 -- 172.21.15.99:0/3861618827 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc0d0860 con 0x7f12cc0b6110 2024-09-10T07:34:52.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.308+0000 7f12cb400640 1 --2- 172.21.15.99:0/3861618827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0b6110 0x7f12cc0cff20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f12c4009dc0 tx=0x7f12c402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e187aefe9fc88a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:52.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.309+0000 7f12ca000640 1 -- 172.21.15.99:0/3861618827 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc001670 con 0x7f12cc0b6110 2024-09-10T07:34:52.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.309+0000 7f12ca000640 1 -- 172.21.15.99:0/3861618827 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c402ae50 con 0x7f12cc0b6110 2024-09-10T07:34:52.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.309+0000 7f12ca000640 1 -- 172.21.15.99:0/3861618827 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4007740 con 0x7f12cc0b6110 2024-09-10T07:34:52.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.309+0000 7f12cbe00640 1 -- 172.21.15.99:0/3861618827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0b6110 msgr2=0x7f12cc0cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.309+0000 7f12cbe00640 1 --2- 172.21.15.99:0/3861618827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0b6110 0x7f12cc0cff20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f12c4009dc0 tx=0x7f12c402a6f0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.309+0000 7f12cbe00640 1 -- 172.21.15.99:0/3861618827 shutdown_connections 2024-09-10T07:34:52.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.309+0000 7f12cbe00640 1 --2- 172.21.15.99:0/3861618827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0b6110 0x7f12cc0cff20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.309+0000 7f12cbe00640 1 -- 172.21.15.99:0/3861618827 >> 172.21.15.99:0/3861618827 conn(0x7f12cc08df60 msgr2=0x7f12cc09dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:52.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.309+0000 7f12cbe00640 1 -- 172.21.15.99:0/3861618827 shutdown_connections 2024-09-10T07:34:52.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.309+0000 7f12cbe00640 1 -- 172.21.15.99:0/3861618827 wait complete. 2024-09-10T07:34:52.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.311+0000 7f12cbe00640 1 Processor -- start 2024-09-10T07:34:52.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.311+0000 7f12cbe00640 1 -- start start 2024-09-10T07:34:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12cbe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12cc0b6110 0x7f12cc14dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12cbe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0d5150 0x7f12cc1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12cbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12cc15ed10 0x7f12cc1606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12cbe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc1699e0 con 0x7f12cc15ed10 2024-09-10T07:34:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12cbe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc169860 con 0x7f12cc0b6110 2024-09-10T07:34:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12cbe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f12cc169b60 con 0x7f12cc0d5150 2024-09-10T07:34:52.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12cb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12cc15ed10 0x7f12cc1606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12cb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12cc15ed10 0x7f12cc1606a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53562/0 (socket says 172.21.15.99:53562) 2024-09-10T07:34:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12cb400640 1 -- 172.21.15.99:0/2034354187 learned_addr learned my addr 172.21.15.99:0/2034354187 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12caa00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12cc0b6110 0x7f12cc14dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.312+0000 7f12c3e00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0d5150 0x7f12cc1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12cb400640 1 -- 172.21.15.99:0/2034354187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0d5150 msgr2=0x7f12cc1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12cb400640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0d5150 0x7f12cc1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12cb400640 1 -- 172.21.15.99:0/2034354187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12cc0b6110 msgr2=0x7f12cc14dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12cb400640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12cc0b6110 0x7f12cc14dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12cb400640 1 -- 172.21.15.99:0/2034354187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc15f320 con 0x7f12cc15ed10 2024-09-10T07:34:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12cb400640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12cc15ed10 0x7f12cc1606a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12c402ace0 tx=0x7f12c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12c2a00640 1 -- 172.21.15.99:0/2034354187 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4041030 con 0x7f12cc15ed10 2024-09-10T07:34:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12c2a00640 1 -- 172.21.15.99:0/2034354187 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c403c630 con 0x7f12cc15ed10 2024-09-10T07:34:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12c2a00640 1 -- 172.21.15.99:0/2034354187 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c403ca00 con 0x7f12cc15ed10 2024-09-10T07:34:52.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12cbe00640 1 -- 172.21.15.99:0/2034354187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12cc15f600 con 0x7f12cc15ed10 2024-09-10T07:34:52.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.313+0000 7f12cbe00640 1 -- 172.21.15.99:0/2034354187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12cc15fbc0 con 0x7f12cc15ed10 2024-09-10T07:34:52.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.315+0000 7f12cbe00640 1 -- 172.21.15.99:0/2034354187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12cc154a50 con 0x7f12cc15ed10 2024-09-10T07:34:52.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.315+0000 7f12c2a00640 1 -- 172.21.15.99:0/2034354187 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12c4039040 con 0x7f12cc15ed10 2024-09-10T07:34:52.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.316+0000 7f12c2a00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 0x7f12a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.316+0000 7f12c2a00640 1 -- 172.21.15.99:0/2034354187 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f12c40abb20 con 0x7f12cc15ed10 2024-09-10T07:34:52.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.317+0000 7f12caa00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 0x7f12a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.317+0000 7f12caa00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 0x7f12a806e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0017e0 tx=0x7f12bc001610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:52.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.321+0000 7f12c2a00640 1 -- 172.21.15.99:0/2034354187 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12c4079d50 con 0x7f12cc15ed10 2024-09-10T07:34:52.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.506+0000 7f12cbe00640 1 -- 172.21.15.99:0/2034354187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f12cc0d2e30 con 0x7f12cc15ed10 2024-09-10T07:34:52.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.506+0000 7f12c2a00640 1 -- 172.21.15.99:0/2034354187 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f12c407e050 con 0x7f12cc15ed10 2024-09-10T07:34:52.506 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:34:52.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.508+0000 7f12cbe00640 1 -- 172.21.15.99:0/2034354187 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 msgr2=0x7f12a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.508+0000 7f12cbe00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 0x7f12a806e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0017e0 tx=0x7f12bc001610 comp rx=0 tx=0).stop 2024-09-10T07:34:52.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.508+0000 7f12cbe00640 1 -- 172.21.15.99:0/2034354187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12cc15ed10 msgr2=0x7f12cc1606a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.508+0000 7f12cbe00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12cc15ed10 0x7f12cc1606a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12c402ace0 tx=0x7f12c4004a40 comp rx=0 tx=0).stop 2024-09-10T07:34:52.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.508+0000 7f12cbe00640 1 -- 172.21.15.99:0/2034354187 shutdown_connections 2024-09-10T07:34:52.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.508+0000 7f12cbe00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 0x7f12a806e2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.508+0000 7f12cbe00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12cc15ed10 0x7f12cc1606a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.508+0000 7f12cbe00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc0d5150 0x7f12cc1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.508+0000 7f12cbe00640 1 --2- 172.21.15.99:0/2034354187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12cc0b6110 0x7f12cc14dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.508+0000 7f12cbe00640 1 -- 172.21.15.99:0/2034354187 >> 172.21.15.99:0/2034354187 conn(0x7f12cc08df60 msgr2=0x7f12cc1582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:52.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.509+0000 7f12cbe00640 1 -- 172.21.15.99:0/2034354187 shutdown_connections 2024-09-10T07:34:52.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.509+0000 7f12cbe00640 1 -- 172.21.15.99:0/2034354187 wait complete. 2024-09-10T07:34:52.524 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-10T07:34:52.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:52.525 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-10T07:34:52.585 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:34:52.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:52.585 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-10T07:34:52.621 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:52.621 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:52.660 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:52.660 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:52.738 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:34:52.738 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:34:52.817 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:34:52.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.973+0000 7fda76e00640 1 Processor -- start 2024-09-10T07:34:52.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.973+0000 7fda76e00640 1 -- start start 2024-09-10T07:34:52.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.974+0000 7fda76e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700d3070 0x7fda700d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.974+0000 7fda76e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fda7015ed10 0x7fda700d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.974+0000 7fda76e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda700cf740 con 0x7fda700d51a0 2024-09-10T07:34:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.974+0000 7fda76e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fda700d3990 con 0x7fda7015ed10 2024-09-10T07:34:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.974+0000 7fda76e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fda700d08f0 con 0x7fda700d3070 2024-09-10T07:34:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.974+0000 7fda75000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fda7015ed10 0x7fda700d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.975+0000 7fda75000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fda7015ed10 0x7fda700d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53566/0 (socket says 172.21.15.99:53566) 2024-09-10T07:34:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.975+0000 7fda75000640 1 -- 172.21.15.99:0/2448535940 learned_addr learned my addr 172.21.15.99:0/2448535940 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.975+0000 7fda75a00640 1 --2- 172.21.15.99:0/2448535940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700d3070 0x7fda700d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.975+0000 7fda75000640 1 -- 172.21.15.99:0/2448535940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700d3070 msgr2=0x7fda700d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:52.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.975+0000 7fda75000640 1 --2- 172.21.15.99:0/2448535940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700d3070 0x7fda700d3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.975+0000 7fda75000640 1 -- 172.21.15.99:0/2448535940 >> v1:172.21.15.187:6789/0 conn(0x7fda700d51a0 legacy=0x7fda700d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.975+0000 7fda75000640 1 -- 172.21.15.99:0/2448535940 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda700d5910 con 0x7fda7015ed10 2024-09-10T07:34:52.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.975+0000 7fda6fe00640 1 -- 172.21.15.99:0/2448535940 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 864628981 0 0) 0x7fda700cf740 con 0x7fda700d51a0 2024-09-10T07:34:52.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.976+0000 7fda75000640 1 --2- 172.21.15.99:0/2448535940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda7015ed10 0x7fda700d2660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009870 tx=0x7fda5c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4232c5dc9dee51bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:52.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.976+0000 7fda6fe00640 1 -- 172.21.15.99:0/2448535940 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c037070 con 0x7fda7015ed10 2024-09-10T07:34:52.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.976+0000 7fda6fe00640 1 -- 172.21.15.99:0/2448535940 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5c02ae50 con 0x7fda7015ed10 2024-09-10T07:34:52.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.976+0000 7fda6fe00640 1 -- 172.21.15.99:0/2448535940 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c032860 con 0x7fda7015ed10 2024-09-10T07:34:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.977+0000 7fda76e00640 1 -- 172.21.15.99:0/2448535940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda7015ed10 msgr2=0x7fda700d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.977+0000 7fda76e00640 1 --2- 172.21.15.99:0/2448535940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda7015ed10 0x7fda700d2660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009870 tx=0x7fda5c02a300 comp rx=0 tx=0).stop 2024-09-10T07:34:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.977+0000 7fda76e00640 1 -- 172.21.15.99:0/2448535940 shutdown_connections 2024-09-10T07:34:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.977+0000 7fda76e00640 1 --2- 172.21.15.99:0/2448535940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda7015ed10 0x7fda700d2660 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.977+0000 7fda76e00640 1 --2- 172.21.15.99:0/2448535940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700d3070 0x7fda700d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.977+0000 7fda76e00640 1 -- 172.21.15.99:0/2448535940 >> 172.21.15.99:0/2448535940 conn(0x7fda7009dd60 msgr2=0x7fda700d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.977+0000 7fda76e00640 1 -- 172.21.15.99:0/2448535940 shutdown_connections 2024-09-10T07:34:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.977+0000 7fda76e00640 1 -- 172.21.15.99:0/2448535940 wait complete. 2024-09-10T07:34:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.978+0000 7fda76e00640 1 Processor -- start 2024-09-10T07:34:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.979+0000 7fda76e00640 1 -- start start 2024-09-10T07:34:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.979+0000 7fda76e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda700d3070 0x7fda700b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.979+0000 7fda76e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda7015ed10 0x7fda701f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.979+0000 7fda76e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700b4800 0x7fda701f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.979+0000 7fda76e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fda700cfcc0 con 0x7fda700d3070 2024-09-10T07:34:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.979+0000 7fda76e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fda700cf9e0 con 0x7fda7015ed10 2024-09-10T07:34:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.979+0000 7fda76e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fda700d2ba0 con 0x7fda700b4800 2024-09-10T07:34:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda700d3070 0x7fda700b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda700d3070 0x7fda700b6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53582/0 (socket says 172.21.15.99:53582) 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75a00640 1 -- 172.21.15.99:0/2730190538 learned_addr learned my addr 172.21.15.99:0/2730190538 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda76400640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700b4800 0x7fda701f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75000640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda7015ed10 0x7fda701f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75a00640 1 -- 172.21.15.99:0/2730190538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700b4800 msgr2=0x7fda701f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75a00640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700b4800 0x7fda701f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75a00640 1 -- 172.21.15.99:0/2730190538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda7015ed10 msgr2=0x7fda701f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75a00640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda7015ed10 0x7fda701f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75a00640 1 -- 172.21.15.99:0/2730190538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7015d260 con 0x7fda700d3070 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda76400640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700b4800 0x7fda701f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75000640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda7015ed10 0x7fda701f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.980+0000 7fda75a00640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda700d3070 0x7fda700b6e70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda6400e8a0 tx=0x7fda6400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.981+0000 7fda6d600640 1 -- 172.21.15.99:0/2730190538 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64017070 con 0x7fda700d3070 2024-09-10T07:34:52.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.981+0000 7fda6d600640 1 -- 172.21.15.99:0/2730190538 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6400c940 con 0x7fda700d3070 2024-09-10T07:34:52.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.981+0000 7fda6d600640 1 -- 172.21.15.99:0/2730190538 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6400cd30 con 0x7fda700d3070 2024-09-10T07:34:52.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.981+0000 7fda76e00640 1 -- 172.21.15.99:0/2730190538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda700b4cc0 con 0x7fda700d3070 2024-09-10T07:34:52.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.981+0000 7fda76e00640 1 -- 172.21.15.99:0/2730190538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda700a2590 con 0x7fda700d3070 2024-09-10T07:34:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.982+0000 7fda76e00640 1 -- 172.21.15.99:0/2730190538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda700b8d30 con 0x7fda700d3070 2024-09-10T07:34:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.983+0000 7fda6d600640 1 -- 172.21.15.99:0/2730190538 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda6401a070 con 0x7fda700d3070 2024-09-10T07:34:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.984+0000 7fda6d600640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda5006be30 0x7fda5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.984+0000 7fda6d600640 1 -- 172.21.15.99:0/2730190538 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fda6408b0c0 con 0x7fda700d3070 2024-09-10T07:34:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.984+0000 7fda75000640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda5006be30 0x7fda5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.984+0000 7fda75000640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda5006be30 0x7fda5006e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda5c034000 tx=0x7fda5c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:52.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:52.988+0000 7fda6d600640 1 -- 172.21.15.99:0/2730190538 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda64059a60 con 0x7fda700d3070 2024-09-10T07:34:53.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.173+0000 7fda76e00640 1 -- 172.21.15.99:0/2730190538 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fda700d3450 con 0x7fda700d3070 2024-09-10T07:34:53.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.174+0000 7fda6d600640 1 -- 172.21.15.99:0/2730190538 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fda64059360 con 0x7fda700d3070 2024-09-10T07:34:53.174 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:34:53.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 -- 172.21.15.99:0/2730190538 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda5006be30 msgr2=0x7fda5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda5006be30 0x7fda5006e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fda5c034000 tx=0x7fda5c02e000 comp rx=0 tx=0).stop 2024-09-10T07:34:53.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 -- 172.21.15.99:0/2730190538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda700d3070 msgr2=0x7fda700b6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda700d3070 0x7fda700b6e70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda6400e8a0 tx=0x7fda6400ed60 comp rx=0 tx=0).stop 2024-09-10T07:34:53.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 -- 172.21.15.99:0/2730190538 shutdown_connections 2024-09-10T07:34:53.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda700b4800 0x7fda701f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda7015ed10 0x7fda701f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda5006be30 0x7fda5006e2f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 --2- 172.21.15.99:0/2730190538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda700d3070 0x7fda700b6e70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 -- 172.21.15.99:0/2730190538 >> 172.21.15.99:0/2730190538 conn(0x7fda7009dd60 msgr2=0x7fda700b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 -- 172.21.15.99:0/2730190538 shutdown_connections 2024-09-10T07:34:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.176+0000 7fda76e00640 1 -- 172.21.15.99:0/2730190538 wait complete. 2024-09-10T07:34:53.192 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-10T07:34:53.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:53.192 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-10T07:34:53.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:34:53.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:34:53.256 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-10T07:34:53.297 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T07:34:53.298 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:34:53.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.450+0000 7f0e14e00640 1 Processor -- start 2024-09-10T07:34:53.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.451+0000 7f0e14e00640 1 -- start start 2024-09-10T07:34:53.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.452+0000 7f0e14e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 0x7f0e10160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.452+0000 7f0e14e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0e10160a80 0x7f0e100cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.452+0000 7f0e14e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e10142650 con 0x7f0e1013fae0 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.452+0000 7f0e14e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0e100ce780 con 0x7f0e10160a80 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.452+0000 7f0e14e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0e10142930 con 0x7f0e10142150 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.452+0000 7f0e0de00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0e1013fae0 0x7f0e1006f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38494/0 (socket says 172.21.15.99:38494) 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.452+0000 7f0e0de00640 1 -- 172.21.15.99:0/2753858364 learned_addr learned my addr 172.21.15.99:0/2753858364 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.452+0000 7f0e0e800640 1 --2- 172.21.15.99:0/2753858364 >> v2:172.21.15.187:3300/0 conn(0x7f0e10160a80 0x7f0e100cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.452+0000 7f0e0d400640 1 --2- 172.21.15.99:0/2753858364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 0x7f0e10160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.453+0000 7f0e0ca00640 1 -- 172.21.15.99:0/2753858364 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838877621 0 0) 0x7f0e10142650 con 0x7f0e1013fae0 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.453+0000 7f0e0ca00640 1 -- 172.21.15.99:0/2753858364 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0df4003520 con 0x7f0e1013fae0 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.453+0000 7f0e0e800640 1 -- 172.21.15.99:0/2753858364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 msgr2=0x7f0e10160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.453+0000 7f0e0e800640 1 --2- 172.21.15.99:0/2753858364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 0x7f0e10160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.453+0000 7f0e0e800640 1 -- 172.21.15.99:0/2753858364 >> v1:172.21.15.99:6789/0 conn(0x7f0e1013fae0 legacy=0x7f0e1006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.453+0000 7f0e0e800640 1 -- 172.21.15.99:0/2753858364 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e10142c10 con 0x7f0e10160a80 2024-09-10T07:34:53.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.453+0000 7f0e0d400640 1 --2- 172.21.15.99:0/2753858364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 0x7f0e10160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:53.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.454+0000 7f0e0e800640 1 --2- 172.21.15.99:0/2753858364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e10160a80 0x7f0e100cec10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009d90 tx=0x7f0e0802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6f3237b2d72eafe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:53.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.454+0000 7f0e0ca00640 1 -- 172.21.15.99:0/2753858364 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08031600 con 0x7f0e10160a80 2024-09-10T07:34:53.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.454+0000 7f0e0ca00640 1 -- 172.21.15.99:0/2753858364 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e080317a0 con 0x7f0e10160a80 2024-09-10T07:34:53.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.454+0000 7f0e0ca00640 1 -- 172.21.15.99:0/2753858364 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08031b50 con 0x7f0e10160a80 2024-09-10T07:34:53.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.455+0000 7f0e14e00640 1 -- 172.21.15.99:0/2753858364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e10160a80 msgr2=0x7f0e100cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.455+0000 7f0e14e00640 1 --2- 172.21.15.99:0/2753858364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e10160a80 0x7f0e100cec10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009d90 tx=0x7f0e0802a5d0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.455+0000 7f0e14e00640 1 -- 172.21.15.99:0/2753858364 shutdown_connections 2024-09-10T07:34:53.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.455+0000 7f0e14e00640 1 --2- 172.21.15.99:0/2753858364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e10160a80 0x7f0e100cec10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.455+0000 7f0e14e00640 1 --2- 172.21.15.99:0/2753858364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 0x7f0e10160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.455+0000 7f0e14e00640 1 -- 172.21.15.99:0/2753858364 >> 172.21.15.99:0/2753858364 conn(0x7f0e1006bc10 msgr2=0x7f0e1006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:53.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.455+0000 7f0e14e00640 1 -- 172.21.15.99:0/2753858364 shutdown_connections 2024-09-10T07:34:53.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.455+0000 7f0e14e00640 1 -- 172.21.15.99:0/2753858364 wait complete. 2024-09-10T07:34:53.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.457+0000 7f0e14e00640 1 Processor -- start 2024-09-10T07:34:53.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.457+0000 7f0e14e00640 1 -- start start 2024-09-10T07:34:53.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e14e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e1013fae0 0x7f0e1013e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e14e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 0x7f0e1013fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e14e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e10160a80 0x7f0e100b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e14e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0e100cf2d0 con 0x7f0e1013fae0 2024-09-10T07:34:53.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e14e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0e100cf150 con 0x7f0e10160a80 2024-09-10T07:34:53.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e14e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0e100cf450 con 0x7f0e10142150 2024-09-10T07:34:53.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e0de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e1013fae0 0x7f0e1013e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e0de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e1013fae0 0x7f0e1013e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53584/0 (socket says 172.21.15.99:53584) 2024-09-10T07:34:53.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e0de00640 1 -- 172.21.15.99:0/162408316 learned_addr learned my addr 172.21.15.99:0/162408316 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e0d400640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 0x7f0e1013fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e0e800640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e10160a80 0x7f0e100b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e0de00640 1 -- 172.21.15.99:0/162408316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 msgr2=0x7f0e1013fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e0de00640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 0x7f0e1013fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e0de00640 1 -- 172.21.15.99:0/162408316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e10160a80 msgr2=0x7f0e100b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e0de00640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e10160a80 0x7f0e100b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.458+0000 7f0e0de00640 1 -- 172.21.15.99:0/162408316 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e100b4f50 con 0x7f0e1013fae0 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.459+0000 7f0e0de00640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e1013fae0 0x7f0e1013e600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000c430 tx=0x7f0e0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.459+0000 7f0e06000640 1 -- 172.21.15.99:0/162408316 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e00017070 con 0x7f0e1013fae0 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.459+0000 7f0e06000640 1 -- 172.21.15.99:0/162408316 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e00005ce0 con 0x7f0e1013fae0 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.459+0000 7f0e14e00640 1 -- 172.21.15.99:0/162408316 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e100b5230 con 0x7f0e1013fae0 2024-09-10T07:34:53.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.459+0000 7f0e06000640 1 -- 172.21.15.99:0/162408316 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000072f0 con 0x7f0e1013fae0 2024-09-10T07:34:53.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.459+0000 7f0e14e00640 1 -- 172.21.15.99:0/162408316 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1013eb40 con 0x7f0e1013fae0 2024-09-10T07:34:53.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.460+0000 7f0e14e00640 1 -- 172.21.15.99:0/162408316 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e101448d0 con 0x7f0e1013fae0 2024-09-10T07:34:53.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.461+0000 7f0e06000640 1 -- 172.21.15.99:0/162408316 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e0001a070 con 0x7f0e1013fae0 2024-09-10T07:34:53.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.462+0000 7f0e06000640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0df006be30 0x7f0df006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.462+0000 7f0e06000640 1 -- 172.21.15.99:0/162408316 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0e0008a320 con 0x7f0e1013fae0 2024-09-10T07:34:53.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.462+0000 7f0e0d400640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0df006be30 0x7f0df006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.463+0000 7f0e0d400640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0df006be30 0x7f0df006e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009560 tx=0x7f0dfc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:53.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.466+0000 7f0e06000640 1 -- 172.21.15.99:0/162408316 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e000585e0 con 0x7f0e1013fae0 2024-09-10T07:34:53.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.674+0000 7f0e14e00640 1 -- 172.21.15.99:0/162408316 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e10156e10 con 0x7f0e1013fae0 2024-09-10T07:34:53.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.675+0000 7f0e06000640 1 -- 172.21.15.99:0/162408316 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f0e0005c8e0 con 0x7f0e1013fae0 2024-09-10T07:34:53.675 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:53.675 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"btime":"2024-09-10T07:34:22:900404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3627151667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3627151667},{"type":"v1","addr":"172.21.15.99:6835","nonce":3627151667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/72768681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":72768681},{"type":"v1","addr":"172.21.15.99:6837","nonce":72768681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3327861481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3327861481},{"type":"v1","addr":"172.21.15.187:6834","nonce":3327861481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:34:19.275989+0000","modified":"2024-09-10T07:34:22.302078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/4184584284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4184584284},{"type":"v1","addr":"172.21.15.187:6835","nonce":4184584284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-10T07:34:53.675 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-09-10T07:34:53.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 -- 172.21.15.99:0/162408316 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0df006be30 msgr2=0x7f0df006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0df006be30 0x7f0df006e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009560 tx=0x7f0dfc009190 comp rx=0 tx=0).stop 2024-09-10T07:34:53.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 -- 172.21.15.99:0/162408316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e1013fae0 msgr2=0x7f0e1013e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e1013fae0 0x7f0e1013e600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000c430 tx=0x7f0e0000c8f0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 -- 172.21.15.99:0/162408316 shutdown_connections 2024-09-10T07:34:53.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e10160a80 0x7f0e100b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e10142150 0x7f0e1013fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0df006be30 0x7f0df006e2f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 --2- 172.21.15.99:0/162408316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e1013fae0 0x7f0e1013e600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 -- 172.21.15.99:0/162408316 >> 172.21.15.99:0/162408316 conn(0x7f0e1006bc10 msgr2=0x7f0e10074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:53.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 -- 172.21.15.99:0/162408316 shutdown_connections 2024-09-10T07:34:53.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.677+0000 7f0e14e00640 1 -- 172.21.15.99:0/162408316 wait complete. 2024-09-10T07:34:53.694 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:34:53.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.849+0000 7feb51000640 1 Processor -- start 2024-09-10T07:34:53.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.849+0000 7feb51000640 1 -- start start 2024-09-10T07:34:53.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.850+0000 7feb51000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb4c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.850+0000 7feb51000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7feb4c0cfc90 0x7feb4c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.850+0000 7feb51000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb4c0d2bd0 con 0x7feb4c0d2680 2024-09-10T07:34:53.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.850+0000 7feb51000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7feb4c0d37e0 con 0x7feb4c0cfc90 2024-09-10T07:34:53.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.850+0000 7feb51000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7feb4c0d2eb0 con 0x7feb4c15e970 2024-09-10T07:34:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.850+0000 7feb43e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7feb4c0d2680 0x7feb4c0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38504/0 (socket says 172.21.15.99:38504) 2024-09-10T07:34:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.850+0000 7feb43e00640 1 -- 172.21.15.99:0/2040439655 learned_addr learned my addr 172.21.15.99:0/2040439655 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4b400640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb4c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4be00640 1 --2- 172.21.15.99:0/2040439655 >> v2:172.21.15.187:3300/0 conn(0x7feb4c0cfc90 0x7feb4c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435915670 0 0) 0x7feb4c0d2bd0 con 0x7feb4c0d2680 2024-09-10T07:34:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb30003520 con 0x7feb4c0d2680 2024-09-10T07:34:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2485873242 0 0) 0x7feb30003520 con 0x7feb4c0d2680 2024-09-10T07:34:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 msgr2=0x7feb4c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb4c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 >> v2:172.21.15.187:3300/0 conn(0x7feb4c0cfc90 msgr2=0x7feb4c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:53.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 --2- 172.21.15.99:0/2040439655 >> v2:172.21.15.187:3300/0 conn(0x7feb4c0cfc90 0x7feb4c0c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c0d3190 con 0x7feb4c0d2680 2024-09-10T07:34:53.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7feb34001670 con 0x7feb4c0d2680 2024-09-10T07:34:53.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 >> v1:172.21.15.99:6789/0 conn(0x7feb4c0d2680 legacy=0x7feb4c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb30003f80 0x7feb30004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb30004d40 0x7feb300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c0d37e0 con 0x7feb30004d40 2024-09-10T07:34:53.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c0d2eb0 con 0x7feb30003f80 2024-09-10T07:34:53.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7feb3000ba40 con 0x7feb4c15e970 2024-09-10T07:34:53.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.851+0000 7feb4be00640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb30004d40 0x7feb300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.852+0000 7feb43e00640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb30003f80 0x7feb30004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.852+0000 7feb4b400640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.852+0000 7feb4b400640 1 -- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb30003f80 msgr2=0x7feb30004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:53.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.852+0000 7feb4b400640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb30003f80 0x7feb30004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.852+0000 7feb4b400640 1 -- 172.21.15.99:0/2040439655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb30004d40 msgr2=0x7feb300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:53.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.852+0000 7feb4b400640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb30004d40 0x7feb300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.852+0000 7feb4b400640 1 -- 172.21.15.99:0/2040439655 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb30003520 con 0x7feb4c15e970 2024-09-10T07:34:53.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.852+0000 7feb4be00640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb30004d40 0x7feb300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:34:53.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.853+0000 7feb4b400640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb300039b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009ac0 tx=0x7feb30005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab9336dbeda32cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:53.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.853+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c036070 con 0x7feb4c15e970 2024-09-10T07:34:53.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.853+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3c031400 con 0x7feb4c15e970 2024-09-10T07:34:53.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.853+0000 7feb4aa00640 1 -- 172.21.15.99:0/2040439655 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c009690 con 0x7feb4c15e970 2024-09-10T07:34:53.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.854+0000 7feb51000640 1 -- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 msgr2=0x7feb300039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.854+0000 7feb51000640 1 --2- 172.21.15.99:0/2040439655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb300039b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009ac0 tx=0x7feb30005830 comp rx=0 tx=0).stop 2024-09-10T07:34:53.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.854+0000 7feb4be00640 1 -- 172.21.15.99:0/2040439655 reap_dead start 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.854+0000 7feb51000640 1 -- 172.21.15.99:0/2040439655 shutdown_connections 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.854+0000 7feb51000640 1 -- 172.21.15.99:0/2040439655 >> 172.21.15.99:0/2040439655 conn(0x7feb4c09de00 msgr2=0x7feb4c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.854+0000 7feb51000640 1 -- 172.21.15.99:0/2040439655 shutdown_connections 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.854+0000 7feb51000640 1 -- 172.21.15.99:0/2040439655 wait complete. 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.856+0000 7feb51000640 1 Processor -- start 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.856+0000 7feb51000640 1 -- start start 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.856+0000 7feb51000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb4c0b9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.856+0000 7feb51000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb4c160330 0x7feb4c1607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.856+0000 7feb51000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb4c0ccc00 0x7feb4c0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.856+0000 7feb51000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c15eed0 con 0x7feb4c0ccc00 2024-09-10T07:34:53.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.856+0000 7feb51000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c15ed50 con 0x7feb4c160330 2024-09-10T07:34:53.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.856+0000 7feb51000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7feb4c0d0300 con 0x7feb4c15e970 2024-09-10T07:34:53.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.857+0000 7feb4be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb4c0ccc00 0x7feb4c0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.857+0000 7feb4be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb4c0ccc00 0x7feb4c0cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53604/0 (socket says 172.21.15.99:53604) 2024-09-10T07:34:53.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.857+0000 7feb4be00640 1 -- 172.21.15.99:0/767345158 learned_addr learned my addr 172.21.15.99:0/767345158 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:53.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.857+0000 7feb43e00640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb4c160330 0x7feb4c1607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.857+0000 7feb4b400640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb4c0b9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.857+0000 7feb4be00640 1 -- 172.21.15.99:0/767345158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 msgr2=0x7feb4c0b9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.857+0000 7feb4be00640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb4c0b9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.857+0000 7feb4be00640 1 -- 172.21.15.99:0/767345158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb4c160330 msgr2=0x7feb4c1607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:53.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.857+0000 7feb4be00640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb4c160330 0x7feb4c1607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:53.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.857+0000 7feb4be00640 1 -- 172.21.15.99:0/767345158 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c0b7980 con 0x7feb4c0ccc00 2024-09-10T07:34:53.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.858+0000 7feb4be00640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb4c0ccc00 0x7feb4c0cd080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0bab60 tx=0x7feb4400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:53.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.858+0000 7feb43400640 1 -- 172.21.15.99:0/767345158 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb44009c10 con 0x7feb4c0ccc00 2024-09-10T07:34:53.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.858+0000 7feb43400640 1 -- 172.21.15.99:0/767345158 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4400fd90 con 0x7feb4c0ccc00 2024-09-10T07:34:53.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.858+0000 7feb43400640 1 -- 172.21.15.99:0/767345158 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb44003bd0 con 0x7feb4c0ccc00 2024-09-10T07:34:53.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.858+0000 7feb51000640 1 -- 172.21.15.99:0/767345158 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c0b7c60 con 0x7feb4c0ccc00 2024-09-10T07:34:53.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.858+0000 7feb51000640 1 -- 172.21.15.99:0/767345158 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c0b8220 con 0x7feb4c0ccc00 2024-09-10T07:34:53.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.859+0000 7feb51000640 1 -- 172.21.15.99:0/767345158 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4c0d06e0 con 0x7feb4c0ccc00 2024-09-10T07:34:53.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.860+0000 7feb43400640 1 -- 172.21.15.99:0/767345158 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb4401f020 con 0x7feb4c0ccc00 2024-09-10T07:34:53.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.861+0000 7feb43400640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb2806be30 0x7feb2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:53.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.861+0000 7feb43400640 1 -- 172.21.15.99:0/767345158 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feb4408b000 con 0x7feb4c0ccc00 2024-09-10T07:34:53.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.861+0000 7feb4b400640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb2806be30 0x7feb2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:53.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.862+0000 7feb4b400640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb2806be30 0x7feb2806e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb3c033000 tx=0x7feb3c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:53.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:53.865+0000 7feb43400640 1 -- 172.21.15.99:0/767345158 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb44010040 con 0x7feb4c0ccc00 2024-09-10T07:34:54.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.073+0000 7feb51000640 1 -- 172.21.15.99:0/767345158 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb4c0b5ef0 con 0x7feb4c0ccc00 2024-09-10T07:34:54.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.074+0000 7feb43400640 1 -- 172.21.15.99:0/767345158 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7feb440592c0 con 0x7feb4c0ccc00 2024-09-10T07:34:54.074 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:54.074 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"btime":"2024-09-10T07:34:22:900404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3627151667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3627151667},{"type":"v1","addr":"172.21.15.99:6835","nonce":3627151667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/72768681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":72768681},{"type":"v1","addr":"172.21.15.99:6837","nonce":72768681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3327861481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3327861481},{"type":"v1","addr":"172.21.15.187:6834","nonce":3327861481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:34:19.275989+0000","modified":"2024-09-10T07:34:22.302078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/4184584284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4184584284},{"type":"v1","addr":"172.21.15.187:6835","nonce":4184584284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-10T07:34:54.074 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-09-10T07:34:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 -- 172.21.15.99:0/767345158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb2806be30 msgr2=0x7feb2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb2806be30 0x7feb2806e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb3c033000 tx=0x7feb3c008030 comp rx=0 tx=0).stop 2024-09-10T07:34:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 -- 172.21.15.99:0/767345158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb4c0ccc00 msgr2=0x7feb4c0cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb4c0ccc00 0x7feb4c0cd080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0bab60 tx=0x7feb4400f580 comp rx=0 tx=0).stop 2024-09-10T07:34:54.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 -- 172.21.15.99:0/767345158 shutdown_connections 2024-09-10T07:34:54.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb2806be30 0x7feb2806e2f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb4c0ccc00 0x7feb4c0cd080 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb4c160330 0x7feb4c1607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 --2- 172.21.15.99:0/767345158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb4c15e970 0x7feb4c0b9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 -- 172.21.15.99:0/767345158 >> 172.21.15.99:0/767345158 conn(0x7feb4c09de00 msgr2=0x7feb4c0ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:54.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 -- 172.21.15.99:0/767345158 shutdown_connections 2024-09-10T07:34:54.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.076+0000 7feb51000640 1 -- 172.21.15.99:0/767345158 wait complete. 2024-09-10T07:34:54.092 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.246+0000 7ff98ea00640 1 Processor -- start 2024-09-10T07:34:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.246+0000 7ff98ea00640 1 -- start start 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.247+0000 7ff98ea00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff988145290 0x7ff98806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.247+0000 7ff98ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff9880ce780 0x7ff988072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.247+0000 7ff98ea00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff98806e3d0 con 0x7ff988071510 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.247+0000 7ff98ea00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff98806efe0 con 0x7ff9880ce780 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.247+0000 7ff98ea00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff98806e6b0 con 0x7ff988145290 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.248+0000 7ff987400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff9880ce780 0x7ff988072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.248+0000 7ff987400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff9880ce780 0x7ff988072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53618/0 (socket says 172.21.15.99:53618) 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.248+0000 7ff987400640 1 -- 172.21.15.99:0/208489305 learned_addr learned my addr 172.21.15.99:0/208489305 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.248+0000 7ff987e00640 1 --2- 172.21.15.99:0/208489305 >> v2:172.21.15.187:3300/0 conn(0x7ff988145290 0x7ff98806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.248+0000 7ff987400640 1 -- 172.21.15.99:0/208489305 >> v2:172.21.15.187:3300/0 conn(0x7ff988145290 msgr2=0x7ff98806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.248+0000 7ff987400640 1 --2- 172.21.15.99:0/208489305 >> v2:172.21.15.187:3300/0 conn(0x7ff988145290 0x7ff98806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.248+0000 7ff987400640 1 -- 172.21.15.99:0/208489305 >> v1:172.21.15.187:6789/0 conn(0x7ff988071510 legacy=0x7ff9880b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:54.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.248+0000 7ff987400640 1 -- 172.21.15.99:0/208489305 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98806e990 con 0x7ff9880ce780 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.249+0000 7ff987400640 1 --2- 172.21.15.99:0/208489305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 0x7ff988072830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff988075940 tx=0x7ff97402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a613ec96341b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.249+0000 7ff986a00640 1 -- 172.21.15.99:0/208489305 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974037070 con 0x7ff9880ce780 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.249+0000 7ff986a00640 1 -- 172.21.15.99:0/208489305 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff974032440 con 0x7ff9880ce780 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.249+0000 7ff986a00640 1 -- 172.21.15.99:0/208489305 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974032810 con 0x7ff9880ce780 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.250+0000 7ff98ea00640 1 -- 172.21.15.99:0/208489305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 msgr2=0x7ff988072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.250+0000 7ff98ea00640 1 --2- 172.21.15.99:0/208489305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 0x7ff988072830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff988075940 tx=0x7ff97402a230 comp rx=0 tx=0).stop 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.250+0000 7ff98ea00640 1 -- 172.21.15.99:0/208489305 shutdown_connections 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.250+0000 7ff98ea00640 1 --2- 172.21.15.99:0/208489305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 0x7ff988072830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.250+0000 7ff98ea00640 1 --2- 172.21.15.99:0/208489305 >> v2:172.21.15.187:3300/0 conn(0x7ff988145290 0x7ff98806f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.250+0000 7ff98ea00640 1 -- 172.21.15.99:0/208489305 >> 172.21.15.99:0/208489305 conn(0x7ff98806bc10 msgr2=0x7ff98806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.250+0000 7ff98ea00640 1 -- 172.21.15.99:0/208489305 shutdown_connections 2024-09-10T07:34:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.250+0000 7ff98ea00640 1 -- 172.21.15.99:0/208489305 wait complete. 2024-09-10T07:34:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.252+0000 7ff98ea00640 1 Processor -- start 2024-09-10T07:34:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.252+0000 7ff98ea00640 1 -- start start 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff98ea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff988071510 0x7ff98815b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff98ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 0x7ff9881649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff98ea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff988145290 0x7ff9880b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff98ea00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff98806df80 con 0x7ff9880ce780 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff98ea00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff988145670 con 0x7ff988071510 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff98ea00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff98806e100 con 0x7ff988145290 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff987400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 0x7ff9881649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff987400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 0x7ff9881649c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53634/0 (socket says 172.21.15.99:53634) 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff987e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff988071510 0x7ff98815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff987400640 1 -- 172.21.15.99:0/3652261835 learned_addr learned my addr 172.21.15.99:0/3652261835 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff98ca00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff988145290 0x7ff9880b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff987400640 1 -- 172.21.15.99:0/3652261835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff988145290 msgr2=0x7ff9880b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff987400640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff988145290 0x7ff9880b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff987400640 1 -- 172.21.15.99:0/3652261835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff988071510 msgr2=0x7ff98815b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff987400640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff988071510 0x7ff98815b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff987400640 1 -- 172.21.15.99:0/3652261835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9881419b0 con 0x7ff9880ce780 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.253+0000 7ff98ca00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff988145290 0x7ff9880b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.254+0000 7ff987400640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 0x7ff9881649c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff974000c00 tx=0x7ff9740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.254+0000 7ff97fe00640 1 -- 172.21.15.99:0/3652261835 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974041020 con 0x7ff9880ce780 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.254+0000 7ff97fe00640 1 -- 172.21.15.99:0/3652261835 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9740306c0 con 0x7ff9880ce780 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.254+0000 7ff97fe00640 1 -- 172.21.15.99:0/3652261835 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974037040 con 0x7ff9880ce780 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.254+0000 7ff98ea00640 1 -- 172.21.15.99:0/3652261835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff988140220 con 0x7ff9880ce780 2024-09-10T07:34:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.254+0000 7ff98ea00640 1 -- 172.21.15.99:0/3652261835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98813e2f0 con 0x7ff9880ce780 2024-09-10T07:34:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.255+0000 7ff98ea00640 1 -- 172.21.15.99:0/3652261835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98806f470 con 0x7ff9880ce780 2024-09-10T07:34:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.256+0000 7ff97fe00640 1 -- 172.21.15.99:0/3652261835 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff974044020 con 0x7ff9880ce780 2024-09-10T07:34:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.257+0000 7ff97fe00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff96806be30 0x7ff96806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.257+0000 7ff97fe00640 1 -- 172.21.15.99:0/3652261835 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff9740ab700 con 0x7ff9880ce780 2024-09-10T07:34:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.257+0000 7ff987e00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff96806be30 0x7ff96806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.258+0000 7ff987e00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff96806be30 0x7ff96806e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff978006fd0 tx=0x7ff978008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:54.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.261+0000 7ff97fe00640 1 -- 172.21.15.99:0/3652261835 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff97404b030 con 0x7ff9880ce780 2024-09-10T07:34:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.437+0000 7ff98ea00640 1 -- 172.21.15.99:0/3652261835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff988068e30 con 0x7ff9880ce780 2024-09-10T07:34:54.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.439+0000 7ff97fe00640 1 -- 172.21.15.99:0/3652261835 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7ff97407a010 con 0x7ff9880ce780 2024-09-10T07:34:54.439 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:54.439 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:20.870081+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:34:17.274179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:34:18.279150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 -- 172.21.15.99:0/3652261835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff96806be30 msgr2=0x7ff96806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff96806be30 0x7ff96806e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff978006fd0 tx=0x7ff978008040 comp rx=0 tx=0).stop 2024-09-10T07:34:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 -- 172.21.15.99:0/3652261835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 msgr2=0x7ff9881649c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 0x7ff9881649c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff974000c00 tx=0x7ff9740046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 -- 172.21.15.99:0/3652261835 shutdown_connections 2024-09-10T07:34:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff988145290 0x7ff9880b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff96806be30 0x7ff96806e2f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9880ce780 0x7ff9881649c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 --2- 172.21.15.99:0/3652261835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff988071510 0x7ff98815b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 -- 172.21.15.99:0/3652261835 >> 172.21.15.99:0/3652261835 conn(0x7ff98806bc10 msgr2=0x7ff9880b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 -- 172.21.15.99:0/3652261835 shutdown_connections 2024-09-10T07:34:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.441+0000 7ff98ea00640 1 -- 172.21.15.99:0/3652261835 wait complete. 2024-09-10T07:34:54.458 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:34:54.458 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:34:54.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.611+0000 7f5573e00640 1 Processor -- start 2024-09-10T07:34:54.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.611+0000 7f5573e00640 1 -- start start 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.612+0000 7f5573e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 0x7f55740d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.612+0000 7f5573e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f55740cdf10 0x7f557415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.612+0000 7f5573e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55740d14e0 con 0x7f557415db70 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.612+0000 7f5573e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f55740d0980 con 0x7f55740cdf10 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.612+0000 7f5573e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f55740d06a0 con 0x7f55740d0bc0 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.612+0000 7f5573400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f557415db70 0x7f55740ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38508/0 (socket says 172.21.15.99:38508) 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.612+0000 7f5573400640 1 -- 172.21.15.99:0/1831013952 learned_addr learned my addr 172.21.15.99:0/1831013952 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.612+0000 7f5572a00640 1 --2- 172.21.15.99:0/1831013952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 0x7f55740d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.612+0000 7f556a000640 1 --2- 172.21.15.99:0/1831013952 >> v2:172.21.15.187:3300/0 conn(0x7f55740cdf10 0x7f557415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.613+0000 7f5572000640 1 -- 172.21.15.99:0/1831013952 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349690262 0 0) 0x7f55740d14e0 con 0x7f557415db70 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.613+0000 7f5572000640 1 -- 172.21.15.99:0/1831013952 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5558003520 con 0x7f557415db70 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.613+0000 7f5572a00640 1 -- 172.21.15.99:0/1831013952 >> v2:172.21.15.187:3300/0 conn(0x7f55740cdf10 msgr2=0x7f557415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.613+0000 7f5572a00640 1 --2- 172.21.15.99:0/1831013952 >> v2:172.21.15.187:3300/0 conn(0x7f55740cdf10 0x7f557415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.613+0000 7f5572a00640 1 -- 172.21.15.99:0/1831013952 >> v1:172.21.15.99:6789/0 conn(0x7f557415db70 legacy=0x7f55740ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.613+0000 7f5572a00640 1 -- 172.21.15.99:0/1831013952 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55740cd430 con 0x7f55740d0bc0 2024-09-10T07:34:54.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.614+0000 7f5572a00640 1 --2- 172.21.15.99:0/1831013952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 0x7f55740d0fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f55640097a0 tx=0x7f556402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c75f62b3711da55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:54.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.614+0000 7f5572000640 1 -- 172.21.15.99:0/1831013952 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5564037070 con 0x7f55740d0bc0 2024-09-10T07:34:54.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.614+0000 7f5572000640 1 -- 172.21.15.99:0/1831013952 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f556402ae50 con 0x7f55740d0bc0 2024-09-10T07:34:54.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.614+0000 7f5572000640 1 -- 172.21.15.99:0/1831013952 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5564032660 con 0x7f55740d0bc0 2024-09-10T07:34:54.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.615+0000 7f5573e00640 1 -- 172.21.15.99:0/1831013952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 msgr2=0x7f55740d0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.615+0000 7f5573e00640 1 --2- 172.21.15.99:0/1831013952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 0x7f55740d0fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f55640097a0 tx=0x7f556402a100 comp rx=0 tx=0).stop 2024-09-10T07:34:54.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.615+0000 7f5573e00640 1 -- 172.21.15.99:0/1831013952 shutdown_connections 2024-09-10T07:34:54.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.615+0000 7f5573e00640 1 --2- 172.21.15.99:0/1831013952 >> v2:172.21.15.187:3300/0 conn(0x7f55740cdf10 0x7f557415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.615+0000 7f5573e00640 1 --2- 172.21.15.99:0/1831013952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 0x7f55740d0fa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.615+0000 7f5573e00640 1 -- 172.21.15.99:0/1831013952 >> 172.21.15.99:0/1831013952 conn(0x7f55740b4330 msgr2=0x7f55740b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:54.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.615+0000 7f5573e00640 1 -- 172.21.15.99:0/1831013952 shutdown_connections 2024-09-10T07:34:54.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.615+0000 7f5573e00640 1 -- 172.21.15.99:0/1831013952 wait complete. 2024-09-10T07:34:54.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.617+0000 7f5573e00640 1 Processor -- start 2024-09-10T07:34:54.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.617+0000 7f5573e00640 1 -- start start 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.617+0000 7f5573e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55740cdf10 0x7f5574156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 0x7f55740c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f557415db70 0x7f55741565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f55740d0350 con 0x7f557415db70 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f55740cd9f0 con 0x7f55740cdf10 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f55740b1bd0 con 0x7f55740d0bc0 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f557415db70 0x7f55741565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f557415db70 0x7f55741565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53636/0 (socket says 172.21.15.99:53636) 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573400640 1 -- 172.21.15.99:0/4034412380 learned_addr learned my addr 172.21.15.99:0/4034412380 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5572a00640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55740cdf10 0x7f5574156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f556a000640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 0x7f55740c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573400640 1 -- 172.21.15.99:0/4034412380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 msgr2=0x7f55740c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573400640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 0x7f55740c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573400640 1 -- 172.21.15.99:0/4034412380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55740cdf10 msgr2=0x7f5574156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573400640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55740cdf10 0x7f5574156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.618+0000 7f5573400640 1 -- 172.21.15.99:0/4034412380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55740c8150 con 0x7f557415db70 2024-09-10T07:34:54.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.619+0000 7f5573400640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f557415db70 0x7f55741565e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f556c00ca20 tx=0x7f556c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:54.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.619+0000 7f556b400640 1 -- 172.21.15.99:0/4034412380 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c017070 con 0x7f557415db70 2024-09-10T07:34:54.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.619+0000 7f556b400640 1 -- 172.21.15.99:0/4034412380 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f556c00abd0 con 0x7f557415db70 2024-09-10T07:34:54.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.619+0000 7f556b400640 1 -- 172.21.15.99:0/4034412380 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c012400 con 0x7f557415db70 2024-09-10T07:34:54.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.619+0000 7f5573e00640 1 -- 172.21.15.99:0/4034412380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55740cc7f0 con 0x7f557415db70 2024-09-10T07:34:54.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.619+0000 7f5573e00640 1 -- 172.21.15.99:0/4034412380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55740c83d0 con 0x7f557415db70 2024-09-10T07:34:54.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.620+0000 7f5573e00640 1 -- 172.21.15.99:0/4034412380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55740ccd10 con 0x7f557415db70 2024-09-10T07:34:54.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.621+0000 7f556b400640 1 -- 172.21.15.99:0/4034412380 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f556c01a070 con 0x7f557415db70 2024-09-10T07:34:54.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.622+0000 7f556b400640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f555006be30 0x7f555006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:54.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.622+0000 7f556b400640 1 -- 172.21.15.99:0/4034412380 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f556c08ab10 con 0x7f557415db70 2024-09-10T07:34:54.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.622+0000 7f5572a00640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f555006be30 0x7f555006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:54.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.622+0000 7f5572a00640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f555006be30 0x7f555006e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5564034000 tx=0x7f556402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:54.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.626+0000 7f556b400640 1 -- 172.21.15.99:0/4034412380 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55740c8150 con 0x7f557415db70 2024-09-10T07:34:54.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.833+0000 7f5573e00640 1 -- 172.21.15.99:0/4034412380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5574074060 con 0x7f557415db70 2024-09-10T07:34:54.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.834+0000 7f556b400640 1 -- 172.21.15.99:0/4034412380 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f556c058e60 con 0x7f557415db70 2024-09-10T07:34:54.834 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:54.834 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"btime":"2024-09-10T07:34:22:900404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3627151667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3627151667},{"type":"v1","addr":"172.21.15.99:6835","nonce":3627151667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/72768681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":72768681},{"type":"v1","addr":"172.21.15.99:6837","nonce":72768681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3327861481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3327861481},{"type":"v1","addr":"172.21.15.187:6834","nonce":3327861481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:34:19.275989+0000","modified":"2024-09-10T07:34:22.302078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/4184584284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4184584284},{"type":"v1","addr":"172.21.15.187:6835","nonce":4184584284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-10T07:34:54.835 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-09-10T07:34:54.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 -- 172.21.15.99:0/4034412380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f555006be30 msgr2=0x7f555006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f555006be30 0x7f555006e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5564034000 tx=0x7f556402e000 comp rx=0 tx=0).stop 2024-09-10T07:34:54.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 -- 172.21.15.99:0/4034412380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f557415db70 msgr2=0x7f55741565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:54.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f557415db70 0x7f55741565e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f556c00ca20 tx=0x7f556c00cee0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 -- 172.21.15.99:0/4034412380 shutdown_connections 2024-09-10T07:34:54.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f555006be30 0x7f555006e2f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f557415db70 0x7f55741565e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55740d0bc0 0x7f55740c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 --2- 172.21.15.99:0/4034412380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55740cdf10 0x7f5574156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:54.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 -- 172.21.15.99:0/4034412380 >> 172.21.15.99:0/4034412380 conn(0x7f55740b4330 msgr2=0x7f55740b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:54.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 -- 172.21.15.99:0/4034412380 shutdown_connections 2024-09-10T07:34:54.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:54.836+0000 7f5573e00640 1 -- 172.21.15.99:0/4034412380 wait complete. 2024-09-10T07:34:54.852 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:34:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.006+0000 7ff135a00640 1 Processor -- start 2024-09-10T07:34:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.006+0000 7ff135a00640 1 -- start start 2024-09-10T07:34:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.007+0000 7ff135a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 0x7ff1300d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.007+0000 7ff135a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff1300d2680 0x7ff1300cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.007+0000 7ff135a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff1300cfac0 0x7ff1300d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.007+0000 7ff135a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff1300d37e0 con 0x7ff1300cfac0 2024-09-10T07:34:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.007+0000 7ff135a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff1300d2bd0 con 0x7ff1300d2680 2024-09-10T07:34:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.007+0000 7ff135a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff1300d2eb0 con 0x7ff13015e970 2024-09-10T07:34:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.008+0000 7ff135000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff1300cfac0 0x7ff1300d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.008+0000 7ff135000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff1300cfac0 0x7ff1300d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53648/0 (socket says 172.21.15.99:53648) 2024-09-10T07:34:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.008+0000 7ff135000640 1 -- 172.21.15.99:0/2162704342 learned_addr learned my addr 172.21.15.99:0/2162704342 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.008+0000 7ff12fe00640 1 --2- 172.21.15.99:0/2162704342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 0x7ff1300d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.008+0000 7ff12f400640 1 --2- 172.21.15.99:0/2162704342 >> v2:172.21.15.187:3300/0 conn(0x7ff1300d2680 0x7ff1300cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.008+0000 7ff135000640 1 -- 172.21.15.99:0/2162704342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 msgr2=0x7ff1300d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.008+0000 7ff135000640 1 --2- 172.21.15.99:0/2162704342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 0x7ff1300d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.008+0000 7ff135000640 1 -- 172.21.15.99:0/2162704342 >> v2:172.21.15.187:3300/0 conn(0x7ff1300d2680 msgr2=0x7ff1300cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.008+0000 7ff135000640 1 --2- 172.21.15.99:0/2162704342 >> v2:172.21.15.187:3300/0 conn(0x7ff1300d2680 0x7ff1300cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.008+0000 7ff135000640 1 -- 172.21.15.99:0/2162704342 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1300d3190 con 0x7ff1300cfac0 2024-09-10T07:34:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.009+0000 7ff135000640 1 --2- 172.21.15.99:0/2162704342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300cfac0 0x7ff1300d0ff0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff13008dd70 tx=0x7ff12802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81ee0d925ff677d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.009+0000 7ff12ea00640 1 -- 172.21.15.99:0/2162704342 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128036070 con 0x7ff1300cfac0 2024-09-10T07:34:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.009+0000 7ff12ea00640 1 -- 172.21.15.99:0/2162704342 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff128031600 con 0x7ff1300cfac0 2024-09-10T07:34:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.009+0000 7ff12ea00640 1 -- 172.21.15.99:0/2162704342 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1280319d0 con 0x7ff1300cfac0 2024-09-10T07:34:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.011+0000 7ff135a00640 1 -- 172.21.15.99:0/2162704342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300cfac0 msgr2=0x7ff1300d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.011+0000 7ff135a00640 1 --2- 172.21.15.99:0/2162704342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300cfac0 0x7ff1300d0ff0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff13008dd70 tx=0x7ff12802a730 comp rx=0 tx=0).stop 2024-09-10T07:34:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.011+0000 7ff135a00640 1 -- 172.21.15.99:0/2162704342 shutdown_connections 2024-09-10T07:34:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.011+0000 7ff135a00640 1 --2- 172.21.15.99:0/2162704342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300cfac0 0x7ff1300d0ff0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.011+0000 7ff135a00640 1 --2- 172.21.15.99:0/2162704342 >> v2:172.21.15.187:3300/0 conn(0x7ff1300d2680 0x7ff1300cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.011+0000 7ff135a00640 1 --2- 172.21.15.99:0/2162704342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 0x7ff1300d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.011+0000 7ff135a00640 1 -- 172.21.15.99:0/2162704342 >> 172.21.15.99:0/2162704342 conn(0x7ff13009de00 msgr2=0x7ff1300d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.011+0000 7ff135a00640 1 -- 172.21.15.99:0/2162704342 shutdown_connections 2024-09-10T07:34:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.011+0000 7ff135a00640 1 -- 172.21.15.99:0/2162704342 wait complete. 2024-09-10T07:34:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.012+0000 7ff135a00640 1 Processor -- start 2024-09-10T07:34:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.012+0000 7ff135a00640 1 -- start start 2024-09-10T07:34:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff135a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1300cfac0 0x7ff1300b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff135a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300d2680 0x7ff1300cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff135a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 0x7ff1300cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff135a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff1300d0840 con 0x7ff1300d2680 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff135a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff1300cff70 con 0x7ff1300cfac0 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff135a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff13015ed50 con 0x7ff13015e970 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff12f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300d2680 0x7ff1300cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff12f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300d2680 0x7ff1300cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53654/0 (socket says 172.21.15.99:53654) 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff12f400640 1 -- 172.21.15.99:0/3898600873 learned_addr learned my addr 172.21.15.99:0/3898600873 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff12fe00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1300cfac0 0x7ff1300b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff135000640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 0x7ff1300cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff12f400640 1 -- 172.21.15.99:0/3898600873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 msgr2=0x7ff1300cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff12f400640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 0x7ff1300cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff12f400640 1 -- 172.21.15.99:0/3898600873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1300cfac0 msgr2=0x7ff1300b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff12f400640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1300cfac0 0x7ff1300b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff12f400640 1 -- 172.21.15.99:0/3898600873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13015f1e0 con 0x7ff1300d2680 2024-09-10T07:34:55.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff135000640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 0x7ff1300cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:55.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.013+0000 7ff12fe00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1300cfac0 0x7ff1300b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:34:55.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.014+0000 7ff12f400640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300d2680 0x7ff1300cd7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00e9b0 tx=0x7ff11c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:55.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.014+0000 7ff127e00640 1 -- 172.21.15.99:0/3898600873 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c017070 con 0x7ff1300d2680 2024-09-10T07:34:55.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.014+0000 7ff127e00640 1 -- 172.21.15.99:0/3898600873 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11c00c9a0 con 0x7ff1300d2680 2024-09-10T07:34:55.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.014+0000 7ff127e00640 1 -- 172.21.15.99:0/3898600873 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00cd70 con 0x7ff1300d2680 2024-09-10T07:34:55.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.014+0000 7ff135a00640 1 -- 172.21.15.99:0/3898600873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13015f480 con 0x7ff1300d2680 2024-09-10T07:34:55.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.014+0000 7ff135a00640 1 -- 172.21.15.99:0/3898600873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1300b9820 con 0x7ff1300d2680 2024-09-10T07:34:55.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.015+0000 7ff135a00640 1 -- 172.21.15.99:0/3898600873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1300cf580 con 0x7ff1300d2680 2024-09-10T07:34:55.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.016+0000 7ff127e00640 1 -- 172.21.15.99:0/3898600873 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff11c01a070 con 0x7ff1300d2680 2024-09-10T07:34:55.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.017+0000 7ff127e00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff11006be30 0x7ff11006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.017+0000 7ff127e00640 1 -- 172.21.15.99:0/3898600873 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff11c08afc0 con 0x7ff1300d2680 2024-09-10T07:34:55.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.017+0000 7ff12fe00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff11006be30 0x7ff11006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.018+0000 7ff12fe00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff11006be30 0x7ff11006e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff120009a40 tx=0x7ff120008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:55.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.021+0000 7ff127e00640 1 -- 172.21.15.99:0/3898600873 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff11c059840 con 0x7ff1300d2680 2024-09-10T07:34:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.229+0000 7ff135a00640 1 -- 172.21.15.99:0/3898600873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff13006c460 con 0x7ff1300d2680 2024-09-10T07:34:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.229+0000 7ff127e00640 1 -- 172.21.15.99:0/3898600873 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7ff11c059140 con 0x7ff1300d2680 2024-09-10T07:34:55.228 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:55.229 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":8,"btime":"2024-09-10T07:34:22:900404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3627151667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3627151667},{"type":"v1","addr":"172.21.15.99:6835","nonce":3627151667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/72768681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":72768681},{"type":"v1","addr":"172.21.15.99:6837","nonce":72768681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3327861481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3327861481},{"type":"v1","addr":"172.21.15.187:6834","nonce":3327861481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:34:19.275989+0000","modified":"2024-09-10T07:34:22.302078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/4184584284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4184584284},{"type":"v1","addr":"172.21.15.187:6835","nonce":4184584284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-10T07:34:55.229 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 8 2024-09-10T07:34:55.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 -- 172.21.15.99:0/3898600873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff11006be30 msgr2=0x7ff11006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff11006be30 0x7ff11006e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff120009a40 tx=0x7ff120008040 comp rx=0 tx=0).stop 2024-09-10T07:34:55.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 -- 172.21.15.99:0/3898600873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300d2680 msgr2=0x7ff1300cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300d2680 0x7ff1300cd7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00e9b0 tx=0x7ff11c00ee70 comp rx=0 tx=0).stop 2024-09-10T07:34:55.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 -- 172.21.15.99:0/3898600873 shutdown_connections 2024-09-10T07:34:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff13015e970 0x7ff1300cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff11006be30 0x7ff11006e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1300d2680 0x7ff1300cd7a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 --2- 172.21.15.99:0/3898600873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1300cfac0 0x7ff1300b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 -- 172.21.15.99:0/3898600873 >> 172.21.15.99:0/3898600873 conn(0x7ff13009de00 msgr2=0x7ff1300c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 -- 172.21.15.99:0/3898600873 shutdown_connections 2024-09-10T07:34:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.230+0000 7ff135a00640 1 -- 172.21.15.99:0/3898600873 wait complete. 2024-09-10T07:34:55.246 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:34:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.402+0000 7f9170c00640 1 Processor -- start 2024-09-10T07:34:55.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.402+0000 7f9170c00640 1 -- start start 2024-09-10T07:34:55.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.402+0000 7f9170c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f916c15e970 0x7f916c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.402+0000 7f9170c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f916c0cfc90 0x7f916c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.402+0000 7f9170c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f916c0d2bd0 con 0x7f916c0d2680 2024-09-10T07:34:55.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.402+0000 7f9170c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f916c0d37e0 con 0x7f916c15e970 2024-09-10T07:34:55.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.402+0000 7f9170c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f916c0d2eb0 con 0x7f916c0cfc90 2024-09-10T07:34:55.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.402+0000 7f916b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f916c15e970 0x7f916c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.402+0000 7f916b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f916c15e970 0x7f916c0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53666/0 (socket says 172.21.15.99:53666) 2024-09-10T07:34:55.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.403+0000 7f916b400640 1 -- 172.21.15.99:0/396350851 learned_addr learned my addr 172.21.15.99:0/396350851 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:55.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.402+0000 7f916aa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f916c0d2680 0x7f916c0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38524/0 (socket says 172.21.15.99:38524) 2024-09-10T07:34:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.403+0000 7f916be00640 1 --2- 172.21.15.99:0/396350851 >> v2:172.21.15.187:3300/0 conn(0x7f916c0cfc90 0x7f916c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.403+0000 7f916b400640 1 -- 172.21.15.99:0/396350851 >> v2:172.21.15.187:3300/0 conn(0x7f916c0cfc90 msgr2=0x7f916c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.403+0000 7f916b400640 1 --2- 172.21.15.99:0/396350851 >> v2:172.21.15.187:3300/0 conn(0x7f916c0cfc90 0x7f916c0c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.403+0000 7f916b400640 1 -- 172.21.15.99:0/396350851 >> v1:172.21.15.99:6789/0 conn(0x7f916c0d2680 legacy=0x7f916c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.403+0000 7f916b400640 1 -- 172.21.15.99:0/396350851 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c0d3190 con 0x7f916c15e970 2024-09-10T07:34:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.404+0000 7f916b400640 1 --2- 172.21.15.99:0/396350851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 0x7f916c0d0300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f916c08e9c0 tx=0x7f915c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f04c15ec65fe10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.404+0000 7f916a000640 1 -- 172.21.15.99:0/396350851 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c037070 con 0x7f916c15e970 2024-09-10T07:34:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.404+0000 7f916a000640 1 -- 172.21.15.99:0/396350851 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f915c02ae50 con 0x7f916c15e970 2024-09-10T07:34:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.404+0000 7f916a000640 1 -- 172.21.15.99:0/396350851 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c032860 con 0x7f916c15e970 2024-09-10T07:34:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.405+0000 7f9170c00640 1 -- 172.21.15.99:0/396350851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 msgr2=0x7f916c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.405+0000 7f9170c00640 1 --2- 172.21.15.99:0/396350851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 0x7f916c0d0300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f916c08e9c0 tx=0x7f915c02a300 comp rx=0 tx=0).stop 2024-09-10T07:34:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.405+0000 7f9170c00640 1 -- 172.21.15.99:0/396350851 shutdown_connections 2024-09-10T07:34:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.405+0000 7f9170c00640 1 --2- 172.21.15.99:0/396350851 >> v2:172.21.15.187:3300/0 conn(0x7f916c0cfc90 0x7f916c0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.405+0000 7f9170c00640 1 --2- 172.21.15.99:0/396350851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 0x7f916c0d0300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.405+0000 7f9170c00640 1 -- 172.21.15.99:0/396350851 >> 172.21.15.99:0/396350851 conn(0x7f916c09de00 msgr2=0x7f916c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.405+0000 7f9170c00640 1 -- 172.21.15.99:0/396350851 shutdown_connections 2024-09-10T07:34:55.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.405+0000 7f9170c00640 1 -- 172.21.15.99:0/396350851 wait complete. 2024-09-10T07:34:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.406+0000 7f9170c00640 1 Processor -- start 2024-09-10T07:34:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.407+0000 7f9170c00640 1 -- start start 2024-09-10T07:34:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.407+0000 7f9170c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f916c0cfc90 0x7f916c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.407+0000 7f9170c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f916c0d2680 0x7f916c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.407+0000 7f9170c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 0x7f916c0ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.407+0000 7f9170c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f916c15ed50 con 0x7f916c15e970 2024-09-10T07:34:55.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.407+0000 7f9170c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f916c0d0840 con 0x7f916c0cfc90 2024-09-10T07:34:55.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.407+0000 7f9170c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f916c15eed0 con 0x7f916c0d2680 2024-09-10T07:34:55.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 0x7f916c0ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 0x7f916c0ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53670/0 (socket says 172.21.15.99:53670) 2024-09-10T07:34:55.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916be00640 1 -- 172.21.15.99:0/3541761938 learned_addr learned my addr 172.21.15.99:0/3541761938 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:55.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916b400640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f916c0cfc90 0x7f916c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916aa00640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f916c0d2680 0x7f916c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916be00640 1 -- 172.21.15.99:0/3541761938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f916c0d2680 msgr2=0x7f916c15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916be00640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f916c0d2680 0x7f916c15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916be00640 1 -- 172.21.15.99:0/3541761938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f916c0cfc90 msgr2=0x7f916c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916be00640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f916c0cfc90 0x7f916c157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916be00640 1 -- 172.21.15.99:0/3541761938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c1582f0 con 0x7f916c15e970 2024-09-10T07:34:55.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916b400640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f916c0cfc90 0x7f916c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:34:55.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.408+0000 7f916be00640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 0x7f916c0ce230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9164007e40 tx=0x7f916400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:55.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.409+0000 7f9163400640 1 -- 172.21.15.99:0/3541761938 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164014620 con 0x7f916c15e970 2024-09-10T07:34:55.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.409+0000 7f9163400640 1 -- 172.21.15.99:0/3541761938 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9164019070 con 0x7f916c15e970 2024-09-10T07:34:55.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.409+0000 7f9163400640 1 -- 172.21.15.99:0/3541761938 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164014a20 con 0x7f916c15e970 2024-09-10T07:34:55.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.409+0000 7f9170c00640 1 -- 172.21.15.99:0/3541761938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916c0cd190 con 0x7f916c15e970 2024-09-10T07:34:55.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.409+0000 7f9170c00640 1 -- 172.21.15.99:0/3541761938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f916c0cda30 con 0x7f916c15e970 2024-09-10T07:34:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.410+0000 7f9170c00640 1 -- 172.21.15.99:0/3541761938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f916c0d0300 con 0x7f916c15e970 2024-09-10T07:34:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.411+0000 7f9163400640 1 -- 172.21.15.99:0/3541761938 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9164014bc0 con 0x7f916c15e970 2024-09-10T07:34:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.412+0000 7f9163400640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f914c06be30 0x7f914c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.412+0000 7f9163400640 1 -- 172.21.15.99:0/3541761938 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f916408b720 con 0x7f916c15e970 2024-09-10T07:34:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.412+0000 7f916b400640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f914c06be30 0x7f914c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.413+0000 7f916b400640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f914c06be30 0x7f914c06e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f915c034000 tx=0x7f915c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:55.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.417+0000 7f9163400640 1 -- 172.21.15.99:0/3541761938 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f916405a0d0 con 0x7f916c15e970 2024-09-10T07:34:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.589+0000 7f9170c00640 1 -- 172.21.15.99:0/3541761938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f916c06c560 con 0x7f916c15e970 2024-09-10T07:34:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.591+0000 7f9163400640 1 -- 172.21.15.99:0/3541761938 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f91640599d0 con 0x7f916c15e970 2024-09-10T07:34:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:34:55.591 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:34:20.870081+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:34:17.274179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T07:34:18.279150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:34:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 -- 172.21.15.99:0/3541761938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f914c06be30 msgr2=0x7f914c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f914c06be30 0x7f914c06e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f915c034000 tx=0x7f915c02e000 comp rx=0 tx=0).stop 2024-09-10T07:34:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 -- 172.21.15.99:0/3541761938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 msgr2=0x7f916c0ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 0x7f916c0ce230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9164007e40 tx=0x7f916400e4b0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 -- 172.21.15.99:0/3541761938 shutdown_connections 2024-09-10T07:34:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f914c06be30 0x7f914c06e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f916c15e970 0x7f916c0ce230 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f916c0d2680 0x7f916c15d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 --2- 172.21.15.99:0/3541761938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f916c0cfc90 0x7f916c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 -- 172.21.15.99:0/3541761938 >> 172.21.15.99:0/3541761938 conn(0x7f916c09de00 msgr2=0x7f916c0c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 -- 172.21.15.99:0/3541761938 shutdown_connections 2024-09-10T07:34:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.594+0000 7f9170c00640 1 -- 172.21.15.99:0/3541761938 wait complete. 2024-09-10T07:34:55.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:34:55.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.764+0000 7fbd57c00640 1 Processor -- start 2024-09-10T07:34:55.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.764+0000 7fbd57c00640 1 -- start start 2024-09-10T07:34:55.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd57c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbd5015db60 0x7fbd50071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd57c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd5006e750 0x7fbd500ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd57c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd50153e50 con 0x7fbd500724d0 2024-09-10T07:34:55.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd57c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbd5015df40 con 0x7fbd5015db60 2024-09-10T07:34:55.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd57c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbd50072ac0 con 0x7fbd5006e750 2024-09-10T07:34:55.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd55200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbd5015db60 0x7fbd50071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd55200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbd5015db60 0x7fbd50071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53678/0 (socket says 172.21.15.99:53678) 2024-09-10T07:34:55.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd55200640 1 -- 172.21.15.99:0/1081012367 learned_addr learned my addr 172.21.15.99:0/1081012367 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:55.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd55c00640 1 --2- 172.21.15.99:0/1081012367 >> v2:172.21.15.187:3300/0 conn(0x7fbd5006e750 0x7fbd500ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd55200640 1 -- 172.21.15.99:0/1081012367 >> v2:172.21.15.187:3300/0 conn(0x7fbd5006e750 msgr2=0x7fbd500ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:55.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd55200640 1 --2- 172.21.15.99:0/1081012367 >> v2:172.21.15.187:3300/0 conn(0x7fbd5006e750 0x7fbd500ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd55200640 1 -- 172.21.15.99:0/1081012367 >> v1:172.21.15.187:6789/0 conn(0x7fbd500724d0 legacy=0x7fbd5006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:55.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.766+0000 7fbd55200640 1 -- 172.21.15.99:0/1081012367 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd50072da0 con 0x7fbd5015db60 2024-09-10T07:34:55.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.767+0000 7fbd55200640 1 --2- 172.21.15.99:0/1081012367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5015db60 0x7fbd50071f90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd5006ed50 tx=0x7fbd4002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09003b81b8cfa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd4fe00640 1 -- 172.21.15.99:0/1081012367 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40037070 con 0x7fbd5015db60 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd4fe00640 1 -- 172.21.15.99:0/1081012367 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd40032440 con 0x7fbd5015db60 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd4fe00640 1 -- 172.21.15.99:0/1081012367 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40032810 con 0x7fbd5015db60 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd57c00640 1 -- 172.21.15.99:0/1081012367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5015db60 msgr2=0x7fbd50071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd57c00640 1 --2- 172.21.15.99:0/1081012367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5015db60 0x7fbd50071f90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd5006ed50 tx=0x7fbd4002a230 comp rx=0 tx=0).stop 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd57c00640 1 -- 172.21.15.99:0/1081012367 shutdown_connections 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd57c00640 1 --2- 172.21.15.99:0/1081012367 >> v2:172.21.15.187:3300/0 conn(0x7fbd5006e750 0x7fbd500ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd57c00640 1 --2- 172.21.15.99:0/1081012367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5015db60 0x7fbd50071f90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd57c00640 1 -- 172.21.15.99:0/1081012367 >> 172.21.15.99:0/1081012367 conn(0x7fbd500b2630 msgr2=0x7fbd500b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd57c00640 1 -- 172.21.15.99:0/1081012367 shutdown_connections 2024-09-10T07:34:55.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.768+0000 7fbd57c00640 1 -- 172.21.15.99:0/1081012367 wait complete. 2024-09-10T07:34:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.770+0000 7fbd57c00640 1 Processor -- start 2024-09-10T07:34:55.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.770+0000 7fbd57c00640 1 -- start start 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd57c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5006e750 0x7fbd5014c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd57c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd500724d0 0x7fbd5014f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd57c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd5015db60 0x7fbd5014f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd57c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbd50073640 con 0x7fbd5006e750 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd57c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbd50073360 con 0x7fbd500724d0 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd57c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5015d1c0 con 0x7fbd5015db60 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd55200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5006e750 0x7fbd5014c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd55200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5006e750 0x7fbd5014c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53688/0 (socket says 172.21.15.99:53688) 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd55200640 1 -- 172.21.15.99:0/2760323941 learned_addr learned my addr 172.21.15.99:0/2760323941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd47e00640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd500724d0 0x7fbd5014f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.771+0000 7fbd55c00640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd5015db60 0x7fbd5014f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd55200640 1 -- 172.21.15.99:0/2760323941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd5015db60 msgr2=0x7fbd5014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd55200640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd5015db60 0x7fbd5014f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd55200640 1 -- 172.21.15.99:0/2760323941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd500724d0 msgr2=0x7fbd5014f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd55200640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd500724d0 0x7fbd5014f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd55200640 1 -- 172.21.15.99:0/2760323941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5014ff10 con 0x7fbd5006e750 2024-09-10T07:34:55.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd55200640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5006e750 0x7fbd5014c640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd4002a270 tx=0x7fbd400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:55.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd4d600640 1 -- 172.21.15.99:0/2760323941 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40041020 con 0x7fbd5006e750 2024-09-10T07:34:55.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd4d600640 1 -- 172.21.15.99:0/2760323941 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd400306c0 con 0x7fbd5006e750 2024-09-10T07:34:55.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd57c00640 1 -- 172.21.15.99:0/2760323941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd501501f0 con 0x7fbd5006e750 2024-09-10T07:34:55.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd4d600640 1 -- 172.21.15.99:0/2760323941 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40037040 con 0x7fbd5006e750 2024-09-10T07:34:55.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.772+0000 7fbd57c00640 1 -- 172.21.15.99:0/2760323941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd501552b0 con 0x7fbd5006e750 2024-09-10T07:34:55.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.774+0000 7fbd57c00640 1 -- 172.21.15.99:0/2760323941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd50071f90 con 0x7fbd5006e750 2024-09-10T07:34:55.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.774+0000 7fbd4d600640 1 -- 172.21.15.99:0/2760323941 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd40044020 con 0x7fbd5006e750 2024-09-10T07:34:55.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.776+0000 7fbd4d600640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd2c06be30 0x7fbd2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:55.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.776+0000 7fbd4d600640 1 -- 172.21.15.99:0/2760323941 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbd400ab590 con 0x7fbd5006e750 2024-09-10T07:34:55.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.776+0000 7fbd47e00640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd2c06be30 0x7fbd2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:55.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.776+0000 7fbd47e00640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd2c06be30 0x7fbd2c06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd501f6250 tx=0x7fbd38007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:55.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.780+0000 7fbd4d600640 1 -- 172.21.15.99:0/2760323941 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd4004b030 con 0x7fbd5006e750 2024-09-10T07:34:55.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.986+0000 7fbd57c00640 1 -- 172.21.15.99:0/2760323941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbd5006dc10 con 0x7fbd5006e750 2024-09-10T07:34:55.986 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:34:55.987+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:34:55.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.990+0000 7fbd4d600640 1 -- 172.21.15.99:0/2760323941 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fbd400798e0 con 0x7fbd5006e750 2024-09-10T07:34:55.989 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:34:55.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 -- 172.21.15.99:0/2760323941 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd2c06be30 msgr2=0x7fbd2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd2c06be30 0x7fbd2c06e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd501f6250 tx=0x7fbd38007e30 comp rx=0 tx=0).stop 2024-09-10T07:34:55.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 -- 172.21.15.99:0/2760323941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5006e750 msgr2=0x7fbd5014c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:55.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5006e750 0x7fbd5014c640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbd4002a270 tx=0x7fbd400046c0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 -- 172.21.15.99:0/2760323941 shutdown_connections 2024-09-10T07:34:55.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd5015db60 0x7fbd5014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd500724d0 0x7fbd5014f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd2c06be30 0x7fbd2c06e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 --2- 172.21.15.99:0/2760323941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd5006e750 0x7fbd5014c640 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:55.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 -- 172.21.15.99:0/2760323941 >> 172.21.15.99:0/2760323941 conn(0x7fbd500b2630 msgr2=0x7fbd5015eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:55.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 -- 172.21.15.99:0/2760323941 shutdown_connections 2024-09-10T07:34:55.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:55.993+0000 7fbd57c00640 1 -- 172.21.15.99:0/2760323941 wait complete. 2024-09-10T07:34:56.001 INFO:tasks.ceph.mds.d.smithi187.stderr: -4245> 2024-09-10T07:34:24.846+0000 7f73ef200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:34:56.008 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:34:56.056 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:34:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.165+0000 7f5499600640 1 Processor -- start 2024-09-10T07:34:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.165+0000 7f5499600640 1 -- start start 2024-09-10T07:34:56.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.166+0000 7f5499600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f54940b4e70 0x7f5494071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.166+0000 7f5499600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f549415ece0 0x7f54940b5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.166+0000 7f5499600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54940b5790 con 0x7f54940af250 2024-09-10T07:34:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.166+0000 7f5499600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f54940d1780 con 0x7f549415ece0 2024-09-10T07:34:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.166+0000 7f5499600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f549406d5d0 con 0x7f54940b4e70 2024-09-10T07:34:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.167+0000 7f548a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f549415ece0 0x7f54940b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.167+0000 7f5493400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f54940af250 0x7f549406dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38528/0 (socket says 172.21.15.99:38528) 2024-09-10T07:34:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.167+0000 7f5493400640 1 -- 172.21.15.99:0/1729497972 learned_addr learned my addr 172.21.15.99:0/1729497972 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.167+0000 7f5492a00640 1 --2- 172.21.15.99:0/1729497972 >> v2:172.21.15.187:3300/0 conn(0x7f54940b4e70 0x7f5494071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:56.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.167+0000 7f548a000640 1 -- 172.21.15.99:0/1729497972 >> v2:172.21.15.187:3300/0 conn(0x7f54940b4e70 msgr2=0x7f5494071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:56.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.167+0000 7f548a000640 1 --2- 172.21.15.99:0/1729497972 >> v2:172.21.15.187:3300/0 conn(0x7f54940b4e70 0x7f5494071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.167+0000 7f548a000640 1 -- 172.21.15.99:0/1729497972 >> v1:172.21.15.99:6789/0 conn(0x7f54940af250 legacy=0x7f549406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:56.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.167+0000 7f548a000640 1 -- 172.21.15.99:0/1729497972 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549406f1a0 con 0x7f549415ece0 2024-09-10T07:34:56.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.168+0000 7f548a000640 1 --2- 172.21.15.99:0/1729497972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f549415ece0 0x7f54940b5250 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f54940506f0 tx=0x7f547c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2018559bbb16464 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:56.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.168+0000 7f5492000640 1 -- 172.21.15.99:0/1729497972 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547c037070 con 0x7f549415ece0 2024-09-10T07:34:56.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.168+0000 7f5492000640 1 -- 172.21.15.99:0/1729497972 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f547c032440 con 0x7f549415ece0 2024-09-10T07:34:56.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.168+0000 7f5492000640 1 -- 172.21.15.99:0/1729497972 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547c032810 con 0x7f549415ece0 2024-09-10T07:34:56.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.169+0000 7f5499600640 1 -- 172.21.15.99:0/1729497972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f549415ece0 msgr2=0x7f54940b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:56.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.169+0000 7f5499600640 1 --2- 172.21.15.99:0/1729497972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f549415ece0 0x7f54940b5250 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f54940506f0 tx=0x7f547c02a1a0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.169+0000 7f5499600640 1 -- 172.21.15.99:0/1729497972 shutdown_connections 2024-09-10T07:34:56.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.169+0000 7f5499600640 1 --2- 172.21.15.99:0/1729497972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f549415ece0 0x7f54940b5250 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.169+0000 7f5499600640 1 --2- 172.21.15.99:0/1729497972 >> v2:172.21.15.187:3300/0 conn(0x7f54940b4e70 0x7f5494071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.169+0000 7f5499600640 1 -- 172.21.15.99:0/1729497972 >> 172.21.15.99:0/1729497972 conn(0x7f549406bc10 msgr2=0x7f549406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:56.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.169+0000 7f5499600640 1 -- 172.21.15.99:0/1729497972 shutdown_connections 2024-09-10T07:34:56.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.169+0000 7f5499600640 1 -- 172.21.15.99:0/1729497972 wait complete. 2024-09-10T07:34:56.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.171+0000 7f5499600640 1 Processor -- start 2024-09-10T07:34:56.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.171+0000 7f5499600640 1 -- start start 2024-09-10T07:34:56.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5499600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54940af250 0x7f5494145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:56.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5499600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54940b4e70 0x7f54941ea600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:56.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5499600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f549415fae0 0x7f54941eab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:56.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5499600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f549406d820 con 0x7f54940af250 2024-09-10T07:34:56.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5499600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f549406f760 con 0x7f549415fae0 2024-09-10T07:34:56.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5499600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f549406ede0 con 0x7f54940b4e70 2024-09-10T07:34:56.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5492a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54940af250 0x7f5494145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:56.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5492a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54940af250 0x7f5494145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53696/0 (socket says 172.21.15.99:53696) 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5492a00640 1 -- 172.21.15.99:0/1172198300 learned_addr learned my addr 172.21.15.99:0/1172198300 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f548a000640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54940b4e70 0x7f54941ea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5493400640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f549415fae0 0x7f54941eab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5492a00640 1 -- 172.21.15.99:0/1172198300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54940b4e70 msgr2=0x7f54941ea600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5492a00640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54940b4e70 0x7f54941ea600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5492a00640 1 -- 172.21.15.99:0/1172198300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f549415fae0 msgr2=0x7f54941eab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5492a00640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f549415fae0 0x7f54941eab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.172+0000 7f5492a00640 1 -- 172.21.15.99:0/1172198300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549415ffe0 con 0x7f54940af250 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.173+0000 7f5492a00640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54940af250 0x7f5494145400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f548400e9e0 tx=0x7f548400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.173+0000 7f548b400640 1 -- 172.21.15.99:0/1172198300 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484017070 con 0x7f54940af250 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.173+0000 7f548b400640 1 -- 172.21.15.99:0/1172198300 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548400c9d0 con 0x7f54940af250 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.173+0000 7f5499600640 1 -- 172.21.15.99:0/1172198300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54941602c0 con 0x7f54940af250 2024-09-10T07:34:56.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.173+0000 7f548b400640 1 -- 172.21.15.99:0/1172198300 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548400cdc0 con 0x7f54940af250 2024-09-10T07:34:56.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.173+0000 7f5499600640 1 -- 172.21.15.99:0/1172198300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5494160880 con 0x7f54940af250 2024-09-10T07:34:56.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.174+0000 7f5499600640 1 -- 172.21.15.99:0/1172198300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54940b3f60 con 0x7f54940af250 2024-09-10T07:34:56.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.175+0000 7f548b400640 1 -- 172.21.15.99:0/1172198300 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f548401a070 con 0x7f54940af250 2024-09-10T07:34:56.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.176+0000 7f548b400640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f547006be30 0x7f547006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:56.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.176+0000 7f548b400640 1 -- 172.21.15.99:0/1172198300 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f548408b280 con 0x7f54940af250 2024-09-10T07:34:56.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.176+0000 7f548a000640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f547006be30 0x7f547006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:56.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.177+0000 7f548a000640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f547006be30 0x7f547006e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f547c034000 tx=0x7f547c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:56.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.180+0000 7f548b400640 1 -- 172.21.15.99:0/1172198300 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54940b3f60 con 0x7f54940af250 2024-09-10T07:34:56.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.385+0000 7f5499600640 1 -- 172.21.15.99:0/1172198300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f54940af680 con 0x7f54940af250 2024-09-10T07:34:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.996+0000 7f548b400640 1 -- 172.21.15.99:0/1172198300 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f54840594e0 con 0x7f54940af250 2024-09-10T07:34:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.998+0000 7f5499600640 1 -- 172.21.15.99:0/1172198300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f547006be30 msgr2=0x7f547006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.998+0000 7f5499600640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f547006be30 0x7f547006e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f547c034000 tx=0x7f547c02e000 comp rx=0 tx=0).stop 2024-09-10T07:34:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.998+0000 7f5499600640 1 -- 172.21.15.99:0/1172198300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54940af250 msgr2=0x7f5494145400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.998+0000 7f5499600640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54940af250 0x7f5494145400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f548400e9e0 tx=0x7f548400eea0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.999+0000 7f5499600640 1 -- 172.21.15.99:0/1172198300 shutdown_connections 2024-09-10T07:34:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.999+0000 7f5499600640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f549415fae0 0x7f54941eab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.999+0000 7f5499600640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54940b4e70 0x7f54941ea600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.999+0000 7f5499600640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f547006be30 0x7f547006e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.999+0000 7f5499600640 1 --2- 172.21.15.99:0/1172198300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54940af250 0x7f5494145400 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.999+0000 7f5499600640 1 -- 172.21.15.99:0/1172198300 >> 172.21.15.99:0/1172198300 conn(0x7f549406bc10 msgr2=0x7f54940b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.999+0000 7f5499600640 1 -- 172.21.15.99:0/1172198300 shutdown_connections 2024-09-10T07:34:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:56.999+0000 7f5499600640 1 -- 172.21.15.99:0/1172198300 wait complete. 2024-09-10T07:34:57.016 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:34:57.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.177+0000 7f9853200640 1 Processor -- start 2024-09-10T07:34:57.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.177+0000 7f9853200640 1 -- start start 2024-09-10T07:34:57.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.178+0000 7f9853200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f98540b57a0 0x7f98540cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:57.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.178+0000 7f9853200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f98540cfb80 0x7f98540cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:57.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.178+0000 7f9853200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98540d56f0 con 0x7f98540d16b0 2024-09-10T07:34:57.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.178+0000 7f9853200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f98540d59d0 con 0x7f98540b57a0 2024-09-10T07:34:57.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.178+0000 7f9853200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f98540d0a60 con 0x7f98540cfb80 2024-09-10T07:34:57.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.179+0000 7f9849400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f98540b57a0 0x7f98540cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:57.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.179+0000 7f9849400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f98540b57a0 0x7f98540cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53700/0 (socket says 172.21.15.99:53700) 2024-09-10T07:34:57.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.179+0000 7f9849400640 1 -- 172.21.15.99:0/3015045481 learned_addr learned my addr 172.21.15.99:0/3015045481 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:57.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.179+0000 7f9852800640 1 --2- 172.21.15.99:0/3015045481 >> v2:172.21.15.187:3300/0 conn(0x7f98540cfb80 0x7f98540cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:57.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.179+0000 7f9849400640 1 -- 172.21.15.99:0/3015045481 >> v2:172.21.15.187:3300/0 conn(0x7f98540cfb80 msgr2=0x7f98540cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:57.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.179+0000 7f9849400640 1 --2- 172.21.15.99:0/3015045481 >> v2:172.21.15.187:3300/0 conn(0x7f98540cfb80 0x7f98540cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:57.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.179+0000 7f9849400640 1 -- 172.21.15.99:0/3015045481 >> v1:172.21.15.187:6789/0 conn(0x7f98540d16b0 legacy=0x7f98540d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:57.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.179+0000 7f9849400640 1 -- 172.21.15.99:0/3015045481 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98540d31b0 con 0x7f98540b57a0 2024-09-10T07:34:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.180+0000 7f9849400640 1 --2- 172.21.15.99:0/3015045481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 0x7f98540cf640 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98540b40c0 tx=0x7f983c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b47ad20305ae03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9851400640 1 -- 172.21.15.99:0/3015045481 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c037070 con 0x7f98540b57a0 2024-09-10T07:34:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9851400640 1 -- 172.21.15.99:0/3015045481 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c032440 con 0x7f98540b57a0 2024-09-10T07:34:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9851400640 1 -- 172.21.15.99:0/3015045481 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c032810 con 0x7f98540b57a0 2024-09-10T07:34:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9853200640 1 -- 172.21.15.99:0/3015045481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 msgr2=0x7f98540cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9853200640 1 --2- 172.21.15.99:0/3015045481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 0x7f98540cf640 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98540b40c0 tx=0x7f983c02a1e0 comp rx=0 tx=0).stop 2024-09-10T07:34:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9853200640 1 -- 172.21.15.99:0/3015045481 shutdown_connections 2024-09-10T07:34:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9853200640 1 --2- 172.21.15.99:0/3015045481 >> v2:172.21.15.187:3300/0 conn(0x7f98540cfb80 0x7f98540cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9853200640 1 --2- 172.21.15.99:0/3015045481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 0x7f98540cf640 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:57.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9853200640 1 -- 172.21.15.99:0/3015045481 >> 172.21.15.99:0/3015045481 conn(0x7f98540d4a30 msgr2=0x7f98540d4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:57.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9853200640 1 -- 172.21.15.99:0/3015045481 shutdown_connections 2024-09-10T07:34:57.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.181+0000 7f9853200640 1 -- 172.21.15.99:0/3015045481 wait complete. 2024-09-10T07:34:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.183+0000 7f9853200640 1 Processor -- start 2024-09-10T07:34:57.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.183+0000 7f9853200640 1 -- start start 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9853200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 0x7f9854154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9853200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98540cfb80 0x7f98540b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9853200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98540d16b0 0x7f98540ba0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9853200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f98540d04d0 con 0x7f98540b57a0 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9853200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f98540d3800 con 0x7f98540cfb80 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9853200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f98540d21a0 con 0x7f98540d16b0 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9851e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 0x7f9854154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9851e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 0x7f9854154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53708/0 (socket says 172.21.15.99:53708) 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9851e00640 1 -- 172.21.15.99:0/2225695150 learned_addr learned my addr 172.21.15.99:0/2225695150 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9849400640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98540cfb80 0x7f98540b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9852800640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98540d16b0 0x7f98540ba0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:57.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9851e00640 1 -- 172.21.15.99:0/2225695150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98540d16b0 msgr2=0x7f98540ba0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:57.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9851e00640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98540d16b0 0x7f98540ba0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:57.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9851e00640 1 -- 172.21.15.99:0/2225695150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98540cfb80 msgr2=0x7f98540b9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:57.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.184+0000 7f9851e00640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98540cfb80 0x7f98540b9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:57.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.185+0000 7f9851e00640 1 -- 172.21.15.99:0/2225695150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98540b79b0 con 0x7f98540b57a0 2024-09-10T07:34:57.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.185+0000 7f9851e00640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 0x7f9854154a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f984400c3f0 tx=0x7f984400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:57.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.185+0000 7f984aa00640 1 -- 172.21.15.99:0/2225695150 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98440052d0 con 0x7f98540b57a0 2024-09-10T07:34:57.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.185+0000 7f984aa00640 1 -- 172.21.15.99:0/2225695150 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9844005490 con 0x7f98540b57a0 2024-09-10T07:34:57.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.185+0000 7f984aa00640 1 -- 172.21.15.99:0/2225695150 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844007260 con 0x7f98540b57a0 2024-09-10T07:34:57.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.185+0000 7f9853200640 1 -- 172.21.15.99:0/2225695150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98540b7c50 con 0x7f98540b57a0 2024-09-10T07:34:57.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.185+0000 7f9853200640 1 -- 172.21.15.99:0/2225695150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98540b8210 con 0x7f98540b57a0 2024-09-10T07:34:57.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.186+0000 7f9853200640 1 -- 172.21.15.99:0/2225695150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98540cf640 con 0x7f98540b57a0 2024-09-10T07:34:57.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.187+0000 7f984aa00640 1 -- 172.21.15.99:0/2225695150 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9844007400 con 0x7f98540b57a0 2024-09-10T07:34:57.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.188+0000 7f984aa00640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f983006be30 0x7f983006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:57.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.188+0000 7f984aa00640 1 -- 172.21.15.99:0/2225695150 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f984408a310 con 0x7f98540b57a0 2024-09-10T07:34:57.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.188+0000 7f9849400640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f983006be30 0x7f983006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:57.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.189+0000 7f9849400640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f983006be30 0x7f983006e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f983c034000 tx=0x7f983c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:57.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.193+0000 7f984aa00640 1 -- 172.21.15.99:0/2225695150 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9844058600 con 0x7f98540b57a0 2024-09-10T07:34:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.366+0000 7f9853200640 1 -- 172.21.15.99:0/2225695150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9854162ae0 con 0x7f98540b57a0 2024-09-10T07:34:57.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:57.998+0000 7f984aa00640 1 -- 172.21.15.99:0/2225695150 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7f984405c900 con 0x7f98540b57a0 2024-09-10T07:34:57.998 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:34:58.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.001+0000 7f9853200640 1 -- 172.21.15.99:0/2225695150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f983006be30 msgr2=0x7f983006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:58.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.001+0000 7f9853200640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f983006be30 0x7f983006e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f983c034000 tx=0x7f983c02e000 comp rx=0 tx=0).stop 2024-09-10T07:34:58.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.001+0000 7f9853200640 1 -- 172.21.15.99:0/2225695150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 msgr2=0x7f9854154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:58.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.001+0000 7f9853200640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 0x7f9854154a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f984400c3f0 tx=0x7f984400c8b0 comp rx=0 tx=0).stop 2024-09-10T07:34:58.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.002+0000 7f9853200640 1 -- 172.21.15.99:0/2225695150 shutdown_connections 2024-09-10T07:34:58.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.002+0000 7f9853200640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98540d16b0 0x7f98540ba0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:58.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.002+0000 7f9853200640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98540cfb80 0x7f98540b9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:58.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.002+0000 7f9853200640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f983006be30 0x7f983006e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:58.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.002+0000 7f9853200640 1 --2- 172.21.15.99:0/2225695150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98540b57a0 0x7f9854154a80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:58.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.002+0000 7f9853200640 1 -- 172.21.15.99:0/2225695150 >> 172.21.15.99:0/2225695150 conn(0x7f98540d4a30 msgr2=0x7f98540d1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:58.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.002+0000 7f9853200640 1 -- 172.21.15.99:0/2225695150 shutdown_connections 2024-09-10T07:34:58.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.002+0000 7f9853200640 1 -- 172.21.15.99:0/2225695150 wait complete. 2024-09-10T07:34:58.019 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:34:58.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.180+0000 7fc150a00640 1 Processor -- start 2024-09-10T07:34:58.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.180+0000 7fc150a00640 1 -- start start 2024-09-10T07:34:58.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.181+0000 7fc150a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc14c072d90 0x7fc14c166590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:58.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.181+0000 7fc150a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc14c160310 con 0x7fc14c0ced50 2024-09-10T07:34:58.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.181+0000 7fc150a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc14c160030 con 0x7fc14c1445a0 2024-09-10T07:34:58.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.181+0000 7fc150a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc14c0b4d20 con 0x7fc14c072d90 2024-09-10T07:34:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.182+0000 7fc149400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc14c0ced50 0x7fc14c072680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38532/0 (socket says 172.21.15.99:38532) 2024-09-10T07:34:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.182+0000 7fc149400640 1 -- 172.21.15.99:0/2987432347 learned_addr learned my addr 172.21.15.99:0/2987432347 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:34:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.182+0000 7fc14a800640 1 --2- 172.21.15.99:0/2987432347 >> v2:172.21.15.99:3300/0 conn(0x7fc14c072d90 0x7fc14c166590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.182+0000 7fc148a00640 1 -- 172.21.15.99:0/2987432347 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859160928 0 0) 0x7fc14c160310 con 0x7fc14c0ced50 2024-09-10T07:34:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.182+0000 7fc14a800640 1 -- 172.21.15.99:0/2987432347 >> v1:172.21.15.187:6789/0 conn(0x7fc14c1445a0 legacy=0x7fc14c0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.182+0000 7fc14a800640 1 -- 172.21.15.99:0/2987432347 >> v1:172.21.15.99:6789/0 conn(0x7fc14c0ced50 legacy=0x7fc14c072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.182+0000 7fc14a800640 1 -- 172.21.15.99:0/2987432347 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c0b5940 con 0x7fc14c072d90 2024-09-10T07:34:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.183+0000 7fc14a800640 1 --2- 172.21.15.99:0/2987432347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c072d90 0x7fc14c166590 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc144009d90 tx=0x7fc14402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e9547565ace065 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.183+0000 7fc148a00640 1 -- 172.21.15.99:0/2987432347 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144031600 con 0x7fc14c072d90 2024-09-10T07:34:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.184+0000 7fc148a00640 1 -- 172.21.15.99:0/2987432347 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1440317a0 con 0x7fc14c072d90 2024-09-10T07:34:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.184+0000 7fc148a00640 1 -- 172.21.15.99:0/2987432347 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144031b70 con 0x7fc14c072d90 2024-09-10T07:34:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.184+0000 7fc150a00640 1 -- 172.21.15.99:0/2987432347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c072d90 msgr2=0x7fc14c166590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.184+0000 7fc150a00640 1 --2- 172.21.15.99:0/2987432347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c072d90 0x7fc14c166590 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc144009d90 tx=0x7fc14402a5d0 comp rx=0 tx=0).stop 2024-09-10T07:34:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.184+0000 7fc150a00640 1 -- 172.21.15.99:0/2987432347 shutdown_connections 2024-09-10T07:34:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.184+0000 7fc150a00640 1 --2- 172.21.15.99:0/2987432347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c072d90 0x7fc14c166590 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.184+0000 7fc150a00640 1 -- 172.21.15.99:0/2987432347 >> 172.21.15.99:0/2987432347 conn(0x7fc14c0b26a0 msgr2=0x7fc14c0b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:58.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.184+0000 7fc150a00640 1 -- 172.21.15.99:0/2987432347 shutdown_connections 2024-09-10T07:34:58.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.184+0000 7fc150a00640 1 -- 172.21.15.99:0/2987432347 wait complete. 2024-09-10T07:34:58.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.186+0000 7fc150a00640 1 Processor -- start 2024-09-10T07:34:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.186+0000 7fc150a00640 1 -- start start 2024-09-10T07:34:58.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc150a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c072d90 0x7fc14c15af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:58.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc150a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc14c0ced50 0x7fc14c13ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:58.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc150a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c1445a0 0x7fc14c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:58.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc150a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c144980 con 0x7fc14c1445a0 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc150a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c0b5f00 con 0x7fc14c072d90 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc150a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc14c144b00 con 0x7fc14c0ced50 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc14a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c1445a0 0x7fc14c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc14a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c1445a0 0x7fc14c0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53734/0 (socket says 172.21.15.99:53734) 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc14a800640 1 -- 172.21.15.99:0/1196507828 learned_addr learned my addr 172.21.15.99:0/1196507828 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc149e00640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c072d90 0x7fc14c15af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc149400640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc14c0ced50 0x7fc14c13ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc14a800640 1 -- 172.21.15.99:0/1196507828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc14c0ced50 msgr2=0x7fc14c13ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc14a800640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc14c0ced50 0x7fc14c13ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc14a800640 1 -- 172.21.15.99:0/1196507828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c072d90 msgr2=0x7fc14c15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc14a800640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c072d90 0x7fc14c15af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.187+0000 7fc14a800640 1 -- 172.21.15.99:0/1196507828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c13aa70 con 0x7fc14c1445a0 2024-09-10T07:34:58.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.188+0000 7fc14a800640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c1445a0 0x7fc14c0b0fd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc144009d90 tx=0x7fc144004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:58.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.188+0000 7fc142000640 1 -- 172.21.15.99:0/1196507828 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144040070 con 0x7fc14c1445a0 2024-09-10T07:34:58.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.188+0000 7fc142000640 1 -- 172.21.15.99:0/1196507828 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc144030b60 con 0x7fc14c1445a0 2024-09-10T07:34:58.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.188+0000 7fc142000640 1 -- 172.21.15.99:0/1196507828 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14403c420 con 0x7fc14c1445a0 2024-09-10T07:34:58.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.188+0000 7fc150a00640 1 -- 172.21.15.99:0/1196507828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14c13d5b0 con 0x7fc14c1445a0 2024-09-10T07:34:58.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.188+0000 7fc150a00640 1 -- 172.21.15.99:0/1196507828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14c13db70 con 0x7fc14c1445a0 2024-09-10T07:34:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.189+0000 7fc150a00640 1 -- 172.21.15.99:0/1196507828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc14c144f50 con 0x7fc14c1445a0 2024-09-10T07:34:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.190+0000 7fc142000640 1 -- 172.21.15.99:0/1196507828 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc144039040 con 0x7fc14c1445a0 2024-09-10T07:34:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.191+0000 7fc142000640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc12c06be30 0x7fc12c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.191+0000 7fc142000640 1 -- 172.21.15.99:0/1196507828 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5357+0+0 (secure 0 0 0) 0x7fc1440ac190 con 0x7fc14c1445a0 2024-09-10T07:34:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.191+0000 7fc149e00640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc12c06be30 0x7fc12c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.192+0000 7fc149e00640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc12c06be30 0x7fc12c06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc13c000f60 tx=0x7fc13c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:58.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.195+0000 7fc142000640 1 -- 172.21.15.99:0/1196507828 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc14c13aa70 con 0x7fc14c1445a0 2024-09-10T07:34:58.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:58.372+0000 7fc150a00640 1 -- 172.21.15.99:0/1196507828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc14c15bc00 con 0x7fc14c1445a0 2024-09-10T07:34:59.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.004+0000 7fc142000640 1 -- 172.21.15.99:0/1196507828 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7fc14407ad50 con 0x7fc14c1445a0 2024-09-10T07:34:59.004 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:34:59.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 -- 172.21.15.99:0/1196507828 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc12c06be30 msgr2=0x7fc12c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:59.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc12c06be30 0x7fc12c06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc13c000f60 tx=0x7fc13c009040 comp rx=0 tx=0).stop 2024-09-10T07:34:59.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 -- 172.21.15.99:0/1196507828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c1445a0 msgr2=0x7fc14c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:59.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c1445a0 0x7fc14c0b0fd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc144009d90 tx=0x7fc144004a40 comp rx=0 tx=0).stop 2024-09-10T07:34:59.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 -- 172.21.15.99:0/1196507828 shutdown_connections 2024-09-10T07:34:59.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc12c06be30 0x7fc12c06e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:59.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc14c1445a0 0x7fc14c0b0fd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:59.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc14c0ced50 0x7fc14c13ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:59.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 --2- 172.21.15.99:0/1196507828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc14c072d90 0x7fc14c15af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:59.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 -- 172.21.15.99:0/1196507828 >> 172.21.15.99:0/1196507828 conn(0x7fc14c0b26a0 msgr2=0x7fc14c06d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:59.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 -- 172.21.15.99:0/1196507828 shutdown_connections 2024-09-10T07:34:59.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.008+0000 7fc150a00640 1 -- 172.21.15.99:0/1196507828 wait complete. 2024-09-10T07:34:59.024 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:34:59.024 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T07:34:59.024 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:34:59.024 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:34:59.024 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:34:59.025 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T07:34:59.025 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:34:59.025 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:34:59.025 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:34:59.025 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T07:34:59.025 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:34:59.025 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:34:59.026 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:34:59.026 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T07:34:59.026 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:34:59.026 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:34:59.039 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:34:59.039 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:34:59.040 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:34:59.040 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:34:59.043 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:34:59.043 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:34:59.044 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:34:59.044 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:34:59.084 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:34:59.085 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:59.087 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:34:59.087 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:59.088 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:34:59.088 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:59.089 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:34:59.090 DEBUG:teuthology.parallel:result is None 2024-09-10T07:34:59.090 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T07:34:59.220 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:34:59.221 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:34:59.221 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:34:59.233 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:34:59.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.258+0000 7f0c54800640 1 Processor -- start 2024-09-10T07:34:59.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.258+0000 7f0c54800640 1 -- start start 2024-09-10T07:34:59.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.259+0000 7f0c54800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 0x7f0c4c0d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:59.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.259+0000 7f0c54800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0c4c0d0480 0x7f0c4c0d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:59.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.259+0000 7f0c54800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4c0d0bf0 con 0x7f0c4c0d3af0 2024-09-10T07:34:59.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.259+0000 7f0c54800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0c4c0d2880 con 0x7f0c4c0d0480 2024-09-10T07:34:59.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.259+0000 7f0c54800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0c4c0d3120 con 0x7f0c4c15eda0 2024-09-10T07:34:59.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.260+0000 7f0c51400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0c4c0d0480 0x7f0c4c0d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:59.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.260+0000 7f0c51400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0c4c0d0480 0x7f0c4c0d35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53770/0 (socket says 172.21.15.99:53770) 2024-09-10T07:34:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.260+0000 7f0c51e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 0x7f0c4c0d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.260+0000 7f0c51400640 1 -- 172.21.15.99:0/4034736550 learned_addr learned my addr 172.21.15.99:0/4034736550 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.260+0000 7f0c51400640 1 -- 172.21.15.99:0/4034736550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 msgr2=0x7f0c4c0d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:34:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.260+0000 7f0c51400640 1 --2- 172.21.15.99:0/4034736550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 0x7f0c4c0d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.260+0000 7f0c51400640 1 -- 172.21.15.99:0/4034736550 >> v1:172.21.15.187:6789/0 conn(0x7f0c4c0d3af0 legacy=0x7f0c4c0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.260+0000 7f0c51400640 1 -- 172.21.15.99:0/4034736550 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c0d2ad0 con 0x7f0c4c0d0480 2024-09-10T07:34:59.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.261+0000 7f0c51400640 1 --2- 172.21.15.99:0/4034736550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c0d0480 0x7f0c4c0d35b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009870 tx=0x7f0c3c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bb7c55fad299c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:59.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.261+0000 7f0c50a00640 1 -- 172.21.15.99:0/4034736550 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c037070 con 0x7f0c4c0d0480 2024-09-10T07:34:59.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.262+0000 7f0c50a00640 1 -- 172.21.15.99:0/4034736550 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c032440 con 0x7f0c4c0d0480 2024-09-10T07:34:59.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.262+0000 7f0c50a00640 1 -- 172.21.15.99:0/4034736550 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c032810 con 0x7f0c4c0d0480 2024-09-10T07:34:59.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.262+0000 7f0c54800640 1 -- 172.21.15.99:0/4034736550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c0d0480 msgr2=0x7f0c4c0d35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.262+0000 7f0c54800640 1 --2- 172.21.15.99:0/4034736550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c0d0480 0x7f0c4c0d35b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009870 tx=0x7f0c3c02a250 comp rx=0 tx=0).stop 2024-09-10T07:34:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.262+0000 7f0c54800640 1 -- 172.21.15.99:0/4034736550 shutdown_connections 2024-09-10T07:34:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.262+0000 7f0c54800640 1 --2- 172.21.15.99:0/4034736550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c0d0480 0x7f0c4c0d35b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.262+0000 7f0c54800640 1 --2- 172.21.15.99:0/4034736550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 0x7f0c4c0d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.262+0000 7f0c54800640 1 -- 172.21.15.99:0/4034736550 >> 172.21.15.99:0/4034736550 conn(0x7f0c4c09df40 msgr2=0x7f0c4c0d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:34:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.262+0000 7f0c54800640 1 -- 172.21.15.99:0/4034736550 shutdown_connections 2024-09-10T07:34:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.262+0000 7f0c54800640 1 -- 172.21.15.99:0/4034736550 wait complete. 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.264+0000 7f0c54800640 1 Processor -- start 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.264+0000 7f0c54800640 1 -- start start 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.265+0000 7f0c54800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c4c0d0480 0x7f0c4c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.265+0000 7f0c54800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 0x7f0c4c161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.265+0000 7f0c54800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c15fef0 0x7f0c4c160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.265+0000 7f0c54800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c15f180 con 0x7f0c4c15fef0 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.265+0000 7f0c54800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c0d08c0 con 0x7f0c4c0d0480 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.265+0000 7f0c54800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0c4c15f300 con 0x7f0c4c15eda0 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.265+0000 7f0c51400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 0x7f0c4c161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.265+0000 7f0c52800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c15fef0 0x7f0c4c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c51400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 0x7f0c4c161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:52948/0 (socket says 172.21.15.99:52948) 2024-09-10T07:34:59.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c52800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c15fef0 0x7f0c4c160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53786/0 (socket says 172.21.15.99:53786) 2024-09-10T07:34:59.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c52800640 1 -- 172.21.15.99:0/3843961829 learned_addr learned my addr 172.21.15.99:0/3843961829 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:34:59.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c51e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c4c0d0480 0x7f0c4c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:59.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c52800640 1 -- 172.21.15.99:0/3843961829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 msgr2=0x7f0c4c161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:59.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c52800640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 0x7f0c4c161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:59.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c52800640 1 -- 172.21.15.99:0/3843961829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c4c0d0480 msgr2=0x7f0c4c15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:34:59.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c52800640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c4c0d0480 0x7f0c4c15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:34:59.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c52800640 1 -- 172.21.15.99:0/3843961829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c1609b0 con 0x7f0c4c15fef0 2024-09-10T07:34:59.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c52800640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c15fef0 0x7f0c4c160380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800c710 tx=0x7f0c4800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:59.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c46000640 1 -- 172.21.15.99:0/3843961829 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48016020 con 0x7f0c4c15fef0 2024-09-10T07:34:59.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c46000640 1 -- 172.21.15.99:0/3843961829 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c48006d50 con 0x7f0c4c15fef0 2024-09-10T07:34:59.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c46000640 1 -- 172.21.15.99:0/3843961829 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48003bb0 con 0x7f0c4c15fef0 2024-09-10T07:34:59.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.266+0000 7f0c54800640 1 -- 172.21.15.99:0/3843961829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4c160c90 con 0x7f0c4c15fef0 2024-09-10T07:34:59.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.267+0000 7f0c54800640 1 -- 172.21.15.99:0/3843961829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4c161250 con 0x7f0c4c15fef0 2024-09-10T07:34:59.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.268+0000 7f0c54800640 1 -- 172.21.15.99:0/3843961829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c4c0d35b0 con 0x7f0c4c15fef0 2024-09-10T07:34:59.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.269+0000 7f0c46000640 1 -- 172.21.15.99:0/3843961829 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c480050d0 con 0x7f0c4c15fef0 2024-09-10T07:34:59.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.270+0000 7f0c46000640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c3006be60 0x7f0c3006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:34:59.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.270+0000 7f0c46000640 1 -- 172.21.15.99:0/3843961829 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7f0c4808a5d0 con 0x7f0c4c15fef0 2024-09-10T07:34:59.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.270+0000 7f0c51e00640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c3006be60 0x7f0c3006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:34:59.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.271+0000 7f0c51e00640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c3006be60 0x7f0c3006e320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0ce190 tx=0x7f0c40009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:34:59.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.274+0000 7f0c46000640 1 -- 172.21.15.99:0/3843961829 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c48020020 con 0x7f0c4c15fef0 2024-09-10T07:34:59.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:34:59.468+0000 7f0c54800640 1 -- 172.21.15.99:0/3843961829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0c4c0d2330 con 0x7f0c4c15fef0 2024-09-10T07:35:00.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.016+0000 7f0c46000640 1 -- 172.21.15.99:0/3843961829 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7f0c48058c20 con 0x7f0c4c15fef0 2024-09-10T07:35:00.016 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.019+0000 7f0c54800640 1 -- 172.21.15.99:0/3843961829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c3006be60 msgr2=0x7f0c3006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.019+0000 7f0c54800640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c3006be60 0x7f0c3006e320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0ce190 tx=0x7f0c40009190 comp rx=0 tx=0).stop 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.019+0000 7f0c54800640 1 -- 172.21.15.99:0/3843961829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c15fef0 msgr2=0x7f0c4c160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.019+0000 7f0c54800640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c15fef0 0x7f0c4c160380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800c710 tx=0x7f0c4800cbd0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.019+0000 7f0c54800640 1 -- 172.21.15.99:0/3843961829 shutdown_connections 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.019+0000 7f0c54800640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c3006be60 0x7f0c3006e320 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.019+0000 7f0c54800640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c4c15fef0 0x7f0c4c160380 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.019+0000 7f0c54800640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4c15eda0 0x7f0c4c161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.019+0000 7f0c54800640 1 --2- 172.21.15.99:0/3843961829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c4c0d0480 0x7f0c4c15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.019+0000 7f0c54800640 1 -- 172.21.15.99:0/3843961829 >> 172.21.15.99:0/3843961829 conn(0x7f0c4c09df40 msgr2=0x7f0c4c0b9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:00.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.020+0000 7f0c54800640 1 -- 172.21.15.99:0/3843961829 shutdown_connections 2024-09-10T07:35:00.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.020+0000 7f0c54800640 1 -- 172.21.15.99:0/3843961829 wait complete. 2024-09-10T07:35:00.036 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T07:35:00.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.191+0000 7f59ebe00640 1 Processor -- start 2024-09-10T07:35:00.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.191+0000 7f59ebe00640 1 -- start start 2024-09-10T07:35:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.192+0000 7f59ebe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59e415ef50 0x7f59e40d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.192+0000 7f59ebe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59e40d3240 0x7f59e40d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.192+0000 7f59ebe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e40b7a90 con 0x7f59e40d5780 2024-09-10T07:35:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.192+0000 7f59ebe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f59e40d3740 con 0x7f59e40d3240 2024-09-10T07:35:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.192+0000 7f59ebe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f59e40d3a20 con 0x7f59e415ef50 2024-09-10T07:35:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.193+0000 7f59e8a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59e40d3240 0x7f59e40d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.193+0000 7f59e8a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59e40d3240 0x7f59e40d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50670/0 (socket says 172.21.15.99:50670) 2024-09-10T07:35:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.193+0000 7f59e8a00640 1 -- 172.21.15.99:0/2553313765 learned_addr learned my addr 172.21.15.99:0/2553313765 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.193+0000 7f59e9400640 1 --2- 172.21.15.99:0/2553313765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59e415ef50 0x7f59e40d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.193+0000 7f59e8a00640 1 -- 172.21.15.99:0/2553313765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59e415ef50 msgr2=0x7f59e40d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:00.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.193+0000 7f59e8a00640 1 --2- 172.21.15.99:0/2553313765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59e415ef50 0x7f59e40d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.193+0000 7f59e8a00640 1 -- 172.21.15.99:0/2553313765 >> v1:172.21.15.187:6789/0 conn(0x7f59e40d5780 legacy=0x7f59e40cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.193+0000 7f59e8a00640 1 -- 172.21.15.99:0/2553313765 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e40b7d00 con 0x7f59e40d3240 2024-09-10T07:35:00.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.195+0000 7f59e8a00640 1 --2- 172.21.15.99:0/2553313765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e40d3240 0x7f59e40d18e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009870 tx=0x7f59d002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc9e1330a9bf7ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.195+0000 7f59e3e00640 1 -- 172.21.15.99:0/2553313765 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0037070 con 0x7f59e40d3240 2024-09-10T07:35:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.195+0000 7f59e3e00640 1 -- 172.21.15.99:0/2553313765 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d0032440 con 0x7f59e40d3240 2024-09-10T07:35:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.195+0000 7f59e3e00640 1 -- 172.21.15.99:0/2553313765 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0032810 con 0x7f59e40d3240 2024-09-10T07:35:00.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.196+0000 7f59ebe00640 1 -- 172.21.15.99:0/2553313765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e40d3240 msgr2=0x7f59e40d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.196+0000 7f59ebe00640 1 --2- 172.21.15.99:0/2553313765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e40d3240 0x7f59e40d18e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009870 tx=0x7f59d002a1c0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.196+0000 7f59ebe00640 1 -- 172.21.15.99:0/2553313765 shutdown_connections 2024-09-10T07:35:00.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.196+0000 7f59ebe00640 1 --2- 172.21.15.99:0/2553313765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e40d3240 0x7f59e40d18e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.196+0000 7f59ebe00640 1 --2- 172.21.15.99:0/2553313765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59e415ef50 0x7f59e40d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.196+0000 7f59ebe00640 1 -- 172.21.15.99:0/2553313765 >> 172.21.15.99:0/2553313765 conn(0x7f59e40d4c60 msgr2=0x7f59e40d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:00.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.196+0000 7f59ebe00640 1 -- 172.21.15.99:0/2553313765 shutdown_connections 2024-09-10T07:35:00.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.196+0000 7f59ebe00640 1 -- 172.21.15.99:0/2553313765 wait complete. 2024-09-10T07:35:00.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.197+0000 7f59ebe00640 1 Processor -- start 2024-09-10T07:35:00.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.198+0000 7f59ebe00640 1 -- start start 2024-09-10T07:35:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.198+0000 7f59ebe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59e40d3240 0x7f59e40cea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.198+0000 7f59ebe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59e40d5780 0x7f59e41e6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.198+0000 7f59ebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e415ef50 0x7f59e41f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.198+0000 7f59ebe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f59e40d21a0 con 0x7f59e415ef50 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.198+0000 7f59ebe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f59e40d2020 con 0x7f59e40d5780 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.198+0000 7f59ebe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f59e40b9510 con 0x7f59e40d3240 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e415ef50 0x7f59e41f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e9400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59e40d3240 0x7f59e40cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e8a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59e40d5780 0x7f59e41e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e415ef50 0x7f59e41f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50684/0 (socket says 172.21.15.99:50684) 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e9e00640 1 -- 172.21.15.99:0/3723218078 learned_addr learned my addr 172.21.15.99:0/3723218078 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e9e00640 1 -- 172.21.15.99:0/3723218078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59e40d3240 msgr2=0x7f59e40cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e9e00640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59e40d3240 0x7f59e40cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e9e00640 1 -- 172.21.15.99:0/3723218078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59e40d5780 msgr2=0x7f59e41e6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e9e00640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59e40d5780 0x7f59e41e6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e9e00640 1 -- 172.21.15.99:0/3723218078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e41f5590 con 0x7f59e415ef50 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.199+0000 7f59e8a00640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59e40d5780 0x7f59e41e6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:00.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.200+0000 7f59e9e00640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e415ef50 0x7f59e41f4980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00c730 tx=0x7f59dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:00.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.200+0000 7f59e1600640 1 -- 172.21.15.99:0/3723218078 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc003b70 con 0x7f59e415ef50 2024-09-10T07:35:00.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.200+0000 7f59e1600640 1 -- 172.21.15.99:0/3723218078 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59dc003d10 con 0x7f59e415ef50 2024-09-10T07:35:00.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.200+0000 7f59e1600640 1 -- 172.21.15.99:0/3723218078 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00aa90 con 0x7f59e415ef50 2024-09-10T07:35:00.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.200+0000 7f59ebe00640 1 -- 172.21.15.99:0/3723218078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e40cdf50 con 0x7f59e415ef50 2024-09-10T07:35:00.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.200+0000 7f59ebe00640 1 -- 172.21.15.99:0/3723218078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e40ce510 con 0x7f59e415ef50 2024-09-10T07:35:00.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.201+0000 7f59ebe00640 1 -- 172.21.15.99:0/3723218078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e40d13a0 con 0x7f59e415ef50 2024-09-10T07:35:00.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.202+0000 7f59e1600640 1 -- 172.21.15.99:0/3723218078 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59dc00ac30 con 0x7f59e415ef50 2024-09-10T07:35:00.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.203+0000 7f59e1600640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f59c406be30 0x7f59c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.203+0000 7f59e1600640 1 -- 172.21.15.99:0/3723218078 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f59dc08a980 con 0x7f59e415ef50 2024-09-10T07:35:00.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.203+0000 7f59e9400640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f59c406be30 0x7f59c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.204+0000 7f59e9400640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f59c406be30 0x7f59c406e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009aa0 tx=0x7f59d8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:00.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.207+0000 7f59e1600640 1 -- 172.21.15.99:0/3723218078 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59dc058f90 con 0x7f59e415ef50 2024-09-10T07:35:00.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.470+0000 7f59ebe00640 1 -- 172.21.15.99:0/3723218078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f59e40b9a90 con 0x7f59e415ef50 2024-09-10T07:35:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.471+0000 7f59e1600640 1 -- 172.21.15.99:0/3723218078 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f59dc05d290 con 0x7f59e415ef50 2024-09-10T07:35:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:00.471 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:35:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-09-10T07:35:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-09-10T07:35:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw==", 2024-09-10T07:35:00.471 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ==", 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:35:00.472 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw==", 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw==", 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA==", 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.474 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A==", 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.475 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w==", 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA==", 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:00.476 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w==", 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-09-10T07:35:00.477 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw==", 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw==", 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg==", 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg==", 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.479 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ==", 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:35:00.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A==", 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw==", 2024-09-10T07:35:00.481 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBc9t9m2Fs5JBAAQfJNCUhmbHevYDJWsG/oAg==", 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-mds", 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBp9t9mwy83NhAAsVgRSf3gShzY3ieHdeM/cA==", 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-mds" 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-mgr", 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBp9t9mgjk3NhAAZ9vjBQr+Fkn/lFRZqoODhw==", 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-10T07:35:00.483 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-osd", 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBp9t9m/EE3NhAAsMb3Dk1+rCTRv7/kLWkV0A==", 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-osd" 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-rbd", 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBp9t9mako3NhAAylRLCtwu23Tzf2g719MSqA==", 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-10T07:35:00.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBp9t9mxVM3NhAAu1qyqrQ4ERHuwYL+A20Eww==", 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.bootstrap-rgw", 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBp9t9mjV03NhAAppOUY8JOEzVPJI8GDfq+xQ==", 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q==", 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw==", 2024-09-10T07:35:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:35:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:35:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:00.487 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:35:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 -- 172.21.15.99:0/3723218078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f59c406be30 msgr2=0x7f59c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f59c406be30 0x7f59c406e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009aa0 tx=0x7f59d8009190 comp rx=0 tx=0).stop 2024-09-10T07:35:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 -- 172.21.15.99:0/3723218078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e415ef50 msgr2=0x7f59e41f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e415ef50 0x7f59e41f4980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00c730 tx=0x7f59dc00cbf0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 -- 172.21.15.99:0/3723218078 shutdown_connections 2024-09-10T07:35:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f59c406be30 0x7f59c406e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59e415ef50 0x7f59e41f4980 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59e40d5780 0x7f59e41e6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 --2- 172.21.15.99:0/3723218078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59e40d3240 0x7f59e40cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 -- 172.21.15.99:0/3723218078 >> 172.21.15.99:0/3723218078 conn(0x7f59e40d4c60 msgr2=0x7f59e40d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:00.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 -- 172.21.15.99:0/3723218078 shutdown_connections 2024-09-10T07:35:00.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.473+0000 7f59ebe00640 1 -- 172.21.15.99:0/3723218078 wait complete. 2024-09-10T07:35:00.490 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-10T07:35:00.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.646+0000 7f7f5b400640 1 Processor -- start 2024-09-10T07:35:00.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.647+0000 7f7f5b400640 1 -- start start 2024-09-10T07:35:00.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f5b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7f5406f620 0x7f7f54073850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f5b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f541626a0 0x7f7f54162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f5b400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f540b6fa0 con 0x7f7f5415c720 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f5b400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7f54160480 con 0x7f7f541626a0 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f5b400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7f5415fa50 con 0x7f7f5406f620 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f59400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f541626a0 0x7f7f54162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f59400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f541626a0 0x7f7f54162ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50696/0 (socket says 172.21.15.99:50696) 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f59400640 1 -- 172.21.15.99:0/4186820220 learned_addr learned my addr 172.21.15.99:0/4186820220 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f4be00640 1 --2- 172.21.15.99:0/4186820220 >> v2:172.21.15.187:3300/0 conn(0x7f7f5406f620 0x7f7f54073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f59400640 1 -- 172.21.15.99:0/4186820220 >> v2:172.21.15.187:3300/0 conn(0x7f7f5406f620 msgr2=0x7f7f54073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f59400640 1 --2- 172.21.15.99:0/4186820220 >> v2:172.21.15.187:3300/0 conn(0x7f7f5406f620 0x7f7f54073850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f59400640 1 -- 172.21.15.99:0/4186820220 >> v1:172.21.15.187:6789/0 conn(0x7f7f5415c720 legacy=0x7f7f54073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.648+0000 7f7f59400640 1 -- 172.21.15.99:0/4186820220 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5406fa40 con 0x7f7f541626a0 2024-09-10T07:35:00.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.649+0000 7f7f59400640 1 --2- 172.21.15.99:0/4186820220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f541626a0 0x7f7f54162ae0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7f54071d00 tx=0x7f7f4c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c499ff7da2f8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:00.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f53e00640 1 -- 172.21.15.99:0/4186820220 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c036070 con 0x7f7f541626a0 2024-09-10T07:35:00.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f53e00640 1 -- 172.21.15.99:0/4186820220 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4c031600 con 0x7f7f541626a0 2024-09-10T07:35:00.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f53e00640 1 -- 172.21.15.99:0/4186820220 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0319f0 con 0x7f7f541626a0 2024-09-10T07:35:00.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f5b400640 1 -- 172.21.15.99:0/4186820220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f541626a0 msgr2=0x7f7f54162ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f5b400640 1 --2- 172.21.15.99:0/4186820220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f541626a0 0x7f7f54162ae0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7f54071d00 tx=0x7f7f4c02a7c0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f5b400640 1 -- 172.21.15.99:0/4186820220 shutdown_connections 2024-09-10T07:35:00.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f5b400640 1 --2- 172.21.15.99:0/4186820220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f541626a0 0x7f7f54162ae0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f5b400640 1 --2- 172.21.15.99:0/4186820220 >> v2:172.21.15.187:3300/0 conn(0x7f7f5406f620 0x7f7f54073850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f5b400640 1 -- 172.21.15.99:0/4186820220 >> 172.21.15.99:0/4186820220 conn(0x7f7f540b5eb0 msgr2=0x7f7f540b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:00.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f5b400640 1 -- 172.21.15.99:0/4186820220 shutdown_connections 2024-09-10T07:35:00.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.650+0000 7f7f5b400640 1 -- 172.21.15.99:0/4186820220 wait complete. 2024-09-10T07:35:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.652+0000 7f7f5b400640 1 Processor -- start 2024-09-10T07:35:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.652+0000 7f7f5b400640 1 -- start start 2024-09-10T07:35:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f5b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f5406f620 0x7f7f541575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f5b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f5415c720 0x7f7f541508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f5b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f541626a0 0x7f7f54152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f5b400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5415f6e0 con 0x7f7f5406f620 2024-09-10T07:35:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f5b400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5415f400 con 0x7f7f541626a0 2024-09-10T07:35:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f5b400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5415f0b0 con 0x7f7f5415c720 2024-09-10T07:35:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f58a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f5406f620 0x7f7f541575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f58a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f5406f620 0x7f7f541575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50710/0 (socket says 172.21.15.99:50710) 2024-09-10T07:35:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f58a00640 1 -- 172.21.15.99:0/83674418 learned_addr learned my addr 172.21.15.99:0/83674418 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f4be00640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f5415c720 0x7f7f541508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.653+0000 7f7f59400640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f541626a0 0x7f7f54152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f58a00640 1 -- 172.21.15.99:0/83674418 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f5415c720 msgr2=0x7f7f541508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f58a00640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f5415c720 0x7f7f541508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f58a00640 1 -- 172.21.15.99:0/83674418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f541626a0 msgr2=0x7f7f54152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f58a00640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f541626a0 0x7f7f54152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f58a00640 1 -- 172.21.15.99:0/83674418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f541518f0 con 0x7f7f5406f620 2024-09-10T07:35:00.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f58a00640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f5406f620 0x7f7f541575b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400c450 tx=0x7f7f4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:00.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f51600640 1 -- 172.21.15.99:0/83674418 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f440052d0 con 0x7f7f5406f620 2024-09-10T07:35:00.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f51600640 1 -- 172.21.15.99:0/83674418 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f44005470 con 0x7f7f5406f620 2024-09-10T07:35:00.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f5b400640 1 -- 172.21.15.99:0/83674418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f54150e30 con 0x7f7f5406f620 2024-09-10T07:35:00.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f51600640 1 -- 172.21.15.99:0/83674418 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f44012870 con 0x7f7f5406f620 2024-09-10T07:35:00.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.654+0000 7f7f5b400640 1 -- 172.21.15.99:0/83674418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f54152110 con 0x7f7f5406f620 2024-09-10T07:35:00.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.655+0000 7f7f5b400640 1 -- 172.21.15.99:0/83674418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5415fee0 con 0x7f7f5406f620 2024-09-10T07:35:00.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.656+0000 7f7f51600640 1 -- 172.21.15.99:0/83674418 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f44012a10 con 0x7f7f5406f620 2024-09-10T07:35:00.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.657+0000 7f7f51600640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7f3006be30 0x7f7f3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:00.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.657+0000 7f7f51600640 1 -- 172.21.15.99:0/83674418 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f7f4408a530 con 0x7f7f5406f620 2024-09-10T07:35:00.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.657+0000 7f7f4be00640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7f3006be30 0x7f7f3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:00.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.658+0000 7f7f4be00640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7f3006be30 0x7f7f3006e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f541630c0 tx=0x7f7f3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:00.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.662+0000 7f7f51600640 1 -- 172.21.15.99:0/83674418 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f540b6fa0 con 0x7f7f5406f620 2024-09-10T07:35:00.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.896+0000 7f7f5b400640 1 -- 172.21.15.99:0/83674418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f7f54072960 con 0x7f7f5406f620 2024-09-10T07:35:00.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.899+0000 7f7f51600640 1 -- 172.21.15.99:0/83674418 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f7f44058c70 con 0x7f7f5406f620 2024-09-10T07:35:00.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.901+0000 7f7f5b400640 1 -- 172.21.15.99:0/83674418 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7f3006be30 msgr2=0x7f7f3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.901+0000 7f7f5b400640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7f3006be30 0x7f7f3006e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f541630c0 tx=0x7f7f3c008040 comp rx=0 tx=0).stop 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.901+0000 7f7f5b400640 1 -- 172.21.15.99:0/83674418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f5406f620 msgr2=0x7f7f541575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.901+0000 7f7f5b400640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f5406f620 0x7f7f541575b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400c450 tx=0x7f7f4400c910 comp rx=0 tx=0).stop 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.901+0000 7f7f5b400640 1 -- 172.21.15.99:0/83674418 shutdown_connections 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.901+0000 7f7f5b400640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f541626a0 0x7f7f54152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.901+0000 7f7f5b400640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f5415c720 0x7f7f541508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.901+0000 7f7f5b400640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7f3006be30 0x7f7f3006e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.901+0000 7f7f5b400640 1 --2- 172.21.15.99:0/83674418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f5406f620 0x7f7f541575b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.901+0000 7f7f5b400640 1 -- 172.21.15.99:0/83674418 >> 172.21.15.99:0/83674418 conn(0x7f7f540b5eb0 msgr2=0x7f7f5415abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.902+0000 7f7f5b400640 1 -- 172.21.15.99:0/83674418 shutdown_connections 2024-09-10T07:35:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:00.902+0000 7f7f5b400640 1 -- 172.21.15.99:0/83674418 wait complete. 2024-09-10T07:35:00.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-10T07:35:01.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.074+0000 7f29b2e00640 1 Processor -- start 2024-09-10T07:35:01.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.075+0000 7f29b2e00640 1 -- start start 2024-09-10T07:35:01.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.076+0000 7f29b2e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac15db60 0x7f29ac071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.076+0000 7f29b2e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29ac0724d0 0x7f29ac06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.076+0000 7f29b2e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29ac153e50 con 0x7f29ac06e580 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.076+0000 7f29b2e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f29ac15df40 con 0x7f29ac0724d0 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.076+0000 7f29b2e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f29ac06e9b0 con 0x7f29ac15db60 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.076+0000 7f29a3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29ac0724d0 0x7f29ac06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.076+0000 7f29a3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29ac0724d0 0x7f29ac06e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50714/0 (socket says 172.21.15.99:50714) 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.076+0000 7f29b0e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f29ac06e580 0x7f29ac160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43576/0 (socket says 172.21.15.99:43576) 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.076+0000 7f29a3400640 1 -- 172.21.15.99:0/204168528 learned_addr learned my addr 172.21.15.99:0/204168528 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.077+0000 7f29abe00640 1 --2- 172.21.15.99:0/204168528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac15db60 0x7f29ac071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.077+0000 7f29a3400640 1 -- 172.21.15.99:0/204168528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac15db60 msgr2=0x7f29ac071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.077+0000 7f29a3400640 1 --2- 172.21.15.99:0/204168528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac15db60 0x7f29ac071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.077+0000 7f29a3400640 1 -- 172.21.15.99:0/204168528 >> v1:172.21.15.99:6789/0 conn(0x7f29ac06e580 legacy=0x7f29ac160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.077+0000 7f29a3400640 1 -- 172.21.15.99:0/204168528 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac072ac0 con 0x7f29ac0724d0 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.077+0000 7f29ab400640 1 -- 172.21.15.99:0/204168528 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2104107097 0 0) 0x7f29ac153e50 con 0x7f29ac06e580 2024-09-10T07:35:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.077+0000 7f29abe00640 1 --2- 172.21.15.99:0/204168528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac15db60 0x7f29ac071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.078+0000 7f29a3400640 1 --2- 172.21.15.99:0/204168528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac0724d0 0x7f29ac06e040 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f29940098a0 tx=0x7f299402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a610a9848a48b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.078+0000 7f29ab400640 1 -- 172.21.15.99:0/204168528 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994037070 con 0x7f29ac0724d0 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.078+0000 7f29ab400640 1 -- 172.21.15.99:0/204168528 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2994032440 con 0x7f29ac0724d0 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.078+0000 7f29ab400640 1 -- 172.21.15.99:0/204168528 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994032810 con 0x7f29ac0724d0 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.078+0000 7f29b2e00640 1 -- 172.21.15.99:0/204168528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac0724d0 msgr2=0x7f29ac06e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.078+0000 7f29b2e00640 1 --2- 172.21.15.99:0/204168528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac0724d0 0x7f29ac06e040 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f29940098a0 tx=0x7f299402a290 comp rx=0 tx=0).stop 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.078+0000 7f29b2e00640 1 -- 172.21.15.99:0/204168528 shutdown_connections 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.078+0000 7f29b2e00640 1 --2- 172.21.15.99:0/204168528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac0724d0 0x7f29ac06e040 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.078+0000 7f29b2e00640 1 --2- 172.21.15.99:0/204168528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac15db60 0x7f29ac071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.078+0000 7f29b2e00640 1 -- 172.21.15.99:0/204168528 >> 172.21.15.99:0/204168528 conn(0x7f29ac0b2630 msgr2=0x7f29ac0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.079+0000 7f29b2e00640 1 -- 172.21.15.99:0/204168528 shutdown_connections 2024-09-10T07:35:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.079+0000 7f29b2e00640 1 -- 172.21.15.99:0/204168528 wait complete. 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.080+0000 7f29b2e00640 1 Processor -- start 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.080+0000 7f29b2e00640 1 -- start start 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.081+0000 7f29b2e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06e580 0x7f29ac153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.081+0000 7f29b2e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac0724d0 0x7f29ac1607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.081+0000 7f29b2e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac15db60 0x7f29ac1e8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.081+0000 7f29b2e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac073360 con 0x7f29ac06e580 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.081+0000 7f29b2e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac0730c0 con 0x7f29ac15db60 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.081+0000 7f29b2e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f29ac073640 con 0x7f29ac0724d0 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.081+0000 7f29abe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06e580 0x7f29ac153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.081+0000 7f29abe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06e580 0x7f29ac153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50722/0 (socket says 172.21.15.99:50722) 2024-09-10T07:35:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.081+0000 7f29abe00640 1 -- 172.21.15.99:0/1820837925 learned_addr learned my addr 172.21.15.99:0/1820837925 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.082+0000 7f29abe00640 1 -- 172.21.15.99:0/1820837925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac0724d0 msgr2=0x7f29ac1607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.082+0000 7f29abe00640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac0724d0 0x7f29ac1607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.082+0000 7f29abe00640 1 -- 172.21.15.99:0/1820837925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac15db60 msgr2=0x7f29ac1e8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.082+0000 7f29abe00640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac15db60 0x7f29ac1e8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.082+0000 7f29abe00640 1 -- 172.21.15.99:0/1820837925 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac15f750 con 0x7f29ac06e580 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.082+0000 7f29abe00640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06e580 0x7f29ac153300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c820 tx=0x7f299c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.082+0000 7f29a8c00640 1 -- 172.21.15.99:0/1820837925 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c015070 con 0x7f29ac06e580 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.082+0000 7f29a8c00640 1 -- 172.21.15.99:0/1820837925 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299c007a30 con 0x7f29ac06e580 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.082+0000 7f29b2e00640 1 -- 172.21.15.99:0/1820837925 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ac15fa30 con 0x7f29ac06e580 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.082+0000 7f29a8c00640 1 -- 172.21.15.99:0/1820837925 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c007de0 con 0x7f29ac06e580 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.083+0000 7f29b2e00640 1 -- 172.21.15.99:0/1820837925 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ac15fff0 con 0x7f29ac06e580 2024-09-10T07:35:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.084+0000 7f29b2e00640 1 -- 172.21.15.99:0/1820837925 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29ac0b3ba0 con 0x7f29ac06e580 2024-09-10T07:35:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.084+0000 7f29a8c00640 1 -- 172.21.15.99:0/1820837925 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f299c018070 con 0x7f29ac06e580 2024-09-10T07:35:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.085+0000 7f29a8c00640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f298806be30 0x7f298806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.085+0000 7f29a8c00640 1 -- 172.21.15.99:0/1820837925 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f299c08aa40 con 0x7f29ac06e580 2024-09-10T07:35:01.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.086+0000 7f29a3400640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f298806be30 0x7f298806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.086+0000 7f29a3400640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f298806be30 0x7f298806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2994034000 tx=0x7f299402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:01.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.090+0000 7f29a8c00640 1 -- 172.21.15.99:0/1820837925 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29ac0b3ba0 con 0x7f29ac06e580 2024-09-10T07:35:01.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.329+0000 7f29b2e00640 1 -- 172.21.15.99:0/1820837925 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f29ac06e040 con 0x7f29ac06e580 2024-09-10T07:35:01.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.331+0000 7f29a8c00640 1 -- 172.21.15.99:0/1820837925 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f299c059730 con 0x7f29ac06e580 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.333+0000 7f29b2e00640 1 -- 172.21.15.99:0/1820837925 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f298806be30 msgr2=0x7f298806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.333+0000 7f29b2e00640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f298806be30 0x7f298806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2994034000 tx=0x7f299402c000 comp rx=0 tx=0).stop 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.333+0000 7f29b2e00640 1 -- 172.21.15.99:0/1820837925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06e580 msgr2=0x7f29ac153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.333+0000 7f29b2e00640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06e580 0x7f29ac153300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c820 tx=0x7f299c00cce0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.334+0000 7f29b2e00640 1 -- 172.21.15.99:0/1820837925 shutdown_connections 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.334+0000 7f29b2e00640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac15db60 0x7f29ac1e8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.334+0000 7f29b2e00640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac0724d0 0x7f29ac1607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.334+0000 7f29b2e00640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f298806be30 0x7f298806e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.334+0000 7f29b2e00640 1 --2- 172.21.15.99:0/1820837925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06e580 0x7f29ac153300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.334+0000 7f29b2e00640 1 -- 172.21.15.99:0/1820837925 >> 172.21.15.99:0/1820837925 conn(0x7f29ac0b2630 msgr2=0x7f29ac0cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:01.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.334+0000 7f29b2e00640 1 -- 172.21.15.99:0/1820837925 shutdown_connections 2024-09-10T07:35:01.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.334+0000 7f29b2e00640 1 -- 172.21.15.99:0/1820837925 wait complete. 2024-09-10T07:35:01.350 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-10T07:35:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.504+0000 7fd516200640 1 Processor -- start 2024-09-10T07:35:01.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.504+0000 7fd516200640 1 -- start start 2024-09-10T07:35:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.505+0000 7fd516200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd5100d3070 0x7fd5100d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.505+0000 7fd516200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 0x7fd5100d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.505+0000 7fd516200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd5100d51a0 0x7fd5100d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.505+0000 7fd516200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd5100cf740 con 0x7fd5100d3070 2024-09-10T07:35:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.505+0000 7fd516200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd5100d3990 con 0x7fd5100d51a0 2024-09-10T07:35:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.505+0000 7fd516200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd5100d5910 con 0x7fd51015ed10 2024-09-10T07:35:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.505+0000 7fd514e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd5100d3070 0x7fd5100d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.505+0000 7fd514e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd5100d3070 0x7fd5100d3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50724/0 (socket says 172.21.15.99:50724) 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.505+0000 7fd514e00640 1 -- 172.21.15.99:0/2442566597 learned_addr learned my addr 172.21.15.99:0/2442566597 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.506+0000 7fd515800640 1 --2- 172.21.15.99:0/2442566597 >> v2:172.21.15.187:3300/0 conn(0x7fd5100d51a0 0x7fd5100d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.506+0000 7fd50fe00640 1 --2- 172.21.15.99:0/2442566597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 0x7fd5100d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.506+0000 7fd514e00640 1 -- 172.21.15.99:0/2442566597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 msgr2=0x7fd5100d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.506+0000 7fd514e00640 1 --2- 172.21.15.99:0/2442566597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 0x7fd5100d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.506+0000 7fd514e00640 1 -- 172.21.15.99:0/2442566597 >> v2:172.21.15.187:3300/0 conn(0x7fd5100d51a0 msgr2=0x7fd5100d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.506+0000 7fd514e00640 1 --2- 172.21.15.99:0/2442566597 >> v2:172.21.15.187:3300/0 conn(0x7fd5100d51a0 0x7fd5100d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.506+0000 7fd514e00640 1 -- 172.21.15.99:0/2442566597 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5100d5630 con 0x7fd5100d3070 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.506+0000 7fd515800640 1 --2- 172.21.15.99:0/2442566597 >> v2:172.21.15.187:3300/0 conn(0x7fd5100d51a0 0x7fd5100d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.506+0000 7fd50fe00640 1 --2- 172.21.15.99:0/2442566597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 0x7fd5100d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.507+0000 7fd514e00640 1 --2- 172.21.15.99:0/2442566597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100d3070 0x7fd5100d3450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd51008e860 tx=0x7fd50402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc57398113de581 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.507+0000 7fd50f400640 1 -- 172.21.15.99:0/2442566597 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504037070 con 0x7fd5100d3070 2024-09-10T07:35:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.507+0000 7fd50f400640 1 -- 172.21.15.99:0/2442566597 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd504032440 con 0x7fd5100d3070 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.507+0000 7fd50f400640 1 -- 172.21.15.99:0/2442566597 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504032810 con 0x7fd5100d3070 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.508+0000 7fd516200640 1 -- 172.21.15.99:0/2442566597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100d3070 msgr2=0x7fd5100d3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.508+0000 7fd516200640 1 --2- 172.21.15.99:0/2442566597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100d3070 0x7fd5100d3450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd51008e860 tx=0x7fd50402a270 comp rx=0 tx=0).stop 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.508+0000 7fd516200640 1 -- 172.21.15.99:0/2442566597 shutdown_connections 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.508+0000 7fd516200640 1 --2- 172.21.15.99:0/2442566597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 0x7fd5100d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.508+0000 7fd516200640 1 --2- 172.21.15.99:0/2442566597 >> v2:172.21.15.187:3300/0 conn(0x7fd5100d51a0 0x7fd5100d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.508+0000 7fd516200640 1 --2- 172.21.15.99:0/2442566597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100d3070 0x7fd5100d3450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.508+0000 7fd516200640 1 -- 172.21.15.99:0/2442566597 >> 172.21.15.99:0/2442566597 conn(0x7fd51009dd60 msgr2=0x7fd5100d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.508+0000 7fd516200640 1 -- 172.21.15.99:0/2442566597 shutdown_connections 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.508+0000 7fd516200640 1 -- 172.21.15.99:0/2442566597 wait complete. 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.509+0000 7fd516200640 1 Processor -- start 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.509+0000 7fd516200640 1 -- start start 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.510+0000 7fd516200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5100d3070 0x7fd5100cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.510+0000 7fd516200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 0x7fd5101f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.510+0000 7fd516200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100cd0e0 0x7fd5100ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.510+0000 7fd516200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd5100d2ba0 con 0x7fd5100cd0e0 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.510+0000 7fd516200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd5100cfcc0 con 0x7fd5100d3070 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.510+0000 7fd516200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd5100d2d20 con 0x7fd51015ed10 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd515800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100cd0e0 0x7fd5100ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd515800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100cd0e0 0x7fd5100ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50726/0 (socket says 172.21.15.99:50726) 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd515800640 1 -- 172.21.15.99:0/4242094000 learned_addr learned my addr 172.21.15.99:0/4242094000 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd514e00640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5100d3070 0x7fd5100cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd50fe00640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 0x7fd5101f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd515800640 1 -- 172.21.15.99:0/4242094000 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 msgr2=0x7fd5101f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd515800640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 0x7fd5101f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd515800640 1 -- 172.21.15.99:0/4242094000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5100d3070 msgr2=0x7fd5100cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd515800640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5100d3070 0x7fd5100cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd515800640 1 -- 172.21.15.99:0/4242094000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5101f5e60 con 0x7fd5100cd0e0 2024-09-10T07:35:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd515800640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100cd0e0 0x7fd5100ce1f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd50800cd40 tx=0x7fd50800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.511+0000 7fd50cc00640 1 -- 172.21.15.99:0/4242094000 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50800f680 con 0x7fd5100cd0e0 2024-09-10T07:35:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.512+0000 7fd50cc00640 1 -- 172.21.15.99:0/4242094000 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50800f840 con 0x7fd5100cd0e0 2024-09-10T07:35:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.512+0000 7fd50cc00640 1 -- 172.21.15.99:0/4242094000 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50800fc30 con 0x7fd5100cd0e0 2024-09-10T07:35:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.512+0000 7fd516200640 1 -- 172.21.15.99:0/4242094000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5100cbd70 con 0x7fd5100cd0e0 2024-09-10T07:35:01.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.512+0000 7fd516200640 1 -- 172.21.15.99:0/4242094000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5101f4e40 con 0x7fd5100cd0e0 2024-09-10T07:35:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.513+0000 7fd516200640 1 -- 172.21.15.99:0/4242094000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5100d3450 con 0x7fd5100cd0e0 2024-09-10T07:35:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.514+0000 7fd50cc00640 1 -- 172.21.15.99:0/4242094000 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd50800e3e0 con 0x7fd5100cd0e0 2024-09-10T07:35:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.515+0000 7fd50cc00640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd4f006be30 0x7fd4f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.515+0000 7fd50cc00640 1 -- 172.21.15.99:0/4242094000 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fd50808b680 con 0x7fd5100cd0e0 2024-09-10T07:35:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.515+0000 7fd514e00640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd4f006be30 0x7fd4f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.516+0000 7fd514e00640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd4f006be30 0x7fd4f006e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd504034000 tx=0x7fd50402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:01.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.519+0000 7fd50cc00640 1 -- 172.21.15.99:0/4242094000 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd508014030 con 0x7fd5100cd0e0 2024-09-10T07:35:01.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.760+0000 7fd516200640 1 -- 172.21.15.99:0/4242094000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fd5100d4870 con 0x7fd5100cd0e0 2024-09-10T07:35:01.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.763+0000 7fd50cc00640 1 -- 172.21.15.99:0/4242094000 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fd508059d30 con 0x7fd5100cd0e0 2024-09-10T07:35:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 -- 172.21.15.99:0/4242094000 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd4f006be30 msgr2=0x7fd4f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd4f006be30 0x7fd4f006e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd504034000 tx=0x7fd50402e000 comp rx=0 tx=0).stop 2024-09-10T07:35:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 -- 172.21.15.99:0/4242094000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100cd0e0 msgr2=0x7fd5100ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100cd0e0 0x7fd5100ce1f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd50800cd40 tx=0x7fd50800a650 comp rx=0 tx=0).stop 2024-09-10T07:35:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 -- 172.21.15.99:0/4242094000 shutdown_connections 2024-09-10T07:35:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd4f006be30 0x7fd4f006e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5100cd0e0 0x7fd5100ce1f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51015ed10 0x7fd5101f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 --2- 172.21.15.99:0/4242094000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5100d3070 0x7fd5100cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 -- 172.21.15.99:0/4242094000 >> 172.21.15.99:0/4242094000 conn(0x7fd51009dd60 msgr2=0x7fd5100b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 -- 172.21.15.99:0/4242094000 shutdown_connections 2024-09-10T07:35:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.765+0000 7fd516200640 1 -- 172.21.15.99:0/4242094000 wait complete. 2024-09-10T07:35:01.780 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-10T07:35:01.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.934+0000 7f0babe00640 1 Processor -- start 2024-09-10T07:35:01.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.934+0000 7f0babe00640 1 -- start start 2024-09-10T07:35:01.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.935+0000 7f0babe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0bac0d3070 0x7f0bac0d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.935+0000 7f0babe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 0x7f0bac0d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.935+0000 7f0babe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bac0cf740 con 0x7f0bac0d51a0 2024-09-10T07:35:01.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.935+0000 7f0babe00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0bac0d3990 con 0x7f0bac0d3070 2024-09-10T07:35:01.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.935+0000 7f0babe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac0d08f0 con 0x7f0bac15ed10 2024-09-10T07:35:01.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.935+0000 7f0bab400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0bac0d51a0 0x7f0bac0d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43586/0 (socket says 172.21.15.99:43586) 2024-09-10T07:35:01.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.935+0000 7f0bab400640 1 -- 172.21.15.99:0/1241675668 learned_addr learned my addr 172.21.15.99:0/1241675668 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:01.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.936+0000 7f0baaa00640 1 --2- 172.21.15.99:0/1241675668 >> v2:172.21.15.187:3300/0 conn(0x7f0bac0d3070 0x7f0bac0d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.936+0000 7f0baa000640 1 --2- 172.21.15.99:0/1241675668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 0x7f0bac0d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.936+0000 7f0ba9600640 1 -- 172.21.15.99:0/1241675668 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1084899592 0 0) 0x7f0bac0cf740 con 0x7f0bac0d51a0 2024-09-10T07:35:01.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.936+0000 7f0ba9600640 1 -- 172.21.15.99:0/1241675668 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b90003520 con 0x7f0bac0d51a0 2024-09-10T07:35:01.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.936+0000 7f0baaa00640 1 -- 172.21.15.99:0/1241675668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 msgr2=0x7f0bac0d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:01.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.936+0000 7f0ba9600640 1 -- 172.21.15.99:0/1241675668 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2130399340 0 0) 0x7f0b90003520 con 0x7f0bac0d51a0 2024-09-10T07:35:01.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.936+0000 7f0baaa00640 1 --2- 172.21.15.99:0/1241675668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 0x7f0bac0d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.936+0000 7f0baaa00640 1 -- 172.21.15.99:0/1241675668 >> v1:172.21.15.99:6789/0 conn(0x7f0bac0d51a0 legacy=0x7f0bac0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.936+0000 7f0baaa00640 1 -- 172.21.15.99:0/1241675668 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac0d5910 con 0x7f0bac0d3070 2024-09-10T07:35:01.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.937+0000 7f0baaa00640 1 --2- 172.21.15.99:0/1241675668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bac0d3070 0x7f0bac0d3450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0097a0 tx=0x7f0b9c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=127bf5764670ec5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:01.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0ba9600640 1 -- 172.21.15.99:0/1241675668 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c037070 con 0x7f0bac0d3070 2024-09-10T07:35:01.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0ba9600640 1 -- 172.21.15.99:0/1241675668 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b9c02ac30 con 0x7f0bac0d3070 2024-09-10T07:35:01.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0ba9600640 1 -- 172.21.15.99:0/1241675668 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba40019f0 con 0x7f0bac0d3070 2024-09-10T07:35:01.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0babe00640 1 -- 172.21.15.99:0/1241675668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bac0d3070 msgr2=0x7f0bac0d3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0babe00640 1 --2- 172.21.15.99:0/1241675668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bac0d3070 0x7f0bac0d3450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0097a0 tx=0x7f0b9c02a1a0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0babe00640 1 -- 172.21.15.99:0/1241675668 shutdown_connections 2024-09-10T07:35:01.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0babe00640 1 --2- 172.21.15.99:0/1241675668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 0x7f0bac0d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0babe00640 1 --2- 172.21.15.99:0/1241675668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bac0d3070 0x7f0bac0d3450 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0babe00640 1 -- 172.21.15.99:0/1241675668 >> 172.21.15.99:0/1241675668 conn(0x7f0bac09dd60 msgr2=0x7f0bac0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:01.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0babe00640 1 -- 172.21.15.99:0/1241675668 shutdown_connections 2024-09-10T07:35:01.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.938+0000 7f0babe00640 1 -- 172.21.15.99:0/1241675668 wait complete. 2024-09-10T07:35:01.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.940+0000 7f0babe00640 1 Processor -- start 2024-09-10T07:35:01.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.940+0000 7f0babe00640 1 -- start start 2024-09-10T07:35:01.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0babe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bac0d3070 0x7f0bac0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0babe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 0x7f0bac0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0babe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac0c8370 0x7f0bac0c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0babe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac0cfcc0 con 0x7f0bac0c8370 2024-09-10T07:35:01.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0babe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac0cf9e0 con 0x7f0bac0d3070 2024-09-10T07:35:01.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0babe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac0d2ba0 con 0x7f0bac15ed10 2024-09-10T07:35:01.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0bab400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac0c8370 0x7f0bac0c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0bab400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac0c8370 0x7f0bac0c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50736/0 (socket says 172.21.15.99:50736) 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0bab400640 1 -- 172.21.15.99:0/1341790495 learned_addr learned my addr 172.21.15.99:0/1341790495 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0baaa00640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bac0d3070 0x7f0bac0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.941+0000 7f0baa000640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 0x7f0bac0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0bab400640 1 -- 172.21.15.99:0/1341790495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 msgr2=0x7f0bac0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0bab400640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 0x7f0bac0ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0bab400640 1 -- 172.21.15.99:0/1341790495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bac0d3070 msgr2=0x7f0bac0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0bab400640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bac0d3070 0x7f0bac0cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0bab400640 1 -- 172.21.15.99:0/1341790495 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac14f7a0 con 0x7f0bac0c8370 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0baa000640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 0x7f0bac0ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0bab400640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac0c8370 0x7f0bac0c8800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400cb70 tx=0x7f0ba400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0ba3400640 1 -- 172.21.15.99:0/1341790495 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba400ad40 con 0x7f0bac0c8370 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0ba3400640 1 -- 172.21.15.99:0/1341790495 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba4012400 con 0x7f0bac0c8370 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0ba3400640 1 -- 172.21.15.99:0/1341790495 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba40127f0 con 0x7f0bac0c8370 2024-09-10T07:35:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0babe00640 1 -- 172.21.15.99:0/1341790495 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bac14fa30 con 0x7f0bac0c8370 2024-09-10T07:35:01.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.942+0000 7f0babe00640 1 -- 172.21.15.99:0/1341790495 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bac14fff0 con 0x7f0bac0c8370 2024-09-10T07:35:01.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.944+0000 7f0babe00640 1 -- 172.21.15.99:0/1341790495 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bac0d3450 con 0x7f0bac0c8370 2024-09-10T07:35:01.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.944+0000 7f0ba3400640 1 -- 172.21.15.99:0/1341790495 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ba4012990 con 0x7f0bac0c8370 2024-09-10T07:35:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.945+0000 7f0ba3400640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8c06be30 0x7f0b8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.945+0000 7f0ba3400640 1 -- 172.21.15.99:0/1341790495 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f0ba408b210 con 0x7f0bac0c8370 2024-09-10T07:35:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.945+0000 7f0baaa00640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8c06be30 0x7f0b8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:01.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.946+0000 7f0baaa00640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8c06be30 0x7f0b8c06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c034000 tx=0x7f0b9c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:01.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:01.950+0000 7f0ba3400640 1 -- 172.21.15.99:0/1341790495 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ba4059f10 con 0x7f0bac0c8370 2024-09-10T07:35:02.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.190+0000 7f0babe00640 1 -- 172.21.15.99:0/1341790495 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f0bac0d2040 con 0x7f0bac0c8370 2024-09-10T07:35:02.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.192+0000 7f0ba3400640 1 -- 172.21.15.99:0/1341790495 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f0ba4059810 con 0x7f0bac0c8370 2024-09-10T07:35:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.194+0000 7f0babe00640 1 -- 172.21.15.99:0/1341790495 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8c06be30 msgr2=0x7f0b8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.194+0000 7f0babe00640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8c06be30 0x7f0b8c06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c034000 tx=0x7f0b9c02e000 comp rx=0 tx=0).stop 2024-09-10T07:35:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.194+0000 7f0babe00640 1 -- 172.21.15.99:0/1341790495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac0c8370 msgr2=0x7f0bac0c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.194+0000 7f0babe00640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac0c8370 0x7f0bac0c8800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400cb70 tx=0x7f0ba400a430 comp rx=0 tx=0).stop 2024-09-10T07:35:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.195+0000 7f0babe00640 1 -- 172.21.15.99:0/1341790495 shutdown_connections 2024-09-10T07:35:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.195+0000 7f0babe00640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8c06be30 0x7f0b8c06e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.195+0000 7f0babe00640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac0c8370 0x7f0bac0c8800 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.195+0000 7f0babe00640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bac15ed10 0x7f0bac0ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.195+0000 7f0babe00640 1 --2- 172.21.15.99:0/1341790495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bac0d3070 0x7f0bac0cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.195+0000 7f0babe00640 1 -- 172.21.15.99:0/1341790495 >> 172.21.15.99:0/1341790495 conn(0x7f0bac09dd60 msgr2=0x7f0bac161190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:02.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.195+0000 7f0babe00640 1 -- 172.21.15.99:0/1341790495 shutdown_connections 2024-09-10T07:35:02.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.195+0000 7f0babe00640 1 -- 172.21.15.99:0/1341790495 wait complete. 2024-09-10T07:35:02.210 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-10T07:35:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.365+0000 7f192a000640 1 Processor -- start 2024-09-10T07:35:02.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.365+0000 7f192a000640 1 -- start start 2024-09-10T07:35:02.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.366+0000 7f192a000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f19240d3070 0x7f19240d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.366+0000 7f192a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19240d51a0 0x7f19240d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.366+0000 7f192a000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19240cf740 con 0x7f192415ed10 2024-09-10T07:35:02.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.366+0000 7f192a000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f19240d2d70 con 0x7f19240d3070 2024-09-10T07:35:02.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.366+0000 7f192a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f19240d3990 con 0x7f19240d51a0 2024-09-10T07:35:02.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.366+0000 7f191be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f192415ed10 0x7f19240d2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43592/0 (socket says 172.21.15.99:43592) 2024-09-10T07:35:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.366+0000 7f191be00640 1 -- 172.21.15.99:0/793813975 learned_addr learned my addr 172.21.15.99:0/793813975 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.367+0000 7f1928c00640 1 --2- 172.21.15.99:0/793813975 >> v2:172.21.15.187:3300/0 conn(0x7f19240d3070 0x7f19240d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.367+0000 7f1929600640 1 --2- 172.21.15.99:0/793813975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19240d51a0 0x7f19240d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.367+0000 7f1923e00640 1 -- 172.21.15.99:0/793813975 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4248554003 0 0) 0x7f19240cf740 con 0x7f192415ed10 2024-09-10T07:35:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.367+0000 7f1923e00640 1 -- 172.21.15.99:0/793813975 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1908003520 con 0x7f192415ed10 2024-09-10T07:35:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.367+0000 7f1928c00640 1 -- 172.21.15.99:0/793813975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19240d51a0 msgr2=0x7f19240d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.367+0000 7f1928c00640 1 --2- 172.21.15.99:0/793813975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19240d51a0 0x7f19240d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.367+0000 7f1928c00640 1 -- 172.21.15.99:0/793813975 >> v1:172.21.15.99:6789/0 conn(0x7f192415ed10 legacy=0x7f19240d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.367+0000 7f1928c00640 1 -- 172.21.15.99:0/793813975 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19240d5910 con 0x7f19240d3070 2024-09-10T07:35:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.368+0000 7f1928c00640 1 --2- 172.21.15.99:0/793813975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19240d3070 0x7f19240d3450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f19140097a0 tx=0x7f191402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57dfce50ed4907b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.368+0000 7f1923e00640 1 -- 172.21.15.99:0/793813975 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914037070 con 0x7f19240d3070 2024-09-10T07:35:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.368+0000 7f1923e00640 1 -- 172.21.15.99:0/793813975 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1914032440 con 0x7f19240d3070 2024-09-10T07:35:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.368+0000 7f1923e00640 1 -- 172.21.15.99:0/793813975 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19140327f0 con 0x7f19240d3070 2024-09-10T07:35:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.369+0000 7f192a000640 1 -- 172.21.15.99:0/793813975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19240d3070 msgr2=0x7f19240d3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.369+0000 7f192a000640 1 --2- 172.21.15.99:0/793813975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19240d3070 0x7f19240d3450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f19140097a0 tx=0x7f191402a210 comp rx=0 tx=0).stop 2024-09-10T07:35:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.369+0000 7f192a000640 1 -- 172.21.15.99:0/793813975 shutdown_connections 2024-09-10T07:35:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.369+0000 7f192a000640 1 --2- 172.21.15.99:0/793813975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19240d51a0 0x7f19240d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.369+0000 7f192a000640 1 --2- 172.21.15.99:0/793813975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19240d3070 0x7f19240d3450 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.369+0000 7f192a000640 1 -- 172.21.15.99:0/793813975 >> 172.21.15.99:0/793813975 conn(0x7f192409dd60 msgr2=0x7f19240d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.369+0000 7f192a000640 1 -- 172.21.15.99:0/793813975 shutdown_connections 2024-09-10T07:35:02.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.369+0000 7f192a000640 1 -- 172.21.15.99:0/793813975 wait complete. 2024-09-10T07:35:02.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.371+0000 7f192a000640 1 Processor -- start 2024-09-10T07:35:02.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.371+0000 7f192a000640 1 -- start start 2024-09-10T07:35:02.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f192a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19240d3070 0x7f19240ba220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f192a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f192415ed10 0x7f19240c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f192a000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19240ce570 0x7f19240cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f192a000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f19240cfcc0 con 0x7f192415ed10 2024-09-10T07:35:02.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f192a000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f19240cf9e0 con 0x7f19240ce570 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f192a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f19240d0720 con 0x7f19240d3070 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f191be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f192415ed10 0x7f19240c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f191be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f192415ed10 0x7f19240c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50750/0 (socket says 172.21.15.99:50750) 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f191be00640 1 -- 172.21.15.99:0/889892085 learned_addr learned my addr 172.21.15.99:0/889892085 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f1928c00640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19240d3070 0x7f19240ba220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f1929600640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19240ce570 0x7f19240cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f191be00640 1 -- 172.21.15.99:0/889892085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19240d3070 msgr2=0x7f19240ba220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f191be00640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19240d3070 0x7f19240ba220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f191be00640 1 -- 172.21.15.99:0/889892085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19240ce570 msgr2=0x7f19240cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f191be00640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19240ce570 0x7f19240cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.372+0000 7f191be00640 1 -- 172.21.15.99:0/889892085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19240c8c70 con 0x7f192415ed10 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.373+0000 7f191be00640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f192415ed10 0x7f19240c9ff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f190c00c390 tx=0x7f190c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:02.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.373+0000 7f1921600640 1 -- 172.21.15.99:0/889892085 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c017070 con 0x7f192415ed10 2024-09-10T07:35:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.373+0000 7f1921600640 1 -- 172.21.15.99:0/889892085 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190c005ce0 con 0x7f192415ed10 2024-09-10T07:35:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.373+0000 7f1921600640 1 -- 172.21.15.99:0/889892085 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c0072f0 con 0x7f192415ed10 2024-09-10T07:35:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.373+0000 7f192a000640 1 -- 172.21.15.99:0/889892085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19240c8f50 con 0x7f192415ed10 2024-09-10T07:35:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.373+0000 7f192a000640 1 -- 172.21.15.99:0/889892085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19240c9510 con 0x7f192415ed10 2024-09-10T07:35:02.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.374+0000 7f192a000640 1 -- 172.21.15.99:0/889892085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19240d3450 con 0x7f192415ed10 2024-09-10T07:35:02.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.375+0000 7f1921600640 1 -- 172.21.15.99:0/889892085 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f190c01a070 con 0x7f192415ed10 2024-09-10T07:35:02.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.376+0000 7f1921600640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f190006be30 0x7f190006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.376+0000 7f1921600640 1 -- 172.21.15.99:0/889892085 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f190c089f20 con 0x7f192415ed10 2024-09-10T07:35:02.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.377+0000 7f1928c00640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f190006be30 0x7f190006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.377+0000 7f1928c00640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f190006be30 0x7f190006e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1914034000 tx=0x7f191402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:02.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.381+0000 7f1921600640 1 -- 172.21.15.99:0/889892085 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f190c058530 con 0x7f192415ed10 2024-09-10T07:35:02.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.614+0000 7f192a000640 1 -- 172.21.15.99:0/889892085 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f19240d4870 con 0x7f192415ed10 2024-09-10T07:35:02.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.617+0000 7f1921600640 1 -- 172.21.15.99:0/889892085 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f190c05c830 con 0x7f192415ed10 2024-09-10T07:35:02.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 -- 172.21.15.99:0/889892085 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f190006be30 msgr2=0x7f190006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f190006be30 0x7f190006e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1914034000 tx=0x7f191402e000 comp rx=0 tx=0).stop 2024-09-10T07:35:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 -- 172.21.15.99:0/889892085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f192415ed10 msgr2=0x7f19240c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f192415ed10 0x7f19240c9ff0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f190c00c390 tx=0x7f190c00c850 comp rx=0 tx=0).stop 2024-09-10T07:35:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 -- 172.21.15.99:0/889892085 shutdown_connections 2024-09-10T07:35:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19240ce570 0x7f19240cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f190006be30 0x7f190006e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f192415ed10 0x7f19240c9ff0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 --2- 172.21.15.99:0/889892085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19240d3070 0x7f19240ba220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 -- 172.21.15.99:0/889892085 >> 172.21.15.99:0/889892085 conn(0x7f192409dd60 msgr2=0x7f19240d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 -- 172.21.15.99:0/889892085 shutdown_connections 2024-09-10T07:35:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.619+0000 7f192a000640 1 -- 172.21.15.99:0/889892085 wait complete. 2024-09-10T07:35:02.635 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-10T07:35:02.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.791+0000 7f3e0b000640 1 Processor -- start 2024-09-10T07:35:02.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.791+0000 7f3e0b000640 1 -- start start 2024-09-10T07:35:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.792+0000 7f3e0b000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 0x7f3e040d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.792+0000 7f3e0b000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3e040d1630 0x7f3e040d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.792+0000 7f3e0b000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e040d3cc0 con 0x7f3e040d0480 2024-09-10T07:35:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.792+0000 7f3e0b000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f3e040d2880 con 0x7f3e040d1630 2024-09-10T07:35:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.792+0000 7f3e0b000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3e040d3120 con 0x7f3e0415eda0 2024-09-10T07:35:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.792+0000 7f3e03400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3e040d0480 0x7f3e040d35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43606/0 (socket says 172.21.15.99:43606) 2024-09-10T07:35:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.792+0000 7f3e03400640 1 -- 172.21.15.99:0/2027339980 learned_addr learned my addr 172.21.15.99:0/2027339980 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.792+0000 7f3e03e00640 1 --2- 172.21.15.99:0/2027339980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 0x7f3e040d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.792+0000 7f3e09000640 1 --2- 172.21.15.99:0/2027339980 >> v2:172.21.15.187:3300/0 conn(0x7f3e040d1630 0x7f3e040d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.793+0000 7f3e02a00640 1 -- 172.21.15.99:0/2027339980 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3243340964 0 0) 0x7f3e040d3cc0 con 0x7f3e040d0480 2024-09-10T07:35:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.793+0000 7f3e03e00640 1 -- 172.21.15.99:0/2027339980 >> v2:172.21.15.187:3300/0 conn(0x7f3e040d1630 msgr2=0x7f3e040d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.793+0000 7f3e03e00640 1 --2- 172.21.15.99:0/2027339980 >> v2:172.21.15.187:3300/0 conn(0x7f3e040d1630 0x7f3e040d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.793+0000 7f3e03e00640 1 -- 172.21.15.99:0/2027339980 >> v1:172.21.15.99:6789/0 conn(0x7f3e040d0480 legacy=0x7f3e040d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.793+0000 7f3e03e00640 1 -- 172.21.15.99:0/2027339980 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e040d0bf0 con 0x7f3e0415eda0 2024-09-10T07:35:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.794+0000 7f3e03e00640 1 --2- 172.21.15.99:0/2027339980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 0x7f3e040d5790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3df40097a0 tx=0x7f3df402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cfaafd6c8734f88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.794+0000 7f3e02a00640 1 -- 172.21.15.99:0/2027339980 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4037070 con 0x7f3e0415eda0 2024-09-10T07:35:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.794+0000 7f3e02a00640 1 -- 172.21.15.99:0/2027339980 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4032440 con 0x7f3e0415eda0 2024-09-10T07:35:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.794+0000 7f3e02a00640 1 -- 172.21.15.99:0/2027339980 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4032810 con 0x7f3e0415eda0 2024-09-10T07:35:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.794+0000 7f3e0b000640 1 -- 172.21.15.99:0/2027339980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 msgr2=0x7f3e040d5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.794+0000 7f3e0b000640 1 --2- 172.21.15.99:0/2027339980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 0x7f3e040d5790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3df40097a0 tx=0x7f3df402a180 comp rx=0 tx=0).stop 2024-09-10T07:35:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.795+0000 7f3e0b000640 1 -- 172.21.15.99:0/2027339980 shutdown_connections 2024-09-10T07:35:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.795+0000 7f3e0b000640 1 --2- 172.21.15.99:0/2027339980 >> v2:172.21.15.187:3300/0 conn(0x7f3e040d1630 0x7f3e040d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.795+0000 7f3e0b000640 1 --2- 172.21.15.99:0/2027339980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 0x7f3e040d5790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.795+0000 7f3e0b000640 1 -- 172.21.15.99:0/2027339980 >> 172.21.15.99:0/2027339980 conn(0x7f3e0409df40 msgr2=0x7f3e040d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.795+0000 7f3e0b000640 1 -- 172.21.15.99:0/2027339980 shutdown_connections 2024-09-10T07:35:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.795+0000 7f3e0b000640 1 -- 172.21.15.99:0/2027339980 wait complete. 2024-09-10T07:35:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.796+0000 7f3e0b000640 1 Processor -- start 2024-09-10T07:35:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.796+0000 7f3e0b000640 1 -- start start 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.797+0000 7f3e0b000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e040d0480 0x7f3e041f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.797+0000 7f3e0b000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e040d1630 0x7f3e040a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.797+0000 7f3e0b000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 0x7f3e041f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.797+0000 7f3e0b000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3e040d08c0 con 0x7f3e040d1630 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.797+0000 7f3e0b000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3e040d2db0 con 0x7f3e040d0480 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.797+0000 7f3e0b000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0415f180 con 0x7f3e0415eda0 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.797+0000 7f3e03400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e040d1630 0x7f3e040a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.797+0000 7f3e03400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e040d1630 0x7f3e040a1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50754/0 (socket says 172.21.15.99:50754) 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.798+0000 7f3e03400640 1 -- 172.21.15.99:0/2594799583 learned_addr learned my addr 172.21.15.99:0/2594799583 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.798+0000 7f3e03e00640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e040d0480 0x7f3e041f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.798+0000 7f3e09000640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 0x7f3e041f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.798+0000 7f3e03400640 1 -- 172.21.15.99:0/2594799583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 msgr2=0x7f3e041f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.798+0000 7f3e03400640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 0x7f3e041f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.798+0000 7f3e03400640 1 -- 172.21.15.99:0/2594799583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e040d0480 msgr2=0x7f3e041f5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.798+0000 7f3e03400640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e040d0480 0x7f3e041f5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.798+0000 7f3e03400640 1 -- 172.21.15.99:0/2594799583 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e041f6320 con 0x7f3e040d1630 2024-09-10T07:35:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.798+0000 7f3e03400640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e040d1630 0x7f3e040a1280 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3df000c4b0 tx=0x7f3df000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.799+0000 7f3dfbe00640 1 -- 172.21.15.99:0/2594799583 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0018070 con 0x7f3e040d1630 2024-09-10T07:35:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.799+0000 7f3dfbe00640 1 -- 172.21.15.99:0/2594799583 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df0007500 con 0x7f3e040d1630 2024-09-10T07:35:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.799+0000 7f3dfbe00640 1 -- 172.21.15.99:0/2594799583 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0004a20 con 0x7f3e040d1630 2024-09-10T07:35:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.799+0000 7f3e0b000640 1 -- 172.21.15.99:0/2594799583 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e040a17c0 con 0x7f3e040d1630 2024-09-10T07:35:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.799+0000 7f3e0b000640 1 -- 172.21.15.99:0/2594799583 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e041f5930 con 0x7f3e040d1630 2024-09-10T07:35:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.800+0000 7f3e0b000640 1 -- 172.21.15.99:0/2594799583 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e040d5790 con 0x7f3e040d1630 2024-09-10T07:35:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.801+0000 7f3dfbe00640 1 -- 172.21.15.99:0/2594799583 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3df0004bc0 con 0x7f3e040d1630 2024-09-10T07:35:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.802+0000 7f3dfbe00640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3de406be30 0x7f3de406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.802+0000 7f3dfbe00640 1 -- 172.21.15.99:0/2594799583 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f3df0089e00 con 0x7f3e040d1630 2024-09-10T07:35:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.802+0000 7f3e03e00640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3de406be30 0x7f3de406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.803+0000 7f3e03e00640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3de406be30 0x7f3de406e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3df4034000 tx=0x7f3df402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:02.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:02.806+0000 7f3dfbe00640 1 -- 172.21.15.99:0/2594799583 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3df0058450 con 0x7f3e040d1630 2024-09-10T07:35:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.044+0000 7f3e0b000640 1 -- 172.21.15.99:0/2594799583 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f3e040cb7b0 con 0x7f3e040d1630 2024-09-10T07:35:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.046+0000 7f3dfbe00640 1 -- 172.21.15.99:0/2594799583 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f3df005c750 con 0x7f3e040d1630 2024-09-10T07:35:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 -- 172.21.15.99:0/2594799583 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3de406be30 msgr2=0x7f3de406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3de406be30 0x7f3de406e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3df4034000 tx=0x7f3df402e000 comp rx=0 tx=0).stop 2024-09-10T07:35:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 -- 172.21.15.99:0/2594799583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e040d1630 msgr2=0x7f3e040a1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e040d1630 0x7f3e040a1280 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3df000c4b0 tx=0x7f3df000c970 comp rx=0 tx=0).stop 2024-09-10T07:35:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 -- 172.21.15.99:0/2594799583 shutdown_connections 2024-09-10T07:35:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e0415eda0 0x7f3e041f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3de406be30 0x7f3de406e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e040d1630 0x7f3e040a1280 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 --2- 172.21.15.99:0/2594799583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e040d0480 0x7f3e041f5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 -- 172.21.15.99:0/2594799583 >> 172.21.15.99:0/2594799583 conn(0x7f3e0409df40 msgr2=0x7f3e0415d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 -- 172.21.15.99:0/2594799583 shutdown_connections 2024-09-10T07:35:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.049+0000 7f3e0b000640 1 -- 172.21.15.99:0/2594799583 wait complete. 2024-09-10T07:35:03.064 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:35:03.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.216+0000 7fea6e600640 1 Processor -- start 2024-09-10T07:35:03.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.216+0000 7fea6e600640 1 -- start start 2024-09-10T07:35:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.217+0000 7fea6e600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fea68162160 0x7fea680d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.217+0000 7fea6e600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680cf670 0x7fea680cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.217+0000 7fea6e600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea680d37e0 con 0x7fea680b37a0 2024-09-10T07:35:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.217+0000 7fea6e600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fea680d35b0 con 0x7fea68162160 2024-09-10T07:35:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.217+0000 7fea6e600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fea680d1990 con 0x7fea680cf670 2024-09-10T07:35:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea6dc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680cf670 0x7fea680cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea6d200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fea68162160 0x7fea680d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea67e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fea680b37a0 0x7fea680d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43610/0 (socket says 172.21.15.99:43610) 2024-09-10T07:35:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea67e00640 1 -- 172.21.15.99:0/971975437 learned_addr learned my addr 172.21.15.99:0/971975437 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea67400640 1 -- 172.21.15.99:0/971975437 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089005394 0 0) 0x7fea680d37e0 con 0x7fea680b37a0 2024-09-10T07:35:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea67400640 1 -- 172.21.15.99:0/971975437 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea50003520 con 0x7fea680b37a0 2024-09-10T07:35:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea6d200640 1 -- 172.21.15.99:0/971975437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680cf670 msgr2=0x7fea680cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea6d200640 1 --2- 172.21.15.99:0/971975437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680cf670 0x7fea680cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea6d200640 1 -- 172.21.15.99:0/971975437 >> v1:172.21.15.99:6789/0 conn(0x7fea680b37a0 legacy=0x7fea680d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea6d200640 1 -- 172.21.15.99:0/971975437 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea680d1c70 con 0x7fea68162160 2024-09-10T07:35:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.218+0000 7fea6dc00640 1 --2- 172.21.15.99:0/971975437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680cf670 0x7fea680cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.219+0000 7fea6d200640 1 --2- 172.21.15.99:0/971975437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea68162160 0x7fea680d2960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0097a0 tx=0x7fea5c02a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=affbf9e24fb7e4ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.219+0000 7fea67400640 1 -- 172.21.15.99:0/971975437 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c037070 con 0x7fea68162160 2024-09-10T07:35:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.219+0000 7fea67400640 1 -- 172.21.15.99:0/971975437 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea5c02adc0 con 0x7fea68162160 2024-09-10T07:35:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.220+0000 7fea67400640 1 -- 172.21.15.99:0/971975437 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c032660 con 0x7fea68162160 2024-09-10T07:35:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.220+0000 7fea6e600640 1 -- 172.21.15.99:0/971975437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea68162160 msgr2=0x7fea680d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.220+0000 7fea6e600640 1 --2- 172.21.15.99:0/971975437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea68162160 0x7fea680d2960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0097a0 tx=0x7fea5c02a0b0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.220+0000 7fea6e600640 1 -- 172.21.15.99:0/971975437 shutdown_connections 2024-09-10T07:35:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.220+0000 7fea6e600640 1 --2- 172.21.15.99:0/971975437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680cf670 0x7fea680cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.220+0000 7fea6e600640 1 --2- 172.21.15.99:0/971975437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea68162160 0x7fea680d2960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.220+0000 7fea6e600640 1 -- 172.21.15.99:0/971975437 >> 172.21.15.99:0/971975437 conn(0x7fea680d4a60 msgr2=0x7fea680d4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.220+0000 7fea6e600640 1 -- 172.21.15.99:0/971975437 shutdown_connections 2024-09-10T07:35:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.220+0000 7fea6e600640 1 -- 172.21.15.99:0/971975437 wait complete. 2024-09-10T07:35:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.222+0000 7fea6e600640 1 Processor -- start 2024-09-10T07:35:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.222+0000 7fea6e600640 1 -- start start 2024-09-10T07:35:03.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6e600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680b37a0 0x7fea680ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6e600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea680cf670 0x7fea6815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6e600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea68162160 0x7fea6815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6e600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fea680b2700 con 0x7fea68162160 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6e600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fea680d3ac0 con 0x7fea680cf670 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6e600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fea680b2880 con 0x7fea680b37a0 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea68162160 0x7fea6815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea68162160 0x7fea6815dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50770/0 (socket says 172.21.15.99:50770) 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6dc00640 1 -- 172.21.15.99:0/3616340987 learned_addr learned my addr 172.21.15.99:0/3616340987 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6d200640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680b37a0 0x7fea680ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea67e00640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea680cf670 0x7fea6815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6dc00640 1 -- 172.21.15.99:0/3616340987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680b37a0 msgr2=0x7fea680ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6dc00640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680b37a0 0x7fea680ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6dc00640 1 -- 172.21.15.99:0/3616340987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea680cf670 msgr2=0x7fea6815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6dc00640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea680cf670 0x7fea6815d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.223+0000 7fea6dc00640 1 -- 172.21.15.99:0/3616340987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea680cee50 con 0x7fea68162160 2024-09-10T07:35:03.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.224+0000 7fea6dc00640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea68162160 0x7fea6815dbe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea6000efc0 tx=0x7fea60009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:03.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.224+0000 7fea64c00640 1 -- 172.21.15.99:0/3616340987 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60018030 con 0x7fea68162160 2024-09-10T07:35:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.224+0000 7fea64c00640 1 -- 172.21.15.99:0/3616340987 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea6000cde0 con 0x7fea68162160 2024-09-10T07:35:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.224+0000 7fea6e600640 1 -- 172.21.15.99:0/3616340987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6815b570 con 0x7fea68162160 2024-09-10T07:35:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.224+0000 7fea64c00640 1 -- 172.21.15.99:0/3616340987 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60003bb0 con 0x7fea68162160 2024-09-10T07:35:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.224+0000 7fea6e600640 1 -- 172.21.15.99:0/3616340987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea6815e8b0 con 0x7fea68162160 2024-09-10T07:35:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.225+0000 7fea6e600640 1 -- 172.21.15.99:0/3616340987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea68162540 con 0x7fea68162160 2024-09-10T07:35:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.226+0000 7fea64c00640 1 -- 172.21.15.99:0/3616340987 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea60005d10 con 0x7fea68162160 2024-09-10T07:35:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.227+0000 7fea64c00640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea4806be60 0x7fea4806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.227+0000 7fea64c00640 1 -- 172.21.15.99:0/3616340987 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fea6008b430 con 0x7fea68162160 2024-09-10T07:35:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.227+0000 7fea6d200640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea4806be60 0x7fea4806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.228+0000 7fea6d200640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea4806be60 0x7fea4806e320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fea5c034000 tx=0x7fea5c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:03.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.232+0000 7fea64c00640 1 -- 172.21.15.99:0/3616340987 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea60022070 con 0x7fea68162160 2024-09-10T07:35:03.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.405+0000 7fea6e600640 1 -- 172.21.15.99:0/3616340987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fea680b4d90 con 0x7fea68162160 2024-09-10T07:35:03.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.405+0000 7fea64c00640 1 -- 172.21.15.99:0/3616340987 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7fea60010040 con 0x7fea68162160 2024-09-10T07:35:03.405 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:03.406 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:35:03.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:03.406 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:35:03.406 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:35:03.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:03.406 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:35:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 -- 172.21.15.99:0/3616340987 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea4806be60 msgr2=0x7fea4806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea4806be60 0x7fea4806e320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fea5c034000 tx=0x7fea5c02e000 comp rx=0 tx=0).stop 2024-09-10T07:35:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 -- 172.21.15.99:0/3616340987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea68162160 msgr2=0x7fea6815dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea68162160 0x7fea6815dbe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea6000efc0 tx=0x7fea60009f90 comp rx=0 tx=0).stop 2024-09-10T07:35:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 -- 172.21.15.99:0/3616340987 shutdown_connections 2024-09-10T07:35:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea4806be60 0x7fea4806e320 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea68162160 0x7fea6815dbe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea680cf670 0x7fea6815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 --2- 172.21.15.99:0/3616340987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea680b37a0 0x7fea680ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 -- 172.21.15.99:0/3616340987 >> 172.21.15.99:0/3616340987 conn(0x7fea680d4a60 msgr2=0x7fea680b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 -- 172.21.15.99:0/3616340987 shutdown_connections 2024-09-10T07:35:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.408+0000 7fea6e600640 1 -- 172.21.15.99:0/3616340987 wait complete. 2024-09-10T07:35:03.424 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:35:03.424 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:35:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.581+0000 7f2575000640 1 Processor -- start 2024-09-10T07:35:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.581+0000 7f2575000640 1 -- start start 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.582+0000 7f2575000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f25700b69c0 0x7f25701675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.582+0000 7f2575000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25700707e0 con 0x7f257015ca90 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.582+0000 7f2575000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2570070ac0 con 0x7f25700b5bd0 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.582+0000 7f2575000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f2570070da0 con 0x7f25700b69c0 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.583+0000 7f256fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f25700b69c0 0x7f25701675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.583+0000 7f256fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f25700b69c0 0x7f25701675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50786/0 (socket says 172.21.15.99:50786) 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.583+0000 7f256fe00640 1 -- 172.21.15.99:0/3387873909 learned_addr learned my addr 172.21.15.99:0/3387873909 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.583+0000 7f256f400640 1 --1- 172.21.15.99:0/3387873909 >> v1:172.21.15.99:6789/0 conn(0x7f257015ca90 0x7f257006ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43616/0 (socket says 172.21.15.99:43616) 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.583+0000 7f256fe00640 1 -- 172.21.15.99:0/3387873909 >> v1:172.21.15.187:6789/0 conn(0x7f25700b5bd0 legacy=0x7f25700b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.583+0000 7f256fe00640 1 -- 172.21.15.99:0/3387873909 >> v1:172.21.15.99:6789/0 conn(0x7f257015ca90 legacy=0x7f257006ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.583+0000 7f256e000640 1 -- 172.21.15.99:0/3387873909 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778205635 0 0) 0x7f25700707e0 con 0x7f257015ca90 2024-09-10T07:35:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.583+0000 7f256fe00640 1 -- 172.21.15.99:0/3387873909 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2570071080 con 0x7f25700b69c0 2024-09-10T07:35:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.584+0000 7f256fe00640 1 --2- 172.21.15.99:0/3387873909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 0x7f25701675f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2568009e50 tx=0x7f256802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a538932b35ac4218 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.584+0000 7f256e000640 1 -- 172.21.15.99:0/3387873909 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568036070 con 0x7f25700b69c0 2024-09-10T07:35:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.584+0000 7f256e000640 1 -- 172.21.15.99:0/3387873909 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2568031600 con 0x7f25700b69c0 2024-09-10T07:35:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.584+0000 7f256e000640 1 -- 172.21.15.99:0/3387873909 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25680319d0 con 0x7f25700b69c0 2024-09-10T07:35:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.585+0000 7f2575000640 1 -- 172.21.15.99:0/3387873909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 msgr2=0x7f25701675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.585+0000 7f2575000640 1 --2- 172.21.15.99:0/3387873909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 0x7f25701675f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2568009e50 tx=0x7f256802a760 comp rx=0 tx=0).stop 2024-09-10T07:35:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.585+0000 7f2575000640 1 -- 172.21.15.99:0/3387873909 shutdown_connections 2024-09-10T07:35:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.585+0000 7f2575000640 1 --2- 172.21.15.99:0/3387873909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 0x7f25701675f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.585+0000 7f2575000640 1 -- 172.21.15.99:0/3387873909 >> 172.21.15.99:0/3387873909 conn(0x7f25700b7cc0 msgr2=0x7f25700b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.585+0000 7f2575000640 1 -- 172.21.15.99:0/3387873909 shutdown_connections 2024-09-10T07:35:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.585+0000 7f2575000640 1 -- 172.21.15.99:0/3387873909 wait complete. 2024-09-10T07:35:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.587+0000 7f2575000640 1 Processor -- start 2024-09-10T07:35:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.587+0000 7f2575000640 1 -- start start 2024-09-10T07:35:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f2575000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f25700b5bd0 0x7f25701578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f2575000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 0x7f2570157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f2575000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f257015ca90 0x7f25701f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f2575000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2570167b30 con 0x7f25700b69c0 2024-09-10T07:35:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f2575000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f25700b1430 con 0x7f257015ca90 2024-09-10T07:35:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f2575000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2570167cb0 con 0x7f25700b5bd0 2024-09-10T07:35:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f256ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 0x7f2570157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f256ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 0x7f2570157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50796/0 (socket says 172.21.15.99:50796) 2024-09-10T07:35:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f256ea00640 1 -- 172.21.15.99:0/3266857584 learned_addr learned my addr 172.21.15.99:0/3266857584 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f256f400640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f25700b5bd0 0x7f25701578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f256fe00640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f257015ca90 0x7f25701f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f256ea00640 1 -- 172.21.15.99:0/3266857584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f25700b5bd0 msgr2=0x7f25701578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f256ea00640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f25700b5bd0 0x7f25701578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f256ea00640 1 -- 172.21.15.99:0/3266857584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f257015ca90 msgr2=0x7f25701f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f256ea00640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f257015ca90 0x7f25701f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.588+0000 7f256ea00640 1 -- 172.21.15.99:0/3266857584 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257015b530 con 0x7f25700b69c0 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.589+0000 7f256ea00640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 0x7f2570157e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f255c00c460 tx=0x7f255c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.589+0000 7f2567400640 1 -- 172.21.15.99:0/3266857584 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c016020 con 0x7f25700b69c0 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.589+0000 7f2567400640 1 -- 172.21.15.99:0/3266857584 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c012870 con 0x7f25700b69c0 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.589+0000 7f2567400640 1 -- 172.21.15.99:0/3266857584 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c012c60 con 0x7f25700b69c0 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.589+0000 7f2575000640 1 -- 172.21.15.99:0/3266857584 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257015b810 con 0x7f25700b69c0 2024-09-10T07:35:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.589+0000 7f2575000640 1 -- 172.21.15.99:0/3266857584 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25701560e0 con 0x7f25700b69c0 2024-09-10T07:35:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.590+0000 7f2575000640 1 -- 172.21.15.99:0/3266857584 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25700b2fc0 con 0x7f25700b69c0 2024-09-10T07:35:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.591+0000 7f2567400640 1 -- 172.21.15.99:0/3266857584 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f255c019020 con 0x7f25700b69c0 2024-09-10T07:35:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.592+0000 7f2567400640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f255006be30 0x7f255006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.592+0000 7f2567400640 1 -- 172.21.15.99:0/3266857584 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f255c08abb0 con 0x7f25700b69c0 2024-09-10T07:35:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.592+0000 7f256f400640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f255006be30 0x7f255006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.592+0000 7f256f400640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f255006be30 0x7f255006e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2560000f60 tx=0x7f2560007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:03.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.596+0000 7f2567400640 1 -- 172.21.15.99:0/3266857584 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f255c020020 con 0x7f25700b69c0 2024-09-10T07:35:03.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:03.772+0000 7f2575000640 1 -- 172.21.15.99:0/3266857584 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f257015b9e0 con 0x7f25700b69c0 2024-09-10T07:35:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.621+0000 7f2567400640 1 -- 172.21.15.99:0/3266857584 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7f255c0182c0 con 0x7f25700b69c0 2024-09-10T07:35:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:35:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.624+0000 7f2575000640 1 -- 172.21.15.99:0/3266857584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f255006be30 msgr2=0x7f255006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.624+0000 7f2575000640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f255006be30 0x7f255006e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2560000f60 tx=0x7f2560007c00 comp rx=0 tx=0).stop 2024-09-10T07:35:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.624+0000 7f2575000640 1 -- 172.21.15.99:0/3266857584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 msgr2=0x7f2570157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.624+0000 7f2575000640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 0x7f2570157e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f255c00c460 tx=0x7f255c00c920 comp rx=0 tx=0).stop 2024-09-10T07:35:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.625+0000 7f2575000640 1 -- 172.21.15.99:0/3266857584 shutdown_connections 2024-09-10T07:35:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.625+0000 7f2575000640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f257015ca90 0x7f25701f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.625+0000 7f2575000640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f255006be30 0x7f255006e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.625+0000 7f2575000640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25700b69c0 0x7f2570157e10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.625+0000 7f2575000640 1 --2- 172.21.15.99:0/3266857584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f25700b5bd0 0x7f25701578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.625+0000 7f2575000640 1 -- 172.21.15.99:0/3266857584 >> 172.21.15.99:0/3266857584 conn(0x7f25700b7cc0 msgr2=0x7f2570153b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.626+0000 7f2575000640 1 -- 172.21.15.99:0/3266857584 shutdown_connections 2024-09-10T07:35:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.626+0000 7f2575000640 1 -- 172.21.15.99:0/3266857584 wait complete. 2024-09-10T07:35:04.647 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:35:04.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.811+0000 7f89d0400640 1 Processor -- start 2024-09-10T07:35:04.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.811+0000 7f89d0400640 1 -- start start 2024-09-10T07:35:04.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89d0400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f89c806e280 0x7f89c8073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:04.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89d0400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f89c8071df0 0x7f89c806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89d0400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 0x7f89c80ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89d0400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f89c80738b0 con 0x7f89c806e280 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89d0400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f89c806eba0 con 0x7f89c8071df0 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89d0400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f89c80722d0 con 0x7f89c80d1010 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89cda00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f89c806e280 0x7f89c8073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89cda00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f89c806e280 0x7f89c8073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50812/0 (socket says 172.21.15.99:50812) 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89cda00640 1 -- 172.21.15.99:0/3621742315 learned_addr learned my addr 172.21.15.99:0/3621742315 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89ce400640 1 --2- 172.21.15.99:0/3621742315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 0x7f89c80ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89cd000640 1 --2- 172.21.15.99:0/3621742315 >> v2:172.21.15.187:3300/0 conn(0x7f89c8071df0 0x7f89c806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89cda00640 1 -- 172.21.15.99:0/3621742315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 msgr2=0x7f89c80ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89cda00640 1 --2- 172.21.15.99:0/3621742315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 0x7f89c80ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89cda00640 1 -- 172.21.15.99:0/3621742315 >> v2:172.21.15.187:3300/0 conn(0x7f89c8071df0 msgr2=0x7f89c806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89cda00640 1 --2- 172.21.15.99:0/3621742315 >> v2:172.21.15.187:3300/0 conn(0x7f89c8071df0 0x7f89c806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89cda00640 1 -- 172.21.15.99:0/3621742315 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c80725b0 con 0x7f89c806e280 2024-09-10T07:35:04.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.813+0000 7f89ce400640 1 --2- 172.21.15.99:0/3621742315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 0x7f89c80ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.814+0000 7f89cda00640 1 --2- 172.21.15.99:0/3621742315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 0x7f89c8073370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f89c8050020 tx=0x7f89bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e92ce5136185dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89c7e00640 1 -- 172.21.15.99:0/3621742315 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc037070 con 0x7f89c806e280 2024-09-10T07:35:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89c7e00640 1 -- 172.21.15.99:0/3621742315 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc032440 con 0x7f89c806e280 2024-09-10T07:35:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89c7e00640 1 -- 172.21.15.99:0/3621742315 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc032810 con 0x7f89c806e280 2024-09-10T07:35:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89d0400640 1 -- 172.21.15.99:0/3621742315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 msgr2=0x7f89c8073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89d0400640 1 --2- 172.21.15.99:0/3621742315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 0x7f89c8073370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f89c8050020 tx=0x7f89bc02a1e0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89d0400640 1 -- 172.21.15.99:0/3621742315 shutdown_connections 2024-09-10T07:35:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89d0400640 1 --2- 172.21.15.99:0/3621742315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 0x7f89c80ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89d0400640 1 --2- 172.21.15.99:0/3621742315 >> v2:172.21.15.187:3300/0 conn(0x7f89c8071df0 0x7f89c806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89d0400640 1 --2- 172.21.15.99:0/3621742315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 0x7f89c8073370 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89d0400640 1 -- 172.21.15.99:0/3621742315 >> 172.21.15.99:0/3621742315 conn(0x7f89c806bc10 msgr2=0x7f89c806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89d0400640 1 -- 172.21.15.99:0/3621742315 shutdown_connections 2024-09-10T07:35:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.815+0000 7f89d0400640 1 -- 172.21.15.99:0/3621742315 wait complete. 2024-09-10T07:35:04.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.817+0000 7f89d0400640 1 Processor -- start 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.817+0000 7f89d0400640 1 -- start start 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89d0400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 0x7f89c80af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89d0400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89c8071df0 0x7f89c81f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89d0400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 0x7f89c80ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89d0400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f89c8072e50 con 0x7f89c806e280 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89d0400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f89c8072b70 con 0x7f89c8071df0 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89d0400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f89c80d14c0 con 0x7f89c80d1010 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89cda00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 0x7f89c80af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89cda00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 0x7f89c80af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50820/0 (socket says 172.21.15.99:50820) 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89cda00640 1 -- 172.21.15.99:0/3743655350 learned_addr learned my addr 172.21.15.99:0/3743655350 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89ce400640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 0x7f89c80ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.818+0000 7f89cd000640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89c8071df0 0x7f89c81f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89cda00640 1 -- 172.21.15.99:0/3743655350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 msgr2=0x7f89c80ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89cda00640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 0x7f89c80ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89cda00640 1 -- 172.21.15.99:0/3743655350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89c8071df0 msgr2=0x7f89c81f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89cda00640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89c8071df0 0x7f89c81f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89cda00640 1 -- 172.21.15.99:0/3743655350 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c815fac0 con 0x7f89c806e280 2024-09-10T07:35:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89cda00640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 0x7f89c80af150 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f89bc02a220 tx=0x7f89bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89c5600640 1 -- 172.21.15.99:0/3743655350 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc041020 con 0x7f89c806e280 2024-09-10T07:35:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89c5600640 1 -- 172.21.15.99:0/3743655350 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc0306c0 con 0x7f89c806e280 2024-09-10T07:35:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89d0400640 1 -- 172.21.15.99:0/3743655350 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c80ae670 con 0x7f89c806e280 2024-09-10T07:35:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89c5600640 1 -- 172.21.15.99:0/3743655350 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89bc037040 con 0x7f89c806e280 2024-09-10T07:35:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.819+0000 7f89d0400640 1 -- 172.21.15.99:0/3743655350 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c81596b0 con 0x7f89c806e280 2024-09-10T07:35:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.820+0000 7f89d0400640 1 -- 172.21.15.99:0/3743655350 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c80ae460 con 0x7f89c806e280 2024-09-10T07:35:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.821+0000 7f89c5600640 1 -- 172.21.15.99:0/3743655350 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89bc044020 con 0x7f89c806e280 2024-09-10T07:35:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.822+0000 7f89c5600640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f89a806be30 0x7f89a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.822+0000 7f89c5600640 1 -- 172.21.15.99:0/3743655350 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7f89bc0ab4d0 con 0x7f89c806e280 2024-09-10T07:35:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.822+0000 7f89cd000640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f89a806be30 0x7f89a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:04.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.823+0000 7f89cd000640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f89a806be30 0x7f89a806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f89c80abe90 tx=0x7f89b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:04.827+0000 7f89c5600640 1 -- 172.21.15.99:0/3743655350 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89bc04b030 con 0x7f89c806e280 2024-09-10T07:35:05.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.001+0000 7f89d0400640 1 -- 172.21.15.99:0/3743655350 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f89c8073370 con 0x7f89c806e280 2024-09-10T07:35:05.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.628+0000 7f89c5600640 1 -- 172.21.15.99:0/3743655350 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7f89bc07a050 con 0x7f89c806e280 2024-09-10T07:35:05.628 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:35:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.630+0000 7f89d0400640 1 -- 172.21.15.99:0/3743655350 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f89a806be30 msgr2=0x7f89a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.630+0000 7f89d0400640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f89a806be30 0x7f89a806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f89c80abe90 tx=0x7f89b4008040 comp rx=0 tx=0).stop 2024-09-10T07:35:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.630+0000 7f89d0400640 1 -- 172.21.15.99:0/3743655350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 msgr2=0x7f89c80af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.630+0000 7f89d0400640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 0x7f89c80af150 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f89bc02a220 tx=0x7f89bc0046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.631+0000 7f89d0400640 1 -- 172.21.15.99:0/3743655350 shutdown_connections 2024-09-10T07:35:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.631+0000 7f89d0400640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89c80d1010 0x7f89c80ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.631+0000 7f89d0400640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89c8071df0 0x7f89c81f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.631+0000 7f89d0400640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f89a806be30 0x7f89a806e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.631+0000 7f89d0400640 1 --2- 172.21.15.99:0/3743655350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89c806e280 0x7f89c80af150 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.631+0000 7f89d0400640 1 -- 172.21.15.99:0/3743655350 >> 172.21.15.99:0/3743655350 conn(0x7f89c806bc10 msgr2=0x7f89c8159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.631+0000 7f89d0400640 1 -- 172.21.15.99:0/3743655350 shutdown_connections 2024-09-10T07:35:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.631+0000 7f89d0400640 1 -- 172.21.15.99:0/3743655350 wait complete. 2024-09-10T07:35:05.656 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:35:05.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.812+0000 7f8c32800640 1 Processor -- start 2024-09-10T07:35:05.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.813+0000 7f8c32800640 1 -- start start 2024-09-10T07:35:05.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.814+0000 7f8c32800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8c2c15b760 0x7f8c2c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:05.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.814+0000 7f8c32800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c0b4300 con 0x7f8c2c0d0630 2024-09-10T07:35:05.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.814+0000 7f8c32800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c06d700 con 0x7f8c2c0b4a90 2024-09-10T07:35:05.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.814+0000 7f8c32800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2c06d9e0 con 0x7f8c2c15b760 2024-09-10T07:35:05.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.814+0000 7f8c2be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8c2c0d0630 0x7f8c2c0d0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43628/0 (socket says 172.21.15.99:43628) 2024-09-10T07:35:05.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.814+0000 7f8c2be00640 1 -- 172.21.15.99:0/2240833080 learned_addr learned my addr 172.21.15.99:0/2240833080 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.814+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340071145 0 0) 0x7f8c2c0b4300 con 0x7f8c2c0d0630 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.814+0000 7f8c2b400640 1 --2- 172.21.15.99:0/2240833080 >> v2:172.21.15.187:3300/0 conn(0x7f8c2c15b760 0x7f8c2c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c10003520 con 0x7f8c2c0d0630 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 339571326 0 0) 0x7f8c10003520 con 0x7f8c2c0d0630 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 >> v2:172.21.15.187:3300/0 conn(0x7f8c2c15b760 msgr2=0x7f8c2c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 --2- 172.21.15.99:0/2240833080 >> v2:172.21.15.187:3300/0 conn(0x7f8c2c15b760 0x7f8c2c0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 >> v1:172.21.15.187:6789/0 conn(0x7f8c2c0b4a90 legacy=0x7f8c2c06f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c0b4570 con 0x7f8c2c0d0630 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f8c240019f0 con 0x7f8c2c0d0630 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 >> v1:172.21.15.99:6789/0 conn(0x7f8c2c0d0630 legacy=0x7f8c2c0d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:05.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c100039b0 0x7f8c10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c10004800 0x7f8c10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c100052e0 0x7f8c1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c06d9e0 con 0x7f8c10004800 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1000c1b0 con 0x7f8c100039b0 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1000c3b0 con 0x7f8c100052e0 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c22a00640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c10004800 0x7f8c10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2b400640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c100039b0 0x7f8c10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.815+0000 7f8c2be00640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c100052e0 0x7f8c1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.816+0000 7f8c22a00640 1 -- 172.21.15.99:0/2240833080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c100052e0 msgr2=0x7f8c1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.816+0000 7f8c22a00640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c100052e0 0x7f8c1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.816+0000 7f8c22a00640 1 -- 172.21.15.99:0/2240833080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c100039b0 msgr2=0x7f8c10003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.816+0000 7f8c22a00640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c100039b0 0x7f8c10003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.816+0000 7f8c22a00640 1 -- 172.21.15.99:0/2240833080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c10003520 con 0x7f8c10004800 2024-09-10T07:35:05.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.816+0000 7f8c2be00640 1 -- 172.21.15.99:0/2240833080 reap_dead start 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.816+0000 7f8c2b400640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c100039b0 0x7f8c10003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.817+0000 7f8c22a00640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c10004800 0x7f8c10004c80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c14001720 tx=0x7f8c10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ee5e8bbb4b6f3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.817+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14001370 con 0x7f8c10004800 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.817+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c140052d0 con 0x7f8c10004800 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.817+0000 7f8c2aa00640 1 -- 172.21.15.99:0/2240833080 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1402ab70 con 0x7f8c10004800 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.817+0000 7f8c32800640 1 -- 172.21.15.99:0/2240833080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c10004800 msgr2=0x7f8c10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.817+0000 7f8c32800640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c10004800 0x7f8c10004c80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c14001720 tx=0x7f8c10005830 comp rx=0 tx=0).stop 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.818+0000 7f8c32800640 1 -- 172.21.15.99:0/2240833080 shutdown_connections 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.818+0000 7f8c32800640 1 --2- 172.21.15.99:0/2240833080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c10004800 0x7f8c10004c80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.818+0000 7f8c32800640 1 -- 172.21.15.99:0/2240833080 >> 172.21.15.99:0/2240833080 conn(0x7f8c2c06bc10 msgr2=0x7f8c2c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.818+0000 7f8c32800640 1 -- 172.21.15.99:0/2240833080 shutdown_connections 2024-09-10T07:35:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.818+0000 7f8c32800640 1 -- 172.21.15.99:0/2240833080 wait complete. 2024-09-10T07:35:05.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.819+0000 7f8c32800640 1 Processor -- start 2024-09-10T07:35:05.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.819+0000 7f8c32800640 1 -- start start 2024-09-10T07:35:05.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.820+0000 7f8c32800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c10004800 0x7f8c2c1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.820+0000 7f8c32800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c2c151970 0x7f8c2c071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.820+0000 7f8c32800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0af2e0 0x7f8c2c0719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.820+0000 7f8c32800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c15bcc0 con 0x7f8c2c0af2e0 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.820+0000 7f8c32800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c15bb40 con 0x7f8c10004800 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.820+0000 7f8c32800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c06dcc0 con 0x7f8c2c151970 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0af2e0 0x7f8c2c0719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0af2e0 0x7f8c2c0719b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50840/0 (socket says 172.21.15.99:50840) 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2be00640 1 -- 172.21.15.99:0/2955511700 learned_addr learned my addr 172.21.15.99:0/2955511700 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c22a00640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c2c151970 0x7f8c2c071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2b400640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c10004800 0x7f8c2c1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2be00640 1 -- 172.21.15.99:0/2955511700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c2c151970 msgr2=0x7f8c2c071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2be00640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c2c151970 0x7f8c2c071470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2be00640 1 -- 172.21.15.99:0/2955511700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c10004800 msgr2=0x7f8c2c1522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:05.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2be00640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c10004800 0x7f8c2c1522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2be00640 1 -- 172.21.15.99:0/2955511700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c1515d0 con 0x7f8c2c0af2e0 2024-09-10T07:35:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2b400640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c10004800 0x7f8c2c1522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.821+0000 7f8c2be00640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0af2e0 0x7f8c2c0719b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0b3610 tx=0x7f8c24007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.822+0000 7f8c23e00640 1 -- 172.21.15.99:0/2955511700 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400ab20 con 0x7f8c2c0af2e0 2024-09-10T07:35:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.822+0000 7f8c32800640 1 -- 172.21.15.99:0/2955511700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2c0ad6b0 con 0x7f8c2c0af2e0 2024-09-10T07:35:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.822+0000 7f8c23e00640 1 -- 172.21.15.99:0/2955511700 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c24018070 con 0x7f8c2c0af2e0 2024-09-10T07:35:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.822+0000 7f8c23e00640 1 -- 172.21.15.99:0/2955511700 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240133f0 con 0x7f8c2c0af2e0 2024-09-10T07:35:05.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.822+0000 7f8c32800640 1 -- 172.21.15.99:0/2955511700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2c0adc70 con 0x7f8c2c0af2e0 2024-09-10T07:35:05.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.823+0000 7f8c32800640 1 -- 172.21.15.99:0/2955511700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2c0afa90 con 0x7f8c2c0af2e0 2024-09-10T07:35:05.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.824+0000 7f8c23e00640 1 -- 172.21.15.99:0/2955511700 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c24013590 con 0x7f8c2c0af2e0 2024-09-10T07:35:05.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.825+0000 7f8c23e00640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8c0806be60 0x7f8c0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:05.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.825+0000 7f8c23e00640 1 -- 172.21.15.99:0/2955511700 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7f8c2408b370 con 0x7f8c2c0af2e0 2024-09-10T07:35:05.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.825+0000 7f8c2b400640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8c0806be60 0x7f8c0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.826+0000 7f8c2b400640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8c0806be60 0x7f8c0806e320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0af0d0 tx=0x7f8c1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:05.830+0000 7f8c23e00640 1 -- 172.21.15.99:0/2955511700 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c2c1515d0 con 0x7f8c2c0af2e0 2024-09-10T07:35:06.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.036+0000 7f8c32800640 1 -- 172.21.15.99:0/2955511700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8c2c15a5c0 con 0x7f8c2c0af2e0 2024-09-10T07:35:06.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.630+0000 7f8c23e00640 1 -- 172.21.15.99:0/2955511700 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f8c24059cf0 con 0x7f8c2c0af2e0 2024-09-10T07:35:06.630 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 4 and data pool 5 2024-09-10T07:35:06.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.633+0000 7f8c32800640 1 -- 172.21.15.99:0/2955511700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8c0806be60 msgr2=0x7f8c0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:06.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.633+0000 7f8c32800640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8c0806be60 0x7f8c0806e320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0af0d0 tx=0x7f8c1c008040 comp rx=0 tx=0).stop 2024-09-10T07:35:06.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.633+0000 7f8c32800640 1 -- 172.21.15.99:0/2955511700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0af2e0 msgr2=0x7f8c2c0719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:06.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.633+0000 7f8c32800640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0af2e0 0x7f8c2c0719b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0b3610 tx=0x7f8c24007b20 comp rx=0 tx=0).stop 2024-09-10T07:35:06.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.633+0000 7f8c32800640 1 -- 172.21.15.99:0/2955511700 shutdown_connections 2024-09-10T07:35:06.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.633+0000 7f8c32800640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8c0806be60 0x7f8c0806e320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:06.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.633+0000 7f8c32800640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0af2e0 0x7f8c2c0719b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:06.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.633+0000 7f8c32800640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c2c151970 0x7f8c2c071470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:06.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.633+0000 7f8c32800640 1 --2- 172.21.15.99:0/2955511700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c10004800 0x7f8c2c1522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:06.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.633+0000 7f8c32800640 1 -- 172.21.15.99:0/2955511700 >> 172.21.15.99:0/2955511700 conn(0x7f8c2c06bc10 msgr2=0x7f8c2c074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:06.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.634+0000 7f8c32800640 1 -- 172.21.15.99:0/2955511700 shutdown_connections 2024-09-10T07:35:06.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.634+0000 7f8c32800640 1 -- 172.21.15.99:0/2955511700 wait complete. 2024-09-10T07:35:06.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:35:06.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.828+0000 7f8fd1e00640 1 Processor -- start 2024-09-10T07:35:06.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.828+0000 7f8fd1e00640 1 -- start start 2024-09-10T07:35:06.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.829+0000 7f8fd1e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8fcc0d2680 0x7f8fcc0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:06.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.829+0000 7f8fd1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc0cfac0 0x7f8fcc0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:06.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.829+0000 7f8fd1e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fcc0d2bd0 con 0x7f8fcc15e970 2024-09-10T07:35:06.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.829+0000 7f8fd1e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8fcc0d37e0 con 0x7f8fcc0d2680 2024-09-10T07:35:06.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.829+0000 7f8fd1e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc0d2eb0 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.829+0000 7f8fcbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8fcc0d2680 0x7f8fcc0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:06.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.829+0000 7f8fd0a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8fcc15e970 0x7f8fcc0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43644/0 (socket says 172.21.15.99:43644) 2024-09-10T07:35:06.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.829+0000 7f8fcbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8fcc0d2680 0x7f8fcc0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50850/0 (socket says 172.21.15.99:50850) 2024-09-10T07:35:06.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.829+0000 7f8fd0a00640 1 -- 172.21.15.99:0/2467081547 learned_addr learned my addr 172.21.15.99:0/2467081547 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:06.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.830+0000 7f8fd1400640 1 --2- 172.21.15.99:0/2467081547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc0cfac0 0x7f8fcc0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:06.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.830+0000 7f8fcbe00640 1 -- 172.21.15.99:0/2467081547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc0cfac0 msgr2=0x7f8fcc0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:06.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.830+0000 7f8fcbe00640 1 --2- 172.21.15.99:0/2467081547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc0cfac0 0x7f8fcc0c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:06.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.830+0000 7f8fcbe00640 1 -- 172.21.15.99:0/2467081547 >> v1:172.21.15.99:6789/0 conn(0x7f8fcc15e970 legacy=0x7f8fcc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:06.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.830+0000 7f8fcbe00640 1 -- 172.21.15.99:0/2467081547 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc0d3190 con 0x7f8fcc0d2680 2024-09-10T07:35:06.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.830+0000 7f8fd1400640 1 --2- 172.21.15.99:0/2467081547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc0cfac0 0x7f8fcc0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:06.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.831+0000 7f8fcbe00640 1 --2- 172.21.15.99:0/2467081547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0d2680 0x7f8fcc0cf580 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80097a0 tx=0x7f8fb802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed06c5fafb5ec04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:06.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.831+0000 7f8fcb400640 1 -- 172.21.15.99:0/2467081547 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8037070 con 0x7f8fcc0d2680 2024-09-10T07:35:06.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.831+0000 7f8fcb400640 1 -- 172.21.15.99:0/2467081547 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb8032440 con 0x7f8fcc0d2680 2024-09-10T07:35:06.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.831+0000 7f8fcb400640 1 -- 172.21.15.99:0/2467081547 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8032810 con 0x7f8fcc0d2680 2024-09-10T07:35:06.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.832+0000 7f8fd1e00640 1 -- 172.21.15.99:0/2467081547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0d2680 msgr2=0x7f8fcc0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:06.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.832+0000 7f8fd1e00640 1 --2- 172.21.15.99:0/2467081547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0d2680 0x7f8fcc0cf580 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80097a0 tx=0x7f8fb802a210 comp rx=0 tx=0).stop 2024-09-10T07:35:06.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.832+0000 7f8fd1e00640 1 -- 172.21.15.99:0/2467081547 shutdown_connections 2024-09-10T07:35:06.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.832+0000 7f8fd1e00640 1 --2- 172.21.15.99:0/2467081547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc0cfac0 0x7f8fcc0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:06.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.832+0000 7f8fd1e00640 1 --2- 172.21.15.99:0/2467081547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0d2680 0x7f8fcc0cf580 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:06.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.832+0000 7f8fd1e00640 1 -- 172.21.15.99:0/2467081547 >> 172.21.15.99:0/2467081547 conn(0x7f8fcc09de00 msgr2=0x7f8fcc0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:06.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.832+0000 7f8fd1e00640 1 -- 172.21.15.99:0/2467081547 shutdown_connections 2024-09-10T07:35:06.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.832+0000 7f8fd1e00640 1 -- 172.21.15.99:0/2467081547 wait complete. 2024-09-10T07:35:06.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.833+0000 7f8fd1e00640 1 Processor -- start 2024-09-10T07:35:06.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.834+0000 7f8fd1e00640 1 -- start start 2024-09-10T07:35:06.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.834+0000 7f8fd1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0cfac0 0x7f8fcc0ba320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:06.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.834+0000 7f8fd1e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fcc0d2680 0x7f8fcc0b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:06.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.834+0000 7f8fd1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc15e970 0x7f8fcc153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:06.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.834+0000 7f8fd1e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc15ed50 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.834+0000 7f8fd1e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc0cff50 con 0x7f8fcc0d2680 2024-09-10T07:35:06.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.834+0000 7f8fd1e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc15eed0 con 0x7f8fcc15e970 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fd0a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0cfac0 0x7f8fcc0ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fd0a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0cfac0 0x7f8fcc0ba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50862/0 (socket says 172.21.15.99:50862) 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fd0a00640 1 -- 172.21.15.99:0/870356028 learned_addr learned my addr 172.21.15.99:0/870356028 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fcbe00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fcc0d2680 0x7f8fcc0b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fd1400640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc15e970 0x7f8fcc153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fd0a00640 1 -- 172.21.15.99:0/870356028 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc15e970 msgr2=0x7f8fcc153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fd0a00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc15e970 0x7f8fcc153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fd0a00640 1 -- 172.21.15.99:0/870356028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fcc0d2680 msgr2=0x7f8fcc0b88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fd0a00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fcc0d2680 0x7f8fcc0b88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fd0a00640 1 -- 172.21.15.99:0/870356028 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc1e8230 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.835+0000 7f8fd0a00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0cfac0 0x7f8fcc0ba320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000c3c0 tx=0x7f8fc000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:06.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.836+0000 7f8fc8c00640 1 -- 172.21.15.99:0/870356028 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0017070 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.836+0000 7f8fc8c00640 1 -- 172.21.15.99:0/870356028 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc0005ce0 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.836+0000 7f8fd1e00640 1 -- 172.21.15.99:0/870356028 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fcc1e8510 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.836+0000 7f8fc8c00640 1 -- 172.21.15.99:0/870356028 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc00072f0 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.836+0000 7f8fd1e00640 1 -- 172.21.15.99:0/870356028 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fcc0b8e20 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.837+0000 7f8fd1e00640 1 -- 172.21.15.99:0/870356028 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fcc0cf580 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.838+0000 7f8fc8c00640 1 -- 172.21.15.99:0/870356028 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fc001a070 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.839+0000 7f8fc8c00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fac06be30 0x7f8fac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:06.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.839+0000 7f8fc8c00640 1 -- 172.21.15.99:0/870356028 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f8fc008a1c0 con 0x7f8fcc0cfac0 2024-09-10T07:35:06.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.839+0000 7f8fcbe00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fac06be30 0x7f8fac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:06.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.839+0000 7f8fcbe00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fac06be30 0x7f8fac06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8034000 tx=0x7f8fb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:06.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:06.843+0000 7f8fc8c00640 1 -- 172.21.15.99:0/870356028 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fc0058b70 con 0x7f8fcc0cfac0 2024-09-10T07:35:07.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.019+0000 7f8fd1e00640 1 -- 172.21.15.99:0/870356028 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8fcc0cb300 con 0x7f8fcc0cfac0 2024-09-10T07:35:07.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.020+0000 7f8fc8c00640 1 -- 172.21.15.99:0/870356028 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16718 (secure 0 0 0) 0x7f8fc0058470 con 0x7f8fcc0cfac0 2024-09-10T07:35:07.020 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:07.020 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":30,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:35:06.037729+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:03.811904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:05.040821+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:35:07.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 -- 172.21.15.99:0/870356028 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fac06be30 msgr2=0x7f8fac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fac06be30 0x7f8fac06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8034000 tx=0x7f8fb802e000 comp rx=0 tx=0).stop 2024-09-10T07:35:07.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 -- 172.21.15.99:0/870356028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0cfac0 msgr2=0x7f8fcc0ba320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0cfac0 0x7f8fcc0ba320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000c3c0 tx=0x7f8fc000c880 comp rx=0 tx=0).stop 2024-09-10T07:35:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 -- 172.21.15.99:0/870356028 shutdown_connections 2024-09-10T07:35:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fcc15e970 0x7f8fcc153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fcc0d2680 0x7f8fcc0b88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fac06be30 0x7f8fac06e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 --2- 172.21.15.99:0/870356028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fcc0cfac0 0x7f8fcc0ba320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 -- 172.21.15.99:0/870356028 >> 172.21.15.99:0/870356028 conn(0x7f8fcc09de00 msgr2=0x7f8fcc0d1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 -- 172.21.15.99:0/870356028 shutdown_connections 2024-09-10T07:35:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.022+0000 7f8fd1e00640 1 -- 172.21.15.99:0/870356028 wait complete. 2024-09-10T07:35:07.038 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:35:07.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.191+0000 7f2398600640 1 Processor -- start 2024-09-10T07:35:07.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.191+0000 7f2398600640 1 -- start start 2024-09-10T07:35:07.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2398600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2390072f40 0x7f239006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2398600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f23900ce780 0x7f23900b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2398600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239006e3d0 con 0x7f2390145290 2024-09-10T07:35:07.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2398600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f239006efe0 con 0x7f23900ce780 2024-09-10T07:35:07.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2398600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f239006e6b0 con 0x7f2390072f40 2024-09-10T07:35:07.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2395c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2390145290 0x7f2390072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43652/0 (socket says 172.21.15.99:43652) 2024-09-10T07:35:07.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2395c00640 1 -- 172.21.15.99:0/3947597785 learned_addr learned my addr 172.21.15.99:0/3947597785 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:07.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2396600640 1 --2- 172.21.15.99:0/3947597785 >> v2:172.21.15.99:3300/0 conn(0x7f23900ce780 0x7f23900b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2395200640 1 --2- 172.21.15.99:0/3947597785 >> v2:172.21.15.187:3300/0 conn(0x7f2390072f40 0x7f239006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f238fe00640 1 -- 172.21.15.99:0/3947597785 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803940668 0 0) 0x7f239006e3d0 con 0x7f2390145290 2024-09-10T07:35:07.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2396600640 1 -- 172.21.15.99:0/3947597785 >> v2:172.21.15.187:3300/0 conn(0x7f2390072f40 msgr2=0x7f239006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:07.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2396600640 1 --2- 172.21.15.99:0/3947597785 >> v2:172.21.15.187:3300/0 conn(0x7f2390072f40 0x7f239006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2396600640 1 -- 172.21.15.99:0/3947597785 >> v1:172.21.15.99:6789/0 conn(0x7f2390145290 legacy=0x7f2390072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.193+0000 7f2396600640 1 -- 172.21.15.99:0/3947597785 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239006e990 con 0x7f23900ce780 2024-09-10T07:35:07.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.194+0000 7f2396600640 1 --2- 172.21.15.99:0/3947597785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23900ce780 0x7f23900b3930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f239006d450 tx=0x7f238802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1ba557199c61fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:07.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.195+0000 7f238fe00640 1 -- 172.21.15.99:0/3947597785 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388007740 con 0x7f23900ce780 2024-09-10T07:35:07.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.195+0000 7f238fe00640 1 -- 172.21.15.99:0/3947597785 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23880078e0 con 0x7f23900ce780 2024-09-10T07:35:07.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.195+0000 7f238fe00640 1 -- 172.21.15.99:0/3947597785 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388007cb0 con 0x7f23900ce780 2024-09-10T07:35:07.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.195+0000 7f2398600640 1 -- 172.21.15.99:0/3947597785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23900ce780 msgr2=0x7f23900b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.195+0000 7f2398600640 1 --2- 172.21.15.99:0/3947597785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23900ce780 0x7f23900b3930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f239006d450 tx=0x7f238802a680 comp rx=0 tx=0).stop 2024-09-10T07:35:07.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.195+0000 7f2398600640 1 -- 172.21.15.99:0/3947597785 shutdown_connections 2024-09-10T07:35:07.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.195+0000 7f2398600640 1 --2- 172.21.15.99:0/3947597785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23900ce780 0x7f23900b3930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.195+0000 7f2398600640 1 --2- 172.21.15.99:0/3947597785 >> v2:172.21.15.187:3300/0 conn(0x7f2390072f40 0x7f239006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.195+0000 7f2398600640 1 -- 172.21.15.99:0/3947597785 >> 172.21.15.99:0/3947597785 conn(0x7f239006bc10 msgr2=0x7f239006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:07.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.196+0000 7f2398600640 1 -- 172.21.15.99:0/3947597785 shutdown_connections 2024-09-10T07:35:07.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.196+0000 7f2398600640 1 -- 172.21.15.99:0/3947597785 wait complete. 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.197+0000 7f2398600640 1 Processor -- start 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.197+0000 7f2398600640 1 -- start start 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.198+0000 7f2398600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390072f40 0x7f239015ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.198+0000 7f2398600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900ce780 0x7f23900c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.198+0000 7f2398600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2390145290 0x7f2390142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.198+0000 7f2398600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f239006df80 con 0x7f2390145290 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.198+0000 7f2398600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2390145670 con 0x7f2390072f40 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.198+0000 7f2398600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f239006e100 con 0x7f23900ce780 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2396600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2390145290 0x7f2390142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2396600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2390145290 0x7f2390142e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50876/0 (socket says 172.21.15.99:50876) 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2396600640 1 -- 172.21.15.99:0/1546432747 learned_addr learned my addr 172.21.15.99:0/1546432747 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:07.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2395c00640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390072f40 0x7f239015ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2395200640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900ce780 0x7f23900c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2396600640 1 -- 172.21.15.99:0/1546432747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900ce780 msgr2=0x7f23900c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2396600640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900ce780 0x7f23900c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2396600640 1 -- 172.21.15.99:0/1546432747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390072f40 msgr2=0x7f239015ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2396600640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390072f40 0x7f239015ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2396600640 1 -- 172.21.15.99:0/1546432747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23900cb730 con 0x7f2390145290 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2395c00640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390072f40 0x7f239015ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.199+0000 7f2396600640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2390145290 0x7f2390142e40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2388009e80 tx=0x7f2388004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.200+0000 7f238d600640 1 -- 172.21.15.99:0/1546432747 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238803f070 con 0x7f2390145290 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.200+0000 7f238d600640 1 -- 172.21.15.99:0/1546432747 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2388031c40 con 0x7f2390145290 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.200+0000 7f2398600640 1 -- 172.21.15.99:0/1546432747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23900ca690 con 0x7f2390145290 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.200+0000 7f238d600640 1 -- 172.21.15.99:0/1546432747 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388009450 con 0x7f2390145290 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.200+0000 7f2398600640 1 -- 172.21.15.99:0/1546432747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23900cac50 con 0x7f2390145290 2024-09-10T07:35:07.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.201+0000 7f2398600640 1 -- 172.21.15.99:0/1546432747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2390071510 con 0x7f2390145290 2024-09-10T07:35:07.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.202+0000 7f238d600640 1 -- 172.21.15.99:0/1546432747 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2388003b90 con 0x7f2390145290 2024-09-10T07:35:07.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.202+0000 7f238d600640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f237006be60 0x7f237006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.202+0000 7f238d600640 1 -- 172.21.15.99:0/1546432747 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f23880abfe0 con 0x7f2390145290 2024-09-10T07:35:07.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.203+0000 7f2395c00640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f237006be60 0x7f237006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.203+0000 7f2395c00640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f237006be60 0x7f237006e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2384000f60 tx=0x7f2384007c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:07.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.206+0000 7f238d600640 1 -- 172.21.15.99:0/1546432747 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f238807a8f0 con 0x7f2390145290 2024-09-10T07:35:07.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.382+0000 7f2398600640 1 -- 172.21.15.99:0/1546432747 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2390075620 con 0x7f2390145290 2024-09-10T07:35:07.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.383+0000 7f238d600640 1 -- 172.21.15.99:0/1546432747 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16718 (secure 0 0 0) 0x7f238807a1f0 con 0x7f2390145290 2024-09-10T07:35:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:07.384 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":30,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:35:06.037729+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:03.811904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:05.040821+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:35:07.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.385+0000 7f2398600640 1 -- 172.21.15.99:0/1546432747 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f237006be60 msgr2=0x7f237006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.385+0000 7f2398600640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f237006be60 0x7f237006e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2384000f60 tx=0x7f2384007c30 comp rx=0 tx=0).stop 2024-09-10T07:35:07.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.385+0000 7f2398600640 1 -- 172.21.15.99:0/1546432747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2390145290 msgr2=0x7f2390142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.385+0000 7f2398600640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2390145290 0x7f2390142e40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2388009e80 tx=0x7f2388004a40 comp rx=0 tx=0).stop 2024-09-10T07:35:07.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.386+0000 7f2398600640 1 -- 172.21.15.99:0/1546432747 shutdown_connections 2024-09-10T07:35:07.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.386+0000 7f2398600640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f237006be60 0x7f237006e320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.386+0000 7f2398600640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2390145290 0x7f2390142e40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.386+0000 7f2398600640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900ce780 0x7f23900c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.386+0000 7f2398600640 1 --2- 172.21.15.99:0/1546432747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390072f40 0x7f239015ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.386+0000 7f2398600640 1 -- 172.21.15.99:0/1546432747 >> 172.21.15.99:0/1546432747 conn(0x7f239006bc10 msgr2=0x7f23900b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:07.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.386+0000 7f2398600640 1 -- 172.21.15.99:0/1546432747 shutdown_connections 2024-09-10T07:35:07.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.386+0000 7f2398600640 1 -- 172.21.15.99:0/1546432747 wait complete. 2024-09-10T07:35:07.402 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:35:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.557+0000 7f0314600640 1 Processor -- start 2024-09-10T07:35:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.557+0000 7f0314600640 1 -- start start 2024-09-10T07:35:07.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.558+0000 7f0314600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f030c1623c0 0x7f030c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.558+0000 7f0314600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f030c0d3700 con 0x7f030c0d1470 2024-09-10T07:35:07.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.558+0000 7f0314600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f030c0cfa70 con 0x7f030c0d56b0 2024-09-10T07:35:07.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.558+0000 7f0314600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f030c0d21a0 con 0x7f030c1623c0 2024-09-10T07:35:07.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.559+0000 7f0312600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f030c0d1470 0x7f030c0b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43668/0 (socket says 172.21.15.99:43668) 2024-09-10T07:35:07.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.559+0000 7f0312600640 1 -- 172.21.15.99:0/1264170259 learned_addr learned my addr 172.21.15.99:0/1264170259 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:07.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.559+0000 7f0311c00640 1 --2- 172.21.15.99:0/1264170259 >> v2:172.21.15.187:3300/0 conn(0x7f030c1623c0 0x7f030c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.559+0000 7f030be00640 1 -- 172.21.15.99:0/1264170259 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003429870 0 0) 0x7f030c0d3700 con 0x7f030c0d1470 2024-09-10T07:35:07.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.559+0000 7f030be00640 1 -- 172.21.15.99:0/1264170259 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02f4003520 con 0x7f030c0d1470 2024-09-10T07:35:07.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.559+0000 7f0311c00640 1 -- 172.21.15.99:0/1264170259 >> v1:172.21.15.187:6789/0 conn(0x7f030c0d56b0 legacy=0x7f030c0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.559+0000 7f0311c00640 1 -- 172.21.15.99:0/1264170259 >> v1:172.21.15.99:6789/0 conn(0x7f030c0d1470 legacy=0x7f030c0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.559+0000 7f0311c00640 1 -- 172.21.15.99:0/1264170259 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c0d0c20 con 0x7f030c1623c0 2024-09-10T07:35:07.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.560+0000 7f0311c00640 1 --2- 172.21.15.99:0/1264170259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f030c1623c0 0x7f030c0b6260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f03000097a0 tx=0x7f030002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a5487395da2e660 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:07.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.561+0000 7f030be00640 1 -- 172.21.15.99:0/1264170259 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300037070 con 0x7f030c1623c0 2024-09-10T07:35:07.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.561+0000 7f030be00640 1 -- 172.21.15.99:0/1264170259 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0300032440 con 0x7f030c1623c0 2024-09-10T07:35:07.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.561+0000 7f030be00640 1 -- 172.21.15.99:0/1264170259 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300032810 con 0x7f030c1623c0 2024-09-10T07:35:07.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.561+0000 7f0314600640 1 -- 172.21.15.99:0/1264170259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f030c1623c0 msgr2=0x7f030c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.561+0000 7f0314600640 1 --2- 172.21.15.99:0/1264170259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f030c1623c0 0x7f030c0b6260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f03000097a0 tx=0x7f030002a230 comp rx=0 tx=0).stop 2024-09-10T07:35:07.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.561+0000 7f0314600640 1 -- 172.21.15.99:0/1264170259 shutdown_connections 2024-09-10T07:35:07.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.561+0000 7f0314600640 1 --2- 172.21.15.99:0/1264170259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f030c1623c0 0x7f030c0b6260 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.561+0000 7f0314600640 1 -- 172.21.15.99:0/1264170259 >> 172.21.15.99:0/1264170259 conn(0x7f030c09df30 msgr2=0x7f030c0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:07.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.561+0000 7f0314600640 1 -- 172.21.15.99:0/1264170259 shutdown_connections 2024-09-10T07:35:07.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.561+0000 7f0314600640 1 -- 172.21.15.99:0/1264170259 wait complete. 2024-09-10T07:35:07.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.563+0000 7f0314600640 1 Processor -- start 2024-09-10T07:35:07.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.563+0000 7f0314600640 1 -- start start 2024-09-10T07:35:07.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.564+0000 7f0314600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f030c0d1470 0x7f030c1520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.564+0000 7f0314600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f030c0d56b0 0x7f030c0cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.564+0000 7f0314600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f030c1623c0 0x7f030c0b9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.564+0000 7f0314600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f030c0cfd10 con 0x7f030c0d56b0 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.564+0000 7f0314600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f030c0d0080 con 0x7f030c1623c0 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.564+0000 7f0314600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f030c1627a0 con 0x7f030c0d1470 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.564+0000 7f0311200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f030c0d56b0 0x7f030c0cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.564+0000 7f0311200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f030c0d56b0 0x7f030c0cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50882/0 (socket says 172.21.15.99:50882) 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.564+0000 7f0311200640 1 -- 172.21.15.99:0/1667920037 learned_addr learned my addr 172.21.15.99:0/1667920037 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0311c00640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f030c0d1470 0x7f030c1520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0312600640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f030c1623c0 0x7f030c0b9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0311200640 1 -- 172.21.15.99:0/1667920037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f030c0d1470 msgr2=0x7f030c1520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0311200640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f030c0d1470 0x7f030c1520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0311200640 1 -- 172.21.15.99:0/1667920037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f030c1623c0 msgr2=0x7f030c0b9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0311200640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f030c1623c0 0x7f030c0b9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:07.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0311200640 1 -- 172.21.15.99:0/1667920037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c15ba70 con 0x7f030c0d56b0 2024-09-10T07:35:07.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0311200640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f030c0d56b0 0x7f030c0cb1b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f02f800c430 tx=0x7f02f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:07.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0309600640 1 -- 172.21.15.99:0/1667920037 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8017070 con 0x7f030c0d56b0 2024-09-10T07:35:07.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0309600640 1 -- 172.21.15.99:0/1667920037 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f80052d0 con 0x7f030c0d56b0 2024-09-10T07:35:07.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0309600640 1 -- 172.21.15.99:0/1667920037 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8003850 con 0x7f030c0d56b0 2024-09-10T07:35:07.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0314600640 1 -- 172.21.15.99:0/1667920037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030c0cbd90 con 0x7f030c0d56b0 2024-09-10T07:35:07.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.565+0000 7f0314600640 1 -- 172.21.15.99:0/1667920037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030c0cc350 con 0x7f030c0d56b0 2024-09-10T07:35:07.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.567+0000 7f0314600640 1 -- 172.21.15.99:0/1667920037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030c0d3c80 con 0x7f030c0d56b0 2024-09-10T07:35:07.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.567+0000 7f0309600640 1 -- 172.21.15.99:0/1667920037 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02f801a070 con 0x7f030c0d56b0 2024-09-10T07:35:07.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.568+0000 7f0309600640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02ec06be30 0x7f02ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:07.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.568+0000 7f0309600640 1 -- 172.21.15.99:0/1667920037 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f02f808a1f0 con 0x7f030c0d56b0 2024-09-10T07:35:07.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.568+0000 7f0311c00640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02ec06be30 0x7f02ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:07.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.569+0000 7f0311c00640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02ec06be30 0x7f02ec06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0300034000 tx=0x7f030002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:07.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.572+0000 7f0309600640 1 -- 172.21.15.99:0/1667920037 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02f8058ba0 con 0x7f030c0d56b0 2024-09-10T07:35:07.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:07.785+0000 7f0314600640 1 -- 172.21.15.99:0/1667920037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f030c0d2340 con 0x7f030c0d56b0 2024-09-10T07:35:08.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.705+0000 7f0309600640 1 -- 172.21.15.99:0/1667920037 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f02f80584a0 con 0x7f030c0d56b0 2024-09-10T07:35:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.708+0000 7f0314600640 1 -- 172.21.15.99:0/1667920037 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02ec06be30 msgr2=0x7f02ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.708+0000 7f0314600640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02ec06be30 0x7f02ec06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0300034000 tx=0x7f030002e000 comp rx=0 tx=0).stop 2024-09-10T07:35:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.708+0000 7f0314600640 1 -- 172.21.15.99:0/1667920037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f030c0d56b0 msgr2=0x7f030c0cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.708+0000 7f0314600640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f030c0d56b0 0x7f030c0cb1b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f02f800c430 tx=0x7f02f800c8f0 comp rx=0 tx=0).stop 2024-09-10T07:35:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.709+0000 7f0314600640 1 -- 172.21.15.99:0/1667920037 shutdown_connections 2024-09-10T07:35:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.709+0000 7f0314600640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f030c1623c0 0x7f030c0b9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.709+0000 7f0314600640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02ec06be30 0x7f02ec06e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.709+0000 7f0314600640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f030c0d56b0 0x7f030c0cb1b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:08.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.709+0000 7f0314600640 1 --2- 172.21.15.99:0/1667920037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f030c0d1470 0x7f030c1520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:08.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.709+0000 7f0314600640 1 -- 172.21.15.99:0/1667920037 >> 172.21.15.99:0/1667920037 conn(0x7f030c09df30 msgr2=0x7f030c0b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:08.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.709+0000 7f0314600640 1 -- 172.21.15.99:0/1667920037 shutdown_connections 2024-09-10T07:35:08.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.709+0000 7f0314600640 1 -- 172.21.15.99:0/1667920037 wait complete. 2024-09-10T07:35:08.728 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T07:35:08.728 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:35:08.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.888+0000 7feb8e400640 1 Processor -- start 2024-09-10T07:35:08.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.888+0000 7feb8e400640 1 -- start start 2024-09-10T07:35:08.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.889+0000 7feb8e400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feb880d2680 0x7feb880cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:08.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.889+0000 7feb8e400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb880d2bd0 con 0x7feb8815e970 2024-09-10T07:35:08.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.889+0000 7feb8e400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb880d2eb0 con 0x7feb880cfac0 2024-09-10T07:35:08.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.889+0000 7feb8e400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7feb880d37e0 con 0x7feb880d2680 2024-09-10T07:35:08.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.890+0000 7feb8d000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7feb8815e970 0x7feb880d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43684/0 (socket says 172.21.15.99:43684) 2024-09-10T07:35:08.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.890+0000 7feb8d000640 1 -- 172.21.15.99:0/3985811100 learned_addr learned my addr 172.21.15.99:0/3985811100 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:08.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.890+0000 7feb7fe00640 1 --2- 172.21.15.99:0/3985811100 >> v2:172.21.15.99:3300/0 conn(0x7feb880d2680 0x7feb880cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:08.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.890+0000 7feb7fe00640 1 -- 172.21.15.99:0/3985811100 >> v1:172.21.15.187:6789/0 conn(0x7feb880cfac0 legacy=0x7feb880c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:08.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.890+0000 7feb7fe00640 1 -- 172.21.15.99:0/3985811100 >> v1:172.21.15.99:6789/0 conn(0x7feb8815e970 legacy=0x7feb880d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:08.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.890+0000 7feb7fe00640 1 -- 172.21.15.99:0/3985811100 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb880d3190 con 0x7feb880d2680 2024-09-10T07:35:08.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.890+0000 7feb87e00640 1 -- 172.21.15.99:0/3985811100 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985404037 0 0) 0x7feb880d2bd0 con 0x7feb8815e970 2024-09-10T07:35:08.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.891+0000 7feb7fe00640 1 --2- 172.21.15.99:0/3985811100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 0x7feb880cf580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feb880d3960 tx=0x7feb7002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2751c4ce35ded6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:08.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.891+0000 7feb87e00640 1 -- 172.21.15.99:0/3985811100 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70037070 con 0x7feb880d2680 2024-09-10T07:35:08.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.891+0000 7feb87e00640 1 -- 172.21.15.99:0/3985811100 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb70032640 con 0x7feb880d2680 2024-09-10T07:35:08.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.891+0000 7feb87e00640 1 -- 172.21.15.99:0/3985811100 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70032a10 con 0x7feb880d2680 2024-09-10T07:35:08.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.892+0000 7feb8e400640 1 -- 172.21.15.99:0/3985811100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 msgr2=0x7feb880cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:08.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.892+0000 7feb8e400640 1 --2- 172.21.15.99:0/3985811100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 0x7feb880cf580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feb880d3960 tx=0x7feb7002a2c0 comp rx=0 tx=0).stop 2024-09-10T07:35:08.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.892+0000 7feb8e400640 1 -- 172.21.15.99:0/3985811100 shutdown_connections 2024-09-10T07:35:08.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.892+0000 7feb8e400640 1 --2- 172.21.15.99:0/3985811100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 0x7feb880cf580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:08.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.892+0000 7feb8e400640 1 -- 172.21.15.99:0/3985811100 >> 172.21.15.99:0/3985811100 conn(0x7feb8809de00 msgr2=0x7feb880d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:08.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.892+0000 7feb8e400640 1 -- 172.21.15.99:0/3985811100 shutdown_connections 2024-09-10T07:35:08.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.892+0000 7feb8e400640 1 -- 172.21.15.99:0/3985811100 wait complete. 2024-09-10T07:35:08.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.894+0000 7feb8e400640 1 Processor -- start 2024-09-10T07:35:08.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.894+0000 7feb8e400640 1 -- start start 2024-09-10T07:35:08.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb8e400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb880cfac0 0x7feb880b9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:08.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb8e400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 0x7feb8815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb8e400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb8815e970 0x7feb881f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb8e400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feb8815ed50 con 0x7feb880d2680 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb8e400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7feb880cff10 con 0x7feb880cfac0 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb8e400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7feb8815eed0 con 0x7feb8815e970 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 0x7feb8815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 0x7feb8815b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50910/0 (socket says 172.21.15.99:50910) 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb7fe00640 1 -- 172.21.15.99:0/712151666 learned_addr learned my addr 172.21.15.99:0/712151666 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb8d000640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb880cfac0 0x7feb880b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb8da00640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb8815e970 0x7feb881f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb7fe00640 1 -- 172.21.15.99:0/712151666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb8815e970 msgr2=0x7feb881f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb7fe00640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb8815e970 0x7feb881f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb7fe00640 1 -- 172.21.15.99:0/712151666 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb880cfac0 msgr2=0x7feb880b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb7fe00640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb880cfac0 0x7feb880b9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.895+0000 7feb7fe00640 1 -- 172.21.15.99:0/712151666 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb881f7820 con 0x7feb880d2680 2024-09-10T07:35:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.896+0000 7feb7fe00640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 0x7feb8815b0d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feb70035040 tx=0x7feb700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.896+0000 7feb85600640 1 -- 172.21.15.99:0/712151666 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70037050 con 0x7feb880d2680 2024-09-10T07:35:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.896+0000 7feb85600640 1 -- 172.21.15.99:0/712151666 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb70038040 con 0x7feb880d2680 2024-09-10T07:35:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.896+0000 7feb8e400640 1 -- 172.21.15.99:0/712151666 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb881f7b00 con 0x7feb880d2680 2024-09-10T07:35:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.896+0000 7feb85600640 1 -- 172.21.15.99:0/712151666 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70004450 con 0x7feb880d2680 2024-09-10T07:35:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.896+0000 7feb8e400640 1 -- 172.21.15.99:0/712151666 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb881f80c0 con 0x7feb880d2680 2024-09-10T07:35:08.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.897+0000 7feb8e400640 1 -- 172.21.15.99:0/712151666 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb880cf580 con 0x7feb880d2680 2024-09-10T07:35:08.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.898+0000 7feb85600640 1 -- 172.21.15.99:0/712151666 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb70030900 con 0x7feb880d2680 2024-09-10T07:35:08.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.899+0000 7feb85600640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb6406be30 0x7feb6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:08.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.899+0000 7feb85600640 1 -- 172.21.15.99:0/712151666 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7feb700ab8d0 con 0x7feb880d2680 2024-09-10T07:35:08.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.899+0000 7feb8d000640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb6406be30 0x7feb6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:08.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.900+0000 7feb8d000640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb6406be30 0x7feb6406e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feb78000f60 tx=0x7feb78007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:08.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:08.903+0000 7feb85600640 1 -- 172.21.15.99:0/712151666 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb70079de0 con 0x7feb880d2680 2024-09-10T07:35:09.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.109+0000 7feb8e400640 1 -- 172.21.15.99:0/712151666 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7feb880d1670 con 0x7feb880d2680 2024-09-10T07:35:09.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.707+0000 7feb85600640 1 -- 172.21.15.99:0/712151666 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7feb7007e0e0 con 0x7feb880d2680 2024-09-10T07:35:09.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 -- 172.21.15.99:0/712151666 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb6406be30 msgr2=0x7feb6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:09.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb6406be30 0x7feb6406e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feb78000f60 tx=0x7feb78007e40 comp rx=0 tx=0).stop 2024-09-10T07:35:09.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 -- 172.21.15.99:0/712151666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 msgr2=0x7feb8815b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:09.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 0x7feb8815b0d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feb70035040 tx=0x7feb700046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:09.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 -- 172.21.15.99:0/712151666 shutdown_connections 2024-09-10T07:35:09.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb8815e970 0x7feb881f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:09.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7feb6406be30 0x7feb6406e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:09.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb880d2680 0x7feb8815b0d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:09.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 --2- 172.21.15.99:0/712151666 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb880cfac0 0x7feb880b9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:09.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 -- 172.21.15.99:0/712151666 >> 172.21.15.99:0/712151666 conn(0x7feb8809de00 msgr2=0x7feb880d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:09.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 -- 172.21.15.99:0/712151666 shutdown_connections 2024-09-10T07:35:09.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.710+0000 7feb8e400640 1 -- 172.21.15.99:0/712151666 wait complete. 2024-09-10T07:35:09.728 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:35:09.728 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:09.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.883+0000 7f22c1c00640 1 Processor -- start 2024-09-10T07:35:09.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.884+0000 7f22c1c00640 1 -- start start 2024-09-10T07:35:09.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22c1c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 0x7f22bc160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:09.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22c1c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f22bc160a80 0x7f22bc0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:09.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22c1c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22bc142650 con 0x7f22bc13fae0 2024-09-10T07:35:09.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22c1c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f22bc0ce780 con 0x7f22bc160a80 2024-09-10T07:35:09.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22c1c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc142930 con 0x7f22bc142150 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22bb400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f22bc160a80 0x7f22bc0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22bb400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f22bc160a80 0x7f22bc0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49358/0 (socket says 172.21.15.99:49358) 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22bb400640 1 -- 172.21.15.99:0/3361706650 learned_addr learned my addr 172.21.15.99:0/3361706650 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22b2000640 1 --2- 172.21.15.99:0/3361706650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 0x7f22bc160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22bb400640 1 -- 172.21.15.99:0/3361706650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 msgr2=0x7f22bc160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22bb400640 1 --2- 172.21.15.99:0/3361706650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 0x7f22bc160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.885+0000 7f22bb400640 1 -- 172.21.15.99:0/3361706650 >> v1:172.21.15.187:6789/0 conn(0x7f22bc13fae0 legacy=0x7f22bc06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.886+0000 7f22bb400640 1 -- 172.21.15.99:0/3361706650 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc142c10 con 0x7f22bc160a80 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.886+0000 7f22b2000640 1 --2- 172.21.15.99:0/3361706650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 0x7f22bc160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.886+0000 7f22bb400640 1 --2- 172.21.15.99:0/3361706650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 0x7f22bc0cec10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009e50 tx=0x7f22b402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5579e8ac974ee5a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.887+0000 7f22ba000640 1 -- 172.21.15.99:0/3361706650 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4036070 con 0x7f22bc160a80 2024-09-10T07:35:09.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.887+0000 7f22ba000640 1 -- 172.21.15.99:0/3361706650 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b4031600 con 0x7f22bc160a80 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.887+0000 7f22ba000640 1 -- 172.21.15.99:0/3361706650 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b40319d0 con 0x7f22bc160a80 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.887+0000 7f22c1c00640 1 -- 172.21.15.99:0/3361706650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 msgr2=0x7f22bc0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.887+0000 7f22c1c00640 1 --2- 172.21.15.99:0/3361706650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 0x7f22bc0cec10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009e50 tx=0x7f22b402a630 comp rx=0 tx=0).stop 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.887+0000 7f22c1c00640 1 -- 172.21.15.99:0/3361706650 shutdown_connections 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.887+0000 7f22c1c00640 1 --2- 172.21.15.99:0/3361706650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 0x7f22bc0cec10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.887+0000 7f22c1c00640 1 --2- 172.21.15.99:0/3361706650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 0x7f22bc160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.887+0000 7f22c1c00640 1 -- 172.21.15.99:0/3361706650 >> 172.21.15.99:0/3361706650 conn(0x7f22bc06bc10 msgr2=0x7f22bc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.887+0000 7f22c1c00640 1 -- 172.21.15.99:0/3361706650 shutdown_connections 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.888+0000 7f22c1c00640 1 -- 172.21.15.99:0/3361706650 wait complete. 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.889+0000 7f22c1c00640 1 Processor -- start 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.889+0000 7f22c1c00640 1 -- start start 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22c1c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22bc13fae0 0x7f22bc13f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22c1c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 0x7f22bc0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:09.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22c1c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 0x7f22bc1f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22c1c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc0cf2d0 con 0x7f22bc160a80 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22c1c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc0cf150 con 0x7f22bc13fae0 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22c1c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc0cf450 con 0x7f22bc142150 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22bb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 0x7f22bc1f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22bb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 0x7f22bc1f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49374/0 (socket says 172.21.15.99:49374) 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22bb400640 1 -- 172.21.15.99:0/3821552620 learned_addr learned my addr 172.21.15.99:0/3821552620 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22baa00640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22bc13fae0 0x7f22bc13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.890+0000 7f22b2000640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 0x7f22bc0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22bb400640 1 -- 172.21.15.99:0/3821552620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 msgr2=0x7f22bc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22bb400640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 0x7f22bc0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22bb400640 1 -- 172.21.15.99:0/3821552620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22bc13fae0 msgr2=0x7f22bc13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22bb400640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22bc13fae0 0x7f22bc13f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22bb400640 1 -- 172.21.15.99:0/3821552620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc13f690 con 0x7f22bc160a80 2024-09-10T07:35:09.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22baa00640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22bc13fae0 0x7f22bc13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22bb400640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 0x7f22bc1f4790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f22b4034040 tx=0x7f22b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22b3400640 1 -- 172.21.15.99:0/3821552620 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4036050 con 0x7f22bc160a80 2024-09-10T07:35:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22b3400640 1 -- 172.21.15.99:0/3821552620 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b4042070 con 0x7f22bc160a80 2024-09-10T07:35:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22b3400640 1 -- 172.21.15.99:0/3821552620 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4009510 con 0x7f22bc160a80 2024-09-10T07:35:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22c1c00640 1 -- 172.21.15.99:0/3821552620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc1f5170 con 0x7f22bc160a80 2024-09-10T07:35:09.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.891+0000 7f22c1c00640 1 -- 172.21.15.99:0/3821552620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc0b3bd0 con 0x7f22bc160a80 2024-09-10T07:35:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.892+0000 7f22c1c00640 1 -- 172.21.15.99:0/3821552620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc1f5690 con 0x7f22bc160a80 2024-09-10T07:35:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.893+0000 7f22b3400640 1 -- 172.21.15.99:0/3821552620 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22b4007bd0 con 0x7f22bc160a80 2024-09-10T07:35:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.895+0000 7f22b3400640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f229806be30 0x7f229806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.895+0000 7f22b3400640 1 -- 172.21.15.99:0/3821552620 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f22b40abe70 con 0x7f22bc160a80 2024-09-10T07:35:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.895+0000 7f22baa00640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f229806be30 0x7f229806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:09.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.896+0000 7f22baa00640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f229806be30 0x7f229806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22ac003eb0 tx=0x7f22ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:09.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:09.899+0000 7f22b3400640 1 -- 172.21.15.99:0/3821552620 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22bc1f5690 con 0x7f22bc160a80 2024-09-10T07:35:10.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.117+0000 7f22c1c00640 1 -- 172.21.15.99:0/3821552620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22bc0b0d00 con 0x7f22bc160a80 2024-09-10T07:35:10.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.119+0000 7f22b3400640 1 -- 172.21.15.99:0/3821552620 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f22bc13f690 con 0x7f22bc160a80 2024-09-10T07:35:10.119 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:10.119 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"btime":"2024-09-10T07:35:09:706532+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3299804861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3299804861},{"type":"v1","addr":"172.21.15.187:6834","nonce":3299804861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/4173112208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4173112208},{"type":"v1","addr":"172.21.15.187:6835","nonce":4173112208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4740,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2963379591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2963379591},{"type":"v1","addr":"172.21.15.99:6835","nonce":2963379591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:06.038065+0000","modified":"2024-09-10T07:35:09.110775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4743":{"gid":4743,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/4168486217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":4168486217},{"type":"v1","addr":"172.21.15.99:6837","nonce":4168486217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4743,"qdb_cluster":[4743]},"id":2}]} 2024-09-10T07:35:10.119 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-09-10T07:35:10.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 -- 172.21.15.99:0/3821552620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f229806be30 msgr2=0x7f229806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f229806be30 0x7f229806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22ac003eb0 tx=0x7f22ac009040 comp rx=0 tx=0).stop 2024-09-10T07:35:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 -- 172.21.15.99:0/3821552620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 msgr2=0x7f22bc1f4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 0x7f22bc1f4790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f22b4034040 tx=0x7f22b4004a40 comp rx=0 tx=0).stop 2024-09-10T07:35:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 -- 172.21.15.99:0/3821552620 shutdown_connections 2024-09-10T07:35:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f229806be30 0x7f229806e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22bc160a80 0x7f22bc1f4790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22bc142150 0x7f22bc0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 --2- 172.21.15.99:0/3821552620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22bc13fae0 0x7f22bc13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 -- 172.21.15.99:0/3821552620 >> 172.21.15.99:0/3821552620 conn(0x7f22bc06bc10 msgr2=0x7f22bc15fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 -- 172.21.15.99:0/3821552620 shutdown_connections 2024-09-10T07:35:10.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.121+0000 7f22c1c00640 1 -- 172.21.15.99:0/3821552620 wait complete. 2024-09-10T07:35:10.137 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:35:10.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.291+0000 7ff776200640 1 Processor -- start 2024-09-10T07:35:10.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.291+0000 7ff776200640 1 -- start start 2024-09-10T07:35:10.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.292+0000 7ff776200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff770160c50 0x7ff770167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.292+0000 7ff776200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff770142650 con 0x7ff77013fae0 2024-09-10T07:35:10.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.292+0000 7ff776200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff770142930 con 0x7ff770142150 2024-09-10T07:35:10.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.292+0000 7ff776200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff7700ce780 con 0x7ff770160c50 2024-09-10T07:35:10.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff77013fae0 0x7ff77006f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46814/0 (socket says 172.21.15.99:46814) 2024-09-10T07:35:10.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76f400640 1 -- 172.21.15.99:0/958721343 learned_addr learned my addr 172.21.15.99:0/958721343 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76fe00640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff770160c50 0x7ff770167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185595551 0 0) 0x7ff770142650 con 0x7ff77013fae0 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff754003520 con 0x7ff77013fae0 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563340839 0 0) 0x7ff770142930 con 0x7ff770142150 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff770142650 con 0x7ff770142150 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3355878453 0 0) 0x7ff754003520 con 0x7ff77013fae0 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff770160c50 msgr2=0x7ff770167680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff770160c50 0x7ff770167680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 >> v1:172.21.15.187:6789/0 conn(0x7ff770142150 legacy=0x7ff770160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff770142c10 con 0x7ff77013fae0 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7ff760001670 con 0x7ff77013fae0 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 >> v1:172.21.15.99:6789/0 conn(0x7ff77013fae0 legacy=0x7ff77006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.293+0000 7ff76ea00640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff754003b70 0x7ff754003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76ea00640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff754004800 0x7ff754004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76ea00640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 0x7ff75400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff75400c000 con 0x7ff7540051c0 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff75400c1b0 con 0x7ff754004800 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff75400c3b0 con 0x7ff754003b70 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76fe00640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 0x7ff75400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff766a00640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff754004800 0x7ff754004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76f400640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff754003b70 0x7ff754003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76fe00640 1 -- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff754003b70 msgr2=0x7ff754003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76fe00640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff754003b70 0x7ff754003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76fe00640 1 -- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff754004800 msgr2=0x7ff754004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76fe00640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff754004800 0x7ff754004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.294+0000 7ff76fe00640 1 -- 172.21.15.99:0/958721343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff754003520 con 0x7ff7540051c0 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.295+0000 7ff76fe00640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 0x7ff75400b9c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff7700b39e0 tx=0x7ff754005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb98e3b176b8736d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.295+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768037070 con 0x7ff7540051c0 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.295+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff768032640 con 0x7ff7540051c0 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.295+0000 7ff76ea00640 1 -- 172.21.15.99:0/958721343 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff768009bd0 con 0x7ff7540051c0 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.296+0000 7ff776200640 1 -- 172.21.15.99:0/958721343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 msgr2=0x7ff75400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.296+0000 7ff776200640 1 --2- 172.21.15.99:0/958721343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 0x7ff75400b9c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff7700b39e0 tx=0x7ff754005830 comp rx=0 tx=0).stop 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.296+0000 7ff76fe00640 1 -- 172.21.15.99:0/958721343 reap_dead start 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.296+0000 7ff776200640 1 -- 172.21.15.99:0/958721343 shutdown_connections 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.296+0000 7ff776200640 1 -- 172.21.15.99:0/958721343 >> 172.21.15.99:0/958721343 conn(0x7ff77006bc10 msgr2=0x7ff77006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.296+0000 7ff776200640 1 -- 172.21.15.99:0/958721343 shutdown_connections 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.296+0000 7ff776200640 1 -- 172.21.15.99:0/958721343 wait complete. 2024-09-10T07:35:10.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.298+0000 7ff776200640 1 Processor -- start 2024-09-10T07:35:10.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.298+0000 7ff776200640 1 -- start start 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff776200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 0x7ff77013dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff776200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7700b16f0 0x7ff7700b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff776200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff770145130 0x7ff7701455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff776200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff7700cfda0 con 0x7ff7540051c0 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff776200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff7700cfc20 con 0x7ff770145130 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff776200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff7700cff20 con 0x7ff7700b16f0 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff76f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 0x7ff77013dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff76f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 0x7ff77013dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49396/0 (socket says 172.21.15.99:49396) 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff76f400640 1 -- 172.21.15.99:0/2015821719 learned_addr learned my addr 172.21.15.99:0/2015821719 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff766a00640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7700b16f0 0x7ff7700b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.299+0000 7ff76fe00640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff770145130 0x7ff7701455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff76f400640 1 -- 172.21.15.99:0/2015821719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7700b16f0 msgr2=0x7ff7700b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff76f400640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7700b16f0 0x7ff7700b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff76f400640 1 -- 172.21.15.99:0/2015821719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff770145130 msgr2=0x7ff7701455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff76f400640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff770145130 0x7ff7701455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff76f400640 1 -- 172.21.15.99:0/2015821719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7701f25e0 con 0x7ff7540051c0 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff76fe00640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff770145130 0x7ff7701455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff766a00640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7700b16f0 0x7ff7700b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff76f400640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 0x7ff77013dcf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff760004f70 tx=0x7ff7600074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff767e00640 1 -- 172.21.15.99:0/2015821719 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76000f750 con 0x7ff7540051c0 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff767e00640 1 -- 172.21.15.99:0/2015821719 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff760018070 con 0x7ff7540051c0 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff767e00640 1 -- 172.21.15.99:0/2015821719 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76000fb50 con 0x7ff7540051c0 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff776200640 1 -- 172.21.15.99:0/2015821719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7701f28a0 con 0x7ff7540051c0 2024-09-10T07:35:10.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.300+0000 7ff776200640 1 -- 172.21.15.99:0/2015821719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7701f2e60 con 0x7ff7540051c0 2024-09-10T07:35:10.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.301+0000 7ff776200640 1 -- 172.21.15.99:0/2015821719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7700d04d0 con 0x7ff7540051c0 2024-09-10T07:35:10.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.302+0000 7ff767e00640 1 -- 172.21.15.99:0/2015821719 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff76000fcf0 con 0x7ff7540051c0 2024-09-10T07:35:10.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.303+0000 7ff767e00640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff74c06be60 0x7ff74c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.303+0000 7ff767e00640 1 -- 172.21.15.99:0/2015821719 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff76008ae00 con 0x7ff7540051c0 2024-09-10T07:35:10.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.303+0000 7ff766a00640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff74c06be60 0x7ff74c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.304+0000 7ff766a00640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff74c06be60 0x7ff74c06e320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff7700b2370 tx=0x7ff758009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:10.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.307+0000 7ff767e00640 1 -- 172.21.15.99:0/2015821719 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7700d04d0 con 0x7ff7540051c0 2024-09-10T07:35:10.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.479+0000 7ff776200640 1 -- 172.21.15.99:0/2015821719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff770160540 con 0x7ff7540051c0 2024-09-10T07:35:10.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.481+0000 7ff767e00640 1 -- 172.21.15.99:0/2015821719 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16705 (secure 0 0 0) 0x7ff7600597b0 con 0x7ff7540051c0 2024-09-10T07:35:10.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:10.481 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":31,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:35:07.631326+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:03.811904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:05.040821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:35:10.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 -- 172.21.15.99:0/2015821719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff74c06be60 msgr2=0x7ff74c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff74c06be60 0x7ff74c06e320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff7700b2370 tx=0x7ff758009040 comp rx=0 tx=0).stop 2024-09-10T07:35:10.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 -- 172.21.15.99:0/2015821719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 msgr2=0x7ff77013dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 0x7ff77013dcf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff760004f70 tx=0x7ff7600074f0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 -- 172.21.15.99:0/2015821719 shutdown_connections 2024-09-10T07:35:10.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff770145130 0x7ff7701455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7700b16f0 0x7ff7700b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff74c06be60 0x7ff74c06e320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 --2- 172.21.15.99:0/2015821719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7540051c0 0x7ff77013dcf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 -- 172.21.15.99:0/2015821719 >> 172.21.15.99:0/2015821719 conn(0x7ff77006bc10 msgr2=0x7ff77006f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:10.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 -- 172.21.15.99:0/2015821719 shutdown_connections 2024-09-10T07:35:10.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.483+0000 7ff776200640 1 -- 172.21.15.99:0/2015821719 wait complete. 2024-09-10T07:35:10.502 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:35:10.502 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:35:10.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.662+0000 7fb609a00640 1 Processor -- start 2024-09-10T07:35:10.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.662+0000 7fb609a00640 1 -- start start 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.663+0000 7fb609a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb60415ecc0 0x7fb6040d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.663+0000 7fb609a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb6040d1b60 0x7fb6040b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.663+0000 7fb609a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6040d3b20 con 0x7fb6040d57a0 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.663+0000 7fb609a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb6040b42f0 con 0x7fb6040d1b60 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.663+0000 7fb609a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb6040b45d0 con 0x7fb60415ecc0 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.663+0000 7fb603400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb6040d1b60 0x7fb6040b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.663+0000 7fb603400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb6040d1b60 0x7fb6040b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49410/0 (socket says 172.21.15.99:49410) 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.663+0000 7fb603400640 1 -- 172.21.15.99:0/1014580588 learned_addr learned my addr 172.21.15.99:0/1014580588 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.663+0000 7fb602a00640 1 --2- 172.21.15.99:0/1014580588 >> v2:172.21.15.187:3300/0 conn(0x7fb60415ecc0 0x7fb6040d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.664+0000 7fb603400640 1 -- 172.21.15.99:0/1014580588 >> v2:172.21.15.187:3300/0 conn(0x7fb60415ecc0 msgr2=0x7fb6040d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.664+0000 7fb603400640 1 --2- 172.21.15.99:0/1014580588 >> v2:172.21.15.187:3300/0 conn(0x7fb60415ecc0 0x7fb6040d3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.664+0000 7fb603400640 1 -- 172.21.15.99:0/1014580588 >> v1:172.21.15.187:6789/0 conn(0x7fb6040d57a0 legacy=0x7fb6040d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.664+0000 7fb603400640 1 -- 172.21.15.99:0/1014580588 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6040b48b0 con 0x7fb6040d1b60 2024-09-10T07:35:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.665+0000 7fb603400640 1 --2- 172.21.15.99:0/1014580588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 0x7fb6040b50b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb6040d4b30 tx=0x7fb5fc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c8407c26e4dc6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.665+0000 7fb601600640 1 -- 172.21.15.99:0/1014580588 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc036070 con 0x7fb6040d1b60 2024-09-10T07:35:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.665+0000 7fb601600640 1 -- 172.21.15.99:0/1014580588 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5fc031600 con 0x7fb6040d1b60 2024-09-10T07:35:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.665+0000 7fb601600640 1 -- 172.21.15.99:0/1014580588 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0319d0 con 0x7fb6040d1b60 2024-09-10T07:35:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.666+0000 7fb609a00640 1 -- 172.21.15.99:0/1014580588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 msgr2=0x7fb6040b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.666+0000 7fb609a00640 1 --2- 172.21.15.99:0/1014580588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 0x7fb6040b50b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb6040d4b30 tx=0x7fb5fc02a6a0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.666+0000 7fb609a00640 1 -- 172.21.15.99:0/1014580588 shutdown_connections 2024-09-10T07:35:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.666+0000 7fb609a00640 1 --2- 172.21.15.99:0/1014580588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 0x7fb6040b50b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.666+0000 7fb609a00640 1 --2- 172.21.15.99:0/1014580588 >> v2:172.21.15.187:3300/0 conn(0x7fb60415ecc0 0x7fb6040d3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.666+0000 7fb609a00640 1 -- 172.21.15.99:0/1014580588 >> 172.21.15.99:0/1014580588 conn(0x7fb6040d4bd0 msgr2=0x7fb6040d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.666+0000 7fb609a00640 1 -- 172.21.15.99:0/1014580588 shutdown_connections 2024-09-10T07:35:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.666+0000 7fb609a00640 1 -- 172.21.15.99:0/1014580588 wait complete. 2024-09-10T07:35:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.667+0000 7fb609a00640 1 Processor -- start 2024-09-10T07:35:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.668+0000 7fb609a00640 1 -- start start 2024-09-10T07:35:10.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.668+0000 7fb609a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 0x7fb6041560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.668+0000 7fb609a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6040d57a0 0x7fb6040b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.668+0000 7fb609a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb60415ecc0 0x7fb6041614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.668+0000 7fb609a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb60415f220 con 0x7fb6040d1b60 2024-09-10T07:35:10.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.668+0000 7fb609a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb60415f0a0 con 0x7fb60415ecc0 2024-09-10T07:35:10.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.668+0000 7fb609a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb6040d36b0 con 0x7fb6040d57a0 2024-09-10T07:35:10.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb602a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 0x7fb6041560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb602a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 0x7fb6041560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49426/0 (socket says 172.21.15.99:49426) 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb602a00640 1 -- 172.21.15.99:0/3339196047 learned_addr learned my addr 172.21.15.99:0/3339196047 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb603400640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb60415ecc0 0x7fb6041614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb602000640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6040d57a0 0x7fb6040b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb602a00640 1 -- 172.21.15.99:0/3339196047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6040d57a0 msgr2=0x7fb6040b9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb602a00640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6040d57a0 0x7fb6040b9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb602a00640 1 -- 172.21.15.99:0/3339196047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb60415ecc0 msgr2=0x7fb6041614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb602a00640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb60415ecc0 0x7fb6041614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb602a00640 1 -- 172.21.15.99:0/3339196047 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb604156630 con 0x7fb6040d1b60 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb603400640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb60415ecc0 0x7fb6041614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb602a00640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 0x7fb6041560f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400e870 tx=0x7fb5f400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.669+0000 7fb5faa00640 1 -- 172.21.15.99:0/3339196047 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4017070 con 0x7fb6040d1b60 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.670+0000 7fb5faa00640 1 -- 172.21.15.99:0/3339196047 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f400c940 con 0x7fb6040d1b60 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.670+0000 7fb609a00640 1 -- 172.21.15.99:0/3339196047 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6040b7ba0 con 0x7fb6040d1b60 2024-09-10T07:35:10.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.670+0000 7fb5faa00640 1 -- 172.21.15.99:0/3339196047 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400cd30 con 0x7fb6040d1b60 2024-09-10T07:35:10.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.670+0000 7fb609a00640 1 -- 172.21.15.99:0/3339196047 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6040b8160 con 0x7fb6040d1b60 2024-09-10T07:35:10.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.671+0000 7fb609a00640 1 -- 172.21.15.99:0/3339196047 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6040d3170 con 0x7fb6040d1b60 2024-09-10T07:35:10.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.671+0000 7fb5faa00640 1 -- 172.21.15.99:0/3339196047 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5f401a070 con 0x7fb6040d1b60 2024-09-10T07:35:10.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.672+0000 7fb5faa00640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5e406be30 0x7fb5e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:10.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.672+0000 7fb5faa00640 1 -- 172.21.15.99:0/3339196047 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb5f408ae20 con 0x7fb6040d1b60 2024-09-10T07:35:10.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.672+0000 7fb602000640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5e406be30 0x7fb5e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:10.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.673+0000 7fb602000640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5e406be30 0x7fb5e406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb6041623e0 tx=0x7fb5f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:10.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.676+0000 7fb5faa00640 1 -- 172.21.15.99:0/3339196047 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb604156630 con 0x7fb6040d1b60 2024-09-10T07:35:10.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.846+0000 7fb609a00640 1 -- 172.21.15.99:0/3339196047 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb60408e3c0 con 0x7fb5e406be30 2024-09-10T07:35:10.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.853+0000 7fb5faa00640 1 -- 172.21.15.99:0/3339196047 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247489 (secure 0 0 0) 0x7fb60408e3c0 con 0x7fb5e406be30 2024-09-10T07:35:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:10.858 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:35:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 -- 172.21.15.99:0/3339196047 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5e406be30 msgr2=0x7fb5e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5e406be30 0x7fb5e406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb6041623e0 tx=0x7fb5f0009040 comp rx=0 tx=0).stop 2024-09-10T07:35:10.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 -- 172.21.15.99:0/3339196047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 msgr2=0x7fb6041560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:10.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 0x7fb6041560f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400e870 tx=0x7fb5f400ec70 comp rx=0 tx=0).stop 2024-09-10T07:35:10.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 -- 172.21.15.99:0/3339196047 shutdown_connections 2024-09-10T07:35:10.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb60415ecc0 0x7fb6041614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6040d57a0 0x7fb6040b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5e406be30 0x7fb5e406e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 --2- 172.21.15.99:0/3339196047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6040d1b60 0x7fb6041560f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:10.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 -- 172.21.15.99:0/3339196047 >> 172.21.15.99:0/3339196047 conn(0x7fb6040d4bd0 msgr2=0x7fb6040b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:10.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 -- 172.21.15.99:0/3339196047 shutdown_connections 2024-09-10T07:35:10.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:10.857+0000 7fb609a00640 1 -- 172.21.15.99:0/3339196047 wait complete. 2024-09-10T07:35:10.874 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-10T07:35:10.702636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2179,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560320,"statfs":{"total":1600000000,"available":1597767916,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000938"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980376+0000","last_change":"2024-09-10T07:35:06.646932+0000","last_active":"2024-09-10T07:35:07.980376+0000","last_peered":"2024-09-10T07:35:07.980376+0000","last_clean":"2024-09-10T07:35:07.980376+0000","last_became_active":"2024-09-10T07:35:06.645535+0000","last_became_peered":"2024-09-10T07:35:06.645535+0000","last_unstale":"2024-09-10T07:35:07.980376+0000","last_undegraded":"2024-09-10T07:35:07.980376+0000","last_fullsized":"2024-09-10T07:35:07.980376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:37.442703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669563+0000","last_change":"2024-09-10T07:35:06.654440+0000","last_active":"2024-09-10T07:35:08.669563+0000","last_peered":"2024-09-10T07:35:08.669563+0000","last_clean":"2024-09-10T07:35:08.669563+0000","last_became_active":"2024-09-10T07:35:06.653950+0000","last_became_peered":"2024-09-10T07:35:06.653950+0000","last_unstale":"2024-09-10T07:35:08.669563+0000","last_undegraded":"2024-09-10T07:35:08.669563+0000","last_fullsized":"2024-09-10T07:35:08.669563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:17.863648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.638041+0000","last_change":"2024-09-10T07:35:06.648389+0000","last_active":"2024-09-10T07:35:07.638041+0000","last_peered":"2024-09-10T07:35:07.638041+0000","last_clean":"2024-09-10T07:35:07.638041+0000","last_became_active":"2024-09-10T07:35:06.647894+0000","last_became_peered":"2024-09-10T07:35:06.647894+0000","last_unstale":"2024-09-10T07:35:07.638041+0000","last_undegraded":"2024-09-10T07:35:07.638041+0000","last_fullsized":"2024-09-10T07:35:07.638041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:28.174292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637663+0000","last_change":"2024-09-10T07:35:06.658625+0000","last_active":"2024-09-10T07:35:07.637663+0000","last_peered":"2024-09-10T07:35:07.637663+0000","last_clean":"2024-09-10T07:35:07.637663+0000","last_became_active":"2024-09-10T07:35:06.658295+0000","last_became_peered":"2024-09-10T07:35:06.658295+0000","last_unstale":"2024-09-10T07:35:07.637663+0000","last_undegraded":"2024-09-10T07:35:07.637663+0000","last_fullsized":"2024-09-10T07:35:07.637663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:25.815019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669136+0000","last_change":"2024-09-10T07:35:06.652460+0000","last_active":"2024-09-10T07:35:08.669136+0000","last_peered":"2024-09-10T07:35:08.669136+0000","last_clean":"2024-09-10T07:35:08.669136+0000","last_became_active":"2024-09-10T07:35:06.652235+0000","last_became_peered":"2024-09-10T07:35:06.652235+0000","last_unstale":"2024-09-10T07:35:08.669136+0000","last_undegraded":"2024-09-10T07:35:08.669136+0000","last_fullsized":"2024-09-10T07:35:08.669136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:42.433598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669789+0000","last_change":"2024-09-10T07:35:06.651990+0000","last_active":"2024-09-10T07:35:08.669789+0000","last_peered":"2024-09-10T07:35:08.669789+0000","last_clean":"2024-09-10T07:35:08.669789+0000","last_became_active":"2024-09-10T07:35:06.651415+0000","last_became_peered":"2024-09-10T07:35:06.651415+0000","last_unstale":"2024-09-10T07:35:08.669789+0000","last_undegraded":"2024-09-10T07:35:08.669789+0000","last_fullsized":"2024-09-10T07:35:08.669789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:28.515271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669735+0000","last_change":"2024-09-10T07:35:06.649222+0000","last_active":"2024-09-10T07:35:08.669735+0000","last_peered":"2024-09-10T07:35:08.669735+0000","last_clean":"2024-09-10T07:35:08.669735+0000","last_became_active":"2024-09-10T07:35:06.648967+0000","last_became_peered":"2024-09-10T07:35:06.648967+0000","last_unstale":"2024-09-10T07:35:08.669735+0000","last_undegraded":"2024-09-10T07:35:08.669735+0000","last_fullsized":"2024-09-10T07:35:08.669735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:21.085825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669252+0000","last_change":"2024-09-10T07:35:06.645852+0000","last_active":"2024-09-10T07:35:08.669252+0000","last_peered":"2024-09-10T07:35:08.669252+0000","last_clean":"2024-09-10T07:35:08.669252+0000","last_became_active":"2024-09-10T07:35:06.645320+0000","last_became_peered":"2024-09-10T07:35:06.645320+0000","last_unstale":"2024-09-10T07:35:08.669252+0000","last_undegraded":"2024-09-10T07:35:08.669252+0000","last_fullsized":"2024-09-10T07:35:08.669252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:41.862311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669545+0000","last_change":"2024-09-10T07:35:06.656310+0000","last_active":"2024-09-10T07:35:08.669545+0000","last_peered":"2024-09-10T07:35:08.669545+0000","last_clean":"2024-09-10T07:35:08.669545+0000","last_became_active":"2024-09-10T07:35:06.656035+0000","last_became_peered":"2024-09-10T07:35:06.656035+0000","last_unstale":"2024-09-10T07:35:08.669545+0000","last_undegraded":"2024-09-10T07:35:08.669545+0000","last_fullsized":"2024-09-10T07:35:08.669545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:35.074161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637873+0000","last_change":"2024-09-10T07:35:06.656618+0000","last_active":"2024-09-10T07:35:07.637873+0000","last_peered":"2024-09-10T07:35:07.637873+0000","last_clean":"2024-09-10T07:35:07.637873+0000","last_became_active":"2024-09-10T07:35:06.656071+0000","last_became_peered":"2024-09-10T07:35:06.656071+0000","last_unstale":"2024-09-10T07:35:07.637873+0000","last_undegraded":"2024-09-10T07:35:07.637873+0000","last_fullsized":"2024-09-10T07:35:07.637873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:39.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669581+0000","last_change":"2024-09-10T07:35:06.655158+0000","last_active":"2024-09-10T07:35:08.669581+0000","last_peered":"2024-09-10T07:35:08.669581+0000","last_clean":"2024-09-10T07:35:08.669581+0000","last_became_active":"2024-09-10T07:35:06.654897+0000","last_became_peered":"2024-09-10T07:35:06.654897+0000","last_unstale":"2024-09-10T07:35:08.669581+0000","last_undegraded":"2024-09-10T07:35:08.669581+0000","last_fullsized":"2024-09-10T07:35:08.669581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:14.092853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637646+0000","last_change":"2024-09-10T07:35:06.651638+0000","last_active":"2024-09-10T07:35:07.637646+0000","last_peered":"2024-09-10T07:35:07.637646+0000","last_clean":"2024-09-10T07:35:07.637646+0000","last_became_active":"2024-09-10T07:35:06.651190+0000","last_became_peered":"2024-09-10T07:35:06.651190+0000","last_unstale":"2024-09-10T07:35:07.637646+0000","last_undegraded":"2024-09-10T07:35:07.637646+0000","last_fullsized":"2024-09-10T07:35:07.637646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:38.274667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669057+0000","last_change":"2024-09-10T07:35:06.647090+0000","last_active":"2024-09-10T07:35:08.669057+0000","last_peered":"2024-09-10T07:35:08.669057+0000","last_clean":"2024-09-10T07:35:08.669057+0000","last_became_active":"2024-09-10T07:35:06.646748+0000","last_became_peered":"2024-09-10T07:35:06.646748+0000","last_unstale":"2024-09-10T07:35:08.669057+0000","last_undegraded":"2024-09-10T07:35:08.669057+0000","last_fullsized":"2024-09-10T07:35:08.669057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:52.018827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669469+0000","last_change":"2024-09-10T07:35:06.658417+0000","last_active":"2024-09-10T07:35:08.669469+0000","last_peered":"2024-09-10T07:35:08.669469+0000","last_clean":"2024-09-10T07:35:08.669469+0000","last_became_active":"2024-09-10T07:35:06.657319+0000","last_became_peered":"2024-09-10T07:35:06.657319+0000","last_unstale":"2024-09-10T07:35:08.669469+0000","last_undegraded":"2024-09-10T07:35:08.669469+0000","last_fullsized":"2024-09-10T07:35:08.669469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:21.027976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.638042+0000","last_change":"2024-09-10T07:35:06.648059+0000","last_active":"2024-09-10T07:35:07.638042+0000","last_peered":"2024-09-10T07:35:07.638042+0000","last_clean":"2024-09-10T07:35:07.638042+0000","last_became_active":"2024-09-10T07:35:06.647783+0000","last_became_peered":"2024-09-10T07:35:06.647783+0000","last_unstale":"2024-09-10T07:35:07.638042+0000","last_undegraded":"2024-09-10T07:35:07.638042+0000","last_fullsized":"2024-09-10T07:35:07.638042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:03.066389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669766+0000","last_change":"2024-09-10T07:35:06.654175+0000","last_active":"2024-09-10T07:35:08.669766+0000","last_peered":"2024-09-10T07:35:08.669766+0000","last_clean":"2024-09-10T07:35:08.669766+0000","last_became_active":"2024-09-10T07:35:06.653805+0000","last_became_peered":"2024-09-10T07:35:06.653805+0000","last_unstale":"2024-09-10T07:35:08.669766+0000","last_undegraded":"2024-09-10T07:35:08.669766+0000","last_fullsized":"2024-09-10T07:35:08.669766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:28.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669333+0000","last_change":"2024-09-10T07:35:06.648316+0000","last_active":"2024-09-10T07:35:08.669333+0000","last_peered":"2024-09-10T07:35:08.669333+0000","last_clean":"2024-09-10T07:35:08.669333+0000","last_became_active":"2024-09-10T07:35:06.648079+0000","last_became_peered":"2024-09-10T07:35:06.648079+0000","last_unstale":"2024-09-10T07:35:08.669333+0000","last_undegraded":"2024-09-10T07:35:08.669333+0000","last_fullsized":"2024-09-10T07:35:08.669333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:47.954281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669028+0000","last_change":"2024-09-10T07:35:06.665606+0000","last_active":"2024-09-10T07:35:08.669028+0000","last_peered":"2024-09-10T07:35:08.669028+0000","last_clean":"2024-09-10T07:35:08.669028+0000","last_became_active":"2024-09-10T07:35:06.664916+0000","last_became_peered":"2024-09-10T07:35:06.664916+0000","last_unstale":"2024-09-10T07:35:08.669028+0000","last_undegraded":"2024-09-10T07:35:08.669028+0000","last_fullsized":"2024-09-10T07:35:08.669028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:56.788477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.668912+0000","last_change":"2024-09-10T07:35:06.658829+0000","last_active":"2024-09-10T07:35:08.668912+0000","last_peered":"2024-09-10T07:35:08.668912+0000","last_clean":"2024-09-10T07:35:08.668912+0000","last_became_active":"2024-09-10T07:35:06.658167+0000","last_became_peered":"2024-09-10T07:35:06.658167+0000","last_unstale":"2024-09-10T07:35:08.668912+0000","last_undegraded":"2024-09-10T07:35:08.668912+0000","last_fullsized":"2024-09-10T07:35:08.668912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:25.844301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669312+0000","last_change":"2024-09-10T07:35:06.649067+0000","last_active":"2024-09-10T07:35:08.669312+0000","last_peered":"2024-09-10T07:35:08.669312+0000","last_clean":"2024-09-10T07:35:08.669312+0000","last_became_active":"2024-09-10T07:35:06.645798+0000","last_became_peered":"2024-09-10T07:35:06.645798+0000","last_unstale":"2024-09-10T07:35:08.669312+0000","last_undegraded":"2024-09-10T07:35:08.669312+0000","last_fullsized":"2024-09-10T07:35:08.669312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:23.687009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670029+0000","last_change":"2024-09-10T07:35:06.638588+0000","last_active":"2024-09-10T07:35:08.670029+0000","last_peered":"2024-09-10T07:35:08.670029+0000","last_clean":"2024-09-10T07:35:08.670029+0000","last_became_active":"2024-09-10T07:35:06.638357+0000","last_became_peered":"2024-09-10T07:35:06.638357+0000","last_unstale":"2024-09-10T07:35:08.670029+0000","last_undegraded":"2024-09-10T07:35:08.670029+0000","last_fullsized":"2024-09-10T07:35:08.670029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:10.773806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670370+0000","last_change":"2024-09-10T07:35:06.649651+0000","last_active":"2024-09-10T07:35:08.670370+0000","last_peered":"2024-09-10T07:35:08.670370+0000","last_clean":"2024-09-10T07:35:08.670370+0000","last_became_active":"2024-09-10T07:35:06.649379+0000","last_became_peered":"2024-09-10T07:35:06.649379+0000","last_unstale":"2024-09-10T07:35:08.670370+0000","last_undegraded":"2024-09-10T07:35:08.670370+0000","last_fullsized":"2024-09-10T07:35:08.670370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:54.319691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634299+0000","last_change":"2024-09-10T07:35:06.648743+0000","last_active":"2024-09-10T07:35:07.634299+0000","last_peered":"2024-09-10T07:35:07.634299+0000","last_clean":"2024-09-10T07:35:07.634299+0000","last_became_active":"2024-09-10T07:35:06.644920+0000","last_became_peered":"2024-09-10T07:35:06.644920+0000","last_unstale":"2024-09-10T07:35:07.634299+0000","last_undegraded":"2024-09-10T07:35:07.634299+0000","last_fullsized":"2024-09-10T07:35:07.634299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:34.510609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637565+0000","last_change":"2024-09-10T07:35:06.644632+0000","last_active":"2024-09-10T07:35:07.637565+0000","last_peered":"2024-09-10T07:35:07.637565+0000","last_clean":"2024-09-10T07:35:07.637565+0000","last_became_active":"2024-09-10T07:35:06.642042+0000","last_became_peered":"2024-09-10T07:35:06.642042+0000","last_unstale":"2024-09-10T07:35:07.637565+0000","last_undegraded":"2024-09-10T07:35:07.637565+0000","last_fullsized":"2024-09-10T07:35:07.637565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:46.201952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637535+0000","last_change":"2024-09-10T07:35:06.652173+0000","last_active":"2024-09-10T07:35:07.637535+0000","last_peered":"2024-09-10T07:35:07.637535+0000","last_clean":"2024-09-10T07:35:07.637535+0000","last_became_active":"2024-09-10T07:35:06.647731+0000","last_became_peered":"2024-09-10T07:35:06.647731+0000","last_unstale":"2024-09-10T07:35:07.637535+0000","last_undegraded":"2024-09-10T07:35:07.637535+0000","last_fullsized":"2024-09-10T07:35:07.637535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:25.115773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669979+0000","last_change":"2024-09-10T07:35:06.652183+0000","last_active":"2024-09-10T07:35:08.669979+0000","last_peered":"2024-09-10T07:35:08.669979+0000","last_clean":"2024-09-10T07:35:08.669979+0000","last_became_active":"2024-09-10T07:35:06.651712+0000","last_became_peered":"2024-09-10T07:35:06.651712+0000","last_unstale":"2024-09-10T07:35:08.669979+0000","last_undegraded":"2024-09-10T07:35:08.669979+0000","last_fullsized":"2024-09-10T07:35:08.669979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:08.579053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637795+0000","last_change":"2024-09-10T07:35:06.657233+0000","last_active":"2024-09-10T07:35:07.637795+0000","last_peered":"2024-09-10T07:35:07.637795+0000","last_clean":"2024-09-10T07:35:07.637795+0000","last_became_active":"2024-09-10T07:35:06.656986+0000","last_became_peered":"2024-09-10T07:35:06.656986+0000","last_unstale":"2024-09-10T07:35:07.637795+0000","last_undegraded":"2024-09-10T07:35:07.637795+0000","last_fullsized":"2024-09-10T07:35:07.637795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:48.808802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637626+0000","last_change":"2024-09-10T07:35:06.639239+0000","last_active":"2024-09-10T07:35:07.637626+0000","last_peered":"2024-09-10T07:35:07.637626+0000","last_clean":"2024-09-10T07:35:07.637626+0000","last_became_active":"2024-09-10T07:35:06.638984+0000","last_became_peered":"2024-09-10T07:35:06.638984+0000","last_unstale":"2024-09-10T07:35:07.637626+0000","last_undegraded":"2024-09-10T07:35:07.637626+0000","last_fullsized":"2024-09-10T07:35:07.637626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:32.398022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669704+0000","last_change":"2024-09-10T07:35:06.649635+0000","last_active":"2024-09-10T07:35:08.669704+0000","last_peered":"2024-09-10T07:35:08.669704+0000","last_clean":"2024-09-10T07:35:08.669704+0000","last_became_active":"2024-09-10T07:35:06.649395+0000","last_became_peered":"2024-09-10T07:35:06.649395+0000","last_unstale":"2024-09-10T07:35:08.669704+0000","last_undegraded":"2024-09-10T07:35:08.669704+0000","last_fullsized":"2024-09-10T07:35:08.669704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:44.737754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669736+0000","last_change":"2024-09-10T07:35:06.646899+0000","last_active":"2024-09-10T07:35:08.669736+0000","last_peered":"2024-09-10T07:35:08.669736+0000","last_clean":"2024-09-10T07:35:08.669736+0000","last_became_active":"2024-09-10T07:35:06.646660+0000","last_became_peered":"2024-09-10T07:35:06.646660+0000","last_unstale":"2024-09-10T07:35:08.669736+0000","last_undegraded":"2024-09-10T07:35:08.669736+0000","last_fullsized":"2024-09-10T07:35:08.669736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:34.862891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980485+0000","last_change":"2024-09-10T07:35:06.643021+0000","last_active":"2024-09-10T07:35:07.980485+0000","last_peered":"2024-09-10T07:35:07.980485+0000","last_clean":"2024-09-10T07:35:07.980485+0000","last_became_active":"2024-09-10T07:35:06.642733+0000","last_became_peered":"2024-09-10T07:35:06.642733+0000","last_unstale":"2024-09-10T07:35:07.980485+0000","last_undegraded":"2024-09-10T07:35:07.980485+0000","last_fullsized":"2024-09-10T07:35:07.980485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:43.749126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669540+0000","last_change":"2024-09-10T07:35:06.643966+0000","last_active":"2024-09-10T07:35:08.669540+0000","last_peered":"2024-09-10T07:35:08.669540+0000","last_clean":"2024-09-10T07:35:08.669540+0000","last_became_active":"2024-09-10T07:35:06.643718+0000","last_became_peered":"2024-09-10T07:35:06.643718+0000","last_unstale":"2024-09-10T07:35:08.669540+0000","last_undegraded":"2024-09-10T07:35:08.669540+0000","last_fullsized":"2024-09-10T07:35:08.669540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:45.937056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634448+0000","last_change":"2024-09-10T07:35:06.642512+0000","last_active":"2024-09-10T07:35:07.634448+0000","last_peered":"2024-09-10T07:35:07.634448+0000","last_clean":"2024-09-10T07:35:07.634448+0000","last_became_active":"2024-09-10T07:35:06.642287+0000","last_became_peered":"2024-09-10T07:35:06.642287+0000","last_unstale":"2024-09-10T07:35:07.634448+0000","last_undegraded":"2024-09-10T07:35:07.634448+0000","last_fullsized":"2024-09-10T07:35:07.634448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:27.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980268+0000","last_change":"2024-09-10T07:35:05.639247+0000","last_active":"2024-09-10T07:35:07.980268+0000","last_peered":"2024-09-10T07:35:07.980268+0000","last_clean":"2024-09-10T07:35:07.980268+0000","last_became_active":"2024-09-10T07:35:05.639018+0000","last_became_peered":"2024-09-10T07:35:05.639018+0000","last_unstale":"2024-09-10T07:35:07.980268+0000","last_undegraded":"2024-09-10T07:35:07.980268+0000","last_fullsized":"2024-09-10T07:35:07.980268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:21.204549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980129+0000","last_change":"2024-09-10T07:35:06.643972+0000","last_active":"2024-09-10T07:35:07.980129+0000","last_peered":"2024-09-10T07:35:07.980129+0000","last_clean":"2024-09-10T07:35:07.980129+0000","last_became_active":"2024-09-10T07:35:06.643736+0000","last_became_peered":"2024-09-10T07:35:06.643736+0000","last_unstale":"2024-09-10T07:35:07.980129+0000","last_undegraded":"2024-09-10T07:35:07.980129+0000","last_fullsized":"2024-09-10T07:35:07.980129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:59.076477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634317+0000","last_change":"2024-09-10T07:35:05.645699+0000","last_active":"2024-09-10T07:35:07.634317+0000","last_peered":"2024-09-10T07:35:07.634317+0000","last_clean":"2024-09-10T07:35:07.634317+0000","last_became_active":"2024-09-10T07:35:05.645487+0000","last_became_peered":"2024-09-10T07:35:05.645487+0000","last_unstale":"2024-09-10T07:35:07.634317+0000","last_undegraded":"2024-09-10T07:35:07.634317+0000","last_fullsized":"2024-09-10T07:35:07.634317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:15.967903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670198+0000","last_change":"2024-09-10T07:35:06.651804+0000","last_active":"2024-09-10T07:35:08.670198+0000","last_peered":"2024-09-10T07:35:08.670198+0000","last_clean":"2024-09-10T07:35:08.670198+0000","last_became_active":"2024-09-10T07:35:06.651539+0000","last_became_peered":"2024-09-10T07:35:06.651539+0000","last_unstale":"2024-09-10T07:35:08.670198+0000","last_undegraded":"2024-09-10T07:35:08.670198+0000","last_fullsized":"2024-09-10T07:35:08.670198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:10.970635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670016+0000","last_change":"2024-09-10T07:35:05.648163+0000","last_active":"2024-09-10T07:35:08.670016+0000","last_peered":"2024-09-10T07:35:08.670016+0000","last_clean":"2024-09-10T07:35:08.670016+0000","last_became_active":"2024-09-10T07:35:05.647926+0000","last_became_peered":"2024-09-10T07:35:05.647926+0000","last_unstale":"2024-09-10T07:35:08.670016+0000","last_undegraded":"2024-09-10T07:35:08.670016+0000","last_fullsized":"2024-09-10T07:35:08.670016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:40.153459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637681+0000","last_change":"2024-09-10T07:35:06.656364+0000","last_active":"2024-09-10T07:35:07.637681+0000","last_peered":"2024-09-10T07:35:07.637681+0000","last_clean":"2024-09-10T07:35:07.637681+0000","last_became_active":"2024-09-10T07:35:06.648347+0000","last_became_peered":"2024-09-10T07:35:06.648347+0000","last_unstale":"2024-09-10T07:35:07.637681+0000","last_undegraded":"2024-09-10T07:35:07.637681+0000","last_fullsized":"2024-09-10T07:35:07.637681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:02.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669341+0000","last_change":"2024-09-10T07:35:05.640140+0000","last_active":"2024-09-10T07:35:08.669341+0000","last_peered":"2024-09-10T07:35:08.669341+0000","last_clean":"2024-09-10T07:35:08.669341+0000","last_became_active":"2024-09-10T07:35:05.639771+0000","last_became_peered":"2024-09-10T07:35:05.639771+0000","last_unstale":"2024-09-10T07:35:08.669341+0000","last_undegraded":"2024-09-10T07:35:08.669341+0000","last_fullsized":"2024-09-10T07:35:08.669341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:31.173325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669536+0000","last_change":"2024-09-10T07:35:06.645007+0000","last_active":"2024-09-10T07:35:08.669536+0000","last_peered":"2024-09-10T07:35:08.669536+0000","last_clean":"2024-09-10T07:35:08.669536+0000","last_became_active":"2024-09-10T07:35:06.643982+0000","last_became_peered":"2024-09-10T07:35:06.643982+0000","last_unstale":"2024-09-10T07:35:08.669536+0000","last_undegraded":"2024-09-10T07:35:08.669536+0000","last_fullsized":"2024-09-10T07:35:08.669536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:16.056312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670184+0000","last_change":"2024-09-10T07:35:05.644162+0000","last_active":"2024-09-10T07:35:08.670184+0000","last_peered":"2024-09-10T07:35:08.670184+0000","last_clean":"2024-09-10T07:35:08.670184+0000","last_became_active":"2024-09-10T07:35:05.643877+0000","last_became_peered":"2024-09-10T07:35:05.643877+0000","last_unstale":"2024-09-10T07:35:08.670184+0000","last_undegraded":"2024-09-10T07:35:08.670184+0000","last_fullsized":"2024-09-10T07:35:08.670184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:56.762144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637842+0000","last_change":"2024-09-10T07:35:06.638314+0000","last_active":"2024-09-10T07:35:07.637842+0000","last_peered":"2024-09-10T07:35:07.637842+0000","last_clean":"2024-09-10T07:35:07.637842+0000","last_became_active":"2024-09-10T07:35:06.638048+0000","last_became_peered":"2024-09-10T07:35:06.638048+0000","last_unstale":"2024-09-10T07:35:07.637842+0000","last_undegraded":"2024-09-10T07:35:07.637842+0000","last_fullsized":"2024-09-10T07:35:07.637842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:04.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669584+0000","last_change":"2024-09-10T07:35:05.643043+0000","last_active":"2024-09-10T07:35:08.669584+0000","last_peered":"2024-09-10T07:35:08.669584+0000","last_clean":"2024-09-10T07:35:08.669584+0000","last_became_active":"2024-09-10T07:35:05.642718+0000","last_became_peered":"2024-09-10T07:35:05.642718+0000","last_unstale":"2024-09-10T07:35:08.669584+0000","last_undegraded":"2024-09-10T07:35:08.669584+0000","last_fullsized":"2024-09-10T07:35:08.669584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:04.121323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669891+0000","last_change":"2024-09-10T07:35:06.648013+0000","last_active":"2024-09-10T07:35:08.669891+0000","last_peered":"2024-09-10T07:35:08.669891+0000","last_clean":"2024-09-10T07:35:08.669891+0000","last_became_active":"2024-09-10T07:35:06.647763+0000","last_became_peered":"2024-09-10T07:35:06.647763+0000","last_unstale":"2024-09-10T07:35:08.669891+0000","last_undegraded":"2024-09-10T07:35:08.669891+0000","last_fullsized":"2024-09-10T07:35:08.669891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:22.543341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669666+0000","last_change":"2024-09-10T07:35:05.643641+0000","last_active":"2024-09-10T07:35:08.669666+0000","last_peered":"2024-09-10T07:35:08.669666+0000","last_clean":"2024-09-10T07:35:08.669666+0000","last_became_active":"2024-09-10T07:35:05.643273+0000","last_became_peered":"2024-09-10T07:35:05.643273+0000","last_unstale":"2024-09-10T07:35:08.669666+0000","last_undegraded":"2024-09-10T07:35:08.669666+0000","last_fullsized":"2024-09-10T07:35:08.669666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:45:31.279242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637813+0000","last_change":"2024-09-10T07:35:06.655651+0000","last_active":"2024-09-10T07:35:07.637813+0000","last_peered":"2024-09-10T07:35:07.637813+0000","last_clean":"2024-09-10T07:35:07.637813+0000","last_became_active":"2024-09-10T07:35:06.655412+0000","last_became_peered":"2024-09-10T07:35:06.655412+0000","last_unstale":"2024-09-10T07:35:07.637813+0000","last_undegraded":"2024-09-10T07:35:07.637813+0000","last_fullsized":"2024-09-10T07:35:07.637813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:26.828103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670249+0000","last_change":"2024-09-10T07:35:05.642886+0000","last_active":"2024-09-10T07:35:08.670249+0000","last_peered":"2024-09-10T07:35:08.670249+0000","last_clean":"2024-09-10T07:35:08.670249+0000","last_became_active":"2024-09-10T07:35:05.641793+0000","last_became_peered":"2024-09-10T07:35:05.641793+0000","last_unstale":"2024-09-10T07:35:08.670249+0000","last_undegraded":"2024-09-10T07:35:08.670249+0000","last_fullsized":"2024-09-10T07:35:08.670249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:13.286457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.638017+0000","last_change":"2024-09-10T07:35:06.651431+0000","last_active":"2024-09-10T07:35:07.638017+0000","last_peered":"2024-09-10T07:35:07.638017+0000","last_clean":"2024-09-10T07:35:07.638017+0000","last_became_active":"2024-09-10T07:35:06.650783+0000","last_became_peered":"2024-09-10T07:35:06.650783+0000","last_unstale":"2024-09-10T07:35:07.638017+0000","last_undegraded":"2024-09-10T07:35:07.638017+0000","last_fullsized":"2024-09-10T07:35:07.638017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:15.608665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670236+0000","last_change":"2024-09-10T07:35:05.644921+0000","last_active":"2024-09-10T07:35:08.670236+0000","last_peered":"2024-09-10T07:35:08.670236+0000","last_clean":"2024-09-10T07:35:08.670236+0000","last_became_active":"2024-09-10T07:35:05.644694+0000","last_became_peered":"2024-09-10T07:35:05.644694+0000","last_unstale":"2024-09-10T07:35:08.670236+0000","last_undegraded":"2024-09-10T07:35:08.670236+0000","last_fullsized":"2024-09-10T07:35:08.670236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:52.648807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670133+0000","last_change":"2024-09-10T07:35:06.664703+0000","last_active":"2024-09-10T07:35:08.670133+0000","last_peered":"2024-09-10T07:35:08.670133+0000","last_clean":"2024-09-10T07:35:08.670133+0000","last_became_active":"2024-09-10T07:35:06.664422+0000","last_became_peered":"2024-09-10T07:35:06.664422+0000","last_unstale":"2024-09-10T07:35:08.670133+0000","last_undegraded":"2024-09-10T07:35:08.670133+0000","last_fullsized":"2024-09-10T07:35:08.670133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:42.888258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634406+0000","last_change":"2024-09-10T07:35:05.644533+0000","last_active":"2024-09-10T07:35:07.634406+0000","last_peered":"2024-09-10T07:35:07.634406+0000","last_clean":"2024-09-10T07:35:07.634406+0000","last_became_active":"2024-09-10T07:35:05.644310+0000","last_became_peered":"2024-09-10T07:35:05.644310+0000","last_unstale":"2024-09-10T07:35:07.634406+0000","last_undegraded":"2024-09-10T07:35:07.634406+0000","last_fullsized":"2024-09-10T07:35:07.634406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:29.282788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669978+0000","last_change":"2024-09-10T07:35:06.648934+0000","last_active":"2024-09-10T07:35:08.669978+0000","last_peered":"2024-09-10T07:35:08.669978+0000","last_clean":"2024-09-10T07:35:08.669978+0000","last_became_active":"2024-09-10T07:35:06.648724+0000","last_became_peered":"2024-09-10T07:35:06.648724+0000","last_unstale":"2024-09-10T07:35:08.669978+0000","last_undegraded":"2024-09-10T07:35:08.669978+0000","last_fullsized":"2024-09-10T07:35:08.669978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:12.387276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.638129+0000","last_change":"2024-09-10T07:35:05.644710+0000","last_active":"2024-09-10T07:35:07.638129+0000","last_peered":"2024-09-10T07:35:07.638129+0000","last_clean":"2024-09-10T07:35:07.638129+0000","last_became_active":"2024-09-10T07:35:05.644479+0000","last_became_peered":"2024-09-10T07:35:05.644479+0000","last_unstale":"2024-09-10T07:35:07.638129+0000","last_undegraded":"2024-09-10T07:35:07.638129+0000","last_fullsized":"2024-09-10T07:35:07.638129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:43.136836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637881+0000","last_change":"2024-09-10T07:35:06.648168+0000","last_active":"2024-09-10T07:35:07.637881+0000","last_peered":"2024-09-10T07:35:07.637881+0000","last_clean":"2024-09-10T07:35:07.637881+0000","last_became_active":"2024-09-10T07:35:06.647473+0000","last_became_peered":"2024-09-10T07:35:06.647473+0000","last_unstale":"2024-09-10T07:35:07.637881+0000","last_undegraded":"2024-09-10T07:35:07.637881+0000","last_fullsized":"2024-09-10T07:35:07.637881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:26.742871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669800+0000","last_change":"2024-09-10T07:35:05.648380+0000","last_active":"2024-09-10T07:35:08.669800+0000","last_peered":"2024-09-10T07:35:08.669800+0000","last_clean":"2024-09-10T07:35:08.669800+0000","last_became_active":"2024-09-10T07:35:05.648033+0000","last_became_peered":"2024-09-10T07:35:05.648033+0000","last_unstale":"2024-09-10T07:35:08.669800+0000","last_undegraded":"2024-09-10T07:35:08.669800+0000","last_fullsized":"2024-09-10T07:35:08.669800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:29.700582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637540+0000","last_change":"2024-09-10T07:35:06.654470+0000","last_active":"2024-09-10T07:35:07.637540+0000","last_peered":"2024-09-10T07:35:07.637540+0000","last_clean":"2024-09-10T07:35:07.637540+0000","last_became_active":"2024-09-10T07:35:06.653958+0000","last_became_peered":"2024-09-10T07:35:06.653958+0000","last_unstale":"2024-09-10T07:35:07.637540+0000","last_undegraded":"2024-09-10T07:35:07.637540+0000","last_fullsized":"2024-09-10T07:35:07.637540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:09.622125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670354+0000","last_change":"2024-09-10T07:35:05.643070+0000","last_active":"2024-09-10T07:35:08.670354+0000","last_peered":"2024-09-10T07:35:08.670354+0000","last_clean":"2024-09-10T07:35:08.670354+0000","last_became_active":"2024-09-10T07:35:05.642167+0000","last_became_peered":"2024-09-10T07:35:05.642167+0000","last_unstale":"2024-09-10T07:35:08.670354+0000","last_undegraded":"2024-09-10T07:35:08.670354+0000","last_fullsized":"2024-09-10T07:35:08.670354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:23.682444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669809+0000","last_change":"2024-09-10T07:35:06.654610+0000","last_active":"2024-09-10T07:35:08.669809+0000","last_peered":"2024-09-10T07:35:08.669809+0000","last_clean":"2024-09-10T07:35:08.669809+0000","last_became_active":"2024-09-10T07:35:06.654313+0000","last_became_peered":"2024-09-10T07:35:06.654313+0000","last_unstale":"2024-09-10T07:35:08.669809+0000","last_undegraded":"2024-09-10T07:35:08.669809+0000","last_fullsized":"2024-09-10T07:35:08.669809+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:54.966900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637793+0000","last_change":"2024-09-10T07:35:05.641127+0000","last_active":"2024-09-10T07:35:07.637793+0000","last_peered":"2024-09-10T07:35:07.637793+0000","last_clean":"2024-09-10T07:35:07.637793+0000","last_became_active":"2024-09-10T07:35:05.640798+0000","last_became_peered":"2024-09-10T07:35:05.640798+0000","last_unstale":"2024-09-10T07:35:07.637793+0000","last_undegraded":"2024-09-10T07:35:07.637793+0000","last_fullsized":"2024-09-10T07:35:07.637793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:01.567448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669726+0000","last_change":"2024-09-10T07:35:06.645580+0000","last_active":"2024-09-10T07:35:08.669726+0000","last_peered":"2024-09-10T07:35:08.669726+0000","last_clean":"2024-09-10T07:35:08.669726+0000","last_became_active":"2024-09-10T07:35:06.644538+0000","last_became_peered":"2024-09-10T07:35:06.644538+0000","last_unstale":"2024-09-10T07:35:08.669726+0000","last_undegraded":"2024-09-10T07:35:08.669726+0000","last_fullsized":"2024-09-10T07:35:08.669726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:15.573028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670123+0000","last_change":"2024-09-10T07:35:05.644927+0000","last_active":"2024-09-10T07:35:08.670123+0000","last_peered":"2024-09-10T07:35:08.670123+0000","last_clean":"2024-09-10T07:35:08.670123+0000","last_became_active":"2024-09-10T07:35:05.644663+0000","last_became_peered":"2024-09-10T07:35:05.644663+0000","last_unstale":"2024-09-10T07:35:08.670123+0000","last_undegraded":"2024-09-10T07:35:08.670123+0000","last_fullsized":"2024-09-10T07:35:08.670123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:33.254262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980404+0000","last_change":"2024-09-10T07:35:06.644003+0000","last_active":"2024-09-10T07:35:07.980404+0000","last_peered":"2024-09-10T07:35:07.980404+0000","last_clean":"2024-09-10T07:35:07.980404+0000","last_became_active":"2024-09-10T07:35:06.643751+0000","last_became_peered":"2024-09-10T07:35:06.643751+0000","last_unstale":"2024-09-10T07:35:07.980404+0000","last_undegraded":"2024-09-10T07:35:07.980404+0000","last_fullsized":"2024-09-10T07:35:07.980404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:20.398059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669350+0000","last_change":"2024-09-10T07:35:05.646559+0000","last_active":"2024-09-10T07:35:08.669350+0000","last_peered":"2024-09-10T07:35:08.669350+0000","last_clean":"2024-09-10T07:35:08.669350+0000","last_became_active":"2024-09-10T07:35:05.646171+0000","last_became_peered":"2024-09-10T07:35:05.646171+0000","last_unstale":"2024-09-10T07:35:08.669350+0000","last_undegraded":"2024-09-10T07:35:08.669350+0000","last_fullsized":"2024-09-10T07:35:08.669350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:51.687386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670117+0000","last_change":"2024-09-10T07:35:06.637706+0000","last_active":"2024-09-10T07:35:08.670117+0000","last_peered":"2024-09-10T07:35:08.670117+0000","last_clean":"2024-09-10T07:35:08.670117+0000","last_became_active":"2024-09-10T07:35:06.637424+0000","last_became_peered":"2024-09-10T07:35:06.637424+0000","last_unstale":"2024-09-10T07:35:08.670117+0000","last_undegraded":"2024-09-10T07:35:08.670117+0000","last_fullsized":"2024-09-10T07:35:08.670117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:32.601864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637941+0000","last_change":"2024-09-10T07:35:05.645610+0000","last_active":"2024-09-10T07:35:07.637941+0000","last_peered":"2024-09-10T07:35:07.637941+0000","last_clean":"2024-09-10T07:35:07.637941+0000","last_became_active":"2024-09-10T07:35:05.645368+0000","last_became_peered":"2024-09-10T07:35:05.645368+0000","last_unstale":"2024-09-10T07:35:07.637941+0000","last_undegraded":"2024-09-10T07:35:07.637941+0000","last_fullsized":"2024-09-10T07:35:07.637941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:39.034392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637775+0000","last_change":"2024-09-10T07:35:06.637604+0000","last_active":"2024-09-10T07:35:07.637775+0000","last_peered":"2024-09-10T07:35:07.637775+0000","last_clean":"2024-09-10T07:35:07.637775+0000","last_became_active":"2024-09-10T07:35:06.637253+0000","last_became_peered":"2024-09-10T07:35:06.637253+0000","last_unstale":"2024-09-10T07:35:07.637775+0000","last_undegraded":"2024-09-10T07:35:07.637775+0000","last_fullsized":"2024-09-10T07:35:07.637775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:47.200876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670463+0000","last_change":"2024-09-10T07:35:05.643244+0000","last_active":"2024-09-10T07:35:08.670463+0000","last_peered":"2024-09-10T07:35:08.670463+0000","last_clean":"2024-09-10T07:35:08.670463+0000","last_became_active":"2024-09-10T07:35:05.642504+0000","last_became_peered":"2024-09-10T07:35:05.642504+0000","last_unstale":"2024-09-10T07:35:08.670463+0000","last_undegraded":"2024-09-10T07:35:08.670463+0000","last_fullsized":"2024-09-10T07:35:08.670463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:02.872357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637524+0000","last_change":"2024-09-10T07:35:06.659797+0000","last_active":"2024-09-10T07:35:07.637524+0000","last_peered":"2024-09-10T07:35:07.637524+0000","last_clean":"2024-09-10T07:35:07.637524+0000","last_became_active":"2024-09-10T07:35:06.659341+0000","last_became_peered":"2024-09-10T07:35:06.659341+0000","last_unstale":"2024-09-10T07:35:07.637524+0000","last_undegraded":"2024-09-10T07:35:07.637524+0000","last_fullsized":"2024-09-10T07:35:07.637524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:29.555342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670325+0000","last_change":"2024-09-10T07:35:05.641308+0000","last_active":"2024-09-10T07:35:08.670325+0000","last_peered":"2024-09-10T07:35:08.670325+0000","last_clean":"2024-09-10T07:35:08.670325+0000","last_became_active":"2024-09-10T07:35:05.639327+0000","last_became_peered":"2024-09-10T07:35:05.639327+0000","last_unstale":"2024-09-10T07:35:08.670325+0000","last_undegraded":"2024-09-10T07:35:08.670325+0000","last_fullsized":"2024-09-10T07:35:08.670325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:47:14.164283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669069+0000","last_change":"2024-09-10T07:35:06.650570+0000","last_active":"2024-09-10T07:35:08.669069+0000","last_peered":"2024-09-10T07:35:08.669069+0000","last_clean":"2024-09-10T07:35:08.669069+0000","last_became_active":"2024-09-10T07:35:06.650291+0000","last_became_peered":"2024-09-10T07:35:06.650291+0000","last_unstale":"2024-09-10T07:35:08.669069+0000","last_undegraded":"2024-09-10T07:35:08.669069+0000","last_fullsized":"2024-09-10T07:35:08.669069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:29.180286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670475+0000","last_change":"2024-09-10T07:35:05.644709+0000","last_active":"2024-09-10T07:35:08.670475+0000","last_peered":"2024-09-10T07:35:08.670475+0000","last_clean":"2024-09-10T07:35:08.670475+0000","last_became_active":"2024-09-10T07:35:05.644473+0000","last_became_peered":"2024-09-10T07:35:05.644473+0000","last_unstale":"2024-09-10T07:35:08.670475+0000","last_undegraded":"2024-09-10T07:35:08.670475+0000","last_fullsized":"2024-09-10T07:35:08.670475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:27.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.668871+0000","last_change":"2024-09-10T07:35:06.643491+0000","last_active":"2024-09-10T07:35:08.668871+0000","last_peered":"2024-09-10T07:35:08.668871+0000","last_clean":"2024-09-10T07:35:08.668871+0000","last_became_active":"2024-09-10T07:35:06.643206+0000","last_became_peered":"2024-09-10T07:35:06.643206+0000","last_unstale":"2024-09-10T07:35:08.668871+0000","last_undegraded":"2024-09-10T07:35:08.668871+0000","last_fullsized":"2024-09-10T07:35:08.668871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:51.985196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634405+0000","last_change":"2024-09-10T07:35:05.648402+0000","last_active":"2024-09-10T07:35:07.634405+0000","last_peered":"2024-09-10T07:35:07.634405+0000","last_clean":"2024-09-10T07:35:07.634405+0000","last_became_active":"2024-09-10T07:35:05.647908+0000","last_became_peered":"2024-09-10T07:35:05.647908+0000","last_unstale":"2024-09-10T07:35:07.634405+0000","last_undegraded":"2024-09-10T07:35:07.634405+0000","last_fullsized":"2024-09-10T07:35:07.634405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:12.984798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669260+0000","last_change":"2024-09-10T07:35:06.657414+0000","last_active":"2024-09-10T07:35:08.669260+0000","last_peered":"2024-09-10T07:35:08.669260+0000","last_clean":"2024-09-10T07:35:08.669260+0000","last_became_active":"2024-09-10T07:35:06.657182+0000","last_became_peered":"2024-09-10T07:35:06.657182+0000","last_unstale":"2024-09-10T07:35:08.669260+0000","last_undegraded":"2024-09-10T07:35:08.669260+0000","last_fullsized":"2024-09-10T07:35:08.669260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:13.152397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980080+0000","last_change":"2024-09-10T07:35:05.645621+0000","last_active":"2024-09-10T07:35:07.980080+0000","last_peered":"2024-09-10T07:35:07.980080+0000","last_clean":"2024-09-10T07:35:07.980080+0000","last_became_active":"2024-09-10T07:35:05.645338+0000","last_became_peered":"2024-09-10T07:35:05.645338+0000","last_unstale":"2024-09-10T07:35:07.980080+0000","last_undegraded":"2024-09-10T07:35:07.980080+0000","last_fullsized":"2024-09-10T07:35:07.980080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:04.640253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669228+0000","last_change":"2024-09-10T07:35:06.658492+0000","last_active":"2024-09-10T07:35:08.669228+0000","last_peered":"2024-09-10T07:35:08.669228+0000","last_clean":"2024-09-10T07:35:08.669228+0000","last_became_active":"2024-09-10T07:35:06.653347+0000","last_became_peered":"2024-09-10T07:35:06.653347+0000","last_unstale":"2024-09-10T07:35:08.669228+0000","last_undegraded":"2024-09-10T07:35:08.669228+0000","last_fullsized":"2024-09-10T07:35:08.669228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:11.463830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670560+0000","last_change":"2024-09-10T07:35:05.647828+0000","last_active":"2024-09-10T07:35:08.670560+0000","last_peered":"2024-09-10T07:35:08.670560+0000","last_clean":"2024-09-10T07:35:08.670560+0000","last_became_active":"2024-09-10T07:35:05.647650+0000","last_became_peered":"2024-09-10T07:35:05.647650+0000","last_unstale":"2024-09-10T07:35:08.670560+0000","last_undegraded":"2024-09-10T07:35:08.670560+0000","last_fullsized":"2024-09-10T07:35:08.670560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:31.460218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669871+0000","last_change":"2024-09-10T07:35:06.648543+0000","last_active":"2024-09-10T07:35:08.669871+0000","last_peered":"2024-09-10T07:35:08.669871+0000","last_clean":"2024-09-10T07:35:08.669871+0000","last_became_active":"2024-09-10T07:35:06.648192+0000","last_became_peered":"2024-09-10T07:35:06.648192+0000","last_unstale":"2024-09-10T07:35:08.669871+0000","last_undegraded":"2024-09-10T07:35:08.669871+0000","last_fullsized":"2024-09-10T07:35:08.669871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:40.068120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637858+0000","last_change":"2024-09-10T07:35:05.644989+0000","last_active":"2024-09-10T07:35:07.637858+0000","last_peered":"2024-09-10T07:35:07.637858+0000","last_clean":"2024-09-10T07:35:07.637858+0000","last_became_active":"2024-09-10T07:35:05.644754+0000","last_became_peered":"2024-09-10T07:35:05.644754+0000","last_unstale":"2024-09-10T07:35:07.637858+0000","last_undegraded":"2024-09-10T07:35:07.637858+0000","last_fullsized":"2024-09-10T07:35:07.637858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:56.364576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669727+0000","last_change":"2024-09-10T07:35:06.653353+0000","last_active":"2024-09-10T07:35:08.669727+0000","last_peered":"2024-09-10T07:35:08.669727+0000","last_clean":"2024-09-10T07:35:08.669727+0000","last_became_active":"2024-09-10T07:35:06.652933+0000","last_became_peered":"2024-09-10T07:35:06.652933+0000","last_unstale":"2024-09-10T07:35:08.669727+0000","last_undegraded":"2024-09-10T07:35:08.669727+0000","last_fullsized":"2024-09-10T07:35:08.669727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:14.554898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637640+0000","last_change":"2024-09-10T07:35:05.647859+0000","last_active":"2024-09-10T07:35:07.637640+0000","last_peered":"2024-09-10T07:35:07.637640+0000","last_clean":"2024-09-10T07:35:07.637640+0000","last_became_active":"2024-09-10T07:35:05.644526+0000","last_became_peered":"2024-09-10T07:35:05.644526+0000","last_unstale":"2024-09-10T07:35:07.637640+0000","last_undegraded":"2024-09-10T07:35:07.637640+0000","last_fullsized":"2024-09-10T07:35:07.637640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:21.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.638114+0000","last_change":"2024-09-10T07:35:06.656721+0000","last_active":"2024-09-10T07:35:07.638114+0000","last_peered":"2024-09-10T07:35:07.638114+0000","last_clean":"2024-09-10T07:35:07.638114+0000","last_became_active":"2024-09-10T07:35:06.655910+0000","last_became_peered":"2024-09-10T07:35:06.655910+0000","last_unstale":"2024-09-10T07:35:07.638114+0000","last_undegraded":"2024-09-10T07:35:07.638114+0000","last_fullsized":"2024-09-10T07:35:07.638114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:39.906058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.639585+0000","last_change":"2024-09-10T07:35:05.648734+0000","last_active":"2024-09-10T07:35:07.639585+0000","last_peered":"2024-09-10T07:35:07.639585+0000","last_clean":"2024-09-10T07:35:07.639585+0000","last_became_active":"2024-09-10T07:35:05.648188+0000","last_became_peered":"2024-09-10T07:35:05.648188+0000","last_unstale":"2024-09-10T07:35:07.639585+0000","last_undegraded":"2024-09-10T07:35:07.639585+0000","last_fullsized":"2024-09-10T07:35:07.639585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:13.735576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634211+0000","last_change":"2024-09-10T07:35:06.658302+0000","last_active":"2024-09-10T07:35:07.634211+0000","last_peered":"2024-09-10T07:35:07.634211+0000","last_clean":"2024-09-10T07:35:07.634211+0000","last_became_active":"2024-09-10T07:35:06.658033+0000","last_became_peered":"2024-09-10T07:35:06.658033+0000","last_unstale":"2024-09-10T07:35:07.634211+0000","last_undegraded":"2024-09-10T07:35:07.634211+0000","last_fullsized":"2024-09-10T07:35:07.634211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:38.680322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637953+0000","last_change":"2024-09-10T07:35:05.645410+0000","last_active":"2024-09-10T07:35:07.637953+0000","last_peered":"2024-09-10T07:35:07.637953+0000","last_clean":"2024-09-10T07:35:07.637953+0000","last_became_active":"2024-09-10T07:35:05.644200+0000","last_became_peered":"2024-09-10T07:35:05.644200+0000","last_unstale":"2024-09-10T07:35:07.637953+0000","last_undegraded":"2024-09-10T07:35:07.637953+0000","last_fullsized":"2024-09-10T07:35:07.637953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:51.574368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980563+0000","last_change":"2024-09-10T07:35:06.648742+0000","last_active":"2024-09-10T07:35:07.980563+0000","last_peered":"2024-09-10T07:35:07.980563+0000","last_clean":"2024-09-10T07:35:07.980563+0000","last_became_active":"2024-09-10T07:35:06.647117+0000","last_became_peered":"2024-09-10T07:35:06.647117+0000","last_unstale":"2024-09-10T07:35:07.980563+0000","last_undegraded":"2024-09-10T07:35:07.980563+0000","last_fullsized":"2024-09-10T07:35:07.980563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:16.874553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634505+0000","last_change":"2024-09-10T07:35:05.640409+0000","last_active":"2024-09-10T07:35:07.634505+0000","last_peered":"2024-09-10T07:35:07.634505+0000","last_clean":"2024-09-10T07:35:07.634505+0000","last_became_active":"2024-09-10T07:35:05.640192+0000","last_became_peered":"2024-09-10T07:35:05.640192+0000","last_unstale":"2024-09-10T07:35:07.634505+0000","last_undegraded":"2024-09-10T07:35:07.634505+0000","last_fullsized":"2024-09-10T07:35:07.634505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:42.364573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634354+0000","last_change":"2024-09-10T07:35:06.646451+0000","last_active":"2024-09-10T07:35:07.634354+0000","last_peered":"2024-09-10T07:35:07.634354+0000","last_clean":"2024-09-10T07:35:07.634354+0000","last_became_active":"2024-09-10T07:35:06.646027+0000","last_became_peered":"2024-09-10T07:35:06.646027+0000","last_unstale":"2024-09-10T07:35:07.634354+0000","last_undegraded":"2024-09-10T07:35:07.634354+0000","last_fullsized":"2024-09-10T07:35:07.634354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:22.632517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637881+0000","last_change":"2024-09-10T07:35:05.647665+0000","last_active":"2024-09-10T07:35:07.637881+0000","last_peered":"2024-09-10T07:35:07.637881+0000","last_clean":"2024-09-10T07:35:07.637881+0000","last_became_active":"2024-09-10T07:35:05.643475+0000","last_became_peered":"2024-09-10T07:35:05.643475+0000","last_unstale":"2024-09-10T07:35:07.637881+0000","last_undegraded":"2024-09-10T07:35:07.637881+0000","last_fullsized":"2024-09-10T07:35:07.637881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:15.685956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669086+0000","last_change":"2024-09-10T07:35:06.658612+0000","last_active":"2024-09-10T07:35:08.669086+0000","last_peered":"2024-09-10T07:35:08.669086+0000","last_clean":"2024-09-10T07:35:08.669086+0000","last_became_active":"2024-09-10T07:35:06.657799+0000","last_became_peered":"2024-09-10T07:35:06.657799+0000","last_unstale":"2024-09-10T07:35:08.669086+0000","last_undegraded":"2024-09-10T07:35:08.669086+0000","last_fullsized":"2024-09-10T07:35:08.669086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:37.031935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670561+0000","last_change":"2024-09-10T07:35:05.638078+0000","last_active":"2024-09-10T07:35:08.670561+0000","last_peered":"2024-09-10T07:35:08.670561+0000","last_clean":"2024-09-10T07:35:08.670561+0000","last_became_active":"2024-09-10T07:35:05.637854+0000","last_became_peered":"2024-09-10T07:35:05.637854+0000","last_unstale":"2024-09-10T07:35:08.670561+0000","last_undegraded":"2024-09-10T07:35:08.670561+0000","last_fullsized":"2024-09-10T07:35:08.670561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:20.984109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669474+0000","last_change":"2024-09-10T07:35:06.650756+0000","last_active":"2024-09-10T07:35:08.669474+0000","last_peered":"2024-09-10T07:35:08.669474+0000","last_clean":"2024-09-10T07:35:08.669474+0000","last_became_active":"2024-09-10T07:35:06.650515+0000","last_became_peered":"2024-09-10T07:35:06.650515+0000","last_unstale":"2024-09-10T07:35:08.669474+0000","last_undegraded":"2024-09-10T07:35:08.669474+0000","last_fullsized":"2024-09-10T07:35:08.669474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:41.219764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670083+0000","last_change":"2024-09-10T07:35:05.646694+0000","last_active":"2024-09-10T07:35:08.670083+0000","last_peered":"2024-09-10T07:35:08.670083+0000","last_clean":"2024-09-10T07:35:08.670083+0000","last_became_active":"2024-09-10T07:35:05.646170+0000","last_became_peered":"2024-09-10T07:35:05.646170+0000","last_unstale":"2024-09-10T07:35:08.670083+0000","last_undegraded":"2024-09-10T07:35:08.670083+0000","last_fullsized":"2024-09-10T07:35:08.670083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:27.328243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669960+0000","last_change":"2024-09-10T07:35:06.652239+0000","last_active":"2024-09-10T07:35:08.669960+0000","last_peered":"2024-09-10T07:35:08.669960+0000","last_clean":"2024-09-10T07:35:08.669960+0000","last_became_active":"2024-09-10T07:35:06.652034+0000","last_became_peered":"2024-09-10T07:35:06.652034+0000","last_unstale":"2024-09-10T07:35:08.669960+0000","last_undegraded":"2024-09-10T07:35:08.669960+0000","last_fullsized":"2024-09-10T07:35:08.669960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:25.695802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980221+0000","last_change":"2024-09-10T07:35:05.643440+0000","last_active":"2024-09-10T07:35:07.980221+0000","last_peered":"2024-09-10T07:35:07.980221+0000","last_clean":"2024-09-10T07:35:07.980221+0000","last_became_active":"2024-09-10T07:35:05.643204+0000","last_became_peered":"2024-09-10T07:35:05.643204+0000","last_unstale":"2024-09-10T07:35:07.980221+0000","last_undegraded":"2024-09-10T07:35:07.980221+0000","last_fullsized":"2024-09-10T07:35:07.980221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:46.255699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669391+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:35:08.669391+0000","last_peered":"2024-09-10T07:35:08.669391+0000","last_clean":"2024-09-10T07:35:08.669391+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:35:08.669391+0000","last_undegraded":"2024-09-10T07:35:08.669391+0000","last_fullsized":"2024-09-10T07:35:08.669391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":701,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194611,"statfs":{"total":200000000,"available":199281876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865418,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865362,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195187,"statfs":{"total":200000000,"available":199872230,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":126,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195186,"statfs":{"total":200000000,"available":199870700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195187,"statfs":{"total":200000000,"available":199872264,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":132,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864400,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199275666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:35:10.879 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:35:11.028 INFO:tasks.ceph.mds.c.smithi099.stderr:2024-09-10T07:35:11.028+0000 7fbe33400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:35:11.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.068+0000 7f7471600640 1 Processor -- start 2024-09-10T07:35:11.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.069+0000 7f7471600640 1 -- start start 2024-09-10T07:35:11.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f7471600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f746c145290 0x7f746c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f7471600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f746c0ce780 0x7f746c072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f7471600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f746c06e3d0 con 0x7f746c071510 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f7471600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f746c06efe0 con 0x7f746c145290 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f7471600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f746c06e6b0 con 0x7f746c0ce780 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f746aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f746c145290 0x7f746c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f746b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f746c071510 0x7f746c0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46826/0 (socket says 172.21.15.99:46826) 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f746aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f746c145290 0x7f746c06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49436/0 (socket says 172.21.15.99:49436) 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f746b400640 1 -- 172.21.15.99:0/2298547965 learned_addr learned my addr 172.21.15.99:0/2298547965 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f7462000640 1 --2- 172.21.15.99:0/2298547965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f746c0ce780 0x7f746c072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.070+0000 7f746aa00640 1 -- 172.21.15.99:0/2298547965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f746c0ce780 msgr2=0x7f746c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.071+0000 7f746aa00640 1 --2- 172.21.15.99:0/2298547965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f746c0ce780 0x7f746c072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.071+0000 7f746aa00640 1 -- 172.21.15.99:0/2298547965 >> v1:172.21.15.99:6789/0 conn(0x7f746c071510 legacy=0x7f746c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.071+0000 7f746aa00640 1 -- 172.21.15.99:0/2298547965 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c06e990 con 0x7f746c145290 2024-09-10T07:35:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.071+0000 7f746a000640 1 -- 172.21.15.99:0/2298547965 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2637045837 0 0) 0x7f746c06e3d0 con 0x7f746c071510 2024-09-10T07:35:11.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.071+0000 7f746aa00640 1 --2- 172.21.15.99:0/2298547965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 0x7f746c06f470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f745c0097a0 tx=0x7f745c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bcb044febfa597 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:11.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f746a000640 1 -- 172.21.15.99:0/2298547965 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c037070 con 0x7f746c145290 2024-09-10T07:35:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f746a000640 1 -- 172.21.15.99:0/2298547965 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745c032440 con 0x7f746c145290 2024-09-10T07:35:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f746a000640 1 -- 172.21.15.99:0/2298547965 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c032810 con 0x7f746c145290 2024-09-10T07:35:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f7471600640 1 -- 172.21.15.99:0/2298547965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 msgr2=0x7f746c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f7471600640 1 --2- 172.21.15.99:0/2298547965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 0x7f746c06f470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f745c0097a0 tx=0x7f745c02a180 comp rx=0 tx=0).stop 2024-09-10T07:35:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f7471600640 1 -- 172.21.15.99:0/2298547965 shutdown_connections 2024-09-10T07:35:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f7471600640 1 --2- 172.21.15.99:0/2298547965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f746c0ce780 0x7f746c072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f7471600640 1 --2- 172.21.15.99:0/2298547965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 0x7f746c06f470 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f7471600640 1 -- 172.21.15.99:0/2298547965 >> 172.21.15.99:0/2298547965 conn(0x7f746c06bc10 msgr2=0x7f746c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f7471600640 1 -- 172.21.15.99:0/2298547965 shutdown_connections 2024-09-10T07:35:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.072+0000 7f7471600640 1 -- 172.21.15.99:0/2298547965 wait complete. 2024-09-10T07:35:11.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.074+0000 7f7471600640 1 Processor -- start 2024-09-10T07:35:11.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.074+0000 7f7471600640 1 -- start start 2024-09-10T07:35:11.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f7471600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f746c071510 0x7f746c13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f7471600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f746c0ce780 0x7f746c1e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f7471600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 0x7f746c140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f7471600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f746c06df80 con 0x7f746c145290 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f7471600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f746c145670 con 0x7f746c0ce780 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f7471600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f746c06e100 con 0x7f746c071510 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f746b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 0x7f746c140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f746b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 0x7f746c140200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49442/0 (socket says 172.21.15.99:49442) 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f746b400640 1 -- 172.21.15.99:0/2401981376 learned_addr learned my addr 172.21.15.99:0/2401981376 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f746aa00640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f746c071510 0x7f746c13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.075+0000 7f7462000640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f746c0ce780 0x7f746c1e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f746b400640 1 -- 172.21.15.99:0/2401981376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f746c071510 msgr2=0x7f746c13ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f746b400640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f746c071510 0x7f746c13ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f746b400640 1 -- 172.21.15.99:0/2401981376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f746c0ce780 msgr2=0x7f746c1e5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f746b400640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f746c0ce780 0x7f746c1e5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f746b400640 1 -- 172.21.15.99:0/2401981376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c1f8e90 con 0x7f746c145290 2024-09-10T07:35:11.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f746b400640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 0x7f746c140200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f746400c6d0 tx=0x7f746400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:11.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f7463400640 1 -- 172.21.15.99:0/2401981376 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464018070 con 0x7f746c145290 2024-09-10T07:35:11.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f7463400640 1 -- 172.21.15.99:0/2401981376 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7464004d60 con 0x7f746c145290 2024-09-10T07:35:11.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f7463400640 1 -- 172.21.15.99:0/2401981376 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746400a880 con 0x7f746c145290 2024-09-10T07:35:11.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f7471600640 1 -- 172.21.15.99:0/2401981376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c1e5460 con 0x7f746c145290 2024-09-10T07:35:11.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.076+0000 7f7471600640 1 -- 172.21.15.99:0/2401981376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c1e5a20 con 0x7f746c145290 2024-09-10T07:35:11.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.077+0000 7f7471600640 1 -- 172.21.15.99:0/2401981376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c1e5c20 con 0x7f746c145290 2024-09-10T07:35:11.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.078+0000 7f7463400640 1 -- 172.21.15.99:0/2401981376 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f746401b070 con 0x7f746c145290 2024-09-10T07:35:11.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.079+0000 7f7463400640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f744806be60 0x7f744806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.080+0000 7f7463400640 1 -- 172.21.15.99:0/2401981376 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f746408a500 con 0x7f746c145290 2024-09-10T07:35:11.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.080+0000 7f746aa00640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f744806be60 0x7f744806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.080+0000 7f746aa00640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f744806be60 0x7f744806e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f745c034000 tx=0x7f745c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:11.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.084+0000 7f7463400640 1 -- 172.21.15.99:0/2401981376 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f746c1e5c20 con 0x7f746c145290 2024-09-10T07:35:11.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.252+0000 7f7471600640 1 -- 172.21.15.99:0/2401981376 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f746c144ab0 con 0x7f744806be60 2024-09-10T07:35:11.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.258+0000 7f7463400640 1 -- 172.21.15.99:0/2401981376 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247489 (secure 0 0 0) 0x7f746c144ab0 con 0x7f744806be60 2024-09-10T07:35:11.260 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:11.262 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:35:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 -- 172.21.15.99:0/2401981376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f744806be60 msgr2=0x7f744806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f744806be60 0x7f744806e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f745c034000 tx=0x7f745c02e000 comp rx=0 tx=0).stop 2024-09-10T07:35:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 -- 172.21.15.99:0/2401981376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 msgr2=0x7f746c140200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 0x7f746c140200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f746400c6d0 tx=0x7f746400cb90 comp rx=0 tx=0).stop 2024-09-10T07:35:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 -- 172.21.15.99:0/2401981376 shutdown_connections 2024-09-10T07:35:11.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f744806be60 0x7f744806e320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f746c145290 0x7f746c140200 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f746c0ce780 0x7f746c1e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 --2- 172.21.15.99:0/2401981376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f746c071510 0x7f746c13ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 -- 172.21.15.99:0/2401981376 >> 172.21.15.99:0/2401981376 conn(0x7f746c06bc10 msgr2=0x7f746c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:11.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 -- 172.21.15.99:0/2401981376 shutdown_connections 2024-09-10T07:35:11.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.263+0000 7f7471600640 1 -- 172.21.15.99:0/2401981376 wait complete. 2024-09-10T07:35:11.279 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-10T07:35:10.702636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2179,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560320,"statfs":{"total":1600000000,"available":1597767916,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000938"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980376+0000","last_change":"2024-09-10T07:35:06.646932+0000","last_active":"2024-09-10T07:35:07.980376+0000","last_peered":"2024-09-10T07:35:07.980376+0000","last_clean":"2024-09-10T07:35:07.980376+0000","last_became_active":"2024-09-10T07:35:06.645535+0000","last_became_peered":"2024-09-10T07:35:06.645535+0000","last_unstale":"2024-09-10T07:35:07.980376+0000","last_undegraded":"2024-09-10T07:35:07.980376+0000","last_fullsized":"2024-09-10T07:35:07.980376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:37.442703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669563+0000","last_change":"2024-09-10T07:35:06.654440+0000","last_active":"2024-09-10T07:35:08.669563+0000","last_peered":"2024-09-10T07:35:08.669563+0000","last_clean":"2024-09-10T07:35:08.669563+0000","last_became_active":"2024-09-10T07:35:06.653950+0000","last_became_peered":"2024-09-10T07:35:06.653950+0000","last_unstale":"2024-09-10T07:35:08.669563+0000","last_undegraded":"2024-09-10T07:35:08.669563+0000","last_fullsized":"2024-09-10T07:35:08.669563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:17.863648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.638041+0000","last_change":"2024-09-10T07:35:06.648389+0000","last_active":"2024-09-10T07:35:07.638041+0000","last_peered":"2024-09-10T07:35:07.638041+0000","last_clean":"2024-09-10T07:35:07.638041+0000","last_became_active":"2024-09-10T07:35:06.647894+0000","last_became_peered":"2024-09-10T07:35:06.647894+0000","last_unstale":"2024-09-10T07:35:07.638041+0000","last_undegraded":"2024-09-10T07:35:07.638041+0000","last_fullsized":"2024-09-10T07:35:07.638041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:28.174292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637663+0000","last_change":"2024-09-10T07:35:06.658625+0000","last_active":"2024-09-10T07:35:07.637663+0000","last_peered":"2024-09-10T07:35:07.637663+0000","last_clean":"2024-09-10T07:35:07.637663+0000","last_became_active":"2024-09-10T07:35:06.658295+0000","last_became_peered":"2024-09-10T07:35:06.658295+0000","last_unstale":"2024-09-10T07:35:07.637663+0000","last_undegraded":"2024-09-10T07:35:07.637663+0000","last_fullsized":"2024-09-10T07:35:07.637663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:25.815019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669136+0000","last_change":"2024-09-10T07:35:06.652460+0000","last_active":"2024-09-10T07:35:08.669136+0000","last_peered":"2024-09-10T07:35:08.669136+0000","last_clean":"2024-09-10T07:35:08.669136+0000","last_became_active":"2024-09-10T07:35:06.652235+0000","last_became_peered":"2024-09-10T07:35:06.652235+0000","last_unstale":"2024-09-10T07:35:08.669136+0000","last_undegraded":"2024-09-10T07:35:08.669136+0000","last_fullsized":"2024-09-10T07:35:08.669136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:42.433598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669789+0000","last_change":"2024-09-10T07:35:06.651990+0000","last_active":"2024-09-10T07:35:08.669789+0000","last_peered":"2024-09-10T07:35:08.669789+0000","last_clean":"2024-09-10T07:35:08.669789+0000","last_became_active":"2024-09-10T07:35:06.651415+0000","last_became_peered":"2024-09-10T07:35:06.651415+0000","last_unstale":"2024-09-10T07:35:08.669789+0000","last_undegraded":"2024-09-10T07:35:08.669789+0000","last_fullsized":"2024-09-10T07:35:08.669789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:28.515271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669735+0000","last_change":"2024-09-10T07:35:06.649222+0000","last_active":"2024-09-10T07:35:08.669735+0000","last_peered":"2024-09-10T07:35:08.669735+0000","last_clean":"2024-09-10T07:35:08.669735+0000","last_became_active":"2024-09-10T07:35:06.648967+0000","last_became_peered":"2024-09-10T07:35:06.648967+0000","last_unstale":"2024-09-10T07:35:08.669735+0000","last_undegraded":"2024-09-10T07:35:08.669735+0000","last_fullsized":"2024-09-10T07:35:08.669735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:21.085825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669252+0000","last_change":"2024-09-10T07:35:06.645852+0000","last_active":"2024-09-10T07:35:08.669252+0000","last_peered":"2024-09-10T07:35:08.669252+0000","last_clean":"2024-09-10T07:35:08.669252+0000","last_became_active":"2024-09-10T07:35:06.645320+0000","last_became_peered":"2024-09-10T07:35:06.645320+0000","last_unstale":"2024-09-10T07:35:08.669252+0000","last_undegraded":"2024-09-10T07:35:08.669252+0000","last_fullsized":"2024-09-10T07:35:08.669252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:41.862311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669545+0000","last_change":"2024-09-10T07:35:06.656310+0000","last_active":"2024-09-10T07:35:08.669545+0000","last_peered":"2024-09-10T07:35:08.669545+0000","last_clean":"2024-09-10T07:35:08.669545+0000","last_became_active":"2024-09-10T07:35:06.656035+0000","last_became_peered":"2024-09-10T07:35:06.656035+0000","last_unstale":"2024-09-10T07:35:08.669545+0000","last_undegraded":"2024-09-10T07:35:08.669545+0000","last_fullsized":"2024-09-10T07:35:08.669545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:35.074161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637873+0000","last_change":"2024-09-10T07:35:06.656618+0000","last_active":"2024-09-10T07:35:07.637873+0000","last_peered":"2024-09-10T07:35:07.637873+0000","last_clean":"2024-09-10T07:35:07.637873+0000","last_became_active":"2024-09-10T07:35:06.656071+0000","last_became_peered":"2024-09-10T07:35:06.656071+0000","last_unstale":"2024-09-10T07:35:07.637873+0000","last_undegraded":"2024-09-10T07:35:07.637873+0000","last_fullsized":"2024-09-10T07:35:07.637873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:39.916636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669581+0000","last_change":"2024-09-10T07:35:06.655158+0000","last_active":"2024-09-10T07:35:08.669581+0000","last_peered":"2024-09-10T07:35:08.669581+0000","last_clean":"2024-09-10T07:35:08.669581+0000","last_became_active":"2024-09-10T07:35:06.654897+0000","last_became_peered":"2024-09-10T07:35:06.654897+0000","last_unstale":"2024-09-10T07:35:08.669581+0000","last_undegraded":"2024-09-10T07:35:08.669581+0000","last_fullsized":"2024-09-10T07:35:08.669581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:14.092853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637646+0000","last_change":"2024-09-10T07:35:06.651638+0000","last_active":"2024-09-10T07:35:07.637646+0000","last_peered":"2024-09-10T07:35:07.637646+0000","last_clean":"2024-09-10T07:35:07.637646+0000","last_became_active":"2024-09-10T07:35:06.651190+0000","last_became_peered":"2024-09-10T07:35:06.651190+0000","last_unstale":"2024-09-10T07:35:07.637646+0000","last_undegraded":"2024-09-10T07:35:07.637646+0000","last_fullsized":"2024-09-10T07:35:07.637646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:38.274667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669057+0000","last_change":"2024-09-10T07:35:06.647090+0000","last_active":"2024-09-10T07:35:08.669057+0000","last_peered":"2024-09-10T07:35:08.669057+0000","last_clean":"2024-09-10T07:35:08.669057+0000","last_became_active":"2024-09-10T07:35:06.646748+0000","last_became_peered":"2024-09-10T07:35:06.646748+0000","last_unstale":"2024-09-10T07:35:08.669057+0000","last_undegraded":"2024-09-10T07:35:08.669057+0000","last_fullsized":"2024-09-10T07:35:08.669057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:52.018827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669469+0000","last_change":"2024-09-10T07:35:06.658417+0000","last_active":"2024-09-10T07:35:08.669469+0000","last_peered":"2024-09-10T07:35:08.669469+0000","last_clean":"2024-09-10T07:35:08.669469+0000","last_became_active":"2024-09-10T07:35:06.657319+0000","last_became_peered":"2024-09-10T07:35:06.657319+0000","last_unstale":"2024-09-10T07:35:08.669469+0000","last_undegraded":"2024-09-10T07:35:08.669469+0000","last_fullsized":"2024-09-10T07:35:08.669469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:21.027976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.638042+0000","last_change":"2024-09-10T07:35:06.648059+0000","last_active":"2024-09-10T07:35:07.638042+0000","last_peered":"2024-09-10T07:35:07.638042+0000","last_clean":"2024-09-10T07:35:07.638042+0000","last_became_active":"2024-09-10T07:35:06.647783+0000","last_became_peered":"2024-09-10T07:35:06.647783+0000","last_unstale":"2024-09-10T07:35:07.638042+0000","last_undegraded":"2024-09-10T07:35:07.638042+0000","last_fullsized":"2024-09-10T07:35:07.638042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:03.066389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669766+0000","last_change":"2024-09-10T07:35:06.654175+0000","last_active":"2024-09-10T07:35:08.669766+0000","last_peered":"2024-09-10T07:35:08.669766+0000","last_clean":"2024-09-10T07:35:08.669766+0000","last_became_active":"2024-09-10T07:35:06.653805+0000","last_became_peered":"2024-09-10T07:35:06.653805+0000","last_unstale":"2024-09-10T07:35:08.669766+0000","last_undegraded":"2024-09-10T07:35:08.669766+0000","last_fullsized":"2024-09-10T07:35:08.669766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:28.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669333+0000","last_change":"2024-09-10T07:35:06.648316+0000","last_active":"2024-09-10T07:35:08.669333+0000","last_peered":"2024-09-10T07:35:08.669333+0000","last_clean":"2024-09-10T07:35:08.669333+0000","last_became_active":"2024-09-10T07:35:06.648079+0000","last_became_peered":"2024-09-10T07:35:06.648079+0000","last_unstale":"2024-09-10T07:35:08.669333+0000","last_undegraded":"2024-09-10T07:35:08.669333+0000","last_fullsized":"2024-09-10T07:35:08.669333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:47.954281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669028+0000","last_change":"2024-09-10T07:35:06.665606+0000","last_active":"2024-09-10T07:35:08.669028+0000","last_peered":"2024-09-10T07:35:08.669028+0000","last_clean":"2024-09-10T07:35:08.669028+0000","last_became_active":"2024-09-10T07:35:06.664916+0000","last_became_peered":"2024-09-10T07:35:06.664916+0000","last_unstale":"2024-09-10T07:35:08.669028+0000","last_undegraded":"2024-09-10T07:35:08.669028+0000","last_fullsized":"2024-09-10T07:35:08.669028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:56.788477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.668912+0000","last_change":"2024-09-10T07:35:06.658829+0000","last_active":"2024-09-10T07:35:08.668912+0000","last_peered":"2024-09-10T07:35:08.668912+0000","last_clean":"2024-09-10T07:35:08.668912+0000","last_became_active":"2024-09-10T07:35:06.658167+0000","last_became_peered":"2024-09-10T07:35:06.658167+0000","last_unstale":"2024-09-10T07:35:08.668912+0000","last_undegraded":"2024-09-10T07:35:08.668912+0000","last_fullsized":"2024-09-10T07:35:08.668912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:25.844301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669312+0000","last_change":"2024-09-10T07:35:06.649067+0000","last_active":"2024-09-10T07:35:08.669312+0000","last_peered":"2024-09-10T07:35:08.669312+0000","last_clean":"2024-09-10T07:35:08.669312+0000","last_became_active":"2024-09-10T07:35:06.645798+0000","last_became_peered":"2024-09-10T07:35:06.645798+0000","last_unstale":"2024-09-10T07:35:08.669312+0000","last_undegraded":"2024-09-10T07:35:08.669312+0000","last_fullsized":"2024-09-10T07:35:08.669312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:23.687009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670029+0000","last_change":"2024-09-10T07:35:06.638588+0000","last_active":"2024-09-10T07:35:08.670029+0000","last_peered":"2024-09-10T07:35:08.670029+0000","last_clean":"2024-09-10T07:35:08.670029+0000","last_became_active":"2024-09-10T07:35:06.638357+0000","last_became_peered":"2024-09-10T07:35:06.638357+0000","last_unstale":"2024-09-10T07:35:08.670029+0000","last_undegraded":"2024-09-10T07:35:08.670029+0000","last_fullsized":"2024-09-10T07:35:08.670029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:10.773806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670370+0000","last_change":"2024-09-10T07:35:06.649651+0000","last_active":"2024-09-10T07:35:08.670370+0000","last_peered":"2024-09-10T07:35:08.670370+0000","last_clean":"2024-09-10T07:35:08.670370+0000","last_became_active":"2024-09-10T07:35:06.649379+0000","last_became_peered":"2024-09-10T07:35:06.649379+0000","last_unstale":"2024-09-10T07:35:08.670370+0000","last_undegraded":"2024-09-10T07:35:08.670370+0000","last_fullsized":"2024-09-10T07:35:08.670370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:54.319691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634299+0000","last_change":"2024-09-10T07:35:06.648743+0000","last_active":"2024-09-10T07:35:07.634299+0000","last_peered":"2024-09-10T07:35:07.634299+0000","last_clean":"2024-09-10T07:35:07.634299+0000","last_became_active":"2024-09-10T07:35:06.644920+0000","last_became_peered":"2024-09-10T07:35:06.644920+0000","last_unstale":"2024-09-10T07:35:07.634299+0000","last_undegraded":"2024-09-10T07:35:07.634299+0000","last_fullsized":"2024-09-10T07:35:07.634299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:34.510609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637565+0000","last_change":"2024-09-10T07:35:06.644632+0000","last_active":"2024-09-10T07:35:07.637565+0000","last_peered":"2024-09-10T07:35:07.637565+0000","last_clean":"2024-09-10T07:35:07.637565+0000","last_became_active":"2024-09-10T07:35:06.642042+0000","last_became_peered":"2024-09-10T07:35:06.642042+0000","last_unstale":"2024-09-10T07:35:07.637565+0000","last_undegraded":"2024-09-10T07:35:07.637565+0000","last_fullsized":"2024-09-10T07:35:07.637565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:46.201952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637535+0000","last_change":"2024-09-10T07:35:06.652173+0000","last_active":"2024-09-10T07:35:07.637535+0000","last_peered":"2024-09-10T07:35:07.637535+0000","last_clean":"2024-09-10T07:35:07.637535+0000","last_became_active":"2024-09-10T07:35:06.647731+0000","last_became_peered":"2024-09-10T07:35:06.647731+0000","last_unstale":"2024-09-10T07:35:07.637535+0000","last_undegraded":"2024-09-10T07:35:07.637535+0000","last_fullsized":"2024-09-10T07:35:07.637535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:25.115773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669979+0000","last_change":"2024-09-10T07:35:06.652183+0000","last_active":"2024-09-10T07:35:08.669979+0000","last_peered":"2024-09-10T07:35:08.669979+0000","last_clean":"2024-09-10T07:35:08.669979+0000","last_became_active":"2024-09-10T07:35:06.651712+0000","last_became_peered":"2024-09-10T07:35:06.651712+0000","last_unstale":"2024-09-10T07:35:08.669979+0000","last_undegraded":"2024-09-10T07:35:08.669979+0000","last_fullsized":"2024-09-10T07:35:08.669979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:08.579053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637795+0000","last_change":"2024-09-10T07:35:06.657233+0000","last_active":"2024-09-10T07:35:07.637795+0000","last_peered":"2024-09-10T07:35:07.637795+0000","last_clean":"2024-09-10T07:35:07.637795+0000","last_became_active":"2024-09-10T07:35:06.656986+0000","last_became_peered":"2024-09-10T07:35:06.656986+0000","last_unstale":"2024-09-10T07:35:07.637795+0000","last_undegraded":"2024-09-10T07:35:07.637795+0000","last_fullsized":"2024-09-10T07:35:07.637795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:48.808802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637626+0000","last_change":"2024-09-10T07:35:06.639239+0000","last_active":"2024-09-10T07:35:07.637626+0000","last_peered":"2024-09-10T07:35:07.637626+0000","last_clean":"2024-09-10T07:35:07.637626+0000","last_became_active":"2024-09-10T07:35:06.638984+0000","last_became_peered":"2024-09-10T07:35:06.638984+0000","last_unstale":"2024-09-10T07:35:07.637626+0000","last_undegraded":"2024-09-10T07:35:07.637626+0000","last_fullsized":"2024-09-10T07:35:07.637626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:32.398022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669704+0000","last_change":"2024-09-10T07:35:06.649635+0000","last_active":"2024-09-10T07:35:08.669704+0000","last_peered":"2024-09-10T07:35:08.669704+0000","last_clean":"2024-09-10T07:35:08.669704+0000","last_became_active":"2024-09-10T07:35:06.649395+0000","last_became_peered":"2024-09-10T07:35:06.649395+0000","last_unstale":"2024-09-10T07:35:08.669704+0000","last_undegraded":"2024-09-10T07:35:08.669704+0000","last_fullsized":"2024-09-10T07:35:08.669704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:44.737754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669736+0000","last_change":"2024-09-10T07:35:06.646899+0000","last_active":"2024-09-10T07:35:08.669736+0000","last_peered":"2024-09-10T07:35:08.669736+0000","last_clean":"2024-09-10T07:35:08.669736+0000","last_became_active":"2024-09-10T07:35:06.646660+0000","last_became_peered":"2024-09-10T07:35:06.646660+0000","last_unstale":"2024-09-10T07:35:08.669736+0000","last_undegraded":"2024-09-10T07:35:08.669736+0000","last_fullsized":"2024-09-10T07:35:08.669736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:34.862891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980485+0000","last_change":"2024-09-10T07:35:06.643021+0000","last_active":"2024-09-10T07:35:07.980485+0000","last_peered":"2024-09-10T07:35:07.980485+0000","last_clean":"2024-09-10T07:35:07.980485+0000","last_became_active":"2024-09-10T07:35:06.642733+0000","last_became_peered":"2024-09-10T07:35:06.642733+0000","last_unstale":"2024-09-10T07:35:07.980485+0000","last_undegraded":"2024-09-10T07:35:07.980485+0000","last_fullsized":"2024-09-10T07:35:07.980485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:43.749126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669540+0000","last_change":"2024-09-10T07:35:06.643966+0000","last_active":"2024-09-10T07:35:08.669540+0000","last_peered":"2024-09-10T07:35:08.669540+0000","last_clean":"2024-09-10T07:35:08.669540+0000","last_became_active":"2024-09-10T07:35:06.643718+0000","last_became_peered":"2024-09-10T07:35:06.643718+0000","last_unstale":"2024-09-10T07:35:08.669540+0000","last_undegraded":"2024-09-10T07:35:08.669540+0000","last_fullsized":"2024-09-10T07:35:08.669540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:45.937056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634448+0000","last_change":"2024-09-10T07:35:06.642512+0000","last_active":"2024-09-10T07:35:07.634448+0000","last_peered":"2024-09-10T07:35:07.634448+0000","last_clean":"2024-09-10T07:35:07.634448+0000","last_became_active":"2024-09-10T07:35:06.642287+0000","last_became_peered":"2024-09-10T07:35:06.642287+0000","last_unstale":"2024-09-10T07:35:07.634448+0000","last_undegraded":"2024-09-10T07:35:07.634448+0000","last_fullsized":"2024-09-10T07:35:07.634448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:27.471151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980268+0000","last_change":"2024-09-10T07:35:05.639247+0000","last_active":"2024-09-10T07:35:07.980268+0000","last_peered":"2024-09-10T07:35:07.980268+0000","last_clean":"2024-09-10T07:35:07.980268+0000","last_became_active":"2024-09-10T07:35:05.639018+0000","last_became_peered":"2024-09-10T07:35:05.639018+0000","last_unstale":"2024-09-10T07:35:07.980268+0000","last_undegraded":"2024-09-10T07:35:07.980268+0000","last_fullsized":"2024-09-10T07:35:07.980268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:21.204549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980129+0000","last_change":"2024-09-10T07:35:06.643972+0000","last_active":"2024-09-10T07:35:07.980129+0000","last_peered":"2024-09-10T07:35:07.980129+0000","last_clean":"2024-09-10T07:35:07.980129+0000","last_became_active":"2024-09-10T07:35:06.643736+0000","last_became_peered":"2024-09-10T07:35:06.643736+0000","last_unstale":"2024-09-10T07:35:07.980129+0000","last_undegraded":"2024-09-10T07:35:07.980129+0000","last_fullsized":"2024-09-10T07:35:07.980129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:59.076477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634317+0000","last_change":"2024-09-10T07:35:05.645699+0000","last_active":"2024-09-10T07:35:07.634317+0000","last_peered":"2024-09-10T07:35:07.634317+0000","last_clean":"2024-09-10T07:35:07.634317+0000","last_became_active":"2024-09-10T07:35:05.645487+0000","last_became_peered":"2024-09-10T07:35:05.645487+0000","last_unstale":"2024-09-10T07:35:07.634317+0000","last_undegraded":"2024-09-10T07:35:07.634317+0000","last_fullsized":"2024-09-10T07:35:07.634317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:15.967903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670198+0000","last_change":"2024-09-10T07:35:06.651804+0000","last_active":"2024-09-10T07:35:08.670198+0000","last_peered":"2024-09-10T07:35:08.670198+0000","last_clean":"2024-09-10T07:35:08.670198+0000","last_became_active":"2024-09-10T07:35:06.651539+0000","last_became_peered":"2024-09-10T07:35:06.651539+0000","last_unstale":"2024-09-10T07:35:08.670198+0000","last_undegraded":"2024-09-10T07:35:08.670198+0000","last_fullsized":"2024-09-10T07:35:08.670198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:10.970635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670016+0000","last_change":"2024-09-10T07:35:05.648163+0000","last_active":"2024-09-10T07:35:08.670016+0000","last_peered":"2024-09-10T07:35:08.670016+0000","last_clean":"2024-09-10T07:35:08.670016+0000","last_became_active":"2024-09-10T07:35:05.647926+0000","last_became_peered":"2024-09-10T07:35:05.647926+0000","last_unstale":"2024-09-10T07:35:08.670016+0000","last_undegraded":"2024-09-10T07:35:08.670016+0000","last_fullsized":"2024-09-10T07:35:08.670016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:40.153459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637681+0000","last_change":"2024-09-10T07:35:06.656364+0000","last_active":"2024-09-10T07:35:07.637681+0000","last_peered":"2024-09-10T07:35:07.637681+0000","last_clean":"2024-09-10T07:35:07.637681+0000","last_became_active":"2024-09-10T07:35:06.648347+0000","last_became_peered":"2024-09-10T07:35:06.648347+0000","last_unstale":"2024-09-10T07:35:07.637681+0000","last_undegraded":"2024-09-10T07:35:07.637681+0000","last_fullsized":"2024-09-10T07:35:07.637681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:02.703797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669341+0000","last_change":"2024-09-10T07:35:05.640140+0000","last_active":"2024-09-10T07:35:08.669341+0000","last_peered":"2024-09-10T07:35:08.669341+0000","last_clean":"2024-09-10T07:35:08.669341+0000","last_became_active":"2024-09-10T07:35:05.639771+0000","last_became_peered":"2024-09-10T07:35:05.639771+0000","last_unstale":"2024-09-10T07:35:08.669341+0000","last_undegraded":"2024-09-10T07:35:08.669341+0000","last_fullsized":"2024-09-10T07:35:08.669341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:31.173325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669536+0000","last_change":"2024-09-10T07:35:06.645007+0000","last_active":"2024-09-10T07:35:08.669536+0000","last_peered":"2024-09-10T07:35:08.669536+0000","last_clean":"2024-09-10T07:35:08.669536+0000","last_became_active":"2024-09-10T07:35:06.643982+0000","last_became_peered":"2024-09-10T07:35:06.643982+0000","last_unstale":"2024-09-10T07:35:08.669536+0000","last_undegraded":"2024-09-10T07:35:08.669536+0000","last_fullsized":"2024-09-10T07:35:08.669536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:16.056312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670184+0000","last_change":"2024-09-10T07:35:05.644162+0000","last_active":"2024-09-10T07:35:08.670184+0000","last_peered":"2024-09-10T07:35:08.670184+0000","last_clean":"2024-09-10T07:35:08.670184+0000","last_became_active":"2024-09-10T07:35:05.643877+0000","last_became_peered":"2024-09-10T07:35:05.643877+0000","last_unstale":"2024-09-10T07:35:08.670184+0000","last_undegraded":"2024-09-10T07:35:08.670184+0000","last_fullsized":"2024-09-10T07:35:08.670184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:56.762144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637842+0000","last_change":"2024-09-10T07:35:06.638314+0000","last_active":"2024-09-10T07:35:07.637842+0000","last_peered":"2024-09-10T07:35:07.637842+0000","last_clean":"2024-09-10T07:35:07.637842+0000","last_became_active":"2024-09-10T07:35:06.638048+0000","last_became_peered":"2024-09-10T07:35:06.638048+0000","last_unstale":"2024-09-10T07:35:07.637842+0000","last_undegraded":"2024-09-10T07:35:07.637842+0000","last_fullsized":"2024-09-10T07:35:07.637842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:04.689701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669584+0000","last_change":"2024-09-10T07:35:05.643043+0000","last_active":"2024-09-10T07:35:08.669584+0000","last_peered":"2024-09-10T07:35:08.669584+0000","last_clean":"2024-09-10T07:35:08.669584+0000","last_became_active":"2024-09-10T07:35:05.642718+0000","last_became_peered":"2024-09-10T07:35:05.642718+0000","last_unstale":"2024-09-10T07:35:08.669584+0000","last_undegraded":"2024-09-10T07:35:08.669584+0000","last_fullsized":"2024-09-10T07:35:08.669584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:04.121323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669891+0000","last_change":"2024-09-10T07:35:06.648013+0000","last_active":"2024-09-10T07:35:08.669891+0000","last_peered":"2024-09-10T07:35:08.669891+0000","last_clean":"2024-09-10T07:35:08.669891+0000","last_became_active":"2024-09-10T07:35:06.647763+0000","last_became_peered":"2024-09-10T07:35:06.647763+0000","last_unstale":"2024-09-10T07:35:08.669891+0000","last_undegraded":"2024-09-10T07:35:08.669891+0000","last_fullsized":"2024-09-10T07:35:08.669891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:22.543341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669666+0000","last_change":"2024-09-10T07:35:05.643641+0000","last_active":"2024-09-10T07:35:08.669666+0000","last_peered":"2024-09-10T07:35:08.669666+0000","last_clean":"2024-09-10T07:35:08.669666+0000","last_became_active":"2024-09-10T07:35:05.643273+0000","last_became_peered":"2024-09-10T07:35:05.643273+0000","last_unstale":"2024-09-10T07:35:08.669666+0000","last_undegraded":"2024-09-10T07:35:08.669666+0000","last_fullsized":"2024-09-10T07:35:08.669666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:45:31.279242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637813+0000","last_change":"2024-09-10T07:35:06.655651+0000","last_active":"2024-09-10T07:35:07.637813+0000","last_peered":"2024-09-10T07:35:07.637813+0000","last_clean":"2024-09-10T07:35:07.637813+0000","last_became_active":"2024-09-10T07:35:06.655412+0000","last_became_peered":"2024-09-10T07:35:06.655412+0000","last_unstale":"2024-09-10T07:35:07.637813+0000","last_undegraded":"2024-09-10T07:35:07.637813+0000","last_fullsized":"2024-09-10T07:35:07.637813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:26.828103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670249+0000","last_change":"2024-09-10T07:35:05.642886+0000","last_active":"2024-09-10T07:35:08.670249+0000","last_peered":"2024-09-10T07:35:08.670249+0000","last_clean":"2024-09-10T07:35:08.670249+0000","last_became_active":"2024-09-10T07:35:05.641793+0000","last_became_peered":"2024-09-10T07:35:05.641793+0000","last_unstale":"2024-09-10T07:35:08.670249+0000","last_undegraded":"2024-09-10T07:35:08.670249+0000","last_fullsized":"2024-09-10T07:35:08.670249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:13.286457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.638017+0000","last_change":"2024-09-10T07:35:06.651431+0000","last_active":"2024-09-10T07:35:07.638017+0000","last_peered":"2024-09-10T07:35:07.638017+0000","last_clean":"2024-09-10T07:35:07.638017+0000","last_became_active":"2024-09-10T07:35:06.650783+0000","last_became_peered":"2024-09-10T07:35:06.650783+0000","last_unstale":"2024-09-10T07:35:07.638017+0000","last_undegraded":"2024-09-10T07:35:07.638017+0000","last_fullsized":"2024-09-10T07:35:07.638017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:15.608665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670236+0000","last_change":"2024-09-10T07:35:05.644921+0000","last_active":"2024-09-10T07:35:08.670236+0000","last_peered":"2024-09-10T07:35:08.670236+0000","last_clean":"2024-09-10T07:35:08.670236+0000","last_became_active":"2024-09-10T07:35:05.644694+0000","last_became_peered":"2024-09-10T07:35:05.644694+0000","last_unstale":"2024-09-10T07:35:08.670236+0000","last_undegraded":"2024-09-10T07:35:08.670236+0000","last_fullsized":"2024-09-10T07:35:08.670236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:52.648807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670133+0000","last_change":"2024-09-10T07:35:06.664703+0000","last_active":"2024-09-10T07:35:08.670133+0000","last_peered":"2024-09-10T07:35:08.670133+0000","last_clean":"2024-09-10T07:35:08.670133+0000","last_became_active":"2024-09-10T07:35:06.664422+0000","last_became_peered":"2024-09-10T07:35:06.664422+0000","last_unstale":"2024-09-10T07:35:08.670133+0000","last_undegraded":"2024-09-10T07:35:08.670133+0000","last_fullsized":"2024-09-10T07:35:08.670133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:42.888258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634406+0000","last_change":"2024-09-10T07:35:05.644533+0000","last_active":"2024-09-10T07:35:07.634406+0000","last_peered":"2024-09-10T07:35:07.634406+0000","last_clean":"2024-09-10T07:35:07.634406+0000","last_became_active":"2024-09-10T07:35:05.644310+0000","last_became_peered":"2024-09-10T07:35:05.644310+0000","last_unstale":"2024-09-10T07:35:07.634406+0000","last_undegraded":"2024-09-10T07:35:07.634406+0000","last_fullsized":"2024-09-10T07:35:07.634406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:29.282788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669978+0000","last_change":"2024-09-10T07:35:06.648934+0000","last_active":"2024-09-10T07:35:08.669978+0000","last_peered":"2024-09-10T07:35:08.669978+0000","last_clean":"2024-09-10T07:35:08.669978+0000","last_became_active":"2024-09-10T07:35:06.648724+0000","last_became_peered":"2024-09-10T07:35:06.648724+0000","last_unstale":"2024-09-10T07:35:08.669978+0000","last_undegraded":"2024-09-10T07:35:08.669978+0000","last_fullsized":"2024-09-10T07:35:08.669978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:12.387276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.638129+0000","last_change":"2024-09-10T07:35:05.644710+0000","last_active":"2024-09-10T07:35:07.638129+0000","last_peered":"2024-09-10T07:35:07.638129+0000","last_clean":"2024-09-10T07:35:07.638129+0000","last_became_active":"2024-09-10T07:35:05.644479+0000","last_became_peered":"2024-09-10T07:35:05.644479+0000","last_unstale":"2024-09-10T07:35:07.638129+0000","last_undegraded":"2024-09-10T07:35:07.638129+0000","last_fullsized":"2024-09-10T07:35:07.638129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:43.136836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637881+0000","last_change":"2024-09-10T07:35:06.648168+0000","last_active":"2024-09-10T07:35:07.637881+0000","last_peered":"2024-09-10T07:35:07.637881+0000","last_clean":"2024-09-10T07:35:07.637881+0000","last_became_active":"2024-09-10T07:35:06.647473+0000","last_became_peered":"2024-09-10T07:35:06.647473+0000","last_unstale":"2024-09-10T07:35:07.637881+0000","last_undegraded":"2024-09-10T07:35:07.637881+0000","last_fullsized":"2024-09-10T07:35:07.637881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:26.742871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669800+0000","last_change":"2024-09-10T07:35:05.648380+0000","last_active":"2024-09-10T07:35:08.669800+0000","last_peered":"2024-09-10T07:35:08.669800+0000","last_clean":"2024-09-10T07:35:08.669800+0000","last_became_active":"2024-09-10T07:35:05.648033+0000","last_became_peered":"2024-09-10T07:35:05.648033+0000","last_unstale":"2024-09-10T07:35:08.669800+0000","last_undegraded":"2024-09-10T07:35:08.669800+0000","last_fullsized":"2024-09-10T07:35:08.669800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:29.700582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637540+0000","last_change":"2024-09-10T07:35:06.654470+0000","last_active":"2024-09-10T07:35:07.637540+0000","last_peered":"2024-09-10T07:35:07.637540+0000","last_clean":"2024-09-10T07:35:07.637540+0000","last_became_active":"2024-09-10T07:35:06.653958+0000","last_became_peered":"2024-09-10T07:35:06.653958+0000","last_unstale":"2024-09-10T07:35:07.637540+0000","last_undegraded":"2024-09-10T07:35:07.637540+0000","last_fullsized":"2024-09-10T07:35:07.637540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:09.622125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670354+0000","last_change":"2024-09-10T07:35:05.643070+0000","last_active":"2024-09-10T07:35:08.670354+0000","last_peered":"2024-09-10T07:35:08.670354+0000","last_clean":"2024-09-10T07:35:08.670354+0000","last_became_active":"2024-09-10T07:35:05.642167+0000","last_became_peered":"2024-09-10T07:35:05.642167+0000","last_unstale":"2024-09-10T07:35:08.670354+0000","last_undegraded":"2024-09-10T07:35:08.670354+0000","last_fullsized":"2024-09-10T07:35:08.670354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:23.682444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669809+0000","last_change":"2024-09-10T07:35:06.654610+0000","last_active":"2024-09-10T07:35:08.669809+0000","last_peered":"2024-09-10T07:35:08.669809+0000","last_clean":"2024-09-10T07:35:08.669809+0000","last_became_active":"2024-09-10T07:35:06.654313+0000","last_became_peered":"2024-09-10T07:35:06.654313+0000","last_unstale":"2024-09-10T07:35:08.669809+0000","last_undegraded":"2024-09-10T07:35:08.669809+0000","last_fullsized":"2024-09-10T07:35:08.669809+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:54.966900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637793+0000","last_change":"2024-09-10T07:35:05.641127+0000","last_active":"2024-09-10T07:35:07.637793+0000","last_peered":"2024-09-10T07:35:07.637793+0000","last_clean":"2024-09-10T07:35:07.637793+0000","last_became_active":"2024-09-10T07:35:05.640798+0000","last_became_peered":"2024-09-10T07:35:05.640798+0000","last_unstale":"2024-09-10T07:35:07.637793+0000","last_undegraded":"2024-09-10T07:35:07.637793+0000","last_fullsized":"2024-09-10T07:35:07.637793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:01.567448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669726+0000","last_change":"2024-09-10T07:35:06.645580+0000","last_active":"2024-09-10T07:35:08.669726+0000","last_peered":"2024-09-10T07:35:08.669726+0000","last_clean":"2024-09-10T07:35:08.669726+0000","last_became_active":"2024-09-10T07:35:06.644538+0000","last_became_peered":"2024-09-10T07:35:06.644538+0000","last_unstale":"2024-09-10T07:35:08.669726+0000","last_undegraded":"2024-09-10T07:35:08.669726+0000","last_fullsized":"2024-09-10T07:35:08.669726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:15.573028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670123+0000","last_change":"2024-09-10T07:35:05.644927+0000","last_active":"2024-09-10T07:35:08.670123+0000","last_peered":"2024-09-10T07:35:08.670123+0000","last_clean":"2024-09-10T07:35:08.670123+0000","last_became_active":"2024-09-10T07:35:05.644663+0000","last_became_peered":"2024-09-10T07:35:05.644663+0000","last_unstale":"2024-09-10T07:35:08.670123+0000","last_undegraded":"2024-09-10T07:35:08.670123+0000","last_fullsized":"2024-09-10T07:35:08.670123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:33.254262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980404+0000","last_change":"2024-09-10T07:35:06.644003+0000","last_active":"2024-09-10T07:35:07.980404+0000","last_peered":"2024-09-10T07:35:07.980404+0000","last_clean":"2024-09-10T07:35:07.980404+0000","last_became_active":"2024-09-10T07:35:06.643751+0000","last_became_peered":"2024-09-10T07:35:06.643751+0000","last_unstale":"2024-09-10T07:35:07.980404+0000","last_undegraded":"2024-09-10T07:35:07.980404+0000","last_fullsized":"2024-09-10T07:35:07.980404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:20.398059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669350+0000","last_change":"2024-09-10T07:35:05.646559+0000","last_active":"2024-09-10T07:35:08.669350+0000","last_peered":"2024-09-10T07:35:08.669350+0000","last_clean":"2024-09-10T07:35:08.669350+0000","last_became_active":"2024-09-10T07:35:05.646171+0000","last_became_peered":"2024-09-10T07:35:05.646171+0000","last_unstale":"2024-09-10T07:35:08.669350+0000","last_undegraded":"2024-09-10T07:35:08.669350+0000","last_fullsized":"2024-09-10T07:35:08.669350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:51.687386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670117+0000","last_change":"2024-09-10T07:35:06.637706+0000","last_active":"2024-09-10T07:35:08.670117+0000","last_peered":"2024-09-10T07:35:08.670117+0000","last_clean":"2024-09-10T07:35:08.670117+0000","last_became_active":"2024-09-10T07:35:06.637424+0000","last_became_peered":"2024-09-10T07:35:06.637424+0000","last_unstale":"2024-09-10T07:35:08.670117+0000","last_undegraded":"2024-09-10T07:35:08.670117+0000","last_fullsized":"2024-09-10T07:35:08.670117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:32.601864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637941+0000","last_change":"2024-09-10T07:35:05.645610+0000","last_active":"2024-09-10T07:35:07.637941+0000","last_peered":"2024-09-10T07:35:07.637941+0000","last_clean":"2024-09-10T07:35:07.637941+0000","last_became_active":"2024-09-10T07:35:05.645368+0000","last_became_peered":"2024-09-10T07:35:05.645368+0000","last_unstale":"2024-09-10T07:35:07.637941+0000","last_undegraded":"2024-09-10T07:35:07.637941+0000","last_fullsized":"2024-09-10T07:35:07.637941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:39.034392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637775+0000","last_change":"2024-09-10T07:35:06.637604+0000","last_active":"2024-09-10T07:35:07.637775+0000","last_peered":"2024-09-10T07:35:07.637775+0000","last_clean":"2024-09-10T07:35:07.637775+0000","last_became_active":"2024-09-10T07:35:06.637253+0000","last_became_peered":"2024-09-10T07:35:06.637253+0000","last_unstale":"2024-09-10T07:35:07.637775+0000","last_undegraded":"2024-09-10T07:35:07.637775+0000","last_fullsized":"2024-09-10T07:35:07.637775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:47.200876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670463+0000","last_change":"2024-09-10T07:35:05.643244+0000","last_active":"2024-09-10T07:35:08.670463+0000","last_peered":"2024-09-10T07:35:08.670463+0000","last_clean":"2024-09-10T07:35:08.670463+0000","last_became_active":"2024-09-10T07:35:05.642504+0000","last_became_peered":"2024-09-10T07:35:05.642504+0000","last_unstale":"2024-09-10T07:35:08.670463+0000","last_undegraded":"2024-09-10T07:35:08.670463+0000","last_fullsized":"2024-09-10T07:35:08.670463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:02.872357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637524+0000","last_change":"2024-09-10T07:35:06.659797+0000","last_active":"2024-09-10T07:35:07.637524+0000","last_peered":"2024-09-10T07:35:07.637524+0000","last_clean":"2024-09-10T07:35:07.637524+0000","last_became_active":"2024-09-10T07:35:06.659341+0000","last_became_peered":"2024-09-10T07:35:06.659341+0000","last_unstale":"2024-09-10T07:35:07.637524+0000","last_undegraded":"2024-09-10T07:35:07.637524+0000","last_fullsized":"2024-09-10T07:35:07.637524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:29.555342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670325+0000","last_change":"2024-09-10T07:35:05.641308+0000","last_active":"2024-09-10T07:35:08.670325+0000","last_peered":"2024-09-10T07:35:08.670325+0000","last_clean":"2024-09-10T07:35:08.670325+0000","last_became_active":"2024-09-10T07:35:05.639327+0000","last_became_peered":"2024-09-10T07:35:05.639327+0000","last_unstale":"2024-09-10T07:35:08.670325+0000","last_undegraded":"2024-09-10T07:35:08.670325+0000","last_fullsized":"2024-09-10T07:35:08.670325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:47:14.164283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669069+0000","last_change":"2024-09-10T07:35:06.650570+0000","last_active":"2024-09-10T07:35:08.669069+0000","last_peered":"2024-09-10T07:35:08.669069+0000","last_clean":"2024-09-10T07:35:08.669069+0000","last_became_active":"2024-09-10T07:35:06.650291+0000","last_became_peered":"2024-09-10T07:35:06.650291+0000","last_unstale":"2024-09-10T07:35:08.669069+0000","last_undegraded":"2024-09-10T07:35:08.669069+0000","last_fullsized":"2024-09-10T07:35:08.669069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:29.180286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670475+0000","last_change":"2024-09-10T07:35:05.644709+0000","last_active":"2024-09-10T07:35:08.670475+0000","last_peered":"2024-09-10T07:35:08.670475+0000","last_clean":"2024-09-10T07:35:08.670475+0000","last_became_active":"2024-09-10T07:35:05.644473+0000","last_became_peered":"2024-09-10T07:35:05.644473+0000","last_unstale":"2024-09-10T07:35:08.670475+0000","last_undegraded":"2024-09-10T07:35:08.670475+0000","last_fullsized":"2024-09-10T07:35:08.670475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:27.245873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.668871+0000","last_change":"2024-09-10T07:35:06.643491+0000","last_active":"2024-09-10T07:35:08.668871+0000","last_peered":"2024-09-10T07:35:08.668871+0000","last_clean":"2024-09-10T07:35:08.668871+0000","last_became_active":"2024-09-10T07:35:06.643206+0000","last_became_peered":"2024-09-10T07:35:06.643206+0000","last_unstale":"2024-09-10T07:35:08.668871+0000","last_undegraded":"2024-09-10T07:35:08.668871+0000","last_fullsized":"2024-09-10T07:35:08.668871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:51.985196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634405+0000","last_change":"2024-09-10T07:35:05.648402+0000","last_active":"2024-09-10T07:35:07.634405+0000","last_peered":"2024-09-10T07:35:07.634405+0000","last_clean":"2024-09-10T07:35:07.634405+0000","last_became_active":"2024-09-10T07:35:05.647908+0000","last_became_peered":"2024-09-10T07:35:05.647908+0000","last_unstale":"2024-09-10T07:35:07.634405+0000","last_undegraded":"2024-09-10T07:35:07.634405+0000","last_fullsized":"2024-09-10T07:35:07.634405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:12.984798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669260+0000","last_change":"2024-09-10T07:35:06.657414+0000","last_active":"2024-09-10T07:35:08.669260+0000","last_peered":"2024-09-10T07:35:08.669260+0000","last_clean":"2024-09-10T07:35:08.669260+0000","last_became_active":"2024-09-10T07:35:06.657182+0000","last_became_peered":"2024-09-10T07:35:06.657182+0000","last_unstale":"2024-09-10T07:35:08.669260+0000","last_undegraded":"2024-09-10T07:35:08.669260+0000","last_fullsized":"2024-09-10T07:35:08.669260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:13.152397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980080+0000","last_change":"2024-09-10T07:35:05.645621+0000","last_active":"2024-09-10T07:35:07.980080+0000","last_peered":"2024-09-10T07:35:07.980080+0000","last_clean":"2024-09-10T07:35:07.980080+0000","last_became_active":"2024-09-10T07:35:05.645338+0000","last_became_peered":"2024-09-10T07:35:05.645338+0000","last_unstale":"2024-09-10T07:35:07.980080+0000","last_undegraded":"2024-09-10T07:35:07.980080+0000","last_fullsized":"2024-09-10T07:35:07.980080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:04.640253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669228+0000","last_change":"2024-09-10T07:35:06.658492+0000","last_active":"2024-09-10T07:35:08.669228+0000","last_peered":"2024-09-10T07:35:08.669228+0000","last_clean":"2024-09-10T07:35:08.669228+0000","last_became_active":"2024-09-10T07:35:06.653347+0000","last_became_peered":"2024-09-10T07:35:06.653347+0000","last_unstale":"2024-09-10T07:35:08.669228+0000","last_undegraded":"2024-09-10T07:35:08.669228+0000","last_fullsized":"2024-09-10T07:35:08.669228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:11.463830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670560+0000","last_change":"2024-09-10T07:35:05.647828+0000","last_active":"2024-09-10T07:35:08.670560+0000","last_peered":"2024-09-10T07:35:08.670560+0000","last_clean":"2024-09-10T07:35:08.670560+0000","last_became_active":"2024-09-10T07:35:05.647650+0000","last_became_peered":"2024-09-10T07:35:05.647650+0000","last_unstale":"2024-09-10T07:35:08.670560+0000","last_undegraded":"2024-09-10T07:35:08.670560+0000","last_fullsized":"2024-09-10T07:35:08.670560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:31.460218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669871+0000","last_change":"2024-09-10T07:35:06.648543+0000","last_active":"2024-09-10T07:35:08.669871+0000","last_peered":"2024-09-10T07:35:08.669871+0000","last_clean":"2024-09-10T07:35:08.669871+0000","last_became_active":"2024-09-10T07:35:06.648192+0000","last_became_peered":"2024-09-10T07:35:06.648192+0000","last_unstale":"2024-09-10T07:35:08.669871+0000","last_undegraded":"2024-09-10T07:35:08.669871+0000","last_fullsized":"2024-09-10T07:35:08.669871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:40.068120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637858+0000","last_change":"2024-09-10T07:35:05.644989+0000","last_active":"2024-09-10T07:35:07.637858+0000","last_peered":"2024-09-10T07:35:07.637858+0000","last_clean":"2024-09-10T07:35:07.637858+0000","last_became_active":"2024-09-10T07:35:05.644754+0000","last_became_peered":"2024-09-10T07:35:05.644754+0000","last_unstale":"2024-09-10T07:35:07.637858+0000","last_undegraded":"2024-09-10T07:35:07.637858+0000","last_fullsized":"2024-09-10T07:35:07.637858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:56.364576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669727+0000","last_change":"2024-09-10T07:35:06.653353+0000","last_active":"2024-09-10T07:35:08.669727+0000","last_peered":"2024-09-10T07:35:08.669727+0000","last_clean":"2024-09-10T07:35:08.669727+0000","last_became_active":"2024-09-10T07:35:06.652933+0000","last_became_peered":"2024-09-10T07:35:06.652933+0000","last_unstale":"2024-09-10T07:35:08.669727+0000","last_undegraded":"2024-09-10T07:35:08.669727+0000","last_fullsized":"2024-09-10T07:35:08.669727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:14.554898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637640+0000","last_change":"2024-09-10T07:35:05.647859+0000","last_active":"2024-09-10T07:35:07.637640+0000","last_peered":"2024-09-10T07:35:07.637640+0000","last_clean":"2024-09-10T07:35:07.637640+0000","last_became_active":"2024-09-10T07:35:05.644526+0000","last_became_peered":"2024-09-10T07:35:05.644526+0000","last_unstale":"2024-09-10T07:35:07.637640+0000","last_undegraded":"2024-09-10T07:35:07.637640+0000","last_fullsized":"2024-09-10T07:35:07.637640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:21.046332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.638114+0000","last_change":"2024-09-10T07:35:06.656721+0000","last_active":"2024-09-10T07:35:07.638114+0000","last_peered":"2024-09-10T07:35:07.638114+0000","last_clean":"2024-09-10T07:35:07.638114+0000","last_became_active":"2024-09-10T07:35:06.655910+0000","last_became_peered":"2024-09-10T07:35:06.655910+0000","last_unstale":"2024-09-10T07:35:07.638114+0000","last_undegraded":"2024-09-10T07:35:07.638114+0000","last_fullsized":"2024-09-10T07:35:07.638114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:39.906058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.639585+0000","last_change":"2024-09-10T07:35:05.648734+0000","last_active":"2024-09-10T07:35:07.639585+0000","last_peered":"2024-09-10T07:35:07.639585+0000","last_clean":"2024-09-10T07:35:07.639585+0000","last_became_active":"2024-09-10T07:35:05.648188+0000","last_became_peered":"2024-09-10T07:35:05.648188+0000","last_unstale":"2024-09-10T07:35:07.639585+0000","last_undegraded":"2024-09-10T07:35:07.639585+0000","last_fullsized":"2024-09-10T07:35:07.639585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:13.735576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634211+0000","last_change":"2024-09-10T07:35:06.658302+0000","last_active":"2024-09-10T07:35:07.634211+0000","last_peered":"2024-09-10T07:35:07.634211+0000","last_clean":"2024-09-10T07:35:07.634211+0000","last_became_active":"2024-09-10T07:35:06.658033+0000","last_became_peered":"2024-09-10T07:35:06.658033+0000","last_unstale":"2024-09-10T07:35:07.634211+0000","last_undegraded":"2024-09-10T07:35:07.634211+0000","last_fullsized":"2024-09-10T07:35:07.634211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:38.680322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637953+0000","last_change":"2024-09-10T07:35:05.645410+0000","last_active":"2024-09-10T07:35:07.637953+0000","last_peered":"2024-09-10T07:35:07.637953+0000","last_clean":"2024-09-10T07:35:07.637953+0000","last_became_active":"2024-09-10T07:35:05.644200+0000","last_became_peered":"2024-09-10T07:35:05.644200+0000","last_unstale":"2024-09-10T07:35:07.637953+0000","last_undegraded":"2024-09-10T07:35:07.637953+0000","last_fullsized":"2024-09-10T07:35:07.637953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:51.574368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980563+0000","last_change":"2024-09-10T07:35:06.648742+0000","last_active":"2024-09-10T07:35:07.980563+0000","last_peered":"2024-09-10T07:35:07.980563+0000","last_clean":"2024-09-10T07:35:07.980563+0000","last_became_active":"2024-09-10T07:35:06.647117+0000","last_became_peered":"2024-09-10T07:35:06.647117+0000","last_unstale":"2024-09-10T07:35:07.980563+0000","last_undegraded":"2024-09-10T07:35:07.980563+0000","last_fullsized":"2024-09-10T07:35:07.980563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:16.874553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634505+0000","last_change":"2024-09-10T07:35:05.640409+0000","last_active":"2024-09-10T07:35:07.634505+0000","last_peered":"2024-09-10T07:35:07.634505+0000","last_clean":"2024-09-10T07:35:07.634505+0000","last_became_active":"2024-09-10T07:35:05.640192+0000","last_became_peered":"2024-09-10T07:35:05.640192+0000","last_unstale":"2024-09-10T07:35:07.634505+0000","last_undegraded":"2024-09-10T07:35:07.634505+0000","last_fullsized":"2024-09-10T07:35:07.634505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:42.364573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.634354+0000","last_change":"2024-09-10T07:35:06.646451+0000","last_active":"2024-09-10T07:35:07.634354+0000","last_peered":"2024-09-10T07:35:07.634354+0000","last_clean":"2024-09-10T07:35:07.634354+0000","last_became_active":"2024-09-10T07:35:06.646027+0000","last_became_peered":"2024-09-10T07:35:06.646027+0000","last_unstale":"2024-09-10T07:35:07.634354+0000","last_undegraded":"2024-09-10T07:35:07.634354+0000","last_fullsized":"2024-09-10T07:35:07.634354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:22.632517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.637881+0000","last_change":"2024-09-10T07:35:05.647665+0000","last_active":"2024-09-10T07:35:07.637881+0000","last_peered":"2024-09-10T07:35:07.637881+0000","last_clean":"2024-09-10T07:35:07.637881+0000","last_became_active":"2024-09-10T07:35:05.643475+0000","last_became_peered":"2024-09-10T07:35:05.643475+0000","last_unstale":"2024-09-10T07:35:07.637881+0000","last_undegraded":"2024-09-10T07:35:07.637881+0000","last_fullsized":"2024-09-10T07:35:07.637881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:15.685956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669086+0000","last_change":"2024-09-10T07:35:06.658612+0000","last_active":"2024-09-10T07:35:08.669086+0000","last_peered":"2024-09-10T07:35:08.669086+0000","last_clean":"2024-09-10T07:35:08.669086+0000","last_became_active":"2024-09-10T07:35:06.657799+0000","last_became_peered":"2024-09-10T07:35:06.657799+0000","last_unstale":"2024-09-10T07:35:08.669086+0000","last_undegraded":"2024-09-10T07:35:08.669086+0000","last_fullsized":"2024-09-10T07:35:08.669086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:37.031935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670561+0000","last_change":"2024-09-10T07:35:05.638078+0000","last_active":"2024-09-10T07:35:08.670561+0000","last_peered":"2024-09-10T07:35:08.670561+0000","last_clean":"2024-09-10T07:35:08.670561+0000","last_became_active":"2024-09-10T07:35:05.637854+0000","last_became_peered":"2024-09-10T07:35:05.637854+0000","last_unstale":"2024-09-10T07:35:08.670561+0000","last_undegraded":"2024-09-10T07:35:08.670561+0000","last_fullsized":"2024-09-10T07:35:08.670561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:20.984109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669474+0000","last_change":"2024-09-10T07:35:06.650756+0000","last_active":"2024-09-10T07:35:08.669474+0000","last_peered":"2024-09-10T07:35:08.669474+0000","last_clean":"2024-09-10T07:35:08.669474+0000","last_became_active":"2024-09-10T07:35:06.650515+0000","last_became_peered":"2024-09-10T07:35:06.650515+0000","last_unstale":"2024-09-10T07:35:08.669474+0000","last_undegraded":"2024-09-10T07:35:08.669474+0000","last_fullsized":"2024-09-10T07:35:08.669474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:41.219764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.670083+0000","last_change":"2024-09-10T07:35:05.646694+0000","last_active":"2024-09-10T07:35:08.670083+0000","last_peered":"2024-09-10T07:35:08.670083+0000","last_clean":"2024-09-10T07:35:08.670083+0000","last_became_active":"2024-09-10T07:35:05.646170+0000","last_became_peered":"2024-09-10T07:35:05.646170+0000","last_unstale":"2024-09-10T07:35:08.670083+0000","last_undegraded":"2024-09-10T07:35:08.670083+0000","last_fullsized":"2024-09-10T07:35:08.670083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:27.328243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669960+0000","last_change":"2024-09-10T07:35:06.652239+0000","last_active":"2024-09-10T07:35:08.669960+0000","last_peered":"2024-09-10T07:35:08.669960+0000","last_clean":"2024-09-10T07:35:08.669960+0000","last_became_active":"2024-09-10T07:35:06.652034+0000","last_became_peered":"2024-09-10T07:35:06.652034+0000","last_unstale":"2024-09-10T07:35:08.669960+0000","last_undegraded":"2024-09-10T07:35:08.669960+0000","last_fullsized":"2024-09-10T07:35:08.669960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:05.623246+0000","last_clean_scrub_stamp":"2024-09-10T07:35:05.623246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:25.695802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:07.980221+0000","last_change":"2024-09-10T07:35:05.643440+0000","last_active":"2024-09-10T07:35:07.980221+0000","last_peered":"2024-09-10T07:35:07.980221+0000","last_clean":"2024-09-10T07:35:07.980221+0000","last_became_active":"2024-09-10T07:35:05.643204+0000","last_became_peered":"2024-09-10T07:35:05.643204+0000","last_unstale":"2024-09-10T07:35:07.980221+0000","last_undegraded":"2024-09-10T07:35:07.980221+0000","last_fullsized":"2024-09-10T07:35:07.980221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:04.619989+0000","last_clean_scrub_stamp":"2024-09-10T07:35:04.619989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:46.255699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T07:35:08.669391+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:35:08.669391+0000","last_peered":"2024-09-10T07:35:08.669391+0000","last_clean":"2024-09-10T07:35:08.669391+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:35:08.669391+0000","last_undegraded":"2024-09-10T07:35:08.669391+0000","last_fullsized":"2024-09-10T07:35:08.669391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":701,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194611,"statfs":{"total":200000000,"available":199281876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865418,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865362,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195187,"statfs":{"total":200000000,"available":199872230,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":126,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195186,"statfs":{"total":200000000,"available":199870700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195187,"statfs":{"total":200000000,"available":199872264,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":132,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864400,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199275666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:35:11.283 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:35:11.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T07:35:11.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.479+0000 7fb410800640 1 Processor -- start 2024-09-10T07:35:11.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.479+0000 7fb410800640 1 -- start start 2024-09-10T07:35:11.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.480+0000 7fb410800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb408071df0 0x7fb408073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.480+0000 7fb410800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4080d1010 0x7fb4080ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.480+0000 7fb410800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4080722d0 con 0x7fb40806e280 2024-09-10T07:35:11.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.480+0000 7fb410800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb4080738b0 con 0x7fb408071df0 2024-09-10T07:35:11.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.480+0000 7fb410800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb4080725b0 con 0x7fb4080d1010 2024-09-10T07:35:11.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.481+0000 7fb40d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb408071df0 0x7fb408073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.481+0000 7fb40d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb408071df0 0x7fb408073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49448/0 (socket says 172.21.15.99:49448) 2024-09-10T07:35:11.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.481+0000 7fb40d400640 1 -- 172.21.15.99:0/2733347639 learned_addr learned my addr 172.21.15.99:0/2733347639 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:11.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.481+0000 7fb40e800640 1 --2- 172.21.15.99:0/2733347639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4080d1010 0x7fb4080ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.481+0000 7fb40d400640 1 -- 172.21.15.99:0/2733347639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4080d1010 msgr2=0x7fb4080ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:11.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.481+0000 7fb40d400640 1 --2- 172.21.15.99:0/2733347639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4080d1010 0x7fb4080ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.481+0000 7fb40d400640 1 -- 172.21.15.99:0/2733347639 >> v1:172.21.15.187:6789/0 conn(0x7fb40806e280 legacy=0x7fb40806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.481+0000 7fb40d400640 1 -- 172.21.15.99:0/2733347639 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb408072890 con 0x7fb408071df0 2024-09-10T07:35:11.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.482+0000 7fb40d400640 1 --2- 172.21.15.99:0/2733347639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb408071df0 0x7fb408073370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009870 tx=0x7fb3f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f9124c8c5fce40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:11.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.482+0000 7fb40ca00640 1 -- 172.21.15.99:0/2733347639 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8037070 con 0x7fb408071df0 2024-09-10T07:35:11.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.482+0000 7fb40ca00640 1 -- 172.21.15.99:0/2733347639 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f8032440 con 0x7fb408071df0 2024-09-10T07:35:11.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.482+0000 7fb40ca00640 1 -- 172.21.15.99:0/2733347639 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8032810 con 0x7fb408071df0 2024-09-10T07:35:11.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.483+0000 7fb410800640 1 -- 172.21.15.99:0/2733347639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb408071df0 msgr2=0x7fb408073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.483+0000 7fb410800640 1 --2- 172.21.15.99:0/2733347639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb408071df0 0x7fb408073370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009870 tx=0x7fb3f802a270 comp rx=0 tx=0).stop 2024-09-10T07:35:11.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.483+0000 7fb410800640 1 -- 172.21.15.99:0/2733347639 shutdown_connections 2024-09-10T07:35:11.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.483+0000 7fb410800640 1 --2- 172.21.15.99:0/2733347639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4080d1010 0x7fb4080ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.483+0000 7fb410800640 1 --2- 172.21.15.99:0/2733347639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb408071df0 0x7fb408073370 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.483+0000 7fb410800640 1 -- 172.21.15.99:0/2733347639 >> 172.21.15.99:0/2733347639 conn(0x7fb40806bc10 msgr2=0x7fb40806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:11.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.483+0000 7fb410800640 1 -- 172.21.15.99:0/2733347639 shutdown_connections 2024-09-10T07:35:11.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.483+0000 7fb410800640 1 -- 172.21.15.99:0/2733347639 wait complete. 2024-09-10T07:35:11.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.485+0000 7fb410800640 1 Processor -- start 2024-09-10T07:35:11.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.485+0000 7fb410800640 1 -- start start 2024-09-10T07:35:11.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.485+0000 7fb410800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb40806e280 0x7fb408149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb410800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb408071df0 0x7fb408154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb410800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4080d1010 0x7fb40815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb410800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb40815db60 con 0x7fb4080d1010 2024-09-10T07:35:11.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb410800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb408072e50 con 0x7fb408071df0 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb410800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb4080d14c0 con 0x7fb40806e280 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4080d1010 0x7fb40815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4080d1010 0x7fb40815a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49462/0 (socket says 172.21.15.99:49462) 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40e800640 1 -- 172.21.15.99:0/1410178634 learned_addr learned my addr 172.21.15.99:0/1410178634 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40de00640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb40806e280 0x7fb408149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40d400640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb408071df0 0x7fb408154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40e800640 1 -- 172.21.15.99:0/1410178634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb40806e280 msgr2=0x7fb408149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40e800640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb40806e280 0x7fb408149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40e800640 1 -- 172.21.15.99:0/1410178634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb408071df0 msgr2=0x7fb408154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40e800640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb408071df0 0x7fb408154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40e800640 1 -- 172.21.15.99:0/1410178634 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb408159040 con 0x7fb4080d1010 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.486+0000 7fb40d400640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb408071df0 0x7fb408154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:11.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.487+0000 7fb40e800640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4080d1010 0x7fb40815a850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb404007e60 tx=0x7fb40400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:11.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.487+0000 7fb402000640 1 -- 172.21.15.99:0/1410178634 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404014420 con 0x7fb4080d1010 2024-09-10T07:35:11.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.487+0000 7fb402000640 1 -- 172.21.15.99:0/1410178634 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb404019070 con 0x7fb4080d1010 2024-09-10T07:35:11.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.487+0000 7fb402000640 1 -- 172.21.15.99:0/1410178634 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404014820 con 0x7fb4080d1010 2024-09-10T07:35:11.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.487+0000 7fb410800640 1 -- 172.21.15.99:0/1410178634 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb408159320 con 0x7fb4080d1010 2024-09-10T07:35:11.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.487+0000 7fb410800640 1 -- 172.21.15.99:0/1410178634 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4081598e0 con 0x7fb4080d1010 2024-09-10T07:35:11.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.488+0000 7fb410800640 1 -- 172.21.15.99:0/1410178634 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb408073370 con 0x7fb4080d1010 2024-09-10T07:35:11.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.489+0000 7fb402000640 1 -- 172.21.15.99:0/1410178634 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4040149c0 con 0x7fb4080d1010 2024-09-10T07:35:11.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.490+0000 7fb402000640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3ec06be30 0x7fb3ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.490+0000 7fb402000640 1 -- 172.21.15.99:0/1410178634 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb40408b6c0 con 0x7fb4080d1010 2024-09-10T07:35:11.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.490+0000 7fb40de00640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3ec06be30 0x7fb3ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.490+0000 7fb40de00640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3ec06be30 0x7fb3ec06e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001780 tx=0x7fb3fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:11.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.494+0000 7fb402000640 1 -- 172.21.15.99:0/1410178634 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb404059fd0 con 0x7fb4080d1010 2024-09-10T07:35:11.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.732+0000 7fb410800640 1 -- 172.21.15.99:0/1410178634 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb4080ce490 con 0x7fb4080d1010 2024-09-10T07:35:11.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.734+0000 7fb402000640 1 -- 172.21.15.99:0/1410178634 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fb4040598d0 con 0x7fb4080d1010 2024-09-10T07:35:11.734 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:35:11.734 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:35:11.734 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-09-10T07:35:11.734 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-09-10T07:35:11.734 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T07:35:11.735 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-09-10T07:35:11.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.736+0000 7fb410800640 1 -- 172.21.15.99:0/1410178634 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3ec06be30 msgr2=0x7fb3ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.736+0000 7fb410800640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3ec06be30 0x7fb3ec06e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001780 tx=0x7fb3fc009040 comp rx=0 tx=0).stop 2024-09-10T07:35:11.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.736+0000 7fb410800640 1 -- 172.21.15.99:0/1410178634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4080d1010 msgr2=0x7fb40815a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.736+0000 7fb410800640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4080d1010 0x7fb40815a850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb404007e60 tx=0x7fb40400e4b0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.737+0000 7fb410800640 1 -- 172.21.15.99:0/1410178634 shutdown_connections 2024-09-10T07:35:11.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.737+0000 7fb410800640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3ec06be30 0x7fb3ec06e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.737+0000 7fb410800640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4080d1010 0x7fb40815a850 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.737+0000 7fb410800640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb408071df0 0x7fb408154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.737+0000 7fb410800640 1 --2- 172.21.15.99:0/1410178634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb40806e280 0x7fb408149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.737+0000 7fb410800640 1 -- 172.21.15.99:0/1410178634 >> 172.21.15.99:0/1410178634 conn(0x7fb40806bc10 msgr2=0x7fb40815d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:11.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.737+0000 7fb410800640 1 -- 172.21.15.99:0/1410178634 shutdown_connections 2024-09-10T07:35:11.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.737+0000 7fb410800640 1 -- 172.21.15.99:0/1410178634 wait complete. 2024-09-10T07:35:11.754 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:11.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.908+0000 7f7cf5200640 1 Processor -- start 2024-09-10T07:35:11.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.908+0000 7f7cf5200640 1 -- start start 2024-09-10T07:35:11.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.909+0000 7f7cf5200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 0x7f7cf006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cf5200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cf00b67b0 0x7f7cf006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cf5200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf00b6db0 con 0x7f7cf00ced00 2024-09-10T07:35:11.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cf5200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf00b7070 con 0x7f7cf00b67b0 2024-09-10T07:35:11.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cf5200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf00b1390 con 0x7f7cf015eea0 2024-09-10T07:35:11.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cee800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cf00b67b0 0x7f7cf006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cee800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cf00b67b0 0x7f7cf006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49474/0 (socket says 172.21.15.99:49474) 2024-09-10T07:35:11.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cee800640 1 -- 172.21.15.99:0/3146654537 learned_addr learned my addr 172.21.15.99:0/3146654537 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:11.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cede00640 1 --2- 172.21.15.99:0/3146654537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 0x7f7cf006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cee800640 1 -- 172.21.15.99:0/3146654537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 msgr2=0x7f7cf006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:11.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cee800640 1 --2- 172.21.15.99:0/3146654537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 0x7f7cf006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cee800640 1 -- 172.21.15.99:0/3146654537 >> v1:172.21.15.99:6789/0 conn(0x7f7cf00ced00 legacy=0x7f7cf00b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cee800640 1 -- 172.21.15.99:0/3146654537 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf00b1670 con 0x7f7cf00b67b0 2024-09-10T07:35:11.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7ced400640 1 -- 172.21.15.99:0/3146654537 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179693978 0 0) 0x7f7cf00b6db0 con 0x7f7cf00ced00 2024-09-10T07:35:11.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.910+0000 7f7cede00640 1 --2- 172.21.15.99:0/3146654537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 0x7f7cf006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:11.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.911+0000 7f7cee800640 1 --2- 172.21.15.99:0/3146654537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00b67b0 0x7f7cf006c150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009e50 tx=0x7f7ce802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3421a01247f017 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:11.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7ced400640 1 -- 172.21.15.99:0/3146654537 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8036070 con 0x7f7cf00b67b0 2024-09-10T07:35:11.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7ced400640 1 -- 172.21.15.99:0/3146654537 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce8031600 con 0x7f7cf00b67b0 2024-09-10T07:35:11.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7ced400640 1 -- 172.21.15.99:0/3146654537 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80319d0 con 0x7f7cf00b67b0 2024-09-10T07:35:11.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7cf5200640 1 -- 172.21.15.99:0/3146654537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00b67b0 msgr2=0x7f7cf006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7cf5200640 1 --2- 172.21.15.99:0/3146654537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00b67b0 0x7f7cf006c150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009e50 tx=0x7f7ce802a710 comp rx=0 tx=0).stop 2024-09-10T07:35:11.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7cf5200640 1 -- 172.21.15.99:0/3146654537 shutdown_connections 2024-09-10T07:35:11.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7cf5200640 1 --2- 172.21.15.99:0/3146654537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00b67b0 0x7f7cf006c150 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7cf5200640 1 --2- 172.21.15.99:0/3146654537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 0x7f7cf006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7cf5200640 1 -- 172.21.15.99:0/3146654537 >> 172.21.15.99:0/3146654537 conn(0x7f7cf00731b0 msgr2=0x7f7cf00735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:11.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7cf5200640 1 -- 172.21.15.99:0/3146654537 shutdown_connections 2024-09-10T07:35:11.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.912+0000 7f7cf5200640 1 -- 172.21.15.99:0/3146654537 wait complete. 2024-09-10T07:35:11.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.914+0000 7f7cf5200640 1 Processor -- start 2024-09-10T07:35:11.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.914+0000 7f7cf5200640 1 -- start start 2024-09-10T07:35:11.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.915+0000 7f7cf5200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf00b67b0 0x7f7cf0154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.915+0000 7f7cf5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00ced00 0x7f7cf0160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.915+0000 7f7cf5200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 0x7f7cf0153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.915+0000 7f7cf5200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00b1b90 con 0x7f7cf00ced00 2024-09-10T07:35:11.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.915+0000 7f7cf5200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00b1040 con 0x7f7cf00b67b0 2024-09-10T07:35:11.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.915+0000 7f7cf5200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf00b1d10 con 0x7f7cf015eea0 2024-09-10T07:35:11.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.915+0000 7f7ce5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00ced00 0x7f7cf0160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.915+0000 7f7ce5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00ced00 0x7f7cf0160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49486/0 (socket says 172.21.15.99:49486) 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.915+0000 7f7ce5400640 1 -- 172.21.15.99:0/1667413378 learned_addr learned my addr 172.21.15.99:0/1667413378 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7cee800640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 0x7f7cf0153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7cede00640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf00b67b0 0x7f7cf0154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7ce5400640 1 -- 172.21.15.99:0/1667413378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 msgr2=0x7f7cf0153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7ce5400640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 0x7f7cf0153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7ce5400640 1 -- 172.21.15.99:0/1667413378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf00b67b0 msgr2=0x7f7cf0154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7ce5400640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf00b67b0 0x7f7cf0154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7ce5400640 1 -- 172.21.15.99:0/1667413378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf0154940 con 0x7f7cf00ced00 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7cee800640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 0x7f7cf0153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7cede00640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf00b67b0 0x7f7cf0154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7ce5400640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00ced00 0x7f7cf0160120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800c4e0 tx=0x7f7cd800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:11.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7ce6a00640 1 -- 172.21.15.99:0/1667413378 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8017070 con 0x7f7cf00ced00 2024-09-10T07:35:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7ce6a00640 1 -- 172.21.15.99:0/1667413378 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd80035f0 con 0x7f7cf00ced00 2024-09-10T07:35:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7ce6a00640 1 -- 172.21.15.99:0/1667413378 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80039e0 con 0x7f7cf00ced00 2024-09-10T07:35:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7cf5200640 1 -- 172.21.15.99:0/1667413378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf0154c20 con 0x7f7cf00ced00 2024-09-10T07:35:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.916+0000 7f7cf5200640 1 -- 172.21.15.99:0/1667413378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf01551e0 con 0x7f7cf00ced00 2024-09-10T07:35:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.917+0000 7f7cf5200640 1 -- 172.21.15.99:0/1667413378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf00b60a0 con 0x7f7cf00ced00 2024-09-10T07:35:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.918+0000 7f7ce6a00640 1 -- 172.21.15.99:0/1667413378 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cd801a070 con 0x7f7cf00ced00 2024-09-10T07:35:11.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.919+0000 7f7ce6a00640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ccc06be30 0x7f7ccc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:11.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.919+0000 7f7ce6a00640 1 -- 172.21.15.99:0/1667413378 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f7cd808a0a0 con 0x7f7cf00ced00 2024-09-10T07:35:11.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.919+0000 7f7cede00640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ccc06be30 0x7f7ccc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:11.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.920+0000 7f7cede00640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ccc06be30 0x7f7ccc06e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0006fd0 tx=0x7f7ce0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:11.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:11.924+0000 7f7ce6a00640 1 -- 172.21.15.99:0/1667413378 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7cd8058490 con 0x7f7cf00ced00 2024-09-10T07:35:12.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.132+0000 7f7cf5200640 1 -- 172.21.15.99:0/1667413378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cf0074080 con 0x7f7cf00ced00 2024-09-10T07:35:12.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.133+0000 7f7ce6a00640 1 -- 172.21.15.99:0/1667413378 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f7cd805c790 con 0x7f7cf00ced00 2024-09-10T07:35:12.133 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:12.133 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"btime":"2024-09-10T07:35:09:706532+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3299804861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3299804861},{"type":"v1","addr":"172.21.15.187:6834","nonce":3299804861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/4173112208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4173112208},{"type":"v1","addr":"172.21.15.187:6835","nonce":4173112208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4740,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2963379591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2963379591},{"type":"v1","addr":"172.21.15.99:6835","nonce":2963379591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:06.038065+0000","modified":"2024-09-10T07:35:09.110775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4743":{"gid":4743,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/4168486217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":4168486217},{"type":"v1","addr":"172.21.15.99:6837","nonce":4168486217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4743,"qdb_cluster":[4743]},"id":2}]} 2024-09-10T07:35:12.134 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-09-10T07:35:12.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.135+0000 7f7cf5200640 1 -- 172.21.15.99:0/1667413378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ccc06be30 msgr2=0x7f7ccc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.135+0000 7f7cf5200640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ccc06be30 0x7f7ccc06e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0006fd0 tx=0x7f7ce0008040 comp rx=0 tx=0).stop 2024-09-10T07:35:12.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.135+0000 7f7cf5200640 1 -- 172.21.15.99:0/1667413378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00ced00 msgr2=0x7f7cf0160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.135+0000 7f7cf5200640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00ced00 0x7f7cf0160120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800c4e0 tx=0x7f7cd800c9a0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.135+0000 7f7cf5200640 1 -- 172.21.15.99:0/1667413378 shutdown_connections 2024-09-10T07:35:12.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.135+0000 7f7cf5200640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cf015eea0 0x7f7cf0153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.135+0000 7f7cf5200640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ccc06be30 0x7f7ccc06e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.135+0000 7f7cf5200640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cf00ced00 0x7f7cf0160120 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.135+0000 7f7cf5200640 1 --2- 172.21.15.99:0/1667413378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf00b67b0 0x7f7cf0154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.135+0000 7f7cf5200640 1 -- 172.21.15.99:0/1667413378 >> 172.21.15.99:0/1667413378 conn(0x7f7cf00731b0 msgr2=0x7f7cf00cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:12.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.136+0000 7f7cf5200640 1 -- 172.21.15.99:0/1667413378 shutdown_connections 2024-09-10T07:35:12.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.136+0000 7f7cf5200640 1 -- 172.21.15.99:0/1667413378 wait complete. 2024-09-10T07:35:12.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:35:06.038065+0000', 'modified': '2024-09-10T07:35:09.110775+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4743}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4743': {'gid': 4743, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/4168486217', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 4168486217}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 4168486217}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4743, 'qdb_cluster': [4743]} 2024-09-10T07:35:12.555 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:35:12.555 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T07:35:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.711+0000 7fec62600640 1 Processor -- start 2024-09-10T07:35:12.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.711+0000 7fec62600640 1 -- start start 2024-09-10T07:35:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.712+0000 7fec62600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fec5c15db60 0x7fec5c071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.712+0000 7fec62600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec5c0724d0 0x7fec5c06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.712+0000 7fec62600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec5c06e580 0x7fec5c160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.712+0000 7fec62600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fec5c15df40 con 0x7fec5c06e580 2024-09-10T07:35:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.712+0000 7fec62600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fec5c06e9b0 con 0x7fec5c15db60 2024-09-10T07:35:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.712+0000 7fec62600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fec5c153e50 con 0x7fec5c0724d0 2024-09-10T07:35:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.712+0000 7fec5be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec5c06e580 0x7fec5c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.712+0000 7fec5be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec5c06e580 0x7fec5c160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49492/0 (socket says 172.21.15.99:49492) 2024-09-10T07:35:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.712+0000 7fec5be00640 1 -- 172.21.15.99:0/3230667022 learned_addr learned my addr 172.21.15.99:0/3230667022 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:12.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.713+0000 7fec5b400640 1 --2- 172.21.15.99:0/3230667022 >> v2:172.21.15.187:3300/0 conn(0x7fec5c15db60 0x7fec5c071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.713+0000 7fec5be00640 1 -- 172.21.15.99:0/3230667022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec5c0724d0 msgr2=0x7fec5c06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.713+0000 7fec5be00640 1 --2- 172.21.15.99:0/3230667022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec5c0724d0 0x7fec5c06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.713+0000 7fec5be00640 1 -- 172.21.15.99:0/3230667022 >> v2:172.21.15.187:3300/0 conn(0x7fec5c15db60 msgr2=0x7fec5c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.713+0000 7fec5be00640 1 --2- 172.21.15.99:0/3230667022 >> v2:172.21.15.187:3300/0 conn(0x7fec5c15db60 0x7fec5c071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.713+0000 7fec5be00640 1 -- 172.21.15.99:0/3230667022 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c072ac0 con 0x7fec5c06e580 2024-09-10T07:35:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.713+0000 7fec5b400640 1 --2- 172.21.15.99:0/3230667022 >> v2:172.21.15.187:3300/0 conn(0x7fec5c15db60 0x7fec5c071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.714+0000 7fec5be00640 1 --2- 172.21.15.99:0/3230667022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 0x7fec5c160580 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec5c073f30 tx=0x7fec5402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabca536a31605b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.714+0000 7fec5aa00640 1 -- 172.21.15.99:0/3230667022 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54036070 con 0x7fec5c06e580 2024-09-10T07:35:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.714+0000 7fec5aa00640 1 -- 172.21.15.99:0/3230667022 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54031600 con 0x7fec5c06e580 2024-09-10T07:35:12.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.714+0000 7fec5aa00640 1 -- 172.21.15.99:0/3230667022 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540319d0 con 0x7fec5c06e580 2024-09-10T07:35:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.714+0000 7fec62600640 1 -- 172.21.15.99:0/3230667022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 msgr2=0x7fec5c160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.714+0000 7fec62600640 1 --2- 172.21.15.99:0/3230667022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 0x7fec5c160580 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec5c073f30 tx=0x7fec5402a6c0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.715+0000 7fec62600640 1 -- 172.21.15.99:0/3230667022 shutdown_connections 2024-09-10T07:35:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.715+0000 7fec62600640 1 --2- 172.21.15.99:0/3230667022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec5c0724d0 0x7fec5c06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.715+0000 7fec62600640 1 --2- 172.21.15.99:0/3230667022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 0x7fec5c160580 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.715+0000 7fec62600640 1 --2- 172.21.15.99:0/3230667022 >> v2:172.21.15.187:3300/0 conn(0x7fec5c15db60 0x7fec5c071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.715+0000 7fec62600640 1 -- 172.21.15.99:0/3230667022 >> 172.21.15.99:0/3230667022 conn(0x7fec5c0b2630 msgr2=0x7fec5c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:12.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.715+0000 7fec62600640 1 -- 172.21.15.99:0/3230667022 shutdown_connections 2024-09-10T07:35:12.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.715+0000 7fec62600640 1 -- 172.21.15.99:0/3230667022 wait complete. 2024-09-10T07:35:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.716+0000 7fec62600640 1 Processor -- start 2024-09-10T07:35:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.716+0000 7fec62600640 1 -- start start 2024-09-10T07:35:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.717+0000 7fec62600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 0x7fec5c14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.717+0000 7fec62600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec5c0724d0 0x7fec5c14f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.717+0000 7fec62600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec5c15db60 0x7fec5c155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.717+0000 7fec62600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c073360 con 0x7fec5c06e580 2024-09-10T07:35:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.717+0000 7fec62600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c073080 con 0x7fec5c0724d0 2024-09-10T07:35:12.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.717+0000 7fec62600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fec5c073640 con 0x7fec5c15db60 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.717+0000 7fec5b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 0x7fec5c14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.717+0000 7fec5b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 0x7fec5c14bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49508/0 (socket says 172.21.15.99:49508) 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.717+0000 7fec5b400640 1 -- 172.21.15.99:0/3761360476 learned_addr learned my addr 172.21.15.99:0/3761360476 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec5be00640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec5c15db60 0x7fec5c155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec52a00640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec5c0724d0 0x7fec5c14f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec5b400640 1 -- 172.21.15.99:0/3761360476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec5c15db60 msgr2=0x7fec5c155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec5b400640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec5c15db60 0x7fec5c155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec5b400640 1 -- 172.21.15.99:0/3761360476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec5c0724d0 msgr2=0x7fec5c14f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec5b400640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec5c0724d0 0x7fec5c14f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec5b400640 1 -- 172.21.15.99:0/3761360476 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c14c1e0 con 0x7fec5c06e580 2024-09-10T07:35:12.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec5be00640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec5c15db60 0x7fec5c155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec52a00640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec5c0724d0 0x7fec5c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec5b400640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 0x7fec5c14bca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00c7f0 tx=0x7fec4c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec53e00640 1 -- 172.21.15.99:0/3761360476 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c015070 con 0x7fec5c06e580 2024-09-10T07:35:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec53e00640 1 -- 172.21.15.99:0/3761360476 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4c007820 con 0x7fec5c06e580 2024-09-10T07:35:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec62600640 1 -- 172.21.15.99:0/3761360476 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c14df70 con 0x7fec5c06e580 2024-09-10T07:35:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.718+0000 7fec53e00640 1 -- 172.21.15.99:0/3761360476 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c007bd0 con 0x7fec5c06e580 2024-09-10T07:35:12.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.719+0000 7fec62600640 1 -- 172.21.15.99:0/3761360476 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c14e810 con 0x7fec5c06e580 2024-09-10T07:35:12.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.721+0000 7fec53e00640 1 -- 172.21.15.99:0/3761360476 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec4c018070 con 0x7fec5c06e580 2024-09-10T07:35:12.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.721+0000 7fec53e00640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec3806be30 0x7fec3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.722+0000 7fec53e00640 1 -- 172.21.15.99:0/3761360476 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fec4c08afe0 con 0x7fec5c06e580 2024-09-10T07:35:12.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.722+0000 7fec52a00640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec3806be30 0x7fec3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.722+0000 7fec653d8740 1 Processor -- start 2024-09-10T07:35:12.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.722+0000 7fec653d8740 1 -- start start 2024-09-10T07:35:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.723+0000 7fec52a00640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec3806be30 0x7fec3806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0cfc50 tx=0x7fec44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.723+0000 7fec653d8740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 0x5575eb8e3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.723+0000 7fec653d8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89b4b0 0x5575eb89e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.723+0000 7fec653d8740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89f480 0x5575eb898570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.723+0000 7fec653d8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5575eb7fc3b0 con 0x5575eb89b4b0 2024-09-10T07:35:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.723+0000 7fec653d8740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x5575eb801410 con 0x5575eb89dcf0 2024-09-10T07:35:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.723+0000 7fec653d8740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x5575eb7a9620 con 0x5575eb89f480 2024-09-10T07:35:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec52a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89b4b0 0x5575eb89e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec5b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 0x5575eb8e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec5be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89f480 0x5575eb898570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec5b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 0x5575eb8e3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:34946/0 (socket says 172.21.15.99:34946) 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec5b400640 1 -- 172.21.15.99:0/593174804 learned_addr learned my addr 172.21.15.99:0/593174804 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec5b400640 1 -- 172.21.15.99:0/593174804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89f480 msgr2=0x5575eb898570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec5b400640 1 --2- 172.21.15.99:0/593174804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89f480 0x5575eb898570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec5b400640 1 -- 172.21.15.99:0/593174804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89b4b0 msgr2=0x5575eb89e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec5b400640 1 --2- 172.21.15.99:0/593174804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89b4b0 0x5575eb89e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec5b400640 1 -- 172.21.15.99:0/593174804 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575eb5142d0 con 0x5575eb89dcf0 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec52a00640 1 --2- 172.21.15.99:0/593174804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89b4b0 0x5575eb89e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:12.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.724+0000 7fec5b400640 1 --2- 172.21.15.99:0/593174804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 0x5575eb8e3490 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec4c059a90 tx=0x7fec4c058e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52330de5e2e01166 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.727+0000 7fec4be00640 1 -- 172.21.15.99:0/593174804 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c01f040 con 0x5575eb89dcf0 2024-09-10T07:35:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.727+0000 7fec4be00640 1 -- 172.21.15.99:0/593174804 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4c057510 con 0x5575eb89dcf0 2024-09-10T07:35:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.727+0000 7fec4be00640 1 -- 172.21.15.99:0/593174804 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c055880 con 0x5575eb89dcf0 2024-09-10T07:35:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.728+0000 7fec653d8740 1 -- 172.21.15.99:0/593174804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 msgr2=0x5575eb8e3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.728+0000 7fec653d8740 1 --2- 172.21.15.99:0/593174804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 0x5575eb8e3490 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec4c059a90 tx=0x7fec4c058e80 comp rx=0 tx=0).stop 2024-09-10T07:35:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.728+0000 7fec653d8740 1 -- 172.21.15.99:0/593174804 shutdown_connections 2024-09-10T07:35:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.728+0000 7fec653d8740 1 --2- 172.21.15.99:0/593174804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89f480 0x5575eb898570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.728+0000 7fec653d8740 1 --2- 172.21.15.99:0/593174804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89b4b0 0x5575eb89e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.728+0000 7fec653d8740 1 --2- 172.21.15.99:0/593174804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 0x5575eb8e3490 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.728+0000 7fec653d8740 1 -- 172.21.15.99:0/593174804 >> 172.21.15.99:0/593174804 conn(0x5575eb89a740 msgr2=0x5575eb8e2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.728+0000 7fec653d8740 1 -- 172.21.15.99:0/593174804 shutdown_connections 2024-09-10T07:35:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.728+0000 7fec653d8740 1 -- 172.21.15.99:0/593174804 wait complete. 2024-09-10T07:35:12.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.729+0000 7fec653d8740 1 -- start start 2024-09-10T07:35:12.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.729+0000 7fec653d8740 1 Processor -- start 2024-09-10T07:35:12.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec653d8740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89dcf0 0x5575eb8c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec653d8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89f480 0x5575eb8f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec653d8740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb8c21b0 0x5575eb8f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec653d8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5575eb7bc780 con 0x5575eb89f480 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec653d8740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x5575eb7fd3d0 con 0x5575eb8c21b0 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec653d8740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x5575eb899be0 con 0x5575eb89dcf0 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec653d8740 10 client.0 _ll_register_callbacks cb 0x5575eb7fa5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec52a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89f480 0x5575eb8f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec52a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89f480 0x5575eb8f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49528/0 (socket says 172.21.15.99:49528) 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec52a00640 1 -- 172.21.15.99:0/3398902136 learned_addr learned my addr 172.21.15.99:0/3398902136 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec5b400640 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89dcf0 0x5575eb8c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.730+0000 7fec5be00640 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb8c21b0 0x5575eb8f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.731+0000 7fec52a00640 1 -- 172.21.15.99:0/3398902136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89dcf0 msgr2=0x5575eb8c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.731+0000 7fec52a00640 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89dcf0 0x5575eb8c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.731+0000 7fec52a00640 1 -- 172.21.15.99:0/3398902136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb8c21b0 msgr2=0x5575eb8f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.731+0000 7fec52a00640 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb8c21b0 0x5575eb8f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.731+0000 7fec52a00640 1 -- 172.21.15.99:0/3398902136 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575eb5de6b0 con 0x5575eb89f480 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.731+0000 7fec52a00640 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89f480 0x5575eb8f5e70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec4400df70 tx=0x7fec440047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b842ded97b77545 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.731+0000 7fec48c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.731+0000 7fec48c00640 1 -- 172.21.15.99:0/3398902136 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec440125f0 con 0x5575eb89f480 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.731+0000 7fec48c00640 1 -- 172.21.15.99:0/3398902136 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fec4400f040 con 0x5575eb89f480 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.731+0000 7fec653d8740 1 -- 172.21.15.99:0/3398902136 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec4c057510 con 0x5575eb89f480 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec48c00640 1 -- 172.21.15.99:0/3398902136 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fec4402d050 con 0x5575eb89f480 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec653d8740 10 client.4908 fetch_fsmap learned FSMap version 16 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec653d8740 1 -- 172.21.15.99:0/3398902136 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5575eb8c6200 con 0x5575eb89f480 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec48c00640 1 -- 172.21.15.99:0/3398902136 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4c057510 con 0x5575eb89f480 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec48c00640 1 -- 172.21.15.99:0/3398902136 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fec44030020 con 0x5575eb89f480 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec653d8740 10 client.4908 fetch_fsmap finished waiting for FSMap version 16 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec653d8740 10 client.4908 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T07:35:12.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec653d8740 20 client.4908 populate_metadata read hostname 'smithi099' 2024-09-10T07:35:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec653d8740 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.99:6836/4168486217,v1:172.21.15.99:6837/4168486217] conn(0x5575eb8f2fa0 0x5575eb8f3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec653d8740 4 client.4908 mds_command: new command op to 4743 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:35:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec653d8740 1 -- 172.21.15.99:0/3398902136 --> [v2:172.21.15.99:6836/4168486217,v1:172.21.15.99:6837/4168486217] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575eb80eb40 con 0x5575eb8f2fa0 2024-09-10T07:35:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.732+0000 7fec5b400640 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.99:6836/4168486217,v1:172.21.15.99:6837/4168486217] conn(0x5575eb8f2fa0 0x5575eb8f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.733+0000 7fec5b400640 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.99:6836/4168486217,v1:172.21.15.99:6837/4168486217] conn(0x5575eb8f2fa0 0x5575eb8f3380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f729ff276fb8c795 server_cookie=f169bac863286139 in_seq=0 out_seq=0 2024-09-10T07:35:12.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.733+0000 7fec48c00640 10 client.4908 ms_handle_connect on v2:172.21.15.99:6836/4168486217 2024-09-10T07:35:12.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.733+0000 7fec48c00640 1 -- 172.21.15.99:0/3398902136 <== mds.0 v2:172.21.15.99:6836/4168486217 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575eb80eb40 con 0x5575eb8f2fa0 2024-09-10T07:35:12.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.733+0000 7fec48c00640 10 client.4908 handle_command_reply: tid=0 2024-09-10T07:35:12.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 client.4908 shutdown 2024-09-10T07:35:12.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 -- 172.21.15.99:0/3398902136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89f480 msgr2=0x5575eb8f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89f480 0x5575eb8f5e70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec4400df70 tx=0x7fec440047d0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 -- 172.21.15.99:0/3398902136 shutdown_connections 2024-09-10T07:35:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.99:6836/4168486217,v1:172.21.15.99:6837/4168486217] conn(0x5575eb8f2fa0 0x5575eb8f3380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb8c21b0 0x5575eb8f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb89f480 0x5575eb8f5e70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 --2- 172.21.15.99:0/3398902136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89dcf0 0x5575eb8c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec48c00640 0 client.4908 ms_handle_reset on v2:172.21.15.99:6836/4168486217 2024-09-10T07:35:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 -- 172.21.15.99:0/3398902136 >> 172.21.15.99:0/3398902136 conn(0x5575eb89b4b0 msgr2=0x5575eb8e1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:12.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 -- 172.21.15.99:0/3398902136 shutdown_connections 2024-09-10T07:35:12.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 1 -- 172.21.15.99:0/3398902136 wait complete. 2024-09-10T07:35:12.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.734+0000 7fec653d8740 20 client.4908 trim_cache size 0 max 16384 2024-09-10T07:35:12.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.753+0000 7fec653d8740 1 Processor -- start 2024-09-10T07:35:12.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.753+0000 7fec653d8740 1 -- start start 2024-09-10T07:35:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.753+0000 7fec653d8740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 0x5575eb8deb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.753+0000 7fec653d8740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89f480 0x5575eb8e0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.753+0000 7fec653d8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb906310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.753+0000 7fec653d8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c1fef80 con 0x5575eb8c21b0 2024-09-10T07:35:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.753+0000 7fec653d8740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c155800 con 0x5575eb89dcf0 2024-09-10T07:35:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.753+0000 7fec653d8740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fec5c154b60 con 0x5575eb89f480 2024-09-10T07:35:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec5be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb906310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec5be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb906310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49532/0 (socket says 172.21.15.99:49532) 2024-09-10T07:35:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec5be00640 1 -- 172.21.15.99:0/4087453166 learned_addr learned my addr 172.21.15.99:0/4087453166 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec52a00640 1 --2- 172.21.15.99:0/4087453166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89f480 0x5575eb8e0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec5b400640 1 --2- 172.21.15.99:0/4087453166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 0x5575eb8deb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec5be00640 1 -- 172.21.15.99:0/4087453166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89f480 msgr2=0x5575eb8e0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec5be00640 1 --2- 172.21.15.99:0/4087453166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89f480 0x5575eb8e0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec5be00640 1 -- 172.21.15.99:0/4087453166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 msgr2=0x5575eb8deb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec5be00640 1 --2- 172.21.15.99:0/4087453166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 0x5575eb8deb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec5be00640 1 -- 172.21.15.99:0/4087453166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575eb8f48e0 con 0x5575eb8c21b0 2024-09-10T07:35:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.754+0000 7fec5be00640 1 --2- 172.21.15.99:0/4087453166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb906310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec54034040 tx=0x7fec5402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107cda43a7c7f493 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:12.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.755+0000 7fec4b400640 1 -- 172.21.15.99:0/4087453166 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54036040 con 0x5575eb8c21b0 2024-09-10T07:35:12.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.755+0000 7fec4b400640 1 -- 172.21.15.99:0/4087453166 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540319d0 con 0x5575eb8c21b0 2024-09-10T07:35:12.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.755+0000 7fec4b400640 1 -- 172.21.15.99:0/4087453166 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54031da0 con 0x5575eb8c21b0 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.755+0000 7fec653d8740 1 -- 172.21.15.99:0/4087453166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 msgr2=0x5575eb906310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.755+0000 7fec653d8740 1 --2- 172.21.15.99:0/4087453166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb906310 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec54034040 tx=0x7fec5402e000 comp rx=0 tx=0).stop 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.755+0000 7fec653d8740 1 -- 172.21.15.99:0/4087453166 shutdown_connections 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.755+0000 7fec653d8740 1 --2- 172.21.15.99:0/4087453166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb906310 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.755+0000 7fec653d8740 1 --2- 172.21.15.99:0/4087453166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89f480 0x5575eb8e0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.755+0000 7fec653d8740 1 --2- 172.21.15.99:0/4087453166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89dcf0 0x5575eb8deb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.756+0000 7fec653d8740 1 -- 172.21.15.99:0/4087453166 >> 172.21.15.99:0/4087453166 conn(0x5575eb89b4b0 msgr2=0x5575eb8f4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.756+0000 7fec653d8740 1 -- 172.21.15.99:0/4087453166 shutdown_connections 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.756+0000 7fec653d8740 1 -- 172.21.15.99:0/4087453166 wait complete. 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.756+0000 7fec653d8740 1 -- start start 2024-09-10T07:35:12.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.756+0000 7fec653d8740 1 Processor -- start 2024-09-10T07:35:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.757+0000 7fec653d8740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89dcf0 0x5575eb8e9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.757+0000 7fec653d8740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89f480 0x5575eb964660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.757+0000 7fec653d8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb9069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.757+0000 7fec653d8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5575eb8c69e0 con 0x5575eb8c21b0 2024-09-10T07:35:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.757+0000 7fec653d8740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c1551b0 con 0x5575eb89f480 2024-09-10T07:35:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.757+0000 7fec653d8740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x5575eb8f4dd0 con 0x5575eb89dcf0 2024-09-10T07:35:12.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.757+0000 7fec653d8740 10 client.0 _ll_register_callbacks cb 0x7fec4400d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec5be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb9069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec5be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb9069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49536/0 (socket says 172.21.15.99:49536) 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec5be00640 1 -- 172.21.15.99:0/923669974 learned_addr learned my addr 172.21.15.99:0/923669974 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec52a00640 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89f480 0x5575eb964660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec5b400640 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89dcf0 0x5575eb8e9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec5be00640 1 -- 172.21.15.99:0/923669974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89dcf0 msgr2=0x5575eb8e9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec5be00640 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89dcf0 0x5575eb8e9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec5be00640 1 -- 172.21.15.99:0/923669974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89f480 msgr2=0x5575eb964660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec5be00640 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89f480 0x5575eb964660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec5be00640 1 -- 172.21.15.99:0/923669974 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575eb8989b0 con 0x5575eb8c21b0 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec5be00640 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb9069d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec5402acb0 tx=0x7fec54004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219256c496b44809 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.758+0000 7fec48c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:35:12.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec48c00640 1 -- 172.21.15.99:0/923669974 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54036070 con 0x5575eb8c21b0 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec48c00640 1 -- 172.21.15.99:0/923669974 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fec54003990 con 0x5575eb8c21b0 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec653d8740 1 -- 172.21.15.99:0/923669974 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec540319d0 con 0x5575eb8c21b0 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec48c00640 1 -- 172.21.15.99:0/923669974 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fec54059050 con 0x5575eb8c21b0 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec653d8740 10 client.4914 fetch_fsmap learned FSMap version 16 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec653d8740 1 -- 172.21.15.99:0/923669974 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5575eb8c4c00 con 0x5575eb8c21b0 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec48c00640 1 -- 172.21.15.99:0/923669974 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540319d0 con 0x5575eb8c21b0 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec48c00640 1 -- 172.21.15.99:0/923669974 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fec5405c020 con 0x5575eb8c21b0 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec653d8740 10 client.4914 fetch_fsmap finished waiting for FSMap version 16 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec653d8740 10 client.4914 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec653d8740 20 client.4914 populate_metadata read hostname 'smithi099' 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec653d8740 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.99:6836/4168486217,v1:172.21.15.99:6837/4168486217] conn(0x5575eb8982e0 0x5575eb8f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec653d8740 4 client.4914 mds_command: new command op to 4743 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.759+0000 7fec653d8740 1 -- 172.21.15.99:0/923669974 --> [v2:172.21.15.99:6836/4168486217,v1:172.21.15.99:6837/4168486217] -- command(tid 0: {"prefix": "status"}) -- 0x5575eb808e90 con 0x5575eb8982e0 2024-09-10T07:35:12.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.760+0000 7fec5b400640 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.99:6836/4168486217,v1:172.21.15.99:6837/4168486217] conn(0x5575eb8982e0 0x5575eb8f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.760+0000 7fec5b400640 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.99:6836/4168486217,v1:172.21.15.99:6837/4168486217] conn(0x5575eb8982e0 0x5575eb8f0ef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7948196473d78933 server_cookie=abcd77dd4dbd7a4c in_seq=0 out_seq=0 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.760+0000 7fec48c00640 10 client.4914 ms_handle_connect on v2:172.21.15.99:6836/4168486217 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.760+0000 7fec48c00640 1 -- 172.21.15.99:0/923669974 <== mds.0 v2:172.21.15.99:6836/4168486217 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5575eb808e90 con 0x5575eb8982e0 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.760+0000 7fec48c00640 10 client.4914 handle_command_reply: tid=0 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.760+0000 7fec653d8740 1 client.4914 shutdown 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 1 -- 172.21.15.99:0/923669974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 msgr2=0x5575eb9069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb9069d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec5402acb0 tx=0x7fec54004ab0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 1 -- 172.21.15.99:0/923669974 shutdown_connections 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.99:6836/4168486217,v1:172.21.15.99:6837/4168486217] conn(0x5575eb8982e0 0x5575eb8f0ef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575eb8c21b0 0x5575eb9069d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5575eb89f480 0x5575eb964660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec48c00640 0 client.4914 ms_handle_reset on v2:172.21.15.99:6836/4168486217 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 1 --2- 172.21.15.99:0/923669974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5575eb89dcf0 0x5575eb8e9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 1 -- 172.21.15.99:0/923669974 >> 172.21.15.99:0/923669974 conn(0x5575eb89b4b0 msgr2=0x5575eb8f5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:12.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 1 -- 172.21.15.99:0/923669974 shutdown_connections 2024-09-10T07:35:12.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 1 -- 172.21.15.99:0/923669974 wait complete. 2024-09-10T07:35:12.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec653d8740 20 client.4914 trim_cache size 0 max 16384 2024-09-10T07:35:12.765 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:35:12.765 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:35:12.765 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:35:12.765 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4743, 2024-09-10T07:35:12.765 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:35:12.766 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:35:12.766 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:35:12.766 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 6.1294825020000001, 2024-09-10T07:35:12.766 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 16, 2024-09-10T07:35:12.766 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 31, 2024-09-10T07:35:12.766 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 31, 2024-09-10T07:35:12.766 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 13.523888557999999 2024-09-10T07:35:12.766 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:35:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec62600640 1 -- 172.21.15.99:0/3761360476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec3806be30 msgr2=0x7fec3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec62600640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec3806be30 0x7fec3806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0cfc50 tx=0x7fec44008040 comp rx=0 tx=0).stop 2024-09-10T07:35:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec62600640 1 -- 172.21.15.99:0/3761360476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 msgr2=0x7fec5c14bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.761+0000 7fec62600640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 0x7fec5c14bca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00c7f0 tx=0x7fec4c00ccb0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.762+0000 7fec62600640 1 -- 172.21.15.99:0/3761360476 shutdown_connections 2024-09-10T07:35:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.762+0000 7fec62600640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec5c15db60 0x7fec5c155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.762+0000 7fec62600640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec5c0724d0 0x7fec5c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.762+0000 7fec62600640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec3806be30 0x7fec3806e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.762+0000 7fec62600640 1 --2- 172.21.15.99:0/3761360476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec5c06e580 0x7fec5c14bca0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.762+0000 7fec62600640 1 -- 172.21.15.99:0/3761360476 >> 172.21.15.99:0/3761360476 conn(0x7fec5c0b2630 msgr2=0x7fec5c0b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:12.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.762+0000 7fec62600640 1 -- 172.21.15.99:0/3761360476 shutdown_connections 2024-09-10T07:35:12.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.762+0000 7fec62600640 1 -- 172.21.15.99:0/3761360476 wait complete. 2024-09-10T07:35:12.778 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:35:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.930+0000 7f12d0000640 1 Processor -- start 2024-09-10T07:35:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.930+0000 7f12d0000640 1 -- start start 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.931+0000 7f12d0000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c813fae0 0x7f12c806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.931+0000 7f12d0000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f12c8142150 0x7f12c8160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.931+0000 7f12d0000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12c8160a80 0x7f12c815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12d0000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f12c80ce780 con 0x7f12c8160a80 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12d0000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f12c8142650 con 0x7f12c8142150 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12d0000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f12c8142930 con 0x7f12c813fae0 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12ce000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12c8160a80 0x7f12c815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12ccc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f12c8142150 0x7f12c8160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12ce000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12c8160a80 0x7f12c815cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49544/0 (socket says 172.21.15.99:49544) 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12ce000640 1 -- 172.21.15.99:0/491141230 learned_addr learned my addr 172.21.15.99:0/491141230 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:12.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12cd600640 1 --2- 172.21.15.99:0/491141230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c813fae0 0x7f12c806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12ce000640 1 -- 172.21.15.99:0/491141230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c813fae0 msgr2=0x7f12c806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12ce000640 1 --2- 172.21.15.99:0/491141230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c813fae0 0x7f12c806f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12ce000640 1 -- 172.21.15.99:0/491141230 >> v2:172.21.15.187:3300/0 conn(0x7f12c8142150 msgr2=0x7f12c8160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12ce000640 1 --2- 172.21.15.99:0/491141230 >> v2:172.21.15.187:3300/0 conn(0x7f12c8142150 0x7f12c8160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.932+0000 7f12ce000640 1 -- 172.21.15.99:0/491141230 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c8142c10 con 0x7f12c8160a80 2024-09-10T07:35:12.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.933+0000 7f12ce000640 1 --2- 172.21.15.99:0/491141230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8160a80 0x7f12c815cf50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f12c80d06f0 tx=0x7f12c002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b609e4b9af06cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12c7e00640 1 -- 172.21.15.99:0/491141230 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0036070 con 0x7f12c8160a80 2024-09-10T07:35:12.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12c7e00640 1 -- 172.21.15.99:0/491141230 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c0031600 con 0x7f12c8160a80 2024-09-10T07:35:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12c7e00640 1 -- 172.21.15.99:0/491141230 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00319d0 con 0x7f12c8160a80 2024-09-10T07:35:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12d0000640 1 -- 172.21.15.99:0/491141230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8160a80 msgr2=0x7f12c815cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12d0000640 1 --2- 172.21.15.99:0/491141230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8160a80 0x7f12c815cf50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f12c80d06f0 tx=0x7f12c002a610 comp rx=0 tx=0).stop 2024-09-10T07:35:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12d0000640 1 -- 172.21.15.99:0/491141230 shutdown_connections 2024-09-10T07:35:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12d0000640 1 --2- 172.21.15.99:0/491141230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8160a80 0x7f12c815cf50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12d0000640 1 --2- 172.21.15.99:0/491141230 >> v2:172.21.15.187:3300/0 conn(0x7f12c8142150 0x7f12c8160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12d0000640 1 --2- 172.21.15.99:0/491141230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c813fae0 0x7f12c806f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12d0000640 1 -- 172.21.15.99:0/491141230 >> 172.21.15.99:0/491141230 conn(0x7f12c806bc10 msgr2=0x7f12c806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12d0000640 1 -- 172.21.15.99:0/491141230 shutdown_connections 2024-09-10T07:35:12.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.934+0000 7f12d0000640 1 -- 172.21.15.99:0/491141230 wait complete. 2024-09-10T07:35:12.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.936+0000 7f12d0000640 1 Processor -- start 2024-09-10T07:35:12.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.936+0000 7f12d0000640 1 -- start start 2024-09-10T07:35:12.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.937+0000 7f12d0000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12c813fae0 0x7f12c81563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.937+0000 7f12d0000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8142150 0x7f12c813d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.937+0000 7f12d0000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c8160a80 0x7f12c813de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.937+0000 7f12d0000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f12c806f870 con 0x7f12c8142150 2024-09-10T07:35:12.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.937+0000 7f12d0000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f12c806f6f0 con 0x7f12c813fae0 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.937+0000 7f12d0000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f12c815d490 con 0x7f12c8160a80 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.937+0000 7f12ccc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8142150 0x7f12c813d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.937+0000 7f12ccc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8142150 0x7f12c813d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49552/0 (socket says 172.21.15.99:49552) 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.937+0000 7f12ccc00640 1 -- 172.21.15.99:0/3252462200 learned_addr learned my addr 172.21.15.99:0/3252462200 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12cd600640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12c813fae0 0x7f12c81563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12ce000640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c8160a80 0x7f12c813de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12ccc00640 1 -- 172.21.15.99:0/3252462200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c8160a80 msgr2=0x7f12c813de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12ccc00640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c8160a80 0x7f12c813de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12ccc00640 1 -- 172.21.15.99:0/3252462200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12c813fae0 msgr2=0x7f12c81563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12ccc00640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12c813fae0 0x7f12c81563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12ccc00640 1 -- 172.21.15.99:0/3252462200 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c813dbc0 con 0x7f12c8142150 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12ce000640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c8160a80 0x7f12c813de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12ccc00640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8142150 0x7f12c813d250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f12b400e8b0 tx=0x7f12b400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:12.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12c5600640 1 -- 172.21.15.99:0/3252462200 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4017070 con 0x7f12c8142150 2024-09-10T07:35:12.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12c5600640 1 -- 172.21.15.99:0/3252462200 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b400c940 con 0x7f12c8142150 2024-09-10T07:35:12.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12d0000640 1 -- 172.21.15.99:0/3252462200 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c813a950 con 0x7f12c8142150 2024-09-10T07:35:12.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.938+0000 7f12c5600640 1 -- 172.21.15.99:0/3252462200 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b400cd10 con 0x7f12c8142150 2024-09-10T07:35:12.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.939+0000 7f12d0000640 1 -- 172.21.15.99:0/3252462200 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c813af10 con 0x7f12c8142150 2024-09-10T07:35:12.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.939+0000 7f12d0000640 1 -- 172.21.15.99:0/3252462200 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c8160540 con 0x7f12c8142150 2024-09-10T07:35:12.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.940+0000 7f12c5600640 1 -- 172.21.15.99:0/3252462200 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12b401a070 con 0x7f12c8142150 2024-09-10T07:35:12.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.941+0000 7f12c5600640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 0x7f12a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:12.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.941+0000 7f12c5600640 1 -- 172.21.15.99:0/3252462200 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f12b408adb0 con 0x7f12c8142150 2024-09-10T07:35:12.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.942+0000 7f12cd600640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 0x7f12a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:12.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.942+0000 7f12cd600640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 0x7f12a806e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009ac0 tx=0x7f12bc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:12.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:12.946+0000 7f12c5600640 1 -- 172.21.15.99:0/3252462200 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12b408f070 con 0x7f12c8142150 2024-09-10T07:35:13.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.152+0000 7f12d0000640 1 -- 172.21.15.99:0/3252462200 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f12c8075620 con 0x7f12c8142150 2024-09-10T07:35:13.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.153+0000 7f12c5600640 1 -- 172.21.15.99:0/3252462200 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f12b4059100 con 0x7f12c8142150 2024-09-10T07:35:13.153 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:35:13.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 -- 172.21.15.99:0/3252462200 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 msgr2=0x7f12a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:13.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 0x7f12a806e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009ac0 tx=0x7f12bc009190 comp rx=0 tx=0).stop 2024-09-10T07:35:13.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 -- 172.21.15.99:0/3252462200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8142150 msgr2=0x7f12c813d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:13.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8142150 0x7f12c813d250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f12b400e8b0 tx=0x7f12b400ed70 comp rx=0 tx=0).stop 2024-09-10T07:35:13.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 -- 172.21.15.99:0/3252462200 shutdown_connections 2024-09-10T07:35:13.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12c8160a80 0x7f12c813de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:13.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f12a806be30 0x7f12a806e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:13.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12c8142150 0x7f12c813d250 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:13.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 --2- 172.21.15.99:0/3252462200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12c813fae0 0x7f12c81563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:13.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 -- 172.21.15.99:0/3252462200 >> 172.21.15.99:0/3252462200 conn(0x7f12c806bc10 msgr2=0x7f12c80b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:13.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 -- 172.21.15.99:0/3252462200 shutdown_connections 2024-09-10T07:35:13.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13.155+0000 7f12d0000640 1 -- 172.21.15.99:0/3252462200 wait complete. 2024-09-10T07:35:13.170 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:35:13.170 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:35:13.170 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:35:13.170 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:35:13.170 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:35:13.171 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:35:13.171 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:35:13.171 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:35:13.171 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:35:13.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:13.171 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:35:13.207 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:35:13.207 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:35:13.207 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:35:13.207 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:13.207 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:35:13.207 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42715sec preferred_lft 42715sec 2024-09-10T07:35:13.208 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:35:13.209 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::1c1f:52ff:fe95:9fbe/64 scope link 2024-09-10T07:35:13.210 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:13.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:13.210 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:35:13.300 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:35:13.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:13.303 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:35:13.339 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:35:13.339 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:35:13.339 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:35:13.339 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:35:13.340 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:35:13.340 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:35:13.340 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:35:13.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:35:13.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:35:13.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:35:13.340 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:35:13.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:35:13.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:13.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:13.536 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:35:13.571 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:35:13.571 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:35:13.571 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:35:13.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:13.572 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:35:13.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:35:13.669 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:35:13.704 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:35:13.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:35:13.705 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:35:13.780 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:35:13.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:13.780 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:13.910 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:13.910 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:35:13.936 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:13.936 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:35:13.936 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:35:13.936 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:35:13.936 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:35:13.938 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:35:13.938 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:35:13.938 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:35:13.938 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:35:13.938 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:35:13.941 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:35:13.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:13.942 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:35:13.998 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:35:14.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:35:14.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:14.096 INFO:teuthology.orchestra.run.smithi099.stdout:client4923 2024-09-10T07:35:14.096 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:14.096 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:14.132 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:35:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.327+0000 7f1f4d600640 1 Processor -- start 2024-09-10T07:35:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.327+0000 7f1f4d600640 1 -- start start 2024-09-10T07:35:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f4d600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1f48142150 0x7f1f48160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f4d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f48160a80 0x7f1f480cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f4d600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f48142650 con 0x7f1f4813fae0 2024-09-10T07:35:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f4d600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1f480ce780 con 0x7f1f48160a80 2024-09-10T07:35:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f4d600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f1f48142930 con 0x7f1f48142150 2024-09-10T07:35:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f47400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f48160a80 0x7f1f480cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f47400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f48160a80 0x7f1f480cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49562/0 (socket says 172.21.15.99:49562) 2024-09-10T07:35:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f47400640 1 -- 172.21.15.99:0/375324267 learned_addr learned my addr 172.21.15.99:0/375324267 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f46000640 1 --2- 172.21.15.99:0/375324267 >> v2:172.21.15.187:3300/0 conn(0x7f1f48142150 0x7f1f48160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f47400640 1 -- 172.21.15.99:0/375324267 >> v2:172.21.15.187:3300/0 conn(0x7f1f48142150 msgr2=0x7f1f48160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f47400640 1 --2- 172.21.15.99:0/375324267 >> v2:172.21.15.187:3300/0 conn(0x7f1f48142150 0x7f1f48160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f47400640 1 -- 172.21.15.99:0/375324267 >> v1:172.21.15.99:6789/0 conn(0x7f1f4813fae0 legacy=0x7f1f4806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f47400640 1 -- 172.21.15.99:0/375324267 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f48142c10 con 0x7f1f48160a80 2024-09-10T07:35:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.329+0000 7f1f46000640 1 --2- 172.21.15.99:0/375324267 >> v2:172.21.15.187:3300/0 conn(0x7f1f48142150 0x7f1f48160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.330+0000 7f1f47400640 1 --2- 172.21.15.99:0/375324267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 0x7f1f480cec10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1f48075560 tx=0x7f1f4002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e941bf3291dbdd7f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f45600640 1 -- 172.21.15.99:0/375324267 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40036070 con 0x7f1f48160a80 2024-09-10T07:35:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f45600640 1 -- 172.21.15.99:0/375324267 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f40031600 con 0x7f1f48160a80 2024-09-10T07:35:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f45600640 1 -- 172.21.15.99:0/375324267 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400319d0 con 0x7f1f48160a80 2024-09-10T07:35:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f4d600640 1 -- 172.21.15.99:0/375324267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 msgr2=0x7f1f480cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f4d600640 1 --2- 172.21.15.99:0/375324267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 0x7f1f480cec10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1f48075560 tx=0x7f1f4002a6a0 comp rx=0 tx=0).stop 2024-09-10T07:35:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f4d600640 1 -- 172.21.15.99:0/375324267 shutdown_connections 2024-09-10T07:35:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f4d600640 1 --2- 172.21.15.99:0/375324267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 0x7f1f480cec10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f4d600640 1 --2- 172.21.15.99:0/375324267 >> v2:172.21.15.187:3300/0 conn(0x7f1f48142150 0x7f1f48160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f4d600640 1 -- 172.21.15.99:0/375324267 >> 172.21.15.99:0/375324267 conn(0x7f1f4806bc10 msgr2=0x7f1f4806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f4d600640 1 -- 172.21.15.99:0/375324267 shutdown_connections 2024-09-10T07:35:14.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.331+0000 7f1f4d600640 1 -- 172.21.15.99:0/375324267 wait complete. 2024-09-10T07:35:14.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.333+0000 7f1f4d600640 1 Processor -- start 2024-09-10T07:35:14.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.333+0000 7f1f4d600640 1 -- start start 2024-09-10T07:35:14.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f4d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4813fae0 0x7f1f480b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:14.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f4d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f48142150 0x7f1f4813aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:14.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f4d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 0x7f1f4813b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:14.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f4d600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1f480cf2d0 con 0x7f1f48160a80 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f4d600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1f480cf150 con 0x7f1f48142150 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f4d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1f480cf450 con 0x7f1f4813fae0 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f47400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 0x7f1f4813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f47400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 0x7f1f4813b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49576/0 (socket says 172.21.15.99:49576) 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f47400640 1 -- 172.21.15.99:0/1713268719 learned_addr learned my addr 172.21.15.99:0/1713268719 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f46000640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f48142150 0x7f1f4813aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f46a00640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4813fae0 0x7f1f480b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.334+0000 7f1f47400640 1 -- 172.21.15.99:0/1713268719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4813fae0 msgr2=0x7f1f480b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.335+0000 7f1f47400640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4813fae0 0x7f1f480b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.335+0000 7f1f47400640 1 -- 172.21.15.99:0/1713268719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f48142150 msgr2=0x7f1f4813aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.335+0000 7f1f47400640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f48142150 0x7f1f4813aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.335+0000 7f1f47400640 1 -- 172.21.15.99:0/1713268719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f481f2710 con 0x7f1f48160a80 2024-09-10T07:35:14.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.335+0000 7f1f47400640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 0x7f1f4813b530 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009f40 tx=0x7f1f40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.335+0000 7f1f3ea00640 1 -- 172.21.15.99:0/1713268719 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40036050 con 0x7f1f48160a80 2024-09-10T07:35:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.335+0000 7f1f3ea00640 1 -- 172.21.15.99:0/1713268719 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f40042070 con 0x7f1f48160a80 2024-09-10T07:35:14.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.335+0000 7f1f3ea00640 1 -- 172.21.15.99:0/1713268719 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40009510 con 0x7f1f48160a80 2024-09-10T07:35:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.335+0000 7f1f4d600640 1 -- 172.21.15.99:0/1713268719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f481f29f0 con 0x7f1f48160a80 2024-09-10T07:35:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.335+0000 7f1f4d600640 1 -- 172.21.15.99:0/1713268719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f481f2fb0 con 0x7f1f48160a80 2024-09-10T07:35:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.336+0000 7f1f4d600640 1 -- 172.21.15.99:0/1713268719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f48160540 con 0x7f1f48160a80 2024-09-10T07:35:14.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.337+0000 7f1f3ea00640 1 -- 172.21.15.99:0/1713268719 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f40007bd0 con 0x7f1f48160a80 2024-09-10T07:35:14.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.338+0000 7f1f3ea00640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f2806be30 0x7f1f2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:14.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.338+0000 7f1f3ea00640 1 -- 172.21.15.99:0/1713268719 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f1f400abd60 con 0x7f1f48160a80 2024-09-10T07:35:14.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.338+0000 7f1f46a00640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f2806be30 0x7f1f2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:14.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.339+0000 7f1f46a00640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f2806be30 0x7f1f2806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1f38001640 tx=0x7f1f38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:14.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.342+0000 7f1f3ea00640 1 -- 172.21.15.99:0/1713268719 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f4007a700 con 0x7f1f48160a80 2024-09-10T07:35:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.553+0000 7f1f4d600640 1 -- 172.21.15.99:0/1713268719 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1f4806f400 con 0x7f1f48160a80 2024-09-10T07:35:14.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.554+0000 7f1f3ea00640 1 -- 172.21.15.99:0/1713268719 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f1f4007a000 con 0x7f1f48160a80 2024-09-10T07:35:14.554 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:35:14.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 -- 172.21.15.99:0/1713268719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f2806be30 msgr2=0x7f1f2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:14.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f2806be30 0x7f1f2806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1f38001640 tx=0x7f1f38009040 comp rx=0 tx=0).stop 2024-09-10T07:35:14.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 -- 172.21.15.99:0/1713268719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 msgr2=0x7f1f4813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:14.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 0x7f1f4813b530 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009f40 tx=0x7f1f40004a40 comp rx=0 tx=0).stop 2024-09-10T07:35:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 -- 172.21.15.99:0/1713268719 shutdown_connections 2024-09-10T07:35:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f2806be30 0x7f1f2806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f48160a80 0x7f1f4813b530 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f48142150 0x7f1f4813aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 --2- 172.21.15.99:0/1713268719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f4813fae0 0x7f1f480b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 -- 172.21.15.99:0/1713268719 >> 172.21.15.99:0/1713268719 conn(0x7f1f4806bc10 msgr2=0x7f1f480718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 -- 172.21.15.99:0/1713268719 shutdown_connections 2024-09-10T07:35:14.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:14.556+0000 7f1f4d600640 1 -- 172.21.15.99:0/1713268719 wait complete. 2024-09-10T07:35:14.572 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:35:14.572 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:35:14.572 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:35:14.573 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:35:14.573 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:35:14.573 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:35:14.573 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:35:14.573 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:35:14.573 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:35:14.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:14.573 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:14.615 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42709sec preferred_lft 42709sec 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:35:14.616 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:14.617 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:35:14.617 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:14.617 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:35:14.617 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:35:14.617 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:35:14.617 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:14.617 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:35:14.618 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:35:14.618 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::84a0:e5ff:fe75:1d2e/64 scope link 2024-09-10T07:35:14.618 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:14.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:14.619 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:35:14.712 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:35:14.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:14.716 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:35:14.754 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:35:14.754 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:35:14.754 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:35:14.754 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:35:14.754 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:35:14.754 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:35:14.754 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:35:14.754 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:35:14.755 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:35:14.755 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:35:14.755 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:35:14.872 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:35:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:35:14.943 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:35:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:14.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:14.951 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:35:14.986 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:35:14.987 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:35:14.987 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:35:14.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:14.987 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:35:15.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:35:15.159 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:35:15.196 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:35:15.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:35:15.196 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:35:15.271 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:35:15.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:15.271 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:15.402 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:15.402 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:35:15.433 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:15.433 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:35:15.433 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:35:15.433 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:35:15.434 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:35:15.435 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:35:15.435 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:35:15.435 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:35:15.435 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:35:15.435 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:35:15.438 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:35:15.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:15.439 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:35:15.495 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:35:15.573 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:35:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:35:15.577 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:35:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:15.586 INFO:teuthology.orchestra.run.smithi187.stdout:client4935 2024-09-10T07:35:15.586 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:35:15.586 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:15.622 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:15.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.786+0000 7f4902c00640 1 Processor -- start 2024-09-10T07:35:15.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.786+0000 7f4902c00640 1 -- start start 2024-09-10T07:35:15.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.788+0000 7f4902c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 0x7f48fc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:15.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.788+0000 7f4902c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48fc06e3d0 con 0x7f48fc072f40 2024-09-10T07:35:15.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.788+0000 7f4902c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48fc06e6b0 con 0x7f48fc0ce780 2024-09-10T07:35:15.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.788+0000 7f4902c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f48fc06efe0 con 0x7f48fc145290 2024-09-10T07:35:15.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.788+0000 7f4900c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f48fc072f40 0x7f48fc0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46860/0 (socket says 172.21.15.99:46860) 2024-09-10T07:35:15.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.788+0000 7f4900c00640 1 -- 172.21.15.99:0/2842621515 learned_addr learned my addr 172.21.15.99:0/2842621515 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:15.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.788+0000 7f48fbe00640 1 --2- 172.21.15.99:0/2842621515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 0x7f48fc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.789+0000 7f48faa00640 1 -- 172.21.15.99:0/2842621515 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32316095 0 0) 0x7f48fc06e3d0 con 0x7f48fc072f40 2024-09-10T07:35:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.789+0000 7f48faa00640 1 -- 172.21.15.99:0/2842621515 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48e0003520 con 0x7f48fc072f40 2024-09-10T07:35:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.789+0000 7f48faa00640 1 -- 172.21.15.99:0/2842621515 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428132875 0 0) 0x7f48fc06e6b0 con 0x7f48fc0ce780 2024-09-10T07:35:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.789+0000 7f48faa00640 1 -- 172.21.15.99:0/2842621515 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48fc06e3d0 con 0x7f48fc0ce780 2024-09-10T07:35:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.789+0000 7f48fbe00640 1 -- 172.21.15.99:0/2842621515 >> v1:172.21.15.187:6789/0 conn(0x7f48fc0ce780 legacy=0x7f48fc072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.789+0000 7f48fbe00640 1 -- 172.21.15.99:0/2842621515 >> v1:172.21.15.99:6789/0 conn(0x7f48fc072f40 legacy=0x7f48fc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.789+0000 7f48fbe00640 1 -- 172.21.15.99:0/2842621515 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc06e990 con 0x7f48fc145290 2024-09-10T07:35:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.790+0000 7f48fbe00640 1 --2- 172.21.15.99:0/2842621515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 0x7f48fc06f470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009dc0 tx=0x7f48ec02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47d68c578dd6a814 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.790+0000 7f48faa00640 1 -- 172.21.15.99:0/2842621515 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec007740 con 0x7f48fc145290 2024-09-10T07:35:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.790+0000 7f48faa00640 1 -- 172.21.15.99:0/2842621515 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec0078e0 con 0x7f48fc145290 2024-09-10T07:35:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.790+0000 7f48faa00640 1 -- 172.21.15.99:0/2842621515 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec007c90 con 0x7f48fc145290 2024-09-10T07:35:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.791+0000 7f4902c00640 1 -- 172.21.15.99:0/2842621515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 msgr2=0x7f48fc06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.791+0000 7f4902c00640 1 --2- 172.21.15.99:0/2842621515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 0x7f48fc06f470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009dc0 tx=0x7f48ec02a6d0 comp rx=0 tx=0).stop 2024-09-10T07:35:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.791+0000 7f4902c00640 1 -- 172.21.15.99:0/2842621515 shutdown_connections 2024-09-10T07:35:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.791+0000 7f4902c00640 1 --2- 172.21.15.99:0/2842621515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 0x7f48fc06f470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.791+0000 7f4902c00640 1 -- 172.21.15.99:0/2842621515 >> 172.21.15.99:0/2842621515 conn(0x7f48fc06bc10 msgr2=0x7f48fc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.791+0000 7f4902c00640 1 -- 172.21.15.99:0/2842621515 shutdown_connections 2024-09-10T07:35:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.791+0000 7f4902c00640 1 -- 172.21.15.99:0/2842621515 wait complete. 2024-09-10T07:35:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.792+0000 7f4902c00640 1 Processor -- start 2024-09-10T07:35:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.792+0000 7f4902c00640 1 -- start start 2024-09-10T07:35:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.793+0000 7f4902c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48fc072f40 0x7f48fc15b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.793+0000 7f4902c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48fc0ce780 0x7f48fc15fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.793+0000 7f4902c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 0x7f48fc13e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.793+0000 7f4902c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc06df80 con 0x7f48fc072f40 2024-09-10T07:35:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.793+0000 7f4902c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc145670 con 0x7f48fc0ce780 2024-09-10T07:35:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.793+0000 7f4902c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f48fc06e100 con 0x7f48fc145290 2024-09-10T07:35:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48fc072f40 0x7f48fc15b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48fc072f40 0x7f48fc15b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49588/0 (socket says 172.21.15.99:49588) 2024-09-10T07:35:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fbe00640 1 -- 172.21.15.99:0/828990204 learned_addr learned my addr 172.21.15.99:0/828990204 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f4900c00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 0x7f48fc13e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fb400640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48fc0ce780 0x7f48fc15fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fbe00640 1 -- 172.21.15.99:0/828990204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 msgr2=0x7f48fc13e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fbe00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 0x7f48fc13e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fbe00640 1 -- 172.21.15.99:0/828990204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48fc0ce780 msgr2=0x7f48fc15fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fbe00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48fc0ce780 0x7f48fc15fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fbe00640 1 -- 172.21.15.99:0/828990204 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc15ecd0 con 0x7f48fc072f40 2024-09-10T07:35:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fb400640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48fc0ce780 0x7f48fc15fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.794+0000 7f48fbe00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48fc072f40 0x7f48fc15b670 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009ee0 tx=0x7f48ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.795+0000 7f48f3e00640 1 -- 172.21.15.99:0/828990204 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec040070 con 0x7f48fc072f40 2024-09-10T07:35:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.795+0000 7f48f3e00640 1 -- 172.21.15.99:0/828990204 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec031c40 con 0x7f48fc072f40 2024-09-10T07:35:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.795+0000 7f48f3e00640 1 -- 172.21.15.99:0/828990204 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec009450 con 0x7f48fc072f40 2024-09-10T07:35:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.795+0000 7f4902c00640 1 -- 172.21.15.99:0/828990204 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48fc15efb0 con 0x7f48fc072f40 2024-09-10T07:35:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.795+0000 7f4902c00640 1 -- 172.21.15.99:0/828990204 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48fc15f570 con 0x7f48fc072f40 2024-09-10T07:35:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.796+0000 7f4902c00640 1 -- 172.21.15.99:0/828990204 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48fc071510 con 0x7f48fc072f40 2024-09-10T07:35:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.797+0000 7f48f3e00640 1 -- 172.21.15.99:0/828990204 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48ec039040 con 0x7f48fc072f40 2024-09-10T07:35:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.798+0000 7f48f3e00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 0x7f48dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:15.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.798+0000 7f48f3e00640 1 -- 172.21.15.99:0/828990204 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f48ec0ac1c0 con 0x7f48fc072f40 2024-09-10T07:35:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.798+0000 7f48fb400640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 0x7f48dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:15.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.799+0000 7f48fb400640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 0x7f48dc06e320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48e8007fd0 tx=0x7f48e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:15.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:15.802+0000 7f48f3e00640 1 -- 172.21.15.99:0/828990204 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48ec07a5a0 con 0x7f48fc072f40 2024-09-10T07:35:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.010+0000 7f4902c00640 1 -- 172.21.15.99:0/828990204 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48fc1432d0 con 0x7f48fc072f40 2024-09-10T07:35:16.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.011+0000 7f48f3e00640 1 -- 172.21.15.99:0/828990204 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f48ec07e8a0 con 0x7f48fc072f40 2024-09-10T07:35:16.011 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:16.011 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"btime":"2024-09-10T07:35:09:706532+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3299804861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3299804861},{"type":"v1","addr":"172.21.15.187:6834","nonce":3299804861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/4173112208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4173112208},{"type":"v1","addr":"172.21.15.187:6835","nonce":4173112208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4740,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2963379591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2963379591},{"type":"v1","addr":"172.21.15.99:6835","nonce":2963379591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:06.038065+0000","modified":"2024-09-10T07:35:09.110775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4743":{"gid":4743,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/4168486217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":4168486217},{"type":"v1","addr":"172.21.15.99:6837","nonce":4168486217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4743,"qdb_cluster":[4743]},"id":2}]} 2024-09-10T07:35:16.011 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-09-10T07:35:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 -- 172.21.15.99:0/828990204 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 msgr2=0x7f48dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 0x7f48dc06e320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48e8007fd0 tx=0x7f48e8009040 comp rx=0 tx=0).stop 2024-09-10T07:35:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 -- 172.21.15.99:0/828990204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48fc072f40 msgr2=0x7f48fc15b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48fc072f40 0x7f48fc15b670 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009ee0 tx=0x7f48ec004a40 comp rx=0 tx=0).stop 2024-09-10T07:35:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 -- 172.21.15.99:0/828990204 shutdown_connections 2024-09-10T07:35:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48fc145290 0x7f48fc13e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48fc0ce780 0x7f48fc15fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 0x7f48dc06e320 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 --2- 172.21.15.99:0/828990204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48fc072f40 0x7f48fc15b670 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 -- 172.21.15.99:0/828990204 >> 172.21.15.99:0/828990204 conn(0x7f48fc06bc10 msgr2=0x7f48fc1419a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 -- 172.21.15.99:0/828990204 shutdown_connections 2024-09-10T07:35:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.013+0000 7f4902c00640 1 -- 172.21.15.99:0/828990204 wait complete. 2024-09-10T07:35:16.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-10T07:35:16.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:35:16.203 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":4743,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.5601008590000003,"mdsmap_epoch":16,"osdmap_epoch":31,"osdmap_epoch_barrier":31,"uptime":16.954508593} 2024-09-10T07:35:16.203 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 4743, "mdsmap_epoch": 16, "osdmap_epoch": 31, "osdmap_epoch_barrier": 31, "rank_uptime": 9.560100859, "state": "up:active", "uptime": 16.954508593, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:35:16.204 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-10T07:35:16.206 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:35:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.360+0000 7f20e4a00640 1 Processor -- start 2024-09-10T07:35:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.360+0000 7f20e4a00640 1 -- start start 2024-09-10T07:35:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20e4a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f20e0147f40 0x7f20e00b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20e4a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f20e006d620 0x7f20e006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20e4a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20e006d120 0x7f20e00ae840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20e4a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f20e0148320 con 0x7f20e0147f40 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20e4a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f20e006c750 con 0x7f20e006d620 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20e4a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f20e00b63d0 con 0x7f20e006d120 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20df400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f20e0147f40 0x7f20e00b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20df400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f20e0147f40 0x7f20e00b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49592/0 (socket says 172.21.15.99:49592) 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20df400640 1 -- 172.21.15.99:0/1961198673 learned_addr learned my addr 172.21.15.99:0/1961198673 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20dfe00640 1 --2- 172.21.15.99:0/1961198673 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20e006d120 0x7f20e00ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.361+0000 7f20d6a00640 1 --2- 172.21.15.99:0/1961198673 >> v2:172.21.15.187:3300/0 conn(0x7f20e006d620 0x7f20e006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.362+0000 7f20df400640 1 -- 172.21.15.99:0/1961198673 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20e006d120 msgr2=0x7f20e00ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.362+0000 7f20df400640 1 --2- 172.21.15.99:0/1961198673 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20e006d120 0x7f20e00ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.362+0000 7f20df400640 1 -- 172.21.15.99:0/1961198673 >> v2:172.21.15.187:3300/0 conn(0x7f20e006d620 msgr2=0x7f20e006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.362+0000 7f20df400640 1 --2- 172.21.15.99:0/1961198673 >> v2:172.21.15.187:3300/0 conn(0x7f20e006d620 0x7f20e006cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.362+0000 7f20df400640 1 -- 172.21.15.99:0/1961198673 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e00b6c50 con 0x7f20e0147f40 2024-09-10T07:35:16.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.363+0000 7f20df400640 1 --2- 172.21.15.99:0/1961198673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e0147f40 0x7f20e00b4b00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f20e00b5e60 tx=0x7f20d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac3515dcf1a1348 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:16.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.363+0000 7f20dea00640 1 -- 172.21.15.99:0/1961198673 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0037070 con 0x7f20e0147f40 2024-09-10T07:35:16.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.363+0000 7f20dea00640 1 -- 172.21.15.99:0/1961198673 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d0032440 con 0x7f20e0147f40 2024-09-10T07:35:16.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.363+0000 7f20dea00640 1 -- 172.21.15.99:0/1961198673 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0032810 con 0x7f20e0147f40 2024-09-10T07:35:16.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.364+0000 7f20e4a00640 1 -- 172.21.15.99:0/1961198673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e0147f40 msgr2=0x7f20e00b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:16.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.364+0000 7f20e4a00640 1 --2- 172.21.15.99:0/1961198673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e0147f40 0x7f20e00b4b00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f20e00b5e60 tx=0x7f20d002a1e0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.364+0000 7f20e4a00640 1 -- 172.21.15.99:0/1961198673 shutdown_connections 2024-09-10T07:35:16.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.364+0000 7f20e4a00640 1 --2- 172.21.15.99:0/1961198673 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20e006d120 0x7f20e00ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.364+0000 7f20e4a00640 1 --2- 172.21.15.99:0/1961198673 >> v2:172.21.15.187:3300/0 conn(0x7f20e006d620 0x7f20e006cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.364+0000 7f20e4a00640 1 --2- 172.21.15.99:0/1961198673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e0147f40 0x7f20e00b4b00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.364+0000 7f20e4a00640 1 -- 172.21.15.99:0/1961198673 >> 172.21.15.99:0/1961198673 conn(0x7f20e00b3720 msgr2=0x7f20e00b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:16.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.364+0000 7f20e4a00640 1 -- 172.21.15.99:0/1961198673 shutdown_connections 2024-09-10T07:35:16.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.364+0000 7f20e4a00640 1 -- 172.21.15.99:0/1961198673 wait complete. 2024-09-10T07:35:16.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.365+0000 7f20e4a00640 1 Processor -- start 2024-09-10T07:35:16.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.366+0000 7f20e4a00640 1 -- start start 2024-09-10T07:35:16.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.366+0000 7f20e4a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20e006d120 0x7f20e013fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:16.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.366+0000 7f20e4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e006d620 0x7f20e013ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:16.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.366+0000 7f20e4a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f20e0147f40 0x7f20e013efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:16.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.366+0000 7f20e4a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f20e006da60 con 0x7f20e006d620 2024-09-10T07:35:16.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.366+0000 7f20e4a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f20e00b6970 con 0x7f20e0147f40 2024-09-10T07:35:16.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.366+0000 7f20e4a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f20e00aed80 con 0x7f20e006d120 2024-09-10T07:35:16.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20d6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e006d620 0x7f20e013ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20d6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e006d620 0x7f20e013ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49594/0 (socket says 172.21.15.99:49594) 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20d6a00640 1 -- 172.21.15.99:0/1336082953 learned_addr learned my addr 172.21.15.99:0/1336082953 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20df400640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20e006d120 0x7f20e013fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20dfe00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f20e0147f40 0x7f20e013efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20d6a00640 1 -- 172.21.15.99:0/1336082953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20e006d120 msgr2=0x7f20e013fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20d6a00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20e006d120 0x7f20e013fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20d6a00640 1 -- 172.21.15.99:0/1336082953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f20e0147f40 msgr2=0x7f20e013efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20d6a00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f20e0147f40 0x7f20e013efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20d6a00640 1 -- 172.21.15.99:0/1336082953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e0145ef0 con 0x7f20e006d620 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.367+0000 7f20d6a00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e006d620 0x7f20e013ea70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f20c800e9b0 tx=0x7f20c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.368+0000 7f20d7e00640 1 -- 172.21.15.99:0/1336082953 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8017070 con 0x7f20e006d620 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.368+0000 7f20d7e00640 1 -- 172.21.15.99:0/1336082953 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c800c9a0 con 0x7f20e006d620 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.368+0000 7f20d7e00640 1 -- 172.21.15.99:0/1336082953 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c800cd90 con 0x7f20e006d620 2024-09-10T07:35:16.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.368+0000 7f20e4a00640 1 -- 172.21.15.99:0/1336082953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e01461d0 con 0x7f20e006d620 2024-09-10T07:35:16.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.368+0000 7f20e4a00640 1 -- 172.21.15.99:0/1336082953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e0146790 con 0x7f20e006d620 2024-09-10T07:35:16.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.369+0000 7f20e4a00640 1 -- 172.21.15.99:0/1336082953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e0069690 con 0x7f20e006d620 2024-09-10T07:35:16.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.370+0000 7f20d7e00640 1 -- 172.21.15.99:0/1336082953 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20c801a070 con 0x7f20e006d620 2024-09-10T07:35:16.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.371+0000 7f20d7e00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f20bc06be30 0x7f20bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:16.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.371+0000 7f20d7e00640 1 -- 172.21.15.99:0/1336082953 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f20c808b0f0 con 0x7f20e006d620 2024-09-10T07:35:16.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.371+0000 7f20df400640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f20bc06be30 0x7f20bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:16.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.372+0000 7f20df400640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f20bc06be30 0x7f20bc06e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f20d0034000 tx=0x7f20d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:16.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.375+0000 7f20d7e00640 1 -- 172.21.15.99:0/1336082953 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20e0069690 con 0x7f20e006d620 2024-09-10T07:35:16.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.610+0000 7f20e4a00640 1 -- 172.21.15.99:0/1336082953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) -- 0x7f20e00af110 con 0x7f20e006d620 2024-09-10T07:35:16.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.610+0000 7f20d7e00640 1 -- 172.21.15.99:0/1336082953 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) ==== 75+0+1620 (secure 0 0 0) 0x7f20c8059440 con 0x7f20e006d620 2024-09-10T07:35:16.610 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout: "stats": { 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout: "total_bytes": 1600000000, 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout: "total_avail_bytes": 1597742716, 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout: "total_used_bytes": 2257284, 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout: "total_used_raw_bytes": 2257284, 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout: "total_used_raw_ratio": 0.0014108024770393968, 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout: "num_osds": 8, 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout: "num_per_pool_osds": 0, 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout: "num_per_pool_omap_osds": 0 2024-09-10T07:35:16.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: "stats_by_class": { 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: "hdd": { 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: "total_bytes": 1600000000, 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: "total_avail_bytes": 1597742716, 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: "total_used_bytes": 2257284, 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: "total_used_raw_bytes": 2257284, 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: "total_used_raw_ratio": 0.0014108024770393968 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:16.612 INFO:teuthology.orchestra.run.smithi099.stdout: "name": ".mgr", 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 1, 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: "stats": { 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: "stored": 590368, 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: "objects": 2, 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: "kb_used": 577, 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: "bytes_used": 590368, 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: "percent_used": 0.00052957510342821479, 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: "max_avail": 557102656 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:16.613 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephfs_metadata", 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4, 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "stats": { 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "stored": 2410, 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "objects": 22, 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "kb_used": 3, 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "bytes_used": 2410, 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "percent_used": 2.1629718958138255e-06, 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "max_avail": 557102656 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephfs_data", 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 5, 2024-09-10T07:35:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: "stats": { 2024-09-10T07:35:16.615 INFO:teuthology.orchestra.run.smithi099.stdout: "stored": 0, 2024-09-10T07:35:16.615 INFO:teuthology.orchestra.run.smithi099.stdout: "objects": 0, 2024-09-10T07:35:16.615 INFO:teuthology.orchestra.run.smithi099.stdout: "kb_used": 0, 2024-09-10T07:35:16.615 INFO:teuthology.orchestra.run.smithi099.stdout: "bytes_used": 0, 2024-09-10T07:35:16.615 INFO:teuthology.orchestra.run.smithi099.stdout: "percent_used": 0, 2024-09-10T07:35:16.615 INFO:teuthology.orchestra.run.smithi099.stdout: "max_avail": 557102656 2024-09-10T07:35:16.615 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:16.615 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:16.615 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:16.615 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:35:16.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.612+0000 7f20e4a00640 1 -- 172.21.15.99:0/1336082953 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f20bc06be30 msgr2=0x7f20bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:16.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.612+0000 7f20e4a00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f20bc06be30 0x7f20bc06e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f20d0034000 tx=0x7f20d002e000 comp rx=0 tx=0).stop 2024-09-10T07:35:16.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.612+0000 7f20e4a00640 1 -- 172.21.15.99:0/1336082953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e006d620 msgr2=0x7f20e013ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:16.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.612+0000 7f20e4a00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e006d620 0x7f20e013ea70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f20c800e9b0 tx=0x7f20c800ee70 comp rx=0 tx=0).stop 2024-09-10T07:35:16.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.613+0000 7f20e4a00640 1 -- 172.21.15.99:0/1336082953 shutdown_connections 2024-09-10T07:35:16.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.613+0000 7f20e4a00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f20e0147f40 0x7f20e013efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.613+0000 7f20e4a00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f20bc06be30 0x7f20bc06e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.613+0000 7f20e4a00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20e006d620 0x7f20e013ea70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.613+0000 7f20e4a00640 1 --2- 172.21.15.99:0/1336082953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20e006d120 0x7f20e013fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:16.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.613+0000 7f20e4a00640 1 -- 172.21.15.99:0/1336082953 >> 172.21.15.99:0/1336082953 conn(0x7f20e00b3720 msgr2=0x7f20e006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:16.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.613+0000 7f20e4a00640 1 -- 172.21.15.99:0/1336082953 shutdown_connections 2024-09-10T07:35:16.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16.613+0000 7f20e4a00640 1 -- 172.21.15.99:0/1336082953 wait complete. 2024-09-10T07:35:16.629 DEBUG:teuthology.orchestra.run.smithi099:> stdin-killer -- python3 -c ' 2024-09-10T07:35:16.629 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-10T07:35:16.629 DEBUG:teuthology.orchestra.run.smithi099:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-10T07:35:16.629 DEBUG:teuthology.orchestra.run.smithi099:> os.fchmod(fd, 0O666) 2024-09-10T07:35:16.629 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(fd) 2024-09-10T07:35:16.629 DEBUG:teuthology.orchestra.run.smithi099:> os.close(fd) 2024-09-10T07:35:16.629 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-10T07:35:16.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:16.746 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:35:16.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:35:16.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:16.878 INFO:teuthology.orchestra.run.smithi099.stdout:client4923 2024-09-10T07:35:16.878 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client4923/osdmap') 2024-09-10T07:35:16.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:35:16.977 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 31 barrier 31 flags 0x588000 2024-09-10T07:35:16.977 INFO:teuthology.orchestra.run.smithi099.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:16.977 INFO:teuthology.orchestra.run.smithi099.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:16.977 INFO:teuthology.orchestra.run.smithi099.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:16.977 INFO:teuthology.orchestra.run.smithi099.stdout:osd0 (2)172.21.15.99:6800 100% (exists, up) 100% -1 2024-09-10T07:35:16.978 INFO:teuthology.orchestra.run.smithi099.stdout:osd1 (2)172.21.15.99:6810 100% (exists, up) 100% -1 2024-09-10T07:35:16.978 INFO:teuthology.orchestra.run.smithi099.stdout:osd2 (2)172.21.15.99:6808 100% (exists, up) 100% -1 2024-09-10T07:35:16.978 INFO:teuthology.orchestra.run.smithi099.stdout:osd3 (2)172.21.15.99:6818 100% (exists, up) 100% -1 2024-09-10T07:35:16.978 INFO:teuthology.orchestra.run.smithi099.stdout:osd4 (2)172.21.15.187:6824 100% (exists, up) 100% -1 2024-09-10T07:35:16.978 INFO:teuthology.orchestra.run.smithi099.stdout:osd5 (2)172.21.15.187:6800 100% (exists, up) 100% -1 2024-09-10T07:35:16.978 INFO:teuthology.orchestra.run.smithi099.stdout:osd6 (2)172.21.15.187:6808 100% (exists, up) 100% -1 2024-09-10T07:35:16.978 INFO:teuthology.orchestra.run.smithi099.stdout:osd7 (2)172.21.15.187:6811 100% (exists, up) 100% -1 2024-09-10T07:35:16.978 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records in 2024-09-10T07:35:16.978 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records out 2024-09-10T07:35:16.978 INFO:teuthology.orchestra.run.smithi099.stderr:795 bytes copied, 0.00011469 s, 6.9 MB/s 2024-09-10T07:35:16.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:16.988 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-10T07:35:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.142+0000 7f80f7200640 1 Processor -- start 2024-09-10T07:35:17.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.142+0000 7f80f7200640 1 -- start start 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.143+0000 7f80f7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80f815ed10 0x7f80f80d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.143+0000 7f80f7200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80f80d51a0 0x7f80f80d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.143+0000 7f80f7200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f80cf740 con 0x7f80f80d3070 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.143+0000 7f80f7200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f80f80d5910 con 0x7f80f80d51a0 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.143+0000 7f80f7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f80f80d5630 con 0x7f80f815ed10 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.143+0000 7f80f5e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f80f80d3070 0x7f80f80d3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46864/0 (socket says 172.21.15.99:46864) 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.143+0000 7f80f5e00640 1 -- 172.21.15.99:0/1654411038 learned_addr learned my addr 172.21.15.99:0/1654411038 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.143+0000 7f80f6800640 1 --2- 172.21.15.99:0/1654411038 >> v2:172.21.15.99:3300/0 conn(0x7f80f80d51a0 0x7f80f80d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.144+0000 7f80f5400640 1 --2- 172.21.15.99:0/1654411038 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80f815ed10 0x7f80f80d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.144+0000 7f80f4a00640 1 -- 172.21.15.99:0/1654411038 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1037826617 0 0) 0x7f80f80cf740 con 0x7f80f80d3070 2024-09-10T07:35:17.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.144+0000 7f80f6800640 1 -- 172.21.15.99:0/1654411038 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80f815ed10 msgr2=0x7f80f80d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:17.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.144+0000 7f80f6800640 1 --2- 172.21.15.99:0/1654411038 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80f815ed10 0x7f80f80d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.144+0000 7f80f6800640 1 -- 172.21.15.99:0/1654411038 >> v1:172.21.15.99:6789/0 conn(0x7f80f80d3070 legacy=0x7f80f80d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:17.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.144+0000 7f80f6800640 1 -- 172.21.15.99:0/1654411038 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f80cf9e0 con 0x7f80f80d51a0 2024-09-10T07:35:17.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.145+0000 7f80f6800640 1 --2- 172.21.15.99:0/1654411038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d51a0 0x7f80f80d01e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009d90 tx=0x7f80f002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cdff1aaf1a06ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:17.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.145+0000 7f80f4a00640 1 -- 172.21.15.99:0/1654411038 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0007740 con 0x7f80f80d51a0 2024-09-10T07:35:17.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.145+0000 7f80f4a00640 1 -- 172.21.15.99:0/1654411038 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00078e0 con 0x7f80f80d51a0 2024-09-10T07:35:17.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.145+0000 7f80f4a00640 1 -- 172.21.15.99:0/1654411038 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0007cb0 con 0x7f80f80d51a0 2024-09-10T07:35:17.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.146+0000 7f80f7200640 1 -- 172.21.15.99:0/1654411038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d51a0 msgr2=0x7f80f80d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:17.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.146+0000 7f80f7200640 1 --2- 172.21.15.99:0/1654411038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d51a0 0x7f80f80d01e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009d90 tx=0x7f80f002a6f0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.146+0000 7f80f7200640 1 -- 172.21.15.99:0/1654411038 shutdown_connections 2024-09-10T07:35:17.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.146+0000 7f80f7200640 1 --2- 172.21.15.99:0/1654411038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d51a0 0x7f80f80d01e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.146+0000 7f80f7200640 1 --2- 172.21.15.99:0/1654411038 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80f815ed10 0x7f80f80d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.146+0000 7f80f7200640 1 -- 172.21.15.99:0/1654411038 >> 172.21.15.99:0/1654411038 conn(0x7f80f809dd60 msgr2=0x7f80f80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:17.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.146+0000 7f80f7200640 1 -- 172.21.15.99:0/1654411038 shutdown_connections 2024-09-10T07:35:17.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.146+0000 7f80f7200640 1 -- 172.21.15.99:0/1654411038 wait complete. 2024-09-10T07:35:17.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.147+0000 7f80f7200640 1 Processor -- start 2024-09-10T07:35:17.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.147+0000 7f80f7200640 1 -- start start 2024-09-10T07:35:17.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.148+0000 7f80f7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d3070 0x7f80f815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.148+0000 7f80f7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80f815ed10 0x7f80f80ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.148+0000 7f80f7200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80f80b8900 0x7f80f80b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.148+0000 7f80f7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f80f80d2d20 con 0x7f80f80d3070 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.148+0000 7f80f7200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f80f80d2ba0 con 0x7f80f80b8900 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.148+0000 7f80f7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f80f80d0720 con 0x7f80f815ed10 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.148+0000 7f80f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d3070 0x7f80f815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d3070 0x7f80f815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49608/0 (socket says 172.21.15.99:49608) 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f5e00640 1 -- 172.21.15.99:0/1884153682 learned_addr learned my addr 172.21.15.99:0/1884153682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f5400640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80f815ed10 0x7f80f80ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f6800640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80f80b8900 0x7f80f80b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f5e00640 1 -- 172.21.15.99:0/1884153682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80f815ed10 msgr2=0x7f80f80ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f5e00640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80f815ed10 0x7f80f80ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f5e00640 1 -- 172.21.15.99:0/1884153682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80f80b8900 msgr2=0x7f80f80b8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f5e00640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80f80b8900 0x7f80f80b8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f5e00640 1 -- 172.21.15.99:0/1884153682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f80b9810 con 0x7f80f80d3070 2024-09-10T07:35:17.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f6800640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80f80b8900 0x7f80f80b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:17.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f5e00640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d3070 0x7f80f815c9b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c4d0 tx=0x7f80e800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:17.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80ee000640 1 -- 172.21.15.99:0/1884153682 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8018070 con 0x7f80f80d3070 2024-09-10T07:35:17.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80ee000640 1 -- 172.21.15.99:0/1884153682 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e8007500 con 0x7f80f80d3070 2024-09-10T07:35:17.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80ee000640 1 -- 172.21.15.99:0/1884153682 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8004a20 con 0x7f80f80d3070 2024-09-10T07:35:17.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.149+0000 7f80f7200640 1 -- 172.21.15.99:0/1884153682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f80b9af0 con 0x7f80f80d3070 2024-09-10T07:35:17.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.150+0000 7f80f7200640 1 -- 172.21.15.99:0/1884153682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f80b4620 con 0x7f80f80d3070 2024-09-10T07:35:17.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.151+0000 7f80f7200640 1 -- 172.21.15.99:0/1884153682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f80b9fb0 con 0x7f80f80d3070 2024-09-10T07:35:17.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.152+0000 7f80ee000640 1 -- 172.21.15.99:0/1884153682 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80e8004bc0 con 0x7f80f80d3070 2024-09-10T07:35:17.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.152+0000 7f80ee000640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80d806be60 0x7f80d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.153+0000 7f80ee000640 1 -- 172.21.15.99:0/1884153682 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f80e808a0f0 con 0x7f80f80d3070 2024-09-10T07:35:17.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.153+0000 7f80f5400640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80d806be60 0x7f80d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.153+0000 7f80f5400640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80d806be60 0x7f80d806e320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f80f80cd930 tx=0x7f80e4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:17.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.157+0000 7f80ee000640 1 -- 172.21.15.99:0/1884153682 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80f80b9fb0 con 0x7f80f80d3070 2024-09-10T07:35:17.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.339+0000 7f80f7200640 1 -- 172.21.15.99:0/1884153682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) -- 0x7f80f80d01e0 con 0x7f80f80d3070 2024-09-10T07:35:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.752+0000 7f80ee000640 1 -- 172.21.15.99:0/1884153682 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v32) ==== 93+0+0 (secure 0 0 0) 0x7f80e80583b0 con 0x7f80f80d3070 2024-09-10T07:35:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:pauserd,pausewr is set 2024-09-10T07:35:17.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 -- 172.21.15.99:0/1884153682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80d806be60 msgr2=0x7f80d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:17.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80d806be60 0x7f80d806e320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f80f80cd930 tx=0x7f80e4009190 comp rx=0 tx=0).stop 2024-09-10T07:35:17.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 -- 172.21.15.99:0/1884153682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d3070 msgr2=0x7f80f815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:17.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d3070 0x7f80f815c9b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c4d0 tx=0x7f80e800c990 comp rx=0 tx=0).stop 2024-09-10T07:35:17.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 -- 172.21.15.99:0/1884153682 shutdown_connections 2024-09-10T07:35:17.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80f80b8900 0x7f80f80b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80f815ed10 0x7f80f80ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80d806be60 0x7f80d806e320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 --2- 172.21.15.99:0/1884153682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80d3070 0x7f80f815c9b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 -- 172.21.15.99:0/1884153682 >> 172.21.15.99:0/1884153682 conn(0x7f80f809dd60 msgr2=0x7f80f80b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:17.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 -- 172.21.15.99:0/1884153682 shutdown_connections 2024-09-10T07:35:17.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.755+0000 7f80f7200640 1 -- 172.21.15.99:0/1884153682 wait complete. 2024-09-10T07:35:17.772 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-10T07:35:17.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.927+0000 7f10a5200640 1 Processor -- start 2024-09-10T07:35:17.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.927+0000 7f10a5200640 1 -- start start 2024-09-10T07:35:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.928+0000 7f10a5200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f10a00b5750 0x7f10a015d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.928+0000 7f10a5200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f10a00cf890 0x7f10a00cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.928+0000 7f10a5200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a015c800 con 0x7f10a00ce070 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.928+0000 7f10a5200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f10a00b5bb0 con 0x7f10a00b5750 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.928+0000 7f10a5200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f10a00d0240 con 0x7f10a00cf890 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.928+0000 7f1097e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f10a00b5750 0x7f10a015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.928+0000 7f1097e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f10a00b5750 0x7f10a015d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49622/0 (socket says 172.21.15.99:49622) 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.928+0000 7f1097e00640 1 -- 172.21.15.99:0/1354822070 learned_addr learned my addr 172.21.15.99:0/1354822070 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.928+0000 7f109e800640 1 --2- 172.21.15.99:0/1354822070 >> v2:172.21.15.187:3300/0 conn(0x7f10a00cf890 0x7f10a00cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.929+0000 7f1097e00640 1 -- 172.21.15.99:0/1354822070 >> v2:172.21.15.187:3300/0 conn(0x7f10a00cf890 msgr2=0x7f10a00cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.929+0000 7f1097e00640 1 --2- 172.21.15.99:0/1354822070 >> v2:172.21.15.187:3300/0 conn(0x7f10a00cf890 0x7f10a00cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.929+0000 7f1097e00640 1 -- 172.21.15.99:0/1354822070 >> v1:172.21.15.187:6789/0 conn(0x7f10a00ce070 legacy=0x7f10a015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:17.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.929+0000 7f1097e00640 1 -- 172.21.15.99:0/1354822070 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a015cae0 con 0x7f10a00b5750 2024-09-10T07:35:17.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.930+0000 7f1097e00640 1 --2- 172.21.15.99:0/1354822070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 0x7f10a015d170 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f10a006cfc0 tx=0x7f108802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b333f5f766a158 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.930+0000 7f109d400640 1 -- 172.21.15.99:0/1354822070 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088037070 con 0x7f10a00b5750 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.930+0000 7f109d400640 1 -- 172.21.15.99:0/1354822070 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1088032440 con 0x7f10a00b5750 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.930+0000 7f109d400640 1 -- 172.21.15.99:0/1354822070 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088032810 con 0x7f10a00b5750 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.930+0000 7f10a5200640 1 -- 172.21.15.99:0/1354822070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 msgr2=0x7f10a015d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.930+0000 7f10a5200640 1 --2- 172.21.15.99:0/1354822070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 0x7f10a015d170 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f10a006cfc0 tx=0x7f108802a270 comp rx=0 tx=0).stop 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.931+0000 7f10a5200640 1 -- 172.21.15.99:0/1354822070 shutdown_connections 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.931+0000 7f10a5200640 1 --2- 172.21.15.99:0/1354822070 >> v2:172.21.15.187:3300/0 conn(0x7f10a00cf890 0x7f10a00cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.931+0000 7f10a5200640 1 --2- 172.21.15.99:0/1354822070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 0x7f10a015d170 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.931+0000 7f10a5200640 1 -- 172.21.15.99:0/1354822070 >> 172.21.15.99:0/1354822070 conn(0x7f10a00b2630 msgr2=0x7f10a00b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.931+0000 7f10a5200640 1 -- 172.21.15.99:0/1354822070 shutdown_connections 2024-09-10T07:35:17.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.931+0000 7f10a5200640 1 -- 172.21.15.99:0/1354822070 wait complete. 2024-09-10T07:35:17.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.932+0000 7f10a5200640 1 Processor -- start 2024-09-10T07:35:17.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.932+0000 7f10a5200640 1 -- start start 2024-09-10T07:35:17.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.933+0000 7f10a5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 0x7f10a01f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.933+0000 7f10a5200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a00ce070 0x7f10a0148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.933+0000 7f10a5200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a00cf890 0x7f10a014cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.933+0000 7f10a5200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f10a015d6b0 con 0x7f10a00b5750 2024-09-10T07:35:17.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.933+0000 7f10a5200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f10a00ce450 con 0x7f10a00cf890 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.933+0000 7f10a5200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f10a015d830 con 0x7f10a00ce070 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.933+0000 7f109de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 0x7f10a01f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.933+0000 7f109de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 0x7f10a01f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49634/0 (socket says 172.21.15.99:49634) 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.933+0000 7f109de00640 1 -- 172.21.15.99:0/875385883 learned_addr learned my addr 172.21.15.99:0/875385883 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f109e800640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a00cf890 0x7f10a014cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f1097e00640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a00ce070 0x7f10a0148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f109de00640 1 -- 172.21.15.99:0/875385883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a00ce070 msgr2=0x7f10a0148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f109de00640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a00ce070 0x7f10a0148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f109de00640 1 -- 172.21.15.99:0/875385883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a00cf890 msgr2=0x7f10a014cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f109de00640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a00cf890 0x7f10a014cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f109de00640 1 -- 172.21.15.99:0/875385883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a0147a40 con 0x7f10a00b5750 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f109de00640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 0x7f10a01f5810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f109000b3f0 tx=0x7f109000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f1096000640 1 -- 172.21.15.99:0/875385883 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090015020 con 0x7f10a00b5750 2024-09-10T07:35:17.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f1096000640 1 -- 172.21.15.99:0/875385883 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1090011830 con 0x7f10a00b5750 2024-09-10T07:35:17.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f10a5200640 1 -- 172.21.15.99:0/875385883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a0147ce0 con 0x7f10a00b5750 2024-09-10T07:35:17.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.934+0000 7f1096000640 1 -- 172.21.15.99:0/875385883 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090011c20 con 0x7f10a00b5750 2024-09-10T07:35:17.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.935+0000 7f10a5200640 1 -- 172.21.15.99:0/875385883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a0148260 con 0x7f10a00b5750 2024-09-10T07:35:17.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.936+0000 7f10a5200640 1 -- 172.21.15.99:0/875385883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a015d170 con 0x7f10a00b5750 2024-09-10T07:35:17.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.937+0000 7f1096000640 1 -- 172.21.15.99:0/875385883 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1090018020 con 0x7f10a00b5750 2024-09-10T07:35:17.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.938+0000 7f1096000640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f107c06be60 0x7f107c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:17.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.938+0000 7f1096000640 1 -- 172.21.15.99:0/875385883 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f109008aa70 con 0x7f10a00b5750 2024-09-10T07:35:17.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.938+0000 7f1097e00640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f107c06be60 0x7f107c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:17.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.938+0000 7f1096000640 1 -- 172.21.15.99:0/875385883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=33+}) -- 0x7f107c073990 con 0x7f10a00b5750 2024-09-10T07:35:17.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.939+0000 7f1097e00640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f107c06be60 0x7f107c06e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1088034000 tx=0x7f108802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:17.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:17.943+0000 7f1096000640 1 -- 172.21.15.99:0/875385883 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f109001f030 con 0x7f10a00b5750 2024-09-10T07:35:18.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.125+0000 7f10a5200640 1 -- 172.21.15.99:0/875385883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) -- 0x7f10a00d0420 con 0x7f10a00b5750 2024-09-10T07:35:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.763+0000 7f1096000640 1 -- 172.21.15.99:0/875385883 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v33) ==== 97+0+0 (secure 0 0 0) 0x7f10900172c0 con 0x7f10a00b5750 2024-09-10T07:35:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:pauserd,pausewr is unset 2024-09-10T07:35:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.763+0000 7f1096000640 1 -- 172.21.15.99:0/875385883 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(33..33 src has 1..33) ==== 288+0+0 (secure 0 0 0) 0x7f1090056db0 con 0x7f10a00b5750 2024-09-10T07:35:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.763+0000 7f1096000640 1 -- 172.21.15.99:0/875385883 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=34}) -- 0x7f107c074360 con 0x7f10a00b5750 2024-09-10T07:35:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.766+0000 7f10a5200640 1 -- 172.21.15.99:0/875385883 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f107c06be60 msgr2=0x7f107c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.766+0000 7f10a5200640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f107c06be60 0x7f107c06e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1088034000 tx=0x7f108802e000 comp rx=0 tx=0).stop 2024-09-10T07:35:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.767+0000 7f10a5200640 1 -- 172.21.15.99:0/875385883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 msgr2=0x7f10a01f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.767+0000 7f10a5200640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 0x7f10a01f5810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f109000b3f0 tx=0x7f109000b8b0 comp rx=0 tx=0).stop 2024-09-10T07:35:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.767+0000 7f10a5200640 1 -- 172.21.15.99:0/875385883 shutdown_connections 2024-09-10T07:35:18.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.767+0000 7f10a5200640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a00cf890 0x7f10a014cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:18.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.767+0000 7f10a5200640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a00ce070 0x7f10a0148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:18.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.767+0000 7f10a5200640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f107c06be60 0x7f107c06e320 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:18.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.767+0000 7f10a5200640 1 --2- 172.21.15.99:0/875385883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a00b5750 0x7f10a01f5810 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:18.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.767+0000 7f10a5200640 1 -- 172.21.15.99:0/875385883 >> 172.21.15.99:0/875385883 conn(0x7f10a00b2630 msgr2=0x7f10a006e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:18.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.767+0000 7f10a5200640 1 -- 172.21.15.99:0/875385883 shutdown_connections 2024-09-10T07:35:18.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.768+0000 7f10a5200640 1 -- 172.21.15.99:0/875385883 wait complete. 2024-09-10T07:35:18.785 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:35:18.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.941+0000 7f18a6a00640 1 Processor -- start 2024-09-10T07:35:18.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.941+0000 7f18a6a00640 1 -- start start 2024-09-10T07:35:18.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.942+0000 7f18a6a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f18a015e970 0x7f18a00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:18.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.942+0000 7f18a6a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 0x7f18a00cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:18.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.942+0000 7f18a6a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a00d2bd0 con 0x7f18a00cfac0 2024-09-10T07:35:18.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.942+0000 7f18a6a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f18a00d37e0 con 0x7f18a015e970 2024-09-10T07:35:18.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.942+0000 7f18a6a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f18a00d2eb0 con 0x7f18a00d2680 2024-09-10T07:35:18.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.942+0000 7f18a5600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f18a015e970 0x7f18a00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:18.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.942+0000 7f18a4c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 0x7f18a00cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:18.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.942+0000 7f18a5600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f18a015e970 0x7f18a00d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:35096/0 (socket says 172.21.15.99:35096) 2024-09-10T07:35:18.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.942+0000 7f18a5600640 1 -- 172.21.15.99:0/4107569887 learned_addr learned my addr 172.21.15.99:0/4107569887 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:18.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.943+0000 7f189fe00640 1 -- 172.21.15.99:0/4107569887 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229894367 0 0) 0x7f18a00d2bd0 con 0x7f18a00cfac0 2024-09-10T07:35:18.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.943+0000 7f189fe00640 1 -- 172.21.15.99:0/4107569887 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1888003520 con 0x7f18a00cfac0 2024-09-10T07:35:18.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.943+0000 7f18a4c00640 1 -- 172.21.15.99:0/4107569887 >> v2:172.21.15.187:3300/0 conn(0x7f18a015e970 msgr2=0x7f18a00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:18.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.943+0000 7f18a4c00640 1 --2- 172.21.15.99:0/4107569887 >> v2:172.21.15.187:3300/0 conn(0x7f18a015e970 0x7f18a00d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:18.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.943+0000 7f18a4c00640 1 -- 172.21.15.99:0/4107569887 >> v1:172.21.15.187:6789/0 conn(0x7f18a00cfac0 legacy=0x7f18a00d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:18.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.943+0000 7f18a4c00640 1 -- 172.21.15.99:0/4107569887 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a00d3190 con 0x7f18a00d2680 2024-09-10T07:35:18.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.943+0000 7f18a5600640 1 --2- 172.21.15.99:0/4107569887 >> v2:172.21.15.187:3300/0 conn(0x7f18a015e970 0x7f18a00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:18.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.944+0000 7f18a4c00640 1 --2- 172.21.15.99:0/4107569887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 0x7f18a00cf580 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097a0 tx=0x7f188c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5d8b8697707194f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:18.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.944+0000 7f189fe00640 1 -- 172.21.15.99:0/4107569887 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c037070 con 0x7f18a00d2680 2024-09-10T07:35:18.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.944+0000 7f189fe00640 1 -- 172.21.15.99:0/4107569887 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c032440 con 0x7f18a00d2680 2024-09-10T07:35:18.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.944+0000 7f189fe00640 1 -- 172.21.15.99:0/4107569887 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c0327f0 con 0x7f18a00d2680 2024-09-10T07:35:18.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.945+0000 7f18a6a00640 1 -- 172.21.15.99:0/4107569887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 msgr2=0x7f18a00cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:18.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.945+0000 7f18a6a00640 1 --2- 172.21.15.99:0/4107569887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 0x7f18a00cf580 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097a0 tx=0x7f188c02a210 comp rx=0 tx=0).stop 2024-09-10T07:35:18.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.945+0000 7f18a6a00640 1 -- 172.21.15.99:0/4107569887 shutdown_connections 2024-09-10T07:35:18.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.945+0000 7f18a6a00640 1 --2- 172.21.15.99:0/4107569887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 0x7f18a00cf580 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:18.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.945+0000 7f18a6a00640 1 --2- 172.21.15.99:0/4107569887 >> v2:172.21.15.187:3300/0 conn(0x7f18a015e970 0x7f18a00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:18.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.945+0000 7f18a6a00640 1 -- 172.21.15.99:0/4107569887 >> 172.21.15.99:0/4107569887 conn(0x7f18a009de00 msgr2=0x7f18a00d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:18.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.945+0000 7f18a6a00640 1 -- 172.21.15.99:0/4107569887 shutdown_connections 2024-09-10T07:35:18.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.945+0000 7f18a6a00640 1 -- 172.21.15.99:0/4107569887 wait complete. 2024-09-10T07:35:18.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.947+0000 7f18a6a00640 1 Processor -- start 2024-09-10T07:35:18.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.947+0000 7f18a6a00640 1 -- start start 2024-09-10T07:35:18.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00cfac0 0x7f18a015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:18.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a6a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 0x7f18a00ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a6a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18a015e970 0x7f18a00cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a6a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f18a00d0840 con 0x7f18a00cfac0 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a6a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f18a00cff70 con 0x7f18a015e970 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a6a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f18a015ed50 con 0x7f18a00d2680 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00cfac0 0x7f18a015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00cfac0 0x7f18a015ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49650/0 (socket says 172.21.15.99:49650) 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a5600640 1 -- 172.21.15.99:0/1895862853 learned_addr learned my addr 172.21.15.99:0/1895862853 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a4c00640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 0x7f18a00ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a6000640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18a015e970 0x7f18a00cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a5600640 1 -- 172.21.15.99:0/1895862853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 msgr2=0x7f18a00ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a5600640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 0x7f18a00ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a5600640 1 -- 172.21.15.99:0/1895862853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18a015e970 msgr2=0x7f18a00cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:18.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.948+0000 7f18a5600640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18a015e970 0x7f18a00cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:18.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.949+0000 7f18a5600640 1 -- 172.21.15.99:0/1895862853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a00cbc20 con 0x7f18a00cfac0 2024-09-10T07:35:18.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.949+0000 7f18a5600640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00cfac0 0x7f18a015ba50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f189400e9e0 tx=0x7f189400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:18.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.949+0000 7f189d600640 1 -- 172.21.15.99:0/1895862853 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894017070 con 0x7f18a00cfac0 2024-09-10T07:35:18.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.949+0000 7f189d600640 1 -- 172.21.15.99:0/1895862853 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f189400c9d0 con 0x7f18a00cfac0 2024-09-10T07:35:18.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.949+0000 7f189d600640 1 -- 172.21.15.99:0/1895862853 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189400cd80 con 0x7f18a00cfac0 2024-09-10T07:35:18.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.949+0000 7f18a6a00640 1 -- 172.21.15.99:0/1895862853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a00cbf00 con 0x7f18a00cfac0 2024-09-10T07:35:18.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.949+0000 7f18a6a00640 1 -- 172.21.15.99:0/1895862853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a00cc4c0 con 0x7f18a00cfac0 2024-09-10T07:35:18.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.950+0000 7f18a6a00640 1 -- 172.21.15.99:0/1895862853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a00cf580 con 0x7f18a00cfac0 2024-09-10T07:35:18.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.951+0000 7f189d600640 1 -- 172.21.15.99:0/1895862853 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f189401a070 con 0x7f18a00cfac0 2024-09-10T07:35:18.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.952+0000 7f189d600640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 0x7f188006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:18.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.953+0000 7f189d600640 1 -- 172.21.15.99:0/1895862853 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f189408b120 con 0x7f18a00cfac0 2024-09-10T07:35:18.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.953+0000 7f18a4c00640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 0x7f188006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:18.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.953+0000 7f18a4c00640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 0x7f188006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f188c034000 tx=0x7f188c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:18.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:18.957+0000 7f189d600640 1 -- 172.21.15.99:0/1895862853 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1894059350 con 0x7f18a00cfac0 2024-09-10T07:35:19.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.133+0000 7f18a6a00640 1 -- 172.21.15.99:0/1895862853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18a006d530 con 0x7f18a00cfac0 2024-09-10T07:35:19.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.135+0000 7f189d600640 1 -- 172.21.15.99:0/1895862853 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16705 (secure 0 0 0) 0x7f189405d650 con 0x7f18a00cfac0 2024-09-10T07:35:19.135 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:19.135 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":33,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:35:18.758998+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:03.811904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:05.040821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:35:19.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 -- 172.21.15.99:0/1895862853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 msgr2=0x7f188006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:19.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 0x7f188006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f188c034000 tx=0x7f188c02e000 comp rx=0 tx=0).stop 2024-09-10T07:35:19.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 -- 172.21.15.99:0/1895862853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00cfac0 msgr2=0x7f18a015ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:19.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00cfac0 0x7f18a015ba50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f189400e9e0 tx=0x7f189400eea0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 -- 172.21.15.99:0/1895862853 shutdown_connections 2024-09-10T07:35:19.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18a015e970 0x7f18a00cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00d2680 0x7f18a00ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 0x7f188006e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 --2- 172.21.15.99:0/1895862853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00cfac0 0x7f18a015ba50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 -- 172.21.15.99:0/1895862853 >> 172.21.15.99:0/1895862853 conn(0x7f18a009de00 msgr2=0x7f18a00c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 -- 172.21.15.99:0/1895862853 shutdown_connections 2024-09-10T07:35:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.137+0000 7f18a6a00640 1 -- 172.21.15.99:0/1895862853 wait complete. 2024-09-10T07:35:19.154 DEBUG:teuthology.orchestra.run.smithi099:> stdin-killer -- python3 -c ' 2024-09-10T07:35:19.154 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-10T07:35:19.154 DEBUG:teuthology.orchestra.run.smithi099:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-10T07:35:19.154 DEBUG:teuthology.orchestra.run.smithi099:> os.fchmod(fd, 0O666) 2024-09-10T07:35:19.154 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(fd) 2024-09-10T07:35:19.154 DEBUG:teuthology.orchestra.run.smithi099:> os.close(fd) 2024-09-10T07:35:19.154 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-10T07:35:19.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:19.267 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:35:19.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:35:19.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:19.395 INFO:teuthology.orchestra.run.smithi099.stdout:client4923 2024-09-10T07:35:19.395 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client4923/osdmap') 2024-09-10T07:35:19.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:35:19.494 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 31 barrier 31 flags 0x588000 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:osd0 (2)172.21.15.99:6800 100% (exists, up) 100% -1 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:osd1 (2)172.21.15.99:6810 100% (exists, up) 100% -1 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:osd2 (2)172.21.15.99:6808 100% (exists, up) 100% -1 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:osd3 (2)172.21.15.99:6818 100% (exists, up) 100% -1 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:osd4 (2)172.21.15.187:6824 100% (exists, up) 100% -1 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:osd5 (2)172.21.15.187:6800 100% (exists, up) 100% -1 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:osd6 (2)172.21.15.187:6808 100% (exists, up) 100% -1 2024-09-10T07:35:19.495 INFO:teuthology.orchestra.run.smithi099.stdout:osd7 (2)172.21.15.187:6811 100% (exists, up) 100% -1 2024-09-10T07:35:19.496 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records in 2024-09-10T07:35:19.496 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records out 2024-09-10T07:35:19.496 INFO:teuthology.orchestra.run.smithi099.stderr:795 bytes copied, 0.000114438 s, 6.9 MB/s 2024-09-10T07:35:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:19.505 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:19.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.658+0000 7f3673400640 1 Processor -- start 2024-09-10T07:35:19.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.658+0000 7f3673400640 1 -- start start 2024-09-10T07:35:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.660+0000 7f3673400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f366c160c50 0x7f366c167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.660+0000 7f3673400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366c142650 con 0x7f366c142150 2024-09-10T07:35:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.660+0000 7f3673400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366c142930 con 0x7f366c13fae0 2024-09-10T07:35:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.660+0000 7f3673400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f366c0ce780 con 0x7f366c160c50 2024-09-10T07:35:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.660+0000 7f3663e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f366c142150 0x7f366c160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:46874/0 (socket says 172.21.15.99:46874) 2024-09-10T07:35:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.660+0000 7f3663e00640 1 -- 172.21.15.99:0/4040900572 learned_addr learned my addr 172.21.15.99:0/4040900572 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.660+0000 7f3671400640 1 --2- 172.21.15.99:0/4040900572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f366c160c50 0x7f366c167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.660+0000 7f366be00640 1 -- 172.21.15.99:0/4040900572 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 901698161 0 0) 0x7f366c142650 con 0x7f366c142150 2024-09-10T07:35:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.660+0000 7f366be00640 1 -- 172.21.15.99:0/4040900572 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3650003520 con 0x7f366c142150 2024-09-10T07:35:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.661+0000 7f366be00640 1 -- 172.21.15.99:0/4040900572 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1244335303 0 0) 0x7f366c142930 con 0x7f366c13fae0 2024-09-10T07:35:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.661+0000 7f366be00640 1 -- 172.21.15.99:0/4040900572 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f366c142650 con 0x7f366c13fae0 2024-09-10T07:35:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.661+0000 7f366be00640 1 -- 172.21.15.99:0/4040900572 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3489684786 0 0) 0x7f3650003520 con 0x7f366c142150 2024-09-10T07:35:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.661+0000 7f3671400640 1 -- 172.21.15.99:0/4040900572 >> v1:172.21.15.187:6789/0 conn(0x7f366c13fae0 legacy=0x7f366c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.661+0000 7f3671400640 1 -- 172.21.15.99:0/4040900572 >> v1:172.21.15.99:6789/0 conn(0x7f366c142150 legacy=0x7f366c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.661+0000 7f3671400640 1 -- 172.21.15.99:0/4040900572 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c142c10 con 0x7f366c160c50 2024-09-10T07:35:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.662+0000 7f3671400640 1 --2- 172.21.15.99:0/4040900572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f366c160c50 0x7f366c167680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3664009dc0 tx=0x7f366402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada9a1f280eaa6ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.662+0000 7f366be00640 1 -- 172.21.15.99:0/4040900572 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654001670 con 0x7f366c160c50 2024-09-10T07:35:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.662+0000 7f366be00640 1 -- 172.21.15.99:0/4040900572 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3664007540 con 0x7f366c160c50 2024-09-10T07:35:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.662+0000 7f366be00640 1 -- 172.21.15.99:0/4040900572 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664007910 con 0x7f366c160c50 2024-09-10T07:35:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.663+0000 7f3673400640 1 -- 172.21.15.99:0/4040900572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f366c160c50 msgr2=0x7f366c167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.663+0000 7f3673400640 1 --2- 172.21.15.99:0/4040900572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f366c160c50 0x7f366c167680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3664009dc0 tx=0x7f366402a5d0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.663+0000 7f3673400640 1 -- 172.21.15.99:0/4040900572 shutdown_connections 2024-09-10T07:35:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.663+0000 7f3673400640 1 --2- 172.21.15.99:0/4040900572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f366c160c50 0x7f366c167680 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.663+0000 7f3673400640 1 -- 172.21.15.99:0/4040900572 >> 172.21.15.99:0/4040900572 conn(0x7f366c06bc10 msgr2=0x7f366c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.663+0000 7f3673400640 1 -- 172.21.15.99:0/4040900572 shutdown_connections 2024-09-10T07:35:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.663+0000 7f3673400640 1 -- 172.21.15.99:0/4040900572 wait complete. 2024-09-10T07:35:19.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.664+0000 7f3673400640 1 Processor -- start 2024-09-10T07:35:19.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.665+0000 7f3673400640 1 -- start start 2024-09-10T07:35:19.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.665+0000 7f3673400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f366c13fae0 0x7f366c1f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:19.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.665+0000 7f3673400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f366c142150 0x7f366c072df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:19.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3673400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f366c160c50 0x7f366c13b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:19.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3673400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f366c0cfda0 con 0x7f366c160c50 2024-09-10T07:35:19.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3673400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f366c0cfc20 con 0x7f366c13fae0 2024-09-10T07:35:19.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3673400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f366c0cff20 con 0x7f366c142150 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3671400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f366c160c50 0x7f366c13b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3671400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f366c160c50 0x7f366c13b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49658/0 (socket says 172.21.15.99:49658) 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3671400640 1 -- 172.21.15.99:0/1281811940 learned_addr learned my addr 172.21.15.99:0/1281811940 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3670a00640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f366c13fae0 0x7f366c1f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3671400640 1 -- 172.21.15.99:0/1281811940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f366c142150 msgr2=0x7f366c072df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3671400640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f366c142150 0x7f366c072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3671400640 1 -- 172.21.15.99:0/1281811940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f366c13fae0 msgr2=0x7f366c1f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3671400640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f366c13fae0 0x7f366c1f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.666+0000 7f3671400640 1 -- 172.21.15.99:0/1281811940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c13ccb0 con 0x7f366c160c50 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.667+0000 7f3671400640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f366c160c50 0x7f366c13b090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f366402abc0 tx=0x7f3664004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.667+0000 7f3669600640 1 -- 172.21.15.99:0/1281811940 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366403f070 con 0x7f366c160c50 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.667+0000 7f3669600640 1 -- 172.21.15.99:0/1281811940 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3664031bc0 con 0x7f366c160c50 2024-09-10T07:35:19.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.667+0000 7f3669600640 1 -- 172.21.15.99:0/1281811940 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664009450 con 0x7f366c160c50 2024-09-10T07:35:19.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.667+0000 7f3673400640 1 -- 172.21.15.99:0/1281811940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366c140e50 con 0x7f366c160c50 2024-09-10T07:35:19.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.667+0000 7f3673400640 1 -- 172.21.15.99:0/1281811940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366c140b70 con 0x7f366c160c50 2024-09-10T07:35:19.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.668+0000 7f3673400640 1 -- 172.21.15.99:0/1281811940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f366c160540 con 0x7f366c160c50 2024-09-10T07:35:19.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.669+0000 7f3669600640 1 -- 172.21.15.99:0/1281811940 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3664044460 con 0x7f366c160c50 2024-09-10T07:35:19.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.670+0000 7f3669600640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f364806be30 0x7f364806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:19.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.670+0000 7f3669600640 1 -- 172.21.15.99:0/1281811940 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f36640ac3a0 con 0x7f366c160c50 2024-09-10T07:35:19.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.670+0000 7f3670a00640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f364806be30 0x7f364806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:19.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.671+0000 7f3670a00640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f364806be30 0x7f364806e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f365c0011e0 tx=0x7f365c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:19.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.674+0000 7f3669600640 1 -- 172.21.15.99:0/1281811940 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f366407ade0 con 0x7f366c160c50 2024-09-10T07:35:19.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.881+0000 7f3673400640 1 -- 172.21.15.99:0/1281811940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f366c0690e0 con 0x7f366c160c50 2024-09-10T07:35:19.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.882+0000 7f3669600640 1 -- 172.21.15.99:0/1281811940 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f366407a6e0 con 0x7f366c160c50 2024-09-10T07:35:19.882 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:19.882 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"btime":"2024-09-10T07:35:09:706532+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3299804861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3299804861},{"type":"v1","addr":"172.21.15.187:6834","nonce":3299804861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/4173112208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4173112208},{"type":"v1","addr":"172.21.15.187:6835","nonce":4173112208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4740,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2963379591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2963379591},{"type":"v1","addr":"172.21.15.99:6835","nonce":2963379591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:06.038065+0000","modified":"2024-09-10T07:35:09.110775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4743":{"gid":4743,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/4168486217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":4168486217},{"type":"v1","addr":"172.21.15.99:6837","nonce":4168486217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4743,"qdb_cluster":[4743]},"id":2}]} 2024-09-10T07:35:19.882 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-09-10T07:35:19.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.884+0000 7f3673400640 1 -- 172.21.15.99:0/1281811940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f364806be30 msgr2=0x7f364806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.884+0000 7f3673400640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f364806be30 0x7f364806e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f365c0011e0 tx=0x7f365c009040 comp rx=0 tx=0).stop 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.884+0000 7f3673400640 1 -- 172.21.15.99:0/1281811940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f366c160c50 msgr2=0x7f366c13b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.884+0000 7f3673400640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f366c160c50 0x7f366c13b090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f366402abc0 tx=0x7f3664004a40 comp rx=0 tx=0).stop 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.884+0000 7f3673400640 1 -- 172.21.15.99:0/1281811940 shutdown_connections 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.884+0000 7f3673400640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f364806be30 0x7f364806e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.884+0000 7f3673400640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f366c160c50 0x7f366c13b090 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.884+0000 7f3673400640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f366c142150 0x7f366c072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.884+0000 7f3673400640 1 --2- 172.21.15.99:0/1281811940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f366c13fae0 0x7f366c1f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.884+0000 7f3673400640 1 -- 172.21.15.99:0/1281811940 >> 172.21.15.99:0/1281811940 conn(0x7f366c06bc10 msgr2=0x7f366c15f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.885+0000 7f3673400640 1 -- 172.21.15.99:0/1281811940 shutdown_connections 2024-09-10T07:35:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:19.885+0000 7f3673400640 1 -- 172.21.15.99:0/1281811940 wait complete. 2024-09-10T07:35:19.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 33 2024-09-10T07:35:20.075 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-10T07:35:20.076 DEBUG:teuthology.orchestra.run.smithi099:> stdin-killer -- python3 -c ' 2024-09-10T07:35:20.076 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-10T07:35:20.076 DEBUG:teuthology.orchestra.run.smithi099:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-10T07:35:20.076 DEBUG:teuthology.orchestra.run.smithi099:> os.fchmod(fd, 0O666) 2024-09-10T07:35:20.076 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(fd) 2024-09-10T07:35:20.076 DEBUG:teuthology.orchestra.run.smithi099:> os.close(fd) 2024-09-10T07:35:20.076 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-10T07:35:20.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:20.192 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:35:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:35:20.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:20.322 INFO:teuthology.orchestra.run.smithi099.stdout:client4923 2024-09-10T07:35:20.323 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client4923/osdmap') 2024-09-10T07:35:20.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:35:20.421 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 33 barrier 33 flags 0x588000 2024-09-10T07:35:20.421 INFO:teuthology.orchestra.run.smithi099.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stdout:osd0 (2)172.21.15.99:6800 100% (exists, up) 100% -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stdout:osd1 (2)172.21.15.99:6810 100% (exists, up) 100% -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stdout:osd2 (2)172.21.15.99:6808 100% (exists, up) 100% -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stdout:osd3 (2)172.21.15.99:6818 100% (exists, up) 100% -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stdout:osd4 (2)172.21.15.187:6824 100% (exists, up) 100% -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stdout:osd5 (2)172.21.15.187:6800 100% (exists, up) 100% -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stdout:osd6 (2)172.21.15.187:6808 100% (exists, up) 100% -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stdout:osd7 (2)172.21.15.187:6811 100% (exists, up) 100% -1 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records in 2024-09-10T07:35:20.422 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records out 2024-09-10T07:35:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:795 bytes copied, 7.3268e-05 s, 10.9 MB/s 2024-09-10T07:35:20.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:20.432 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:35:20.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:35:20.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:20.521 INFO:teuthology.orchestra.run.smithi099.stdout:client4923 2024-09-10T07:35:20.522 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client4923/osdmap') 2024-09-10T07:35:20.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 33 barrier 33 flags 0x588000 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:osd0 (2)172.21.15.99:6800 100% (exists, up) 100% -1 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:osd1 (2)172.21.15.99:6810 100% (exists, up) 100% -1 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:osd2 (2)172.21.15.99:6808 100% (exists, up) 100% -1 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:osd3 (2)172.21.15.99:6818 100% (exists, up) 100% -1 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:osd4 (2)172.21.15.187:6824 100% (exists, up) 100% -1 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:osd5 (2)172.21.15.187:6800 100% (exists, up) 100% -1 2024-09-10T07:35:20.621 INFO:teuthology.orchestra.run.smithi099.stdout:osd6 (2)172.21.15.187:6808 100% (exists, up) 100% -1 2024-09-10T07:35:20.622 INFO:teuthology.orchestra.run.smithi099.stdout:osd7 (2)172.21.15.187:6811 100% (exists, up) 100% -1 2024-09-10T07:35:20.622 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records in 2024-09-10T07:35:20.622 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records out 2024-09-10T07:35:20.622 INFO:teuthology.orchestra.run.smithi099.stderr:795 bytes copied, 6.9433e-05 s, 11.4 MB/s 2024-09-10T07:35:20.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:20.631 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T07:35:20.631 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:35:20.631 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:35:20.718 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:35:20.813 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:35:20.814 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:35:20.814 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:20.814 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:20.849 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:20.850 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:20.926 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:35:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.120+0000 7fb28c000640 1 Processor -- start 2024-09-10T07:35:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.120+0000 7fb28c000640 1 -- start start 2024-09-10T07:35:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28c000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb2840b5750 0x7fb28415d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28c000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb2840cf890 0x7fb2840cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28c000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28415c800 con 0x7fb2840ce070 2024-09-10T07:35:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28c000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb2840b5bb0 con 0x7fb2840cf890 2024-09-10T07:35:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28c000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb2840d0240 con 0x7fb2840b5750 2024-09-10T07:35:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb2840cf890 0x7fb2840cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb2840cf890 0x7fb2840cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32914/0 (socket says 172.21.15.99:32914) 2024-09-10T07:35:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28a000640 1 -- 172.21.15.99:0/4204872047 learned_addr learned my addr 172.21.15.99:0/4204872047 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb288c00640 1 --2- 172.21.15.99:0/4204872047 >> v2:172.21.15.187:3300/0 conn(0x7fb2840b5750 0x7fb28415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28a000640 1 -- 172.21.15.99:0/4204872047 >> v2:172.21.15.187:3300/0 conn(0x7fb2840b5750 msgr2=0x7fb28415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28a000640 1 --2- 172.21.15.99:0/4204872047 >> v2:172.21.15.187:3300/0 conn(0x7fb2840b5750 0x7fb28415d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28a000640 1 -- 172.21.15.99:0/4204872047 >> v1:172.21.15.187:6789/0 conn(0x7fb2840ce070 legacy=0x7fb28415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.122+0000 7fb28a000640 1 -- 172.21.15.99:0/4204872047 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28415cae0 con 0x7fb2840cf890 2024-09-10T07:35:21.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.123+0000 7fb28a000640 1 --2- 172.21.15.99:0/4204872047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840cf890 0x7fb2840cfd00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb28415f500 tx=0x7fb27c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46041b8dd74aadd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:21.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb283e00640 1 -- 172.21.15.99:0/4204872047 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c036070 con 0x7fb2840cf890 2024-09-10T07:35:21.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb283e00640 1 -- 172.21.15.99:0/4204872047 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c031600 con 0x7fb2840cf890 2024-09-10T07:35:21.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb283e00640 1 -- 172.21.15.99:0/4204872047 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0319d0 con 0x7fb2840cf890 2024-09-10T07:35:21.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb28c000640 1 -- 172.21.15.99:0/4204872047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840cf890 msgr2=0x7fb2840cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb28c000640 1 --2- 172.21.15.99:0/4204872047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840cf890 0x7fb2840cfd00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb28415f500 tx=0x7fb27c02a760 comp rx=0 tx=0).stop 2024-09-10T07:35:21.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb28c000640 1 -- 172.21.15.99:0/4204872047 shutdown_connections 2024-09-10T07:35:21.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb28c000640 1 --2- 172.21.15.99:0/4204872047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840cf890 0x7fb2840cfd00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb28c000640 1 --2- 172.21.15.99:0/4204872047 >> v2:172.21.15.187:3300/0 conn(0x7fb2840b5750 0x7fb28415d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb28c000640 1 -- 172.21.15.99:0/4204872047 >> 172.21.15.99:0/4204872047 conn(0x7fb2840b2630 msgr2=0x7fb2840b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:21.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb28c000640 1 -- 172.21.15.99:0/4204872047 shutdown_connections 2024-09-10T07:35:21.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.124+0000 7fb28c000640 1 -- 172.21.15.99:0/4204872047 wait complete. 2024-09-10T07:35:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.126+0000 7fb28c000640 1 Processor -- start 2024-09-10T07:35:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.126+0000 7fb28c000640 1 -- start start 2024-09-10T07:35:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb28c000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840b5750 0x7fb2841472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb28c000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2840ce070 0x7fb2840ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb28c000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2840cf890 0x7fb28415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb28c000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb28415d6b0 con 0x7fb2840b5750 2024-09-10T07:35:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb28c000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb2840ce450 con 0x7fb2840ce070 2024-09-10T07:35:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb28c000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb28415d830 con 0x7fb2840cf890 2024-09-10T07:35:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb289600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840b5750 0x7fb2841472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb289600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840b5750 0x7fb2841472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32920/0 (socket says 172.21.15.99:32920) 2024-09-10T07:35:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb289600640 1 -- 172.21.15.99:0/3806712731 learned_addr learned my addr 172.21.15.99:0/3806712731 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb288c00640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2840ce070 0x7fb2840ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.127+0000 7fb28a000640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2840cf890 0x7fb28415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb289600640 1 -- 172.21.15.99:0/3806712731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2840cf890 msgr2=0x7fb28415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb289600640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2840cf890 0x7fb28415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb289600640 1 -- 172.21.15.99:0/3806712731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2840ce070 msgr2=0x7fb2840ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb289600640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2840ce070 0x7fb2840ac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb289600640 1 -- 172.21.15.99:0/3806712731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2841477f0 con 0x7fb2840b5750 2024-09-10T07:35:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb289600640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840b5750 0x7fb2841472b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c3c0 tx=0x7fb27800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb281600640 1 -- 172.21.15.99:0/3806712731 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2780052d0 con 0x7fb2840b5750 2024-09-10T07:35:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb281600640 1 -- 172.21.15.99:0/3806712731 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb278005490 con 0x7fb2840b5750 2024-09-10T07:35:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb281600640 1 -- 172.21.15.99:0/3806712731 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb278007260 con 0x7fb2840b5750 2024-09-10T07:35:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb28c000640 1 -- 172.21.15.99:0/3806712731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb284151bb0 con 0x7fb2840b5750 2024-09-10T07:35:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.128+0000 7fb28c000640 1 -- 172.21.15.99:0/3806712731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb284152170 con 0x7fb2840b5750 2024-09-10T07:35:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.129+0000 7fb28c000640 1 -- 172.21.15.99:0/3806712731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28415d170 con 0x7fb2840b5750 2024-09-10T07:35:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.130+0000 7fb281600640 1 -- 172.21.15.99:0/3806712731 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb278007400 con 0x7fb2840b5750 2024-09-10T07:35:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.131+0000 7fb281600640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb26406be30 0x7fb26406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.131+0000 7fb281600640 1 -- 172.21.15.99:0/3806712731 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb27808a310 con 0x7fb2840b5750 2024-09-10T07:35:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.131+0000 7fb288c00640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb26406be30 0x7fb26406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.132+0000 7fb288c00640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb26406be30 0x7fb26406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2840b2530 tx=0x7fb270008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:21.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.136+0000 7fb281600640 1 -- 172.21.15.99:0/3806712731 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2780585d0 con 0x7fb2840b5750 2024-09-10T07:35:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.319+0000 7fb28c000640 1 -- 172.21.15.99:0/3806712731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb2840b2cf0 con 0x7fb2840b5750 2024-09-10T07:35:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.320+0000 7fb281600640 1 -- 172.21.15.99:0/3806712731 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7fb27805c8d0 con 0x7fb2840b5750 2024-09-10T07:35:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:35:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 -- 172.21.15.99:0/3806712731 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb26406be30 msgr2=0x7fb26406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb26406be30 0x7fb26406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2840b2530 tx=0x7fb270008040 comp rx=0 tx=0).stop 2024-09-10T07:35:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 -- 172.21.15.99:0/3806712731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840b5750 msgr2=0x7fb2841472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840b5750 0x7fb2841472b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c3c0 tx=0x7fb27800c880 comp rx=0 tx=0).stop 2024-09-10T07:35:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 -- 172.21.15.99:0/3806712731 shutdown_connections 2024-09-10T07:35:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2840cf890 0x7fb28415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2840ce070 0x7fb2840ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb26406be30 0x7fb26406e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 --2- 172.21.15.99:0/3806712731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2840b5750 0x7fb2841472b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 -- 172.21.15.99:0/3806712731 >> 172.21.15.99:0/3806712731 conn(0x7fb2840b2630 msgr2=0x7fb284154000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 -- 172.21.15.99:0/3806712731 shutdown_connections 2024-09-10T07:35:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.322+0000 7fb28c000640 1 -- 172.21.15.99:0/3806712731 wait complete. 2024-09-10T07:35:21.339 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:35:21.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:21.339 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:35:21.432 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:35:21.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:21.432 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:35:21.474 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:35:21.474 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:35:21.475 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:21.513 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:35:21.513 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:21.590 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:35:21.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.747+0000 7f1ba0c00640 1 Processor -- start 2024-09-10T07:35:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.747+0000 7f1ba0c00640 1 -- start start 2024-09-10T07:35:21.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.748+0000 7f1ba0c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0b5750 0x7f1b9c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.748+0000 7f1ba0c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1b9c0cf890 0x7f1b9c0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.748+0000 7f1ba0c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b9c15c800 con 0x7f1b9c0ce070 2024-09-10T07:35:21.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.748+0000 7f1ba0c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f1b9c0b5bb0 con 0x7f1b9c0cf890 2024-09-10T07:35:21.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.748+0000 7f1ba0c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9c0ce450 con 0x7f1b9c0b5750 2024-09-10T07:35:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.748+0000 7f1b99400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0b5750 0x7f1b9c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.748+0000 7f1b9a800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1b9c0cf890 0x7f1b9c0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.749+0000 7f1b99400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0b5750 0x7f1b9c15d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:47408/0 (socket says 172.21.15.99:47408) 2024-09-10T07:35:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.749+0000 7f1b99400640 1 -- 172.21.15.99:0/2700569108 learned_addr learned my addr 172.21.15.99:0/2700569108 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.749+0000 7f1b99e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f1b9c0ce070 0x7f1b9c15bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:57066/0 (socket says 172.21.15.99:57066) 2024-09-10T07:35:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.749+0000 7f1b98a00640 1 -- 172.21.15.99:0/2700569108 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547677966 0 0) 0x7f1b9c15c800 con 0x7f1b9c0ce070 2024-09-10T07:35:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.749+0000 7f1b98a00640 1 -- 172.21.15.99:0/2700569108 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b80003520 con 0x7f1b9c0ce070 2024-09-10T07:35:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.749+0000 7f1b9a800640 1 -- 172.21.15.99:0/2700569108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0b5750 msgr2=0x7f1b9c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.749+0000 7f1b9a800640 1 --2- 172.21.15.99:0/2700569108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0b5750 0x7f1b9c15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.749+0000 7f1b9a800640 1 -- 172.21.15.99:0/2700569108 >> v1:172.21.15.187:6789/0 conn(0x7f1b9c0ce070 legacy=0x7f1b9c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.749+0000 7f1b9a800640 1 -- 172.21.15.99:0/2700569108 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9c15cae0 con 0x7f1b9c0cf890 2024-09-10T07:35:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.749+0000 7f1b99400640 1 --2- 172.21.15.99:0/2700569108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0b5750 0x7f1b9c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:21.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.750+0000 7f1b9a800640 1 --2- 172.21.15.99:0/2700569108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b9c0cf890 0x7f1b9c0cfd40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b940097a0 tx=0x7f1b9402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c0df9f3a2f43617 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:21.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.750+0000 7f1b98a00640 1 -- 172.21.15.99:0/2700569108 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94037070 con 0x7f1b9c0cf890 2024-09-10T07:35:21.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.750+0000 7f1b98a00640 1 -- 172.21.15.99:0/2700569108 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b94032440 con 0x7f1b9c0cf890 2024-09-10T07:35:21.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.750+0000 7f1b98a00640 1 -- 172.21.15.99:0/2700569108 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b940327f0 con 0x7f1b9c0cf890 2024-09-10T07:35:21.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.751+0000 7f1ba0c00640 1 -- 172.21.15.99:0/2700569108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b9c0cf890 msgr2=0x7f1b9c0cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.751+0000 7f1ba0c00640 1 --2- 172.21.15.99:0/2700569108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b9c0cf890 0x7f1b9c0cfd40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b940097a0 tx=0x7f1b9402a180 comp rx=0 tx=0).stop 2024-09-10T07:35:21.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.751+0000 7f1ba0c00640 1 -- 172.21.15.99:0/2700569108 shutdown_connections 2024-09-10T07:35:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.751+0000 7f1ba0c00640 1 --2- 172.21.15.99:0/2700569108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b9c0cf890 0x7f1b9c0cfd40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.751+0000 7f1ba0c00640 1 --2- 172.21.15.99:0/2700569108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0b5750 0x7f1b9c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.751+0000 7f1ba0c00640 1 -- 172.21.15.99:0/2700569108 >> 172.21.15.99:0/2700569108 conn(0x7f1b9c0b2630 msgr2=0x7f1b9c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.751+0000 7f1ba0c00640 1 -- 172.21.15.99:0/2700569108 shutdown_connections 2024-09-10T07:35:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.751+0000 7f1ba0c00640 1 -- 172.21.15.99:0/2700569108 wait complete. 2024-09-10T07:35:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.752+0000 7f1ba0c00640 1 Processor -- start 2024-09-10T07:35:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.753+0000 7f1ba0c00640 1 -- start start 2024-09-10T07:35:21.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.753+0000 7f1ba0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0b5750 0x7f1b9c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.753+0000 7f1ba0c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0ce070 0x7f1b9c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.753+0000 7f1ba0c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b9c0cf890 0x7f1b9c151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.753+0000 7f1ba0c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c15d830 con 0x7f1b9c0b5750 2024-09-10T07:35:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.753+0000 7f1ba0c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c15d6b0 con 0x7f1b9c0cf890 2024-09-10T07:35:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.753+0000 7f1ba0c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9c06e080 con 0x7f1b9c0ce070 2024-09-10T07:35:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b99e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0b5750 0x7f1b9c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b99e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0b5750 0x7f1b9c15acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32936/0 (socket says 172.21.15.99:32936) 2024-09-10T07:35:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b9a800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b9c0cf890 0x7f1b9c151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b99e00640 1 -- 172.21.15.99:0/3404900317 learned_addr learned my addr 172.21.15.99:0/3404900317 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b99400640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0ce070 0x7f1b9c0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b99e00640 1 -- 172.21.15.99:0/3404900317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0ce070 msgr2=0x7f1b9c0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b99e00640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0ce070 0x7f1b9c0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b99e00640 1 -- 172.21.15.99:0/3404900317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b9c0cf890 msgr2=0x7f1b9c151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b99e00640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b9c0cf890 0x7f1b9c151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b99e00640 1 -- 172.21.15.99:0/3404900317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9c073340 con 0x7f1b9c0b5750 2024-09-10T07:35:21.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.754+0000 7f1b99e00640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0b5750 0x7f1b9c15acd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00c840 tx=0x7f1b8c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:21.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.755+0000 7f1b92000640 1 -- 172.21.15.99:0/3404900317 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c017070 con 0x7f1b9c0b5750 2024-09-10T07:35:21.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.755+0000 7f1b92000640 1 -- 172.21.15.99:0/3404900317 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00a640 con 0x7f1b9c0b5750 2024-09-10T07:35:21.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.755+0000 7f1b92000640 1 -- 172.21.15.99:0/3404900317 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00aa10 con 0x7f1b9c0b5750 2024-09-10T07:35:21.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.755+0000 7f1ba0c00640 1 -- 172.21.15.99:0/3404900317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b9c1f4d60 con 0x7f1b9c0b5750 2024-09-10T07:35:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.755+0000 7f1ba0c00640 1 -- 172.21.15.99:0/3404900317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b9c1f5320 con 0x7f1b9c0b5750 2024-09-10T07:35:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.756+0000 7f1ba0c00640 1 -- 172.21.15.99:0/3404900317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9c0b5330 con 0x7f1b9c0b5750 2024-09-10T07:35:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.757+0000 7f1b92000640 1 -- 172.21.15.99:0/3404900317 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b8c01a070 con 0x7f1b9c0b5750 2024-09-10T07:35:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.758+0000 7f1b92000640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b7c06be30 0x7f1b7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.758+0000 7f1b92000640 1 -- 172.21.15.99:0/3404900317 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1b8c08a4d0 con 0x7f1b9c0b5750 2024-09-10T07:35:21.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.758+0000 7f1b99400640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b7c06be30 0x7f1b7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:21.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.759+0000 7f1b99400640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b7c06be30 0x7f1b7c06e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c06ed00 tx=0x7f1b88009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:21.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.762+0000 7f1b92000640 1 -- 172.21.15.99:0/3404900317 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b9c0b5330 con 0x7f1b9c0b5750 2024-09-10T07:35:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.947+0000 7f1ba0c00640 1 -- 172.21.15.99:0/3404900317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1b9c15d170 con 0x7f1b9c0b5750 2024-09-10T07:35:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.947+0000 7f1b92000640 1 -- 172.21.15.99:0/3404900317 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f1b8c088e20 con 0x7f1b9c0b5750 2024-09-10T07:35:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:35:21.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 -- 172.21.15.99:0/3404900317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b7c06be30 msgr2=0x7f1b7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b7c06be30 0x7f1b7c06e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c06ed00 tx=0x7f1b88009240 comp rx=0 tx=0).stop 2024-09-10T07:35:21.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 -- 172.21.15.99:0/3404900317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0b5750 msgr2=0x7f1b9c15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:21.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0b5750 0x7f1b9c15acd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00c840 tx=0x7f1b8c00cd00 comp rx=0 tx=0).stop 2024-09-10T07:35:21.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 -- 172.21.15.99:0/3404900317 shutdown_connections 2024-09-10T07:35:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b9c0cf890 0x7f1b9c151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b9c0ce070 0x7f1b9c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b7c06be30 0x7f1b7c06e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 --2- 172.21.15.99:0/3404900317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0b5750 0x7f1b9c15acd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 -- 172.21.15.99:0/3404900317 >> 172.21.15.99:0/3404900317 conn(0x7f1b9c0b2630 msgr2=0x7f1b9c074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 -- 172.21.15.99:0/3404900317 shutdown_connections 2024-09-10T07:35:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:21.949+0000 7f1ba0c00640 1 -- 172.21.15.99:0/3404900317 wait complete. 2024-09-10T07:35:21.965 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:35:21.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:21.965 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T07:35:22.030 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:35:22.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:22.031 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:35:22.067 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:35:22.067 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:22.067 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:22.103 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:35:22.103 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:35:22.103 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:35:22.103 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:22.142 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:35:22.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.296+0000 7f6269200640 1 Processor -- start 2024-09-10T07:35:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.297+0000 7f6269200640 1 -- start start 2024-09-10T07:35:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.298+0000 7f6269200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f626415c580 0x7f626406d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.298+0000 7f6269200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f626415c960 0x7f62640b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.298+0000 7f6269200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626406d920 con 0x7f62640cea40 2024-09-10T07:35:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.298+0000 7f6269200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f62640b3930 con 0x7f626415c580 2024-09-10T07:35:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.298+0000 7f6269200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f626406dc00 con 0x7f626415c960 2024-09-10T07:35:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.298+0000 7f6263400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f626415c580 0x7f626406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.298+0000 7f6263400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f626415c580 0x7f626406d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32950/0 (socket says 172.21.15.99:32950) 2024-09-10T07:35:22.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.298+0000 7f6263400640 1 -- 172.21.15.99:0/2520973515 learned_addr learned my addr 172.21.15.99:0/2520973515 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.298+0000 7f6263e00640 1 --1- 172.21.15.99:0/2520973515 >> v1:172.21.15.99:6789/0 conn(0x7f62640cea40 0x7f626406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36750/0 (socket says 172.21.15.99:36750) 2024-09-10T07:35:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.298+0000 7f6262a00640 1 --2- 172.21.15.99:0/2520973515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f626415c960 0x7f62640b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.299+0000 7f6263400640 1 -- 172.21.15.99:0/2520973515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f626415c960 msgr2=0x7f62640b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.299+0000 7f6263400640 1 --2- 172.21.15.99:0/2520973515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f626415c960 0x7f62640b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.299+0000 7f6263400640 1 -- 172.21.15.99:0/2520973515 >> v1:172.21.15.99:6789/0 conn(0x7f62640cea40 legacy=0x7f626406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.299+0000 7f6263400640 1 -- 172.21.15.99:0/2520973515 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626406dee0 con 0x7f626415c580 2024-09-10T07:35:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.300+0000 7f6263400640 1 --2- 172.21.15.99:0/2520973515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f626415c580 0x7f626406d340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6254009e50 tx=0x7f625402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62605ef7c075c732 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.300+0000 7f6262000640 1 -- 172.21.15.99:0/2520973515 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254036070 con 0x7f626415c580 2024-09-10T07:35:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.300+0000 7f6262000640 1 -- 172.21.15.99:0/2520973515 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6254031600 con 0x7f626415c580 2024-09-10T07:35:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.300+0000 7f6262000640 1 -- 172.21.15.99:0/2520973515 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540319d0 con 0x7f626415c580 2024-09-10T07:35:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.300+0000 7f6269200640 1 -- 172.21.15.99:0/2520973515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f626415c580 msgr2=0x7f626406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.300+0000 7f6269200640 1 --2- 172.21.15.99:0/2520973515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f626415c580 0x7f626406d340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6254009e50 tx=0x7f625402a710 comp rx=0 tx=0).stop 2024-09-10T07:35:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.300+0000 7f6269200640 1 -- 172.21.15.99:0/2520973515 shutdown_connections 2024-09-10T07:35:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.300+0000 7f6269200640 1 --2- 172.21.15.99:0/2520973515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f626415c960 0x7f62640b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.300+0000 7f6269200640 1 --2- 172.21.15.99:0/2520973515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f626415c580 0x7f626406d340 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.300+0000 7f6269200640 1 -- 172.21.15.99:0/2520973515 >> 172.21.15.99:0/2520973515 conn(0x7f62640b2810 msgr2=0x7f62640b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.301+0000 7f6269200640 1 -- 172.21.15.99:0/2520973515 shutdown_connections 2024-09-10T07:35:22.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.301+0000 7f6269200640 1 -- 172.21.15.99:0/2520973515 wait complete. 2024-09-10T07:35:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.302+0000 7f6269200640 1 Processor -- start 2024-09-10T07:35:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.302+0000 7f6269200640 1 -- start start 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.303+0000 7f6269200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62640cea40 0x7f6264156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.303+0000 7f6269200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f626415c580 0x7f62641590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.303+0000 7f6269200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62641f3160 0x7f62640c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.303+0000 7f6269200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f626406c4a0 con 0x7f62640cea40 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.303+0000 7f6269200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f626406c320 con 0x7f62641f3160 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.303+0000 7f6269200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f62640cee40 con 0x7f626415c580 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.303+0000 7f6263400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62640cea40 0x7f6264156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.303+0000 7f6263400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62640cea40 0x7f6264156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32964/0 (socket says 172.21.15.99:32964) 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.303+0000 7f6263400640 1 -- 172.21.15.99:0/1578533385 learned_addr learned my addr 172.21.15.99:0/1578533385 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f6263400640 1 -- 172.21.15.99:0/1578533385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f626415c580 msgr2=0x7f62641590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f6263400640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f626415c580 0x7f62641590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f6263400640 1 -- 172.21.15.99:0/1578533385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62641f3160 msgr2=0x7f62640c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f6263400640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62641f3160 0x7f62640c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f6263400640 1 -- 172.21.15.99:0/1578533385 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62641f3bb0 con 0x7f62640cea40 2024-09-10T07:35:22.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f6263400640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62640cea40 0x7f6264156110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6254009f70 tx=0x7f6254004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:22.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f625b400640 1 -- 172.21.15.99:0/1578533385 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625403f020 con 0x7f62640cea40 2024-09-10T07:35:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f625b400640 1 -- 172.21.15.99:0/1578533385 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6254037040 con 0x7f62640cea40 2024-09-10T07:35:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f625b400640 1 -- 172.21.15.99:0/1578533385 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254036070 con 0x7f62640cea40 2024-09-10T07:35:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f6269200640 1 -- 172.21.15.99:0/1578533385 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62641f3e90 con 0x7f62640cea40 2024-09-10T07:35:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.304+0000 7f6269200640 1 -- 172.21.15.99:0/1578533385 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62641f4450 con 0x7f62640cea40 2024-09-10T07:35:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.306+0000 7f6269200640 1 -- 172.21.15.99:0/1578533385 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f626406d340 con 0x7f62640cea40 2024-09-10T07:35:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.306+0000 7f625b400640 1 -- 172.21.15.99:0/1578533385 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6254042020 con 0x7f62640cea40 2024-09-10T07:35:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.307+0000 7f625b400640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f624406be60 0x7f624406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.307+0000 7f625b400640 1 -- 172.21.15.99:0/1578533385 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f62540ab380 con 0x7f62640cea40 2024-09-10T07:35:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.307+0000 7f6262a00640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f624406be60 0x7f624406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:22.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.308+0000 7f6262a00640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f624406be60 0x7f624406e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6250006fd0 tx=0x7f6250008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:22.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.312+0000 7f625b400640 1 -- 172.21.15.99:0/1578533385 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6254049030 con 0x7f62640cea40 2024-09-10T07:35:22.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.519+0000 7f6269200640 1 -- 172.21.15.99:0/1578533385 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62640cc170 con 0x7f62640cea40 2024-09-10T07:35:22.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.519+0000 7f625b400640 1 -- 172.21.15.99:0/1578533385 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f6254079640 con 0x7f62640cea40 2024-09-10T07:35:22.519 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:22.520 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"btime":"2024-09-10T07:35:09:706532+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3299804861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3299804861},{"type":"v1","addr":"172.21.15.187:6834","nonce":3299804861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/4173112208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4173112208},{"type":"v1","addr":"172.21.15.187:6835","nonce":4173112208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4740,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2963379591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2963379591},{"type":"v1","addr":"172.21.15.99:6835","nonce":2963379591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:06.038065+0000","modified":"2024-09-10T07:35:09.110775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4743":{"gid":4743,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/4168486217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":4168486217},{"type":"v1","addr":"172.21.15.99:6837","nonce":4168486217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4743,"qdb_cluster":[4743]},"id":2}]} 2024-09-10T07:35:22.520 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-09-10T07:35:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.521+0000 7f6269200640 1 -- 172.21.15.99:0/1578533385 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f624406be60 msgr2=0x7f624406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.521+0000 7f6269200640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f624406be60 0x7f624406e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6250006fd0 tx=0x7f6250008040 comp rx=0 tx=0).stop 2024-09-10T07:35:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.521+0000 7f6269200640 1 -- 172.21.15.99:0/1578533385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62640cea40 msgr2=0x7f6264156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.522+0000 7f6269200640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62640cea40 0x7f6264156110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6254009f70 tx=0x7f6254004a40 comp rx=0 tx=0).stop 2024-09-10T07:35:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.522+0000 7f6269200640 1 -- 172.21.15.99:0/1578533385 shutdown_connections 2024-09-10T07:35:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.522+0000 7f6269200640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62641f3160 0x7f62640c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.522+0000 7f6269200640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f626415c580 0x7f62641590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.522+0000 7f6269200640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f624406be60 0x7f624406e320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.522+0000 7f6269200640 1 --2- 172.21.15.99:0/1578533385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62640cea40 0x7f6264156110 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.522+0000 7f6269200640 1 -- 172.21.15.99:0/1578533385 >> 172.21.15.99:0/1578533385 conn(0x7f62640b2810 msgr2=0x7f626415e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:22.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.522+0000 7f6269200640 1 -- 172.21.15.99:0/1578533385 shutdown_connections 2024-09-10T07:35:22.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.522+0000 7f6269200640 1 -- 172.21.15.99:0/1578533385 wait complete. 2024-09-10T07:35:22.539 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:22.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.696+0000 7f857a000640 1 Processor -- start 2024-09-10T07:35:22.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.696+0000 7f857a000640 1 -- start start 2024-09-10T07:35:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.697+0000 7f857a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8574072f40 0x7f857406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.697+0000 7f857a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85740ce780 0x7f85740b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.697+0000 7f857a000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f857406e3d0 con 0x7f8574145290 2024-09-10T07:35:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.697+0000 7f857a000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f857406efe0 con 0x7f85740ce780 2024-09-10T07:35:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.697+0000 7f857a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f857406e6b0 con 0x7f8574072f40 2024-09-10T07:35:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.697+0000 7f8573e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85740ce780 0x7f85740b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.698+0000 7f8573e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85740ce780 0x7f85740b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32976/0 (socket says 172.21.15.99:32976) 2024-09-10T07:35:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.698+0000 7f8573e00640 1 -- 172.21.15.99:0/2685152784 learned_addr learned my addr 172.21.15.99:0/2685152784 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.698+0000 7f8572a00640 1 --2- 172.21.15.99:0/2685152784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8574072f40 0x7f857406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:22.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.698+0000 7f8573e00640 1 -- 172.21.15.99:0/2685152784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8574072f40 msgr2=0x7f857406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:22.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.698+0000 7f8573e00640 1 --2- 172.21.15.99:0/2685152784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8574072f40 0x7f857406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.698+0000 7f8573e00640 1 -- 172.21.15.99:0/2685152784 >> v1:172.21.15.187:6789/0 conn(0x7f8574145290 legacy=0x7f8574072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.698+0000 7f8573e00640 1 -- 172.21.15.99:0/2685152784 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857406e990 con 0x7f85740ce780 2024-09-10T07:35:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.699+0000 7f8573e00640 1 --2- 172.21.15.99:0/2685152784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85740ce780 0x7f85740b3930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f856c009e50 tx=0x7f856c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f5b19bc0e88e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.699+0000 7f8572000640 1 -- 172.21.15.99:0/2685152784 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c036070 con 0x7f85740ce780 2024-09-10T07:35:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.699+0000 7f8572000640 1 -- 172.21.15.99:0/2685152784 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856c031600 con 0x7f85740ce780 2024-09-10T07:35:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.699+0000 7f8572000640 1 -- 172.21.15.99:0/2685152784 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c0319d0 con 0x7f85740ce780 2024-09-10T07:35:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.700+0000 7f857a000640 1 -- 172.21.15.99:0/2685152784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85740ce780 msgr2=0x7f85740b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.700+0000 7f857a000640 1 --2- 172.21.15.99:0/2685152784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85740ce780 0x7f85740b3930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f856c009e50 tx=0x7f856c02a710 comp rx=0 tx=0).stop 2024-09-10T07:35:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.700+0000 7f857a000640 1 -- 172.21.15.99:0/2685152784 shutdown_connections 2024-09-10T07:35:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.700+0000 7f857a000640 1 --2- 172.21.15.99:0/2685152784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85740ce780 0x7f85740b3930 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.700+0000 7f857a000640 1 --2- 172.21.15.99:0/2685152784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8574072f40 0x7f857406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.700+0000 7f857a000640 1 -- 172.21.15.99:0/2685152784 >> 172.21.15.99:0/2685152784 conn(0x7f857406bc10 msgr2=0x7f857406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.700+0000 7f857a000640 1 -- 172.21.15.99:0/2685152784 shutdown_connections 2024-09-10T07:35:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.700+0000 7f857a000640 1 -- 172.21.15.99:0/2685152784 wait complete. 2024-09-10T07:35:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.702+0000 7f857a000640 1 Processor -- start 2024-09-10T07:35:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.702+0000 7f857a000640 1 -- start start 2024-09-10T07:35:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f857a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8574072f40 0x7f8574139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f857a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85740ce780 0x7f857413c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f857a000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8574145290 0x7f857413c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f857a000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f857406df80 con 0x7f8574072f40 2024-09-10T07:35:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f857a000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8574145670 con 0x7f8574145290 2024-09-10T07:35:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f857a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f857406e100 con 0x7f85740ce780 2024-09-10T07:35:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f8573400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8574072f40 0x7f8574139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f8573400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8574072f40 0x7f8574139310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32982/0 (socket says 172.21.15.99:32982) 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f8573400640 1 -- 172.21.15.99:0/3167085633 learned_addr learned my addr 172.21.15.99:0/3167085633 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f8572a00640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85740ce780 0x7f857413c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f8573e00640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8574145290 0x7f857413c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f8573400640 1 -- 172.21.15.99:0/3167085633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85740ce780 msgr2=0x7f857413c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f8573400640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85740ce780 0x7f857413c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f8573400640 1 -- 172.21.15.99:0/3167085633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8574145290 msgr2=0x7f857413c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f8573400640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8574145290 0x7f857413c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.703+0000 7f8573400640 1 -- 172.21.15.99:0/3167085633 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857413cf40 con 0x7f8574072f40 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.704+0000 7f8573400640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8574072f40 0x7f8574139310 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f856400c430 tx=0x7f856400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.704+0000 7f856b400640 1 -- 172.21.15.99:0/3167085633 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85640052d0 con 0x7f8574072f40 2024-09-10T07:35:22.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.704+0000 7f856b400640 1 -- 172.21.15.99:0/3167085633 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8564005490 con 0x7f8574072f40 2024-09-10T07:35:22.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.704+0000 7f856b400640 1 -- 172.21.15.99:0/3167085633 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564007260 con 0x7f8574072f40 2024-09-10T07:35:22.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.704+0000 7f857a000640 1 -- 172.21.15.99:0/3167085633 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857413d220 con 0x7f8574072f40 2024-09-10T07:35:22.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.704+0000 7f857a000640 1 -- 172.21.15.99:0/3167085633 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f857413d7e0 con 0x7f8574072f40 2024-09-10T07:35:22.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.705+0000 7f857a000640 1 -- 172.21.15.99:0/3167085633 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8574071510 con 0x7f8574072f40 2024-09-10T07:35:22.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.706+0000 7f856b400640 1 -- 172.21.15.99:0/3167085633 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8564007400 con 0x7f8574072f40 2024-09-10T07:35:22.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.707+0000 7f856b400640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f855406be60 0x7f855406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:22.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.708+0000 7f856b400640 1 -- 172.21.15.99:0/3167085633 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f856408a370 con 0x7f8574072f40 2024-09-10T07:35:22.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.708+0000 7f8572a00640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f855406be60 0x7f855406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:22.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.708+0000 7f8572a00640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f855406be60 0x7f855406e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f857413e6f0 tx=0x7f8560008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:22.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.712+0000 7f856b400640 1 -- 172.21.15.99:0/3167085633 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8564058630 con 0x7f8574072f40 2024-09-10T07:35:22.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.920+0000 7f857a000640 1 -- 172.21.15.99:0/3167085633 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8574140c20 con 0x7f8574072f40 2024-09-10T07:35:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.920+0000 7f856b400640 1 -- 172.21.15.99:0/3167085633 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f856405c930 con 0x7f8574072f40 2024-09-10T07:35:22.920 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:22.920 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"btime":"2024-09-10T07:35:09:706532+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3299804861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3299804861},{"type":"v1","addr":"172.21.15.187:6834","nonce":3299804861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/4173112208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4173112208},{"type":"v1","addr":"172.21.15.187:6835","nonce":4173112208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4740,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2963379591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2963379591},{"type":"v1","addr":"172.21.15.99:6835","nonce":2963379591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:06.038065+0000","modified":"2024-09-10T07:35:09.110775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4743":{"gid":4743,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/4168486217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":4168486217},{"type":"v1","addr":"172.21.15.99:6837","nonce":4168486217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4743,"qdb_cluster":[4743]},"id":2}]} 2024-09-10T07:35:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-09-10T07:35:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.922+0000 7f857a000640 1 -- 172.21.15.99:0/3167085633 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f855406be60 msgr2=0x7f855406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.922+0000 7f857a000640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f855406be60 0x7f855406e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f857413e6f0 tx=0x7f8560008040 comp rx=0 tx=0).stop 2024-09-10T07:35:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.922+0000 7f857a000640 1 -- 172.21.15.99:0/3167085633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8574072f40 msgr2=0x7f8574139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.922+0000 7f857a000640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8574072f40 0x7f8574139310 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f856400c430 tx=0x7f856400c8f0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.922+0000 7f857a000640 1 -- 172.21.15.99:0/3167085633 shutdown_connections 2024-09-10T07:35:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.922+0000 7f857a000640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8574145290 0x7f857413c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.922+0000 7f857a000640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85740ce780 0x7f857413c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.922+0000 7f857a000640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f855406be60 0x7f855406e320 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.922+0000 7f857a000640 1 --2- 172.21.15.99:0/3167085633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8574072f40 0x7f8574139310 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.922+0000 7f857a000640 1 -- 172.21.15.99:0/3167085633 >> 172.21.15.99:0/3167085633 conn(0x7f857406bc10 msgr2=0x7f857415c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.923+0000 7f857a000640 1 -- 172.21.15.99:0/3167085633 shutdown_connections 2024-09-10T07:35:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:22.923+0000 7f857a000640 1 -- 172.21.15.99:0/3167085633 wait complete. 2024-09-10T07:35:22.938 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:35:23.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.091+0000 7f4be0c00640 1 Processor -- start 2024-09-10T07:35:23.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.091+0000 7f4be0c00640 1 -- start start 2024-09-10T07:35:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.092+0000 7f4be0c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4bdc145290 0x7f4bdc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.092+0000 7f4be0c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc0ce780 0x7f4bdc072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.092+0000 7f4be0c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bdc06e3d0 con 0x7f4bdc071510 2024-09-10T07:35:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.092+0000 7f4be0c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f4bdc06efe0 con 0x7f4bdc145290 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.092+0000 7f4be0c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4bdc06e6b0 con 0x7f4bdc0ce780 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bd9e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4bdc145290 0x7f4bdc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bda800640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f4bdc071510 0x7f4bdc0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:57080/0 (socket says 172.21.15.99:57080) 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bda800640 1 -- 172.21.15.99:0/2171069074 learned_addr learned my addr 172.21.15.99:0/2171069074 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bd9400640 1 --2- 172.21.15.99:0/2171069074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc0ce780 0x7f4bdc072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bd8a00640 1 -- 172.21.15.99:0/2171069074 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2919534250 0 0) 0x7f4bdc06e3d0 con 0x7f4bdc071510 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bd8a00640 1 -- 172.21.15.99:0/2171069074 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bc0003520 con 0x7f4bdc071510 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bd9e00640 1 -- 172.21.15.99:0/2171069074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc0ce780 msgr2=0x7f4bdc072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bd9e00640 1 --2- 172.21.15.99:0/2171069074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc0ce780 0x7f4bdc072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bd9e00640 1 -- 172.21.15.99:0/2171069074 >> v1:172.21.15.187:6789/0 conn(0x7f4bdc071510 legacy=0x7f4bdc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bd9e00640 1 -- 172.21.15.99:0/2171069074 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bdc06e990 con 0x7f4bdc145290 2024-09-10T07:35:23.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.093+0000 7f4bd9400640 1 --2- 172.21.15.99:0/2171069074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc0ce780 0x7f4bdc072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:23.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.095+0000 7f4bd9e00640 1 --2- 172.21.15.99:0/2171069074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bdc145290 0x7f4bdc06f470 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0097a0 tx=0x7f4bcc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5242e3d6022a3de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.095+0000 7f4bd8a00640 1 -- 172.21.15.99:0/2171069074 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc037070 con 0x7f4bdc145290 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.095+0000 7f4bd8a00640 1 -- 172.21.15.99:0/2171069074 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc032440 con 0x7f4bdc145290 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.095+0000 7f4bd8a00640 1 -- 172.21.15.99:0/2171069074 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc032810 con 0x7f4bdc145290 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.095+0000 7f4be0c00640 1 -- 172.21.15.99:0/2171069074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bdc145290 msgr2=0x7f4bdc06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.095+0000 7f4be0c00640 1 --2- 172.21.15.99:0/2171069074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bdc145290 0x7f4bdc06f470 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0097a0 tx=0x7f4bcc02a180 comp rx=0 tx=0).stop 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.096+0000 7f4be0c00640 1 -- 172.21.15.99:0/2171069074 shutdown_connections 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.096+0000 7f4be0c00640 1 --2- 172.21.15.99:0/2171069074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc0ce780 0x7f4bdc072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.096+0000 7f4be0c00640 1 --2- 172.21.15.99:0/2171069074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bdc145290 0x7f4bdc06f470 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.096+0000 7f4be0c00640 1 -- 172.21.15.99:0/2171069074 >> 172.21.15.99:0/2171069074 conn(0x7f4bdc06bc10 msgr2=0x7f4bdc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.096+0000 7f4be0c00640 1 -- 172.21.15.99:0/2171069074 shutdown_connections 2024-09-10T07:35:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.096+0000 7f4be0c00640 1 -- 172.21.15.99:0/2171069074 wait complete. 2024-09-10T07:35:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.097+0000 7f4be0c00640 1 Processor -- start 2024-09-10T07:35:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.097+0000 7f4be0c00640 1 -- start start 2024-09-10T07:35:23.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.098+0000 7f4be0c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc071510 0x7f4bdc135fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.098+0000 7f4be0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bdc0ce780 0x7f4bdc15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.098+0000 7f4be0c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bdc145290 0x7f4bdc13dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.098+0000 7f4be0c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4bdc06df80 con 0x7f4bdc0ce780 2024-09-10T07:35:23.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.098+0000 7f4be0c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4bdc145670 con 0x7f4bdc145290 2024-09-10T07:35:23.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.098+0000 7f4be0c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4bdc06e100 con 0x7f4bdc071510 2024-09-10T07:35:23.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bd9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bdc0ce780 0x7f4bdc15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bd9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bdc0ce780 0x7f4bdc15b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32992/0 (socket says 172.21.15.99:32992) 2024-09-10T07:35:23.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bd9400640 1 -- 172.21.15.99:0/1934080630 learned_addr learned my addr 172.21.15.99:0/1934080630 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bda800640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bdc145290 0x7f4bdc13dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bd9e00640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc071510 0x7f4bdc135fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bd9400640 1 -- 172.21.15.99:0/1934080630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc071510 msgr2=0x7f4bdc135fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bd9400640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc071510 0x7f4bdc135fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bd9400640 1 -- 172.21.15.99:0/1934080630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bdc145290 msgr2=0x7f4bdc13dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bd9400640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bdc145290 0x7f4bdc13dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bd9400640 1 -- 172.21.15.99:0/1934080630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bdc1365b0 con 0x7f4bdc0ce780 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.099+0000 7f4bd9400640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bdc0ce780 0x7f4bdc15b330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800ebb0 tx=0x7f4bc800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.100+0000 7f4bd2000640 1 -- 172.21.15.99:0/1934080630 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8017070 con 0x7f4bdc0ce780 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.100+0000 7f4bd2000640 1 -- 172.21.15.99:0/1934080630 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc800cc30 con 0x7f4bdc0ce780 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.100+0000 7f4bd2000640 1 -- 172.21.15.99:0/1934080630 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8013470 con 0x7f4bdc0ce780 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.100+0000 7f4be0c00640 1 -- 172.21.15.99:0/1934080630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bdc136890 con 0x7f4bdc0ce780 2024-09-10T07:35:23.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.100+0000 7f4be0c00640 1 -- 172.21.15.99:0/1934080630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bdc136e50 con 0x7f4bdc0ce780 2024-09-10T07:35:23.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.101+0000 7f4be0c00640 1 -- 172.21.15.99:0/1934080630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bdc06f450 con 0x7f4bdc0ce780 2024-09-10T07:35:23.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.102+0000 7f4bd2000640 1 -- 172.21.15.99:0/1934080630 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bc801a070 con 0x7f4bdc0ce780 2024-09-10T07:35:23.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.103+0000 7f4bd2000640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4bbc06be30 0x7f4bbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.103+0000 7f4bd2000640 1 -- 172.21.15.99:0/1934080630 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4bc808b170 con 0x7f4bdc0ce780 2024-09-10T07:35:23.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.103+0000 7f4bd9e00640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4bbc06be30 0x7f4bbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.103+0000 7f4bd9e00640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4bbc06be30 0x7f4bbc06e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc034000 tx=0x7f4bcc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:23.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.107+0000 7f4bd2000640 1 -- 172.21.15.99:0/1934080630 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bc8059b10 con 0x7f4bdc0ce780 2024-09-10T07:35:23.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.282+0000 7f4be0c00640 1 -- 172.21.15.99:0/1934080630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bdc13f730 con 0x7f4bdc0ce780 2024-09-10T07:35:23.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.284+0000 7f4bd2000640 1 -- 172.21.15.99:0/1934080630 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16705 (secure 0 0 0) 0x7f4bc8059410 con 0x7f4bdc0ce780 2024-09-10T07:35:23.284 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:23.284 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":33,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:35:18.758998+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:03.811904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:05.040821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:35:23.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 -- 172.21.15.99:0/1934080630 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4bbc06be30 msgr2=0x7f4bbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4bbc06be30 0x7f4bbc06e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc034000 tx=0x7f4bcc02e000 comp rx=0 tx=0).stop 2024-09-10T07:35:23.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 -- 172.21.15.99:0/1934080630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bdc0ce780 msgr2=0x7f4bdc15b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bdc0ce780 0x7f4bdc15b330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800ebb0 tx=0x7f4bc800c520 comp rx=0 tx=0).stop 2024-09-10T07:35:23.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 -- 172.21.15.99:0/1934080630 shutdown_connections 2024-09-10T07:35:23.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bdc145290 0x7f4bdc13dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4bbc06be30 0x7f4bbc06e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bdc0ce780 0x7f4bdc15b330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 --2- 172.21.15.99:0/1934080630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bdc071510 0x7f4bdc135fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 -- 172.21.15.99:0/1934080630 >> 172.21.15.99:0/1934080630 conn(0x7f4bdc06bc10 msgr2=0x7f4bdc0b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:23.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 -- 172.21.15.99:0/1934080630 shutdown_connections 2024-09-10T07:35:23.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.286+0000 7f4be0c00640 1 -- 172.21.15.99:0/1934080630 wait complete. 2024-09-10T07:35:23.302 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:35:23.302 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:23.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.455+0000 7f6bac800640 1 Processor -- start 2024-09-10T07:35:23.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.455+0000 7f6bac800640 1 -- start start 2024-09-10T07:35:23.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6bac800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ba40ce780 0x7f6ba406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6bac800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba406e3d0 con 0x7f6ba4072f40 2024-09-10T07:35:23.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6bac800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba406e6b0 con 0x7f6ba4145290 2024-09-10T07:35:23.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6bac800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba406efe0 con 0x7f6ba40ce780 2024-09-10T07:35:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6ba9400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6ba4072f40 0x7f6ba40b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36758/0 (socket says 172.21.15.99:36758) 2024-09-10T07:35:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6ba9400640 1 -- 172.21.15.99:0/1091663956 learned_addr learned my addr 172.21.15.99:0/1091663956 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6baa800640 1 --2- 172.21.15.99:0/1091663956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ba40ce780 0x7f6ba406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6ba8a00640 1 -- 172.21.15.99:0/1091663956 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 370502673 0 0) 0x7f6ba406e3d0 con 0x7f6ba4072f40 2024-09-10T07:35:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6ba8a00640 1 -- 172.21.15.99:0/1091663956 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b8c003520 con 0x7f6ba4072f40 2024-09-10T07:35:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6ba8a00640 1 -- 172.21.15.99:0/1091663956 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 869166945 0 0) 0x7f6ba406e6b0 con 0x7f6ba4145290 2024-09-10T07:35:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.457+0000 7f6ba8a00640 1 -- 172.21.15.99:0/1091663956 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ba406e3d0 con 0x7f6ba4145290 2024-09-10T07:35:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.458+0000 7f6baa800640 1 -- 172.21.15.99:0/1091663956 >> v1:172.21.15.187:6789/0 conn(0x7f6ba4145290 legacy=0x7f6ba4072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.458+0000 7f6baa800640 1 -- 172.21.15.99:0/1091663956 >> v1:172.21.15.99:6789/0 conn(0x7f6ba4072f40 legacy=0x7f6ba40b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.458+0000 7f6baa800640 1 -- 172.21.15.99:0/1091663956 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba406e990 con 0x7f6ba40ce780 2024-09-10T07:35:23.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.459+0000 7f6baa800640 1 --2- 172.21.15.99:0/1091663956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ba40ce780 0x7f6ba406f470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009dc0 tx=0x7f6ba002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f63278c27e663e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.459+0000 7f6ba8a00640 1 -- 172.21.15.99:0/1091663956 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0007740 con 0x7f6ba40ce780 2024-09-10T07:35:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.459+0000 7f6ba8a00640 1 -- 172.21.15.99:0/1091663956 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00078e0 con 0x7f6ba40ce780 2024-09-10T07:35:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.459+0000 7f6ba8a00640 1 -- 172.21.15.99:0/1091663956 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0007cb0 con 0x7f6ba40ce780 2024-09-10T07:35:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.459+0000 7f6bac800640 1 -- 172.21.15.99:0/1091663956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ba40ce780 msgr2=0x7f6ba406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.459+0000 7f6bac800640 1 --2- 172.21.15.99:0/1091663956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ba40ce780 0x7f6ba406f470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009dc0 tx=0x7f6ba002a6d0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.460+0000 7f6bac800640 1 -- 172.21.15.99:0/1091663956 shutdown_connections 2024-09-10T07:35:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.460+0000 7f6bac800640 1 --2- 172.21.15.99:0/1091663956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ba40ce780 0x7f6ba406f470 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.460+0000 7f6bac800640 1 -- 172.21.15.99:0/1091663956 >> 172.21.15.99:0/1091663956 conn(0x7f6ba406bc10 msgr2=0x7f6ba406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.460+0000 7f6bac800640 1 -- 172.21.15.99:0/1091663956 shutdown_connections 2024-09-10T07:35:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.460+0000 7f6bac800640 1 -- 172.21.15.99:0/1091663956 wait complete. 2024-09-10T07:35:23.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.461+0000 7f6bac800640 1 Processor -- start 2024-09-10T07:35:23.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.461+0000 7f6bac800640 1 -- start start 2024-09-10T07:35:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.462+0000 7f6bac800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ba4072f40 0x7f6ba4143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.462+0000 7f6bac800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba40ce780 0x7f6ba413d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.462+0000 7f6bac800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ba4145290 0x7f6ba413b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.462+0000 7f6bac800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba406df80 con 0x7f6ba40ce780 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.462+0000 7f6bac800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4145670 con 0x7f6ba4145290 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.462+0000 7f6bac800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba406e100 con 0x7f6ba4072f40 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6ba9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba40ce780 0x7f6ba413d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6ba9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba40ce780 0x7f6ba413d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32994/0 (socket says 172.21.15.99:32994) 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6ba9400640 1 -- 172.21.15.99:0/1487964543 learned_addr learned my addr 172.21.15.99:0/1487964543 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6ba9400640 1 -- 172.21.15.99:0/1487964543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ba4072f40 msgr2=0x7f6ba4143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6baa800640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ba4145290 0x7f6ba413b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6ba9400640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ba4072f40 0x7f6ba4143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6ba9400640 1 -- 172.21.15.99:0/1487964543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ba4145290 msgr2=0x7f6ba413b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6ba9400640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ba4145290 0x7f6ba413b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6ba9400640 1 -- 172.21.15.99:0/1487964543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba415d2c0 con 0x7f6ba40ce780 2024-09-10T07:35:23.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6baa800640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ba4145290 0x7f6ba413b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6ba9400640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba40ce780 0x7f6ba413d5e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400c430 tx=0x7f6b9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.463+0000 7f6b9e000640 1 -- 172.21.15.99:0/1487964543 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94017070 con 0x7f6ba40ce780 2024-09-10T07:35:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.464+0000 7f6b9e000640 1 -- 172.21.15.99:0/1487964543 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b94005ce0 con 0x7f6ba40ce780 2024-09-10T07:35:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.464+0000 7f6b9e000640 1 -- 172.21.15.99:0/1487964543 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940072f0 con 0x7f6ba40ce780 2024-09-10T07:35:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.464+0000 7f6bac800640 1 -- 172.21.15.99:0/1487964543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba41417d0 con 0x7f6ba40ce780 2024-09-10T07:35:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.464+0000 7f6bac800640 1 -- 172.21.15.99:0/1487964543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba415d560 con 0x7f6ba40ce780 2024-09-10T07:35:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.465+0000 7f6bac800640 1 -- 172.21.15.99:0/1487964543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba40715a0 con 0x7f6ba40ce780 2024-09-10T07:35:23.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.466+0000 7f6b9e000640 1 -- 172.21.15.99:0/1487964543 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b9401a070 con 0x7f6ba40ce780 2024-09-10T07:35:23.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.466+0000 7f6b9e000640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b8806be30 0x7f6b8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.467+0000 7f6b9e000640 1 -- 172.21.15.99:0/1487964543 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6b9408a320 con 0x7f6ba40ce780 2024-09-10T07:35:23.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.467+0000 7f6ba9e00640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b8806be30 0x7f6b8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.468+0000 7f6ba9e00640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b8806be30 0x7f6b8806e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b980010e0 tx=0x7f6b98007950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:23.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.471+0000 7f6b9e000640 1 -- 172.21.15.99:0/1487964543 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b94058cc0 con 0x7f6ba40ce780 2024-09-10T07:35:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.680+0000 7f6bac800640 1 -- 172.21.15.99:0/1487964543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ba40b0d00 con 0x7f6ba40ce780 2024-09-10T07:35:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.680+0000 7f6b9e000640 1 -- 172.21.15.99:0/1487964543 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f6b940585c0 con 0x7f6ba40ce780 2024-09-10T07:35:23.680 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:23.680 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"btime":"2024-09-10T07:35:09:706532+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3299804861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3299804861},{"type":"v1","addr":"172.21.15.187:6834","nonce":3299804861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/4173112208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4173112208},{"type":"v1","addr":"172.21.15.187:6835","nonce":4173112208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4740,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2963379591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2963379591},{"type":"v1","addr":"172.21.15.99:6835","nonce":2963379591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:06.038065+0000","modified":"2024-09-10T07:35:09.110775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4743":{"gid":4743,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/4168486217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":4168486217},{"type":"v1","addr":"172.21.15.99:6837","nonce":4168486217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4743,"qdb_cluster":[4743]},"id":2}]} 2024-09-10T07:35:23.681 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-09-10T07:35:23.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 -- 172.21.15.99:0/1487964543 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b8806be30 msgr2=0x7f6b8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b8806be30 0x7f6b8806e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b980010e0 tx=0x7f6b98007950 comp rx=0 tx=0).stop 2024-09-10T07:35:23.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 -- 172.21.15.99:0/1487964543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba40ce780 msgr2=0x7f6ba413d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba40ce780 0x7f6ba413d5e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400c430 tx=0x7f6b9400c8f0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 -- 172.21.15.99:0/1487964543 shutdown_connections 2024-09-10T07:35:23.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ba4145290 0x7f6ba413b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b8806be30 0x7f6b8806e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba40ce780 0x7f6ba413d5e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 --2- 172.21.15.99:0/1487964543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ba4072f40 0x7f6ba4143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 -- 172.21.15.99:0/1487964543 >> 172.21.15.99:0/1487964543 conn(0x7f6ba406bc10 msgr2=0x7f6ba40b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:23.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 -- 172.21.15.99:0/1487964543 shutdown_connections 2024-09-10T07:35:23.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.683+0000 7f6bac800640 1 -- 172.21.15.99:0/1487964543 wait complete. 2024-09-10T07:35:23.699 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:23.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.855+0000 7fea9ae00640 1 Processor -- start 2024-09-10T07:35:23.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.856+0000 7fea9ae00640 1 -- start start 2024-09-10T07:35:23.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.857+0000 7fea9ae00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fea94145290 0x7fea9406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.857+0000 7fea9ae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9406e3d0 con 0x7fea940ce780 2024-09-10T07:35:23.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.857+0000 7fea9ae00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9406e6b0 con 0x7fea94072f40 2024-09-10T07:35:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.857+0000 7fea9ae00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fea9406efe0 con 0x7fea94145290 2024-09-10T07:35:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.857+0000 7fea93e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fea94145290 0x7fea9406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.857+0000 7fea8b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fea940ce780 0x7fea94072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36768/0 (socket says 172.21.15.99:36768) 2024-09-10T07:35:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.857+0000 7fea8b400640 1 -- 172.21.15.99:0/3857977891 learned_addr learned my addr 172.21.15.99:0/3857977891 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.857+0000 7fea93e00640 1 --2- 172.21.15.99:0/3857977891 >> v2:172.21.15.99:3300/0 conn(0x7fea94145290 0x7fea9406f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33010/0 (socket says 172.21.15.99:33010) 2024-09-10T07:35:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.857+0000 7fea93e00640 1 -- 172.21.15.99:0/3857977891 >> v1:172.21.15.187:6789/0 conn(0x7fea94072f40 legacy=0x7fea940b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.857+0000 7fea93e00640 1 -- 172.21.15.99:0/3857977891 >> v1:172.21.15.99:6789/0 conn(0x7fea940ce780 legacy=0x7fea94072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.858+0000 7fea93e00640 1 -- 172.21.15.99:0/3857977891 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9406e990 con 0x7fea94145290 2024-09-10T07:35:23.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.858+0000 7fea93400640 1 -- 172.21.15.99:0/3857977891 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147100662 0 0) 0x7fea9406e3d0 con 0x7fea940ce780 2024-09-10T07:35:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.858+0000 7fea93e00640 1 --2- 172.21.15.99:0/3857977891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 0x7fea9406f470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea8400ba40 tx=0x7fea8402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc1a4ebb15fd6fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:23.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.859+0000 7fea93400640 1 -- 172.21.15.99:0/3857977891 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84032770 con 0x7fea94145290 2024-09-10T07:35:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.859+0000 7fea93400640 1 -- 172.21.15.99:0/3857977891 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea84038070 con 0x7fea94145290 2024-09-10T07:35:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.859+0000 7fea93400640 1 -- 172.21.15.99:0/3857977891 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84032b30 con 0x7fea94145290 2024-09-10T07:35:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.859+0000 7fea9ae00640 1 -- 172.21.15.99:0/3857977891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 msgr2=0x7fea9406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.859+0000 7fea9ae00640 1 --2- 172.21.15.99:0/3857977891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 0x7fea9406f470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea8400ba40 tx=0x7fea8402c8b0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.859+0000 7fea9ae00640 1 -- 172.21.15.99:0/3857977891 shutdown_connections 2024-09-10T07:35:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.859+0000 7fea9ae00640 1 --2- 172.21.15.99:0/3857977891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 0x7fea9406f470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.859+0000 7fea9ae00640 1 -- 172.21.15.99:0/3857977891 >> 172.21.15.99:0/3857977891 conn(0x7fea9406bc10 msgr2=0x7fea9406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.859+0000 7fea9ae00640 1 -- 172.21.15.99:0/3857977891 shutdown_connections 2024-09-10T07:35:23.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.859+0000 7fea9ae00640 1 -- 172.21.15.99:0/3857977891 wait complete. 2024-09-10T07:35:23.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.861+0000 7fea9ae00640 1 Processor -- start 2024-09-10T07:35:23.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.861+0000 7fea9ae00640 1 -- start start 2024-09-10T07:35:23.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.862+0000 7fea9ae00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea94072f40 0x7fea9415b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.862+0000 7fea9ae00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea940ce780 0x7fea9413c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.862+0000 7fea9ae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 0x7fea94138080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.862+0000 7fea9ae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fea9406df80 con 0x7fea94145290 2024-09-10T07:35:23.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.862+0000 7fea9ae00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fea94145670 con 0x7fea94072f40 2024-09-10T07:35:23.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.862+0000 7fea9ae00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fea9406e100 con 0x7fea940ce780 2024-09-10T07:35:23.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.862+0000 7fea98e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 0x7fea94138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.862+0000 7fea98e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 0x7fea94138080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33016/0 (socket says 172.21.15.99:33016) 2024-09-10T07:35:23.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.862+0000 7fea98e00640 1 -- 172.21.15.99:0/2326914098 learned_addr learned my addr 172.21.15.99:0/2326914098 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:23.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.862+0000 7fea93e00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea94072f40 0x7fea9415b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea8b400640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea940ce780 0x7fea9413c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea98e00640 1 -- 172.21.15.99:0/2326914098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea940ce780 msgr2=0x7fea9413c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea98e00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea940ce780 0x7fea9413c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea98e00640 1 -- 172.21.15.99:0/2326914098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea94072f40 msgr2=0x7fea9415b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:23.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea98e00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea94072f40 0x7fea9415b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:23.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea98e00640 1 -- 172.21.15.99:0/2326914098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea940b11c0 con 0x7fea94145290 2024-09-10T07:35:23.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea98e00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 0x7fea94138080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00b9e0 tx=0x7fea8c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:23.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea90c00640 1 -- 172.21.15.99:0/2326914098 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c003b70 con 0x7fea94145290 2024-09-10T07:35:23.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea90c00640 1 -- 172.21.15.99:0/2326914098 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8c003d10 con 0x7fea94145290 2024-09-10T07:35:23.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea9ae00640 1 -- 172.21.15.99:0/2326914098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea940afa40 con 0x7fea94145290 2024-09-10T07:35:23.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea90c00640 1 -- 172.21.15.99:0/2326914098 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c00cb60 con 0x7fea94145290 2024-09-10T07:35:23.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.863+0000 7fea9ae00640 1 -- 172.21.15.99:0/2326914098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea940b0000 con 0x7fea94145290 2024-09-10T07:35:23.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.864+0000 7fea9ae00640 1 -- 172.21.15.99:0/2326914098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea940715a0 con 0x7fea94145290 2024-09-10T07:35:23.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.865+0000 7fea90c00640 1 -- 172.21.15.99:0/2326914098 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea8c00cd00 con 0x7fea94145290 2024-09-10T07:35:23.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.867+0000 7fea90c00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7006be60 0x7fea7006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:23.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.867+0000 7fea90c00640 1 -- 172.21.15.99:0/2326914098 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fea8c08ac50 con 0x7fea94145290 2024-09-10T07:35:23.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.867+0000 7fea93e00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7006be60 0x7fea7006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:23.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.867+0000 7fea93e00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7006be60 0x7fea7006e320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea84037000 tx=0x7fea84032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:23.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:23.871+0000 7fea90c00640 1 -- 172.21.15.99:0/2326914098 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea8c090020 con 0x7fea94145290 2024-09-10T07:35:24.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.078+0000 7fea9ae00640 1 -- 172.21.15.99:0/2326914098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea94140600 con 0x7fea94145290 2024-09-10T07:35:24.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.079+0000 7fea90c00640 1 -- 172.21.15.99:0/2326914098 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7fea8c059600 con 0x7fea94145290 2024-09-10T07:35:24.079 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:24.079 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"btime":"2024-09-10T07:35:09:706532+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3299804861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3299804861},{"type":"v1","addr":"172.21.15.187:6834","nonce":3299804861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/4173112208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4173112208},{"type":"v1","addr":"172.21.15.187:6835","nonce":4173112208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4740,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2963379591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2963379591},{"type":"v1","addr":"172.21.15.99:6835","nonce":2963379591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:06.038065+0000","modified":"2024-09-10T07:35:09.110775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4743},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4743":{"gid":4743,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/4168486217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":4168486217},{"type":"v1","addr":"172.21.15.99:6837","nonce":4168486217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4743,"qdb_cluster":[4743]},"id":2}]} 2024-09-10T07:35:24.079 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-09-10T07:35:24.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 -- 172.21.15.99:0/2326914098 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7006be60 msgr2=0x7fea7006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7006be60 0x7fea7006e320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea84037000 tx=0x7fea84032000 comp rx=0 tx=0).stop 2024-09-10T07:35:24.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 -- 172.21.15.99:0/2326914098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 msgr2=0x7fea94138080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 0x7fea94138080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00b9e0 tx=0x7fea8c00bea0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 -- 172.21.15.99:0/2326914098 shutdown_connections 2024-09-10T07:35:24.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7006be60 0x7fea7006e320 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea94145290 0x7fea94138080 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea940ce780 0x7fea9413c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 --2- 172.21.15.99:0/2326914098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea94072f40 0x7fea9415b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 -- 172.21.15.99:0/2326914098 >> 172.21.15.99:0/2326914098 conn(0x7fea9406bc10 msgr2=0x7fea940717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:24.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 -- 172.21.15.99:0/2326914098 shutdown_connections 2024-09-10T07:35:24.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.081+0000 7fea9ae00640 1 -- 172.21.15.99:0/2326914098 wait complete. 2024-09-10T07:35:24.098 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:35:24.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.252+0000 7f4e7f200640 1 Processor -- start 2024-09-10T07:35:24.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.252+0000 7f4e7f200640 1 -- start start 2024-09-10T07:35:24.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.253+0000 7f4e7f200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4e8015eca0 0x7f4e800b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.253+0000 7f4e7f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e800d1aa0 0x7f4e800ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.253+0000 7f4e7f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4e800b1fe0 0x7f4e800b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.253+0000 7f4e7f200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4e800b6d50 con 0x7f4e800b1fe0 2024-09-10T07:35:24.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.253+0000 7f4e7f200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f4e8006bc10 con 0x7f4e8015eca0 2024-09-10T07:35:24.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.253+0000 7f4e7f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4e800d1ec0 con 0x7f4e800d1aa0 2024-09-10T07:35:24.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.254+0000 7f4e7e800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4e800b1fe0 0x7f4e800b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.254+0000 7f4e7e800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4e800b1fe0 0x7f4e800b2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33030/0 (socket says 172.21.15.99:33030) 2024-09-10T07:35:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.254+0000 7f4e7e800640 1 -- 172.21.15.99:0/2325975793 learned_addr learned my addr 172.21.15.99:0/2325975793 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.254+0000 7f4e75400640 1 --2- 172.21.15.99:0/2325975793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e800d1aa0 0x7f4e800ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.254+0000 7f4e7de00640 1 --2- 172.21.15.99:0/2325975793 >> v2:172.21.15.187:3300/0 conn(0x7f4e8015eca0 0x7f4e800b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.254+0000 7f4e7e800640 1 -- 172.21.15.99:0/2325975793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e800d1aa0 msgr2=0x7f4e800ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.254+0000 7f4e7e800640 1 --2- 172.21.15.99:0/2325975793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e800d1aa0 0x7f4e800ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.254+0000 7f4e7e800640 1 -- 172.21.15.99:0/2325975793 >> v2:172.21.15.187:3300/0 conn(0x7f4e8015eca0 msgr2=0x7f4e800b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.254+0000 7f4e7e800640 1 --2- 172.21.15.99:0/2325975793 >> v2:172.21.15.187:3300/0 conn(0x7f4e8015eca0 0x7f4e800b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.254+0000 7f4e7e800640 1 -- 172.21.15.99:0/2325975793 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8015f080 con 0x7f4e800b1fe0 2024-09-10T07:35:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.255+0000 7f4e7e800640 1 --2- 172.21.15.99:0/2325975793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e800b1fe0 0x7f4e800b2430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e800727f0 tx=0x7f4e7802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1a26c08b657db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.255+0000 7f4e7d400640 1 -- 172.21.15.99:0/2325975793 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78037070 con 0x7f4e800b1fe0 2024-09-10T07:35:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.255+0000 7f4e7d400640 1 -- 172.21.15.99:0/2325975793 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e78032440 con 0x7f4e800b1fe0 2024-09-10T07:35:24.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.255+0000 7f4e7d400640 1 -- 172.21.15.99:0/2325975793 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78032810 con 0x7f4e800b1fe0 2024-09-10T07:35:24.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.256+0000 7f4e7f200640 1 -- 172.21.15.99:0/2325975793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e800b1fe0 msgr2=0x7f4e800b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.256+0000 7f4e7f200640 1 --2- 172.21.15.99:0/2325975793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e800b1fe0 0x7f4e800b2430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e800727f0 tx=0x7f4e7802a180 comp rx=0 tx=0).stop 2024-09-10T07:35:24.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.256+0000 7f4e7f200640 1 -- 172.21.15.99:0/2325975793 shutdown_connections 2024-09-10T07:35:24.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.256+0000 7f4e7f200640 1 --2- 172.21.15.99:0/2325975793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e800d1aa0 0x7f4e800ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.256+0000 7f4e7f200640 1 --2- 172.21.15.99:0/2325975793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e800b1fe0 0x7f4e800b2430 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.256+0000 7f4e7f200640 1 --2- 172.21.15.99:0/2325975793 >> v2:172.21.15.187:3300/0 conn(0x7f4e8015eca0 0x7f4e800b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.256+0000 7f4e7f200640 1 -- 172.21.15.99:0/2325975793 >> 172.21.15.99:0/2325975793 conn(0x7f4e800b6610 msgr2=0x7f4e800b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:24.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.256+0000 7f4e7f200640 1 -- 172.21.15.99:0/2325975793 shutdown_connections 2024-09-10T07:35:24.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.256+0000 7f4e7f200640 1 -- 172.21.15.99:0/2325975793 wait complete. 2024-09-10T07:35:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.258+0000 7f4e7f200640 1 Processor -- start 2024-09-10T07:35:24.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.258+0000 7f4e7f200640 1 -- start start 2024-09-10T07:35:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e800b1fe0 0x7f4e800ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7f200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e800d1aa0 0x7f4e800aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8015eca0 0x7f4e8014f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8006c140 con 0x7f4e8015eca0 2024-09-10T07:35:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7f200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8006be60 con 0x7f4e800d1aa0 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8006c420 con 0x7f4e800b1fe0 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8015eca0 0x7f4e8014f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8015eca0 0x7f4e8014f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33040/0 (socket says 172.21.15.99:33040) 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7e800640 1 -- 172.21.15.99:0/2000509210 learned_addr learned my addr 172.21.15.99:0/2000509210 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e75400640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e800d1aa0 0x7f4e800aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7de00640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e800b1fe0 0x7f4e800ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7e800640 1 -- 172.21.15.99:0/2000509210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e800b1fe0 msgr2=0x7f4e800ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7e800640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e800b1fe0 0x7f4e800ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7e800640 1 -- 172.21.15.99:0/2000509210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e800d1aa0 msgr2=0x7f4e800aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7e800640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e800d1aa0 0x7f4e800aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.259+0000 7f4e7e800640 1 -- 172.21.15.99:0/2000509210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e800af410 con 0x7f4e8015eca0 2024-09-10T07:35:24.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.260+0000 7f4e7e800640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8015eca0 0x7f4e8014f270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e780097f0 tx=0x7f4e780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:24.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.260+0000 7f4e76a00640 1 -- 172.21.15.99:0/2000509210 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78037040 con 0x7f4e8015eca0 2024-09-10T07:35:24.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.260+0000 7f4e76a00640 1 -- 172.21.15.99:0/2000509210 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e78042070 con 0x7f4e8015eca0 2024-09-10T07:35:24.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.260+0000 7f4e76a00640 1 -- 172.21.15.99:0/2000509210 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78030920 con 0x7f4e8015eca0 2024-09-10T07:35:24.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.260+0000 7f4e7f200640 1 -- 172.21.15.99:0/2000509210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e800af6c0 con 0x7f4e8015eca0 2024-09-10T07:35:24.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.260+0000 7f4e7f200640 1 -- 172.21.15.99:0/2000509210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e800afc80 con 0x7f4e8015eca0 2024-09-10T07:35:24.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.261+0000 7f4e7f200640 1 -- 172.21.15.99:0/2000509210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e800ae0d0 con 0x7f4e8015eca0 2024-09-10T07:35:24.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.262+0000 7f4e76a00640 1 -- 172.21.15.99:0/2000509210 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e78030ac0 con 0x7f4e8015eca0 2024-09-10T07:35:24.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.263+0000 7f4e76a00640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e5c06be30 0x7f4e5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.263+0000 7f4e76a00640 1 -- 172.21.15.99:0/2000509210 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4e780ab670 con 0x7f4e8015eca0 2024-09-10T07:35:24.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.263+0000 7f4e7de00640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e5c06be30 0x7f4e5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.264+0000 7f4e7de00640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e5c06be30 0x7f4e5c06e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4e80162690 tx=0x7f4e70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:24.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.267+0000 7f4e76a00640 1 -- 172.21.15.99:0/2000509210 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e780799c0 con 0x7f4e8015eca0 2024-09-10T07:35:24.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.442+0000 7f4e7f200640 1 -- 172.21.15.99:0/2000509210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e8015e390 con 0x7f4e8015eca0 2024-09-10T07:35:24.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.443+0000 7f4e76a00640 1 -- 172.21.15.99:0/2000509210 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16705 (secure 0 0 0) 0x7f4e7807dcc0 con 0x7f4e8015eca0 2024-09-10T07:35:24.444 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:24.444 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":33,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:35:18.758998+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:03.811904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:05.040821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:35:24.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 -- 172.21.15.99:0/2000509210 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e5c06be30 msgr2=0x7f4e5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e5c06be30 0x7f4e5c06e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4e80162690 tx=0x7f4e70008040 comp rx=0 tx=0).stop 2024-09-10T07:35:24.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 -- 172.21.15.99:0/2000509210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8015eca0 msgr2=0x7f4e8014f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8015eca0 0x7f4e8014f270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e780097f0 tx=0x7f4e780046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 -- 172.21.15.99:0/2000509210 shutdown_connections 2024-09-10T07:35:24.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e5c06be30 0x7f4e5c06e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e8015eca0 0x7f4e8014f270 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e800d1aa0 0x7f4e800aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 --2- 172.21.15.99:0/2000509210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e800b1fe0 0x7f4e800ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 -- 172.21.15.99:0/2000509210 >> 172.21.15.99:0/2000509210 conn(0x7f4e800b6610 msgr2=0x7f4e8015d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:24.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 -- 172.21.15.99:0/2000509210 shutdown_connections 2024-09-10T07:35:24.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.446+0000 7f4e7f200640 1 -- 172.21.15.99:0/2000509210 wait complete. 2024-09-10T07:35:24.462 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:35:24.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.614+0000 7fa87c400640 1 Processor -- start 2024-09-10T07:35:24.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.614+0000 7fa87c400640 1 -- start start 2024-09-10T07:35:24.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.615+0000 7fa87c400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa8740b58e0 0x7fa8740af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa87c400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa87415f210 0x7fa87415f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa87c400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87415ff70 con 0x7fa8740d0080 2024-09-10T07:35:24.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa87c400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa8740af990 con 0x7fa8740b58e0 2024-09-10T07:35:24.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa87c400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa874160250 con 0x7fa87415f210 2024-09-10T07:35:24.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa879000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa8740b58e0 0x7fa8740af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa879000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa8740b58e0 0x7fa8740af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33056/0 (socket says 172.21.15.99:33056) 2024-09-10T07:35:24.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa879000640 1 -- 172.21.15.99:0/543355140 learned_addr learned my addr 172.21.15.99:0/543355140 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:24.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa87a400640 1 --2- 172.21.15.99:0/543355140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa87415f210 0x7fa87415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa879000640 1 -- 172.21.15.99:0/543355140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa87415f210 msgr2=0x7fa87415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:24.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa879000640 1 --2- 172.21.15.99:0/543355140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa87415f210 0x7fa87415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa879000640 1 -- 172.21.15.99:0/543355140 >> v1:172.21.15.187:6789/0 conn(0x7fa8740d0080 legacy=0x7fa8740b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.616+0000 7fa879000640 1 -- 172.21.15.99:0/543355140 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8740ae970 con 0x7fa8740b58e0 2024-09-10T07:35:24.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.617+0000 7fa879000640 1 --2- 172.21.15.99:0/543355140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740b58e0 0x7fa8740af450 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa860009870 tx=0x7fa86002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2416bfe112c4425b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:24.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.617+0000 7fa873e00640 1 -- 172.21.15.99:0/543355140 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860037070 con 0x7fa8740b58e0 2024-09-10T07:35:24.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.617+0000 7fa873e00640 1 -- 172.21.15.99:0/543355140 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa860032440 con 0x7fa8740b58e0 2024-09-10T07:35:24.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.617+0000 7fa873e00640 1 -- 172.21.15.99:0/543355140 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860032810 con 0x7fa8740b58e0 2024-09-10T07:35:24.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.618+0000 7fa87c400640 1 -- 172.21.15.99:0/543355140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740b58e0 msgr2=0x7fa8740af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.618+0000 7fa87c400640 1 --2- 172.21.15.99:0/543355140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740b58e0 0x7fa8740af450 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa860009870 tx=0x7fa86002a130 comp rx=0 tx=0).stop 2024-09-10T07:35:24.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.618+0000 7fa87c400640 1 -- 172.21.15.99:0/543355140 shutdown_connections 2024-09-10T07:35:24.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.618+0000 7fa87c400640 1 --2- 172.21.15.99:0/543355140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa87415f210 0x7fa87415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.618+0000 7fa87c400640 1 --2- 172.21.15.99:0/543355140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740b58e0 0x7fa8740af450 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.618+0000 7fa87c400640 1 -- 172.21.15.99:0/543355140 >> 172.21.15.99:0/543355140 conn(0x7fa8740b2630 msgr2=0x7fa8740b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:24.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.618+0000 7fa87c400640 1 -- 172.21.15.99:0/543355140 shutdown_connections 2024-09-10T07:35:24.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.618+0000 7fa87c400640 1 -- 172.21.15.99:0/543355140 wait complete. 2024-09-10T07:35:24.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.620+0000 7fa87c400640 1 Processor -- start 2024-09-10T07:35:24.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.620+0000 7fa87c400640 1 -- start start 2024-09-10T07:35:24.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa87c400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8740b58e0 0x7fa874148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa87c400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740d0080 0x7fa87415af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa87c400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87415f210 0x7fa87415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa87c400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa8740d0460 con 0x7fa8740d0080 2024-09-10T07:35:24.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa87c400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa8740aef30 con 0x7fa87415f210 2024-09-10T07:35:24.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa87c400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa87415fbc0 con 0x7fa8740b58e0 2024-09-10T07:35:24.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa879000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740d0080 0x7fa87415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa879000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740d0080 0x7fa87415af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33070/0 (socket says 172.21.15.99:33070) 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa879000640 1 -- 172.21.15.99:0/1772918454 learned_addr learned my addr 172.21.15.99:0/1772918454 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa87a400640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87415f210 0x7fa87415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.621+0000 7fa879a00640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8740b58e0 0x7fa874148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa879000640 1 -- 172.21.15.99:0/1772918454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8740b58e0 msgr2=0x7fa874148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa879000640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8740b58e0 0x7fa874148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa879000640 1 -- 172.21.15.99:0/1772918454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87415f210 msgr2=0x7fa87415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa879000640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87415f210 0x7fa87415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa879000640 1 -- 172.21.15.99:0/1772918454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87415bba0 con 0x7fa8740d0080 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa87a400640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87415f210 0x7fa87415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:24.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa879000640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740d0080 0x7fa87415af90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa86002a170 tx=0x7fa8600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa871600640 1 -- 172.21.15.99:0/1772918454 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860037040 con 0x7fa8740d0080 2024-09-10T07:35:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa871600640 1 -- 172.21.15.99:0/1772918454 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa860042070 con 0x7fa8740d0080 2024-09-10T07:35:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa871600640 1 -- 172.21.15.99:0/1772918454 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860030980 con 0x7fa8740d0080 2024-09-10T07:35:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.622+0000 7fa87c400640 1 -- 172.21.15.99:0/1772918454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87415be80 con 0x7fa8740d0080 2024-09-10T07:35:24.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.623+0000 7fa87c400640 1 -- 172.21.15.99:0/1772918454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8741487b0 con 0x7fa8740d0080 2024-09-10T07:35:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.624+0000 7fa87c400640 1 -- 172.21.15.99:0/1772918454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8740af450 con 0x7fa8740d0080 2024-09-10T07:35:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.624+0000 7fa871600640 1 -- 172.21.15.99:0/1772918454 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa860030b20 con 0x7fa8740d0080 2024-09-10T07:35:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.626+0000 7fa871600640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa85406be60 0x7fa85406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.626+0000 7fa871600640 1 -- 172.21.15.99:0/1772918454 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa8600ab780 con 0x7fa8740d0080 2024-09-10T07:35:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.626+0000 7fa879a00640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa85406be60 0x7fa85406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:24.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.626+0000 7fa879a00640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa85406be60 0x7fa85406e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa868000f60 tx=0x7fa868009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:24.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.630+0000 7fa871600640 1 -- 172.21.15.99:0/1772918454 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa86007a130 con 0x7fa8740d0080 2024-09-10T07:35:24.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.837+0000 7fa87c400640 1 -- 172.21.15.99:0/1772918454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa8740cf730 con 0x7fa8740d0080 2024-09-10T07:35:24.838 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:35:24.838+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:35:24.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.840+0000 7fa871600640 1 -- 172.21.15.99:0/1772918454 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7fa860079a30 con 0x7fa8740d0080 2024-09-10T07:35:24.840 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:35:24.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 -- 172.21.15.99:0/1772918454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa85406be60 msgr2=0x7fa85406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa85406be60 0x7fa85406e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa868000f60 tx=0x7fa868009040 comp rx=0 tx=0).stop 2024-09-10T07:35:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 -- 172.21.15.99:0/1772918454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740d0080 msgr2=0x7fa87415af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740d0080 0x7fa87415af90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa86002a170 tx=0x7fa8600046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 -- 172.21.15.99:0/1772918454 shutdown_connections 2024-09-10T07:35:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87415f210 0x7fa87415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa85406be60 0x7fa85406e320 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8740d0080 0x7fa87415af90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 --2- 172.21.15.99:0/1772918454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8740b58e0 0x7fa874148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 -- 172.21.15.99:0/1772918454 >> 172.21.15.99:0/1772918454 conn(0x7fa8740b2630 msgr2=0x7fa8740b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.844+0000 7fa87c400640 1 -- 172.21.15.99:0/1772918454 shutdown_connections 2024-09-10T07:35:24.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:24.845+0000 7fa87c400640 1 -- 172.21.15.99:0/1772918454 wait complete. 2024-09-10T07:35:24.852 INFO:tasks.ceph.mds.c.smithi099.stderr: -4974> 2024-09-10T07:35:11.028+0000 7fbe33400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:35:24.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:35:24.904 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:35:25.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.017+0000 7fa0ffa00640 1 Processor -- start 2024-09-10T07:35:25.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.018+0000 7fa0ffa00640 1 -- start start 2024-09-10T07:35:25.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.019+0000 7fa0ffa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f806e280 0x7fa0f8073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:25.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.019+0000 7fa0ffa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa0f80d1010 0x7fa0f80ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:25.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.019+0000 7fa0ffa00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f80722d0 con 0x7fa0f8071df0 2024-09-10T07:35:25.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.019+0000 7fa0ffa00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f80738b0 con 0x7fa0f80d1010 2024-09-10T07:35:25.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.019+0000 7fa0ffa00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f80725b0 con 0x7fa0f806e280 2024-09-10T07:35:25.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.019+0000 7fa0fda00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa0f80d1010 0x7fa0f80ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:25.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.019+0000 7fa0fd000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f806e280 0x7fa0f8073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:25.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.019+0000 7fa0fda00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa0f80d1010 0x7fa0f80ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:56934/0 (socket says 172.21.15.99:56934) 2024-09-10T07:35:25.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.019+0000 7fa0fd000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f806e280 0x7fa0f8073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:47558/0 (socket says 172.21.15.99:47558) 2024-09-10T07:35:25.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.019+0000 7fa0fda00640 1 -- 172.21.15.99:0/4191713625 learned_addr learned my addr 172.21.15.99:0/4191713625 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:25.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.020+0000 7fa0fd000640 1 -- 172.21.15.99:0/4191713625 >> v2:172.21.15.187:3300/0 conn(0x7fa0f80d1010 msgr2=0x7fa0f80ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:25.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.020+0000 7fa0fd000640 1 --2- 172.21.15.99:0/4191713625 >> v2:172.21.15.187:3300/0 conn(0x7fa0f80d1010 0x7fa0f80ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.020+0000 7fa0fd000640 1 -- 172.21.15.99:0/4191713625 >> v1:172.21.15.187:6789/0 conn(0x7fa0f8071df0 legacy=0x7fa0f806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:25.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.020+0000 7fa0fd000640 1 -- 172.21.15.99:0/4191713625 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f8072890 con 0x7fa0f806e280 2024-09-10T07:35:25.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.020+0000 7fa0f7e00640 1 -- 172.21.15.99:0/4191713625 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909413157 0 0) 0x7fa0f80722d0 con 0x7fa0f8071df0 2024-09-10T07:35:25.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.020+0000 7fa0fda00640 1 --2- 172.21.15.99:0/4191713625 >> v2:172.21.15.187:3300/0 conn(0x7fa0f80d1010 0x7fa0f80ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:25.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.021+0000 7fa0fd000640 1 --2- 172.21.15.99:0/4191713625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f806e280 0x7fa0f8073370 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80097a0 tx=0x7fa0e802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18d32faa3e7061e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:25.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.021+0000 7fa0f7e00640 1 -- 172.21.15.99:0/4191713625 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8037070 con 0x7fa0f806e280 2024-09-10T07:35:25.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.022+0000 7fa0f7e00640 1 -- 172.21.15.99:0/4191713625 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e8032440 con 0x7fa0f806e280 2024-09-10T07:35:25.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.022+0000 7fa0f7e00640 1 -- 172.21.15.99:0/4191713625 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8032810 con 0x7fa0f806e280 2024-09-10T07:35:25.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.022+0000 7fa0ffa00640 1 -- 172.21.15.99:0/4191713625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f806e280 msgr2=0x7fa0f8073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:25.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.022+0000 7fa0ffa00640 1 --2- 172.21.15.99:0/4191713625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f806e280 0x7fa0f8073370 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80097a0 tx=0x7fa0e802a1a0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.022+0000 7fa0ffa00640 1 -- 172.21.15.99:0/4191713625 shutdown_connections 2024-09-10T07:35:25.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.022+0000 7fa0ffa00640 1 --2- 172.21.15.99:0/4191713625 >> v2:172.21.15.187:3300/0 conn(0x7fa0f80d1010 0x7fa0f80ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.022+0000 7fa0ffa00640 1 --2- 172.21.15.99:0/4191713625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f806e280 0x7fa0f8073370 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.022+0000 7fa0ffa00640 1 -- 172.21.15.99:0/4191713625 >> 172.21.15.99:0/4191713625 conn(0x7fa0f806bc10 msgr2=0x7fa0f806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:25.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.022+0000 7fa0ffa00640 1 -- 172.21.15.99:0/4191713625 shutdown_connections 2024-09-10T07:35:25.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.022+0000 7fa0ffa00640 1 -- 172.21.15.99:0/4191713625 wait complete. 2024-09-10T07:35:25.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.024+0000 7fa0ffa00640 1 Processor -- start 2024-09-10T07:35:25.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.024+0000 7fa0ffa00640 1 -- start start 2024-09-10T07:35:25.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0ffa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f806e280 0x7fa0f81565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:25.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0ffa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f8071df0 0x7fa0f80aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:25.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0ffa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f80d1010 0x7fa0f815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0ffa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f815db60 con 0x7fa0f806e280 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0ffa00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f8072e50 con 0x7fa0f8071df0 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0ffa00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f80d14c0 con 0x7fa0f80d1010 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0fd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f806e280 0x7fa0f81565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0fd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f806e280 0x7fa0f81565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33090/0 (socket says 172.21.15.99:33090) 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0fd000640 1 -- 172.21.15.99:0/311416060 learned_addr learned my addr 172.21.15.99:0/311416060 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0efe00640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f8071df0 0x7fa0f80aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.025+0000 7fa0fda00640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f80d1010 0x7fa0f815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.026+0000 7fa0fd000640 1 -- 172.21.15.99:0/311416060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f80d1010 msgr2=0x7fa0f815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.026+0000 7fa0fd000640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f80d1010 0x7fa0f815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.026+0000 7fa0fd000640 1 -- 172.21.15.99:0/311416060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f8071df0 msgr2=0x7fa0f80aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.026+0000 7fa0fd000640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f8071df0 0x7fa0f80aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.026+0000 7fa0fd000640 1 -- 172.21.15.99:0/311416060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f8156c90 con 0x7fa0f806e280 2024-09-10T07:35:25.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.026+0000 7fa0fd000640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f806e280 0x7fa0f81565d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80097a0 tx=0x7fa0e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:25.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.026+0000 7fa0f5600640 1 -- 172.21.15.99:0/311416060 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8037040 con 0x7fa0f806e280 2024-09-10T07:35:25.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.026+0000 7fa0f5600640 1 -- 172.21.15.99:0/311416060 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e8004230 con 0x7fa0f806e280 2024-09-10T07:35:25.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.026+0000 7fa0ffa00640 1 -- 172.21.15.99:0/311416060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f8156f70 con 0x7fa0f806e280 2024-09-10T07:35:25.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.026+0000 7fa0f5600640 1 -- 172.21.15.99:0/311416060 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8003610 con 0x7fa0f806e280 2024-09-10T07:35:25.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.027+0000 7fa0ffa00640 1 -- 172.21.15.99:0/311416060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f80b3f50 con 0x7fa0f806e280 2024-09-10T07:35:25.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.028+0000 7fa0ffa00640 1 -- 172.21.15.99:0/311416060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f8157140 con 0x7fa0f806e280 2024-09-10T07:35:25.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.028+0000 7fa0f5600640 1 -- 172.21.15.99:0/311416060 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0e80037b0 con 0x7fa0f806e280 2024-09-10T07:35:25.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.030+0000 7fa0f5600640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0d406be30 0x7fa0d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.030+0000 7fa0f5600640 1 -- 172.21.15.99:0/311416060 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7fa0e80ac1d0 con 0x7fa0f806e280 2024-09-10T07:35:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.030+0000 7fa0efe00640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0d406be30 0x7fa0d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:25.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.030+0000 7fa0efe00640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0d406be30 0x7fa0d406e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80b3b80 tx=0x7fa0e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:25.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.034+0000 7fa0f5600640 1 -- 172.21.15.99:0/311416060 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0e807a550 con 0x7fa0f806e280 2024-09-10T07:35:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.244+0000 7fa0ffa00640 1 -- 172.21.15.99:0/311416060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa0f8073370 con 0x7fa0f806e280 2024-09-10T07:35:25.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.841+0000 7fa0f5600640 1 -- 172.21.15.99:0/311416060 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7fa0e807e850 con 0x7fa0f806e280 2024-09-10T07:35:25.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 -- 172.21.15.99:0/311416060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0d406be30 msgr2=0x7fa0d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:25.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0d406be30 0x7fa0d406e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80b3b80 tx=0x7fa0e0009040 comp rx=0 tx=0).stop 2024-09-10T07:35:25.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 -- 172.21.15.99:0/311416060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f806e280 msgr2=0x7fa0f81565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:25.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f806e280 0x7fa0f81565d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80097a0 tx=0x7fa0e80046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 -- 172.21.15.99:0/311416060 shutdown_connections 2024-09-10T07:35:25.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f80d1010 0x7fa0f815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f8071df0 0x7fa0f80aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0d406be30 0x7fa0d406e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 --2- 172.21.15.99:0/311416060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0f806e280 0x7fa0f81565d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:25.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 -- 172.21.15.99:0/311416060 >> 172.21.15.99:0/311416060 conn(0x7fa0f806bc10 msgr2=0x7fa0f80cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:25.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.844+0000 7fa0ffa00640 1 -- 172.21.15.99:0/311416060 shutdown_connections 2024-09-10T07:35:25.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:25.845+0000 7fa0ffa00640 1 -- 172.21.15.99:0/311416060 wait complete. 2024-09-10T07:35:25.863 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:35:26.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.062+0000 7fcaa8c00640 1 Processor -- start 2024-09-10T07:35:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.062+0000 7fcaa8c00640 1 -- start start 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.063+0000 7fcaa8c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 0x7fcaa40cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa8c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcaa40d0420 0x7fcaa406e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa8c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcaa406eb20 0x7fcaa41605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa8c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa415dfc0 con 0x7fcaa406eb20 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa8c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa415d3b0 con 0x7fcaa40d0420 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa8c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa415d690 con 0x7fcaa40ce460 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa2800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcaa406eb20 0x7fcaa41605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa2800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcaa406eb20 0x7fcaa41605c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33102/0 (socket says 172.21.15.99:33102) 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa2800640 1 -- 172.21.15.99:0/2175535001 learned_addr learned my addr 172.21.15.99:0/2175535001 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa1e00640 1 --2- 172.21.15.99:0/2175535001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 0x7fcaa40cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fca99400640 1 --2- 172.21.15.99:0/2175535001 >> v2:172.21.15.187:3300/0 conn(0x7fcaa40d0420 0x7fcaa406e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa2800640 1 -- 172.21.15.99:0/2175535001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 msgr2=0x7fcaa40cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:26.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa2800640 1 --2- 172.21.15.99:0/2175535001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 0x7fcaa40cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa2800640 1 -- 172.21.15.99:0/2175535001 >> v2:172.21.15.187:3300/0 conn(0x7fcaa40d0420 msgr2=0x7fcaa406e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa2800640 1 --2- 172.21.15.99:0/2175535001 >> v2:172.21.15.187:3300/0 conn(0x7fcaa40d0420 0x7fcaa406e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.064+0000 7fcaa2800640 1 -- 172.21.15.99:0/2175535001 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa415d970 con 0x7fcaa406eb20 2024-09-10T07:35:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.065+0000 7fcaa2800640 1 --2- 172.21.15.99:0/2175535001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 0x7fcaa41605c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4073f90 tx=0x7fca9c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02c1dabfff36036 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa1400640 1 -- 172.21.15.99:0/2175535001 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c036070 con 0x7fcaa406eb20 2024-09-10T07:35:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa1400640 1 -- 172.21.15.99:0/2175535001 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c031600 con 0x7fcaa406eb20 2024-09-10T07:35:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa1400640 1 -- 172.21.15.99:0/2175535001 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0319d0 con 0x7fcaa406eb20 2024-09-10T07:35:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2175535001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 msgr2=0x7fcaa41605c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa8c00640 1 --2- 172.21.15.99:0/2175535001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 0x7fcaa41605c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4073f90 tx=0x7fca9c02a6a0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2175535001 shutdown_connections 2024-09-10T07:35:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa8c00640 1 --2- 172.21.15.99:0/2175535001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 0x7fcaa41605c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa8c00640 1 --2- 172.21.15.99:0/2175535001 >> v2:172.21.15.187:3300/0 conn(0x7fcaa40d0420 0x7fcaa406e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa8c00640 1 --2- 172.21.15.99:0/2175535001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 0x7fcaa40cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2175535001 >> 172.21.15.99:0/2175535001 conn(0x7fcaa40b26a0 msgr2=0x7fcaa40b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2175535001 shutdown_connections 2024-09-10T07:35:26.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.066+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2175535001 wait complete. 2024-09-10T07:35:26.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.068+0000 7fcaa8c00640 1 Processor -- start 2024-09-10T07:35:26.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.068+0000 7fcaa8c00640 1 -- start start 2024-09-10T07:35:26.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fcaa8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 0x7fcaa4162490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:26.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fcaa8c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 0x7fcaa414c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:26.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fcaa8c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa40d0420 0x7fcaa414ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:26.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fcaa8c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa415cfd0 con 0x7fcaa406eb20 2024-09-10T07:35:26.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fcaa8c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa40ce840 con 0x7fcaa40d0420 2024-09-10T07:35:26.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fcaa8c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa415d150 con 0x7fcaa40ce460 2024-09-10T07:35:26.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fcaa1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 0x7fcaa4162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fcaa1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 0x7fcaa4162490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33116/0 (socket says 172.21.15.99:33116) 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fcaa1e00640 1 -- 172.21.15.99:0/2288183332 learned_addr learned my addr 172.21.15.99:0/2288183332 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fca99400640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 0x7fcaa414c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.069+0000 7fcaa2800640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa40d0420 0x7fcaa414ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fcaa1e00640 1 -- 172.21.15.99:0/2288183332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 msgr2=0x7fcaa414c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fcaa1e00640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 0x7fcaa414c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fcaa1e00640 1 -- 172.21.15.99:0/2288183332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa40d0420 msgr2=0x7fcaa414ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fcaa1e00640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa40d0420 0x7fcaa414ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fcaa1e00640 1 -- 172.21.15.99:0/2288183332 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa4151380 con 0x7fcaa406eb20 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fca99400640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 0x7fcaa414c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fcaa1e00640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 0x7fcaa4162490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fca9400e8c0 tx=0x7fca9400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fca9aa00640 1 -- 172.21.15.99:0/2288183332 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94017070 con 0x7fcaa406eb20 2024-09-10T07:35:26.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fca9aa00640 1 -- 172.21.15.99:0/2288183332 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9400c8e0 con 0x7fcaa406eb20 2024-09-10T07:35:26.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fca9aa00640 1 -- 172.21.15.99:0/2288183332 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9400ccb0 con 0x7fcaa406eb20 2024-09-10T07:35:26.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2288183332 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa4151660 con 0x7fcaa406eb20 2024-09-10T07:35:26.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.070+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2288183332 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa4151f40 con 0x7fcaa406eb20 2024-09-10T07:35:26.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.071+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2288183332 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa4151a80 con 0x7fcaa406eb20 2024-09-10T07:35:26.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.072+0000 7fca9aa00640 1 -- 172.21.15.99:0/2288183332 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca9401a070 con 0x7fcaa406eb20 2024-09-10T07:35:26.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.073+0000 7fca9aa00640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8006be30 0x7fca8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:26.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.073+0000 7fca9aa00640 1 -- 172.21.15.99:0/2288183332 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7fca9408b1e0 con 0x7fcaa406eb20 2024-09-10T07:35:26.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.073+0000 7fca99400640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8006be30 0x7fca8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:26.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.074+0000 7fca99400640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8006be30 0x7fca8006e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcaa415ead0 tx=0x7fca8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:26.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.077+0000 7fca9aa00640 1 -- 172.21.15.99:0/2288183332 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcaa4151a80 con 0x7fcaa406eb20 2024-09-10T07:35:26.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.250+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2288183332 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcaa40cfee0 con 0x7fcaa406eb20 2024-09-10T07:35:26.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.848+0000 7fca9aa00640 1 -- 172.21.15.99:0/2288183332 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7fca94059440 con 0x7fcaa406eb20 2024-09-10T07:35:26.849 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:35:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.851+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2288183332 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8006be30 msgr2=0x7fca8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.851+0000 7fcaa8c00640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8006be30 0x7fca8006e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcaa415ead0 tx=0x7fca8c008040 comp rx=0 tx=0).stop 2024-09-10T07:35:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.851+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2288183332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 msgr2=0x7fcaa4162490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.851+0000 7fcaa8c00640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 0x7fcaa4162490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fca9400e8c0 tx=0x7fca9400ed80 comp rx=0 tx=0).stop 2024-09-10T07:35:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.851+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2288183332 shutdown_connections 2024-09-10T07:35:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.851+0000 7fcaa8c00640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa40d0420 0x7fcaa414ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.851+0000 7fcaa8c00640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa40ce460 0x7fcaa414c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.851+0000 7fcaa8c00640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8006be30 0x7fca8006e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.851+0000 7fcaa8c00640 1 --2- 172.21.15.99:0/2288183332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa406eb20 0x7fcaa4162490 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.851+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2288183332 >> 172.21.15.99:0/2288183332 conn(0x7fcaa40b26a0 msgr2=0x7fcaa415f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.852+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2288183332 shutdown_connections 2024-09-10T07:35:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:26.852+0000 7fcaa8c00640 1 -- 172.21.15.99:0/2288183332 wait complete. 2024-09-10T07:35:26.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:35:27.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.027+0000 7f1338200640 1 Processor -- start 2024-09-10T07:35:27.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.027+0000 7f1338200640 1 -- start start 2024-09-10T07:35:27.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.028+0000 7f1338200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f13300ce460 0x7f13300cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:27.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.028+0000 7f1338200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300d0420 0x7f133006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:27.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1338200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133015dfc0 con 0x7f133006eb20 2024-09-10T07:35:27.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1338200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f133015d3b0 con 0x7f13300ce460 2024-09-10T07:35:27.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1338200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f133015d690 con 0x7f13300d0420 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1336200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f133006eb20 0x7f13301605c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36772/0 (socket says 172.21.15.99:36772) 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1336200640 1 -- 172.21.15.99:0/3614614756 learned_addr learned my addr 172.21.15.99:0/3614614756 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1334e00640 1 --2- 172.21.15.99:0/3614614756 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300d0420 0x7f133006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1335800640 1 --2- 172.21.15.99:0/3614614756 >> v2:172.21.15.187:3300/0 conn(0x7f13300ce460 0x7f13300cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f132fe00640 1 -- 172.21.15.99:0/3614614756 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426808194 0 0) 0x7f133015dfc0 con 0x7f133006eb20 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f132fe00640 1 -- 172.21.15.99:0/3614614756 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1318003520 con 0x7f133006eb20 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1334e00640 1 -- 172.21.15.99:0/3614614756 >> v2:172.21.15.187:3300/0 conn(0x7f13300ce460 msgr2=0x7f13300cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1334e00640 1 --2- 172.21.15.99:0/3614614756 >> v2:172.21.15.187:3300/0 conn(0x7f13300ce460 0x7f13300cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1334e00640 1 -- 172.21.15.99:0/3614614756 >> v1:172.21.15.99:6789/0 conn(0x7f133006eb20 legacy=0x7f13301605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1334e00640 1 -- 172.21.15.99:0/3614614756 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133015d970 con 0x7f13300d0420 2024-09-10T07:35:27.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.029+0000 7f1335800640 1 --2- 172.21.15.99:0/3614614756 >> v2:172.21.15.187:3300/0 conn(0x7f13300ce460 0x7f13300cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.030+0000 7f1334e00640 1 --2- 172.21.15.99:0/3614614756 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300d0420 0x7f133006e5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f131c0097a0 tx=0x7f131c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e376e15815b0e6e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f132fe00640 1 -- 172.21.15.99:0/3614614756 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c037070 con 0x7f13300d0420 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f132fe00640 1 -- 172.21.15.99:0/3614614756 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131c032440 con 0x7f13300d0420 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f132fe00640 1 -- 172.21.15.99:0/3614614756 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c0327f0 con 0x7f13300d0420 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f1338200640 1 -- 172.21.15.99:0/3614614756 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300d0420 msgr2=0x7f133006e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f1338200640 1 --2- 172.21.15.99:0/3614614756 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300d0420 0x7f133006e5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f131c0097a0 tx=0x7f131c02a180 comp rx=0 tx=0).stop 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f1338200640 1 -- 172.21.15.99:0/3614614756 shutdown_connections 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f1338200640 1 --2- 172.21.15.99:0/3614614756 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300d0420 0x7f133006e5e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f1338200640 1 --2- 172.21.15.99:0/3614614756 >> v2:172.21.15.187:3300/0 conn(0x7f13300ce460 0x7f13300cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f1338200640 1 -- 172.21.15.99:0/3614614756 >> 172.21.15.99:0/3614614756 conn(0x7f13300b26a0 msgr2=0x7f13300b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:27.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f1338200640 1 -- 172.21.15.99:0/3614614756 shutdown_connections 2024-09-10T07:35:27.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.031+0000 7f1338200640 1 -- 172.21.15.99:0/3614614756 wait complete. 2024-09-10T07:35:27.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.033+0000 7f1338200640 1 Processor -- start 2024-09-10T07:35:27.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.033+0000 7f1338200640 1 -- start start 2024-09-10T07:35:27.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1338200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133006eb20 0x7f133014a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:27.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1338200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300ce460 0x7f13301616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:27.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1338200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300d0420 0x7f13300b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1338200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f13300ce840 con 0x7f13300d0420 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1338200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f133006ef50 con 0x7f133006eb20 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1338200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f133015cfd0 con 0x7f13300ce460 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1336200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300d0420 0x7f13300b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1336200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300d0420 0x7f13300b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33130/0 (socket says 172.21.15.99:33130) 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1336200640 1 -- 172.21.15.99:0/2638433334 learned_addr learned my addr 172.21.15.99:0/2638433334 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1335800640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133006eb20 0x7f133014a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.034+0000 7f1334e00640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300ce460 0x7f13301616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.035+0000 7f1336200640 1 -- 172.21.15.99:0/2638433334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300ce460 msgr2=0x7f13301616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.035+0000 7f1336200640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300ce460 0x7f13301616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.035+0000 7f1336200640 1 -- 172.21.15.99:0/2638433334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133006eb20 msgr2=0x7f133014a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.035+0000 7f1336200640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133006eb20 0x7f133014a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:27.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.035+0000 7f1336200640 1 -- 172.21.15.99:0/2638433334 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1330151c70 con 0x7f13300d0420 2024-09-10T07:35:27.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.035+0000 7f1336200640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300d0420 0x7f13300b1060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f132800cad0 tx=0x7f132800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:27.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.035+0000 7f132d600640 1 -- 172.21.15.99:0/2638433334 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328017070 con 0x7f13300d0420 2024-09-10T07:35:27.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.035+0000 7f132d600640 1 -- 172.21.15.99:0/2638433334 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132800ac30 con 0x7f13300d0420 2024-09-10T07:35:27.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.035+0000 7f132d600640 1 -- 172.21.15.99:0/2638433334 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328012400 con 0x7f13300d0420 2024-09-10T07:35:27.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.035+0000 7f1338200640 1 -- 172.21.15.99:0/2638433334 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1330151f50 con 0x7f13300d0420 2024-09-10T07:35:27.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.036+0000 7f1338200640 1 -- 172.21.15.99:0/2638433334 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13301503a0 con 0x7f13300d0420 2024-09-10T07:35:27.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.037+0000 7f1338200640 1 -- 172.21.15.99:0/2638433334 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13301501c0 con 0x7f13300d0420 2024-09-10T07:35:27.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.038+0000 7f132d600640 1 -- 172.21.15.99:0/2638433334 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f132801a070 con 0x7f13300d0420 2024-09-10T07:35:27.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.038+0000 7f132d600640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131006be30 0x7f131006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:27.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.039+0000 7f132d600640 1 -- 172.21.15.99:0/2638433334 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5357+0+0 (secure 0 0 0) 0x7f132808aa30 con 0x7f13300d0420 2024-09-10T07:35:27.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.039+0000 7f1335800640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131006be30 0x7f131006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:27.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.039+0000 7f1335800640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131006be30 0x7f131006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1330153d00 tx=0x7f1324009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:27.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.043+0000 7f132d600640 1 -- 172.21.15.99:0/2638433334 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13301501c0 con 0x7f13300d0420 2024-09-10T07:35:27.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.216+0000 7f1338200640 1 -- 172.21.15.99:0/2638433334 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f13300cfee0 con 0x7f13300d0420 2024-09-10T07:35:27.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.854+0000 7f132d600640 1 -- 172.21.15.99:0/2638433334 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f1328058ef0 con 0x7f13300d0420 2024-09-10T07:35:27.854 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.856+0000 7f1338200640 1 -- 172.21.15.99:0/2638433334 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131006be30 msgr2=0x7f131006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.856+0000 7f1338200640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131006be30 0x7f131006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1330153d00 tx=0x7f1324009190 comp rx=0 tx=0).stop 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.857+0000 7f1338200640 1 -- 172.21.15.99:0/2638433334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300d0420 msgr2=0x7f13300b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.857+0000 7f1338200640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300d0420 0x7f13300b1060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f132800cad0 tx=0x7f132800cf90 comp rx=0 tx=0).stop 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.857+0000 7f1338200640 1 -- 172.21.15.99:0/2638433334 shutdown_connections 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.857+0000 7f1338200640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131006be30 0x7f131006e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.857+0000 7f1338200640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300d0420 0x7f13300b1060 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.857+0000 7f1338200640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13300ce460 0x7f13301616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.857+0000 7f1338200640 1 --2- 172.21.15.99:0/2638433334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133006eb20 0x7f133014a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.857+0000 7f1338200640 1 -- 172.21.15.99:0/2638433334 >> 172.21.15.99:0/2638433334 conn(0x7f13300b26a0 msgr2=0x7f13300b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:27.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.857+0000 7f1338200640 1 -- 172.21.15.99:0/2638433334 shutdown_connections 2024-09-10T07:35:27.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:27.857+0000 7f1338200640 1 -- 172.21.15.99:0/2638433334 wait complete. 2024-09-10T07:35:27.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T07:35:28.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.034+0000 7fafb2e00640 1 Processor -- start 2024-09-10T07:35:28.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.034+0000 7fafb2e00640 1 -- start start 2024-09-10T07:35:28.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafb2e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fafac15b760 0x7fafac0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafb2e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fafac0d0630 0x7fafac0d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafb2e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafac0b4300 con 0x7fafac0b4a90 2024-09-10T07:35:28.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafb2e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fafac0d0fa0 con 0x7fafac0d0630 2024-09-10T07:35:28.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafb2e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fafac06d700 con 0x7fafac15b760 2024-09-10T07:35:28.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafb0e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fafac0d0630 0x7fafac0d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafab400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fafac0b4a90 0x7fafac06f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36774/0 (socket says 172.21.15.99:36774) 2024-09-10T07:35:28.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafab400640 1 -- 172.21.15.99:0/2872869309 learned_addr learned my addr 172.21.15.99:0/2872869309 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:28.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafabe00640 1 --2- 172.21.15.99:0/2872869309 >> v2:172.21.15.187:3300/0 conn(0x7fafac15b760 0x7fafac0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafb0e00640 1 -- 172.21.15.99:0/2872869309 >> v2:172.21.15.187:3300/0 conn(0x7fafac15b760 msgr2=0x7fafac0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:28.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafb0e00640 1 --2- 172.21.15.99:0/2872869309 >> v2:172.21.15.187:3300/0 conn(0x7fafac15b760 0x7fafac0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafb0e00640 1 -- 172.21.15.99:0/2872869309 >> v1:172.21.15.99:6789/0 conn(0x7fafac0b4a90 legacy=0x7fafac06f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.036+0000 7fafb0e00640 1 -- 172.21.15.99:0/2872869309 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac06d9e0 con 0x7fafac0d0630 2024-09-10T07:35:28.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.037+0000 7fafb0e00640 1 --2- 172.21.15.99:0/2872869309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0d0630 0x7fafac0d0a60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fafac0ce2b0 tx=0x7fafa402c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcf8d2f7f3edee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:28.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafaaa00640 1 -- 172.21.15.99:0/2872869309 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4038070 con 0x7fafac0d0630 2024-09-10T07:35:28.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafaaa00640 1 -- 172.21.15.99:0/2872869309 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa4007740 con 0x7fafac0d0630 2024-09-10T07:35:28.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafaaa00640 1 -- 172.21.15.99:0/2872869309 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4007b10 con 0x7fafac0d0630 2024-09-10T07:35:28.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafb2e00640 1 -- 172.21.15.99:0/2872869309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0d0630 msgr2=0x7fafac0d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafb2e00640 1 --2- 172.21.15.99:0/2872869309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0d0630 0x7fafac0d0a60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fafac0ce2b0 tx=0x7fafa402c770 comp rx=0 tx=0).stop 2024-09-10T07:35:28.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafb2e00640 1 -- 172.21.15.99:0/2872869309 shutdown_connections 2024-09-10T07:35:28.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafb2e00640 1 --2- 172.21.15.99:0/2872869309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0d0630 0x7fafac0d0a60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafb2e00640 1 --2- 172.21.15.99:0/2872869309 >> v2:172.21.15.187:3300/0 conn(0x7fafac15b760 0x7fafac0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafb2e00640 1 -- 172.21.15.99:0/2872869309 >> 172.21.15.99:0/2872869309 conn(0x7fafac06bc10 msgr2=0x7fafac06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:28.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafb2e00640 1 -- 172.21.15.99:0/2872869309 shutdown_connections 2024-09-10T07:35:28.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.038+0000 7fafb2e00640 1 -- 172.21.15.99:0/2872869309 wait complete. 2024-09-10T07:35:28.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.040+0000 7fafb2e00640 1 Processor -- start 2024-09-10T07:35:28.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.040+0000 7fafb2e00640 1 -- start start 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.041+0000 7fafb2e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafac0b4a90 0x7fafac1e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.041+0000 7fafb2e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafac0d0630 0x7fafac15be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.041+0000 7fafb2e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac15b760 0x7fafac0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.041+0000 7fafb2e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fafac0b4f20 con 0x7fafac15b760 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.041+0000 7fafb2e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fafac15bb40 con 0x7fafac0b4a90 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.041+0000 7fafb2e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fafac15c380 con 0x7fafac0d0630 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.041+0000 7fafb0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac15b760 0x7fafac0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.041+0000 7fafb0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac15b760 0x7fafac0aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33150/0 (socket says 172.21.15.99:33150) 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.041+0000 7fafb0e00640 1 -- 172.21.15.99:0/3830903830 learned_addr learned my addr 172.21.15.99:0/3830903830 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.042+0000 7fafabe00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafac0b4a90 0x7fafac1e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.042+0000 7fafab400640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafac0d0630 0x7fafac15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.042+0000 7fafb0e00640 1 -- 172.21.15.99:0/3830903830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafac0d0630 msgr2=0x7fafac15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.042+0000 7fafb0e00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafac0d0630 0x7fafac15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.042+0000 7fafb0e00640 1 -- 172.21.15.99:0/3830903830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafac0b4a90 msgr2=0x7fafac1e4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.042+0000 7fafb0e00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafac0b4a90 0x7fafac1e4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.042+0000 7fafb0e00640 1 -- 172.21.15.99:0/3830903830 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac15c620 con 0x7fafac15b760 2024-09-10T07:35:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.042+0000 7fafb0e00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac15b760 0x7fafac0aeab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009e80 tx=0x7fafa4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.043+0000 7fafa3e00640 1 -- 172.21.15.99:0/3830903830 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4043070 con 0x7fafac15b760 2024-09-10T07:35:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.043+0000 7fafa3e00640 1 -- 172.21.15.99:0/3830903830 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa4033730 con 0x7fafac15b760 2024-09-10T07:35:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.043+0000 7fafb2e00640 1 -- 172.21.15.99:0/3830903830 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafac15c900 con 0x7fafac15b760 2024-09-10T07:35:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.043+0000 7fafa3e00640 1 -- 172.21.15.99:0/3830903830 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4038040 con 0x7fafac15b760 2024-09-10T07:35:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.043+0000 7fafb2e00640 1 -- 172.21.15.99:0/3830903830 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafac15cec0 con 0x7fafac15b760 2024-09-10T07:35:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.044+0000 7fafb2e00640 1 -- 172.21.15.99:0/3830903830 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafac0752a0 con 0x7fafac15b760 2024-09-10T07:35:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.045+0000 7fafa3e00640 1 -- 172.21.15.99:0/3830903830 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafa4046070 con 0x7fafac15b760 2024-09-10T07:35:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.046+0000 7fafa3e00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf8c06be30 0x7faf8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.046+0000 7fafa3e00640 1 -- 172.21.15.99:0/3830903830 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fafa40aacd0 con 0x7fafac15b760 2024-09-10T07:35:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.046+0000 7fafabe00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf8c06be30 0x7faf8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.047+0000 7fafabe00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf8c06be30 0x7faf8c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0079a0 tx=0x7faf9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:28.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.050+0000 7fafa3e00640 1 -- 172.21.15.99:0/3830903830 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafa4079330 con 0x7fafac15b760 2024-09-10T07:35:28.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.225+0000 7fafb2e00640 1 -- 172.21.15.99:0/3830903830 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fafac074fc0 con 0x7fafac15b760 2024-09-10T07:35:28.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.228+0000 7fafa3e00640 1 -- 172.21.15.99:0/3830903830 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) ==== 104+0+0 (secure 0 0 0) 0x7fafa407d630 con 0x7fafac15b760 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.230+0000 7fafb2e00640 1 -- 172.21.15.99:0/3830903830 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf8c06be30 msgr2=0x7faf8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf8c06be30 0x7faf8c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0079a0 tx=0x7faf9c008040 comp rx=0 tx=0).stop 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 -- 172.21.15.99:0/3830903830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac15b760 msgr2=0x7fafac0aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac15b760 0x7fafac0aeab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009e80 tx=0x7fafa4004a40 comp rx=0 tx=0).stop 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 -- 172.21.15.99:0/3830903830 shutdown_connections 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf8c06be30 0x7faf8c06e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac15b760 0x7fafac0aeab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafac0d0630 0x7fafac15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 --2- 172.21.15.99:0/3830903830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafac0b4a90 0x7fafac1e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 -- 172.21.15.99:0/3830903830 >> 172.21.15.99:0/3830903830 conn(0x7fafac06bc10 msgr2=0x7fafac0ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:28.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 -- 172.21.15.99:0/3830903830 shutdown_connections 2024-09-10T07:35:28.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.231+0000 7fafb2e00640 1 -- 172.21.15.99:0/3830903830 wait complete. 2024-09-10T07:35:28.246 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-10T07:35:28.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.400+0000 7f3179000640 1 Processor -- start 2024-09-10T07:35:28.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.400+0000 7f3179000640 1 -- start start 2024-09-10T07:35:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.401+0000 7f3179000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740d2680 0x7f31740cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.401+0000 7f3179000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f31740cfac0 0x7f31740c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.401+0000 7f3179000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31740d2bd0 con 0x7f317415e970 2024-09-10T07:35:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.401+0000 7f3179000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f31740d37e0 con 0x7f31740cfac0 2024-09-10T07:35:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.401+0000 7f3179000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f31740d2eb0 con 0x7f31740d2680 2024-09-10T07:35:28.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.402+0000 7f3172a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740d2680 0x7f31740cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.402+0000 7f3173e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f31740cfac0 0x7f31740c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.402+0000 7f3172a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740d2680 0x7f31740cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:47632/0 (socket says 172.21.15.99:47632) 2024-09-10T07:35:28.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.402+0000 7f3172a00640 1 -- 172.21.15.99:0/2360948400 learned_addr learned my addr 172.21.15.99:0/2360948400 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:28.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.402+0000 7f3173e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f31740cfac0 0x7f31740c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:57012/0 (socket says 172.21.15.99:57012) 2024-09-10T07:35:28.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.402+0000 7f3173e00640 1 -- 172.21.15.99:0/2360948400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740d2680 msgr2=0x7f31740cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:28.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.402+0000 7f3173e00640 1 --2- 172.21.15.99:0/2360948400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740d2680 0x7f31740cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.402+0000 7f3173e00640 1 -- 172.21.15.99:0/2360948400 >> v1:172.21.15.187:6789/0 conn(0x7f317415e970 legacy=0x7f31740d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.402+0000 7f3173e00640 1 -- 172.21.15.99:0/2360948400 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31740d3190 con 0x7f31740cfac0 2024-09-10T07:35:28.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.403+0000 7f3173e00640 1 --2- 172.21.15.99:0/2360948400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31740cfac0 0x7f31740c8700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f316c009d90 tx=0x7f316c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1ebd9405e5c35f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:28.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.404+0000 7f3172000640 1 -- 172.21.15.99:0/2360948400 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c007740 con 0x7f31740cfac0 2024-09-10T07:35:28.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.404+0000 7f3172000640 1 -- 172.21.15.99:0/2360948400 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c0078e0 con 0x7f31740cfac0 2024-09-10T07:35:28.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.404+0000 7f3172000640 1 -- 172.21.15.99:0/2360948400 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c007cb0 con 0x7f31740cfac0 2024-09-10T07:35:28.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.404+0000 7f3179000640 1 -- 172.21.15.99:0/2360948400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31740cfac0 msgr2=0x7f31740c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.404+0000 7f3179000640 1 --2- 172.21.15.99:0/2360948400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31740cfac0 0x7f31740c8700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f316c009d90 tx=0x7f316c02a6f0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.405+0000 7f3179000640 1 -- 172.21.15.99:0/2360948400 shutdown_connections 2024-09-10T07:35:28.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.405+0000 7f3179000640 1 --2- 172.21.15.99:0/2360948400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31740cfac0 0x7f31740c8700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.405+0000 7f3179000640 1 --2- 172.21.15.99:0/2360948400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740d2680 0x7f31740cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.405+0000 7f3179000640 1 -- 172.21.15.99:0/2360948400 >> 172.21.15.99:0/2360948400 conn(0x7f317409de00 msgr2=0x7f31740d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:28.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.405+0000 7f3179000640 1 -- 172.21.15.99:0/2360948400 shutdown_connections 2024-09-10T07:35:28.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.405+0000 7f3179000640 1 -- 172.21.15.99:0/2360948400 wait complete. 2024-09-10T07:35:28.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.406+0000 7f3179000640 1 Processor -- start 2024-09-10T07:35:28.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.406+0000 7f3179000640 1 -- start start 2024-09-10T07:35:28.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.407+0000 7f3179000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740cfac0 0x7f31740b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.407+0000 7f3179000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31740d2680 0x7f31741e8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.407+0000 7f3179000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f317415e970 0x7f3174154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.407+0000 7f3179000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f317415ed50 con 0x7f317415e970 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.407+0000 7f3179000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f31740cff70 con 0x7f31740d2680 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.407+0000 7f3179000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f317415eed0 con 0x7f31740cfac0 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.407+0000 7f3173e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f317415e970 0x7f3174154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.407+0000 7f3173e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f317415e970 0x7f3174154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33158/0 (socket says 172.21.15.99:33158) 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.407+0000 7f3173e00640 1 -- 172.21.15.99:0/3716489618 learned_addr learned my addr 172.21.15.99:0/3716489618 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.408+0000 7f3172a00640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31740d2680 0x7f31741e8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.408+0000 7f3173400640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740cfac0 0x7f31740b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.408+0000 7f3173e00640 1 -- 172.21.15.99:0/3716489618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740cfac0 msgr2=0x7f31740b82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.408+0000 7f3173e00640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740cfac0 0x7f31740b82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.408+0000 7f3173e00640 1 -- 172.21.15.99:0/3716489618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31740d2680 msgr2=0x7f31741e8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.408+0000 7f3173e00640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31740d2680 0x7f31741e8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.408+0000 7f3173e00640 1 -- 172.21.15.99:0/3716489618 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31740b89b0 con 0x7f317415e970 2024-09-10T07:35:28.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.408+0000 7f3173e00640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f317415e970 0x7f3174154b00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f316c009eb0 tx=0x7f316c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:28.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.408+0000 7f316b400640 1 -- 172.21.15.99:0/3716489618 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c040070 con 0x7f317415e970 2024-09-10T07:35:28.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.409+0000 7f316b400640 1 -- 172.21.15.99:0/3716489618 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c031bc0 con 0x7f317415e970 2024-09-10T07:35:28.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.409+0000 7f3179000640 1 -- 172.21.15.99:0/3716489618 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31740b8c90 con 0x7f317415e970 2024-09-10T07:35:28.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.409+0000 7f316b400640 1 -- 172.21.15.99:0/3716489618 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c009450 con 0x7f317415e970 2024-09-10T07:35:28.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.409+0000 7f3179000640 1 -- 172.21.15.99:0/3716489618 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31740b9250 con 0x7f317415e970 2024-09-10T07:35:28.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.410+0000 7f3179000640 1 -- 172.21.15.99:0/3716489618 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31740cf580 con 0x7f317415e970 2024-09-10T07:35:28.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.411+0000 7f316b400640 1 -- 172.21.15.99:0/3716489618 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f316c039040 con 0x7f317415e970 2024-09-10T07:35:28.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.411+0000 7f316b400640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f315406be30 0x7f315406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:28.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.411+0000 7f316b400640 1 -- 172.21.15.99:0/3716489618 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f316c0ac380 con 0x7f317415e970 2024-09-10T07:35:28.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.412+0000 7f3173400640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f315406be30 0x7f315406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:28.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.412+0000 7f3173400640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f315406be30 0x7f315406e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f31640016e0 tx=0x7f3164009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:28.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.415+0000 7f316b400640 1 -- 172.21.15.99:0/3716489618 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f316c07a940 con 0x7f317415e970 2024-09-10T07:35:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.651+0000 7f3179000640 1 -- 172.21.15.99:0/3716489618 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) -- 0x7f317406ca20 con 0x7f317415e970 2024-09-10T07:35:28.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.856+0000 7f316b400640 1 -- 172.21.15.99:0/3716489618 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v80) ==== 130+0+0 (secure 0 0 0) 0x7f316c07ec40 con 0x7f317415e970 2024-09-10T07:35:28.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 -- 172.21.15.99:0/3716489618 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f315406be30 msgr2=0x7f315406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f315406be30 0x7f315406e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f31640016e0 tx=0x7f3164009040 comp rx=0 tx=0).stop 2024-09-10T07:35:28.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 -- 172.21.15.99:0/3716489618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f317415e970 msgr2=0x7f3174154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:28.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f317415e970 0x7f3174154b00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f316c009eb0 tx=0x7f316c004a40 comp rx=0 tx=0).stop 2024-09-10T07:35:28.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 -- 172.21.15.99:0/3716489618 shutdown_connections 2024-09-10T07:35:28.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f315406be30 0x7f315406e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f317415e970 0x7f3174154b00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31740d2680 0x7f31741e8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 --2- 172.21.15.99:0/3716489618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31740cfac0 0x7f31740b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:28.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 -- 172.21.15.99:0/3716489618 >> 172.21.15.99:0/3716489618 conn(0x7f317409de00 msgr2=0x7f31740c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:28.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 -- 172.21.15.99:0/3716489618 shutdown_connections 2024-09-10T07:35:28.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:28.859+0000 7f3179000640 1 -- 172.21.15.99:0/3716489618 wait complete. 2024-09-10T07:35:28.876 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-10T07:35:28.877 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-10T07:35:28.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:35:29.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.039+0000 7f5b85600640 1 Processor -- start 2024-09-10T07:35:29.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.039+0000 7f5b85600640 1 -- start start 2024-09-10T07:35:29.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b85600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b80145290 0x7f5b8006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b85600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5b80072f40 0x7f5b800b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b85600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8006e3d0 con 0x7f5b800ce780 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b85600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f5b8006efe0 con 0x7f5b80072f40 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b85600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8006e6b0 con 0x7f5b80145290 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b76000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5b800ce780 0x7f5b80072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36782/0 (socket says 172.21.15.99:36782) 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b76000640 1 -- 172.21.15.99:0/669112416 learned_addr learned my addr 172.21.15.99:0/669112416 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b7f400640 1 --2- 172.21.15.99:0/669112416 >> v2:172.21.15.99:3300/0 conn(0x7f5b80072f40 0x7f5b800b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b7ea00640 1 --2- 172.21.15.99:0/669112416 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b80145290 0x7f5b8006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b7e000640 1 -- 172.21.15.99:0/669112416 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131767815 0 0) 0x7f5b8006e3d0 con 0x7f5b800ce780 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b7e000640 1 -- 172.21.15.99:0/669112416 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b64003520 con 0x7f5b800ce780 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b7f400640 1 -- 172.21.15.99:0/669112416 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b80145290 msgr2=0x7f5b8006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b7f400640 1 --2- 172.21.15.99:0/669112416 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b80145290 0x7f5b8006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b7f400640 1 -- 172.21.15.99:0/669112416 >> v1:172.21.15.99:6789/0 conn(0x7f5b800ce780 legacy=0x7f5b80072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.041+0000 7f5b7f400640 1 -- 172.21.15.99:0/669112416 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8006e990 con 0x7f5b80072f40 2024-09-10T07:35:29.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.042+0000 7f5b7f400640 1 --2- 172.21.15.99:0/669112416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 0x7f5b800b3930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009d90 tx=0x7f5b7802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9b5ed1b27148d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b7e000640 1 -- 172.21.15.99:0/669112416 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78007740 con 0x7f5b80072f40 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b7e000640 1 -- 172.21.15.99:0/669112416 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b780078e0 con 0x7f5b80072f40 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b7e000640 1 -- 172.21.15.99:0/669112416 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78007c90 con 0x7f5b80072f40 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b85600640 1 -- 172.21.15.99:0/669112416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 msgr2=0x7f5b800b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b85600640 1 --2- 172.21.15.99:0/669112416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 0x7f5b800b3930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009d90 tx=0x7f5b7802a660 comp rx=0 tx=0).stop 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b85600640 1 -- 172.21.15.99:0/669112416 shutdown_connections 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b85600640 1 --2- 172.21.15.99:0/669112416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 0x7f5b800b3930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b85600640 1 --2- 172.21.15.99:0/669112416 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b80145290 0x7f5b8006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b85600640 1 -- 172.21.15.99:0/669112416 >> 172.21.15.99:0/669112416 conn(0x7f5b8006bc10 msgr2=0x7f5b8006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b85600640 1 -- 172.21.15.99:0/669112416 shutdown_connections 2024-09-10T07:35:29.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.043+0000 7f5b85600640 1 -- 172.21.15.99:0/669112416 wait complete. 2024-09-10T07:35:29.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.045+0000 7f5b85600640 1 Processor -- start 2024-09-10T07:35:29.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.045+0000 7f5b85600640 1 -- start start 2024-09-10T07:35:29.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.046+0000 7f5b85600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 0x7f5b8015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.046+0000 7f5b85600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b800ce780 0x7f5b8013f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.046+0000 7f5b85600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b80145290 0x7f5b80138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.046+0000 7f5b85600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8006df80 con 0x7f5b80072f40 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.046+0000 7f5b85600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5b80145670 con 0x7f5b800ce780 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.046+0000 7f5b85600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8006e100 con 0x7f5b80145290 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.046+0000 7f5b7ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 0x7f5b8015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.046+0000 7f5b7ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 0x7f5b8015af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33174/0 (socket says 172.21.15.99:33174) 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.046+0000 7f5b7ea00640 1 -- 172.21.15.99:0/2357727872 learned_addr learned my addr 172.21.15.99:0/2357727872 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b7ea00640 1 -- 172.21.15.99:0/2357727872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b80145290 msgr2=0x7f5b80138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b7ea00640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b80145290 0x7f5b80138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b7ea00640 1 -- 172.21.15.99:0/2357727872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b800ce780 msgr2=0x7f5b8013f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b7ea00640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b800ce780 0x7f5b8013f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b7ea00640 1 -- 172.21.15.99:0/2357727872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b800aec20 con 0x7f5b80072f40 2024-09-10T07:35:29.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b7ea00640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 0x7f5b8015af90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000d800 tx=0x7f5b7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b77400640 1 -- 172.21.15.99:0/2357727872 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000b6c0 con 0x7f5b80072f40 2024-09-10T07:35:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b77400640 1 -- 172.21.15.99:0/2357727872 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b70019070 con 0x7f5b80072f40 2024-09-10T07:35:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b85600640 1 -- 172.21.15.99:0/2357727872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b800aef00 con 0x7f5b80072f40 2024-09-10T07:35:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b77400640 1 -- 172.21.15.99:0/2357727872 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000ba80 con 0x7f5b80072f40 2024-09-10T07:35:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.047+0000 7f5b85600640 1 -- 172.21.15.99:0/2357727872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b800af4c0 con 0x7f5b80072f40 2024-09-10T07:35:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.048+0000 7f5b85600640 1 -- 172.21.15.99:0/2357727872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b80071510 con 0x7f5b80072f40 2024-09-10T07:35:29.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.049+0000 7f5b77400640 1 -- 172.21.15.99:0/2357727872 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b7000bc20 con 0x7f5b80072f40 2024-09-10T07:35:29.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.050+0000 7f5b77400640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5b5c06be30 0x7f5b5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.050+0000 7f5b77400640 1 -- 172.21.15.99:0/2357727872 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f5b7008af50 con 0x7f5b80072f40 2024-09-10T07:35:29.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.051+0000 7f5b76000640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5b5c06be30 0x7f5b5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.051+0000 7f5b76000640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5b5c06be30 0x7f5b5c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b68000f60 tx=0x7f5b680078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:29.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.054+0000 7f5b77400640 1 -- 172.21.15.99:0/2357727872 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b70059c90 con 0x7f5b80072f40 2024-09-10T07:35:29.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.230+0000 7f5b85600640 1 -- 172.21.15.99:0/2357727872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b800b23a0 con 0x7f5b80072f40 2024-09-10T07:35:29.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.231+0000 7f5b77400640 1 -- 172.21.15.99:0/2357727872 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13008 (secure 0 0 0) 0x7f5b70059590 con 0x7f5b80072f40 2024-09-10T07:35:29.232 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:29.232 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":36,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:35:27.850499+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6837/4168486217":"2024-09-11T07:35:24.839145+0000","172.21.15.99:6836/4168486217":"2024-09-11T07:35:24.839145+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:35:29.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 -- 172.21.15.99:0/2357727872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5b5c06be30 msgr2=0x7f5b5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5b5c06be30 0x7f5b5c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b68000f60 tx=0x7f5b680078f0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 -- 172.21.15.99:0/2357727872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 msgr2=0x7f5b8015af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 0x7f5b8015af90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000d800 tx=0x7f5b7000dcc0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 -- 172.21.15.99:0/2357727872 shutdown_connections 2024-09-10T07:35:29.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b80145290 0x7f5b80138aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b800ce780 0x7f5b8013f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5b5c06be30 0x7f5b5c06e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 --2- 172.21.15.99:0/2357727872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b80072f40 0x7f5b8015af90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 -- 172.21.15.99:0/2357727872 >> 172.21.15.99:0/2357727872 conn(0x7f5b8006bc10 msgr2=0x7f5b8015c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:29.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 -- 172.21.15.99:0/2357727872 shutdown_connections 2024-09-10T07:35:29.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.233+0000 7f5b85600640 1 -- 172.21.15.99:0/2357727872 wait complete. 2024-09-10T07:35:29.249 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:34:08.744575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:35:29.250 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:35:29.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.407+0000 7f4453e00640 1 Processor -- start 2024-09-10T07:35:29.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.407+0000 7f4453e00640 1 -- start start 2024-09-10T07:35:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.408+0000 7f4453e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445415e970 0x7f44540d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.409+0000 7f4453e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44540d2bd0 con 0x7f44540d2680 2024-09-10T07:35:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.409+0000 7f4453e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44540d2eb0 con 0x7f44540cfc90 2024-09-10T07:35:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.409+0000 7f4453e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f44540d37e0 con 0x7f445415e970 2024-09-10T07:35:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.409+0000 7f444a000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f44540d2680 0x7f44540cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36796/0 (socket says 172.21.15.99:36796) 2024-09-10T07:35:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.409+0000 7f444a000640 1 -- 172.21.15.99:0/2236295627 learned_addr learned my addr 172.21.15.99:0/2236295627 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.409+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293312606 0 0) 0x7f44540d2bd0 con 0x7f44540d2680 2024-09-10T07:35:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.409+0000 7f4452a00640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445415e970 0x7f44540d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.409+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4438003520 con 0x7f44540d2680 2024-09-10T07:35:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 774909575 0 0) 0x7f4438003520 con 0x7f44540d2680 2024-09-10T07:35:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445415e970 msgr2=0x7f44540d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445415e970 0x7f44540d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 >> v1:172.21.15.187:6789/0 conn(0x7f44540cfc90 legacy=0x7f44540c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44540d3190 con 0x7f44540d2680 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f443c001670 con 0x7f44540d2680 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 >> v1:172.21.15.99:6789/0 conn(0x7f44540d2680 legacy=0x7f44540cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44380039e0 0x7f4438003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445415e970 0x7f4438004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4438004d40 0x7f44380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f44540d37e0 con 0x7f4438004d40 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f443800bb00 con 0x7f44380039e0 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f443800bd00 con 0x7f445415e970 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4452a00640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44380039e0 0x7f4438003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f444a000640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445415e970 0x7f4438004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4453400640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4438004d40 0x7f44380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4453400640 1 -- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445415e970 msgr2=0x7f4438004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.410+0000 7f4453400640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445415e970 0x7f4438004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.411+0000 7f4453400640 1 -- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44380039e0 msgr2=0x7f4438003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.411+0000 7f4453400640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44380039e0 0x7f4438003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.411+0000 7f4453400640 1 -- 172.21.15.99:0/2236295627 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4438003520 con 0x7f4438004d40 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4453400640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4438004d40 0x7f44380051c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f444c001e20 tx=0x7f4438005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fffb65d9a3e3a3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c001a70 con 0x7f4438004d40 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444c02ae40 con 0x7f4438004d40 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4452000640 1 -- 172.21.15.99:0/2236295627 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c003bb0 con 0x7f4438004d40 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4453e00640 1 -- 172.21.15.99:0/2236295627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4438004d40 msgr2=0x7f44380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4453e00640 1 --2- 172.21.15.99:0/2236295627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4438004d40 0x7f44380051c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f444c001e20 tx=0x7f4438005830 comp rx=0 tx=0).stop 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4453400640 1 -- 172.21.15.99:0/2236295627 reap_dead start 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4453e00640 1 -- 172.21.15.99:0/2236295627 shutdown_connections 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4453e00640 1 -- 172.21.15.99:0/2236295627 >> 172.21.15.99:0/2236295627 conn(0x7f445409de00 msgr2=0x7f44540d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4453e00640 1 -- 172.21.15.99:0/2236295627 shutdown_connections 2024-09-10T07:35:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.412+0000 7f4453e00640 1 -- 172.21.15.99:0/2236295627 wait complete. 2024-09-10T07:35:29.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.414+0000 7f4453e00640 1 Processor -- start 2024-09-10T07:35:29.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.414+0000 7f4453e00640 1 -- start start 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.415+0000 7f4453e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4438004d40 0x7f44541546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.415+0000 7f4453e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44541600f0 0x7f4454160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.415+0000 7f4453e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44540b78e0 0x7f44540b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.415+0000 7f4453e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f445415eed0 con 0x7f44541600f0 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.415+0000 7f4453e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f445415ed50 con 0x7f4438004d40 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.415+0000 7f4453e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f44540d0300 con 0x7f44540b78e0 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.415+0000 7f444a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44541600f0 0x7f4454160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.415+0000 7f444a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44541600f0 0x7f4454160570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33194/0 (socket says 172.21.15.99:33194) 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.415+0000 7f444a000640 1 -- 172.21.15.99:0/1016708083 learned_addr learned my addr 172.21.15.99:0/1016708083 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f4452a00640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4438004d40 0x7f44541546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f4453400640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44540b78e0 0x7f44540b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f444a000640 1 -- 172.21.15.99:0/1016708083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44540b78e0 msgr2=0x7f44540b7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f444a000640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44540b78e0 0x7f44540b7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f444a000640 1 -- 172.21.15.99:0/1016708083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4438004d40 msgr2=0x7f44541546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f444a000640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4438004d40 0x7f44541546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f444a000640 1 -- 172.21.15.99:0/1016708083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44540b84f0 con 0x7f44541600f0 2024-09-10T07:35:29.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f4453400640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44540b78e0 0x7f44540b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:29.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f444a000640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44541600f0 0x7f4454160570 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f443c007370 tx=0x7f443c007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:29.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f444b400640 1 -- 172.21.15.99:0/1016708083 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c01a070 con 0x7f44541600f0 2024-09-10T07:35:29.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f444b400640 1 -- 172.21.15.99:0/1016708083 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443c00f9c0 con 0x7f44541600f0 2024-09-10T07:35:29.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f444b400640 1 -- 172.21.15.99:0/1016708083 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c00fdb0 con 0x7f44541600f0 2024-09-10T07:35:29.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.416+0000 7f4453e00640 1 -- 172.21.15.99:0/1016708083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44540b87d0 con 0x7f44541600f0 2024-09-10T07:35:29.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.417+0000 7f4453e00640 1 -- 172.21.15.99:0/1016708083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44540b8d90 con 0x7f44541600f0 2024-09-10T07:35:29.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.418+0000 7f4453e00640 1 -- 172.21.15.99:0/1016708083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44540d0690 con 0x7f44541600f0 2024-09-10T07:35:29.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.418+0000 7f444b400640 1 -- 172.21.15.99:0/1016708083 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f443c01d360 con 0x7f44541600f0 2024-09-10T07:35:29.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.419+0000 7f444b400640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f443006be30 0x7f443006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.419+0000 7f444b400640 1 -- 172.21.15.99:0/1016708083 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f443c08a4a0 con 0x7f44541600f0 2024-09-10T07:35:29.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.420+0000 7f4452a00640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f443006be30 0x7f443006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.420+0000 7f4452a00640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f443006be30 0x7f443006e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4444009bc0 tx=0x7f4444009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.424+0000 7f444b400640 1 -- 172.21.15.99:0/1016708083 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f443c0590b0 con 0x7f44541600f0 2024-09-10T07:35:29.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.595+0000 7f4453e00640 1 -- 172.21.15.99:0/1016708083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f445406c460 con 0x7f44541600f0 2024-09-10T07:35:29.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.596+0000 7f444b400640 1 -- 172.21.15.99:0/1016708083 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7f443c0589b0 con 0x7f44541600f0 2024-09-10T07:35:29.596 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-10T07:35:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 -- 172.21.15.99:0/1016708083 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f443006be30 msgr2=0x7f443006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f443006be30 0x7f443006e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4444009bc0 tx=0x7f4444009190 comp rx=0 tx=0).stop 2024-09-10T07:35:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 -- 172.21.15.99:0/1016708083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44541600f0 msgr2=0x7f4454160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44541600f0 0x7f4454160570 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f443c007370 tx=0x7f443c007770 comp rx=0 tx=0).stop 2024-09-10T07:35:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 -- 172.21.15.99:0/1016708083 shutdown_connections 2024-09-10T07:35:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44540b78e0 0x7f44540b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f443006be30 0x7f443006e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44541600f0 0x7f4454160570 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 --2- 172.21.15.99:0/1016708083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4438004d40 0x7f44541546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 -- 172.21.15.99:0/1016708083 >> 172.21.15.99:0/1016708083 conn(0x7f445409de00 msgr2=0x7f44540d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 -- 172.21.15.99:0/1016708083 shutdown_connections 2024-09-10T07:35:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.598+0000 7f4453e00640 1 -- 172.21.15.99:0/1016708083 wait complete. 2024-09-10T07:35:29.614 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-10T07:35:29.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.768+0000 7f4907600640 1 Processor -- start 2024-09-10T07:35:29.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.769+0000 7f4907600640 1 -- start start 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.770+0000 7f4907600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f49000cf4a0 0x7f49001662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.770+0000 7f4907600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490015c4f0 con 0x7f4900152210 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.770+0000 7f4907600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490015b730 con 0x7f49000cf010 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.770+0000 7f4907600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f490015ba10 con 0x7f49000cf4a0 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.770+0000 7f4904c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4900152210 0x7f4900071e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36812/0 (socket says 172.21.15.99:36812) 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.770+0000 7f4904c00640 1 -- 172.21.15.99:0/1835906001 learned_addr learned my addr 172.21.15.99:0/1835906001 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.770+0000 7f4905600640 1 --2- 172.21.15.99:0/1835906001 >> v2:172.21.15.187:3300/0 conn(0x7f49000cf4a0 0x7f49001662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.771+0000 7f48ffe00640 1 -- 172.21.15.99:0/1835906001 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106216436 0 0) 0x7f490015c4f0 con 0x7f4900152210 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.771+0000 7f48ffe00640 1 -- 172.21.15.99:0/1835906001 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48e4003520 con 0x7f4900152210 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.771+0000 7f48ffe00640 1 -- 172.21.15.99:0/1835906001 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604413214 0 0) 0x7f490015b730 con 0x7f49000cf010 2024-09-10T07:35:29.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.771+0000 7f48ffe00640 1 -- 172.21.15.99:0/1835906001 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f490015c4f0 con 0x7f49000cf010 2024-09-10T07:35:29.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.771+0000 7f4905600640 1 -- 172.21.15.99:0/1835906001 >> v1:172.21.15.187:6789/0 conn(0x7f49000cf010 legacy=0x7f4900162ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.771+0000 7f48ffe00640 1 -- 172.21.15.99:0/1835906001 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1366150826 0 0) 0x7f48e4003520 con 0x7f4900152210 2024-09-10T07:35:29.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.771+0000 7f4905600640 1 -- 172.21.15.99:0/1835906001 >> v1:172.21.15.99:6789/0 conn(0x7f4900152210 legacy=0x7f4900071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.771+0000 7f4905600640 1 -- 172.21.15.99:0/1835906001 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490015bcf0 con 0x7f49000cf4a0 2024-09-10T07:35:29.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.772+0000 7f4905600640 1 --2- 172.21.15.99:0/1835906001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49000cf4a0 0x7f49001662d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009d90 tx=0x7f48f802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af78f7711f991ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:29.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.772+0000 7f48ffe00640 1 -- 172.21.15.99:0/1835906001 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0001670 con 0x7f49000cf4a0 2024-09-10T07:35:29.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.772+0000 7f48ffe00640 1 -- 172.21.15.99:0/1835906001 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f8007540 con 0x7f49000cf4a0 2024-09-10T07:35:29.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.772+0000 7f48ffe00640 1 -- 172.21.15.99:0/1835906001 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f8007910 con 0x7f49000cf4a0 2024-09-10T07:35:29.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.773+0000 7f4907600640 1 -- 172.21.15.99:0/1835906001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49000cf4a0 msgr2=0x7f49001662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.773+0000 7f4907600640 1 --2- 172.21.15.99:0/1835906001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49000cf4a0 0x7f49001662d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009d90 tx=0x7f48f802a680 comp rx=0 tx=0).stop 2024-09-10T07:35:29.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.773+0000 7f4907600640 1 -- 172.21.15.99:0/1835906001 shutdown_connections 2024-09-10T07:35:29.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.773+0000 7f4907600640 1 --2- 172.21.15.99:0/1835906001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49000cf4a0 0x7f49001662d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.773+0000 7f4907600640 1 -- 172.21.15.99:0/1835906001 >> 172.21.15.99:0/1835906001 conn(0x7f490006bc10 msgr2=0x7f490006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:29.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.773+0000 7f4907600640 1 -- 172.21.15.99:0/1835906001 shutdown_connections 2024-09-10T07:35:29.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.773+0000 7f4907600640 1 -- 172.21.15.99:0/1835906001 wait complete. 2024-09-10T07:35:29.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.775+0000 7f4907600640 1 Processor -- start 2024-09-10T07:35:29.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.775+0000 7f4907600640 1 -- start start 2024-09-10T07:35:29.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f4907600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49000cf010 0x7f4900141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f4907600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49000cf4a0 0x7f49000ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f4907600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4900152210 0x7f49000cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f4907600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f49000cf8d0 con 0x7f49000cf4a0 2024-09-10T07:35:29.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f4907600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f490006f380 con 0x7f4900152210 2024-09-10T07:35:29.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f4907600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f49000725a0 con 0x7f49000cf010 2024-09-10T07:35:29.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f48f7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49000cf4a0 0x7f49000ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f48f7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49000cf4a0 0x7f49000ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33210/0 (socket says 172.21.15.99:33210) 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f48f7e00640 1 -- 172.21.15.99:0/249457592 learned_addr learned my addr 172.21.15.99:0/249457592 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f4904c00640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49000cf010 0x7f4900141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.776+0000 7f4905600640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4900152210 0x7f49000cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f48f7e00640 1 -- 172.21.15.99:0/249457592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49000cf010 msgr2=0x7f4900141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f48f7e00640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49000cf010 0x7f4900141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f48f7e00640 1 -- 172.21.15.99:0/249457592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4900152210 msgr2=0x7f49000cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f48f7e00640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4900152210 0x7f49000cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f48f7e00640 1 -- 172.21.15.99:0/249457592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49001416b0 con 0x7f49000cf4a0 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f4904c00640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49000cf010 0x7f4900141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f4905600640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4900152210 0x7f49000cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:29.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f48f7e00640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49000cf4a0 0x7f49000ca3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c4c0 tx=0x7f48e800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:29.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f48fd600640 1 -- 172.21.15.99:0/249457592 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e80052d0 con 0x7f49000cf4a0 2024-09-10T07:35:29.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f48fd600640 1 -- 172.21.15.99:0/249457592 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e8005470 con 0x7f49000cf4a0 2024-09-10T07:35:29.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f48fd600640 1 -- 172.21.15.99:0/249457592 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8012870 con 0x7f49000cf4a0 2024-09-10T07:35:29.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f4907600640 1 -- 172.21.15.99:0/249457592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49001533d0 con 0x7f49000cf4a0 2024-09-10T07:35:29.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.777+0000 7f4907600640 1 -- 172.21.15.99:0/249457592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4900153990 con 0x7f49000cf4a0 2024-09-10T07:35:29.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.778+0000 7f4907600640 1 -- 172.21.15.99:0/249457592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4900071e90 con 0x7f49000cf4a0 2024-09-10T07:35:29.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.779+0000 7f48fd600640 1 -- 172.21.15.99:0/249457592 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48e8012a10 con 0x7f49000cf4a0 2024-09-10T07:35:29.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.780+0000 7f48fd600640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 0x7f48dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:29.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.780+0000 7f48fd600640 1 -- 172.21.15.99:0/249457592 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f48e808a770 con 0x7f49000cf4a0 2024-09-10T07:35:29.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.780+0000 7f4904c00640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 0x7f48dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:29.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.781+0000 7f4904c00640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 0x7f48dc06e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48f00011e0 tx=0x7f48f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:29.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:29.784+0000 7f48fd600640 1 -- 172.21.15.99:0/249457592 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49001416b0 con 0x7f49000cf4a0 2024-09-10T07:35:30.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.021+0000 7f4907600640 1 -- 172.21.15.99:0/249457592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) -- 0x7f49000b5880 con 0x7f49000cf4a0 2024-09-10T07:35:30.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.863+0000 7f48fd600640 1 -- 172.21.15.99:0/249457592 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v82) ==== 145+0+0 (secure 0 0 0) 0x7f48e80594b0 con 0x7f49000cf4a0 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 -- 172.21.15.99:0/249457592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 msgr2=0x7f48dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 0x7f48dc06e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48f00011e0 tx=0x7f48f0009040 comp rx=0 tx=0).stop 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 -- 172.21.15.99:0/249457592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49000cf4a0 msgr2=0x7f49000ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49000cf4a0 0x7f49000ca3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c4c0 tx=0x7f48e800c980 comp rx=0 tx=0).stop 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 -- 172.21.15.99:0/249457592 shutdown_connections 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4900152210 0x7f49000cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f48dc06be60 0x7f48dc06e320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49000cf4a0 0x7f49000ca3c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 --2- 172.21.15.99:0/249457592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49000cf010 0x7f4900141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 -- 172.21.15.99:0/249457592 >> 172.21.15.99:0/249457592 conn(0x7f490006bc10 msgr2=0x7f4900072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:30.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 -- 172.21.15.99:0/249457592 shutdown_connections 2024-09-10T07:35:30.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:30.866+0000 7f4907600640 1 -- 172.21.15.99:0/249457592 wait complete. 2024-09-10T07:35:30.883 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-10T07:35:31.052 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_objectstore":"memstore"} 2024-09-10T07:35:31.052 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-10T07:35:31.052 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T07:35:31.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.208+0000 7fd82f000640 1 Processor -- start 2024-09-10T07:35:31.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.208+0000 7fd82f000640 1 -- start start 2024-09-10T07:35:31.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.209+0000 7fd82f000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd828143b40 0x7fd8280b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.209+0000 7fd82f000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd828072450 0x7fd82806da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.209+0000 7fd82f000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd828072ae0 con 0x7fd8280b3e70 2024-09-10T07:35:31.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.209+0000 7fd82f000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd8280b42e0 con 0x7fd828143b40 2024-09-10T07:35:31.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.209+0000 7fd82f000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd828072dc0 con 0x7fd828072450 2024-09-10T07:35:31.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.210+0000 7fd82dc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd828143b40 0x7fd8280b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.210+0000 7fd82e600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd828072450 0x7fd82806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.210+0000 7fd82dc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd828143b40 0x7fd8280b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:51746/0 (socket says 172.21.15.99:51746) 2024-09-10T07:35:31.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.210+0000 7fd82dc00640 1 -- 172.21.15.99:0/2304127685 learned_addr learned my addr 172.21.15.99:0/2304127685 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:31.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.210+0000 7fd82dc00640 1 -- 172.21.15.99:0/2304127685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd828072450 msgr2=0x7fd82806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:31.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.210+0000 7fd82dc00640 1 --2- 172.21.15.99:0/2304127685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd828072450 0x7fd82806da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.210+0000 7fd82dc00640 1 -- 172.21.15.99:0/2304127685 >> v1:172.21.15.187:6789/0 conn(0x7fd8280b3e70 legacy=0x7fd828071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.210+0000 7fd82dc00640 1 -- 172.21.15.99:0/2304127685 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8280730a0 con 0x7fd828143b40 2024-09-10T07:35:31.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.211+0000 7fd82dc00640 1 --2- 172.21.15.99:0/2304127685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd828143b40 0x7fd8280b3930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009870 tx=0x7fd81c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82297e7f5bbbdec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:31.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.212+0000 7fd827e00640 1 -- 172.21.15.99:0/2304127685 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c037070 con 0x7fd828143b40 2024-09-10T07:35:31.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.212+0000 7fd827e00640 1 -- 172.21.15.99:0/2304127685 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd81c032440 con 0x7fd828143b40 2024-09-10T07:35:31.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.212+0000 7fd827e00640 1 -- 172.21.15.99:0/2304127685 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c032810 con 0x7fd828143b40 2024-09-10T07:35:31.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.213+0000 7fd82f000640 1 -- 172.21.15.99:0/2304127685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd828143b40 msgr2=0x7fd8280b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.213+0000 7fd82f000640 1 --2- 172.21.15.99:0/2304127685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd828143b40 0x7fd8280b3930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009870 tx=0x7fd81c02a270 comp rx=0 tx=0).stop 2024-09-10T07:35:31.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.213+0000 7fd82f000640 1 -- 172.21.15.99:0/2304127685 shutdown_connections 2024-09-10T07:35:31.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.213+0000 7fd82f000640 1 --2- 172.21.15.99:0/2304127685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd828072450 0x7fd82806da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.213+0000 7fd82f000640 1 --2- 172.21.15.99:0/2304127685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd828143b40 0x7fd8280b3930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.213+0000 7fd82f000640 1 -- 172.21.15.99:0/2304127685 >> 172.21.15.99:0/2304127685 conn(0x7fd8280b2810 msgr2=0x7fd8280b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:31.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.213+0000 7fd82f000640 1 -- 172.21.15.99:0/2304127685 shutdown_connections 2024-09-10T07:35:31.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.213+0000 7fd82f000640 1 -- 172.21.15.99:0/2304127685 wait complete. 2024-09-10T07:35:31.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.214+0000 7fd82f000640 1 Processor -- start 2024-09-10T07:35:31.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.214+0000 7fd82f000640 1 -- start start 2024-09-10T07:35:31.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.215+0000 7fd82f000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd828072450 0x7fd8280b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.215+0000 7fd82f000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280b3e70 0x7fd82815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.215+0000 7fd82f000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd828143b40 0x7fd8280d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.215+0000 7fd82f000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd82806bd90 con 0x7fd828143b40 2024-09-10T07:35:31.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.215+0000 7fd82f000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd82806bc10 con 0x7fd8280b3e70 2024-09-10T07:35:31.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.215+0000 7fd82f000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd82806bf10 con 0x7fd828072450 2024-09-10T07:35:31.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82e600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd828143b40 0x7fd8280d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82e600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd828143b40 0x7fd8280d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35160/0 (socket says 172.21.15.99:35160) 2024-09-10T07:35:31.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82e600640 1 -- 172.21.15.99:0/3154312454 learned_addr learned my addr 172.21.15.99:0/3154312454 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82d200640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280b3e70 0x7fd82815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82dc00640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd828072450 0x7fd8280b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82e600640 1 -- 172.21.15.99:0/3154312454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd828072450 msgr2=0x7fd8280b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82e600640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd828072450 0x7fd8280b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82e600640 1 -- 172.21.15.99:0/3154312454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280b3e70 msgr2=0x7fd82815ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82e600640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280b3e70 0x7fd82815ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82e600640 1 -- 172.21.15.99:0/3154312454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82815a1b0 con 0x7fd828143b40 2024-09-10T07:35:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82d200640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280b3e70 0x7fd82815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd82e600640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd828143b40 0x7fd8280d0570 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd82000efc0 tx=0x7fd82000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.216+0000 7fd825600640 1 -- 172.21.15.99:0/3154312454 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820018020 con 0x7fd828143b40 2024-09-10T07:35:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.217+0000 7fd825600640 1 -- 172.21.15.99:0/3154312454 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd820014480 con 0x7fd828143b40 2024-09-10T07:35:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.217+0000 7fd82f000640 1 -- 172.21.15.99:0/3154312454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd828169830 con 0x7fd828143b40 2024-09-10T07:35:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.217+0000 7fd825600640 1 -- 172.21.15.99:0/3154312454 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820014870 con 0x7fd828143b40 2024-09-10T07:35:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.217+0000 7fd82f000640 1 -- 172.21.15.99:0/3154312454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82815a730 con 0x7fd828143b40 2024-09-10T07:35:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.218+0000 7fd82f000640 1 -- 172.21.15.99:0/3154312454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8280b3930 con 0x7fd828143b40 2024-09-10T07:35:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.219+0000 7fd825600640 1 -- 172.21.15.99:0/3154312454 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd820005d10 con 0x7fd828143b40 2024-09-10T07:35:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.220+0000 7fd825600640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80806be30 0x7fd80806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.220+0000 7fd825600640 1 -- 172.21.15.99:0/3154312454 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fd82008b710 con 0x7fd828143b40 2024-09-10T07:35:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.220+0000 7fd82dc00640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80806be30 0x7fd80806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.221+0000 7fd82dc00640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80806be30 0x7fd80806e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd81c034000 tx=0x7fd81c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:31.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.224+0000 7fd825600640 1 -- 172.21.15.99:0/3154312454 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd820022070 con 0x7fd828143b40 2024-09-10T07:35:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.395+0000 7fd82f000640 1 -- 172.21.15.99:0/3154312454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd82815d4c0 con 0x7fd828143b40 2024-09-10T07:35:31.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.399+0000 7fd825600640 1 -- 172.21.15.99:0/3154312454 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) ==== 122+0+0 (secure 0 0 0) 0x7fd820010040 con 0x7fd828143b40 2024-09-10T07:35:31.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.401+0000 7fd82f000640 1 -- 172.21.15.99:0/3154312454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80806be30 msgr2=0x7fd80806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.401+0000 7fd82f000640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80806be30 0x7fd80806e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd81c034000 tx=0x7fd81c02e000 comp rx=0 tx=0).stop 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.401+0000 7fd82f000640 1 -- 172.21.15.99:0/3154312454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd828143b40 msgr2=0x7fd8280d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.401+0000 7fd82f000640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd828143b40 0x7fd8280d0570 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd82000efc0 tx=0x7fd82000c490 comp rx=0 tx=0).stop 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.401+0000 7fd82f000640 1 -- 172.21.15.99:0/3154312454 shutdown_connections 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.401+0000 7fd82f000640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd80806be30 0x7fd80806e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.401+0000 7fd82f000640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd828143b40 0x7fd8280d0570 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.401+0000 7fd82f000640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280b3e70 0x7fd82815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.401+0000 7fd82f000640 1 --2- 172.21.15.99:0/3154312454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd828072450 0x7fd8280b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.401+0000 7fd82f000640 1 -- 172.21.15.99:0/3154312454 >> 172.21.15.99:0/3154312454 conn(0x7fd8280b2810 msgr2=0x7fd82806e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.402+0000 7fd82f000640 1 -- 172.21.15.99:0/3154312454 shutdown_connections 2024-09-10T07:35:31.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.402+0000 7fd82f000640 1 -- 172.21.15.99:0/3154312454 wait complete. 2024-09-10T07:35:31.420 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:35:31.421 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:35:31.513 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:35:31.617 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:35:31.617 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:31.617 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:31.653 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:35:31.654 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:35:31.654 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:31.691 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:35:31.691 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:31.691 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:31.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:35:31.729 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:35:31.729 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:31.767 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:35:31.767 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T07:35:31.767 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.924+0000 7f0561600640 1 Processor -- start 2024-09-10T07:35:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.924+0000 7f0561600640 1 -- start start 2024-09-10T07:35:31.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.925+0000 7f0561600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f055c145290 0x7f055c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.925+0000 7f0561600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c06e3d0 con 0x7f055c0ce780 2024-09-10T07:35:31.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.925+0000 7f0561600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c06e6b0 con 0x7f055c072f40 2024-09-10T07:35:31.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.925+0000 7f0561600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f055c06efe0 con 0x7f055c145290 2024-09-10T07:35:31.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.925+0000 7f0552000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f055c0ce780 0x7f055c072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54388/0 (socket says 172.21.15.99:54388) 2024-09-10T07:35:31.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.925+0000 7f0552000640 1 -- 172.21.15.99:0/1972885076 learned_addr learned my addr 172.21.15.99:0/1972885076 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.925+0000 7f055aa00640 1 --2- 172.21.15.99:0/1972885076 >> v2:172.21.15.187:3300/0 conn(0x7f055c145290 0x7f055c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.926+0000 7f055a000640 1 -- 172.21.15.99:0/1972885076 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747759210 0 0) 0x7f055c06e3d0 con 0x7f055c0ce780 2024-09-10T07:35:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.926+0000 7f055a000640 1 -- 172.21.15.99:0/1972885076 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0540003520 con 0x7f055c0ce780 2024-09-10T07:35:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.926+0000 7f055aa00640 1 -- 172.21.15.99:0/1972885076 >> v1:172.21.15.187:6789/0 conn(0x7f055c072f40 legacy=0x7f055c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.926+0000 7f055a000640 1 -- 172.21.15.99:0/1972885076 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 417053388 0 0) 0x7f055c06e6b0 con 0x7f055c072f40 2024-09-10T07:35:31.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.926+0000 7f055aa00640 1 -- 172.21.15.99:0/1972885076 >> v1:172.21.15.99:6789/0 conn(0x7f055c0ce780 legacy=0x7f055c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.926+0000 7f055aa00640 1 -- 172.21.15.99:0/1972885076 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c06e990 con 0x7f055c145290 2024-09-10T07:35:31.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.927+0000 7f055aa00640 1 --2- 172.21.15.99:0/1972885076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c145290 0x7f055c06f470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f054c0097a0 tx=0x7f054c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67e55548e2f0b4eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:31.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.927+0000 7f055a000640 1 -- 172.21.15.99:0/1972885076 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c037070 con 0x7f055c145290 2024-09-10T07:35:31.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.927+0000 7f055a000640 1 -- 172.21.15.99:0/1972885076 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054c032440 con 0x7f055c145290 2024-09-10T07:35:31.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.927+0000 7f055a000640 1 -- 172.21.15.99:0/1972885076 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c0327f0 con 0x7f055c145290 2024-09-10T07:35:31.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.928+0000 7f0561600640 1 -- 172.21.15.99:0/1972885076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c145290 msgr2=0x7f055c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.928+0000 7f0561600640 1 --2- 172.21.15.99:0/1972885076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c145290 0x7f055c06f470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f054c0097a0 tx=0x7f054c02a230 comp rx=0 tx=0).stop 2024-09-10T07:35:31.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.928+0000 7f0561600640 1 -- 172.21.15.99:0/1972885076 shutdown_connections 2024-09-10T07:35:31.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.928+0000 7f0561600640 1 --2- 172.21.15.99:0/1972885076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c145290 0x7f055c06f470 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.928+0000 7f0561600640 1 -- 172.21.15.99:0/1972885076 >> 172.21.15.99:0/1972885076 conn(0x7f055c06bc10 msgr2=0x7f055c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:31.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.928+0000 7f0561600640 1 -- 172.21.15.99:0/1972885076 shutdown_connections 2024-09-10T07:35:31.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.928+0000 7f0561600640 1 -- 172.21.15.99:0/1972885076 wait complete. 2024-09-10T07:35:31.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.930+0000 7f0561600640 1 Processor -- start 2024-09-10T07:35:31.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.930+0000 7f0561600640 1 -- start start 2024-09-10T07:35:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.930+0000 7f0561600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f055c072f40 0x7f055c13fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.930+0000 7f0561600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0ce780 0x7f055c15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.930+0000 7f0561600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c145290 0x7f055c15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.930+0000 7f0561600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f055c06df80 con 0x7f055c072f40 2024-09-10T07:35:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.930+0000 7f0561600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f055c145670 con 0x7f055c145290 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.930+0000 7f0561600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f055c06e100 con 0x7f055c0ce780 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.931+0000 7f055aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f055c072f40 0x7f055c13fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.931+0000 7f055aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f055c072f40 0x7f055c13fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35170/0 (socket says 172.21.15.99:35170) 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.931+0000 7f055aa00640 1 -- 172.21.15.99:0/2133615145 learned_addr learned my addr 172.21.15.99:0/2133615145 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.931+0000 7f0552000640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0ce780 0x7f055c15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.931+0000 7f055b400640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c145290 0x7f055c15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.931+0000 7f055aa00640 1 -- 172.21.15.99:0/2133615145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0ce780 msgr2=0x7f055c15ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.931+0000 7f055aa00640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0ce780 0x7f055c15ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.931+0000 7f055aa00640 1 -- 172.21.15.99:0/2133615145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c145290 msgr2=0x7f055c15b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.931+0000 7f055aa00640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c145290 0x7f055c15b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.931+0000 7f055aa00640 1 -- 172.21.15.99:0/2133615145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c1e0ec0 con 0x7f055c072f40 2024-09-10T07:35:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.932+0000 7f055aa00640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f055c072f40 0x7f055c13fc10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f054c02a270 tx=0x7f054c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:31.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.932+0000 7f0553400640 1 -- 172.21.15.99:0/2133615145 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c041070 con 0x7f055c072f40 2024-09-10T07:35:31.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.932+0000 7f0553400640 1 -- 172.21.15.99:0/2133615145 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054c03c870 con 0x7f055c072f40 2024-09-10T07:35:31.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.932+0000 7f0553400640 1 -- 172.21.15.99:0/2133615145 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c037040 con 0x7f055c072f40 2024-09-10T07:35:31.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.932+0000 7f0561600640 1 -- 172.21.15.99:0/2133615145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055c1e11a0 con 0x7f055c072f40 2024-09-10T07:35:31.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.932+0000 7f0561600640 1 -- 172.21.15.99:0/2133615145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055c13f6f0 con 0x7f055c072f40 2024-09-10T07:35:31.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.933+0000 7f0561600640 1 -- 172.21.15.99:0/2133615145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f055c071510 con 0x7f055c072f40 2024-09-10T07:35:31.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.934+0000 7f0553400640 1 -- 172.21.15.99:0/2133615145 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f054c044070 con 0x7f055c072f40 2024-09-10T07:35:31.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.935+0000 7f0553400640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f053806be30 0x7f053806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:31.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.935+0000 7f0553400640 1 -- 172.21.15.99:0/2133615145 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f054c0ab580 con 0x7f055c072f40 2024-09-10T07:35:31.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.935+0000 7f0552000640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f053806be30 0x7f053806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:31.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.936+0000 7f0552000640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f053806be30 0x7f053806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f055c140590 tx=0x7f0544009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:31.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:31.939+0000 7f0553400640 1 -- 172.21.15.99:0/2133615145 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f054c079c60 con 0x7f055c072f40 2024-09-10T07:35:32.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.146+0000 7f0561600640 1 -- 172.21.15.99:0/2133615145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f055c140150 con 0x7f055c072f40 2024-09-10T07:35:32.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.147+0000 7f0553400640 1 -- 172.21.15.99:0/2133615145 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3917 (secure 0 0 0) 0x7f054c07df60 con 0x7f055c072f40 2024-09-10T07:35:32.147 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:32.147 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":18,"btime":"2024-09-10T07:35:25:841185+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3299804861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3299804861},{"type":"v1","addr":"172.21.15.187:6834","nonce":3299804861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4723,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/4173112208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4173112208},{"type":"v1","addr":"172.21.15.187:6835","nonce":4173112208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4740,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2963379591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2963379591},{"type":"v1","addr":"172.21.15.99:6835","nonce":2963379591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1300889296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1300889296},{"type":"v1","addr":"172.21.15.99:6837","nonce":1300889296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-09-10T07:35:32.147 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 18 2024-09-10T07:35:32.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 -- 172.21.15.99:0/2133615145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f053806be30 msgr2=0x7f053806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:32.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f053806be30 0x7f053806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f055c140590 tx=0x7f0544009040 comp rx=0 tx=0).stop 2024-09-10T07:35:32.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 -- 172.21.15.99:0/2133615145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f055c072f40 msgr2=0x7f055c13fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:32.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f055c072f40 0x7f055c13fc10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f054c02a270 tx=0x7f054c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 -- 172.21.15.99:0/2133615145 shutdown_connections 2024-09-10T07:35:32.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c145290 0x7f055c15b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0ce780 0x7f055c15ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f053806be30 0x7f053806e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 --2- 172.21.15.99:0/2133615145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f055c072f40 0x7f055c13fc10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 -- 172.21.15.99:0/2133615145 >> 172.21.15.99:0/2133615145 conn(0x7f055c06bc10 msgr2=0x7f055c0b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:32.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 -- 172.21.15.99:0/2133615145 shutdown_connections 2024-09-10T07:35:32.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.149+0000 7f0561600640 1 -- 172.21.15.99:0/2133615145 wait complete. 2024-09-10T07:35:32.165 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:35:32.165 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T07:35:32.165 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:35:32.166 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:35:32.166 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:35:32.166 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T07:35:32.166 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:35:32.166 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:35:32.166 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:35:32.166 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T07:35:32.167 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:35:32.167 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:35:32.167 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:35:32.167 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T07:35:32.167 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:35:32.167 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:35:32.183 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:35:32.183 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:35:32.184 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:35:32.184 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:35:32.185 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:35:32.185 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:35:32.186 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:35:32.186 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:35:32.228 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:35:32.228 DEBUG:teuthology.parallel:result is None 2024-09-10T07:35:32.230 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:35:32.230 DEBUG:teuthology.parallel:result is None 2024-09-10T07:35:32.231 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:35:32.231 DEBUG:teuthology.parallel:result is None 2024-09-10T07:35:32.233 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:35:32.234 DEBUG:teuthology.parallel:result is None 2024-09-10T07:35:32.234 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T07:35:32.360 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:35:32.361 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:35:32.361 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:35:32.361 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:35:32.362 INFO:tasks.ceph.mds.a.smithi099.stderr:2024-09-10T07:35:32.362+0000 7f64c5000640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-10T07:35:32.362 INFO:tasks.ceph.mds.d.smithi187.stderr:2024-09-10T07:35:32.363+0000 7f52ad200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-10T07:35:32.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.396+0000 7f307e000640 1 Processor -- start 2024-09-10T07:35:32.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.396+0000 7f307e000640 1 -- start start 2024-09-10T07:35:32.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.397+0000 7f307e000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f30780d5790 0x7f30780d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:32.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.397+0000 7f307e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30780d1630 0x7f30780d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:32.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.397+0000 7f307e000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30780d3cc0 con 0x7f307815eda0 2024-09-10T07:35:32.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.397+0000 7f307e000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f30780d5c00 con 0x7f30780d5790 2024-09-10T07:35:32.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.397+0000 7f307e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f30780d09c0 con 0x7f30780d1630 2024-09-10T07:35:32.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.398+0000 7f306fe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f30780d5790 0x7f30780d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:32.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.398+0000 7f3077e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30780d1630 0x7f30780d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:32.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.398+0000 7f306fe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f30780d5790 0x7f30780d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:51840/0 (socket says 172.21.15.99:51840) 2024-09-10T07:35:32.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.398+0000 7f306fe00640 1 -- 172.21.15.99:0/1875412334 learned_addr learned my addr 172.21.15.99:0/1875412334 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:32.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.398+0000 7f3077400640 1 --1- 172.21.15.99:0/1875412334 >> v1:172.21.15.187:6789/0 conn(0x7f307815eda0 0x7f30780d35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:43054/0 (socket says 172.21.15.99:43054) 2024-09-10T07:35:32.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.398+0000 7f3077e00640 1 -- 172.21.15.99:0/1875412334 >> v2:172.21.15.187:3300/0 conn(0x7f30780d5790 msgr2=0x7f30780d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:32.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.398+0000 7f3077e00640 1 --2- 172.21.15.99:0/1875412334 >> v2:172.21.15.187:3300/0 conn(0x7f30780d5790 0x7f30780d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.399+0000 7f3077e00640 1 -- 172.21.15.99:0/1875412334 >> v1:172.21.15.187:6789/0 conn(0x7f307815eda0 legacy=0x7f30780d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:32.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.399+0000 7f3077e00640 1 -- 172.21.15.99:0/1875412334 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30780d0bf0 con 0x7f30780d1630 2024-09-10T07:35:32.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.400+0000 7f3077e00640 1 --2- 172.21.15.99:0/1875412334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30780d1630 0x7f30780d1ac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3070009d90 tx=0x7f307002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87c52599213e4ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:32.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.400+0000 7f3076a00640 1 -- 172.21.15.99:0/1875412334 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070007740 con 0x7f30780d1630 2024-09-10T07:35:32.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.400+0000 7f3076a00640 1 -- 172.21.15.99:0/1875412334 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30700078e0 con 0x7f30780d1630 2024-09-10T07:35:32.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.400+0000 7f3076a00640 1 -- 172.21.15.99:0/1875412334 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070007cb0 con 0x7f30780d1630 2024-09-10T07:35:32.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.400+0000 7f307e000640 1 -- 172.21.15.99:0/1875412334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30780d1630 msgr2=0x7f30780d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:32.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.400+0000 7f307e000640 1 --2- 172.21.15.99:0/1875412334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30780d1630 0x7f30780d1ac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3070009d90 tx=0x7f307002a660 comp rx=0 tx=0).stop 2024-09-10T07:35:32.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.400+0000 7f307e000640 1 -- 172.21.15.99:0/1875412334 shutdown_connections 2024-09-10T07:35:32.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.400+0000 7f307e000640 1 --2- 172.21.15.99:0/1875412334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30780d1630 0x7f30780d1ac0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.400+0000 7f307e000640 1 --2- 172.21.15.99:0/1875412334 >> v2:172.21.15.187:3300/0 conn(0x7f30780d5790 0x7f30780d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.400+0000 7f307e000640 1 -- 172.21.15.99:0/1875412334 >> 172.21.15.99:0/1875412334 conn(0x7f307809df40 msgr2=0x7f30780d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:32.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.401+0000 7f307e000640 1 -- 172.21.15.99:0/1875412334 shutdown_connections 2024-09-10T07:35:32.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.401+0000 7f307e000640 1 -- 172.21.15.99:0/1875412334 wait complete. 2024-09-10T07:35:32.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.402+0000 7f307e000640 1 Processor -- start 2024-09-10T07:35:32.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.402+0000 7f307e000640 1 -- start start 2024-09-10T07:35:32.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f307e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30780d1630 0x7f30780ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:32.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f307e000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30780d5790 0x7f3078159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:32.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f307e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307815eda0 0x7f3078157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:32.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f307e000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f30780d3120 con 0x7f30780d1630 2024-09-10T07:35:32.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f307e000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f30780d2880 con 0x7f30780d5790 2024-09-10T07:35:32.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f307e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f30780d2db0 con 0x7f307815eda0 2024-09-10T07:35:32.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f3077400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30780d1630 0x7f30780ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:32.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f3077400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30780d1630 0x7f30780ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35194/0 (socket says 172.21.15.99:35194) 2024-09-10T07:35:32.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f306fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30780d5790 0x7f3078159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:32.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f3077400640 1 -- 172.21.15.99:0/3846732542 learned_addr learned my addr 172.21.15.99:0/3846732542 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:32.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.403+0000 7f3077e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307815eda0 0x7f3078157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:32.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.404+0000 7f3077400640 1 -- 172.21.15.99:0/3846732542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307815eda0 msgr2=0x7f3078157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:32.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.404+0000 7f3077400640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307815eda0 0x7f3078157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.404+0000 7f3077400640 1 -- 172.21.15.99:0/3846732542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30780d5790 msgr2=0x7f3078159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:32.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.404+0000 7f3077400640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30780d5790 0x7f3078159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.404+0000 7f3077400640 1 -- 172.21.15.99:0/3846732542 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30781577b0 con 0x7f30780d1630 2024-09-10T07:35:32.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.404+0000 7f3077e00640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307815eda0 0x7f3078157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:32.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.404+0000 7f3077400640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30780d1630 0x7f30780ccc50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f306800c3c0 tx=0x7f306800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:32.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.404+0000 7f306f400640 1 -- 172.21.15.99:0/3846732542 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30680074e0 con 0x7f30780d1630 2024-09-10T07:35:32.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.405+0000 7f306f400640 1 -- 172.21.15.99:0/3846732542 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3068007680 con 0x7f30780d1630 2024-09-10T07:35:32.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.405+0000 7f306f400640 1 -- 172.21.15.99:0/3846732542 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068004a00 con 0x7f30780d1630 2024-09-10T07:35:32.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.405+0000 7f307e000640 1 -- 172.21.15.99:0/3846732542 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30780cd230 con 0x7f30780d1630 2024-09-10T07:35:32.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.405+0000 7f307e000640 1 -- 172.21.15.99:0/3846732542 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30780cd7f0 con 0x7f30780d1630 2024-09-10T07:35:32.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.406+0000 7f307e000640 1 -- 172.21.15.99:0/3846732542 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307815f180 con 0x7f30780d1630 2024-09-10T07:35:32.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.407+0000 7f306f400640 1 -- 172.21.15.99:0/3846732542 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f306801a020 con 0x7f30780d1630 2024-09-10T07:35:32.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.408+0000 7f306f400640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305406be30 0x7f305406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:32.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.408+0000 7f306f400640 1 -- 172.21.15.99:0/3846732542 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f306808a120 con 0x7f30780d1630 2024-09-10T07:35:32.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.408+0000 7f306fe00640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305406be30 0x7f305406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:32.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.408+0000 7f306fe00640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305406be30 0x7f305406e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3060009bd0 tx=0x7f3060009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:32.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.411+0000 7f306f400640 1 -- 172.21.15.99:0/3846732542 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30781577b0 con 0x7f30780d1630 2024-09-10T07:35:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.595+0000 7f307e000640 1 -- 172.21.15.99:0/3846732542 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f30780b7ae0 con 0x7f30780d1630 2024-09-10T07:35:32.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.876+0000 7f306f400640 1 -- 172.21.15.99:0/3846732542 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) ==== 97+0+0 (secure 0 0 0) 0x7f30680587f0 con 0x7f30780d1630 2024-09-10T07:35:32.876 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.879+0000 7f307e000640 1 -- 172.21.15.99:0/3846732542 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305406be30 msgr2=0x7f305406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.879+0000 7f307e000640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305406be30 0x7f305406e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3060009bd0 tx=0x7f3060009240 comp rx=0 tx=0).stop 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.879+0000 7f307e000640 1 -- 172.21.15.99:0/3846732542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30780d1630 msgr2=0x7f30780ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.879+0000 7f307e000640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30780d1630 0x7f30780ccc50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f306800c3c0 tx=0x7f306800c880 comp rx=0 tx=0).stop 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.879+0000 7f307e000640 1 -- 172.21.15.99:0/3846732542 shutdown_connections 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.879+0000 7f307e000640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307815eda0 0x7f3078157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.879+0000 7f307e000640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30780d5790 0x7f3078159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.879+0000 7f307e000640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305406be30 0x7f305406e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.879+0000 7f307e000640 1 --2- 172.21.15.99:0/3846732542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30780d1630 0x7f30780ccc50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.879+0000 7f307e000640 1 -- 172.21.15.99:0/3846732542 >> 172.21.15.99:0/3846732542 conn(0x7f307809df40 msgr2=0x7f30780d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:32.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.880+0000 7f307e000640 1 -- 172.21.15.99:0/3846732542 shutdown_connections 2024-09-10T07:35:32.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:32.880+0000 7f307e000640 1 -- 172.21.15.99:0/3846732542 wait complete. 2024-09-10T07:35:32.897 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T07:35:33.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.050+0000 7f1544e00640 1 Processor -- start 2024-09-10T07:35:33.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.050+0000 7f1544e00640 1 -- start start 2024-09-10T07:35:33.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.051+0000 7f1544e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f154015e970 0x7f15400d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.051+0000 7f1544e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f15400d2680 0x7f15400cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.051+0000 7f1544e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15400d2bd0 con 0x7f15400cfac0 2024-09-10T07:35:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.051+0000 7f1544e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f15400d37e0 con 0x7f154015e970 2024-09-10T07:35:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.051+0000 7f1544e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f15400d2eb0 con 0x7f15400d2680 2024-09-10T07:35:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.051+0000 7f153f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f154015e970 0x7f15400d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.051+0000 7f153f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f154015e970 0x7f15400d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35202/0 (socket says 172.21.15.99:35202) 2024-09-10T07:35:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.052+0000 7f153f400640 1 -- 172.21.15.99:0/2241472216 learned_addr learned my addr 172.21.15.99:0/2241472216 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.052+0000 7f153ea00640 1 --2- 172.21.15.99:0/2241472216 >> v2:172.21.15.187:3300/0 conn(0x7f15400d2680 0x7f15400cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.052+0000 7f153f400640 1 -- 172.21.15.99:0/2241472216 >> v2:172.21.15.187:3300/0 conn(0x7f15400d2680 msgr2=0x7f15400cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.052+0000 7f153f400640 1 --2- 172.21.15.99:0/2241472216 >> v2:172.21.15.187:3300/0 conn(0x7f15400d2680 0x7f15400cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.052+0000 7f153f400640 1 -- 172.21.15.99:0/2241472216 >> v1:172.21.15.187:6789/0 conn(0x7f15400cfac0 legacy=0x7f15400d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.052+0000 7f153f400640 1 -- 172.21.15.99:0/2241472216 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15400d3190 con 0x7f154015e970 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.053+0000 7f153f400640 1 --2- 172.21.15.99:0/2241472216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f154015e970 0x7f15400d0300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f154009e530 tx=0x7f153002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed06a0d7e83ccbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.053+0000 7f153e000640 1 -- 172.21.15.99:0/2241472216 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530037070 con 0x7f154015e970 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.053+0000 7f153e000640 1 -- 172.21.15.99:0/2241472216 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1530032440 con 0x7f154015e970 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.053+0000 7f153e000640 1 -- 172.21.15.99:0/2241472216 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530032810 con 0x7f154015e970 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.054+0000 7f1544e00640 1 -- 172.21.15.99:0/2241472216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f154015e970 msgr2=0x7f15400d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.054+0000 7f1544e00640 1 --2- 172.21.15.99:0/2241472216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f154015e970 0x7f15400d0300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f154009e530 tx=0x7f153002a2c0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.054+0000 7f1544e00640 1 -- 172.21.15.99:0/2241472216 shutdown_connections 2024-09-10T07:35:33.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.054+0000 7f1544e00640 1 --2- 172.21.15.99:0/2241472216 >> v2:172.21.15.187:3300/0 conn(0x7f15400d2680 0x7f15400cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.054+0000 7f1544e00640 1 --2- 172.21.15.99:0/2241472216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f154015e970 0x7f15400d0300 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.054+0000 7f1544e00640 1 -- 172.21.15.99:0/2241472216 >> 172.21.15.99:0/2241472216 conn(0x7f154009de00 msgr2=0x7f15400d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:33.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.054+0000 7f1544e00640 1 -- 172.21.15.99:0/2241472216 shutdown_connections 2024-09-10T07:35:33.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.054+0000 7f1544e00640 1 -- 172.21.15.99:0/2241472216 wait complete. 2024-09-10T07:35:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.055+0000 7f1544e00640 1 Processor -- start 2024-09-10T07:35:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.056+0000 7f1544e00640 1 -- start start 2024-09-10T07:35:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.056+0000 7f1544e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15400cfac0 0x7f15401548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.056+0000 7f1544e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15400d2680 0x7f1540158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.056+0000 7f1544e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f154015e970 0x7f15401600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.056+0000 7f1544e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f15400d0840 con 0x7f15400cfac0 2024-09-10T07:35:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.056+0000 7f1544e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f15400cff10 con 0x7f154015e970 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.056+0000 7f1544e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f154015ed50 con 0x7f15400d2680 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.057+0000 7f153f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15400cfac0 0x7f15401548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.057+0000 7f153f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15400cfac0 0x7f15401548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35212/0 (socket says 172.21.15.99:35212) 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.057+0000 7f153f400640 1 -- 172.21.15.99:0/919688178 learned_addr learned my addr 172.21.15.99:0/919688178 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.057+0000 7f153f400640 1 -- 172.21.15.99:0/919688178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15400d2680 msgr2=0x7f1540158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.057+0000 7f153f400640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15400d2680 0x7f1540158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.057+0000 7f153f400640 1 -- 172.21.15.99:0/919688178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f154015e970 msgr2=0x7f15401600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.057+0000 7f153f400640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f154015e970 0x7f15401600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.057+0000 7f153f400640 1 -- 172.21.15.99:0/919688178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15401f9af0 con 0x7f15400cfac0 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.057+0000 7f153f400640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15400cfac0 0x7f15401548d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1530000c00 tx=0x7f15300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.058+0000 7f1537400640 1 -- 172.21.15.99:0/919688178 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530041020 con 0x7f15400cfac0 2024-09-10T07:35:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.058+0000 7f1537400640 1 -- 172.21.15.99:0/919688178 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15300307a0 con 0x7f15400cfac0 2024-09-10T07:35:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.058+0000 7f1537400640 1 -- 172.21.15.99:0/919688178 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530037040 con 0x7f15400cfac0 2024-09-10T07:35:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.058+0000 7f1544e00640 1 -- 172.21.15.99:0/919688178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1540158e70 con 0x7f15400cfac0 2024-09-10T07:35:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.058+0000 7f1544e00640 1 -- 172.21.15.99:0/919688178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15401f9250 con 0x7f15400cfac0 2024-09-10T07:35:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.059+0000 7f1544e00640 1 -- 172.21.15.99:0/919688178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15400cf580 con 0x7f15400cfac0 2024-09-10T07:35:33.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.060+0000 7f1537400640 1 -- 172.21.15.99:0/919688178 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1530044020 con 0x7f15400cfac0 2024-09-10T07:35:33.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.061+0000 7f1537400640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f152006be60 0x7f152006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.061+0000 7f1537400640 1 -- 172.21.15.99:0/919688178 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f15300ab2e0 con 0x7f15400cfac0 2024-09-10T07:35:33.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.061+0000 7f153ea00640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f152006be60 0x7f152006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.062+0000 7f153ea00640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f152006be60 0x7f152006e320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f152c0098f0 tx=0x7f152c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:33.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.065+0000 7f1537400640 1 -- 172.21.15.99:0/919688178 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f153004b030 con 0x7f15400cfac0 2024-09-10T07:35:33.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.299+0000 7f1544e00640 1 -- 172.21.15.99:0/919688178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f15400d17d0 con 0x7f15400cfac0 2024-09-10T07:35:33.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.299+0000 7f1537400640 1 -- 172.21.15.99:0/919688178 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f1530079fd0 con 0x7f15400cfac0 2024-09-10T07:35:33.299 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:33.299 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw==", 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ==", 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw==", 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-09-10T07:35:33.302 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw==", 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA==", 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.303 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A==", 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:33.304 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.305 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-09-10T07:35:33.305 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w==", 2024-09-10T07:35:33.305 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.305 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:33.305 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:33.305 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA==", 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.306 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w==", 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw==", 2024-09-10T07:35:33.307 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw==", 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:33.308 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg==", 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg==", 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow r", 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.310 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ==", 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A==", 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.311 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw==", 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:35:33.312 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBc9t9m2Fs5JBAAQfJNCUhmbHevYDJWsG/oAg==", 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:35:33.313 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q==", 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:33.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.315 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-09-10T07:35:33.315 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw==", 2024-09-10T07:35:33.315 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:35:33.315 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:35:33.315 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:35:33.315 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:35:33.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.315 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:33.315 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:35:33.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.301+0000 7f1544e00640 1 -- 172.21.15.99:0/919688178 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f152006be60 msgr2=0x7f152006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.301+0000 7f1544e00640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f152006be60 0x7f152006e320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f152c0098f0 tx=0x7f152c008040 comp rx=0 tx=0).stop 2024-09-10T07:35:33.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.301+0000 7f1544e00640 1 -- 172.21.15.99:0/919688178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15400cfac0 msgr2=0x7f15401548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.301+0000 7f1544e00640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15400cfac0 0x7f15401548d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1530000c00 tx=0x7f15300046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.301+0000 7f1544e00640 1 -- 172.21.15.99:0/919688178 shutdown_connections 2024-09-10T07:35:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.301+0000 7f1544e00640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f154015e970 0x7f15401600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.302+0000 7f1544e00640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15400d2680 0x7f1540158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.302+0000 7f1544e00640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f152006be60 0x7f152006e320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.302+0000 7f1544e00640 1 --2- 172.21.15.99:0/919688178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15400cfac0 0x7f15401548d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.302+0000 7f1544e00640 1 -- 172.21.15.99:0/919688178 >> 172.21.15.99:0/919688178 conn(0x7f154009de00 msgr2=0x7f15400ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.302+0000 7f1544e00640 1 -- 172.21.15.99:0/919688178 shutdown_connections 2024-09-10T07:35:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.302+0000 7f1544e00640 1 -- 172.21.15.99:0/919688178 wait complete. 2024-09-10T07:35:33.319 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:35:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.471+0000 7f5121200640 1 Processor -- start 2024-09-10T07:35:33.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.471+0000 7f5121200640 1 -- start start 2024-09-10T07:35:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.473+0000 7f5121200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f511c072f40 0x7f511c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.473+0000 7f5121200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c06e3d0 con 0x7f511c0ce780 2024-09-10T07:35:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.473+0000 7f5121200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c06e6b0 con 0x7f511c145290 2024-09-10T07:35:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.473+0000 7f5121200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f511c06efe0 con 0x7f511c072f40 2024-09-10T07:35:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.473+0000 7f511a800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f511c0ce780 0x7f511c0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54414/0 (socket says 172.21.15.99:54414) 2024-09-10T07:35:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.473+0000 7f511a800640 1 -- 172.21.15.99:0/4224833145 learned_addr learned my addr 172.21.15.99:0/4224833145 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:33.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.473+0000 7f5111400640 1 --2- 172.21.15.99:0/4224833145 >> v2:172.21.15.187:3300/0 conn(0x7f511c072f40 0x7f511c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.473+0000 7f5119400640 1 -- 172.21.15.99:0/4224833145 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554211130 0 0) 0x7f511c06e3d0 con 0x7f511c0ce780 2024-09-10T07:35:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.473+0000 7f5119400640 1 -- 172.21.15.99:0/4224833145 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5100003520 con 0x7f511c0ce780 2024-09-10T07:35:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.474+0000 7f5111400640 1 -- 172.21.15.99:0/4224833145 >> v1:172.21.15.187:6789/0 conn(0x7f511c145290 legacy=0x7f511c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.474+0000 7f5119400640 1 -- 172.21.15.99:0/4224833145 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2271558166 0 0) 0x7f5100003520 con 0x7f511c0ce780 2024-09-10T07:35:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.474+0000 7f5111400640 1 -- 172.21.15.99:0/4224833145 >> v1:172.21.15.99:6789/0 conn(0x7f511c0ce780 legacy=0x7f511c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.474+0000 7f5111400640 1 -- 172.21.15.99:0/4224833145 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c06e990 con 0x7f511c072f40 2024-09-10T07:35:33.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.475+0000 7f5111400640 1 --2- 172.21.15.99:0/4224833145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f511c072f40 0x7f511c06f470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f51040097a0 tx=0x7f510402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9177b4e54e2e1b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.475+0000 7f5119400640 1 -- 172.21.15.99:0/4224833145 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104037070 con 0x7f511c072f40 2024-09-10T07:35:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.475+0000 7f5119400640 1 -- 172.21.15.99:0/4224833145 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510402ac50 con 0x7f511c072f40 2024-09-10T07:35:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.475+0000 7f5119400640 1 -- 172.21.15.99:0/4224833145 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51140019f0 con 0x7f511c072f40 2024-09-10T07:35:33.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.476+0000 7f5121200640 1 -- 172.21.15.99:0/4224833145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f511c072f40 msgr2=0x7f511c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.476+0000 7f5121200640 1 --2- 172.21.15.99:0/4224833145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f511c072f40 0x7f511c06f470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f51040097a0 tx=0x7f510402a1c0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.476+0000 7f5121200640 1 -- 172.21.15.99:0/4224833145 shutdown_connections 2024-09-10T07:35:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.476+0000 7f5121200640 1 --2- 172.21.15.99:0/4224833145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f511c072f40 0x7f511c06f470 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.476+0000 7f5121200640 1 -- 172.21.15.99:0/4224833145 >> 172.21.15.99:0/4224833145 conn(0x7f511c06bc10 msgr2=0x7f511c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.476+0000 7f5121200640 1 -- 172.21.15.99:0/4224833145 shutdown_connections 2024-09-10T07:35:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.476+0000 7f5121200640 1 -- 172.21.15.99:0/4224833145 wait complete. 2024-09-10T07:35:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.477+0000 7f5121200640 1 Processor -- start 2024-09-10T07:35:33.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.478+0000 7f5121200640 1 -- start start 2024-09-10T07:35:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.478+0000 7f5121200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f511c072f40 0x7f511c13d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.478+0000 7f5121200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0ce780 0x7f511c144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.478+0000 7f5121200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f511c145290 0x7f511c1446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.478+0000 7f5121200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f511c06df80 con 0x7f511c0ce780 2024-09-10T07:35:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.478+0000 7f5121200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f511c145670 con 0x7f511c145290 2024-09-10T07:35:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.478+0000 7f5121200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f511c06e100 con 0x7f511c072f40 2024-09-10T07:35:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5111400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0ce780 0x7f511c144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5111400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0ce780 0x7f511c144170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35214/0 (socket says 172.21.15.99:35214) 2024-09-10T07:35:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5111400640 1 -- 172.21.15.99:0/936994348 learned_addr learned my addr 172.21.15.99:0/936994348 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:33.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5119e00640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f511c072f40 0x7f511c13d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f511a800640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f511c145290 0x7f511c1446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5111400640 1 -- 172.21.15.99:0/936994348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f511c072f40 msgr2=0x7f511c13d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5111400640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f511c072f40 0x7f511c13d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5111400640 1 -- 172.21.15.99:0/936994348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f511c145290 msgr2=0x7f511c1446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5111400640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f511c145290 0x7f511c1446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5111400640 1 -- 172.21.15.99:0/936994348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c13e6a0 con 0x7f511c0ce780 2024-09-10T07:35:33.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5119e00640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f511c072f40 0x7f511c13d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:33.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f511a800640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f511c145290 0x7f511c1446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:33.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5111400640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0ce780 0x7f511c144170 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5104035040 tx=0x7f51040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:33.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.479+0000 7f5112a00640 1 -- 172.21.15.99:0/936994348 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104042020 con 0x7f511c0ce780 2024-09-10T07:35:33.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.480+0000 7f5112a00640 1 -- 172.21.15.99:0/936994348 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510403d470 con 0x7f511c0ce780 2024-09-10T07:35:33.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.480+0000 7f5112a00640 1 -- 172.21.15.99:0/936994348 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104037040 con 0x7f511c0ce780 2024-09-10T07:35:33.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.480+0000 7f5121200640 1 -- 172.21.15.99:0/936994348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511c13f3a0 con 0x7f511c0ce780 2024-09-10T07:35:33.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.480+0000 7f5121200640 1 -- 172.21.15.99:0/936994348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f511c153b70 con 0x7f511c0ce780 2024-09-10T07:35:33.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.481+0000 7f5121200640 1 -- 172.21.15.99:0/936994348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511c071510 con 0x7f511c0ce780 2024-09-10T07:35:33.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.481+0000 7f5112a00640 1 -- 172.21.15.99:0/936994348 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5104045020 con 0x7f511c0ce780 2024-09-10T07:35:33.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.482+0000 7f5112a00640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f50f806be30 0x7f50f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.482+0000 7f5112a00640 1 -- 172.21.15.99:0/936994348 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f51040ab280 con 0x7f511c0ce780 2024-09-10T07:35:33.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.483+0000 7f5119e00640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f50f806be30 0x7f50f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.483+0000 7f5119e00640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f50f806be30 0x7f50f806e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f511c0c9d20 tx=0x7f510c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:33.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.487+0000 7f5112a00640 1 -- 172.21.15.99:0/936994348 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f510404c030 con 0x7f511c0ce780 2024-09-10T07:35:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.661+0000 7f5121200640 1 -- 172.21.15.99:0/936994348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f511c13f150 con 0x7f511c0ce780 2024-09-10T07:35:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.661+0000 7f5112a00640 1 -- 172.21.15.99:0/936994348 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) ==== 84+0+65 (secure 0 0 0) 0x7f5104079f70 con 0x7f511c0ce780 2024-09-10T07:35:33.661 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:33.662 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:35:33.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:33.662 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:35:33.662 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:35:33.662 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:33.662 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:35:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.663+0000 7f5121200640 1 -- 172.21.15.99:0/936994348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f50f806be30 msgr2=0x7f50f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.663+0000 7f5121200640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f50f806be30 0x7f50f806e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f511c0c9d20 tx=0x7f510c009040 comp rx=0 tx=0).stop 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.663+0000 7f5121200640 1 -- 172.21.15.99:0/936994348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0ce780 msgr2=0x7f511c144170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.663+0000 7f5121200640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0ce780 0x7f511c144170 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5104035040 tx=0x7f51040046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.663+0000 7f5121200640 1 -- 172.21.15.99:0/936994348 shutdown_connections 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.663+0000 7f5121200640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f511c145290 0x7f511c1446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.663+0000 7f5121200640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f50f806be30 0x7f50f806e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.663+0000 7f5121200640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f511c0ce780 0x7f511c144170 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.663+0000 7f5121200640 1 --2- 172.21.15.99:0/936994348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f511c072f40 0x7f511c13d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.663+0000 7f5121200640 1 -- 172.21.15.99:0/936994348 >> 172.21.15.99:0/936994348 conn(0x7f511c06bc10 msgr2=0x7f511c0b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.664+0000 7f5121200640 1 -- 172.21.15.99:0/936994348 shutdown_connections 2024-09-10T07:35:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.664+0000 7f5121200640 1 -- 172.21.15.99:0/936994348 wait complete. 2024-09-10T07:35:33.680 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:35:33.680 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:35:33.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.835+0000 7fa3cbc00640 1 Processor -- start 2024-09-10T07:35:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.836+0000 7fa3cbc00640 1 -- start start 2024-09-10T07:35:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.837+0000 7fa3cbc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa3c40ced50 0x7fa3c4072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.837+0000 7fa3cbc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c4160310 con 0x7fa3c41445a0 2024-09-10T07:35:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.837+0000 7fa3cbc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c4160030 con 0x7fa3c4144980 2024-09-10T07:35:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.837+0000 7fa3cbc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c415fdd0 con 0x7fa3c40ced50 2024-09-10T07:35:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.837+0000 7fa3c9200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa3c41445a0 0x7fa3c40cd380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54426/0 (socket says 172.21.15.99:54426) 2024-09-10T07:35:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.837+0000 7fa3c9200640 1 -- 172.21.15.99:0/4142509741 learned_addr learned my addr 172.21.15.99:0/4142509741 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.837+0000 7fa3bbe00640 1 --2- 172.21.15.99:0/4142509741 >> v2:172.21.15.99:3300/0 conn(0x7fa3c40ced50 0x7fa3c4072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.838+0000 7fa3c3e00640 1 -- 172.21.15.99:0/4142509741 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481166606 0 0) 0x7fa3c4160310 con 0x7fa3c41445a0 2024-09-10T07:35:33.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.838+0000 7fa3c3e00640 1 -- 172.21.15.99:0/4142509741 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3a8003520 con 0x7fa3c41445a0 2024-09-10T07:35:33.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.838+0000 7fa3bbe00640 1 -- 172.21.15.99:0/4142509741 >> v1:172.21.15.187:6789/0 conn(0x7fa3c4144980 legacy=0x7fa3c40b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:33.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.838+0000 7fa3bbe00640 1 -- 172.21.15.99:0/4142509741 >> v1:172.21.15.99:6789/0 conn(0x7fa3c41445a0 legacy=0x7fa3c40cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.838+0000 7fa3bbe00640 1 -- 172.21.15.99:0/4142509741 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c40b5940 con 0x7fa3c40ced50 2024-09-10T07:35:33.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.839+0000 7fa3bbe00640 1 --2- 172.21.15.99:0/4142509741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c40ced50 0x7fa3c4072680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0097a0 tx=0x7fa3ac02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b43e5151fdca386 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.839+0000 7fa3c3e00640 1 -- 172.21.15.99:0/4142509741 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac037070 con 0x7fa3c40ced50 2024-09-10T07:35:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.839+0000 7fa3c3e00640 1 -- 172.21.15.99:0/4142509741 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac02adc0 con 0x7fa3c40ced50 2024-09-10T07:35:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.839+0000 7fa3c3e00640 1 -- 172.21.15.99:0/4142509741 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac032660 con 0x7fa3c40ced50 2024-09-10T07:35:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.839+0000 7fa3cbc00640 1 -- 172.21.15.99:0/4142509741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c40ced50 msgr2=0x7fa3c4072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.839+0000 7fa3cbc00640 1 --2- 172.21.15.99:0/4142509741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c40ced50 0x7fa3c4072680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0097a0 tx=0x7fa3ac02a0b0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.840+0000 7fa3cbc00640 1 -- 172.21.15.99:0/4142509741 shutdown_connections 2024-09-10T07:35:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.840+0000 7fa3cbc00640 1 --2- 172.21.15.99:0/4142509741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c40ced50 0x7fa3c4072680 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.840+0000 7fa3cbc00640 1 -- 172.21.15.99:0/4142509741 >> 172.21.15.99:0/4142509741 conn(0x7fa3c40b26a0 msgr2=0x7fa3c40b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.840+0000 7fa3cbc00640 1 -- 172.21.15.99:0/4142509741 shutdown_connections 2024-09-10T07:35:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.840+0000 7fa3cbc00640 1 -- 172.21.15.99:0/4142509741 wait complete. 2024-09-10T07:35:33.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.841+0000 7fa3cbc00640 1 Processor -- start 2024-09-10T07:35:33.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.841+0000 7fa3cbc00640 1 -- start start 2024-09-10T07:35:33.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.842+0000 7fa3cbc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3c40ced50 0x7fa3c415e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.842+0000 7fa3cbc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c41445a0 0x7fa3c415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.842+0000 7fa3cbc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3c4144980 0x7fa3c40b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.842+0000 7fa3cbc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4145040 con 0x7fa3c41445a0 2024-09-10T07:35:33.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.842+0000 7fa3cbc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4144ec0 con 0x7fa3c4144980 2024-09-10T07:35:33.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.842+0000 7fa3cbc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c4072bc0 con 0x7fa3c40ced50 2024-09-10T07:35:33.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.842+0000 7fa3bbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c41445a0 0x7fa3c415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.842+0000 7fa3bbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c41445a0 0x7fa3c415e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35240/0 (socket says 172.21.15.99:35240) 2024-09-10T07:35:33.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.842+0000 7fa3bbe00640 1 -- 172.21.15.99:0/3172058370 learned_addr learned my addr 172.21.15.99:0/3172058370 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:33.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.843+0000 7fa3c9200640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3c40ced50 0x7fa3c415e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.843+0000 7fa3c9c00640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3c4144980 0x7fa3c40b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.843+0000 7fa3bbe00640 1 -- 172.21.15.99:0/3172058370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3c40ced50 msgr2=0x7fa3c415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.843+0000 7fa3bbe00640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3c40ced50 0x7fa3c415e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.843+0000 7fa3bbe00640 1 -- 172.21.15.99:0/3172058370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3c4144980 msgr2=0x7fa3c40b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:33.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.843+0000 7fa3bbe00640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3c4144980 0x7fa3c40b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:33.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.843+0000 7fa3bbe00640 1 -- 172.21.15.99:0/3172058370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c415d380 con 0x7fa3c41445a0 2024-09-10T07:35:33.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.843+0000 7fa3bbe00640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c41445a0 0x7fa3c415e960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac000c00 tx=0x7fa3ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:33.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.844+0000 7fa3c1600640 1 -- 172.21.15.99:0/3172058370 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac041070 con 0x7fa3c41445a0 2024-09-10T07:35:33.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.844+0000 7fa3c1600640 1 -- 172.21.15.99:0/3172058370 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac03c460 con 0x7fa3c41445a0 2024-09-10T07:35:33.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.844+0000 7fa3c1600640 1 -- 172.21.15.99:0/3172058370 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac037040 con 0x7fa3c41445a0 2024-09-10T07:35:33.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.844+0000 7fa3cbc00640 1 -- 172.21.15.99:0/3172058370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c415d660 con 0x7fa3c41445a0 2024-09-10T07:35:33.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.844+0000 7fa3cbc00640 1 -- 172.21.15.99:0/3172058370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c415dc20 con 0x7fa3c41445a0 2024-09-10T07:35:33.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.845+0000 7fa3cbc00640 1 -- 172.21.15.99:0/3172058370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c4072f50 con 0x7fa3c41445a0 2024-09-10T07:35:33.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.846+0000 7fa3c1600640 1 -- 172.21.15.99:0/3172058370 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3ac044070 con 0x7fa3c41445a0 2024-09-10T07:35:33.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.846+0000 7fa3c1600640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3a006be60 0x7fa3a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:33.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.846+0000 7fa3c1600640 1 -- 172.21.15.99:0/3172058370 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7fa3ac0ab180 con 0x7fa3c41445a0 2024-09-10T07:35:33.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.847+0000 7fa3c9200640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3a006be60 0x7fa3a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:33.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.847+0000 7fa3c9200640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3a006be60 0x7fa3a006e320 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4005880 tx=0x7fa3b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:33.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:33.851+0000 7fa3c1600640 1 -- 172.21.15.99:0/3172058370 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa3ac079700 con 0x7fa3c41445a0 2024-09-10T07:35:34.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.028+0000 7fa3cbc00640 1 -- 172.21.15.99:0/3172058370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa3c4075620 con 0x7fa3c41445a0 2024-09-10T07:35:34.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.889+0000 7fa3c1600640 1 -- 172.21.15.99:0/3172058370 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) ==== 138+0+0 (secure 0 0 0) 0x7fa3ac07da00 con 0x7fa3c41445a0 2024-09-10T07:35:34.889 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:35:34.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 -- 172.21.15.99:0/3172058370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3a006be60 msgr2=0x7fa3a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:34.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3a006be60 0x7fa3a006e320 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4005880 tx=0x7fa3b4009040 comp rx=0 tx=0).stop 2024-09-10T07:35:34.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 -- 172.21.15.99:0/3172058370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c41445a0 msgr2=0x7fa3c415e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:34.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c41445a0 0x7fa3c415e960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac000c00 tx=0x7fa3ac0046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:34.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 -- 172.21.15.99:0/3172058370 shutdown_connections 2024-09-10T07:35:34.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3c4144980 0x7fa3c40b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:34.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3a006be60 0x7fa3a006e320 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:34.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3c41445a0 0x7fa3c415e960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:34.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 --2- 172.21.15.99:0/3172058370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3c40ced50 0x7fa3c415e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:34.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 -- 172.21.15.99:0/3172058370 >> 172.21.15.99:0/3172058370 conn(0x7fa3c40b26a0 msgr2=0x7fa3c4071570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:34.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 -- 172.21.15.99:0/3172058370 shutdown_connections 2024-09-10T07:35:34.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:34.892+0000 7fa3cbc00640 1 -- 172.21.15.99:0/3172058370 wait complete. 2024-09-10T07:35:34.912 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:35:35.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.075+0000 7f7a9bc00640 1 Processor -- start 2024-09-10T07:35:35.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.075+0000 7f7a9bc00640 1 -- start start 2024-09-10T07:35:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.076+0000 7f7a9bc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940d56b0 0x7f7a940b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.076+0000 7f7a9bc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7a940d1470 0x7f7a940d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.076+0000 7f7a9bc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a940d3700 con 0x7f7a941623c0 2024-09-10T07:35:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.076+0000 7f7a9bc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7a940d21a0 con 0x7f7a940d1470 2024-09-10T07:35:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.076+0000 7f7a9bc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7a940d0080 con 0x7f7a940d56b0 2024-09-10T07:35:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.076+0000 7f7a99c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7a940d1470 0x7f7a940d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.076+0000 7f7a99c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7a940d1470 0x7f7a940d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35242/0 (socket says 172.21.15.99:35242) 2024-09-10T07:35:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.076+0000 7f7a99c00640 1 -- 172.21.15.99:0/1588685298 learned_addr learned my addr 172.21.15.99:0/1588685298 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.077+0000 7f7a8be00640 1 --2- 172.21.15.99:0/1588685298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940d56b0 0x7f7a940b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:35.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.077+0000 7f7a99c00640 1 -- 172.21.15.99:0/1588685298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940d56b0 msgr2=0x7f7a940b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:35.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.077+0000 7f7a99c00640 1 --2- 172.21.15.99:0/1588685298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940d56b0 0x7f7a940b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:35.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.077+0000 7f7a99c00640 1 -- 172.21.15.99:0/1588685298 >> v1:172.21.15.187:6789/0 conn(0x7f7a941623c0 legacy=0x7f7a940d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:35.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.077+0000 7f7a99c00640 1 -- 172.21.15.99:0/1588685298 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a940cfa70 con 0x7f7a940d1470 2024-09-10T07:35:35.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.078+0000 7f7a99c00640 1 --2- 172.21.15.99:0/1588685298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a940d1470 0x7f7a940d1920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009e50 tx=0x7f7a8c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292673a092493b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:35.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.078+0000 7f7a93e00640 1 -- 172.21.15.99:0/1588685298 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c036070 con 0x7f7a940d1470 2024-09-10T07:35:35.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.078+0000 7f7a93e00640 1 -- 172.21.15.99:0/1588685298 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8c031600 con 0x7f7a940d1470 2024-09-10T07:35:35.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.078+0000 7f7a93e00640 1 -- 172.21.15.99:0/1588685298 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0319d0 con 0x7f7a940d1470 2024-09-10T07:35:35.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.079+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1588685298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a940d1470 msgr2=0x7f7a940d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:35.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.079+0000 7f7a9bc00640 1 --2- 172.21.15.99:0/1588685298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a940d1470 0x7f7a940d1920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009e50 tx=0x7f7a8c02a710 comp rx=0 tx=0).stop 2024-09-10T07:35:35.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.079+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1588685298 shutdown_connections 2024-09-10T07:35:35.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.079+0000 7f7a9bc00640 1 --2- 172.21.15.99:0/1588685298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a940d1470 0x7f7a940d1920 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:35.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.079+0000 7f7a9bc00640 1 --2- 172.21.15.99:0/1588685298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940d56b0 0x7f7a940b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:35.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.079+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1588685298 >> 172.21.15.99:0/1588685298 conn(0x7f7a9409df30 msgr2=0x7f7a940d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:35.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.079+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1588685298 shutdown_connections 2024-09-10T07:35:35.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.079+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1588685298 wait complete. 2024-09-10T07:35:35.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.080+0000 7f7a9bc00640 1 Processor -- start 2024-09-10T07:35:35.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.080+0000 7f7a9bc00640 1 -- start start 2024-09-10T07:35:35.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.081+0000 7f7a9bc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a940d1470 0x7f7a9414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:35.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.081+0000 7f7a9bc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940d56b0 0x7f7a940ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:35.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.081+0000 7f7a9bc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a941623c0 0x7f7a940cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:35.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.081+0000 7f7a9bc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940cfd10 con 0x7f7a941623c0 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.081+0000 7f7a9bc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940d39a0 con 0x7f7a940d1470 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.081+0000 7f7a9bc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7a941627a0 con 0x7f7a940d56b0 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a941623c0 0x7f7a940cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a941623c0 0x7f7a940cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35248/0 (socket says 172.21.15.99:35248) 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99c00640 1 -- 172.21.15.99:0/1577299027 learned_addr learned my addr 172.21.15.99:0/1577299027 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a8be00640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940d56b0 0x7f7a940ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99200640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a940d1470 0x7f7a9414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99c00640 1 -- 172.21.15.99:0/1577299027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940d56b0 msgr2=0x7f7a940ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99c00640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940d56b0 0x7f7a940ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99c00640 1 -- 172.21.15.99:0/1577299027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a940d1470 msgr2=0x7f7a9414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99c00640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a940d1470 0x7f7a9414ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99c00640 1 -- 172.21.15.99:0/1577299027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9414f2d0 con 0x7f7a941623c0 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99200640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a940d1470 0x7f7a9414ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:35.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a99c00640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a941623c0 0x7f7a940cad40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c034040 tx=0x7f7a8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:35.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.082+0000 7f7a91600640 1 -- 172.21.15.99:0/1577299027 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c03f020 con 0x7f7a941623c0 2024-09-10T07:35:35.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.083+0000 7f7a91600640 1 -- 172.21.15.99:0/1577299027 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8c037040 con 0x7f7a941623c0 2024-09-10T07:35:35.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.083+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1577299027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9414efc0 con 0x7f7a941623c0 2024-09-10T07:35:35.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.083+0000 7f7a91600640 1 -- 172.21.15.99:0/1577299027 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c036070 con 0x7f7a941623c0 2024-09-10T07:35:35.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.083+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1577299027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9414f850 con 0x7f7a941623c0 2024-09-10T07:35:35.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.084+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1577299027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a940d3c80 con 0x7f7a941623c0 2024-09-10T07:35:35.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.085+0000 7f7a91600640 1 -- 172.21.15.99:0/1577299027 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a8c042020 con 0x7f7a941623c0 2024-09-10T07:35:35.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.086+0000 7f7a91600640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7006be30 0x7f7a7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:35.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.086+0000 7f7a91600640 1 -- 172.21.15.99:0/1577299027 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5227+0+0 (secure 0 0 0) 0x7f7a8c0ab170 con 0x7f7a941623c0 2024-09-10T07:35:35.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.086+0000 7f7a99200640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7006be30 0x7f7a7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:35.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.086+0000 7f7a99200640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7006be30 0x7f7a7006e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7a840015e0 tx=0x7f7a84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.090+0000 7f7a91600640 1 -- 172.21.15.99:0/1577299027 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a8c049030 con 0x7f7a941623c0 2024-09-10T07:35:35.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.266+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1577299027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7a940b74e0 con 0x7f7a941623c0 2024-09-10T07:35:35.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.892+0000 7f7a91600640 1 -- 172.21.15.99:0/1577299027 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) ==== 170+0+0 (secure 0 0 0) 0x7f7a8c079610 con 0x7f7a941623c0 2024-09-10T07:35:35.892 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:35:35.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.895+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1577299027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7006be30 msgr2=0x7f7a7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:35.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.895+0000 7f7a9bc00640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7006be30 0x7f7a7006e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7a840015e0 tx=0x7f7a84009040 comp rx=0 tx=0).stop 2024-09-10T07:35:35.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.895+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1577299027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a941623c0 msgr2=0x7f7a940cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:35.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.895+0000 7f7a9bc00640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a941623c0 0x7f7a940cad40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c034040 tx=0x7f7a8c004a40 comp rx=0 tx=0).stop 2024-09-10T07:35:35.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.897+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1577299027 shutdown_connections 2024-09-10T07:35:35.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.897+0000 7f7a9bc00640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7006be30 0x7f7a7006e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:35.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.897+0000 7f7a9bc00640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a941623c0 0x7f7a940cad40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:35.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.897+0000 7f7a9bc00640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940d56b0 0x7f7a940ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:35.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.897+0000 7f7a9bc00640 1 --2- 172.21.15.99:0/1577299027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a940d1470 0x7f7a9414ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:35.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.897+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1577299027 >> 172.21.15.99:0/1577299027 conn(0x7f7a9409df30 msgr2=0x7f7a940b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:35.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.899+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1577299027 shutdown_connections 2024-09-10T07:35:35.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:35.901+0000 7f7a9bc00640 1 -- 172.21.15.99:0/1577299027 wait complete. 2024-09-10T07:35:35.924 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:35:36.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.083+0000 7f1118400640 1 Processor -- start 2024-09-10T07:35:36.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.083+0000 7f1118400640 1 -- start start 2024-09-10T07:35:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f1118400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1110071df0 0x7f1110073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:36.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f1118400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100d1010 0x7f11100ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:36.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f1118400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11100722d0 con 0x7f111006e280 2024-09-10T07:35:36.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f1118400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f11100738b0 con 0x7f1110071df0 2024-09-10T07:35:36.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f1118400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f11100725b0 con 0x7f11100d1010 2024-09-10T07:35:36.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f1115a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f111006e280 0x7f111006e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54438/0 (socket says 172.21.15.99:54438) 2024-09-10T07:35:36.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f1115a00640 1 -- 172.21.15.99:0/2650692934 learned_addr learned my addr 172.21.15.99:0/2650692934 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f1116400640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100d1010 0x7f11100ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f1115000640 1 --2- 172.21.15.99:0/2650692934 >> v2:172.21.15.187:3300/0 conn(0x7f1110071df0 0x7f1110073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3627628605 0 0) 0x7f11100722d0 con 0x7f111006e280 2024-09-10T07:35:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.085+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10f8003520 con 0x7f111006e280 2024-09-10T07:35:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 281789277 0 0) 0x7f10f8003520 con 0x7f111006e280 2024-09-10T07:35:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100d1010 msgr2=0x7f11100ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100d1010 0x7f11100ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 >> v2:172.21.15.187:3300/0 conn(0x7f1110071df0 msgr2=0x7f1110073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 --2- 172.21.15.99:0/2650692934 >> v2:172.21.15.187:3300/0 conn(0x7f1110071df0 0x7f1110073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1110072890 con 0x7f111006e280 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f1104001670 con 0x7f111006e280 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 >> v1:172.21.15.99:6789/0 conn(0x7f111006e280 legacy=0x7f111006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10f80039b0 0x7f10f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100d1010 0x7f10f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10f8004d40 0x7f10f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f11100738b0 con 0x7f10f80039b0 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f11100725b0 con 0x7f10f8004d40 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f10f800b9c0 con 0x7f11100d1010 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f1115a00640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10f80039b0 0x7f10f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f1115000640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100d1010 0x7f10f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.086+0000 7f1116400640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10f8004d40 0x7f10f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.087+0000 7f1115a00640 1 -- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100d1010 msgr2=0x7f10f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:36.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.087+0000 7f1115a00640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100d1010 0x7f10f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.087+0000 7f1115a00640 1 -- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10f8004d40 msgr2=0x7f10f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:36.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.087+0000 7f1115a00640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10f8004d40 0x7f10f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.087+0000 7f1115a00640 1 -- 172.21.15.99:0/2650692934 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f8003520 con 0x7f10f80039b0 2024-09-10T07:35:36.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.087+0000 7f1115a00640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10f80039b0 0x7f10f8003dd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f110400c2c0 tx=0x7f10f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff629519c4cf3f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:36.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.088+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104007d50 con 0x7f10f80039b0 2024-09-10T07:35:36.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.088+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f110402e070 con 0x7f10f80039b0 2024-09-10T07:35:36.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.088+0000 7f110fe00640 1 -- 172.21.15.99:0/2650692934 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104005d30 con 0x7f10f80039b0 2024-09-10T07:35:36.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.088+0000 7f1118400640 1 -- 172.21.15.99:0/2650692934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10f80039b0 msgr2=0x7f10f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:36.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.088+0000 7f1118400640 1 --2- 172.21.15.99:0/2650692934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10f80039b0 0x7f10f8003dd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f110400c2c0 tx=0x7f10f8005830 comp rx=0 tx=0).stop 2024-09-10T07:35:36.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.088+0000 7f1116400640 1 -- 172.21.15.99:0/2650692934 reap_dead start 2024-09-10T07:35:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.088+0000 7f1118400640 1 -- 172.21.15.99:0/2650692934 shutdown_connections 2024-09-10T07:35:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.088+0000 7f1118400640 1 -- 172.21.15.99:0/2650692934 >> 172.21.15.99:0/2650692934 conn(0x7f111006bc10 msgr2=0x7f111006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.088+0000 7f1118400640 1 -- 172.21.15.99:0/2650692934 shutdown_connections 2024-09-10T07:35:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.089+0000 7f1118400640 1 -- 172.21.15.99:0/2650692934 wait complete. 2024-09-10T07:35:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.090+0000 7f1118400640 1 Processor -- start 2024-09-10T07:35:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.090+0000 7f1118400640 1 -- start start 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.091+0000 7f1118400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10f80039b0 0x7f1110150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.091+0000 7f1118400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100b4680 0x7f11100b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.091+0000 7f1118400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100ae840 0x7f11100aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.091+0000 7f1118400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f111015db60 con 0x7f11100ae840 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.091+0000 7f1118400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1110072e50 con 0x7f10f80039b0 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.091+0000 7f1118400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f11100d14c0 con 0x7f11100b4680 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.091+0000 7f1116400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100ae840 0x7f11100aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1115000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100b4680 0x7f11100b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1116400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100ae840 0x7f11100aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35268/0 (socket says 172.21.15.99:35268) 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1115a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10f80039b0 0x7f1110150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1116400640 1 -- 172.21.15.99:0/2612190695 learned_addr learned my addr 172.21.15.99:0/2612190695 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1116400640 1 -- 172.21.15.99:0/2612190695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100b4680 msgr2=0x7f11100b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1116400640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100b4680 0x7f11100b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1116400640 1 -- 172.21.15.99:0/2612190695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10f80039b0 msgr2=0x7f1110150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1116400640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10f80039b0 0x7f1110150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1116400640 1 -- 172.21.15.99:0/2612190695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11101543f0 con 0x7f11100ae840 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1115000640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100b4680 0x7f11100b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.092+0000 7f1116400640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100ae840 0x7f11100aecc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1110071b60 tx=0x7f110800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.093+0000 7f110d600640 1 -- 172.21.15.99:0/2612190695 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110800fc80 con 0x7f11100ae840 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.093+0000 7f110d600640 1 -- 172.21.15.99:0/2612190695 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f110800fe20 con 0x7f11100ae840 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.093+0000 7f110d600640 1 -- 172.21.15.99:0/2612190695 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1108015670 con 0x7f11100ae840 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.093+0000 7f1118400640 1 -- 172.21.15.99:0/2612190695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11100b3ba0 con 0x7f11100ae840 2024-09-10T07:35:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.093+0000 7f1118400640 1 -- 172.21.15.99:0/2612190695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11100b4160 con 0x7f11100ae840 2024-09-10T07:35:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.094+0000 7f1118400640 1 -- 172.21.15.99:0/2612190695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11100af200 con 0x7f11100ae840 2024-09-10T07:35:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.095+0000 7f110d600640 1 -- 172.21.15.99:0/2612190695 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1108015810 con 0x7f11100ae840 2024-09-10T07:35:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.096+0000 7f110d600640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10f006be30 0x7f10f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.096+0000 7f110d600640 1 -- 172.21.15.99:0/2612190695 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5609+0+0 (secure 0 0 0) 0x7f110808bb20 con 0x7f11100ae840 2024-09-10T07:35:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.096+0000 7f1115a00640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10f006be30 0x7f10f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.097+0000 7f1115a00640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10f006be30 0x7f10f006e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1104033000 tx=0x7f1104009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:36.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.100+0000 7f110d600640 1 -- 172.21.15.99:0/2612190695 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1108019030 con 0x7f11100ae840 2024-09-10T07:35:36.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.305+0000 7f1118400640 1 -- 172.21.15.99:0/2612190695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1110073370 con 0x7f11100ae840 2024-09-10T07:35:36.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.918+0000 7f110d600640 1 -- 172.21.15.99:0/2612190695 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) ==== 172+0+0 (secure 0 0 0) 0x7f1108010040 con 0x7f11100ae840 2024-09-10T07:35:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 6 and data pool 7 2024-09-10T07:35:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.930+0000 7f1118400640 1 -- 172.21.15.99:0/2612190695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10f006be30 msgr2=0x7f10f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.930+0000 7f1118400640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10f006be30 0x7f10f006e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1104033000 tx=0x7f1104009030 comp rx=0 tx=0).stop 2024-09-10T07:35:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.930+0000 7f1118400640 1 -- 172.21.15.99:0/2612190695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100ae840 msgr2=0x7f11100aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.930+0000 7f1118400640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100ae840 0x7f11100aecc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1110071b60 tx=0x7f110800f1b0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.931+0000 7f1118400640 1 -- 172.21.15.99:0/2612190695 shutdown_connections 2024-09-10T07:35:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.931+0000 7f1118400640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f10f006be30 0x7f10f006e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.931+0000 7f1118400640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11100ae840 0x7f11100aecc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.931+0000 7f1118400640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11100b4680 0x7f11100b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.931+0000 7f1118400640 1 --2- 172.21.15.99:0/2612190695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10f80039b0 0x7f1110150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.931+0000 7f1118400640 1 -- 172.21.15.99:0/2612190695 >> 172.21.15.99:0/2612190695 conn(0x7f111006bc10 msgr2=0x7f111015e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.933+0000 7f1118400640 1 -- 172.21.15.99:0/2612190695 shutdown_connections 2024-09-10T07:35:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:36.934+0000 7f1118400640 1 -- 172.21.15.99:0/2612190695 wait complete. 2024-09-10T07:35:36.956 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:35:37.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.111+0000 7f591e800640 1 Processor -- start 2024-09-10T07:35:37.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.111+0000 7f591e800640 1 -- start start 2024-09-10T07:35:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.112+0000 7f591e800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5918142150 0x7f5918160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.112+0000 7f591e800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5918142650 con 0x7f5918160a80 2024-09-10T07:35:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.112+0000 7f591e800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5918142930 con 0x7f591813fae0 2024-09-10T07:35:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.112+0000 7f591e800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f59180ce780 con 0x7f5918142150 2024-09-10T07:35:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.113+0000 7f5917e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5918160a80 0x7f59180cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54448/0 (socket says 172.21.15.99:54448) 2024-09-10T07:35:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.113+0000 7f5917e00640 1 -- 172.21.15.99:0/841009725 learned_addr learned my addr 172.21.15.99:0/841009725 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.113+0000 7f590ea00640 1 --2- 172.21.15.99:0/841009725 >> v2:172.21.15.187:3300/0 conn(0x7f5918142150 0x7f5918160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.113+0000 7f5916a00640 1 -- 172.21.15.99:0/841009725 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914844637 0 0) 0x7f5918142650 con 0x7f5918160a80 2024-09-10T07:35:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.113+0000 7f5916a00640 1 -- 172.21.15.99:0/841009725 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58fc003520 con 0x7f5918160a80 2024-09-10T07:35:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.113+0000 7f590ea00640 1 -- 172.21.15.99:0/841009725 >> v1:172.21.15.187:6789/0 conn(0x7f591813fae0 legacy=0x7f591806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.113+0000 7f590ea00640 1 -- 172.21.15.99:0/841009725 >> v1:172.21.15.99:6789/0 conn(0x7f5918160a80 legacy=0x7f59180cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.113+0000 7f5916a00640 1 -- 172.21.15.99:0/841009725 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2761067261 0 0) 0x7f58fc003520 con 0x7f5918160a80 2024-09-10T07:35:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.113+0000 7f590ea00640 1 -- 172.21.15.99:0/841009725 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5918142c10 con 0x7f5918142150 2024-09-10T07:35:37.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.115+0000 7f590ea00640 1 --2- 172.21.15.99:0/841009725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5918142150 0x7f5918160540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f59000097a0 tx=0x7f590002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fd1f5ec038b3949 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.115+0000 7f5916a00640 1 -- 172.21.15.99:0/841009725 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900037070 con 0x7f5918142150 2024-09-10T07:35:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.115+0000 7f5916a00640 1 -- 172.21.15.99:0/841009725 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590002abc0 con 0x7f5918142150 2024-09-10T07:35:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.115+0000 7f5916a00640 1 -- 172.21.15.99:0/841009725 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100019f0 con 0x7f5918142150 2024-09-10T07:35:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.115+0000 7f591e800640 1 -- 172.21.15.99:0/841009725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5918142150 msgr2=0x7f5918160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.115+0000 7f591e800640 1 --2- 172.21.15.99:0/841009725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5918142150 0x7f5918160540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f59000097a0 tx=0x7f590002a130 comp rx=0 tx=0).stop 2024-09-10T07:35:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.115+0000 7f591e800640 1 -- 172.21.15.99:0/841009725 shutdown_connections 2024-09-10T07:35:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.115+0000 7f591e800640 1 --2- 172.21.15.99:0/841009725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5918142150 0x7f5918160540 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.115+0000 7f591e800640 1 -- 172.21.15.99:0/841009725 >> 172.21.15.99:0/841009725 conn(0x7f591806bc10 msgr2=0x7f591806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.116+0000 7f591e800640 1 -- 172.21.15.99:0/841009725 shutdown_connections 2024-09-10T07:35:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.116+0000 7f591e800640 1 -- 172.21.15.99:0/841009725 wait complete. 2024-09-10T07:35:37.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.117+0000 7f591e800640 1 Processor -- start 2024-09-10T07:35:37.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.117+0000 7f591e800640 1 -- start start 2024-09-10T07:35:37.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.118+0000 7f591e800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f591813fae0 0x7f5918143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.118+0000 7f591e800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5918142150 0x7f59181442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.118+0000 7f591e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5918160a80 0x7f591815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.118+0000 7f591e800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f59180cf4a0 con 0x7f5918160a80 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.118+0000 7f591e800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f59180cf320 con 0x7f591813fae0 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.118+0000 7f591e800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f59180cf620 con 0x7f5918142150 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.118+0000 7f5917e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5918160a80 0x7f591815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.118+0000 7f5917e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5918160a80 0x7f591815b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35278/0 (socket says 172.21.15.99:35278) 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.118+0000 7f5917e00640 1 -- 172.21.15.99:0/3017025768 learned_addr learned my addr 172.21.15.99:0/3017025768 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f5917e00640 1 -- 172.21.15.99:0/3017025768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5918142150 msgr2=0x7f59181442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f5917e00640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5918142150 0x7f59181442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f5917e00640 1 -- 172.21.15.99:0/3017025768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f591813fae0 msgr2=0x7f5918143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f5917400640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f591813fae0 0x7f5918143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f5917e00640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f591813fae0 0x7f5918143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f5917e00640 1 -- 172.21.15.99:0/3017025768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591813f630 con 0x7f5918160a80 2024-09-10T07:35:37.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f5917400640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f591813fae0 0x7f5918143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:37.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f5917e00640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5918160a80 0x7f591815b8b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f591000cc00 tx=0x7f591000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:37.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f590fe00640 1 -- 172.21.15.99:0/3017025768 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910017070 con 0x7f5918160a80 2024-09-10T07:35:37.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f590fe00640 1 -- 172.21.15.99:0/3017025768 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f591000ce10 con 0x7f5918160a80 2024-09-10T07:35:37.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f590fe00640 1 -- 172.21.15.99:0/3017025768 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910012600 con 0x7f5918160a80 2024-09-10T07:35:37.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.119+0000 7f591e800640 1 -- 172.21.15.99:0/3017025768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59181449a0 con 0x7f5918160a80 2024-09-10T07:35:37.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.120+0000 7f591e800640 1 -- 172.21.15.99:0/3017025768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59181577d0 con 0x7f5918160a80 2024-09-10T07:35:37.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.121+0000 7f591e800640 1 -- 172.21.15.99:0/3017025768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59181613d0 con 0x7f5918160a80 2024-09-10T07:35:37.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.122+0000 7f590fe00640 1 -- 172.21.15.99:0/3017025768 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f591001a070 con 0x7f5918160a80 2024-09-10T07:35:37.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.122+0000 7f590fe00640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58f406be30 0x7f58f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.122+0000 7f590fe00640 1 -- 172.21.15.99:0/3017025768 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f591008abd0 con 0x7f5918160a80 2024-09-10T07:35:37.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.123+0000 7f5917400640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58f406be30 0x7f58f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.123+0000 7f5917400640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58f406be30 0x7f58f406e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5908000f60 tx=0x7f5908009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:37.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.127+0000 7f590fe00640 1 -- 172.21.15.99:0/3017025768 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59181613d0 con 0x7f5918160a80 2024-09-10T07:35:37.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.300+0000 7f591e800640 1 -- 172.21.15.99:0/3017025768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5918160540 con 0x7f5918160a80 2024-09-10T07:35:37.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.301+0000 7f590fe00640 1 -- 172.21.15.99:0/3017025768 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16662 (secure 0 0 0) 0x7f5910058fc0 con 0x7f5918160a80 2024-09-10T07:35:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:37.302 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":43,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:35:36.306913+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:34.068514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:35.306080+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:35:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.303+0000 7f591e800640 1 -- 172.21.15.99:0/3017025768 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58f406be30 msgr2=0x7f58f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.303+0000 7f591e800640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58f406be30 0x7f58f406e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5908000f60 tx=0x7f5908009040 comp rx=0 tx=0).stop 2024-09-10T07:35:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.303+0000 7f591e800640 1 -- 172.21.15.99:0/3017025768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5918160a80 msgr2=0x7f591815b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.303+0000 7f591e800640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5918160a80 0x7f591815b8b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f591000cc00 tx=0x7f591000a430 comp rx=0 tx=0).stop 2024-09-10T07:35:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.304+0000 7f591e800640 1 -- 172.21.15.99:0/3017025768 shutdown_connections 2024-09-10T07:35:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.304+0000 7f591e800640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58f406be30 0x7f58f406e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.304+0000 7f591e800640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5918160a80 0x7f591815b8b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.304+0000 7f591e800640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5918142150 0x7f59181442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.304+0000 7f591e800640 1 --2- 172.21.15.99:0/3017025768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f591813fae0 0x7f5918143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.304+0000 7f591e800640 1 -- 172.21.15.99:0/3017025768 >> 172.21.15.99:0/3017025768 conn(0x7f591806bc10 msgr2=0x7f591815f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:37.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.304+0000 7f591e800640 1 -- 172.21.15.99:0/3017025768 shutdown_connections 2024-09-10T07:35:37.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.304+0000 7f591e800640 1 -- 172.21.15.99:0/3017025768 wait complete. 2024-09-10T07:35:37.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:35:37.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.474+0000 7fbcd2200640 1 Processor -- start 2024-09-10T07:35:37.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.474+0000 7fbcd2200640 1 -- start start 2024-09-10T07:35:37.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.475+0000 7fbcd2200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbccc15e970 0x7fbccc0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.475+0000 7fbcd2200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc0cfc90 0x7fbccc0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.475+0000 7fbcd2200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbccc0d2bd0 con 0x7fbccc0d2680 2024-09-10T07:35:37.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.475+0000 7fbcd2200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbccc0d37e0 con 0x7fbccc15e970 2024-09-10T07:35:37.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.475+0000 7fbcd2200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc0d2eb0 con 0x7fbccc0cfc90 2024-09-10T07:35:37.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.476+0000 7fbcd0e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbccc15e970 0x7fbccc0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.476+0000 7fbcd1800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc0cfc90 0x7fbccc0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.476+0000 7fbcd0e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbccc15e970 0x7fbccc0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:51942/0 (socket says 172.21.15.99:51942) 2024-09-10T07:35:37.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.476+0000 7fbcd0e00640 1 -- 172.21.15.99:0/3832657624 learned_addr learned my addr 172.21.15.99:0/3832657624 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:37.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.476+0000 7fbcd1800640 1 -- 172.21.15.99:0/3832657624 >> v2:172.21.15.187:3300/0 conn(0x7fbccc15e970 msgr2=0x7fbccc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:37.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.476+0000 7fbcd1800640 1 --2- 172.21.15.99:0/3832657624 >> v2:172.21.15.187:3300/0 conn(0x7fbccc15e970 0x7fbccc0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.476+0000 7fbcd1800640 1 -- 172.21.15.99:0/3832657624 >> v1:172.21.15.187:6789/0 conn(0x7fbccc0d2680 legacy=0x7fbccc0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.476+0000 7fbcd1800640 1 -- 172.21.15.99:0/3832657624 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc0d3190 con 0x7fbccc0cfc90 2024-09-10T07:35:37.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.477+0000 7fbcd1800640 1 --2- 172.21.15.99:0/3832657624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc0cfc90 0x7fbccc0c8700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009d90 tx=0x7fbcc402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9443ca178c04d4eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:37.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.477+0000 7fbccb400640 1 -- 172.21.15.99:0/3832657624 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4007740 con 0x7fbccc0cfc90 2024-09-10T07:35:37.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.477+0000 7fbccb400640 1 -- 172.21.15.99:0/3832657624 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc40078e0 con 0x7fbccc0cfc90 2024-09-10T07:35:37.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.477+0000 7fbccb400640 1 -- 172.21.15.99:0/3832657624 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4007cb0 con 0x7fbccc0cfc90 2024-09-10T07:35:37.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.478+0000 7fbcd2200640 1 -- 172.21.15.99:0/3832657624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc0cfc90 msgr2=0x7fbccc0c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.478+0000 7fbcd2200640 1 --2- 172.21.15.99:0/3832657624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc0cfc90 0x7fbccc0c8700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009d90 tx=0x7fbcc402a660 comp rx=0 tx=0).stop 2024-09-10T07:35:37.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.478+0000 7fbcd2200640 1 -- 172.21.15.99:0/3832657624 shutdown_connections 2024-09-10T07:35:37.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.478+0000 7fbcd2200640 1 --2- 172.21.15.99:0/3832657624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc0cfc90 0x7fbccc0c8700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.478+0000 7fbcd2200640 1 --2- 172.21.15.99:0/3832657624 >> v2:172.21.15.187:3300/0 conn(0x7fbccc15e970 0x7fbccc0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.478+0000 7fbcd2200640 1 -- 172.21.15.99:0/3832657624 >> 172.21.15.99:0/3832657624 conn(0x7fbccc09de00 msgr2=0x7fbccc0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:37.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.478+0000 7fbcd2200640 1 -- 172.21.15.99:0/3832657624 shutdown_connections 2024-09-10T07:35:37.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.478+0000 7fbcd2200640 1 -- 172.21.15.99:0/3832657624 wait complete. 2024-09-10T07:35:37.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.480+0000 7fbcd2200640 1 Processor -- start 2024-09-10T07:35:37.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.480+0000 7fbcd2200640 1 -- start start 2024-09-10T07:35:37.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd2200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbccc0cfc90 0x7fbccc0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd2200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbccc0d2680 0x7fbccc0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd2200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc15e970 0x7fbccc14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd2200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc15ed50 con 0x7fbccc0cfc90 2024-09-10T07:35:37.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd2200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc0d0840 con 0x7fbccc0d2680 2024-09-10T07:35:37.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd2200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc15eed0 con 0x7fbccc15e970 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbccc0cfc90 0x7fbccc0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbccc0cfc90 0x7fbccc0b78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35284/0 (socket says 172.21.15.99:35284) 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd0e00640 1 -- 172.21.15.99:0/3622518629 learned_addr learned my addr 172.21.15.99:0/3622518629 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd1800640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc15e970 0x7fbccc14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbccbe00640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbccc0d2680 0x7fbccc0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd0e00640 1 -- 172.21.15.99:0/3622518629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc15e970 msgr2=0x7fbccc14fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd0e00640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc15e970 0x7fbccc14fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd0e00640 1 -- 172.21.15.99:0/3622518629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbccc0d2680 msgr2=0x7fbccc0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd0e00640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbccc0d2680 0x7fbccc0ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd0e00640 1 -- 172.21.15.99:0/3622518629 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc0b81c0 con 0x7fbccc0cfc90 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbcd1800640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc15e970 0x7fbccc14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.481+0000 7fbccbe00640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbccc0d2680 0x7fbccc0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.482+0000 7fbcd0e00640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbccc0cfc90 0x7fbccc0b78e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000e870 tx=0x7fbcc000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.482+0000 7fbcc8c00640 1 -- 172.21.15.99:0/3622518629 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0017070 con 0x7fbccc0cfc90 2024-09-10T07:35:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.482+0000 7fbcc8c00640 1 -- 172.21.15.99:0/3622518629 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc000c8e0 con 0x7fbccc0cfc90 2024-09-10T07:35:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.482+0000 7fbcc8c00640 1 -- 172.21.15.99:0/3622518629 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000ccd0 con 0x7fbccc0cfc90 2024-09-10T07:35:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.482+0000 7fbcd2200640 1 -- 172.21.15.99:0/3622518629 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbccc0b8500 con 0x7fbccc0cfc90 2024-09-10T07:35:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.482+0000 7fbcd2200640 1 -- 172.21.15.99:0/3622518629 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbccc0b8d40 con 0x7fbccc0cfc90 2024-09-10T07:35:37.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.483+0000 7fbcd2200640 1 -- 172.21.15.99:0/3622518629 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbccc0d0300 con 0x7fbccc0cfc90 2024-09-10T07:35:37.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.484+0000 7fbcc8c00640 1 -- 172.21.15.99:0/3622518629 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcc001a070 con 0x7fbccc0cfc90 2024-09-10T07:35:37.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.485+0000 7fbcc8c00640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcac06be30 0x7fbcac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.485+0000 7fbcc8c00640 1 -- 172.21.15.99:0/3622518629 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fbcc008aed0 con 0x7fbccc0cfc90 2024-09-10T07:35:37.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.485+0000 7fbccbe00640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcac06be30 0x7fbcac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.486+0000 7fbccbe00640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcac06be30 0x7fbcac06e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbccc15a5f0 tx=0x7fbcb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.489+0000 7fbcc8c00640 1 -- 172.21.15.99:0/3622518629 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbccc0b8500 con 0x7fbccc0cfc90 2024-09-10T07:35:37.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.664+0000 7fbcd2200640 1 -- 172.21.15.99:0/3622518629 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbccc0b7ee0 con 0x7fbccc0cfc90 2024-09-10T07:35:37.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.665+0000 7fbcc8c00640 1 -- 172.21.15.99:0/3622518629 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16662 (secure 0 0 0) 0x7fbcc0059810 con 0x7fbccc0cfc90 2024-09-10T07:35:37.666 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:37.666 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":43,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:35:36.306913+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:34.068514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:35.306080+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:35:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 -- 172.21.15.99:0/3622518629 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcac06be30 msgr2=0x7fbcac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcac06be30 0x7fbcac06e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbccc15a5f0 tx=0x7fbcb8009040 comp rx=0 tx=0).stop 2024-09-10T07:35:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 -- 172.21.15.99:0/3622518629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbccc0cfc90 msgr2=0x7fbccc0b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbccc0cfc90 0x7fbccc0b78e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000e870 tx=0x7fbcc000ed30 comp rx=0 tx=0).stop 2024-09-10T07:35:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 -- 172.21.15.99:0/3622518629 shutdown_connections 2024-09-10T07:35:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbccc15e970 0x7fbccc14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbccc0d2680 0x7fbccc0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcac06be30 0x7fbcac06e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 --2- 172.21.15.99:0/3622518629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbccc0cfc90 0x7fbccc0b78e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 -- 172.21.15.99:0/3622518629 >> 172.21.15.99:0/3622518629 conn(0x7fbccc09de00 msgr2=0x7fbccc0ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 -- 172.21.15.99:0/3622518629 shutdown_connections 2024-09-10T07:35:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.668+0000 7fbcd2200640 1 -- 172.21.15.99:0/3622518629 wait complete. 2024-09-10T07:35:37.684 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:35:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.842+0000 7ff853000640 1 Processor -- start 2024-09-10T07:35:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.842+0000 7ff853000640 1 -- start start 2024-09-10T07:35:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.843+0000 7ff853000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0b4900 0x7ff84c0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.843+0000 7ff853000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff84c15f080 con 0x7ff84c15eca0 2024-09-10T07:35:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.843+0000 7ff853000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff84c0b4f30 con 0x7ff84c0b1fe0 2024-09-10T07:35:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.843+0000 7ff853000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c0b6d50 con 0x7ff84c0b4900 2024-09-10T07:35:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff851c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff84c15eca0 0x7ff84c0ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54460/0 (socket says 172.21.15.99:54460) 2024-09-10T07:35:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff851c00640 1 -- 172.21.15.99:0/2087083581 learned_addr learned my addr 172.21.15.99:0/2087083581 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4263804854 0 0) 0x7ff84c15f080 con 0x7ff84c15eca0 2024-09-10T07:35:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff834003520 con 0x7ff84c15eca0 2024-09-10T07:35:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff851200640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0b4900 0x7ff84c0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2712999240 0 0) 0x7ff834003520 con 0x7ff84c15eca0 2024-09-10T07:35:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0b4900 msgr2=0x7ff84c0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0b4900 0x7ff84c0d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 >> v1:172.21.15.187:6789/0 conn(0x7ff84c0b1fe0 legacy=0x7ff84c0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c06be60 con 0x7ff84c15eca0 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7ff840001670 con 0x7ff84c15eca0 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff851200640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0b4900 0x7ff84c0d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 >> v1:172.21.15.99:6789/0 conn(0x7ff84c15eca0 legacy=0x7ff84c0ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340039e0 0x7ff834003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0b4900 0x7ff834004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 0x7ff8340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c0b6d50 con 0x7ff834004d40 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff83400bb50 con 0x7ff8340039e0 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.844+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff83400bd50 con 0x7ff84c0b4900 2024-09-10T07:35:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.845+0000 7ff852600640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 0x7ff8340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.845+0000 7ff851c00640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340039e0 0x7ff834003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.845+0000 7ff851200640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0b4900 0x7ff834004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.845+0000 7ff852600640 1 -- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0b4900 msgr2=0x7ff834004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.845+0000 7ff852600640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0b4900 0x7ff834004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.845+0000 7ff852600640 1 -- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340039e0 msgr2=0x7ff834003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.845+0000 7ff852600640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340039e0 0x7ff834003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.845+0000 7ff852600640 1 -- 172.21.15.99:0/2087083581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff834003520 con 0x7ff834004d40 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.845+0000 7ff851c00640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340039e0 0x7ff834003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.846+0000 7ff852600640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 0x7ff8340051c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff844001e20 tx=0x7ff834005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b74afc125d05f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.846+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844001a70 con 0x7ff834004d40 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.846+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84402ae40 con 0x7ff834004d40 2024-09-10T07:35:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.846+0000 7ff84be00640 1 -- 172.21.15.99:0/2087083581 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844003bb0 con 0x7ff834004d40 2024-09-10T07:35:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.847+0000 7ff853000640 1 -- 172.21.15.99:0/2087083581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 msgr2=0x7ff8340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.847+0000 7ff853000640 1 --2- 172.21.15.99:0/2087083581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 0x7ff8340051c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff844001e20 tx=0x7ff834005830 comp rx=0 tx=0).stop 2024-09-10T07:35:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.847+0000 7ff852600640 1 -- 172.21.15.99:0/2087083581 reap_dead start 2024-09-10T07:35:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.847+0000 7ff853000640 1 -- 172.21.15.99:0/2087083581 shutdown_connections 2024-09-10T07:35:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.847+0000 7ff853000640 1 -- 172.21.15.99:0/2087083581 >> 172.21.15.99:0/2087083581 conn(0x7ff84c0b6610 msgr2=0x7ff84c0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.847+0000 7ff853000640 1 -- 172.21.15.99:0/2087083581 shutdown_connections 2024-09-10T07:35:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.847+0000 7ff853000640 1 -- 172.21.15.99:0/2087083581 wait complete. 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.849+0000 7ff853000640 1 Processor -- start 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.849+0000 7ff853000640 1 -- start start 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff853000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 0x7ff84c09dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff853000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff84c09c490 0x7ff84c161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff853000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0afc00 0x7ff84c150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff853000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c06c420 con 0x7ff834004d40 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff853000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c06bc10 con 0x7ff84c09c490 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff853000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c0d1aa0 con 0x7ff84c0afc00 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff851c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 0x7ff84c09dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff851c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 0x7ff84c09dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35302/0 (socket says 172.21.15.99:35302) 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff851c00640 1 -- 172.21.15.99:0/3012173874 learned_addr learned my addr 172.21.15.99:0/3012173874 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff852600640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0afc00 0x7ff84c150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff851200640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff84c09c490 0x7ff84c161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff851c00640 1 -- 172.21.15.99:0/3012173874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0afc00 msgr2=0x7ff84c150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff851c00640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0afc00 0x7ff84c150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff851c00640 1 -- 172.21.15.99:0/3012173874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff84c09c490 msgr2=0x7ff84c161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff851c00640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff84c09c490 0x7ff84c161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.850+0000 7ff851c00640 1 -- 172.21.15.99:0/3012173874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c09b3f0 con 0x7ff834004d40 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.851+0000 7ff851c00640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 0x7ff84c09dc40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff8400017e0 tx=0x7ff840007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.851+0000 7ff849600640 1 -- 172.21.15.99:0/3012173874 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84000f960 con 0x7ff834004d40 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.851+0000 7ff849600640 1 -- 172.21.15.99:0/3012173874 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff840018070 con 0x7ff834004d40 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.851+0000 7ff849600640 1 -- 172.21.15.99:0/3012173874 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84000fd00 con 0x7ff834004d40 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.851+0000 7ff853000640 1 -- 172.21.15.99:0/3012173874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84c09b6d0 con 0x7ff834004d40 2024-09-10T07:35:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.851+0000 7ff853000640 1 -- 172.21.15.99:0/3012173874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84c09bc90 con 0x7ff834004d40 2024-09-10T07:35:37.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.852+0000 7ff853000640 1 -- 172.21.15.99:0/3012173874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84c0b2450 con 0x7ff834004d40 2024-09-10T07:35:37.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.853+0000 7ff849600640 1 -- 172.21.15.99:0/3012173874 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff84001d460 con 0x7ff834004d40 2024-09-10T07:35:37.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.854+0000 7ff849600640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff82c06be30 0x7ff82c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:37.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.854+0000 7ff849600640 1 -- 172.21.15.99:0/3012173874 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7ff84008b190 con 0x7ff834004d40 2024-09-10T07:35:37.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.854+0000 7ff851200640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff82c06be30 0x7ff82c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:37.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.855+0000 7ff851200640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff82c06be30 0x7ff82c06e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff84c15e6b0 tx=0x7ff838008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:37.858+0000 7ff849600640 1 -- 172.21.15.99:0/3012173874 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff840059aa0 con 0x7ff834004d40 2024-09-10T07:35:38.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.071+0000 7ff853000640 1 -- 172.21.15.99:0/3012173874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff84c0d0e70 con 0x7ff834004d40 2024-09-10T07:35:38.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.935+0000 7ff849600640 1 -- 172.21.15.99:0/3012173874 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7ff8400593a0 con 0x7ff834004d40 2024-09-10T07:35:38.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 -- 172.21.15.99:0/3012173874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff82c06be30 msgr2=0x7ff82c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:38.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff82c06be30 0x7ff82c06e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff84c15e6b0 tx=0x7ff838008040 comp rx=0 tx=0).stop 2024-09-10T07:35:38.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 -- 172.21.15.99:0/3012173874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 msgr2=0x7ff84c09dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:38.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 0x7ff84c09dc40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff8400017e0 tx=0x7ff840007720 comp rx=0 tx=0).stop 2024-09-10T07:35:38.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 -- 172.21.15.99:0/3012173874 shutdown_connections 2024-09-10T07:35:38.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff84c0afc00 0x7ff84c150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:38.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff84c09c490 0x7ff84c161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:38.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff82c06be30 0x7ff82c06e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:38.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 --2- 172.21.15.99:0/3012173874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff834004d40 0x7ff84c09dc40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:38.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 -- 172.21.15.99:0/3012173874 >> 172.21.15.99:0/3012173874 conn(0x7ff84c0b6610 msgr2=0x7ff84c06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:38.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 -- 172.21.15.99:0/3012173874 shutdown_connections 2024-09-10T07:35:38.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:38.938+0000 7ff853000640 1 -- 172.21.15.99:0/3012173874 wait complete. 2024-09-10T07:35:38.954 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T07:35:38.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:35:39.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.113+0000 7f9acf200640 1 Processor -- start 2024-09-10T07:35:39.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.113+0000 7f9acf200640 1 -- start start 2024-09-10T07:35:39.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.114+0000 7f9acf200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 0x7f9ad015bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:39.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.114+0000 7f9acf200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ad006e450 0x7f9ad006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:39.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.114+0000 7f9acf200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad015d450 con 0x7f9ad0155c80 2024-09-10T07:35:39.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.114+0000 7f9acf200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad006ee00 con 0x7f9ad006e450 2024-09-10T07:35:39.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.114+0000 7f9acf200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad00723d0 con 0x7f9ad015bb80 2024-09-10T07:35:39.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.115+0000 7f9ace800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ad006e450 0x7f9ad006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:39.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.115+0000 7f9ace800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ad006e450 0x7f9ad006e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35306/0 (socket says 172.21.15.99:35306) 2024-09-10T07:35:39.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.115+0000 7f9ace800640 1 -- 172.21.15.99:0/3467944520 learned_addr learned my addr 172.21.15.99:0/3467944520 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.115+0000 7f9acd400640 1 --2- 172.21.15.99:0/3467944520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 0x7f9ad015bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.115+0000 7f9ace800640 1 -- 172.21.15.99:0/3467944520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 msgr2=0x7f9ad015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.115+0000 7f9ace800640 1 --2- 172.21.15.99:0/3467944520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 0x7f9ad015bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.115+0000 7f9ace800640 1 -- 172.21.15.99:0/3467944520 >> v1:172.21.15.187:6789/0 conn(0x7f9ad0155c80 legacy=0x7f9ad015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.115+0000 7f9ace800640 1 -- 172.21.15.99:0/3467944520 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad0156060 con 0x7f9ad006e450 2024-09-10T07:35:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.116+0000 7f9ace800640 1 --2- 172.21.15.99:0/3467944520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad006e450 0x7f9ad006e8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009e50 tx=0x7f9ac802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83509c9fb57536d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:39.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.116+0000 7f9acca00640 1 -- 172.21.15.99:0/3467944520 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8036070 con 0x7f9ad006e450 2024-09-10T07:35:39.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.116+0000 7f9acca00640 1 -- 172.21.15.99:0/3467944520 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac8031600 con 0x7f9ad006e450 2024-09-10T07:35:39.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.116+0000 7f9acca00640 1 -- 172.21.15.99:0/3467944520 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80319d0 con 0x7f9ad006e450 2024-09-10T07:35:39.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.117+0000 7f9acf200640 1 -- 172.21.15.99:0/3467944520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad006e450 msgr2=0x7f9ad006e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:39.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.117+0000 7f9acf200640 1 --2- 172.21.15.99:0/3467944520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad006e450 0x7f9ad006e8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009e50 tx=0x7f9ac802a710 comp rx=0 tx=0).stop 2024-09-10T07:35:39.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.117+0000 7f9acf200640 1 -- 172.21.15.99:0/3467944520 shutdown_connections 2024-09-10T07:35:39.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.117+0000 7f9acf200640 1 --2- 172.21.15.99:0/3467944520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad006e450 0x7f9ad006e8c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:39.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.117+0000 7f9acf200640 1 --2- 172.21.15.99:0/3467944520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 0x7f9ad015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:39.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.117+0000 7f9acf200640 1 -- 172.21.15.99:0/3467944520 >> 172.21.15.99:0/3467944520 conn(0x7f9ad00b2810 msgr2=0x7f9ad00b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:39.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.117+0000 7f9acf200640 1 -- 172.21.15.99:0/3467944520 shutdown_connections 2024-09-10T07:35:39.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.117+0000 7f9acf200640 1 -- 172.21.15.99:0/3467944520 wait complete. 2024-09-10T07:35:39.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.119+0000 7f9acf200640 1 Processor -- start 2024-09-10T07:35:39.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.119+0000 7f9acf200640 1 -- start start 2024-09-10T07:35:39.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acf200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ad006e450 0x7f9ad0157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:39.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acf200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad0155c80 0x7f9ad01e4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:39.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acf200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 0x7f9ad0156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:39.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acf200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad0072620 con 0x7f9ad0155c80 2024-09-10T07:35:39.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acf200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad015c9d0 con 0x7f9ad006e450 2024-09-10T07:35:39.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acf200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad0072900 con 0x7f9ad015bb80 2024-09-10T07:35:39.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad0155c80 0x7f9ad01e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:39.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad0155c80 0x7f9ad01e4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35320/0 (socket says 172.21.15.99:35320) 2024-09-10T07:35:39.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acd400640 1 -- 172.21.15.99:0/2361936945 learned_addr learned my addr 172.21.15.99:0/2361936945 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9ace800640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 0x7f9ad0156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acde00640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ad006e450 0x7f9ad0157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acd400640 1 -- 172.21.15.99:0/2361936945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 msgr2=0x7f9ad0156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acd400640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 0x7f9ad0156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acd400640 1 -- 172.21.15.99:0/2361936945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ad006e450 msgr2=0x7f9ad0157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acd400640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ad006e450 0x7f9ad0157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9acd400640 1 -- 172.21.15.99:0/2361936945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad01e46a0 con 0x7f9ad0155c80 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.120+0000 7f9ace800640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 0x7f9ad0156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.121+0000 7f9acd400640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad0155c80 0x7f9ad01e4160 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00d800 tx=0x7f9abc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.121+0000 7f9ac6000640 1 -- 172.21.15.99:0/2361936945 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc004020 con 0x7f9ad0155c80 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.121+0000 7f9ac6000640 1 -- 172.21.15.99:0/2361936945 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc0041c0 con 0x7f9ad0155c80 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.121+0000 7f9acf200640 1 -- 172.21.15.99:0/2361936945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad0156c00 con 0x7f9ad0155c80 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.121+0000 7f9ac6000640 1 -- 172.21.15.99:0/2361936945 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc004390 con 0x7f9ad0155c80 2024-09-10T07:35:39.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.121+0000 7f9acf200640 1 -- 172.21.15.99:0/2361936945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad01571c0 con 0x7f9ad0155c80 2024-09-10T07:35:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.122+0000 7f9acf200640 1 -- 172.21.15.99:0/2361936945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad006e8c0 con 0x7f9ad0155c80 2024-09-10T07:35:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.123+0000 7f9ac6000640 1 -- 172.21.15.99:0/2361936945 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9abc01b020 con 0x7f9ad0155c80 2024-09-10T07:35:39.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.124+0000 7f9ac6000640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ab006be60 0x7f9ab006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:39.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.124+0000 7f9ac6000640 1 -- 172.21.15.99:0/2361936945 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f9abc08ab80 con 0x7f9ad0155c80 2024-09-10T07:35:39.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.124+0000 7f9acde00640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ab006be60 0x7f9ab006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:39.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.125+0000 7f9acde00640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ab006be60 0x7f9ab006e320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00016e0 tx=0x7f9ac0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:39.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.129+0000 7f9ac6000640 1 -- 172.21.15.99:0/2361936945 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9abc059520 con 0x7f9ad0155c80 2024-09-10T07:35:39.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.338+0000 7f9acf200640 1 -- 172.21.15.99:0/2361936945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9ad00aefa0 con 0x7f9ad0155c80 2024-09-10T07:35:39.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.938+0000 7f9ac6000640 1 -- 172.21.15.99:0/2361936945 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7f9abc058e20 con 0x7f9ad0155c80 2024-09-10T07:35:39.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.940+0000 7f9acf200640 1 -- 172.21.15.99:0/2361936945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ab006be60 msgr2=0x7f9ab006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.940+0000 7f9acf200640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ab006be60 0x7f9ab006e320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00016e0 tx=0x7f9ac0009040 comp rx=0 tx=0).stop 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.940+0000 7f9acf200640 1 -- 172.21.15.99:0/2361936945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad0155c80 msgr2=0x7f9ad01e4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.940+0000 7f9acf200640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad0155c80 0x7f9ad01e4160 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00d800 tx=0x7f9abc00dcc0 comp rx=0 tx=0).stop 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.940+0000 7f9acf200640 1 -- 172.21.15.99:0/2361936945 shutdown_connections 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.940+0000 7f9acf200640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ad015bb80 0x7f9ad0156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.940+0000 7f9acf200640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ab006be60 0x7f9ab006e320 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.940+0000 7f9acf200640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ad0155c80 0x7f9ad01e4160 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.940+0000 7f9acf200640 1 --2- 172.21.15.99:0/2361936945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ad006e450 0x7f9ad0157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.940+0000 7f9acf200640 1 -- 172.21.15.99:0/2361936945 >> 172.21.15.99:0/2361936945 conn(0x7f9ad00b2810 msgr2=0x7f9ad00b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.941+0000 7f9acf200640 1 -- 172.21.15.99:0/2361936945 shutdown_connections 2024-09-10T07:35:39.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:39.941+0000 7f9acf200640 1 -- 172.21.15.99:0/2361936945 wait complete. 2024-09-10T07:35:39.957 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:35:39.958 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:40.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.113+0000 7fc41ca00640 1 Processor -- start 2024-09-10T07:35:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.114+0000 7fc41ca00640 1 -- start start 2024-09-10T07:35:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.115+0000 7fc41ca00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41813fae0 0x7fc41806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.115+0000 7fc41ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc418142650 con 0x7fc418160c50 2024-09-10T07:35:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.115+0000 7fc41ca00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc418142930 con 0x7fc418142150 2024-09-10T07:35:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.115+0000 7fc41ca00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc4180ce780 con 0x7fc41813fae0 2024-09-10T07:35:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.115+0000 7fc416800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc418160c50 0x7fc4180cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40380/0 (socket says 172.21.15.99:40380) 2024-09-10T07:35:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.115+0000 7fc416800640 1 -- 172.21.15.99:0/2107897492 learned_addr learned my addr 172.21.15.99:0/2107897492 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.115+0000 7fc415e00640 1 --2- 172.21.15.99:0/2107897492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41813fae0 0x7fc41806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.116+0000 7fc415400640 1 -- 172.21.15.99:0/2107897492 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761548160 0 0) 0x7fc418142650 con 0x7fc418160c50 2024-09-10T07:35:40.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.116+0000 7fc415400640 1 -- 172.21.15.99:0/2107897492 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3fc003520 con 0x7fc418160c50 2024-09-10T07:35:40.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.116+0000 7fc415400640 1 -- 172.21.15.99:0/2107897492 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1223324961 0 0) 0x7fc418142930 con 0x7fc418142150 2024-09-10T07:35:40.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.116+0000 7fc415400640 1 -- 172.21.15.99:0/2107897492 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc418142650 con 0x7fc418142150 2024-09-10T07:35:40.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.116+0000 7fc415e00640 1 -- 172.21.15.99:0/2107897492 >> v1:172.21.15.187:6789/0 conn(0x7fc418142150 legacy=0x7fc418160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.116+0000 7fc415e00640 1 -- 172.21.15.99:0/2107897492 >> v1:172.21.15.99:6789/0 conn(0x7fc418160c50 legacy=0x7fc4180cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.116+0000 7fc415e00640 1 -- 172.21.15.99:0/2107897492 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc418142c10 con 0x7fc41813fae0 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.117+0000 7fc415e00640 1 --2- 172.21.15.99:0/2107897492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41813fae0 0x7fc41806f1b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc4080097d0 tx=0x7fc40802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1428a7d0a1d6645 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.117+0000 7fc415400640 1 -- 172.21.15.99:0/2107897492 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408037070 con 0x7fc41813fae0 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.117+0000 7fc415400640 1 -- 172.21.15.99:0/2107897492 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc408032440 con 0x7fc41813fae0 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.117+0000 7fc415400640 1 -- 172.21.15.99:0/2107897492 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408032810 con 0x7fc41813fae0 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.118+0000 7fc41ca00640 1 -- 172.21.15.99:0/2107897492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41813fae0 msgr2=0x7fc41806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.118+0000 7fc41ca00640 1 --2- 172.21.15.99:0/2107897492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41813fae0 0x7fc41806f1b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc4080097d0 tx=0x7fc40802a180 comp rx=0 tx=0).stop 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.118+0000 7fc41ca00640 1 -- 172.21.15.99:0/2107897492 shutdown_connections 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.118+0000 7fc41ca00640 1 --2- 172.21.15.99:0/2107897492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41813fae0 0x7fc41806f1b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.118+0000 7fc41ca00640 1 -- 172.21.15.99:0/2107897492 >> 172.21.15.99:0/2107897492 conn(0x7fc41806bc10 msgr2=0x7fc41806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.118+0000 7fc41ca00640 1 -- 172.21.15.99:0/2107897492 shutdown_connections 2024-09-10T07:35:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.118+0000 7fc41ca00640 1 -- 172.21.15.99:0/2107897492 wait complete. 2024-09-10T07:35:40.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.119+0000 7fc41ca00640 1 Processor -- start 2024-09-10T07:35:40.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.120+0000 7fc41ca00640 1 -- start start 2024-09-10T07:35:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.120+0000 7fc41ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc41813fae0 0x7fc4180b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc41ca00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc418142150 0x7fc4180b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc41ca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc418160c50 0x7fc4181458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc41ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc41806f870 con 0x7fc41813fae0 2024-09-10T07:35:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc41ca00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc41806f6f0 con 0x7fc418160c50 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc41ca00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc4180cf320 con 0x7fc418142150 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc415e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc41813fae0 0x7fc4180b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc415e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc41813fae0 0x7fc4180b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59814/0 (socket says 172.21.15.99:59814) 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc415e00640 1 -- 172.21.15.99:0/564106682 learned_addr learned my addr 172.21.15.99:0/564106682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc416800640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc418160c50 0x7fc4181458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc415e00640 1 -- 172.21.15.99:0/564106682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc418142150 msgr2=0x7fc4180b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc40d400640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc418142150 0x7fc4180b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc415e00640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc418142150 0x7fc4180b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc415e00640 1 -- 172.21.15.99:0/564106682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc418160c50 msgr2=0x7fc4181458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc415e00640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc418160c50 0x7fc4181458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc415e00640 1 -- 172.21.15.99:0/564106682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4180b4380 con 0x7fc41813fae0 2024-09-10T07:35:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc416800640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc418160c50 0x7fc4181458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.121+0000 7fc40d400640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc418142150 0x7fc4180b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.122+0000 7fc415e00640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc41813fae0 0x7fc4180b5420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc4080097d0 tx=0x7fc4080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.122+0000 7fc40ea00640 1 -- 172.21.15.99:0/564106682 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408041070 con 0x7fc41813fae0 2024-09-10T07:35:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.122+0000 7fc40ea00640 1 -- 172.21.15.99:0/564106682 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40803c890 con 0x7fc41813fae0 2024-09-10T07:35:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.122+0000 7fc41ca00640 1 -- 172.21.15.99:0/564106682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4180b4660 con 0x7fc41813fae0 2024-09-10T07:35:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.122+0000 7fc40ea00640 1 -- 172.21.15.99:0/564106682 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408037040 con 0x7fc41813fae0 2024-09-10T07:35:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.122+0000 7fc41ca00640 1 -- 172.21.15.99:0/564106682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4180b4c20 con 0x7fc41813fae0 2024-09-10T07:35:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.123+0000 7fc41ca00640 1 -- 172.21.15.99:0/564106682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41806f1b0 con 0x7fc41813fae0 2024-09-10T07:35:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.124+0000 7fc40ea00640 1 -- 172.21.15.99:0/564106682 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc408044070 con 0x7fc41813fae0 2024-09-10T07:35:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.125+0000 7fc40ea00640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3f406be60 0x7fc3f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.125+0000 7fc40ea00640 1 -- 172.21.15.99:0/564106682 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fc4080ab990 con 0x7fc41813fae0 2024-09-10T07:35:40.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.125+0000 7fc40d400640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3f406be60 0x7fc3f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.126+0000 7fc40d400640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3f406be60 0x7fc3f406e320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc4180691c0 tx=0x7fc400009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:40.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.129+0000 7fc40ea00640 1 -- 172.21.15.99:0/564106682 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc40807a450 con 0x7fc41813fae0 2024-09-10T07:35:40.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.335+0000 7fc41ca00640 1 -- 172.21.15.99:0/564106682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc41815edc0 con 0x7fc41813fae0 2024-09-10T07:35:40.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.336+0000 7fc40ea00640 1 -- 172.21.15.99:0/564106682 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5226 (secure 0 0 0) 0x7fc408079d50 con 0x7fc41813fae0 2024-09-10T07:35:40.335 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:40.335 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"btime":"2024-09-10T07:35:39:936250+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2667247037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2667247037},{"type":"v1","addr":"172.21.15.99:6836","nonce":2667247037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/588885740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":588885740},{"type":"v1","addr":"172.21.15.187:6834","nonce":588885740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2599063325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2599063325},{"type":"v1","addr":"172.21.15.187:6835","nonce":2599063325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:36.307304+0000","modified":"2024-09-10T07:35:39.339225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1015333121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1015333121},{"type":"v1","addr":"172.21.15.99:6837","nonce":1015333121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":3}]} 2024-09-10T07:35:40.335 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 25 2024-09-10T07:35:40.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 -- 172.21.15.99:0/564106682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3f406be60 msgr2=0x7fc3f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3f406be60 0x7fc3f406e320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc4180691c0 tx=0x7fc400009040 comp rx=0 tx=0).stop 2024-09-10T07:35:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 -- 172.21.15.99:0/564106682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc41813fae0 msgr2=0x7fc4180b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc41813fae0 0x7fc4180b5420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc4080097d0 tx=0x7fc4080046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 -- 172.21.15.99:0/564106682 shutdown_connections 2024-09-10T07:35:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc418160c50 0x7fc4181458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc418142150 0x7fc4180b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3f406be60 0x7fc3f406e320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 --2- 172.21.15.99:0/564106682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc41813fae0 0x7fc4180b5420 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 -- 172.21.15.99:0/564106682 >> 172.21.15.99:0/564106682 conn(0x7fc41806bc10 msgr2=0x7fc4180cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.338+0000 7fc41ca00640 1 -- 172.21.15.99:0/564106682 shutdown_connections 2024-09-10T07:35:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.339+0000 7fc41ca00640 1 -- 172.21.15.99:0/564106682 wait complete. 2024-09-10T07:35:40.353 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:35:40.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.507+0000 7f4614c00640 1 Processor -- start 2024-09-10T07:35:40.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.507+0000 7f4614c00640 1 -- start start 2024-09-10T07:35:40.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4614c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f461013fae0 0x7f461006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4614c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4610142150 0x7f4610160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4614c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4610160a80 0x7f461015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4614c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f46100ce780 con 0x7f4610142150 2024-09-10T07:35:40.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4614c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f4610142650 con 0x7f4610160a80 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4614c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4610142930 con 0x7f461013fae0 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4605400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4610142150 0x7f4610160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4605400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4610142150 0x7f4610160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59820/0 (socket says 172.21.15.99:59820) 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4605400640 1 -- 172.21.15.99:0/3113748093 learned_addr learned my addr 172.21.15.99:0/3113748093 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f460e800640 1 --2- 172.21.15.99:0/3113748093 >> v2:172.21.15.187:3300/0 conn(0x7f4610160a80 0x7f461015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f460de00640 1 --2- 172.21.15.99:0/3113748093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f461013fae0 0x7f461006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4605400640 1 -- 172.21.15.99:0/3113748093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f461013fae0 msgr2=0x7f461006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4605400640 1 --2- 172.21.15.99:0/3113748093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f461013fae0 0x7f461006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4605400640 1 -- 172.21.15.99:0/3113748093 >> v2:172.21.15.187:3300/0 conn(0x7f4610160a80 msgr2=0x7f461015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4605400640 1 --2- 172.21.15.99:0/3113748093 >> v2:172.21.15.187:3300/0 conn(0x7f4610160a80 0x7f461015cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f4605400640 1 -- 172.21.15.99:0/3113748093 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4610142c10 con 0x7f4610142150 2024-09-10T07:35:40.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.509+0000 7f460e800640 1 --2- 172.21.15.99:0/3113748093 >> v2:172.21.15.187:3300/0 conn(0x7f4610160a80 0x7f461015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:40.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.510+0000 7f4605400640 1 --2- 172.21.15.99:0/3113748093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4610142150 0x7f4610160540 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f46100685a0 tx=0x7f45f802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770f6941cd52f573 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f460d400640 1 -- 172.21.15.99:0/3113748093 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8037070 con 0x7f4610142150 2024-09-10T07:35:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f460d400640 1 -- 172.21.15.99:0/3113748093 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f8032440 con 0x7f4610142150 2024-09-10T07:35:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f460d400640 1 -- 172.21.15.99:0/3113748093 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8032810 con 0x7f4610142150 2024-09-10T07:35:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f4614c00640 1 -- 172.21.15.99:0/3113748093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4610142150 msgr2=0x7f4610160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f4614c00640 1 --2- 172.21.15.99:0/3113748093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4610142150 0x7f4610160540 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f46100685a0 tx=0x7f45f802a140 comp rx=0 tx=0).stop 2024-09-10T07:35:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f4614c00640 1 -- 172.21.15.99:0/3113748093 shutdown_connections 2024-09-10T07:35:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f4614c00640 1 --2- 172.21.15.99:0/3113748093 >> v2:172.21.15.187:3300/0 conn(0x7f4610160a80 0x7f461015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f4614c00640 1 --2- 172.21.15.99:0/3113748093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4610142150 0x7f4610160540 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f4614c00640 1 --2- 172.21.15.99:0/3113748093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f461013fae0 0x7f461006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f4614c00640 1 -- 172.21.15.99:0/3113748093 >> 172.21.15.99:0/3113748093 conn(0x7f461006bc10 msgr2=0x7f461006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:40.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f4614c00640 1 -- 172.21.15.99:0/3113748093 shutdown_connections 2024-09-10T07:35:40.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.511+0000 7f4614c00640 1 -- 172.21.15.99:0/3113748093 wait complete. 2024-09-10T07:35:40.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.513+0000 7f4614c00640 1 Processor -- start 2024-09-10T07:35:40.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.513+0000 7f4614c00640 1 -- start start 2024-09-10T07:35:40.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.514+0000 7f4614c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f461013fae0 0x7f4610141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.514+0000 7f4614c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4610142150 0x7f46101f8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.514+0000 7f4614c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4610160a80 0x7f461013e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.514+0000 7f4614c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f461006f870 con 0x7f4610160a80 2024-09-10T07:35:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.514+0000 7f4614c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f461006f6f0 con 0x7f461013fae0 2024-09-10T07:35:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.514+0000 7f4614c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f461015d490 con 0x7f4610142150 2024-09-10T07:35:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f4605400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4610142150 0x7f46101f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f460e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4610160a80 0x7f461013e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f460de00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f461013fae0 0x7f4610141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f4605400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4610142150 0x7f46101f8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:35094/0 (socket says 172.21.15.99:35094) 2024-09-10T07:35:40.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f4605400640 1 -- 172.21.15.99:0/3723257215 learned_addr learned my addr 172.21.15.99:0/3723257215 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:40.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f460e800640 1 -- 172.21.15.99:0/3723257215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4610142150 msgr2=0x7f46101f8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f460e800640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4610142150 0x7f46101f8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f460e800640 1 -- 172.21.15.99:0/3723257215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f461013fae0 msgr2=0x7f4610141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f460e800640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f461013fae0 0x7f4610141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f460e800640 1 -- 172.21.15.99:0/3723257215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46101431d0 con 0x7f4610160a80 2024-09-10T07:35:40.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f460e800640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4610160a80 0x7f461013e860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4608007d70 tx=0x7f460800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:40.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.515+0000 7f4606a00640 1 -- 172.21.15.99:0/3723257215 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460801a070 con 0x7f4610160a80 2024-09-10T07:35:40.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.516+0000 7f4606a00640 1 -- 172.21.15.99:0/3723257215 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4608003990 con 0x7f4610160a80 2024-09-10T07:35:40.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.516+0000 7f4614c00640 1 -- 172.21.15.99:0/3723257215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46101f8e60 con 0x7f4610160a80 2024-09-10T07:35:40.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.516+0000 7f4606a00640 1 -- 172.21.15.99:0/3723257215 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608003d80 con 0x7f4610160a80 2024-09-10T07:35:40.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.516+0000 7f4614c00640 1 -- 172.21.15.99:0/3723257215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4610143750 con 0x7f4610160a80 2024-09-10T07:35:40.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.517+0000 7f4614c00640 1 -- 172.21.15.99:0/3723257215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4610160540 con 0x7f4610160a80 2024-09-10T07:35:40.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.518+0000 7f4606a00640 1 -- 172.21.15.99:0/3723257215 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f460801d070 con 0x7f4610160a80 2024-09-10T07:35:40.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.519+0000 7f4606a00640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45ec06be60 0x7f45ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.519+0000 7f4606a00640 1 -- 172.21.15.99:0/3723257215 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f460808aff0 con 0x7f4610160a80 2024-09-10T07:35:40.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.519+0000 7f460de00640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45ec06be60 0x7f45ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.519+0000 7f460de00640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45ec06be60 0x7f45ec06e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4600006fd0 tx=0x7f4600008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:40.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.523+0000 7f4606a00640 1 -- 172.21.15.99:0/3723257215 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4608010070 con 0x7f4610160a80 2024-09-10T07:35:40.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.701+0000 7f4614c00640 1 -- 172.21.15.99:0/3723257215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f461015fde0 con 0x7f4610160a80 2024-09-10T07:35:40.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.702+0000 7f4606a00640 1 -- 172.21.15.99:0/3723257215 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16649 (secure 0 0 0) 0x7f46080592d0 con 0x7f4610160a80 2024-09-10T07:35:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:40.702 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":44,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:35:37.911589+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:34.068514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:35.306080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:35:40.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.704+0000 7f4614c00640 1 -- 172.21.15.99:0/3723257215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45ec06be60 msgr2=0x7f45ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.704+0000 7f4614c00640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45ec06be60 0x7f45ec06e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4600006fd0 tx=0x7f4600008040 comp rx=0 tx=0).stop 2024-09-10T07:35:40.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.704+0000 7f4614c00640 1 -- 172.21.15.99:0/3723257215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4610160a80 msgr2=0x7f461013e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.704+0000 7f4614c00640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4610160a80 0x7f461013e860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4608007d70 tx=0x7f460800d4a0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.704+0000 7f4614c00640 1 -- 172.21.15.99:0/3723257215 shutdown_connections 2024-09-10T07:35:40.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.704+0000 7f4614c00640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45ec06be60 0x7f45ec06e320 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.704+0000 7f4614c00640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4610160a80 0x7f461013e860 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.704+0000 7f4614c00640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4610142150 0x7f46101f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.704+0000 7f4614c00640 1 --2- 172.21.15.99:0/3723257215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f461013fae0 0x7f4610141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.704+0000 7f4614c00640 1 -- 172.21.15.99:0/3723257215 >> 172.21.15.99:0/3723257215 conn(0x7f461006bc10 msgr2=0x7f461015e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:40.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.705+0000 7f4614c00640 1 -- 172.21.15.99:0/3723257215 shutdown_connections 2024-09-10T07:35:40.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.705+0000 7f4614c00640 1 -- 172.21.15.99:0/3723257215 wait complete. 2024-09-10T07:35:40.721 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:35:40.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:35:40.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.876+0000 7f7aa3800640 1 Processor -- start 2024-09-10T07:35:40.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.876+0000 7f7aa3800640 1 -- start start 2024-09-10T07:35:40.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.877+0000 7f7aa3800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7a9c072f40 0x7f7a9c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7aa3800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c06e3d0 con 0x7f7a9c145290 2024-09-10T07:35:40.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7aa3800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c06e6b0 con 0x7f7a9c0ce780 2024-09-10T07:35:40.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7aa3800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7a9c06efe0 con 0x7f7a9c072f40 2024-09-10T07:35:40.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7aa0e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7a9c145290 0x7f7a9c072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40384/0 (socket says 172.21.15.99:40384) 2024-09-10T07:35:40.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7aa0e00640 1 -- 172.21.15.99:0/4078394585 learned_addr learned my addr 172.21.15.99:0/4078394585 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:40.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7a93e00640 1 --2- 172.21.15.99:0/4078394585 >> v2:172.21.15.187:3300/0 conn(0x7f7a9c072f40 0x7f7a9c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7a9be00640 1 -- 172.21.15.99:0/4078394585 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632529902 0 0) 0x7f7a9c06e3d0 con 0x7f7a9c145290 2024-09-10T07:35:40.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7a9be00640 1 -- 172.21.15.99:0/4078394585 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a80003520 con 0x7f7a9c145290 2024-09-10T07:35:40.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7a93e00640 1 -- 172.21.15.99:0/4078394585 >> v1:172.21.15.187:6789/0 conn(0x7f7a9c0ce780 legacy=0x7f7a9c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7a93e00640 1 -- 172.21.15.99:0/4078394585 >> v1:172.21.15.99:6789/0 conn(0x7f7a9c145290 legacy=0x7f7a9c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.878+0000 7f7a93e00640 1 -- 172.21.15.99:0/4078394585 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c06e990 con 0x7f7a9c072f40 2024-09-10T07:35:40.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.880+0000 7f7a93e00640 1 --2- 172.21.15.99:0/4078394585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9c072f40 0x7f7a9c06f470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7a840097a0 tx=0x7f7a8402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82176e851856526e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:40.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.880+0000 7f7a9be00640 1 -- 172.21.15.99:0/4078394585 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84037070 con 0x7f7a9c072f40 2024-09-10T07:35:40.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.880+0000 7f7a9be00640 1 -- 172.21.15.99:0/4078394585 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a84032440 con 0x7f7a9c072f40 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.880+0000 7f7a9be00640 1 -- 172.21.15.99:0/4078394585 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84032810 con 0x7f7a9c072f40 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.881+0000 7f7aa3800640 1 -- 172.21.15.99:0/4078394585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9c072f40 msgr2=0x7f7a9c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.881+0000 7f7aa3800640 1 --2- 172.21.15.99:0/4078394585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9c072f40 0x7f7a9c06f470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7a840097a0 tx=0x7f7a8402a230 comp rx=0 tx=0).stop 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.881+0000 7f7aa3800640 1 -- 172.21.15.99:0/4078394585 shutdown_connections 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.881+0000 7f7aa3800640 1 --2- 172.21.15.99:0/4078394585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9c072f40 0x7f7a9c06f470 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.881+0000 7f7aa3800640 1 -- 172.21.15.99:0/4078394585 >> 172.21.15.99:0/4078394585 conn(0x7f7a9c06bc10 msgr2=0x7f7a9c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.881+0000 7f7aa3800640 1 -- 172.21.15.99:0/4078394585 shutdown_connections 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.881+0000 7f7aa3800640 1 -- 172.21.15.99:0/4078394585 wait complete. 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.882+0000 7f7aa3800640 1 Processor -- start 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.883+0000 7f7aa3800640 1 -- start start 2024-09-10T07:35:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.883+0000 7f7aa3800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9c072f40 0x7f7a9c15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.883+0000 7f7aa3800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a9c0ce780 0x7f7a9c15b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.883+0000 7f7aa3800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a9c145290 0x7f7a9c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.883+0000 7f7aa3800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c06df80 con 0x7f7a9c145290 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.883+0000 7f7aa3800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c145670 con 0x7f7a9c072f40 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.883+0000 7f7aa3800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9c06e100 con 0x7f7a9c0ce780 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a9c145290 0x7f7a9c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a9c145290 0x7f7a9c0cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59852/0 (socket says 172.21.15.99:59852) 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa1800640 1 -- 172.21.15.99:0/318185304 learned_addr learned my addr 172.21.15.99:0/318185304 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa0e00640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9c072f40 0x7f7a9c15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7a93e00640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a9c0ce780 0x7f7a9c15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa1800640 1 -- 172.21.15.99:0/318185304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a9c0ce780 msgr2=0x7f7a9c15b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa1800640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a9c0ce780 0x7f7a9c15b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa1800640 1 -- 172.21.15.99:0/318185304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9c072f40 msgr2=0x7f7a9c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa1800640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9c072f40 0x7f7a9c15a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa1800640 1 -- 172.21.15.99:0/318185304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c15daf0 con 0x7f7a9c145290 2024-09-10T07:35:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa0e00640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9c072f40 0x7f7a9c15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.884+0000 7f7aa1800640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a9c145290 0x7f7a9c0cb790 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c7a0 tx=0x7f7a9400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.885+0000 7f7a99600640 1 -- 172.21.15.99:0/318185304 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94003b70 con 0x7f7a9c145290 2024-09-10T07:35:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.885+0000 7f7a99600640 1 -- 172.21.15.99:0/318185304 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a94003d30 con 0x7f7a9c145290 2024-09-10T07:35:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.885+0000 7f7a99600640 1 -- 172.21.15.99:0/318185304 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9400aa90 con 0x7f7a9c145290 2024-09-10T07:35:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.885+0000 7f7aa3800640 1 -- 172.21.15.99:0/318185304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c15dd90 con 0x7f7a9c145290 2024-09-10T07:35:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.885+0000 7f7aa3800640 1 -- 172.21.15.99:0/318185304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9c15e350 con 0x7f7a9c145290 2024-09-10T07:35:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.886+0000 7f7aa3800640 1 -- 172.21.15.99:0/318185304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9c0715a0 con 0x7f7a9c145290 2024-09-10T07:35:40.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.887+0000 7f7a99600640 1 -- 172.21.15.99:0/318185304 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a9400ac30 con 0x7f7a9c145290 2024-09-10T07:35:40.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.888+0000 7f7a99600640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7806be30 0x7f7a7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:40.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.888+0000 7f7a99600640 1 -- 172.21.15.99:0/318185304 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f7a9408ae90 con 0x7f7a9c145290 2024-09-10T07:35:40.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.888+0000 7f7aa0e00640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7806be30 0x7f7a7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:40.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.888+0000 7f7aa0e00640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7806be30 0x7f7a7806e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c007fd0 tx=0x7f7a8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:40.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:40.892+0000 7f7a99600640 1 -- 172.21.15.99:0/318185304 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a940597a0 con 0x7f7a9c145290 2024-09-10T07:35:41.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.064+0000 7f7aa3800640 1 -- 172.21.15.99:0/318185304 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a9c072c80 con 0x7f7a7806be30 2024-09-10T07:35:41.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.070+0000 7f7a99600640 1 -- 172.21.15.99:0/318185304 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247488 (secure 0 0 0) 0x7f7a9c072c80 con 0x7f7a7806be30 2024-09-10T07:35:41.074 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:35:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.074+0000 7f7aa3800640 1 -- 172.21.15.99:0/318185304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7806be30 msgr2=0x7f7a7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.074+0000 7f7aa3800640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7806be30 0x7f7a7806e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c007fd0 tx=0x7f7a8c009040 comp rx=0 tx=0).stop 2024-09-10T07:35:41.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.074+0000 7f7aa3800640 1 -- 172.21.15.99:0/318185304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a9c145290 msgr2=0x7f7a9c0cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.074+0000 7f7aa3800640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a9c145290 0x7f7a9c0cb790 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c7a0 tx=0x7f7a9400cc60 comp rx=0 tx=0).stop 2024-09-10T07:35:41.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.074+0000 7f7aa3800640 1 -- 172.21.15.99:0/318185304 shutdown_connections 2024-09-10T07:35:41.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.074+0000 7f7aa3800640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7a7806be30 0x7f7a7806e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.074+0000 7f7aa3800640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a9c145290 0x7f7a9c0cb790 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.074+0000 7f7aa3800640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a9c0ce780 0x7f7a9c15b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.074+0000 7f7aa3800640 1 --2- 172.21.15.99:0/318185304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9c072f40 0x7f7a9c15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.074+0000 7f7aa3800640 1 -- 172.21.15.99:0/318185304 >> 172.21.15.99:0/318185304 conn(0x7f7a9c06bc10 msgr2=0x7f7a9c169280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:41.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.075+0000 7f7aa3800640 1 -- 172.21.15.99:0/318185304 shutdown_connections 2024-09-10T07:35:41.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.075+0000 7f7aa3800640 1 -- 172.21.15.99:0/318185304 wait complete. 2024-09-10T07:35:41.089 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-10T07:35:40.708108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2784,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559715,"statfs":{"total":1600000000,"available":1597148936,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.814709"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915908+0000","last_change":"2024-09-10T07:35:36.924358+0000","last_active":"2024-09-10T07:35:37.915908+0000","last_peered":"2024-09-10T07:35:37.915908+0000","last_clean":"2024-09-10T07:35:37.915908+0000","last_became_active":"2024-09-10T07:35:36.924115+0000","last_became_peered":"2024-09-10T07:35:36.924115+0000","last_unstale":"2024-09-10T07:35:37.915908+0000","last_undegraded":"2024-09-10T07:35:37.915908+0000","last_fullsized":"2024-09-10T07:35:37.915908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:45.202396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916035+0000","last_change":"2024-09-10T07:35:36.931707+0000","last_active":"2024-09-10T07:35:37.916035+0000","last_peered":"2024-09-10T07:35:37.916035+0000","last_clean":"2024-09-10T07:35:37.916035+0000","last_became_active":"2024-09-10T07:35:36.931464+0000","last_became_peered":"2024-09-10T07:35:36.931464+0000","last_unstale":"2024-09-10T07:35:37.916035+0000","last_undegraded":"2024-09-10T07:35:37.916035+0000","last_fullsized":"2024-09-10T07:35:37.916035+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:16.838083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931455+0000","last_change":"2024-09-10T07:35:36.927315+0000","last_active":"2024-09-10T07:35:37.931455+0000","last_peered":"2024-09-10T07:35:37.931455+0000","last_clean":"2024-09-10T07:35:37.931455+0000","last_became_active":"2024-09-10T07:35:36.924640+0000","last_became_peered":"2024-09-10T07:35:36.924640+0000","last_unstale":"2024-09-10T07:35:37.931455+0000","last_undegraded":"2024-09-10T07:35:37.931455+0000","last_fullsized":"2024-09-10T07:35:37.931455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:36.552344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274595+0000","last_change":"2024-09-10T07:35:36.933792+0000","last_active":"2024-09-10T07:35:38.274595+0000","last_peered":"2024-09-10T07:35:38.274595+0000","last_clean":"2024-09-10T07:35:38.274595+0000","last_became_active":"2024-09-10T07:35:36.933568+0000","last_became_peered":"2024-09-10T07:35:36.933568+0000","last_unstale":"2024-09-10T07:35:38.274595+0000","last_undegraded":"2024-09-10T07:35:38.274595+0000","last_fullsized":"2024-09-10T07:35:38.274595+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:14.291063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915854+0000","last_change":"2024-09-10T07:35:36.931976+0000","last_active":"2024-09-10T07:35:37.915854+0000","last_peered":"2024-09-10T07:35:37.915854+0000","last_clean":"2024-09-10T07:35:37.915854+0000","last_became_active":"2024-09-10T07:35:36.931722+0000","last_became_peered":"2024-09-10T07:35:36.931722+0000","last_unstale":"2024-09-10T07:35:37.915854+0000","last_undegraded":"2024-09-10T07:35:37.915854+0000","last_fullsized":"2024-09-10T07:35:37.915854+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:48.276501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930037+0000","last_change":"2024-09-10T07:35:36.926939+0000","last_active":"2024-09-10T07:35:37.930037+0000","last_peered":"2024-09-10T07:35:37.930037+0000","last_clean":"2024-09-10T07:35:37.930037+0000","last_became_active":"2024-09-10T07:35:36.926629+0000","last_became_peered":"2024-09-10T07:35:36.926629+0000","last_unstale":"2024-09-10T07:35:37.930037+0000","last_undegraded":"2024-09-10T07:35:37.930037+0000","last_fullsized":"2024-09-10T07:35:37.930037+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:58.170647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915560+0000","last_change":"2024-09-10T07:35:36.926859+0000","last_active":"2024-09-10T07:35:37.915560+0000","last_peered":"2024-09-10T07:35:37.915560+0000","last_clean":"2024-09-10T07:35:37.915560+0000","last_became_active":"2024-09-10T07:35:36.926628+0000","last_became_peered":"2024-09-10T07:35:36.926628+0000","last_unstale":"2024-09-10T07:35:37.915560+0000","last_undegraded":"2024-09-10T07:35:37.915560+0000","last_fullsized":"2024-09-10T07:35:37.915560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:37.385604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274680+0000","last_change":"2024-09-10T07:35:36.934092+0000","last_active":"2024-09-10T07:35:38.274680+0000","last_peered":"2024-09-10T07:35:38.274680+0000","last_clean":"2024-09-10T07:35:38.274680+0000","last_became_active":"2024-09-10T07:35:36.933849+0000","last_became_peered":"2024-09-10T07:35:36.933849+0000","last_unstale":"2024-09-10T07:35:38.274680+0000","last_undegraded":"2024-09-10T07:35:38.274680+0000","last_fullsized":"2024-09-10T07:35:38.274680+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:29.494031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274742+0000","last_change":"2024-09-10T07:35:36.932227+0000","last_active":"2024-09-10T07:35:38.274742+0000","last_peered":"2024-09-10T07:35:38.274742+0000","last_clean":"2024-09-10T07:35:38.274742+0000","last_became_active":"2024-09-10T07:35:36.928758+0000","last_became_peered":"2024-09-10T07:35:36.928758+0000","last_unstale":"2024-09-10T07:35:38.274742+0000","last_undegraded":"2024-09-10T07:35:38.274742+0000","last_fullsized":"2024-09-10T07:35:38.274742+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:45.074440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274533+0000","last_change":"2024-09-10T07:35:36.932038+0000","last_active":"2024-09-10T07:35:38.274533+0000","last_peered":"2024-09-10T07:35:38.274533+0000","last_clean":"2024-09-10T07:35:38.274533+0000","last_became_active":"2024-09-10T07:35:36.930860+0000","last_became_peered":"2024-09-10T07:35:36.930860+0000","last_unstale":"2024-09-10T07:35:38.274533+0000","last_undegraded":"2024-09-10T07:35:38.274533+0000","last_fullsized":"2024-09-10T07:35:38.274533+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:55.051398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275161+0000","last_change":"2024-09-10T07:35:36.930503+0000","last_active":"2024-09-10T07:35:38.275161+0000","last_peered":"2024-09-10T07:35:38.275161+0000","last_clean":"2024-09-10T07:35:38.275161+0000","last_became_active":"2024-09-10T07:35:36.930230+0000","last_became_peered":"2024-09-10T07:35:36.930230+0000","last_unstale":"2024-09-10T07:35:38.275161+0000","last_undegraded":"2024-09-10T07:35:38.275161+0000","last_fullsized":"2024-09-10T07:35:38.275161+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:03.051822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916120+0000","last_change":"2024-09-10T07:35:36.922095+0000","last_active":"2024-09-10T07:35:37.916120+0000","last_peered":"2024-09-10T07:35:37.916120+0000","last_clean":"2024-09-10T07:35:37.916120+0000","last_became_active":"2024-09-10T07:35:36.921839+0000","last_became_peered":"2024-09-10T07:35:36.921839+0000","last_unstale":"2024-09-10T07:35:37.916120+0000","last_undegraded":"2024-09-10T07:35:37.916120+0000","last_fullsized":"2024-09-10T07:35:37.916120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:22.559313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914632+0000","last_change":"2024-09-10T07:35:36.923736+0000","last_active":"2024-09-10T07:35:37.914632+0000","last_peered":"2024-09-10T07:35:37.914632+0000","last_clean":"2024-09-10T07:35:37.914632+0000","last_became_active":"2024-09-10T07:35:36.923394+0000","last_became_peered":"2024-09-10T07:35:36.923394+0000","last_unstale":"2024-09-10T07:35:37.914632+0000","last_undegraded":"2024-09-10T07:35:37.914632+0000","last_fullsized":"2024-09-10T07:35:37.914632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:05.404342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275131+0000","last_change":"2024-09-10T07:35:36.933232+0000","last_active":"2024-09-10T07:35:38.275131+0000","last_peered":"2024-09-10T07:35:38.275131+0000","last_clean":"2024-09-10T07:35:38.275131+0000","last_became_active":"2024-09-10T07:35:36.929696+0000","last_became_peered":"2024-09-10T07:35:36.929696+0000","last_unstale":"2024-09-10T07:35:38.275131+0000","last_undegraded":"2024-09-10T07:35:38.275131+0000","last_fullsized":"2024-09-10T07:35:38.275131+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:31.562594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.929943+0000","last_change":"2024-09-10T07:35:36.931656+0000","last_active":"2024-09-10T07:35:37.929943+0000","last_peered":"2024-09-10T07:35:37.929943+0000","last_clean":"2024-09-10T07:35:37.929943+0000","last_became_active":"2024-09-10T07:35:36.931391+0000","last_became_peered":"2024-09-10T07:35:36.931391+0000","last_unstale":"2024-09-10T07:35:37.929943+0000","last_undegraded":"2024-09-10T07:35:37.929943+0000","last_fullsized":"2024-09-10T07:35:37.929943+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:58.894795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274519+0000","last_change":"2024-09-10T07:35:36.933116+0000","last_active":"2024-09-10T07:35:38.274519+0000","last_peered":"2024-09-10T07:35:38.274519+0000","last_clean":"2024-09-10T07:35:38.274519+0000","last_became_active":"2024-09-10T07:35:36.932552+0000","last_became_peered":"2024-09-10T07:35:36.932552+0000","last_unstale":"2024-09-10T07:35:38.274519+0000","last_undegraded":"2024-09-10T07:35:38.274519+0000","last_fullsized":"2024-09-10T07:35:38.274519+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:56.884870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931251+0000","last_change":"2024-09-10T07:35:36.918543+0000","last_active":"2024-09-10T07:35:37.931251+0000","last_peered":"2024-09-10T07:35:37.931251+0000","last_clean":"2024-09-10T07:35:37.931251+0000","last_became_active":"2024-09-10T07:35:36.918306+0000","last_became_peered":"2024-09-10T07:35:36.918306+0000","last_unstale":"2024-09-10T07:35:37.931251+0000","last_undegraded":"2024-09-10T07:35:37.931251+0000","last_fullsized":"2024-09-10T07:35:37.931251+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:34.228702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931757+0000","last_change":"2024-09-10T07:35:36.921174+0000","last_active":"2024-09-10T07:35:37.931757+0000","last_peered":"2024-09-10T07:35:37.931757+0000","last_clean":"2024-09-10T07:35:37.931757+0000","last_became_active":"2024-09-10T07:35:36.920899+0000","last_became_peered":"2024-09-10T07:35:36.920899+0000","last_unstale":"2024-09-10T07:35:37.931757+0000","last_undegraded":"2024-09-10T07:35:37.931757+0000","last_fullsized":"2024-09-10T07:35:37.931757+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:12.306241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274984+0000","last_change":"2024-09-10T07:35:36.931122+0000","last_active":"2024-09-10T07:35:38.274984+0000","last_peered":"2024-09-10T07:35:38.274984+0000","last_clean":"2024-09-10T07:35:38.274984+0000","last_became_active":"2024-09-10T07:35:36.930896+0000","last_became_peered":"2024-09-10T07:35:36.930896+0000","last_unstale":"2024-09-10T07:35:38.274984+0000","last_undegraded":"2024-09-10T07:35:38.274984+0000","last_fullsized":"2024-09-10T07:35:38.274984+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:01.224996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914577+0000","last_change":"2024-09-10T07:35:36.926035+0000","last_active":"2024-09-10T07:35:37.914577+0000","last_peered":"2024-09-10T07:35:37.914577+0000","last_clean":"2024-09-10T07:35:37.914577+0000","last_became_active":"2024-09-10T07:35:36.925795+0000","last_became_peered":"2024-09-10T07:35:36.925795+0000","last_unstale":"2024-09-10T07:35:37.914577+0000","last_undegraded":"2024-09-10T07:35:37.914577+0000","last_fullsized":"2024-09-10T07:35:37.914577+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:48.365959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930138+0000","last_change":"2024-09-10T07:35:36.932207+0000","last_active":"2024-09-10T07:35:37.930138+0000","last_peered":"2024-09-10T07:35:37.930138+0000","last_clean":"2024-09-10T07:35:37.930138+0000","last_became_active":"2024-09-10T07:35:36.931805+0000","last_became_peered":"2024-09-10T07:35:36.931805+0000","last_unstale":"2024-09-10T07:35:37.930138+0000","last_undegraded":"2024-09-10T07:35:37.930138+0000","last_fullsized":"2024-09-10T07:35:37.930138+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:54.389918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274991+0000","last_change":"2024-09-10T07:35:36.936061+0000","last_active":"2024-09-10T07:35:38.274991+0000","last_peered":"2024-09-10T07:35:38.274991+0000","last_clean":"2024-09-10T07:35:38.274991+0000","last_became_active":"2024-09-10T07:35:36.935573+0000","last_became_peered":"2024-09-10T07:35:36.935573+0000","last_unstale":"2024-09-10T07:35:38.274991+0000","last_undegraded":"2024-09-10T07:35:38.274991+0000","last_fullsized":"2024-09-10T07:35:38.274991+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:13.337852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274970+0000","last_change":"2024-09-10T07:35:36.930510+0000","last_active":"2024-09-10T07:35:38.274970+0000","last_peered":"2024-09-10T07:35:38.274970+0000","last_clean":"2024-09-10T07:35:38.274970+0000","last_became_active":"2024-09-10T07:35:36.929880+0000","last_became_peered":"2024-09-10T07:35:36.929880+0000","last_unstale":"2024-09-10T07:35:38.274970+0000","last_undegraded":"2024-09-10T07:35:38.274970+0000","last_fullsized":"2024-09-10T07:35:38.274970+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:47.051457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274466+0000","last_change":"2024-09-10T07:35:36.928897+0000","last_active":"2024-09-10T07:35:38.274466+0000","last_peered":"2024-09-10T07:35:38.274466+0000","last_clean":"2024-09-10T07:35:38.274466+0000","last_became_active":"2024-09-10T07:35:36.926249+0000","last_became_peered":"2024-09-10T07:35:36.926249+0000","last_unstale":"2024-09-10T07:35:38.274466+0000","last_undegraded":"2024-09-10T07:35:38.274466+0000","last_fullsized":"2024-09-10T07:35:38.274466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:55.813827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274819+0000","last_change":"2024-09-10T07:35:36.931785+0000","last_active":"2024-09-10T07:35:38.274819+0000","last_peered":"2024-09-10T07:35:38.274819+0000","last_clean":"2024-09-10T07:35:38.274819+0000","last_became_active":"2024-09-10T07:35:36.931559+0000","last_became_peered":"2024-09-10T07:35:36.931559+0000","last_unstale":"2024-09-10T07:35:38.274819+0000","last_undegraded":"2024-09-10T07:35:38.274819+0000","last_fullsized":"2024-09-10T07:35:38.274819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:52.820457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914628+0000","last_change":"2024-09-10T07:35:36.922866+0000","last_active":"2024-09-10T07:35:37.914628+0000","last_peered":"2024-09-10T07:35:37.914628+0000","last_clean":"2024-09-10T07:35:37.914628+0000","last_became_active":"2024-09-10T07:35:36.922595+0000","last_became_peered":"2024-09-10T07:35:36.922595+0000","last_unstale":"2024-09-10T07:35:37.914628+0000","last_undegraded":"2024-09-10T07:35:37.914628+0000","last_fullsized":"2024-09-10T07:35:37.914628+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:11.265422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931431+0000","last_change":"2024-09-10T07:35:36.920227+0000","last_active":"2024-09-10T07:35:37.931431+0000","last_peered":"2024-09-10T07:35:37.931431+0000","last_clean":"2024-09-10T07:35:37.931431+0000","last_became_active":"2024-09-10T07:35:36.919983+0000","last_became_peered":"2024-09-10T07:35:36.919983+0000","last_unstale":"2024-09-10T07:35:37.931431+0000","last_undegraded":"2024-09-10T07:35:37.931431+0000","last_fullsized":"2024-09-10T07:35:37.931431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:39.576091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915468+0000","last_change":"2024-09-10T07:35:36.923805+0000","last_active":"2024-09-10T07:35:37.915468+0000","last_peered":"2024-09-10T07:35:37.915468+0000","last_clean":"2024-09-10T07:35:37.915468+0000","last_became_active":"2024-09-10T07:35:36.923048+0000","last_became_peered":"2024-09-10T07:35:36.923048+0000","last_unstale":"2024-09-10T07:35:37.915468+0000","last_undegraded":"2024-09-10T07:35:37.915468+0000","last_fullsized":"2024-09-10T07:35:37.915468+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:54.287057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274676+0000","last_change":"2024-09-10T07:35:36.934719+0000","last_active":"2024-09-10T07:35:38.274676+0000","last_peered":"2024-09-10T07:35:38.274676+0000","last_clean":"2024-09-10T07:35:38.274676+0000","last_became_active":"2024-09-10T07:35:36.934469+0000","last_became_peered":"2024-09-10T07:35:36.934469+0000","last_unstale":"2024-09-10T07:35:38.274676+0000","last_undegraded":"2024-09-10T07:35:38.274676+0000","last_fullsized":"2024-09-10T07:35:38.274676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:05.220762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931387+0000","last_change":"2024-09-10T07:35:36.924052+0000","last_active":"2024-09-10T07:35:37.931387+0000","last_peered":"2024-09-10T07:35:37.931387+0000","last_clean":"2024-09-10T07:35:37.931387+0000","last_became_active":"2024-09-10T07:35:36.923709+0000","last_became_peered":"2024-09-10T07:35:36.923709+0000","last_unstale":"2024-09-10T07:35:37.931387+0000","last_undegraded":"2024-09-10T07:35:37.931387+0000","last_fullsized":"2024-09-10T07:35:37.931387+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:45.700845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930221+0000","last_change":"2024-09-10T07:35:36.927988+0000","last_active":"2024-09-10T07:35:37.930221+0000","last_peered":"2024-09-10T07:35:37.930221+0000","last_clean":"2024-09-10T07:35:37.930221+0000","last_became_active":"2024-09-10T07:35:36.927722+0000","last_became_peered":"2024-09-10T07:35:36.927722+0000","last_unstale":"2024-09-10T07:35:37.930221+0000","last_undegraded":"2024-09-10T07:35:37.930221+0000","last_fullsized":"2024-09-10T07:35:37.930221+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:05.096436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914608+0000","last_change":"2024-09-10T07:35:36.928825+0000","last_active":"2024-09-10T07:35:37.914608+0000","last_peered":"2024-09-10T07:35:37.914608+0000","last_clean":"2024-09-10T07:35:37.914608+0000","last_became_active":"2024-09-10T07:35:36.928607+0000","last_became_peered":"2024-09-10T07:35:36.928607+0000","last_unstale":"2024-09-10T07:35:37.914608+0000","last_undegraded":"2024-09-10T07:35:37.914608+0000","last_fullsized":"2024-09-10T07:35:37.914608+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:39.633956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274587+0000","last_change":"2024-09-10T07:35:36.932253+0000","last_active":"2024-09-10T07:35:38.274587+0000","last_peered":"2024-09-10T07:35:38.274587+0000","last_clean":"2024-09-10T07:35:38.274587+0000","last_became_active":"2024-09-10T07:35:36.928450+0000","last_became_peered":"2024-09-10T07:35:36.928450+0000","last_unstale":"2024-09-10T07:35:38.274587+0000","last_undegraded":"2024-09-10T07:35:38.274587+0000","last_fullsized":"2024-09-10T07:35:38.274587+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:45:13.830680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.929972+0000","last_change":"2024-09-10T07:35:35.905690+0000","last_active":"2024-09-10T07:35:37.929972+0000","last_peered":"2024-09-10T07:35:37.929972+0000","last_clean":"2024-09-10T07:35:37.929972+0000","last_became_active":"2024-09-10T07:35:35.905419+0000","last_became_peered":"2024-09-10T07:35:35.905419+0000","last_unstale":"2024-09-10T07:35:37.929972+0000","last_undegraded":"2024-09-10T07:35:37.929972+0000","last_fullsized":"2024-09-10T07:35:37.929972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:49.443786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274807+0000","last_change":"2024-09-10T07:35:36.930323+0000","last_active":"2024-09-10T07:35:38.274807+0000","last_peered":"2024-09-10T07:35:38.274807+0000","last_clean":"2024-09-10T07:35:38.274807+0000","last_became_active":"2024-09-10T07:35:36.929202+0000","last_became_peered":"2024-09-10T07:35:36.929202+0000","last_unstale":"2024-09-10T07:35:38.274807+0000","last_undegraded":"2024-09-10T07:35:38.274807+0000","last_fullsized":"2024-09-10T07:35:38.274807+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:19.995575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931237+0000","last_change":"2024-09-10T07:35:35.907834+0000","last_active":"2024-09-10T07:35:37.931237+0000","last_peered":"2024-09-10T07:35:37.931237+0000","last_clean":"2024-09-10T07:35:37.931237+0000","last_became_active":"2024-09-10T07:35:35.906933+0000","last_became_peered":"2024-09-10T07:35:35.906933+0000","last_unstale":"2024-09-10T07:35:37.931237+0000","last_undegraded":"2024-09-10T07:35:37.931237+0000","last_fullsized":"2024-09-10T07:35:37.931237+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:41.397733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915896+0000","last_change":"2024-09-10T07:35:36.926169+0000","last_active":"2024-09-10T07:35:37.915896+0000","last_peered":"2024-09-10T07:35:37.915896+0000","last_clean":"2024-09-10T07:35:37.915896+0000","last_became_active":"2024-09-10T07:35:36.922393+0000","last_became_peered":"2024-09-10T07:35:36.922393+0000","last_unstale":"2024-09-10T07:35:37.915896+0000","last_undegraded":"2024-09-10T07:35:37.915896+0000","last_fullsized":"2024-09-10T07:35:37.915896+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:26.094887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274756+0000","last_change":"2024-09-10T07:35:35.901954+0000","last_active":"2024-09-10T07:35:38.274756+0000","last_peered":"2024-09-10T07:35:38.274756+0000","last_clean":"2024-09-10T07:35:38.274756+0000","last_became_active":"2024-09-10T07:35:35.901368+0000","last_became_peered":"2024-09-10T07:35:35.901368+0000","last_unstale":"2024-09-10T07:35:38.274756+0000","last_undegraded":"2024-09-10T07:35:38.274756+0000","last_fullsized":"2024-09-10T07:35:38.274756+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:15:22.056416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274597+0000","last_change":"2024-09-10T07:35:36.933135+0000","last_active":"2024-09-10T07:35:38.274597+0000","last_peered":"2024-09-10T07:35:38.274597+0000","last_clean":"2024-09-10T07:35:38.274597+0000","last_became_active":"2024-09-10T07:35:36.932896+0000","last_became_peered":"2024-09-10T07:35:36.932896+0000","last_unstale":"2024-09-10T07:35:38.274597+0000","last_undegraded":"2024-09-10T07:35:38.274597+0000","last_fullsized":"2024-09-10T07:35:38.274597+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:49.294414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916142+0000","last_change":"2024-09-10T07:35:35.908615+0000","last_active":"2024-09-10T07:35:37.916142+0000","last_peered":"2024-09-10T07:35:37.916142+0000","last_clean":"2024-09-10T07:35:37.916142+0000","last_became_active":"2024-09-10T07:35:35.908258+0000","last_became_peered":"2024-09-10T07:35:35.908258+0000","last_unstale":"2024-09-10T07:35:37.916142+0000","last_undegraded":"2024-09-10T07:35:37.916142+0000","last_fullsized":"2024-09-10T07:35:37.916142+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:12.491155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931307+0000","last_change":"2024-09-10T07:35:36.929340+0000","last_active":"2024-09-10T07:35:37.931307+0000","last_peered":"2024-09-10T07:35:37.931307+0000","last_clean":"2024-09-10T07:35:37.931307+0000","last_became_active":"2024-09-10T07:35:36.929105+0000","last_became_peered":"2024-09-10T07:35:36.929105+0000","last_unstale":"2024-09-10T07:35:37.931307+0000","last_undegraded":"2024-09-10T07:35:37.931307+0000","last_fullsized":"2024-09-10T07:35:37.931307+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:47.855898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930148+0000","last_change":"2024-09-10T07:35:35.910294+0000","last_active":"2024-09-10T07:35:37.930148+0000","last_peered":"2024-09-10T07:35:37.930148+0000","last_clean":"2024-09-10T07:35:37.930148+0000","last_became_active":"2024-09-10T07:35:35.909337+0000","last_became_peered":"2024-09-10T07:35:35.909337+0000","last_unstale":"2024-09-10T07:35:37.930148+0000","last_undegraded":"2024-09-10T07:35:37.930148+0000","last_fullsized":"2024-09-10T07:35:37.930148+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:54.392147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275157+0000","last_change":"2024-09-10T07:35:36.927825+0000","last_active":"2024-09-10T07:35:38.275157+0000","last_peered":"2024-09-10T07:35:38.275157+0000","last_clean":"2024-09-10T07:35:38.275157+0000","last_became_active":"2024-09-10T07:35:36.926050+0000","last_became_peered":"2024-09-10T07:35:36.926050+0000","last_unstale":"2024-09-10T07:35:38.275157+0000","last_undegraded":"2024-09-10T07:35:38.275157+0000","last_fullsized":"2024-09-10T07:35:38.275157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:15.367815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931812+0000","last_change":"2024-09-10T07:35:35.907116+0000","last_active":"2024-09-10T07:35:37.931812+0000","last_peered":"2024-09-10T07:35:37.931812+0000","last_clean":"2024-09-10T07:35:37.931812+0000","last_became_active":"2024-09-10T07:35:35.906787+0000","last_became_peered":"2024-09-10T07:35:35.906787+0000","last_unstale":"2024-09-10T07:35:37.931812+0000","last_undegraded":"2024-09-10T07:35:37.931812+0000","last_fullsized":"2024-09-10T07:35:37.931812+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:06.418763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274628+0000","last_change":"2024-09-10T07:35:36.934516+0000","last_active":"2024-09-10T07:35:38.274628+0000","last_peered":"2024-09-10T07:35:38.274628+0000","last_clean":"2024-09-10T07:35:38.274628+0000","last_became_active":"2024-09-10T07:35:36.934002+0000","last_became_peered":"2024-09-10T07:35:36.934002+0000","last_unstale":"2024-09-10T07:35:38.274628+0000","last_undegraded":"2024-09-10T07:35:38.274628+0000","last_fullsized":"2024-09-10T07:35:38.274628+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:55.235277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915195+0000","last_change":"2024-09-10T07:35:35.900666+0000","last_active":"2024-09-10T07:35:37.915195+0000","last_peered":"2024-09-10T07:35:37.915195+0000","last_clean":"2024-09-10T07:35:37.915195+0000","last_became_active":"2024-09-10T07:35:35.899068+0000","last_became_peered":"2024-09-10T07:35:35.899068+0000","last_unstale":"2024-09-10T07:35:37.915195+0000","last_undegraded":"2024-09-10T07:35:37.915195+0000","last_fullsized":"2024-09-10T07:35:37.915195+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:41.457946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274851+0000","last_change":"2024-09-10T07:35:36.924232+0000","last_active":"2024-09-10T07:35:38.274851+0000","last_peered":"2024-09-10T07:35:38.274851+0000","last_clean":"2024-09-10T07:35:38.274851+0000","last_became_active":"2024-09-10T07:35:36.923901+0000","last_became_peered":"2024-09-10T07:35:36.923901+0000","last_unstale":"2024-09-10T07:35:38.274851+0000","last_undegraded":"2024-09-10T07:35:38.274851+0000","last_fullsized":"2024-09-10T07:35:38.274851+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:05.369762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275119+0000","last_change":"2024-09-10T07:35:35.908791+0000","last_active":"2024-09-10T07:35:38.275119+0000","last_peered":"2024-09-10T07:35:38.275119+0000","last_clean":"2024-09-10T07:35:38.275119+0000","last_became_active":"2024-09-10T07:35:35.908082+0000","last_became_peered":"2024-09-10T07:35:35.908082+0000","last_unstale":"2024-09-10T07:35:38.275119+0000","last_undegraded":"2024-09-10T07:35:38.275119+0000","last_fullsized":"2024-09-10T07:35:38.275119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:18.324916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931573+0000","last_change":"2024-09-10T07:35:36.931740+0000","last_active":"2024-09-10T07:35:37.931573+0000","last_peered":"2024-09-10T07:35:37.931573+0000","last_clean":"2024-09-10T07:35:37.931573+0000","last_became_active":"2024-09-10T07:35:36.931513+0000","last_became_peered":"2024-09-10T07:35:36.931513+0000","last_unstale":"2024-09-10T07:35:37.931573+0000","last_undegraded":"2024-09-10T07:35:37.931573+0000","last_fullsized":"2024-09-10T07:35:37.931573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:20.634264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931281+0000","last_change":"2024-09-10T07:35:35.908951+0000","last_active":"2024-09-10T07:35:37.931281+0000","last_peered":"2024-09-10T07:35:37.931281+0000","last_clean":"2024-09-10T07:35:37.931281+0000","last_became_active":"2024-09-10T07:35:35.905178+0000","last_became_peered":"2024-09-10T07:35:35.905178+0000","last_unstale":"2024-09-10T07:35:37.931281+0000","last_undegraded":"2024-09-10T07:35:37.931281+0000","last_fullsized":"2024-09-10T07:35:37.931281+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:22.838684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916045+0000","last_change":"2024-09-10T07:35:36.928734+0000","last_active":"2024-09-10T07:35:37.916045+0000","last_peered":"2024-09-10T07:35:37.916045+0000","last_clean":"2024-09-10T07:35:37.916045+0000","last_became_active":"2024-09-10T07:35:36.928510+0000","last_became_peered":"2024-09-10T07:35:36.928510+0000","last_unstale":"2024-09-10T07:35:37.916045+0000","last_undegraded":"2024-09-10T07:35:37.916045+0000","last_fullsized":"2024-09-10T07:35:37.916045+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:07.043020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275298+0000","last_change":"2024-09-10T07:35:35.907691+0000","last_active":"2024-09-10T07:35:38.275298+0000","last_peered":"2024-09-10T07:35:38.275298+0000","last_clean":"2024-09-10T07:35:38.275298+0000","last_became_active":"2024-09-10T07:35:35.907468+0000","last_became_peered":"2024-09-10T07:35:35.907468+0000","last_unstale":"2024-09-10T07:35:38.275298+0000","last_undegraded":"2024-09-10T07:35:38.275298+0000","last_fullsized":"2024-09-10T07:35:38.275298+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:24.597062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930053+0000","last_change":"2024-09-10T07:35:36.924488+0000","last_active":"2024-09-10T07:35:37.930053+0000","last_peered":"2024-09-10T07:35:37.930053+0000","last_clean":"2024-09-10T07:35:37.930053+0000","last_became_active":"2024-09-10T07:35:36.924071+0000","last_became_peered":"2024-09-10T07:35:36.924071+0000","last_unstale":"2024-09-10T07:35:37.930053+0000","last_undegraded":"2024-09-10T07:35:37.930053+0000","last_fullsized":"2024-09-10T07:35:37.930053+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:33.499679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915467+0000","last_change":"2024-09-10T07:35:35.910125+0000","last_active":"2024-09-10T07:35:37.915467+0000","last_peered":"2024-09-10T07:35:37.915467+0000","last_clean":"2024-09-10T07:35:37.915467+0000","last_became_active":"2024-09-10T07:35:35.909907+0000","last_became_peered":"2024-09-10T07:35:35.909907+0000","last_unstale":"2024-09-10T07:35:37.915467+0000","last_undegraded":"2024-09-10T07:35:37.915467+0000","last_fullsized":"2024-09-10T07:35:37.915467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:42.697888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915304+0000","last_change":"2024-09-10T07:35:36.927721+0000","last_active":"2024-09-10T07:35:37.915304+0000","last_peered":"2024-09-10T07:35:37.915304+0000","last_clean":"2024-09-10T07:35:37.915304+0000","last_became_active":"2024-09-10T07:35:36.926310+0000","last_became_peered":"2024-09-10T07:35:36.926310+0000","last_unstale":"2024-09-10T07:35:37.915304+0000","last_undegraded":"2024-09-10T07:35:37.915304+0000","last_fullsized":"2024-09-10T07:35:37.915304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:25.129861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914516+0000","last_change":"2024-09-10T07:35:35.908716+0000","last_active":"2024-09-10T07:35:37.914516+0000","last_peered":"2024-09-10T07:35:37.914516+0000","last_clean":"2024-09-10T07:35:37.914516+0000","last_became_active":"2024-09-10T07:35:35.908458+0000","last_became_peered":"2024-09-10T07:35:35.908458+0000","last_unstale":"2024-09-10T07:35:37.914516+0000","last_undegraded":"2024-09-10T07:35:37.914516+0000","last_fullsized":"2024-09-10T07:35:37.914516+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:16.209256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274668+0000","last_change":"2024-09-10T07:35:36.932814+0000","last_active":"2024-09-10T07:35:38.274668+0000","last_peered":"2024-09-10T07:35:38.274668+0000","last_clean":"2024-09-10T07:35:38.274668+0000","last_became_active":"2024-09-10T07:35:36.932230+0000","last_became_peered":"2024-09-10T07:35:36.932230+0000","last_unstale":"2024-09-10T07:35:38.274668+0000","last_undegraded":"2024-09-10T07:35:38.274668+0000","last_fullsized":"2024-09-10T07:35:38.274668+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:22.298976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930048+0000","last_change":"2024-09-10T07:35:35.902063+0000","last_active":"2024-09-10T07:35:37.930048+0000","last_peered":"2024-09-10T07:35:37.930048+0000","last_clean":"2024-09-10T07:35:37.930048+0000","last_became_active":"2024-09-10T07:35:35.901419+0000","last_became_peered":"2024-09-10T07:35:35.901419+0000","last_unstale":"2024-09-10T07:35:37.930048+0000","last_undegraded":"2024-09-10T07:35:37.930048+0000","last_fullsized":"2024-09-10T07:35:37.930048+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:16.166092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274707+0000","last_change":"2024-09-10T07:35:36.931507+0000","last_active":"2024-09-10T07:35:38.274707+0000","last_peered":"2024-09-10T07:35:38.274707+0000","last_clean":"2024-09-10T07:35:38.274707+0000","last_became_active":"2024-09-10T07:35:36.930078+0000","last_became_peered":"2024-09-10T07:35:36.930078+0000","last_unstale":"2024-09-10T07:35:38.274707+0000","last_undegraded":"2024-09-10T07:35:38.274707+0000","last_fullsized":"2024-09-10T07:35:38.274707+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:47.366907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916242+0000","last_change":"2024-09-10T07:35:35.912465+0000","last_active":"2024-09-10T07:35:37.916242+0000","last_peered":"2024-09-10T07:35:37.916242+0000","last_clean":"2024-09-10T07:35:37.916242+0000","last_became_active":"2024-09-10T07:35:35.911707+0000","last_became_peered":"2024-09-10T07:35:35.911707+0000","last_unstale":"2024-09-10T07:35:37.916242+0000","last_undegraded":"2024-09-10T07:35:37.916242+0000","last_fullsized":"2024-09-10T07:35:37.916242+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:34.437653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.929869+0000","last_change":"2024-09-10T07:35:36.933450+0000","last_active":"2024-09-10T07:35:37.929869+0000","last_peered":"2024-09-10T07:35:37.929869+0000","last_clean":"2024-09-10T07:35:37.929869+0000","last_became_active":"2024-09-10T07:35:36.932905+0000","last_became_peered":"2024-09-10T07:35:36.932905+0000","last_unstale":"2024-09-10T07:35:37.929869+0000","last_undegraded":"2024-09-10T07:35:37.929869+0000","last_fullsized":"2024-09-10T07:35:37.929869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.258172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930244+0000","last_change":"2024-09-10T07:35:35.909825+0000","last_active":"2024-09-10T07:35:37.930244+0000","last_peered":"2024-09-10T07:35:37.930244+0000","last_clean":"2024-09-10T07:35:37.930244+0000","last_became_active":"2024-09-10T07:35:35.906567+0000","last_became_peered":"2024-09-10T07:35:35.906567+0000","last_unstale":"2024-09-10T07:35:37.930244+0000","last_undegraded":"2024-09-10T07:35:37.930244+0000","last_fullsized":"2024-09-10T07:35:37.930244+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:20.215343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915711+0000","last_change":"2024-09-10T07:35:36.930611+0000","last_active":"2024-09-10T07:35:37.915711+0000","last_peered":"2024-09-10T07:35:37.915711+0000","last_clean":"2024-09-10T07:35:37.915711+0000","last_became_active":"2024-09-10T07:35:36.930371+0000","last_became_peered":"2024-09-10T07:35:36.930371+0000","last_unstale":"2024-09-10T07:35:37.915711+0000","last_undegraded":"2024-09-10T07:35:37.915711+0000","last_fullsized":"2024-09-10T07:35:37.915711+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:12.024482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274938+0000","last_change":"2024-09-10T07:35:35.903986+0000","last_active":"2024-09-10T07:35:38.274938+0000","last_peered":"2024-09-10T07:35:38.274938+0000","last_clean":"2024-09-10T07:35:38.274938+0000","last_became_active":"2024-09-10T07:35:35.903429+0000","last_became_peered":"2024-09-10T07:35:35.903429+0000","last_unstale":"2024-09-10T07:35:38.274938+0000","last_undegraded":"2024-09-10T07:35:38.274938+0000","last_fullsized":"2024-09-10T07:35:38.274938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:09.960106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914731+0000","last_change":"2024-09-10T07:35:36.916833+0000","last_active":"2024-09-10T07:35:37.914731+0000","last_peered":"2024-09-10T07:35:37.914731+0000","last_clean":"2024-09-10T07:35:37.914731+0000","last_became_active":"2024-09-10T07:35:36.916203+0000","last_became_peered":"2024-09-10T07:35:36.916203+0000","last_unstale":"2024-09-10T07:35:37.914731+0000","last_undegraded":"2024-09-10T07:35:37.914731+0000","last_fullsized":"2024-09-10T07:35:37.914731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:04.538200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914634+0000","last_change":"2024-09-10T07:35:35.899707+0000","last_active":"2024-09-10T07:35:37.914634+0000","last_peered":"2024-09-10T07:35:37.914634+0000","last_clean":"2024-09-10T07:35:37.914634+0000","last_became_active":"2024-09-10T07:35:35.898895+0000","last_became_peered":"2024-09-10T07:35:35.898895+0000","last_unstale":"2024-09-10T07:35:37.914634+0000","last_undegraded":"2024-09-10T07:35:37.914634+0000","last_fullsized":"2024-09-10T07:35:37.914634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:16.228853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274893+0000","last_change":"2024-09-10T07:35:36.925325+0000","last_active":"2024-09-10T07:35:38.274893+0000","last_peered":"2024-09-10T07:35:38.274893+0000","last_clean":"2024-09-10T07:35:38.274893+0000","last_became_active":"2024-09-10T07:35:36.920641+0000","last_became_peered":"2024-09-10T07:35:36.920641+0000","last_unstale":"2024-09-10T07:35:38.274893+0000","last_undegraded":"2024-09-10T07:35:38.274893+0000","last_fullsized":"2024-09-10T07:35:38.274893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:40.290820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931454+0000","last_change":"2024-09-10T07:35:35.910572+0000","last_active":"2024-09-10T07:35:37.931454+0000","last_peered":"2024-09-10T07:35:37.931454+0000","last_clean":"2024-09-10T07:35:37.931454+0000","last_became_active":"2024-09-10T07:35:35.910334+0000","last_became_peered":"2024-09-10T07:35:35.910334+0000","last_unstale":"2024-09-10T07:35:37.931454+0000","last_undegraded":"2024-09-10T07:35:37.931454+0000","last_fullsized":"2024-09-10T07:35:37.931454+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:12.810964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274539+0000","last_change":"2024-09-10T07:35:36.929561+0000","last_active":"2024-09-10T07:35:38.274539+0000","last_peered":"2024-09-10T07:35:38.274539+0000","last_clean":"2024-09-10T07:35:38.274539+0000","last_became_active":"2024-09-10T07:35:36.929210+0000","last_became_peered":"2024-09-10T07:35:36.929210+0000","last_unstale":"2024-09-10T07:35:38.274539+0000","last_undegraded":"2024-09-10T07:35:38.274539+0000","last_fullsized":"2024-09-10T07:35:38.274539+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:21.241326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916009+0000","last_change":"2024-09-10T07:35:35.900987+0000","last_active":"2024-09-10T07:35:37.916009+0000","last_peered":"2024-09-10T07:35:37.916009+0000","last_clean":"2024-09-10T07:35:37.916009+0000","last_became_active":"2024-09-10T07:35:35.900599+0000","last_became_peered":"2024-09-10T07:35:35.900599+0000","last_unstale":"2024-09-10T07:35:37.916009+0000","last_undegraded":"2024-09-10T07:35:37.916009+0000","last_fullsized":"2024-09-10T07:35:37.916009+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:15.127522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274795+0000","last_change":"2024-09-10T07:35:36.930077+0000","last_active":"2024-09-10T07:35:38.274795+0000","last_peered":"2024-09-10T07:35:38.274795+0000","last_clean":"2024-09-10T07:35:38.274795+0000","last_became_active":"2024-09-10T07:35:36.929756+0000","last_became_peered":"2024-09-10T07:35:36.929756+0000","last_unstale":"2024-09-10T07:35:38.274795+0000","last_undegraded":"2024-09-10T07:35:38.274795+0000","last_fullsized":"2024-09-10T07:35:38.274795+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:54.118454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930296+0000","last_change":"2024-09-10T07:35:35.910018+0000","last_active":"2024-09-10T07:35:37.930296+0000","last_peered":"2024-09-10T07:35:37.930296+0000","last_clean":"2024-09-10T07:35:37.930296+0000","last_became_active":"2024-09-10T07:35:35.906871+0000","last_became_peered":"2024-09-10T07:35:35.906871+0000","last_unstale":"2024-09-10T07:35:37.930296+0000","last_undegraded":"2024-09-10T07:35:37.930296+0000","last_fullsized":"2024-09-10T07:35:37.930296+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.634391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.929898+0000","last_change":"2024-09-10T07:35:36.924301+0000","last_active":"2024-09-10T07:35:37.929898+0000","last_peered":"2024-09-10T07:35:37.929898+0000","last_clean":"2024-09-10T07:35:37.929898+0000","last_became_active":"2024-09-10T07:35:36.923746+0000","last_became_peered":"2024-09-10T07:35:36.923746+0000","last_unstale":"2024-09-10T07:35:37.929898+0000","last_undegraded":"2024-09-10T07:35:37.929898+0000","last_fullsized":"2024-09-10T07:35:37.929898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:19.879130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930153+0000","last_change":"2024-09-10T07:35:35.908053+0000","last_active":"2024-09-10T07:35:37.930153+0000","last_peered":"2024-09-10T07:35:37.930153+0000","last_clean":"2024-09-10T07:35:37.930153+0000","last_became_active":"2024-09-10T07:35:35.907561+0000","last_became_peered":"2024-09-10T07:35:35.907561+0000","last_unstale":"2024-09-10T07:35:37.930153+0000","last_undegraded":"2024-09-10T07:35:37.930153+0000","last_fullsized":"2024-09-10T07:35:37.930153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:50.971004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274410+0000","last_change":"2024-09-10T07:35:36.926174+0000","last_active":"2024-09-10T07:35:38.274410+0000","last_peered":"2024-09-10T07:35:38.274410+0000","last_clean":"2024-09-10T07:35:38.274410+0000","last_became_active":"2024-09-10T07:35:36.925948+0000","last_became_peered":"2024-09-10T07:35:36.925948+0000","last_unstale":"2024-09-10T07:35:38.274410+0000","last_undegraded":"2024-09-10T07:35:38.274410+0000","last_fullsized":"2024-09-10T07:35:38.274410+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:08.641350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915289+0000","last_change":"2024-09-10T07:35:35.905925+0000","last_active":"2024-09-10T07:35:37.915289+0000","last_peered":"2024-09-10T07:35:37.915289+0000","last_clean":"2024-09-10T07:35:37.915289+0000","last_became_active":"2024-09-10T07:35:35.905661+0000","last_became_peered":"2024-09-10T07:35:35.905661+0000","last_unstale":"2024-09-10T07:35:37.915289+0000","last_undegraded":"2024-09-10T07:35:37.915289+0000","last_fullsized":"2024-09-10T07:35:37.915289+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:13.364802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914756+0000","last_change":"2024-09-10T07:35:36.924458+0000","last_active":"2024-09-10T07:35:37.914756+0000","last_peered":"2024-09-10T07:35:37.914756+0000","last_clean":"2024-09-10T07:35:37.914756+0000","last_became_active":"2024-09-10T07:35:36.924248+0000","last_became_peered":"2024-09-10T07:35:36.924248+0000","last_unstale":"2024-09-10T07:35:37.914756+0000","last_undegraded":"2024-09-10T07:35:37.914756+0000","last_fullsized":"2024-09-10T07:35:37.914756+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.627353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275173+0000","last_change":"2024-09-10T07:35:35.909044+0000","last_active":"2024-09-10T07:35:38.275173+0000","last_peered":"2024-09-10T07:35:38.275173+0000","last_clean":"2024-09-10T07:35:38.275173+0000","last_became_active":"2024-09-10T07:35:35.908406+0000","last_became_peered":"2024-09-10T07:35:35.908406+0000","last_unstale":"2024-09-10T07:35:38.275173+0000","last_undegraded":"2024-09-10T07:35:38.275173+0000","last_fullsized":"2024-09-10T07:35:38.275173+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:33.712629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274786+0000","last_change":"2024-09-10T07:35:36.934262+0000","last_active":"2024-09-10T07:35:38.274786+0000","last_peered":"2024-09-10T07:35:38.274786+0000","last_clean":"2024-09-10T07:35:38.274786+0000","last_became_active":"2024-09-10T07:35:36.931262+0000","last_became_peered":"2024-09-10T07:35:36.931262+0000","last_unstale":"2024-09-10T07:35:38.274786+0000","last_undegraded":"2024-09-10T07:35:38.274786+0000","last_fullsized":"2024-09-10T07:35:38.274786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:16.348775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916318+0000","last_change":"2024-09-10T07:35:35.912705+0000","last_active":"2024-09-10T07:35:37.916318+0000","last_peered":"2024-09-10T07:35:37.916318+0000","last_clean":"2024-09-10T07:35:37.916318+0000","last_became_active":"2024-09-10T07:35:35.912031+0000","last_became_peered":"2024-09-10T07:35:35.912031+0000","last_unstale":"2024-09-10T07:35:37.916318+0000","last_undegraded":"2024-09-10T07:35:37.916318+0000","last_fullsized":"2024-09-10T07:35:37.916318+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:04.082370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274674+0000","last_change":"2024-09-10T07:35:36.939356+0000","last_active":"2024-09-10T07:35:38.274674+0000","last_peered":"2024-09-10T07:35:38.274674+0000","last_clean":"2024-09-10T07:35:38.274674+0000","last_became_active":"2024-09-10T07:35:36.938996+0000","last_became_peered":"2024-09-10T07:35:36.938996+0000","last_unstale":"2024-09-10T07:35:38.274674+0000","last_undegraded":"2024-09-10T07:35:38.274674+0000","last_fullsized":"2024-09-10T07:35:38.274674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:14.694557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931409+0000","last_change":"2024-09-10T07:35:35.908743+0000","last_active":"2024-09-10T07:35:37.931409+0000","last_peered":"2024-09-10T07:35:37.931409+0000","last_clean":"2024-09-10T07:35:37.931409+0000","last_became_active":"2024-09-10T07:35:35.908528+0000","last_became_peered":"2024-09-10T07:35:35.908528+0000","last_unstale":"2024-09-10T07:35:37.931409+0000","last_undegraded":"2024-09-10T07:35:37.931409+0000","last_fullsized":"2024-09-10T07:35:37.931409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:25.413316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274868+0000","last_change":"2024-09-10T07:35:36.931712+0000","last_active":"2024-09-10T07:35:38.274868+0000","last_peered":"2024-09-10T07:35:38.274868+0000","last_clean":"2024-09-10T07:35:38.274868+0000","last_became_active":"2024-09-10T07:35:36.930414+0000","last_became_peered":"2024-09-10T07:35:36.930414+0000","last_unstale":"2024-09-10T07:35:38.274868+0000","last_undegraded":"2024-09-10T07:35:38.274868+0000","last_fullsized":"2024-09-10T07:35:38.274868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:06.750865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915293+0000","last_change":"2024-09-10T07:35:35.910970+0000","last_active":"2024-09-10T07:35:37.915293+0000","last_peered":"2024-09-10T07:35:37.915293+0000","last_clean":"2024-09-10T07:35:37.915293+0000","last_became_active":"2024-09-10T07:35:35.910727+0000","last_became_peered":"2024-09-10T07:35:35.910727+0000","last_unstale":"2024-09-10T07:35:37.915293+0000","last_undegraded":"2024-09-10T07:35:37.915293+0000","last_fullsized":"2024-09-10T07:35:37.915293+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:47.207369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915199+0000","last_change":"2024-09-10T07:35:36.925811+0000","last_active":"2024-09-10T07:35:37.915199+0000","last_peered":"2024-09-10T07:35:37.915199+0000","last_clean":"2024-09-10T07:35:37.915199+0000","last_became_active":"2024-09-10T07:35:36.923216+0000","last_became_peered":"2024-09-10T07:35:36.923216+0000","last_unstale":"2024-09-10T07:35:37.915199+0000","last_undegraded":"2024-09-10T07:35:37.915199+0000","last_fullsized":"2024-09-10T07:35:37.915199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:37.579608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274840+0000","last_change":"2024-09-10T07:35:35.902140+0000","last_active":"2024-09-10T07:35:38.274840+0000","last_peered":"2024-09-10T07:35:38.274840+0000","last_clean":"2024-09-10T07:35:38.274840+0000","last_became_active":"2024-09-10T07:35:35.901722+0000","last_became_peered":"2024-09-10T07:35:35.901722+0000","last_unstale":"2024-09-10T07:35:38.274840+0000","last_undegraded":"2024-09-10T07:35:38.274840+0000","last_fullsized":"2024-09-10T07:35:38.274840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:12.982261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.929975+0000","last_change":"2024-09-10T07:35:36.929232+0000","last_active":"2024-09-10T07:35:37.929975+0000","last_peered":"2024-09-10T07:35:37.929975+0000","last_clean":"2024-09-10T07:35:37.929975+0000","last_became_active":"2024-09-10T07:35:36.928982+0000","last_became_peered":"2024-09-10T07:35:36.928982+0000","last_unstale":"2024-09-10T07:35:37.929975+0000","last_undegraded":"2024-09-10T07:35:37.929975+0000","last_fullsized":"2024-09-10T07:35:37.929975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:43.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916395+0000","last_change":"2024-09-10T07:35:35.912263+0000","last_active":"2024-09-10T07:35:37.916395+0000","last_peered":"2024-09-10T07:35:37.916395+0000","last_clean":"2024-09-10T07:35:37.916395+0000","last_became_active":"2024-09-10T07:35:35.911368+0000","last_became_peered":"2024-09-10T07:35:35.911368+0000","last_unstale":"2024-09-10T07:35:37.916395+0000","last_undegraded":"2024-09-10T07:35:37.916395+0000","last_fullsized":"2024-09-10T07:35:37.916395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:23.367938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930300+0000","last_change":"2024-09-10T07:35:36.932023+0000","last_active":"2024-09-10T07:35:37.930300+0000","last_peered":"2024-09-10T07:35:37.930300+0000","last_clean":"2024-09-10T07:35:37.930300+0000","last_became_active":"2024-09-10T07:35:36.931442+0000","last_became_peered":"2024-09-10T07:35:36.931442+0000","last_unstale":"2024-09-10T07:35:37.930300+0000","last_undegraded":"2024-09-10T07:35:37.930300+0000","last_fullsized":"2024-09-10T07:35:37.930300+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:43.637992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931658+0000","last_change":"2024-09-10T07:35:35.911168+0000","last_active":"2024-09-10T07:35:37.931658+0000","last_peered":"2024-09-10T07:35:37.931658+0000","last_clean":"2024-09-10T07:35:37.931658+0000","last_became_active":"2024-09-10T07:35:35.910928+0000","last_became_peered":"2024-09-10T07:35:35.910928+0000","last_unstale":"2024-09-10T07:35:37.931658+0000","last_undegraded":"2024-09-10T07:35:37.931658+0000","last_fullsized":"2024-09-10T07:35:37.931658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:19.721602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915068+0000","last_change":"2024-09-10T07:35:36.926994+0000","last_active":"2024-09-10T07:35:37.915068+0000","last_peered":"2024-09-10T07:35:37.915068+0000","last_clean":"2024-09-10T07:35:37.915068+0000","last_became_active":"2024-09-10T07:35:36.926704+0000","last_became_peered":"2024-09-10T07:35:36.926704+0000","last_unstale":"2024-09-10T07:35:37.915068+0000","last_undegraded":"2024-09-10T07:35:37.915068+0000","last_fullsized":"2024-09-10T07:35:37.915068+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:28.651763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274506+0000","last_change":"2024-09-10T07:35:35.905288+0000","last_active":"2024-09-10T07:35:38.274506+0000","last_peered":"2024-09-10T07:35:38.274506+0000","last_clean":"2024-09-10T07:35:38.274506+0000","last_became_active":"2024-09-10T07:35:35.903073+0000","last_became_peered":"2024-09-10T07:35:35.903073+0000","last_unstale":"2024-09-10T07:35:38.274506+0000","last_undegraded":"2024-09-10T07:35:38.274506+0000","last_fullsized":"2024-09-10T07:35:38.274506+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:22.140704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931579+0000","last_change":"2024-09-10T07:35:36.923008+0000","last_active":"2024-09-10T07:35:37.931579+0000","last_peered":"2024-09-10T07:35:37.931579+0000","last_clean":"2024-09-10T07:35:37.931579+0000","last_became_active":"2024-09-10T07:35:36.922749+0000","last_became_peered":"2024-09-10T07:35:36.922749+0000","last_unstale":"2024-09-10T07:35:37.931579+0000","last_undegraded":"2024-09-10T07:35:37.931579+0000","last_fullsized":"2024-09-10T07:35:37.931579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:42.862274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274991+0000","last_change":"2024-09-10T07:35:35.905864+0000","last_active":"2024-09-10T07:35:38.274991+0000","last_peered":"2024-09-10T07:35:38.274991+0000","last_clean":"2024-09-10T07:35:38.274991+0000","last_became_active":"2024-09-10T07:35:35.905605+0000","last_became_peered":"2024-09-10T07:35:35.905605+0000","last_unstale":"2024-09-10T07:35:38.274991+0000","last_undegraded":"2024-09-10T07:35:38.274991+0000","last_fullsized":"2024-09-10T07:35:38.274991+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:11.042735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274829+0000","last_change":"2024-09-10T07:35:36.922930+0000","last_active":"2024-09-10T07:35:38.274829+0000","last_peered":"2024-09-10T07:35:38.274829+0000","last_clean":"2024-09-10T07:35:38.274829+0000","last_became_active":"2024-09-10T07:35:36.922701+0000","last_became_peered":"2024-09-10T07:35:36.922701+0000","last_unstale":"2024-09-10T07:35:38.274829+0000","last_undegraded":"2024-09-10T07:35:38.274829+0000","last_fullsized":"2024-09-10T07:35:38.274829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:46.309619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916241+0000","last_change":"2024-09-10T07:35:35.899846+0000","last_active":"2024-09-10T07:35:37.916241+0000","last_peered":"2024-09-10T07:35:37.916241+0000","last_clean":"2024-09-10T07:35:37.916241+0000","last_became_active":"2024-09-10T07:35:35.899137+0000","last_became_peered":"2024-09-10T07:35:35.899137+0000","last_unstale":"2024-09-10T07:35:37.916241+0000","last_undegraded":"2024-09-10T07:35:37.916241+0000","last_fullsized":"2024-09-10T07:35:37.916241+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:56.960451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":213,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915345+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:35:37.915345+0000","last_peered":"2024-09-10T07:35:37.915345+0000","last_clean":"2024-09-10T07:35:37.915345+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:35:37.915345+0000","last_undegraded":"2024-09-10T07:35:37.915345+0000","last_fullsized":"2024-09-10T07:35:37.915345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":780,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194531,"statfs":{"total":200000000,"available":199200566,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195107,"statfs":{"total":200000000,"available":199790352,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195108,"statfs":{"total":200000000,"available":199790954,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195106,"statfs":{"total":200000000,"available":199789412,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195107,"statfs":{"total":200000000,"available":199790386,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195106,"statfs":{"total":200000000,"available":199789390,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195114,"statfs":{"total":200000000,"available":199797254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":780,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194531,"statfs":{"total":200000000,"available":199200622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:35:41.094 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:35:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.285+0000 7f15e3000640 1 Processor -- start 2024-09-10T07:35:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.285+0000 7f15e3000640 1 -- start start 2024-09-10T07:35:41.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.286+0000 7f15e3000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f15dc145290 0x7f15dc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.286+0000 7f15e3000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f15dc0ce780 0x7f15dc072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.286+0000 7f15e3000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15dc06e3d0 con 0x7f15dc071510 2024-09-10T07:35:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.286+0000 7f15e3000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f15dc06efe0 con 0x7f15dc145290 2024-09-10T07:35:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.286+0000 7f15e3000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f15dc06e6b0 con 0x7f15dc0ce780 2024-09-10T07:35:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.286+0000 7f15dbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f15dc145290 0x7f15dc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.286+0000 7f15dbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f15dc145290 0x7f15dc06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59868/0 (socket says 172.21.15.99:59868) 2024-09-10T07:35:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.286+0000 7f15dbe00640 1 -- 172.21.15.99:0/3467671843 learned_addr learned my addr 172.21.15.99:0/3467671843 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.287+0000 7f15dbe00640 1 -- 172.21.15.99:0/3467671843 >> v2:172.21.15.187:3300/0 conn(0x7f15dc0ce780 msgr2=0x7f15dc072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.287+0000 7f15dbe00640 1 --2- 172.21.15.99:0/3467671843 >> v2:172.21.15.187:3300/0 conn(0x7f15dc0ce780 0x7f15dc072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.287+0000 7f15dbe00640 1 -- 172.21.15.99:0/3467671843 >> v1:172.21.15.187:6789/0 conn(0x7f15dc071510 legacy=0x7f15dc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.287+0000 7f15dbe00640 1 -- 172.21.15.99:0/3467671843 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc06e990 con 0x7f15dc145290 2024-09-10T07:35:41.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.288+0000 7f15dbe00640 1 --2- 172.21.15.99:0/3467671843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc145290 0x7f15dc06f470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f15dc06d450 tx=0x7f15cc02c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89211a1993eef013 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:41.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.288+0000 7f15db400640 1 -- 172.21.15.99:0/3467671843 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc038070 con 0x7f15dc145290 2024-09-10T07:35:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.288+0000 7f15db400640 1 -- 172.21.15.99:0/3467671843 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15cc031710 con 0x7f15dc145290 2024-09-10T07:35:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.288+0000 7f15db400640 1 -- 172.21.15.99:0/3467671843 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc031ae0 con 0x7f15dc145290 2024-09-10T07:35:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.288+0000 7f15e3000640 1 -- 172.21.15.99:0/3467671843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc145290 msgr2=0x7f15dc06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.288+0000 7f15e3000640 1 --2- 172.21.15.99:0/3467671843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc145290 0x7f15dc06f470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f15dc06d450 tx=0x7f15cc02c440 comp rx=0 tx=0).stop 2024-09-10T07:35:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.288+0000 7f15e3000640 1 -- 172.21.15.99:0/3467671843 shutdown_connections 2024-09-10T07:35:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.288+0000 7f15e3000640 1 --2- 172.21.15.99:0/3467671843 >> v2:172.21.15.187:3300/0 conn(0x7f15dc0ce780 0x7f15dc072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.288+0000 7f15e3000640 1 --2- 172.21.15.99:0/3467671843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc145290 0x7f15dc06f470 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.288+0000 7f15e3000640 1 -- 172.21.15.99:0/3467671843 >> 172.21.15.99:0/3467671843 conn(0x7f15dc06bc10 msgr2=0x7f15dc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.289+0000 7f15e3000640 1 -- 172.21.15.99:0/3467671843 shutdown_connections 2024-09-10T07:35:41.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.289+0000 7f15e3000640 1 -- 172.21.15.99:0/3467671843 wait complete. 2024-09-10T07:35:41.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.290+0000 7f15e3000640 1 Processor -- start 2024-09-10T07:35:41.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.290+0000 7f15e3000640 1 -- start start 2024-09-10T07:35:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.291+0000 7f15e3000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15dc071510 0x7f15dc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.291+0000 7f15e3000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc0ce780 0x7f15dc1f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.291+0000 7f15e3000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15dc145290 0x7f15dc139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.291+0000 7f15e3000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc06df80 con 0x7f15dc0ce780 2024-09-10T07:35:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.291+0000 7f15e3000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc145670 con 0x7f15dc145290 2024-09-10T07:35:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.291+0000 7f15e3000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f15dc06e100 con 0x7f15dc071510 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.291+0000 7f15d3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc0ce780 0x7f15dc1f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.291+0000 7f15d3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc0ce780 0x7f15dc1f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59872/0 (socket says 172.21.15.99:59872) 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.291+0000 7f15d3400640 1 -- 172.21.15.99:0/4048009113 learned_addr learned my addr 172.21.15.99:0/4048009113 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.292+0000 7f15dbe00640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15dc071510 0x7f15dc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.292+0000 7f15e1000640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15dc145290 0x7f15dc139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.292+0000 7f15d3400640 1 -- 172.21.15.99:0/4048009113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15dc071510 msgr2=0x7f15dc15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.292+0000 7f15d3400640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15dc071510 0x7f15dc15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.292+0000 7f15d3400640 1 -- 172.21.15.99:0/4048009113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15dc145290 msgr2=0x7f15dc139bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.292+0000 7f15d3400640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15dc145290 0x7f15dc139bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.292+0000 7f15d3400640 1 -- 172.21.15.99:0/4048009113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc13edd0 con 0x7f15dc0ce780 2024-09-10T07:35:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.292+0000 7f15d3400640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc0ce780 0x7f15dc1f4da0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f15c400b450 tx=0x7f15c400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:41.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.292+0000 7f15d8c00640 1 -- 172.21.15.99:0/4048009113 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4015020 con 0x7f15dc0ce780 2024-09-10T07:35:41.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.292+0000 7f15d8c00640 1 -- 172.21.15.99:0/4048009113 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c4011890 con 0x7f15dc0ce780 2024-09-10T07:35:41.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.293+0000 7f15e3000640 1 -- 172.21.15.99:0/4048009113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc1f5450 con 0x7f15dc0ce780 2024-09-10T07:35:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.293+0000 7f15d8c00640 1 -- 172.21.15.99:0/4048009113 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4011c80 con 0x7f15dc0ce780 2024-09-10T07:35:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.293+0000 7f15e3000640 1 -- 172.21.15.99:0/4048009113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc1f5a10 con 0x7f15dc0ce780 2024-09-10T07:35:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.294+0000 7f15e3000640 1 -- 172.21.15.99:0/4048009113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15dc06f450 con 0x7f15dc0ce780 2024-09-10T07:35:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.295+0000 7f15d8c00640 1 -- 172.21.15.99:0/4048009113 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15c4018020 con 0x7f15dc0ce780 2024-09-10T07:35:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.295+0000 7f15d8c00640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f15b806be30 0x7f15b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.296+0000 7f15d8c00640 1 -- 172.21.15.99:0/4048009113 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f15c408af10 con 0x7f15dc0ce780 2024-09-10T07:35:41.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.296+0000 7f15dbe00640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f15b806be30 0x7f15b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.296+0000 7f15dbe00640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f15b806be30 0x7f15b806e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f15cc035000 tx=0x7f15cc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.300+0000 7f15d8c00640 1 -- 172.21.15.99:0/4048009113 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15c401f020 con 0x7f15dc0ce780 2024-09-10T07:35:41.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.470+0000 7f15e3000640 1 -- 172.21.15.99:0/4048009113 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15dc0b5aa0 con 0x7f15b806be30 2024-09-10T07:35:41.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.476+0000 7f15d8c00640 1 -- 172.21.15.99:0/4048009113 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247488 (secure 0 0 0) 0x7f15dc0b5aa0 con 0x7f15b806be30 2024-09-10T07:35:41.478 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:41.479 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:35:41.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.479+0000 7f15e3000640 1 -- 172.21.15.99:0/4048009113 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f15b806be30 msgr2=0x7f15b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.479+0000 7f15e3000640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f15b806be30 0x7f15b806e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f15cc035000 tx=0x7f15cc008030 comp rx=0 tx=0).stop 2024-09-10T07:35:41.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.479+0000 7f15e3000640 1 -- 172.21.15.99:0/4048009113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc0ce780 msgr2=0x7f15dc1f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.479+0000 7f15e3000640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc0ce780 0x7f15dc1f4da0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f15c400b450 tx=0x7f15c400b910 comp rx=0 tx=0).stop 2024-09-10T07:35:41.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.480+0000 7f15e3000640 1 -- 172.21.15.99:0/4048009113 shutdown_connections 2024-09-10T07:35:41.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.480+0000 7f15e3000640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15dc145290 0x7f15dc139bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.480+0000 7f15e3000640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f15b806be30 0x7f15b806e2f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.480+0000 7f15e3000640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15dc0ce780 0x7f15dc1f4da0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.480+0000 7f15e3000640 1 --2- 172.21.15.99:0/4048009113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15dc071510 0x7f15dc15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.480+0000 7f15e3000640 1 -- 172.21.15.99:0/4048009113 >> 172.21.15.99:0/4048009113 conn(0x7f15dc06bc10 msgr2=0x7f15dc0b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:41.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.480+0000 7f15e3000640 1 -- 172.21.15.99:0/4048009113 shutdown_connections 2024-09-10T07:35:41.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.480+0000 7f15e3000640 1 -- 172.21.15.99:0/4048009113 wait complete. 2024-09-10T07:35:41.495 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-10T07:35:40.708108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2784,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559715,"statfs":{"total":1600000000,"available":1597148936,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.814709"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915908+0000","last_change":"2024-09-10T07:35:36.924358+0000","last_active":"2024-09-10T07:35:37.915908+0000","last_peered":"2024-09-10T07:35:37.915908+0000","last_clean":"2024-09-10T07:35:37.915908+0000","last_became_active":"2024-09-10T07:35:36.924115+0000","last_became_peered":"2024-09-10T07:35:36.924115+0000","last_unstale":"2024-09-10T07:35:37.915908+0000","last_undegraded":"2024-09-10T07:35:37.915908+0000","last_fullsized":"2024-09-10T07:35:37.915908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:45.202396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916035+0000","last_change":"2024-09-10T07:35:36.931707+0000","last_active":"2024-09-10T07:35:37.916035+0000","last_peered":"2024-09-10T07:35:37.916035+0000","last_clean":"2024-09-10T07:35:37.916035+0000","last_became_active":"2024-09-10T07:35:36.931464+0000","last_became_peered":"2024-09-10T07:35:36.931464+0000","last_unstale":"2024-09-10T07:35:37.916035+0000","last_undegraded":"2024-09-10T07:35:37.916035+0000","last_fullsized":"2024-09-10T07:35:37.916035+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:16.838083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931455+0000","last_change":"2024-09-10T07:35:36.927315+0000","last_active":"2024-09-10T07:35:37.931455+0000","last_peered":"2024-09-10T07:35:37.931455+0000","last_clean":"2024-09-10T07:35:37.931455+0000","last_became_active":"2024-09-10T07:35:36.924640+0000","last_became_peered":"2024-09-10T07:35:36.924640+0000","last_unstale":"2024-09-10T07:35:37.931455+0000","last_undegraded":"2024-09-10T07:35:37.931455+0000","last_fullsized":"2024-09-10T07:35:37.931455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:36.552344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274595+0000","last_change":"2024-09-10T07:35:36.933792+0000","last_active":"2024-09-10T07:35:38.274595+0000","last_peered":"2024-09-10T07:35:38.274595+0000","last_clean":"2024-09-10T07:35:38.274595+0000","last_became_active":"2024-09-10T07:35:36.933568+0000","last_became_peered":"2024-09-10T07:35:36.933568+0000","last_unstale":"2024-09-10T07:35:38.274595+0000","last_undegraded":"2024-09-10T07:35:38.274595+0000","last_fullsized":"2024-09-10T07:35:38.274595+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:14.291063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915854+0000","last_change":"2024-09-10T07:35:36.931976+0000","last_active":"2024-09-10T07:35:37.915854+0000","last_peered":"2024-09-10T07:35:37.915854+0000","last_clean":"2024-09-10T07:35:37.915854+0000","last_became_active":"2024-09-10T07:35:36.931722+0000","last_became_peered":"2024-09-10T07:35:36.931722+0000","last_unstale":"2024-09-10T07:35:37.915854+0000","last_undegraded":"2024-09-10T07:35:37.915854+0000","last_fullsized":"2024-09-10T07:35:37.915854+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:48.276501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930037+0000","last_change":"2024-09-10T07:35:36.926939+0000","last_active":"2024-09-10T07:35:37.930037+0000","last_peered":"2024-09-10T07:35:37.930037+0000","last_clean":"2024-09-10T07:35:37.930037+0000","last_became_active":"2024-09-10T07:35:36.926629+0000","last_became_peered":"2024-09-10T07:35:36.926629+0000","last_unstale":"2024-09-10T07:35:37.930037+0000","last_undegraded":"2024-09-10T07:35:37.930037+0000","last_fullsized":"2024-09-10T07:35:37.930037+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:58.170647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915560+0000","last_change":"2024-09-10T07:35:36.926859+0000","last_active":"2024-09-10T07:35:37.915560+0000","last_peered":"2024-09-10T07:35:37.915560+0000","last_clean":"2024-09-10T07:35:37.915560+0000","last_became_active":"2024-09-10T07:35:36.926628+0000","last_became_peered":"2024-09-10T07:35:36.926628+0000","last_unstale":"2024-09-10T07:35:37.915560+0000","last_undegraded":"2024-09-10T07:35:37.915560+0000","last_fullsized":"2024-09-10T07:35:37.915560+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:37.385604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274680+0000","last_change":"2024-09-10T07:35:36.934092+0000","last_active":"2024-09-10T07:35:38.274680+0000","last_peered":"2024-09-10T07:35:38.274680+0000","last_clean":"2024-09-10T07:35:38.274680+0000","last_became_active":"2024-09-10T07:35:36.933849+0000","last_became_peered":"2024-09-10T07:35:36.933849+0000","last_unstale":"2024-09-10T07:35:38.274680+0000","last_undegraded":"2024-09-10T07:35:38.274680+0000","last_fullsized":"2024-09-10T07:35:38.274680+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:29.494031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274742+0000","last_change":"2024-09-10T07:35:36.932227+0000","last_active":"2024-09-10T07:35:38.274742+0000","last_peered":"2024-09-10T07:35:38.274742+0000","last_clean":"2024-09-10T07:35:38.274742+0000","last_became_active":"2024-09-10T07:35:36.928758+0000","last_became_peered":"2024-09-10T07:35:36.928758+0000","last_unstale":"2024-09-10T07:35:38.274742+0000","last_undegraded":"2024-09-10T07:35:38.274742+0000","last_fullsized":"2024-09-10T07:35:38.274742+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:45.074440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274533+0000","last_change":"2024-09-10T07:35:36.932038+0000","last_active":"2024-09-10T07:35:38.274533+0000","last_peered":"2024-09-10T07:35:38.274533+0000","last_clean":"2024-09-10T07:35:38.274533+0000","last_became_active":"2024-09-10T07:35:36.930860+0000","last_became_peered":"2024-09-10T07:35:36.930860+0000","last_unstale":"2024-09-10T07:35:38.274533+0000","last_undegraded":"2024-09-10T07:35:38.274533+0000","last_fullsized":"2024-09-10T07:35:38.274533+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:55.051398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275161+0000","last_change":"2024-09-10T07:35:36.930503+0000","last_active":"2024-09-10T07:35:38.275161+0000","last_peered":"2024-09-10T07:35:38.275161+0000","last_clean":"2024-09-10T07:35:38.275161+0000","last_became_active":"2024-09-10T07:35:36.930230+0000","last_became_peered":"2024-09-10T07:35:36.930230+0000","last_unstale":"2024-09-10T07:35:38.275161+0000","last_undegraded":"2024-09-10T07:35:38.275161+0000","last_fullsized":"2024-09-10T07:35:38.275161+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:03.051822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916120+0000","last_change":"2024-09-10T07:35:36.922095+0000","last_active":"2024-09-10T07:35:37.916120+0000","last_peered":"2024-09-10T07:35:37.916120+0000","last_clean":"2024-09-10T07:35:37.916120+0000","last_became_active":"2024-09-10T07:35:36.921839+0000","last_became_peered":"2024-09-10T07:35:36.921839+0000","last_unstale":"2024-09-10T07:35:37.916120+0000","last_undegraded":"2024-09-10T07:35:37.916120+0000","last_fullsized":"2024-09-10T07:35:37.916120+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:22.559313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914632+0000","last_change":"2024-09-10T07:35:36.923736+0000","last_active":"2024-09-10T07:35:37.914632+0000","last_peered":"2024-09-10T07:35:37.914632+0000","last_clean":"2024-09-10T07:35:37.914632+0000","last_became_active":"2024-09-10T07:35:36.923394+0000","last_became_peered":"2024-09-10T07:35:36.923394+0000","last_unstale":"2024-09-10T07:35:37.914632+0000","last_undegraded":"2024-09-10T07:35:37.914632+0000","last_fullsized":"2024-09-10T07:35:37.914632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:05.404342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275131+0000","last_change":"2024-09-10T07:35:36.933232+0000","last_active":"2024-09-10T07:35:38.275131+0000","last_peered":"2024-09-10T07:35:38.275131+0000","last_clean":"2024-09-10T07:35:38.275131+0000","last_became_active":"2024-09-10T07:35:36.929696+0000","last_became_peered":"2024-09-10T07:35:36.929696+0000","last_unstale":"2024-09-10T07:35:38.275131+0000","last_undegraded":"2024-09-10T07:35:38.275131+0000","last_fullsized":"2024-09-10T07:35:38.275131+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:31.562594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.929943+0000","last_change":"2024-09-10T07:35:36.931656+0000","last_active":"2024-09-10T07:35:37.929943+0000","last_peered":"2024-09-10T07:35:37.929943+0000","last_clean":"2024-09-10T07:35:37.929943+0000","last_became_active":"2024-09-10T07:35:36.931391+0000","last_became_peered":"2024-09-10T07:35:36.931391+0000","last_unstale":"2024-09-10T07:35:37.929943+0000","last_undegraded":"2024-09-10T07:35:37.929943+0000","last_fullsized":"2024-09-10T07:35:37.929943+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:58.894795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274519+0000","last_change":"2024-09-10T07:35:36.933116+0000","last_active":"2024-09-10T07:35:38.274519+0000","last_peered":"2024-09-10T07:35:38.274519+0000","last_clean":"2024-09-10T07:35:38.274519+0000","last_became_active":"2024-09-10T07:35:36.932552+0000","last_became_peered":"2024-09-10T07:35:36.932552+0000","last_unstale":"2024-09-10T07:35:38.274519+0000","last_undegraded":"2024-09-10T07:35:38.274519+0000","last_fullsized":"2024-09-10T07:35:38.274519+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:56.884870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931251+0000","last_change":"2024-09-10T07:35:36.918543+0000","last_active":"2024-09-10T07:35:37.931251+0000","last_peered":"2024-09-10T07:35:37.931251+0000","last_clean":"2024-09-10T07:35:37.931251+0000","last_became_active":"2024-09-10T07:35:36.918306+0000","last_became_peered":"2024-09-10T07:35:36.918306+0000","last_unstale":"2024-09-10T07:35:37.931251+0000","last_undegraded":"2024-09-10T07:35:37.931251+0000","last_fullsized":"2024-09-10T07:35:37.931251+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:34.228702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931757+0000","last_change":"2024-09-10T07:35:36.921174+0000","last_active":"2024-09-10T07:35:37.931757+0000","last_peered":"2024-09-10T07:35:37.931757+0000","last_clean":"2024-09-10T07:35:37.931757+0000","last_became_active":"2024-09-10T07:35:36.920899+0000","last_became_peered":"2024-09-10T07:35:36.920899+0000","last_unstale":"2024-09-10T07:35:37.931757+0000","last_undegraded":"2024-09-10T07:35:37.931757+0000","last_fullsized":"2024-09-10T07:35:37.931757+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:12.306241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274984+0000","last_change":"2024-09-10T07:35:36.931122+0000","last_active":"2024-09-10T07:35:38.274984+0000","last_peered":"2024-09-10T07:35:38.274984+0000","last_clean":"2024-09-10T07:35:38.274984+0000","last_became_active":"2024-09-10T07:35:36.930896+0000","last_became_peered":"2024-09-10T07:35:36.930896+0000","last_unstale":"2024-09-10T07:35:38.274984+0000","last_undegraded":"2024-09-10T07:35:38.274984+0000","last_fullsized":"2024-09-10T07:35:38.274984+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:01.224996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914577+0000","last_change":"2024-09-10T07:35:36.926035+0000","last_active":"2024-09-10T07:35:37.914577+0000","last_peered":"2024-09-10T07:35:37.914577+0000","last_clean":"2024-09-10T07:35:37.914577+0000","last_became_active":"2024-09-10T07:35:36.925795+0000","last_became_peered":"2024-09-10T07:35:36.925795+0000","last_unstale":"2024-09-10T07:35:37.914577+0000","last_undegraded":"2024-09-10T07:35:37.914577+0000","last_fullsized":"2024-09-10T07:35:37.914577+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:48.365959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930138+0000","last_change":"2024-09-10T07:35:36.932207+0000","last_active":"2024-09-10T07:35:37.930138+0000","last_peered":"2024-09-10T07:35:37.930138+0000","last_clean":"2024-09-10T07:35:37.930138+0000","last_became_active":"2024-09-10T07:35:36.931805+0000","last_became_peered":"2024-09-10T07:35:36.931805+0000","last_unstale":"2024-09-10T07:35:37.930138+0000","last_undegraded":"2024-09-10T07:35:37.930138+0000","last_fullsized":"2024-09-10T07:35:37.930138+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:54.389918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274991+0000","last_change":"2024-09-10T07:35:36.936061+0000","last_active":"2024-09-10T07:35:38.274991+0000","last_peered":"2024-09-10T07:35:38.274991+0000","last_clean":"2024-09-10T07:35:38.274991+0000","last_became_active":"2024-09-10T07:35:36.935573+0000","last_became_peered":"2024-09-10T07:35:36.935573+0000","last_unstale":"2024-09-10T07:35:38.274991+0000","last_undegraded":"2024-09-10T07:35:38.274991+0000","last_fullsized":"2024-09-10T07:35:38.274991+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:13.337852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274970+0000","last_change":"2024-09-10T07:35:36.930510+0000","last_active":"2024-09-10T07:35:38.274970+0000","last_peered":"2024-09-10T07:35:38.274970+0000","last_clean":"2024-09-10T07:35:38.274970+0000","last_became_active":"2024-09-10T07:35:36.929880+0000","last_became_peered":"2024-09-10T07:35:36.929880+0000","last_unstale":"2024-09-10T07:35:38.274970+0000","last_undegraded":"2024-09-10T07:35:38.274970+0000","last_fullsized":"2024-09-10T07:35:38.274970+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:47.051457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274466+0000","last_change":"2024-09-10T07:35:36.928897+0000","last_active":"2024-09-10T07:35:38.274466+0000","last_peered":"2024-09-10T07:35:38.274466+0000","last_clean":"2024-09-10T07:35:38.274466+0000","last_became_active":"2024-09-10T07:35:36.926249+0000","last_became_peered":"2024-09-10T07:35:36.926249+0000","last_unstale":"2024-09-10T07:35:38.274466+0000","last_undegraded":"2024-09-10T07:35:38.274466+0000","last_fullsized":"2024-09-10T07:35:38.274466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:55.813827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274819+0000","last_change":"2024-09-10T07:35:36.931785+0000","last_active":"2024-09-10T07:35:38.274819+0000","last_peered":"2024-09-10T07:35:38.274819+0000","last_clean":"2024-09-10T07:35:38.274819+0000","last_became_active":"2024-09-10T07:35:36.931559+0000","last_became_peered":"2024-09-10T07:35:36.931559+0000","last_unstale":"2024-09-10T07:35:38.274819+0000","last_undegraded":"2024-09-10T07:35:38.274819+0000","last_fullsized":"2024-09-10T07:35:38.274819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:52.820457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914628+0000","last_change":"2024-09-10T07:35:36.922866+0000","last_active":"2024-09-10T07:35:37.914628+0000","last_peered":"2024-09-10T07:35:37.914628+0000","last_clean":"2024-09-10T07:35:37.914628+0000","last_became_active":"2024-09-10T07:35:36.922595+0000","last_became_peered":"2024-09-10T07:35:36.922595+0000","last_unstale":"2024-09-10T07:35:37.914628+0000","last_undegraded":"2024-09-10T07:35:37.914628+0000","last_fullsized":"2024-09-10T07:35:37.914628+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:11.265422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931431+0000","last_change":"2024-09-10T07:35:36.920227+0000","last_active":"2024-09-10T07:35:37.931431+0000","last_peered":"2024-09-10T07:35:37.931431+0000","last_clean":"2024-09-10T07:35:37.931431+0000","last_became_active":"2024-09-10T07:35:36.919983+0000","last_became_peered":"2024-09-10T07:35:36.919983+0000","last_unstale":"2024-09-10T07:35:37.931431+0000","last_undegraded":"2024-09-10T07:35:37.931431+0000","last_fullsized":"2024-09-10T07:35:37.931431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:39.576091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915468+0000","last_change":"2024-09-10T07:35:36.923805+0000","last_active":"2024-09-10T07:35:37.915468+0000","last_peered":"2024-09-10T07:35:37.915468+0000","last_clean":"2024-09-10T07:35:37.915468+0000","last_became_active":"2024-09-10T07:35:36.923048+0000","last_became_peered":"2024-09-10T07:35:36.923048+0000","last_unstale":"2024-09-10T07:35:37.915468+0000","last_undegraded":"2024-09-10T07:35:37.915468+0000","last_fullsized":"2024-09-10T07:35:37.915468+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:54.287057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274676+0000","last_change":"2024-09-10T07:35:36.934719+0000","last_active":"2024-09-10T07:35:38.274676+0000","last_peered":"2024-09-10T07:35:38.274676+0000","last_clean":"2024-09-10T07:35:38.274676+0000","last_became_active":"2024-09-10T07:35:36.934469+0000","last_became_peered":"2024-09-10T07:35:36.934469+0000","last_unstale":"2024-09-10T07:35:38.274676+0000","last_undegraded":"2024-09-10T07:35:38.274676+0000","last_fullsized":"2024-09-10T07:35:38.274676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:05.220762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931387+0000","last_change":"2024-09-10T07:35:36.924052+0000","last_active":"2024-09-10T07:35:37.931387+0000","last_peered":"2024-09-10T07:35:37.931387+0000","last_clean":"2024-09-10T07:35:37.931387+0000","last_became_active":"2024-09-10T07:35:36.923709+0000","last_became_peered":"2024-09-10T07:35:36.923709+0000","last_unstale":"2024-09-10T07:35:37.931387+0000","last_undegraded":"2024-09-10T07:35:37.931387+0000","last_fullsized":"2024-09-10T07:35:37.931387+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:45.700845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930221+0000","last_change":"2024-09-10T07:35:36.927988+0000","last_active":"2024-09-10T07:35:37.930221+0000","last_peered":"2024-09-10T07:35:37.930221+0000","last_clean":"2024-09-10T07:35:37.930221+0000","last_became_active":"2024-09-10T07:35:36.927722+0000","last_became_peered":"2024-09-10T07:35:36.927722+0000","last_unstale":"2024-09-10T07:35:37.930221+0000","last_undegraded":"2024-09-10T07:35:37.930221+0000","last_fullsized":"2024-09-10T07:35:37.930221+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:05.096436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914608+0000","last_change":"2024-09-10T07:35:36.928825+0000","last_active":"2024-09-10T07:35:37.914608+0000","last_peered":"2024-09-10T07:35:37.914608+0000","last_clean":"2024-09-10T07:35:37.914608+0000","last_became_active":"2024-09-10T07:35:36.928607+0000","last_became_peered":"2024-09-10T07:35:36.928607+0000","last_unstale":"2024-09-10T07:35:37.914608+0000","last_undegraded":"2024-09-10T07:35:37.914608+0000","last_fullsized":"2024-09-10T07:35:37.914608+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:39.633956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274587+0000","last_change":"2024-09-10T07:35:36.932253+0000","last_active":"2024-09-10T07:35:38.274587+0000","last_peered":"2024-09-10T07:35:38.274587+0000","last_clean":"2024-09-10T07:35:38.274587+0000","last_became_active":"2024-09-10T07:35:36.928450+0000","last_became_peered":"2024-09-10T07:35:36.928450+0000","last_unstale":"2024-09-10T07:35:38.274587+0000","last_undegraded":"2024-09-10T07:35:38.274587+0000","last_fullsized":"2024-09-10T07:35:38.274587+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:45:13.830680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.929972+0000","last_change":"2024-09-10T07:35:35.905690+0000","last_active":"2024-09-10T07:35:37.929972+0000","last_peered":"2024-09-10T07:35:37.929972+0000","last_clean":"2024-09-10T07:35:37.929972+0000","last_became_active":"2024-09-10T07:35:35.905419+0000","last_became_peered":"2024-09-10T07:35:35.905419+0000","last_unstale":"2024-09-10T07:35:37.929972+0000","last_undegraded":"2024-09-10T07:35:37.929972+0000","last_fullsized":"2024-09-10T07:35:37.929972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:49.443786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274807+0000","last_change":"2024-09-10T07:35:36.930323+0000","last_active":"2024-09-10T07:35:38.274807+0000","last_peered":"2024-09-10T07:35:38.274807+0000","last_clean":"2024-09-10T07:35:38.274807+0000","last_became_active":"2024-09-10T07:35:36.929202+0000","last_became_peered":"2024-09-10T07:35:36.929202+0000","last_unstale":"2024-09-10T07:35:38.274807+0000","last_undegraded":"2024-09-10T07:35:38.274807+0000","last_fullsized":"2024-09-10T07:35:38.274807+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:19.995575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931237+0000","last_change":"2024-09-10T07:35:35.907834+0000","last_active":"2024-09-10T07:35:37.931237+0000","last_peered":"2024-09-10T07:35:37.931237+0000","last_clean":"2024-09-10T07:35:37.931237+0000","last_became_active":"2024-09-10T07:35:35.906933+0000","last_became_peered":"2024-09-10T07:35:35.906933+0000","last_unstale":"2024-09-10T07:35:37.931237+0000","last_undegraded":"2024-09-10T07:35:37.931237+0000","last_fullsized":"2024-09-10T07:35:37.931237+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:41.397733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915896+0000","last_change":"2024-09-10T07:35:36.926169+0000","last_active":"2024-09-10T07:35:37.915896+0000","last_peered":"2024-09-10T07:35:37.915896+0000","last_clean":"2024-09-10T07:35:37.915896+0000","last_became_active":"2024-09-10T07:35:36.922393+0000","last_became_peered":"2024-09-10T07:35:36.922393+0000","last_unstale":"2024-09-10T07:35:37.915896+0000","last_undegraded":"2024-09-10T07:35:37.915896+0000","last_fullsized":"2024-09-10T07:35:37.915896+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:26.094887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274756+0000","last_change":"2024-09-10T07:35:35.901954+0000","last_active":"2024-09-10T07:35:38.274756+0000","last_peered":"2024-09-10T07:35:38.274756+0000","last_clean":"2024-09-10T07:35:38.274756+0000","last_became_active":"2024-09-10T07:35:35.901368+0000","last_became_peered":"2024-09-10T07:35:35.901368+0000","last_unstale":"2024-09-10T07:35:38.274756+0000","last_undegraded":"2024-09-10T07:35:38.274756+0000","last_fullsized":"2024-09-10T07:35:38.274756+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:15:22.056416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274597+0000","last_change":"2024-09-10T07:35:36.933135+0000","last_active":"2024-09-10T07:35:38.274597+0000","last_peered":"2024-09-10T07:35:38.274597+0000","last_clean":"2024-09-10T07:35:38.274597+0000","last_became_active":"2024-09-10T07:35:36.932896+0000","last_became_peered":"2024-09-10T07:35:36.932896+0000","last_unstale":"2024-09-10T07:35:38.274597+0000","last_undegraded":"2024-09-10T07:35:38.274597+0000","last_fullsized":"2024-09-10T07:35:38.274597+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:49.294414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916142+0000","last_change":"2024-09-10T07:35:35.908615+0000","last_active":"2024-09-10T07:35:37.916142+0000","last_peered":"2024-09-10T07:35:37.916142+0000","last_clean":"2024-09-10T07:35:37.916142+0000","last_became_active":"2024-09-10T07:35:35.908258+0000","last_became_peered":"2024-09-10T07:35:35.908258+0000","last_unstale":"2024-09-10T07:35:37.916142+0000","last_undegraded":"2024-09-10T07:35:37.916142+0000","last_fullsized":"2024-09-10T07:35:37.916142+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:12.491155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931307+0000","last_change":"2024-09-10T07:35:36.929340+0000","last_active":"2024-09-10T07:35:37.931307+0000","last_peered":"2024-09-10T07:35:37.931307+0000","last_clean":"2024-09-10T07:35:37.931307+0000","last_became_active":"2024-09-10T07:35:36.929105+0000","last_became_peered":"2024-09-10T07:35:36.929105+0000","last_unstale":"2024-09-10T07:35:37.931307+0000","last_undegraded":"2024-09-10T07:35:37.931307+0000","last_fullsized":"2024-09-10T07:35:37.931307+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:47.855898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930148+0000","last_change":"2024-09-10T07:35:35.910294+0000","last_active":"2024-09-10T07:35:37.930148+0000","last_peered":"2024-09-10T07:35:37.930148+0000","last_clean":"2024-09-10T07:35:37.930148+0000","last_became_active":"2024-09-10T07:35:35.909337+0000","last_became_peered":"2024-09-10T07:35:35.909337+0000","last_unstale":"2024-09-10T07:35:37.930148+0000","last_undegraded":"2024-09-10T07:35:37.930148+0000","last_fullsized":"2024-09-10T07:35:37.930148+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:54.392147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275157+0000","last_change":"2024-09-10T07:35:36.927825+0000","last_active":"2024-09-10T07:35:38.275157+0000","last_peered":"2024-09-10T07:35:38.275157+0000","last_clean":"2024-09-10T07:35:38.275157+0000","last_became_active":"2024-09-10T07:35:36.926050+0000","last_became_peered":"2024-09-10T07:35:36.926050+0000","last_unstale":"2024-09-10T07:35:38.275157+0000","last_undegraded":"2024-09-10T07:35:38.275157+0000","last_fullsized":"2024-09-10T07:35:38.275157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:15.367815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931812+0000","last_change":"2024-09-10T07:35:35.907116+0000","last_active":"2024-09-10T07:35:37.931812+0000","last_peered":"2024-09-10T07:35:37.931812+0000","last_clean":"2024-09-10T07:35:37.931812+0000","last_became_active":"2024-09-10T07:35:35.906787+0000","last_became_peered":"2024-09-10T07:35:35.906787+0000","last_unstale":"2024-09-10T07:35:37.931812+0000","last_undegraded":"2024-09-10T07:35:37.931812+0000","last_fullsized":"2024-09-10T07:35:37.931812+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:06.418763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274628+0000","last_change":"2024-09-10T07:35:36.934516+0000","last_active":"2024-09-10T07:35:38.274628+0000","last_peered":"2024-09-10T07:35:38.274628+0000","last_clean":"2024-09-10T07:35:38.274628+0000","last_became_active":"2024-09-10T07:35:36.934002+0000","last_became_peered":"2024-09-10T07:35:36.934002+0000","last_unstale":"2024-09-10T07:35:38.274628+0000","last_undegraded":"2024-09-10T07:35:38.274628+0000","last_fullsized":"2024-09-10T07:35:38.274628+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:55.235277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915195+0000","last_change":"2024-09-10T07:35:35.900666+0000","last_active":"2024-09-10T07:35:37.915195+0000","last_peered":"2024-09-10T07:35:37.915195+0000","last_clean":"2024-09-10T07:35:37.915195+0000","last_became_active":"2024-09-10T07:35:35.899068+0000","last_became_peered":"2024-09-10T07:35:35.899068+0000","last_unstale":"2024-09-10T07:35:37.915195+0000","last_undegraded":"2024-09-10T07:35:37.915195+0000","last_fullsized":"2024-09-10T07:35:37.915195+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:41.457946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274851+0000","last_change":"2024-09-10T07:35:36.924232+0000","last_active":"2024-09-10T07:35:38.274851+0000","last_peered":"2024-09-10T07:35:38.274851+0000","last_clean":"2024-09-10T07:35:38.274851+0000","last_became_active":"2024-09-10T07:35:36.923901+0000","last_became_peered":"2024-09-10T07:35:36.923901+0000","last_unstale":"2024-09-10T07:35:38.274851+0000","last_undegraded":"2024-09-10T07:35:38.274851+0000","last_fullsized":"2024-09-10T07:35:38.274851+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:05.369762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275119+0000","last_change":"2024-09-10T07:35:35.908791+0000","last_active":"2024-09-10T07:35:38.275119+0000","last_peered":"2024-09-10T07:35:38.275119+0000","last_clean":"2024-09-10T07:35:38.275119+0000","last_became_active":"2024-09-10T07:35:35.908082+0000","last_became_peered":"2024-09-10T07:35:35.908082+0000","last_unstale":"2024-09-10T07:35:38.275119+0000","last_undegraded":"2024-09-10T07:35:38.275119+0000","last_fullsized":"2024-09-10T07:35:38.275119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:18.324916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931573+0000","last_change":"2024-09-10T07:35:36.931740+0000","last_active":"2024-09-10T07:35:37.931573+0000","last_peered":"2024-09-10T07:35:37.931573+0000","last_clean":"2024-09-10T07:35:37.931573+0000","last_became_active":"2024-09-10T07:35:36.931513+0000","last_became_peered":"2024-09-10T07:35:36.931513+0000","last_unstale":"2024-09-10T07:35:37.931573+0000","last_undegraded":"2024-09-10T07:35:37.931573+0000","last_fullsized":"2024-09-10T07:35:37.931573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:20.634264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931281+0000","last_change":"2024-09-10T07:35:35.908951+0000","last_active":"2024-09-10T07:35:37.931281+0000","last_peered":"2024-09-10T07:35:37.931281+0000","last_clean":"2024-09-10T07:35:37.931281+0000","last_became_active":"2024-09-10T07:35:35.905178+0000","last_became_peered":"2024-09-10T07:35:35.905178+0000","last_unstale":"2024-09-10T07:35:37.931281+0000","last_undegraded":"2024-09-10T07:35:37.931281+0000","last_fullsized":"2024-09-10T07:35:37.931281+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:22.838684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916045+0000","last_change":"2024-09-10T07:35:36.928734+0000","last_active":"2024-09-10T07:35:37.916045+0000","last_peered":"2024-09-10T07:35:37.916045+0000","last_clean":"2024-09-10T07:35:37.916045+0000","last_became_active":"2024-09-10T07:35:36.928510+0000","last_became_peered":"2024-09-10T07:35:36.928510+0000","last_unstale":"2024-09-10T07:35:37.916045+0000","last_undegraded":"2024-09-10T07:35:37.916045+0000","last_fullsized":"2024-09-10T07:35:37.916045+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:07.043020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275298+0000","last_change":"2024-09-10T07:35:35.907691+0000","last_active":"2024-09-10T07:35:38.275298+0000","last_peered":"2024-09-10T07:35:38.275298+0000","last_clean":"2024-09-10T07:35:38.275298+0000","last_became_active":"2024-09-10T07:35:35.907468+0000","last_became_peered":"2024-09-10T07:35:35.907468+0000","last_unstale":"2024-09-10T07:35:38.275298+0000","last_undegraded":"2024-09-10T07:35:38.275298+0000","last_fullsized":"2024-09-10T07:35:38.275298+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:24.597062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930053+0000","last_change":"2024-09-10T07:35:36.924488+0000","last_active":"2024-09-10T07:35:37.930053+0000","last_peered":"2024-09-10T07:35:37.930053+0000","last_clean":"2024-09-10T07:35:37.930053+0000","last_became_active":"2024-09-10T07:35:36.924071+0000","last_became_peered":"2024-09-10T07:35:36.924071+0000","last_unstale":"2024-09-10T07:35:37.930053+0000","last_undegraded":"2024-09-10T07:35:37.930053+0000","last_fullsized":"2024-09-10T07:35:37.930053+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:33.499679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915467+0000","last_change":"2024-09-10T07:35:35.910125+0000","last_active":"2024-09-10T07:35:37.915467+0000","last_peered":"2024-09-10T07:35:37.915467+0000","last_clean":"2024-09-10T07:35:37.915467+0000","last_became_active":"2024-09-10T07:35:35.909907+0000","last_became_peered":"2024-09-10T07:35:35.909907+0000","last_unstale":"2024-09-10T07:35:37.915467+0000","last_undegraded":"2024-09-10T07:35:37.915467+0000","last_fullsized":"2024-09-10T07:35:37.915467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:42.697888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915304+0000","last_change":"2024-09-10T07:35:36.927721+0000","last_active":"2024-09-10T07:35:37.915304+0000","last_peered":"2024-09-10T07:35:37.915304+0000","last_clean":"2024-09-10T07:35:37.915304+0000","last_became_active":"2024-09-10T07:35:36.926310+0000","last_became_peered":"2024-09-10T07:35:36.926310+0000","last_unstale":"2024-09-10T07:35:37.915304+0000","last_undegraded":"2024-09-10T07:35:37.915304+0000","last_fullsized":"2024-09-10T07:35:37.915304+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:25.129861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914516+0000","last_change":"2024-09-10T07:35:35.908716+0000","last_active":"2024-09-10T07:35:37.914516+0000","last_peered":"2024-09-10T07:35:37.914516+0000","last_clean":"2024-09-10T07:35:37.914516+0000","last_became_active":"2024-09-10T07:35:35.908458+0000","last_became_peered":"2024-09-10T07:35:35.908458+0000","last_unstale":"2024-09-10T07:35:37.914516+0000","last_undegraded":"2024-09-10T07:35:37.914516+0000","last_fullsized":"2024-09-10T07:35:37.914516+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:16.209256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274668+0000","last_change":"2024-09-10T07:35:36.932814+0000","last_active":"2024-09-10T07:35:38.274668+0000","last_peered":"2024-09-10T07:35:38.274668+0000","last_clean":"2024-09-10T07:35:38.274668+0000","last_became_active":"2024-09-10T07:35:36.932230+0000","last_became_peered":"2024-09-10T07:35:36.932230+0000","last_unstale":"2024-09-10T07:35:38.274668+0000","last_undegraded":"2024-09-10T07:35:38.274668+0000","last_fullsized":"2024-09-10T07:35:38.274668+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:22.298976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930048+0000","last_change":"2024-09-10T07:35:35.902063+0000","last_active":"2024-09-10T07:35:37.930048+0000","last_peered":"2024-09-10T07:35:37.930048+0000","last_clean":"2024-09-10T07:35:37.930048+0000","last_became_active":"2024-09-10T07:35:35.901419+0000","last_became_peered":"2024-09-10T07:35:35.901419+0000","last_unstale":"2024-09-10T07:35:37.930048+0000","last_undegraded":"2024-09-10T07:35:37.930048+0000","last_fullsized":"2024-09-10T07:35:37.930048+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:16.166092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274707+0000","last_change":"2024-09-10T07:35:36.931507+0000","last_active":"2024-09-10T07:35:38.274707+0000","last_peered":"2024-09-10T07:35:38.274707+0000","last_clean":"2024-09-10T07:35:38.274707+0000","last_became_active":"2024-09-10T07:35:36.930078+0000","last_became_peered":"2024-09-10T07:35:36.930078+0000","last_unstale":"2024-09-10T07:35:38.274707+0000","last_undegraded":"2024-09-10T07:35:38.274707+0000","last_fullsized":"2024-09-10T07:35:38.274707+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:47.366907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916242+0000","last_change":"2024-09-10T07:35:35.912465+0000","last_active":"2024-09-10T07:35:37.916242+0000","last_peered":"2024-09-10T07:35:37.916242+0000","last_clean":"2024-09-10T07:35:37.916242+0000","last_became_active":"2024-09-10T07:35:35.911707+0000","last_became_peered":"2024-09-10T07:35:35.911707+0000","last_unstale":"2024-09-10T07:35:37.916242+0000","last_undegraded":"2024-09-10T07:35:37.916242+0000","last_fullsized":"2024-09-10T07:35:37.916242+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:34.437653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.929869+0000","last_change":"2024-09-10T07:35:36.933450+0000","last_active":"2024-09-10T07:35:37.929869+0000","last_peered":"2024-09-10T07:35:37.929869+0000","last_clean":"2024-09-10T07:35:37.929869+0000","last_became_active":"2024-09-10T07:35:36.932905+0000","last_became_peered":"2024-09-10T07:35:36.932905+0000","last_unstale":"2024-09-10T07:35:37.929869+0000","last_undegraded":"2024-09-10T07:35:37.929869+0000","last_fullsized":"2024-09-10T07:35:37.929869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.258172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930244+0000","last_change":"2024-09-10T07:35:35.909825+0000","last_active":"2024-09-10T07:35:37.930244+0000","last_peered":"2024-09-10T07:35:37.930244+0000","last_clean":"2024-09-10T07:35:37.930244+0000","last_became_active":"2024-09-10T07:35:35.906567+0000","last_became_peered":"2024-09-10T07:35:35.906567+0000","last_unstale":"2024-09-10T07:35:37.930244+0000","last_undegraded":"2024-09-10T07:35:37.930244+0000","last_fullsized":"2024-09-10T07:35:37.930244+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:20.215343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915711+0000","last_change":"2024-09-10T07:35:36.930611+0000","last_active":"2024-09-10T07:35:37.915711+0000","last_peered":"2024-09-10T07:35:37.915711+0000","last_clean":"2024-09-10T07:35:37.915711+0000","last_became_active":"2024-09-10T07:35:36.930371+0000","last_became_peered":"2024-09-10T07:35:36.930371+0000","last_unstale":"2024-09-10T07:35:37.915711+0000","last_undegraded":"2024-09-10T07:35:37.915711+0000","last_fullsized":"2024-09-10T07:35:37.915711+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:12.024482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":22,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274938+0000","last_change":"2024-09-10T07:35:35.903986+0000","last_active":"2024-09-10T07:35:38.274938+0000","last_peered":"2024-09-10T07:35:38.274938+0000","last_clean":"2024-09-10T07:35:38.274938+0000","last_became_active":"2024-09-10T07:35:35.903429+0000","last_became_peered":"2024-09-10T07:35:35.903429+0000","last_unstale":"2024-09-10T07:35:38.274938+0000","last_undegraded":"2024-09-10T07:35:38.274938+0000","last_fullsized":"2024-09-10T07:35:38.274938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:09.960106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914731+0000","last_change":"2024-09-10T07:35:36.916833+0000","last_active":"2024-09-10T07:35:37.914731+0000","last_peered":"2024-09-10T07:35:37.914731+0000","last_clean":"2024-09-10T07:35:37.914731+0000","last_became_active":"2024-09-10T07:35:36.916203+0000","last_became_peered":"2024-09-10T07:35:36.916203+0000","last_unstale":"2024-09-10T07:35:37.914731+0000","last_undegraded":"2024-09-10T07:35:37.914731+0000","last_fullsized":"2024-09-10T07:35:37.914731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:04.538200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914634+0000","last_change":"2024-09-10T07:35:35.899707+0000","last_active":"2024-09-10T07:35:37.914634+0000","last_peered":"2024-09-10T07:35:37.914634+0000","last_clean":"2024-09-10T07:35:37.914634+0000","last_became_active":"2024-09-10T07:35:35.898895+0000","last_became_peered":"2024-09-10T07:35:35.898895+0000","last_unstale":"2024-09-10T07:35:37.914634+0000","last_undegraded":"2024-09-10T07:35:37.914634+0000","last_fullsized":"2024-09-10T07:35:37.914634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:16.228853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274893+0000","last_change":"2024-09-10T07:35:36.925325+0000","last_active":"2024-09-10T07:35:38.274893+0000","last_peered":"2024-09-10T07:35:38.274893+0000","last_clean":"2024-09-10T07:35:38.274893+0000","last_became_active":"2024-09-10T07:35:36.920641+0000","last_became_peered":"2024-09-10T07:35:36.920641+0000","last_unstale":"2024-09-10T07:35:38.274893+0000","last_undegraded":"2024-09-10T07:35:38.274893+0000","last_fullsized":"2024-09-10T07:35:38.274893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:40.290820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931454+0000","last_change":"2024-09-10T07:35:35.910572+0000","last_active":"2024-09-10T07:35:37.931454+0000","last_peered":"2024-09-10T07:35:37.931454+0000","last_clean":"2024-09-10T07:35:37.931454+0000","last_became_active":"2024-09-10T07:35:35.910334+0000","last_became_peered":"2024-09-10T07:35:35.910334+0000","last_unstale":"2024-09-10T07:35:37.931454+0000","last_undegraded":"2024-09-10T07:35:37.931454+0000","last_fullsized":"2024-09-10T07:35:37.931454+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:12.810964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274539+0000","last_change":"2024-09-10T07:35:36.929561+0000","last_active":"2024-09-10T07:35:38.274539+0000","last_peered":"2024-09-10T07:35:38.274539+0000","last_clean":"2024-09-10T07:35:38.274539+0000","last_became_active":"2024-09-10T07:35:36.929210+0000","last_became_peered":"2024-09-10T07:35:36.929210+0000","last_unstale":"2024-09-10T07:35:38.274539+0000","last_undegraded":"2024-09-10T07:35:38.274539+0000","last_fullsized":"2024-09-10T07:35:38.274539+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:21.241326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916009+0000","last_change":"2024-09-10T07:35:35.900987+0000","last_active":"2024-09-10T07:35:37.916009+0000","last_peered":"2024-09-10T07:35:37.916009+0000","last_clean":"2024-09-10T07:35:37.916009+0000","last_became_active":"2024-09-10T07:35:35.900599+0000","last_became_peered":"2024-09-10T07:35:35.900599+0000","last_unstale":"2024-09-10T07:35:37.916009+0000","last_undegraded":"2024-09-10T07:35:37.916009+0000","last_fullsized":"2024-09-10T07:35:37.916009+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:15.127522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274795+0000","last_change":"2024-09-10T07:35:36.930077+0000","last_active":"2024-09-10T07:35:38.274795+0000","last_peered":"2024-09-10T07:35:38.274795+0000","last_clean":"2024-09-10T07:35:38.274795+0000","last_became_active":"2024-09-10T07:35:36.929756+0000","last_became_peered":"2024-09-10T07:35:36.929756+0000","last_unstale":"2024-09-10T07:35:38.274795+0000","last_undegraded":"2024-09-10T07:35:38.274795+0000","last_fullsized":"2024-09-10T07:35:38.274795+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:54.118454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930296+0000","last_change":"2024-09-10T07:35:35.910018+0000","last_active":"2024-09-10T07:35:37.930296+0000","last_peered":"2024-09-10T07:35:37.930296+0000","last_clean":"2024-09-10T07:35:37.930296+0000","last_became_active":"2024-09-10T07:35:35.906871+0000","last_became_peered":"2024-09-10T07:35:35.906871+0000","last_unstale":"2024-09-10T07:35:37.930296+0000","last_undegraded":"2024-09-10T07:35:37.930296+0000","last_fullsized":"2024-09-10T07:35:37.930296+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:45.634391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.929898+0000","last_change":"2024-09-10T07:35:36.924301+0000","last_active":"2024-09-10T07:35:37.929898+0000","last_peered":"2024-09-10T07:35:37.929898+0000","last_clean":"2024-09-10T07:35:37.929898+0000","last_became_active":"2024-09-10T07:35:36.923746+0000","last_became_peered":"2024-09-10T07:35:36.923746+0000","last_unstale":"2024-09-10T07:35:37.929898+0000","last_undegraded":"2024-09-10T07:35:37.929898+0000","last_fullsized":"2024-09-10T07:35:37.929898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:19.879130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930153+0000","last_change":"2024-09-10T07:35:35.908053+0000","last_active":"2024-09-10T07:35:37.930153+0000","last_peered":"2024-09-10T07:35:37.930153+0000","last_clean":"2024-09-10T07:35:37.930153+0000","last_became_active":"2024-09-10T07:35:35.907561+0000","last_became_peered":"2024-09-10T07:35:35.907561+0000","last_unstale":"2024-09-10T07:35:37.930153+0000","last_undegraded":"2024-09-10T07:35:37.930153+0000","last_fullsized":"2024-09-10T07:35:37.930153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:50.971004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274410+0000","last_change":"2024-09-10T07:35:36.926174+0000","last_active":"2024-09-10T07:35:38.274410+0000","last_peered":"2024-09-10T07:35:38.274410+0000","last_clean":"2024-09-10T07:35:38.274410+0000","last_became_active":"2024-09-10T07:35:36.925948+0000","last_became_peered":"2024-09-10T07:35:36.925948+0000","last_unstale":"2024-09-10T07:35:38.274410+0000","last_undegraded":"2024-09-10T07:35:38.274410+0000","last_fullsized":"2024-09-10T07:35:38.274410+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:08.641350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915289+0000","last_change":"2024-09-10T07:35:35.905925+0000","last_active":"2024-09-10T07:35:37.915289+0000","last_peered":"2024-09-10T07:35:37.915289+0000","last_clean":"2024-09-10T07:35:37.915289+0000","last_became_active":"2024-09-10T07:35:35.905661+0000","last_became_peered":"2024-09-10T07:35:35.905661+0000","last_unstale":"2024-09-10T07:35:37.915289+0000","last_undegraded":"2024-09-10T07:35:37.915289+0000","last_fullsized":"2024-09-10T07:35:37.915289+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:13.364802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.914756+0000","last_change":"2024-09-10T07:35:36.924458+0000","last_active":"2024-09-10T07:35:37.914756+0000","last_peered":"2024-09-10T07:35:37.914756+0000","last_clean":"2024-09-10T07:35:37.914756+0000","last_became_active":"2024-09-10T07:35:36.924248+0000","last_became_peered":"2024-09-10T07:35:36.924248+0000","last_unstale":"2024-09-10T07:35:37.914756+0000","last_undegraded":"2024-09-10T07:35:37.914756+0000","last_fullsized":"2024-09-10T07:35:37.914756+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.627353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.275173+0000","last_change":"2024-09-10T07:35:35.909044+0000","last_active":"2024-09-10T07:35:38.275173+0000","last_peered":"2024-09-10T07:35:38.275173+0000","last_clean":"2024-09-10T07:35:38.275173+0000","last_became_active":"2024-09-10T07:35:35.908406+0000","last_became_peered":"2024-09-10T07:35:35.908406+0000","last_unstale":"2024-09-10T07:35:38.275173+0000","last_undegraded":"2024-09-10T07:35:38.275173+0000","last_fullsized":"2024-09-10T07:35:38.275173+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:33.712629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274786+0000","last_change":"2024-09-10T07:35:36.934262+0000","last_active":"2024-09-10T07:35:38.274786+0000","last_peered":"2024-09-10T07:35:38.274786+0000","last_clean":"2024-09-10T07:35:38.274786+0000","last_became_active":"2024-09-10T07:35:36.931262+0000","last_became_peered":"2024-09-10T07:35:36.931262+0000","last_unstale":"2024-09-10T07:35:38.274786+0000","last_undegraded":"2024-09-10T07:35:38.274786+0000","last_fullsized":"2024-09-10T07:35:38.274786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:16.348775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916318+0000","last_change":"2024-09-10T07:35:35.912705+0000","last_active":"2024-09-10T07:35:37.916318+0000","last_peered":"2024-09-10T07:35:37.916318+0000","last_clean":"2024-09-10T07:35:37.916318+0000","last_became_active":"2024-09-10T07:35:35.912031+0000","last_became_peered":"2024-09-10T07:35:35.912031+0000","last_unstale":"2024-09-10T07:35:37.916318+0000","last_undegraded":"2024-09-10T07:35:37.916318+0000","last_fullsized":"2024-09-10T07:35:37.916318+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:04.082370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274674+0000","last_change":"2024-09-10T07:35:36.939356+0000","last_active":"2024-09-10T07:35:38.274674+0000","last_peered":"2024-09-10T07:35:38.274674+0000","last_clean":"2024-09-10T07:35:38.274674+0000","last_became_active":"2024-09-10T07:35:36.938996+0000","last_became_peered":"2024-09-10T07:35:36.938996+0000","last_unstale":"2024-09-10T07:35:38.274674+0000","last_undegraded":"2024-09-10T07:35:38.274674+0000","last_fullsized":"2024-09-10T07:35:38.274674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:14.694557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931409+0000","last_change":"2024-09-10T07:35:35.908743+0000","last_active":"2024-09-10T07:35:37.931409+0000","last_peered":"2024-09-10T07:35:37.931409+0000","last_clean":"2024-09-10T07:35:37.931409+0000","last_became_active":"2024-09-10T07:35:35.908528+0000","last_became_peered":"2024-09-10T07:35:35.908528+0000","last_unstale":"2024-09-10T07:35:37.931409+0000","last_undegraded":"2024-09-10T07:35:37.931409+0000","last_fullsized":"2024-09-10T07:35:37.931409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:25.413316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274868+0000","last_change":"2024-09-10T07:35:36.931712+0000","last_active":"2024-09-10T07:35:38.274868+0000","last_peered":"2024-09-10T07:35:38.274868+0000","last_clean":"2024-09-10T07:35:38.274868+0000","last_became_active":"2024-09-10T07:35:36.930414+0000","last_became_peered":"2024-09-10T07:35:36.930414+0000","last_unstale":"2024-09-10T07:35:38.274868+0000","last_undegraded":"2024-09-10T07:35:38.274868+0000","last_fullsized":"2024-09-10T07:35:38.274868+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:06.750865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915293+0000","last_change":"2024-09-10T07:35:35.910970+0000","last_active":"2024-09-10T07:35:37.915293+0000","last_peered":"2024-09-10T07:35:37.915293+0000","last_clean":"2024-09-10T07:35:37.915293+0000","last_became_active":"2024-09-10T07:35:35.910727+0000","last_became_peered":"2024-09-10T07:35:35.910727+0000","last_unstale":"2024-09-10T07:35:37.915293+0000","last_undegraded":"2024-09-10T07:35:37.915293+0000","last_fullsized":"2024-09-10T07:35:37.915293+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:47.207369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915199+0000","last_change":"2024-09-10T07:35:36.925811+0000","last_active":"2024-09-10T07:35:37.915199+0000","last_peered":"2024-09-10T07:35:37.915199+0000","last_clean":"2024-09-10T07:35:37.915199+0000","last_became_active":"2024-09-10T07:35:36.923216+0000","last_became_peered":"2024-09-10T07:35:36.923216+0000","last_unstale":"2024-09-10T07:35:37.915199+0000","last_undegraded":"2024-09-10T07:35:37.915199+0000","last_fullsized":"2024-09-10T07:35:37.915199+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:37.579608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274840+0000","last_change":"2024-09-10T07:35:35.902140+0000","last_active":"2024-09-10T07:35:38.274840+0000","last_peered":"2024-09-10T07:35:38.274840+0000","last_clean":"2024-09-10T07:35:38.274840+0000","last_became_active":"2024-09-10T07:35:35.901722+0000","last_became_peered":"2024-09-10T07:35:35.901722+0000","last_unstale":"2024-09-10T07:35:38.274840+0000","last_undegraded":"2024-09-10T07:35:38.274840+0000","last_fullsized":"2024-09-10T07:35:38.274840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:12.982261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.929975+0000","last_change":"2024-09-10T07:35:36.929232+0000","last_active":"2024-09-10T07:35:37.929975+0000","last_peered":"2024-09-10T07:35:37.929975+0000","last_clean":"2024-09-10T07:35:37.929975+0000","last_became_active":"2024-09-10T07:35:36.928982+0000","last_became_peered":"2024-09-10T07:35:36.928982+0000","last_unstale":"2024-09-10T07:35:37.929975+0000","last_undegraded":"2024-09-10T07:35:37.929975+0000","last_fullsized":"2024-09-10T07:35:37.929975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:43.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916395+0000","last_change":"2024-09-10T07:35:35.912263+0000","last_active":"2024-09-10T07:35:37.916395+0000","last_peered":"2024-09-10T07:35:37.916395+0000","last_clean":"2024-09-10T07:35:37.916395+0000","last_became_active":"2024-09-10T07:35:35.911368+0000","last_became_peered":"2024-09-10T07:35:35.911368+0000","last_unstale":"2024-09-10T07:35:37.916395+0000","last_undegraded":"2024-09-10T07:35:37.916395+0000","last_fullsized":"2024-09-10T07:35:37.916395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:23.367938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.930300+0000","last_change":"2024-09-10T07:35:36.932023+0000","last_active":"2024-09-10T07:35:37.930300+0000","last_peered":"2024-09-10T07:35:37.930300+0000","last_clean":"2024-09-10T07:35:37.930300+0000","last_became_active":"2024-09-10T07:35:36.931442+0000","last_became_peered":"2024-09-10T07:35:36.931442+0000","last_unstale":"2024-09-10T07:35:37.930300+0000","last_undegraded":"2024-09-10T07:35:37.930300+0000","last_fullsized":"2024-09-10T07:35:37.930300+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:43.637992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931658+0000","last_change":"2024-09-10T07:35:35.911168+0000","last_active":"2024-09-10T07:35:37.931658+0000","last_peered":"2024-09-10T07:35:37.931658+0000","last_clean":"2024-09-10T07:35:37.931658+0000","last_became_active":"2024-09-10T07:35:35.910928+0000","last_became_peered":"2024-09-10T07:35:35.910928+0000","last_unstale":"2024-09-10T07:35:37.931658+0000","last_undegraded":"2024-09-10T07:35:37.931658+0000","last_fullsized":"2024-09-10T07:35:37.931658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:19.721602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915068+0000","last_change":"2024-09-10T07:35:36.926994+0000","last_active":"2024-09-10T07:35:37.915068+0000","last_peered":"2024-09-10T07:35:37.915068+0000","last_clean":"2024-09-10T07:35:37.915068+0000","last_became_active":"2024-09-10T07:35:36.926704+0000","last_became_peered":"2024-09-10T07:35:36.926704+0000","last_unstale":"2024-09-10T07:35:37.915068+0000","last_undegraded":"2024-09-10T07:35:37.915068+0000","last_fullsized":"2024-09-10T07:35:37.915068+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:28.651763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274506+0000","last_change":"2024-09-10T07:35:35.905288+0000","last_active":"2024-09-10T07:35:38.274506+0000","last_peered":"2024-09-10T07:35:38.274506+0000","last_clean":"2024-09-10T07:35:38.274506+0000","last_became_active":"2024-09-10T07:35:35.903073+0000","last_became_peered":"2024-09-10T07:35:35.903073+0000","last_unstale":"2024-09-10T07:35:38.274506+0000","last_undegraded":"2024-09-10T07:35:38.274506+0000","last_fullsized":"2024-09-10T07:35:38.274506+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:22.140704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.931579+0000","last_change":"2024-09-10T07:35:36.923008+0000","last_active":"2024-09-10T07:35:37.931579+0000","last_peered":"2024-09-10T07:35:37.931579+0000","last_clean":"2024-09-10T07:35:37.931579+0000","last_became_active":"2024-09-10T07:35:36.922749+0000","last_became_peered":"2024-09-10T07:35:36.922749+0000","last_unstale":"2024-09-10T07:35:37.931579+0000","last_undegraded":"2024-09-10T07:35:37.931579+0000","last_fullsized":"2024-09-10T07:35:37.931579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:42.862274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274991+0000","last_change":"2024-09-10T07:35:35.905864+0000","last_active":"2024-09-10T07:35:38.274991+0000","last_peered":"2024-09-10T07:35:38.274991+0000","last_clean":"2024-09-10T07:35:38.274991+0000","last_became_active":"2024-09-10T07:35:35.905605+0000","last_became_peered":"2024-09-10T07:35:35.905605+0000","last_unstale":"2024-09-10T07:35:38.274991+0000","last_undegraded":"2024-09-10T07:35:38.274991+0000","last_fullsized":"2024-09-10T07:35:38.274991+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:11.042735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:38.274829+0000","last_change":"2024-09-10T07:35:36.922930+0000","last_active":"2024-09-10T07:35:38.274829+0000","last_peered":"2024-09-10T07:35:38.274829+0000","last_clean":"2024-09-10T07:35:38.274829+0000","last_became_active":"2024-09-10T07:35:36.922701+0000","last_became_peered":"2024-09-10T07:35:36.922701+0000","last_unstale":"2024-09-10T07:35:38.274829+0000","last_undegraded":"2024-09-10T07:35:38.274829+0000","last_fullsized":"2024-09-10T07:35:38.274829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:35.890334+0000","last_clean_scrub_stamp":"2024-09-10T07:35:35.890334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:46.309619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.916241+0000","last_change":"2024-09-10T07:35:35.899846+0000","last_active":"2024-09-10T07:35:37.916241+0000","last_peered":"2024-09-10T07:35:37.916241+0000","last_clean":"2024-09-10T07:35:37.916241+0000","last_became_active":"2024-09-10T07:35:35.899137+0000","last_became_peered":"2024-09-10T07:35:35.899137+0000","last_unstale":"2024-09-10T07:35:37.916241+0000","last_undegraded":"2024-09-10T07:35:37.916241+0000","last_fullsized":"2024-09-10T07:35:37.916241+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:35:34.883091+0000","last_clean_scrub_stamp":"2024-09-10T07:35:34.883091+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:56.960451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":213,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-10T07:35:37.915345+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:35:37.915345+0000","last_peered":"2024-09-10T07:35:37.915345+0000","last_clean":"2024-09-10T07:35:37.915345+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:35:37.915345+0000","last_undegraded":"2024-09-10T07:35:37.915345+0000","last_fullsized":"2024-09-10T07:35:37.915345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.124452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":780,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194531,"statfs":{"total":200000000,"available":199200566,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195107,"statfs":{"total":200000000,"available":199790352,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195108,"statfs":{"total":200000000,"available":199790954,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195106,"statfs":{"total":200000000,"available":199789412,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":204,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195107,"statfs":{"total":200000000,"available":199790386,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":205,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195106,"statfs":{"total":200000000,"available":199789390,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":197,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195114,"statfs":{"total":200000000,"available":199797254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":780,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194531,"statfs":{"total":200000000,"available":199200622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:35:41.499 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:35:41.499 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T07:35:41.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.695+0000 7fdb09a00640 1 Processor -- start 2024-09-10T07:35:41.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.695+0000 7fdb09a00640 1 -- start start 2024-09-10T07:35:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb09a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdb040b4e70 0x7fdb04071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb09a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0415ece0 0x7fdb040b5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb09a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb040b5790 con 0x7fdb040af250 2024-09-10T07:35:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb09a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fdb040d1780 con 0x7fdb040b4e70 2024-09-10T07:35:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb09a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0406d5d0 con 0x7fdb0415ece0 2024-09-10T07:35:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb03400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdb040af250 0x7fdb0406dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40400/0 (socket says 172.21.15.99:40400) 2024-09-10T07:35:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb02a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdb040b4e70 0x7fdb04071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb03400640 1 -- 172.21.15.99:0/2231462583 learned_addr learned my addr 172.21.15.99:0/2231462583 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdafa000640 1 --2- 172.21.15.99:0/2231462583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0415ece0 0x7fdb040b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb02a00640 1 -- 172.21.15.99:0/2231462583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0415ece0 msgr2=0x7fdb040b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb02a00640 1 --2- 172.21.15.99:0/2231462583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0415ece0 0x7fdb040b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb02a00640 1 -- 172.21.15.99:0/2231462583 >> v1:172.21.15.99:6789/0 conn(0x7fdb040af250 legacy=0x7fdb0406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb02a00640 1 -- 172.21.15.99:0/2231462583 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0406f1a0 con 0x7fdb040b4e70 2024-09-10T07:35:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.697+0000 7fdb02000640 1 -- 172.21.15.99:0/2231462583 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2742158348 0 0) 0x7fdb040b5790 con 0x7fdb040af250 2024-09-10T07:35:41.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.698+0000 7fdb02a00640 1 --2- 172.21.15.99:0/2231462583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb040b4e70 0x7fdb04071570 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40097a0 tx=0x7fdaf402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69e2862b8651e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:41.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb02000640 1 -- 172.21.15.99:0/2231462583 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4037070 con 0x7fdb040b4e70 2024-09-10T07:35:41.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb02000640 1 -- 172.21.15.99:0/2231462583 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf4032440 con 0x7fdb040b4e70 2024-09-10T07:35:41.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb02000640 1 -- 172.21.15.99:0/2231462583 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4032810 con 0x7fdb040b4e70 2024-09-10T07:35:41.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb09a00640 1 -- 172.21.15.99:0/2231462583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb040b4e70 msgr2=0x7fdb04071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb09a00640 1 --2- 172.21.15.99:0/2231462583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb040b4e70 0x7fdb04071570 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40097a0 tx=0x7fdaf402a180 comp rx=0 tx=0).stop 2024-09-10T07:35:41.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb09a00640 1 -- 172.21.15.99:0/2231462583 shutdown_connections 2024-09-10T07:35:41.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb09a00640 1 --2- 172.21.15.99:0/2231462583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0415ece0 0x7fdb040b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb09a00640 1 --2- 172.21.15.99:0/2231462583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb040b4e70 0x7fdb04071570 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb09a00640 1 -- 172.21.15.99:0/2231462583 >> 172.21.15.99:0/2231462583 conn(0x7fdb0406bc10 msgr2=0x7fdb0406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:41.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb09a00640 1 -- 172.21.15.99:0/2231462583 shutdown_connections 2024-09-10T07:35:41.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.699+0000 7fdb09a00640 1 -- 172.21.15.99:0/2231462583 wait complete. 2024-09-10T07:35:41.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.701+0000 7fdb09a00640 1 Processor -- start 2024-09-10T07:35:41.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.701+0000 7fdb09a00640 1 -- start start 2024-09-10T07:35:41.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdb09a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb040af250 0x7fdb041515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdb09a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb040b4e70 0x7fdb04072420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdb09a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb04072960 0x7fdb040ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdb09a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0406d820 con 0x7fdb04072960 2024-09-10T07:35:41.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdb09a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0406f760 con 0x7fdb040b4e70 2024-09-10T07:35:41.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdb09a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0406ede0 con 0x7fdb040af250 2024-09-10T07:35:41.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdb03400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb04072960 0x7fdb040ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdb03400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb04072960 0x7fdb040ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59884/0 (socket says 172.21.15.99:59884) 2024-09-10T07:35:41.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdb03400640 1 -- 172.21.15.99:0/3660684005 learned_addr learned my addr 172.21.15.99:0/3660684005 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:41.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdb02a00640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb040af250 0x7fdb041515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.702+0000 7fdafa000640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb040b4e70 0x7fdb04072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdb03400640 1 -- 172.21.15.99:0/3660684005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb040af250 msgr2=0x7fdb041515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdb03400640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb040af250 0x7fdb041515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdb03400640 1 -- 172.21.15.99:0/3660684005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb040b4e70 msgr2=0x7fdb04072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdb03400640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb040b4e70 0x7fdb04072420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdb03400640 1 -- 172.21.15.99:0/3660684005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb040cf950 con 0x7fdb04072960 2024-09-10T07:35:41.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdb03400640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb04072960 0x7fdb040ced20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00c730 tx=0x7fdafc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:41.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdafb400640 1 -- 172.21.15.99:0/3660684005 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc018070 con 0x7fdb04072960 2024-09-10T07:35:41.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdafb400640 1 -- 172.21.15.99:0/3660684005 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc00ce40 con 0x7fdb04072960 2024-09-10T07:35:41.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdafb400640 1 -- 172.21.15.99:0/3660684005 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc00a800 con 0x7fdb04072960 2024-09-10T07:35:41.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdb09a00640 1 -- 172.21.15.99:0/3660684005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb040cfc30 con 0x7fdb04072960 2024-09-10T07:35:41.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.703+0000 7fdb09a00640 1 -- 172.21.15.99:0/3660684005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb040d01f0 con 0x7fdb04072960 2024-09-10T07:35:41.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.704+0000 7fdb09a00640 1 -- 172.21.15.99:0/3660684005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb040af6a0 con 0x7fdb04072960 2024-09-10T07:35:41.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.706+0000 7fdafb400640 1 -- 172.21.15.99:0/3660684005 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdafc00a9a0 con 0x7fdb04072960 2024-09-10T07:35:41.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.707+0000 7fdafb400640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdae006be30 0x7fdae006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:41.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.707+0000 7fdafb400640 1 -- 172.21.15.99:0/3660684005 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fdafc08a3f0 con 0x7fdb04072960 2024-09-10T07:35:41.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.707+0000 7fdb02a00640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdae006be30 0x7fdae006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:41.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.708+0000 7fdb02a00640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdae006be30 0x7fdae006e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4034000 tx=0x7fdaf402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:41.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.712+0000 7fdafb400640 1 -- 172.21.15.99:0/3660684005 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdafc058740 con 0x7fdb04072960 2024-09-10T07:35:41.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.946+0000 7fdb09a00640 1 -- 172.21.15.99:0/3660684005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdb0415e500 con 0x7fdb04072960 2024-09-10T07:35:41.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.949+0000 7fdafb400640 1 -- 172.21.15.99:0/3660684005 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7fdafc05ca40 con 0x7fdb04072960 2024-09-10T07:35:41.948 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:35:41.948 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:35:41.948 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-09-10T07:35:41.948 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-09-10T07:35:41.948 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T07:35:41.948 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-09-10T07:35:41.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 -- 172.21.15.99:0/3660684005 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdae006be30 msgr2=0x7fdae006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdae006be30 0x7fdae006e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4034000 tx=0x7fdaf402e000 comp rx=0 tx=0).stop 2024-09-10T07:35:41.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 -- 172.21.15.99:0/3660684005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb04072960 msgr2=0x7fdb040ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:41.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb04072960 0x7fdb040ced20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00c730 tx=0x7fdafc00cbf0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 -- 172.21.15.99:0/3660684005 shutdown_connections 2024-09-10T07:35:41.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdae006be30 0x7fdae006e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb04072960 0x7fdb040ced20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb040b4e70 0x7fdb04072420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 --2- 172.21.15.99:0/3660684005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb040af250 0x7fdb041515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:41.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 -- 172.21.15.99:0/3660684005 >> 172.21.15.99:0/3660684005 conn(0x7fdb0406bc10 msgr2=0x7fdb040b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:41.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 -- 172.21.15.99:0/3660684005 shutdown_connections 2024-09-10T07:35:41.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:41.951+0000 7fdb09a00640 1 -- 172.21.15.99:0/3660684005 wait complete. 2024-09-10T07:35:41.966 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:42.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.119+0000 7fdaa0000640 1 Processor -- start 2024-09-10T07:35:42.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.119+0000 7fdaa0000640 1 -- start start 2024-09-10T07:35:42.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.121+0000 7fdaa0000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda9813fae0 0x7fda9806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.121+0000 7fdaa0000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda98142650 con 0x7fda98142150 2024-09-10T07:35:42.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.121+0000 7fdaa0000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda98142930 con 0x7fda98160c50 2024-09-10T07:35:42.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.121+0000 7fdaa0000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fda980ce780 con 0x7fda9813fae0 2024-09-10T07:35:42.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.121+0000 7fda9cc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fda98142150 0x7fda98160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40406/0 (socket says 172.21.15.99:40406) 2024-09-10T07:35:42.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.121+0000 7fda9cc00640 1 -- 172.21.15.99:0/3582300950 learned_addr learned my addr 172.21.15.99:0/3582300950 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:42.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.121+0000 7fda9d600640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda9813fae0 0x7fda9806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.121+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927836658 0 0) 0x7fda98142650 con 0x7fda98142150 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.121+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda80003520 con 0x7fda98142150 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2075411136 0 0) 0x7fda80003520 con 0x7fda98142150 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda9813fae0 msgr2=0x7fda9806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda9813fae0 0x7fda9806f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 >> v1:172.21.15.187:6789/0 conn(0x7fda98160c50 legacy=0x7fda980cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda98142c10 con 0x7fda98142150 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fda84001670 con 0x7fda98142150 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda9d600640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda9813fae0 0x7fda9806f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 >> v1:172.21.15.99:6789/0 conn(0x7fda98142150 legacy=0x7fda98160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda800039e0 0x7fda80003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda80004340 0x7fda80004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda800050c0 0x7fda8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fda8000bfb0 con 0x7fda80004340 2024-09-10T07:35:42.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fda8000c160 con 0x7fda800050c0 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fda8000c360 con 0x7fda800039e0 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda9cc00640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda80004340 0x7fda80004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda9d600640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda800039e0 0x7fda80003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda9e000640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda800050c0 0x7fda8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda9cc00640 1 -- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda800039e0 msgr2=0x7fda80003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda9cc00640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda800039e0 0x7fda80003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda9cc00640 1 -- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda800050c0 msgr2=0x7fda8000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda9cc00640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda800050c0 0x7fda8000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.122+0000 7fda9cc00640 1 -- 172.21.15.99:0/3582300950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda80003520 con 0x7fda80004340 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.123+0000 7fda9cc00640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda80004340 0x7fda80004820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fda98075560 tx=0x7fda80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c70d6c5f6b7c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.124+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84007ca0 con 0x7fda80004340 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.124+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda84005ad0 con 0x7fda80004340 2024-09-10T07:35:42.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.124+0000 7fda97e00640 1 -- 172.21.15.99:0/3582300950 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda84007070 con 0x7fda80004340 2024-09-10T07:35:42.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.124+0000 7fdaa0000640 1 -- 172.21.15.99:0/3582300950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda80004340 msgr2=0x7fda80004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.124+0000 7fdaa0000640 1 --2- 172.21.15.99:0/3582300950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda80004340 0x7fda80004820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fda98075560 tx=0x7fda80005830 comp rx=0 tx=0).stop 2024-09-10T07:35:42.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.124+0000 7fda9e000640 1 -- 172.21.15.99:0/3582300950 reap_dead start 2024-09-10T07:35:42.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.124+0000 7fdaa0000640 1 -- 172.21.15.99:0/3582300950 shutdown_connections 2024-09-10T07:35:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.124+0000 7fdaa0000640 1 -- 172.21.15.99:0/3582300950 >> 172.21.15.99:0/3582300950 conn(0x7fda9806bc10 msgr2=0x7fda9806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.124+0000 7fdaa0000640 1 -- 172.21.15.99:0/3582300950 shutdown_connections 2024-09-10T07:35:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.124+0000 7fdaa0000640 1 -- 172.21.15.99:0/3582300950 wait complete. 2024-09-10T07:35:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.126+0000 7fdaa0000640 1 Processor -- start 2024-09-10T07:35:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.126+0000 7fdaa0000640 1 -- start start 2024-09-10T07:35:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fdaa0000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda80004340 0x7fda981f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fdaa0000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda9815e080 0x7fda9813b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fdaa0000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9815e500 0x7fda9813ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fdaa0000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fda9806f330 con 0x7fda9815e500 2024-09-10T07:35:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fdaa0000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fda9806f1b0 con 0x7fda9815e080 2024-09-10T07:35:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fdaa0000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fda9806f4b0 con 0x7fda80004340 2024-09-10T07:35:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fda9e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9815e500 0x7fda9813ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fda9e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9815e500 0x7fda9813ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59912/0 (socket says 172.21.15.99:59912) 2024-09-10T07:35:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fda9e000640 1 -- 172.21.15.99:0/2556029069 learned_addr learned my addr 172.21.15.99:0/2556029069 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fda9cc00640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda9815e080 0x7fda9813b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.127+0000 7fda9d600640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda80004340 0x7fda981f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fda9e000640 1 -- 172.21.15.99:0/2556029069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda80004340 msgr2=0x7fda981f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fda9e000640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda80004340 0x7fda981f0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fda9e000640 1 -- 172.21.15.99:0/2556029069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda9815e080 msgr2=0x7fda9813b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fda9e000640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda9815e080 0x7fda9813b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fda9e000640 1 -- 172.21.15.99:0/2556029069 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9815ead0 con 0x7fda9815e500 2024-09-10T07:35:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fda9e000640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9815e500 0x7fda9813ba00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fda9806c7b0 tx=0x7fda9000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fda95600640 1 -- 172.21.15.99:0/2556029069 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda90019070 con 0x7fda9815e500 2024-09-10T07:35:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fda95600640 1 -- 172.21.15.99:0/2556029069 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda90006d60 con 0x7fda9815e500 2024-09-10T07:35:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fda95600640 1 -- 172.21.15.99:0/2556029069 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda90003b90 con 0x7fda9815e500 2024-09-10T07:35:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fdaa0000640 1 -- 172.21.15.99:0/2556029069 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9815edb0 con 0x7fda9815e500 2024-09-10T07:35:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.128+0000 7fdaa0000640 1 -- 172.21.15.99:0/2556029069 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9815f370 con 0x7fda9815e500 2024-09-10T07:35:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.129+0000 7fdaa0000640 1 -- 172.21.15.99:0/2556029069 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda98160540 con 0x7fda9815e500 2024-09-10T07:35:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.130+0000 7fda95600640 1 -- 172.21.15.99:0/2556029069 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda9001c070 con 0x7fda9815e500 2024-09-10T07:35:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.131+0000 7fda95600640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda7806be60 0x7fda7806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.131+0000 7fda95600640 1 -- 172.21.15.99:0/2556029069 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fda9008a5e0 con 0x7fda9815e500 2024-09-10T07:35:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.131+0000 7fda9d600640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda7806be60 0x7fda7806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.132+0000 7fda9d600640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda7806be60 0x7fda7806e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fda980b1710 tx=0x7fda8c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:42.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.135+0000 7fda95600640 1 -- 172.21.15.99:0/2556029069 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda900588a0 con 0x7fda9815e500 2024-09-10T07:35:42.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.343+0000 7fdaa0000640 1 -- 172.21.15.99:0/2556029069 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda9815ca00 con 0x7fda9815e500 2024-09-10T07:35:42.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.343+0000 7fda95600640 1 -- 172.21.15.99:0/2556029069 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5226 (secure 0 0 0) 0x7fda9005cba0 con 0x7fda9815e500 2024-09-10T07:35:42.342 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:42.342 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"btime":"2024-09-10T07:35:39:936250+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2667247037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2667247037},{"type":"v1","addr":"172.21.15.99:6836","nonce":2667247037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/588885740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":588885740},{"type":"v1","addr":"172.21.15.187:6834","nonce":588885740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2599063325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2599063325},{"type":"v1","addr":"172.21.15.187:6835","nonce":2599063325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:36.307304+0000","modified":"2024-09-10T07:35:39.339225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1015333121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1015333121},{"type":"v1","addr":"172.21.15.99:6837","nonce":1015333121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":3}]} 2024-09-10T07:35:42.343 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 25 2024-09-10T07:35:42.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 -- 172.21.15.99:0/2556029069 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda7806be60 msgr2=0x7fda7806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda7806be60 0x7fda7806e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fda980b1710 tx=0x7fda8c009190 comp rx=0 tx=0).stop 2024-09-10T07:35:42.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 -- 172.21.15.99:0/2556029069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9815e500 msgr2=0x7fda9813ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9815e500 0x7fda9813ba00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fda9806c7b0 tx=0x7fda9000ec80 comp rx=0 tx=0).stop 2024-09-10T07:35:42.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 -- 172.21.15.99:0/2556029069 shutdown_connections 2024-09-10T07:35:42.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda7806be60 0x7fda7806e320 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9815e500 0x7fda9813ba00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda9815e080 0x7fda9813b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 --2- 172.21.15.99:0/2556029069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda80004340 0x7fda981f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 -- 172.21.15.99:0/2556029069 >> 172.21.15.99:0/2556029069 conn(0x7fda9806bc10 msgr2=0x7fda980b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:42.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 -- 172.21.15.99:0/2556029069 shutdown_connections 2024-09-10T07:35:42.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.345+0000 7fdaa0000640 1 -- 172.21.15.99:0/2556029069 wait complete. 2024-09-10T07:35:42.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:35:36.307304+0000', 'modified': '2024-09-10T07:35:39.339225+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5103': {'gid': 5103, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/1015333121', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6835', 'nonce': 1015333121}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 1015333121}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5103, 'qdb_cluster': [5103]} 2024-09-10T07:35:42.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:35:42.763 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T07:35:42.880 INFO:tasks.ceph.mds.a.smithi099.stderr:2024-09-10T07:35:42.880+0000 7f64bd800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:35:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.919+0000 7fb9e8000640 1 Processor -- start 2024-09-10T07:35:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.919+0000 7fb9e8000640 1 -- start start 2024-09-10T07:35:42.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.920+0000 7fb9e8000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb9e006e040 0x7fb9e006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.920+0000 7fb9e8000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 0x7fb9e00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.920+0000 7fb9e8000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e0153e50 con 0x7fb9e015db60 2024-09-10T07:35:42.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.920+0000 7fb9e8000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e015df40 con 0x7fb9e006e040 2024-09-10T07:35:42.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.920+0000 7fb9e8000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e006e9d0 con 0x7fb9e00ce8d0 2024-09-10T07:35:42.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.921+0000 7fb9e5600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb9e015db60 0x7fb9e0071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40412/0 (socket says 172.21.15.99:40412) 2024-09-10T07:35:42.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.921+0000 7fb9e5600640 1 -- 172.21.15.99:0/4110400044 learned_addr learned my addr 172.21.15.99:0/4110400044 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:42.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.921+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/4110400044 >> v2:172.21.15.99:3300/0 conn(0x7fb9e006e040 0x7fb9e006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.921+0000 7fb9e6000640 1 --2- 172.21.15.99:0/4110400044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 0x7fb9e00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.921+0000 7fb9e4c00640 1 -- 172.21.15.99:0/4110400044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 msgr2=0x7fb9e00ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.921+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/4110400044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 0x7fb9e00ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.921+0000 7fb9e4c00640 1 -- 172.21.15.99:0/4110400044 >> v1:172.21.15.99:6789/0 conn(0x7fb9e015db60 legacy=0x7fb9e0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.921+0000 7fb9e4c00640 1 -- 172.21.15.99:0/4110400044 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e0072ac0 con 0x7fb9e006e040 2024-09-10T07:35:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.921+0000 7fb9dfe00640 1 -- 172.21.15.99:0/4110400044 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 30206000 0 0) 0x7fb9e0153e50 con 0x7fb9e015db60 2024-09-10T07:35:42.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.922+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/4110400044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e006e040 0x7fb9e006e490 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097a0 tx=0x7fb9cc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452a41681db06d9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.922+0000 7fb9dfe00640 1 -- 172.21.15.99:0/4110400044 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc037070 con 0x7fb9e006e040 2024-09-10T07:35:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.922+0000 7fb9dfe00640 1 -- 172.21.15.99:0/4110400044 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc032440 con 0x7fb9e006e040 2024-09-10T07:35:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.922+0000 7fb9dfe00640 1 -- 172.21.15.99:0/4110400044 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc032810 con 0x7fb9e006e040 2024-09-10T07:35:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.923+0000 7fb9e8000640 1 -- 172.21.15.99:0/4110400044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e006e040 msgr2=0x7fb9e006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.923+0000 7fb9e8000640 1 --2- 172.21.15.99:0/4110400044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e006e040 0x7fb9e006e490 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097a0 tx=0x7fb9cc02a180 comp rx=0 tx=0).stop 2024-09-10T07:35:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.923+0000 7fb9e8000640 1 -- 172.21.15.99:0/4110400044 shutdown_connections 2024-09-10T07:35:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.923+0000 7fb9e8000640 1 --2- 172.21.15.99:0/4110400044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 0x7fb9e00ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.923+0000 7fb9e8000640 1 --2- 172.21.15.99:0/4110400044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e006e040 0x7fb9e006e490 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.923+0000 7fb9e8000640 1 -- 172.21.15.99:0/4110400044 >> 172.21.15.99:0/4110400044 conn(0x7fb9e00b2630 msgr2=0x7fb9e00b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:42.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.923+0000 7fb9e8000640 1 -- 172.21.15.99:0/4110400044 shutdown_connections 2024-09-10T07:35:42.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.923+0000 7fb9e8000640 1 -- 172.21.15.99:0/4110400044 wait complete. 2024-09-10T07:35:42.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.925+0000 7fb9e8000640 1 Processor -- start 2024-09-10T07:35:42.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.925+0000 7fb9e8000640 1 -- start start 2024-09-10T07:35:42.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e8000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9e006e040 0x7fb9e015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e8000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 0x7fb9e01f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e8000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e015db60 0x7fb9e00b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e8000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0073360 con 0x7fb9e015db60 2024-09-10T07:35:42.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e8000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0072e30 con 0x7fb9e006e040 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e8000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e0073640 con 0x7fb9e00ce8d0 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e015db60 0x7fb9e00b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e015db60 0x7fb9e00b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59934/0 (socket says 172.21.15.99:59934) 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e6000640 1 -- 172.21.15.99:0/2283777616 learned_addr learned my addr 172.21.15.99:0/2283777616 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e5600640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9e006e040 0x7fb9e015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 0x7fb9e01f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e6000640 1 -- 172.21.15.99:0/2283777616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 msgr2=0x7fb9e01f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e6000640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 0x7fb9e01f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e6000640 1 -- 172.21.15.99:0/2283777616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9e006e040 msgr2=0x7fb9e015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e6000640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9e006e040 0x7fb9e015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e6000640 1 -- 172.21.15.99:0/2283777616 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e014df80 con 0x7fb9e015db60 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 0x7fb9e01f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.926+0000 7fb9e5600640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9e006e040 0x7fb9e015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:42.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.927+0000 7fb9e6000640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e015db60 0x7fb9e00b1790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800efc0 tx=0x7fb9d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.927+0000 7fb9dd600640 1 -- 172.21.15.99:0/2283777616 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8018020 con 0x7fb9e015db60 2024-09-10T07:35:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.927+0000 7fb9dd600640 1 -- 172.21.15.99:0/2283777616 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d8014480 con 0x7fb9e015db60 2024-09-10T07:35:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.927+0000 7fb9dd600640 1 -- 172.21.15.99:0/2283777616 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8014870 con 0x7fb9e015db60 2024-09-10T07:35:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.927+0000 7fb9e8000640 1 -- 172.21.15.99:0/2283777616 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e014e260 con 0x7fb9e015db60 2024-09-10T07:35:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.927+0000 7fb9e8000640 1 -- 172.21.15.99:0/2283777616 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e00b4790 con 0x7fb9e015db60 2024-09-10T07:35:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.929+0000 7fb9dd600640 1 -- 172.21.15.99:0/2283777616 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb9d8005d10 con 0x7fb9e015db60 2024-09-10T07:35:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.931+0000 7fb9dd600640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9c006be30 0x7fb9c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.931+0000 7fb9dd600640 1 -- 172.21.15.99:0/2283777616 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fb9d808b980 con 0x7fb9e015db60 2024-09-10T07:35:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.931+0000 7fb9e5600640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9c006be30 0x7fb9c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.931+0000 7fb9eae82740 1 Processor -- start 2024-09-10T07:35:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.931+0000 7fb9eae82740 1 -- start start 2024-09-10T07:35:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.931+0000 7fb9e5600640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9c006be30 0x7fb9c006e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4000f60 tx=0x7fb9d4007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.932+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452bcf0 0x563194571490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.932+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5631945294b0 0x56319452c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.932+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 0x563194526570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.932+0000 7fb9eae82740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56319448a3b0 con 0x56319452bcf0 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.932+0000 7fb9eae82740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56319448f410 con 0x5631945294b0 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.932+0000 7fb9eae82740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x563194437620 con 0x56319452d480 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452bcf0 0x563194571490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452bcf0 0x563194571490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59950/0 (socket says 172.21.15.99:59950) 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e5600640 1 -- 172.21.15.99:0/2443711484 learned_addr learned my addr 172.21.15.99:0/2443711484 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/2443711484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5631945294b0 0x56319452c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e6000640 1 --2- 172.21.15.99:0/2443711484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 0x563194526570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e5600640 1 -- 172.21.15.99:0/2443711484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 msgr2=0x563194526570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e5600640 1 --2- 172.21.15.99:0/2443711484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 0x563194526570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e5600640 1 -- 172.21.15.99:0/2443711484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5631945294b0 msgr2=0x56319452c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e5600640 1 --2- 172.21.15.99:0/2443711484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5631945294b0 0x56319452c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e5600640 1 -- 172.21.15.99:0/2443711484 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631941a22d0 con 0x56319452bcf0 2024-09-10T07:35:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e6000640 1 --2- 172.21.15.99:0/2443711484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 0x563194526570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.933+0000 7fb9e5600640 1 --2- 172.21.15.99:0/2443711484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452bcf0 0x563194571490 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4005f80 tx=0x7fb9d4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a818fa035f36535 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9d1c00640 1 -- 172.21.15.99:0/2443711484 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4001d20 con 0x56319452bcf0 2024-09-10T07:35:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9d1c00640 1 -- 172.21.15.99:0/2443711484 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d40159c0 con 0x56319452bcf0 2024-09-10T07:35:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9d1c00640 1 -- 172.21.15.99:0/2443711484 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4015d70 con 0x56319452bcf0 2024-09-10T07:35:42.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9eae82740 1 -- 172.21.15.99:0/2443711484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452bcf0 msgr2=0x563194571490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9eae82740 1 --2- 172.21.15.99:0/2443711484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452bcf0 0x563194571490 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4005f80 tx=0x7fb9d4012000 comp rx=0 tx=0).stop 2024-09-10T07:35:42.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9eae82740 1 -- 172.21.15.99:0/2443711484 shutdown_connections 2024-09-10T07:35:42.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9eae82740 1 --2- 172.21.15.99:0/2443711484 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 0x563194526570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9eae82740 1 --2- 172.21.15.99:0/2443711484 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5631945294b0 0x56319452c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9eae82740 1 --2- 172.21.15.99:0/2443711484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452bcf0 0x563194571490 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9eae82740 1 -- 172.21.15.99:0/2443711484 >> 172.21.15.99:0/2443711484 conn(0x563194528740 msgr2=0x563194570960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9eae82740 1 -- 172.21.15.99:0/2443711484 shutdown_connections 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.934+0000 7fb9eae82740 1 -- 172.21.15.99:0/2443711484 wait complete. 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.935+0000 7fb9eae82740 1 -- start start 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.935+0000 7fb9eae82740 1 Processor -- start 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.936+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452bcf0 0x56319454db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.936+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452d480 0x563194555c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.936+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194556160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.936+0000 7fb9eae82740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56319444a780 con 0x5631945547c0 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.936+0000 7fb9eae82740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56319448b3d0 con 0x56319452d480 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.936+0000 7fb9eae82740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x563194527be0 con 0x56319452bcf0 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.936+0000 7fb9eae82740 10 client.0 _ll_register_callbacks cb 0x5631944885d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.936+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194556160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.936+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194556160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59956/0 (socket says 172.21.15.99:59956) 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9e6000640 1 -- 172.21.15.99:0/3524124339 learned_addr learned my addr 172.21.15.99:0/3524124339 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9e5600640 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452bcf0 0x56319454db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452d480 0x563194555c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9e6000640 1 -- 172.21.15.99:0/3524124339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452bcf0 msgr2=0x56319454db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9e6000640 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452bcf0 0x56319454db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9e6000640 1 -- 172.21.15.99:0/3524124339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452d480 msgr2=0x563194555c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9e6000640 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452d480 0x563194555c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9e6000640 1 -- 172.21.15.99:0/3524124339 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56319426c6b0 con 0x5631945547c0 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452d480 0x563194555c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9e6000640 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194556160 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8089e10 tx=0x7fb9d8059ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca65dbd0a129483 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9c6000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9c6000640 1 -- 172.21.15.99:0/3524124339 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8088060 con 0x5631945547c0 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9c6000640 1 -- 172.21.15.99:0/3524124339 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fb9d8062570 con 0x5631945547c0 2024-09-10T07:35:42.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.937+0000 7fb9eae82740 1 -- 172.21.15.99:0/3524124339 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d40159c0 con 0x5631945547c0 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9c6000640 1 -- 172.21.15.99:0/3524124339 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb9d8076050 con 0x5631945547c0 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9eae82740 10 client.5223 fetch_fsmap learned FSMap version 25 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9eae82740 1 -- 172.21.15.99:0/3524124339 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x563194525780 con 0x5631945547c0 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9c6000640 1 -- 172.21.15.99:0/3524124339 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d40159c0 con 0x5631945547c0 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9c6000640 1 -- 172.21.15.99:0/3524124339 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fb9d8059070 con 0x5631945547c0 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9eae82740 10 client.5223 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9eae82740 10 client.5223 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9eae82740 20 client.5223 populate_metadata read hostname 'smithi099' 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9eae82740 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.99:6835/1015333121,v1:172.21.15.99:6837/1015333121] conn(0x563194584900 0x563194584ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9eae82740 4 client.5223 mds_command: new command op to 5103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9eae82740 1 -- 172.21.15.99:0/3524124339 --> [v2:172.21.15.99:6835/1015333121,v1:172.21.15.99:6837/1015333121] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56319449cb40 con 0x563194584900 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.938+0000 7fb9e5600640 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.99:6835/1015333121,v1:172.21.15.99:6837/1015333121] conn(0x563194584900 0x563194584ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.939+0000 7fb9e5600640 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.99:6835/1015333121,v1:172.21.15.99:6837/1015333121] conn(0x563194584900 0x563194584ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e2036a73148ea11 server_cookie=fa0f1333ff32fbaa in_seq=0 out_seq=0 2024-09-10T07:35:42.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.939+0000 7fb9c6000640 10 client.5223 ms_handle_connect on v2:172.21.15.99:6835/1015333121 2024-09-10T07:35:42.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9c6000640 1 -- 172.21.15.99:0/3524124339 <== mds.0 v2:172.21.15.99:6835/1015333121 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56319449cb40 con 0x563194584900 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9c6000640 10 client.5223 handle_command_reply: tid=0 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 client.5223 shutdown 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 -- 172.21.15.99:0/3524124339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 msgr2=0x563194556160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194556160 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8089e10 tx=0x7fb9d8059ce0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 -- 172.21.15.99:0/3524124339 shutdown_connections 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.99:6835/1015333121,v1:172.21.15.99:6837/1015333121] conn(0x563194584900 0x563194584ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194556160 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452d480 0x563194555c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 --2- 172.21.15.99:0/3524124339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452bcf0 0x56319454db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9c6000640 0 client.5223 ms_handle_reset on v2:172.21.15.99:6835/1015333121 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 -- 172.21.15.99:0/3524124339 >> 172.21.15.99:0/3524124339 conn(0x5631945294b0 msgr2=0x56319456f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 -- 172.21.15.99:0/3524124339 shutdown_connections 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.940+0000 7fb9eae82740 1 -- 172.21.15.99:0/3524124339 wait complete. 2024-09-10T07:35:42.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.941+0000 7fb9eae82740 20 client.5223 trim_cache size 0 max 16384 2024-09-10T07:35:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.959+0000 7fb9eae82740 1 Processor -- start 2024-09-10T07:35:42.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.960+0000 7fb9eae82740 1 -- start start 2024-09-10T07:35:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.960+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 0x563194528150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.960+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 0x563194553d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.960+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194550ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.960+0000 7fb9eae82740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00af120 con 0x5631945547c0 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.960+0000 7fb9eae82740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00b5880 con 0x56319452bcf0 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.960+0000 7fb9eae82740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e00aead0 con 0x56319452d480 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194550ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194550ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59964/0 (socket says 172.21.15.99:59964) 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e6000640 1 -- 172.21.15.99:0/2554246057 learned_addr learned my addr 172.21.15.99:0/2554246057 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e5600640 1 --2- 172.21.15.99:0/2554246057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 0x563194528150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/2554246057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 0x563194553d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e6000640 1 -- 172.21.15.99:0/2554246057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 msgr2=0x563194553d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e6000640 1 --2- 172.21.15.99:0/2554246057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 0x563194553d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e6000640 1 -- 172.21.15.99:0/2554246057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 msgr2=0x563194528150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e6000640 1 --2- 172.21.15.99:0/2554246057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 0x563194528150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e6000640 1 -- 172.21.15.99:0/2554246057 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563194525db0 con 0x5631945547c0 2024-09-10T07:35:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e5600640 1 --2- 172.21.15.99:0/2554246057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 0x563194528150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:42.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9e6000640 1 --2- 172.21.15.99:0/2554246057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194550ce0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800ef90 tx=0x7fb9d805d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0098927041e0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:42.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.961+0000 7fb9d1200640 1 -- 172.21.15.99:0/2554246057 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8055ec0 con 0x5631945547c0 2024-09-10T07:35:42.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9d1200640 1 -- 172.21.15.99:0/2554246057 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d8062370 con 0x5631945547c0 2024-09-10T07:35:42.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9d1200640 1 -- 172.21.15.99:0/2554246057 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8060220 con 0x5631945547c0 2024-09-10T07:35:42.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9eae82740 1 -- 172.21.15.99:0/2554246057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 msgr2=0x563194550ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9eae82740 1 --2- 172.21.15.99:0/2554246057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194550ce0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800ef90 tx=0x7fb9d805d000 comp rx=0 tx=0).stop 2024-09-10T07:35:42.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9eae82740 1 -- 172.21.15.99:0/2554246057 shutdown_connections 2024-09-10T07:35:42.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9eae82740 1 --2- 172.21.15.99:0/2554246057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631945547c0 0x563194550ce0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9eae82740 1 --2- 172.21.15.99:0/2554246057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56319452d480 0x563194553d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9eae82740 1 --2- 172.21.15.99:0/2554246057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 0x563194528150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9eae82740 1 -- 172.21.15.99:0/2554246057 >> 172.21.15.99:0/2554246057 conn(0x5631945294b0 msgr2=0x5631945724c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:42.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9eae82740 1 -- 172.21.15.99:0/2554246057 shutdown_connections 2024-09-10T07:35:42.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.962+0000 7fb9eae82740 1 -- 172.21.15.99:0/2554246057 wait complete. 2024-09-10T07:35:42.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.963+0000 7fb9eae82740 1 -- start start 2024-09-10T07:35:42.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.963+0000 7fb9eae82740 1 Processor -- start 2024-09-10T07:35:42.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 0x56319456cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452d480 0x5631945d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9eae82740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5631945547c0 0x563194570890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9eae82740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56319456c930 con 0x56319452d480 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9eae82740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x563194525a60 con 0x56319452bcf0 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9eae82740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x563194526a40 con 0x5631945547c0 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9eae82740 10 client.0 _ll_register_callbacks cb 0x7fb9d80597f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9e4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452d480 0x5631945d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9e4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452d480 0x5631945d4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59972/0 (socket says 172.21.15.99:59972) 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9e5600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 0x56319456cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.964+0000 7fb9e4c00640 1 -- 172.21.15.99:0/1139880836 learned_addr learned my addr 172.21.15.99:0/1139880836 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9e6000640 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5631945547c0 0x563194570890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9e4c00640 1 -- 172.21.15.99:0/1139880836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5631945547c0 msgr2=0x563194570890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5631945547c0 0x563194570890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9e4c00640 1 -- 172.21.15.99:0/1139880836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 msgr2=0x56319456cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:42.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 0x56319456cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9e4c00640 1 -- 172.21.15.99:0/1139880836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56319456bea0 con 0x56319452d480 2024-09-10T07:35:42.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9e4c00640 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452d480 0x5631945d4e20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc000c00 tx=0x7fb9cc02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feab606bcfe4fa95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:42.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9c6000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:35:42.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9c6000640 1 -- 172.21.15.99:0/1139880836 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc037040 con 0x56319452d480 2024-09-10T07:35:42.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9c6000640 1 -- 172.21.15.99:0/1139880836 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fb9cc032d20 con 0x56319452d480 2024-09-10T07:35:42.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.965+0000 7fb9eae82740 1 -- 172.21.15.99:0/1139880836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d8062370 con 0x56319452d480 2024-09-10T07:35:42.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9c6000640 1 -- 172.21.15.99:0/1139880836 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb9cc03c410 con 0x56319452d480 2024-09-10T07:35:42.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9eae82740 10 client.5229 fetch_fsmap learned FSMap version 25 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9eae82740 1 -- 172.21.15.99:0/1139880836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x56319456fb60 con 0x56319452d480 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9c6000640 1 -- 172.21.15.99:0/1139880836 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d8062370 con 0x56319452d480 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9c6000640 1 -- 172.21.15.99:0/1139880836 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fb9cc03c5b0 con 0x56319452d480 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9eae82740 10 client.5229 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9eae82740 10 client.5229 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9eae82740 20 client.5229 populate_metadata read hostname 'smithi099' 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9eae82740 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.99:6835/1015333121,v1:172.21.15.99:6837/1015333121] conn(0x563194593da0 0x56319456eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9eae82740 4 client.5229 mds_command: new command op to 5103 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9eae82740 1 -- 172.21.15.99:0/1139880836 --> [v2:172.21.15.99:6835/1015333121,v1:172.21.15.99:6837/1015333121] -- command(tid 0: {"prefix": "status"}) -- 0x563194496e90 con 0x563194593da0 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.966+0000 7fb9e5600640 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.99:6835/1015333121,v1:172.21.15.99:6837/1015333121] conn(0x563194593da0 0x56319456eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9e5600640 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.99:6835/1015333121,v1:172.21.15.99:6837/1015333121] conn(0x563194593da0 0x56319456eae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c67c35f4ef9bd7d server_cookie=a2be8f5e8e7580f1 in_seq=0 out_seq=0 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9c6000640 10 client.5229 ms_handle_connect on v2:172.21.15.99:6835/1015333121 2024-09-10T07:35:42.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9c6000640 1 -- 172.21.15.99:0/1139880836 <== mds.0 v2:172.21.15.99:6835/1015333121 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x563194496e90 con 0x563194593da0 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9c6000640 10 client.5229 handle_command_reply: tid=0 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 client.5229 shutdown 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 -- 172.21.15.99:0/1139880836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452d480 msgr2=0x5631945d4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452d480 0x5631945d4e20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc000c00 tx=0x7fb9cc02c070 comp rx=0 tx=0).stop 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 -- 172.21.15.99:0/1139880836 shutdown_connections 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.99:6835/1015333121,v1:172.21.15.99:6837/1015333121] conn(0x563194593da0 0x56319456eae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5631945547c0 0x563194570890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56319452d480 0x5631945d4e20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 --2- 172.21.15.99:0/1139880836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56319452bcf0 0x56319456cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9c6000640 0 client.5229 ms_handle_reset on v2:172.21.15.99:6835/1015333121 2024-09-10T07:35:42.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 -- 172.21.15.99:0/1139880836 >> 172.21.15.99:0/1139880836 conn(0x5631945294b0 msgr2=0x563194526bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:42.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 -- 172.21.15.99:0/1139880836 shutdown_connections 2024-09-10T07:35:42.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.967+0000 7fb9eae82740 1 -- 172.21.15.99:0/1139880836 wait complete. 2024-09-10T07:35:42.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9eae82740 20 client.5229 trim_cache size 0 max 16384 2024-09-10T07:35:42.971 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:35:42.971 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:35:42.971 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:35:42.971 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 5103, 2024-09-10T07:35:42.971 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:35:42.972 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:35:42.972 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:35:42.972 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 6.0466414989999997, 2024-09-10T07:35:42.972 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 25, 2024-09-10T07:35:42.972 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 44, 2024-09-10T07:35:42.972 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 44, 2024-09-10T07:35:42.972 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 10.6017271 2024-09-10T07:35:42.972 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:35:42.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 -- 172.21.15.99:0/2283777616 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9c006be30 msgr2=0x7fb9c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9c006be30 0x7fb9c006e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4000f60 tx=0x7fb9d4007ca0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 -- 172.21.15.99:0/2283777616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e015db60 msgr2=0x7fb9e00b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:42.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e015db60 0x7fb9e00b1790 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800efc0 tx=0x7fb9d800c490 comp rx=0 tx=0).stop 2024-09-10T07:35:42.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 -- 172.21.15.99:0/2283777616 shutdown_connections 2024-09-10T07:35:42.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb9c006be30 0x7fb9c006e2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e015db60 0x7fb9e00b1790 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9e00ce8d0 0x7fb9e01f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 --2- 172.21.15.99:0/2283777616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9e006e040 0x7fb9e015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:42.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 -- 172.21.15.99:0/2283777616 >> 172.21.15.99:0/2283777616 conn(0x7fb9e00b2630 msgr2=0x7fb9e015fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:42.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 -- 172.21.15.99:0/2283777616 shutdown_connections 2024-09-10T07:35:42.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:42.968+0000 7fb9e8000640 1 -- 172.21.15.99:0/2283777616 wait complete. 2024-09-10T07:35:42.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:35:43.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.138+0000 7fc7b4000640 1 Processor -- start 2024-09-10T07:35:43.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.138+0000 7fc7b4000640 1 -- start start 2024-09-10T07:35:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.139+0000 7fc7b4000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac145290 0x7fc7ac06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.139+0000 7fc7b4000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc7ac0ce780 0x7fc7ac072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.139+0000 7fc7b4000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7ac06e3d0 con 0x7fc7ac071510 2024-09-10T07:35:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.139+0000 7fc7b4000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fc7ac06efe0 con 0x7fc7ac0ce780 2024-09-10T07:35:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.139+0000 7fc7b4000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ac06e6b0 con 0x7fc7ac145290 2024-09-10T07:35:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.140+0000 7fc7b1600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac145290 0x7fc7ac06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.140+0000 7fc7b1600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac145290 0x7fc7ac06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:35208/0 (socket says 172.21.15.99:35208) 2024-09-10T07:35:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.140+0000 7fc7b1600640 1 -- 172.21.15.99:0/1097740477 learned_addr learned my addr 172.21.15.99:0/1097740477 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:43.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.140+0000 7fc7b0c00640 1 --2- 172.21.15.99:0/1097740477 >> v2:172.21.15.187:3300/0 conn(0x7fc7ac0ce780 0x7fc7ac072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:43.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.140+0000 7fc7b1600640 1 -- 172.21.15.99:0/1097740477 >> v2:172.21.15.187:3300/0 conn(0x7fc7ac0ce780 msgr2=0x7fc7ac072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:43.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.140+0000 7fc7b1600640 1 --2- 172.21.15.99:0/1097740477 >> v2:172.21.15.187:3300/0 conn(0x7fc7ac0ce780 0x7fc7ac072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:43.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.140+0000 7fc7b1600640 1 -- 172.21.15.99:0/1097740477 >> v1:172.21.15.187:6789/0 conn(0x7fc7ac071510 legacy=0x7fc7ac0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:43.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.140+0000 7fc7b1600640 1 -- 172.21.15.99:0/1097740477 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac06e990 con 0x7fc7ac145290 2024-09-10T07:35:43.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.141+0000 7fc7b1600640 1 --2- 172.21.15.99:0/1097740477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac145290 0x7fc7ac06f470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009870 tx=0x7fc7a002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0e218a6b3fb05d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:43.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.142+0000 7fc7abe00640 1 -- 172.21.15.99:0/1097740477 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0037070 con 0x7fc7ac145290 2024-09-10T07:35:43.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.142+0000 7fc7abe00640 1 -- 172.21.15.99:0/1097740477 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a0032440 con 0x7fc7ac145290 2024-09-10T07:35:43.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.142+0000 7fc7abe00640 1 -- 172.21.15.99:0/1097740477 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0032810 con 0x7fc7ac145290 2024-09-10T07:35:43.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.142+0000 7fc7b4000640 1 -- 172.21.15.99:0/1097740477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac145290 msgr2=0x7fc7ac06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:43.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.142+0000 7fc7b4000640 1 --2- 172.21.15.99:0/1097740477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac145290 0x7fc7ac06f470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009870 tx=0x7fc7a002a270 comp rx=0 tx=0).stop 2024-09-10T07:35:43.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.143+0000 7fc7b4000640 1 -- 172.21.15.99:0/1097740477 shutdown_connections 2024-09-10T07:35:43.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.143+0000 7fc7b4000640 1 --2- 172.21.15.99:0/1097740477 >> v2:172.21.15.187:3300/0 conn(0x7fc7ac0ce780 0x7fc7ac072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:43.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.143+0000 7fc7b4000640 1 --2- 172.21.15.99:0/1097740477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac145290 0x7fc7ac06f470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:43.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.143+0000 7fc7b4000640 1 -- 172.21.15.99:0/1097740477 >> 172.21.15.99:0/1097740477 conn(0x7fc7ac06bc10 msgr2=0x7fc7ac06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:43.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.143+0000 7fc7b4000640 1 -- 172.21.15.99:0/1097740477 shutdown_connections 2024-09-10T07:35:43.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.143+0000 7fc7b4000640 1 -- 172.21.15.99:0/1097740477 wait complete. 2024-09-10T07:35:43.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.144+0000 7fc7b4000640 1 Processor -- start 2024-09-10T07:35:43.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.144+0000 7fc7b4000640 1 -- start start 2024-09-10T07:35:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.145+0000 7fc7b4000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac071510 0x7fc7ac131910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.145+0000 7fc7b4000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7ac0ce780 0x7fc7ac15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.145+0000 7fc7b4000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac145290 0x7fc7ac133d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.145+0000 7fc7b4000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac06df80 con 0x7fc7ac0ce780 2024-09-10T07:35:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.145+0000 7fc7b4000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac145670 con 0x7fc7ac145290 2024-09-10T07:35:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.145+0000 7fc7b4000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ac06e100 con 0x7fc7ac071510 2024-09-10T07:35:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7ac0ce780 0x7fc7ac15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7ac0ce780 0x7fc7ac15b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59980/0 (socket says 172.21.15.99:59980) 2024-09-10T07:35:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b0c00640 1 -- 172.21.15.99:0/593741718 learned_addr learned my addr 172.21.15.99:0/593741718 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b1600640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac071510 0x7fc7ac131910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b2000640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac145290 0x7fc7ac133d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b0c00640 1 -- 172.21.15.99:0/593741718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac071510 msgr2=0x7fc7ac131910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b0c00640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac071510 0x7fc7ac131910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b0c00640 1 -- 172.21.15.99:0/593741718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac145290 msgr2=0x7fc7ac133d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b0c00640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac145290 0x7fc7ac133d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b0c00640 1 -- 172.21.15.99:0/593741718 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac134550 con 0x7fc7ac0ce780 2024-09-10T07:35:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b2000640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac145290 0x7fc7ac133d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:35:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7b0c00640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7ac0ce780 0x7fc7ac15b330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc79800e980 tx=0x7fc79800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:43.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.146+0000 7fc7a9600640 1 -- 172.21.15.99:0/593741718 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798017070 con 0x7fc7ac0ce780 2024-09-10T07:35:43.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.147+0000 7fc7a9600640 1 -- 172.21.15.99:0/593741718 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79800ca00 con 0x7fc7ac0ce780 2024-09-10T07:35:43.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.147+0000 7fc7b4000640 1 -- 172.21.15.99:0/593741718 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ac135380 con 0x7fc7ac0ce780 2024-09-10T07:35:43.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.147+0000 7fc7a9600640 1 -- 172.21.15.99:0/593741718 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79800cdd0 con 0x7fc7ac0ce780 2024-09-10T07:35:43.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.147+0000 7fc7b4000640 1 -- 172.21.15.99:0/593741718 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ac135940 con 0x7fc7ac0ce780 2024-09-10T07:35:43.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.148+0000 7fc7b4000640 1 -- 172.21.15.99:0/593741718 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ac06f450 con 0x7fc7ac0ce780 2024-09-10T07:35:43.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.149+0000 7fc7a9600640 1 -- 172.21.15.99:0/593741718 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc79801a070 con 0x7fc7ac0ce780 2024-09-10T07:35:43.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.150+0000 7fc7a9600640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc78c06be60 0x7fc78c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:43.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.150+0000 7fc7a9600640 1 -- 172.21.15.99:0/593741718 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fc79808ae60 con 0x7fc7ac0ce780 2024-09-10T07:35:43.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.150+0000 7fc7b1600640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc78c06be60 0x7fc78c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:43.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.150+0000 7fc7b1600640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc78c06be60 0x7fc78c06e320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0034000 tx=0x7fc7a002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:43.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.154+0000 7fc7a9600640 1 -- 172.21.15.99:0/593741718 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc798059800 con 0x7fc7ac0ce780 2024-09-10T07:35:43.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.361+0000 7fc7b4000640 1 -- 172.21.15.99:0/593741718 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc7ac13e030 con 0x7fc7ac0ce780 2024-09-10T07:35:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.362+0000 7fc7a9600640 1 -- 172.21.15.99:0/593741718 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7fc798059100 con 0x7fc7ac0ce780 2024-09-10T07:35:43.361 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:35:43.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 -- 172.21.15.99:0/593741718 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc78c06be60 msgr2=0x7fc78c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:43.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc78c06be60 0x7fc78c06e320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0034000 tx=0x7fc7a002e000 comp rx=0 tx=0).stop 2024-09-10T07:35:43.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 -- 172.21.15.99:0/593741718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7ac0ce780 msgr2=0x7fc7ac15b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:43.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7ac0ce780 0x7fc7ac15b330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc79800e980 tx=0x7fc79800ee40 comp rx=0 tx=0).stop 2024-09-10T07:35:43.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 -- 172.21.15.99:0/593741718 shutdown_connections 2024-09-10T07:35:43.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac145290 0x7fc7ac133d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:43.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc78c06be60 0x7fc78c06e320 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:43.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7ac0ce780 0x7fc7ac15b330 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:43.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 --2- 172.21.15.99:0/593741718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7ac071510 0x7fc7ac131910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:43.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 -- 172.21.15.99:0/593741718 >> 172.21.15.99:0/593741718 conn(0x7fc7ac06bc10 msgr2=0x7fc7ac072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:43.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 -- 172.21.15.99:0/593741718 shutdown_connections 2024-09-10T07:35:43.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43.364+0000 7fc7b4000640 1 -- 172.21.15.99:0/593741718 wait complete. 2024-09-10T07:35:43.379 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:35:43.379 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:35:43.379 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:35:43.379 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:35:43.379 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:35:43.379 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:35:43.380 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:35:43.380 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:35:43.380 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:35:43.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:43.380 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:35:43.416 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:43.417 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42684sec preferred_lft 42684sec 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:43.418 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:35:43.419 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:35:43.419 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link 2024-09-10T07:35:43.419 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:43.419 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:35:43.419 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:35:43.419 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::1c1f:52ff:fe95:9fbe/64 scope link 2024-09-10T07:35:43.419 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:43.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:43.420 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:35:43.510 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:35:43.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:43.513 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:35:43.549 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:35:43.550 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:35:43.550 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:35:43.550 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:35:43.550 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:35:43.550 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:35:43.550 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:35:43.550 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:35:43.550 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:35:43.550 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:35:43.551 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:35:43.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:35:43.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:43.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:43.752 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:35:43.786 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:35:43.787 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:35:43.787 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:35:43.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:43.787 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:35:43.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:35:43.883 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:35:43.920 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:35:43.920 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:35:43.920 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:35:43.996 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:35:43.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:43.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:44.124 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:44.124 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:35:44.153 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:44.153 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:35:44.154 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:35:44.154 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:35:44.154 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:35:44.155 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:35:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:35:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:35:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:35:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:35:44.158 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:35:44.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:44.159 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:35:44.215 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:35:44.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:35:44.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:44.311 INFO:teuthology.orchestra.run.smithi099.stdout:client4886 2024-09-10T07:35:44.311 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:44.311 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:44.347 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:35:44.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.541+0000 7f634ac00640 1 Processor -- start 2024-09-10T07:35:44.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.542+0000 7f634ac00640 1 -- start start 2024-09-10T07:35:44.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.543+0000 7f634ac00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 0x7f634406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:44.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.543+0000 7f634ac00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6344072f40 0x7f63440b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:44.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.543+0000 7f634ac00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f634406e3d0 con 0x7f63440ce780 2024-09-10T07:35:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.543+0000 7f634ac00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f634406efe0 con 0x7f6344072f40 2024-09-10T07:35:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.543+0000 7f634ac00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f634406e6b0 con 0x7f6344145290 2024-09-10T07:35:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.543+0000 7f6348c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6344072f40 0x7f63440b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.543+0000 7f6348c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6344072f40 0x7f63440b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59994/0 (socket says 172.21.15.99:59994) 2024-09-10T07:35:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.543+0000 7f6348c00640 1 -- 172.21.15.99:0/1460498210 learned_addr learned my addr 172.21.15.99:0/1460498210 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.543+0000 7f6343e00640 1 --2- 172.21.15.99:0/1460498210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 0x7f634406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.544+0000 7f6348c00640 1 -- 172.21.15.99:0/1460498210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 msgr2=0x7f634406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.544+0000 7f6348c00640 1 --2- 172.21.15.99:0/1460498210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 0x7f634406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.544+0000 7f6348c00640 1 -- 172.21.15.99:0/1460498210 >> v1:172.21.15.187:6789/0 conn(0x7f63440ce780 legacy=0x7f6344072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.544+0000 7f6348c00640 1 -- 172.21.15.99:0/1460498210 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634406e990 con 0x7f6344072f40 2024-09-10T07:35:44.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.545+0000 7f6348c00640 1 --2- 172.21.15.99:0/1460498210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 0x7f63440b3930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f633c009e50 tx=0x7f633c02c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce410848e644884 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.545+0000 7f6342a00640 1 -- 172.21.15.99:0/1460498210 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c032610 con 0x7f6344072f40 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.545+0000 7f6342a00640 1 -- 172.21.15.99:0/1460498210 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633c037070 con 0x7f6344072f40 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.545+0000 7f6342a00640 1 -- 172.21.15.99:0/1460498210 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c0329d0 con 0x7f6344072f40 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.545+0000 7f634ac00640 1 -- 172.21.15.99:0/1460498210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 msgr2=0x7f63440b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.545+0000 7f634ac00640 1 --2- 172.21.15.99:0/1460498210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 0x7f63440b3930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f633c009e50 tx=0x7f633c02c920 comp rx=0 tx=0).stop 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.546+0000 7f634ac00640 1 -- 172.21.15.99:0/1460498210 shutdown_connections 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.546+0000 7f634ac00640 1 --2- 172.21.15.99:0/1460498210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 0x7f63440b3930 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.546+0000 7f634ac00640 1 --2- 172.21.15.99:0/1460498210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 0x7f634406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.546+0000 7f634ac00640 1 -- 172.21.15.99:0/1460498210 >> 172.21.15.99:0/1460498210 conn(0x7f634406bc10 msgr2=0x7f634406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.546+0000 7f634ac00640 1 -- 172.21.15.99:0/1460498210 shutdown_connections 2024-09-10T07:35:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.546+0000 7f634ac00640 1 -- 172.21.15.99:0/1460498210 wait complete. 2024-09-10T07:35:44.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.547+0000 7f634ac00640 1 Processor -- start 2024-09-10T07:35:44.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.547+0000 7f634ac00640 1 -- start start 2024-09-10T07:35:44.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.548+0000 7f634ac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 0x7f634415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:44.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.548+0000 7f634ac00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63440ce780 0x7f63440af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.548+0000 7f634ac00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 0x7f6344143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.548+0000 7f634ac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f634406df80 con 0x7f6344072f40 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.548+0000 7f634ac00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6344145670 con 0x7f63440ce780 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.548+0000 7f634ac00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f634406e100 con 0x7f6344145290 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 0x7f634415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 0x7f634415a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60004/0 (socket says 172.21.15.99:60004) 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343e00640 1 -- 172.21.15.99:0/275687199 learned_addr learned my addr 172.21.15.99:0/275687199 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6348c00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 0x7f6344143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343400640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63440ce780 0x7f63440af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343e00640 1 -- 172.21.15.99:0/275687199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 msgr2=0x7f6344143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343e00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 0x7f6344143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343e00640 1 -- 172.21.15.99:0/275687199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63440ce780 msgr2=0x7f63440af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343e00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63440ce780 0x7f63440af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343e00640 1 -- 172.21.15.99:0/275687199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634413afd0 con 0x7f6344072f40 2024-09-10T07:35:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6348c00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 0x7f6344143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343400640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63440ce780 0x7f63440af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.549+0000 7f6343e00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 0x7f634415a340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f633400e9b0 tx=0x7f633400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.550+0000 7f633be00640 1 -- 172.21.15.99:0/275687199 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334017070 con 0x7f6344072f40 2024-09-10T07:35:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.550+0000 7f633be00640 1 -- 172.21.15.99:0/275687199 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633400c9a0 con 0x7f6344072f40 2024-09-10T07:35:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.550+0000 7f633be00640 1 -- 172.21.15.99:0/275687199 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633400cd90 con 0x7f6344072f40 2024-09-10T07:35:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.550+0000 7f634ac00640 1 -- 172.21.15.99:0/275687199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634415c150 con 0x7f6344072f40 2024-09-10T07:35:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.550+0000 7f634ac00640 1 -- 172.21.15.99:0/275687199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634415c710 con 0x7f6344072f40 2024-09-10T07:35:44.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.551+0000 7f634ac00640 1 -- 172.21.15.99:0/275687199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6344071510 con 0x7f6344072f40 2024-09-10T07:35:44.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.552+0000 7f633be00640 1 -- 172.21.15.99:0/275687199 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f633401a070 con 0x7f6344072f40 2024-09-10T07:35:44.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.552+0000 7f633be00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f632406be30 0x7f632406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:44.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.553+0000 7f633be00640 1 -- 172.21.15.99:0/275687199 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f633408aea0 con 0x7f6344072f40 2024-09-10T07:35:44.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.553+0000 7f6343400640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f632406be30 0x7f632406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:44.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.553+0000 7f6343400640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f632406be30 0x7f632406e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f63440b57d0 tx=0x7f6330009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:44.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.557+0000 7f633be00640 1 -- 172.21.15.99:0/275687199 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f634413afd0 con 0x7f6344072f40 2024-09-10T07:35:44.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.762+0000 7f634ac00640 1 -- 172.21.15.99:0/275687199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f63440b0e70 con 0x7f6344072f40 2024-09-10T07:35:44.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.763+0000 7f633be00640 1 -- 172.21.15.99:0/275687199 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f6334059840 con 0x7f6344072f40 2024-09-10T07:35:44.763 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:35:44.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 -- 172.21.15.99:0/275687199 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f632406be30 msgr2=0x7f632406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:44.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f632406be30 0x7f632406e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f63440b57d0 tx=0x7f6330009040 comp rx=0 tx=0).stop 2024-09-10T07:35:44.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 -- 172.21.15.99:0/275687199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 msgr2=0x7f634415a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:44.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 0x7f634415a340 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f633400e9b0 tx=0x7f633400ee70 comp rx=0 tx=0).stop 2024-09-10T07:35:44.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 -- 172.21.15.99:0/275687199 shutdown_connections 2024-09-10T07:35:44.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6344145290 0x7f6344143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:44.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63440ce780 0x7f63440af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:44.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f632406be30 0x7f632406e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:44.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 --2- 172.21.15.99:0/275687199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6344072f40 0x7f634415a340 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:44.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 -- 172.21.15.99:0/275687199 >> 172.21.15.99:0/275687199 conn(0x7f634406bc10 msgr2=0x7f63440b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:44.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 -- 172.21.15.99:0/275687199 shutdown_connections 2024-09-10T07:35:44.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:44.765+0000 7f634ac00640 1 -- 172.21.15.99:0/275687199 wait complete. 2024-09-10T07:35:44.781 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:35:44.781 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:35:44.781 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:35:44.781 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:35:44.782 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:35:44.782 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:35:44.782 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:35:44.782 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:35:44.782 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:35:44.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:44.782 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:35:44.823 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:35:44.823 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:35:44.823 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:35:44.823 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:44.823 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:44.824 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42679sec preferred_lft 42679sec 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:35:44.825 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:44.826 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:35:44.826 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:35:44.826 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::84a0:e5ff:fe75:1d2e/64 scope link 2024-09-10T07:35:44.826 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:35:44.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:44.826 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:35:44.921 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:35:44.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:44.928 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:35:44.966 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:35:44.966 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:35:44.966 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:35:44.966 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:35:44.966 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:35:44.967 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:35:44.967 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:35:44.967 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:35:44.967 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:35:44.968 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:35:44.968 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:35:45.084 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:35:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:35:45.154 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:35:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:45.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:45.164 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:35:45.200 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:35:45.200 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:35:45.200 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:35:45.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:45.200 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:35:45.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:35:45.298 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:35:45.336 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:35:45.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:35:45.336 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:35:45.408 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:35:45.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:45.408 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:45.540 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:45.540 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:35:45.567 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:35:45.567 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:35:45.567 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:35:45.567 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:35:45.567 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:35:45.568 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:35:45.569 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:35:45.569 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:35:45.569 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:35:45.569 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:35:45.572 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:35:45.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:45.572 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:35:45.628 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:35:45.707 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:35:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:35:45.710 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:35:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:35:45.718 INFO:teuthology.orchestra.run.smithi187.stdout:client5241 2024-09-10T07:35:45.719 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:35:45.719 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:45.754 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:45.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.913+0000 7ff0f2400640 1 Processor -- start 2024-09-10T07:35:45.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.913+0000 7ff0f2400640 1 -- start start 2024-09-10T07:35:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.914+0000 7ff0f2400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff0ec15eb00 0x7ff0ec1630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.914+0000 7ff0f2400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0ec06e730 con 0x7ff0ec06d810 2024-09-10T07:35:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.914+0000 7ff0f2400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0ec06ea10 con 0x7ff0ec15fef0 2024-09-10T07:35:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.914+0000 7ff0f2400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff0ec1628d0 con 0x7ff0ec15eb00 2024-09-10T07:35:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.915+0000 7ff0e2a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff0ec06d810 0x7ff0ec0b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40428/0 (socket says 172.21.15.99:40428) 2024-09-10T07:35:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.915+0000 7ff0e2a00640 1 -- 172.21.15.99:0/1995429514 learned_addr learned my addr 172.21.15.99:0/1995429514 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.915+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4070219076 0 0) 0x7ff0ec06e730 con 0x7ff0ec06d810 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.915+0000 7ff0eb400640 1 --2- 172.21.15.99:0/1995429514 >> v2:172.21.15.187:3300/0 conn(0x7ff0ec15eb00 0x7ff0ec1630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.915+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0d0003520 con 0x7ff0ec06d810 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.915+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3837907732 0 0) 0x7ff0d0003520 con 0x7ff0ec06d810 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.915+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 >> v2:172.21.15.187:3300/0 conn(0x7ff0ec15eb00 msgr2=0x7ff0ec1630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.915+0000 7ff0eaa00640 1 --2- 172.21.15.99:0/1995429514 >> v2:172.21.15.187:3300/0 conn(0x7ff0ec15eb00 0x7ff0ec1630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 >> v1:172.21.15.187:6789/0 conn(0x7ff0ec15fef0 legacy=0x7ff0ec0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ec162bb0 con 0x7ff0ec06d810 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7ff0d4001670 con 0x7ff0ec06d810 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 >> v1:172.21.15.99:6789/0 conn(0x7ff0ec06d810 legacy=0x7ff0ec0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eaa00640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eaa00640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0d0004800 0x7ff0d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eaa00640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0d00051c0 0x7ff0d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec1628d0 con 0x7ff0d00039b0 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d000c160 con 0x7ff0d0004800 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d000c360 con 0x7ff0d00051c0 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eb400640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0e2a00640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0d0004800 0x7ff0d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0ebe00640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0d00051c0 0x7ff0d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eb400640 1 -- 172.21.15.99:0/1995429514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0d00051c0 msgr2=0x7ff0d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eb400640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0d00051c0 0x7ff0d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eb400640 1 -- 172.21.15.99:0/1995429514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0d0004800 msgr2=0x7ff0d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eb400640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0d0004800 0x7ff0d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0eb400640 1 -- 172.21.15.99:0/1995429514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d0003520 con 0x7ff0d00039b0 2024-09-10T07:35:45.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.916+0000 7ff0ebe00640 1 -- 172.21.15.99:0/1995429514 reap_dead start 2024-09-10T07:35:45.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.917+0000 7ff0eb400640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0d0003dd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009ac0 tx=0x7ff0d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dc67b4d2c8a1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:45.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.917+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc036070 con 0x7ff0d00039b0 2024-09-10T07:35:45.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.918+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc031400 con 0x7ff0d00039b0 2024-09-10T07:35:45.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.918+0000 7ff0eaa00640 1 -- 172.21.15.99:0/1995429514 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc009690 con 0x7ff0d00039b0 2024-09-10T07:35:45.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.918+0000 7ff0f2400640 1 -- 172.21.15.99:0/1995429514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 msgr2=0x7ff0d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:45.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.918+0000 7ff0f2400640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0d0003dd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009ac0 tx=0x7ff0d0005830 comp rx=0 tx=0).stop 2024-09-10T07:35:45.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.918+0000 7ff0f2400640 1 -- 172.21.15.99:0/1995429514 shutdown_connections 2024-09-10T07:35:45.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.918+0000 7ff0f2400640 1 --2- 172.21.15.99:0/1995429514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0d0003dd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:45.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.918+0000 7ff0f2400640 1 -- 172.21.15.99:0/1995429514 >> 172.21.15.99:0/1995429514 conn(0x7ff0ec06cd20 msgr2=0x7ff0ec06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:45.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.918+0000 7ff0f2400640 1 -- 172.21.15.99:0/1995429514 shutdown_connections 2024-09-10T07:35:45.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.918+0000 7ff0f2400640 1 -- 172.21.15.99:0/1995429514 wait complete. 2024-09-10T07:35:45.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.920+0000 7ff0f2400640 1 Processor -- start 2024-09-10T07:35:45.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.920+0000 7ff0f2400640 1 -- start start 2024-09-10T07:35:45.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0f2400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0ec15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:45.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0f2400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0ec1f8a40 0x7ff0ec072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:45.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0f2400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0ec1459b0 0x7ff0ec145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:45.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0f2400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec0d1460 con 0x7ff0d00039b0 2024-09-10T07:35:45.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0f2400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec0701e0 con 0x7ff0ec1f8a40 2024-09-10T07:35:45.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0f2400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff0ec0d15e0 con 0x7ff0ec1459b0 2024-09-10T07:35:45.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0eb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0ec15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:45.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0eb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0ec15d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60032/0 (socket says 172.21.15.99:60032) 2024-09-10T07:35:45.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0eb400640 1 -- 172.21.15.99:0/3385792727 learned_addr learned my addr 172.21.15.99:0/3385792727 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0e2a00640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0ec1f8a40 0x7ff0ec072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.921+0000 7ff0ebe00640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0ec1459b0 0x7ff0ec145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0eb400640 1 -- 172.21.15.99:0/3385792727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0ec1459b0 msgr2=0x7ff0ec145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0eb400640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0ec1459b0 0x7ff0ec145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0eb400640 1 -- 172.21.15.99:0/3385792727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0ec1f8a40 msgr2=0x7ff0ec072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0eb400640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0ec1f8a40 0x7ff0ec072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0eb400640 1 -- 172.21.15.99:0/3385792727 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ec15b900 con 0x7ff0d00039b0 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0e2a00640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0ec1f8a40 0x7ff0ec072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0eb400640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0ec15d3e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc034040 tx=0x7ff0dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0e3e00640 1 -- 172.21.15.99:0/3385792727 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc03f020 con 0x7ff0d00039b0 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0e3e00640 1 -- 172.21.15.99:0/3385792727 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc037040 con 0x7ff0d00039b0 2024-09-10T07:35:45.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0e3e00640 1 -- 172.21.15.99:0/3385792727 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc036070 con 0x7ff0d00039b0 2024-09-10T07:35:45.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0f2400640 1 -- 172.21.15.99:0/3385792727 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ec15bbc0 con 0x7ff0d00039b0 2024-09-10T07:35:45.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.922+0000 7ff0f2400640 1 -- 172.21.15.99:0/3385792727 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ec15c180 con 0x7ff0d00039b0 2024-09-10T07:35:45.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.923+0000 7ff0f2400640 1 -- 172.21.15.99:0/3385792727 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0ec1630d0 con 0x7ff0d00039b0 2024-09-10T07:35:45.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.924+0000 7ff0e3e00640 1 -- 172.21.15.99:0/3385792727 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0dc042020 con 0x7ff0d00039b0 2024-09-10T07:35:45.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.925+0000 7ff0e3e00640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0c806be30 0x7ff0c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:45.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.925+0000 7ff0e3e00640 1 -- 172.21.15.99:0/3385792727 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7ff0dc0aacd0 con 0x7ff0d00039b0 2024-09-10T07:35:45.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.925+0000 7ff0e2a00640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0c806be30 0x7ff0c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:45.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.926+0000 7ff0e2a00640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0c806be30 0x7ff0c806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec14d040 tx=0x7ff0d40078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:45.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:45.929+0000 7ff0e3e00640 1 -- 172.21.15.99:0/3385792727 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0dc049030 con 0x7ff0d00039b0 2024-09-10T07:35:46.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.138+0000 7ff0f2400640 1 -- 172.21.15.99:0/3385792727 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0ec06c8f0 con 0x7ff0d00039b0 2024-09-10T07:35:46.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.138+0000 7ff0e3e00640 1 -- 172.21.15.99:0/3385792727 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5226 (secure 0 0 0) 0x7ff0dc0790c0 con 0x7ff0d00039b0 2024-09-10T07:35:46.138 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:46.138 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"btime":"2024-09-10T07:35:39:936250+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2667247037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2667247037},{"type":"v1","addr":"172.21.15.99:6836","nonce":2667247037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/588885740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":588885740},{"type":"v1","addr":"172.21.15.187:6834","nonce":588885740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2599063325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2599063325},{"type":"v1","addr":"172.21.15.187:6835","nonce":2599063325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:36.307304+0000","modified":"2024-09-10T07:35:39.339225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1015333121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1015333121},{"type":"v1","addr":"172.21.15.99:6837","nonce":1015333121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":3}]} 2024-09-10T07:35:46.139 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 25 2024-09-10T07:35:46.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.140+0000 7ff0f2400640 1 -- 172.21.15.99:0/3385792727 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0c806be30 msgr2=0x7ff0c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:46.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0c806be30 0x7ff0c806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec14d040 tx=0x7ff0d40078f0 comp rx=0 tx=0).stop 2024-09-10T07:35:46.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 -- 172.21.15.99:0/3385792727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 msgr2=0x7ff0ec15d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:46.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0ec15d3e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc034040 tx=0x7ff0dc004730 comp rx=0 tx=0).stop 2024-09-10T07:35:46.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 -- 172.21.15.99:0/3385792727 shutdown_connections 2024-09-10T07:35:46.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0ec1459b0 0x7ff0ec145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:46.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0ec1f8a40 0x7ff0ec072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:46.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0c806be30 0x7ff0c806e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:46.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 --2- 172.21.15.99:0/3385792727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d00039b0 0x7ff0ec15d3e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:46.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 -- 172.21.15.99:0/3385792727 >> 172.21.15.99:0/3385792727 conn(0x7ff0ec06cd20 msgr2=0x7ff0ec0cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:46.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 -- 172.21.15.99:0/3385792727 shutdown_connections 2024-09-10T07:35:46.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:46.141+0000 7ff0f2400640 1 -- 172.21.15.99:0/3385792727 wait complete. 2024-09-10T07:35:46.157 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:35:46.295 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:35:46.299 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:35:46.333 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":5103,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.401370859,"mdsmap_epoch":25,"osdmap_epoch":44,"osdmap_epoch_barrier":44,"uptime":13.956464180999999} 2024-09-10T07:35:46.334 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 5103, "mdsmap_epoch": 25, "osdmap_epoch": 44, "osdmap_epoch_barrier": 44, "rank_uptime": 9.401370859, "state": "up:active", "uptime": 13.956464181, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:35:46.334 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-10T07:35:46.544 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_mon_report_interval":"5"} 2024-09-10T07:35:46.544 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-10T07:35:46.544 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-10T07:35:46.545 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:46.545 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:46.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:46.580 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-10T07:35:48.549 INFO:teuthology.orchestra.run.smithi099.stderr:265+0 records in 2024-09-10T07:35:48.550 INFO:teuthology.orchestra.run.smithi099.stderr:265+0 records out 2024-09-10T07:35:48.550 INFO:teuthology.orchestra.run.smithi099.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.89032 s, 147 MB/s 2024-09-10T07:35:48.551 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:48.551 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:48.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:48.588 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-10T07:35:50.642 INFO:teuthology.orchestra.run.smithi099.stderr:292+0 records in 2024-09-10T07:35:50.642 INFO:teuthology.orchestra.run.smithi099.stderr:292+0 records out 2024-09-10T07:35:50.642 INFO:teuthology.orchestra.run.smithi099.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.97728 s, 155 MB/s 2024-09-10T07:35:50.643 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-10T07:35:50.643 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:35:50.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.798+0000 7f1f9de00640 1 Processor -- start 2024-09-10T07:35:50.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.798+0000 7f1f9de00640 1 -- start start 2024-09-10T07:35:50.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.799+0000 7f1f9de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f98142150 0x7f1f98160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:50.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.799+0000 7f1f9de00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f98142650 con 0x7f1f9813fae0 2024-09-10T07:35:50.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.799+0000 7f1f9de00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f98142930 con 0x7f1f98160a80 2024-09-10T07:35:50.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.799+0000 7f1f9de00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1f980ce780 con 0x7f1f98142150 2024-09-10T07:35:50.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.800+0000 7f1f96000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f98142150 0x7f1f98160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:50.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.800+0000 7f1f96a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1f9813fae0 0x7f1f9806f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57116/0 (socket says 172.21.15.99:57116) 2024-09-10T07:35:50.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.800+0000 7f1f96a00640 1 -- 172.21.15.99:0/4107118400 learned_addr learned my addr 172.21.15.99:0/4107118400 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:50.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.800+0000 7f1f96000640 1 -- 172.21.15.99:0/4107118400 >> v1:172.21.15.187:6789/0 conn(0x7f1f98160a80 legacy=0x7f1f980cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:50.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.800+0000 7f1f96000640 1 -- 172.21.15.99:0/4107118400 >> v1:172.21.15.99:6789/0 conn(0x7f1f9813fae0 legacy=0x7f1f9806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:50.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.800+0000 7f1f96000640 1 -- 172.21.15.99:0/4107118400 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f98142c10 con 0x7f1f98142150 2024-09-10T07:35:50.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.801+0000 7f1f96000640 1 --2- 172.21.15.99:0/4107118400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f98142150 0x7f1f98160540 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f840097a0 tx=0x7f1f8402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38edd2ca279f9aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:50.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.801+0000 7f1f95600640 1 -- 172.21.15.99:0/4107118400 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84037070 con 0x7f1f98142150 2024-09-10T07:35:50.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.801+0000 7f1f95600640 1 -- 172.21.15.99:0/4107118400 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f84032440 con 0x7f1f98142150 2024-09-10T07:35:50.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.801+0000 7f1f95600640 1 -- 172.21.15.99:0/4107118400 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84032810 con 0x7f1f98142150 2024-09-10T07:35:50.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.802+0000 7f1f9de00640 1 -- 172.21.15.99:0/4107118400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f98142150 msgr2=0x7f1f98160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:50.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.802+0000 7f1f9de00640 1 --2- 172.21.15.99:0/4107118400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f98142150 0x7f1f98160540 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f840097a0 tx=0x7f1f8402a1a0 comp rx=0 tx=0).stop 2024-09-10T07:35:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.802+0000 7f1f9de00640 1 -- 172.21.15.99:0/4107118400 shutdown_connections 2024-09-10T07:35:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.802+0000 7f1f9de00640 1 --2- 172.21.15.99:0/4107118400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f98142150 0x7f1f98160540 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.802+0000 7f1f9de00640 1 -- 172.21.15.99:0/4107118400 >> 172.21.15.99:0/4107118400 conn(0x7f1f9806bc10 msgr2=0x7f1f9806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.802+0000 7f1f9de00640 1 -- 172.21.15.99:0/4107118400 shutdown_connections 2024-09-10T07:35:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.802+0000 7f1f9de00640 1 -- 172.21.15.99:0/4107118400 wait complete. 2024-09-10T07:35:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.803+0000 7f1f9de00640 1 Processor -- start 2024-09-10T07:35:50.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.804+0000 7f1f9de00640 1 -- start start 2024-09-10T07:35:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.804+0000 7f1f9de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f9813fae0 0x7f1f981f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.804+0000 7f1f9de00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f98142150 0x7f1f981f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.804+0000 7f1f9de00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f98160a80 0x7f1f98072970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.804+0000 7f1f9de00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1f980cf4a0 con 0x7f1f9813fae0 2024-09-10T07:35:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.804+0000 7f1f9de00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1f980cf320 con 0x7f1f98142150 2024-09-10T07:35:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.804+0000 7f1f9de00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1f980cf620 con 0x7f1f98160a80 2024-09-10T07:35:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f9813fae0 0x7f1f981f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f9813fae0 0x7f1f981f5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41638/0 (socket says 172.21.15.99:41638) 2024-09-10T07:35:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96a00640 1 -- 172.21.15.99:0/2068709508 learned_addr learned my addr 172.21.15.99:0/2068709508 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96000640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f98142150 0x7f1f981f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f97400640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f98160a80 0x7f1f98072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96a00640 1 -- 172.21.15.99:0/2068709508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f98160a80 msgr2=0x7f1f98072970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96a00640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f98160a80 0x7f1f98072970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96a00640 1 -- 172.21.15.99:0/2068709508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f98142150 msgr2=0x7f1f981f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96a00640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f98142150 0x7f1f981f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96a00640 1 -- 172.21.15.99:0/2068709508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f98143600 con 0x7f1f9813fae0 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96000640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f98142150 0x7f1f981f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.805+0000 7f1f96a00640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f9813fae0 0x7f1f981f5040 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800c4a0 tx=0x7f1f8800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.806+0000 7f1f8f400640 1 -- 172.21.15.99:0/2068709508 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88017070 con 0x7f1f9813fae0 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.806+0000 7f1f8f400640 1 -- 172.21.15.99:0/2068709508 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f88005ce0 con 0x7f1f9813fae0 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.806+0000 7f1f8f400640 1 -- 172.21.15.99:0/2068709508 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88007270 con 0x7f1f9813fae0 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.806+0000 7f1f9de00640 1 -- 172.21.15.99:0/2068709508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f981f5900 con 0x7f1f9813fae0 2024-09-10T07:35:50.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.806+0000 7f1f9de00640 1 -- 172.21.15.99:0/2068709508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f981f5ec0 con 0x7f1f9813fae0 2024-09-10T07:35:50.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.807+0000 7f1f9de00640 1 -- 172.21.15.99:0/2068709508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f98160540 con 0x7f1f9813fae0 2024-09-10T07:35:50.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.808+0000 7f1f8f400640 1 -- 172.21.15.99:0/2068709508 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f8801a070 con 0x7f1f9813fae0 2024-09-10T07:35:50.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.808+0000 7f1f8f400640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f7806be60 0x7f1f7806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:50.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.809+0000 7f1f8f400640 1 -- 172.21.15.99:0/2068709508 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f1f88089ff0 con 0x7f1f9813fae0 2024-09-10T07:35:50.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.809+0000 7f1f96000640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f7806be60 0x7f1f7806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:50.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.809+0000 7f1f96000640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f7806be60 0x7f1f7806e320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f84034000 tx=0x7f1f8402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:50.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.813+0000 7f1f8f400640 1 -- 172.21.15.99:0/2068709508 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f880583a0 con 0x7f1f9813fae0 2024-09-10T07:35:50.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.988+0000 7f1f9de00640 1 -- 172.21.15.99:0/2068709508 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f1f981433e0 con 0x7f1f9813fae0 2024-09-10T07:35:50.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.989+0000 7f1f8f400640 1 -- 172.21.15.99:0/2068709508 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v44) ==== 81+0+34180 (secure 0 0 0) 0x7f1f8805c6a0 con 0x7f1f9813fae0 2024-09-10T07:35:50.989 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 44, 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:35:37.911589+0000", 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:35:50.990 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 7, 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:35:50.991 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:50.992 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:35:50.993 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "16", 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:50.994 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:50.995 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:50.996 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:50.997 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:50.998 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 6, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:34.068514+0000", 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:50.999 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:51.000 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:51.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.001 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "43", 2024-09-10T07:35:51.001 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:51.001 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:51.001 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:51.001 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:51.001 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:51.001 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:51.001 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:51.001 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:51.002 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:51.003 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:35:51.004 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 7, 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:35.306080+0000", 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:51.006 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:51.007 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:51.007 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:51.008 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "44", 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:51.009 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:51.010 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:51.011 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:51.012 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:35:51.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:51.014 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.015 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:51.019 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:35:51.020 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:35:51.021 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.022 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.023 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:35:51.024 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:51.025 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.026 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.027 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:51.030 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:51.031 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.032 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.033 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.034 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:51.036 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:51.037 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.039 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:51.040 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.041 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.041 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:51.041 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.041 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.041 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:35:51.041 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:51.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:51.042 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:51.043 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.044 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.045 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:51.046 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:35:51.047 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:51.049 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:51.052 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:35:51.053 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.056 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.058 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:51.059 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:51.060 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:51.061 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:51.062 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.063 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:51.064 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:35:51.065 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:35:51.066 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:51.068 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:35:51.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 -- 172.21.15.99:0/2068709508 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f7806be60 msgr2=0x7f1f7806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:51.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f7806be60 0x7f1f7806e320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f84034000 tx=0x7f1f8402e000 comp rx=0 tx=0).stop 2024-09-10T07:35:51.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 -- 172.21.15.99:0/2068709508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f9813fae0 msgr2=0x7f1f981f5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:51.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f9813fae0 0x7f1f981f5040 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800c4a0 tx=0x7f1f8800c960 comp rx=0 tx=0).stop 2024-09-10T07:35:51.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 -- 172.21.15.99:0/2068709508 shutdown_connections 2024-09-10T07:35:51.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f98160a80 0x7f1f98072970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:51.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f98142150 0x7f1f981f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:51.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1f7806be60 0x7f1f7806e320 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:51.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 --2- 172.21.15.99:0/2068709508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f9813fae0 0x7f1f981f5040 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:51.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 -- 172.21.15.99:0/2068709508 >> 172.21.15.99:0/2068709508 conn(0x7f1f9806bc10 msgr2=0x7f1f9806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:51.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.991+0000 7f1f9de00640 1 -- 172.21.15.99:0/2068709508 shutdown_connections 2024-09-10T07:35:51.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:50.992+0000 7f1f9de00640 1 -- 172.21.15.99:0/2068709508 wait complete. 2024-09-10T07:35:51.072 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:35:51.765 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:35:51.765+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-10T07:35:56.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:35:56.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.238+0000 7f78e8a00640 1 Processor -- start 2024-09-10T07:35:56.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.238+0000 7f78e8a00640 1 -- start start 2024-09-10T07:35:56.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.239+0000 7f78e8a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f78e40d2680 0x7f78e40cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:56.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.239+0000 7f78e8a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e40d2bd0 con 0x7f78e415e970 2024-09-10T07:35:56.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.239+0000 7f78e8a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e40d2eb0 con 0x7f78e40cfac0 2024-09-10T07:35:56.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.239+0000 7f78e8a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f78e40d37e0 con 0x7f78e40d2680 2024-09-10T07:35:56.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.239+0000 7f78e1e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f78e40d2680 0x7f78e40cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:56.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.239+0000 7f78e2800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f78e415e970 0x7f78e40d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57132/0 (socket says 172.21.15.99:57132) 2024-09-10T07:35:56.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.240+0000 7f78e2800640 1 -- 172.21.15.99:0/2698379267 learned_addr learned my addr 172.21.15.99:0/2698379267 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:56.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.240+0000 7f78e1e00640 1 -- 172.21.15.99:0/2698379267 >> v1:172.21.15.187:6789/0 conn(0x7f78e40cfac0 legacy=0x7f78e40c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:56.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.240+0000 7f78e1e00640 1 -- 172.21.15.99:0/2698379267 >> v1:172.21.15.99:6789/0 conn(0x7f78e415e970 legacy=0x7f78e40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:56.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.240+0000 7f78e1e00640 1 -- 172.21.15.99:0/2698379267 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e40d3190 con 0x7f78e40d2680 2024-09-10T07:35:56.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.241+0000 7f78e1e00640 1 --2- 172.21.15.99:0/2698379267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40d2680 0x7f78e40cf580 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f78e40d3960 tx=0x7f78d002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8692d75f0aaa340b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:56.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.241+0000 7f78e1400640 1 -- 172.21.15.99:0/2698379267 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0037070 con 0x7f78e40d2680 2024-09-10T07:35:56.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.241+0000 7f78e1400640 1 -- 172.21.15.99:0/2698379267 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d0032440 con 0x7f78e40d2680 2024-09-10T07:35:56.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.241+0000 7f78e1400640 1 -- 172.21.15.99:0/2698379267 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0032810 con 0x7f78e40d2680 2024-09-10T07:35:56.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.242+0000 7f78e8a00640 1 -- 172.21.15.99:0/2698379267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40d2680 msgr2=0x7f78e40cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:56.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.242+0000 7f78e8a00640 1 --2- 172.21.15.99:0/2698379267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40d2680 0x7f78e40cf580 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f78e40d3960 tx=0x7f78d002a2a0 comp rx=0 tx=0).stop 2024-09-10T07:35:56.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.242+0000 7f78e8a00640 1 -- 172.21.15.99:0/2698379267 shutdown_connections 2024-09-10T07:35:56.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.242+0000 7f78e8a00640 1 --2- 172.21.15.99:0/2698379267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40d2680 0x7f78e40cf580 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:56.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.242+0000 7f78e8a00640 1 -- 172.21.15.99:0/2698379267 >> 172.21.15.99:0/2698379267 conn(0x7f78e409de00 msgr2=0x7f78e40d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:56.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.242+0000 7f78e8a00640 1 -- 172.21.15.99:0/2698379267 shutdown_connections 2024-09-10T07:35:56.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.242+0000 7f78e8a00640 1 -- 172.21.15.99:0/2698379267 wait complete. 2024-09-10T07:35:56.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.244+0000 7f78e8a00640 1 Processor -- start 2024-09-10T07:35:56.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.244+0000 7f78e8a00640 1 -- start start 2024-09-10T07:35:56.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40cfac0 0x7f78e4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:56.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e8a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78e40d2680 0x7f78e40b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:56.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e8a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78e415e970 0x7f78e40b9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e8a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f78e415ed50 con 0x7f78e40cfac0 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e8a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f78e40cff10 con 0x7f78e415e970 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e8a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f78e415eed0 con 0x7f78e40d2680 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40cfac0 0x7f78e4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40cfac0 0x7f78e4154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41666/0 (socket says 172.21.15.99:41666) 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e2800640 1 -- 172.21.15.99:0/2245383907 learned_addr learned my addr 172.21.15.99:0/2245383907 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e1e00640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78e40d2680 0x7f78e40b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e3200640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78e415e970 0x7f78e40b9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e2800640 1 -- 172.21.15.99:0/2245383907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78e40d2680 msgr2=0x7f78e40b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e2800640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78e40d2680 0x7f78e40b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e2800640 1 -- 172.21.15.99:0/2245383907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78e415e970 msgr2=0x7f78e40b9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e2800640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78e415e970 0x7f78e40b9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e2800640 1 -- 172.21.15.99:0/2245383907 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e40b8170 con 0x7f78e40cfac0 2024-09-10T07:35:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.245+0000 7f78e3200640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78e415e970 0x7f78e40b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:56.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.246+0000 7f78e2800640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40cfac0 0x7f78e4154cb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f78d400c4b0 tx=0x7f78d400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:56.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.246+0000 7f78daa00640 1 -- 172.21.15.99:0/2245383907 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d4017070 con 0x7f78e40cfac0 2024-09-10T07:35:56.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.246+0000 7f78daa00640 1 -- 172.21.15.99:0/2245383907 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d4005ce0 con 0x7f78e40cfac0 2024-09-10T07:35:56.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.246+0000 7f78daa00640 1 -- 172.21.15.99:0/2245383907 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d4007270 con 0x7f78e40cfac0 2024-09-10T07:35:56.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.246+0000 7f78e8a00640 1 -- 172.21.15.99:0/2245383907 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e40b8450 con 0x7f78e40cfac0 2024-09-10T07:35:56.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.246+0000 7f78e8a00640 1 -- 172.21.15.99:0/2245383907 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e40b8a10 con 0x7f78e40cfac0 2024-09-10T07:35:56.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.247+0000 7f78e8a00640 1 -- 172.21.15.99:0/2245383907 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e40cf580 con 0x7f78e40cfac0 2024-09-10T07:35:56.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.248+0000 7f78daa00640 1 -- 172.21.15.99:0/2245383907 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78d401a070 con 0x7f78e40cfac0 2024-09-10T07:35:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.249+0000 7f78daa00640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f78c406be30 0x7f78c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.249+0000 7f78daa00640 1 -- 172.21.15.99:0/2245383907 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f78d408a150 con 0x7f78e40cfac0 2024-09-10T07:35:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.249+0000 7f78e1e00640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f78c406be30 0x7f78c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.250+0000 7f78daa00640 1 -- 172.21.15.99:0/2245383907 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7f78c4073960 con 0x7f78e40cfac0 2024-09-10T07:35:56.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.250+0000 7f78e1e00640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f78c406be30 0x7f78c406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78d0034000 tx=0x7f78d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:56.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.254+0000 7f78daa00640 1 -- 172.21.15.99:0/2245383907 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78d40584a0 con 0x7f78e40cfac0 2024-09-10T07:35:56.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.427+0000 7f78e8a00640 1 -- 172.21.15.99:0/2245383907 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f78e40cb3f0 con 0x7f78e40cfac0 2024-09-10T07:35:56.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.429+0000 7f78daa00640 1 -- 172.21.15.99:0/2245383907 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) ==== 81+0+34323 (secure 0 0 0) 0x7f78d405c7a0 con 0x7f78e40cfac0 2024-09-10T07:35:56.429 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:56.430 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:35:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 48, 2024-09-10T07:35:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:35:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:35:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:35:54.781163+0000", 2024-09-10T07:35:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:35:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:35:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:35:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:35:56.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 7, 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:35:56.431 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:56.432 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:56.433 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:35:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:56.434 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:56.435 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:56.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:35:56.437 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:56.438 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 6, 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:34.068514+0000", 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:56.439 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:56.440 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:56.441 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:56.442 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:56.442 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:56.442 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:56.442 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:56.442 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:56.442 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:56.442 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:56.442 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:56.442 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:56.443 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:35:56.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:35:56.445 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 7, 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:35.306080+0000", 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:56.446 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:56.447 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:56.447 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:56.447 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:56.447 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:56.447 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:56.447 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:56.447 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:56.448 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:56.449 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:56.450 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:56.451 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:56.452 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:56.453 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:35:56.454 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:56.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.455 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:35:56.455 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:56.455 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.455 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.455 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:56.455 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:56.456 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.458 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:56.458 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.458 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:35:56.458 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:56.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.459 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:35:56.459 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:56.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.460 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.460 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:35:56.460 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:35:56.460 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:35:56.460 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:35:56.461 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:56.461 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:56.461 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:56.461 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:56.461 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.461 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:35:56.461 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:56.461 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:56.462 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:56.462 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:56.462 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:56.462 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:56.462 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:56.462 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:56.462 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.463 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:35:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:35:56.466 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:56.467 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:56.468 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:35:56.469 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:56.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.470 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.470 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:56.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:35:56.470 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:35:56.471 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:35:56.473 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:56.474 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:56.475 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:56.475 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:56.475 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:56.475 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:56.475 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.476 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:35:56.476 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:56.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.476 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:35:56.477 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:56.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.477 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.477 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:56.477 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:56.478 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:56.479 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.480 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull", 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:35:56.481 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:35:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:35:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:35:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:35:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:35:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:35:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:35:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:35:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:35:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:35:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:35:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:35:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:35:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:35:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:35:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:35:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:35:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:35:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:35:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:35:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:35:56.516 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:35:56.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:56.516 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:35:56.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 -- 172.21.15.99:0/2245383907 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f78c406be30 msgr2=0x7f78c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:56.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f78c406be30 0x7f78c406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f78d0034000 tx=0x7f78d002e000 comp rx=0 tx=0).stop 2024-09-10T07:35:56.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 -- 172.21.15.99:0/2245383907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40cfac0 msgr2=0x7f78e4154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:56.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40cfac0 0x7f78e4154cb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f78d400c4b0 tx=0x7f78d400c970 comp rx=0 tx=0).stop 2024-09-10T07:35:56.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 -- 172.21.15.99:0/2245383907 shutdown_connections 2024-09-10T07:35:56.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78e415e970 0x7f78e40b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:56.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78e40d2680 0x7f78e40b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:56.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f78c406be30 0x7f78c406e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:56.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 --2- 172.21.15.99:0/2245383907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78e40cfac0 0x7f78e4154cb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:56.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 -- 172.21.15.99:0/2245383907 >> 172.21.15.99:0/2245383907 conn(0x7f78e409de00 msgr2=0x7f78e40d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:56.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 -- 172.21.15.99:0/2245383907 shutdown_connections 2024-09-10T07:35:56.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:56.431+0000 7f78e8a00640 1 -- 172.21.15.99:0/2245383907 wait complete. 2024-09-10T07:35:56.519 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-10T07:35:56.519 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:56.520 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:56.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:56.556 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-10T07:35:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-10T07:35:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records in 2024-09-10T07:35:56.946 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records out 2024-09-10T07:35:56.946 INFO:teuthology.orchestra.run.smithi099.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.298157 s, 176 MB/s 2024-09-10T07:35:56.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:35:56.948 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:35:57.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.100+0000 7fc4d3800640 1 Processor -- start 2024-09-10T07:35:57.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.100+0000 7fc4d3800640 1 -- start start 2024-09-10T07:35:57.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.101+0000 7fc4d3800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4cc13fae0 0x7fc4cc06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d3800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc4cc160c50 0x7fc4cc0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d3800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4cc142650 con 0x7fc4cc142150 2024-09-10T07:35:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d3800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc4cc0ce780 con 0x7fc4cc160c50 2024-09-10T07:35:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d3800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc4cc142930 con 0x7fc4cc13fae0 2024-09-10T07:35:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d1800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc4cc160c50 0x7fc4cc0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d1800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc4cc160c50 0x7fc4cc0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41668/0 (socket says 172.21.15.99:41668) 2024-09-10T07:35:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d1800640 1 -- 172.21.15.99:0/887185475 learned_addr learned my addr 172.21.15.99:0/887185475 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d0e00640 1 --2- 172.21.15.99:0/887185475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4cc13fae0 0x7fc4cc06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d1800640 1 -- 172.21.15.99:0/887185475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4cc13fae0 msgr2=0x7fc4cc06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d1800640 1 --2- 172.21.15.99:0/887185475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4cc13fae0 0x7fc4cc06f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d1800640 1 -- 172.21.15.99:0/887185475 >> v1:172.21.15.187:6789/0 conn(0x7fc4cc142150 legacy=0x7fc4cc160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.102+0000 7fc4d1800640 1 -- 172.21.15.99:0/887185475 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc142c10 con 0x7fc4cc160c50 2024-09-10T07:35:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.103+0000 7fc4d1800640 1 --2- 172.21.15.99:0/887185475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc160c50 0x7fc4cc0cec10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009e50 tx=0x7fc4c402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1655c14456b1cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4cbe00640 1 -- 172.21.15.99:0/887185475 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4036070 con 0x7fc4cc160c50 2024-09-10T07:35:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4cbe00640 1 -- 172.21.15.99:0/887185475 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c4031600 con 0x7fc4cc160c50 2024-09-10T07:35:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4cbe00640 1 -- 172.21.15.99:0/887185475 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40319d0 con 0x7fc4cc160c50 2024-09-10T07:35:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4d3800640 1 -- 172.21.15.99:0/887185475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc160c50 msgr2=0x7fc4cc0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4d3800640 1 --2- 172.21.15.99:0/887185475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc160c50 0x7fc4cc0cec10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009e50 tx=0x7fc4c402a680 comp rx=0 tx=0).stop 2024-09-10T07:35:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4d3800640 1 -- 172.21.15.99:0/887185475 shutdown_connections 2024-09-10T07:35:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4d3800640 1 --2- 172.21.15.99:0/887185475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc160c50 0x7fc4cc0cec10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4d3800640 1 --2- 172.21.15.99:0/887185475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4cc13fae0 0x7fc4cc06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4d3800640 1 -- 172.21.15.99:0/887185475 >> 172.21.15.99:0/887185475 conn(0x7fc4cc06bc10 msgr2=0x7fc4cc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:57.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4d3800640 1 -- 172.21.15.99:0/887185475 shutdown_connections 2024-09-10T07:35:57.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.104+0000 7fc4d3800640 1 -- 172.21.15.99:0/887185475 wait complete. 2024-09-10T07:35:57.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.106+0000 7fc4d3800640 1 Processor -- start 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.106+0000 7fc4d3800640 1 -- start start 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4d3800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc13fae0 0x7fc4cc157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4d3800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4cc142150 0x7fc4cc15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4d3800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4cc160c50 0x7fc4cc158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4d3800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc06f870 con 0x7fc4cc13fae0 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4d3800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc06f6f0 con 0x7fc4cc142150 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4d3800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc4cc0cf150 con 0x7fc4cc160c50 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4d0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc13fae0 0x7fc4cc157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4d0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc13fae0 0x7fc4cc157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41680/0 (socket says 172.21.15.99:41680) 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4d0e00640 1 -- 172.21.15.99:0/323189137 learned_addr learned my addr 172.21.15.99:0/323189137 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4d1800640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4cc160c50 0x7fc4cc158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.107+0000 7fc4c3e00640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4cc142150 0x7fc4cc15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4d0e00640 1 -- 172.21.15.99:0/323189137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4cc160c50 msgr2=0x7fc4cc158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4d0e00640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4cc160c50 0x7fc4cc158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4d0e00640 1 -- 172.21.15.99:0/323189137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4cc142150 msgr2=0x7fc4cc15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4d0e00640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4cc142150 0x7fc4cc15bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4d0e00640 1 -- 172.21.15.99:0/323189137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc15c440 con 0x7fc4cc13fae0 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4c3e00640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4cc142150 0x7fc4cc15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4d0e00640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc13fae0 0x7fc4cc157630 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00d800 tx=0x7fc4bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4c9600640 1 -- 172.21.15.99:0/323189137 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00b6c0 con 0x7fc4cc13fae0 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4c9600640 1 -- 172.21.15.99:0/323189137 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc019070 con 0x7fc4cc13fae0 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4c9600640 1 -- 172.21.15.99:0/323189137 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00bac0 con 0x7fc4cc13fae0 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4d3800640 1 -- 172.21.15.99:0/323189137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4cc157c10 con 0x7fc4cc13fae0 2024-09-10T07:35:57.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.108+0000 7fc4d3800640 1 -- 172.21.15.99:0/323189137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4cc1584b0 con 0x7fc4cc13fae0 2024-09-10T07:35:57.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.109+0000 7fc4d3800640 1 -- 172.21.15.99:0/323189137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4cc06f1b0 con 0x7fc4cc13fae0 2024-09-10T07:35:57.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.110+0000 7fc4c9600640 1 -- 172.21.15.99:0/323189137 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4bc00bc60 con 0x7fc4cc13fae0 2024-09-10T07:35:57.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.111+0000 7fc4c9600640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc4a806be30 0x7fc4a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.111+0000 7fc4c9600640 1 -- 172.21.15.99:0/323189137 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fc4bc08b330 con 0x7fc4cc13fae0 2024-09-10T07:35:57.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.111+0000 7fc4c9600640 1 -- 172.21.15.99:0/323189137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7fc4a8073960 con 0x7fc4cc13fae0 2024-09-10T07:35:57.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.111+0000 7fc4c3e00640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc4a806be30 0x7fc4a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.112+0000 7fc4c3e00640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc4a806be30 0x7fc4a806e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc1450c0 tx=0x7fc4b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:57.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.116+0000 7fc4c9600640 1 -- 172.21.15.99:0/323189137 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4bc059c40 con 0x7fc4cc13fae0 2024-09-10T07:35:57.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.287+0000 7fc4d3800640 1 -- 172.21.15.99:0/323189137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fc4cc160590 con 0x7fc4cc13fae0 2024-09-10T07:35:57.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.289+0000 7fc4c9600640 1 -- 172.21.15.99:0/323189137 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) ==== 81+0+34323 (secure 0 0 0) 0x7fc4bc059540 con 0x7fc4cc13fae0 2024-09-10T07:35:57.289 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:57.289 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:35:57.289 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 48, 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:35:54.781163+0000", 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:57.290 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 7, 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.291 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:57.292 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:57.293 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:57.294 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:57.295 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:57.296 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:35:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:35:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:35:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 6, 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:35:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:34.068514+0000", 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:57.299 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.300 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:57.301 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.302 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:35:57.303 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:35:57.304 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 7, 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:35.306080+0000", 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:35:57.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:35:57.306 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:35:57.307 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:35:57.307 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:35:57.307 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:57.307 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:57.307 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:57.307 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:57.307 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:57.307 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:57.308 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:57.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.308 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:35:57.308 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:57.308 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:57.308 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:57.309 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:57.309 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:57.309 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:57.309 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:57.309 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:57.309 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:57.309 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:57.309 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:57.309 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:57.310 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:57.310 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:57.310 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:57.310 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:57.310 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:57.310 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:57.310 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:57.311 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:35:57.312 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:35:57.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.313 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:57.313 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:35:57.313 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:35:57.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.313 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:57.314 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:57.314 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:35:57.314 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:35:57.314 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:35:57.314 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:35:57.314 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:35:57.314 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:57.314 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:57.314 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:57.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.315 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:57.315 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:35:57.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.315 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:35:57.315 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:57.315 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:57.315 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:57.315 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:57.315 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:57.316 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:57.316 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:57.316 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:57.316 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:57.316 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:57.316 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:57.316 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:57.316 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.317 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:35:57.317 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:57.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.318 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:35:57.318 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:57.318 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.318 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.318 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:57.318 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.318 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:35:57.321 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:35:57.322 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:35:57.322 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:57.322 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:57.322 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:57.322 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:57.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.322 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:35:57.322 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.326 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.327 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:35:57.328 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.330 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.330 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:35:57.330 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:57.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.330 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.330 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:35:57.330 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:57.330 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.330 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.331 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:57.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:35:57.333 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:35:57.334 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.337 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:35:57.337 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:57.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.337 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:35:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull", 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:35:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:35:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:35:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:35:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:35:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:35:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:35:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:35:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:35:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:35:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:35:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:35:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:35:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:35:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:35:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:35:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:35:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:35:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:35:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:35:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:35:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:35:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:35:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:35:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:35:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:35:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:35:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:35:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:35:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:35:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:35:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:35:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:35:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:35:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:35:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:35:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:35:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:35:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:35:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:35:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:35:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:35:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:35:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:35:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:35:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:35:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:35:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:35:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:35:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:35:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:35:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:35:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:35:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:35:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:35:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:35:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:35:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:57.387 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:35:57.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 -- 172.21.15.99:0/323189137 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc4a806be30 msgr2=0x7fc4a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc4a806be30 0x7fc4a806e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc1450c0 tx=0x7fc4b4009040 comp rx=0 tx=0).stop 2024-09-10T07:35:57.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 -- 172.21.15.99:0/323189137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc13fae0 msgr2=0x7fc4cc157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc13fae0 0x7fc4cc157630 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00d800 tx=0x7fc4bc00dcc0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 -- 172.21.15.99:0/323189137 shutdown_connections 2024-09-10T07:35:57.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4cc160c50 0x7fc4cc158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4cc142150 0x7fc4cc15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc4a806be30 0x7fc4a806e2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 --2- 172.21.15.99:0/323189137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4cc13fae0 0x7fc4cc157630 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 -- 172.21.15.99:0/323189137 >> 172.21.15.99:0/323189137 conn(0x7fc4cc06bc10 msgr2=0x7fc4cc06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:57.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 -- 172.21.15.99:0/323189137 shutdown_connections 2024-09-10T07:35:57.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.291+0000 7fc4d3800640 1 -- 172.21.15.99:0/323189137 wait complete. 2024-09-10T07:35:57.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:35:57.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.545+0000 7f0b32400640 1 Processor -- start 2024-09-10T07:35:57.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.545+0000 7f0b32400640 1 -- start start 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.546+0000 7f0b32400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b2c0d2680 0x7f0b2c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.546+0000 7f0b32400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c0d2bd0 con 0x7f0b2c15e970 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.546+0000 7f0b32400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c0d2eb0 con 0x7f0b2c0cfac0 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.546+0000 7f0b32400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0b2c0d37e0 con 0x7f0b2c0d2680 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.546+0000 7f0b2be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b2c0d2680 0x7f0b2c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.547+0000 7f0b2be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b2c0d2680 0x7f0b2c0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41696/0 (socket says 172.21.15.99:41696) 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.547+0000 7f0b2be00640 1 -- 172.21.15.99:0/3619345701 learned_addr learned my addr 172.21.15.99:0/3619345701 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.547+0000 7f0b31000640 1 --1- 172.21.15.99:0/3619345701 >> v1:172.21.15.99:6789/0 conn(0x7f0b2c15e970 0x7f0b2c0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57146/0 (socket says 172.21.15.99:57146) 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.547+0000 7f0b2be00640 1 -- 172.21.15.99:0/3619345701 >> v1:172.21.15.187:6789/0 conn(0x7f0b2c0cfac0 legacy=0x7f0b2c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.547+0000 7f0b2be00640 1 -- 172.21.15.99:0/3619345701 >> v1:172.21.15.99:6789/0 conn(0x7f0b2c15e970 legacy=0x7f0b2c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.547+0000 7f0b2b400640 1 -- 172.21.15.99:0/3619345701 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081126239 0 0) 0x7f0b2c0d2bd0 con 0x7f0b2c15e970 2024-09-10T07:35:57.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.547+0000 7f0b2be00640 1 -- 172.21.15.99:0/3619345701 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c0d3190 con 0x7f0b2c0d2680 2024-09-10T07:35:57.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.548+0000 7f0b2be00640 1 --2- 172.21.15.99:0/3619345701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c0d2680 0x7f0b2c0cf580 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0d3960 tx=0x7f0b1802a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920344e1e14189 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:57.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.548+0000 7f0b2b400640 1 -- 172.21.15.99:0/3619345701 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18037070 con 0x7f0b2c0d2680 2024-09-10T07:35:57.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.548+0000 7f0b2b400640 1 -- 172.21.15.99:0/3619345701 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b18032640 con 0x7f0b2c0d2680 2024-09-10T07:35:57.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.548+0000 7f0b2b400640 1 -- 172.21.15.99:0/3619345701 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18032a10 con 0x7f0b2c0d2680 2024-09-10T07:35:57.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.549+0000 7f0b32400640 1 -- 172.21.15.99:0/3619345701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c0d2680 msgr2=0x7f0b2c0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.549+0000 7f0b32400640 1 --2- 172.21.15.99:0/3619345701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c0d2680 0x7f0b2c0cf580 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0d3960 tx=0x7f0b1802a320 comp rx=0 tx=0).stop 2024-09-10T07:35:57.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.549+0000 7f0b32400640 1 -- 172.21.15.99:0/3619345701 shutdown_connections 2024-09-10T07:35:57.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.549+0000 7f0b32400640 1 --2- 172.21.15.99:0/3619345701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c0d2680 0x7f0b2c0cf580 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.549+0000 7f0b32400640 1 -- 172.21.15.99:0/3619345701 >> 172.21.15.99:0/3619345701 conn(0x7f0b2c09de00 msgr2=0x7f0b2c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:57.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.549+0000 7f0b32400640 1 -- 172.21.15.99:0/3619345701 shutdown_connections 2024-09-10T07:35:57.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.549+0000 7f0b32400640 1 -- 172.21.15.99:0/3619345701 wait complete. 2024-09-10T07:35:57.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.551+0000 7f0b32400640 1 Processor -- start 2024-09-10T07:35:57.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.551+0000 7f0b32400640 1 -- start start 2024-09-10T07:35:57.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b32400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c0cfac0 0x7f0b2c160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b32400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2c0d2680 0x7f0b2c0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b32400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c15e970 0x7f0b2c0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b32400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c15ed50 con 0x7f0b2c15e970 2024-09-10T07:35:57.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b32400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c0cff10 con 0x7f0b2c0cfac0 2024-09-10T07:35:57.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b32400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2c15eed0 con 0x7f0b2c0d2680 2024-09-10T07:35:57.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b31a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c15e970 0x7f0b2c0cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b31000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c0cfac0 0x7f0b2c160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b2be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2c0d2680 0x7f0b2c0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b31a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c15e970 0x7f0b2c0cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41708/0 (socket says 172.21.15.99:41708) 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b31a00640 1 -- 172.21.15.99:0/537034420 learned_addr learned my addr 172.21.15.99:0/537034420 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b31a00640 1 -- 172.21.15.99:0/537034420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2c0d2680 msgr2=0x7f0b2c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b31a00640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2c0d2680 0x7f0b2c0cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b31a00640 1 -- 172.21.15.99:0/537034420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c0cfac0 msgr2=0x7f0b2c160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b31a00640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c0cfac0 0x7f0b2c160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.552+0000 7f0b31a00640 1 -- 172.21.15.99:0/537034420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c15f5f0 con 0x7f0b2c15e970 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.553+0000 7f0b31a00640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c15e970 0x7f0b2c0cc250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400c780 tx=0x7f0b2400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.553+0000 7f0b28c00640 1 -- 172.21.15.99:0/537034420 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24004b60 con 0x7f0b2c15e970 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.553+0000 7f0b28c00640 1 -- 172.21.15.99:0/537034420 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b24004d00 con 0x7f0b2c15e970 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.553+0000 7f0b32400640 1 -- 172.21.15.99:0/537034420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2c15f8d0 con 0x7f0b2c15e970 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.553+0000 7f0b28c00640 1 -- 172.21.15.99:0/537034420 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2400aa90 con 0x7f0b2c15e970 2024-09-10T07:35:57.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.553+0000 7f0b32400640 1 -- 172.21.15.99:0/537034420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2c15fe90 con 0x7f0b2c15e970 2024-09-10T07:35:57.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.554+0000 7f0b32400640 1 -- 172.21.15.99:0/537034420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2c0cf580 con 0x7f0b2c15e970 2024-09-10T07:35:57.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.555+0000 7f0b28c00640 1 -- 172.21.15.99:0/537034420 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b2400ac30 con 0x7f0b2c15e970 2024-09-10T07:35:57.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.556+0000 7f0b28c00640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0c06be30 0x7f0b0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:57.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.556+0000 7f0b28c00640 1 -- 172.21.15.99:0/537034420 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f0b2408b130 con 0x7f0b2c15e970 2024-09-10T07:35:57.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.556+0000 7f0b31000640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0c06be30 0x7f0b0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:57.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.556+0000 7f0b28c00640 1 -- 172.21.15.99:0/537034420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7f0b0c0739c0 con 0x7f0b2c15e970 2024-09-10T07:35:57.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.557+0000 7f0b31000640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0c06be30 0x7f0b0c06e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b20007fd0 tx=0x7f0b20007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:57.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.560+0000 7f0b28c00640 1 -- 172.21.15.99:0/537034420 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b24020070 con 0x7f0b2c15e970 2024-09-10T07:35:57.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.769+0000 7f0b32400640 1 -- 172.21.15.99:0/537034420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b2c0d1700 con 0x7f0b2c15e970 2024-09-10T07:35:57.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.770+0000 7f0b28c00640 1 -- 172.21.15.99:0/537034420 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5226 (secure 0 0 0) 0x7f0b24059360 con 0x7f0b2c15e970 2024-09-10T07:35:57.770 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:57.770 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"btime":"2024-09-10T07:35:39:936250+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2667247037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2667247037},{"type":"v1","addr":"172.21.15.99:6836","nonce":2667247037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/588885740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":588885740},{"type":"v1","addr":"172.21.15.187:6834","nonce":588885740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2599063325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2599063325},{"type":"v1","addr":"172.21.15.187:6835","nonce":2599063325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:36.307304+0000","modified":"2024-09-10T07:35:39.339225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1015333121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1015333121},{"type":"v1","addr":"172.21.15.99:6837","nonce":1015333121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":3}]} 2024-09-10T07:35:57.770 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 25 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.772+0000 7f0b32400640 1 -- 172.21.15.99:0/537034420 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0c06be30 msgr2=0x7f0b0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.772+0000 7f0b32400640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0c06be30 0x7f0b0c06e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b20007fd0 tx=0x7f0b20007de0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.772+0000 7f0b32400640 1 -- 172.21.15.99:0/537034420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c15e970 msgr2=0x7f0b2c0cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.772+0000 7f0b32400640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c15e970 0x7f0b2c0cc250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400c780 tx=0x7f0b2400cc40 comp rx=0 tx=0).stop 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.772+0000 7f0b32400640 1 -- 172.21.15.99:0/537034420 shutdown_connections 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.772+0000 7f0b32400640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0c06be30 0x7f0b0c06e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.772+0000 7f0b32400640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b2c15e970 0x7f0b2c0cc250 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.772+0000 7f0b32400640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2c0d2680 0x7f0b2c0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.772+0000 7f0b32400640 1 --2- 172.21.15.99:0/537034420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2c0cfac0 0x7f0b2c160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.773+0000 7f0b32400640 1 -- 172.21.15.99:0/537034420 >> 172.21.15.99:0/537034420 conn(0x7f0b2c09de00 msgr2=0x7f0b2c0c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.773+0000 7f0b32400640 1 -- 172.21.15.99:0/537034420 shutdown_connections 2024-09-10T07:35:57.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:57.773+0000 7f0b32400640 1 -- 172.21.15.99:0/537034420 wait complete. 2024-09-10T07:35:57.788 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:35:57.964 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":5103,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.03247343,"mdsmap_epoch":25,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":25.587559289000001} 2024-09-10T07:35:57.964 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 5103, "mdsmap_epoch": 25, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 21.03247343, "state": "up:active", "uptime": 25.587559289, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:35:57.964 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T07:35:57.965 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:35:57.965 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:35:58.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:58.001 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-10T07:35:58.076 INFO:teuthology.orchestra.run.smithi099.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-10T07:35:58.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:35:58.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:58.077 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-10T07:35:58.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:35:58.157 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-10T07:35:58.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:35:58.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.442+0000 7f8281c00640 1 Processor -- start 2024-09-10T07:35:58.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.442+0000 7f8281c00640 1 -- start start 2024-09-10T07:35:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.443+0000 7f8281c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f827c0d2680 0x7f827c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.443+0000 7f8281c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f827c0d2bd0 con 0x7f827c15e970 2024-09-10T07:35:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.443+0000 7f8281c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f827c0d2eb0 con 0x7f827c0cfac0 2024-09-10T07:35:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.443+0000 7f8281c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f827c0d37e0 con 0x7f827c0d2680 2024-09-10T07:35:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.443+0000 7f827be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f827c15e970 0x7f827c0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57148/0 (socket says 172.21.15.99:57148) 2024-09-10T07:35:58.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.443+0000 7f827be00640 1 -- 172.21.15.99:0/2552388176 learned_addr learned my addr 172.21.15.99:0/2552388176 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:35:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.444+0000 7f827b400640 1 --2- 172.21.15.99:0/2552388176 >> v2:172.21.15.187:3300/0 conn(0x7f827c0d2680 0x7f827c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.444+0000 7f827aa00640 1 -- 172.21.15.99:0/2552388176 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768217713 0 0) 0x7f827c0d2bd0 con 0x7f827c15e970 2024-09-10T07:35:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.444+0000 7f827aa00640 1 -- 172.21.15.99:0/2552388176 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8260003520 con 0x7f827c15e970 2024-09-10T07:35:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.444+0000 7f827b400640 1 -- 172.21.15.99:0/2552388176 >> v1:172.21.15.187:6789/0 conn(0x7f827c0cfac0 legacy=0x7f827c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.444+0000 7f827b400640 1 -- 172.21.15.99:0/2552388176 >> v1:172.21.15.99:6789/0 conn(0x7f827c15e970 legacy=0x7f827c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.444+0000 7f827aa00640 1 -- 172.21.15.99:0/2552388176 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 226007446 0 0) 0x7f8260003520 con 0x7f827c15e970 2024-09-10T07:35:58.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.444+0000 7f827b400640 1 -- 172.21.15.99:0/2552388176 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827c0d3190 con 0x7f827c0d2680 2024-09-10T07:35:58.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.445+0000 7f827b400640 1 --2- 172.21.15.99:0/2552388176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f827c0d2680 0x7f827c0cf580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f827c0d3960 tx=0x7f826802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6db86c0a169a11ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:58.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.446+0000 7f827aa00640 1 -- 172.21.15.99:0/2552388176 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268037070 con 0x7f827c0d2680 2024-09-10T07:35:58.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.446+0000 7f827aa00640 1 -- 172.21.15.99:0/2552388176 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826802acc0 con 0x7f827c0d2680 2024-09-10T07:35:58.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.446+0000 7f827aa00640 1 -- 172.21.15.99:0/2552388176 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c001670 con 0x7f827c0d2680 2024-09-10T07:35:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.446+0000 7f8281c00640 1 -- 172.21.15.99:0/2552388176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f827c0d2680 msgr2=0x7f827c0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.446+0000 7f8281c00640 1 --2- 172.21.15.99:0/2552388176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f827c0d2680 0x7f827c0cf580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f827c0d3960 tx=0x7f826802a230 comp rx=0 tx=0).stop 2024-09-10T07:35:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.446+0000 7f8281c00640 1 -- 172.21.15.99:0/2552388176 shutdown_connections 2024-09-10T07:35:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.446+0000 7f8281c00640 1 --2- 172.21.15.99:0/2552388176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f827c0d2680 0x7f827c0cf580 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:58.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.446+0000 7f8281c00640 1 -- 172.21.15.99:0/2552388176 >> 172.21.15.99:0/2552388176 conn(0x7f827c09de00 msgr2=0x7f827c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:58.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.446+0000 7f8281c00640 1 -- 172.21.15.99:0/2552388176 shutdown_connections 2024-09-10T07:35:58.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.446+0000 7f8281c00640 1 -- 172.21.15.99:0/2552388176 wait complete. 2024-09-10T07:35:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.448+0000 7f8281c00640 1 Processor -- start 2024-09-10T07:35:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.448+0000 7f8281c00640 1 -- start start 2024-09-10T07:35:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f8281c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f827c0cfac0 0x7f827c160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f8281c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f827c0d2680 0x7f827c1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f8281c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f827c15e970 0x7f827c1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f8281c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f827c15ed50 con 0x7f827c0d2680 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f8281c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f827c0cff10 con 0x7f827c15e970 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f8281c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f827c15eed0 con 0x7f827c0cfac0 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f827b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f827c0d2680 0x7f827c1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f827b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f827c0d2680 0x7f827c1546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41712/0 (socket says 172.21.15.99:41712) 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f827b400640 1 -- 172.21.15.99:0/3301154726 learned_addr learned my addr 172.21.15.99:0/3301154726 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f8281200640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f827c15e970 0x7f827c1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.449+0000 7f827be00640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f827c0cfac0 0x7f827c160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f827b400640 1 -- 172.21.15.99:0/3301154726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f827c0cfac0 msgr2=0x7f827c160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f827b400640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f827c0cfac0 0x7f827c160500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f827b400640 1 -- 172.21.15.99:0/3301154726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f827c15e970 msgr2=0x7f827c1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f827b400640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f827c15e970 0x7f827c1553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:58.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f827b400640 1 -- 172.21.15.99:0/3301154726 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827c0b8070 con 0x7f827c0d2680 2024-09-10T07:35:58.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f827b400640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f827c0d2680 0x7f827c1546d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8268035040 tx=0x7f82680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:58.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f8273e00640 1 -- 172.21.15.99:0/3301154726 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268041070 con 0x7f827c0d2680 2024-09-10T07:35:58.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f8273e00640 1 -- 172.21.15.99:0/3301154726 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826803c680 con 0x7f827c0d2680 2024-09-10T07:35:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f8281c00640 1 -- 172.21.15.99:0/3301154726 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827c161940 con 0x7f827c0d2680 2024-09-10T07:35:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f8273e00640 1 -- 172.21.15.99:0/3301154726 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268037040 con 0x7f827c0d2680 2024-09-10T07:35:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.450+0000 7f8281c00640 1 -- 172.21.15.99:0/3301154726 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827c161f00 con 0x7f827c0d2680 2024-09-10T07:35:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.451+0000 7f8281c00640 1 -- 172.21.15.99:0/3301154726 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f827c161d30 con 0x7f827c0d2680 2024-09-10T07:35:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.452+0000 7f8273e00640 1 -- 172.21.15.99:0/3301154726 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8268044070 con 0x7f827c0d2680 2024-09-10T07:35:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.453+0000 7f8273e00640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f825c06be30 0x7f825c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:35:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.453+0000 7f8273e00640 1 -- 172.21.15.99:0/3301154726 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f82680ab680 con 0x7f827c0d2680 2024-09-10T07:35:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.453+0000 7f827be00640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f825c06be30 0x7f825c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:35:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.453+0000 7f8273e00640 1 -- 172.21.15.99:0/3301154726 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=49}) -- 0x7f825c073960 con 0x7f827c0d2680 2024-09-10T07:35:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.454+0000 7f827be00640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f825c06be30 0x7f825c06e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f826c0011e0 tx=0x7f826c0016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:35:58.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.457+0000 7f8273e00640 1 -- 172.21.15.99:0/3301154726 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8268079940 con 0x7f827c0d2680 2024-09-10T07:35:58.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.630+0000 7f8281c00640 1 -- 172.21.15.99:0/3301154726 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f827c0cf580 con 0x7f827c0d2680 2024-09-10T07:35:58.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.632+0000 7f8273e00640 1 -- 172.21.15.99:0/3301154726 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) ==== 81+0+34323 (secure 0 0 0) 0x7f826807dc40 con 0x7f827c0d2680 2024-09-10T07:35:58.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:35:58.632 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:35:58.632 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 48, 2024-09-10T07:35:58.632 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:35:58.632 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:35:54.781163+0000", 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:35:58.633 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 7, 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:35:58.634 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:58.635 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:58.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.637 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:35:58.637 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:58.637 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:58.637 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:58.637 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:58.637 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:58.637 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:58.637 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:58.640 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:58.641 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:58.641 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:58.641 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:58.641 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:58.641 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:58.642 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:58.642 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:58.642 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:58.642 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:58.642 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:58.642 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:58.642 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:58.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.642 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:35:58.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:58.644 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 6, 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:34.068514+0000", 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:58.645 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:58.646 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:58.647 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:58.648 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:58.649 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:58.650 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:35:58.650 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:35:58.650 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:35:58.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.650 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:58.650 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:35:58.650 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:35:58.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.650 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:58.651 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:58.651 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:35:58.651 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:35:58.651 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:35:58.651 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:35:58.651 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:35:58.651 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:58.651 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 7, 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:35.306080+0000", 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:35:58.652 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:35:58.653 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:35:58.654 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:35:58.655 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:35:58.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:35:58.657 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:35:58.658 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:35:58.659 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.660 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:35:58.664 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:58.665 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:58.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:58.670 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:58.671 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.674 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.675 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:35:58.676 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.677 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:35:58.681 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull", 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:58.682 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:58.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:58.688 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.689 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.690 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:58.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:35:58.692 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:58.693 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:58.694 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:58.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:58.696 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:35:58.697 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:35:58.698 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:35:58.700 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:35:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:58.706 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:58.708 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:58.709 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:35:58.710 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:35:58.711 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:35:58.712 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:35:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:35:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:35:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:35:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:35:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:35:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:35:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:35:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:35:58.713 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:35:58.713 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:35:58.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 -- 172.21.15.99:0/3301154726 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f825c06be30 msgr2=0x7f825c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:58.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f825c06be30 0x7f825c06e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f826c0011e0 tx=0x7f826c0016f0 comp rx=0 tx=0).stop 2024-09-10T07:35:58.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 -- 172.21.15.99:0/3301154726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f827c0d2680 msgr2=0x7f827c1546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:35:58.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f827c0d2680 0x7f827c1546d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8268035040 tx=0x7f82680046c0 comp rx=0 tx=0).stop 2024-09-10T07:35:58.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 -- 172.21.15.99:0/3301154726 shutdown_connections 2024-09-10T07:35:58.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f827c15e970 0x7f827c1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:58.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f825c06be30 0x7f825c06e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:58.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f827c0d2680 0x7f827c1546d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:58.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 --2- 172.21.15.99:0/3301154726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f827c0cfac0 0x7f827c160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:35:58.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 -- 172.21.15.99:0/3301154726 >> 172.21.15.99:0/3301154726 conn(0x7f827c09de00 msgr2=0x7f827c0d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:35:58.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 -- 172.21.15.99:0/3301154726 shutdown_connections 2024-09-10T07:35:58.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:35:58.634+0000 7f8281c00640 1 -- 172.21.15.99:0/3301154726 wait complete. 2024-09-10T07:35:58.717 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:36:01.705 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:36:01.706+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-10T07:36:03.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:36:03.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.884+0000 7f434a800640 1 Processor -- start 2024-09-10T07:36:03.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.885+0000 7f434a800640 1 -- start start 2024-09-10T07:36:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.886+0000 7f434a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f43440ce780 0x7f434406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.886+0000 7f434a800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f434406e3d0 con 0x7f4344072f40 2024-09-10T07:36:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.886+0000 7f434a800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f434406e6b0 con 0x7f4344145290 2024-09-10T07:36:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.886+0000 7f434a800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f434406efe0 con 0x7f43440ce780 2024-09-10T07:36:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.886+0000 7f4343e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f43440ce780 0x7f434406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.886+0000 7f4343e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f43440ce780 0x7f434406f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59758/0 (socket says 172.21.15.99:59758) 2024-09-10T07:36:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.886+0000 7f4343e00640 1 -- 172.21.15.99:0/332643330 learned_addr learned my addr 172.21.15.99:0/332643330 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.887+0000 7f4343e00640 1 -- 172.21.15.99:0/332643330 >> v1:172.21.15.187:6789/0 conn(0x7f4344145290 legacy=0x7f4344072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.887+0000 7f4343e00640 1 -- 172.21.15.99:0/332643330 >> v1:172.21.15.99:6789/0 conn(0x7f4344072f40 legacy=0x7f43440b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.887+0000 7f4343e00640 1 -- 172.21.15.99:0/332643330 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434406e990 con 0x7f43440ce780 2024-09-10T07:36:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.888+0000 7f4343e00640 1 --2- 172.21.15.99:0/332643330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43440ce780 0x7f434406f470 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f433c009e50 tx=0x7f433c02c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf72ef84c7cdb0ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.888+0000 7f4342a00640 1 -- 172.21.15.99:0/332643330 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c035020 con 0x7f43440ce780 2024-09-10T07:36:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.888+0000 7f4342a00640 1 -- 172.21.15.99:0/332643330 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f433c031620 con 0x7f43440ce780 2024-09-10T07:36:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.888+0000 7f4342a00640 1 -- 172.21.15.99:0/332643330 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c0319f0 con 0x7f43440ce780 2024-09-10T07:36:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.888+0000 7f434a800640 1 -- 172.21.15.99:0/332643330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43440ce780 msgr2=0x7f434406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.888+0000 7f434a800640 1 --2- 172.21.15.99:0/332643330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43440ce780 0x7f434406f470 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f433c009e50 tx=0x7f433c02c9d0 comp rx=0 tx=0).stop 2024-09-10T07:36:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.889+0000 7f434a800640 1 -- 172.21.15.99:0/332643330 shutdown_connections 2024-09-10T07:36:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.889+0000 7f434a800640 1 --2- 172.21.15.99:0/332643330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43440ce780 0x7f434406f470 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.889+0000 7f434a800640 1 -- 172.21.15.99:0/332643330 >> 172.21.15.99:0/332643330 conn(0x7f434406bc10 msgr2=0x7f434406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.889+0000 7f434a800640 1 -- 172.21.15.99:0/332643330 shutdown_connections 2024-09-10T07:36:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.889+0000 7f434a800640 1 -- 172.21.15.99:0/332643330 wait complete. 2024-09-10T07:36:03.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.890+0000 7f434a800640 1 Processor -- start 2024-09-10T07:36:03.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.890+0000 7f434a800640 1 -- start start 2024-09-10T07:36:03.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.891+0000 7f434a800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4344072f40 0x7f43441f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:03.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.891+0000 7f434a800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43440ce780 0x7f434413b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.891+0000 7f434a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4344145290 0x7f434413cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.891+0000 7f434a800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f434406df80 con 0x7f4344145290 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.891+0000 7f434a800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4344145670 con 0x7f4344072f40 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.891+0000 7f434a800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f434406e100 con 0x7f43440ce780 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f4343e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4344145290 0x7f434413cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f4343e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4344145290 0x7f434413cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59770/0 (socket says 172.21.15.99:59770) 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f4343e00640 1 -- 172.21.15.99:0/2237056197 learned_addr learned my addr 172.21.15.99:0/2237056197 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f4343400640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4344072f40 0x7f43441f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f433aa00640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43440ce780 0x7f434413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f4343e00640 1 -- 172.21.15.99:0/2237056197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43440ce780 msgr2=0x7f434413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f4343e00640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43440ce780 0x7f434413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f4343e00640 1 -- 172.21.15.99:0/2237056197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4344072f40 msgr2=0x7f43441f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f4343e00640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4344072f40 0x7f43441f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f4343e00640 1 -- 172.21.15.99:0/2237056197 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434413bff0 con 0x7f4344145290 2024-09-10T07:36:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f433aa00640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43440ce780 0x7f434413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f4343e00640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4344145290 0x7f434413cb20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f433c02cfc0 tx=0x7f433c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.892+0000 7f433be00640 1 -- 172.21.15.99:0/2237056197 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c035050 con 0x7f4344145290 2024-09-10T07:36:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.893+0000 7f433be00640 1 -- 172.21.15.99:0/2237056197 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f433c03a630 con 0x7f4344145290 2024-09-10T07:36:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.893+0000 7f433be00640 1 -- 172.21.15.99:0/2237056197 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c03aa20 con 0x7f4344145290 2024-09-10T07:36:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.893+0000 7f434a800640 1 -- 172.21.15.99:0/2237056197 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434413c2d0 con 0x7f4344145290 2024-09-10T07:36:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.893+0000 7f434a800640 1 -- 172.21.15.99:0/2237056197 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4344141a60 con 0x7f4344145290 2024-09-10T07:36:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.894+0000 7f434a800640 1 -- 172.21.15.99:0/2237056197 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43440715a0 con 0x7f4344145290 2024-09-10T07:36:03.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.894+0000 7f433be00640 1 -- 172.21.15.99:0/2237056197 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f433c038020 con 0x7f4344145290 2024-09-10T07:36:03.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.895+0000 7f433be00640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f432006be30 0x7f432006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:03.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.895+0000 7f433be00640 1 -- 172.21.15.99:0/2237056197 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5709+0+0 (secure 0 0 0) 0x7f433c0adc50 con 0x7f4344145290 2024-09-10T07:36:03.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.896+0000 7f4343400640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f432006be30 0x7f432006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:03.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.896+0000 7f433be00640 1 -- 172.21.15.99:0/2237056197 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=51}) -- 0x7f4320073960 con 0x7f4344145290 2024-09-10T07:36:03.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.896+0000 7f4343400640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f432006be30 0x7f432006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4334000f60 tx=0x7f4334009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:03.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:03.900+0000 7f433be00640 1 -- 172.21.15.99:0/2237056197 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f433c07c560 con 0x7f4344145290 2024-09-10T07:36:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.074+0000 7f434a800640 1 -- 172.21.15.99:0/2237056197 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f434406f630 con 0x7f4344145290 2024-09-10T07:36:04.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.076+0000 7f433be00640 1 -- 172.21.15.99:0/2237056197 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) ==== 81+0+34251 (secure 0 0 0) 0x7f433c04ce80 con 0x7f4344145290 2024-09-10T07:36:04.076 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:04.076 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:36:04.076 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 50, 2024-09-10T07:36:04.076 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:36:04.076 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:36:04.076 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:36:03.813174+0000", 2024-09-10T07:36:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:36:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:36:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:36:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:36:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:36:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:36:04.077 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 7, 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:36:04.078 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:36:04.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:36:04.080 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:36:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:36:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:36:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:36:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:36:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:36:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:36:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:36:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:36:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:36:04.081 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:36:04.082 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:36:04.083 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:36:04.084 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:36:04.085 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:36:04.086 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 6, 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:34.068514+0000", 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:36:04.087 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:36:04.088 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:36:04.089 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:36:04.090 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:36:04.091 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:36:04.092 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.093 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 7, 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:35.306080+0000", 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:36:04.095 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:36:04.096 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "45", 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:36:04.097 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:36:04.098 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:36:04.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:36:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:36:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:36:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:36:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:36:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:36:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:36:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:36:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:36:04.100 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.101 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.102 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:04.103 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:36:04.105 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.106 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:04.107 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.108 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:04.110 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:04.111 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:36:04.114 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:36:04.115 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:04.116 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.117 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.120 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:04.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:04.123 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.124 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:36:04.126 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:36:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull", 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:04.129 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.130 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.131 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.132 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:36:04.133 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.134 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:04.135 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:04.136 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.137 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:36:04.138 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:36:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:04.139 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.140 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.141 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:36:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:36:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:36:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:36:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:36:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:04.142 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:04.143 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:36:04.144 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.145 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.146 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:04.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.148 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:04.149 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:04.150 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:36:04.152 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.153 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:04.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.156 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:04.158 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:04.159 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:04.160 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:04.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:36:04.163 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:36:04.164 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:36:04.164 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:36:04.164 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:36:04.164 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:36:04.164 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:36:04.164 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:36:04.164 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:36:04.164 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:36:04.164 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:36:04.164 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:36:04.165 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:36:04.166 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:36:04.166 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:36:04.166 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:36:04.166 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:36:04.166 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:04.166 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:36:04.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 -- 172.21.15.99:0/2237056197 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f432006be30 msgr2=0x7f432006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:04.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f432006be30 0x7f432006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4334000f60 tx=0x7f4334009040 comp rx=0 tx=0).stop 2024-09-10T07:36:04.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 -- 172.21.15.99:0/2237056197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4344145290 msgr2=0x7f434413cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:04.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4344145290 0x7f434413cb20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f433c02cfc0 tx=0x7f433c004a40 comp rx=0 tx=0).stop 2024-09-10T07:36:04.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 -- 172.21.15.99:0/2237056197 shutdown_connections 2024-09-10T07:36:04.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f432006be30 0x7f432006e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:04.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4344145290 0x7f434413cb20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:04.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43440ce780 0x7f434413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:04.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 --2- 172.21.15.99:0/2237056197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4344072f40 0x7f43441f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:04.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 -- 172.21.15.99:0/2237056197 >> 172.21.15.99:0/2237056197 conn(0x7f434406bc10 msgr2=0x7f434415c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:04.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 -- 172.21.15.99:0/2237056197 shutdown_connections 2024-09-10T07:36:04.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:04.078+0000 7f434a800640 1 -- 172.21.15.99:0/2237056197 wait complete. 2024-09-10T07:36:04.170 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:36:09.171 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:36:09.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.337+0000 7ff7c0000640 1 Processor -- start 2024-09-10T07:36:09.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.337+0000 7ff7c0000640 1 -- start start 2024-09-10T07:36:09.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.338+0000 7ff7c0000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7b815ed30 0x7ff7b8070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.338+0000 7ff7c0000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff7b80b5200 0x7ff7b81629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.338+0000 7ff7c0000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff7b8162f20 0x7ff7b80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.338+0000 7ff7c0000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b80d0a10 con 0x7ff7b8162f20 2024-09-10T07:36:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.338+0000 7ff7c0000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b8070ab0 con 0x7ff7b80b5200 2024-09-10T07:36:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.338+0000 7ff7c0000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b80d0cb0 con 0x7ff7b815ed30 2024-09-10T07:36:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.339+0000 7ff7be000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff7b8162f20 0x7ff7b80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.339+0000 7ff7be000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff7b8162f20 0x7ff7b80cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59780/0 (socket says 172.21.15.99:59780) 2024-09-10T07:36:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.339+0000 7ff7be000640 1 -- 172.21.15.99:0/4088510405 learned_addr learned my addr 172.21.15.99:0/4088510405 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.339+0000 7ff7bcc00640 1 --2- 172.21.15.99:0/4088510405 >> v2:172.21.15.187:3300/0 conn(0x7ff7b80b5200 0x7ff7b81629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.339+0000 7ff7bd600640 1 --2- 172.21.15.99:0/4088510405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7b815ed30 0x7ff7b8070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.339+0000 7ff7be000640 1 -- 172.21.15.99:0/4088510405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7b815ed30 msgr2=0x7ff7b8070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.339+0000 7ff7be000640 1 --2- 172.21.15.99:0/4088510405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7b815ed30 0x7ff7b8070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.339+0000 7ff7be000640 1 -- 172.21.15.99:0/4088510405 >> v2:172.21.15.187:3300/0 conn(0x7ff7b80b5200 msgr2=0x7ff7b81629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.339+0000 7ff7be000640 1 --2- 172.21.15.99:0/4088510405 >> v2:172.21.15.187:3300/0 conn(0x7ff7b80b5200 0x7ff7b81629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.339+0000 7ff7be000640 1 -- 172.21.15.99:0/4088510405 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b80d0f90 con 0x7ff7b8162f20 2024-09-10T07:36:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.340+0000 7ff7be000640 1 --2- 172.21.15.99:0/4088510405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b8162f20 0x7ff7b80cf1e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8072920 tx=0x7ff7b002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7faf69e1ac1f42c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7b7e00640 1 -- 172.21.15.99:0/4088510405 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0036070 con 0x7ff7b8162f20 2024-09-10T07:36:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7b7e00640 1 -- 172.21.15.99:0/4088510405 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b0031600 con 0x7ff7b8162f20 2024-09-10T07:36:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7b7e00640 1 -- 172.21.15.99:0/4088510405 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00319d0 con 0x7ff7b8162f20 2024-09-10T07:36:09.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7c0000640 1 -- 172.21.15.99:0/4088510405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b8162f20 msgr2=0x7ff7b80cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:09.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7c0000640 1 --2- 172.21.15.99:0/4088510405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b8162f20 0x7ff7b80cf1e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8072920 tx=0x7ff7b002a730 comp rx=0 tx=0).stop 2024-09-10T07:36:09.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7c0000640 1 -- 172.21.15.99:0/4088510405 shutdown_connections 2024-09-10T07:36:09.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7c0000640 1 --2- 172.21.15.99:0/4088510405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b8162f20 0x7ff7b80cf1e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7c0000640 1 --2- 172.21.15.99:0/4088510405 >> v2:172.21.15.187:3300/0 conn(0x7ff7b80b5200 0x7ff7b81629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7c0000640 1 --2- 172.21.15.99:0/4088510405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7b815ed30 0x7ff7b8070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7c0000640 1 -- 172.21.15.99:0/4088510405 >> 172.21.15.99:0/4088510405 conn(0x7ff7b80b4600 msgr2=0x7ff7b80b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:09.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7c0000640 1 -- 172.21.15.99:0/4088510405 shutdown_connections 2024-09-10T07:36:09.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.341+0000 7ff7c0000640 1 -- 172.21.15.99:0/4088510405 wait complete. 2024-09-10T07:36:09.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.343+0000 7ff7c0000640 1 Processor -- start 2024-09-10T07:36:09.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.343+0000 7ff7c0000640 1 -- start start 2024-09-10T07:36:09.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7c0000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7b80b5200 0x7ff7b8151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7c0000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b815ed30 0x7ff7b815fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7c0000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7b8162f20 0x7ff7b80c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7c0000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8070f10 con 0x7ff7b815ed30 2024-09-10T07:36:09.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7c0000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8070d90 con 0x7ff7b8162f20 2024-09-10T07:36:09.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7c0000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b815f110 con 0x7ff7b80b5200 2024-09-10T07:36:09.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7bcc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b815ed30 0x7ff7b815fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7bcc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b815ed30 0x7ff7b815fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59790/0 (socket says 172.21.15.99:59790) 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7bcc00640 1 -- 172.21.15.99:0/168541682 learned_addr learned my addr 172.21.15.99:0/168541682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7be000640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7b8162f20 0x7ff7b80c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7bd600640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7b80b5200 0x7ff7b8151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7bcc00640 1 -- 172.21.15.99:0/168541682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7b80b5200 msgr2=0x7ff7b8151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.344+0000 7ff7bcc00640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7b80b5200 0x7ff7b8151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.345+0000 7ff7bcc00640 1 -- 172.21.15.99:0/168541682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7b8162f20 msgr2=0x7ff7b80c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.345+0000 7ff7bcc00640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7b8162f20 0x7ff7b80c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.345+0000 7ff7bcc00640 1 -- 172.21.15.99:0/168541682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b8162240 con 0x7ff7b815ed30 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.345+0000 7ff7be000640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7b8162f20 0x7ff7b80c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.345+0000 7ff7bcc00640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b815ed30 0x7ff7b815fd90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400e860 tx=0x7ff7a400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.345+0000 7ff7b5600640 1 -- 172.21.15.99:0/168541682 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4017070 con 0x7ff7b815ed30 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.345+0000 7ff7b5600640 1 -- 172.21.15.99:0/168541682 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a400c940 con 0x7ff7b815ed30 2024-09-10T07:36:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.345+0000 7ff7b5600640 1 -- 172.21.15.99:0/168541682 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400cd10 con 0x7ff7b815ed30 2024-09-10T07:36:09.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.345+0000 7ff7c0000640 1 -- 172.21.15.99:0/168541682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b81619e0 con 0x7ff7b815ed30 2024-09-10T07:36:09.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.345+0000 7ff7c0000640 1 -- 172.21.15.99:0/168541682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b8161f60 con 0x7ff7b815ed30 2024-09-10T07:36:09.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.346+0000 7ff7c0000640 1 -- 172.21.15.99:0/168541682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b81629e0 con 0x7ff7b815ed30 2024-09-10T07:36:09.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.347+0000 7ff7b5600640 1 -- 172.21.15.99:0/168541682 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7a401a070 con 0x7ff7b815ed30 2024-09-10T07:36:09.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.348+0000 7ff7b5600640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff79806be30 0x7ff79806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.348+0000 7ff7b5600640 1 -- 172.21.15.99:0/168541682 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7ff7a408ab10 con 0x7ff7b815ed30 2024-09-10T07:36:09.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.348+0000 7ff7bd600640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff79806be30 0x7ff79806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.349+0000 7ff7bd600640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff79806be30 0x7ff79806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009b40 tx=0x7ff7ac009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.353+0000 7ff7b5600640 1 -- 172.21.15.99:0/168541682 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7b8162240 con 0x7ff7b815ed30 2024-09-10T07:36:09.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.526+0000 7ff7c0000640 1 -- 172.21.15.99:0/168541682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7ff7b80686d0 con 0x7ff7b815ed30 2024-09-10T07:36:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.528+0000 7ff7b5600640 1 -- 172.21.15.99:0/168541682 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) ==== 81+0+34611 (secure 0 0 0) 0x7ff7a4058e20 con 0x7ff7b815ed30 2024-09-10T07:36:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:09.528 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:36:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 54, 2024-09-10T07:36:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:36:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:36:07.849458+0000", 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:36:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 7, 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "luminous", 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:36:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:36:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:36:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:36:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:36:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:36:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:36:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:36:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:36:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:36:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:36:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "52", 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:36:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:36:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:36:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:36:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:36:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:36:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:36:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:36:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:36:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:36:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:36:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:36:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:36:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:36:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:36:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:36:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:36:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:36:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:36:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:36:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:36:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:36:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:36:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:36:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:36:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:36:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:36:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:36:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:36:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:36:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:36:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 6, 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:34.068514+0000", 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:36:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:36:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "52", 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:36:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:36:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:36:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 7, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:35.306080+0000", 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:36:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:36:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "52", 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:36:09.548 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:36:09.549 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:36:09.550 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.6299999952316284, 2024-09-10T07:36:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.6299999952316284, 2024-09-10T07:36:09.552 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:36:09.552 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-10T07:36:09.552 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-10T07:36:09.552 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:36:09.552 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:36:09.552 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:36:09.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.552 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:09.553 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.554 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.555 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.556 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.559 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:09.560 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:09.561 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:09.562 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:36:09.563 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 53, 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:09.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.566 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.566 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:36:09.566 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:09.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.567 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.567 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:09.567 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:09.568 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:09.569 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.571 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:36:09.572 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:36:09.573 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:36:09.574 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.575 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:36:09.576 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.577 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.578 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.578 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.578 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.578 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.578 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 53, 2024-09-10T07:36:09.578 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.578 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.578 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.579 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.579 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.579 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:36:09.579 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:09.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.579 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.580 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:36:09.580 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:09.580 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.580 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.580 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:09.580 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.581 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.581 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:36:09.581 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:09.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.581 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.581 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:36:09.581 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.582 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.583 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:09.584 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:09.585 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.586 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.586 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.586 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:09.587 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.588 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.590 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.591 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.592 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.595 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:36:09.596 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.597 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:09.602 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:36:09.603 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:36:09.604 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:09.605 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:09.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.607 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:09.608 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [ 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "7.2a", 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.609 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 0, 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 4 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "7.2c", 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 0, 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 5 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:36:09.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:36:09.612 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.613 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:36:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 -- 172.21.15.99:0/168541682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff79806be30 msgr2=0x7ff79806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff79806be30 0x7ff79806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009b40 tx=0x7ff7ac009190 comp rx=0 tx=0).stop 2024-09-10T07:36:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 -- 172.21.15.99:0/168541682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b815ed30 msgr2=0x7ff7b815fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b815ed30 0x7ff7b815fd90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400e860 tx=0x7ff7a400ed20 comp rx=0 tx=0).stop 2024-09-10T07:36:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 -- 172.21.15.99:0/168541682 shutdown_connections 2024-09-10T07:36:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7b8162f20 0x7ff7b80c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff79806be30 0x7ff79806e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b815ed30 0x7ff7b815fd90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 --2- 172.21.15.99:0/168541682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7b80b5200 0x7ff7b8151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 -- 172.21.15.99:0/168541682 >> 172.21.15.99:0/168541682 conn(0x7ff7b80b4600 msgr2=0x7ff7b80d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:09.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 -- 172.21.15.99:0/168541682 shutdown_connections 2024-09-10T07:36:09.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.530+0000 7ff7c0000640 1 -- 172.21.15.99:0/168541682 wait complete. 2024-09-10T07:36:09.616 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-10T07:36:09.616 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:36:09.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.769+0000 7f0c8b400640 1 Processor -- start 2024-09-10T07:36:09.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.770+0000 7f0c8b400640 1 -- start start 2024-09-10T07:36:09.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c8b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0c8415ede0 0x7f0c840afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c8b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0c840cf830 0x7f0c840b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c8b400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c840b0200 con 0x7f0c840cfca0 2024-09-10T07:36:09.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c8b400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0c840aec20 con 0x7f0c8415ede0 2024-09-10T07:36:09.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c8b400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0c840aef00 con 0x7f0c840cf830 2024-09-10T07:36:09.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c88a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0c8415ede0 0x7f0c840afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c88a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0c8415ede0 0x7f0c840afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59806/0 (socket says 172.21.15.99:59806) 2024-09-10T07:36:09.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c88a00640 1 -- 172.21.15.99:0/809352578 learned_addr learned my addr 172.21.15.99:0/809352578 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:09.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c88a00640 1 -- 172.21.15.99:0/809352578 >> v2:172.21.15.187:3300/0 conn(0x7f0c840cf830 msgr2=0x7f0c840b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:09.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c88a00640 1 --2- 172.21.15.99:0/809352578 >> v2:172.21.15.187:3300/0 conn(0x7f0c840cf830 0x7f0c840b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c88a00640 1 -- 172.21.15.99:0/809352578 >> v1:172.21.15.187:6789/0 conn(0x7f0c840cfca0 legacy=0x7f0c84071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:09.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.771+0000 7f0c88a00640 1 -- 172.21.15.99:0/809352578 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c840af1e0 con 0x7f0c8415ede0 2024-09-10T07:36:09.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.772+0000 7f0c88a00640 1 --2- 172.21.15.99:0/809352578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c8415ede0 0x7f0c840afcc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0c840b5a30 tx=0x7f0c7402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8814e7a008be7b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:09.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c83e00640 1 -- 172.21.15.99:0/809352578 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74037070 con 0x7f0c8415ede0 2024-09-10T07:36:09.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c83e00640 1 -- 172.21.15.99:0/809352578 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74032440 con 0x7f0c8415ede0 2024-09-10T07:36:09.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c83e00640 1 -- 172.21.15.99:0/809352578 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74032810 con 0x7f0c8415ede0 2024-09-10T07:36:09.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c8b400640 1 -- 172.21.15.99:0/809352578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c8415ede0 msgr2=0x7f0c840afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:09.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c8b400640 1 --2- 172.21.15.99:0/809352578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c8415ede0 0x7f0c840afcc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0c840b5a30 tx=0x7f0c7402a230 comp rx=0 tx=0).stop 2024-09-10T07:36:09.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c8b400640 1 -- 172.21.15.99:0/809352578 shutdown_connections 2024-09-10T07:36:09.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c8b400640 1 --2- 172.21.15.99:0/809352578 >> v2:172.21.15.187:3300/0 conn(0x7f0c840cf830 0x7f0c840b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c8b400640 1 --2- 172.21.15.99:0/809352578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c8415ede0 0x7f0c840afcc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c8b400640 1 -- 172.21.15.99:0/809352578 >> 172.21.15.99:0/809352578 conn(0x7f0c8406bc10 msgr2=0x7f0c8406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:09.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c8b400640 1 -- 172.21.15.99:0/809352578 shutdown_connections 2024-09-10T07:36:09.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.773+0000 7f0c8b400640 1 -- 172.21.15.99:0/809352578 wait complete. 2024-09-10T07:36:09.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.775+0000 7f0c8b400640 1 Processor -- start 2024-09-10T07:36:09.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.775+0000 7f0c8b400640 1 -- start start 2024-09-10T07:36:09.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c8b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c840cf830 0x7f0c84152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c8b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c840cfca0 0x7f0c84160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c8b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c8415ede0 0x7f0c84161210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c8b400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0c840ae840 con 0x7f0c840cf830 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c8b400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0c840af7a0 con 0x7f0c8415ede0 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c8b400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0c840ae9c0 con 0x7f0c840cfca0 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c88a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c840cf830 0x7f0c84152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c88a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c840cf830 0x7f0c84152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59812/0 (socket says 172.21.15.99:59812) 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c88a00640 1 -- 172.21.15.99:0/1912540886 learned_addr learned my addr 172.21.15.99:0/1912540886 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c7be00640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c840cfca0 0x7f0c84160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.776+0000 7f0c89400640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c8415ede0 0x7f0c84161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c88a00640 1 -- 172.21.15.99:0/1912540886 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c840cfca0 msgr2=0x7f0c84160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c88a00640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c840cfca0 0x7f0c84160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c88a00640 1 -- 172.21.15.99:0/1912540886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c8415ede0 msgr2=0x7f0c84161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:09.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c88a00640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c8415ede0 0x7f0c84161210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:09.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c88a00640 1 -- 172.21.15.99:0/1912540886 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8406f450 con 0x7f0c840cf830 2024-09-10T07:36:09.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c88a00640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c840cf830 0x7f0c84152740 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0c74000c00 tx=0x7f0c740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:09.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c81600640 1 -- 172.21.15.99:0/1912540886 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74041070 con 0x7f0c840cf830 2024-09-10T07:36:09.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c81600640 1 -- 172.21.15.99:0/1912540886 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7403c870 con 0x7f0c840cf830 2024-09-10T07:36:09.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c81600640 1 -- 172.21.15.99:0/1912540886 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74037040 con 0x7f0c840cf830 2024-09-10T07:36:09.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c8b400640 1 -- 172.21.15.99:0/1912540886 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c841f5260 con 0x7f0c840cf830 2024-09-10T07:36:09.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.777+0000 7f0c8b400640 1 -- 172.21.15.99:0/1912540886 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c841f5820 con 0x7f0c840cf830 2024-09-10T07:36:09.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.778+0000 7f0c8b400640 1 -- 172.21.15.99:0/1912540886 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c840afcc0 con 0x7f0c840cf830 2024-09-10T07:36:09.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.779+0000 7f0c81600640 1 -- 172.21.15.99:0/1912540886 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c74044070 con 0x7f0c840cf830 2024-09-10T07:36:09.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.780+0000 7f0c81600640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c6006be30 0x7f0c6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:09.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.780+0000 7f0c81600640 1 -- 172.21.15.99:0/1912540886 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7f0c740abca0 con 0x7f0c840cf830 2024-09-10T07:36:09.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.780+0000 7f0c7be00640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c6006be30 0x7f0c6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:09.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.781+0000 7f0c7be00640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c6006be30 0x7f0c6006e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c8406e2c0 tx=0x7f0c6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:09.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.784+0000 7f0c81600640 1 -- 172.21.15.99:0/1912540886 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c7407a720 con 0x7f0c840cf830 2024-09-10T07:36:09.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.961+0000 7f0c8b400640 1 -- 172.21.15.99:0/1912540886 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f0c84073500 con 0x7f0c840cf830 2024-09-10T07:36:09.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.962+0000 7f0c81600640 1 -- 172.21.15.99:0/1912540886 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) ==== 81+0+34611 (secure 0 0 0) 0x7f0c7407a020 con 0x7f0c840cf830 2024-09-10T07:36:09.962 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:09.962 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:36:09.962 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 54, 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:36:07.849458+0000", 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:36:09.963 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 7, 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "luminous", 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:36:09.964 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:36:09.965 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:36:09.966 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "52", 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:36:09.967 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:36:09.968 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:36:09.969 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:36:09.970 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 6, 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:34.068514+0000", 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:36:09.971 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:36:09.972 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "52", 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:36:09.973 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:36:09.974 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:36:09.975 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:36:09.975 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:36:09.975 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:36:09.975 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:36:09.975 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:36:09.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.976 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:36:09.976 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:36:09.976 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:36:09.976 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:36:09.976 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:36:09.976 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:36:09.976 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:36:09.976 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:36:09.976 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:36:09.976 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:36:09.977 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 7, 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:36:09.978 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:35:35.306080+0000", 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:36:09.979 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.980 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "52", 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:36:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.982 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:36:09.983 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:36:09.983 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:36:09.983 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:36:09.983 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:36:09.983 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:36:09.983 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:36:09.983 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:36:09.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.6299999952316284, 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.6299999952316284, 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.6299999952316284, 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.6299999952316284, 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.985 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.986 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.988 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:09.988 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.988 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.988 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:36:09.988 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:09.991 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.992 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.993 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:36:09.994 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.995 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.996 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 53, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:09.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.002 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:10.003 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.004 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:36:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 53, 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:36:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:36:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:36:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:36:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:36:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 42, 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:36:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:36:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:36:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:36:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:36:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:36:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [ 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "7.2a", 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 0, 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 4 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "7.2c", 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 0, 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 5 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:36:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:36:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:36:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:36:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:36:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:36:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:36:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:36:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:36:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:36:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:10.042 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:36:10.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.964+0000 7f0c8b400640 1 -- 172.21.15.99:0/1912540886 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c6006be30 msgr2=0x7f0c6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:10.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.964+0000 7f0c8b400640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c6006be30 0x7f0c6006e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c8406e2c0 tx=0x7f0c6c008040 comp rx=0 tx=0).stop 2024-09-10T07:36:10.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.964+0000 7f0c8b400640 1 -- 172.21.15.99:0/1912540886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c840cf830 msgr2=0x7f0c84152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:10.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.964+0000 7f0c8b400640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c840cf830 0x7f0c84152740 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0c74000c00 tx=0x7f0c740046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.965+0000 7f0c8b400640 1 -- 172.21.15.99:0/1912540886 shutdown_connections 2024-09-10T07:36:10.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.965+0000 7f0c8b400640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c8415ede0 0x7f0c84161210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.965+0000 7f0c8b400640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c840cfca0 0x7f0c84160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.965+0000 7f0c8b400640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c6006be30 0x7f0c6006e2f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.965+0000 7f0c8b400640 1 --2- 172.21.15.99:0/1912540886 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c840cf830 0x7f0c84152740 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.965+0000 7f0c8b400640 1 -- 172.21.15.99:0/1912540886 >> 172.21.15.99:0/1912540886 conn(0x7f0c8406bc10 msgr2=0x7f0c840cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:10.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.965+0000 7f0c8b400640 1 -- 172.21.15.99:0/1912540886 shutdown_connections 2024-09-10T07:36:10.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:09.965+0000 7f0c8b400640 1 -- 172.21.15.99:0/1912540886 wait complete. 2024-09-10T07:36:10.045 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:36:10.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.199+0000 7f957e000640 1 Processor -- start 2024-09-10T07:36:10.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.199+0000 7f957e000640 1 -- start start 2024-09-10T07:36:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.200+0000 7f957e000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f957815e970 0x7f95780d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.200+0000 7f957e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f95780d2680 0x7f95780cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.200+0000 7f957e000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95780d2bd0 con 0x7f95780cfac0 2024-09-10T07:36:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.200+0000 7f957e000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f95780d37e0 con 0x7f95780d2680 2024-09-10T07:36:10.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.200+0000 7f957e000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f95780d2eb0 con 0x7f957815e970 2024-09-10T07:36:10.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.201+0000 7f9577e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f95780d2680 0x7f95780cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:10.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.201+0000 7f9577e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f95780d2680 0x7f95780cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48296/0 (socket says 172.21.15.99:48296) 2024-09-10T07:36:10.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.201+0000 7f9577e00640 1 -- 172.21.15.99:0/31659372 learned_addr learned my addr 172.21.15.99:0/31659372 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:10.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.201+0000 7f957cc00640 1 --2- 172.21.15.99:0/31659372 >> v2:172.21.15.187:3300/0 conn(0x7f957815e970 0x7f95780d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:10.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.201+0000 7f9577e00640 1 -- 172.21.15.99:0/31659372 >> v2:172.21.15.187:3300/0 conn(0x7f957815e970 msgr2=0x7f95780d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:10.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.201+0000 7f9577e00640 1 --2- 172.21.15.99:0/31659372 >> v2:172.21.15.187:3300/0 conn(0x7f957815e970 0x7f95780d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.201+0000 7f9577e00640 1 -- 172.21.15.99:0/31659372 >> v1:172.21.15.187:6789/0 conn(0x7f95780cfac0 legacy=0x7f95780d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:10.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.201+0000 7f9577e00640 1 -- 172.21.15.99:0/31659372 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95780d3190 con 0x7f95780d2680 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.202+0000 7f9577e00640 1 --2- 172.21.15.99:0/31659372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 0x7f95780cf580 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f957806c1c0 tx=0x7f956402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357e65e0a4ac0e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.202+0000 7f9577400640 1 -- 172.21.15.99:0/31659372 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564037070 con 0x7f95780d2680 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.202+0000 7f9577400640 1 -- 172.21.15.99:0/31659372 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f956402ae50 con 0x7f95780d2680 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.202+0000 7f9577400640 1 -- 172.21.15.99:0/31659372 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564032860 con 0x7f95780d2680 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.203+0000 7f957e000640 1 -- 172.21.15.99:0/31659372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 msgr2=0x7f95780cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.203+0000 7f957e000640 1 --2- 172.21.15.99:0/31659372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 0x7f95780cf580 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f957806c1c0 tx=0x7f956402a300 comp rx=0 tx=0).stop 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.203+0000 7f957e000640 1 -- 172.21.15.99:0/31659372 shutdown_connections 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.203+0000 7f957e000640 1 --2- 172.21.15.99:0/31659372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 0x7f95780cf580 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.203+0000 7f957e000640 1 --2- 172.21.15.99:0/31659372 >> v2:172.21.15.187:3300/0 conn(0x7f957815e970 0x7f95780d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.203+0000 7f957e000640 1 -- 172.21.15.99:0/31659372 >> 172.21.15.99:0/31659372 conn(0x7f957809de00 msgr2=0x7f95780d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:10.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.203+0000 7f957e000640 1 -- 172.21.15.99:0/31659372 shutdown_connections 2024-09-10T07:36:10.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.203+0000 7f957e000640 1 -- 172.21.15.99:0/31659372 wait complete. 2024-09-10T07:36:10.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.205+0000 7f957e000640 1 Processor -- start 2024-09-10T07:36:10.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.205+0000 7f957e000640 1 -- start start 2024-09-10T07:36:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.205+0000 7f957e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95780cfac0 0x7f95781f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f957e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 0x7f95780b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f957e000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f957815e970 0x7f957815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f957e000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f95780d0840 con 0x7f95780d2680 2024-09-10T07:36:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f957e000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f95780cff10 con 0x7f957815e970 2024-09-10T07:36:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f957e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f957815ed50 con 0x7f95780cfac0 2024-09-10T07:36:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f9577e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 0x7f95780b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:10.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f9577e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 0x7f95780b8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48310/0 (socket says 172.21.15.99:48310) 2024-09-10T07:36:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f9577e00640 1 -- 172.21.15.99:0/199951584 learned_addr learned my addr 172.21.15.99:0/199951584 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f957cc00640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95780cfac0 0x7f95781f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f9577e00640 1 -- 172.21.15.99:0/199951584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95780cfac0 msgr2=0x7f95781f7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f957d600640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f957815e970 0x7f957815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f9577e00640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95780cfac0 0x7f95781f7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f9577e00640 1 -- 172.21.15.99:0/199951584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f957815e970 msgr2=0x7f957815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f9577e00640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f957815e970 0x7f957815cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f9577e00640 1 -- 172.21.15.99:0/199951584 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95780b9a10 con 0x7f95780d2680 2024-09-10T07:36:10.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.206+0000 7f957d600640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f957815e970 0x7f957815cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.207+0000 7f9577e00640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 0x7f95780b8f50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9564000c00 tx=0x7f95640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.207+0000 7f9574c00640 1 -- 172.21.15.99:0/199951584 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564041020 con 0x7f95780d2680 2024-09-10T07:36:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.207+0000 7f9574c00640 1 -- 172.21.15.99:0/199951584 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f956403c670 con 0x7f95780d2680 2024-09-10T07:36:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.207+0000 7f9574c00640 1 -- 172.21.15.99:0/199951584 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564037040 con 0x7f95780d2680 2024-09-10T07:36:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.207+0000 7f957e000640 1 -- 172.21.15.99:0/199951584 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95780b9cf0 con 0x7f95780d2680 2024-09-10T07:36:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.207+0000 7f957e000640 1 -- 172.21.15.99:0/199951584 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95780ba2b0 con 0x7f95780d2680 2024-09-10T07:36:10.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.208+0000 7f957e000640 1 -- 172.21.15.99:0/199951584 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95780cf580 con 0x7f95780d2680 2024-09-10T07:36:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.209+0000 7f9574c00640 1 -- 172.21.15.99:0/199951584 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9564044020 con 0x7f95780d2680 2024-09-10T07:36:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.210+0000 7f9574c00640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f955806be30 0x7f955806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:10.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.210+0000 7f9574c00640 1 -- 172.21.15.99:0/199951584 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7f95640ab5f0 con 0x7f95780d2680 2024-09-10T07:36:10.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.210+0000 7f957cc00640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f955806be30 0x7f955806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:10.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.211+0000 7f957cc00640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f955806be30 0x7f955806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f956c006fd0 tx=0x7f956c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:10.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.214+0000 7f9574c00640 1 -- 172.21.15.99:0/199951584 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f956404b030 con 0x7f95780d2680 2024-09-10T07:36:10.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.422+0000 7f957e000640 1 -- 172.21.15.99:0/199951584 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95780cb1d0 con 0x7f95780d2680 2024-09-10T07:36:10.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.423+0000 7f9574c00640 1 -- 172.21.15.99:0/199951584 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5226 (secure 0 0 0) 0x7f9564079f60 con 0x7f95780d2680 2024-09-10T07:36:10.423 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:10.423 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"btime":"2024-09-10T07:35:39:936250+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2667247037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2667247037},{"type":"v1","addr":"172.21.15.99:6836","nonce":2667247037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/588885740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":588885740},{"type":"v1","addr":"172.21.15.187:6834","nonce":588885740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2599063325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2599063325},{"type":"v1","addr":"172.21.15.187:6835","nonce":2599063325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:36.307304+0000","modified":"2024-09-10T07:35:39.339225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1015333121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1015333121},{"type":"v1","addr":"172.21.15.99:6837","nonce":1015333121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":3}]} 2024-09-10T07:36:10.423 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 25 2024-09-10T07:36:10.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 -- 172.21.15.99:0/199951584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f955806be30 msgr2=0x7f955806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:10.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f955806be30 0x7f955806e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f956c006fd0 tx=0x7f956c008040 comp rx=0 tx=0).stop 2024-09-10T07:36:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 -- 172.21.15.99:0/199951584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 msgr2=0x7f95780b8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 0x7f95780b8f50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9564000c00 tx=0x7f95640046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 -- 172.21.15.99:0/199951584 shutdown_connections 2024-09-10T07:36:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f957815e970 0x7f957815cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f955806be30 0x7f955806e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95780d2680 0x7f95780b8f50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 --2- 172.21.15.99:0/199951584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95780cfac0 0x7f95781f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 -- 172.21.15.99:0/199951584 >> 172.21.15.99:0/199951584 conn(0x7f957809de00 msgr2=0x7f95780d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.425+0000 7f957e000640 1 -- 172.21.15.99:0/199951584 shutdown_connections 2024-09-10T07:36:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:10.426+0000 7f957e000640 1 -- 172.21.15.99:0/199951584 wait complete. 2024-09-10T07:36:10.442 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:36:10.615 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":5103,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":33.683905936000002,"mdsmap_epoch":25,"osdmap_epoch":54,"osdmap_epoch_barrier":48,"uptime":38.238994470999998} 2024-09-10T07:36:10.616 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 5103, "mdsmap_epoch": 25, "osdmap_epoch": 54, "osdmap_epoch_barrier": 48, "rank_uptime": 33.683905936, "state": "up:active", "uptime": 38.238994471, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:36:10.616 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T07:36:10.616 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:36:10.616 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:10.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:10.652 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-10T07:36:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records in 2024-09-10T07:36:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records out 2024-09-10T07:36:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.357705 s, 147 MB/s 2024-09-10T07:36:11.089 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:36:11.089 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:36:11.184 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:36:11.283 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:36:11.283 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:36:11.283 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:36:11.283 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:11.319 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:36:11.319 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:11.396 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:36:11.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.591+0000 7f1fcae00640 1 Processor -- start 2024-09-10T07:36:11.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.591+0000 7f1fcae00640 1 -- start start 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.592+0000 7f1fcae00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1fc40d3070 0x7f1fc40d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.592+0000 7f1fcae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc40cf740 con 0x7f1fc40d51a0 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.592+0000 7f1fcae00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc40d3990 con 0x7f1fc415ed10 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.592+0000 7f1fcae00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f1fc40d2d70 con 0x7f1fc40d3070 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.593+0000 7f1fca400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1fc40d51a0 0x7f1fc40d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43288/0 (socket says 172.21.15.99:43288) 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.593+0000 7f1fca400640 1 -- 172.21.15.99:0/3840516604 learned_addr learned my addr 172.21.15.99:0/3840516604 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.593+0000 7f1fc9a00640 1 --2- 172.21.15.99:0/3840516604 >> v2:172.21.15.187:3300/0 conn(0x7f1fc40d3070 0x7f1fc40d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.593+0000 7f1fc3e00640 1 -- 172.21.15.99:0/3840516604 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555637714 0 0) 0x7f1fc40cf740 con 0x7f1fc40d51a0 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.593+0000 7f1fc3e00640 1 -- 172.21.15.99:0/3840516604 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fac003520 con 0x7f1fc40d51a0 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.593+0000 7f1fc9a00640 1 -- 172.21.15.99:0/3840516604 >> v1:172.21.15.187:6789/0 conn(0x7f1fc415ed10 legacy=0x7f1fc40d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.593+0000 7f1fc9a00640 1 -- 172.21.15.99:0/3840516604 >> v1:172.21.15.99:6789/0 conn(0x7f1fc40d51a0 legacy=0x7f1fc40d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:11.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.593+0000 7f1fc9a00640 1 -- 172.21.15.99:0/3840516604 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc40d08f0 con 0x7f1fc40d3070 2024-09-10T07:36:11.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.594+0000 7f1fc9a00640 1 --2- 172.21.15.99:0/3840516604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc40d3070 0x7f1fc40d3450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009d90 tx=0x7f1fb802a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ebd7d3119d74877 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.595+0000 7f1fc3e00640 1 -- 172.21.15.99:0/3840516604 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8037070 con 0x7f1fc40d3070 2024-09-10T07:36:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.595+0000 7f1fc3e00640 1 -- 172.21.15.99:0/3840516604 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb8007740 con 0x7f1fc40d3070 2024-09-10T07:36:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.595+0000 7f1fc3e00640 1 -- 172.21.15.99:0/3840516604 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8007af0 con 0x7f1fc40d3070 2024-09-10T07:36:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.595+0000 7f1fcae00640 1 -- 172.21.15.99:0/3840516604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc40d3070 msgr2=0x7f1fc40d3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.595+0000 7f1fcae00640 1 --2- 172.21.15.99:0/3840516604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc40d3070 0x7f1fc40d3450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009d90 tx=0x7f1fb802a780 comp rx=0 tx=0).stop 2024-09-10T07:36:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.595+0000 7f1fcae00640 1 -- 172.21.15.99:0/3840516604 shutdown_connections 2024-09-10T07:36:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.595+0000 7f1fcae00640 1 --2- 172.21.15.99:0/3840516604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc40d3070 0x7f1fc40d3450 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.595+0000 7f1fcae00640 1 -- 172.21.15.99:0/3840516604 >> 172.21.15.99:0/3840516604 conn(0x7f1fc409dd60 msgr2=0x7f1fc40d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.595+0000 7f1fcae00640 1 -- 172.21.15.99:0/3840516604 shutdown_connections 2024-09-10T07:36:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.595+0000 7f1fcae00640 1 -- 172.21.15.99:0/3840516604 wait complete. 2024-09-10T07:36:11.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.597+0000 7f1fcae00640 1 Processor -- start 2024-09-10T07:36:11.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.597+0000 7f1fcae00640 1 -- start start 2024-09-10T07:36:11.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fcae00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc40d3070 0x7f1fc40b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:11.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fcae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415ed10 0x7f1fc40b9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fcae00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc40ce3e0 0x7f1fc40b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fcae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc40cf9e0 con 0x7f1fc415ed10 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fcae00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc40d5630 con 0x7f1fc40ce3e0 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fcae00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc40cfcc0 con 0x7f1fc40d3070 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fc9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415ed10 0x7f1fc40b9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fc9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415ed10 0x7f1fc40b9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48316/0 (socket says 172.21.15.99:48316) 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fc9000640 1 -- 172.21.15.99:0/4018177456 learned_addr learned my addr 172.21.15.99:0/4018177456 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fc9a00640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc40d3070 0x7f1fc40b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.598+0000 7f1fca400640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc40ce3e0 0x7f1fc40b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fc9000640 1 -- 172.21.15.99:0/4018177456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc40d3070 msgr2=0x7f1fc40b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fc9000640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc40d3070 0x7f1fc40b8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:11.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fc9000640 1 -- 172.21.15.99:0/4018177456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc40ce3e0 msgr2=0x7f1fc40b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:11.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fc9000640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc40ce3e0 0x7f1fc40b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:11.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fc9000640 1 -- 172.21.15.99:0/4018177456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc40ba5a0 con 0x7f1fc415ed10 2024-09-10T07:36:11.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fca400640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc40ce3e0 0x7f1fc40b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:11.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fc9000640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415ed10 0x7f1fc40b9e10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c400 tx=0x7f1fb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:11.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fc1600640 1 -- 172.21.15.99:0/4018177456 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0017070 con 0x7f1fc415ed10 2024-09-10T07:36:11.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fc1600640 1 -- 172.21.15.99:0/4018177456 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb00052d0 con 0x7f1fc415ed10 2024-09-10T07:36:11.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fcae00640 1 -- 172.21.15.99:0/4018177456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc40cbd00 con 0x7f1fc415ed10 2024-09-10T07:36:11.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fc1600640 1 -- 172.21.15.99:0/4018177456 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0003830 con 0x7f1fc415ed10 2024-09-10T07:36:11.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.599+0000 7f1fcae00640 1 -- 172.21.15.99:0/4018177456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc40ce870 con 0x7f1fc415ed10 2024-09-10T07:36:11.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.600+0000 7f1fcae00640 1 -- 172.21.15.99:0/4018177456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc40d3450 con 0x7f1fc415ed10 2024-09-10T07:36:11.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.601+0000 7f1fc1600640 1 -- 172.21.15.99:0/4018177456 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fb001a070 con 0x7f1fc415ed10 2024-09-10T07:36:11.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.602+0000 7f1fc1600640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 0x7f1fa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:11.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.602+0000 7f1fc1600640 1 -- 172.21.15.99:0/4018177456 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7f1fb008a2b0 con 0x7f1fc415ed10 2024-09-10T07:36:11.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.602+0000 7f1fc9a00640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 0x7f1fa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:11.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.603+0000 7f1fc9a00640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 0x7f1fa406e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8034000 tx=0x7f1fb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:11.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.606+0000 7f1fc1600640 1 -- 172.21.15.99:0/4018177456 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fb00584a0 con 0x7f1fc415ed10 2024-09-10T07:36:11.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.790+0000 7f1fcae00640 1 -- 172.21.15.99:0/4018177456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1fc40d4870 con 0x7f1fc415ed10 2024-09-10T07:36:11.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.790+0000 7f1fc1600640 1 -- 172.21.15.99:0/4018177456 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7f1fb005c7a0 con 0x7f1fc415ed10 2024-09-10T07:36:11.790 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:36:11.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.792+0000 7f1fcae00640 1 -- 172.21.15.99:0/4018177456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 msgr2=0x7f1fa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.792+0000 7f1fcae00640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 0x7f1fa406e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8034000 tx=0x7f1fb802e000 comp rx=0 tx=0).stop 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.792+0000 7f1fcae00640 1 -- 172.21.15.99:0/4018177456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415ed10 msgr2=0x7f1fc40b9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.792+0000 7f1fcae00640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415ed10 0x7f1fc40b9e10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c400 tx=0x7f1fb000c8c0 comp rx=0 tx=0).stop 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.792+0000 7f1fcae00640 1 -- 172.21.15.99:0/4018177456 shutdown_connections 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.792+0000 7f1fcae00640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc40ce3e0 0x7f1fc40b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.792+0000 7f1fcae00640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 0x7f1fa406e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.792+0000 7f1fcae00640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415ed10 0x7f1fc40b9e10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.792+0000 7f1fcae00640 1 --2- 172.21.15.99:0/4018177456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc40d3070 0x7f1fc40b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.792+0000 7f1fcae00640 1 -- 172.21.15.99:0/4018177456 >> 172.21.15.99:0/4018177456 conn(0x7f1fc409dd60 msgr2=0x7f1fc41611a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.793+0000 7f1fcae00640 1 -- 172.21.15.99:0/4018177456 shutdown_connections 2024-09-10T07:36:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:11.793+0000 7f1fcae00640 1 -- 172.21.15.99:0/4018177456 wait complete. 2024-09-10T07:36:11.808 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:36:11.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:11.808 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:36:11.906 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:36:11.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:11.907 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:36:11.950 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:36:11.950 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:36:11.951 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:11.987 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:36:11.987 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:12.063 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:36:12.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.218+0000 7fb939000640 1 Processor -- start 2024-09-10T07:36:12.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.219+0000 7fb939000640 1 -- start start 2024-09-10T07:36:12.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.220+0000 7fb939000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb93415db60 0x7fb934071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:12.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.220+0000 7fb939000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb934153e50 con 0x7fb9340724d0 2024-09-10T07:36:12.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.220+0000 7fb939000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb934072ac0 con 0x7fb93406e750 2024-09-10T07:36:12.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.220+0000 7fb939000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb93415df40 con 0x7fb93415db60 2024-09-10T07:36:12.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.220+0000 7fb931e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb93415db60 0x7fb934071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:12.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.220+0000 7fb931e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb93415db60 0x7fb934071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48330/0 (socket says 172.21.15.99:48330) 2024-09-10T07:36:12.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.220+0000 7fb931e00640 1 -- 172.21.15.99:0/2138647796 learned_addr learned my addr 172.21.15.99:0/2138647796 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:12.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.220+0000 7fb931e00640 1 -- 172.21.15.99:0/2138647796 >> v1:172.21.15.187:6789/0 conn(0x7fb93406e750 legacy=0x7fb9340ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:12.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.220+0000 7fb931e00640 1 -- 172.21.15.99:0/2138647796 >> v1:172.21.15.99:6789/0 conn(0x7fb9340724d0 legacy=0x7fb93406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.220+0000 7fb931e00640 1 -- 172.21.15.99:0/2138647796 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb934072da0 con 0x7fb93415db60 2024-09-10T07:36:12.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.221+0000 7fb931e00640 1 --2- 172.21.15.99:0/2138647796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93415db60 0x7fb934071f90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb924009870 tx=0x7fb92402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d5fc5637fbf321 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:12.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.222+0000 7fb931400640 1 -- 172.21.15.99:0/2138647796 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924037070 con 0x7fb93415db60 2024-09-10T07:36:12.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.222+0000 7fb931400640 1 -- 172.21.15.99:0/2138647796 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb924032440 con 0x7fb93415db60 2024-09-10T07:36:12.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.222+0000 7fb931400640 1 -- 172.21.15.99:0/2138647796 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924032810 con 0x7fb93415db60 2024-09-10T07:36:12.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.222+0000 7fb939000640 1 -- 172.21.15.99:0/2138647796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93415db60 msgr2=0x7fb934071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.222+0000 7fb939000640 1 --2- 172.21.15.99:0/2138647796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93415db60 0x7fb934071f90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb924009870 tx=0x7fb92402a2a0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.222+0000 7fb939000640 1 -- 172.21.15.99:0/2138647796 shutdown_connections 2024-09-10T07:36:12.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.222+0000 7fb939000640 1 --2- 172.21.15.99:0/2138647796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93415db60 0x7fb934071f90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.222+0000 7fb939000640 1 -- 172.21.15.99:0/2138647796 >> 172.21.15.99:0/2138647796 conn(0x7fb9340b2630 msgr2=0x7fb9340b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:12.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.222+0000 7fb939000640 1 -- 172.21.15.99:0/2138647796 shutdown_connections 2024-09-10T07:36:12.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.222+0000 7fb939000640 1 -- 172.21.15.99:0/2138647796 wait complete. 2024-09-10T07:36:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.224+0000 7fb939000640 1 Processor -- start 2024-09-10T07:36:12.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.224+0000 7fb939000640 1 -- start start 2024-09-10T07:36:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb939000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93406e750 0x7fb934148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb939000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9340724d0 0x7fb93415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb939000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb93415db60 0x7fb93415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb939000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb934073640 con 0x7fb93406e750 2024-09-10T07:36:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb939000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb934073360 con 0x7fb9340724d0 2024-09-10T07:36:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb939000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb93415d1c0 con 0x7fb93415db60 2024-09-10T07:36:12.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb931e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93406e750 0x7fb934148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb931e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93406e750 0x7fb934148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48344/0 (socket says 172.21.15.99:48344) 2024-09-10T07:36:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb931e00640 1 -- 172.21.15.99:0/969512221 learned_addr learned my addr 172.21.15.99:0/969512221 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb932800640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb93415db60 0x7fb93415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:12.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.225+0000 7fb929400640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9340724d0 0x7fb93415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb931e00640 1 -- 172.21.15.99:0/969512221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb93415db60 msgr2=0x7fb93415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb931e00640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb93415db60 0x7fb93415bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb931e00640 1 -- 172.21.15.99:0/969512221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9340724d0 msgr2=0x7fb93415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb931e00640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9340724d0 0x7fb93415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb931e00640 1 -- 172.21.15.99:0/969512221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb934149950 con 0x7fb93406e750 2024-09-10T07:36:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb931e00640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93406e750 0x7fb934148f30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb924009870 tx=0x7fb9240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb92aa00640 1 -- 172.21.15.99:0/969512221 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924041070 con 0x7fb93406e750 2024-09-10T07:36:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb92aa00640 1 -- 172.21.15.99:0/969512221 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92403c870 con 0x7fb93406e750 2024-09-10T07:36:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb939000640 1 -- 172.21.15.99:0/969512221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9340b3c80 con 0x7fb93406e750 2024-09-10T07:36:12.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb92aa00640 1 -- 172.21.15.99:0/969512221 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924037040 con 0x7fb93406e750 2024-09-10T07:36:12.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.226+0000 7fb939000640 1 -- 172.21.15.99:0/969512221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9340b4240 con 0x7fb93406e750 2024-09-10T07:36:12.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.228+0000 7fb939000640 1 -- 172.21.15.99:0/969512221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb934071f90 con 0x7fb93406e750 2024-09-10T07:36:12.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.228+0000 7fb92aa00640 1 -- 172.21.15.99:0/969512221 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb924044070 con 0x7fb93406e750 2024-09-10T07:36:12.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.229+0000 7fb92aa00640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb91006be30 0x7fb91006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:12.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.229+0000 7fb92aa00640 1 -- 172.21.15.99:0/969512221 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7fb9240ab9b0 con 0x7fb93406e750 2024-09-10T07:36:12.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.230+0000 7fb929400640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb91006be30 0x7fb91006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:12.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.230+0000 7fb929400640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb91006be30 0x7fb91006e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9341507e0 tx=0x7fb91c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:12.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.234+0000 7fb92aa00640 1 -- 172.21.15.99:0/969512221 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb934149950 con 0x7fb93406e750 2024-09-10T07:36:12.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.418+0000 7fb939000640 1 -- 172.21.15.99:0/969512221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb934160950 con 0x7fb93406e750 2024-09-10T07:36:12.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.419+0000 7fb92aa00640 1 -- 172.21.15.99:0/969512221 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7fb92407a3b0 con 0x7fb93406e750 2024-09-10T07:36:12.419 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:36:12.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 -- 172.21.15.99:0/969512221 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb91006be30 msgr2=0x7fb91006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb91006be30 0x7fb91006e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9341507e0 tx=0x7fb91c009040 comp rx=0 tx=0).stop 2024-09-10T07:36:12.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 -- 172.21.15.99:0/969512221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93406e750 msgr2=0x7fb934148f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93406e750 0x7fb934148f30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb924009870 tx=0x7fb9240046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 -- 172.21.15.99:0/969512221 shutdown_connections 2024-09-10T07:36:12.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb93415db60 0x7fb93415bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9340724d0 0x7fb93415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb91006be30 0x7fb91006e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 --2- 172.21.15.99:0/969512221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93406e750 0x7fb934148f30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 -- 172.21.15.99:0/969512221 >> 172.21.15.99:0/969512221 conn(0x7fb9340b2630 msgr2=0x7fb9340cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:12.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 -- 172.21.15.99:0/969512221 shutdown_connections 2024-09-10T07:36:12.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.421+0000 7fb939000640 1 -- 172.21.15.99:0/969512221 wait complete. 2024-09-10T07:36:12.436 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:36:12.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:12.437 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T07:36:12.499 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:36:12.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:12.499 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:36:12.535 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:36:12.536 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:36:12.536 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:12.571 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:36:12.571 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:36:12.572 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:36:12.572 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:12.611 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:36:12.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:36:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.764+0000 7fd76f000640 1 Processor -- start 2024-09-10T07:36:12.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.764+0000 7fd76f000640 1 -- start start 2024-09-10T07:36:12.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.766+0000 7fd76f000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd7680ce780 0x7fd76806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:12.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.766+0000 7fd76f000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76806e3d0 con 0x7fd768072f40 2024-09-10T07:36:12.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.766+0000 7fd76f000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76806e6b0 con 0x7fd768145290 2024-09-10T07:36:12.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.766+0000 7fd76f000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd76806efe0 con 0x7fd7680ce780 2024-09-10T07:36:12.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.766+0000 7fd75f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd768072f40 0x7fd7680b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43318/0 (socket says 172.21.15.99:43318) 2024-09-10T07:36:12.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.766+0000 7fd75f400640 1 -- 172.21.15.99:0/3053152254 learned_addr learned my addr 172.21.15.99:0/3053152254 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:12.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.766+0000 7fd76d000640 1 --2- 172.21.15.99:0/3053152254 >> v2:172.21.15.187:3300/0 conn(0x7fd7680ce780 0x7fd76806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.766+0000 7fd767400640 1 -- 172.21.15.99:0/3053152254 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3933142236 0 0) 0x7fd76806e3d0 con 0x7fd768072f40 2024-09-10T07:36:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.766+0000 7fd767400640 1 -- 172.21.15.99:0/3053152254 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd74c003520 con 0x7fd768072f40 2024-09-10T07:36:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.767+0000 7fd76d000640 1 -- 172.21.15.99:0/3053152254 >> v1:172.21.15.187:6789/0 conn(0x7fd768145290 legacy=0x7fd768072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.767+0000 7fd767400640 1 -- 172.21.15.99:0/3053152254 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345511753 0 0) 0x7fd76806e6b0 con 0x7fd768145290 2024-09-10T07:36:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.767+0000 7fd76d000640 1 -- 172.21.15.99:0/3053152254 >> v1:172.21.15.99:6789/0 conn(0x7fd768072f40 legacy=0x7fd7680b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.767+0000 7fd76d000640 1 -- 172.21.15.99:0/3053152254 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76806e990 con 0x7fd7680ce780 2024-09-10T07:36:12.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.768+0000 7fd76d000640 1 --2- 172.21.15.99:0/3053152254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7680ce780 0x7fd76806f470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd760009d90 tx=0x7fd76002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b31fbf6f064a522 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:12.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.768+0000 7fd767400640 1 -- 172.21.15.99:0/3053152254 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760007740 con 0x7fd7680ce780 2024-09-10T07:36:12.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.768+0000 7fd767400640 1 -- 172.21.15.99:0/3053152254 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7600078e0 con 0x7fd7680ce780 2024-09-10T07:36:12.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.768+0000 7fd767400640 1 -- 172.21.15.99:0/3053152254 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760007cb0 con 0x7fd7680ce780 2024-09-10T07:36:12.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.768+0000 7fd76f000640 1 -- 172.21.15.99:0/3053152254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7680ce780 msgr2=0x7fd76806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.768+0000 7fd76f000640 1 --2- 172.21.15.99:0/3053152254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7680ce780 0x7fd76806f470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd760009d90 tx=0x7fd76002a6f0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.768+0000 7fd76f000640 1 -- 172.21.15.99:0/3053152254 shutdown_connections 2024-09-10T07:36:12.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.768+0000 7fd76f000640 1 --2- 172.21.15.99:0/3053152254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7680ce780 0x7fd76806f470 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.768+0000 7fd76f000640 1 -- 172.21.15.99:0/3053152254 >> 172.21.15.99:0/3053152254 conn(0x7fd76806bc10 msgr2=0x7fd76806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:12.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.768+0000 7fd76f000640 1 -- 172.21.15.99:0/3053152254 shutdown_connections 2024-09-10T07:36:12.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.769+0000 7fd76f000640 1 -- 172.21.15.99:0/3053152254 wait complete. 2024-09-10T07:36:12.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.770+0000 7fd76f000640 1 Processor -- start 2024-09-10T07:36:12.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.770+0000 7fd76f000640 1 -- start start 2024-09-10T07:36:12.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.771+0000 7fd76f000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd768072f40 0x7fd76813d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:12.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.771+0000 7fd76f000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7680ce780 0x7fd7681f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:12.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.771+0000 7fd76f000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd768145290 0x7fd7681f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:12.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.771+0000 7fd76f000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd76806df80 con 0x7fd768145290 2024-09-10T07:36:12.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.771+0000 7fd76f000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd768145670 con 0x7fd768072f40 2024-09-10T07:36:12.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.771+0000 7fd76f000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd76806e100 con 0x7fd7680ce780 2024-09-10T07:36:12.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.771+0000 7fd76d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd768145290 0x7fd7681f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:12.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.771+0000 7fd76d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd768145290 0x7fd7681f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48358/0 (socket says 172.21.15.99:48358) 2024-09-10T07:36:12.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.771+0000 7fd76d000640 1 -- 172.21.15.99:0/654820757 learned_addr learned my addr 172.21.15.99:0/654820757 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd76d000640 1 -- 172.21.15.99:0/654820757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7680ce780 msgr2=0x7fd7681f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd76d000640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7680ce780 0x7fd7681f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd76d000640 1 -- 172.21.15.99:0/654820757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd768072f40 msgr2=0x7fd76813d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd767e00640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd768072f40 0x7fd76813d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd76d000640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd768072f40 0x7fd76813d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd76d000640 1 -- 172.21.15.99:0/654820757 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd768141760 con 0x7fd768145290 2024-09-10T07:36:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd767e00640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd768072f40 0x7fd76813d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd76d000640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd768145290 0x7fd7681f46e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd760009d90 tx=0x7fd760004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd764c00640 1 -- 172.21.15.99:0/654820757 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760040070 con 0x7fd768145290 2024-09-10T07:36:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd764c00640 1 -- 172.21.15.99:0/654820757 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd760031b40 con 0x7fd768145290 2024-09-10T07:36:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd76f000640 1 -- 172.21.15.99:0/654820757 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76813c090 con 0x7fd768145290 2024-09-10T07:36:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd764c00640 1 -- 172.21.15.99:0/654820757 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76003c420 con 0x7fd768145290 2024-09-10T07:36:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.772+0000 7fd76f000640 1 -- 172.21.15.99:0/654820757 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76813c650 con 0x7fd768145290 2024-09-10T07:36:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.773+0000 7fd76f000640 1 -- 172.21.15.99:0/654820757 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7680715a0 con 0x7fd768145290 2024-09-10T07:36:12.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.774+0000 7fd764c00640 1 -- 172.21.15.99:0/654820757 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd760039040 con 0x7fd768145290 2024-09-10T07:36:12.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.775+0000 7fd764c00640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd74406be30 0x7fd74406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:12.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.775+0000 7fd764c00640 1 -- 172.21.15.99:0/654820757 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7fd7600ac410 con 0x7fd768145290 2024-09-10T07:36:12.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.775+0000 7fd767e00640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd74406be30 0x7fd74406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:12.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.776+0000 7fd767e00640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd74406be30 0x7fd74406e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd758000f60 tx=0x7fd758009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:12.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.780+0000 7fd764c00640 1 -- 172.21.15.99:0/654820757 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd768141760 con 0x7fd768145290 2024-09-10T07:36:12.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.992+0000 7fd76f000640 1 -- 172.21.15.99:0/654820757 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7680cfe30 con 0x7fd768145290 2024-09-10T07:36:12.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.992+0000 7fd764c00640 1 -- 172.21.15.99:0/654820757 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5226 (secure 0 0 0) 0x7fd76007ace0 con 0x7fd768145290 2024-09-10T07:36:12.992 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:12.993 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"btime":"2024-09-10T07:35:39:936250+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2667247037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2667247037},{"type":"v1","addr":"172.21.15.99:6836","nonce":2667247037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/588885740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":588885740},{"type":"v1","addr":"172.21.15.187:6834","nonce":588885740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2599063325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2599063325},{"type":"v1","addr":"172.21.15.187:6835","nonce":2599063325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:36.307304+0000","modified":"2024-09-10T07:35:39.339225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1015333121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1015333121},{"type":"v1","addr":"172.21.15.99:6837","nonce":1015333121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":3}]} 2024-09-10T07:36:12.993 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 25 2024-09-10T07:36:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 -- 172.21.15.99:0/654820757 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd74406be30 msgr2=0x7fd74406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd74406be30 0x7fd74406e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd758000f60 tx=0x7fd758009040 comp rx=0 tx=0).stop 2024-09-10T07:36:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 -- 172.21.15.99:0/654820757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd768145290 msgr2=0x7fd7681f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd768145290 0x7fd7681f46e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd760009d90 tx=0x7fd760004a40 comp rx=0 tx=0).stop 2024-09-10T07:36:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 -- 172.21.15.99:0/654820757 shutdown_connections 2024-09-10T07:36:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd74406be30 0x7fd74406e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd768145290 0x7fd7681f46e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7680ce780 0x7fd7681f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 --2- 172.21.15.99:0/654820757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd768072f40 0x7fd76813d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:12.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 -- 172.21.15.99:0/654820757 >> 172.21.15.99:0/654820757 conn(0x7fd76806bc10 msgr2=0x7fd76815c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:12.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 -- 172.21.15.99:0/654820757 shutdown_connections 2024-09-10T07:36:12.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:12.995+0000 7fd76f000640 1 -- 172.21.15.99:0/654820757 wait complete. 2024-09-10T07:36:13.011 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:36:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.166+0000 7f88c1600640 1 Processor -- start 2024-09-10T07:36:13.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.166+0000 7f88c1600640 1 -- start start 2024-09-10T07:36:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88c1600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f88bc145290 0x7f88bc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88c1600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88bc0ce780 0x7f88bc072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88c1600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88bc06e3d0 con 0x7f88bc071510 2024-09-10T07:36:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88c1600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f88bc06efe0 con 0x7f88bc145290 2024-09-10T07:36:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88c1600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f88bc06e6b0 con 0x7f88bc0ce780 2024-09-10T07:36:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88baa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f88bc145290 0x7f88bc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88bb400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f88bc071510 0x7f88bc0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43334/0 (socket says 172.21.15.99:43334) 2024-09-10T07:36:13.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88bb400640 1 -- 172.21.15.99:0/140599427 learned_addr learned my addr 172.21.15.99:0/140599427 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:13.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88b2000640 1 --2- 172.21.15.99:0/140599427 >> v2:172.21.15.187:3300/0 conn(0x7f88bc0ce780 0x7f88bc072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88baa00640 1 -- 172.21.15.99:0/140599427 >> v2:172.21.15.187:3300/0 conn(0x7f88bc0ce780 msgr2=0x7f88bc072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:13.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88baa00640 1 --2- 172.21.15.99:0/140599427 >> v2:172.21.15.187:3300/0 conn(0x7f88bc0ce780 0x7f88bc072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88baa00640 1 -- 172.21.15.99:0/140599427 >> v1:172.21.15.99:6789/0 conn(0x7f88bc071510 legacy=0x7f88bc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88baa00640 1 -- 172.21.15.99:0/140599427 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88bc06e990 con 0x7f88bc145290 2024-09-10T07:36:13.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.168+0000 7f88ba000640 1 -- 172.21.15.99:0/140599427 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2602298665 0 0) 0x7f88bc06e3d0 con 0x7f88bc071510 2024-09-10T07:36:13.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.169+0000 7f88baa00640 1 --2- 172.21.15.99:0/140599427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc145290 0x7f88bc06f470 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f88bc06d450 tx=0x7f88ac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3dc144cfc1a085 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:13.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88ba000640 1 -- 172.21.15.99:0/140599427 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac037070 con 0x7f88bc145290 2024-09-10T07:36:13.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88ba000640 1 -- 172.21.15.99:0/140599427 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ac032440 con 0x7f88bc145290 2024-09-10T07:36:13.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88ba000640 1 -- 172.21.15.99:0/140599427 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac032810 con 0x7f88bc145290 2024-09-10T07:36:13.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88c1600640 1 -- 172.21.15.99:0/140599427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc145290 msgr2=0x7f88bc06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88c1600640 1 --2- 172.21.15.99:0/140599427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc145290 0x7f88bc06f470 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f88bc06d450 tx=0x7f88ac02a1a0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88c1600640 1 -- 172.21.15.99:0/140599427 shutdown_connections 2024-09-10T07:36:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88c1600640 1 --2- 172.21.15.99:0/140599427 >> v2:172.21.15.187:3300/0 conn(0x7f88bc0ce780 0x7f88bc072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88c1600640 1 --2- 172.21.15.99:0/140599427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc145290 0x7f88bc06f470 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88c1600640 1 -- 172.21.15.99:0/140599427 >> 172.21.15.99:0/140599427 conn(0x7f88bc06bc10 msgr2=0x7f88bc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88c1600640 1 -- 172.21.15.99:0/140599427 shutdown_connections 2024-09-10T07:36:13.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.170+0000 7f88c1600640 1 -- 172.21.15.99:0/140599427 wait complete. 2024-09-10T07:36:13.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.172+0000 7f88c1600640 1 Processor -- start 2024-09-10T07:36:13.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.172+0000 7f88c1600640 1 -- start start 2024-09-10T07:36:13.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88c1600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc071510 0x7f88bc15c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88c1600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88bc0ce780 0x7f88bc15a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88c1600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc145290 0x7f88bc1f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88c1600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc06df80 con 0x7f88bc071510 2024-09-10T07:36:13.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88c1600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc145670 con 0x7f88bc145290 2024-09-10T07:36:13.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88c1600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f88bc06e100 con 0x7f88bc0ce780 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88baa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc071510 0x7f88bc15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88baa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc071510 0x7f88bc15c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48380/0 (socket says 172.21.15.99:48380) 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88baa00640 1 -- 172.21.15.99:0/3780210195 learned_addr learned my addr 172.21.15.99:0/3780210195 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88bb400640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc145290 0x7f88bc1f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.173+0000 7f88b2000640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88bc0ce780 0x7f88bc15a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.174+0000 7f88baa00640 1 -- 172.21.15.99:0/3780210195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88bc0ce780 msgr2=0x7f88bc15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.174+0000 7f88baa00640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88bc0ce780 0x7f88bc15a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.174+0000 7f88baa00640 1 -- 172.21.15.99:0/3780210195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc145290 msgr2=0x7f88bc1f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.174+0000 7f88baa00640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc145290 0x7f88bc1f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.174+0000 7f88baa00640 1 -- 172.21.15.99:0/3780210195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88bc13d8f0 con 0x7f88bc071510 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.174+0000 7f88baa00640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc071510 0x7f88bc15c880 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f88ac000c00 tx=0x7f88ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.174+0000 7f88b3400640 1 -- 172.21.15.99:0/3780210195 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac037050 con 0x7f88bc071510 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.174+0000 7f88b3400640 1 -- 172.21.15.99:0/3780210195 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ac038040 con 0x7f88bc071510 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.174+0000 7f88b3400640 1 -- 172.21.15.99:0/3780210195 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac004450 con 0x7f88bc071510 2024-09-10T07:36:13.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.174+0000 7f88c1600640 1 -- 172.21.15.99:0/3780210195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88bc13dbb0 con 0x7f88bc071510 2024-09-10T07:36:13.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.175+0000 7f88c1600640 1 -- 172.21.15.99:0/3780210195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88bc13e170 con 0x7f88bc071510 2024-09-10T07:36:13.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.176+0000 7f88c1600640 1 -- 172.21.15.99:0/3780210195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88bc06f470 con 0x7f88bc071510 2024-09-10T07:36:13.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.176+0000 7f88b3400640 1 -- 172.21.15.99:0/3780210195 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88ac03c6d0 con 0x7f88bc071510 2024-09-10T07:36:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.177+0000 7f88b3400640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f889806be30 0x7f889806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.177+0000 7f88b3400640 1 -- 172.21.15.99:0/3780210195 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7f88ac0ab7a0 con 0x7f88bc071510 2024-09-10T07:36:13.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.178+0000 7f88b2000640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f889806be30 0x7f889806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.178+0000 7f88b2000640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f889806be30 0x7f889806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f88bc1379f0 tx=0x7f88a4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:13.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.181+0000 7f88b3400640 1 -- 172.21.15.99:0/3780210195 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88ac079ab0 con 0x7f88bc071510 2024-09-10T07:36:13.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.386+0000 7f88c1600640 1 -- 172.21.15.99:0/3780210195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88bc1434b0 con 0x7f88bc071510 2024-09-10T07:36:13.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.387+0000 7f88b3400640 1 -- 172.21.15.99:0/3780210195 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5226 (secure 0 0 0) 0x7f88ac07ddb0 con 0x7f88bc071510 2024-09-10T07:36:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:13.387 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"btime":"2024-09-10T07:35:39:936250+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2667247037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2667247037},{"type":"v1","addr":"172.21.15.99:6836","nonce":2667247037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/588885740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":588885740},{"type":"v1","addr":"172.21.15.187:6834","nonce":588885740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2599063325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2599063325},{"type":"v1","addr":"172.21.15.187:6835","nonce":2599063325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:36.307304+0000","modified":"2024-09-10T07:35:39.339225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1015333121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1015333121},{"type":"v1","addr":"172.21.15.99:6837","nonce":1015333121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":3}]} 2024-09-10T07:36:13.387 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 25 2024-09-10T07:36:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 -- 172.21.15.99:0/3780210195 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f889806be30 msgr2=0x7f889806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f889806be30 0x7f889806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f88bc1379f0 tx=0x7f88a4009190 comp rx=0 tx=0).stop 2024-09-10T07:36:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 -- 172.21.15.99:0/3780210195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc071510 msgr2=0x7f88bc15c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc071510 0x7f88bc15c880 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f88ac000c00 tx=0x7f88ac0046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 -- 172.21.15.99:0/3780210195 shutdown_connections 2024-09-10T07:36:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc145290 0x7f88bc1f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88bc0ce780 0x7f88bc15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f889806be30 0x7f889806e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 --2- 172.21.15.99:0/3780210195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88bc071510 0x7f88bc15c880 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 -- 172.21.15.99:0/3780210195 >> 172.21.15.99:0/3780210195 conn(0x7f88bc06bc10 msgr2=0x7f88bc072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 -- 172.21.15.99:0/3780210195 shutdown_connections 2024-09-10T07:36:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.389+0000 7f88c1600640 1 -- 172.21.15.99:0/3780210195 wait complete. 2024-09-10T07:36:13.405 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:36:13.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.558+0000 7f4660a00640 1 Processor -- start 2024-09-10T07:36:13.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.558+0000 7f4660a00640 1 -- start start 2024-09-10T07:36:13.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4660a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f465c145290 0x7f465c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4660a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c06e3d0 con 0x7f465c0ce780 2024-09-10T07:36:13.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4660a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c06e6b0 con 0x7f465c072f40 2024-09-10T07:36:13.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4660a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f465c06efe0 con 0x7f465c145290 2024-09-10T07:36:13.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4651400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f465c0ce780 0x7f465c072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43338/0 (socket says 172.21.15.99:43338) 2024-09-10T07:36:13.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4651400640 1 -- 172.21.15.99:0/1347558881 learned_addr learned my addr 172.21.15.99:0/1347558881 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:13.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4659e00640 1 --2- 172.21.15.99:0/1347558881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f465c145290 0x7f465c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4659400640 1 -- 172.21.15.99:0/1347558881 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228251826 0 0) 0x7f465c06e3d0 con 0x7f465c0ce780 2024-09-10T07:36:13.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4659400640 1 -- 172.21.15.99:0/1347558881 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4640005730 con 0x7f465c0ce780 2024-09-10T07:36:13.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4659400640 1 -- 172.21.15.99:0/1347558881 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496006185 0 0) 0x7f465c06e6b0 con 0x7f465c072f40 2024-09-10T07:36:13.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.560+0000 7f4659e00640 1 -- 172.21.15.99:0/1347558881 >> v1:172.21.15.187:6789/0 conn(0x7f465c072f40 legacy=0x7f465c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.561+0000 7f4659e00640 1 -- 172.21.15.99:0/1347558881 >> v1:172.21.15.99:6789/0 conn(0x7f465c0ce780 legacy=0x7f465c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.561+0000 7f4659e00640 1 -- 172.21.15.99:0/1347558881 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c06e990 con 0x7f465c145290 2024-09-10T07:36:13.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.562+0000 7f4659e00640 1 --2- 172.21.15.99:0/1347558881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f465c145290 0x7f465c06f470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f464c0097d0 tx=0x7f464c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7f56c64c36bce15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:13.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.562+0000 7f4659400640 1 -- 172.21.15.99:0/1347558881 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c037070 con 0x7f465c145290 2024-09-10T07:36:13.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.562+0000 7f4659400640 1 -- 172.21.15.99:0/1347558881 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f464c032440 con 0x7f465c145290 2024-09-10T07:36:13.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.562+0000 7f4659400640 1 -- 172.21.15.99:0/1347558881 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c032810 con 0x7f465c145290 2024-09-10T07:36:13.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.562+0000 7f4660a00640 1 -- 172.21.15.99:0/1347558881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f465c145290 msgr2=0x7f465c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.562+0000 7f4660a00640 1 --2- 172.21.15.99:0/1347558881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f465c145290 0x7f465c06f470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f464c0097d0 tx=0x7f464c02a210 comp rx=0 tx=0).stop 2024-09-10T07:36:13.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.562+0000 7f4660a00640 1 -- 172.21.15.99:0/1347558881 shutdown_connections 2024-09-10T07:36:13.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.562+0000 7f4660a00640 1 --2- 172.21.15.99:0/1347558881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f465c145290 0x7f465c06f470 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.562+0000 7f4660a00640 1 -- 172.21.15.99:0/1347558881 >> 172.21.15.99:0/1347558881 conn(0x7f465c06bc10 msgr2=0x7f465c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:13.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.563+0000 7f4660a00640 1 -- 172.21.15.99:0/1347558881 shutdown_connections 2024-09-10T07:36:13.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.563+0000 7f4660a00640 1 -- 172.21.15.99:0/1347558881 wait complete. 2024-09-10T07:36:13.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.564+0000 7f4660a00640 1 Processor -- start 2024-09-10T07:36:13.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.564+0000 7f4660a00640 1 -- start start 2024-09-10T07:36:13.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.565+0000 7f4660a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f465c072f40 0x7f465c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.565+0000 7f4660a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f465c0ce780 0x7f465c13c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.565+0000 7f4660a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f465c145290 0x7f465c13cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.565+0000 7f4660a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f465c06df80 con 0x7f465c072f40 2024-09-10T07:36:13.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.565+0000 7f4660a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f465c145670 con 0x7f465c0ce780 2024-09-10T07:36:13.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.565+0000 7f4660a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f465c06e100 con 0x7f465c145290 2024-09-10T07:36:13.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.565+0000 7f4659e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f465c072f40 0x7f465c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.565+0000 7f4659e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f465c072f40 0x7f465c15b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48396/0 (socket says 172.21.15.99:48396) 2024-09-10T07:36:13.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4659e00640 1 -- 172.21.15.99:0/4029342753 learned_addr learned my addr 172.21.15.99:0/4029342753 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:13.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4659e00640 1 -- 172.21.15.99:0/4029342753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f465c145290 msgr2=0x7f465c13cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4659e00640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f465c145290 0x7f465c13cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4659e00640 1 -- 172.21.15.99:0/4029342753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f465c0ce780 msgr2=0x7f465c13c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4659e00640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f465c0ce780 0x7f465c13c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4659e00640 1 -- 172.21.15.99:0/4029342753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c15bab0 con 0x7f465c072f40 2024-09-10T07:36:13.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4659e00640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f465c072f40 0x7f465c15b570 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f464c0097d0 tx=0x7f464c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:13.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4652a00640 1 -- 172.21.15.99:0/4029342753 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c041070 con 0x7f465c072f40 2024-09-10T07:36:13.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4652a00640 1 -- 172.21.15.99:0/4029342753 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f464c004240 con 0x7f465c072f40 2024-09-10T07:36:13.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4660a00640 1 -- 172.21.15.99:0/4029342753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c1f6090 con 0x7f465c072f40 2024-09-10T07:36:13.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.566+0000 7f4652a00640 1 -- 172.21.15.99:0/4029342753 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c037040 con 0x7f465c072f40 2024-09-10T07:36:13.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.567+0000 7f4660a00640 1 -- 172.21.15.99:0/4029342753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c1f6650 con 0x7f465c072f40 2024-09-10T07:36:13.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.568+0000 7f4660a00640 1 -- 172.21.15.99:0/4029342753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c0715a0 con 0x7f465c072f40 2024-09-10T07:36:13.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.569+0000 7f4652a00640 1 -- 172.21.15.99:0/4029342753 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f464c03a070 con 0x7f465c072f40 2024-09-10T07:36:13.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.569+0000 7f4652a00640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f463806be30 0x7f463806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.569+0000 7f4652a00640 1 -- 172.21.15.99:0/4029342753 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7f464c0ab510 con 0x7f465c072f40 2024-09-10T07:36:13.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.570+0000 7f4651400640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f463806be30 0x7f463806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.570+0000 7f4651400640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f463806be30 0x7f463806e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4644000f60 tx=0x7f46440078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:13.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.574+0000 7f4652a00640 1 -- 172.21.15.99:0/4029342753 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f464c079e60 con 0x7f465c072f40 2024-09-10T07:36:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.749+0000 7f4660a00640 1 -- 172.21.15.99:0/4029342753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f465c0b0920 con 0x7f465c072f40 2024-09-10T07:36:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.751+0000 7f4652a00640 1 -- 172.21.15.99:0/4029342753 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16801 (secure 0 0 0) 0x7f464c079760 con 0x7f465c072f40 2024-09-10T07:36:13.751 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:13.751 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":54,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:36:07.849458+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:34.068514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:35.306080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:36:13.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 -- 172.21.15.99:0/4029342753 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f463806be30 msgr2=0x7f463806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f463806be30 0x7f463806e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4644000f60 tx=0x7f46440078f0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 -- 172.21.15.99:0/4029342753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f465c072f40 msgr2=0x7f465c15b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f465c072f40 0x7f465c15b570 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f464c0097d0 tx=0x7f464c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 -- 172.21.15.99:0/4029342753 shutdown_connections 2024-09-10T07:36:13.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f465c145290 0x7f465c13cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f465c0ce780 0x7f465c13c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f463806be30 0x7f463806e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 --2- 172.21.15.99:0/4029342753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f465c072f40 0x7f465c15b570 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 -- 172.21.15.99:0/4029342753 >> 172.21.15.99:0/4029342753 conn(0x7f465c06bc10 msgr2=0x7f465c143cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:13.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 -- 172.21.15.99:0/4029342753 shutdown_connections 2024-09-10T07:36:13.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.753+0000 7f4660a00640 1 -- 172.21.15.99:0/4029342753 wait complete. 2024-09-10T07:36:13.769 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:36:13.769 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:36:13.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.924+0000 7f8eef800640 1 Processor -- start 2024-09-10T07:36:13.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.924+0000 7f8eef800640 1 -- start start 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.925+0000 7f8eef800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ee815ede0 0x7f8ee80afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.925+0000 7f8eef800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8ee80cf830 0x7f8ee80b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.925+0000 7f8eef800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ee80b0200 con 0x7f8ee80cfca0 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.925+0000 7f8eef800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8ee80aec20 con 0x7f8ee815ede0 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.925+0000 7f8eef800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8ee80aef00 con 0x7f8ee80cf830 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.926+0000 7f8eece00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ee815ede0 0x7f8ee80afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.926+0000 7f8eece00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ee815ede0 0x7f8ee80afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48406/0 (socket says 172.21.15.99:48406) 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.926+0000 7f8eece00640 1 -- 172.21.15.99:0/499018106 learned_addr learned my addr 172.21.15.99:0/499018106 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.926+0000 7f8ee7e00640 1 --2- 172.21.15.99:0/499018106 >> v2:172.21.15.187:3300/0 conn(0x7f8ee80cf830 0x7f8ee80b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.926+0000 7f8eece00640 1 -- 172.21.15.99:0/499018106 >> v2:172.21.15.187:3300/0 conn(0x7f8ee80cf830 msgr2=0x7f8ee80b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:13.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.926+0000 7f8eece00640 1 --2- 172.21.15.99:0/499018106 >> v2:172.21.15.187:3300/0 conn(0x7f8ee80cf830 0x7f8ee80b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.926+0000 7f8eece00640 1 -- 172.21.15.99:0/499018106 >> v1:172.21.15.187:6789/0 conn(0x7f8ee80cfca0 legacy=0x7f8ee8071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:13.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.926+0000 7f8eece00640 1 -- 172.21.15.99:0/499018106 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee80af1e0 con 0x7f8ee815ede0 2024-09-10T07:36:13.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.927+0000 7f8eece00640 1 --2- 172.21.15.99:0/499018106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee815ede0 0x7f8ee80afcc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80b5a30 tx=0x7f8ed802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845c2defee29290a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:13.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.927+0000 7f8ee7400640 1 -- 172.21.15.99:0/499018106 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8036070 con 0x7f8ee815ede0 2024-09-10T07:36:13.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.927+0000 7f8ee7400640 1 -- 172.21.15.99:0/499018106 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed8031600 con 0x7f8ee815ede0 2024-09-10T07:36:13.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.927+0000 7f8ee7400640 1 -- 172.21.15.99:0/499018106 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80319d0 con 0x7f8ee815ede0 2024-09-10T07:36:13.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.928+0000 7f8eef800640 1 -- 172.21.15.99:0/499018106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee815ede0 msgr2=0x7f8ee80afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.928+0000 7f8eef800640 1 --2- 172.21.15.99:0/499018106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee815ede0 0x7f8ee80afcc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80b5a30 tx=0x7f8ed802a6f0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.928+0000 7f8eef800640 1 -- 172.21.15.99:0/499018106 shutdown_connections 2024-09-10T07:36:13.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.928+0000 7f8eef800640 1 --2- 172.21.15.99:0/499018106 >> v2:172.21.15.187:3300/0 conn(0x7f8ee80cf830 0x7f8ee80b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.928+0000 7f8eef800640 1 --2- 172.21.15.99:0/499018106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee815ede0 0x7f8ee80afcc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.928+0000 7f8eef800640 1 -- 172.21.15.99:0/499018106 >> 172.21.15.99:0/499018106 conn(0x7f8ee806bc10 msgr2=0x7f8ee806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.928+0000 7f8eef800640 1 -- 172.21.15.99:0/499018106 shutdown_connections 2024-09-10T07:36:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.928+0000 7f8eef800640 1 -- 172.21.15.99:0/499018106 wait complete. 2024-09-10T07:36:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.929+0000 7f8eef800640 1 Processor -- start 2024-09-10T07:36:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.930+0000 7f8eef800640 1 -- start start 2024-09-10T07:36:13.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.930+0000 7f8eef800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee80cf830 0x7f8ee815cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.930+0000 7f8eef800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ee80cfca0 0x7f8ee81520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.930+0000 7f8eef800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ee815ede0 0x7f8ee8154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.930+0000 7f8eef800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee80ae840 con 0x7f8ee80cf830 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.930+0000 7f8eef800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee80af7a0 con 0x7f8ee815ede0 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.930+0000 7f8eef800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee80ae9c0 con 0x7f8ee80cfca0 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eece00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee80cf830 0x7f8ee815cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eece00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee80cf830 0x7f8ee815cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48418/0 (socket says 172.21.15.99:48418) 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eece00640 1 -- 172.21.15.99:0/4219456080 learned_addr learned my addr 172.21.15.99:0/4219456080 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eece00640 1 -- 172.21.15.99:0/4219456080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ee80cfca0 msgr2=0x7f8ee81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8ee7e00640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ee80cfca0 0x7f8ee81520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eed800640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ee815ede0 0x7f8ee8154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eece00640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ee80cfca0 0x7f8ee81520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eece00640 1 -- 172.21.15.99:0/4219456080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ee815ede0 msgr2=0x7f8ee8154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eece00640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ee815ede0 0x7f8ee8154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eece00640 1 -- 172.21.15.99:0/4219456080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee815d0e0 con 0x7f8ee80cf830 2024-09-10T07:36:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eed800640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ee815ede0 0x7f8ee8154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.931+0000 7f8eece00640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee80cf830 0x7f8ee815cba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009f40 tx=0x7f8ed8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.932+0000 7f8ee4c00640 1 -- 172.21.15.99:0/4219456080 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed803f020 con 0x7f8ee80cf830 2024-09-10T07:36:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.932+0000 7f8ee4c00640 1 -- 172.21.15.99:0/4219456080 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed8037040 con 0x7f8ee80cf830 2024-09-10T07:36:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.932+0000 7f8ee4c00640 1 -- 172.21.15.99:0/4219456080 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8036070 con 0x7f8ee80cf830 2024-09-10T07:36:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.932+0000 7f8eef800640 1 -- 172.21.15.99:0/4219456080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee8152620 con 0x7f8ee80cf830 2024-09-10T07:36:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.932+0000 7f8eef800640 1 -- 172.21.15.99:0/4219456080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee81554a0 con 0x7f8ee80cf830 2024-09-10T07:36:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.933+0000 7f8eef800640 1 -- 172.21.15.99:0/4219456080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee81556e0 con 0x7f8ee80cf830 2024-09-10T07:36:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.934+0000 7f8ee4c00640 1 -- 172.21.15.99:0/4219456080 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ed8042020 con 0x7f8ee80cf830 2024-09-10T07:36:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.934+0000 7f8ee4c00640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ec806be30 0x7f8ec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.935+0000 7f8ee4c00640 1 -- 172.21.15.99:0/4219456080 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7f8ed80ab4b0 con 0x7f8ee80cf830 2024-09-10T07:36:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.935+0000 7f8ee7e00640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ec806be30 0x7f8ec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:13.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.935+0000 7f8ee7e00640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ec806be30 0x7f8ec806e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4006fd0 tx=0x7f8ed4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:13.939+0000 7f8ee4c00640 1 -- 172.21.15.99:0/4219456080 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ed8049030 con 0x7f8ee80cf830 2024-09-10T07:36:14.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.144+0000 7f8eef800640 1 -- 172.21.15.99:0/4219456080 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ee80733b0 con 0x7f8ee80cf830 2024-09-10T07:36:14.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.144+0000 7f8ee4c00640 1 -- 172.21.15.99:0/4219456080 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5226 (secure 0 0 0) 0x7f8ed8079d80 con 0x7f8ee80cf830 2024-09-10T07:36:14.144 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:14.144 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"btime":"2024-09-10T07:35:39:936250+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2667247037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2667247037},{"type":"v1","addr":"172.21.15.99:6836","nonce":2667247037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/588885740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":588885740},{"type":"v1","addr":"172.21.15.187:6834","nonce":588885740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2599063325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2599063325},{"type":"v1","addr":"172.21.15.187:6835","nonce":2599063325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:36.307304+0000","modified":"2024-09-10T07:35:39.339225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1015333121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1015333121},{"type":"v1","addr":"172.21.15.99:6837","nonce":1015333121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":3}]} 2024-09-10T07:36:14.145 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 25 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 -- 172.21.15.99:0/4219456080 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ec806be30 msgr2=0x7f8ec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ec806be30 0x7f8ec806e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4006fd0 tx=0x7f8ed4008040 comp rx=0 tx=0).stop 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 -- 172.21.15.99:0/4219456080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee80cf830 msgr2=0x7f8ee815cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee80cf830 0x7f8ee815cba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009f40 tx=0x7f8ed8004a40 comp rx=0 tx=0).stop 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 -- 172.21.15.99:0/4219456080 shutdown_connections 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ee815ede0 0x7f8ee8154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ee80cfca0 0x7f8ee81520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ec806be30 0x7f8ec806e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 --2- 172.21.15.99:0/4219456080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ee80cf830 0x7f8ee815cba0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 -- 172.21.15.99:0/4219456080 >> 172.21.15.99:0/4219456080 conn(0x7f8ee806bc10 msgr2=0x7f8ee80cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 -- 172.21.15.99:0/4219456080 shutdown_connections 2024-09-10T07:36:14.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.147+0000 7f8eef800640 1 -- 172.21.15.99:0/4219456080 wait complete. 2024-09-10T07:36:14.162 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:36:14.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.316+0000 7f31de600640 1 Processor -- start 2024-09-10T07:36:14.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.316+0000 7f31de600640 1 -- start start 2024-09-10T07:36:14.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.317+0000 7f31de600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f31d8145290 0x7f31d806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.317+0000 7f31de600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31d80ce780 0x7f31d8072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.317+0000 7f31de600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d806e3d0 con 0x7f31d8071510 2024-09-10T07:36:14.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.317+0000 7f31de600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f31d806efe0 con 0x7f31d8145290 2024-09-10T07:36:14.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.317+0000 7f31de600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f31d806e6b0 con 0x7f31d80ce780 2024-09-10T07:36:14.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.318+0000 7f31d7400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f31d8145290 0x7f31d806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:14.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.318+0000 7f31d7e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f31d8071510 0x7f31d80b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43340/0 (socket says 172.21.15.99:43340) 2024-09-10T07:36:14.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.318+0000 7f31d7e00640 1 -- 172.21.15.99:0/2930698032 learned_addr learned my addr 172.21.15.99:0/2930698032 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:14.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.318+0000 7f31cea00640 1 --2- 172.21.15.99:0/2930698032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31d80ce780 0x7f31d8072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:14.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.318+0000 7f31d7400640 1 -- 172.21.15.99:0/2930698032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31d80ce780 msgr2=0x7f31d8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:14.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.318+0000 7f31d7400640 1 --2- 172.21.15.99:0/2930698032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31d80ce780 0x7f31d8072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.318+0000 7f31d7400640 1 -- 172.21.15.99:0/2930698032 >> v1:172.21.15.99:6789/0 conn(0x7f31d8071510 legacy=0x7f31d80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.318+0000 7f31d7400640 1 -- 172.21.15.99:0/2930698032 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d806e990 con 0x7f31d8145290 2024-09-10T07:36:14.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.318+0000 7f31d6a00640 1 -- 172.21.15.99:0/2930698032 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595430403 0 0) 0x7f31d806e3d0 con 0x7f31d8071510 2024-09-10T07:36:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.319+0000 7f31d7400640 1 --2- 172.21.15.99:0/2930698032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d8145290 0x7f31d806f470 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f31c80097a0 tx=0x7f31c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74b5762e982ab01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.319+0000 7f31d6a00640 1 -- 172.21.15.99:0/2930698032 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8037070 con 0x7f31d8145290 2024-09-10T07:36:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.319+0000 7f31d6a00640 1 -- 172.21.15.99:0/2930698032 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c8032440 con 0x7f31d8145290 2024-09-10T07:36:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.319+0000 7f31d6a00640 1 -- 172.21.15.99:0/2930698032 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8032810 con 0x7f31d8145290 2024-09-10T07:36:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.320+0000 7f31de600640 1 -- 172.21.15.99:0/2930698032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d8145290 msgr2=0x7f31d806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.320+0000 7f31de600640 1 --2- 172.21.15.99:0/2930698032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d8145290 0x7f31d806f470 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f31c80097a0 tx=0x7f31c802a180 comp rx=0 tx=0).stop 2024-09-10T07:36:14.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.320+0000 7f31de600640 1 -- 172.21.15.99:0/2930698032 shutdown_connections 2024-09-10T07:36:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.320+0000 7f31de600640 1 --2- 172.21.15.99:0/2930698032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31d80ce780 0x7f31d8072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.320+0000 7f31de600640 1 --2- 172.21.15.99:0/2930698032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d8145290 0x7f31d806f470 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.320+0000 7f31de600640 1 -- 172.21.15.99:0/2930698032 >> 172.21.15.99:0/2930698032 conn(0x7f31d806bc10 msgr2=0x7f31d806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.320+0000 7f31de600640 1 -- 172.21.15.99:0/2930698032 shutdown_connections 2024-09-10T07:36:14.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.320+0000 7f31de600640 1 -- 172.21.15.99:0/2930698032 wait complete. 2024-09-10T07:36:14.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.322+0000 7f31de600640 1 Processor -- start 2024-09-10T07:36:14.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.322+0000 7f31de600640 1 -- start start 2024-09-10T07:36:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.323+0000 7f31de600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31d8071510 0x7f31d813cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.323+0000 7f31de600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d80ce780 0x7f31d815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.323+0000 7f31de600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31d8145290 0x7f31d813e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.323+0000 7f31de600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f31d806df80 con 0x7f31d80ce780 2024-09-10T07:36:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.323+0000 7f31de600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8145670 con 0x7f31d8145290 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.323+0000 7f31de600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f31d806e100 con 0x7f31d8071510 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.323+0000 7f31cea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d80ce780 0x7f31d815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.323+0000 7f31cea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d80ce780 0x7f31d815b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48430/0 (socket says 172.21.15.99:48430) 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.323+0000 7f31cea00640 1 -- 172.21.15.99:0/3132950651 learned_addr learned my addr 172.21.15.99:0/3132950651 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31cea00640 1 -- 172.21.15.99:0/3132950651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31d8071510 msgr2=0x7f31d813cef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31cea00640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31d8071510 0x7f31d813cef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31cea00640 1 -- 172.21.15.99:0/3132950651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31d8145290 msgr2=0x7f31d813e490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31cea00640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31d8145290 0x7f31d813e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31cea00640 1 -- 172.21.15.99:0/3132950651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d813e9d0 con 0x7f31d80ce780 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31cea00640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d80ce780 0x7f31d815b5e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f31c000d7d0 tx=0x7f31c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31cfe00640 1 -- 172.21.15.99:0/3132950651 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0004020 con 0x7f31d80ce780 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31cfe00640 1 -- 172.21.15.99:0/3132950651 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c00041e0 con 0x7f31d80ce780 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31cfe00640 1 -- 172.21.15.99:0/3132950651 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c00043d0 con 0x7f31d80ce780 2024-09-10T07:36:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31de600640 1 -- 172.21.15.99:0/3132950651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d813bb70 con 0x7f31d80ce780 2024-09-10T07:36:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.324+0000 7f31de600640 1 -- 172.21.15.99:0/3132950651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d813c130 con 0x7f31d80ce780 2024-09-10T07:36:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.325+0000 7f31de600640 1 -- 172.21.15.99:0/3132950651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d806f450 con 0x7f31d80ce780 2024-09-10T07:36:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.326+0000 7f31cfe00640 1 -- 172.21.15.99:0/3132950651 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31c001b020 con 0x7f31d80ce780 2024-09-10T07:36:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.327+0000 7f31cfe00640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31b406be30 0x7f31b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.327+0000 7f31cfe00640 1 -- 172.21.15.99:0/3132950651 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7f31c008ad70 con 0x7f31d80ce780 2024-09-10T07:36:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.327+0000 7f31d7400640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31b406be30 0x7f31b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:14.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.328+0000 7f31d7400640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31b406be30 0x7f31b406e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f31c8034000 tx=0x7f31c802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.332+0000 7f31cfe00640 1 -- 172.21.15.99:0/3132950651 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31c0059640 con 0x7f31d80ce780 2024-09-10T07:36:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.537+0000 7f31de600640 1 -- 172.21.15.99:0/3132950651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31d8142150 con 0x7f31d80ce780 2024-09-10T07:36:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.538+0000 7f31cfe00640 1 -- 172.21.15.99:0/3132950651 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5226 (secure 0 0 0) 0x7f31c0058f40 con 0x7f31d80ce780 2024-09-10T07:36:14.538 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:14.538 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"btime":"2024-09-10T07:35:39:936250+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2667247037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2667247037},{"type":"v1","addr":"172.21.15.99:6836","nonce":2667247037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/588885740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":588885740},{"type":"v1","addr":"172.21.15.187:6834","nonce":588885740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2599063325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2599063325},{"type":"v1","addr":"172.21.15.187:6835","nonce":2599063325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:35:36.307304+0000","modified":"2024-09-10T07:35:39.339225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1015333121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1015333121},{"type":"v1","addr":"172.21.15.99:6837","nonce":1015333121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":3}]} 2024-09-10T07:36:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 25 2024-09-10T07:36:14.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 -- 172.21.15.99:0/3132950651 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31b406be30 msgr2=0x7f31b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31b406be30 0x7f31b406e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f31c8034000 tx=0x7f31c802e000 comp rx=0 tx=0).stop 2024-09-10T07:36:14.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 -- 172.21.15.99:0/3132950651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d80ce780 msgr2=0x7f31d815b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d80ce780 0x7f31d815b5e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f31c000d7d0 tx=0x7f31c000dc90 comp rx=0 tx=0).stop 2024-09-10T07:36:14.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 -- 172.21.15.99:0/3132950651 shutdown_connections 2024-09-10T07:36:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31d8145290 0x7f31d813e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31b406be30 0x7f31b406e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31d80ce780 0x7f31d815b5e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 --2- 172.21.15.99:0/3132950651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31d8071510 0x7f31d813cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 -- 172.21.15.99:0/3132950651 >> 172.21.15.99:0/3132950651 conn(0x7f31d806bc10 msgr2=0x7f31d8142670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 -- 172.21.15.99:0/3132950651 shutdown_connections 2024-09-10T07:36:14.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.540+0000 7f31de600640 1 -- 172.21.15.99:0/3132950651 wait complete. 2024-09-10T07:36:14.556 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:36:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.708+0000 7f393a000640 1 Processor -- start 2024-09-10T07:36:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.708+0000 7f393a000640 1 -- start start 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.709+0000 7f393a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 0x7f39340cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.709+0000 7f393a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f39340cfac0 0x7f39340c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.709+0000 7f393a000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39340d2bd0 con 0x7f393415e970 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.709+0000 7f393a000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f39340d37e0 con 0x7f39340cfac0 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.709+0000 7f393a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f39340d2eb0 con 0x7f39340d2680 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.709+0000 7f3939600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f39340cfac0 0x7f39340c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.710+0000 7f3939600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f39340cfac0 0x7f39340c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48446/0 (socket says 172.21.15.99:48446) 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.710+0000 7f3938c00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f393415e970 0x7f39340d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:39154/0 (socket says 172.21.15.99:39154) 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.710+0000 7f3939600640 1 -- 172.21.15.99:0/2298542299 learned_addr learned my addr 172.21.15.99:0/2298542299 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.710+0000 7f3933e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 0x7f39340cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.710+0000 7f3939600640 1 -- 172.21.15.99:0/2298542299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 msgr2=0x7f39340cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.710+0000 7f3939600640 1 --2- 172.21.15.99:0/2298542299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 0x7f39340cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.710+0000 7f3939600640 1 -- 172.21.15.99:0/2298542299 >> v1:172.21.15.187:6789/0 conn(0x7f393415e970 legacy=0x7f39340d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.710+0000 7f3939600640 1 -- 172.21.15.99:0/2298542299 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39340d3190 con 0x7f39340cfac0 2024-09-10T07:36:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.711+0000 7f3939600640 1 --2- 172.21.15.99:0/2298542299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 0x7f39340c8700 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f392c009e50 tx=0x7f392c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e1d7341268760f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.711+0000 7f3933400640 1 -- 172.21.15.99:0/2298542299 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c036070 con 0x7f39340cfac0 2024-09-10T07:36:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.711+0000 7f3933400640 1 -- 172.21.15.99:0/2298542299 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392c031600 con 0x7f39340cfac0 2024-09-10T07:36:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.711+0000 7f3933400640 1 -- 172.21.15.99:0/2298542299 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c0319d0 con 0x7f39340cfac0 2024-09-10T07:36:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.712+0000 7f393a000640 1 -- 172.21.15.99:0/2298542299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 msgr2=0x7f39340c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.712+0000 7f393a000640 1 --2- 172.21.15.99:0/2298542299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 0x7f39340c8700 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f392c009e50 tx=0x7f392c02a7a0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.712+0000 7f393a000640 1 -- 172.21.15.99:0/2298542299 shutdown_connections 2024-09-10T07:36:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.712+0000 7f393a000640 1 --2- 172.21.15.99:0/2298542299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 0x7f39340c8700 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.712+0000 7f393a000640 1 --2- 172.21.15.99:0/2298542299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 0x7f39340cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.712+0000 7f393a000640 1 -- 172.21.15.99:0/2298542299 >> 172.21.15.99:0/2298542299 conn(0x7f393409de00 msgr2=0x7f39340d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:14.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.712+0000 7f393a000640 1 -- 172.21.15.99:0/2298542299 shutdown_connections 2024-09-10T07:36:14.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.712+0000 7f393a000640 1 -- 172.21.15.99:0/2298542299 wait complete. 2024-09-10T07:36:14.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.714+0000 7f393a000640 1 Processor -- start 2024-09-10T07:36:14.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.714+0000 7f393a000640 1 -- start start 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.715+0000 7f393a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 0x7f39341e6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.715+0000 7f393a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 0x7f39341e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.715+0000 7f393a000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f393415e970 0x7f3934160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.715+0000 7f393a000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f393415ed50 con 0x7f39340cfac0 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.715+0000 7f393a000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f39340cff70 con 0x7f393415e970 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.715+0000 7f393a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f393415eed0 con 0x7f39340d2680 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.715+0000 7f3938c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 0x7f39341e6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.715+0000 7f3938c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 0x7f39341e6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48460/0 (socket says 172.21.15.99:48460) 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.715+0000 7f3938c00640 1 -- 172.21.15.99:0/317809194 learned_addr learned my addr 172.21.15.99:0/317809194 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3933e00640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 0x7f39341e8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3939600640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f393415e970 0x7f3934160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3938c00640 1 -- 172.21.15.99:0/317809194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 msgr2=0x7f39341e8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3938c00640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 0x7f39341e8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3938c00640 1 -- 172.21.15.99:0/317809194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f393415e970 msgr2=0x7f3934160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3938c00640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f393415e970 0x7f3934160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3938c00640 1 -- 172.21.15.99:0/317809194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3934158980 con 0x7f39340cfac0 2024-09-10T07:36:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3939600640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f393415e970 0x7f3934160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3933e00640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 0x7f39341e8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:14.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3938c00640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 0x7f39341e6ff0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f392800c3c0 tx=0x7f392800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:14.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3930c00640 1 -- 172.21.15.99:0/317809194 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39280074e0 con 0x7f39340cfac0 2024-09-10T07:36:14.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3930c00640 1 -- 172.21.15.99:0/317809194 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3928007680 con 0x7f39340cfac0 2024-09-10T07:36:14.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f393a000640 1 -- 172.21.15.99:0/317809194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39341e93b0 con 0x7f39340cfac0 2024-09-10T07:36:14.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f3930c00640 1 -- 172.21.15.99:0/317809194 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928004a00 con 0x7f39340cfac0 2024-09-10T07:36:14.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.716+0000 7f393a000640 1 -- 172.21.15.99:0/317809194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39341e78b0 con 0x7f39340cfac0 2024-09-10T07:36:14.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.717+0000 7f393a000640 1 -- 172.21.15.99:0/317809194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39340cf580 con 0x7f39340cfac0 2024-09-10T07:36:14.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.718+0000 7f3930c00640 1 -- 172.21.15.99:0/317809194 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f392801a020 con 0x7f39340cfac0 2024-09-10T07:36:14.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.719+0000 7f3930c00640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f391406be30 0x7f391406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:14.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.719+0000 7f3930c00640 1 -- 172.21.15.99:0/317809194 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7f392808a630 con 0x7f39340cfac0 2024-09-10T07:36:14.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.719+0000 7f3933e00640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f391406be30 0x7f391406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:14.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.720+0000 7f3933e00640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f391406be30 0x7f391406e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f39341e97f0 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:14.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.723+0000 7f3930c00640 1 -- 172.21.15.99:0/317809194 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3928058f90 con 0x7f39340cfac0 2024-09-10T07:36:14.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.901+0000 7f393a000640 1 -- 172.21.15.99:0/317809194 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39340d2030 con 0x7f39340cfac0 2024-09-10T07:36:14.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.902+0000 7f3930c00640 1 -- 172.21.15.99:0/317809194 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16801 (secure 0 0 0) 0x7f3928058890 con 0x7f39340cfac0 2024-09-10T07:36:14.902 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":54,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:36:07.849458+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:35:34.068514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T07:35:35.306080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.2c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.904+0000 7f393a000640 1 -- 172.21.15.99:0/317809194 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f391406be30 msgr2=0x7f391406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.904+0000 7f393a000640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f391406be30 0x7f391406e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f39341e97f0 tx=0x7f3920008040 comp rx=0 tx=0).stop 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.904+0000 7f393a000640 1 -- 172.21.15.99:0/317809194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 msgr2=0x7f39341e6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.904+0000 7f393a000640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 0x7f39341e6ff0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f392800c3c0 tx=0x7f392800c880 comp rx=0 tx=0).stop 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.905+0000 7f393a000640 1 -- 172.21.15.99:0/317809194 shutdown_connections 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.905+0000 7f393a000640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f393415e970 0x7f3934160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.905+0000 7f393a000640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39340d2680 0x7f39341e8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.905+0000 7f393a000640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f391406be30 0x7f391406e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.905+0000 7f393a000640 1 --2- 172.21.15.99:0/317809194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39340cfac0 0x7f39341e6ff0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.905+0000 7f393a000640 1 -- 172.21.15.99:0/317809194 >> 172.21.15.99:0/317809194 conn(0x7f393409de00 msgr2=0x7f39340c8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.905+0000 7f393a000640 1 -- 172.21.15.99:0/317809194 shutdown_connections 2024-09-10T07:36:14.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:14.905+0000 7f393a000640 1 -- 172.21.15.99:0/317809194 wait complete. 2024-09-10T07:36:14.922 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:36:15.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.075+0000 7f3792400640 1 Processor -- start 2024-09-10T07:36:15.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.076+0000 7f3792400640 1 -- start start 2024-09-10T07:36:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.077+0000 7f3792400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0b5750 0x7f378c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.077+0000 7f3792400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f378c0cf890 0x7f378c0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.077+0000 7f3792400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378c15c800 con 0x7f378c0ce070 2024-09-10T07:36:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.077+0000 7f3792400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f378c0b5bb0 con 0x7f378c0cf890 2024-09-10T07:36:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.077+0000 7f3792400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f378c0ce450 con 0x7f378c0b5750 2024-09-10T07:36:15.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.078+0000 7f3782a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0b5750 0x7f378c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.077+0000 7f378be00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f378c0cf890 0x7f378c0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.078+0000 7f378b400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f378c0ce070 0x7f378c15bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:39160/0 (socket says 172.21.15.99:39160) 2024-09-10T07:36:15.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.078+0000 7f378b400640 1 -- 172.21.15.99:0/3463924808 learned_addr learned my addr 172.21.15.99:0/3463924808 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:15.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.078+0000 7f3782a00640 1 -- 172.21.15.99:0/3463924808 >> v2:172.21.15.187:3300/0 conn(0x7f378c0cf890 msgr2=0x7f378c0cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:15.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.078+0000 7f3782a00640 1 --2- 172.21.15.99:0/3463924808 >> v2:172.21.15.187:3300/0 conn(0x7f378c0cf890 0x7f378c0cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.078+0000 7f3782a00640 1 -- 172.21.15.99:0/3463924808 >> v1:172.21.15.187:6789/0 conn(0x7f378c0ce070 legacy=0x7f378c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:15.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.078+0000 7f3782a00640 1 -- 172.21.15.99:0/3463924808 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c15cae0 con 0x7f378c0b5750 2024-09-10T07:36:15.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.078+0000 7f378be00640 1 --2- 172.21.15.99:0/3463924808 >> v2:172.21.15.187:3300/0 conn(0x7f378c0cf890 0x7f378c0cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:36:15.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.079+0000 7f3782a00640 1 --2- 172.21.15.99:0/3463924808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0b5750 0x7f378c15d170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f37740097a0 tx=0x7f377402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63fb400478647d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:15.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.079+0000 7f378aa00640 1 -- 172.21.15.99:0/3463924808 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774037070 con 0x7f378c0b5750 2024-09-10T07:36:15.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.079+0000 7f378aa00640 1 -- 172.21.15.99:0/3463924808 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3774032440 con 0x7f378c0b5750 2024-09-10T07:36:15.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.079+0000 7f378aa00640 1 -- 172.21.15.99:0/3463924808 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774032810 con 0x7f378c0b5750 2024-09-10T07:36:15.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.080+0000 7f3792400640 1 -- 172.21.15.99:0/3463924808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0b5750 msgr2=0x7f378c15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:15.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.080+0000 7f3792400640 1 --2- 172.21.15.99:0/3463924808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0b5750 0x7f378c15d170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f37740097a0 tx=0x7f377402a180 comp rx=0 tx=0).stop 2024-09-10T07:36:15.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.080+0000 7f3792400640 1 -- 172.21.15.99:0/3463924808 shutdown_connections 2024-09-10T07:36:15.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.080+0000 7f3792400640 1 --2- 172.21.15.99:0/3463924808 >> v2:172.21.15.187:3300/0 conn(0x7f378c0cf890 0x7f378c0cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.080+0000 7f3792400640 1 --2- 172.21.15.99:0/3463924808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0b5750 0x7f378c15d170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.080+0000 7f3792400640 1 -- 172.21.15.99:0/3463924808 >> 172.21.15.99:0/3463924808 conn(0x7f378c0b2630 msgr2=0x7f378c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:15.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.080+0000 7f3792400640 1 -- 172.21.15.99:0/3463924808 shutdown_connections 2024-09-10T07:36:15.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.080+0000 7f3792400640 1 -- 172.21.15.99:0/3463924808 wait complete. 2024-09-10T07:36:15.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.082+0000 7f3792400640 1 Processor -- start 2024-09-10T07:36:15.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.082+0000 7f3792400640 1 -- start start 2024-09-10T07:36:15.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f3792400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f378c0b5750 0x7f378c1e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f3792400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0ce070 0x7f378c1e9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f3792400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c0cf890 0x7f378c1e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f3792400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f378c15d830 con 0x7f378c0cf890 2024-09-10T07:36:15.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f3792400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f378c15d6b0 con 0x7f378c0b5750 2024-09-10T07:36:15.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f3792400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f378c06e080 con 0x7f378c0ce070 2024-09-10T07:36:15.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f378be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c0cf890 0x7f378c1e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f378be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c0cf890 0x7f378c1e9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48466/0 (socket says 172.21.15.99:48466) 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f378be00640 1 -- 172.21.15.99:0/2211337145 learned_addr learned my addr 172.21.15.99:0/2211337145 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f378b400640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f378c0b5750 0x7f378c1e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f3782a00640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0ce070 0x7f378c1e9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f378be00640 1 -- 172.21.15.99:0/2211337145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0ce070 msgr2=0x7f378c1e9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f378be00640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0ce070 0x7f378c1e9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f378be00640 1 -- 172.21.15.99:0/2211337145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f378c0b5750 msgr2=0x7f378c1e9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f378be00640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f378c0b5750 0x7f378c1e9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f378be00640 1 -- 172.21.15.99:0/2211337145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c149940 con 0x7f378c0cf890 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.083+0000 7f3782a00640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0ce070 0x7f378c1e9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.084+0000 7f378be00640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c0cf890 0x7f378c1e9c90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f378400efc0 tx=0x7f378400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.084+0000 7f3783e00640 1 -- 172.21.15.99:0/2211337145 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784018030 con 0x7f378c0cf890 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.084+0000 7f3783e00640 1 -- 172.21.15.99:0/2211337145 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378400cdf0 con 0x7f378c0cf890 2024-09-10T07:36:15.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.084+0000 7f3792400640 1 -- 172.21.15.99:0/2211337145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378c1557e0 con 0x7f378c0cf890 2024-09-10T07:36:15.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.084+0000 7f3783e00640 1 -- 172.21.15.99:0/2211337145 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784003bb0 con 0x7f378c0cf890 2024-09-10T07:36:15.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.084+0000 7f3792400640 1 -- 172.21.15.99:0/2211337145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f378c1e8450 con 0x7f378c0cf890 2024-09-10T07:36:15.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.085+0000 7f3792400640 1 -- 172.21.15.99:0/2211337145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f378c15d170 con 0x7f378c0cf890 2024-09-10T07:36:15.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.086+0000 7f3783e00640 1 -- 172.21.15.99:0/2211337145 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3784005d10 con 0x7f378c0cf890 2024-09-10T07:36:15.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.087+0000 7f3783e00640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376806be30 0x7f376806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.087+0000 7f3783e00640 1 -- 172.21.15.99:0/2211337145 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5767+0+0 (secure 0 0 0) 0x7f378408b810 con 0x7f378c0cf890 2024-09-10T07:36:15.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.087+0000 7f378b400640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376806be30 0x7f376806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.088+0000 7f378b400640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376806be30 0x7f376806e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f377c000f60 tx=0x7f377c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:15.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.091+0000 7f3783e00640 1 -- 172.21.15.99:0/2211337145 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3784022070 con 0x7f378c0cf890 2024-09-10T07:36:15.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.298+0000 7f3792400640 1 -- 172.21.15.99:0/2211337145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f378c0b4840 con 0x7f378c0cf890 2024-09-10T07:36:15.299 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:36:15.299+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:36:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.301+0000 7f3783e00640 1 -- 172.21.15.99:0/2211337145 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f3784010040 con 0x7f378c0cf890 2024-09-10T07:36:15.301 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:36:15.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 -- 172.21.15.99:0/2211337145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376806be30 msgr2=0x7f376806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376806be30 0x7f376806e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f377c000f60 tx=0x7f377c009040 comp rx=0 tx=0).stop 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 -- 172.21.15.99:0/2211337145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c0cf890 msgr2=0x7f378c1e9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c0cf890 0x7f378c1e9c90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f378400efc0 tx=0x7f378400c490 comp rx=0 tx=0).stop 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 -- 172.21.15.99:0/2211337145 shutdown_connections 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376806be30 0x7f376806e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f378c0cf890 0x7f378c1e9c90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378c0ce070 0x7f378c1e9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 --2- 172.21.15.99:0/2211337145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f378c0b5750 0x7f378c1e9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 -- 172.21.15.99:0/2211337145 >> 172.21.15.99:0/2211337145 conn(0x7f378c0b2630 msgr2=0x7f378c15f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 -- 172.21.15.99:0/2211337145 shutdown_connections 2024-09-10T07:36:15.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.304+0000 7f3792400640 1 -- 172.21.15.99:0/2211337145 wait complete. 2024-09-10T07:36:15.321 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:36:15.369 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:36:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.479+0000 7f8263200640 1 Processor -- start 2024-09-10T07:36:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.479+0000 7f8263200640 1 -- start start 2024-09-10T07:36:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.480+0000 7f8263200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f825c143b40 0x7f825c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.480+0000 7f8263200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c0b3e70 0x7f825c071d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.481+0000 7f8263200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825c072ae0 con 0x7f825c072280 2024-09-10T07:36:15.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.481+0000 7f8263200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f825c0b42b0 con 0x7f825c143b40 2024-09-10T07:36:15.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.481+0000 7f8263200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f825c072dc0 con 0x7f825c0b3e70 2024-09-10T07:36:15.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.481+0000 7f8261400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c0b3e70 0x7f825c071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.481+0000 7f8261e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f825c143b40 0x7f825c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.481+0000 7f8261400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c0b3e70 0x7f825c071d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:59384/0 (socket says 172.21.15.99:59384) 2024-09-10T07:36:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.481+0000 7f8261400640 1 -- 172.21.15.99:0/2236890080 learned_addr learned my addr 172.21.15.99:0/2236890080 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.482+0000 7f8261400640 1 -- 172.21.15.99:0/2236890080 >> v2:172.21.15.187:3300/0 conn(0x7f825c143b40 msgr2=0x7f825c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.482+0000 7f8261400640 1 --2- 172.21.15.99:0/2236890080 >> v2:172.21.15.187:3300/0 conn(0x7f825c143b40 0x7f825c0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.482+0000 7f8261400640 1 -- 172.21.15.99:0/2236890080 >> v1:172.21.15.187:6789/0 conn(0x7f825c072280 legacy=0x7f825c15e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.482+0000 7f8261400640 1 -- 172.21.15.99:0/2236890080 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825c0730a0 con 0x7f825c0b3e70 2024-09-10T07:36:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.483+0000 7f8261400640 1 --2- 172.21.15.99:0/2236890080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c0b3e70 0x7f825c071d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f824c009870 tx=0x7f824c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=289f5cbeca86f788 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.483+0000 7f8260a00640 1 -- 172.21.15.99:0/2236890080 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c037070 con 0x7f825c0b3e70 2024-09-10T07:36:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.483+0000 7f8260a00640 1 -- 172.21.15.99:0/2236890080 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c032440 con 0x7f825c0b3e70 2024-09-10T07:36:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.483+0000 7f8260a00640 1 -- 172.21.15.99:0/2236890080 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c032810 con 0x7f825c0b3e70 2024-09-10T07:36:15.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.484+0000 7f8263200640 1 -- 172.21.15.99:0/2236890080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c0b3e70 msgr2=0x7f825c071d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:15.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.484+0000 7f8263200640 1 --2- 172.21.15.99:0/2236890080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c0b3e70 0x7f825c071d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f824c009870 tx=0x7f824c02a250 comp rx=0 tx=0).stop 2024-09-10T07:36:15.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.484+0000 7f8263200640 1 -- 172.21.15.99:0/2236890080 shutdown_connections 2024-09-10T07:36:15.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.484+0000 7f8263200640 1 --2- 172.21.15.99:0/2236890080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c0b3e70 0x7f825c071d40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.484+0000 7f8263200640 1 --2- 172.21.15.99:0/2236890080 >> v2:172.21.15.187:3300/0 conn(0x7f825c143b40 0x7f825c0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.484+0000 7f8263200640 1 -- 172.21.15.99:0/2236890080 >> 172.21.15.99:0/2236890080 conn(0x7f825c0b2810 msgr2=0x7f825c0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:15.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.484+0000 7f8263200640 1 -- 172.21.15.99:0/2236890080 shutdown_connections 2024-09-10T07:36:15.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.484+0000 7f8263200640 1 -- 172.21.15.99:0/2236890080 wait complete. 2024-09-10T07:36:15.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.485+0000 7f8263200640 1 Processor -- start 2024-09-10T07:36:15.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.486+0000 7f8263200640 1 -- start start 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.486+0000 7f8263200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f825c072280 0x7f825c15a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.486+0000 7f8263200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f825c0b3e70 0x7f825c0ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8263200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c143b40 0x7f825c166770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8263200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f825c072730 con 0x7f825c0b3e70 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8263200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f825c06ea80 con 0x7f825c072280 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8263200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f825c167190 con 0x7f825c143b40 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8261400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f825c0b3e70 0x7f825c0ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8261400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f825c0b3e70 0x7f825c0ab0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48498/0 (socket says 172.21.15.99:48498) 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8261400640 1 -- 172.21.15.99:0/2222214235 learned_addr learned my addr 172.21.15.99:0/2222214235 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8261e00640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f825c072280 0x7f825c15a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8262800640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c143b40 0x7f825c166770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8261400640 1 -- 172.21.15.99:0/2222214235 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c143b40 msgr2=0x7f825c166770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8261400640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c143b40 0x7f825c166770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8261400640 1 -- 172.21.15.99:0/2222214235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f825c072280 msgr2=0x7f825c15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8261400640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f825c072280 0x7f825c15a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.487+0000 7f8261400640 1 -- 172.21.15.99:0/2222214235 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825c167470 con 0x7f825c0b3e70 2024-09-10T07:36:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.488+0000 7f8261400640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f825c0b3e70 0x7f825c0ab0b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f824c02a290 tx=0x7f824c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.488+0000 7f8256000640 1 -- 172.21.15.99:0/2222214235 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c037040 con 0x7f825c0b3e70 2024-09-10T07:36:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.488+0000 7f8256000640 1 -- 172.21.15.99:0/2222214235 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c042070 con 0x7f825c0b3e70 2024-09-10T07:36:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.488+0000 7f8263200640 1 -- 172.21.15.99:0/2222214235 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825c167750 con 0x7f825c0b3e70 2024-09-10T07:36:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.488+0000 7f8256000640 1 -- 172.21.15.99:0/2222214235 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c030880 con 0x7f825c0b3e70 2024-09-10T07:36:15.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.488+0000 7f8263200640 1 -- 172.21.15.99:0/2222214235 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f825c167d10 con 0x7f825c0b3e70 2024-09-10T07:36:15.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.489+0000 7f8263200640 1 -- 172.21.15.99:0/2222214235 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f825c15af70 con 0x7f825c0b3e70 2024-09-10T07:36:15.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.490+0000 7f8256000640 1 -- 172.21.15.99:0/2222214235 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f824c030a20 con 0x7f825c0b3e70 2024-09-10T07:36:15.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.491+0000 7f8256000640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f824006be30 0x7f824006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.491+0000 7f8256000640 1 -- 172.21.15.99:0/2222214235 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5853+0+0 (secure 0 0 0) 0x7f824c0ab650 con 0x7f825c0b3e70 2024-09-10T07:36:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.491+0000 7f8261e00640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f824006be30 0x7f824006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.492+0000 7f8261e00640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f824006be30 0x7f824006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8250009aa0 tx=0x7f8250009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:15.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.495+0000 7f8256000640 1 -- 172.21.15.99:0/2222214235 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f824c079880 con 0x7f825c0b3e70 2024-09-10T07:36:15.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:15.702+0000 7f8263200640 1 -- 172.21.15.99:0/2222214235 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f825c071d40 con 0x7f825c0b3e70 2024-09-10T07:36:16.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.303+0000 7f8256000640 1 -- 172.21.15.99:0/2222214235 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f824c07db80 con 0x7f825c0b3e70 2024-09-10T07:36:16.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 -- 172.21.15.99:0/2222214235 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f824006be30 msgr2=0x7f824006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:16.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f824006be30 0x7f824006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8250009aa0 tx=0x7f8250009190 comp rx=0 tx=0).stop 2024-09-10T07:36:16.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 -- 172.21.15.99:0/2222214235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f825c0b3e70 msgr2=0x7f825c0ab0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:16.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f825c0b3e70 0x7f825c0ab0b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f824c02a290 tx=0x7f824c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 -- 172.21.15.99:0/2222214235 shutdown_connections 2024-09-10T07:36:16.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f825c143b40 0x7f825c166770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f824006be30 0x7f824006e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f825c0b3e70 0x7f825c0ab0b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 --2- 172.21.15.99:0/2222214235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f825c072280 0x7f825c15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 -- 172.21.15.99:0/2222214235 >> 172.21.15.99:0/2222214235 conn(0x7f825c0b2810 msgr2=0x7f825c0b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:16.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 -- 172.21.15.99:0/2222214235 shutdown_connections 2024-09-10T07:36:16.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.306+0000 7f8263200640 1 -- 172.21.15.99:0/2222214235 wait complete. 2024-09-10T07:36:16.323 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:36:16.406 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:36:16.410 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:36:16.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.484+0000 7f4f3b400640 1 Processor -- start 2024-09-10T07:36:16.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.485+0000 7f4f3b400640 1 -- start start 2024-09-10T07:36:16.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f3b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 0x7f4f340cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:16.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f3b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4f340ced50 0x7f4f34072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:16.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f3b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4f34144980 0x7f4f34072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:16.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f3b400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4f3415fdd0 con 0x7f4f340ced50 2024-09-10T07:36:16.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f3b400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f4f340b5f00 con 0x7f4f34144980 2024-09-10T07:36:16.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f3b400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4f340cd8c0 con 0x7f4f341445a0 2024-09-10T07:36:16.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f33e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4f340ced50 0x7f4f34072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f33e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4f340ced50 0x7f4f34072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48500/0 (socket says 172.21.15.99:48500) 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f33e00640 1 -- 172.21.15.99:0/4085976319 learned_addr learned my addr 172.21.15.99:0/4085976319 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f33e00640 1 -- 172.21.15.99:0/4085976319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 msgr2=0x7f4f340cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f39400640 1 --2- 172.21.15.99:0/4085976319 >> v2:172.21.15.187:3300/0 conn(0x7f4f34144980 0x7f4f34072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f38a00640 1 --2- 172.21.15.99:0/4085976319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 0x7f4f340cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f33e00640 1 --2- 172.21.15.99:0/4085976319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 0x7f4f340cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f33e00640 1 -- 172.21.15.99:0/4085976319 >> v2:172.21.15.187:3300/0 conn(0x7f4f34144980 msgr2=0x7f4f34072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.486+0000 7f4f33e00640 1 --2- 172.21.15.99:0/4085976319 >> v2:172.21.15.187:3300/0 conn(0x7f4f34144980 0x7f4f34072bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.487+0000 7f4f33e00640 1 -- 172.21.15.99:0/4085976319 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f34160310 con 0x7f4f340ced50 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.487+0000 7f4f39400640 1 --2- 172.21.15.99:0/4085976319 >> v2:172.21.15.187:3300/0 conn(0x7f4f34144980 0x7f4f34072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.487+0000 7f4f38a00640 1 --2- 172.21.15.99:0/4085976319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 0x7f4f340cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.487+0000 7f4f33e00640 1 --2- 172.21.15.99:0/4085976319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340ced50 0x7f4f34072680 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4f340ce890 tx=0x7f4f2002c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1884a96afcea38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f33400640 1 -- 172.21.15.99:0/4085976319 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20039070 con 0x7f4f340ced50 2024-09-10T07:36:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f33400640 1 -- 172.21.15.99:0/4085976319 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f20034440 con 0x7f4f340ced50 2024-09-10T07:36:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f33400640 1 -- 172.21.15.99:0/4085976319 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f20034810 con 0x7f4f340ced50 2024-09-10T07:36:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f3b400640 1 -- 172.21.15.99:0/4085976319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340ced50 msgr2=0x7f4f34072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f3b400640 1 --2- 172.21.15.99:0/4085976319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340ced50 0x7f4f34072680 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4f340ce890 tx=0x7f4f2002c2f0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f3b400640 1 -- 172.21.15.99:0/4085976319 shutdown_connections 2024-09-10T07:36:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f3b400640 1 --2- 172.21.15.99:0/4085976319 >> v2:172.21.15.187:3300/0 conn(0x7f4f34144980 0x7f4f34072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f3b400640 1 --2- 172.21.15.99:0/4085976319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f340ced50 0x7f4f34072680 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f3b400640 1 --2- 172.21.15.99:0/4085976319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 0x7f4f340cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f3b400640 1 -- 172.21.15.99:0/4085976319 >> 172.21.15.99:0/4085976319 conn(0x7f4f340b26a0 msgr2=0x7f4f340b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f3b400640 1 -- 172.21.15.99:0/4085976319 shutdown_connections 2024-09-10T07:36:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.488+0000 7f4f3b400640 1 -- 172.21.15.99:0/4085976319 wait complete. 2024-09-10T07:36:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.490+0000 7f4f3b400640 1 Processor -- start 2024-09-10T07:36:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.490+0000 7f4f3b400640 1 -- start start 2024-09-10T07:36:16.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f3b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f340ced50 0x7f4f341f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:16.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f3b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 0x7f4f340af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:16.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f3b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f34144980 0x7f4f34139b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:16.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f3b400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4f340b5c20 con 0x7f4f34144980 2024-09-10T07:36:16.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f3b400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4f340b5940 con 0x7f4f340ced50 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f3b400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4f34144ec0 con 0x7f4f341445a0 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f39400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f34144980 0x7f4f34139b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f39400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f34144980 0x7f4f34139b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48502/0 (socket says 172.21.15.99:48502) 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f38a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f340ced50 0x7f4f341f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f39400640 1 -- 172.21.15.99:0/3720418572 learned_addr learned my addr 172.21.15.99:0/3720418572 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.491+0000 7f4f33e00640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 0x7f4f340af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f39400640 1 -- 172.21.15.99:0/3720418572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 msgr2=0x7f4f340af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f39400640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 0x7f4f340af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f39400640 1 -- 172.21.15.99:0/3720418572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f340ced50 msgr2=0x7f4f341f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f39400640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f340ced50 0x7f4f341f55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f39400640 1 -- 172.21.15.99:0/3720418572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f34138dd0 con 0x7f4f34144980 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f39400640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f34144980 0x7f4f34139b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00cd20 tx=0x7f4f2c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f30c00640 1 -- 172.21.15.99:0/3720418572 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00f680 con 0x7f4f34144980 2024-09-10T07:36:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f30c00640 1 -- 172.21.15.99:0/3720418572 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c00f840 con 0x7f4f34144980 2024-09-10T07:36:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f30c00640 1 -- 172.21.15.99:0/3720418572 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00fc30 con 0x7f4f34144980 2024-09-10T07:36:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f3b400640 1 -- 172.21.15.99:0/3720418572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f341390b0 con 0x7f4f34144980 2024-09-10T07:36:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.492+0000 7f4f3b400640 1 -- 172.21.15.99:0/3720418572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f340af670 con 0x7f4f34144980 2024-09-10T07:36:16.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.493+0000 7f4f3b400640 1 -- 172.21.15.99:0/3720418572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f3415bc00 con 0x7f4f34144980 2024-09-10T07:36:16.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.494+0000 7f4f30c00640 1 -- 172.21.15.99:0/3720418572 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f2c00e3e0 con 0x7f4f34144980 2024-09-10T07:36:16.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.495+0000 7f4f30c00640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4f1406be30 0x7f4f1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:16.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.495+0000 7f4f30c00640 1 -- 172.21.15.99:0/3720418572 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5853+0+0 (secure 0 0 0) 0x7f4f2c08bb60 con 0x7f4f34144980 2024-09-10T07:36:16.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.495+0000 7f4f38a00640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4f1406be30 0x7f4f1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:16.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.496+0000 7f4f38a00640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4f1406be30 0x7f4f1406e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4f28006b10 tx=0x7f4f28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:16.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.499+0000 7f4f30c00640 1 -- 172.21.15.99:0/3720418572 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f2c014030 con 0x7f4f34144980 2024-09-10T07:36:16.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:16.673+0000 7f4f3b400640 1 -- 172.21.15.99:0/3720418572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4f341400e0 con 0x7f4f34144980 2024-09-10T07:36:17.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.311+0000 7f4f30c00640 1 -- 172.21.15.99:0/3720418572 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) ==== 181+0+0 (secure 0 0 0) 0x7f4f2c059e20 con 0x7f4f34144980 2024-09-10T07:36:17.311 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:36:17.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.314+0000 7f4f3b400640 1 -- 172.21.15.99:0/3720418572 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4f1406be30 msgr2=0x7f4f1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.314+0000 7f4f3b400640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4f1406be30 0x7f4f1406e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4f28006b10 tx=0x7f4f28008040 comp rx=0 tx=0).stop 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.314+0000 7f4f3b400640 1 -- 172.21.15.99:0/3720418572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f34144980 msgr2=0x7f4f34139b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.314+0000 7f4f3b400640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f34144980 0x7f4f34139b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00cd20 tx=0x7f4f2c00a650 comp rx=0 tx=0).stop 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.315+0000 7f4f3b400640 1 -- 172.21.15.99:0/3720418572 shutdown_connections 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.315+0000 7f4f3b400640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4f1406be30 0x7f4f1406e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.315+0000 7f4f3b400640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f34144980 0x7f4f34139b90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.315+0000 7f4f3b400640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f341445a0 0x7f4f340af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.315+0000 7f4f3b400640 1 --2- 172.21.15.99:0/3720418572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f340ced50 0x7f4f341f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.315+0000 7f4f3b400640 1 -- 172.21.15.99:0/3720418572 >> 172.21.15.99:0/3720418572 conn(0x7f4f340b26a0 msgr2=0x7f4f3406dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.315+0000 7f4f3b400640 1 -- 172.21.15.99:0/3720418572 shutdown_connections 2024-09-10T07:36:17.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.315+0000 7f4f3b400640 1 -- 172.21.15.99:0/3720418572 wait complete. 2024-09-10T07:36:17.332 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:36:17.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.531+0000 7facb8200640 1 Processor -- start 2024-09-10T07:36:17.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.531+0000 7facb8200640 1 -- start start 2024-09-10T07:36:17.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.532+0000 7facb8200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7facb015af10 0x7facb00cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:17.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.532+0000 7facb8200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb006f580 0x7facb00b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:17.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.532+0000 7facb8200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb00716a0 con 0x7facb00cf440 2024-09-10T07:36:17.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.532+0000 7facb8200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7facb00731f0 con 0x7facb015af10 2024-09-10T07:36:17.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.532+0000 7facb8200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7facb0071980 con 0x7facb006f580 2024-09-10T07:36:17.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.532+0000 7facb5800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7facb015af10 0x7facb00cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:17.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.532+0000 7facb5800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7facb015af10 0x7facb00cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48512/0 (socket says 172.21.15.99:48512) 2024-09-10T07:36:17.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.532+0000 7facb5800640 1 -- 172.21.15.99:0/949522332 learned_addr learned my addr 172.21.15.99:0/949522332 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:17.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.533+0000 7facb5800640 1 -- 172.21.15.99:0/949522332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb006f580 msgr2=0x7facb00b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:17.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.533+0000 7facb5800640 1 --2- 172.21.15.99:0/949522332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb006f580 0x7facb00b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:17.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.533+0000 7facb5800640 1 -- 172.21.15.99:0/949522332 >> v1:172.21.15.187:6789/0 conn(0x7facb00cf440 legacy=0x7facb006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:17.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.533+0000 7facb5800640 1 -- 172.21.15.99:0/949522332 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb0071c60 con 0x7facb015af10 2024-09-10T07:36:17.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.534+0000 7facb5800640 1 --2- 172.21.15.99:0/949522332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb015af10 0x7facb00cef00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7facb0076810 tx=0x7faca402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ef9c6c5451d6bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:17.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.534+0000 7facafe00640 1 -- 172.21.15.99:0/949522332 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4037070 con 0x7facb015af10 2024-09-10T07:36:17.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.534+0000 7facafe00640 1 -- 172.21.15.99:0/949522332 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca402ae20 con 0x7facb015af10 2024-09-10T07:36:17.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.534+0000 7facafe00640 1 -- 172.21.15.99:0/949522332 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4032660 con 0x7facb015af10 2024-09-10T07:36:17.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.534+0000 7facb8200640 1 -- 172.21.15.99:0/949522332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb015af10 msgr2=0x7facb00cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:17.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.534+0000 7facb8200640 1 --2- 172.21.15.99:0/949522332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb015af10 0x7facb00cef00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7facb0076810 tx=0x7faca402a110 comp rx=0 tx=0).stop 2024-09-10T07:36:17.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.535+0000 7facb8200640 1 -- 172.21.15.99:0/949522332 shutdown_connections 2024-09-10T07:36:17.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.535+0000 7facb8200640 1 --2- 172.21.15.99:0/949522332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb006f580 0x7facb00b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:17.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.535+0000 7facb8200640 1 --2- 172.21.15.99:0/949522332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb015af10 0x7facb00cef00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:17.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.535+0000 7facb8200640 1 -- 172.21.15.99:0/949522332 >> 172.21.15.99:0/949522332 conn(0x7facb00b26a0 msgr2=0x7facb00b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:17.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.535+0000 7facb8200640 1 -- 172.21.15.99:0/949522332 shutdown_connections 2024-09-10T07:36:17.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.535+0000 7facb8200640 1 -- 172.21.15.99:0/949522332 wait complete. 2024-09-10T07:36:17.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.536+0000 7facb8200640 1 Processor -- start 2024-09-10T07:36:17.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.536+0000 7facb8200640 1 -- start start 2024-09-10T07:36:17.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb8200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb006f580 0x7facb015dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:17.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb8200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00cf440 0x7facb0149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:17.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb8200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb015af10 0x7facb0150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:17.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb8200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7facb015b2f0 con 0x7facb00cf440 2024-09-10T07:36:17.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb8200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7facb0072220 con 0x7facb006f580 2024-09-10T07:36:17.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb8200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7facb0072740 con 0x7facb015af10 2024-09-10T07:36:17.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00cf440 0x7facb0149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00cf440 0x7facb0149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48518/0 (socket says 172.21.15.99:48518) 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb4e00640 1 -- 172.21.15.99:0/2198518165 learned_addr learned my addr 172.21.15.99:0/2198518165 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb5800640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb006f580 0x7facb015dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.537+0000 7facb6200640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb015af10 0x7facb0150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facb4e00640 1 -- 172.21.15.99:0/2198518165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb015af10 msgr2=0x7facb0150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facb4e00640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb015af10 0x7facb0150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facb4e00640 1 -- 172.21.15.99:0/2198518165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb006f580 msgr2=0x7facb015dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facb4e00640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb006f580 0x7facb015dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facb4e00640 1 -- 172.21.15.99:0/2198518165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb0149da0 con 0x7facb00cf440 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facb5800640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb006f580 0x7facb015dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facb6200640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb015af10 0x7facb0150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:17.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facb4e00640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00cf440 0x7facb0149860 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00c410 tx=0x7fac9c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:17.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facad600640 1 -- 172.21.15.99:0/2198518165 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c017070 con 0x7facb00cf440 2024-09-10T07:36:17.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facad600640 1 -- 172.21.15.99:0/2198518165 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac9c0035f0 con 0x7facb00cf440 2024-09-10T07:36:17.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facad600640 1 -- 172.21.15.99:0/2198518165 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c0039e0 con 0x7facb00cf440 2024-09-10T07:36:17.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facb8200640 1 -- 172.21.15.99:0/2198518165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb014a930 con 0x7facb00cf440 2024-09-10T07:36:17.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.538+0000 7facb8200640 1 -- 172.21.15.99:0/2198518165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb014aef0 con 0x7facb00cf440 2024-09-10T07:36:17.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.539+0000 7facb8200640 1 -- 172.21.15.99:0/2198518165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb014b130 con 0x7facb00cf440 2024-09-10T07:36:17.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.540+0000 7facad600640 1 -- 172.21.15.99:0/2198518165 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac9c01a070 con 0x7facb00cf440 2024-09-10T07:36:17.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.541+0000 7facad600640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac9006be30 0x7fac9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:17.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.541+0000 7facad600640 1 -- 172.21.15.99:0/2198518165 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5415+0+0 (secure 0 0 0) 0x7fac9c08a1c0 con 0x7facb00cf440 2024-09-10T07:36:17.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.541+0000 7facb5800640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac9006be30 0x7fac9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:17.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.542+0000 7facb5800640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac9006be30 0x7fac9006e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faca4034000 tx=0x7faca402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:17.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.546+0000 7facad600640 1 -- 172.21.15.99:0/2198518165 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facb014b130 con 0x7facb00cf440 2024-09-10T07:36:17.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:17.720+0000 7facb8200640 1 -- 172.21.15.99:0/2198518165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7facb00cef00 con 0x7facb00cf440 2024-09-10T07:36:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.315+0000 7facad600640 1 -- 172.21.15.99:0/2198518165 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) ==== 169+0+0 (secure 0 0 0) 0x7fac9c058c80 con 0x7facb00cf440 2024-09-10T07:36:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:36:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 -- 172.21.15.99:0/2198518165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac9006be30 msgr2=0x7fac9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac9006be30 0x7fac9006e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faca4034000 tx=0x7faca402e000 comp rx=0 tx=0).stop 2024-09-10T07:36:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 -- 172.21.15.99:0/2198518165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00cf440 msgr2=0x7facb0149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00cf440 0x7facb0149860 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00c410 tx=0x7fac9c00c8d0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 -- 172.21.15.99:0/2198518165 shutdown_connections 2024-09-10T07:36:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb015af10 0x7facb0150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac9006be30 0x7fac9006e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facb00cf440 0x7facb0149860 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 --2- 172.21.15.99:0/2198518165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb006f580 0x7facb015dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 -- 172.21.15.99:0/2198518165 >> 172.21.15.99:0/2198518165 conn(0x7facb00b26a0 msgr2=0x7facb00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.317+0000 7facb8200640 1 -- 172.21.15.99:0/2198518165 shutdown_connections 2024-09-10T07:36:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.318+0000 7facb8200640 1 -- 172.21.15.99:0/2198518165 wait complete. 2024-09-10T07:36:18.341 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T07:36:18.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.496+0000 7f5722600640 1 Processor -- start 2024-09-10T07:36:18.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.496+0000 7f5722600640 1 -- start start 2024-09-10T07:36:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.497+0000 7f5722600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f571c0b4e70 0x7f571c071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.497+0000 7f5722600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f571c0af250 0x7f571c06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.497+0000 7f5722600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571c06f1a0 con 0x7f571c15ece0 2024-09-10T07:36:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f5722600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f571c0d1780 con 0x7f571c0b4e70 2024-09-10T07:36:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f5722600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f571c06d5d0 con 0x7f571c0af250 2024-09-10T07:36:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f571b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f571c0b4e70 0x7f571c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f5712a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f571c15ece0 0x7f571c0b5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43356/0 (socket says 172.21.15.99:43356) 2024-09-10T07:36:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f5712a00640 1 -- 172.21.15.99:0/852772525 learned_addr learned my addr 172.21.15.99:0/852772525 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f571be00640 1 --2- 172.21.15.99:0/852772525 >> v2:172.21.15.187:3300/0 conn(0x7f571c0af250 0x7f571c06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f571b400640 1 -- 172.21.15.99:0/852772525 >> v2:172.21.15.187:3300/0 conn(0x7f571c0af250 msgr2=0x7f571c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f571b400640 1 --2- 172.21.15.99:0/852772525 >> v2:172.21.15.187:3300/0 conn(0x7f571c0af250 0x7f571c06dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f571b400640 1 -- 172.21.15.99:0/852772525 >> v1:172.21.15.99:6789/0 conn(0x7f571c15ece0 legacy=0x7f571c0b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f571aa00640 1 -- 172.21.15.99:0/852772525 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040522988 0 0) 0x7f571c06f1a0 con 0x7f571c15ece0 2024-09-10T07:36:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.498+0000 7f571b400640 1 -- 172.21.15.99:0/852772525 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c06f480 con 0x7f571c0b4e70 2024-09-10T07:36:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.499+0000 7f571b400640 1 --2- 172.21.15.99:0/852772525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0b4e70 0x7f571c071570 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f571c075590 tx=0x7f570c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365372f967f5a3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f571aa00640 1 -- 172.21.15.99:0/852772525 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c037070 con 0x7f571c0b4e70 2024-09-10T07:36:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f571aa00640 1 -- 172.21.15.99:0/852772525 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c032440 con 0x7f571c0b4e70 2024-09-10T07:36:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f571aa00640 1 -- 172.21.15.99:0/852772525 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c032810 con 0x7f571c0b4e70 2024-09-10T07:36:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f5722600640 1 -- 172.21.15.99:0/852772525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0b4e70 msgr2=0x7f571c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f5722600640 1 --2- 172.21.15.99:0/852772525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0b4e70 0x7f571c071570 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f571c075590 tx=0x7f570c02a1a0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f5722600640 1 -- 172.21.15.99:0/852772525 shutdown_connections 2024-09-10T07:36:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f5722600640 1 --2- 172.21.15.99:0/852772525 >> v2:172.21.15.187:3300/0 conn(0x7f571c0af250 0x7f571c06dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f5722600640 1 --2- 172.21.15.99:0/852772525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0b4e70 0x7f571c071570 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f5722600640 1 -- 172.21.15.99:0/852772525 >> 172.21.15.99:0/852772525 conn(0x7f571c06bc10 msgr2=0x7f571c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f5722600640 1 -- 172.21.15.99:0/852772525 shutdown_connections 2024-09-10T07:36:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.500+0000 7f5722600640 1 -- 172.21.15.99:0/852772525 wait complete. 2024-09-10T07:36:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.502+0000 7f5722600640 1 Processor -- start 2024-09-10T07:36:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.502+0000 7f5722600640 1 -- start start 2024-09-10T07:36:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f5722600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0af250 0x7f571c0ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f5722600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f571c0b4e70 0x7f571c14a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f5722600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f571c154370 0x7f571c1f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f5722600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f571c06ede0 con 0x7f571c0af250 2024-09-10T07:36:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f5722600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f571c06d820 con 0x7f571c0b4e70 2024-09-10T07:36:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f5722600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f571c06ef60 con 0x7f571c154370 2024-09-10T07:36:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f571b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0af250 0x7f571c0ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f571b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0af250 0x7f571c0ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48542/0 (socket says 172.21.15.99:48542) 2024-09-10T07:36:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f571b400640 1 -- 172.21.15.99:0/1044506 learned_addr learned my addr 172.21.15.99:0/1044506 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f5712a00640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f571c0b4e70 0x7f571c14a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f571b400640 1 -- 172.21.15.99:0/1044506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f571c154370 msgr2=0x7f571c1f4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f571b400640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f571c154370 0x7f571c1f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f571b400640 1 -- 172.21.15.99:0/1044506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f571c0b4e70 msgr2=0x7f571c14a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f571b400640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f571c0b4e70 0x7f571c14a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f571b400640 1 -- 172.21.15.99:0/1044506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c0cf220 con 0x7f571c0af250 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.503+0000 7f5712a00640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f571c0b4e70 0x7f571c14a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.504+0000 7f571b400640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0af250 0x7f571c0ce310 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f570c000c00 tx=0x7f570c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.504+0000 7f5713e00640 1 -- 172.21.15.99:0/1044506 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c037050 con 0x7f571c0af250 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.504+0000 7f5713e00640 1 -- 172.21.15.99:0/1044506 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c038040 con 0x7f571c0af250 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.504+0000 7f5713e00640 1 -- 172.21.15.99:0/1044506 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c004470 con 0x7f571c0af250 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.504+0000 7f5722600640 1 -- 172.21.15.99:0/1044506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c0ce980 con 0x7f571c0af250 2024-09-10T07:36:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.504+0000 7f5722600640 1 -- 172.21.15.99:0/1044506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c0cef40 con 0x7f571c0af250 2024-09-10T07:36:18.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.505+0000 7f5722600640 1 -- 172.21.15.99:0/1044506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571c0af6a0 con 0x7f571c0af250 2024-09-10T07:36:18.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.506+0000 7f5713e00640 1 -- 172.21.15.99:0/1044506 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f570c030900 con 0x7f571c0af250 2024-09-10T07:36:18.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.507+0000 7f5713e00640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f56f806be30 0x7f56f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.507+0000 7f5713e00640 1 -- 172.21.15.99:0/1044506 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f570c0ab700 con 0x7f571c0af250 2024-09-10T07:36:18.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.507+0000 7f5712a00640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f56f806be30 0x7f56f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.508+0000 7f5712a00640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f56f806be30 0x7f56f806e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f571c0cf8e0 tx=0x7f5704009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:18.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.511+0000 7f5713e00640 1 -- 172.21.15.99:0/1044506 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f570c07a560 con 0x7f571c0af250 2024-09-10T07:36:18.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.686+0000 7f5722600640 1 -- 172.21.15.99:0/1044506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f571c0b1ff0 con 0x7f571c0af250 2024-09-10T07:36:18.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.692+0000 7f5713e00640 1 -- 172.21.15.99:0/1044506 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) ==== 104+0+0 (secure 0 0 0) 0x7f570c079e60 con 0x7f571c0af250 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.694+0000 7f5722600640 1 -- 172.21.15.99:0/1044506 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f56f806be30 msgr2=0x7f56f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.694+0000 7f5722600640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f56f806be30 0x7f56f806e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f571c0cf8e0 tx=0x7f5704009040 comp rx=0 tx=0).stop 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.694+0000 7f5722600640 1 -- 172.21.15.99:0/1044506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0af250 msgr2=0x7f571c0ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.694+0000 7f5722600640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0af250 0x7f571c0ce310 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f570c000c00 tx=0x7f570c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.694+0000 7f5722600640 1 -- 172.21.15.99:0/1044506 shutdown_connections 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.694+0000 7f5722600640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f571c154370 0x7f571c1f4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.694+0000 7f5722600640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f571c0b4e70 0x7f571c14a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.694+0000 7f5722600640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f56f806be30 0x7f56f806e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.694+0000 7f5722600640 1 --2- 172.21.15.99:0/1044506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f571c0af250 0x7f571c0ce310 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.694+0000 7f5722600640 1 -- 172.21.15.99:0/1044506 >> 172.21.15.99:0/1044506 conn(0x7f571c06bc10 msgr2=0x7f571c0ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.695+0000 7f5722600640 1 -- 172.21.15.99:0/1044506 shutdown_connections 2024-09-10T07:36:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.695+0000 7f5722600640 1 -- 172.21.15.99:0/1044506 wait complete. 2024-09-10T07:36:18.715 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-10T07:36:18.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.868+0000 7fbd07c00640 1 Processor -- start 2024-09-10T07:36:18.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.869+0000 7fbd07c00640 1 -- start start 2024-09-10T07:36:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.870+0000 7fbd07c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00142150 0x7fbd00160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.870+0000 7fbd07c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd00160a80 0x7fbd000cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.870+0000 7fbd07c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd00142650 con 0x7fbd0013fae0 2024-09-10T07:36:18.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.870+0000 7fbd07c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbd000ce780 con 0x7fbd00160a80 2024-09-10T07:36:18.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.870+0000 7fbd07c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbd00142930 con 0x7fbd00142150 2024-09-10T07:36:18.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.871+0000 7fbd05c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd00160a80 0x7fbd000cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.871+0000 7fbcf7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00142150 0x7fbd00160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.871+0000 7fbd05200640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fbd0013fae0 0x7fbd0006f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:39202/0 (socket says 172.21.15.99:39202) 2024-09-10T07:36:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.871+0000 7fbd05200640 1 -- 172.21.15.99:0/134108592 learned_addr learned my addr 172.21.15.99:0/134108592 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.871+0000 7fbcf7e00640 1 -- 172.21.15.99:0/134108592 >> v2:172.21.15.187:3300/0 conn(0x7fbd00160a80 msgr2=0x7fbd000cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.871+0000 7fbcf7e00640 1 --2- 172.21.15.99:0/134108592 >> v2:172.21.15.187:3300/0 conn(0x7fbd00160a80 0x7fbd000cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.871+0000 7fbcf7e00640 1 -- 172.21.15.99:0/134108592 >> v1:172.21.15.187:6789/0 conn(0x7fbd0013fae0 legacy=0x7fbd0006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.871+0000 7fbcf7e00640 1 -- 172.21.15.99:0/134108592 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd00142c10 con 0x7fbd00142150 2024-09-10T07:36:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.872+0000 7fbcf7e00640 1 --2- 172.21.15.99:0/134108592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00142150 0x7fbd00160540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbce80097a0 tx=0x7fbce802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66f835b2c76c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbcffe00640 1 -- 172.21.15.99:0/134108592 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8037070 con 0x7fbd00142150 2024-09-10T07:36:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbcffe00640 1 -- 172.21.15.99:0/134108592 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce802ae50 con 0x7fbd00142150 2024-09-10T07:36:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbcffe00640 1 -- 172.21.15.99:0/134108592 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8032660 con 0x7fbd00142150 2024-09-10T07:36:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbd07c00640 1 -- 172.21.15.99:0/134108592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00142150 msgr2=0x7fbd00160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbd07c00640 1 --2- 172.21.15.99:0/134108592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00142150 0x7fbd00160540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbce80097a0 tx=0x7fbce802a100 comp rx=0 tx=0).stop 2024-09-10T07:36:18.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbd07c00640 1 -- 172.21.15.99:0/134108592 shutdown_connections 2024-09-10T07:36:18.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbd07c00640 1 --2- 172.21.15.99:0/134108592 >> v2:172.21.15.187:3300/0 conn(0x7fbd00160a80 0x7fbd000cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbd07c00640 1 --2- 172.21.15.99:0/134108592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00142150 0x7fbd00160540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbd07c00640 1 -- 172.21.15.99:0/134108592 >> 172.21.15.99:0/134108592 conn(0x7fbd0006bc10 msgr2=0x7fbd0006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:18.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbd07c00640 1 -- 172.21.15.99:0/134108592 shutdown_connections 2024-09-10T07:36:18.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.873+0000 7fbd07c00640 1 -- 172.21.15.99:0/134108592 wait complete. 2024-09-10T07:36:18.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.875+0000 7fbd07c00640 1 Processor -- start 2024-09-10T07:36:18.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.875+0000 7fbd07c00640 1 -- start start 2024-09-10T07:36:18.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbd07c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd0013fae0 0x7fbd0013e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbd07c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd00142150 0x7fbd00143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbd07c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00160a80 0x7fbd001e8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbd07c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbd000cf2d0 con 0x7fbd0013fae0 2024-09-10T07:36:18.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbd07c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbd000cf150 con 0x7fbd00142150 2024-09-10T07:36:18.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbd07c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbd000cf450 con 0x7fbd00160a80 2024-09-10T07:36:18.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbd05200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd0013fae0 0x7fbd0013e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbd05200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd0013fae0 0x7fbd0013e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48544/0 (socket says 172.21.15.99:48544) 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbd05200640 1 -- 172.21.15.99:0/191675050 learned_addr learned my addr 172.21.15.99:0/191675050 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbcf7e00640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd00142150 0x7fbd00143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.876+0000 7fbd05c00640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00160a80 0x7fbd001e8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbd05200640 1 -- 172.21.15.99:0/191675050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00160a80 msgr2=0x7fbd001e8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbd05200640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00160a80 0x7fbd001e8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbd05200640 1 -- 172.21.15.99:0/191675050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd00142150 msgr2=0x7fbd00143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbd05200640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd00142150 0x7fbd00143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbd05200640 1 -- 172.21.15.99:0/191675050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd00143bf0 con 0x7fbd0013fae0 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbd05200640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd0013fae0 0x7fbd0013e720 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c430 tx=0x7fbcf000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbcfd600640 1 -- 172.21.15.99:0/191675050 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0017070 con 0x7fbd0013fae0 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbcfd600640 1 -- 172.21.15.99:0/191675050 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf0005ce0 con 0x7fbd0013fae0 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbcfd600640 1 -- 172.21.15.99:0/191675050 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00072f0 con 0x7fbd0013fae0 2024-09-10T07:36:18.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbd07c00640 1 -- 172.21.15.99:0/191675050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd00143ed0 con 0x7fbd0013fae0 2024-09-10T07:36:18.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.877+0000 7fbd07c00640 1 -- 172.21.15.99:0/191675050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd00144490 con 0x7fbd0013fae0 2024-09-10T07:36:18.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.878+0000 7fbd07c00640 1 -- 172.21.15.99:0/191675050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd00160540 con 0x7fbd0013fae0 2024-09-10T07:36:18.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.879+0000 7fbcfd600640 1 -- 172.21.15.99:0/191675050 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcf001a070 con 0x7fbd0013fae0 2024-09-10T07:36:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.880+0000 7fbcfd600640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcdc06be30 0x7fbcdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.880+0000 7fbcfd600640 1 -- 172.21.15.99:0/191675050 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7fbcf0089ec0 con 0x7fbd0013fae0 2024-09-10T07:36:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.880+0000 7fbcf7e00640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcdc06be30 0x7fbcdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:18.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.881+0000 7fbcf7e00640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcdc06be30 0x7fbcdc06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbce8034000 tx=0x7fbce802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:18.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:18.885+0000 7fbcfd600640 1 -- 172.21.15.99:0/191675050 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbcf0058510 con 0x7fbd0013fae0 2024-09-10T07:36:19.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.126+0000 7fbd07c00640 1 -- 172.21.15.99:0/191675050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) -- 0x7fbd000b0e20 con 0x7fbd0013fae0 2024-09-10T07:36:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.316+0000 7fbcfd600640 1 -- 172.21.15.99:0/191675050 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v125) ==== 142+0+0 (secure 0 0 0) 0x7fbcf005c810 con 0x7fbd0013fae0 2024-09-10T07:36:19.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 -- 172.21.15.99:0/191675050 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcdc06be30 msgr2=0x7fbcdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcdc06be30 0x7fbcdc06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbce8034000 tx=0x7fbce802e000 comp rx=0 tx=0).stop 2024-09-10T07:36:19.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 -- 172.21.15.99:0/191675050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd0013fae0 msgr2=0x7fbd0013e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd0013fae0 0x7fbd0013e720 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c430 tx=0x7fbcf000c8f0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 -- 172.21.15.99:0/191675050 shutdown_connections 2024-09-10T07:36:19.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd00160a80 0x7fbd001e8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd00142150 0x7fbd00143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcdc06be30 0x7fbcdc06e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 --2- 172.21.15.99:0/191675050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd0013fae0 0x7fbd0013e720 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 -- 172.21.15.99:0/191675050 >> 172.21.15.99:0/191675050 conn(0x7fbd0006bc10 msgr2=0x7fbd0006e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:19.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 -- 172.21.15.99:0/191675050 shutdown_connections 2024-09-10T07:36:19.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.319+0000 7fbd07c00640 1 -- 172.21.15.99:0/191675050 wait complete. 2024-09-10T07:36:19.334 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-10T07:36:19.335 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2024-09-10T07:36:19.335 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:36:19.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.488+0000 7f6b75e00640 1 Processor -- start 2024-09-10T07:36:19.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.489+0000 7f6b75e00640 1 -- start start 2024-09-10T07:36:19.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b75e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 0x7f6b7006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b75e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6b700ce780 0x7f6b70072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b75e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b7006e3d0 con 0x7f6b70071510 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b75e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6b7006efe0 con 0x7f6b700ce780 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b75e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6b7006e6b0 con 0x7f6b70145290 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b66000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6b700ce780 0x7f6b70072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b66000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6b700ce780 0x7f6b70072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48552/0 (socket says 172.21.15.99:48552) 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b66000640 1 -- 172.21.15.99:0/96427072 learned_addr learned my addr 172.21.15.99:0/96427072 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b6ea00640 1 --2- 172.21.15.99:0/96427072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 0x7f6b7006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b66000640 1 -- 172.21.15.99:0/96427072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 msgr2=0x7f6b7006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b66000640 1 --2- 172.21.15.99:0/96427072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 0x7f6b7006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.490+0000 7f6b66000640 1 -- 172.21.15.99:0/96427072 >> v1:172.21.15.187:6789/0 conn(0x7f6b70071510 legacy=0x7f6b700b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.491+0000 7f6b66000640 1 -- 172.21.15.99:0/96427072 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7006e990 con 0x7f6b700ce780 2024-09-10T07:36:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.491+0000 7f6b6ea00640 1 --2- 172.21.15.99:0/96427072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 0x7f6b7006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.491+0000 7f6b66000640 1 --2- 172.21.15.99:0/96427072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b700ce780 0x7f6b70072830 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009870 tx=0x7f6b5802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f456504ecc0f709a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.492+0000 7f6b6e000640 1 -- 172.21.15.99:0/96427072 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b58037070 con 0x7f6b700ce780 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.492+0000 7f6b6e000640 1 -- 172.21.15.99:0/96427072 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b58032440 con 0x7f6b700ce780 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.492+0000 7f6b6e000640 1 -- 172.21.15.99:0/96427072 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b58032810 con 0x7f6b700ce780 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.492+0000 7f6b75e00640 1 -- 172.21.15.99:0/96427072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b700ce780 msgr2=0x7f6b70072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.492+0000 7f6b75e00640 1 --2- 172.21.15.99:0/96427072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b700ce780 0x7f6b70072830 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009870 tx=0x7f6b5802a210 comp rx=0 tx=0).stop 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.492+0000 7f6b75e00640 1 -- 172.21.15.99:0/96427072 shutdown_connections 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.492+0000 7f6b75e00640 1 --2- 172.21.15.99:0/96427072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b700ce780 0x7f6b70072830 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.492+0000 7f6b75e00640 1 --2- 172.21.15.99:0/96427072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 0x7f6b7006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.492+0000 7f6b75e00640 1 -- 172.21.15.99:0/96427072 >> 172.21.15.99:0/96427072 conn(0x7f6b7006bc10 msgr2=0x7f6b7006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.492+0000 7f6b75e00640 1 -- 172.21.15.99:0/96427072 shutdown_connections 2024-09-10T07:36:19.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.493+0000 7f6b75e00640 1 -- 172.21.15.99:0/96427072 wait complete. 2024-09-10T07:36:19.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.494+0000 7f6b75e00640 1 Processor -- start 2024-09-10T07:36:19.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.494+0000 7f6b75e00640 1 -- start start 2024-09-10T07:36:19.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.495+0000 7f6b75e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70071510 0x7f6b700b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.495+0000 7f6b75e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b700ce780 0x7f6b7013db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.495+0000 7f6b75e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 0x7f6b7013e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.495+0000 7f6b75e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7006df80 con 0x7f6b70071510 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.495+0000 7f6b75e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6b70145670 con 0x7f6b700ce780 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.495+0000 7f6b75e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6b7006e100 con 0x7f6b70145290 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.495+0000 7f6b6ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70071510 0x7f6b700b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.495+0000 7f6b6ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70071510 0x7f6b700b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48554/0 (socket says 172.21.15.99:48554) 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.495+0000 7f6b6ea00640 1 -- 172.21.15.99:0/110119409 learned_addr learned my addr 172.21.15.99:0/110119409 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b66000640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b700ce780 0x7f6b7013db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b6f400640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 0x7f6b7013e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b6ea00640 1 -- 172.21.15.99:0/110119409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 msgr2=0x7f6b7013e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b6ea00640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 0x7f6b7013e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b6ea00640 1 -- 172.21.15.99:0/110119409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b700ce780 msgr2=0x7f6b7013db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b6ea00640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b700ce780 0x7f6b7013db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b6ea00640 1 -- 172.21.15.99:0/110119409 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b700b4090 con 0x7f6b70071510 2024-09-10T07:36:19.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b66000640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b700ce780 0x7f6b7013db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:19.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b6f400640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 0x7f6b7013e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:19.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b6ea00640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70071510 0x7f6b700b3960 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000c820 tx=0x7f6b6000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:19.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b67e00640 1 -- 172.21.15.99:0/110119409 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60015070 con 0x7f6b70071510 2024-09-10T07:36:19.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b67e00640 1 -- 172.21.15.99:0/110119409 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b60007a30 con 0x7f6b70071510 2024-09-10T07:36:19.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b75e00640 1 -- 172.21.15.99:0/110119409 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b700b4370 con 0x7f6b70071510 2024-09-10T07:36:19.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.496+0000 7f6b67e00640 1 -- 172.21.15.99:0/110119409 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60007e00 con 0x7f6b70071510 2024-09-10T07:36:19.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.497+0000 7f6b75e00640 1 -- 172.21.15.99:0/110119409 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b700b4930 con 0x7f6b70071510 2024-09-10T07:36:19.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.498+0000 7f6b75e00640 1 -- 172.21.15.99:0/110119409 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b70069500 con 0x7f6b70071510 2024-09-10T07:36:19.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.498+0000 7f6b67e00640 1 -- 172.21.15.99:0/110119409 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b60018070 con 0x7f6b70071510 2024-09-10T07:36:19.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.499+0000 7f6b67e00640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b4c06be30 0x7f6b4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.499+0000 7f6b67e00640 1 -- 172.21.15.99:0/110119409 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f6b6008aa40 con 0x7f6b70071510 2024-09-10T07:36:19.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.500+0000 7f6b66000640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b4c06be30 0x7f6b4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.500+0000 7f6b66000640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b4c06be30 0x7f6b4c06e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b58034000 tx=0x7f6b5802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:19.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.503+0000 7f6b67e00640 1 -- 172.21.15.99:0/110119409 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b70069500 con 0x7f6b70071510 2024-09-10T07:36:19.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.677+0000 7f6b75e00640 1 -- 172.21.15.99:0/110119409 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b70072280 con 0x7f6b70071510 2024-09-10T07:36:19.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.678+0000 7f6b67e00640 1 -- 172.21.15.99:0/110119409 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+13008 (secure 0 0 0) 0x7f6b70072280 con 0x7f6b70071510 2024-09-10T07:36:19.678 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":57,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:36:18.312284+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6837/1015333121":"2024-09-11T07:36:15.300372+0000","172.21.15.99:6835/1015333121":"2024-09-11T07:36:15.300372+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:36:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 -- 172.21.15.99:0/110119409 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b4c06be30 msgr2=0x7f6b4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b4c06be30 0x7f6b4c06e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b58034000 tx=0x7f6b5802e000 comp rx=0 tx=0).stop 2024-09-10T07:36:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 -- 172.21.15.99:0/110119409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70071510 msgr2=0x7f6b700b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70071510 0x7f6b700b3960 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000c820 tx=0x7f6b6000cc20 comp rx=0 tx=0).stop 2024-09-10T07:36:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 -- 172.21.15.99:0/110119409 shutdown_connections 2024-09-10T07:36:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70145290 0x7f6b7013e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b700ce780 0x7f6b7013db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6b4c06be30 0x7f6b4c06e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 --2- 172.21.15.99:0/110119409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b70071510 0x7f6b700b3960 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 -- 172.21.15.99:0/110119409 >> 172.21.15.99:0/110119409 conn(0x7f6b7006bc10 msgr2=0x7f6b7015f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 -- 172.21.15.99:0/110119409 shutdown_connections 2024-09-10T07:36:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.680+0000 7f6b75e00640 1 -- 172.21.15.99:0/110119409 wait complete. 2024-09-10T07:36:19.698 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:34:08.744575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:36:19.699 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:36:19.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.855+0000 7f95b9c00640 1 Processor -- start 2024-09-10T07:36:19.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.855+0000 7f95b9c00640 1 -- start start 2024-09-10T07:36:19.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.856+0000 7f95b9c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b4155c80 0x7f95b415cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.856+0000 7f95b9c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f95b406eb60 0x7f95b415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.856+0000 7f95b9c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b4156060 con 0x7f95b415bb80 2024-09-10T07:36:19.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.856+0000 7f95b9c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f95b40723d0 con 0x7f95b406eb60 2024-09-10T07:36:19.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.856+0000 7f95b9c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f95b415c6f0 con 0x7f95b4155c80 2024-09-10T07:36:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.857+0000 7f95b9200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f95b406eb60 0x7f95b415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.857+0000 7f95b9200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f95b406eb60 0x7f95b415bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:42904/0 (socket says 172.21.15.99:42904) 2024-09-10T07:36:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.857+0000 7f95b3e00640 1 --2- 172.21.15.99:0/1256983692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b4155c80 0x7f95b415cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.857+0000 7f95b9200640 1 -- 172.21.15.99:0/1256983692 learned_addr learned my addr 172.21.15.99:0/1256983692 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.858+0000 7f95b3e00640 1 -- 172.21.15.99:0/1256983692 >> v2:172.21.15.187:3300/0 conn(0x7f95b406eb60 msgr2=0x7f95b415bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.858+0000 7f95b3e00640 1 --2- 172.21.15.99:0/1256983692 >> v2:172.21.15.187:3300/0 conn(0x7f95b406eb60 0x7f95b415bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.858+0000 7f95b3e00640 1 -- 172.21.15.99:0/1256983692 >> v1:172.21.15.187:6789/0 conn(0x7f95b415bb80 legacy=0x7f95b406e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.858+0000 7f95b3e00640 1 -- 172.21.15.99:0/1256983692 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b415c9d0 con 0x7f95b4155c80 2024-09-10T07:36:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.858+0000 7f95b9200640 1 --2- 172.21.15.99:0/1256983692 >> v2:172.21.15.187:3300/0 conn(0x7f95b406eb60 0x7f95b415bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:36:19.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.859+0000 7f95b3e00640 1 --2- 172.21.15.99:0/1256983692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b4155c80 0x7f95b415cd40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95a40097a0 tx=0x7f95a402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb855b99f2701ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.859+0000 7f95b3400640 1 -- 172.21.15.99:0/1256983692 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4037070 con 0x7f95b4155c80 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.859+0000 7f95b3400640 1 -- 172.21.15.99:0/1256983692 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a4032440 con 0x7f95b4155c80 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.859+0000 7f95b3400640 1 -- 172.21.15.99:0/1256983692 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4032810 con 0x7f95b4155c80 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.860+0000 7f95b9c00640 1 -- 172.21.15.99:0/1256983692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b4155c80 msgr2=0x7f95b415cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.860+0000 7f95b9c00640 1 --2- 172.21.15.99:0/1256983692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b4155c80 0x7f95b415cd40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95a40097a0 tx=0x7f95a402a180 comp rx=0 tx=0).stop 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.860+0000 7f95b9c00640 1 -- 172.21.15.99:0/1256983692 shutdown_connections 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.860+0000 7f95b9c00640 1 --2- 172.21.15.99:0/1256983692 >> v2:172.21.15.187:3300/0 conn(0x7f95b406eb60 0x7f95b415bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.860+0000 7f95b9c00640 1 --2- 172.21.15.99:0/1256983692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b4155c80 0x7f95b415cd40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.860+0000 7f95b9c00640 1 -- 172.21.15.99:0/1256983692 >> 172.21.15.99:0/1256983692 conn(0x7f95b40b2810 msgr2=0x7f95b40b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.860+0000 7f95b9c00640 1 -- 172.21.15.99:0/1256983692 shutdown_connections 2024-09-10T07:36:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.860+0000 7f95b9c00640 1 -- 172.21.15.99:0/1256983692 wait complete. 2024-09-10T07:36:19.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.861+0000 7f95b9c00640 1 Processor -- start 2024-09-10T07:36:19.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.862+0000 7f95b9c00640 1 -- start start 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.862+0000 7f95b9c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b406eb60 0x7f95b414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.862+0000 7f95b9c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b4155c80 0x7f95b406e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.862+0000 7f95b9c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b415bb80 0x7f95b4149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.862+0000 7f95b9c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f95b4071ce0 con 0x7f95b406eb60 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.862+0000 7f95b9c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f95b4072900 con 0x7f95b4155c80 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.862+0000 7f95b9c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f95b415d280 con 0x7f95b415bb80 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b406eb60 0x7f95b414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b406eb60 0x7f95b414b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58060/0 (socket says 172.21.15.99:58060) 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95b3e00640 1 -- 172.21.15.99:0/2691833342 learned_addr learned my addr 172.21.15.99:0/2691833342 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95b9200640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b415bb80 0x7f95b4149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95ab400640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b4155c80 0x7f95b406e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95b3e00640 1 -- 172.21.15.99:0/2691833342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b415bb80 msgr2=0x7f95b4149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95b3e00640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b415bb80 0x7f95b4149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95b3e00640 1 -- 172.21.15.99:0/2691833342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b4155c80 msgr2=0x7f95b406e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95b3e00640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b4155c80 0x7f95b406e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95b3e00640 1 -- 172.21.15.99:0/2691833342 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b414f9a0 con 0x7f95b406eb60 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.863+0000 7f95b3e00640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b406eb60 0x7f95b414b9d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f95a4035040 tx=0x7f95a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.864+0000 7f95b0c00640 1 -- 172.21.15.99:0/2691833342 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4037040 con 0x7f95b406eb60 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.864+0000 7f95b0c00640 1 -- 172.21.15.99:0/2691833342 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a4030500 con 0x7f95b406eb60 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.864+0000 7f95b9c00640 1 -- 172.21.15.99:0/2691833342 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b414fc80 con 0x7f95b406eb60 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.864+0000 7f95b0c00640 1 -- 172.21.15.99:0/2691833342 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4030910 con 0x7f95b406eb60 2024-09-10T07:36:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.864+0000 7f95b9c00640 1 -- 172.21.15.99:0/2691833342 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b4147c10 con 0x7f95b406eb60 2024-09-10T07:36:19.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.865+0000 7f95b9c00640 1 -- 172.21.15.99:0/2691833342 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b415cd40 con 0x7f95b406eb60 2024-09-10T07:36:19.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.866+0000 7f95b0c00640 1 -- 172.21.15.99:0/2691833342 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95a4044020 con 0x7f95b406eb60 2024-09-10T07:36:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.867+0000 7f95b0c00640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f959006be30 0x7f959006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.867+0000 7f95b0c00640 1 -- 172.21.15.99:0/2691833342 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f95a40aace0 con 0x7f95b406eb60 2024-09-10T07:36:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.867+0000 7f95ab400640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f959006be30 0x7f959006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.867+0000 7f95ab400640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f959006be30 0x7f959006e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f95b415c360 tx=0x7f959c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:19.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:19.871+0000 7f95b0c00640 1 -- 172.21.15.99:0/2691833342 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95a4079330 con 0x7f95b406eb60 2024-09-10T07:36:20.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.043+0000 7f95b9c00640 1 -- 172.21.15.99:0/2691833342 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f95b415bfe0 con 0x7f95b406eb60 2024-09-10T07:36:20.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.043+0000 7f95b0c00640 1 -- 172.21.15.99:0/2691833342 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) ==== 93+0+10 (secure 0 0 0) 0x7f95a407d630 con 0x7f95b406eb60 2024-09-10T07:36:20.043 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-10T07:36:20.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.045+0000 7f95b9c00640 1 -- 172.21.15.99:0/2691833342 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f959006be30 msgr2=0x7f959006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.045+0000 7f95b9c00640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f959006be30 0x7f959006e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f95b415c360 tx=0x7f959c009040 comp rx=0 tx=0).stop 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.045+0000 7f95b9c00640 1 -- 172.21.15.99:0/2691833342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b406eb60 msgr2=0x7f95b414b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.045+0000 7f95b9c00640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b406eb60 0x7f95b414b9d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f95a4035040 tx=0x7f95a40046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.045+0000 7f95b9c00640 1 -- 172.21.15.99:0/2691833342 shutdown_connections 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.045+0000 7f95b9c00640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b415bb80 0x7f95b4149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.045+0000 7f95b9c00640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b4155c80 0x7f95b406e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.045+0000 7f95b9c00640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f959006be30 0x7f959006e2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.045+0000 7f95b9c00640 1 --2- 172.21.15.99:0/2691833342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95b406eb60 0x7f95b414b9d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.045+0000 7f95b9c00640 1 -- 172.21.15.99:0/2691833342 >> 172.21.15.99:0/2691833342 conn(0x7f95b40b2810 msgr2=0x7f95b4154b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.046+0000 7f95b9c00640 1 -- 172.21.15.99:0/2691833342 shutdown_connections 2024-09-10T07:36:20.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.046+0000 7f95b9c00640 1 -- 172.21.15.99:0/2691833342 wait complete. 2024-09-10T07:36:20.061 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-10T07:36:20.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.214+0000 7f9757600640 1 Processor -- start 2024-09-10T07:36:20.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.214+0000 7f9757600640 1 -- start start 2024-09-10T07:36:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f9757600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f975013fae0 0x7f975006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f9757600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9750160c50 0x7f97500cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f9757600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9750142650 con 0x7f9750142150 2024-09-10T07:36:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f9757600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f97500ce780 con 0x7f975013fae0 2024-09-10T07:36:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f9757600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9750142930 con 0x7f9750160c50 2024-09-10T07:36:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f9747e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9750142150 0x7f9750160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52044/0 (socket says 172.21.15.99:52044) 2024-09-10T07:36:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f9747e00640 1 -- 172.21.15.99:0/1953292030 learned_addr learned my addr 172.21.15.99:0/1953292030 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f9754c00640 1 --2- 172.21.15.99:0/1953292030 >> v2:172.21.15.187:3300/0 conn(0x7f975013fae0 0x7f975006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f9755600640 1 --2- 172.21.15.99:0/1953292030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9750160c50 0x7f97500cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f974fe00640 1 -- 172.21.15.99:0/1953292030 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372056167 0 0) 0x7f9750142650 con 0x7f9750142150 2024-09-10T07:36:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.216+0000 7f974fe00640 1 -- 172.21.15.99:0/1953292030 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9734003520 con 0x7f9750142150 2024-09-10T07:36:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.217+0000 7f9754c00640 1 -- 172.21.15.99:0/1953292030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9750160c50 msgr2=0x7f97500cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.217+0000 7f9754c00640 1 --2- 172.21.15.99:0/1953292030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9750160c50 0x7f97500cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.217+0000 7f974fe00640 1 -- 172.21.15.99:0/1953292030 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 403534623 0 0) 0x7f9734003520 con 0x7f9750142150 2024-09-10T07:36:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.217+0000 7f9754c00640 1 -- 172.21.15.99:0/1953292030 >> v1:172.21.15.99:6789/0 conn(0x7f9750142150 legacy=0x7f9750160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.217+0000 7f9754c00640 1 -- 172.21.15.99:0/1953292030 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9750142c10 con 0x7f975013fae0 2024-09-10T07:36:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.218+0000 7f9754c00640 1 --2- 172.21.15.99:0/1953292030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f975013fae0 0x7f975006f1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f97400097a0 tx=0x7f974002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f69e98e67232938 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.218+0000 7f974fe00640 1 -- 172.21.15.99:0/1953292030 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740037070 con 0x7f975013fae0 2024-09-10T07:36:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.218+0000 7f974fe00640 1 -- 172.21.15.99:0/1953292030 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974002ab10 con 0x7f975013fae0 2024-09-10T07:36:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.218+0000 7f974fe00640 1 -- 172.21.15.99:0/1953292030 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738001670 con 0x7f975013fae0 2024-09-10T07:36:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.219+0000 7f9757600640 1 -- 172.21.15.99:0/1953292030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f975013fae0 msgr2=0x7f975006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.219+0000 7f9757600640 1 --2- 172.21.15.99:0/1953292030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f975013fae0 0x7f975006f1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f97400097a0 tx=0x7f974002a080 comp rx=0 tx=0).stop 2024-09-10T07:36:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.219+0000 7f9757600640 1 -- 172.21.15.99:0/1953292030 shutdown_connections 2024-09-10T07:36:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.219+0000 7f9757600640 1 --2- 172.21.15.99:0/1953292030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9750160c50 0x7f97500cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.219+0000 7f9757600640 1 --2- 172.21.15.99:0/1953292030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f975013fae0 0x7f975006f1b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.219+0000 7f9757600640 1 -- 172.21.15.99:0/1953292030 >> 172.21.15.99:0/1953292030 conn(0x7f975006bc10 msgr2=0x7f975006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.219+0000 7f9757600640 1 -- 172.21.15.99:0/1953292030 shutdown_connections 2024-09-10T07:36:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.219+0000 7f9757600640 1 -- 172.21.15.99:0/1953292030 wait complete. 2024-09-10T07:36:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.220+0000 7f9757600640 1 Processor -- start 2024-09-10T07:36:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.220+0000 7f9757600640 1 -- start start 2024-09-10T07:36:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.221+0000 7f9757600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f975013fae0 0x7f97501f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.221+0000 7f9757600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750142150 0x7f97501ef890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.221+0000 7f9757600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9750160c50 0x7f9750144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.221+0000 7f9757600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f975006f870 con 0x7f9750142150 2024-09-10T07:36:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.221+0000 7f9757600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f975006f6f0 con 0x7f975013fae0 2024-09-10T07:36:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.221+0000 7f9757600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f97500cf150 con 0x7f9750160c50 2024-09-10T07:36:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.221+0000 7f9747e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750142150 0x7f97501ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f9747e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750142150 0x7f97501ef890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58072/0 (socket says 172.21.15.99:58072) 2024-09-10T07:36:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f9747e00640 1 -- 172.21.15.99:0/2867020976 learned_addr learned my addr 172.21.15.99:0/2867020976 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f9755600640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9750160c50 0x7f9750144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f9754c00640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f975013fae0 0x7f97501f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f9747e00640 1 -- 172.21.15.99:0/2867020976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9750160c50 msgr2=0x7f9750144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f9747e00640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9750160c50 0x7f9750144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f9747e00640 1 -- 172.21.15.99:0/2867020976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f975013fae0 msgr2=0x7f97501f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f9747e00640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f975013fae0 0x7f97501f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f9747e00640 1 -- 172.21.15.99:0/2867020976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97501592a0 con 0x7f9750142150 2024-09-10T07:36:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f9747e00640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750142150 0x7f97501ef890 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f97380011e0 tx=0x7f973800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f974d600640 1 -- 172.21.15.99:0/2867020976 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738017070 con 0x7f9750142150 2024-09-10T07:36:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.222+0000 7f974d600640 1 -- 172.21.15.99:0/2867020976 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9738005ad0 con 0x7f9750142150 2024-09-10T07:36:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.223+0000 7f9757600640 1 -- 172.21.15.99:0/2867020976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9750159580 con 0x7f9750142150 2024-09-10T07:36:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.223+0000 7f974d600640 1 -- 172.21.15.99:0/2867020976 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738007070 con 0x7f9750142150 2024-09-10T07:36:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.223+0000 7f9757600640 1 -- 172.21.15.99:0/2867020976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9750159b40 con 0x7f9750142150 2024-09-10T07:36:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.224+0000 7f9757600640 1 -- 172.21.15.99:0/2867020976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975006f1b0 con 0x7f9750142150 2024-09-10T07:36:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.225+0000 7f974d600640 1 -- 172.21.15.99:0/2867020976 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f973801a070 con 0x7f9750142150 2024-09-10T07:36:20.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.225+0000 7f974d600640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f972c06be60 0x7f972c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:20.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.226+0000 7f974d600640 1 -- 172.21.15.99:0/2867020976 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f9738089ea0 con 0x7f9750142150 2024-09-10T07:36:20.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.226+0000 7f9754c00640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f972c06be60 0x7f972c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:20.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.226+0000 7f9754c00640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f972c06be60 0x7f972c06e320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9740034000 tx=0x7f974002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:20.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.230+0000 7f974d600640 1 -- 172.21.15.99:0/2867020976 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9738058590 con 0x7f9750142150 2024-09-10T07:36:20.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:20.466+0000 7f9757600640 1 -- 172.21.15.99:0/2867020976 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) -- 0x7f97501602f0 con 0x7f9750142150 2024-09-10T07:36:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.324+0000 7f974d600640 1 -- 172.21.15.99:0/2867020976 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v127) ==== 137+0+0 (secure 0 0 0) 0x7f973805c890 con 0x7f9750142150 2024-09-10T07:36:21.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 -- 172.21.15.99:0/2867020976 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f972c06be60 msgr2=0x7f972c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:21.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f972c06be60 0x7f972c06e320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9740034000 tx=0x7f974002e000 comp rx=0 tx=0).stop 2024-09-10T07:36:21.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 -- 172.21.15.99:0/2867020976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750142150 msgr2=0x7f97501ef890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750142150 0x7f97501ef890 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f97380011e0 tx=0x7f973800cbe0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 -- 172.21.15.99:0/2867020976 shutdown_connections 2024-09-10T07:36:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9750160c50 0x7f9750144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f972c06be60 0x7f972c06e320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750142150 0x7f97501ef890 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 --2- 172.21.15.99:0/2867020976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f975013fae0 0x7f97501f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 -- 172.21.15.99:0/2867020976 >> 172.21.15.99:0/2867020976 conn(0x7f975006bc10 msgr2=0x7f97500cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.327+0000 7f9757600640 1 -- 172.21.15.99:0/2867020976 shutdown_connections 2024-09-10T07:36:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.328+0000 7f9757600640 1 -- 172.21.15.99:0/2867020976 wait complete. 2024-09-10T07:36:21.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-10T07:36:21.517 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_objectstore":"memstore"} 2024-09-10T07:36:21.518 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-10T07:36:21.518 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T07:36:21.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.675+0000 7f29bda00640 1 Processor -- start 2024-09-10T07:36:21.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.676+0000 7f29bda00640 1 -- start start 2024-09-10T07:36:21.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29bda00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29b80b4e70 0x7f29b8071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:21.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29bda00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29b815ece0 0x7f29b80b5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:21.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29bda00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f29b80af250 0x7f29b806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:21.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29bda00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f29b80d1780 con 0x7f29b80b4e70 2024-09-10T07:36:21.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29bda00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f29b806d5d0 con 0x7f29b80af250 2024-09-10T07:36:21.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29bda00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f29b80b5790 con 0x7f29b815ece0 2024-09-10T07:36:21.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29b6a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29b80b4e70 0x7f29b8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:21.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29b6a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29b80b4e70 0x7f29b8071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58084/0 (socket says 172.21.15.99:58084) 2024-09-10T07:36:21.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29b6a00640 1 -- 172.21.15.99:0/2196708791 learned_addr learned my addr 172.21.15.99:0/2196708791 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:21.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29b6a00640 1 -- 172.21.15.99:0/2196708791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29b815ece0 msgr2=0x7f29b80b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:21.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29b6a00640 1 --2- 172.21.15.99:0/2196708791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29b815ece0 0x7f29b80b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29b6a00640 1 -- 172.21.15.99:0/2196708791 >> v2:172.21.15.187:3300/0 conn(0x7f29b80af250 msgr2=0x7f29b806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:21.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29b6a00640 1 --2- 172.21.15.99:0/2196708791 >> v2:172.21.15.187:3300/0 conn(0x7f29b80af250 0x7f29b806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.677+0000 7f29b6a00640 1 -- 172.21.15.99:0/2196708791 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b806f1a0 con 0x7f29b80b4e70 2024-09-10T07:36:21.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.678+0000 7f29b6a00640 1 --2- 172.21.15.99:0/2196708791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 0x7f29b8071570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f29b8071500 tx=0x7f29a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ba90900bead2e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:21.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29b6000640 1 -- 172.21.15.99:0/2196708791 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8037070 con 0x7f29b80b4e70 2024-09-10T07:36:21.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29b6000640 1 -- 172.21.15.99:0/2196708791 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a8032440 con 0x7f29b80b4e70 2024-09-10T07:36:21.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29b6000640 1 -- 172.21.15.99:0/2196708791 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8032810 con 0x7f29b80b4e70 2024-09-10T07:36:21.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29bda00640 1 -- 172.21.15.99:0/2196708791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 msgr2=0x7f29b8071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:21.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29bda00640 1 --2- 172.21.15.99:0/2196708791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 0x7f29b8071570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f29b8071500 tx=0x7f29a802a1e0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29bda00640 1 -- 172.21.15.99:0/2196708791 shutdown_connections 2024-09-10T07:36:21.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29bda00640 1 --2- 172.21.15.99:0/2196708791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29b815ece0 0x7f29b80b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29bda00640 1 --2- 172.21.15.99:0/2196708791 >> v2:172.21.15.187:3300/0 conn(0x7f29b80af250 0x7f29b806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29bda00640 1 --2- 172.21.15.99:0/2196708791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 0x7f29b8071570 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29bda00640 1 -- 172.21.15.99:0/2196708791 >> 172.21.15.99:0/2196708791 conn(0x7f29b806bc10 msgr2=0x7f29b806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:21.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29bda00640 1 -- 172.21.15.99:0/2196708791 shutdown_connections 2024-09-10T07:36:21.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.679+0000 7f29bda00640 1 -- 172.21.15.99:0/2196708791 wait complete. 2024-09-10T07:36:21.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.681+0000 7f29bda00640 1 Processor -- start 2024-09-10T07:36:21.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.681+0000 7f29bda00640 1 -- start start 2024-09-10T07:36:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.682+0000 7f29bda00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29b80af250 0x7f29b81501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.682+0000 7f29bda00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 0x7f29b8156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.682+0000 7f29bda00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29b80cec50 0x7f29b8152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.682+0000 7f29bda00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f29b806d820 con 0x7f29b80b4e70 2024-09-10T07:36:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.682+0000 7f29bda00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f29b806f760 con 0x7f29b80cec50 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.682+0000 7f29bda00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f29b806ede0 con 0x7f29b80af250 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.682+0000 7f29ae000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 0x7f29b8156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.682+0000 7f29ae000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 0x7f29b8156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58098/0 (socket says 172.21.15.99:58098) 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.682+0000 7f29ae000640 1 -- 172.21.15.99:0/507157658 learned_addr learned my addr 172.21.15.99:0/507157658 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.682+0000 7f29b6a00640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29b80af250 0x7f29b81501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29b7400640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29b80cec50 0x7f29b8152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29ae000640 1 -- 172.21.15.99:0/507157658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29b80af250 msgr2=0x7f29b81501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29ae000640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29b80af250 0x7f29b81501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29ae000640 1 -- 172.21.15.99:0/507157658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29b80cec50 msgr2=0x7f29b8152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29ae000640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29b80cec50 0x7f29b8152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29ae000640 1 -- 172.21.15.99:0/507157658 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b8150730 con 0x7f29b80b4e70 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29b6a00640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29b80af250 0x7f29b81501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29ae000640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 0x7f29b8156f30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f29a000b480 tx=0x7f29a000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29af400640 1 -- 172.21.15.99:0/507157658 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0014070 con 0x7f29b80b4e70 2024-09-10T07:36:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29af400640 1 -- 172.21.15.99:0/507157658 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a0010870 con 0x7f29b80b4e70 2024-09-10T07:36:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29af400640 1 -- 172.21.15.99:0/507157658 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0010c60 con 0x7f29b80b4e70 2024-09-10T07:36:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29bda00640 1 -- 172.21.15.99:0/507157658 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b8160400 con 0x7f29b80b4e70 2024-09-10T07:36:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.683+0000 7f29bda00640 1 -- 172.21.15.99:0/507157658 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b81606a0 con 0x7f29b80b4e70 2024-09-10T07:36:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.684+0000 7f29bda00640 1 -- 172.21.15.99:0/507157658 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b80af6a0 con 0x7f29b80b4e70 2024-09-10T07:36:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.685+0000 7f29af400640 1 -- 172.21.15.99:0/507157658 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29a0017070 con 0x7f29b80b4e70 2024-09-10T07:36:21.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.686+0000 7f29af400640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f299406be30 0x7f299406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:21.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.686+0000 7f29af400640 1 -- 172.21.15.99:0/507157658 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f29a008a9b0 con 0x7f29b80b4e70 2024-09-10T07:36:21.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.686+0000 7f29b6a00640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f299406be30 0x7f299406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:21.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.687+0000 7f29b6a00640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f299406be30 0x7f299406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f29a8034000 tx=0x7f29a802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:21.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.690+0000 7f29af400640 1 -- 172.21.15.99:0/507157658 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29a0059650 con 0x7f29b80b4e70 2024-09-10T07:36:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.861+0000 7f29bda00640 1 -- 172.21.15.99:0/507157658 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f29b8159d50 con 0x7f29b80b4e70 2024-09-10T07:36:21.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.866+0000 7f29af400640 1 -- 172.21.15.99:0/507157658 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f29a0058f50 con 0x7f29b80b4e70 2024-09-10T07:36:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 -- 172.21.15.99:0/507157658 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f299406be30 msgr2=0x7f299406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f299406be30 0x7f299406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f29a8034000 tx=0x7f29a802e000 comp rx=0 tx=0).stop 2024-09-10T07:36:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 -- 172.21.15.99:0/507157658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 msgr2=0x7f29b8156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 0x7f29b8156f30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f29a000b480 tx=0x7f29a000b940 comp rx=0 tx=0).stop 2024-09-10T07:36:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 -- 172.21.15.99:0/507157658 shutdown_connections 2024-09-10T07:36:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29b80cec50 0x7f29b8152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f299406be30 0x7f299406e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29b80b4e70 0x7f29b8156f30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 --2- 172.21.15.99:0/507157658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29b80af250 0x7f29b81501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 -- 172.21.15.99:0/507157658 >> 172.21.15.99:0/507157658 conn(0x7f29b806bc10 msgr2=0x7f29b8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 -- 172.21.15.99:0/507157658 shutdown_connections 2024-09-10T07:36:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:21.869+0000 7f29bda00640 1 -- 172.21.15.99:0/507157658 wait complete. 2024-09-10T07:36:21.885 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:36:21.885 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:36:21.981 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:36:22.071 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:36:22.071 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:36:22.072 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:22.108 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:36:22.108 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:36:22.108 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:22.145 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:36:22.145 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:36:22.145 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:22.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:36:22.184 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:36:22.185 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:22.222 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:36:22.222 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T07:36:22.222 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:36:22.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.379+0000 7f4511000640 1 Processor -- start 2024-09-10T07:36:22.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.379+0000 7f4511000640 1 -- start start 2024-09-10T07:36:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.379+0000 7f4511000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f450c155c80 0x7f450c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.379+0000 7f4511000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f450c15bb80 0x7f450c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.379+0000 7f4511000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f450c156060 con 0x7f450c06e450 2024-09-10T07:36:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.379+0000 7f4511000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f450c0723d0 con 0x7f450c155c80 2024-09-10T07:36:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.379+0000 7f4511000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f450c15c6f0 con 0x7f450c15bb80 2024-09-10T07:36:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.379+0000 7f450b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f450c155c80 0x7f450c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.379+0000 7f450b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f450c155c80 0x7f450c15cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58110/0 (socket says 172.21.15.99:58110) 2024-09-10T07:36:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.379+0000 7f450b400640 1 -- 172.21.15.99:0/3709081680 learned_addr learned my addr 172.21.15.99:0/3709081680 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.380+0000 7f450aa00640 1 --2- 172.21.15.99:0/3709081680 >> v2:172.21.15.187:3300/0 conn(0x7f450c15bb80 0x7f450c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.380+0000 7f450b400640 1 -- 172.21.15.99:0/3709081680 >> v2:172.21.15.187:3300/0 conn(0x7f450c15bb80 msgr2=0x7f450c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.380+0000 7f450b400640 1 --2- 172.21.15.99:0/3709081680 >> v2:172.21.15.187:3300/0 conn(0x7f450c15bb80 0x7f450c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.380+0000 7f450b400640 1 -- 172.21.15.99:0/3709081680 >> v1:172.21.15.99:6789/0 conn(0x7f450c06e450 legacy=0x7f450c072e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.380+0000 7f450b400640 1 -- 172.21.15.99:0/3709081680 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c15c9d0 con 0x7f450c155c80 2024-09-10T07:36:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.380+0000 7f450a000640 1 -- 172.21.15.99:0/3709081680 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 835145985 0 0) 0x7f4504001490 con 0x7f450c06e450 2024-09-10T07:36:22.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.381+0000 7f450b400640 1 --2- 172.21.15.99:0/3709081680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c155c80 0x7f450c15cd40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f450c06f640 tx=0x7f44fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a6ce91d5ef81af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:22.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.381+0000 7f450a000640 1 -- 172.21.15.99:0/3709081680 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc037070 con 0x7f450c155c80 2024-09-10T07:36:22.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.381+0000 7f450a000640 1 -- 172.21.15.99:0/3709081680 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44fc032440 con 0x7f450c155c80 2024-09-10T07:36:22.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.381+0000 7f450a000640 1 -- 172.21.15.99:0/3709081680 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc032810 con 0x7f450c155c80 2024-09-10T07:36:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.382+0000 7f4511000640 1 -- 172.21.15.99:0/3709081680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c155c80 msgr2=0x7f450c15cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.382+0000 7f4511000640 1 --2- 172.21.15.99:0/3709081680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c155c80 0x7f450c15cd40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f450c06f640 tx=0x7f44fc02a270 comp rx=0 tx=0).stop 2024-09-10T07:36:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.382+0000 7f4511000640 1 -- 172.21.15.99:0/3709081680 shutdown_connections 2024-09-10T07:36:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.382+0000 7f4511000640 1 --2- 172.21.15.99:0/3709081680 >> v2:172.21.15.187:3300/0 conn(0x7f450c15bb80 0x7f450c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.382+0000 7f4511000640 1 --2- 172.21.15.99:0/3709081680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c155c80 0x7f450c15cd40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.382+0000 7f4511000640 1 -- 172.21.15.99:0/3709081680 >> 172.21.15.99:0/3709081680 conn(0x7f450c0b2810 msgr2=0x7f450c0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.382+0000 7f4511000640 1 -- 172.21.15.99:0/3709081680 shutdown_connections 2024-09-10T07:36:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.382+0000 7f4511000640 1 -- 172.21.15.99:0/3709081680 wait complete. 2024-09-10T07:36:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.383+0000 7f4511000640 1 Processor -- start 2024-09-10T07:36:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.384+0000 7f4511000640 1 -- start start 2024-09-10T07:36:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.384+0000 7f4511000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c06e450 0x7f450c156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.384+0000 7f4511000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450c155c80 0x7f450c158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.384+0000 7f4511000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450c15bb80 0x7f450c150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.384+0000 7f4511000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f450c071ce0 con 0x7f450c06e450 2024-09-10T07:36:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.384+0000 7f4511000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f450c072900 con 0x7f450c15bb80 2024-09-10T07:36:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.384+0000 7f4511000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f450c15d280 con 0x7f450c155c80 2024-09-10T07:36:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c06e450 0x7f450c156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c06e450 0x7f450c156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58118/0 (socket says 172.21.15.99:58118) 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450b400640 1 -- 172.21.15.99:0/3954964473 learned_addr learned my addr 172.21.15.99:0/3954964473 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450be00640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450c15bb80 0x7f450c150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450aa00640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450c155c80 0x7f450c158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450b400640 1 -- 172.21.15.99:0/3954964473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450c155c80 msgr2=0x7f450c158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450b400640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450c155c80 0x7f450c158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450b400640 1 -- 172.21.15.99:0/3954964473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450c15bb80 msgr2=0x7f450c150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450b400640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450c15bb80 0x7f450c150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450b400640 1 -- 172.21.15.99:0/3954964473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c156780 con 0x7f450c06e450 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450aa00640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450c155c80 0x7f450c158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.385+0000 7f450b400640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c06e450 0x7f450c156240 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f44fc02a2b0 tx=0x7f44fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.386+0000 7f4503400640 1 -- 172.21.15.99:0/3954964473 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc041020 con 0x7f450c06e450 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.386+0000 7f4503400640 1 -- 172.21.15.99:0/3954964473 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44fc0306c0 con 0x7f450c06e450 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.386+0000 7f4503400640 1 -- 172.21.15.99:0/3954964473 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc037040 con 0x7f450c06e450 2024-09-10T07:36:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.386+0000 7f4511000640 1 -- 172.21.15.99:0/3954964473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450c159170 con 0x7f450c06e450 2024-09-10T07:36:22.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.386+0000 7f4511000640 1 -- 172.21.15.99:0/3954964473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450c150870 con 0x7f450c06e450 2024-09-10T07:36:22.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.387+0000 7f4511000640 1 -- 172.21.15.99:0/3954964473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450c0ce0b0 con 0x7f450c06e450 2024-09-10T07:36:22.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.388+0000 7f4503400640 1 -- 172.21.15.99:0/3954964473 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44fc044020 con 0x7f450c06e450 2024-09-10T07:36:22.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.388+0000 7f4503400640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44ec06be30 0x7f44ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.388+0000 7f4503400640 1 -- 172.21.15.99:0/3954964473 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f44fc0ab440 con 0x7f450c06e450 2024-09-10T07:36:22.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.389+0000 7f450aa00640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44ec06be30 0x7f44ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.389+0000 7f450aa00640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44ec06be30 0x7f44ec06e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f450c150d50 tx=0x7f44f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:22.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.393+0000 7f4503400640 1 -- 172.21.15.99:0/3954964473 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44fc04b030 con 0x7f450c06e450 2024-09-10T07:36:22.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.599+0000 7f4511000640 1 -- 172.21.15.99:0/3954964473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f450c15cd40 con 0x7f450c06e450 2024-09-10T07:36:22.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.600+0000 7f4503400640 1 -- 172.21.15.99:0/3954964473 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+3914 (secure 0 0 0) 0x7f44fc07a050 con 0x7f450c06e450 2024-09-10T07:36:22.601 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:22.601 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":27,"btime":"2024-09-10T07:36:16:302605+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/2667247037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2667247037},{"type":"v1","addr":"172.21.15.99:6836","nonce":2667247037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/588885740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":588885740},{"type":"v1","addr":"172.21.15.187:6834","nonce":588885740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2599063325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2599063325},{"type":"v1","addr":"172.21.15.187:6835","nonce":2599063325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5382,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2879484729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":2879484729},{"type":"v1","addr":"172.21.15.99:6837","nonce":2879484729}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[]} 2024-09-10T07:36:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 27 2024-09-10T07:36:22.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 -- 172.21.15.99:0/3954964473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44ec06be30 msgr2=0x7f44ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:22.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44ec06be30 0x7f44ec06e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f450c150d50 tx=0x7f44f8008040 comp rx=0 tx=0).stop 2024-09-10T07:36:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 -- 172.21.15.99:0/3954964473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c06e450 msgr2=0x7f450c156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c06e450 0x7f450c156240 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f44fc02a2b0 tx=0x7f44fc0046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 -- 172.21.15.99:0/3954964473 shutdown_connections 2024-09-10T07:36:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450c15bb80 0x7f450c150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450c155c80 0x7f450c158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44ec06be30 0x7f44ec06e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 --2- 172.21.15.99:0/3954964473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f450c06e450 0x7f450c156240 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 -- 172.21.15.99:0/3954964473 >> 172.21.15.99:0/3954964473 conn(0x7f450c0b2810 msgr2=0x7f450c15de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:22.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 -- 172.21.15.99:0/3954964473 shutdown_connections 2024-09-10T07:36:22.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.603+0000 7f4511000640 1 -- 172.21.15.99:0/3954964473 wait complete. 2024-09-10T07:36:22.618 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:36:22.618 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T07:36:22.618 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:36:22.618 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:36:22.619 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:36:22.619 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T07:36:22.619 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:36:22.619 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:36:22.619 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:36:22.619 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T07:36:22.619 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:36:22.620 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:36:22.620 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:36:22.620 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T07:36:22.620 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:36:22.620 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:36:22.633 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:36:22.633 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:36:22.634 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:36:22.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:36:22.635 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:36:22.635 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:36:22.636 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:36:22.636 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:36:22.678 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:36:22.678 DEBUG:teuthology.parallel:result is None 2024-09-10T07:36:22.680 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:36:22.680 DEBUG:teuthology.parallel:result is None 2024-09-10T07:36:22.681 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:36:22.682 DEBUG:teuthology.parallel:result is None 2024-09-10T07:36:22.682 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:36:22.682 DEBUG:teuthology.parallel:result is None 2024-09-10T07:36:22.682 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T07:36:22.811 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:36:22.811 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:36:22.811 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:36:22.812 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:36:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.848+0000 7fae5b400640 1 Processor -- start 2024-09-10T07:36:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.848+0000 7fae5b400640 1 -- start start 2024-09-10T07:36:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae5b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae5415cbb0 0x7fae540b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae5b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae540cfb80 0x7fae540d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae5b400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5415cf90 con 0x7fae540b1ba0 2024-09-10T07:36:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae5b400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fae540ce980 con 0x7fae540cfb80 2024-09-10T07:36:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae5b400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fae540d02a0 con 0x7fae5415cbb0 2024-09-10T07:36:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae58a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae5415cbb0 0x7fae540b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae59400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae540cfb80 0x7fae540d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae58a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae5415cbb0 0x7fae540b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:43860/0 (socket says 172.21.15.99:43860) 2024-09-10T07:36:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae59400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae540cfb80 0x7fae540d0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:42990/0 (socket says 172.21.15.99:42990) 2024-09-10T07:36:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae58a00640 1 -- 172.21.15.99:0/1891369948 learned_addr learned my addr 172.21.15.99:0/1891369948 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.849+0000 7fae53e00640 1 --1- 172.21.15.99:0/1891369948 >> v1:172.21.15.187:6789/0 conn(0x7fae540b1ba0 0x7fae540cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:60936/0 (socket says 172.21.15.99:60936) 2024-09-10T07:36:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.850+0000 7fae58a00640 1 -- 172.21.15.99:0/1891369948 >> v2:172.21.15.187:3300/0 conn(0x7fae540cfb80 msgr2=0x7fae540d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.850+0000 7fae58a00640 1 --2- 172.21.15.99:0/1891369948 >> v2:172.21.15.187:3300/0 conn(0x7fae540cfb80 0x7fae540d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.850+0000 7fae58a00640 1 -- 172.21.15.99:0/1891369948 >> v1:172.21.15.187:6789/0 conn(0x7fae540b1ba0 legacy=0x7fae540cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.850+0000 7fae58a00640 1 -- 172.21.15.99:0/1891369948 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae540b2160 con 0x7fae5415cbb0 2024-09-10T07:36:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.851+0000 7fae58a00640 1 --2- 172.21.15.99:0/1891369948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae5415cbb0 0x7fae540b5110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae48009870 tx=0x7fae4802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7872aaa97eb12d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.851+0000 7fae53400640 1 -- 172.21.15.99:0/1891369948 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48037070 con 0x7fae5415cbb0 2024-09-10T07:36:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.851+0000 7fae53400640 1 -- 172.21.15.99:0/1891369948 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae48032440 con 0x7fae5415cbb0 2024-09-10T07:36:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.851+0000 7fae53400640 1 -- 172.21.15.99:0/1891369948 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48032810 con 0x7fae5415cbb0 2024-09-10T07:36:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.851+0000 7fae5b400640 1 -- 172.21.15.99:0/1891369948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae5415cbb0 msgr2=0x7fae540b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.851+0000 7fae5b400640 1 --2- 172.21.15.99:0/1891369948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae5415cbb0 0x7fae540b5110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae48009870 tx=0x7fae4802a250 comp rx=0 tx=0).stop 2024-09-10T07:36:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.852+0000 7fae5b400640 1 -- 172.21.15.99:0/1891369948 shutdown_connections 2024-09-10T07:36:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.852+0000 7fae5b400640 1 --2- 172.21.15.99:0/1891369948 >> v2:172.21.15.187:3300/0 conn(0x7fae540cfb80 0x7fae540d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.852+0000 7fae5b400640 1 --2- 172.21.15.99:0/1891369948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae5415cbb0 0x7fae540b5110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.852+0000 7fae5b400640 1 -- 172.21.15.99:0/1891369948 >> 172.21.15.99:0/1891369948 conn(0x7fae540b45f0 msgr2=0x7fae540b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.852+0000 7fae5b400640 1 -- 172.21.15.99:0/1891369948 shutdown_connections 2024-09-10T07:36:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.852+0000 7fae5b400640 1 -- 172.21.15.99:0/1891369948 wait complete. 2024-09-10T07:36:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.853+0000 7fae5b400640 1 Processor -- start 2024-09-10T07:36:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.854+0000 7fae5b400640 1 -- start start 2024-09-10T07:36:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.854+0000 7fae5b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae540b1ba0 0x7fae5406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.854+0000 7fae5b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae540cfb80 0x7fae541e7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.854+0000 7fae5b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae5415cbb0 0x7fae541e4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.854+0000 7fae5b400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fae540b2460 con 0x7fae540b1ba0 2024-09-10T07:36:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.854+0000 7fae5b400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fae540ce6a0 con 0x7fae5415cbb0 2024-09-10T07:36:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae5b400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fae540ce0b0 con 0x7fae540cfb80 2024-09-10T07:36:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae58a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae540b1ba0 0x7fae5406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae58a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae540b1ba0 0x7fae5406e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58162/0 (socket says 172.21.15.99:58162) 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae58a00640 1 -- 172.21.15.99:0/2265216610 learned_addr learned my addr 172.21.15.99:0/2265216610 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae53e00640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae540cfb80 0x7fae541e7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae59400640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae5415cbb0 0x7fae541e4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae58a00640 1 -- 172.21.15.99:0/2265216610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae540cfb80 msgr2=0x7fae541e7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae58a00640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae540cfb80 0x7fae541e7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae58a00640 1 -- 172.21.15.99:0/2265216610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae5415cbb0 msgr2=0x7fae541e4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae58a00640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae5415cbb0 0x7fae541e4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae58a00640 1 -- 172.21.15.99:0/2265216610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae541e4c90 con 0x7fae540b1ba0 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae59400640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae5415cbb0 0x7fae541e4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.855+0000 7fae58a00640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae540b1ba0 0x7fae5406e3e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fae4802a290 tx=0x7fae480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.856+0000 7fae50c00640 1 -- 172.21.15.99:0/2265216610 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48041030 con 0x7fae540b1ba0 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.856+0000 7fae50c00640 1 -- 172.21.15.99:0/2265216610 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae48030440 con 0x7fae540b1ba0 2024-09-10T07:36:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.856+0000 7fae50c00640 1 -- 172.21.15.99:0/2265216610 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48037040 con 0x7fae540b1ba0 2024-09-10T07:36:22.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.856+0000 7fae5b400640 1 -- 172.21.15.99:0/2265216610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae541e36b0 con 0x7fae540b1ba0 2024-09-10T07:36:22.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.856+0000 7fae5b400640 1 -- 172.21.15.99:0/2265216610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae541e3c70 con 0x7fae540b1ba0 2024-09-10T07:36:22.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.857+0000 7fae5b400640 1 -- 172.21.15.99:0/2265216610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae540b5110 con 0x7fae540b1ba0 2024-09-10T07:36:22.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.858+0000 7fae50c00640 1 -- 172.21.15.99:0/2265216610 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae48044070 con 0x7fae540b1ba0 2024-09-10T07:36:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.859+0000 7fae50c00640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae3406be30 0x7fae3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.859+0000 7fae50c00640 1 -- 172.21.15.99:0/2265216610 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7fae480ab210 con 0x7fae540b1ba0 2024-09-10T07:36:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.859+0000 7fae53e00640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae3406be30 0x7fae3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.860+0000 7fae53e00640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae3406be30 0x7fae3406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae54070110 tx=0x7fae40007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:22.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:22.863+0000 7fae50c00640 1 -- 172.21.15.99:0/2265216610 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae48079e20 con 0x7fae540b1ba0 2024-09-10T07:36:23.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.047+0000 7fae5b400640 1 -- 172.21.15.99:0/2265216610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fae540b8a40 con 0x7fae540b1ba0 2024-09-10T07:36:23.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.348+0000 7fae50c00640 1 -- 172.21.15.99:0/2265216610 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) ==== 97+0+0 (secure 0 0 0) 0x7fae48079720 con 0x7fae540b1ba0 2024-09-10T07:36:23.347 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-09-10T07:36:23.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.350+0000 7fae5b400640 1 -- 172.21.15.99:0/2265216610 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae3406be30 msgr2=0x7fae3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.350+0000 7fae5b400640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae3406be30 0x7fae3406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae54070110 tx=0x7fae40007e80 comp rx=0 tx=0).stop 2024-09-10T07:36:23.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.350+0000 7fae5b400640 1 -- 172.21.15.99:0/2265216610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae540b1ba0 msgr2=0x7fae5406e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.350+0000 7fae5b400640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae540b1ba0 0x7fae5406e3e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fae4802a290 tx=0x7fae480046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.351+0000 7fae5b400640 1 -- 172.21.15.99:0/2265216610 shutdown_connections 2024-09-10T07:36:23.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.351+0000 7fae5b400640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae5415cbb0 0x7fae541e4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.351+0000 7fae5b400640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae540cfb80 0x7fae541e7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.351+0000 7fae5b400640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae3406be30 0x7fae3406e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.351+0000 7fae5b400640 1 --2- 172.21.15.99:0/2265216610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae540b1ba0 0x7fae5406e3e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.351+0000 7fae5b400640 1 -- 172.21.15.99:0/2265216610 >> 172.21.15.99:0/2265216610 conn(0x7fae540b45f0 msgr2=0x7fae540d2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:23.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.351+0000 7fae5b400640 1 -- 172.21.15.99:0/2265216610 shutdown_connections 2024-09-10T07:36:23.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.351+0000 7fae5b400640 1 -- 172.21.15.99:0/2265216610 wait complete. 2024-09-10T07:36:23.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T07:36:23.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.523+0000 7fa096200640 1 Processor -- start 2024-09-10T07:36:23.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.523+0000 7fa096200640 1 -- start start 2024-09-10T07:36:23.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa096200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa09013fae0 0x7fa09006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa096200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa090142150 0x7fa090160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa096200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa090142650 con 0x7fa090160a80 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa096200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa0900ce780 con 0x7fa090142150 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa096200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa090142930 con 0x7fa09013fae0 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa08ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa090142150 0x7fa090160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa08ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa090142150 0x7fa090160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58174/0 (socket says 172.21.15.99:58174) 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa08ea00640 1 -- 172.21.15.99:0/687148485 learned_addr learned my addr 172.21.15.99:0/687148485 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa08f400640 1 --2- 172.21.15.99:0/687148485 >> v2:172.21.15.187:3300/0 conn(0x7fa09013fae0 0x7fa09006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa08ea00640 1 -- 172.21.15.99:0/687148485 >> v2:172.21.15.187:3300/0 conn(0x7fa09013fae0 msgr2=0x7fa09006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa08ea00640 1 --2- 172.21.15.99:0/687148485 >> v2:172.21.15.187:3300/0 conn(0x7fa09013fae0 0x7fa09006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa08ea00640 1 -- 172.21.15.99:0/687148485 >> v1:172.21.15.187:6789/0 conn(0x7fa090160a80 legacy=0x7fa09015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.525+0000 7fa08ea00640 1 -- 172.21.15.99:0/687148485 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa090142c10 con 0x7fa090142150 2024-09-10T07:36:23.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.526+0000 7fa08ea00640 1 --2- 172.21.15.99:0/687148485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090142150 0x7fa090160540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa090050590 tx=0x7fa07c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a79c5aef75c0e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:23.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa08e000640 1 -- 172.21.15.99:0/687148485 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c037070 con 0x7fa090142150 2024-09-10T07:36:23.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa08e000640 1 -- 172.21.15.99:0/687148485 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07c032440 con 0x7fa090142150 2024-09-10T07:36:23.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa08e000640 1 -- 172.21.15.99:0/687148485 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c032810 con 0x7fa090142150 2024-09-10T07:36:23.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa096200640 1 -- 172.21.15.99:0/687148485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090142150 msgr2=0x7fa090160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa096200640 1 --2- 172.21.15.99:0/687148485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090142150 0x7fa090160540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa090050590 tx=0x7fa07c02a1e0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa096200640 1 -- 172.21.15.99:0/687148485 shutdown_connections 2024-09-10T07:36:23.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa096200640 1 --2- 172.21.15.99:0/687148485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090142150 0x7fa090160540 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa096200640 1 --2- 172.21.15.99:0/687148485 >> v2:172.21.15.187:3300/0 conn(0x7fa09013fae0 0x7fa09006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa096200640 1 -- 172.21.15.99:0/687148485 >> 172.21.15.99:0/687148485 conn(0x7fa09006bc10 msgr2=0x7fa09006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:23.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa096200640 1 -- 172.21.15.99:0/687148485 shutdown_connections 2024-09-10T07:36:23.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.527+0000 7fa096200640 1 -- 172.21.15.99:0/687148485 wait complete. 2024-09-10T07:36:23.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.529+0000 7fa096200640 1 Processor -- start 2024-09-10T07:36:23.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.529+0000 7fa096200640 1 -- start start 2024-09-10T07:36:23.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa096200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa09013fae0 0x7fa090138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa096200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa090142150 0x7fa090072df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa096200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090160a80 0x7fa090138270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa096200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa09006f870 con 0x7fa090160a80 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa096200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa09006f6f0 con 0x7fa09013fae0 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa096200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa0900cfc20 con 0x7fa090142150 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa08fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090160a80 0x7fa090138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa08fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090160a80 0x7fa090138270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58190/0 (socket says 172.21.15.99:58190) 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa08f400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa09013fae0 0x7fa090138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa08fe00640 1 -- 172.21.15.99:0/4065279570 learned_addr learned my addr 172.21.15.99:0/4065279570 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.530+0000 7fa08ea00640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa090142150 0x7fa090072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa08f400640 1 -- 172.21.15.99:0/4065279570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa090142150 msgr2=0x7fa090072df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa08f400640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa090142150 0x7fa090072df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa08f400640 1 -- 172.21.15.99:0/4065279570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090160a80 msgr2=0x7fa090138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa08f400640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090160a80 0x7fa090138270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa08f400640 1 -- 172.21.15.99:0/4065279570 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa090145470 con 0x7fa09013fae0 2024-09-10T07:36:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa08fe00640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090160a80 0x7fa090138270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:36:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa08f400640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa09013fae0 0x7fa090138e50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa08000e850 tx=0x7fa08000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa087400640 1 -- 172.21.15.99:0/4065279570 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080017070 con 0x7fa09013fae0 2024-09-10T07:36:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa087400640 1 -- 172.21.15.99:0/4065279570 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08000c940 con 0x7fa09013fae0 2024-09-10T07:36:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa096200640 1 -- 172.21.15.99:0/4065279570 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0901459e0 con 0x7fa09013fae0 2024-09-10T07:36:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa087400640 1 -- 172.21.15.99:0/4065279570 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08000cd10 con 0x7fa09013fae0 2024-09-10T07:36:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.531+0000 7fa096200640 1 -- 172.21.15.99:0/4065279570 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0901f2730 con 0x7fa09013fae0 2024-09-10T07:36:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.532+0000 7fa096200640 1 -- 172.21.15.99:0/4065279570 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09006f1b0 con 0x7fa09013fae0 2024-09-10T07:36:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.533+0000 7fa087400640 1 -- 172.21.15.99:0/4065279570 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa08001a070 con 0x7fa09013fae0 2024-09-10T07:36:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.534+0000 7fa087400640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa07006be30 0x7fa07006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.534+0000 7fa087400640 1 -- 172.21.15.99:0/4065279570 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4857+0+0 (secure 0 0 0) 0x7fa08008aaa0 con 0x7fa09013fae0 2024-09-10T07:36:23.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.534+0000 7fa08ea00640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa07006be30 0x7fa07006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.535+0000 7fa08ea00640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa07006be30 0x7fa07006e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa07c034000 tx=0x7fa07c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:23.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.539+0000 7fa087400640 1 -- 172.21.15.99:0/4065279570 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0800590b0 con 0x7fa09013fae0 2024-09-10T07:36:23.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.780+0000 7fa096200640 1 -- 172.21.15.99:0/4065279570 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa0900ccde0 con 0x7fa09013fae0 2024-09-10T07:36:23.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.781+0000 7fa087400640 1 -- 172.21.15.99:0/4065279570 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7fa08005d3b0 con 0x7fa09013fae0 2024-09-10T07:36:23.780 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:23.780 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw==", 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.781 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-09-10T07:36:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ==", 2024-09-10T07:36:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:36:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:36:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:36:23.782 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw==", 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw==", 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA==", 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A==", 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w==", 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA==", 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:36:23.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w==", 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.787 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw==", 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw==", 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:36:23.788 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg==", 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-09-10T07:36:23.789 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg==", 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow r", 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ==", 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:36:23.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A==", 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw==", 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBc9t9m2Fs5JBAAQfJNCUhmbHevYDJWsG/oAg==", 2024-09-10T07:36:23.792 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q==", 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:36:23.793 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw==", 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:36:23.794 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:36:23.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.783+0000 7fa096200640 1 -- 172.21.15.99:0/4065279570 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa07006be30 msgr2=0x7fa07006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.783+0000 7fa096200640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa07006be30 0x7fa07006e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa07c034000 tx=0x7fa07c02e000 comp rx=0 tx=0).stop 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.783+0000 7fa096200640 1 -- 172.21.15.99:0/4065279570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa09013fae0 msgr2=0x7fa090138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.783+0000 7fa096200640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa09013fae0 0x7fa090138e50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa08000e850 tx=0x7fa08000ed10 comp rx=0 tx=0).stop 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.784+0000 7fa096200640 1 -- 172.21.15.99:0/4065279570 shutdown_connections 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.784+0000 7fa096200640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa07006be30 0x7fa07006e2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.784+0000 7fa096200640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa090160a80 0x7fa090138270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.784+0000 7fa096200640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa090142150 0x7fa090072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.784+0000 7fa096200640 1 --2- 172.21.15.99:0/4065279570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa09013fae0 0x7fa090138e50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.784+0000 7fa096200640 1 -- 172.21.15.99:0/4065279570 >> 172.21.15.99:0/4065279570 conn(0x7fa09006bc10 msgr2=0x7fa09015e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.784+0000 7fa096200640 1 -- 172.21.15.99:0/4065279570 shutdown_connections 2024-09-10T07:36:23.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.784+0000 7fa096200640 1 -- 172.21.15.99:0/4065279570 wait complete. 2024-09-10T07:36:23.799 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:36:23.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.954+0000 7f618b200640 1 Processor -- start 2024-09-10T07:36:23.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.954+0000 7f618b200640 1 -- start start 2024-09-10T07:36:23.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.955+0000 7f618b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c15c690 0x7f618c0733a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.955+0000 7f618b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f618c0ce960 0x7f618c0cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.955+0000 7f618b200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618c0b3c20 con 0x7f618c0cf570 2024-09-10T07:36:23.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.955+0000 7f618b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f618c0cf2f0 con 0x7f618c0ce960 2024-09-10T07:36:23.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.955+0000 7f618b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0b41e0 con 0x7f618c15c690 2024-09-10T07:36:23.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.955+0000 7f618a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f618c0ce960 0x7f618c0cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.955+0000 7f618a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f618c0ce960 0x7f618c0cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58200/0 (socket says 172.21.15.99:58200) 2024-09-10T07:36:23.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.955+0000 7f618a800640 1 -- 172.21.15.99:0/3281184575 learned_addr learned my addr 172.21.15.99:0/3281184575 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:23.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.955+0000 7f6189e00640 1 --2- 172.21.15.99:0/3281184575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c15c690 0x7f618c0733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.956+0000 7f6189e00640 1 -- 172.21.15.99:0/3281184575 >> v2:172.21.15.99:3300/0 conn(0x7f618c0ce960 msgr2=0x7f618c0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:23.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.956+0000 7f6189e00640 1 --2- 172.21.15.99:0/3281184575 >> v2:172.21.15.99:3300/0 conn(0x7f618c0ce960 0x7f618c0cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.956+0000 7f6189e00640 1 -- 172.21.15.99:0/3281184575 >> v1:172.21.15.187:6789/0 conn(0x7f618c0cf570 legacy=0x7f618c072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.956+0000 7f6189e00640 1 -- 172.21.15.99:0/3281184575 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c0b3f00 con 0x7f618c15c690 2024-09-10T07:36:23.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.957+0000 7f6189e00640 1 --2- 172.21.15.99:0/3281184575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c15c690 0x7f618c0733a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097a0 tx=0x7f617c02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56b46625e06c5885 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.957+0000 7f6189400640 1 -- 172.21.15.99:0/3281184575 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c037070 con 0x7f618c15c690 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.957+0000 7f6189400640 1 -- 172.21.15.99:0/3281184575 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c02ae40 con 0x7f618c15c690 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.957+0000 7f6189400640 1 -- 172.21.15.99:0/3281184575 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c032660 con 0x7f618c15c690 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.958+0000 7f618b200640 1 -- 172.21.15.99:0/3281184575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c15c690 msgr2=0x7f618c0733a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.958+0000 7f618b200640 1 --2- 172.21.15.99:0/3281184575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c15c690 0x7f618c0733a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097a0 tx=0x7f617c02a0f0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.958+0000 7f618b200640 1 -- 172.21.15.99:0/3281184575 shutdown_connections 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.958+0000 7f618b200640 1 --2- 172.21.15.99:0/3281184575 >> v2:172.21.15.99:3300/0 conn(0x7f618c0ce960 0x7f618c0cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.958+0000 7f618b200640 1 --2- 172.21.15.99:0/3281184575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c15c690 0x7f618c0733a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.958+0000 7f618b200640 1 -- 172.21.15.99:0/3281184575 >> 172.21.15.99:0/3281184575 conn(0x7f618c06bc10 msgr2=0x7f618c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.958+0000 7f618b200640 1 -- 172.21.15.99:0/3281184575 shutdown_connections 2024-09-10T07:36:23.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.958+0000 7f618b200640 1 -- 172.21.15.99:0/3281184575 wait complete. 2024-09-10T07:36:23.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.959+0000 7f618b200640 1 Processor -- start 2024-09-10T07:36:23.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.960+0000 7f618b200640 1 -- start start 2024-09-10T07:36:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.960+0000 7f618b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c0ce960 0x7f618c148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618b200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f618c0cf570 0x7f618c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f618c15c690 0x7f618c1499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f618c072720 con 0x7f618c15c690 2024-09-10T07:36:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618b200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f618c071af0 con 0x7f618c0cf570 2024-09-10T07:36:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0738e0 con 0x7f618c0ce960 2024-09-10T07:36:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f618c15c690 0x7f618c1499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f618c15c690 0x7f618c1499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58208/0 (socket says 172.21.15.99:58208) 2024-09-10T07:36:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618a800640 1 -- 172.21.15.99:0/2997401112 learned_addr learned my addr 172.21.15.99:0/2997401112 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:23.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f6189e00640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c0ce960 0x7f618c148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f6181400640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f618c0cf570 0x7f618c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618a800640 1 -- 172.21.15.99:0/2997401112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c0ce960 msgr2=0x7f618c148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618a800640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c0ce960 0x7f618c148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618a800640 1 -- 172.21.15.99:0/2997401112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f618c0cf570 msgr2=0x7f618c149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618a800640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f618c0cf570 0x7f618c149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.961+0000 7f618a800640 1 -- 172.21.15.99:0/2997401112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c14fca0 con 0x7f618c15c690 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.962+0000 7f618a800640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f618c15c690 0x7f618c1499b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6184009d90 tx=0x7f618400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.962+0000 7f6182a00640 1 -- 172.21.15.99:0/2997401112 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618400cd20 con 0x7f618c15c690 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.962+0000 7f6182a00640 1 -- 172.21.15.99:0/2997401112 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6184003990 con 0x7f618c15c690 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.962+0000 7f618b200640 1 -- 172.21.15.99:0/2997401112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c14f120 con 0x7f618c15c690 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.962+0000 7f6182a00640 1 -- 172.21.15.99:0/2997401112 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184003d60 con 0x7f618c15c690 2024-09-10T07:36:23.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.962+0000 7f618b200640 1 -- 172.21.15.99:0/2997401112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c14f6e0 con 0x7f618c15c690 2024-09-10T07:36:23.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.963+0000 7f618b200640 1 -- 172.21.15.99:0/2997401112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c0cedb0 con 0x7f618c15c690 2024-09-10T07:36:23.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.964+0000 7f6182a00640 1 -- 172.21.15.99:0/2997401112 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6184005d10 con 0x7f618c15c690 2024-09-10T07:36:23.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.965+0000 7f6182a00640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f616806be60 0x7f616806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:23.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.965+0000 7f6182a00640 1 -- 172.21.15.99:0/2997401112 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4857+0+0 (secure 0 0 0) 0x7f618408b1d0 con 0x7f618c15c690 2024-09-10T07:36:23.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.965+0000 7f6189e00640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f616806be60 0x7f616806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:23.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.966+0000 7f6189e00640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f616806be60 0x7f616806e320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f617c034000 tx=0x7f617c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:23.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:23.969+0000 7f6182a00640 1 -- 172.21.15.99:0/2997401112 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6184022020 con 0x7f618c15c690 2024-09-10T07:36:24.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.141+0000 7f618b200640 1 -- 172.21.15.99:0/2997401112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f618c0d00c0 con 0x7f618c15c690 2024-09-10T07:36:24.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.141+0000 7f6182a00640 1 -- 172.21.15.99:0/2997401112 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) ==== 84+0+65 (secure 0 0 0) 0x7f6184010040 con 0x7f618c15c690 2024-09-10T07:36:24.140 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:24.141 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:36:24.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:36:24.141 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:36:24.141 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:36:24.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:36:24.141 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.143+0000 7f618b200640 1 -- 172.21.15.99:0/2997401112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f616806be60 msgr2=0x7f616806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.143+0000 7f618b200640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f616806be60 0x7f616806e320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f617c034000 tx=0x7f617c02e000 comp rx=0 tx=0).stop 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.143+0000 7f618b200640 1 -- 172.21.15.99:0/2997401112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f618c15c690 msgr2=0x7f618c1499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.143+0000 7f618b200640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f618c15c690 0x7f618c1499b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6184009d90 tx=0x7f618400c490 comp rx=0 tx=0).stop 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.144+0000 7f618b200640 1 -- 172.21.15.99:0/2997401112 shutdown_connections 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.144+0000 7f618b200640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f616806be60 0x7f616806e320 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.144+0000 7f618b200640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f618c15c690 0x7f618c1499b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.144+0000 7f618b200640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f618c0cf570 0x7f618c149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.144+0000 7f618b200640 1 --2- 172.21.15.99:0/2997401112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f618c0ce960 0x7f618c148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.144+0000 7f618b200640 1 -- 172.21.15.99:0/2997401112 >> 172.21.15.99:0/2997401112 conn(0x7f618c06bc10 msgr2=0x7f618c072c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:24.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.144+0000 7f618b200640 1 -- 172.21.15.99:0/2997401112 shutdown_connections 2024-09-10T07:36:24.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.144+0000 7f618b200640 1 -- 172.21.15.99:0/2997401112 wait complete. 2024-09-10T07:36:24.158 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:36:24.159 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:36:24.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.315+0000 7f7931a00640 1 Processor -- start 2024-09-10T07:36:24.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.315+0000 7f7931a00640 1 -- start start 2024-09-10T07:36:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.316+0000 7f7931a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f792c1445a0 0x7f792c0cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.316+0000 7f7931a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f792c0ced50 0x7f792c072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.316+0000 7f7931a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 0x7f792c072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.316+0000 7f7931a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f792c15fdd0 con 0x7f792c0ced50 2024-09-10T07:36:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f7931a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f792c0b5f00 con 0x7f792c1445a0 2024-09-10T07:36:24.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f7931a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f792c0cd8c0 con 0x7f792c144980 2024-09-10T07:36:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f7922000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f792c0ced50 0x7f792c072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f7922000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f792c0ced50 0x7f792c072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58218/0 (socket says 172.21.15.99:58218) 2024-09-10T07:36:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f7922000640 1 -- 172.21.15.99:0/1459317952 learned_addr learned my addr 172.21.15.99:0/1459317952 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f792b400640 1 --2- 172.21.15.99:0/1459317952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 0x7f792c072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f792aa00640 1 --2- 172.21.15.99:0/1459317952 >> v2:172.21.15.187:3300/0 conn(0x7f792c1445a0 0x7f792c0cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f7922000640 1 -- 172.21.15.99:0/1459317952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 msgr2=0x7f792c072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f7922000640 1 --2- 172.21.15.99:0/1459317952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 0x7f792c072bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f7922000640 1 -- 172.21.15.99:0/1459317952 >> v2:172.21.15.187:3300/0 conn(0x7f792c1445a0 msgr2=0x7f792c0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f7922000640 1 --2- 172.21.15.99:0/1459317952 >> v2:172.21.15.187:3300/0 conn(0x7f792c1445a0 0x7f792c0cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.317+0000 7f7922000640 1 -- 172.21.15.99:0/1459317952 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792c160310 con 0x7f792c0ced50 2024-09-10T07:36:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.318+0000 7f7922000640 1 --2- 172.21.15.99:0/1459317952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 0x7f792c072680 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f79140098a0 tx=0x7f791402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860c31187ca80fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.318+0000 7f792a000640 1 -- 172.21.15.99:0/1459317952 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914037070 con 0x7f792c0ced50 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f792a000640 1 -- 172.21.15.99:0/1459317952 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791402ae20 con 0x7f792c0ced50 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f792a000640 1 -- 172.21.15.99:0/1459317952 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914032660 con 0x7f792c0ced50 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f7931a00640 1 -- 172.21.15.99:0/1459317952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 msgr2=0x7f792c072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f7931a00640 1 --2- 172.21.15.99:0/1459317952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 0x7f792c072680 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f79140098a0 tx=0x7f791402a110 comp rx=0 tx=0).stop 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f7931a00640 1 -- 172.21.15.99:0/1459317952 shutdown_connections 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f7931a00640 1 --2- 172.21.15.99:0/1459317952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 0x7f792c072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f7931a00640 1 --2- 172.21.15.99:0/1459317952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 0x7f792c072680 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f7931a00640 1 --2- 172.21.15.99:0/1459317952 >> v2:172.21.15.187:3300/0 conn(0x7f792c1445a0 0x7f792c0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f7931a00640 1 -- 172.21.15.99:0/1459317952 >> 172.21.15.99:0/1459317952 conn(0x7f792c0b26a0 msgr2=0x7f792c0b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f7931a00640 1 -- 172.21.15.99:0/1459317952 shutdown_connections 2024-09-10T07:36:24.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.319+0000 7f7931a00640 1 -- 172.21.15.99:0/1459317952 wait complete. 2024-09-10T07:36:24.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.321+0000 7f7931a00640 1 Processor -- start 2024-09-10T07:36:24.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.321+0000 7f7931a00640 1 -- start start 2024-09-10T07:36:24.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f7931a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 0x7f792c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:24.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f7931a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f792c1445a0 0x7f792c15b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:24.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f7931a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 0x7f792c1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:24.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f7931a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f792c0b5c20 con 0x7f792c0ced50 2024-09-10T07:36:24.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f7931a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f792c0b5940 con 0x7f792c1445a0 2024-09-10T07:36:24.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f7931a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f792c144ec0 con 0x7f792c144980 2024-09-10T07:36:24.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f792aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 0x7f792c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f792aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 0x7f792c15e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58228/0 (socket says 172.21.15.99:58228) 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f792aa00640 1 -- 172.21.15.99:0/2183386956 learned_addr learned my addr 172.21.15.99:0/2183386956 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f7922000640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f792c1445a0 0x7f792c15b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f792b400640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 0x7f792c1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.322+0000 7f792aa00640 1 -- 172.21.15.99:0/2183386956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 msgr2=0x7f792c1f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f792aa00640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 0x7f792c1f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f792aa00640 1 -- 172.21.15.99:0/2183386956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f792c1445a0 msgr2=0x7f792c15b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f792aa00640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f792c1445a0 0x7f792c15b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f792aa00640 1 -- 172.21.15.99:0/2183386956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792c15b9e0 con 0x7f792c0ced50 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f792b400640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 0x7f792c1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f792aa00640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 0x7f792c15e940 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f791c00e890 tx=0x7f791c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f7923400640 1 -- 172.21.15.99:0/2183386956 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c017070 con 0x7f792c0ced50 2024-09-10T07:36:24.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f7923400640 1 -- 172.21.15.99:0/2183386956 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791c00c940 con 0x7f792c0ced50 2024-09-10T07:36:24.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f7923400640 1 -- 172.21.15.99:0/2183386956 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c00cd10 con 0x7f792c0ced50 2024-09-10T07:36:24.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f7931a00640 1 -- 172.21.15.99:0/2183386956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792c1e5380 con 0x7f792c0ced50 2024-09-10T07:36:24.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.323+0000 7f7931a00640 1 -- 172.21.15.99:0/2183386956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f792c1e5940 con 0x7f792c0ced50 2024-09-10T07:36:24.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.324+0000 7f7931a00640 1 -- 172.21.15.99:0/2183386956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792c15bc00 con 0x7f792c0ced50 2024-09-10T07:36:24.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.325+0000 7f7923400640 1 -- 172.21.15.99:0/2183386956 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f791c01a070 con 0x7f792c0ced50 2024-09-10T07:36:24.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.326+0000 7f7923400640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f790806be30 0x7f790806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:24.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.327+0000 7f7923400640 1 -- 172.21.15.99:0/2183386956 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4857+0+0 (secure 0 0 0) 0x7f791c08aa30 con 0x7f792c0ced50 2024-09-10T07:36:24.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.327+0000 7f7922000640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f790806be30 0x7f790806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:24.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.327+0000 7f7922000640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f790806be30 0x7f790806e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7914034000 tx=0x7f791402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:24.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.331+0000 7f7923400640 1 -- 172.21.15.99:0/2183386956 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f791c0590d0 con 0x7f792c0ced50 2024-09-10T07:36:24.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:24.507+0000 7f7931a00640 1 -- 172.21.15.99:0/2183386956 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f792c0719c0 con 0x7f792c0ced50 2024-09-10T07:36:25.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.352+0000 7f7923400640 1 -- 172.21.15.99:0/2183386956 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) ==== 138+0+0 (secure 0 0 0) 0x7f791c05d3d0 con 0x7f792c0ced50 2024-09-10T07:36:25.351 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:36:25.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.355+0000 7f7931a00640 1 -- 172.21.15.99:0/2183386956 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f790806be30 msgr2=0x7f790806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:25.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.355+0000 7f7931a00640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f790806be30 0x7f790806e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7914034000 tx=0x7f791402e000 comp rx=0 tx=0).stop 2024-09-10T07:36:25.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.356+0000 7f7931a00640 1 -- 172.21.15.99:0/2183386956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 msgr2=0x7f792c15e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:25.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.356+0000 7f7931a00640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 0x7f792c15e940 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f791c00e890 tx=0x7f791c00ed50 comp rx=0 tx=0).stop 2024-09-10T07:36:25.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.356+0000 7f7931a00640 1 -- 172.21.15.99:0/2183386956 shutdown_connections 2024-09-10T07:36:25.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.356+0000 7f7931a00640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f792c144980 0x7f792c1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:25.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.356+0000 7f7931a00640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f792c1445a0 0x7f792c15b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:25.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.356+0000 7f7931a00640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f790806be30 0x7f790806e2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:25.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.356+0000 7f7931a00640 1 --2- 172.21.15.99:0/2183386956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f792c0ced50 0x7f792c15e940 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:25.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.356+0000 7f7931a00640 1 -- 172.21.15.99:0/2183386956 >> 172.21.15.99:0/2183386956 conn(0x7f792c0b26a0 msgr2=0x7f792c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:25.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.357+0000 7f7931a00640 1 -- 172.21.15.99:0/2183386956 shutdown_connections 2024-09-10T07:36:25.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.357+0000 7f7931a00640 1 -- 172.21.15.99:0/2183386956 wait complete. 2024-09-10T07:36:25.377 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:36:25.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.543+0000 7f9ba4a00640 1 Processor -- start 2024-09-10T07:36:25.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.543+0000 7f9ba4a00640 1 -- start start 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.544+0000 7f9ba4a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9ba015e970 0x7f9ba00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.544+0000 7f9ba4a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00cfc90 0x7f9ba00c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.544+0000 7f9ba4a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba00d2bd0 con 0x7f9ba00d2680 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.544+0000 7f9ba4a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba00d37e0 con 0x7f9ba015e970 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.544+0000 7f9ba4a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba00d2eb0 con 0x7f9ba00cfc90 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.544+0000 7f9b9de00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9ba00d2680 0x7f9ba00cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52068/0 (socket says 172.21.15.99:52068) 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.544+0000 7f9b9de00640 1 -- 172.21.15.99:0/3655634304 learned_addr learned my addr 172.21.15.99:0/3655634304 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.545+0000 7f9b9e800640 1 --2- 172.21.15.99:0/3655634304 >> v2:172.21.15.187:3300/0 conn(0x7f9ba015e970 0x7f9ba00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.545+0000 7f9b9f200640 1 --2- 172.21.15.99:0/3655634304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00cfc90 0x7f9ba00c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.545+0000 7f9b9d400640 1 -- 172.21.15.99:0/3655634304 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237112522 0 0) 0x7f9ba00d2bd0 con 0x7f9ba00d2680 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.545+0000 7f9b9d400640 1 -- 172.21.15.99:0/3655634304 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b84003520 con 0x7f9ba00d2680 2024-09-10T07:36:25.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.545+0000 7f9b9e800640 1 -- 172.21.15.99:0/3655634304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00cfc90 msgr2=0x7f9ba00c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:25.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.545+0000 7f9b9e800640 1 --2- 172.21.15.99:0/3655634304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00cfc90 0x7f9ba00c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:25.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.545+0000 7f9b9e800640 1 -- 172.21.15.99:0/3655634304 >> v1:172.21.15.99:6789/0 conn(0x7f9ba00d2680 legacy=0x7f9ba00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:25.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.545+0000 7f9b9d400640 1 -- 172.21.15.99:0/3655634304 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 197224975 0 0) 0x7f9b84003520 con 0x7f9ba00d2680 2024-09-10T07:36:25.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.545+0000 7f9b9e800640 1 -- 172.21.15.99:0/3655634304 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba00d3190 con 0x7f9ba015e970 2024-09-10T07:36:25.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.546+0000 7f9b9e800640 1 --2- 172.21.15.99:0/3655634304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba015e970 0x7f9ba00d0300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9b900097a0 tx=0x7f9b9002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20fc3d9e9c729073 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:25.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.547+0000 7f9b9d400640 1 -- 172.21.15.99:0/3655634304 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90037070 con 0x7f9ba015e970 2024-09-10T07:36:25.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.547+0000 7f9b9d400640 1 -- 172.21.15.99:0/3655634304 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b90032440 con 0x7f9ba015e970 2024-09-10T07:36:25.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.547+0000 7f9b9d400640 1 -- 172.21.15.99:0/3655634304 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90032810 con 0x7f9ba015e970 2024-09-10T07:36:25.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.547+0000 7f9ba4a00640 1 -- 172.21.15.99:0/3655634304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba015e970 msgr2=0x7f9ba00d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:25.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.547+0000 7f9ba4a00640 1 --2- 172.21.15.99:0/3655634304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba015e970 0x7f9ba00d0300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9b900097a0 tx=0x7f9b9002a180 comp rx=0 tx=0).stop 2024-09-10T07:36:25.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.547+0000 7f9ba4a00640 1 -- 172.21.15.99:0/3655634304 shutdown_connections 2024-09-10T07:36:25.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.547+0000 7f9ba4a00640 1 --2- 172.21.15.99:0/3655634304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00cfc90 0x7f9ba00c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:25.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.547+0000 7f9ba4a00640 1 --2- 172.21.15.99:0/3655634304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba015e970 0x7f9ba00d0300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:25.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.547+0000 7f9ba4a00640 1 -- 172.21.15.99:0/3655634304 >> 172.21.15.99:0/3655634304 conn(0x7f9ba009de00 msgr2=0x7f9ba00d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:25.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.548+0000 7f9ba4a00640 1 -- 172.21.15.99:0/3655634304 shutdown_connections 2024-09-10T07:36:25.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.548+0000 7f9ba4a00640 1 -- 172.21.15.99:0/3655634304 wait complete. 2024-09-10T07:36:25.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.549+0000 7f9ba4a00640 1 Processor -- start 2024-09-10T07:36:25.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.549+0000 7f9ba4a00640 1 -- start start 2024-09-10T07:36:25.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.550+0000 7f9ba4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ba00cfc90 0x7f9ba00ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:25.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.550+0000 7f9ba4a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00d2680 0x7f9ba00cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:25.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.550+0000 7f9ba4a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba015e970 0x7f9ba006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.550+0000 7f9ba4a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba015ed50 con 0x7f9ba00cfc90 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.550+0000 7f9ba4a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba00d0840 con 0x7f9ba015e970 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.550+0000 7f9ba4a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba015eed0 con 0x7f9ba00d2680 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.550+0000 7f9b9e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ba00cfc90 0x7f9ba00ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.550+0000 7f9b9e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ba00cfc90 0x7f9ba00ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58232/0 (socket says 172.21.15.99:58232) 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.550+0000 7f9b9e800640 1 -- 172.21.15.99:0/2268372951 learned_addr learned my addr 172.21.15.99:0/2268372951 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b9f200640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba015e970 0x7f9ba006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b9de00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00d2680 0x7f9ba00cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b9e800640 1 -- 172.21.15.99:0/2268372951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00d2680 msgr2=0x7f9ba00cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b9e800640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00d2680 0x7f9ba00cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b9e800640 1 -- 172.21.15.99:0/2268372951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba015e970 msgr2=0x7f9ba006d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b9e800640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba015e970 0x7f9ba006d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:25.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b9e800640 1 -- 172.21.15.99:0/2268372951 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba00cd8a0 con 0x7f9ba00cfc90 2024-09-10T07:36:25.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b9f200640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba015e970 0x7f9ba006d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:25.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b9de00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00d2680 0x7f9ba00cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:25.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b9e800640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ba00cfc90 0x7f9ba00ce660 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9b90035040 tx=0x7f9b900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:25.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b96a00640 1 -- 172.21.15.99:0/2268372951 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90041030 con 0x7f9ba00cfc90 2024-09-10T07:36:25.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b96a00640 1 -- 172.21.15.99:0/2268372951 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9003d4e0 con 0x7f9ba00cfc90 2024-09-10T07:36:25.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9b96a00640 1 -- 172.21.15.99:0/2268372951 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90037040 con 0x7f9ba00cfc90 2024-09-10T07:36:25.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.551+0000 7f9ba4a00640 1 -- 172.21.15.99:0/2268372951 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba00cdb80 con 0x7f9ba00cfc90 2024-09-10T07:36:25.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.552+0000 7f9ba4a00640 1 -- 172.21.15.99:0/2268372951 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba00ce140 con 0x7f9ba00cfc90 2024-09-10T07:36:25.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.553+0000 7f9ba4a00640 1 -- 172.21.15.99:0/2268372951 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba00d0300 con 0x7f9ba00cfc90 2024-09-10T07:36:25.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.554+0000 7f9b96a00640 1 -- 172.21.15.99:0/2268372951 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b90044070 con 0x7f9ba00cfc90 2024-09-10T07:36:25.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.554+0000 7f9b96a00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b8006be30 0x7f9b8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:25.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.554+0000 7f9b96a00640 1 -- 172.21.15.99:0/2268372951 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5227+0+0 (secure 0 0 0) 0x7f9b900ab2f0 con 0x7f9ba00cfc90 2024-09-10T07:36:25.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.555+0000 7f9b9de00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b8006be30 0x7f9b8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:25.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.555+0000 7f9b9de00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b8006be30 0x7f9b8006e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9ba009e480 tx=0x7f9b8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:25.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.559+0000 7f9b96a00640 1 -- 172.21.15.99:0/2268372951 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b90044e40 con 0x7f9ba00cfc90 2024-09-10T07:36:25.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:25.734+0000 7f9ba4a00640 1 -- 172.21.15.99:0/2268372951 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9ba00c7f30 con 0x7f9ba00cfc90 2024-09-10T07:36:26.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.355+0000 7f9b96a00640 1 -- 172.21.15.99:0/2268372951 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) ==== 170+0+0 (secure 0 0 0) 0x7f9b900a9e20 con 0x7f9ba00cfc90 2024-09-10T07:36:26.354 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:36:26.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.358+0000 7f9ba4a00640 1 -- 172.21.15.99:0/2268372951 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b8006be30 msgr2=0x7f9b8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:26.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.358+0000 7f9ba4a00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b8006be30 0x7f9b8006e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9ba009e480 tx=0x7f9b8c009040 comp rx=0 tx=0).stop 2024-09-10T07:36:26.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.358+0000 7f9ba4a00640 1 -- 172.21.15.99:0/2268372951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ba00cfc90 msgr2=0x7f9ba00ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:26.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.358+0000 7f9ba4a00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ba00cfc90 0x7f9ba00ce660 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9b90035040 tx=0x7f9b900046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.359+0000 7f9ba4a00640 1 -- 172.21.15.99:0/2268372951 shutdown_connections 2024-09-10T07:36:26.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.359+0000 7f9ba4a00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba015e970 0x7f9ba006d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.359+0000 7f9ba4a00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ba00d2680 0x7f9ba00cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.359+0000 7f9ba4a00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b8006be30 0x7f9b8006e2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.359+0000 7f9ba4a00640 1 --2- 172.21.15.99:0/2268372951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ba00cfc90 0x7f9ba00ce660 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.359+0000 7f9ba4a00640 1 -- 172.21.15.99:0/2268372951 >> 172.21.15.99:0/2268372951 conn(0x7f9ba009de00 msgr2=0x7f9ba00d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:26.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.360+0000 7f9ba4a00640 1 -- 172.21.15.99:0/2268372951 shutdown_connections 2024-09-10T07:36:26.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.360+0000 7f9ba4a00640 1 -- 172.21.15.99:0/2268372951 wait complete. 2024-09-10T07:36:26.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:36:26.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.545+0000 7fe7d9200640 1 Processor -- start 2024-09-10T07:36:26.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.545+0000 7fe7d9200640 1 -- start start 2024-09-10T07:36:26.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.546+0000 7fe7d9200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe7d415ede0 0x7fe7d40d5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:26.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.546+0000 7fe7d9200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7d40d1bf0 0x7fe7d40b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:26.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.546+0000 7fe7d9200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d40d3270 con 0x7fe7d40d5840 2024-09-10T07:36:26.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.546+0000 7fe7d9200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d40d34e0 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.546+0000 7fe7d9200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d40d37c0 con 0x7fe7d415ede0 2024-09-10T07:36:26.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.547+0000 7fe7d2800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7d40d1bf0 0x7fe7d40b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:26.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.547+0000 7fe7d2800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7d40d1bf0 0x7fe7d40b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58234/0 (socket says 172.21.15.99:58234) 2024-09-10T07:36:26.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.547+0000 7fe7d2800640 1 -- 172.21.15.99:0/2182622469 learned_addr learned my addr 172.21.15.99:0/2182622469 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:26.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.547+0000 7fe7d1400640 1 --1- 172.21.15.99:0/2182622469 >> v1:172.21.15.99:6789/0 conn(0x7fe7d40d5840 0x7fe7d40d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52070/0 (socket says 172.21.15.99:52070) 2024-09-10T07:36:26.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.547+0000 7fe7d1e00640 1 --2- 172.21.15.99:0/2182622469 >> v2:172.21.15.187:3300/0 conn(0x7fe7d415ede0 0x7fe7d40d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:26.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.547+0000 7fe7d2800640 1 -- 172.21.15.99:0/2182622469 >> v2:172.21.15.187:3300/0 conn(0x7fe7d415ede0 msgr2=0x7fe7d40d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:26.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.547+0000 7fe7d2800640 1 --2- 172.21.15.99:0/2182622469 >> v2:172.21.15.187:3300/0 conn(0x7fe7d415ede0 0x7fe7d40d5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.547+0000 7fe7d2800640 1 -- 172.21.15.99:0/2182622469 >> v1:172.21.15.99:6789/0 conn(0x7fe7d40d5840 legacy=0x7fe7d40d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:26.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.547+0000 7fe7d2800640 1 -- 172.21.15.99:0/2182622469 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d40d3aa0 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.547+0000 7fe7d0a00640 1 -- 172.21.15.99:0/2182622469 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586219588 0 0) 0x7fe7d40d3270 con 0x7fe7d40d5840 2024-09-10T07:36:26.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.548+0000 7fe7d2800640 1 --2- 172.21.15.99:0/2182622469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 0x7fe7d40b47e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe7d408dbe0 tx=0x7fe7cc02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffcddb86491598c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:26.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.548+0000 7fe7d0a00640 1 -- 172.21.15.99:0/2182622469 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc036070 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.548+0000 7fe7d0a00640 1 -- 172.21.15.99:0/2182622469 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7cc031600 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.548+0000 7fe7d0a00640 1 -- 172.21.15.99:0/2182622469 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0319f0 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.549+0000 7fe7d9200640 1 -- 172.21.15.99:0/2182622469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 msgr2=0x7fe7d40b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:26.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.549+0000 7fe7d9200640 1 --2- 172.21.15.99:0/2182622469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 0x7fe7d40b47e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe7d408dbe0 tx=0x7fe7cc02a7c0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.549+0000 7fe7d9200640 1 -- 172.21.15.99:0/2182622469 shutdown_connections 2024-09-10T07:36:26.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.549+0000 7fe7d9200640 1 --2- 172.21.15.99:0/2182622469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 0x7fe7d40b47e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.549+0000 7fe7d9200640 1 --2- 172.21.15.99:0/2182622469 >> v2:172.21.15.187:3300/0 conn(0x7fe7d415ede0 0x7fe7d40d5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.549+0000 7fe7d9200640 1 -- 172.21.15.99:0/2182622469 >> 172.21.15.99:0/2182622469 conn(0x7fe7d409df30 msgr2=0x7fe7d40d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:26.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.549+0000 7fe7d9200640 1 -- 172.21.15.99:0/2182622469 shutdown_connections 2024-09-10T07:36:26.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.549+0000 7fe7d9200640 1 -- 172.21.15.99:0/2182622469 wait complete. 2024-09-10T07:36:26.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.551+0000 7fe7d9200640 1 Processor -- start 2024-09-10T07:36:26.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.551+0000 7fe7d9200640 1 -- start start 2024-09-10T07:36:26.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 0x7fe7d41f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:26.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d9200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40d5840 0x7fe7d41f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d9200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7d415ede0 0x7fe7d40b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d9200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d40b41a0 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d9200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d40b4020 con 0x7fe7d415ede0 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d9200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d40b4d20 con 0x7fe7d40d5840 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 0x7fe7d41f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 0x7fe7d41f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58244/0 (socket says 172.21.15.99:58244) 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d1e00640 1 -- 172.21.15.99:0/730980695 learned_addr learned my addr 172.21.15.99:0/730980695 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d1400640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40d5840 0x7fe7d41f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d2800640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7d415ede0 0x7fe7d40b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d1e00640 1 -- 172.21.15.99:0/730980695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40d5840 msgr2=0x7fe7d41f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d1e00640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40d5840 0x7fe7d41f53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d1e00640 1 -- 172.21.15.99:0/730980695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7d415ede0 msgr2=0x7fe7d40b9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:26.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.552+0000 7fe7d1e00640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7d415ede0 0x7fe7d40b9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:26.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.553+0000 7fe7d1e00640 1 -- 172.21.15.99:0/730980695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d41f2390 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.553+0000 7fe7d1e00640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 0x7fe7d41f1e50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400e870 tx=0x7fe7c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:26.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.553+0000 7fe7ca000640 1 -- 172.21.15.99:0/730980695 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4017070 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.553+0000 7fe7ca000640 1 -- 172.21.15.99:0/730980695 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c400c940 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.553+0000 7fe7ca000640 1 -- 172.21.15.99:0/730980695 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400cd30 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.553+0000 7fe7d9200640 1 -- 172.21.15.99:0/730980695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d4159d00 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.553+0000 7fe7d9200640 1 -- 172.21.15.99:0/730980695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d415a2c0 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.554+0000 7fe7d9200640 1 -- 172.21.15.99:0/730980695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d40b47e0 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.555+0000 7fe7ca000640 1 -- 172.21.15.99:0/730980695 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe7c401a070 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.556+0000 7fe7ca000640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7b406be30 0x7fe7b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:26.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.556+0000 7fe7ca000640 1 -- 172.21.15.99:0/730980695 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5609+0+0 (secure 0 0 0) 0x7fe7c408ad50 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.557+0000 7fe7d1400640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7b406be30 0x7fe7b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:26.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.557+0000 7fe7d1400640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7b406be30 0x7fe7b406e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe7d415b0a0 tx=0x7fe7c0007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:26.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.561+0000 7fe7ca000640 1 -- 172.21.15.99:0/730980695 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7c40596c0 con 0x7fe7d40d1bf0 2024-09-10T07:36:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:26.770+0000 7fe7d9200640 1 -- 172.21.15.99:0/730980695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe7d40d02b0 con 0x7fe7d40d1bf0 2024-09-10T07:36:27.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.373+0000 7fe7ca000640 1 -- 172.21.15.99:0/730980695 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) ==== 172+0+0 (secure 0 0 0) 0x7fe7c4058fc0 con 0x7fe7d40d1bf0 2024-09-10T07:36:27.373 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 8 and data pool 9 2024-09-10T07:36:27.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.376+0000 7fe7d9200640 1 -- 172.21.15.99:0/730980695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7b406be30 msgr2=0x7fe7b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.376+0000 7fe7d9200640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7b406be30 0x7fe7b406e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe7d415b0a0 tx=0x7fe7c0007b50 comp rx=0 tx=0).stop 2024-09-10T07:36:27.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.376+0000 7fe7d9200640 1 -- 172.21.15.99:0/730980695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 msgr2=0x7fe7d41f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.376+0000 7fe7d9200640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 0x7fe7d41f1e50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400e870 tx=0x7fe7c400ed30 comp rx=0 tx=0).stop 2024-09-10T07:36:27.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.376+0000 7fe7d9200640 1 -- 172.21.15.99:0/730980695 shutdown_connections 2024-09-10T07:36:27.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.376+0000 7fe7d9200640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7d415ede0 0x7fe7d40b9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.376+0000 7fe7d9200640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40d5840 0x7fe7d41f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.376+0000 7fe7d9200640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7b406be30 0x7fe7b406e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.376+0000 7fe7d9200640 1 --2- 172.21.15.99:0/730980695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7d40d1bf0 0x7fe7d41f1e50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.376+0000 7fe7d9200640 1 -- 172.21.15.99:0/730980695 >> 172.21.15.99:0/730980695 conn(0x7fe7d409df30 msgr2=0x7fe7d40d26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:27.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.377+0000 7fe7d9200640 1 -- 172.21.15.99:0/730980695 shutdown_connections 2024-09-10T07:36:27.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.377+0000 7fe7d9200640 1 -- 172.21.15.99:0/730980695 wait complete. 2024-09-10T07:36:27.411 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:36:27.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.567+0000 7f77b2600640 1 Processor -- start 2024-09-10T07:36:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.567+0000 7f77b2600640 1 -- start start 2024-09-10T07:36:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.568+0000 7f77b2600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77ac155c80 0x7f77ac15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.568+0000 7f77b2600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f77ac15bb80 0x7f77ac15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.568+0000 7f77b2600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac156060 con 0x7f77ac06e450 2024-09-10T07:36:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.568+0000 7f77b2600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f77ac0723d0 con 0x7f77ac15bb80 2024-09-10T07:36:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.568+0000 7f77b2600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f77ac15c6f0 con 0x7f77ac155c80 2024-09-10T07:36:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.568+0000 7f77b1c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f77ac06e450 0x7f77ac072e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52082/0 (socket says 172.21.15.99:52082) 2024-09-10T07:36:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.568+0000 7f77b1c00640 1 -- 172.21.15.99:0/1261385264 learned_addr learned my addr 172.21.15.99:0/1261385264 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.568+0000 7f77b1200640 1 --2- 172.21.15.99:0/1261385264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77ac155c80 0x7f77ac15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.568+0000 7f77abe00640 1 --2- 172.21.15.99:0/1261385264 >> v2:172.21.15.187:3300/0 conn(0x7f77ac15bb80 0x7f77ac15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:27.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.569+0000 7f77ab400640 1 -- 172.21.15.99:0/1261385264 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691955507 0 0) 0x7f77a4001490 con 0x7f77ac06e450 2024-09-10T07:36:27.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.569+0000 7f77ab400640 1 -- 172.21.15.99:0/1261385264 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7794005730 con 0x7f77ac06e450 2024-09-10T07:36:27.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.569+0000 7f77b1200640 1 -- 172.21.15.99:0/1261385264 >> v2:172.21.15.187:3300/0 conn(0x7f77ac15bb80 msgr2=0x7f77ac15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:27.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.569+0000 7f77b1200640 1 --2- 172.21.15.99:0/1261385264 >> v2:172.21.15.187:3300/0 conn(0x7f77ac15bb80 0x7f77ac15bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.569+0000 7f77b1200640 1 -- 172.21.15.99:0/1261385264 >> v1:172.21.15.99:6789/0 conn(0x7f77ac06e450 legacy=0x7f77ac072e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.569+0000 7f77b1200640 1 -- 172.21.15.99:0/1261385264 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac15c9d0 con 0x7f77ac155c80 2024-09-10T07:36:27.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.569+0000 7f77abe00640 1 --2- 172.21.15.99:0/1261385264 >> v2:172.21.15.187:3300/0 conn(0x7f77ac15bb80 0x7f77ac15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.570+0000 7f77b1200640 1 --2- 172.21.15.99:0/1261385264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77ac155c80 0x7f77ac15cd40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77a00097a0 tx=0x7f77a002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee06b41abc1d6573 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.570+0000 7f77ab400640 1 -- 172.21.15.99:0/1261385264 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0037070 con 0x7f77ac155c80 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.570+0000 7f77ab400640 1 -- 172.21.15.99:0/1261385264 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a0032440 con 0x7f77ac155c80 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.570+0000 7f77ab400640 1 -- 172.21.15.99:0/1261385264 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a00327f0 con 0x7f77ac155c80 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.571+0000 7f77b2600640 1 -- 172.21.15.99:0/1261385264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77ac155c80 msgr2=0x7f77ac15cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.571+0000 7f77b2600640 1 --2- 172.21.15.99:0/1261385264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77ac155c80 0x7f77ac15cd40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77a00097a0 tx=0x7f77a002a180 comp rx=0 tx=0).stop 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.571+0000 7f77b2600640 1 -- 172.21.15.99:0/1261385264 shutdown_connections 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.571+0000 7f77b2600640 1 --2- 172.21.15.99:0/1261385264 >> v2:172.21.15.187:3300/0 conn(0x7f77ac15bb80 0x7f77ac15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.571+0000 7f77b2600640 1 --2- 172.21.15.99:0/1261385264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77ac155c80 0x7f77ac15cd40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.571+0000 7f77b2600640 1 -- 172.21.15.99:0/1261385264 >> 172.21.15.99:0/1261385264 conn(0x7f77ac0b2810 msgr2=0x7f77ac0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.571+0000 7f77b2600640 1 -- 172.21.15.99:0/1261385264 shutdown_connections 2024-09-10T07:36:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.571+0000 7f77b2600640 1 -- 172.21.15.99:0/1261385264 wait complete. 2024-09-10T07:36:27.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.573+0000 7f77b2600640 1 Processor -- start 2024-09-10T07:36:27.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.573+0000 7f77b2600640 1 -- start start 2024-09-10T07:36:27.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.573+0000 7f77b2600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77ac06e450 0x7f77ac154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.573+0000 7f77b2600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77ac155c80 0x7f77ac151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b2600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77ac15bb80 0x7f77ac0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b2600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac071ce0 con 0x7f77ac06e450 2024-09-10T07:36:27.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b2600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac072900 con 0x7f77ac15bb80 2024-09-10T07:36:27.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b2600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f77ac15d280 con 0x7f77ac155c80 2024-09-10T07:36:27.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77ac06e450 0x7f77ac154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:27.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77ac06e450 0x7f77ac154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58252/0 (socket says 172.21.15.99:58252) 2024-09-10T07:36:27.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b1200640 1 -- 172.21.15.99:0/4039271826 learned_addr learned my addr 172.21.15.99:0/4039271826 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:27.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b1200640 1 -- 172.21.15.99:0/4039271826 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77ac155c80 msgr2=0x7f77ac151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b1200640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77ac155c80 0x7f77ac151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b1200640 1 -- 172.21.15.99:0/4039271826 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77ac15bb80 msgr2=0x7f77ac0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b1200640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77ac15bb80 0x7f77ac0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b1200640 1 -- 172.21.15.99:0/4039271826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac154170 con 0x7f77ac06e450 2024-09-10T07:36:27.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.574+0000 7f77b1200640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77ac06e450 0x7f77ac154ef0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f77a0035040 tx=0x7f77a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:27.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.575+0000 7f77a8c00640 1 -- 172.21.15.99:0/4039271826 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0037040 con 0x7f77ac06e450 2024-09-10T07:36:27.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.575+0000 7f77a8c00640 1 -- 172.21.15.99:0/4039271826 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a00044c0 con 0x7f77ac06e450 2024-09-10T07:36:27.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.575+0000 7f77a8c00640 1 -- 172.21.15.99:0/4039271826 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a00325f0 con 0x7f77ac06e450 2024-09-10T07:36:27.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.575+0000 7f77b2600640 1 -- 172.21.15.99:0/4039271826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ac154410 con 0x7f77ac06e450 2024-09-10T07:36:27.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.575+0000 7f77b2600640 1 -- 172.21.15.99:0/4039271826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ac1549d0 con 0x7f77ac06e450 2024-09-10T07:36:27.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.576+0000 7f77b2600640 1 -- 172.21.15.99:0/4039271826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ac15cd40 con 0x7f77ac06e450 2024-09-10T07:36:27.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.577+0000 7f77a8c00640 1 -- 172.21.15.99:0/4039271826 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77a0044020 con 0x7f77ac06e450 2024-09-10T07:36:27.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.577+0000 7f77a8c00640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f778c06be60 0x7f778c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.578+0000 7f77a8c00640 1 -- 172.21.15.99:0/4039271826 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7f77a00ab160 con 0x7f77ac06e450 2024-09-10T07:36:27.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.578+0000 7f77abe00640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f778c06be60 0x7f778c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:27.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.578+0000 7f77abe00640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f778c06be60 0x7f778c06e320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7798006e80 tx=0x7f7798006dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:27.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.582+0000 7f77a8c00640 1 -- 172.21.15.99:0/4039271826 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f77a0079a70 con 0x7f77ac06e450 2024-09-10T07:36:27.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.757+0000 7f77b2600640 1 -- 172.21.15.99:0/4039271826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77ac06ead0 con 0x7f77ac06e450 2024-09-10T07:36:27.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.759+0000 7f77a8c00640 1 -- 172.21.15.99:0/4039271826 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16714 (secure 0 0 0) 0x7f77a0079370 con 0x7f77ac06e450 2024-09-10T07:36:27.759 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:27.759 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":64,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:36:26.770446+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:36:24.546261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T07:36:25.773175+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:36:27.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 -- 172.21.15.99:0/4039271826 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f778c06be60 msgr2=0x7f778c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f778c06be60 0x7f778c06e320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7798006e80 tx=0x7f7798006dd0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 -- 172.21.15.99:0/4039271826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77ac06e450 msgr2=0x7f77ac154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77ac06e450 0x7f77ac154ef0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f77a0035040 tx=0x7f77a00046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 -- 172.21.15.99:0/4039271826 shutdown_connections 2024-09-10T07:36:27.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77ac15bb80 0x7f77ac0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77ac155c80 0x7f77ac151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f778c06be60 0x7f778c06e320 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 --2- 172.21.15.99:0/4039271826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77ac06e450 0x7f77ac154ef0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 -- 172.21.15.99:0/4039271826 >> 172.21.15.99:0/4039271826 conn(0x7f77ac0b2810 msgr2=0x7f77ac0b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:27.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 -- 172.21.15.99:0/4039271826 shutdown_connections 2024-09-10T07:36:27.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.761+0000 7f77b2600640 1 -- 172.21.15.99:0/4039271826 wait complete. 2024-09-10T07:36:27.776 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:36:27.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.931+0000 7fb78b800640 1 Processor -- start 2024-09-10T07:36:27.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.931+0000 7fb78b800640 1 -- start start 2024-09-10T07:36:27.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.932+0000 7fb78b800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb78413fae0 0x7fb78406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.932+0000 7fb78b800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb784160c50 0x7fb7840cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.932+0000 7fb78b800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb784142650 con 0x7fb784142150 2024-09-10T07:36:27.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.932+0000 7fb78b800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb7840ce780 con 0x7fb784160c50 2024-09-10T07:36:27.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.932+0000 7fb78b800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb784142930 con 0x7fb78413fae0 2024-09-10T07:36:27.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.933+0000 7fb788e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb78413fae0 0x7fb78406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:27.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.933+0000 7fb788e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb78413fae0 0x7fb78406f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:43988/0 (socket says 172.21.15.99:43988) 2024-09-10T07:36:27.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.933+0000 7fb789800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb784160c50 0x7fb7840cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:27.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.933+0000 7fb788e00640 1 -- 172.21.15.99:0/4169357539 learned_addr learned my addr 172.21.15.99:0/4169357539 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:27.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.933+0000 7fb789800640 1 -- 172.21.15.99:0/4169357539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb78413fae0 msgr2=0x7fb78406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:27.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.933+0000 7fb789800640 1 --2- 172.21.15.99:0/4169357539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb78413fae0 0x7fb78406f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.933+0000 7fb789800640 1 -- 172.21.15.99:0/4169357539 >> v1:172.21.15.187:6789/0 conn(0x7fb784142150 legacy=0x7fb784160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.933+0000 7fb789800640 1 -- 172.21.15.99:0/4169357539 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb784142c10 con 0x7fb784160c50 2024-09-10T07:36:27.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.933+0000 7fb788e00640 1 --2- 172.21.15.99:0/4169357539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb78413fae0 0x7fb78406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:36:27.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.935+0000 7fb789800640 1 --2- 172.21.15.99:0/4169357539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb784160c50 0x7fb7840cec10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009d90 tx=0x7fb77c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee672e77369e1a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:27.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.935+0000 7fb783e00640 1 -- 172.21.15.99:0/4169357539 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c031600 con 0x7fb784160c50 2024-09-10T07:36:27.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.935+0000 7fb783e00640 1 -- 172.21.15.99:0/4169357539 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77c0317a0 con 0x7fb784160c50 2024-09-10T07:36:27.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.935+0000 7fb783e00640 1 -- 172.21.15.99:0/4169357539 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c031b70 con 0x7fb784160c50 2024-09-10T07:36:27.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.935+0000 7fb78b800640 1 -- 172.21.15.99:0/4169357539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb784160c50 msgr2=0x7fb7840cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.935+0000 7fb78b800640 1 --2- 172.21.15.99:0/4169357539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb784160c50 0x7fb7840cec10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009d90 tx=0x7fb77c02a5d0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.935+0000 7fb78b800640 1 -- 172.21.15.99:0/4169357539 shutdown_connections 2024-09-10T07:36:27.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.936+0000 7fb78b800640 1 --2- 172.21.15.99:0/4169357539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb784160c50 0x7fb7840cec10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.936+0000 7fb78b800640 1 --2- 172.21.15.99:0/4169357539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb78413fae0 0x7fb78406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.936+0000 7fb78b800640 1 -- 172.21.15.99:0/4169357539 >> 172.21.15.99:0/4169357539 conn(0x7fb78406bc10 msgr2=0x7fb78406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:27.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.936+0000 7fb78b800640 1 -- 172.21.15.99:0/4169357539 shutdown_connections 2024-09-10T07:36:27.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.936+0000 7fb78b800640 1 -- 172.21.15.99:0/4169357539 wait complete. 2024-09-10T07:36:27.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.937+0000 7fb78b800640 1 Processor -- start 2024-09-10T07:36:27.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.937+0000 7fb78b800640 1 -- start start 2024-09-10T07:36:27.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.938+0000 7fb78b800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb78413fae0 0x7fb78413e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.938+0000 7fb78b800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb784142150 0x7fb7840b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.938+0000 7fb78b800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb784160c50 0x7fb78415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.938+0000 7fb78b800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb78406f870 con 0x7fb78413fae0 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.938+0000 7fb78b800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb78406f6f0 con 0x7fb784142150 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.938+0000 7fb78b800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb7840cf150 con 0x7fb784160c50 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.938+0000 7fb788e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb78413fae0 0x7fb78413e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.938+0000 7fb788e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb78413fae0 0x7fb78413e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58262/0 (socket says 172.21.15.99:58262) 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.938+0000 7fb788e00640 1 -- 172.21.15.99:0/576182712 learned_addr learned my addr 172.21.15.99:0/576182712 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb789800640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb784160c50 0x7fb78415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb77be00640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb784142150 0x7fb7840b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb788e00640 1 -- 172.21.15.99:0/576182712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb784160c50 msgr2=0x7fb78415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb788e00640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb784160c50 0x7fb78415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb788e00640 1 -- 172.21.15.99:0/576182712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb784142150 msgr2=0x7fb7840b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:27.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb788e00640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb784142150 0x7fb7840b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:27.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb788e00640 1 -- 172.21.15.99:0/576182712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7841e7450 con 0x7fb78413fae0 2024-09-10T07:36:27.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb789800640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb784160c50 0x7fb78415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:27.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb788e00640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb78413fae0 0x7fb78413e860 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb77400e9d0 tx=0x7fb77400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:27.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb781600640 1 -- 172.21.15.99:0/576182712 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774017070 con 0x7fb78413fae0 2024-09-10T07:36:27.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb781600640 1 -- 172.21.15.99:0/576182712 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77400ca60 con 0x7fb78413fae0 2024-09-10T07:36:27.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb781600640 1 -- 172.21.15.99:0/576182712 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77400ce10 con 0x7fb78413fae0 2024-09-10T07:36:27.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.939+0000 7fb78b800640 1 -- 172.21.15.99:0/576182712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7841e7730 con 0x7fb78413fae0 2024-09-10T07:36:27.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.940+0000 7fb78b800640 1 -- 172.21.15.99:0/576182712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7841e7cf0 con 0x7fb78413fae0 2024-09-10T07:36:27.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.941+0000 7fb78b800640 1 -- 172.21.15.99:0/576182712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78406f1b0 con 0x7fb78413fae0 2024-09-10T07:36:27.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.942+0000 7fb781600640 1 -- 172.21.15.99:0/576182712 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb77401a070 con 0x7fb78413fae0 2024-09-10T07:36:27.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.942+0000 7fb781600640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb76006be30 0x7fb76006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:27.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.943+0000 7fb781600640 1 -- 172.21.15.99:0/576182712 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7fb77408ae20 con 0x7fb78413fae0 2024-09-10T07:36:27.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.943+0000 7fb77be00640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb76006be30 0x7fb76006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:27.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.943+0000 7fb77be00640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb76006be30 0x7fb76006e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb78415c8c0 tx=0x7fb76c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:27.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:27.947+0000 7fb781600640 1 -- 172.21.15.99:0/576182712 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb774059180 con 0x7fb78413fae0 2024-09-10T07:36:28.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.119+0000 7fb78b800640 1 -- 172.21.15.99:0/576182712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7841600b0 con 0x7fb78413fae0 2024-09-10T07:36:28.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.120+0000 7fb781600640 1 -- 172.21.15.99:0/576182712 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16714 (secure 0 0 0) 0x7fb77405d480 con 0x7fb78413fae0 2024-09-10T07:36:28.120 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:28.120 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":64,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:36:26.770446+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:36:24.546261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T07:36:25.773175+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 -- 172.21.15.99:0/576182712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb76006be30 msgr2=0x7fb76006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb76006be30 0x7fb76006e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb78415c8c0 tx=0x7fb76c009040 comp rx=0 tx=0).stop 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 -- 172.21.15.99:0/576182712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb78413fae0 msgr2=0x7fb78413e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb78413fae0 0x7fb78413e860 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb77400e9d0 tx=0x7fb77400ee90 comp rx=0 tx=0).stop 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 -- 172.21.15.99:0/576182712 shutdown_connections 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb784160c50 0x7fb78415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb784142150 0x7fb7840b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb76006be30 0x7fb76006e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 --2- 172.21.15.99:0/576182712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb78413fae0 0x7fb78413e860 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 -- 172.21.15.99:0/576182712 >> 172.21.15.99:0/576182712 conn(0x7fb78406bc10 msgr2=0x7fb7840cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:28.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 -- 172.21.15.99:0/576182712 shutdown_connections 2024-09-10T07:36:28.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.122+0000 7fb78b800640 1 -- 172.21.15.99:0/576182712 wait complete. 2024-09-10T07:36:28.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:36:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.296+0000 7fa289600640 1 Processor -- start 2024-09-10T07:36:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.296+0000 7fa289600640 1 -- start start 2024-09-10T07:36:28.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.297+0000 7fa289600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 0x7fa2840b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.297+0000 7fa289600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa2840d56b0 0x7fa2840d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.297+0000 7fa289600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2840d3700 con 0x7fa2840d0a50 2024-09-10T07:36:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.297+0000 7fa289600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa2840d21a0 con 0x7fa2840d56b0 2024-09-10T07:36:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.297+0000 7fa289600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa2840d0080 con 0x7fa2841623c0 2024-09-10T07:36:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa282000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa2840d56b0 0x7fa2840d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa282a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 0x7fa2840b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa282a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 0x7fa2840b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:44004/0 (socket says 172.21.15.99:44004) 2024-09-10T07:36:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa282a00640 1 -- 172.21.15.99:0/1126737872 learned_addr learned my addr 172.21.15.99:0/1126737872 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa282000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa2840d56b0 0x7fa2840d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:43108/0 (socket says 172.21.15.99:43108) 2024-09-10T07:36:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa282a00640 1 -- 172.21.15.99:0/1126737872 >> v2:172.21.15.187:3300/0 conn(0x7fa2840d56b0 msgr2=0x7fa2840d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa282a00640 1 --2- 172.21.15.99:0/1126737872 >> v2:172.21.15.187:3300/0 conn(0x7fa2840d56b0 0x7fa2840d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa282a00640 1 -- 172.21.15.99:0/1126737872 >> v1:172.21.15.187:6789/0 conn(0x7fa2840d0a50 legacy=0x7fa2840d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa282a00640 1 -- 172.21.15.99:0/1126737872 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2840cfa70 con 0x7fa2841623c0 2024-09-10T07:36:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa281600640 1 -- 172.21.15.99:0/1126737872 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1491529934 0 0) 0x7fa2840d3700 con 0x7fa2840d0a50 2024-09-10T07:36:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.298+0000 7fa282000640 1 --2- 172.21.15.99:0/1126737872 >> v2:172.21.15.187:3300/0 conn(0x7fa2840d56b0 0x7fa2840d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:36:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.299+0000 7fa282a00640 1 --2- 172.21.15.99:0/1126737872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 0x7fa2840b6260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa274009870 tx=0x7fa27402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52661d6812bd282 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:28.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.300+0000 7fa281600640 1 -- 172.21.15.99:0/1126737872 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274037070 con 0x7fa2841623c0 2024-09-10T07:36:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.300+0000 7fa281600640 1 -- 172.21.15.99:0/1126737872 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa274032440 con 0x7fa2841623c0 2024-09-10T07:36:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.300+0000 7fa281600640 1 -- 172.21.15.99:0/1126737872 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274032810 con 0x7fa2841623c0 2024-09-10T07:36:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.300+0000 7fa289600640 1 -- 172.21.15.99:0/1126737872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 msgr2=0x7fa2840b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.300+0000 7fa289600640 1 --2- 172.21.15.99:0/1126737872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 0x7fa2840b6260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa274009870 tx=0x7fa27402a250 comp rx=0 tx=0).stop 2024-09-10T07:36:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.300+0000 7fa289600640 1 -- 172.21.15.99:0/1126737872 shutdown_connections 2024-09-10T07:36:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.300+0000 7fa289600640 1 --2- 172.21.15.99:0/1126737872 >> v2:172.21.15.187:3300/0 conn(0x7fa2840d56b0 0x7fa2840d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.300+0000 7fa289600640 1 --2- 172.21.15.99:0/1126737872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 0x7fa2840b6260 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.300+0000 7fa289600640 1 -- 172.21.15.99:0/1126737872 >> 172.21.15.99:0/1126737872 conn(0x7fa28409df30 msgr2=0x7fa2840d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.301+0000 7fa289600640 1 -- 172.21.15.99:0/1126737872 shutdown_connections 2024-09-10T07:36:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.301+0000 7fa289600640 1 -- 172.21.15.99:0/1126737872 wait complete. 2024-09-10T07:36:28.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.302+0000 7fa289600640 1 Processor -- start 2024-09-10T07:36:28.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.302+0000 7fa289600640 1 -- start start 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.303+0000 7fa289600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2840d56b0 0x7fa2841f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.303+0000 7fa289600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 0x7fa284155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.303+0000 7fa289600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2840b8500 0x7fa2840b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.303+0000 7fa289600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa2841627a0 con 0x7fa2840d56b0 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.303+0000 7fa289600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa2840cfd10 con 0x7fa2840b8500 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.303+0000 7fa289600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa2840d3c80 con 0x7fa2841623c0 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2840d56b0 0x7fa2841f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2840d56b0 0x7fa2841f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58268/0 (socket says 172.21.15.99:58268) 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa282a00640 1 -- 172.21.15.99:0/2675448700 learned_addr learned my addr 172.21.15.99:0/2675448700 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa282000640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 0x7fa284155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:28.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa283400640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2840b8500 0x7fa2840b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa282a00640 1 -- 172.21.15.99:0/2675448700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 msgr2=0x7fa284155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa282a00640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 0x7fa284155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa282a00640 1 -- 172.21.15.99:0/2675448700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2840b8500 msgr2=0x7fa2840b89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa282a00640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2840b8500 0x7fa2840b89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa282a00640 1 -- 172.21.15.99:0/2675448700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2840b8fa0 con 0x7fa2840d56b0 2024-09-10T07:36:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa283400640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2840b8500 0x7fa2840b89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.304+0000 7fa282a00640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2840d56b0 0x7fa2841f4900 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa2740090b0 tx=0x7fa2740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.305+0000 7fa27aa00640 1 -- 172.21.15.99:0/2675448700 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274041020 con 0x7fa2840d56b0 2024-09-10T07:36:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.305+0000 7fa27aa00640 1 -- 172.21.15.99:0/2675448700 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa274030660 con 0x7fa2840d56b0 2024-09-10T07:36:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.305+0000 7fa27aa00640 1 -- 172.21.15.99:0/2675448700 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274037040 con 0x7fa2840d56b0 2024-09-10T07:36:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.305+0000 7fa289600640 1 -- 172.21.15.99:0/2675448700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2840cbfe0 con 0x7fa2840d56b0 2024-09-10T07:36:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.305+0000 7fa289600640 1 -- 172.21.15.99:0/2675448700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2840ce810 con 0x7fa2840d56b0 2024-09-10T07:36:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.306+0000 7fa289600640 1 -- 172.21.15.99:0/2675448700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2840d0510 con 0x7fa2840d56b0 2024-09-10T07:36:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.307+0000 7fa27aa00640 1 -- 172.21.15.99:0/2675448700 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa274044020 con 0x7fa2840d56b0 2024-09-10T07:36:28.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.307+0000 7fa27aa00640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa26406be30 0x7fa26406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:28.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.308+0000 7fa27aa00640 1 -- 172.21.15.99:0/2675448700 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5709+0+0 (secure 0 0 0) 0x7fa2740ab570 con 0x7fa2840d56b0 2024-09-10T07:36:28.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.308+0000 7fa282000640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa26406be30 0x7fa26406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.308+0000 7fa282000640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa26406be30 0x7fa26406e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa270009560 tx=0x7fa270009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:28.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.312+0000 7fa27aa00640 1 -- 172.21.15.99:0/2675448700 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa27404b030 con 0x7fa2840d56b0 2024-09-10T07:36:28.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:28.523+0000 7fa289600640 1 -- 172.21.15.99:0/2675448700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa2840b3f60 con 0x7fa2840d56b0 2024-09-10T07:36:29.352 INFO:tasks.ceph.mds.a.smithi099.stderr:2024-09-10T07:36:29.352+0000 7f4221600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:36:29.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.405+0000 7fa27aa00640 1 -- 172.21.15.99:0/2675448700 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) ==== 118+0+0 (secure 0 0 0) 0x7fa274079f10 con 0x7fa2840d56b0 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.408+0000 7fa289600640 1 -- 172.21.15.99:0/2675448700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa26406be30 msgr2=0x7fa26406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.408+0000 7fa289600640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa26406be30 0x7fa26406e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa270009560 tx=0x7fa270009190 comp rx=0 tx=0).stop 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.408+0000 7fa289600640 1 -- 172.21.15.99:0/2675448700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2840d56b0 msgr2=0x7fa2841f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.408+0000 7fa289600640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2840d56b0 0x7fa2841f4900 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa2740090b0 tx=0x7fa2740046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.409+0000 7fa289600640 1 -- 172.21.15.99:0/2675448700 shutdown_connections 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.409+0000 7fa289600640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2840b8500 0x7fa2840b89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.409+0000 7fa289600640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2841623c0 0x7fa284155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.409+0000 7fa289600640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa26406be30 0x7fa26406e2f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.409+0000 7fa289600640 1 --2- 172.21.15.99:0/2675448700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2840d56b0 0x7fa2841f4900 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.409+0000 7fa289600640 1 -- 172.21.15.99:0/2675448700 >> 172.21.15.99:0/2675448700 conn(0x7fa28409df30 msgr2=0x7fa2840b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.409+0000 7fa289600640 1 -- 172.21.15.99:0/2675448700 shutdown_connections 2024-09-10T07:36:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.409+0000 7fa289600640 1 -- 172.21.15.99:0/2675448700 wait complete. 2024-09-10T07:36:29.427 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T07:36:29.427 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:36:29.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.589+0000 7f2cf2200640 1 Processor -- start 2024-09-10T07:36:29.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.589+0000 7f2cf2200640 1 -- start start 2024-09-10T07:36:29.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.590+0000 7f2cf2200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2cec06e280 0x7f2cec073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2cf2200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec0722d0 con 0x7f2cec071df0 2024-09-10T07:36:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2cf2200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec0725b0 con 0x7f2cec0d1010 2024-09-10T07:36:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2cf2200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f2cec0738b0 con 0x7f2cec06e280 2024-09-10T07:36:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2ceb400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2cec06e280 0x7f2cec073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2ce2a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2cec071df0 0x7f2cec06e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52098/0 (socket says 172.21.15.99:52098) 2024-09-10T07:36:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2ceb400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2cec06e280 0x7f2cec073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58272/0 (socket says 172.21.15.99:58272) 2024-09-10T07:36:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2ce2a00640 1 -- 172.21.15.99:0/111458782 learned_addr learned my addr 172.21.15.99:0/111458782 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2ceb400640 1 -- 172.21.15.99:0/111458782 >> v1:172.21.15.187:6789/0 conn(0x7f2cec0d1010 legacy=0x7f2cec0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2ceb400640 1 -- 172.21.15.99:0/111458782 >> v1:172.21.15.99:6789/0 conn(0x7f2cec071df0 legacy=0x7f2cec06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2ceb400640 1 -- 172.21.15.99:0/111458782 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec072890 con 0x7f2cec06e280 2024-09-10T07:36:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.591+0000 7f2ceaa00640 1 -- 172.21.15.99:0/111458782 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437175019 0 0) 0x7f2cec0722d0 con 0x7f2cec071df0 2024-09-10T07:36:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.592+0000 7f2ceb400640 1 --2- 172.21.15.99:0/111458782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec06e280 0x7f2cec073370 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0097a0 tx=0x7f2cdc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e655a56b686b91fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.593+0000 7f2ceaa00640 1 -- 172.21.15.99:0/111458782 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc037070 con 0x7f2cec06e280 2024-09-10T07:36:29.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.593+0000 7f2ceaa00640 1 -- 172.21.15.99:0/111458782 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cdc032440 con 0x7f2cec06e280 2024-09-10T07:36:29.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.593+0000 7f2ceaa00640 1 -- 172.21.15.99:0/111458782 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc032810 con 0x7f2cec06e280 2024-09-10T07:36:29.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.593+0000 7f2cf2200640 1 -- 172.21.15.99:0/111458782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec06e280 msgr2=0x7f2cec073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:29.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.593+0000 7f2cf2200640 1 --2- 172.21.15.99:0/111458782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec06e280 0x7f2cec073370 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0097a0 tx=0x7f2cdc02a230 comp rx=0 tx=0).stop 2024-09-10T07:36:29.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.593+0000 7f2cf2200640 1 -- 172.21.15.99:0/111458782 shutdown_connections 2024-09-10T07:36:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.593+0000 7f2cf2200640 1 --2- 172.21.15.99:0/111458782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec06e280 0x7f2cec073370 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.593+0000 7f2cf2200640 1 -- 172.21.15.99:0/111458782 >> 172.21.15.99:0/111458782 conn(0x7f2cec06bc10 msgr2=0x7f2cec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.593+0000 7f2cf2200640 1 -- 172.21.15.99:0/111458782 shutdown_connections 2024-09-10T07:36:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.593+0000 7f2cf2200640 1 -- 172.21.15.99:0/111458782 wait complete. 2024-09-10T07:36:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.595+0000 7f2cf2200640 1 Processor -- start 2024-09-10T07:36:29.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.595+0000 7f2cf2200640 1 -- start start 2024-09-10T07:36:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2cf2200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cec06e280 0x7f2cec0ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2cf2200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cec071df0 0x7f2cec0aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2cf2200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec0d1010 0x7f2cec1e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2cf2200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec15db60 con 0x7f2cec0d1010 2024-09-10T07:36:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2cf2200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec072e50 con 0x7f2cec06e280 2024-09-10T07:36:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2cf2200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2cec0d14c0 con 0x7f2cec071df0 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2cebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec0d1010 0x7f2cec1e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2cebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec0d1010 0x7f2cec1e6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58286/0 (socket says 172.21.15.99:58286) 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2cebe00640 1 -- 172.21.15.99:0/228813016 learned_addr learned my addr 172.21.15.99:0/228813016 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2ceb400640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cec06e280 0x7f2cec0ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.596+0000 7f2ce2a00640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cec071df0 0x7f2cec0aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2cebe00640 1 -- 172.21.15.99:0/228813016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cec071df0 msgr2=0x7f2cec0aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2cebe00640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cec071df0 0x7f2cec0aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2cebe00640 1 -- 172.21.15.99:0/228813016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cec06e280 msgr2=0x7f2cec0ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2cebe00640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cec06e280 0x7f2cec0ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2cebe00640 1 -- 172.21.15.99:0/228813016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec1e7c30 con 0x7f2cec0d1010 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2cebe00640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec0d1010 0x7f2cec1e6be0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400c6b0 tx=0x7f2ce400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2ce3e00640 1 -- 172.21.15.99:0/228813016 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4003b70 con 0x7f2cec0d1010 2024-09-10T07:36:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2ce3e00640 1 -- 172.21.15.99:0/228813016 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce4003d30 con 0x7f2cec0d1010 2024-09-10T07:36:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2cf2200640 1 -- 172.21.15.99:0/228813016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec1e7950 con 0x7f2cec0d1010 2024-09-10T07:36:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2ce3e00640 1 -- 172.21.15.99:0/228813016 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4005310 con 0x7f2cec0d1010 2024-09-10T07:36:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.597+0000 7f2cf2200640 1 -- 172.21.15.99:0/228813016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec147ba0 con 0x7f2cec0d1010 2024-09-10T07:36:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.598+0000 7f2cf2200640 1 -- 172.21.15.99:0/228813016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cec15fa40 con 0x7f2cec0d1010 2024-09-10T07:36:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.599+0000 7f2ce3e00640 1 -- 172.21.15.99:0/228813016 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ce40054b0 con 0x7f2cec0d1010 2024-09-10T07:36:29.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.600+0000 7f2ce3e00640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2cc806be30 0x7f2cc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:29.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.600+0000 7f2ce3e00640 1 -- 172.21.15.99:0/228813016 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7f2ce408abc0 con 0x7f2cec0d1010 2024-09-10T07:36:29.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.600+0000 7f2ceb400640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2cc806be30 0x7f2cc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:29.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.601+0000 7f2ceb400640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2cc806be30 0x7f2cc806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc034000 tx=0x7f2cdc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.605+0000 7f2ce3e00640 1 -- 172.21.15.99:0/228813016 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2cec15fa40 con 0x7f2cec0d1010 2024-09-10T07:36:29.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:29.815+0000 7f2cf2200640 1 -- 172.21.15.99:0/228813016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2cec073370 con 0x7f2cec0d1010 2024-09-10T07:36:30.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.407+0000 7f2ce3e00640 1 -- 172.21.15.99:0/228813016 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f2ce4058f10 con 0x7f2cec0d1010 2024-09-10T07:36:30.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 -- 172.21.15.99:0/228813016 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2cc806be30 msgr2=0x7f2cc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2cc806be30 0x7f2cc806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc034000 tx=0x7f2cdc02e000 comp rx=0 tx=0).stop 2024-09-10T07:36:30.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 -- 172.21.15.99:0/228813016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec0d1010 msgr2=0x7f2cec1e6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec0d1010 0x7f2cec1e6be0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400c6b0 tx=0x7f2ce400cb70 comp rx=0 tx=0).stop 2024-09-10T07:36:30.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 -- 172.21.15.99:0/228813016 shutdown_connections 2024-09-10T07:36:30.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2cc806be30 0x7f2cc806e2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cec0d1010 0x7f2cec1e6be0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cec071df0 0x7f2cec0aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 --2- 172.21.15.99:0/228813016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cec06e280 0x7f2cec0ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 -- 172.21.15.99:0/228813016 >> 172.21.15.99:0/228813016 conn(0x7f2cec06bc10 msgr2=0x7f2cec15bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:30.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 -- 172.21.15.99:0/228813016 shutdown_connections 2024-09-10T07:36:30.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.410+0000 7f2cf2200640 1 -- 172.21.15.99:0/228813016 wait complete. 2024-09-10T07:36:30.427 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:36:30.427 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:36:30.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.581+0000 7fb310a00640 1 Processor -- start 2024-09-10T07:36:30.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.581+0000 7fb310a00640 1 -- start start 2024-09-10T07:36:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.582+0000 7fb310a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb30c15e970 0x7fb30c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.582+0000 7fb310a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30c0d2bd0 con 0x7fb30c0d2680 2024-09-10T07:36:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.582+0000 7fb310a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30c0d2eb0 con 0x7fb30c0cfc90 2024-09-10T07:36:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.582+0000 7fb310a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb30c0d37e0 con 0x7fb30c15e970 2024-09-10T07:36:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.582+0000 7fb302a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb30c0d2680 0x7fb30c0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58864/0 (socket says 172.21.15.99:58864) 2024-09-10T07:36:30.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.582+0000 7fb302a00640 1 -- 172.21.15.99:0/2025695560 learned_addr learned my addr 172.21.15.99:0/2025695560 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:30.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.583+0000 7fb30b400640 1 --2- 172.21.15.99:0/2025695560 >> v2:172.21.15.187:3300/0 conn(0x7fb30c15e970 0x7fb30c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.583+0000 7fb30aa00640 1 -- 172.21.15.99:0/2025695560 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794932916 0 0) 0x7fb30c0d2bd0 con 0x7fb30c0d2680 2024-09-10T07:36:30.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.583+0000 7fb30aa00640 1 -- 172.21.15.99:0/2025695560 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2f0003520 con 0x7fb30c0d2680 2024-09-10T07:36:30.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.583+0000 7fb30b400640 1 -- 172.21.15.99:0/2025695560 >> v1:172.21.15.187:6789/0 conn(0x7fb30c0cfc90 legacy=0x7fb30c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.583+0000 7fb30b400640 1 -- 172.21.15.99:0/2025695560 >> v1:172.21.15.99:6789/0 conn(0x7fb30c0d2680 legacy=0x7fb30c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.583+0000 7fb30b400640 1 -- 172.21.15.99:0/2025695560 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c0d3190 con 0x7fb30c15e970 2024-09-10T07:36:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.584+0000 7fb30b400640 1 --2- 172.21.15.99:0/2025695560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30c15e970 0x7fb30c0d0300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0d3960 tx=0x7fb2fc02a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ccd4c9161b1042 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.584+0000 7fb30aa00640 1 -- 172.21.15.99:0/2025695560 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc037070 con 0x7fb30c15e970 2024-09-10T07:36:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.584+0000 7fb30aa00640 1 -- 172.21.15.99:0/2025695560 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc032440 con 0x7fb30c15e970 2024-09-10T07:36:30.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.584+0000 7fb30aa00640 1 -- 172.21.15.99:0/2025695560 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc032810 con 0x7fb30c15e970 2024-09-10T07:36:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.585+0000 7fb310a00640 1 -- 172.21.15.99:0/2025695560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30c15e970 msgr2=0x7fb30c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.585+0000 7fb310a00640 1 --2- 172.21.15.99:0/2025695560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30c15e970 0x7fb30c0d0300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0d3960 tx=0x7fb2fc02a2a0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.585+0000 7fb310a00640 1 -- 172.21.15.99:0/2025695560 shutdown_connections 2024-09-10T07:36:30.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.585+0000 7fb310a00640 1 --2- 172.21.15.99:0/2025695560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30c15e970 0x7fb30c0d0300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.585+0000 7fb310a00640 1 -- 172.21.15.99:0/2025695560 >> 172.21.15.99:0/2025695560 conn(0x7fb30c09de00 msgr2=0x7fb30c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:30.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.585+0000 7fb310a00640 1 -- 172.21.15.99:0/2025695560 shutdown_connections 2024-09-10T07:36:30.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.585+0000 7fb310a00640 1 -- 172.21.15.99:0/2025695560 wait complete. 2024-09-10T07:36:30.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.587+0000 7fb310a00640 1 Processor -- start 2024-09-10T07:36:30.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.587+0000 7fb310a00640 1 -- start start 2024-09-10T07:36:30.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb310a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb30c0cfc90 0x7fb30c157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb310a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30c0d2680 0x7fb30c0ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb310a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30c15e970 0x7fb30c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb310a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c15ed50 con 0x7fb30c15e970 2024-09-10T07:36:30.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb310a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c0d0840 con 0x7fb30c0d2680 2024-09-10T07:36:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb310a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb30c15eed0 con 0x7fb30c0cfc90 2024-09-10T07:36:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb30be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30c15e970 0x7fb30c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb30be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30c15e970 0x7fb30c157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55342/0 (socket says 172.21.15.99:55342) 2024-09-10T07:36:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb30be00640 1 -- 172.21.15.99:0/3756413466 learned_addr learned my addr 172.21.15.99:0/3756413466 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb302a00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30c0d2680 0x7fb30c0ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb30b400640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb30c0cfc90 0x7fb30c157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb30be00640 1 -- 172.21.15.99:0/3756413466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb30c0cfc90 msgr2=0x7fb30c157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb30be00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb30c0cfc90 0x7fb30c157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb30be00640 1 -- 172.21.15.99:0/3756413466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30c0d2680 msgr2=0x7fb30c0ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb30be00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30c0d2680 0x7fb30c0ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.588+0000 7fb30be00640 1 -- 172.21.15.99:0/3756413466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c1581e0 con 0x7fb30c15e970 2024-09-10T07:36:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.589+0000 7fb30be00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30c15e970 0x7fb30c157290 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c7a0 tx=0x7fb30400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.589+0000 7fb303e00640 1 -- 172.21.15.99:0/3756413466 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb304003b70 con 0x7fb30c15e970 2024-09-10T07:36:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.589+0000 7fb303e00640 1 -- 172.21.15.99:0/3756413466 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb304003d30 con 0x7fb30c15e970 2024-09-10T07:36:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.589+0000 7fb303e00640 1 -- 172.21.15.99:0/3756413466 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30400aa90 con 0x7fb30c15e970 2024-09-10T07:36:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.589+0000 7fb310a00640 1 -- 172.21.15.99:0/3756413466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30c1584c0 con 0x7fb30c15e970 2024-09-10T07:36:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.589+0000 7fb310a00640 1 -- 172.21.15.99:0/3756413466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30c1577d0 con 0x7fb30c15e970 2024-09-10T07:36:30.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.590+0000 7fb310a00640 1 -- 172.21.15.99:0/3756413466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30c0d0300 con 0x7fb30c15e970 2024-09-10T07:36:30.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.591+0000 7fb303e00640 1 -- 172.21.15.99:0/3756413466 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb30400ac30 con 0x7fb30c15e970 2024-09-10T07:36:30.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.592+0000 7fb303e00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e806be30 0x7fb2e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.593+0000 7fb303e00640 1 -- 172.21.15.99:0/3756413466 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7fb30408ad00 con 0x7fb30c15e970 2024-09-10T07:36:30.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.593+0000 7fb30b400640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e806be30 0x7fb2e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.593+0000 7fb30b400640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e806be30 0x7fb2e806e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc034000 tx=0x7fb2fc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:30.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.597+0000 7fb303e00640 1 -- 172.21.15.99:0/3756413466 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb304058fd0 con 0x7fb30c15e970 2024-09-10T07:36:30.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.802+0000 7fb310a00640 1 -- 172.21.15.99:0/3756413466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb30c06d150 con 0x7fb30c15e970 2024-09-10T07:36:30.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.803+0000 7fb303e00640 1 -- 172.21.15.99:0/3756413466 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5229 (secure 0 0 0) 0x7fb30405d2d0 con 0x7fb30c15e970 2024-09-10T07:36:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:30.806 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":34,"btime":"2024-09-10T07:36:30:406568+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/2770940747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2770940747},{"type":"v1","addr":"172.21.15.187:6834","nonce":2770940747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":4997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/1207587759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1207587759},{"type":"v1","addr":"172.21.15.99:6836","nonce":1207587759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5463,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3753955373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3753955373},{"type":"v1","addr":"172.21.15.187:6835","nonce":3753955373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:36:26.770809+0000","modified":"2024-09-10T07:36:29.817237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5466":{"gid":5466,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3805850931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3805850931},{"type":"v1","addr":"172.21.15.99:6837","nonce":3805850931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5466,"qdb_cluster":[5466]},"id":4}]} 2024-09-10T07:36:30.807 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 34 2024-09-10T07:36:30.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 -- 172.21.15.99:0/3756413466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e806be30 msgr2=0x7fb2e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e806be30 0x7fb2e806e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc034000 tx=0x7fb2fc02e000 comp rx=0 tx=0).stop 2024-09-10T07:36:30.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 -- 172.21.15.99:0/3756413466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30c15e970 msgr2=0x7fb30c157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30c15e970 0x7fb30c157290 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c7a0 tx=0x7fb30400cc60 comp rx=0 tx=0).stop 2024-09-10T07:36:30.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 -- 172.21.15.99:0/3756413466 shutdown_connections 2024-09-10T07:36:30.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2e806be30 0x7fb2e806e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb30c15e970 0x7fb30c157290 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30c0d2680 0x7fb30c0ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 --2- 172.21.15.99:0/3756413466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb30c0cfc90 0x7fb30c157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 -- 172.21.15.99:0/3756413466 >> 172.21.15.99:0/3756413466 conn(0x7fb30c09de00 msgr2=0x7fb30c06d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:30.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 -- 172.21.15.99:0/3756413466 shutdown_connections 2024-09-10T07:36:30.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.805+0000 7fb310a00640 1 -- 172.21.15.99:0/3756413466 wait complete. 2024-09-10T07:36:30.822 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:36:30.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.976+0000 7febeb400640 1 Processor -- start 2024-09-10T07:36:30.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.976+0000 7febeb400640 1 -- start start 2024-09-10T07:36:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.977+0000 7febeb400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7febe4145290 0x7febe406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.977+0000 7febeb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072f40 0x7febe40b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.977+0000 7febeb400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe406e3d0 con 0x7febe40ce780 2024-09-10T07:36:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.977+0000 7febeb400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7febe406efe0 con 0x7febe4145290 2024-09-10T07:36:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.977+0000 7febeb400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7febe406e6b0 con 0x7febe4072f40 2024-09-10T07:36:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.977+0000 7febe8a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7febe4145290 0x7febe406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.977+0000 7febe9400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072f40 0x7febe40b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.977+0000 7febe8a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7febe4145290 0x7febe406f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:52524/0 (socket says 172.21.15.99:52524) 2024-09-10T07:36:30.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.977+0000 7febe8a00640 1 -- 172.21.15.99:0/1320599085 learned_addr learned my addr 172.21.15.99:0/1320599085 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:30.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.978+0000 7febe8a00640 1 -- 172.21.15.99:0/1320599085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072f40 msgr2=0x7febe40b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:30.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.978+0000 7febe8a00640 1 --2- 172.21.15.99:0/1320599085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072f40 0x7febe40b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.978+0000 7febe8a00640 1 -- 172.21.15.99:0/1320599085 >> v1:172.21.15.187:6789/0 conn(0x7febe40ce780 legacy=0x7febe4072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.978+0000 7febe8a00640 1 -- 172.21.15.99:0/1320599085 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe406e990 con 0x7febe4145290 2024-09-10T07:36:30.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.978+0000 7febe3e00640 1 -- 172.21.15.99:0/1320599085 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427740433 0 0) 0x7febe406e3d0 con 0x7febe40ce780 2024-09-10T07:36:30.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.979+0000 7febe8a00640 1 --2- 172.21.15.99:0/1320599085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe4145290 0x7febe406f470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7febd4009870 tx=0x7febd402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad9af961fc6bfb98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:30.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.979+0000 7febe3e00640 1 -- 172.21.15.99:0/1320599085 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd4037070 con 0x7febe4145290 2024-09-10T07:36:30.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.979+0000 7febe3e00640 1 -- 172.21.15.99:0/1320599085 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd4032440 con 0x7febe4145290 2024-09-10T07:36:30.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.979+0000 7febe3e00640 1 -- 172.21.15.99:0/1320599085 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd4032810 con 0x7febe4145290 2024-09-10T07:36:30.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.980+0000 7febeb400640 1 -- 172.21.15.99:0/1320599085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe4145290 msgr2=0x7febe406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.980+0000 7febeb400640 1 --2- 172.21.15.99:0/1320599085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe4145290 0x7febe406f470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7febd4009870 tx=0x7febd402a270 comp rx=0 tx=0).stop 2024-09-10T07:36:30.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.980+0000 7febeb400640 1 -- 172.21.15.99:0/1320599085 shutdown_connections 2024-09-10T07:36:30.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.980+0000 7febeb400640 1 --2- 172.21.15.99:0/1320599085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072f40 0x7febe40b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.980+0000 7febeb400640 1 --2- 172.21.15.99:0/1320599085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe4145290 0x7febe406f470 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.980+0000 7febeb400640 1 -- 172.21.15.99:0/1320599085 >> 172.21.15.99:0/1320599085 conn(0x7febe406bc10 msgr2=0x7febe406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.980+0000 7febeb400640 1 -- 172.21.15.99:0/1320599085 shutdown_connections 2024-09-10T07:36:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.980+0000 7febeb400640 1 -- 172.21.15.99:0/1320599085 wait complete. 2024-09-10T07:36:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.981+0000 7febeb400640 1 Processor -- start 2024-09-10T07:36:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.982+0000 7febeb400640 1 -- start start 2024-09-10T07:36:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.982+0000 7febeb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febe4072f40 0x7febe41387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.982+0000 7febeb400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe40ce780 0x7febe4143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.982+0000 7febeb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4145290 0x7febe41444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.982+0000 7febeb400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7febe406df80 con 0x7febe4072f40 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.982+0000 7febeb400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7febe4145670 con 0x7febe40ce780 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.982+0000 7febeb400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7febe406e100 con 0x7febe4145290 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febe8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febe4072f40 0x7febe41387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febe8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febe4072f40 0x7febe41387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55344/0 (socket says 172.21.15.99:55344) 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febe8a00640 1 -- 172.21.15.99:0/3962268619 learned_addr learned my addr 172.21.15.99:0/3962268619 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febdbe00640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe40ce780 0x7febe4143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febe9400640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4145290 0x7febe41444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febe8a00640 1 -- 172.21.15.99:0/3962268619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4145290 msgr2=0x7febe41444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febe8a00640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4145290 0x7febe41444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febe8a00640 1 -- 172.21.15.99:0/3962268619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe40ce780 msgr2=0x7febe4143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febe8a00640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe40ce780 0x7febe4143f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febe8a00640 1 -- 172.21.15.99:0/3962268619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe40aea50 con 0x7febe4072f40 2024-09-10T07:36:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.983+0000 7febdbe00640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe40ce780 0x7febe4143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.984+0000 7febe8a00640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febe4072f40 0x7febe41387d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7febd4009870 tx=0x7febd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.984+0000 7febe1600640 1 -- 172.21.15.99:0/3962268619 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd4041070 con 0x7febe4072f40 2024-09-10T07:36:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.984+0000 7febe1600640 1 -- 172.21.15.99:0/3962268619 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd403c870 con 0x7febe4072f40 2024-09-10T07:36:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.984+0000 7febeb400640 1 -- 172.21.15.99:0/3962268619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe40aed30 con 0x7febe4072f40 2024-09-10T07:36:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.984+0000 7febe1600640 1 -- 172.21.15.99:0/3962268619 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd4037040 con 0x7febe4072f40 2024-09-10T07:36:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.984+0000 7febeb400640 1 -- 172.21.15.99:0/3962268619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe40af2f0 con 0x7febe4072f40 2024-09-10T07:36:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.985+0000 7febeb400640 1 -- 172.21.15.99:0/3962268619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febe40715a0 con 0x7febe4072f40 2024-09-10T07:36:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.986+0000 7febe1600640 1 -- 172.21.15.99:0/3962268619 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febd4044070 con 0x7febe4072f40 2024-09-10T07:36:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.987+0000 7febe1600640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febc006be60 0x7febc006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.987+0000 7febe1600640 1 -- 172.21.15.99:0/3962268619 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7febd40aba80 con 0x7febe4072f40 2024-09-10T07:36:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.987+0000 7febdbe00640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febc006be60 0x7febc006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.987+0000 7febdbe00640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febc006be60 0x7febc006e320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7febe413be00 tx=0x7febcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:30.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:30.991+0000 7febe1600640 1 -- 172.21.15.99:0/3962268619 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7febd407a4d0 con 0x7febe4072f40 2024-09-10T07:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.164+0000 7febeb400640 1 -- 172.21.15.99:0/3962268619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febe40ccfc0 con 0x7febe4072f40 2024-09-10T07:36:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.166+0000 7febe1600640 1 -- 172.21.15.99:0/3962268619 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16701 (secure 0 0 0) 0x7febd4079dd0 con 0x7febe4072f40 2024-09-10T07:36:31.166 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:31.167 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":65,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:36:28.374502+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:36:24.546261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T07:36:25.773175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:36:31.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 -- 172.21.15.99:0/3962268619 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febc006be60 msgr2=0x7febc006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febc006be60 0x7febc006e320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7febe413be00 tx=0x7febcc009040 comp rx=0 tx=0).stop 2024-09-10T07:36:31.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 -- 172.21.15.99:0/3962268619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febe4072f40 msgr2=0x7febe41387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febe4072f40 0x7febe41387d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7febd4009870 tx=0x7febd40046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 -- 172.21.15.99:0/3962268619 shutdown_connections 2024-09-10T07:36:31.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4145290 0x7febe41444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe40ce780 0x7febe4143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febc006be60 0x7febc006e320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 --2- 172.21.15.99:0/3962268619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febe4072f40 0x7febe41387d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 -- 172.21.15.99:0/3962268619 >> 172.21.15.99:0/3962268619 conn(0x7febe406bc10 msgr2=0x7febe4072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:31.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 -- 172.21.15.99:0/3962268619 shutdown_connections 2024-09-10T07:36:31.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.168+0000 7febeb400640 1 -- 172.21.15.99:0/3962268619 wait complete. 2024-09-10T07:36:31.186 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:36:31.186 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:36:31.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.340+0000 7fb79b200640 1 Processor -- start 2024-09-10T07:36:31.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.340+0000 7fb79b200640 1 -- start start 2024-09-10T07:36:31.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb79b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb79c15e970 0x7fb79c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb79b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb79c0d2680 0x7fb79c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb79b200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb79c0cfac0 0x7fb79c0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb79b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb79c0d37e0 con 0x7fb79c0d2680 2024-09-10T07:36:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb79b200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb79c0d2bd0 con 0x7fb79c0cfac0 2024-09-10T07:36:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb79b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb79c0d2eb0 con 0x7fb79c15e970 2024-09-10T07:36:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb799400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb79c0d2680 0x7fb79c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb799400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb79c0d2680 0x7fb79c0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55358/0 (socket says 172.21.15.99:55358) 2024-09-10T07:36:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb79a800640 1 --2- 172.21.15.99:0/145713633 >> v2:172.21.15.187:3300/0 conn(0x7fb79c0cfac0 0x7fb79c0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb799400640 1 -- 172.21.15.99:0/145713633 learned_addr learned my addr 172.21.15.99:0/145713633 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.341+0000 7fb799e00640 1 --2- 172.21.15.99:0/145713633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb79c15e970 0x7fb79c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.342+0000 7fb799400640 1 -- 172.21.15.99:0/145713633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb79c15e970 msgr2=0x7fb79c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.342+0000 7fb799400640 1 --2- 172.21.15.99:0/145713633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb79c15e970 0x7fb79c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.342+0000 7fb799400640 1 -- 172.21.15.99:0/145713633 >> v2:172.21.15.187:3300/0 conn(0x7fb79c0cfac0 msgr2=0x7fb79c0d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.342+0000 7fb799400640 1 --2- 172.21.15.99:0/145713633 >> v2:172.21.15.187:3300/0 conn(0x7fb79c0cfac0 0x7fb79c0d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.342+0000 7fb799400640 1 -- 172.21.15.99:0/145713633 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79c0d3190 con 0x7fb79c0d2680 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.343+0000 7fb799400640 1 --2- 172.21.15.99:0/145713633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c0d2680 0x7fb79c0cf580 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb79c08dca0 tx=0x7fb78802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5783b08eaf6b96b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.343+0000 7fb798a00640 1 -- 172.21.15.99:0/145713633 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788037070 con 0x7fb79c0d2680 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.343+0000 7fb798a00640 1 -- 172.21.15.99:0/145713633 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb788032440 con 0x7fb79c0d2680 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.343+0000 7fb798a00640 1 -- 172.21.15.99:0/145713633 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788032810 con 0x7fb79c0d2680 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.344+0000 7fb79b200640 1 -- 172.21.15.99:0/145713633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c0d2680 msgr2=0x7fb79c0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.344+0000 7fb79b200640 1 --2- 172.21.15.99:0/145713633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c0d2680 0x7fb79c0cf580 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb79c08dca0 tx=0x7fb78802a270 comp rx=0 tx=0).stop 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.344+0000 7fb79b200640 1 -- 172.21.15.99:0/145713633 shutdown_connections 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.344+0000 7fb79b200640 1 --2- 172.21.15.99:0/145713633 >> v2:172.21.15.187:3300/0 conn(0x7fb79c0cfac0 0x7fb79c0d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.344+0000 7fb79b200640 1 --2- 172.21.15.99:0/145713633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c0d2680 0x7fb79c0cf580 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.344+0000 7fb79b200640 1 --2- 172.21.15.99:0/145713633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb79c15e970 0x7fb79c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.344+0000 7fb79b200640 1 -- 172.21.15.99:0/145713633 >> 172.21.15.99:0/145713633 conn(0x7fb79c09de00 msgr2=0x7fb79c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:31.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.344+0000 7fb79b200640 1 -- 172.21.15.99:0/145713633 shutdown_connections 2024-09-10T07:36:31.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.344+0000 7fb79b200640 1 -- 172.21.15.99:0/145713633 wait complete. 2024-09-10T07:36:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.346+0000 7fb79b200640 1 Processor -- start 2024-09-10T07:36:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.346+0000 7fb79b200640 1 -- start start 2024-09-10T07:36:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb79c0cfac0 0x7fb79c0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79b200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb79c0d2680 0x7fb79c0b7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c15e970 0x7fb79c0b8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c0d0840 con 0x7fb79c15e970 2024-09-10T07:36:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79b200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c0cff70 con 0x7fb79c0d2680 2024-09-10T07:36:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb79c15ed50 con 0x7fb79c0cfac0 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c15e970 0x7fb79c0b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c15e970 0x7fb79c0b8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55372/0 (socket says 172.21.15.99:55372) 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79a800640 1 -- 172.21.15.99:0/1741020675 learned_addr learned my addr 172.21.15.99:0/1741020675 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb799e00640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb79c0cfac0 0x7fb79c0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb799400640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb79c0d2680 0x7fb79c0b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79a800640 1 -- 172.21.15.99:0/1741020675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb79c0cfac0 msgr2=0x7fb79c0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79a800640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb79c0cfac0 0x7fb79c0b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79a800640 1 -- 172.21.15.99:0/1741020675 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb79c0d2680 msgr2=0x7fb79c0b7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79a800640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb79c0d2680 0x7fb79c0b7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.347+0000 7fb79a800640 1 -- 172.21.15.99:0/1741020675 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79c1e7ce0 con 0x7fb79c15e970 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.348+0000 7fb79a800640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c15e970 0x7fb79c0b8360 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb794009d30 tx=0x7fb79400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.348+0000 7fb792000640 1 -- 172.21.15.99:0/1741020675 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794018020 con 0x7fb79c15e970 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.348+0000 7fb792000640 1 -- 172.21.15.99:0/1741020675 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb794014480 con 0x7fb79c15e970 2024-09-10T07:36:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.348+0000 7fb79b200640 1 -- 172.21.15.99:0/1741020675 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79c1e7fc0 con 0x7fb79c15e970 2024-09-10T07:36:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.348+0000 7fb792000640 1 -- 172.21.15.99:0/1741020675 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794014870 con 0x7fb79c15e970 2024-09-10T07:36:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.348+0000 7fb79b200640 1 -- 172.21.15.99:0/1741020675 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79c1e8580 con 0x7fb79c15e970 2024-09-10T07:36:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.349+0000 7fb79b200640 1 -- 172.21.15.99:0/1741020675 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb79c1594c0 con 0x7fb79c15e970 2024-09-10T07:36:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.350+0000 7fb792000640 1 -- 172.21.15.99:0/1741020675 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb794005d10 con 0x7fb79c15e970 2024-09-10T07:36:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.351+0000 7fb792000640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb77c06be30 0x7fb77c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.351+0000 7fb792000640 1 -- 172.21.15.99:0/1741020675 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7fb79408b7b0 con 0x7fb79c15e970 2024-09-10T07:36:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.351+0000 7fb799e00640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb77c06be30 0x7fb77c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.352+0000 7fb799e00640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb77c06be30 0x7fb77c06e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009ac0 tx=0x7fb78c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.355+0000 7fb792000640 1 -- 172.21.15.99:0/1741020675 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb79c1594c0 con 0x7fb79c15e970 2024-09-10T07:36:31.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.527+0000 7fb79b200640 1 -- 172.21.15.99:0/1741020675 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb79c0cf580 con 0x7fb77c06be30 2024-09-10T07:36:31.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.533+0000 7fb792000640 1 -- 172.21.15.99:0/1741020675 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247448 (secure 0 0 0) 0x7fb79c0cf580 con 0x7fb77c06be30 2024-09-10T07:36:31.536 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:31.538 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:36:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.537+0000 7fb79b200640 1 -- 172.21.15.99:0/1741020675 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb77c06be30 msgr2=0x7fb77c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.537+0000 7fb79b200640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb77c06be30 0x7fb77c06e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009ac0 tx=0x7fb78c009190 comp rx=0 tx=0).stop 2024-09-10T07:36:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.537+0000 7fb79b200640 1 -- 172.21.15.99:0/1741020675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c15e970 msgr2=0x7fb79c0b8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.537+0000 7fb79b200640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c15e970 0x7fb79c0b8360 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb794009d30 tx=0x7fb79400c490 comp rx=0 tx=0).stop 2024-09-10T07:36:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.537+0000 7fb79b200640 1 -- 172.21.15.99:0/1741020675 shutdown_connections 2024-09-10T07:36:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.537+0000 7fb79b200640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb77c06be30 0x7fb77c06e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.537+0000 7fb79b200640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb79c15e970 0x7fb79c0b8360 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.537+0000 7fb79b200640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb79c0d2680 0x7fb79c0b7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.537+0000 7fb79b200640 1 --2- 172.21.15.99:0/1741020675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb79c0cfac0 0x7fb79c0b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.537+0000 7fb79b200640 1 -- 172.21.15.99:0/1741020675 >> 172.21.15.99:0/1741020675 conn(0x7fb79c09de00 msgr2=0x7fb79c0c8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:31.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.538+0000 7fb79b200640 1 -- 172.21.15.99:0/1741020675 shutdown_connections 2024-09-10T07:36:31.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.538+0000 7fb79b200640 1 -- 172.21.15.99:0/1741020675 wait complete. 2024-09-10T07:36:31.554 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-09-10T07:36:30.717749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3730,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558769,"statfs":{"total":1600000000,"available":1596180068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.364685"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394523+0000","last_change":"2024-09-10T07:36:27.394366+0000","last_active":"2024-09-10T07:36:27.394523+0000","last_peered":"2024-09-10T07:36:27.394523+0000","last_clean":"2024-09-10T07:36:27.394523+0000","last_became_active":"2024-09-10T07:36:27.394082+0000","last_became_peered":"2024-09-10T07:36:27.394082+0000","last_unstale":"2024-09-10T07:36:27.394523+0000","last_undegraded":"2024-09-10T07:36:27.394523+0000","last_fullsized":"2024-09-10T07:36:27.394523+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:05.865576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.393674+0000","last_change":"2024-09-10T07:36:27.393483+0000","last_active":"2024-09-10T07:36:27.393674+0000","last_peered":"2024-09-10T07:36:27.393674+0000","last_clean":"2024-09-10T07:36:27.393674+0000","last_became_active":"2024-09-10T07:36:27.393003+0000","last_became_peered":"2024-09-10T07:36:27.393003+0000","last_unstale":"2024-09-10T07:36:27.393674+0000","last_undegraded":"2024-09-10T07:36:27.393674+0000","last_fullsized":"2024-09-10T07:36:27.393674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:54.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.395470+0000","last_change":"2024-09-10T07:36:27.394794+0000","last_active":"2024-09-10T07:36:27.395470+0000","last_peered":"2024-09-10T07:36:27.395470+0000","last_clean":"2024-09-10T07:36:27.395470+0000","last_became_active":"2024-09-10T07:36:27.393939+0000","last_became_peered":"2024-09-10T07:36:27.393939+0000","last_unstale":"2024-09-10T07:36:27.395470+0000","last_undegraded":"2024-09-10T07:36:27.395470+0000","last_fullsized":"2024-09-10T07:36:27.395470+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:54.985316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378069+0000","last_change":"2024-09-10T07:36:27.390232+0000","last_active":"2024-09-10T07:36:28.378069+0000","last_peered":"2024-09-10T07:36:28.378069+0000","last_clean":"2024-09-10T07:36:28.378069+0000","last_became_active":"2024-09-10T07:36:27.389918+0000","last_became_peered":"2024-09-10T07:36:27.389918+0000","last_unstale":"2024-09-10T07:36:28.378069+0000","last_undegraded":"2024-09-10T07:36:28.378069+0000","last_fullsized":"2024-09-10T07:36:28.378069+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:05.885553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.392446+0000","last_change":"2024-09-10T07:36:27.392329+0000","last_active":"2024-09-10T07:36:27.392446+0000","last_peered":"2024-09-10T07:36:27.392446+0000","last_clean":"2024-09-10T07:36:27.392446+0000","last_became_active":"2024-09-10T07:36:27.392110+0000","last_became_peered":"2024-09-10T07:36:27.392110+0000","last_unstale":"2024-09-10T07:36:27.392446+0000","last_undegraded":"2024-09-10T07:36:27.392446+0000","last_fullsized":"2024-09-10T07:36:27.392446+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:24.506358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379777+0000","last_change":"2024-09-10T07:36:27.390572+0000","last_active":"2024-09-10T07:36:28.379777+0000","last_peered":"2024-09-10T07:36:28.379777+0000","last_clean":"2024-09-10T07:36:28.379777+0000","last_became_active":"2024-09-10T07:36:27.390164+0000","last_became_peered":"2024-09-10T07:36:27.390164+0000","last_unstale":"2024-09-10T07:36:28.379777+0000","last_undegraded":"2024-09-10T07:36:28.379777+0000","last_fullsized":"2024-09-10T07:36:28.379777+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:09.603679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378511+0000","last_change":"2024-09-10T07:36:27.389814+0000","last_active":"2024-09-10T07:36:28.378511+0000","last_peered":"2024-09-10T07:36:28.378511+0000","last_clean":"2024-09-10T07:36:28.378511+0000","last_became_active":"2024-09-10T07:36:27.389586+0000","last_became_peered":"2024-09-10T07:36:27.389586+0000","last_unstale":"2024-09-10T07:36:28.378511+0000","last_undegraded":"2024-09-10T07:36:28.378511+0000","last_fullsized":"2024-09-10T07:36:28.378511+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:42.918293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.384279+0000","last_change":"2024-09-10T07:36:27.383993+0000","last_active":"2024-09-10T07:36:27.384279+0000","last_peered":"2024-09-10T07:36:27.384279+0000","last_clean":"2024-09-10T07:36:27.384279+0000","last_became_active":"2024-09-10T07:36:27.383740+0000","last_became_peered":"2024-09-10T07:36:27.383740+0000","last_unstale":"2024-09-10T07:36:27.384279+0000","last_undegraded":"2024-09-10T07:36:27.384279+0000","last_fullsized":"2024-09-10T07:36:27.384279+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:57.604182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379079+0000","last_change":"2024-09-10T07:36:27.383520+0000","last_active":"2024-09-10T07:36:28.379079+0000","last_peered":"2024-09-10T07:36:28.379079+0000","last_clean":"2024-09-10T07:36:28.379079+0000","last_became_active":"2024-09-10T07:36:27.383061+0000","last_became_peered":"2024-09-10T07:36:27.383061+0000","last_unstale":"2024-09-10T07:36:28.379079+0000","last_undegraded":"2024-09-10T07:36:28.379079+0000","last_fullsized":"2024-09-10T07:36:28.379079+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:34.120736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.397674+0000","last_change":"2024-09-10T07:36:27.397582+0000","last_active":"2024-09-10T07:36:27.397674+0000","last_peered":"2024-09-10T07:36:27.397674+0000","last_clean":"2024-09-10T07:36:27.397674+0000","last_became_active":"2024-09-10T07:36:27.396623+0000","last_became_peered":"2024-09-10T07:36:27.396623+0000","last_unstale":"2024-09-10T07:36:27.397674+0000","last_undegraded":"2024-09-10T07:36:27.397674+0000","last_fullsized":"2024-09-10T07:36:27.397674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:13.204088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.397236+0000","last_change":"2024-09-10T07:36:27.397124+0000","last_active":"2024-09-10T07:36:27.397236+0000","last_peered":"2024-09-10T07:36:27.397236+0000","last_clean":"2024-09-10T07:36:27.397236+0000","last_became_active":"2024-09-10T07:36:27.396599+0000","last_became_peered":"2024-09-10T07:36:27.396599+0000","last_unstale":"2024-09-10T07:36:27.397236+0000","last_undegraded":"2024-09-10T07:36:27.397236+0000","last_fullsized":"2024-09-10T07:36:27.397236+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:29.359248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378418+0000","last_change":"2024-09-10T07:36:27.388408+0000","last_active":"2024-09-10T07:36:28.378418+0000","last_peered":"2024-09-10T07:36:28.378418+0000","last_clean":"2024-09-10T07:36:28.378418+0000","last_became_active":"2024-09-10T07:36:27.386647+0000","last_became_peered":"2024-09-10T07:36:27.386647+0000","last_unstale":"2024-09-10T07:36:28.378418+0000","last_undegraded":"2024-09-10T07:36:28.378418+0000","last_fullsized":"2024-09-10T07:36:28.378418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:38.627820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.388578+0000","last_change":"2024-09-10T07:36:27.388330+0000","last_active":"2024-09-10T07:36:27.388578+0000","last_peered":"2024-09-10T07:36:27.388578+0000","last_clean":"2024-09-10T07:36:27.388578+0000","last_became_active":"2024-09-10T07:36:27.388064+0000","last_became_peered":"2024-09-10T07:36:27.388064+0000","last_unstale":"2024-09-10T07:36:27.388578+0000","last_undegraded":"2024-09-10T07:36:27.388578+0000","last_fullsized":"2024-09-10T07:36:27.388578+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:40.139171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379254+0000","last_change":"2024-09-10T07:36:27.388826+0000","last_active":"2024-09-10T07:36:28.379254+0000","last_peered":"2024-09-10T07:36:28.379254+0000","last_clean":"2024-09-10T07:36:28.379254+0000","last_became_active":"2024-09-10T07:36:27.388584+0000","last_became_peered":"2024-09-10T07:36:27.388584+0000","last_unstale":"2024-09-10T07:36:28.379254+0000","last_undegraded":"2024-09-10T07:36:28.379254+0000","last_fullsized":"2024-09-10T07:36:28.379254+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:51.481110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379551+0000","last_change":"2024-09-10T07:36:27.397813+0000","last_active":"2024-09-10T07:36:28.379551+0000","last_peered":"2024-09-10T07:36:28.379551+0000","last_clean":"2024-09-10T07:36:28.379551+0000","last_became_active":"2024-09-10T07:36:27.397559+0000","last_became_peered":"2024-09-10T07:36:27.397559+0000","last_unstale":"2024-09-10T07:36:28.379551+0000","last_undegraded":"2024-09-10T07:36:28.379551+0000","last_fullsized":"2024-09-10T07:36:28.379551+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:49.334242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380080+0000","last_change":"2024-09-10T07:36:27.390378+0000","last_active":"2024-09-10T07:36:28.380080+0000","last_peered":"2024-09-10T07:36:28.380080+0000","last_clean":"2024-09-10T07:36:28.380080+0000","last_became_active":"2024-09-10T07:36:27.389660+0000","last_became_peered":"2024-09-10T07:36:27.389660+0000","last_unstale":"2024-09-10T07:36:28.380080+0000","last_undegraded":"2024-09-10T07:36:28.380080+0000","last_fullsized":"2024-09-10T07:36:28.380080+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:35.725303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.390158+0000","last_change":"2024-09-10T07:36:27.389987+0000","last_active":"2024-09-10T07:36:27.390158+0000","last_peered":"2024-09-10T07:36:27.390158+0000","last_clean":"2024-09-10T07:36:27.390158+0000","last_became_active":"2024-09-10T07:36:27.388731+0000","last_became_peered":"2024-09-10T07:36:27.388731+0000","last_unstale":"2024-09-10T07:36:27.390158+0000","last_undegraded":"2024-09-10T07:36:27.390158+0000","last_fullsized":"2024-09-10T07:36:27.390158+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:05.364959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394782+0000","last_change":"2024-09-10T07:36:27.394560+0000","last_active":"2024-09-10T07:36:27.394782+0000","last_peered":"2024-09-10T07:36:27.394782+0000","last_clean":"2024-09-10T07:36:27.394782+0000","last_became_active":"2024-09-10T07:36:27.392706+0000","last_became_peered":"2024-09-10T07:36:27.392706+0000","last_unstale":"2024-09-10T07:36:27.394782+0000","last_undegraded":"2024-09-10T07:36:27.394782+0000","last_fullsized":"2024-09-10T07:36:27.394782+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:50.707114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.395256+0000","last_change":"2024-09-10T07:36:27.394866+0000","last_active":"2024-09-10T07:36:27.395256+0000","last_peered":"2024-09-10T07:36:27.395256+0000","last_clean":"2024-09-10T07:36:27.395256+0000","last_became_active":"2024-09-10T07:36:27.394632+0000","last_became_peered":"2024-09-10T07:36:27.394632+0000","last_unstale":"2024-09-10T07:36:27.395256+0000","last_undegraded":"2024-09-10T07:36:27.395256+0000","last_fullsized":"2024-09-10T07:36:27.395256+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:24.240396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.391511+0000","last_change":"2024-09-10T07:36:27.391222+0000","last_active":"2024-09-10T07:36:27.391511+0000","last_peered":"2024-09-10T07:36:27.391511+0000","last_clean":"2024-09-10T07:36:27.391511+0000","last_became_active":"2024-09-10T07:36:27.390888+0000","last_became_peered":"2024-09-10T07:36:27.390888+0000","last_unstale":"2024-09-10T07:36:27.391511+0000","last_undegraded":"2024-09-10T07:36:27.391511+0000","last_fullsized":"2024-09-10T07:36:27.391511+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:52.320905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.396043+0000","last_change":"2024-09-10T07:36:27.395897+0000","last_active":"2024-09-10T07:36:27.396043+0000","last_peered":"2024-09-10T07:36:27.396043+0000","last_clean":"2024-09-10T07:36:27.396043+0000","last_became_active":"2024-09-10T07:36:27.393984+0000","last_became_peered":"2024-09-10T07:36:27.393984+0000","last_unstale":"2024-09-10T07:36:27.396043+0000","last_undegraded":"2024-09-10T07:36:27.396043+0000","last_fullsized":"2024-09-10T07:36:27.396043+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:52.056312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.393351+0000","last_change":"2024-09-10T07:36:27.393227+0000","last_active":"2024-09-10T07:36:27.393351+0000","last_peered":"2024-09-10T07:36:27.393351+0000","last_clean":"2024-09-10T07:36:27.393351+0000","last_became_active":"2024-09-10T07:36:27.392679+0000","last_became_peered":"2024-09-10T07:36:27.392679+0000","last_unstale":"2024-09-10T07:36:27.393351+0000","last_undegraded":"2024-09-10T07:36:27.393351+0000","last_fullsized":"2024-09-10T07:36:27.393351+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:49.655402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394742+0000","last_change":"2024-09-10T07:36:27.394268+0000","last_active":"2024-09-10T07:36:27.394742+0000","last_peered":"2024-09-10T07:36:27.394742+0000","last_clean":"2024-09-10T07:36:27.394742+0000","last_became_active":"2024-09-10T07:36:27.389974+0000","last_became_peered":"2024-09-10T07:36:27.389974+0000","last_unstale":"2024-09-10T07:36:27.394742+0000","last_undegraded":"2024-09-10T07:36:27.394742+0000","last_fullsized":"2024-09-10T07:36:27.394742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:31.650036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.387328+0000","last_change":"2024-09-10T07:36:27.386740+0000","last_active":"2024-09-10T07:36:27.387328+0000","last_peered":"2024-09-10T07:36:27.387328+0000","last_clean":"2024-09-10T07:36:27.387328+0000","last_became_active":"2024-09-10T07:36:27.386469+0000","last_became_peered":"2024-09-10T07:36:27.386469+0000","last_unstale":"2024-09-10T07:36:27.387328+0000","last_undegraded":"2024-09-10T07:36:27.387328+0000","last_fullsized":"2024-09-10T07:36:27.387328+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:05.356666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.398272+0000","last_change":"2024-09-10T07:36:27.397944+0000","last_active":"2024-09-10T07:36:27.398272+0000","last_peered":"2024-09-10T07:36:27.398272+0000","last_clean":"2024-09-10T07:36:27.398272+0000","last_became_active":"2024-09-10T07:36:27.397739+0000","last_became_peered":"2024-09-10T07:36:27.397739+0000","last_unstale":"2024-09-10T07:36:27.398272+0000","last_undegraded":"2024-09-10T07:36:27.398272+0000","last_fullsized":"2024-09-10T07:36:27.398272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:53.775423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378891+0000","last_change":"2024-09-10T07:36:27.387181+0000","last_active":"2024-09-10T07:36:28.378891+0000","last_peered":"2024-09-10T07:36:28.378891+0000","last_clean":"2024-09-10T07:36:28.378891+0000","last_became_active":"2024-09-10T07:36:27.385219+0000","last_became_peered":"2024-09-10T07:36:27.385219+0000","last_unstale":"2024-09-10T07:36:28.378891+0000","last_undegraded":"2024-09-10T07:36:28.378891+0000","last_fullsized":"2024-09-10T07:36:28.378891+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:49.276069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379752+0000","last_change":"2024-09-10T07:36:27.395582+0000","last_active":"2024-09-10T07:36:28.379752+0000","last_peered":"2024-09-10T07:36:28.379752+0000","last_clean":"2024-09-10T07:36:28.379752+0000","last_became_active":"2024-09-10T07:36:27.395353+0000","last_became_peered":"2024-09-10T07:36:27.395353+0000","last_unstale":"2024-09-10T07:36:28.379752+0000","last_undegraded":"2024-09-10T07:36:28.379752+0000","last_fullsized":"2024-09-10T07:36:28.379752+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:19.358140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394506+0000","last_change":"2024-09-10T07:36:27.393636+0000","last_active":"2024-09-10T07:36:27.394506+0000","last_peered":"2024-09-10T07:36:27.394506+0000","last_clean":"2024-09-10T07:36:27.394506+0000","last_became_active":"2024-09-10T07:36:27.393224+0000","last_became_peered":"2024-09-10T07:36:27.393224+0000","last_unstale":"2024-09-10T07:36:27.394506+0000","last_undegraded":"2024-09-10T07:36:27.394506+0000","last_fullsized":"2024-09-10T07:36:27.394506+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:37.164288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.382814+0000","last_change":"2024-09-10T07:36:27.381536+0000","last_active":"2024-09-10T07:36:27.382814+0000","last_peered":"2024-09-10T07:36:27.382814+0000","last_clean":"2024-09-10T07:36:27.382814+0000","last_became_active":"2024-09-10T07:36:27.381372+0000","last_became_peered":"2024-09-10T07:36:27.381372+0000","last_unstale":"2024-09-10T07:36:27.382814+0000","last_undegraded":"2024-09-10T07:36:27.382814+0000","last_fullsized":"2024-09-10T07:36:27.382814+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:33.395247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394260+0000","last_change":"2024-09-10T07:36:27.393708+0000","last_active":"2024-09-10T07:36:27.394260+0000","last_peered":"2024-09-10T07:36:27.394260+0000","last_clean":"2024-09-10T07:36:27.394260+0000","last_became_active":"2024-09-10T07:36:27.389624+0000","last_became_peered":"2024-09-10T07:36:27.389624+0000","last_unstale":"2024-09-10T07:36:27.394260+0000","last_undegraded":"2024-09-10T07:36:27.394260+0000","last_fullsized":"2024-09-10T07:36:27.394260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:18.156552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.398309+0000","last_change":"2024-09-10T07:36:27.397978+0000","last_active":"2024-09-10T07:36:27.398309+0000","last_peered":"2024-09-10T07:36:27.398309+0000","last_clean":"2024-09-10T07:36:27.398309+0000","last_became_active":"2024-09-10T07:36:27.397718+0000","last_became_peered":"2024-09-10T07:36:27.397718+0000","last_unstale":"2024-09-10T07:36:27.398309+0000","last_undegraded":"2024-09-10T07:36:27.398309+0000","last_fullsized":"2024-09-10T07:36:27.398309+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:36.547363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379894+0000","last_change":"2024-09-10T07:36:27.396710+0000","last_active":"2024-09-10T07:36:28.379894+0000","last_peered":"2024-09-10T07:36:28.379894+0000","last_clean":"2024-09-10T07:36:28.379894+0000","last_became_active":"2024-09-10T07:36:27.396483+0000","last_became_peered":"2024-09-10T07:36:27.396483+0000","last_unstale":"2024-09-10T07:36:28.379894+0000","last_undegraded":"2024-09-10T07:36:28.379894+0000","last_fullsized":"2024-09-10T07:36:28.379894+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:13.113936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379965+0000","last_change":"2024-09-10T07:36:27.387879+0000","last_active":"2024-09-10T07:36:28.379965+0000","last_peered":"2024-09-10T07:36:28.379965+0000","last_clean":"2024-09-10T07:36:28.379965+0000","last_became_active":"2024-09-10T07:36:27.387656+0000","last_became_peered":"2024-09-10T07:36:27.387656+0000","last_unstale":"2024-09-10T07:36:28.379965+0000","last_undegraded":"2024-09-10T07:36:28.379965+0000","last_fullsized":"2024-09-10T07:36:28.379965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:03.545055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"64'4","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379926+0000","last_change":"2024-09-10T07:36:26.371373+0000","last_active":"2024-09-10T07:36:28.379926+0000","last_peered":"2024-09-10T07:36:28.379926+0000","last_clean":"2024-09-10T07:36:28.379926+0000","last_became_active":"2024-09-10T07:36:26.370863+0000","last_became_peered":"2024-09-10T07:36:26.370863+0000","last_unstale":"2024-09-10T07:36:28.379926+0000","last_undegraded":"2024-09-10T07:36:28.379926+0000","last_fullsized":"2024-09-10T07:36:28.379926+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:49.346238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.395597+0000","last_change":"2024-09-10T07:36:27.395460+0000","last_active":"2024-09-10T07:36:27.395597+0000","last_peered":"2024-09-10T07:36:27.395597+0000","last_clean":"2024-09-10T07:36:27.395597+0000","last_became_active":"2024-09-10T07:36:27.395208+0000","last_became_peered":"2024-09-10T07:36:27.395208+0000","last_unstale":"2024-09-10T07:36:27.395597+0000","last_undegraded":"2024-09-10T07:36:27.395597+0000","last_fullsized":"2024-09-10T07:36:27.395597+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:06.861886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.405571+0000","last_change":"2024-09-10T07:36:26.367635+0000","last_active":"2024-09-10T07:36:27.405571+0000","last_peered":"2024-09-10T07:36:27.405571+0000","last_clean":"2024-09-10T07:36:27.405571+0000","last_became_active":"2024-09-10T07:36:26.367031+0000","last_became_peered":"2024-09-10T07:36:26.367031+0000","last_unstale":"2024-09-10T07:36:27.405571+0000","last_undegraded":"2024-09-10T07:36:27.405571+0000","last_fullsized":"2024-09-10T07:36:27.405571+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:01.402656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379923+0000","last_change":"2024-09-10T07:36:27.399136+0000","last_active":"2024-09-10T07:36:28.379923+0000","last_peered":"2024-09-10T07:36:28.379923+0000","last_clean":"2024-09-10T07:36:28.379923+0000","last_became_active":"2024-09-10T07:36:27.398903+0000","last_became_peered":"2024-09-10T07:36:27.398903+0000","last_unstale":"2024-09-10T07:36:28.379923+0000","last_undegraded":"2024-09-10T07:36:28.379923+0000","last_fullsized":"2024-09-10T07:36:28.379923+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:21.486228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380094+0000","last_change":"2024-09-10T07:36:26.371906+0000","last_active":"2024-09-10T07:36:28.380094+0000","last_peered":"2024-09-10T07:36:28.380094+0000","last_clean":"2024-09-10T07:36:28.380094+0000","last_became_active":"2024-09-10T07:36:26.371682+0000","last_became_peered":"2024-09-10T07:36:26.371682+0000","last_unstale":"2024-09-10T07:36:28.380094+0000","last_undegraded":"2024-09-10T07:36:28.380094+0000","last_fullsized":"2024-09-10T07:36:28.380094+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:33.289008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379849+0000","last_change":"2024-09-10T07:36:27.393153+0000","last_active":"2024-09-10T07:36:28.379849+0000","last_peered":"2024-09-10T07:36:28.379849+0000","last_clean":"2024-09-10T07:36:28.379849+0000","last_became_active":"2024-09-10T07:36:27.392881+0000","last_became_peered":"2024-09-10T07:36:27.392881+0000","last_unstale":"2024-09-10T07:36:28.379849+0000","last_undegraded":"2024-09-10T07:36:28.379849+0000","last_fullsized":"2024-09-10T07:36:28.379849+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:38.448890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378999+0000","last_change":"2024-09-10T07:36:26.368811+0000","last_active":"2024-09-10T07:36:28.378999+0000","last_peered":"2024-09-10T07:36:28.378999+0000","last_clean":"2024-09-10T07:36:28.378999+0000","last_became_active":"2024-09-10T07:36:26.368297+0000","last_became_peered":"2024-09-10T07:36:26.368297+0000","last_unstale":"2024-09-10T07:36:28.378999+0000","last_undegraded":"2024-09-10T07:36:28.378999+0000","last_fullsized":"2024-09-10T07:36:28.378999+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:54.812936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.397403+0000","last_change":"2024-09-10T07:36:27.394030+0000","last_active":"2024-09-10T07:36:27.397403+0000","last_peered":"2024-09-10T07:36:27.397403+0000","last_clean":"2024-09-10T07:36:27.397403+0000","last_became_active":"2024-09-10T07:36:27.393738+0000","last_became_peered":"2024-09-10T07:36:27.393738+0000","last_unstale":"2024-09-10T07:36:27.397403+0000","last_undegraded":"2024-09-10T07:36:27.397403+0000","last_fullsized":"2024-09-10T07:36:27.397403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:26.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378905+0000","last_change":"2024-09-10T07:36:26.362722+0000","last_active":"2024-09-10T07:36:28.378905+0000","last_peered":"2024-09-10T07:36:28.378905+0000","last_clean":"2024-09-10T07:36:28.378905+0000","last_became_active":"2024-09-10T07:36:26.362306+0000","last_became_peered":"2024-09-10T07:36:26.362306+0000","last_unstale":"2024-09-10T07:36:28.378905+0000","last_undegraded":"2024-09-10T07:36:28.378905+0000","last_fullsized":"2024-09-10T07:36:28.378905+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:36.437766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394759+0000","last_change":"2024-09-10T07:36:27.394588+0000","last_active":"2024-09-10T07:36:27.394759+0000","last_peered":"2024-09-10T07:36:27.394759+0000","last_clean":"2024-09-10T07:36:27.394759+0000","last_became_active":"2024-09-10T07:36:27.394324+0000","last_became_peered":"2024-09-10T07:36:27.394324+0000","last_unstale":"2024-09-10T07:36:27.394759+0000","last_undegraded":"2024-09-10T07:36:27.394759+0000","last_fullsized":"2024-09-10T07:36:27.394759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:56.081648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380053+0000","last_change":"2024-09-10T07:36:26.368581+0000","last_active":"2024-09-10T07:36:28.380053+0000","last_peered":"2024-09-10T07:36:28.380053+0000","last_clean":"2024-09-10T07:36:28.380053+0000","last_became_active":"2024-09-10T07:36:26.368272+0000","last_became_peered":"2024-09-10T07:36:26.368272+0000","last_unstale":"2024-09-10T07:36:28.380053+0000","last_undegraded":"2024-09-10T07:36:28.380053+0000","last_fullsized":"2024-09-10T07:36:28.380053+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:48.711202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394453+0000","last_change":"2024-09-10T07:36:27.394322+0000","last_active":"2024-09-10T07:36:27.394453+0000","last_peered":"2024-09-10T07:36:27.394453+0000","last_clean":"2024-09-10T07:36:27.394453+0000","last_became_active":"2024-09-10T07:36:27.393502+0000","last_became_peered":"2024-09-10T07:36:27.393502+0000","last_unstale":"2024-09-10T07:36:27.394453+0000","last_undegraded":"2024-09-10T07:36:27.394453+0000","last_fullsized":"2024-09-10T07:36:27.394453+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:39.219847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378648+0000","last_change":"2024-09-10T07:36:26.367726+0000","last_active":"2024-09-10T07:36:28.378648+0000","last_peered":"2024-09-10T07:36:28.378648+0000","last_clean":"2024-09-10T07:36:28.378648+0000","last_became_active":"2024-09-10T07:36:26.367433+0000","last_became_peered":"2024-09-10T07:36:26.367433+0000","last_unstale":"2024-09-10T07:36:28.378648+0000","last_undegraded":"2024-09-10T07:36:28.378648+0000","last_fullsized":"2024-09-10T07:36:28.378648+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:39.570653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.391048+0000","last_change":"2024-09-10T07:36:27.390803+0000","last_active":"2024-09-10T07:36:27.391048+0000","last_peered":"2024-09-10T07:36:27.391048+0000","last_clean":"2024-09-10T07:36:27.391048+0000","last_became_active":"2024-09-10T07:36:27.389505+0000","last_became_peered":"2024-09-10T07:36:27.389505+0000","last_unstale":"2024-09-10T07:36:27.391048+0000","last_undegraded":"2024-09-10T07:36:27.391048+0000","last_fullsized":"2024-09-10T07:36:27.391048+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:48.866553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379642+0000","last_change":"2024-09-10T07:36:26.364701+0000","last_active":"2024-09-10T07:36:28.379642+0000","last_peered":"2024-09-10T07:36:28.379642+0000","last_clean":"2024-09-10T07:36:28.379642+0000","last_became_active":"2024-09-10T07:36:26.364234+0000","last_became_peered":"2024-09-10T07:36:26.364234+0000","last_unstale":"2024-09-10T07:36:28.379642+0000","last_undegraded":"2024-09-10T07:36:28.379642+0000","last_fullsized":"2024-09-10T07:36:28.379642+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:57.948604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378710+0000","last_change":"2024-09-10T07:36:27.392980+0000","last_active":"2024-09-10T07:36:28.378710+0000","last_peered":"2024-09-10T07:36:28.378710+0000","last_clean":"2024-09-10T07:36:28.378710+0000","last_became_active":"2024-09-10T07:36:27.392727+0000","last_became_peered":"2024-09-10T07:36:27.392727+0000","last_unstale":"2024-09-10T07:36:28.378710+0000","last_undegraded":"2024-09-10T07:36:28.378710+0000","last_fullsized":"2024-09-10T07:36:28.378710+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:41.270057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.388834+0000","last_change":"2024-09-10T07:36:26.368101+0000","last_active":"2024-09-10T07:36:27.388834+0000","last_peered":"2024-09-10T07:36:27.388834+0000","last_clean":"2024-09-10T07:36:27.388834+0000","last_became_active":"2024-09-10T07:36:26.367356+0000","last_became_peered":"2024-09-10T07:36:26.367356+0000","last_unstale":"2024-09-10T07:36:27.388834+0000","last_undegraded":"2024-09-10T07:36:27.388834+0000","last_fullsized":"2024-09-10T07:36:27.388834+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:33.084816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.399318+0000","last_change":"2024-09-10T07:36:27.399208+0000","last_active":"2024-09-10T07:36:27.399318+0000","last_peered":"2024-09-10T07:36:27.399318+0000","last_clean":"2024-09-10T07:36:27.399318+0000","last_became_active":"2024-09-10T07:36:27.398718+0000","last_became_peered":"2024-09-10T07:36:27.398718+0000","last_unstale":"2024-09-10T07:36:27.399318+0000","last_undegraded":"2024-09-10T07:36:27.399318+0000","last_fullsized":"2024-09-10T07:36:27.399318+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:32.153950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.380193+0000","last_change":"2024-09-10T07:36:26.365617+0000","last_active":"2024-09-10T07:36:27.380193+0000","last_peered":"2024-09-10T07:36:27.380193+0000","last_clean":"2024-09-10T07:36:27.380193+0000","last_became_active":"2024-09-10T07:36:26.365244+0000","last_became_peered":"2024-09-10T07:36:26.365244+0000","last_unstale":"2024-09-10T07:36:27.380193+0000","last_undegraded":"2024-09-10T07:36:27.380193+0000","last_fullsized":"2024-09-10T07:36:27.380193+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:35.201077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.395772+0000","last_change":"2024-09-10T07:36:27.395666+0000","last_active":"2024-09-10T07:36:27.395772+0000","last_peered":"2024-09-10T07:36:27.395772+0000","last_clean":"2024-09-10T07:36:27.395772+0000","last_became_active":"2024-09-10T07:36:27.395125+0000","last_became_peered":"2024-09-10T07:36:27.395125+0000","last_unstale":"2024-09-10T07:36:27.395772+0000","last_undegraded":"2024-09-10T07:36:27.395772+0000","last_fullsized":"2024-09-10T07:36:27.395772+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:04.579932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"64'3","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.406640+0000","last_change":"2024-09-10T07:36:26.367430+0000","last_active":"2024-09-10T07:36:27.406640+0000","last_peered":"2024-09-10T07:36:27.406640+0000","last_clean":"2024-09-10T07:36:27.406640+0000","last_became_active":"2024-09-10T07:36:26.366772+0000","last_became_peered":"2024-09-10T07:36:26.366772+0000","last_unstale":"2024-09-10T07:36:27.406640+0000","last_undegraded":"2024-09-10T07:36:27.406640+0000","last_fullsized":"2024-09-10T07:36:27.406640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:59.146566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.399113+0000","last_change":"2024-09-10T07:36:27.398979+0000","last_active":"2024-09-10T07:36:27.399113+0000","last_peered":"2024-09-10T07:36:27.399113+0000","last_clean":"2024-09-10T07:36:27.399113+0000","last_became_active":"2024-09-10T07:36:27.398543+0000","last_became_peered":"2024-09-10T07:36:27.398543+0000","last_unstale":"2024-09-10T07:36:27.399113+0000","last_undegraded":"2024-09-10T07:36:27.399113+0000","last_fullsized":"2024-09-10T07:36:27.399113+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:34.088825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"64'6","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379365+0000","last_change":"2024-09-10T07:36:26.369592+0000","last_active":"2024-09-10T07:36:28.379365+0000","last_peered":"2024-09-10T07:36:28.379365+0000","last_clean":"2024-09-10T07:36:28.379365+0000","last_became_active":"2024-09-10T07:36:26.369302+0000","last_became_peered":"2024-09-10T07:36:26.369302+0000","last_unstale":"2024-09-10T07:36:28.379365+0000","last_undegraded":"2024-09-10T07:36:28.379365+0000","last_fullsized":"2024-09-10T07:36:28.379365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:26.962964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378418+0000","last_change":"2024-09-10T07:36:27.397595+0000","last_active":"2024-09-10T07:36:28.378418+0000","last_peered":"2024-09-10T07:36:28.378418+0000","last_clean":"2024-09-10T07:36:28.378418+0000","last_became_active":"2024-09-10T07:36:27.397351+0000","last_became_peered":"2024-09-10T07:36:27.397351+0000","last_unstale":"2024-09-10T07:36:28.378418+0000","last_undegraded":"2024-09-10T07:36:28.378418+0000","last_fullsized":"2024-09-10T07:36:28.378418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:10.212549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.404692+0000","last_change":"2024-09-10T07:36:26.366355+0000","last_active":"2024-09-10T07:36:27.404692+0000","last_peered":"2024-09-10T07:36:27.404692+0000","last_clean":"2024-09-10T07:36:27.404692+0000","last_became_active":"2024-09-10T07:36:26.365617+0000","last_became_peered":"2024-09-10T07:36:26.365617+0000","last_unstale":"2024-09-10T07:36:27.404692+0000","last_undegraded":"2024-09-10T07:36:27.404692+0000","last_fullsized":"2024-09-10T07:36:27.404692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:01.243178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394800+0000","last_change":"2024-09-10T07:36:27.394661+0000","last_active":"2024-09-10T07:36:27.394800+0000","last_peered":"2024-09-10T07:36:27.394800+0000","last_clean":"2024-09-10T07:36:27.394800+0000","last_became_active":"2024-09-10T07:36:27.392072+0000","last_became_peered":"2024-09-10T07:36:27.392072+0000","last_unstale":"2024-09-10T07:36:27.394800+0000","last_undegraded":"2024-09-10T07:36:27.394800+0000","last_fullsized":"2024-09-10T07:36:27.394800+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:38.941053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.383462+0000","last_change":"2024-09-10T07:36:26.363463+0000","last_active":"2024-09-10T07:36:27.383462+0000","last_peered":"2024-09-10T07:36:27.383462+0000","last_clean":"2024-09-10T07:36:27.383462+0000","last_became_active":"2024-09-10T07:36:26.363171+0000","last_became_peered":"2024-09-10T07:36:26.363171+0000","last_unstale":"2024-09-10T07:36:27.383462+0000","last_undegraded":"2024-09-10T07:36:27.383462+0000","last_fullsized":"2024-09-10T07:36:27.383462+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:15.954820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378349+0000","last_change":"2024-09-10T07:36:27.390533+0000","last_active":"2024-09-10T07:36:28.378349+0000","last_peered":"2024-09-10T07:36:28.378349+0000","last_clean":"2024-09-10T07:36:28.378349+0000","last_became_active":"2024-09-10T07:36:27.390242+0000","last_became_peered":"2024-09-10T07:36:27.390242+0000","last_unstale":"2024-09-10T07:36:28.378349+0000","last_undegraded":"2024-09-10T07:36:28.378349+0000","last_fullsized":"2024-09-10T07:36:28.378349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:46:14.859683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378529+0000","last_change":"2024-09-10T07:36:26.366736+0000","last_active":"2024-09-10T07:36:28.378529+0000","last_peered":"2024-09-10T07:36:28.378529+0000","last_clean":"2024-09-10T07:36:28.378529+0000","last_became_active":"2024-09-10T07:36:26.366341+0000","last_became_peered":"2024-09-10T07:36:26.366341+0000","last_unstale":"2024-09-10T07:36:28.378529+0000","last_undegraded":"2024-09-10T07:36:28.378529+0000","last_fullsized":"2024-09-10T07:36:28.378529+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:56.362909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.388939+0000","last_change":"2024-09-10T07:36:27.388490+0000","last_active":"2024-09-10T07:36:27.388939+0000","last_peered":"2024-09-10T07:36:27.388939+0000","last_clean":"2024-09-10T07:36:27.388939+0000","last_became_active":"2024-09-10T07:36:27.388051+0000","last_became_peered":"2024-09-10T07:36:27.388051+0000","last_unstale":"2024-09-10T07:36:27.388939+0000","last_undegraded":"2024-09-10T07:36:27.388939+0000","last_fullsized":"2024-09-10T07:36:27.388939+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:49.934360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"64'8","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.405808+0000","last_change":"2024-09-10T07:36:26.369351+0000","last_active":"2024-09-10T07:36:27.405808+0000","last_peered":"2024-09-10T07:36:27.405808+0000","last_clean":"2024-09-10T07:36:27.405808+0000","last_became_active":"2024-09-10T07:36:26.367179+0000","last_became_peered":"2024-09-10T07:36:26.367179+0000","last_unstale":"2024-09-10T07:36:27.405808+0000","last_undegraded":"2024-09-10T07:36:27.405808+0000","last_fullsized":"2024-09-10T07:36:27.405808+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:27.302375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394762+0000","last_change":"2024-09-10T07:36:27.394398+0000","last_active":"2024-09-10T07:36:27.394762+0000","last_peered":"2024-09-10T07:36:27.394762+0000","last_clean":"2024-09-10T07:36:27.394762+0000","last_became_active":"2024-09-10T07:36:27.390139+0000","last_became_peered":"2024-09-10T07:36:27.390139+0000","last_unstale":"2024-09-10T07:36:27.394762+0000","last_undegraded":"2024-09-10T07:36:27.394762+0000","last_fullsized":"2024-09-10T07:36:27.394762+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:35.881709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.404220+0000","last_change":"2024-09-10T07:36:26.365501+0000","last_active":"2024-09-10T07:36:27.404220+0000","last_peered":"2024-09-10T07:36:27.404220+0000","last_clean":"2024-09-10T07:36:27.404220+0000","last_became_active":"2024-09-10T07:36:26.365201+0000","last_became_peered":"2024-09-10T07:36:26.365201+0000","last_unstale":"2024-09-10T07:36:27.404220+0000","last_undegraded":"2024-09-10T07:36:27.404220+0000","last_fullsized":"2024-09-10T07:36:27.404220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:05.827656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378242+0000","last_change":"2024-09-10T07:36:27.398142+0000","last_active":"2024-09-10T07:36:28.378242+0000","last_peered":"2024-09-10T07:36:28.378242+0000","last_clean":"2024-09-10T07:36:28.378242+0000","last_became_active":"2024-09-10T07:36:27.397703+0000","last_became_peered":"2024-09-10T07:36:27.397703+0000","last_unstale":"2024-09-10T07:36:28.378242+0000","last_undegraded":"2024-09-10T07:36:28.378242+0000","last_fullsized":"2024-09-10T07:36:28.378242+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:33.652071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380191+0000","last_change":"2024-09-10T07:36:26.373561+0000","last_active":"2024-09-10T07:36:28.380191+0000","last_peered":"2024-09-10T07:36:28.380191+0000","last_clean":"2024-09-10T07:36:28.380191+0000","last_became_active":"2024-09-10T07:36:26.373343+0000","last_became_peered":"2024-09-10T07:36:26.373343+0000","last_unstale":"2024-09-10T07:36:28.380191+0000","last_undegraded":"2024-09-10T07:36:28.380191+0000","last_fullsized":"2024-09-10T07:36:28.380191+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:03.534275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.384256+0000","last_change":"2024-09-10T07:36:27.383837+0000","last_active":"2024-09-10T07:36:27.384256+0000","last_peered":"2024-09-10T07:36:27.384256+0000","last_clean":"2024-09-10T07:36:27.384256+0000","last_became_active":"2024-09-10T07:36:27.383605+0000","last_became_peered":"2024-09-10T07:36:27.383605+0000","last_unstale":"2024-09-10T07:36:27.384256+0000","last_undegraded":"2024-09-10T07:36:27.384256+0000","last_fullsized":"2024-09-10T07:36:27.384256+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:26.744294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379102+0000","last_change":"2024-09-10T07:36:26.369014+0000","last_active":"2024-09-10T07:36:28.379102+0000","last_peered":"2024-09-10T07:36:28.379102+0000","last_clean":"2024-09-10T07:36:28.379102+0000","last_became_active":"2024-09-10T07:36:26.368592+0000","last_became_peered":"2024-09-10T07:36:26.368592+0000","last_unstale":"2024-09-10T07:36:28.379102+0000","last_undegraded":"2024-09-10T07:36:28.379102+0000","last_fullsized":"2024-09-10T07:36:28.379102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:13.023829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.399489+0000","last_change":"2024-09-10T07:36:27.399387+0000","last_active":"2024-09-10T07:36:27.399489+0000","last_peered":"2024-09-10T07:36:27.399489+0000","last_clean":"2024-09-10T07:36:27.399489+0000","last_became_active":"2024-09-10T07:36:27.399024+0000","last_became_peered":"2024-09-10T07:36:27.399024+0000","last_unstale":"2024-09-10T07:36:27.399489+0000","last_undegraded":"2024-09-10T07:36:27.399489+0000","last_fullsized":"2024-09-10T07:36:27.399489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:27.665748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380042+0000","last_change":"2024-09-10T07:36:26.372065+0000","last_active":"2024-09-10T07:36:28.380042+0000","last_peered":"2024-09-10T07:36:28.380042+0000","last_clean":"2024-09-10T07:36:28.380042+0000","last_became_active":"2024-09-10T07:36:26.371709+0000","last_became_peered":"2024-09-10T07:36:26.371709+0000","last_unstale":"2024-09-10T07:36:28.380042+0000","last_undegraded":"2024-09-10T07:36:28.380042+0000","last_fullsized":"2024-09-10T07:36:28.380042+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:54.470730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378482+0000","last_change":"2024-09-10T07:36:27.397939+0000","last_active":"2024-09-10T07:36:28.378482+0000","last_peered":"2024-09-10T07:36:28.378482+0000","last_clean":"2024-09-10T07:36:28.378482+0000","last_became_active":"2024-09-10T07:36:27.397294+0000","last_became_peered":"2024-09-10T07:36:27.397294+0000","last_unstale":"2024-09-10T07:36:28.378482+0000","last_undegraded":"2024-09-10T07:36:28.378482+0000","last_fullsized":"2024-09-10T07:36:28.378482+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:42.366358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.404410+0000","last_change":"2024-09-10T07:36:26.367526+0000","last_active":"2024-09-10T07:36:27.404410+0000","last_peered":"2024-09-10T07:36:27.404410+0000","last_clean":"2024-09-10T07:36:27.404410+0000","last_became_active":"2024-09-10T07:36:26.365532+0000","last_became_peered":"2024-09-10T07:36:26.365532+0000","last_unstale":"2024-09-10T07:36:27.404410+0000","last_undegraded":"2024-09-10T07:36:27.404410+0000","last_fullsized":"2024-09-10T07:36:27.404410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:49.574247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379819+0000","last_change":"2024-09-10T07:36:27.390639+0000","last_active":"2024-09-10T07:36:28.379819+0000","last_peered":"2024-09-10T07:36:28.379819+0000","last_clean":"2024-09-10T07:36:28.379819+0000","last_became_active":"2024-09-10T07:36:27.390312+0000","last_became_peered":"2024-09-10T07:36:27.390312+0000","last_unstale":"2024-09-10T07:36:28.379819+0000","last_undegraded":"2024-09-10T07:36:28.379819+0000","last_fullsized":"2024-09-10T07:36:28.379819+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.510855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.391691+0000","last_change":"2024-09-10T07:36:26.362986+0000","last_active":"2024-09-10T07:36:27.391691+0000","last_peered":"2024-09-10T07:36:27.391691+0000","last_clean":"2024-09-10T07:36:27.391691+0000","last_became_active":"2024-09-10T07:36:26.362619+0000","last_became_peered":"2024-09-10T07:36:26.362619+0000","last_unstale":"2024-09-10T07:36:27.391691+0000","last_undegraded":"2024-09-10T07:36:27.391691+0000","last_fullsized":"2024-09-10T07:36:27.391691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:40.439014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379998+0000","last_change":"2024-09-10T07:36:27.397028+0000","last_active":"2024-09-10T07:36:28.379998+0000","last_peered":"2024-09-10T07:36:28.379998+0000","last_clean":"2024-09-10T07:36:28.379998+0000","last_became_active":"2024-09-10T07:36:27.396793+0000","last_became_peered":"2024-09-10T07:36:27.396793+0000","last_unstale":"2024-09-10T07:36:28.379998+0000","last_undegraded":"2024-09-10T07:36:28.379998+0000","last_fullsized":"2024-09-10T07:36:28.379998+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:18.582540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379210+0000","last_change":"2024-09-10T07:36:26.365606+0000","last_active":"2024-09-10T07:36:28.379210+0000","last_peered":"2024-09-10T07:36:28.379210+0000","last_clean":"2024-09-10T07:36:28.379210+0000","last_became_active":"2024-09-10T07:36:26.365212+0000","last_became_peered":"2024-09-10T07:36:26.365212+0000","last_unstale":"2024-09-10T07:36:28.379210+0000","last_undegraded":"2024-09-10T07:36:28.379210+0000","last_fullsized":"2024-09-10T07:36:28.379210+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:30.560218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378134+0000","last_change":"2024-09-10T07:36:27.389822+0000","last_active":"2024-09-10T07:36:28.378134+0000","last_peered":"2024-09-10T07:36:28.378134+0000","last_clean":"2024-09-10T07:36:28.378134+0000","last_became_active":"2024-09-10T07:36:27.389533+0000","last_became_peered":"2024-09-10T07:36:27.389533+0000","last_unstale":"2024-09-10T07:36:28.378134+0000","last_undegraded":"2024-09-10T07:36:28.378134+0000","last_fullsized":"2024-09-10T07:36:28.378134+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:01.602841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.403049+0000","last_change":"2024-09-10T07:36:26.363786+0000","last_active":"2024-09-10T07:36:27.403049+0000","last_peered":"2024-09-10T07:36:27.403049+0000","last_clean":"2024-09-10T07:36:27.403049+0000","last_became_active":"2024-09-10T07:36:26.363569+0000","last_became_peered":"2024-09-10T07:36:26.363569+0000","last_unstale":"2024-09-10T07:36:27.403049+0000","last_undegraded":"2024-09-10T07:36:27.403049+0000","last_fullsized":"2024-09-10T07:36:27.403049+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:48.927067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378134+0000","last_change":"2024-09-10T07:36:27.388196+0000","last_active":"2024-09-10T07:36:28.378134+0000","last_peered":"2024-09-10T07:36:28.378134+0000","last_clean":"2024-09-10T07:36:28.378134+0000","last_became_active":"2024-09-10T07:36:27.386254+0000","last_became_peered":"2024-09-10T07:36:27.386254+0000","last_unstale":"2024-09-10T07:36:28.378134+0000","last_undegraded":"2024-09-10T07:36:28.378134+0000","last_fullsized":"2024-09-10T07:36:28.378134+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:14.648531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380169+0000","last_change":"2024-09-10T07:36:26.371025+0000","last_active":"2024-09-10T07:36:28.380169+0000","last_peered":"2024-09-10T07:36:28.380169+0000","last_clean":"2024-09-10T07:36:28.380169+0000","last_became_active":"2024-09-10T07:36:26.370443+0000","last_became_peered":"2024-09-10T07:36:26.370443+0000","last_unstale":"2024-09-10T07:36:28.380169+0000","last_undegraded":"2024-09-10T07:36:28.380169+0000","last_fullsized":"2024-09-10T07:36:28.380169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:00.442654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.397509+0000","last_change":"2024-09-10T07:36:27.397397+0000","last_active":"2024-09-10T07:36:27.397509+0000","last_peered":"2024-09-10T07:36:27.397509+0000","last_clean":"2024-09-10T07:36:27.397509+0000","last_became_active":"2024-09-10T07:36:27.396191+0000","last_became_peered":"2024-09-10T07:36:27.396191+0000","last_unstale":"2024-09-10T07:36:27.397509+0000","last_undegraded":"2024-09-10T07:36:27.397509+0000","last_fullsized":"2024-09-10T07:36:27.397509+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:27.380913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.385776+0000","last_change":"2024-09-10T07:36:26.365183+0000","last_active":"2024-09-10T07:36:27.385776+0000","last_peered":"2024-09-10T07:36:27.385776+0000","last_clean":"2024-09-10T07:36:27.385776+0000","last_became_active":"2024-09-10T07:36:26.364844+0000","last_became_peered":"2024-09-10T07:36:26.364844+0000","last_unstale":"2024-09-10T07:36:27.385776+0000","last_undegraded":"2024-09-10T07:36:27.385776+0000","last_fullsized":"2024-09-10T07:36:27.385776+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:19.597767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379749+0000","last_change":"2024-09-10T07:36:27.393656+0000","last_active":"2024-09-10T07:36:28.379749+0000","last_peered":"2024-09-10T07:36:28.379749+0000","last_clean":"2024-09-10T07:36:28.379749+0000","last_became_active":"2024-09-10T07:36:27.393433+0000","last_became_peered":"2024-09-10T07:36:27.393433+0000","last_unstale":"2024-09-10T07:36:28.379749+0000","last_undegraded":"2024-09-10T07:36:28.379749+0000","last_fullsized":"2024-09-10T07:36:28.379749+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:07.938635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378738+0000","last_change":"2024-09-10T07:36:26.370650+0000","last_active":"2024-09-10T07:36:28.378738+0000","last_peered":"2024-09-10T07:36:28.378738+0000","last_clean":"2024-09-10T07:36:28.378738+0000","last_became_active":"2024-09-10T07:36:26.370295+0000","last_became_peered":"2024-09-10T07:36:26.370295+0000","last_unstale":"2024-09-10T07:36:28.378738+0000","last_undegraded":"2024-09-10T07:36:28.378738+0000","last_fullsized":"2024-09-10T07:36:28.378738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:12.295430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.392968+0000","last_change":"2024-09-10T07:36:27.392074+0000","last_active":"2024-09-10T07:36:27.392968+0000","last_peered":"2024-09-10T07:36:27.392968+0000","last_clean":"2024-09-10T07:36:27.392968+0000","last_became_active":"2024-09-10T07:36:27.391844+0000","last_became_peered":"2024-09-10T07:36:27.391844+0000","last_unstale":"2024-09-10T07:36:27.392968+0000","last_undegraded":"2024-09-10T07:36:27.392968+0000","last_fullsized":"2024-09-10T07:36:27.392968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:31:39.394173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.393633+0000","last_change":"2024-09-10T07:36:26.364507+0000","last_active":"2024-09-10T07:36:27.393633+0000","last_peered":"2024-09-10T07:36:27.393633+0000","last_clean":"2024-09-10T07:36:27.393633+0000","last_became_active":"2024-09-10T07:36:26.364279+0000","last_became_peered":"2024-09-10T07:36:26.364279+0000","last_unstale":"2024-09-10T07:36:27.393633+0000","last_undegraded":"2024-09-10T07:36:27.393633+0000","last_fullsized":"2024-09-10T07:36:27.393633+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:16.162865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.396242+0000","last_change":"2024-09-10T07:36:27.396115+0000","last_active":"2024-09-10T07:36:27.396242+0000","last_peered":"2024-09-10T07:36:27.396242+0000","last_clean":"2024-09-10T07:36:27.396242+0000","last_became_active":"2024-09-10T07:36:27.395625+0000","last_became_peered":"2024-09-10T07:36:27.395625+0000","last_unstale":"2024-09-10T07:36:27.396242+0000","last_undegraded":"2024-09-10T07:36:27.396242+0000","last_fullsized":"2024-09-10T07:36:27.396242+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:32.458764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378808+0000","last_change":"2024-09-10T07:36:26.371232+0000","last_active":"2024-09-10T07:36:28.378808+0000","last_peered":"2024-09-10T07:36:28.378808+0000","last_clean":"2024-09-10T07:36:28.378808+0000","last_became_active":"2024-09-10T07:36:26.370974+0000","last_became_peered":"2024-09-10T07:36:26.370974+0000","last_unstale":"2024-09-10T07:36:28.378808+0000","last_undegraded":"2024-09-10T07:36:28.378808+0000","last_fullsized":"2024-09-10T07:36:28.378808+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:18.607783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.395617+0000","last_change":"2024-09-10T07:36:27.395475+0000","last_active":"2024-09-10T07:36:27.395617+0000","last_peered":"2024-09-10T07:36:27.395617+0000","last_clean":"2024-09-10T07:36:27.395617+0000","last_became_active":"2024-09-10T07:36:27.394824+0000","last_became_peered":"2024-09-10T07:36:27.394824+0000","last_unstale":"2024-09-10T07:36:27.395617+0000","last_undegraded":"2024-09-10T07:36:27.395617+0000","last_fullsized":"2024-09-10T07:36:27.395617+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:30.682121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394652+0000","last_change":"2024-09-10T07:36:26.369165+0000","last_active":"2024-09-10T07:36:27.394652+0000","last_peered":"2024-09-10T07:36:27.394652+0000","last_clean":"2024-09-10T07:36:27.394652+0000","last_became_active":"2024-09-10T07:36:26.368492+0000","last_became_peered":"2024-09-10T07:36:26.368492+0000","last_unstale":"2024-09-10T07:36:27.394652+0000","last_undegraded":"2024-09-10T07:36:27.394652+0000","last_fullsized":"2024-09-10T07:36:27.394652+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:16.154612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.390135+0000","last_change":"2024-09-10T07:36:27.389465+0000","last_active":"2024-09-10T07:36:27.390135+0000","last_peered":"2024-09-10T07:36:27.390135+0000","last_clean":"2024-09-10T07:36:27.390135+0000","last_became_active":"2024-09-10T07:36:27.389216+0000","last_became_peered":"2024-09-10T07:36:27.389216+0000","last_unstale":"2024-09-10T07:36:27.390135+0000","last_undegraded":"2024-09-10T07:36:27.390135+0000","last_fullsized":"2024-09-10T07:36:27.390135+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:53.403872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.379343+0000","last_change":"2024-09-10T07:36:26.367818+0000","last_active":"2024-09-10T07:36:27.379343+0000","last_peered":"2024-09-10T07:36:27.379343+0000","last_clean":"2024-09-10T07:36:27.379343+0000","last_became_active":"2024-09-10T07:36:26.367381+0000","last_became_peered":"2024-09-10T07:36:26.367381+0000","last_unstale":"2024-09-10T07:36:27.379343+0000","last_undegraded":"2024-09-10T07:36:27.379343+0000","last_fullsized":"2024-09-10T07:36:27.379343+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:12.228075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.393004+0000","last_change":"2024-09-10T07:36:27.392725+0000","last_active":"2024-09-10T07:36:27.393004+0000","last_peered":"2024-09-10T07:36:27.393004+0000","last_clean":"2024-09-10T07:36:27.393004+0000","last_became_active":"2024-09-10T07:36:27.391545+0000","last_became_peered":"2024-09-10T07:36:27.391545+0000","last_unstale":"2024-09-10T07:36:27.393004+0000","last_undegraded":"2024-09-10T07:36:27.393004+0000","last_fullsized":"2024-09-10T07:36:27.393004+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:14.897585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.383363+0000","last_change":"2024-09-10T07:36:26.366122+0000","last_active":"2024-09-10T07:36:27.383363+0000","last_peered":"2024-09-10T07:36:27.383363+0000","last_clean":"2024-09-10T07:36:27.383363+0000","last_became_active":"2024-09-10T07:36:26.365897+0000","last_became_peered":"2024-09-10T07:36:26.365897+0000","last_unstale":"2024-09-10T07:36:27.383363+0000","last_undegraded":"2024-09-10T07:36:27.383363+0000","last_fullsized":"2024-09-10T07:36:27.383363+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:48.844804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":254,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.383317+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:36:27.383317+0000","last_peered":"2024-09-10T07:36:27.383317+0000","last_clean":"2024-09-10T07:36:27.383317+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:36:27.383317+0000","last_undegraded":"2024-09-10T07:36:27.383317+0000","last_fullsized":"2024-09-10T07:36:27.383317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:49.257689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":896,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194415,"statfs":{"total":200000000,"available":199081750,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194992,"statfs":{"total":200000000,"available":199672278,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194991,"statfs":{"total":200000000,"available":199671626,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194984,"statfs":{"total":200000000,"available":199664366,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194992,"statfs":{"total":200000000,"available":199672222,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194992,"statfs":{"total":200000000,"available":199672222,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194992,"statfs":{"total":200000000,"available":199672188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":904,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194407,"statfs":{"total":200000000,"available":199073416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:36:31.559 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:36:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.747+0000 7fcaace00640 1 Processor -- start 2024-09-10T07:36:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.748+0000 7fcaace00640 1 -- start start 2024-09-10T07:36:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaace00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcaa8142150 0x7fcaa8160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaace00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa8160a80 0x7fcaa80cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaace00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa8142650 con 0x7fcaa813fae0 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaace00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa80ce780 con 0x7fcaa8142150 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaace00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa8142930 con 0x7fcaa8160a80 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaa5e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcaa813fae0 0x7fcaa806f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58874/0 (socket says 172.21.15.99:58874) 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaa5e00640 1 -- 172.21.15.99:0/474793396 learned_addr learned my addr 172.21.15.99:0/474793396 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaa5400640 1 --2- 172.21.15.99:0/474793396 >> v2:172.21.15.99:3300/0 conn(0x7fcaa8142150 0x7fcaa8160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaa6800640 1 --2- 172.21.15.99:0/474793396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa8160a80 0x7fcaa80cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaa5400640 1 -- 172.21.15.99:0/474793396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa8160a80 msgr2=0x7fcaa80cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaa5400640 1 --2- 172.21.15.99:0/474793396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa8160a80 0x7fcaa80cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.749+0000 7fcaa5400640 1 -- 172.21.15.99:0/474793396 >> v1:172.21.15.99:6789/0 conn(0x7fcaa813fae0 legacy=0x7fcaa806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.750+0000 7fcaa5400640 1 -- 172.21.15.99:0/474793396 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa8142c10 con 0x7fcaa8142150 2024-09-10T07:36:31.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.750+0000 7fcaa5400640 1 --2- 172.21.15.99:0/474793396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8142150 0x7fcaa8160540 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fca940097a0 tx=0x7fca9402a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb9b917b56831ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.751+0000 7fcaa4a00640 1 -- 172.21.15.99:0/474793396 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94037070 con 0x7fcaa8142150 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.751+0000 7fcaa4a00640 1 -- 172.21.15.99:0/474793396 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9402ae40 con 0x7fcaa8142150 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.751+0000 7fcaa4a00640 1 -- 172.21.15.99:0/474793396 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94032660 con 0x7fcaa8142150 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.751+0000 7fcaace00640 1 -- 172.21.15.99:0/474793396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8142150 msgr2=0x7fcaa8160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.751+0000 7fcaace00640 1 --2- 172.21.15.99:0/474793396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8142150 0x7fcaa8160540 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fca940097a0 tx=0x7fca9402a0f0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.751+0000 7fcaace00640 1 -- 172.21.15.99:0/474793396 shutdown_connections 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.751+0000 7fcaace00640 1 --2- 172.21.15.99:0/474793396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa8160a80 0x7fcaa80cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.751+0000 7fcaace00640 1 --2- 172.21.15.99:0/474793396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8142150 0x7fcaa8160540 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.751+0000 7fcaace00640 1 -- 172.21.15.99:0/474793396 >> 172.21.15.99:0/474793396 conn(0x7fcaa806bc10 msgr2=0x7fcaa806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.752+0000 7fcaace00640 1 -- 172.21.15.99:0/474793396 shutdown_connections 2024-09-10T07:36:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.752+0000 7fcaace00640 1 -- 172.21.15.99:0/474793396 wait complete. 2024-09-10T07:36:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.753+0000 7fcaace00640 1 Processor -- start 2024-09-10T07:36:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.753+0000 7fcaace00640 1 -- start start 2024-09-10T07:36:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.754+0000 7fcaace00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa813fae0 0x7fcaa8144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.754+0000 7fcaace00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa8142150 0x7fcaa81409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.754+0000 7fcaace00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8160a80 0x7fcaa80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.754+0000 7fcaace00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa80cf2d0 con 0x7fcaa8160a80 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.754+0000 7fcaace00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa80cf150 con 0x7fcaa813fae0 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.754+0000 7fcaace00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa80cf450 con 0x7fcaa8142150 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.754+0000 7fcaa6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8160a80 0x7fcaa80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.754+0000 7fcaa6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8160a80 0x7fcaa80b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55380/0 (socket says 172.21.15.99:55380) 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fcaa6800640 1 -- 172.21.15.99:0/868873558 learned_addr learned my addr 172.21.15.99:0/868873558 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fcaa5400640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa8142150 0x7fcaa81409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fcaa5e00640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa813fae0 0x7fcaa8144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fcaa6800640 1 -- 172.21.15.99:0/868873558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa8142150 msgr2=0x7fcaa81409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fcaa6800640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa8142150 0x7fcaa81409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fcaa6800640 1 -- 172.21.15.99:0/868873558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa813fae0 msgr2=0x7fcaa8144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fcaa6800640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa813fae0 0x7fcaa8144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fcaa6800640 1 -- 172.21.15.99:0/868873558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa8144c00 con 0x7fcaa8160a80 2024-09-10T07:36:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fcaa6800640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8160a80 0x7fcaa80b4cf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0007e60 tx=0x7fcaa000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fca9e000640 1 -- 172.21.15.99:0/868873558 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0014420 con 0x7fcaa8160a80 2024-09-10T07:36:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fca9e000640 1 -- 172.21.15.99:0/868873558 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa0019070 con 0x7fcaa8160a80 2024-09-10T07:36:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.755+0000 7fca9e000640 1 -- 172.21.15.99:0/868873558 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0014820 con 0x7fcaa8160a80 2024-09-10T07:36:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.756+0000 7fcaace00640 1 -- 172.21.15.99:0/868873558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa8144ee0 con 0x7fcaa8160a80 2024-09-10T07:36:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.756+0000 7fcaace00640 1 -- 172.21.15.99:0/868873558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa81454a0 con 0x7fcaa8160a80 2024-09-10T07:36:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.757+0000 7fcaace00640 1 -- 172.21.15.99:0/868873558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa8160540 con 0x7fcaa8160a80 2024-09-10T07:36:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.758+0000 7fca9e000640 1 -- 172.21.15.99:0/868873558 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcaa00149c0 con 0x7fcaa8160a80 2024-09-10T07:36:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.758+0000 7fca9e000640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8806be30 0x7fca8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.758+0000 7fca9e000640 1 -- 172.21.15.99:0/868873558 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7fcaa008b570 con 0x7fcaa8160a80 2024-09-10T07:36:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.759+0000 7fcaa5e00640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8806be30 0x7fca8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:31.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.759+0000 7fcaa5e00640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8806be30 0x7fca8806e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca98007fd0 tx=0x7fca98007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:31.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.763+0000 7fca9e000640 1 -- 172.21.15.99:0/868873558 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcaa00598d0 con 0x7fcaa8160a80 2024-09-10T07:36:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.932+0000 7fcaace00640 1 -- 172.21.15.99:0/868873558 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcaa815c230 con 0x7fca8806be30 2024-09-10T07:36:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.938+0000 7fca9e000640 1 -- 172.21.15.99:0/868873558 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247448 (secure 0 0 0) 0x7fcaa815c230 con 0x7fca8806be30 2024-09-10T07:36:31.941 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:31.942 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:36:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 -- 172.21.15.99:0/868873558 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8806be30 msgr2=0x7fca8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8806be30 0x7fca8806e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca98007fd0 tx=0x7fca98007e80 comp rx=0 tx=0).stop 2024-09-10T07:36:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 -- 172.21.15.99:0/868873558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8160a80 msgr2=0x7fcaa80b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8160a80 0x7fcaa80b4cf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0007e60 tx=0x7fcaa000e4b0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 -- 172.21.15.99:0/868873558 shutdown_connections 2024-09-10T07:36:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca8806be30 0x7fca8806e2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcaa8160a80 0x7fcaa80b4cf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa8142150 0x7fcaa81409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 --2- 172.21.15.99:0/868873558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa813fae0 0x7fcaa8144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:31.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 -- 172.21.15.99:0/868873558 >> 172.21.15.99:0/868873558 conn(0x7fcaa806bc10 msgr2=0x7fcaa815e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:31.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 -- 172.21.15.99:0/868873558 shutdown_connections 2024-09-10T07:36:31.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:31.942+0000 7fcaace00640 1 -- 172.21.15.99:0/868873558 wait complete. 2024-09-10T07:36:31.958 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-09-10T07:36:30.717749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3730,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558769,"statfs":{"total":1600000000,"available":1596180068,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.364685"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394523+0000","last_change":"2024-09-10T07:36:27.394366+0000","last_active":"2024-09-10T07:36:27.394523+0000","last_peered":"2024-09-10T07:36:27.394523+0000","last_clean":"2024-09-10T07:36:27.394523+0000","last_became_active":"2024-09-10T07:36:27.394082+0000","last_became_peered":"2024-09-10T07:36:27.394082+0000","last_unstale":"2024-09-10T07:36:27.394523+0000","last_undegraded":"2024-09-10T07:36:27.394523+0000","last_fullsized":"2024-09-10T07:36:27.394523+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:05.865576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.393674+0000","last_change":"2024-09-10T07:36:27.393483+0000","last_active":"2024-09-10T07:36:27.393674+0000","last_peered":"2024-09-10T07:36:27.393674+0000","last_clean":"2024-09-10T07:36:27.393674+0000","last_became_active":"2024-09-10T07:36:27.393003+0000","last_became_peered":"2024-09-10T07:36:27.393003+0000","last_unstale":"2024-09-10T07:36:27.393674+0000","last_undegraded":"2024-09-10T07:36:27.393674+0000","last_fullsized":"2024-09-10T07:36:27.393674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:54.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.395470+0000","last_change":"2024-09-10T07:36:27.394794+0000","last_active":"2024-09-10T07:36:27.395470+0000","last_peered":"2024-09-10T07:36:27.395470+0000","last_clean":"2024-09-10T07:36:27.395470+0000","last_became_active":"2024-09-10T07:36:27.393939+0000","last_became_peered":"2024-09-10T07:36:27.393939+0000","last_unstale":"2024-09-10T07:36:27.395470+0000","last_undegraded":"2024-09-10T07:36:27.395470+0000","last_fullsized":"2024-09-10T07:36:27.395470+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:54.985316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378069+0000","last_change":"2024-09-10T07:36:27.390232+0000","last_active":"2024-09-10T07:36:28.378069+0000","last_peered":"2024-09-10T07:36:28.378069+0000","last_clean":"2024-09-10T07:36:28.378069+0000","last_became_active":"2024-09-10T07:36:27.389918+0000","last_became_peered":"2024-09-10T07:36:27.389918+0000","last_unstale":"2024-09-10T07:36:28.378069+0000","last_undegraded":"2024-09-10T07:36:28.378069+0000","last_fullsized":"2024-09-10T07:36:28.378069+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:05.885553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.392446+0000","last_change":"2024-09-10T07:36:27.392329+0000","last_active":"2024-09-10T07:36:27.392446+0000","last_peered":"2024-09-10T07:36:27.392446+0000","last_clean":"2024-09-10T07:36:27.392446+0000","last_became_active":"2024-09-10T07:36:27.392110+0000","last_became_peered":"2024-09-10T07:36:27.392110+0000","last_unstale":"2024-09-10T07:36:27.392446+0000","last_undegraded":"2024-09-10T07:36:27.392446+0000","last_fullsized":"2024-09-10T07:36:27.392446+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:24.506358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379777+0000","last_change":"2024-09-10T07:36:27.390572+0000","last_active":"2024-09-10T07:36:28.379777+0000","last_peered":"2024-09-10T07:36:28.379777+0000","last_clean":"2024-09-10T07:36:28.379777+0000","last_became_active":"2024-09-10T07:36:27.390164+0000","last_became_peered":"2024-09-10T07:36:27.390164+0000","last_unstale":"2024-09-10T07:36:28.379777+0000","last_undegraded":"2024-09-10T07:36:28.379777+0000","last_fullsized":"2024-09-10T07:36:28.379777+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:09.603679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378511+0000","last_change":"2024-09-10T07:36:27.389814+0000","last_active":"2024-09-10T07:36:28.378511+0000","last_peered":"2024-09-10T07:36:28.378511+0000","last_clean":"2024-09-10T07:36:28.378511+0000","last_became_active":"2024-09-10T07:36:27.389586+0000","last_became_peered":"2024-09-10T07:36:27.389586+0000","last_unstale":"2024-09-10T07:36:28.378511+0000","last_undegraded":"2024-09-10T07:36:28.378511+0000","last_fullsized":"2024-09-10T07:36:28.378511+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:42.918293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.384279+0000","last_change":"2024-09-10T07:36:27.383993+0000","last_active":"2024-09-10T07:36:27.384279+0000","last_peered":"2024-09-10T07:36:27.384279+0000","last_clean":"2024-09-10T07:36:27.384279+0000","last_became_active":"2024-09-10T07:36:27.383740+0000","last_became_peered":"2024-09-10T07:36:27.383740+0000","last_unstale":"2024-09-10T07:36:27.384279+0000","last_undegraded":"2024-09-10T07:36:27.384279+0000","last_fullsized":"2024-09-10T07:36:27.384279+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:57.604182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379079+0000","last_change":"2024-09-10T07:36:27.383520+0000","last_active":"2024-09-10T07:36:28.379079+0000","last_peered":"2024-09-10T07:36:28.379079+0000","last_clean":"2024-09-10T07:36:28.379079+0000","last_became_active":"2024-09-10T07:36:27.383061+0000","last_became_peered":"2024-09-10T07:36:27.383061+0000","last_unstale":"2024-09-10T07:36:28.379079+0000","last_undegraded":"2024-09-10T07:36:28.379079+0000","last_fullsized":"2024-09-10T07:36:28.379079+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:34.120736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.397674+0000","last_change":"2024-09-10T07:36:27.397582+0000","last_active":"2024-09-10T07:36:27.397674+0000","last_peered":"2024-09-10T07:36:27.397674+0000","last_clean":"2024-09-10T07:36:27.397674+0000","last_became_active":"2024-09-10T07:36:27.396623+0000","last_became_peered":"2024-09-10T07:36:27.396623+0000","last_unstale":"2024-09-10T07:36:27.397674+0000","last_undegraded":"2024-09-10T07:36:27.397674+0000","last_fullsized":"2024-09-10T07:36:27.397674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:13.204088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.397236+0000","last_change":"2024-09-10T07:36:27.397124+0000","last_active":"2024-09-10T07:36:27.397236+0000","last_peered":"2024-09-10T07:36:27.397236+0000","last_clean":"2024-09-10T07:36:27.397236+0000","last_became_active":"2024-09-10T07:36:27.396599+0000","last_became_peered":"2024-09-10T07:36:27.396599+0000","last_unstale":"2024-09-10T07:36:27.397236+0000","last_undegraded":"2024-09-10T07:36:27.397236+0000","last_fullsized":"2024-09-10T07:36:27.397236+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:29.359248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378418+0000","last_change":"2024-09-10T07:36:27.388408+0000","last_active":"2024-09-10T07:36:28.378418+0000","last_peered":"2024-09-10T07:36:28.378418+0000","last_clean":"2024-09-10T07:36:28.378418+0000","last_became_active":"2024-09-10T07:36:27.386647+0000","last_became_peered":"2024-09-10T07:36:27.386647+0000","last_unstale":"2024-09-10T07:36:28.378418+0000","last_undegraded":"2024-09-10T07:36:28.378418+0000","last_fullsized":"2024-09-10T07:36:28.378418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:38.627820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.388578+0000","last_change":"2024-09-10T07:36:27.388330+0000","last_active":"2024-09-10T07:36:27.388578+0000","last_peered":"2024-09-10T07:36:27.388578+0000","last_clean":"2024-09-10T07:36:27.388578+0000","last_became_active":"2024-09-10T07:36:27.388064+0000","last_became_peered":"2024-09-10T07:36:27.388064+0000","last_unstale":"2024-09-10T07:36:27.388578+0000","last_undegraded":"2024-09-10T07:36:27.388578+0000","last_fullsized":"2024-09-10T07:36:27.388578+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:40.139171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379254+0000","last_change":"2024-09-10T07:36:27.388826+0000","last_active":"2024-09-10T07:36:28.379254+0000","last_peered":"2024-09-10T07:36:28.379254+0000","last_clean":"2024-09-10T07:36:28.379254+0000","last_became_active":"2024-09-10T07:36:27.388584+0000","last_became_peered":"2024-09-10T07:36:27.388584+0000","last_unstale":"2024-09-10T07:36:28.379254+0000","last_undegraded":"2024-09-10T07:36:28.379254+0000","last_fullsized":"2024-09-10T07:36:28.379254+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:51.481110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379551+0000","last_change":"2024-09-10T07:36:27.397813+0000","last_active":"2024-09-10T07:36:28.379551+0000","last_peered":"2024-09-10T07:36:28.379551+0000","last_clean":"2024-09-10T07:36:28.379551+0000","last_became_active":"2024-09-10T07:36:27.397559+0000","last_became_peered":"2024-09-10T07:36:27.397559+0000","last_unstale":"2024-09-10T07:36:28.379551+0000","last_undegraded":"2024-09-10T07:36:28.379551+0000","last_fullsized":"2024-09-10T07:36:28.379551+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:49.334242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380080+0000","last_change":"2024-09-10T07:36:27.390378+0000","last_active":"2024-09-10T07:36:28.380080+0000","last_peered":"2024-09-10T07:36:28.380080+0000","last_clean":"2024-09-10T07:36:28.380080+0000","last_became_active":"2024-09-10T07:36:27.389660+0000","last_became_peered":"2024-09-10T07:36:27.389660+0000","last_unstale":"2024-09-10T07:36:28.380080+0000","last_undegraded":"2024-09-10T07:36:28.380080+0000","last_fullsized":"2024-09-10T07:36:28.380080+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:35.725303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.390158+0000","last_change":"2024-09-10T07:36:27.389987+0000","last_active":"2024-09-10T07:36:27.390158+0000","last_peered":"2024-09-10T07:36:27.390158+0000","last_clean":"2024-09-10T07:36:27.390158+0000","last_became_active":"2024-09-10T07:36:27.388731+0000","last_became_peered":"2024-09-10T07:36:27.388731+0000","last_unstale":"2024-09-10T07:36:27.390158+0000","last_undegraded":"2024-09-10T07:36:27.390158+0000","last_fullsized":"2024-09-10T07:36:27.390158+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:05.364959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394782+0000","last_change":"2024-09-10T07:36:27.394560+0000","last_active":"2024-09-10T07:36:27.394782+0000","last_peered":"2024-09-10T07:36:27.394782+0000","last_clean":"2024-09-10T07:36:27.394782+0000","last_became_active":"2024-09-10T07:36:27.392706+0000","last_became_peered":"2024-09-10T07:36:27.392706+0000","last_unstale":"2024-09-10T07:36:27.394782+0000","last_undegraded":"2024-09-10T07:36:27.394782+0000","last_fullsized":"2024-09-10T07:36:27.394782+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:50.707114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.395256+0000","last_change":"2024-09-10T07:36:27.394866+0000","last_active":"2024-09-10T07:36:27.395256+0000","last_peered":"2024-09-10T07:36:27.395256+0000","last_clean":"2024-09-10T07:36:27.395256+0000","last_became_active":"2024-09-10T07:36:27.394632+0000","last_became_peered":"2024-09-10T07:36:27.394632+0000","last_unstale":"2024-09-10T07:36:27.395256+0000","last_undegraded":"2024-09-10T07:36:27.395256+0000","last_fullsized":"2024-09-10T07:36:27.395256+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:24.240396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.391511+0000","last_change":"2024-09-10T07:36:27.391222+0000","last_active":"2024-09-10T07:36:27.391511+0000","last_peered":"2024-09-10T07:36:27.391511+0000","last_clean":"2024-09-10T07:36:27.391511+0000","last_became_active":"2024-09-10T07:36:27.390888+0000","last_became_peered":"2024-09-10T07:36:27.390888+0000","last_unstale":"2024-09-10T07:36:27.391511+0000","last_undegraded":"2024-09-10T07:36:27.391511+0000","last_fullsized":"2024-09-10T07:36:27.391511+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:52.320905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.396043+0000","last_change":"2024-09-10T07:36:27.395897+0000","last_active":"2024-09-10T07:36:27.396043+0000","last_peered":"2024-09-10T07:36:27.396043+0000","last_clean":"2024-09-10T07:36:27.396043+0000","last_became_active":"2024-09-10T07:36:27.393984+0000","last_became_peered":"2024-09-10T07:36:27.393984+0000","last_unstale":"2024-09-10T07:36:27.396043+0000","last_undegraded":"2024-09-10T07:36:27.396043+0000","last_fullsized":"2024-09-10T07:36:27.396043+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:52.056312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.393351+0000","last_change":"2024-09-10T07:36:27.393227+0000","last_active":"2024-09-10T07:36:27.393351+0000","last_peered":"2024-09-10T07:36:27.393351+0000","last_clean":"2024-09-10T07:36:27.393351+0000","last_became_active":"2024-09-10T07:36:27.392679+0000","last_became_peered":"2024-09-10T07:36:27.392679+0000","last_unstale":"2024-09-10T07:36:27.393351+0000","last_undegraded":"2024-09-10T07:36:27.393351+0000","last_fullsized":"2024-09-10T07:36:27.393351+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:49.655402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394742+0000","last_change":"2024-09-10T07:36:27.394268+0000","last_active":"2024-09-10T07:36:27.394742+0000","last_peered":"2024-09-10T07:36:27.394742+0000","last_clean":"2024-09-10T07:36:27.394742+0000","last_became_active":"2024-09-10T07:36:27.389974+0000","last_became_peered":"2024-09-10T07:36:27.389974+0000","last_unstale":"2024-09-10T07:36:27.394742+0000","last_undegraded":"2024-09-10T07:36:27.394742+0000","last_fullsized":"2024-09-10T07:36:27.394742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:31.650036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.387328+0000","last_change":"2024-09-10T07:36:27.386740+0000","last_active":"2024-09-10T07:36:27.387328+0000","last_peered":"2024-09-10T07:36:27.387328+0000","last_clean":"2024-09-10T07:36:27.387328+0000","last_became_active":"2024-09-10T07:36:27.386469+0000","last_became_peered":"2024-09-10T07:36:27.386469+0000","last_unstale":"2024-09-10T07:36:27.387328+0000","last_undegraded":"2024-09-10T07:36:27.387328+0000","last_fullsized":"2024-09-10T07:36:27.387328+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:05.356666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.398272+0000","last_change":"2024-09-10T07:36:27.397944+0000","last_active":"2024-09-10T07:36:27.398272+0000","last_peered":"2024-09-10T07:36:27.398272+0000","last_clean":"2024-09-10T07:36:27.398272+0000","last_became_active":"2024-09-10T07:36:27.397739+0000","last_became_peered":"2024-09-10T07:36:27.397739+0000","last_unstale":"2024-09-10T07:36:27.398272+0000","last_undegraded":"2024-09-10T07:36:27.398272+0000","last_fullsized":"2024-09-10T07:36:27.398272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:53.775423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378891+0000","last_change":"2024-09-10T07:36:27.387181+0000","last_active":"2024-09-10T07:36:28.378891+0000","last_peered":"2024-09-10T07:36:28.378891+0000","last_clean":"2024-09-10T07:36:28.378891+0000","last_became_active":"2024-09-10T07:36:27.385219+0000","last_became_peered":"2024-09-10T07:36:27.385219+0000","last_unstale":"2024-09-10T07:36:28.378891+0000","last_undegraded":"2024-09-10T07:36:28.378891+0000","last_fullsized":"2024-09-10T07:36:28.378891+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:49.276069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379752+0000","last_change":"2024-09-10T07:36:27.395582+0000","last_active":"2024-09-10T07:36:28.379752+0000","last_peered":"2024-09-10T07:36:28.379752+0000","last_clean":"2024-09-10T07:36:28.379752+0000","last_became_active":"2024-09-10T07:36:27.395353+0000","last_became_peered":"2024-09-10T07:36:27.395353+0000","last_unstale":"2024-09-10T07:36:28.379752+0000","last_undegraded":"2024-09-10T07:36:28.379752+0000","last_fullsized":"2024-09-10T07:36:28.379752+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:19.358140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394506+0000","last_change":"2024-09-10T07:36:27.393636+0000","last_active":"2024-09-10T07:36:27.394506+0000","last_peered":"2024-09-10T07:36:27.394506+0000","last_clean":"2024-09-10T07:36:27.394506+0000","last_became_active":"2024-09-10T07:36:27.393224+0000","last_became_peered":"2024-09-10T07:36:27.393224+0000","last_unstale":"2024-09-10T07:36:27.394506+0000","last_undegraded":"2024-09-10T07:36:27.394506+0000","last_fullsized":"2024-09-10T07:36:27.394506+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:37.164288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.382814+0000","last_change":"2024-09-10T07:36:27.381536+0000","last_active":"2024-09-10T07:36:27.382814+0000","last_peered":"2024-09-10T07:36:27.382814+0000","last_clean":"2024-09-10T07:36:27.382814+0000","last_became_active":"2024-09-10T07:36:27.381372+0000","last_became_peered":"2024-09-10T07:36:27.381372+0000","last_unstale":"2024-09-10T07:36:27.382814+0000","last_undegraded":"2024-09-10T07:36:27.382814+0000","last_fullsized":"2024-09-10T07:36:27.382814+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:33.395247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394260+0000","last_change":"2024-09-10T07:36:27.393708+0000","last_active":"2024-09-10T07:36:27.394260+0000","last_peered":"2024-09-10T07:36:27.394260+0000","last_clean":"2024-09-10T07:36:27.394260+0000","last_became_active":"2024-09-10T07:36:27.389624+0000","last_became_peered":"2024-09-10T07:36:27.389624+0000","last_unstale":"2024-09-10T07:36:27.394260+0000","last_undegraded":"2024-09-10T07:36:27.394260+0000","last_fullsized":"2024-09-10T07:36:27.394260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:18.156552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.398309+0000","last_change":"2024-09-10T07:36:27.397978+0000","last_active":"2024-09-10T07:36:27.398309+0000","last_peered":"2024-09-10T07:36:27.398309+0000","last_clean":"2024-09-10T07:36:27.398309+0000","last_became_active":"2024-09-10T07:36:27.397718+0000","last_became_peered":"2024-09-10T07:36:27.397718+0000","last_unstale":"2024-09-10T07:36:27.398309+0000","last_undegraded":"2024-09-10T07:36:27.398309+0000","last_fullsized":"2024-09-10T07:36:27.398309+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:36.547363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379894+0000","last_change":"2024-09-10T07:36:27.396710+0000","last_active":"2024-09-10T07:36:28.379894+0000","last_peered":"2024-09-10T07:36:28.379894+0000","last_clean":"2024-09-10T07:36:28.379894+0000","last_became_active":"2024-09-10T07:36:27.396483+0000","last_became_peered":"2024-09-10T07:36:27.396483+0000","last_unstale":"2024-09-10T07:36:28.379894+0000","last_undegraded":"2024-09-10T07:36:28.379894+0000","last_fullsized":"2024-09-10T07:36:28.379894+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:13.113936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379965+0000","last_change":"2024-09-10T07:36:27.387879+0000","last_active":"2024-09-10T07:36:28.379965+0000","last_peered":"2024-09-10T07:36:28.379965+0000","last_clean":"2024-09-10T07:36:28.379965+0000","last_became_active":"2024-09-10T07:36:27.387656+0000","last_became_peered":"2024-09-10T07:36:27.387656+0000","last_unstale":"2024-09-10T07:36:28.379965+0000","last_undegraded":"2024-09-10T07:36:28.379965+0000","last_fullsized":"2024-09-10T07:36:28.379965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:03.545055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"64'4","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379926+0000","last_change":"2024-09-10T07:36:26.371373+0000","last_active":"2024-09-10T07:36:28.379926+0000","last_peered":"2024-09-10T07:36:28.379926+0000","last_clean":"2024-09-10T07:36:28.379926+0000","last_became_active":"2024-09-10T07:36:26.370863+0000","last_became_peered":"2024-09-10T07:36:26.370863+0000","last_unstale":"2024-09-10T07:36:28.379926+0000","last_undegraded":"2024-09-10T07:36:28.379926+0000","last_fullsized":"2024-09-10T07:36:28.379926+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:49.346238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.395597+0000","last_change":"2024-09-10T07:36:27.395460+0000","last_active":"2024-09-10T07:36:27.395597+0000","last_peered":"2024-09-10T07:36:27.395597+0000","last_clean":"2024-09-10T07:36:27.395597+0000","last_became_active":"2024-09-10T07:36:27.395208+0000","last_became_peered":"2024-09-10T07:36:27.395208+0000","last_unstale":"2024-09-10T07:36:27.395597+0000","last_undegraded":"2024-09-10T07:36:27.395597+0000","last_fullsized":"2024-09-10T07:36:27.395597+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:06.861886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.405571+0000","last_change":"2024-09-10T07:36:26.367635+0000","last_active":"2024-09-10T07:36:27.405571+0000","last_peered":"2024-09-10T07:36:27.405571+0000","last_clean":"2024-09-10T07:36:27.405571+0000","last_became_active":"2024-09-10T07:36:26.367031+0000","last_became_peered":"2024-09-10T07:36:26.367031+0000","last_unstale":"2024-09-10T07:36:27.405571+0000","last_undegraded":"2024-09-10T07:36:27.405571+0000","last_fullsized":"2024-09-10T07:36:27.405571+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:01.402656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379923+0000","last_change":"2024-09-10T07:36:27.399136+0000","last_active":"2024-09-10T07:36:28.379923+0000","last_peered":"2024-09-10T07:36:28.379923+0000","last_clean":"2024-09-10T07:36:28.379923+0000","last_became_active":"2024-09-10T07:36:27.398903+0000","last_became_peered":"2024-09-10T07:36:27.398903+0000","last_unstale":"2024-09-10T07:36:28.379923+0000","last_undegraded":"2024-09-10T07:36:28.379923+0000","last_fullsized":"2024-09-10T07:36:28.379923+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:21.486228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380094+0000","last_change":"2024-09-10T07:36:26.371906+0000","last_active":"2024-09-10T07:36:28.380094+0000","last_peered":"2024-09-10T07:36:28.380094+0000","last_clean":"2024-09-10T07:36:28.380094+0000","last_became_active":"2024-09-10T07:36:26.371682+0000","last_became_peered":"2024-09-10T07:36:26.371682+0000","last_unstale":"2024-09-10T07:36:28.380094+0000","last_undegraded":"2024-09-10T07:36:28.380094+0000","last_fullsized":"2024-09-10T07:36:28.380094+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:33.289008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379849+0000","last_change":"2024-09-10T07:36:27.393153+0000","last_active":"2024-09-10T07:36:28.379849+0000","last_peered":"2024-09-10T07:36:28.379849+0000","last_clean":"2024-09-10T07:36:28.379849+0000","last_became_active":"2024-09-10T07:36:27.392881+0000","last_became_peered":"2024-09-10T07:36:27.392881+0000","last_unstale":"2024-09-10T07:36:28.379849+0000","last_undegraded":"2024-09-10T07:36:28.379849+0000","last_fullsized":"2024-09-10T07:36:28.379849+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:38.448890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378999+0000","last_change":"2024-09-10T07:36:26.368811+0000","last_active":"2024-09-10T07:36:28.378999+0000","last_peered":"2024-09-10T07:36:28.378999+0000","last_clean":"2024-09-10T07:36:28.378999+0000","last_became_active":"2024-09-10T07:36:26.368297+0000","last_became_peered":"2024-09-10T07:36:26.368297+0000","last_unstale":"2024-09-10T07:36:28.378999+0000","last_undegraded":"2024-09-10T07:36:28.378999+0000","last_fullsized":"2024-09-10T07:36:28.378999+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:54.812936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.397403+0000","last_change":"2024-09-10T07:36:27.394030+0000","last_active":"2024-09-10T07:36:27.397403+0000","last_peered":"2024-09-10T07:36:27.397403+0000","last_clean":"2024-09-10T07:36:27.397403+0000","last_became_active":"2024-09-10T07:36:27.393738+0000","last_became_peered":"2024-09-10T07:36:27.393738+0000","last_unstale":"2024-09-10T07:36:27.397403+0000","last_undegraded":"2024-09-10T07:36:27.397403+0000","last_fullsized":"2024-09-10T07:36:27.397403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:26.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378905+0000","last_change":"2024-09-10T07:36:26.362722+0000","last_active":"2024-09-10T07:36:28.378905+0000","last_peered":"2024-09-10T07:36:28.378905+0000","last_clean":"2024-09-10T07:36:28.378905+0000","last_became_active":"2024-09-10T07:36:26.362306+0000","last_became_peered":"2024-09-10T07:36:26.362306+0000","last_unstale":"2024-09-10T07:36:28.378905+0000","last_undegraded":"2024-09-10T07:36:28.378905+0000","last_fullsized":"2024-09-10T07:36:28.378905+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:36.437766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394759+0000","last_change":"2024-09-10T07:36:27.394588+0000","last_active":"2024-09-10T07:36:27.394759+0000","last_peered":"2024-09-10T07:36:27.394759+0000","last_clean":"2024-09-10T07:36:27.394759+0000","last_became_active":"2024-09-10T07:36:27.394324+0000","last_became_peered":"2024-09-10T07:36:27.394324+0000","last_unstale":"2024-09-10T07:36:27.394759+0000","last_undegraded":"2024-09-10T07:36:27.394759+0000","last_fullsized":"2024-09-10T07:36:27.394759+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:56.081648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380053+0000","last_change":"2024-09-10T07:36:26.368581+0000","last_active":"2024-09-10T07:36:28.380053+0000","last_peered":"2024-09-10T07:36:28.380053+0000","last_clean":"2024-09-10T07:36:28.380053+0000","last_became_active":"2024-09-10T07:36:26.368272+0000","last_became_peered":"2024-09-10T07:36:26.368272+0000","last_unstale":"2024-09-10T07:36:28.380053+0000","last_undegraded":"2024-09-10T07:36:28.380053+0000","last_fullsized":"2024-09-10T07:36:28.380053+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:48.711202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394453+0000","last_change":"2024-09-10T07:36:27.394322+0000","last_active":"2024-09-10T07:36:27.394453+0000","last_peered":"2024-09-10T07:36:27.394453+0000","last_clean":"2024-09-10T07:36:27.394453+0000","last_became_active":"2024-09-10T07:36:27.393502+0000","last_became_peered":"2024-09-10T07:36:27.393502+0000","last_unstale":"2024-09-10T07:36:27.394453+0000","last_undegraded":"2024-09-10T07:36:27.394453+0000","last_fullsized":"2024-09-10T07:36:27.394453+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:39.219847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378648+0000","last_change":"2024-09-10T07:36:26.367726+0000","last_active":"2024-09-10T07:36:28.378648+0000","last_peered":"2024-09-10T07:36:28.378648+0000","last_clean":"2024-09-10T07:36:28.378648+0000","last_became_active":"2024-09-10T07:36:26.367433+0000","last_became_peered":"2024-09-10T07:36:26.367433+0000","last_unstale":"2024-09-10T07:36:28.378648+0000","last_undegraded":"2024-09-10T07:36:28.378648+0000","last_fullsized":"2024-09-10T07:36:28.378648+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:39.570653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.391048+0000","last_change":"2024-09-10T07:36:27.390803+0000","last_active":"2024-09-10T07:36:27.391048+0000","last_peered":"2024-09-10T07:36:27.391048+0000","last_clean":"2024-09-10T07:36:27.391048+0000","last_became_active":"2024-09-10T07:36:27.389505+0000","last_became_peered":"2024-09-10T07:36:27.389505+0000","last_unstale":"2024-09-10T07:36:27.391048+0000","last_undegraded":"2024-09-10T07:36:27.391048+0000","last_fullsized":"2024-09-10T07:36:27.391048+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:48.866553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379642+0000","last_change":"2024-09-10T07:36:26.364701+0000","last_active":"2024-09-10T07:36:28.379642+0000","last_peered":"2024-09-10T07:36:28.379642+0000","last_clean":"2024-09-10T07:36:28.379642+0000","last_became_active":"2024-09-10T07:36:26.364234+0000","last_became_peered":"2024-09-10T07:36:26.364234+0000","last_unstale":"2024-09-10T07:36:28.379642+0000","last_undegraded":"2024-09-10T07:36:28.379642+0000","last_fullsized":"2024-09-10T07:36:28.379642+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:57.948604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378710+0000","last_change":"2024-09-10T07:36:27.392980+0000","last_active":"2024-09-10T07:36:28.378710+0000","last_peered":"2024-09-10T07:36:28.378710+0000","last_clean":"2024-09-10T07:36:28.378710+0000","last_became_active":"2024-09-10T07:36:27.392727+0000","last_became_peered":"2024-09-10T07:36:27.392727+0000","last_unstale":"2024-09-10T07:36:28.378710+0000","last_undegraded":"2024-09-10T07:36:28.378710+0000","last_fullsized":"2024-09-10T07:36:28.378710+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:41.270057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.388834+0000","last_change":"2024-09-10T07:36:26.368101+0000","last_active":"2024-09-10T07:36:27.388834+0000","last_peered":"2024-09-10T07:36:27.388834+0000","last_clean":"2024-09-10T07:36:27.388834+0000","last_became_active":"2024-09-10T07:36:26.367356+0000","last_became_peered":"2024-09-10T07:36:26.367356+0000","last_unstale":"2024-09-10T07:36:27.388834+0000","last_undegraded":"2024-09-10T07:36:27.388834+0000","last_fullsized":"2024-09-10T07:36:27.388834+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:33.084816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.399318+0000","last_change":"2024-09-10T07:36:27.399208+0000","last_active":"2024-09-10T07:36:27.399318+0000","last_peered":"2024-09-10T07:36:27.399318+0000","last_clean":"2024-09-10T07:36:27.399318+0000","last_became_active":"2024-09-10T07:36:27.398718+0000","last_became_peered":"2024-09-10T07:36:27.398718+0000","last_unstale":"2024-09-10T07:36:27.399318+0000","last_undegraded":"2024-09-10T07:36:27.399318+0000","last_fullsized":"2024-09-10T07:36:27.399318+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:32.153950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.380193+0000","last_change":"2024-09-10T07:36:26.365617+0000","last_active":"2024-09-10T07:36:27.380193+0000","last_peered":"2024-09-10T07:36:27.380193+0000","last_clean":"2024-09-10T07:36:27.380193+0000","last_became_active":"2024-09-10T07:36:26.365244+0000","last_became_peered":"2024-09-10T07:36:26.365244+0000","last_unstale":"2024-09-10T07:36:27.380193+0000","last_undegraded":"2024-09-10T07:36:27.380193+0000","last_fullsized":"2024-09-10T07:36:27.380193+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:35.201077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.395772+0000","last_change":"2024-09-10T07:36:27.395666+0000","last_active":"2024-09-10T07:36:27.395772+0000","last_peered":"2024-09-10T07:36:27.395772+0000","last_clean":"2024-09-10T07:36:27.395772+0000","last_became_active":"2024-09-10T07:36:27.395125+0000","last_became_peered":"2024-09-10T07:36:27.395125+0000","last_unstale":"2024-09-10T07:36:27.395772+0000","last_undegraded":"2024-09-10T07:36:27.395772+0000","last_fullsized":"2024-09-10T07:36:27.395772+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:04.579932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"64'3","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.406640+0000","last_change":"2024-09-10T07:36:26.367430+0000","last_active":"2024-09-10T07:36:27.406640+0000","last_peered":"2024-09-10T07:36:27.406640+0000","last_clean":"2024-09-10T07:36:27.406640+0000","last_became_active":"2024-09-10T07:36:26.366772+0000","last_became_peered":"2024-09-10T07:36:26.366772+0000","last_unstale":"2024-09-10T07:36:27.406640+0000","last_undegraded":"2024-09-10T07:36:27.406640+0000","last_fullsized":"2024-09-10T07:36:27.406640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:59.146566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.399113+0000","last_change":"2024-09-10T07:36:27.398979+0000","last_active":"2024-09-10T07:36:27.399113+0000","last_peered":"2024-09-10T07:36:27.399113+0000","last_clean":"2024-09-10T07:36:27.399113+0000","last_became_active":"2024-09-10T07:36:27.398543+0000","last_became_peered":"2024-09-10T07:36:27.398543+0000","last_unstale":"2024-09-10T07:36:27.399113+0000","last_undegraded":"2024-09-10T07:36:27.399113+0000","last_fullsized":"2024-09-10T07:36:27.399113+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:34.088825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"64'6","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379365+0000","last_change":"2024-09-10T07:36:26.369592+0000","last_active":"2024-09-10T07:36:28.379365+0000","last_peered":"2024-09-10T07:36:28.379365+0000","last_clean":"2024-09-10T07:36:28.379365+0000","last_became_active":"2024-09-10T07:36:26.369302+0000","last_became_peered":"2024-09-10T07:36:26.369302+0000","last_unstale":"2024-09-10T07:36:28.379365+0000","last_undegraded":"2024-09-10T07:36:28.379365+0000","last_fullsized":"2024-09-10T07:36:28.379365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:26.962964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378418+0000","last_change":"2024-09-10T07:36:27.397595+0000","last_active":"2024-09-10T07:36:28.378418+0000","last_peered":"2024-09-10T07:36:28.378418+0000","last_clean":"2024-09-10T07:36:28.378418+0000","last_became_active":"2024-09-10T07:36:27.397351+0000","last_became_peered":"2024-09-10T07:36:27.397351+0000","last_unstale":"2024-09-10T07:36:28.378418+0000","last_undegraded":"2024-09-10T07:36:28.378418+0000","last_fullsized":"2024-09-10T07:36:28.378418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:10.212549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.404692+0000","last_change":"2024-09-10T07:36:26.366355+0000","last_active":"2024-09-10T07:36:27.404692+0000","last_peered":"2024-09-10T07:36:27.404692+0000","last_clean":"2024-09-10T07:36:27.404692+0000","last_became_active":"2024-09-10T07:36:26.365617+0000","last_became_peered":"2024-09-10T07:36:26.365617+0000","last_unstale":"2024-09-10T07:36:27.404692+0000","last_undegraded":"2024-09-10T07:36:27.404692+0000","last_fullsized":"2024-09-10T07:36:27.404692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:01.243178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394800+0000","last_change":"2024-09-10T07:36:27.394661+0000","last_active":"2024-09-10T07:36:27.394800+0000","last_peered":"2024-09-10T07:36:27.394800+0000","last_clean":"2024-09-10T07:36:27.394800+0000","last_became_active":"2024-09-10T07:36:27.392072+0000","last_became_peered":"2024-09-10T07:36:27.392072+0000","last_unstale":"2024-09-10T07:36:27.394800+0000","last_undegraded":"2024-09-10T07:36:27.394800+0000","last_fullsized":"2024-09-10T07:36:27.394800+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:38.941053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.383462+0000","last_change":"2024-09-10T07:36:26.363463+0000","last_active":"2024-09-10T07:36:27.383462+0000","last_peered":"2024-09-10T07:36:27.383462+0000","last_clean":"2024-09-10T07:36:27.383462+0000","last_became_active":"2024-09-10T07:36:26.363171+0000","last_became_peered":"2024-09-10T07:36:26.363171+0000","last_unstale":"2024-09-10T07:36:27.383462+0000","last_undegraded":"2024-09-10T07:36:27.383462+0000","last_fullsized":"2024-09-10T07:36:27.383462+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:15.954820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378349+0000","last_change":"2024-09-10T07:36:27.390533+0000","last_active":"2024-09-10T07:36:28.378349+0000","last_peered":"2024-09-10T07:36:28.378349+0000","last_clean":"2024-09-10T07:36:28.378349+0000","last_became_active":"2024-09-10T07:36:27.390242+0000","last_became_peered":"2024-09-10T07:36:27.390242+0000","last_unstale":"2024-09-10T07:36:28.378349+0000","last_undegraded":"2024-09-10T07:36:28.378349+0000","last_fullsized":"2024-09-10T07:36:28.378349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:46:14.859683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378529+0000","last_change":"2024-09-10T07:36:26.366736+0000","last_active":"2024-09-10T07:36:28.378529+0000","last_peered":"2024-09-10T07:36:28.378529+0000","last_clean":"2024-09-10T07:36:28.378529+0000","last_became_active":"2024-09-10T07:36:26.366341+0000","last_became_peered":"2024-09-10T07:36:26.366341+0000","last_unstale":"2024-09-10T07:36:28.378529+0000","last_undegraded":"2024-09-10T07:36:28.378529+0000","last_fullsized":"2024-09-10T07:36:28.378529+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:56.362909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.388939+0000","last_change":"2024-09-10T07:36:27.388490+0000","last_active":"2024-09-10T07:36:27.388939+0000","last_peered":"2024-09-10T07:36:27.388939+0000","last_clean":"2024-09-10T07:36:27.388939+0000","last_became_active":"2024-09-10T07:36:27.388051+0000","last_became_peered":"2024-09-10T07:36:27.388051+0000","last_unstale":"2024-09-10T07:36:27.388939+0000","last_undegraded":"2024-09-10T07:36:27.388939+0000","last_fullsized":"2024-09-10T07:36:27.388939+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:49.934360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"64'8","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.405808+0000","last_change":"2024-09-10T07:36:26.369351+0000","last_active":"2024-09-10T07:36:27.405808+0000","last_peered":"2024-09-10T07:36:27.405808+0000","last_clean":"2024-09-10T07:36:27.405808+0000","last_became_active":"2024-09-10T07:36:26.367179+0000","last_became_peered":"2024-09-10T07:36:26.367179+0000","last_unstale":"2024-09-10T07:36:27.405808+0000","last_undegraded":"2024-09-10T07:36:27.405808+0000","last_fullsized":"2024-09-10T07:36:27.405808+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:27.302375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394762+0000","last_change":"2024-09-10T07:36:27.394398+0000","last_active":"2024-09-10T07:36:27.394762+0000","last_peered":"2024-09-10T07:36:27.394762+0000","last_clean":"2024-09-10T07:36:27.394762+0000","last_became_active":"2024-09-10T07:36:27.390139+0000","last_became_peered":"2024-09-10T07:36:27.390139+0000","last_unstale":"2024-09-10T07:36:27.394762+0000","last_undegraded":"2024-09-10T07:36:27.394762+0000","last_fullsized":"2024-09-10T07:36:27.394762+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:35.881709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.404220+0000","last_change":"2024-09-10T07:36:26.365501+0000","last_active":"2024-09-10T07:36:27.404220+0000","last_peered":"2024-09-10T07:36:27.404220+0000","last_clean":"2024-09-10T07:36:27.404220+0000","last_became_active":"2024-09-10T07:36:26.365201+0000","last_became_peered":"2024-09-10T07:36:26.365201+0000","last_unstale":"2024-09-10T07:36:27.404220+0000","last_undegraded":"2024-09-10T07:36:27.404220+0000","last_fullsized":"2024-09-10T07:36:27.404220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:05.827656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378242+0000","last_change":"2024-09-10T07:36:27.398142+0000","last_active":"2024-09-10T07:36:28.378242+0000","last_peered":"2024-09-10T07:36:28.378242+0000","last_clean":"2024-09-10T07:36:28.378242+0000","last_became_active":"2024-09-10T07:36:27.397703+0000","last_became_peered":"2024-09-10T07:36:27.397703+0000","last_unstale":"2024-09-10T07:36:28.378242+0000","last_undegraded":"2024-09-10T07:36:28.378242+0000","last_fullsized":"2024-09-10T07:36:28.378242+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:33.652071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380191+0000","last_change":"2024-09-10T07:36:26.373561+0000","last_active":"2024-09-10T07:36:28.380191+0000","last_peered":"2024-09-10T07:36:28.380191+0000","last_clean":"2024-09-10T07:36:28.380191+0000","last_became_active":"2024-09-10T07:36:26.373343+0000","last_became_peered":"2024-09-10T07:36:26.373343+0000","last_unstale":"2024-09-10T07:36:28.380191+0000","last_undegraded":"2024-09-10T07:36:28.380191+0000","last_fullsized":"2024-09-10T07:36:28.380191+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:34:03.534275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.384256+0000","last_change":"2024-09-10T07:36:27.383837+0000","last_active":"2024-09-10T07:36:27.384256+0000","last_peered":"2024-09-10T07:36:27.384256+0000","last_clean":"2024-09-10T07:36:27.384256+0000","last_became_active":"2024-09-10T07:36:27.383605+0000","last_became_peered":"2024-09-10T07:36:27.383605+0000","last_unstale":"2024-09-10T07:36:27.384256+0000","last_undegraded":"2024-09-10T07:36:27.384256+0000","last_fullsized":"2024-09-10T07:36:27.384256+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:26.744294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379102+0000","last_change":"2024-09-10T07:36:26.369014+0000","last_active":"2024-09-10T07:36:28.379102+0000","last_peered":"2024-09-10T07:36:28.379102+0000","last_clean":"2024-09-10T07:36:28.379102+0000","last_became_active":"2024-09-10T07:36:26.368592+0000","last_became_peered":"2024-09-10T07:36:26.368592+0000","last_unstale":"2024-09-10T07:36:28.379102+0000","last_undegraded":"2024-09-10T07:36:28.379102+0000","last_fullsized":"2024-09-10T07:36:28.379102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:13.023829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.399489+0000","last_change":"2024-09-10T07:36:27.399387+0000","last_active":"2024-09-10T07:36:27.399489+0000","last_peered":"2024-09-10T07:36:27.399489+0000","last_clean":"2024-09-10T07:36:27.399489+0000","last_became_active":"2024-09-10T07:36:27.399024+0000","last_became_peered":"2024-09-10T07:36:27.399024+0000","last_unstale":"2024-09-10T07:36:27.399489+0000","last_undegraded":"2024-09-10T07:36:27.399489+0000","last_fullsized":"2024-09-10T07:36:27.399489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:27.665748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380042+0000","last_change":"2024-09-10T07:36:26.372065+0000","last_active":"2024-09-10T07:36:28.380042+0000","last_peered":"2024-09-10T07:36:28.380042+0000","last_clean":"2024-09-10T07:36:28.380042+0000","last_became_active":"2024-09-10T07:36:26.371709+0000","last_became_peered":"2024-09-10T07:36:26.371709+0000","last_unstale":"2024-09-10T07:36:28.380042+0000","last_undegraded":"2024-09-10T07:36:28.380042+0000","last_fullsized":"2024-09-10T07:36:28.380042+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:54.470730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378482+0000","last_change":"2024-09-10T07:36:27.397939+0000","last_active":"2024-09-10T07:36:28.378482+0000","last_peered":"2024-09-10T07:36:28.378482+0000","last_clean":"2024-09-10T07:36:28.378482+0000","last_became_active":"2024-09-10T07:36:27.397294+0000","last_became_peered":"2024-09-10T07:36:27.397294+0000","last_unstale":"2024-09-10T07:36:28.378482+0000","last_undegraded":"2024-09-10T07:36:28.378482+0000","last_fullsized":"2024-09-10T07:36:28.378482+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:42.366358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.404410+0000","last_change":"2024-09-10T07:36:26.367526+0000","last_active":"2024-09-10T07:36:27.404410+0000","last_peered":"2024-09-10T07:36:27.404410+0000","last_clean":"2024-09-10T07:36:27.404410+0000","last_became_active":"2024-09-10T07:36:26.365532+0000","last_became_peered":"2024-09-10T07:36:26.365532+0000","last_unstale":"2024-09-10T07:36:27.404410+0000","last_undegraded":"2024-09-10T07:36:27.404410+0000","last_fullsized":"2024-09-10T07:36:27.404410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:49.574247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379819+0000","last_change":"2024-09-10T07:36:27.390639+0000","last_active":"2024-09-10T07:36:28.379819+0000","last_peered":"2024-09-10T07:36:28.379819+0000","last_clean":"2024-09-10T07:36:28.379819+0000","last_became_active":"2024-09-10T07:36:27.390312+0000","last_became_peered":"2024-09-10T07:36:27.390312+0000","last_unstale":"2024-09-10T07:36:28.379819+0000","last_undegraded":"2024-09-10T07:36:28.379819+0000","last_fullsized":"2024-09-10T07:36:28.379819+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.510855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.391691+0000","last_change":"2024-09-10T07:36:26.362986+0000","last_active":"2024-09-10T07:36:27.391691+0000","last_peered":"2024-09-10T07:36:27.391691+0000","last_clean":"2024-09-10T07:36:27.391691+0000","last_became_active":"2024-09-10T07:36:26.362619+0000","last_became_peered":"2024-09-10T07:36:26.362619+0000","last_unstale":"2024-09-10T07:36:27.391691+0000","last_undegraded":"2024-09-10T07:36:27.391691+0000","last_fullsized":"2024-09-10T07:36:27.391691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:40.439014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379998+0000","last_change":"2024-09-10T07:36:27.397028+0000","last_active":"2024-09-10T07:36:28.379998+0000","last_peered":"2024-09-10T07:36:28.379998+0000","last_clean":"2024-09-10T07:36:28.379998+0000","last_became_active":"2024-09-10T07:36:27.396793+0000","last_became_peered":"2024-09-10T07:36:27.396793+0000","last_unstale":"2024-09-10T07:36:28.379998+0000","last_undegraded":"2024-09-10T07:36:28.379998+0000","last_fullsized":"2024-09-10T07:36:28.379998+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:18.582540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379210+0000","last_change":"2024-09-10T07:36:26.365606+0000","last_active":"2024-09-10T07:36:28.379210+0000","last_peered":"2024-09-10T07:36:28.379210+0000","last_clean":"2024-09-10T07:36:28.379210+0000","last_became_active":"2024-09-10T07:36:26.365212+0000","last_became_peered":"2024-09-10T07:36:26.365212+0000","last_unstale":"2024-09-10T07:36:28.379210+0000","last_undegraded":"2024-09-10T07:36:28.379210+0000","last_fullsized":"2024-09-10T07:36:28.379210+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:30.560218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378134+0000","last_change":"2024-09-10T07:36:27.389822+0000","last_active":"2024-09-10T07:36:28.378134+0000","last_peered":"2024-09-10T07:36:28.378134+0000","last_clean":"2024-09-10T07:36:28.378134+0000","last_became_active":"2024-09-10T07:36:27.389533+0000","last_became_peered":"2024-09-10T07:36:27.389533+0000","last_unstale":"2024-09-10T07:36:28.378134+0000","last_undegraded":"2024-09-10T07:36:28.378134+0000","last_fullsized":"2024-09-10T07:36:28.378134+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:01.602841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.403049+0000","last_change":"2024-09-10T07:36:26.363786+0000","last_active":"2024-09-10T07:36:27.403049+0000","last_peered":"2024-09-10T07:36:27.403049+0000","last_clean":"2024-09-10T07:36:27.403049+0000","last_became_active":"2024-09-10T07:36:26.363569+0000","last_became_peered":"2024-09-10T07:36:26.363569+0000","last_unstale":"2024-09-10T07:36:27.403049+0000","last_undegraded":"2024-09-10T07:36:27.403049+0000","last_fullsized":"2024-09-10T07:36:27.403049+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:48.927067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378134+0000","last_change":"2024-09-10T07:36:27.388196+0000","last_active":"2024-09-10T07:36:28.378134+0000","last_peered":"2024-09-10T07:36:28.378134+0000","last_clean":"2024-09-10T07:36:28.378134+0000","last_became_active":"2024-09-10T07:36:27.386254+0000","last_became_peered":"2024-09-10T07:36:27.386254+0000","last_unstale":"2024-09-10T07:36:28.378134+0000","last_undegraded":"2024-09-10T07:36:28.378134+0000","last_fullsized":"2024-09-10T07:36:28.378134+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:14.648531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.380169+0000","last_change":"2024-09-10T07:36:26.371025+0000","last_active":"2024-09-10T07:36:28.380169+0000","last_peered":"2024-09-10T07:36:28.380169+0000","last_clean":"2024-09-10T07:36:28.380169+0000","last_became_active":"2024-09-10T07:36:26.370443+0000","last_became_peered":"2024-09-10T07:36:26.370443+0000","last_unstale":"2024-09-10T07:36:28.380169+0000","last_undegraded":"2024-09-10T07:36:28.380169+0000","last_fullsized":"2024-09-10T07:36:28.380169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:00.442654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.397509+0000","last_change":"2024-09-10T07:36:27.397397+0000","last_active":"2024-09-10T07:36:27.397509+0000","last_peered":"2024-09-10T07:36:27.397509+0000","last_clean":"2024-09-10T07:36:27.397509+0000","last_became_active":"2024-09-10T07:36:27.396191+0000","last_became_peered":"2024-09-10T07:36:27.396191+0000","last_unstale":"2024-09-10T07:36:27.397509+0000","last_undegraded":"2024-09-10T07:36:27.397509+0000","last_fullsized":"2024-09-10T07:36:27.397509+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:27.380913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.385776+0000","last_change":"2024-09-10T07:36:26.365183+0000","last_active":"2024-09-10T07:36:27.385776+0000","last_peered":"2024-09-10T07:36:27.385776+0000","last_clean":"2024-09-10T07:36:27.385776+0000","last_became_active":"2024-09-10T07:36:26.364844+0000","last_became_peered":"2024-09-10T07:36:26.364844+0000","last_unstale":"2024-09-10T07:36:27.385776+0000","last_undegraded":"2024-09-10T07:36:27.385776+0000","last_fullsized":"2024-09-10T07:36:27.385776+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:19.597767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.379749+0000","last_change":"2024-09-10T07:36:27.393656+0000","last_active":"2024-09-10T07:36:28.379749+0000","last_peered":"2024-09-10T07:36:28.379749+0000","last_clean":"2024-09-10T07:36:28.379749+0000","last_became_active":"2024-09-10T07:36:27.393433+0000","last_became_peered":"2024-09-10T07:36:27.393433+0000","last_unstale":"2024-09-10T07:36:28.379749+0000","last_undegraded":"2024-09-10T07:36:28.379749+0000","last_fullsized":"2024-09-10T07:36:28.379749+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:07.938635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378738+0000","last_change":"2024-09-10T07:36:26.370650+0000","last_active":"2024-09-10T07:36:28.378738+0000","last_peered":"2024-09-10T07:36:28.378738+0000","last_clean":"2024-09-10T07:36:28.378738+0000","last_became_active":"2024-09-10T07:36:26.370295+0000","last_became_peered":"2024-09-10T07:36:26.370295+0000","last_unstale":"2024-09-10T07:36:28.378738+0000","last_undegraded":"2024-09-10T07:36:28.378738+0000","last_fullsized":"2024-09-10T07:36:28.378738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:12.295430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.392968+0000","last_change":"2024-09-10T07:36:27.392074+0000","last_active":"2024-09-10T07:36:27.392968+0000","last_peered":"2024-09-10T07:36:27.392968+0000","last_clean":"2024-09-10T07:36:27.392968+0000","last_became_active":"2024-09-10T07:36:27.391844+0000","last_became_peered":"2024-09-10T07:36:27.391844+0000","last_unstale":"2024-09-10T07:36:27.392968+0000","last_undegraded":"2024-09-10T07:36:27.392968+0000","last_fullsized":"2024-09-10T07:36:27.392968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:31:39.394173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.393633+0000","last_change":"2024-09-10T07:36:26.364507+0000","last_active":"2024-09-10T07:36:27.393633+0000","last_peered":"2024-09-10T07:36:27.393633+0000","last_clean":"2024-09-10T07:36:27.393633+0000","last_became_active":"2024-09-10T07:36:26.364279+0000","last_became_peered":"2024-09-10T07:36:26.364279+0000","last_unstale":"2024-09-10T07:36:27.393633+0000","last_undegraded":"2024-09-10T07:36:27.393633+0000","last_fullsized":"2024-09-10T07:36:27.393633+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:16.162865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.396242+0000","last_change":"2024-09-10T07:36:27.396115+0000","last_active":"2024-09-10T07:36:27.396242+0000","last_peered":"2024-09-10T07:36:27.396242+0000","last_clean":"2024-09-10T07:36:27.396242+0000","last_became_active":"2024-09-10T07:36:27.395625+0000","last_became_peered":"2024-09-10T07:36:27.395625+0000","last_unstale":"2024-09-10T07:36:27.396242+0000","last_undegraded":"2024-09-10T07:36:27.396242+0000","last_fullsized":"2024-09-10T07:36:27.396242+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:32.458764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-10T07:36:28.378808+0000","last_change":"2024-09-10T07:36:26.371232+0000","last_active":"2024-09-10T07:36:28.378808+0000","last_peered":"2024-09-10T07:36:28.378808+0000","last_clean":"2024-09-10T07:36:28.378808+0000","last_became_active":"2024-09-10T07:36:26.370974+0000","last_became_peered":"2024-09-10T07:36:26.370974+0000","last_unstale":"2024-09-10T07:36:28.378808+0000","last_undegraded":"2024-09-10T07:36:28.378808+0000","last_fullsized":"2024-09-10T07:36:28.378808+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:18.607783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.395617+0000","last_change":"2024-09-10T07:36:27.395475+0000","last_active":"2024-09-10T07:36:27.395617+0000","last_peered":"2024-09-10T07:36:27.395617+0000","last_clean":"2024-09-10T07:36:27.395617+0000","last_became_active":"2024-09-10T07:36:27.394824+0000","last_became_peered":"2024-09-10T07:36:27.394824+0000","last_unstale":"2024-09-10T07:36:27.395617+0000","last_undegraded":"2024-09-10T07:36:27.395617+0000","last_fullsized":"2024-09-10T07:36:27.395617+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:30.682121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.394652+0000","last_change":"2024-09-10T07:36:26.369165+0000","last_active":"2024-09-10T07:36:27.394652+0000","last_peered":"2024-09-10T07:36:27.394652+0000","last_clean":"2024-09-10T07:36:27.394652+0000","last_became_active":"2024-09-10T07:36:26.368492+0000","last_became_peered":"2024-09-10T07:36:26.368492+0000","last_unstale":"2024-09-10T07:36:27.394652+0000","last_undegraded":"2024-09-10T07:36:27.394652+0000","last_fullsized":"2024-09-10T07:36:27.394652+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:16.154612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.390135+0000","last_change":"2024-09-10T07:36:27.389465+0000","last_active":"2024-09-10T07:36:27.390135+0000","last_peered":"2024-09-10T07:36:27.390135+0000","last_clean":"2024-09-10T07:36:27.390135+0000","last_became_active":"2024-09-10T07:36:27.389216+0000","last_became_peered":"2024-09-10T07:36:27.389216+0000","last_unstale":"2024-09-10T07:36:27.390135+0000","last_undegraded":"2024-09-10T07:36:27.390135+0000","last_fullsized":"2024-09-10T07:36:27.390135+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:53.403872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.379343+0000","last_change":"2024-09-10T07:36:26.367818+0000","last_active":"2024-09-10T07:36:27.379343+0000","last_peered":"2024-09-10T07:36:27.379343+0000","last_clean":"2024-09-10T07:36:27.379343+0000","last_became_active":"2024-09-10T07:36:26.367381+0000","last_became_peered":"2024-09-10T07:36:26.367381+0000","last_unstale":"2024-09-10T07:36:27.379343+0000","last_undegraded":"2024-09-10T07:36:27.379343+0000","last_fullsized":"2024-09-10T07:36:27.379343+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:12.228075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.393004+0000","last_change":"2024-09-10T07:36:27.392725+0000","last_active":"2024-09-10T07:36:27.393004+0000","last_peered":"2024-09-10T07:36:27.393004+0000","last_clean":"2024-09-10T07:36:27.393004+0000","last_became_active":"2024-09-10T07:36:27.391545+0000","last_became_peered":"2024-09-10T07:36:27.391545+0000","last_unstale":"2024-09-10T07:36:27.393004+0000","last_undegraded":"2024-09-10T07:36:27.393004+0000","last_fullsized":"2024-09-10T07:36:27.393004+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:26.352182+0000","last_clean_scrub_stamp":"2024-09-10T07:36:26.352182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:14.897585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.383363+0000","last_change":"2024-09-10T07:36:26.366122+0000","last_active":"2024-09-10T07:36:27.383363+0000","last_peered":"2024-09-10T07:36:27.383363+0000","last_clean":"2024-09-10T07:36:27.383363+0000","last_became_active":"2024-09-10T07:36:26.365897+0000","last_became_peered":"2024-09-10T07:36:26.365897+0000","last_unstale":"2024-09-10T07:36:27.383363+0000","last_undegraded":"2024-09-10T07:36:27.383363+0000","last_fullsized":"2024-09-10T07:36:27.383363+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:36:25.346142+0000","last_clean_scrub_stamp":"2024-09-10T07:36:25.346142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:48.844804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":254,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-10T07:36:27.383317+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:36:27.383317+0000","last_peered":"2024-09-10T07:36:27.383317+0000","last_clean":"2024-09-10T07:36:27.383317+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:36:27.383317+0000","last_undegraded":"2024-09-10T07:36:27.383317+0000","last_fullsized":"2024-09-10T07:36:27.383317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:49.257689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":896,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194415,"statfs":{"total":200000000,"available":199081750,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194992,"statfs":{"total":200000000,"available":199672278,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194991,"statfs":{"total":200000000,"available":199671626,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":327,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194984,"statfs":{"total":200000000,"available":199664366,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194992,"statfs":{"total":200000000,"available":199672222,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194992,"statfs":{"total":200000000,"available":199672222,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":320,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194992,"statfs":{"total":200000000,"available":199672188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":904,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194407,"statfs":{"total":200000000,"available":199073416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:36:31.961 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:36:31.962 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T07:36:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.157+0000 7fca56800640 1 Processor -- start 2024-09-10T07:36:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.157+0000 7fca56800640 1 -- start start 2024-09-10T07:36:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.159+0000 7fca56800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca50073370 0x7fca500ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.159+0000 7fca56800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca50073820 con 0x7fca5006e280 2024-09-10T07:36:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.159+0000 7fca56800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca500722d0 con 0x7fca50071df0 2024-09-10T07:36:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.159+0000 7fca56800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fca500d1720 con 0x7fca50073370 2024-09-10T07:36:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.159+0000 7fca4f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fca5006e280 0x7fca5006e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58882/0 (socket says 172.21.15.99:58882) 2024-09-10T07:36:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.159+0000 7fca4f400640 1 -- 172.21.15.99:0/3621083651 learned_addr learned my addr 172.21.15.99:0/3621083651 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.159+0000 7fca4fe00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca50073370 0x7fca500ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.159+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404755835 0 0) 0x7fca50073820 con 0x7fca5006e280 2024-09-10T07:36:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.159+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca34003520 con 0x7fca5006e280 2024-09-10T07:36:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1429303628 0 0) 0x7fca500722d0 con 0x7fca50071df0 2024-09-10T07:36:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca50073820 con 0x7fca50071df0 2024-09-10T07:36:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3644765438 0 0) 0x7fca34003520 con 0x7fca5006e280 2024-09-10T07:36:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca50073370 msgr2=0x7fca500ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca50073370 0x7fca500ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 >> v1:172.21.15.187:6789/0 conn(0x7fca50071df0 legacy=0x7fca500d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca500725b0 con 0x7fca5006e280 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fca40001670 con 0x7fca5006e280 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4fe00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca50073370 0x7fca500ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 >> v1:172.21.15.99:6789/0 conn(0x7fca5006e280 legacy=0x7fca5006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca34003b70 0x7fca34003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca34004800 0x7fca34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca340051c0 0x7fca3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fca500d1720 con 0x7fca34004800 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fca3400bfb0 con 0x7fca340051c0 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fca3400c1b0 con 0x7fca34003b70 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca46a00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca34004800 0x7fca34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4f400640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca34003b70 0x7fca34003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.160+0000 7fca4fe00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca340051c0 0x7fca3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.161+0000 7fca46a00640 1 -- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca34003b70 msgr2=0x7fca34003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.161+0000 7fca46a00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca34003b70 0x7fca34003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.161+0000 7fca46a00640 1 -- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca340051c0 msgr2=0x7fca3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.161+0000 7fca46a00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca340051c0 0x7fca3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.161+0000 7fca46a00640 1 -- 172.21.15.99:0/3621083651 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca34003520 con 0x7fca34004800 2024-09-10T07:36:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.161+0000 7fca4fe00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca340051c0 0x7fca3400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.162+0000 7fca46a00640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca34004800 0x7fca34004c80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fca380018d0 tx=0x7fca34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0778a9bae7e65a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.162+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca380014f0 con 0x7fca34004800 2024-09-10T07:36:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.162+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca380052d0 con 0x7fca34004800 2024-09-10T07:36:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.162+0000 7fca4ea00640 1 -- 172.21.15.99:0/3621083651 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3802aca0 con 0x7fca34004800 2024-09-10T07:36:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.162+0000 7fca56800640 1 -- 172.21.15.99:0/3621083651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca34004800 msgr2=0x7fca34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.162+0000 7fca56800640 1 --2- 172.21.15.99:0/3621083651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca34004800 0x7fca34004c80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fca380018d0 tx=0x7fca34005830 comp rx=0 tx=0).stop 2024-09-10T07:36:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.162+0000 7fca4fe00640 1 -- 172.21.15.99:0/3621083651 reap_dead start 2024-09-10T07:36:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.162+0000 7fca56800640 1 -- 172.21.15.99:0/3621083651 shutdown_connections 2024-09-10T07:36:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.162+0000 7fca56800640 1 -- 172.21.15.99:0/3621083651 >> 172.21.15.99:0/3621083651 conn(0x7fca5006bc10 msgr2=0x7fca5006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.162+0000 7fca56800640 1 -- 172.21.15.99:0/3621083651 shutdown_connections 2024-09-10T07:36:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.163+0000 7fca56800640 1 -- 172.21.15.99:0/3621083651 wait complete. 2024-09-10T07:36:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.164+0000 7fca56800640 1 Processor -- start 2024-09-10T07:36:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.164+0000 7fca56800640 1 -- start start 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.165+0000 7fca56800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca34004800 0x7fca50158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.165+0000 7fca56800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca50152d80 0x7fca500af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.165+0000 7fca56800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca50147e90 0x7fca50148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.165+0000 7fca56800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fca50072e50 con 0x7fca50147e90 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.165+0000 7fca56800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fca50072b70 con 0x7fca34004800 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.165+0000 7fca56800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fca5015db60 con 0x7fca50152d80 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.165+0000 7fca4fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca50147e90 0x7fca50148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca4fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca50147e90 0x7fca50148320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55390/0 (socket says 172.21.15.99:55390) 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca4fe00640 1 -- 172.21.15.99:0/3311862781 learned_addr learned my addr 172.21.15.99:0/3311862781 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca46a00640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca50152d80 0x7fca500af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca4f400640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca34004800 0x7fca50158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca4fe00640 1 -- 172.21.15.99:0/3311862781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca50152d80 msgr2=0x7fca500af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca4fe00640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca50152d80 0x7fca500af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca4fe00640 1 -- 172.21.15.99:0/3311862781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca34004800 msgr2=0x7fca50158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca4fe00640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca34004800 0x7fca50158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca4fe00640 1 -- 172.21.15.99:0/3311862781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca50148860 con 0x7fca50147e90 2024-09-10T07:36:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca4fe00640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca50147e90 0x7fca50148320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fca48000f80 tx=0x7fca480115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.166+0000 7fca47e00640 1 -- 172.21.15.99:0/3311862781 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48003990 con 0x7fca50147e90 2024-09-10T07:36:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.167+0000 7fca47e00640 1 -- 172.21.15.99:0/3311862781 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4801b070 con 0x7fca50147e90 2024-09-10T07:36:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.167+0000 7fca47e00640 1 -- 172.21.15.99:0/3311862781 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48003b30 con 0x7fca50147e90 2024-09-10T07:36:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.167+0000 7fca56800640 1 -- 172.21.15.99:0/3311862781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca50154300 con 0x7fca50147e90 2024-09-10T07:36:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.167+0000 7fca56800640 1 -- 172.21.15.99:0/3311862781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca50153540 con 0x7fca50147e90 2024-09-10T07:36:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.168+0000 7fca56800640 1 -- 172.21.15.99:0/3311862781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5006e660 con 0x7fca50147e90 2024-09-10T07:36:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.169+0000 7fca47e00640 1 -- 172.21.15.99:0/3311862781 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca48005d10 con 0x7fca50147e90 2024-09-10T07:36:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.169+0000 7fca47e00640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca2c06be30 0x7fca2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.170+0000 7fca47e00640 1 -- 172.21.15.99:0/3311862781 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7fca4808b2a0 con 0x7fca50147e90 2024-09-10T07:36:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.170+0000 7fca4f400640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca2c06be30 0x7fca2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.170+0000 7fca4f400640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca2c06be30 0x7fca2c06e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca40001e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:32.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.174+0000 7fca47e00640 1 -- 172.21.15.99:0/3311862781 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca48059690 con 0x7fca50147e90 2024-09-10T07:36:32.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.410+0000 7fca56800640 1 -- 172.21.15.99:0/3311862781 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fca500b1fd0 con 0x7fca50147e90 2024-09-10T07:36:32.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.414+0000 7fca47e00640 1 -- 172.21.15.99:0/3311862781 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fca4805d990 con 0x7fca50147e90 2024-09-10T07:36:32.414 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:36:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:36:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-09-10T07:36:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-09-10T07:36:32.414 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T07:36:32.415 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-09-10T07:36:32.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.416+0000 7fca56800640 1 -- 172.21.15.99:0/3311862781 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca2c06be30 msgr2=0x7fca2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.416+0000 7fca56800640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca2c06be30 0x7fca2c06e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca40001e40 comp rx=0 tx=0).stop 2024-09-10T07:36:32.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.416+0000 7fca56800640 1 -- 172.21.15.99:0/3311862781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca50147e90 msgr2=0x7fca50148320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.416+0000 7fca56800640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca50147e90 0x7fca50148320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fca48000f80 tx=0x7fca480115a0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.416+0000 7fca56800640 1 -- 172.21.15.99:0/3311862781 shutdown_connections 2024-09-10T07:36:32.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.416+0000 7fca56800640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fca2c06be30 0x7fca2c06e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.416+0000 7fca56800640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca50147e90 0x7fca50148320 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.416+0000 7fca56800640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca50152d80 0x7fca500af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.416+0000 7fca56800640 1 --2- 172.21.15.99:0/3311862781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca34004800 0x7fca50158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.416+0000 7fca56800640 1 -- 172.21.15.99:0/3311862781 >> 172.21.15.99:0/3311862781 conn(0x7fca5006bc10 msgr2=0x7fca500b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:32.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.417+0000 7fca56800640 1 -- 172.21.15.99:0/3311862781 shutdown_connections 2024-09-10T07:36:32.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.417+0000 7fca56800640 1 -- 172.21.15.99:0/3311862781 wait complete. 2024-09-10T07:36:32.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:36:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.587+0000 7f514f200640 1 Processor -- start 2024-09-10T07:36:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.587+0000 7f514f200640 1 -- start start 2024-09-10T07:36:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.588+0000 7f514f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f515015e970 0x7f51500d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.588+0000 7f514f200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f51500d2680 0x7f51500cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.588+0000 7f514f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51500cfac0 0x7f51500d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.588+0000 7f514f200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f51500d37e0 con 0x7f515015e970 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.588+0000 7f514f200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f51500d2bd0 con 0x7f51500d2680 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.588+0000 7f514f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f51500d2eb0 con 0x7f51500cfac0 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.588+0000 7f514de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f515015e970 0x7f51500d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.588+0000 7f514de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f515015e970 0x7f51500d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55396/0 (socket says 172.21.15.99:55396) 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.588+0000 7f514de00640 1 -- 172.21.15.99:0/1413449557 learned_addr learned my addr 172.21.15.99:0/1413449557 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.589+0000 7f514d400640 1 --2- 172.21.15.99:0/1413449557 >> v2:172.21.15.187:3300/0 conn(0x7f51500d2680 0x7f51500cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.589+0000 7f514e800640 1 --2- 172.21.15.99:0/1413449557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51500cfac0 0x7f51500d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.589+0000 7f514de00640 1 -- 172.21.15.99:0/1413449557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51500cfac0 msgr2=0x7f51500d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.589+0000 7f514de00640 1 --2- 172.21.15.99:0/1413449557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51500cfac0 0x7f51500d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.589+0000 7f514de00640 1 -- 172.21.15.99:0/1413449557 >> v2:172.21.15.187:3300/0 conn(0x7f51500d2680 msgr2=0x7f51500cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.589+0000 7f514de00640 1 --2- 172.21.15.99:0/1413449557 >> v2:172.21.15.187:3300/0 conn(0x7f51500d2680 0x7f51500cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.589+0000 7f514de00640 1 -- 172.21.15.99:0/1413449557 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51500d3190 con 0x7f515015e970 2024-09-10T07:36:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.589+0000 7f514d400640 1 --2- 172.21.15.99:0/1413449557 >> v2:172.21.15.187:3300/0 conn(0x7f51500d2680 0x7f51500cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.590+0000 7f514de00640 1 --2- 172.21.15.99:0/1413449557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f515015e970 0x7f51500d0300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f515009e530 tx=0x7f514002a260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a77c9ef53323be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.590+0000 7f514ca00640 1 -- 172.21.15.99:0/1413449557 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140037070 con 0x7f515015e970 2024-09-10T07:36:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.590+0000 7f514ca00640 1 -- 172.21.15.99:0/1413449557 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5140032440 con 0x7f515015e970 2024-09-10T07:36:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.590+0000 7f514ca00640 1 -- 172.21.15.99:0/1413449557 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140032810 con 0x7f515015e970 2024-09-10T07:36:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.591+0000 7f514f200640 1 -- 172.21.15.99:0/1413449557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f515015e970 msgr2=0x7f51500d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.591+0000 7f514f200640 1 --2- 172.21.15.99:0/1413449557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f515015e970 0x7f51500d0300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f515009e530 tx=0x7f514002a260 comp rx=0 tx=0).stop 2024-09-10T07:36:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.591+0000 7f514f200640 1 -- 172.21.15.99:0/1413449557 shutdown_connections 2024-09-10T07:36:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.591+0000 7f514f200640 1 --2- 172.21.15.99:0/1413449557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51500cfac0 0x7f51500d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.591+0000 7f514f200640 1 --2- 172.21.15.99:0/1413449557 >> v2:172.21.15.187:3300/0 conn(0x7f51500d2680 0x7f51500cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.591+0000 7f514f200640 1 --2- 172.21.15.99:0/1413449557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f515015e970 0x7f51500d0300 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.591+0000 7f514f200640 1 -- 172.21.15.99:0/1413449557 >> 172.21.15.99:0/1413449557 conn(0x7f515009de00 msgr2=0x7f51500d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.591+0000 7f514f200640 1 -- 172.21.15.99:0/1413449557 shutdown_connections 2024-09-10T07:36:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.591+0000 7f514f200640 1 -- 172.21.15.99:0/1413449557 wait complete. 2024-09-10T07:36:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.592+0000 7f514f200640 1 Processor -- start 2024-09-10T07:36:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.593+0000 7f514f200640 1 -- start start 2024-09-10T07:36:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.593+0000 7f514f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51500cfac0 0x7f5150154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.593+0000 7f514f200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51500d2680 0x7f51501e83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.593+0000 7f514f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515015e970 0x7f51500cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.593+0000 7f514f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f51500d0840 con 0x7f51500cfac0 2024-09-10T07:36:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.593+0000 7f514f200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f51500cff50 con 0x7f51500d2680 2024-09-10T07:36:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.593+0000 7f514f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f515015ed50 con 0x7f515015e970 2024-09-10T07:36:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51500cfac0 0x7f5150154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51500cfac0 0x7f5150154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55400/0 (socket says 172.21.15.99:55400) 2024-09-10T07:36:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514de00640 1 -- 172.21.15.99:0/2984529940 learned_addr learned my addr 172.21.15.99:0/2984529940 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514de00640 1 -- 172.21.15.99:0/2984529940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515015e970 msgr2=0x7f51500cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514de00640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515015e970 0x7f51500cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514d400640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51500d2680 0x7f51501e83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514de00640 1 -- 172.21.15.99:0/2984529940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51500d2680 msgr2=0x7f51501e83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514de00640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51500d2680 0x7f51501e83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514de00640 1 -- 172.21.15.99:0/2984529940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5150155040 con 0x7f51500cfac0 2024-09-10T07:36:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514d400640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51500d2680 0x7f51501e83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f514de00640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51500cfac0 0x7f5150154b00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f514002a2a0 tx=0x7f51400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.594+0000 7f5146000640 1 -- 172.21.15.99:0/2984529940 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140041020 con 0x7f51500cfac0 2024-09-10T07:36:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.595+0000 7f5146000640 1 -- 172.21.15.99:0/2984529940 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51400306c0 con 0x7f51500cfac0 2024-09-10T07:36:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.595+0000 7f514f200640 1 -- 172.21.15.99:0/2984529940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51500b94f0 con 0x7f51500cfac0 2024-09-10T07:36:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.595+0000 7f5146000640 1 -- 172.21.15.99:0/2984529940 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140037040 con 0x7f51500cfac0 2024-09-10T07:36:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.595+0000 7f514f200640 1 -- 172.21.15.99:0/2984529940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51501e8f10 con 0x7f51500cfac0 2024-09-10T07:36:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.596+0000 7f514f200640 1 -- 172.21.15.99:0/2984529940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51500cf580 con 0x7f51500cfac0 2024-09-10T07:36:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.597+0000 7f5146000640 1 -- 172.21.15.99:0/2984529940 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5140044020 con 0x7f51500cfac0 2024-09-10T07:36:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.597+0000 7f5146000640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f513006be30 0x7f513006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.598+0000 7f5146000640 1 -- 172.21.15.99:0/2984529940 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7f51400ab660 con 0x7f51500cfac0 2024-09-10T07:36:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.598+0000 7f514d400640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f513006be30 0x7f513006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.598+0000 7f514d400640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f513006be30 0x7f513006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f513c006fd0 tx=0x7f513c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:32.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.602+0000 7f5146000640 1 -- 172.21.15.99:0/2984529940 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f514004b030 con 0x7f51500cfac0 2024-09-10T07:36:32.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.809+0000 7f514f200640 1 -- 172.21.15.99:0/2984529940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f515006c460 con 0x7f51500cfac0 2024-09-10T07:36:32.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.809+0000 7f5146000640 1 -- 172.21.15.99:0/2984529940 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5229 (secure 0 0 0) 0x7f5150155040 con 0x7f51500cfac0 2024-09-10T07:36:32.809 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:32.810 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":34,"btime":"2024-09-10T07:36:30:406568+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/2770940747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2770940747},{"type":"v1","addr":"172.21.15.187:6834","nonce":2770940747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":4997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/1207587759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1207587759},{"type":"v1","addr":"172.21.15.99:6836","nonce":1207587759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5463,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3753955373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3753955373},{"type":"v1","addr":"172.21.15.187:6835","nonce":3753955373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:36:26.770809+0000","modified":"2024-09-10T07:36:29.817237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5466":{"gid":5466,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3805850931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3805850931},{"type":"v1","addr":"172.21.15.99:6837","nonce":3805850931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5466,"qdb_cluster":[5466]},"id":4}]} 2024-09-10T07:36:32.810 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 34 2024-09-10T07:36:32.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.811+0000 7f514f200640 1 -- 172.21.15.99:0/2984529940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f513006be30 msgr2=0x7f513006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.811+0000 7f514f200640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f513006be30 0x7f513006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f513c006fd0 tx=0x7f513c008040 comp rx=0 tx=0).stop 2024-09-10T07:36:32.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.811+0000 7f514f200640 1 -- 172.21.15.99:0/2984529940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51500cfac0 msgr2=0x7f5150154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:32.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.811+0000 7f514f200640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51500cfac0 0x7f5150154b00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f514002a2a0 tx=0x7f51400046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.811+0000 7f514f200640 1 -- 172.21.15.99:0/2984529940 shutdown_connections 2024-09-10T07:36:32.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.811+0000 7f514f200640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515015e970 0x7f51500cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.812+0000 7f514f200640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51500d2680 0x7f51501e83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.812+0000 7f514f200640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f513006be30 0x7f513006e2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.812+0000 7f514f200640 1 --2- 172.21.15.99:0/2984529940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51500cfac0 0x7f5150154b00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:32.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.812+0000 7f514f200640 1 -- 172.21.15.99:0/2984529940 >> 172.21.15.99:0/2984529940 conn(0x7f515009de00 msgr2=0x7f51500d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:32.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.812+0000 7f514f200640 1 -- 172.21.15.99:0/2984529940 shutdown_connections 2024-09-10T07:36:32.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:32.812+0000 7f514f200640 1 -- 172.21.15.99:0/2984529940 wait complete. 2024-09-10T07:36:33.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:36:26.770809+0000', 'modified': '2024-09-10T07:36:29.817237+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5466}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5466': {'gid': 5466, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/3805850931', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6835', 'nonce': 3805850931}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 3805850931}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5466, 'qdb_cluster': [5466]} 2024-09-10T07:36:33.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:36:33.231 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T07:36:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.387+0000 7ff383e00640 1 Processor -- start 2024-09-10T07:36:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.387+0000 7ff383e00640 1 -- start start 2024-09-10T07:36:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.388+0000 7ff383e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff37c0b5750 0x7ff37c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.388+0000 7ff383e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff37c0cf890 0x7ff37c0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.388+0000 7ff383e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37c15c800 con 0x7ff37c0ce070 2024-09-10T07:36:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.388+0000 7ff383e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff37c0b5bb0 con 0x7ff37c0b5750 2024-09-10T07:36:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.388+0000 7ff383e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff37c0ce450 con 0x7ff37c0cf890 2024-09-10T07:36:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.389+0000 7ff380a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff37c0b5750 0x7ff37c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.389+0000 7ff380a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff37c0b5750 0x7ff37c15d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55414/0 (socket says 172.21.15.99:55414) 2024-09-10T07:36:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.389+0000 7ff380a00640 1 -- 172.21.15.99:0/608018865 learned_addr learned my addr 172.21.15.99:0/608018865 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.389+0000 7ff381e00640 1 --2- 172.21.15.99:0/608018865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff37c0cf890 0x7ff37c0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.389+0000 7ff380a00640 1 -- 172.21.15.99:0/608018865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff37c0cf890 msgr2=0x7ff37c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.389+0000 7ff380a00640 1 --2- 172.21.15.99:0/608018865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff37c0cf890 0x7ff37c0cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.389+0000 7ff380a00640 1 -- 172.21.15.99:0/608018865 >> v1:172.21.15.187:6789/0 conn(0x7ff37c0ce070 legacy=0x7ff37c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.389+0000 7ff380a00640 1 -- 172.21.15.99:0/608018865 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37c15cae0 con 0x7ff37c0b5750 2024-09-10T07:36:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.390+0000 7ff380a00640 1 --2- 172.21.15.99:0/608018865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0b5750 0x7ff37c15d170 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff368009870 tx=0x7ff36802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae5dacba56b7677 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.390+0000 7ff37be00640 1 -- 172.21.15.99:0/608018865 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368037070 con 0x7ff37c0b5750 2024-09-10T07:36:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.390+0000 7ff37be00640 1 -- 172.21.15.99:0/608018865 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff368032440 con 0x7ff37c0b5750 2024-09-10T07:36:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.390+0000 7ff37be00640 1 -- 172.21.15.99:0/608018865 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368032810 con 0x7ff37c0b5750 2024-09-10T07:36:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.391+0000 7ff383e00640 1 -- 172.21.15.99:0/608018865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0b5750 msgr2=0x7ff37c15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.391+0000 7ff383e00640 1 --2- 172.21.15.99:0/608018865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0b5750 0x7ff37c15d170 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff368009870 tx=0x7ff36802a270 comp rx=0 tx=0).stop 2024-09-10T07:36:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.391+0000 7ff383e00640 1 -- 172.21.15.99:0/608018865 shutdown_connections 2024-09-10T07:36:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.391+0000 7ff383e00640 1 --2- 172.21.15.99:0/608018865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff37c0cf890 0x7ff37c0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.391+0000 7ff383e00640 1 --2- 172.21.15.99:0/608018865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0b5750 0x7ff37c15d170 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.391+0000 7ff383e00640 1 -- 172.21.15.99:0/608018865 >> 172.21.15.99:0/608018865 conn(0x7ff37c0b2630 msgr2=0x7ff37c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.391+0000 7ff383e00640 1 -- 172.21.15.99:0/608018865 shutdown_connections 2024-09-10T07:36:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.391+0000 7ff383e00640 1 -- 172.21.15.99:0/608018865 wait complete. 2024-09-10T07:36:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.393+0000 7ff383e00640 1 Processor -- start 2024-09-10T07:36:33.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.393+0000 7ff383e00640 1 -- start start 2024-09-10T07:36:33.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff383e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff37c0b5750 0x7ff37c14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff383e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0ce070 0x7ff37c147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff383e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff37c0cf890 0x7ff37c0ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff383e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c15d830 con 0x7ff37c0ce070 2024-09-10T07:36:33.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff383e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c15d6b0 con 0x7ff37c0b5750 2024-09-10T07:36:33.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff383e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff37c06e080 con 0x7ff37c0cf890 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff380a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0ce070 0x7ff37c147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff380a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0ce070 0x7ff37c147e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55422/0 (socket says 172.21.15.99:55422) 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff380a00640 1 -- 172.21.15.99:0/2729799621 learned_addr learned my addr 172.21.15.99:0/2729799621 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff381400640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff37c0b5750 0x7ff37c14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff381e00640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff37c0cf890 0x7ff37c0ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff380a00640 1 -- 172.21.15.99:0/2729799621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff37c0cf890 msgr2=0x7ff37c0ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff380a00640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff37c0cf890 0x7ff37c0ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff380a00640 1 -- 172.21.15.99:0/2729799621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff37c0b5750 msgr2=0x7ff37c14b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff380a00640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff37c0b5750 0x7ff37c14b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.394+0000 7ff380a00640 1 -- 172.21.15.99:0/2729799621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37c14b700 con 0x7ff37c0ce070 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.395+0000 7ff380a00640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0ce070 0x7ff37c147e90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff368000c00 tx=0x7ff3680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.395+0000 7ff379600640 1 -- 172.21.15.99:0/2729799621 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368041020 con 0x7ff37c0ce070 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.395+0000 7ff379600640 1 -- 172.21.15.99:0/2729799621 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3680306c0 con 0x7ff37c0ce070 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.395+0000 7ff383e00640 1 -- 172.21.15.99:0/2729799621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff37c148ae0 con 0x7ff37c0ce070 2024-09-10T07:36:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.395+0000 7ff379600640 1 -- 172.21.15.99:0/2729799621 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368037040 con 0x7ff37c0ce070 2024-09-10T07:36:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.395+0000 7ff383e00640 1 -- 172.21.15.99:0/2729799621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff37c1490a0 con 0x7ff37c0ce070 2024-09-10T07:36:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.397+0000 7ff379600640 1 -- 172.21.15.99:0/2729799621 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff368044020 con 0x7ff37c0ce070 2024-09-10T07:36:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.398+0000 7ff379600640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff35c06be30 0x7ff35c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.398+0000 7ff379600640 1 -- 172.21.15.99:0/2729799621 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7ff3680ab710 con 0x7ff37c0ce070 2024-09-10T07:36:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.398+0000 7ff381400640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff35c06be30 0x7ff35c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.399+0000 7ff381400640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff35c06be30 0x7ff35c06e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff370000f60 tx=0x7ff370009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.399+0000 7ff386c30740 1 Processor -- start 2024-09-10T07:36:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.399+0000 7ff386c30740 1 -- start start 2024-09-10T07:36:33.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.400+0000 7ff386c30740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda8cf0 0x563b6cdee490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.400+0000 7ff386c30740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda64b0 0x563b6cda90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.400+0000 7ff386c30740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cda3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.400+0000 7ff386c30740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563b6cd073b0 con 0x563b6cdaa480 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.400+0000 7ff386c30740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x563b6cd0c410 con 0x563b6cda8cf0 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.400+0000 7ff386c30740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x563b6ccb4620 con 0x563b6cda64b0 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.400+0000 7ff381e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cda3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff381e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cda3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55432/0 (socket says 172.21.15.99:55432) 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff381e00640 1 -- 172.21.15.99:0/2139901171 learned_addr learned my addr 172.21.15.99:0/2139901171 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff381400640 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda8cf0 0x563b6cdee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff381e00640 1 -- 172.21.15.99:0/2139901171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda64b0 msgr2=0x563b6cda90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff380a00640 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda64b0 0x563b6cda90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff381e00640 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda64b0 0x563b6cda90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff381e00640 1 -- 172.21.15.99:0/2139901171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda8cf0 msgr2=0x563b6cdee490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff381e00640 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda8cf0 0x563b6cdee490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff381e00640 1 -- 172.21.15.99:0/2139901171 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b6ca1f2d0 con 0x563b6cdaa480 2024-09-10T07:36:33.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff381400640 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda8cf0 0x563b6cdee490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff380a00640 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda64b0 0x563b6cda90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff381e00640 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cda3570 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff374007410 tx=0x7ff3740078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e836f1e83daf6564 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff36dc00640 1 -- 172.21.15.99:0/2139901171 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3740147e0 con 0x563b6cdaa480 2024-09-10T07:36:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff36dc00640 1 -- 172.21.15.99:0/2139901171 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37401a070 con 0x563b6cdaa480 2024-09-10T07:36:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.401+0000 7ff36dc00640 1 -- 172.21.15.99:0/2139901171 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374014b80 con 0x563b6cdaa480 2024-09-10T07:36:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.402+0000 7ff386c30740 1 -- 172.21.15.99:0/2139901171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 msgr2=0x563b6cda3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.402+0000 7ff386c30740 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cda3570 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff374007410 tx=0x7ff3740078d0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.402+0000 7ff386c30740 1 -- 172.21.15.99:0/2139901171 shutdown_connections 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.402+0000 7ff386c30740 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cda3570 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.402+0000 7ff386c30740 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda64b0 0x563b6cda90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.402+0000 7ff386c30740 1 --2- 172.21.15.99:0/2139901171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda8cf0 0x563b6cdee490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.402+0000 7ff386c30740 1 -- 172.21.15.99:0/2139901171 >> 172.21.15.99:0/2139901171 conn(0x563b6cda5740 msgr2=0x563b6cded960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.402+0000 7ff386c30740 1 -- 172.21.15.99:0/2139901171 shutdown_connections 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.402+0000 7ff386c30740 1 -- 172.21.15.99:0/2139901171 wait complete. 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.403+0000 7ff386c30740 1 -- start start 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.403+0000 7ff386c30740 1 Processor -- start 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.404+0000 7ff386c30740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6cdc89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.404+0000 7ff386c30740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cdaa480 0x563b6cdc9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.404+0000 7ff386c30740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cda7470 0x563b6cdd1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.404+0000 7ff386c30740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563b6ccc7780 con 0x563b6cda7470 2024-09-10T07:36:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.404+0000 7ff386c30740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x563b6cd083d0 con 0x563b6cdaa480 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.404+0000 7ff386c30740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x563b6cda4be0 con 0x563b6cda8cf0 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.404+0000 7ff386c30740 10 client.0 _ll_register_callbacks cb 0x563b6cd055d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.404+0000 7ff381e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cda7470 0x563b6cdd1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.404+0000 7ff381e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cda7470 0x563b6cdd1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55440/0 (socket says 172.21.15.99:55440) 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.404+0000 7ff381e00640 1 -- 172.21.15.99:0/3151057208 learned_addr learned my addr 172.21.15.99:0/3151057208 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff381e00640 1 -- 172.21.15.99:0/3151057208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 msgr2=0x563b6cdc89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff380a00640 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cdaa480 0x563b6cdc9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff381400640 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6cdc89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff381e00640 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6cdc89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff381e00640 1 -- 172.21.15.99:0/3151057208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cdaa480 msgr2=0x563b6cdc9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff381e00640 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cdaa480 0x563b6cdc9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff381e00640 1 -- 172.21.15.99:0/3151057208 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b6cae96b0 con 0x563b6cda7470 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff380a00640 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cdaa480 0x563b6cdc9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff381400640 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6cdc89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff381e00640 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cda7470 0x563b6cdd1e90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff374007dd0 tx=0x7ff374004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5ab4f1c6d13840 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff362000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff362000640 1 -- 172.21.15.99:0/3151057208 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374014d20 con 0x563b6cda7470 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff362000640 1 -- 172.21.15.99:0/3151057208 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7ff37402a480 con 0x563b6cda7470 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.405+0000 7ff386c30740 1 -- 172.21.15.99:0/3151057208 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff37401a070 con 0x563b6cda7470 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff362000640 1 -- 172.21.15.99:0/3151057208 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff374032050 con 0x563b6cda7470 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff386c30740 10 client.5571 fetch_fsmap learned FSMap version 34 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff386c30740 1 -- 172.21.15.99:0/3151057208 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x563b6cdc81e0 con 0x563b6cda7470 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff362000640 1 -- 172.21.15.99:0/3151057208 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37401a070 con 0x563b6cda7470 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff362000640 1 -- 172.21.15.99:0/3151057208 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7ff374035020 con 0x563b6cda7470 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff386c30740 10 client.5571 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff386c30740 10 client.5571 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff386c30740 20 client.5571 populate_metadata read hostname 'smithi099' 2024-09-10T07:36:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff386c30740 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.99:6835/3805850931,v1:172.21.15.99:6837/3805850931] conn(0x563b6cdfd410 0x563b6cda2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff386c30740 4 client.5571 mds_command: new command op to 5466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:36:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff386c30740 1 -- 172.21.15.99:0/3151057208 --> [v2:172.21.15.99:6835/3805850931,v1:172.21.15.99:6837/3805850931] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b6cd19b40 con 0x563b6cdfd410 2024-09-10T07:36:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.406+0000 7ff381400640 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.99:6835/3805850931,v1:172.21.15.99:6837/3805850931] conn(0x563b6cdfd410 0x563b6cda2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.407+0000 7ff381400640 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.99:6835/3805850931,v1:172.21.15.99:6837/3805850931] conn(0x563b6cdfd410 0x563b6cda2bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2130bc318af9bc server_cookie=775c51ccbe8d4ef0 in_seq=0 out_seq=0 2024-09-10T07:36:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.407+0000 7ff362000640 10 client.5571 ms_handle_connect on v2:172.21.15.99:6835/3805850931 2024-09-10T07:36:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff362000640 1 -- 172.21.15.99:0/3151057208 <== mds.0 v2:172.21.15.99:6835/3805850931 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b6cd19b40 con 0x563b6cdfd410 2024-09-10T07:36:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff362000640 10 client.5571 handle_command_reply: tid=0 2024-09-10T07:36:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 client.5571 shutdown 2024-09-10T07:36:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 -- 172.21.15.99:0/3151057208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cda7470 msgr2=0x563b6cdd1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cda7470 0x563b6cdd1e90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff374007dd0 tx=0x7ff374004ab0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 -- 172.21.15.99:0/3151057208 shutdown_connections 2024-09-10T07:36:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.99:6835/3805850931,v1:172.21.15.99:6837/3805850931] conn(0x563b6cdfd410 0x563b6cda2bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cda7470 0x563b6cdd1e90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cdaa480 0x563b6cdc9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 --2- 172.21.15.99:0/3151057208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6cdc89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 -- 172.21.15.99:0/3151057208 >> 172.21.15.99:0/3151057208 conn(0x563b6cda64b0 msgr2=0x563b6cdeb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:33.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff362000640 0 client.5571 ms_handle_reset on v2:172.21.15.99:6835/3805850931 2024-09-10T07:36:33.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 -- 172.21.15.99:0/3151057208 shutdown_connections 2024-09-10T07:36:33.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 1 -- 172.21.15.99:0/3151057208 wait complete. 2024-09-10T07:36:33.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.408+0000 7ff386c30740 20 client.5571 trim_cache size 0 max 16384 2024-09-10T07:36:33.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.427+0000 7ff386c30740 1 Processor -- start 2024-09-10T07:36:33.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.427+0000 7ff386c30740 1 -- start start 2024-09-10T07:36:33.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff386c30740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda7470 0x563b6cdebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff386c30740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6ce11840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff386c30740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6ce11d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff386c30740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c200370 con 0x563b6cdaa480 2024-09-10T07:36:33.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff386c30740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c0ab730 con 0x563b6cda7470 2024-09-10T07:36:33.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff386c30740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff37c0abd80 con 0x563b6cda8cf0 2024-09-10T07:36:33.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff381e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6ce11d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff381e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6ce11d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55446/0 (socket says 172.21.15.99:55446) 2024-09-10T07:36:33.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff381e00640 1 -- 172.21.15.99:0/235336917 learned_addr learned my addr 172.21.15.99:0/235336917 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:33.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff381400640 1 --2- 172.21.15.99:0/235336917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda7470 0x563b6cdebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.428+0000 7ff380a00640 1 --2- 172.21.15.99:0/235336917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6ce11840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.429+0000 7ff381e00640 1 -- 172.21.15.99:0/235336917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 msgr2=0x563b6ce11840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.429+0000 7ff381e00640 1 --2- 172.21.15.99:0/235336917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6ce11840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.429+0000 7ff381e00640 1 -- 172.21.15.99:0/235336917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda7470 msgr2=0x563b6cdebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.429+0000 7ff381e00640 1 --2- 172.21.15.99:0/235336917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda7470 0x563b6cdebbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.429+0000 7ff381e00640 1 -- 172.21.15.99:0/235336917 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b6cda8b20 con 0x563b6cdaa480 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.429+0000 7ff381e00640 1 --2- 172.21.15.99:0/235336917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6ce11d80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff374009f30 tx=0x7ff374021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d99b5463632e07d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.429+0000 7ff36d200640 1 -- 172.21.15.99:0/235336917 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374014d20 con 0x563b6cdaa480 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.429+0000 7ff36d200640 1 -- 172.21.15.99:0/235336917 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37401a040 con 0x563b6cdaa480 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.429+0000 7ff36d200640 1 -- 172.21.15.99:0/235336917 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37402ab80 con 0x563b6cdaa480 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.430+0000 7ff386c30740 1 -- 172.21.15.99:0/235336917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 msgr2=0x563b6ce11d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.430+0000 7ff386c30740 1 --2- 172.21.15.99:0/235336917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6ce11d80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff374009f30 tx=0x7ff374021070 comp rx=0 tx=0).stop 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.430+0000 7ff386c30740 1 -- 172.21.15.99:0/235336917 shutdown_connections 2024-09-10T07:36:33.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.430+0000 7ff386c30740 1 --2- 172.21.15.99:0/235336917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6ce11d80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.430+0000 7ff386c30740 1 --2- 172.21.15.99:0/235336917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6ce11840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.430+0000 7ff386c30740 1 --2- 172.21.15.99:0/235336917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda7470 0x563b6cdebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.430+0000 7ff386c30740 1 -- 172.21.15.99:0/235336917 >> 172.21.15.99:0/235336917 conn(0x563b6cda64b0 msgr2=0x563b6cdc97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.430+0000 7ff386c30740 1 -- 172.21.15.99:0/235336917 shutdown_connections 2024-09-10T07:36:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.430+0000 7ff386c30740 1 -- 172.21.15.99:0/235336917 wait complete. 2024-09-10T07:36:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.431+0000 7ff386c30740 1 -- start start 2024-09-10T07:36:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.431+0000 7ff386c30740 1 Processor -- start 2024-09-10T07:36:33.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff386c30740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda7470 0x563b6ce73d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff386c30740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6cdecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff386c30740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cded520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff386c30740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563b6cdd2940 con 0x563b6cdaa480 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff386c30740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x563b6cdc8520 con 0x563b6cda7470 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff386c30740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x563b6cdfd810 con 0x563b6cda8cf0 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff386c30740 10 client.0 _ll_register_callbacks cb 0x7ff374009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff381e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cded520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff381e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cded520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55450/0 (socket says 172.21.15.99:55450) 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff381e00640 1 -- 172.21.15.99:0/3184632682 learned_addr learned my addr 172.21.15.99:0/3184632682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff381400640 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda7470 0x563b6ce73d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.432+0000 7ff380a00640 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6cdecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff381e00640 1 -- 172.21.15.99:0/3184632682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 msgr2=0x563b6cdecfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff381e00640 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6cdecfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff381e00640 1 -- 172.21.15.99:0/3184632682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda7470 msgr2=0x563b6ce73d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff381e00640 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda7470 0x563b6ce73d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff381e00640 1 -- 172.21.15.99:0/3184632682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b6cdfd240 con 0x563b6cdaa480 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff381e00640 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cded520 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff374007dd0 tx=0x7ff37400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a7007a6185e055 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff362000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff362000640 1 -- 172.21.15.99:0/3184632682 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37402a5c0 con 0x563b6cdaa480 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff362000640 1 -- 172.21.15.99:0/3184632682 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7ff374041ad0 con 0x563b6cdaa480 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff386c30740 1 -- 172.21.15.99:0/3184632682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff37401a040 con 0x563b6cdaa480 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff362000640 1 -- 172.21.15.99:0/3184632682 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff374048050 con 0x563b6cdaa480 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff386c30740 10 client.5577 fetch_fsmap learned FSMap version 34 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.433+0000 7ff386c30740 1 -- 172.21.15.99:0/3184632682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x563b6cdeda60 con 0x563b6cdaa480 2024-09-10T07:36:33.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.434+0000 7ff362000640 1 -- 172.21.15.99:0/3184632682 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37401a040 con 0x563b6cdaa480 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.434+0000 7ff362000640 1 -- 172.21.15.99:0/3184632682 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7ff37404b020 con 0x563b6cdaa480 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.434+0000 7ff386c30740 10 client.5577 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.434+0000 7ff386c30740 10 client.5577 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.434+0000 7ff386c30740 20 client.5577 populate_metadata read hostname 'smithi099' 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.434+0000 7ff386c30740 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.99:6835/3805850931,v1:172.21.15.99:6837/3805850931] conn(0x563b6ce11290 0x563b6ce11670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.434+0000 7ff386c30740 4 client.5577 mds_command: new command op to 5466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.434+0000 7ff386c30740 1 -- 172.21.15.99:0/3184632682 --> [v2:172.21.15.99:6835/3805850931,v1:172.21.15.99:6837/3805850931] -- command(tid 0: {"prefix": "status"}) -- 0x563b6cdaa2d0 con 0x563b6ce11290 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.434+0000 7ff381400640 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.99:6835/3805850931,v1:172.21.15.99:6837/3805850931] conn(0x563b6ce11290 0x563b6ce11670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff381400640 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.99:6835/3805850931,v1:172.21.15.99:6837/3805850931] conn(0x563b6ce11290 0x563b6ce11670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85cb90dd57fb4baa server_cookie=66f122b5a6789acd in_seq=0 out_seq=0 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff362000640 10 client.5577 ms_handle_connect on v2:172.21.15.99:6835/3805850931 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff362000640 1 -- 172.21.15.99:0/3184632682 <== mds.0 v2:172.21.15.99:6835/3805850931 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563b6cdaa2d0 con 0x563b6ce11290 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff362000640 10 client.5577 handle_command_reply: tid=0 2024-09-10T07:36:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 client.5577 shutdown 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 -- 172.21.15.99:0/3184632682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 msgr2=0x563b6cded520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cded520 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff374007dd0 tx=0x7ff37400b040 comp rx=0 tx=0).stop 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 -- 172.21.15.99:0/3184632682 shutdown_connections 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.99:6835/3805850931,v1:172.21.15.99:6837/3805850931] conn(0x563b6ce11290 0x563b6ce11670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b6cdaa480 0x563b6cded520 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x563b6cda8cf0 0x563b6cdecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 --2- 172.21.15.99:0/3184632682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563b6cda7470 0x563b6ce73d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 -- 172.21.15.99:0/3184632682 >> 172.21.15.99:0/3184632682 conn(0x563b6cda64b0 msgr2=0x563b6cdc71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff362000640 0 client.5577 ms_handle_reset on v2:172.21.15.99:6835/3805850931 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 -- 172.21.15.99:0/3184632682 shutdown_connections 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 1 -- 172.21.15.99:0/3184632682 wait complete. 2024-09-10T07:36:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.435+0000 7ff386c30740 20 client.5577 trim_cache size 0 max 16384 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 5466, 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 6.0609211030000001, 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 34, 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 65, 2024-09-10T07:36:33.440 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 65, 2024-09-10T07:36:33.441 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 10.617920653000001 2024-09-10T07:36:33.441 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:36:33.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 -- 172.21.15.99:0/2729799621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff35c06be30 msgr2=0x7ff35c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff35c06be30 0x7ff35c06e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff370000f60 tx=0x7ff370009040 comp rx=0 tx=0).stop 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 -- 172.21.15.99:0/2729799621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0ce070 msgr2=0x7ff37c147e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0ce070 0x7ff37c147e90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff368000c00 tx=0x7ff3680046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 -- 172.21.15.99:0/2729799621 shutdown_connections 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff37c0cf890 0x7ff37c0ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff35c06be30 0x7ff35c06e2f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff37c0ce070 0x7ff37c147e90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 --2- 172.21.15.99:0/2729799621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff37c0b5750 0x7ff37c14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 -- 172.21.15.99:0/2729799621 >> 172.21.15.99:0/2729799621 conn(0x7ff37c0b2630 msgr2=0x7ff37c15f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 -- 172.21.15.99:0/2729799621 shutdown_connections 2024-09-10T07:36:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.436+0000 7ff383e00640 1 -- 172.21.15.99:0/2729799621 wait complete. 2024-09-10T07:36:33.451 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:36:33.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.604+0000 7fe9c5a00640 1 Processor -- start 2024-09-10T07:36:33.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.605+0000 7fe9c5a00640 1 -- start start 2024-09-10T07:36:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.606+0000 7fe9c5a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe9c006eb60 0x7fe9c015c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.606+0000 7fe9c5a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c015d450 con 0x7fe9c0155c80 2024-09-10T07:36:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.606+0000 7fe9c5a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c0156060 con 0x7fe9c015bb80 2024-09-10T07:36:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.606+0000 7fe9c5a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe9c00723d0 con 0x7fe9c006eb60 2024-09-10T07:36:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.606+0000 7fe9bfe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe9c0155c80 0x7fe9c015cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58886/0 (socket says 172.21.15.99:58886) 2024-09-10T07:36:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.606+0000 7fe9bfe00640 1 -- 172.21.15.99:0/2282772503 learned_addr learned my addr 172.21.15.99:0/2282772503 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:33.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.606+0000 7fe9c5000640 1 --2- 172.21.15.99:0/2282772503 >> v2:172.21.15.187:3300/0 conn(0x7fe9c006eb60 0x7fe9c015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.606+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227227223 0 0) 0x7fe9c015d450 con 0x7fe9c0155c80 2024-09-10T07:36:33.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9a4003520 con 0x7fe9c0155c80 2024-09-10T07:36:33.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2593552465 0 0) 0x7fe9a4003520 con 0x7fe9c0155c80 2024-09-10T07:36:33.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 >> v2:172.21.15.187:3300/0 conn(0x7fe9c006eb60 msgr2=0x7fe9c015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 --2- 172.21.15.99:0/2282772503 >> v2:172.21.15.187:3300/0 conn(0x7fe9c006eb60 0x7fe9c015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 >> v1:172.21.15.187:6789/0 conn(0x7fe9c015bb80 legacy=0x7fe9c006e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c015c6f0 con 0x7fe9c0155c80 2024-09-10T07:36:33.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fe9b0001670 con 0x7fe9c0155c80 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 >> v1:172.21.15.99:6789/0 conn(0x7fe9c0155c80 legacy=0x7fe9c015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a4003a30 0x7fe9a4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9a4004800 0x7fe9a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a40051c0 0x7fe9a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00723d0 con 0x7fe9a4004800 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a400c0f0 con 0x7fe9a4003a30 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a400c2f0 con 0x7fe9a40051c0 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bf400640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9a4004800 0x7fe9a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9bfe00640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a4003a30 0x7fe9a4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.607+0000 7fe9c5000640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a40051c0 0x7fe9a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.608+0000 7fe9bf400640 1 -- 172.21.15.99:0/2282772503 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a40051c0 msgr2=0x7fe9a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.608+0000 7fe9bf400640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a40051c0 0x7fe9a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.608+0000 7fe9bf400640 1 -- 172.21.15.99:0/2282772503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a4003a30 msgr2=0x7fe9a4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.608+0000 7fe9bf400640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a4003a30 0x7fe9a4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.608+0000 7fe9bf400640 1 -- 172.21.15.99:0/2282772503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a4003520 con 0x7fe9a4004800 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.608+0000 7fe9c5000640 1 -- 172.21.15.99:0/2282772503 reap_dead start 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.609+0000 7fe9bf400640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9a4004800 0x7fe9a4004c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac001750 tx=0x7fe9a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865321b6de4a7794 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.609+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac001370 con 0x7fe9a4004800 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.609+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0052d0 con 0x7fe9a4004800 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.609+0000 7fe9bea00640 1 -- 172.21.15.99:0/2282772503 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac02abe0 con 0x7fe9a4004800 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.609+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2282772503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9a4004800 msgr2=0x7fe9a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.609+0000 7fe9c5a00640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9a4004800 0x7fe9a4004c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac001750 tx=0x7fe9a4005830 comp rx=0 tx=0).stop 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.609+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2282772503 shutdown_connections 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.609+0000 7fe9c5a00640 1 --2- 172.21.15.99:0/2282772503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9a4004800 0x7fe9a4004c80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.609+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2282772503 >> 172.21.15.99:0/2282772503 conn(0x7fe9c00b2810 msgr2=0x7fe9c00b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.610+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2282772503 shutdown_connections 2024-09-10T07:36:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.610+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2282772503 wait complete. 2024-09-10T07:36:33.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.611+0000 7fe9c5a00640 1 Processor -- start 2024-09-10T07:36:33.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.611+0000 7fe9c5a00640 1 -- start start 2024-09-10T07:36:33.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.612+0000 7fe9c5a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a4004800 0x7fe9c013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.612+0000 7fe9c5a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c0159500 0x7fe9c015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.612+0000 7fe9c5a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9c0159980 0x7fe9c015e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.612+0000 7fe9c5a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0072900 con 0x7fe9c0159500 2024-09-10T07:36:33.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.612+0000 7fe9c5a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0072620 con 0x7fe9a4004800 2024-09-10T07:36:33.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.612+0000 7fe9c5a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c0071ce0 con 0x7fe9c0159980 2024-09-10T07:36:33.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.612+0000 7fe9bf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c0159500 0x7fe9c015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.612+0000 7fe9bf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c0159500 0x7fe9c015dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55464/0 (socket says 172.21.15.99:55464) 2024-09-10T07:36:33.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.612+0000 7fe9bf400640 1 -- 172.21.15.99:0/2348585874 learned_addr learned my addr 172.21.15.99:0/2348585874 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9c5000640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9c0159980 0x7fe9c015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9bfe00640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a4004800 0x7fe9c013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9bf400640 1 -- 172.21.15.99:0/2348585874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9c0159980 msgr2=0x7fe9c015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9bf400640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9c0159980 0x7fe9c015e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9bf400640 1 -- 172.21.15.99:0/2348585874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a4004800 msgr2=0x7fe9c013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9bf400640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a4004800 0x7fe9c013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9bf400640 1 -- 172.21.15.99:0/2348585874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c00b06d0 con 0x7fe9c0159500 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9bf400640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c0159500 0x7fe9c015dd30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac000c00 tx=0x7fe9ac001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9b7e00640 1 -- 172.21.15.99:0/2348585874 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac03f020 con 0x7fe9c0159500 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9b7e00640 1 -- 172.21.15.99:0/2348585874 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ac005480 con 0x7fe9c0159500 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9b7e00640 1 -- 172.21.15.99:0/2348585874 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac001370 con 0x7fe9c0159500 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.613+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2348585874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c00b09b0 con 0x7fe9c0159500 2024-09-10T07:36:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.614+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2348585874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c00b0f70 con 0x7fe9c0159500 2024-09-10T07:36:33.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.614+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2348585874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c015c010 con 0x7fe9c0159500 2024-09-10T07:36:33.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.615+0000 7fe9b7e00640 1 -- 172.21.15.99:0/2348585874 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9ac042020 con 0x7fe9c0159500 2024-09-10T07:36:33.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.616+0000 7fe9b7e00640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9a006be60 0x7fe9a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:33.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.616+0000 7fe9b7e00640 1 -- 172.21.15.99:0/2348585874 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7fe9ac0aa8e0 con 0x7fe9c0159500 2024-09-10T07:36:33.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.616+0000 7fe9bfe00640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9a006be60 0x7fe9a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:33.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.617+0000 7fe9bfe00640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9a006be60 0x7fe9a006e320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0000c00 tx=0x7fe9b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:33.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.620+0000 7fe9b7e00640 1 -- 172.21.15.99:0/2348585874 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9ac049030 con 0x7fe9c0159500 2024-09-10T07:36:33.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.828+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2348585874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe9c013fb10 con 0x7fe9c0159500 2024-09-10T07:36:33.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.828+0000 7fe9b7e00640 1 -- 172.21.15.99:0/2348585874 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7fe9c0156060 con 0x7fe9c0159500 2024-09-10T07:36:33.829 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.830+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2348585874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9a006be60 msgr2=0x7fe9a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.830+0000 7fe9c5a00640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9a006be60 0x7fe9a006e320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0000c00 tx=0x7fe9b0009040 comp rx=0 tx=0).stop 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.830+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2348585874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c0159500 msgr2=0x7fe9c015dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.830+0000 7fe9c5a00640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c0159500 0x7fe9c015dd30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac000c00 tx=0x7fe9ac001120 comp rx=0 tx=0).stop 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.831+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2348585874 shutdown_connections 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.831+0000 7fe9c5a00640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9c0159980 0x7fe9c015e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.831+0000 7fe9c5a00640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe9a006be60 0x7fe9a006e320 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.831+0000 7fe9c5a00640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9c0159500 0x7fe9c015dd30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.831+0000 7fe9c5a00640 1 --2- 172.21.15.99:0/2348585874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a4004800 0x7fe9c013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.831+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2348585874 >> 172.21.15.99:0/2348585874 conn(0x7fe9c00b2810 msgr2=0x7fe9c0152c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.831+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2348585874 shutdown_connections 2024-09-10T07:36:33.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:33.831+0000 7fe9c5a00640 1 -- 172.21.15.99:0/2348585874 wait complete. 2024-09-10T07:36:33.846 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:36:33.846 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:36:33.846 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:36:33.846 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:36:33.846 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:36:33.846 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:36:33.847 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:36:33.847 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:36:33.847 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:36:33.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:33.847 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:36:33.884 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:36:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:36:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:36:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:36:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:33.884 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:36:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:36:33.884 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42634sec preferred_lft 42634sec 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:36:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::1c1f:52ff:fe95:9fbe/64 scope link 2024-09-10T07:36:33.886 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:33.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:33.887 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:36:33.977 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:36:33.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:33.980 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:36:34.017 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:36:34.017 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:36:34.017 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:36:34.017 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:36:34.017 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:36:34.017 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:36:34.018 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:36:34.018 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:36:34.018 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:36:34.018 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:36:34.018 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:36:34.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:36:34.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:36:34.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:34.214 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:36:34.249 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:36:34.249 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:36:34.250 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:36:34.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:34.250 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:36:34.347 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:36:34.347 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:36:34.383 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:36:34.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:36:34.384 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:36:34.459 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:36:34.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:34.460 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:36:34.589 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:36:34.590 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:36:34.617 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:36:34.617 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:36:34.617 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:36:34.617 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:36:34.617 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:36:34.619 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:36:34.619 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:36:34.619 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:36:34.620 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:36:34.620 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:36:34.622 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:36:34.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:34.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:36:34.680 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:36:34.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:36:34.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:36:34.777 INFO:teuthology.orchestra.run.smithi099.stdout:client5464 2024-09-10T07:36:34.777 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:36:34.777 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:34.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:36:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.008+0000 7f0bab400640 1 Processor -- start 2024-09-10T07:36:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.009+0000 7f0bab400640 1 -- start start 2024-09-10T07:36:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.010+0000 7f0bab400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0ba4145290 0x7f0ba406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.010+0000 7f0bab400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba406e3d0 con 0x7f0ba4072f40 2024-09-10T07:36:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.010+0000 7f0bab400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba406e6b0 con 0x7f0ba40ce780 2024-09-10T07:36:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.010+0000 7f0bab400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0ba406efe0 con 0x7f0ba4145290 2024-09-10T07:36:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.010+0000 7f0ba9400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0ba4072f40 0x7f0ba40b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58898/0 (socket says 172.21.15.99:58898) 2024-09-10T07:36:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.010+0000 7f0ba9400640 1 -- 172.21.15.99:0/1372857060 learned_addr learned my addr 172.21.15.99:0/1372857060 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.010+0000 7f0ba8a00640 1 --2- 172.21.15.99:0/1372857060 >> v2:172.21.15.187:3300/0 conn(0x7f0ba4145290 0x7f0ba406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352698718 0 0) 0x7f0ba406e3d0 con 0x7f0ba4072f40 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b88003520 con 0x7f0ba4072f40 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1542811951 0 0) 0x7f0b88003520 con 0x7f0ba4072f40 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 >> v2:172.21.15.187:3300/0 conn(0x7f0ba4145290 msgr2=0x7f0ba406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 --2- 172.21.15.99:0/1372857060 >> v2:172.21.15.187:3300/0 conn(0x7f0ba4145290 0x7f0ba406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 >> v1:172.21.15.187:6789/0 conn(0x7f0ba40ce780 legacy=0x7f0ba4072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba406e990 con 0x7f0ba4072f40 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f0b9c0019f0 con 0x7f0ba4072f40 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 >> v1:172.21.15.99:6789/0 conn(0x7f0ba4072f40 legacy=0x7f0ba40b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0b88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b88004800 0x7f0b88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:35.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b880051c0 0x7f0b8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:35.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba406efe0 con 0x7f0b880039b0 2024-09-10T07:36:35.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8800c060 con 0x7f0b880051c0 2024-09-10T07:36:35.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8800c260 con 0x7f0b88004800 2024-09-10T07:36:35.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba8a00640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0b88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:35.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.011+0000 7f0ba9400640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b880051c0 0x7f0b8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:35.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.012+0000 7f0b9be00640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b88004800 0x7f0b88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:35.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.012+0000 7f0ba8a00640 1 -- 172.21.15.99:0/1372857060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b88004800 msgr2=0x7f0b88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:35.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.012+0000 7f0ba8a00640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b88004800 0x7f0b88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.012+0000 7f0ba8a00640 1 -- 172.21.15.99:0/1372857060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b880051c0 msgr2=0x7f0b8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.012+0000 7f0ba8a00640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b880051c0 0x7f0b8800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.012+0000 7f0ba8a00640 1 -- 172.21.15.99:0/1372857060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b88003520 con 0x7f0b880039b0 2024-09-10T07:36:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.012+0000 7f0ba9400640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b880051c0 0x7f0b8800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:36:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.012+0000 7f0ba9400640 1 -- 172.21.15.99:0/1372857060 reap_dead start 2024-09-10T07:36:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.013+0000 7f0ba8a00640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0b88003dd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0b94009ac0 tx=0x7f0b88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726936ab69654dad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.013+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94036070 con 0x7f0b880039b0 2024-09-10T07:36:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.013+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b94031400 con 0x7f0b880039b0 2024-09-10T07:36:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.013+0000 7f0ba3e00640 1 -- 172.21.15.99:0/1372857060 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94009690 con 0x7f0b880039b0 2024-09-10T07:36:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.013+0000 7f0bab400640 1 -- 172.21.15.99:0/1372857060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 msgr2=0x7f0b88003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:35.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.013+0000 7f0bab400640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0b88003dd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0b94009ac0 tx=0x7f0b88005830 comp rx=0 tx=0).stop 2024-09-10T07:36:35.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.014+0000 7f0bab400640 1 -- 172.21.15.99:0/1372857060 shutdown_connections 2024-09-10T07:36:35.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.014+0000 7f0bab400640 1 --2- 172.21.15.99:0/1372857060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0b88003dd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:35.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.014+0000 7f0bab400640 1 -- 172.21.15.99:0/1372857060 >> 172.21.15.99:0/1372857060 conn(0x7f0ba406bc10 msgr2=0x7f0ba406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:35.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.014+0000 7f0bab400640 1 -- 172.21.15.99:0/1372857060 shutdown_connections 2024-09-10T07:36:35.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.014+0000 7f0bab400640 1 -- 172.21.15.99:0/1372857060 wait complete. 2024-09-10T07:36:35.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.015+0000 7f0bab400640 1 Processor -- start 2024-09-10T07:36:35.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.015+0000 7f0bab400640 1 -- start start 2024-09-10T07:36:35.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.016+0000 7f0bab400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0ba41f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:35.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.016+0000 7f0bab400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ba413db20 0x7f0ba413df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.016+0000 7f0bab400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ba40aa430 0x7f0ba40aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.016+0000 7f0bab400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba406df80 con 0x7f0b880039b0 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.016+0000 7f0bab400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba4145670 con 0x7f0ba40aa430 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.016+0000 7f0bab400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba406e100 con 0x7f0ba413db20 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0ba41f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0ba41f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55480/0 (socket says 172.21.15.99:55480) 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba8a00640 1 -- 172.21.15.99:0/1273399482 learned_addr learned my addr 172.21.15.99:0/1273399482 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba8a00640 1 -- 172.21.15.99:0/1273399482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ba413db20 msgr2=0x7f0ba413df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba9400640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ba40aa430 0x7f0ba40aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba8a00640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ba413db20 0x7f0ba413df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba8a00640 1 -- 172.21.15.99:0/1273399482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ba40aa430 msgr2=0x7f0ba40aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba8a00640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ba40aa430 0x7f0ba40aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba8a00640 1 -- 172.21.15.99:0/1273399482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba41f3770 con 0x7f0b880039b0 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba9400640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ba40aa430 0x7f0ba40aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.017+0000 7f0ba8a00640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0ba41f2ef0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0b94034040 tx=0x7f0b94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.018+0000 7f0ba1600640 1 -- 172.21.15.99:0/1273399482 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9403f020 con 0x7f0b880039b0 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.018+0000 7f0ba1600640 1 -- 172.21.15.99:0/1273399482 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b94037040 con 0x7f0b880039b0 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.018+0000 7f0bab400640 1 -- 172.21.15.99:0/1273399482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba41f3a50 con 0x7f0b880039b0 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.018+0000 7f0ba1600640 1 -- 172.21.15.99:0/1273399482 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94036070 con 0x7f0b880039b0 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.018+0000 7f0bab400640 1 -- 172.21.15.99:0/1273399482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba41f4010 con 0x7f0b880039b0 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.019+0000 7f0bab400640 1 -- 172.21.15.99:0/1273399482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba4071510 con 0x7f0b880039b0 2024-09-10T07:36:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.020+0000 7f0ba1600640 1 -- 172.21.15.99:0/1273399482 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b94042020 con 0x7f0b880039b0 2024-09-10T07:36:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.021+0000 7f0ba1600640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8006be60 0x7f0b8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.021+0000 7f0ba1600640 1 -- 172.21.15.99:0/1273399482 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7f0b940aaee0 con 0x7f0b880039b0 2024-09-10T07:36:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.021+0000 7f0b9be00640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8006be60 0x7f0b8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.022+0000 7f0b9be00640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8006be60 0x7f0b8006e320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c007fd0 tx=0x7f0b8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.025+0000 7f0ba1600640 1 -- 172.21.15.99:0/1273399482 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b94049030 con 0x7f0b880039b0 2024-09-10T07:36:35.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.232+0000 7f0bab400640 1 -- 172.21.15.99:0/1273399482 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0ba415bfa0 con 0x7f0b880039b0 2024-09-10T07:36:35.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.232+0000 7f0ba1600640 1 -- 172.21.15.99:0/1273399482 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7f0b940798b0 con 0x7f0b880039b0 2024-09-10T07:36:35.233 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:36:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 -- 172.21.15.99:0/1273399482 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8006be60 msgr2=0x7f0b8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8006be60 0x7f0b8006e320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c007fd0 tx=0x7f0b8c009040 comp rx=0 tx=0).stop 2024-09-10T07:36:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 -- 172.21.15.99:0/1273399482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 msgr2=0x7f0ba41f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0ba41f2ef0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0b94034040 tx=0x7f0b94004730 comp rx=0 tx=0).stop 2024-09-10T07:36:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 -- 172.21.15.99:0/1273399482 shutdown_connections 2024-09-10T07:36:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ba40aa430 0x7f0ba40aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ba413db20 0x7f0ba413df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b8006be60 0x7f0b8006e320 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:35.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 --2- 172.21.15.99:0/1273399482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b880039b0 0x7f0ba41f2ef0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:35.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 -- 172.21.15.99:0/1273399482 >> 172.21.15.99:0/1273399482 conn(0x7f0ba406bc10 msgr2=0x7f0ba415e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:35.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 -- 172.21.15.99:0/1273399482 shutdown_connections 2024-09-10T07:36:35.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:35.235+0000 7f0bab400640 1 -- 172.21.15.99:0/1273399482 wait complete. 2024-09-10T07:36:35.251 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:36:35.251 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:36:35.251 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:36:35.251 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:36:35.251 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:36:35.251 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:36:35.251 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:36:35.251 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:36:35.252 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:36:35.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:35.252 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:36:35.293 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:36:35.293 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:36:35.293 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:36:35.293 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:35.293 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:36:35.293 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:35.293 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:36:35.293 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:36:35.293 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42629sec preferred_lft 42629sec 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:36:35.294 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::84a0:e5ff:fe75:1d2e/64 scope link 2024-09-10T07:36:35.295 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:36:35.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:35.296 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:36:35.393 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:36:35.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:35.396 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:36:35.435 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:36:35.435 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:36:35.435 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:36:35.435 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:36:35.435 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:36:35.435 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:36:35.436 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:36:35.436 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:36:35.436 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:36:35.436 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:36:35.436 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:36:35.555 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:36:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:36:35.625 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:36:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:36:35.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:35.633 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:36:35.668 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:36:35.669 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:36:35.669 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:36:35.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:35.669 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:36:35.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:36:35.767 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:36:35.802 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:36:35.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:36:35.803 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:36:35.877 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:36:35.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:35.878 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:36:36.005 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:36:36.006 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:36:36.032 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:36:36.032 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:36:36.032 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:36:36.032 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:36:36.032 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:36:36.033 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:36:36.034 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:36:36.034 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:36:36.034 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:36:36.034 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:36:36.036 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:36:36.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:36:36.037 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:36:36.092 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:36:36.170 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:36:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:36:36.173 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:36:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:36:36.180 INFO:teuthology.orchestra.run.smithi187.stdout:client5473 2024-09-10T07:36:36.181 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:36:36.181 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:36:36.217 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:36:36.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.380+0000 7f66fca00640 1 Processor -- start 2024-09-10T07:36:36.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.380+0000 7f66fca00640 1 -- start start 2024-09-10T07:36:36.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.381+0000 7f66fca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f66f8145290 0x7f66f806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:36.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.381+0000 7f66fca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f806e3d0 con 0x7f66f8072f40 2024-09-10T07:36:36.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.381+0000 7f66fca00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f806e6b0 con 0x7f66f80ce780 2024-09-10T07:36:36.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.381+0000 7f66fca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f66f806efe0 con 0x7f66f8145290 2024-09-10T07:36:36.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.381+0000 7f66f5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f66f8145290 0x7f66f806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:36.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.381+0000 7f66f6800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f66f8072f40 0x7f66f80b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58912/0 (socket says 172.21.15.99:58912) 2024-09-10T07:36:36.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.381+0000 7f66f6800640 1 -- 172.21.15.99:0/2223837074 learned_addr learned my addr 172.21.15.99:0/2223837074 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:36:36.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.382+0000 7f66f5e00640 1 -- 172.21.15.99:0/2223837074 >> v1:172.21.15.187:6789/0 conn(0x7f66f80ce780 legacy=0x7f66f8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:36:36.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.382+0000 7f66f5e00640 1 -- 172.21.15.99:0/2223837074 >> v1:172.21.15.99:6789/0 conn(0x7f66f8072f40 legacy=0x7f66f80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:36.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.382+0000 7f66f5e00640 1 -- 172.21.15.99:0/2223837074 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f806e990 con 0x7f66f8145290 2024-09-10T07:36:36.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.382+0000 7f66f5400640 1 -- 172.21.15.99:0/2223837074 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4250792307 0 0) 0x7f66f806e3d0 con 0x7f66f8072f40 2024-09-10T07:36:36.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.383+0000 7f66f5e00640 1 --2- 172.21.15.99:0/2223837074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8145290 0x7f66f806f470 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f66e80097a0 tx=0x7f66e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227823cd710ded9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:36.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.383+0000 7f66f5400640 1 -- 172.21.15.99:0/2223837074 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8037070 con 0x7f66f8145290 2024-09-10T07:36:36.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.383+0000 7f66f5400640 1 -- 172.21.15.99:0/2223837074 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e8032440 con 0x7f66f8145290 2024-09-10T07:36:36.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.383+0000 7f66f5400640 1 -- 172.21.15.99:0/2223837074 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8032810 con 0x7f66f8145290 2024-09-10T07:36:36.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.384+0000 7f66fca00640 1 -- 172.21.15.99:0/2223837074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8145290 msgr2=0x7f66f806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:36.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.384+0000 7f66fca00640 1 --2- 172.21.15.99:0/2223837074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8145290 0x7f66f806f470 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f66e80097a0 tx=0x7f66e802a1e0 comp rx=0 tx=0).stop 2024-09-10T07:36:36.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.384+0000 7f66fca00640 1 -- 172.21.15.99:0/2223837074 shutdown_connections 2024-09-10T07:36:36.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.384+0000 7f66fca00640 1 --2- 172.21.15.99:0/2223837074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8145290 0x7f66f806f470 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:36.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.384+0000 7f66fca00640 1 -- 172.21.15.99:0/2223837074 >> 172.21.15.99:0/2223837074 conn(0x7f66f806bc10 msgr2=0x7f66f806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:36.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.384+0000 7f66fca00640 1 -- 172.21.15.99:0/2223837074 shutdown_connections 2024-09-10T07:36:36.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.384+0000 7f66fca00640 1 -- 172.21.15.99:0/2223837074 wait complete. 2024-09-10T07:36:36.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.386+0000 7f66fca00640 1 Processor -- start 2024-09-10T07:36:36.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.386+0000 7f66fca00640 1 -- start start 2024-09-10T07:36:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66fca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8072f40 0x7f66f80af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66fca00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66f80ce780 0x7f66f815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66fca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66f8145290 0x7f66f81f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66fca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f66f806df80 con 0x7f66f8072f40 2024-09-10T07:36:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66fca00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f66f8145670 con 0x7f66f8145290 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66fca00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f66f806e100 con 0x7f66f80ce780 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8072f40 0x7f66f80af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8072f40 0x7f66f80af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55488/0 (socket says 172.21.15.99:55488) 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66f5e00640 1 -- 172.21.15.99:0/2474727955 learned_addr learned my addr 172.21.15.99:0/2474727955 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66f6800640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66f8145290 0x7f66f81f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66ed400640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66f80ce780 0x7f66f815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66f5e00640 1 -- 172.21.15.99:0/2474727955 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66f80ce780 msgr2=0x7f66f815b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66f5e00640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66f80ce780 0x7f66f815b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66f5e00640 1 -- 172.21.15.99:0/2474727955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66f8145290 msgr2=0x7f66f81f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66f5e00640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66f8145290 0x7f66f81f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.387+0000 7f66f5e00640 1 -- 172.21.15.99:0/2474727955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f81427d0 con 0x7f66f8072f40 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.388+0000 7f66f5e00640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8072f40 0x7f66f80af220 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f66e80098c0 tx=0x7f66e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.388+0000 7f66eea00640 1 -- 172.21.15.99:0/2474727955 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8041070 con 0x7f66f8072f40 2024-09-10T07:36:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.388+0000 7f66eea00640 1 -- 172.21.15.99:0/2474727955 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e803c870 con 0x7f66f8072f40 2024-09-10T07:36:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.388+0000 7f66fca00640 1 -- 172.21.15.99:0/2474727955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f813e5e0 con 0x7f66f8072f40 2024-09-10T07:36:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.388+0000 7f66eea00640 1 -- 172.21.15.99:0/2474727955 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8037040 con 0x7f66f8072f40 2024-09-10T07:36:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.388+0000 7f66fca00640 1 -- 172.21.15.99:0/2474727955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f80afdf0 con 0x7f66f8072f40 2024-09-10T07:36:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.389+0000 7f66fca00640 1 -- 172.21.15.99:0/2474727955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f8071510 con 0x7f66f8072f40 2024-09-10T07:36:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.390+0000 7f66eea00640 1 -- 172.21.15.99:0/2474727955 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66e8044070 con 0x7f66f8072f40 2024-09-10T07:36:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.391+0000 7f66eea00640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f66d406be30 0x7f66d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:36:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.391+0000 7f66eea00640 1 -- 172.21.15.99:0/2474727955 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7f66e80abcd0 con 0x7f66f8072f40 2024-09-10T07:36:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.391+0000 7f66ed400640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f66d406be30 0x7f66d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:36:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.391+0000 7f66ed400640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f66d406be30 0x7f66d406e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f66f80af760 tx=0x7f66e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:36:36.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.395+0000 7f66eea00640 1 -- 172.21.15.99:0/2474727955 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66e807a7a0 con 0x7f66f8072f40 2024-09-10T07:36:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.599+0000 7f66fca00640 1 -- 172.21.15.99:0/2474727955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66f80ce160 con 0x7f66f8072f40 2024-09-10T07:36:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.600+0000 7f66eea00640 1 -- 172.21.15.99:0/2474727955 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5229 (secure 0 0 0) 0x7f66e807a0a0 con 0x7f66f8072f40 2024-09-10T07:36:36.601 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:36:36.601 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":34,"btime":"2024-09-10T07:36:30:406568+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/2770940747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2770940747},{"type":"v1","addr":"172.21.15.187:6834","nonce":2770940747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":4997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/1207587759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1207587759},{"type":"v1","addr":"172.21.15.99:6836","nonce":1207587759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5463,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3753955373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3753955373},{"type":"v1","addr":"172.21.15.187:6835","nonce":3753955373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:36:26.770809+0000","modified":"2024-09-10T07:36:29.817237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5466":{"gid":5466,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3805850931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3805850931},{"type":"v1","addr":"172.21.15.99:6837","nonce":3805850931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5466,"qdb_cluster":[5466]},"id":4}]} 2024-09-10T07:36:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 34 2024-09-10T07:36:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 -- 172.21.15.99:0/2474727955 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f66d406be30 msgr2=0x7f66d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f66d406be30 0x7f66d406e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f66f80af760 tx=0x7f66e0009040 comp rx=0 tx=0).stop 2024-09-10T07:36:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 -- 172.21.15.99:0/2474727955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8072f40 msgr2=0x7f66f80af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:36:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8072f40 0x7f66f80af220 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f66e80098c0 tx=0x7f66e80046c0 comp rx=0 tx=0).stop 2024-09-10T07:36:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 -- 172.21.15.99:0/2474727955 shutdown_connections 2024-09-10T07:36:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66f8145290 0x7f66f81f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66f80ce780 0x7f66f815b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f66d406be30 0x7f66d406e2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 --2- 172.21.15.99:0/2474727955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f8072f40 0x7f66f80af220 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:36:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 -- 172.21.15.99:0/2474727955 >> 172.21.15.99:0/2474727955 conn(0x7f66f806bc10 msgr2=0x7f66f8072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:36:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 -- 172.21.15.99:0/2474727955 shutdown_connections 2024-09-10T07:36:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:36:36.602+0000 7f66fca00640 1 -- 172.21.15.99:0/2474727955 wait complete. 2024-09-10T07:36:36.619 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:36:36.793 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":5466,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.4073851449999992,"mdsmap_epoch":34,"osdmap_epoch":65,"osdmap_epoch_barrier":65,"uptime":13.964386418} 2024-09-10T07:36:36.794 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 5466, "mdsmap_epoch": 34, "osdmap_epoch": 65, "osdmap_epoch_barrier": 65, "rank_uptime": 9.407385145, "state": "up:active", "uptime": 13.964386418, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:36:36.794 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-10T07:36:36.964 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_mon_report_interval":"5"} 2024-09-10T07:36:36.964 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-10T07:36:36.965 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-10T07:36:37.127 INFO:teuthology.orchestra.run.smithi099.stdout:{"mon_tick_interval":"5"} 2024-09-10T07:36:37.128 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-10T07:36:37.128 INFO:tasks.cephfs.test_full:pool capacity 557102656, 531MB should be enough to fill it 2024-09-10T07:36:37.128 DEBUG:teuthology.orchestra.run.smithi099:> stdin-killer -- python3 -c ' 2024-09-10T07:36:37.128 DEBUG:teuthology.orchestra.run.smithi099:> import time 2024-09-10T07:36:37.128 DEBUG:teuthology.orchestra.run.smithi099:> import datetime 2024-09-10T07:36:37.128 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-09-10T07:36:37.128 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-10T07:36:37.128 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:36:37.128 DEBUG:teuthology.orchestra.run.smithi099:> # Write some buffered data through before going full, all should be well 2024-09-10T07:36:37.128 DEBUG:teuthology.orchestra.run.smithi099:> print("writing some data through which we expect to succeed") 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> bytes = 0 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(f) 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> # buffered IO, the error should always only appear from fsync and not 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> # from write 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> full = False 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> for n in range(0, int(531 * 0.9)): 2024-09-10T07:36:37.129 DEBUG:teuthology.orchestra.run.smithi099:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> print("done writing {0} bytes".format(bytes)) 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> # OK, now we should sneak in under the full condition 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> # due to the time it takes the OSDs to report to the 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> # mons, and get a successful fsync on our full-making data 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(f) 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> # buffered write, add more dirty data to the buffer 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> print("starting buffered write") 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> try: 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> for n in range(0, int(531 * 0.2)): 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-10T07:36:37.130 DEBUG:teuthology.orchestra.run.smithi099:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> time.sleep(15.0) 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> except OSError: 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> pass; 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> # Wait long enough for a background flush that should fail 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> time.sleep(30) 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> if False: 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> # ...and check that the failed background flush is reflected in fclose 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> try: 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> os.close(f) 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> except OSError: 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> print("close() returned an error as expected") 2024-09-10T07:36:37.131 DEBUG:teuthology.orchestra.run.smithi099:> else: 2024-09-10T07:36:37.132 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("close() failed to raise error") 2024-09-10T07:36:37.132 DEBUG:teuthology.orchestra.run.smithi099:> else: 2024-09-10T07:36:37.132 DEBUG:teuthology.orchestra.run.smithi099:> # The kernel cephfs client does not raise errors on fclose 2024-09-10T07:36:37.132 DEBUG:teuthology.orchestra.run.smithi099:> os.close(f) 2024-09-10T07:36:37.132 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:36:37.132 DEBUG:teuthology.orchestra.run.smithi099:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-10T07:36:37.132 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-10T07:36:37.987 INFO:teuthology.orchestra.run.smithi099.stdout:writing some data through which we expect to succeed 2024-09-10T07:36:37.987 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-10T07:36:37.988 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-10T07:36:37.988 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-10T07:36:37.988 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-10T07:36:37.988 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-10T07:36:37.988 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-10T07:36:37.988 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-10T07:36:37.988 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-10T07:36:37.988 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-10T07:36:37.988 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-10T07:36:37.988 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-10T07:36:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 30932992 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 31981568 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 33030144 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 34078720 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 35127296 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 36175872 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 37224448 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 38273024 bytes via buffered write, may repeat 2024-09-10T07:36:37.990 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 39321600 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 40370176 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 41418752 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 42467328 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 43515904 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 44564480 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 45613056 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 46661632 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 47710208 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 48758784 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 49807360 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 50855936 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 51904512 bytes via buffered write, may repeat 2024-09-10T07:36:37.991 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 52953088 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 54001664 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 55050240 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 56098816 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 57147392 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 58195968 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 59244544 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 60293120 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 61341696 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 62390272 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 63438848 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 64487424 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 65536000 bytes via buffered write, may repeat 2024-09-10T07:36:37.992 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 66584576 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 67633152 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 68681728 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 69730304 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 70778880 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 71827456 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 72876032 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 73924608 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 74973184 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 76021760 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 77070336 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 78118912 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 79167488 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 80216064 bytes via buffered write, may repeat 2024-09-10T07:36:37.993 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 81264640 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 82313216 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 83361792 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 84410368 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 85458944 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 86507520 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 87556096 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 88604672 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 89653248 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 90701824 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 91750400 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 92798976 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 93847552 bytes via buffered write, may repeat 2024-09-10T07:36:37.994 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 94896128 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 95944704 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 96993280 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 98041856 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 99090432 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 100139008 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 101187584 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 102236160 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 103284736 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 104333312 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 105381888 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 106430464 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 107479040 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 108527616 bytes via buffered write, may repeat 2024-09-10T07:36:37.995 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 109576192 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 110624768 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 111673344 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 112721920 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 113770496 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 114819072 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 115867648 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 116916224 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 117964800 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 119013376 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 120061952 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 121110528 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 122159104 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 123207680 bytes via buffered write, may repeat 2024-09-10T07:36:37.996 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 124256256 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 125304832 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 126353408 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 127401984 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 128450560 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 129499136 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 130547712 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 131596288 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 132644864 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 133693440 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 134742016 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 135790592 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 136839168 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 137887744 bytes via buffered write, may repeat 2024-09-10T07:36:37.997 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 138936320 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 139984896 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 141033472 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 142082048 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 143130624 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 144179200 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 145227776 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 146276352 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 147324928 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 148373504 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 149422080 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 150470656 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 151519232 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 152567808 bytes via buffered write, may repeat 2024-09-10T07:36:37.998 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 153616384 bytes via buffered write, may repeat 2024-09-10T07:36:37.999 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 154664960 bytes via buffered write, may repeat 2024-09-10T07:36:37.999 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 155713536 bytes via buffered write, may repeat 2024-09-10T07:36:37.999 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 156762112 bytes via buffered write, may repeat 2024-09-10T07:36:37.999 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 157810688 bytes via buffered write, may repeat 2024-09-10T07:36:37.999 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 158859264 bytes via buffered write, may repeat 2024-09-10T07:36:37.999 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 159907840 bytes via buffered write, may repeat 2024-09-10T07:36:37.999 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 160956416 bytes via buffered write, may repeat 2024-09-10T07:36:37.999 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 162004992 bytes via buffered write, may repeat 2024-09-10T07:36:38.134 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 163053568 bytes via buffered write, may repeat 2024-09-10T07:36:38.134 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 164102144 bytes via buffered write, may repeat 2024-09-10T07:36:38.134 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 165150720 bytes via buffered write, may repeat 2024-09-10T07:36:38.134 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 166199296 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 167247872 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 168296448 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 169345024 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 170393600 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 171442176 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 172490752 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 173539328 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 174587904 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 175636480 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 176685056 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 177733632 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 178782208 bytes via buffered write, may repeat 2024-09-10T07:36:38.135 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 179830784 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 180879360 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 181927936 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 182976512 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 184025088 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 185073664 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 186122240 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 187170816 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 188219392 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 189267968 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 190316544 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 191365120 bytes via buffered write, may repeat 2024-09-10T07:36:38.136 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 192413696 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 193462272 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 194510848 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 195559424 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 196608000 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 197656576 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 198705152 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 199753728 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 200802304 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 201850880 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 202899456 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 203948032 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 204996608 bytes via buffered write, may repeat 2024-09-10T07:36:38.137 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 206045184 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 207093760 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 208142336 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 209190912 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 210239488 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 211288064 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 212336640 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 213385216 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 214433792 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 215482368 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 216530944 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 217579520 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 218628096 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 219676672 bytes via buffered write, may repeat 2024-09-10T07:36:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 220725248 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 221773824 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 222822400 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 223870976 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 224919552 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 225968128 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 227016704 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 228065280 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 229113856 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 230162432 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 231211008 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 232259584 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 233308160 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 234356736 bytes via buffered write, may repeat 2024-09-10T07:36:38.139 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 235405312 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 236453888 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 237502464 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 238551040 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 239599616 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 240648192 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 241696768 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 242745344 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 243793920 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 244842496 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 245891072 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 246939648 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 247988224 bytes via buffered write, may repeat 2024-09-10T07:36:38.140 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 249036800 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 250085376 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 251133952 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 252182528 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 253231104 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 254279680 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 255328256 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 256376832 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 257425408 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 258473984 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 259522560 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 260571136 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 261619712 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 262668288 bytes via buffered write, may repeat 2024-09-10T07:36:38.141 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 263716864 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 264765440 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 265814016 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 266862592 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 267911168 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 268959744 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 270008320 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 271056896 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 272105472 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 273154048 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 274202624 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 275251200 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 276299776 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 277348352 bytes via buffered write, may repeat 2024-09-10T07:36:38.142 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 278396928 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 279445504 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 280494080 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 281542656 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 282591232 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 283639808 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 284688384 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 285736960 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 286785536 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 287834112 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 288882688 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 289931264 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 290979840 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 292028416 bytes via buffered write, may repeat 2024-09-10T07:36:38.143 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 293076992 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 294125568 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 295174144 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 296222720 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 297271296 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 298319872 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 299368448 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 300417024 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 301465600 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 302514176 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 303562752 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 304611328 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 305659904 bytes via buffered write, may repeat 2024-09-10T07:36:38.144 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 306708480 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 307757056 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 308805632 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 309854208 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 310902784 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 311951360 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 312999936 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 314048512 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 315097088 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 316145664 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 317194240 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 318242816 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 319291392 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 320339968 bytes via buffered write, may repeat 2024-09-10T07:36:38.145 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 321388544 bytes via buffered write, may repeat 2024-09-10T07:36:38.146 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 322437120 bytes via buffered write, may repeat 2024-09-10T07:36:38.146 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 323485696 bytes via buffered write, may repeat 2024-09-10T07:36:38.282 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 324534272 bytes via buffered write, may repeat 2024-09-10T07:36:38.282 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 325582848 bytes via buffered write, may repeat 2024-09-10T07:36:38.282 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 326631424 bytes via buffered write, may repeat 2024-09-10T07:36:38.282 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 327680000 bytes via buffered write, may repeat 2024-09-10T07:36:38.282 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 328728576 bytes via buffered write, may repeat 2024-09-10T07:36:38.282 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 329777152 bytes via buffered write, may repeat 2024-09-10T07:36:38.282 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 330825728 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 331874304 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 332922880 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 333971456 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 335020032 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 336068608 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 337117184 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 338165760 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 339214336 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 340262912 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 341311488 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 342360064 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 343408640 bytes via buffered write, may repeat 2024-09-10T07:36:38.283 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 344457216 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 345505792 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 346554368 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 347602944 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 348651520 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 349700096 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 350748672 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 351797248 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 352845824 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 353894400 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 354942976 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 355991552 bytes via buffered write, may repeat 2024-09-10T07:36:38.284 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 357040128 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 358088704 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 359137280 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 360185856 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 361234432 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 362283008 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 363331584 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 364380160 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 365428736 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 366477312 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 367525888 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 368574464 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 369623040 bytes via buffered write, may repeat 2024-09-10T07:36:38.285 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 370671616 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 371720192 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 372768768 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 373817344 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 374865920 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 375914496 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 376963072 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 378011648 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 379060224 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 380108800 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 381157376 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 382205952 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 383254528 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 384303104 bytes via buffered write, may repeat 2024-09-10T07:36:38.286 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 385351680 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 386400256 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 387448832 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 388497408 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 389545984 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 390594560 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 391643136 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 392691712 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 393740288 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 394788864 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 395837440 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 396886016 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 397934592 bytes via buffered write, may repeat 2024-09-10T07:36:38.287 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 398983168 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 400031744 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 401080320 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 402128896 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 403177472 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 404226048 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 405274624 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 406323200 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 407371776 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 408420352 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 409468928 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 410517504 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 411566080 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 412614656 bytes via buffered write, may repeat 2024-09-10T07:36:38.288 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 413663232 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 414711808 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 415760384 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 416808960 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 417857536 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 418906112 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 419954688 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 421003264 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 422051840 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 423100416 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 424148992 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 425197568 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 426246144 bytes via buffered write, may repeat 2024-09-10T07:36:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 427294720 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 428343296 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 429391872 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 430440448 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 431489024 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 432537600 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 433586176 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 434634752 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 435683328 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 436731904 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 437780480 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 438829056 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 439877632 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 440926208 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 441974784 bytes via buffered write, may repeat 2024-09-10T07:36:38.290 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 443023360 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 444071936 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 445120512 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 446169088 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 447217664 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 448266240 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 449314816 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 450363392 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 451411968 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 452460544 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 453509120 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 454557696 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 455606272 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 456654848 bytes via buffered write, may repeat 2024-09-10T07:36:38.291 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 457703424 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 458752000 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 459800576 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 460849152 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 461897728 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 462946304 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 463994880 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 465043456 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 466092032 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 467140608 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 468189184 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 469237760 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 470286336 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 471334912 bytes via buffered write, may repeat 2024-09-10T07:36:38.292 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 472383488 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 473432064 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 474480640 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 475529216 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 476577792 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 477626368 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 478674944 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 479723520 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 480772096 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 481820672 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 482869248 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 483917824 bytes via buffered write, may repeat 2024-09-10T07:36:38.293 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 484966400 bytes via buffered write, may repeat 2024-09-10T07:36:40.773 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:36:40.773+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-10T07:36:46.511 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:36:46.516 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:36:46.713 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:36:46.713+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-10T07:37:16.613 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:37:16.619 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:37:39.673 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 486014976 bytes via buffered write, may repeat 2024-09-10T07:37:39.673 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 487063552 bytes via buffered write, may repeat 2024-09-10T07:37:39.673 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 488112128 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 489160704 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 490209280 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 491257856 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 492306432 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 493355008 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 494403584 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 495452160 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 496500736 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 497549312 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 498597888 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 499646464 bytes via buffered write, may repeat 2024-09-10T07:37:39.674 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 500695040 bytes via buffered write, may repeat 2024-09-10T07:37:39.675 INFO:teuthology.orchestra.run.smithi099.stdout:done writing 500695040 bytes 2024-09-10T07:37:39.675 INFO:teuthology.orchestra.run.smithi099.stdout:successfully fsync'ed prior to getting full state reported 2024-09-10T07:37:39.675 INFO:teuthology.orchestra.run.smithi099.stdout:starting buffered write 2024-09-10T07:37:39.675 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:37:39.675 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:37:39.675 INFO:teuthology.orchestra.run.smithi099.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-10T07:37:39.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:37:39.687 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:37:39.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:37:39.794 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:37:39.893 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:37:39.894 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:37:39.894 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:37:39.894 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:37:39.930 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:37:39.930 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:37:40.006 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:37:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.201+0000 7f2827200640 1 Processor -- start 2024-09-10T07:37:40.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.201+0000 7f2827200640 1 -- start start 2024-09-10T07:37:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.202+0000 7f2827200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200b4fe0 0x7f282015c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.202+0000 7f2827200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f28200ce170 0x7f28200b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.202+0000 7f2827200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28200730f0 con 0x7f2820072190 2024-09-10T07:37:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.202+0000 7f2827200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f282015c660 con 0x7f28200ce170 2024-09-10T07:37:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.202+0000 7f2827200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f28200b5900 con 0x7f28200b4fe0 2024-09-10T07:37:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.202+0000 7f2817400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f28200ce170 0x7f28200b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.202+0000 7f2825200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2820072190 0x7f28200ce780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43280/0 (socket says 172.21.15.99:43280) 2024-09-10T07:37:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.202+0000 7f2825200640 1 -- 172.21.15.99:0/3683713075 learned_addr learned my addr 172.21.15.99:0/3683713075 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.202+0000 7f281fe00640 1 --2- 172.21.15.99:0/3683713075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200b4fe0 0x7f282015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.203+0000 7f2817400640 1 -- 172.21.15.99:0/3683713075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200b4fe0 msgr2=0x7f282015c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.203+0000 7f2817400640 1 --2- 172.21.15.99:0/3683713075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200b4fe0 0x7f282015c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.203+0000 7f2817400640 1 -- 172.21.15.99:0/3683713075 >> v1:172.21.15.99:6789/0 conn(0x7f2820072190 legacy=0x7f28200ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.203+0000 7f2817400640 1 -- 172.21.15.99:0/3683713075 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2820073390 con 0x7f28200ce170 2024-09-10T07:37:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.203+0000 7f281f400640 1 -- 172.21.15.99:0/3683713075 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032988042 0 0) 0x7f28200730f0 con 0x7f2820072190 2024-09-10T07:37:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.204+0000 7f2817400640 1 --2- 172.21.15.99:0/3683713075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200ce170 0x7f28200b53c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f28080097a0 tx=0x7f280802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2470a66c2dba07e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.204+0000 7f281f400640 1 -- 172.21.15.99:0/3683713075 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808037070 con 0x7f28200ce170 2024-09-10T07:37:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.204+0000 7f281f400640 1 -- 172.21.15.99:0/3683713075 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2808032440 con 0x7f28200ce170 2024-09-10T07:37:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.204+0000 7f281f400640 1 -- 172.21.15.99:0/3683713075 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808032810 con 0x7f28200ce170 2024-09-10T07:37:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.204+0000 7f2827200640 1 -- 172.21.15.99:0/3683713075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200ce170 msgr2=0x7f28200b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.204+0000 7f2827200640 1 --2- 172.21.15.99:0/3683713075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200ce170 0x7f28200b53c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f28080097a0 tx=0x7f280802a180 comp rx=0 tx=0).stop 2024-09-10T07:37:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.205+0000 7f2827200640 1 -- 172.21.15.99:0/3683713075 shutdown_connections 2024-09-10T07:37:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.205+0000 7f2827200640 1 --2- 172.21.15.99:0/3683713075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200ce170 0x7f28200b53c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.205+0000 7f2827200640 1 --2- 172.21.15.99:0/3683713075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200b4fe0 0x7f282015c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.205+0000 7f2827200640 1 -- 172.21.15.99:0/3683713075 >> 172.21.15.99:0/3683713075 conn(0x7f28200b2630 msgr2=0x7f28200b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.205+0000 7f2827200640 1 -- 172.21.15.99:0/3683713075 shutdown_connections 2024-09-10T07:37:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.205+0000 7f2827200640 1 -- 172.21.15.99:0/3683713075 wait complete. 2024-09-10T07:37:40.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.206+0000 7f2827200640 1 Processor -- start 2024-09-10T07:37:40.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.206+0000 7f2827200640 1 -- start start 2024-09-10T07:37:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.207+0000 7f2827200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2820072190 0x7f2820169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.207+0000 7f2827200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200b4fe0 0x7f2820168e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.207+0000 7f2827200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200ce170 0x7f2820140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.207+0000 7f2827200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2820071c70 con 0x7f28200b4fe0 2024-09-10T07:37:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.207+0000 7f2827200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2820071990 con 0x7f2820072190 2024-09-10T07:37:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.207+0000 7f2827200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f28200cee90 con 0x7f28200ce170 2024-09-10T07:37:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.207+0000 7f2817400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200b4fe0 0x7f2820168e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.207+0000 7f2817400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200b4fe0 0x7f2820168e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56360/0 (socket says 172.21.15.99:56360) 2024-09-10T07:37:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.207+0000 7f2817400640 1 -- 172.21.15.99:0/3840850126 learned_addr learned my addr 172.21.15.99:0/3840850126 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f281fe00640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2820072190 0x7f2820169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f2825200640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200ce170 0x7f2820140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f2817400640 1 -- 172.21.15.99:0/3840850126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200ce170 msgr2=0x7f2820140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f2817400640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200ce170 0x7f2820140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f2817400640 1 -- 172.21.15.99:0/3840850126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2820072190 msgr2=0x7f2820169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f2817400640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2820072190 0x7f2820169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f2817400640 1 -- 172.21.15.99:0/3840850126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28201695b0 con 0x7f28200b4fe0 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f281fe00640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2820072190 0x7f2820169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f2825200640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200ce170 0x7f2820140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f2817400640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200b4fe0 0x7f2820168e80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f28080097a0 tx=0x7f28080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f281cc00640 1 -- 172.21.15.99:0/3840850126 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808037050 con 0x7f28200b4fe0 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.208+0000 7f281cc00640 1 -- 172.21.15.99:0/3840850126 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2808038040 con 0x7f28200b4fe0 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.209+0000 7f281cc00640 1 -- 172.21.15.99:0/3840850126 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808004490 con 0x7f28200b4fe0 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.209+0000 7f2827200640 1 -- 172.21.15.99:0/3840850126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2820144270 con 0x7f28200b4fe0 2024-09-10T07:37:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.209+0000 7f2827200640 1 -- 172.21.15.99:0/3840850126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2820144830 con 0x7f28200b4fe0 2024-09-10T07:37:40.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.210+0000 7f2827200640 1 -- 172.21.15.99:0/3840850126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28200b3c80 con 0x7f28200b4fe0 2024-09-10T07:37:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.210+0000 7f281cc00640 1 -- 172.21.15.99:0/3840850126 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f280803c6d0 con 0x7f28200b4fe0 2024-09-10T07:37:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.211+0000 7f281cc00640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27fc06be30 0x7f27fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.211+0000 7f281cc00640 1 -- 172.21.15.99:0/3840850126 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f28080ab920 con 0x7f28200b4fe0 2024-09-10T07:37:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.212+0000 7f281fe00640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27fc06be30 0x7f27fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.212+0000 7f281cc00640 1 -- 172.21.15.99:0/3840850126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=70}) -- 0x7f27fc073960 con 0x7f28200b4fe0 2024-09-10T07:37:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.212+0000 7f281fe00640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27fc06be30 0x7f27fc06e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2810009ac0 tx=0x7f2810008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.216+0000 7f281cc00640 1 -- 172.21.15.99:0/3840850126 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f28200b3c80 con 0x7f28200b4fe0 2024-09-10T07:37:40.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.399+0000 7f2827200640 1 -- 172.21.15.99:0/3840850126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f28200d0670 con 0x7f28200b4fe0 2024-09-10T07:37:40.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.399+0000 7f281cc00640 1 -- 172.21.15.99:0/3840850126 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7f28200d0670 con 0x7f28200b4fe0 2024-09-10T07:37:40.400 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:37:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 -- 172.21.15.99:0/3840850126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27fc06be30 msgr2=0x7f27fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27fc06be30 0x7f27fc06e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2810009ac0 tx=0x7f2810008040 comp rx=0 tx=0).stop 2024-09-10T07:37:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 -- 172.21.15.99:0/3840850126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200b4fe0 msgr2=0x7f2820168e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200b4fe0 0x7f2820168e80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f28080097a0 tx=0x7f28080046c0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 -- 172.21.15.99:0/3840850126 shutdown_connections 2024-09-10T07:37:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28200ce170 0x7f2820140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27fc06be30 0x7f27fc06e2f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28200b4fe0 0x7f2820168e80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 --2- 172.21.15.99:0/3840850126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2820072190 0x7f2820169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 -- 172.21.15.99:0/3840850126 >> 172.21.15.99:0/3840850126 conn(0x7f28200b2630 msgr2=0x7f28200ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:40.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 -- 172.21.15.99:0/3840850126 shutdown_connections 2024-09-10T07:37:40.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.402+0000 7f2827200640 1 -- 172.21.15.99:0/3840850126 wait complete. 2024-09-10T07:37:40.418 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:37:40.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:37:40.419 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:37:40.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:37:40.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:37:40.483 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:37:40.520 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:37:40.520 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:37:40.521 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:37:40.561 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:37:40.561 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:37:40.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:37:40.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.793+0000 7f6eeca00640 1 Processor -- start 2024-09-10T07:37:40.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.794+0000 7f6eeca00640 1 -- start start 2024-09-10T07:37:40.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.795+0000 7f6eeca00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6ee815db60 0x7f6ee8071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.795+0000 7f6eeca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ee80724d0 0x7f6ee806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.795+0000 7f6eeca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee8153e50 con 0x7f6ee806e580 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.795+0000 7f6eeca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee815df40 con 0x7f6ee80724d0 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.795+0000 7f6eeca00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee8072ac0 con 0x7f6ee815db60 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.795+0000 7f6ee5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ee80724d0 0x7f6ee806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.795+0000 7f6ee5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ee80724d0 0x7f6ee806e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56362/0 (socket says 172.21.15.99:56362) 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.795+0000 7f6ee6800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6ee806e580 0x7f6ee8160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43288/0 (socket says 172.21.15.99:43288) 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.795+0000 7f6ee5400640 1 -- 172.21.15.99:0/1658901041 learned_addr learned my addr 172.21.15.99:0/1658901041 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.795+0000 7f6ee5e00640 1 --2- 172.21.15.99:0/1658901041 >> v2:172.21.15.187:3300/0 conn(0x7f6ee815db60 0x7f6ee8071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.796+0000 7f6ee5400640 1 -- 172.21.15.99:0/1658901041 >> v2:172.21.15.187:3300/0 conn(0x7f6ee815db60 msgr2=0x7f6ee8071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.796+0000 7f6ee5400640 1 --2- 172.21.15.99:0/1658901041 >> v2:172.21.15.187:3300/0 conn(0x7f6ee815db60 0x7f6ee8071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.796+0000 7f6ee5400640 1 -- 172.21.15.99:0/1658901041 >> v1:172.21.15.99:6789/0 conn(0x7f6ee806e580 legacy=0x7f6ee8160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.796+0000 7f6ee5400640 1 -- 172.21.15.99:0/1658901041 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee8072da0 con 0x7f6ee80724d0 2024-09-10T07:37:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.796+0000 7f6ee4a00640 1 -- 172.21.15.99:0/1658901041 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208476537 0 0) 0x7f6ee8153e50 con 0x7f6ee806e580 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6ee5400640 1 --2- 172.21.15.99:0/1658901041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee80724d0 0x7f6ee806e040 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8073f30 tx=0x7f6ed402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e09bbf429ffd93c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6ee4a00640 1 -- 172.21.15.99:0/1658901041 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4037070 con 0x7f6ee80724d0 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6ee4a00640 1 -- 172.21.15.99:0/1658901041 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed4032440 con 0x7f6ee80724d0 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6ee4a00640 1 -- 172.21.15.99:0/1658901041 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4032810 con 0x7f6ee80724d0 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6eeca00640 1 -- 172.21.15.99:0/1658901041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee80724d0 msgr2=0x7f6ee806e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6eeca00640 1 --2- 172.21.15.99:0/1658901041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee80724d0 0x7f6ee806e040 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8073f30 tx=0x7f6ed402a270 comp rx=0 tx=0).stop 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6eeca00640 1 -- 172.21.15.99:0/1658901041 shutdown_connections 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6eeca00640 1 --2- 172.21.15.99:0/1658901041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee80724d0 0x7f6ee806e040 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6eeca00640 1 --2- 172.21.15.99:0/1658901041 >> v2:172.21.15.187:3300/0 conn(0x7f6ee815db60 0x7f6ee8071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6eeca00640 1 -- 172.21.15.99:0/1658901041 >> 172.21.15.99:0/1658901041 conn(0x7f6ee80b2630 msgr2=0x7f6ee80b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6eeca00640 1 -- 172.21.15.99:0/1658901041 shutdown_connections 2024-09-10T07:37:40.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.797+0000 7f6eeca00640 1 -- 172.21.15.99:0/1658901041 wait complete. 2024-09-10T07:37:40.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.799+0000 7f6eeca00640 1 Processor -- start 2024-09-10T07:37:40.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.799+0000 7f6eeca00640 1 -- start start 2024-09-10T07:37:40.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.800+0000 7f6eeca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ee806e580 0x7f6ee8148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.800+0000 7f6eeca00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ee80724d0 0x7f6ee80b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.800+0000 7f6eeca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee815db60 0x7f6ee80b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.800+0000 7f6eeca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee8073640 con 0x7f6ee815db60 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.800+0000 7f6eeca00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee8073360 con 0x7f6ee806e580 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.800+0000 7f6eeca00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee815d1c0 con 0x7f6ee80724d0 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.800+0000 7f6ee6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee815db60 0x7f6ee80b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.800+0000 7f6ee6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee815db60 0x7f6ee80b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56366/0 (socket says 172.21.15.99:56366) 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.800+0000 7f6ee6800640 1 -- 172.21.15.99:0/87722771 learned_addr learned my addr 172.21.15.99:0/87722771 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ee5e00640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ee806e580 0x7f6ee8148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ee5400640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ee80724d0 0x7f6ee80b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ee6800640 1 -- 172.21.15.99:0/87722771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ee80724d0 msgr2=0x7f6ee80b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ee6800640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ee80724d0 0x7f6ee80b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ee6800640 1 -- 172.21.15.99:0/87722771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ee806e580 msgr2=0x7f6ee8148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ee6800640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ee806e580 0x7f6ee8148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ee6800640 1 -- 172.21.15.99:0/87722771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee80ae8e0 con 0x7f6ee815db60 2024-09-10T07:37:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ee5400640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ee80724d0 0x7f6ee80b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:37:40.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ee6800640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee815db60 0x7f6ee80b10f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c480 tx=0x7f6ee000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:40.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ede000640 1 -- 172.21.15.99:0/87722771 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0018070 con 0x7f6ee815db60 2024-09-10T07:37:40.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ede000640 1 -- 172.21.15.99:0/87722771 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee0007500 con 0x7f6ee815db60 2024-09-10T07:37:40.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6ede000640 1 -- 172.21.15.99:0/87722771 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0004a20 con 0x7f6ee815db60 2024-09-10T07:37:40.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.801+0000 7f6eeca00640 1 -- 172.21.15.99:0/87722771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee80b3d60 con 0x7f6ee815db60 2024-09-10T07:37:40.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.802+0000 7f6eeca00640 1 -- 172.21.15.99:0/87722771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee8154c60 con 0x7f6ee815db60 2024-09-10T07:37:40.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.803+0000 7f6eeca00640 1 -- 172.21.15.99:0/87722771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee806e040 con 0x7f6ee815db60 2024-09-10T07:37:40.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.803+0000 7f6ede000640 1 -- 172.21.15.99:0/87722771 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ee0004bc0 con 0x7f6ee815db60 2024-09-10T07:37:40.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.804+0000 7f6ede000640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6ec806be30 0x7f6ec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:40.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.804+0000 7f6ede000640 1 -- 172.21.15.99:0/87722771 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f6ee008a0e0 con 0x7f6ee815db60 2024-09-10T07:37:40.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.805+0000 7f6ede000640 1 -- 172.21.15.99:0/87722771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=70}) -- 0x7f6ec8073960 con 0x7f6ee815db60 2024-09-10T07:37:40.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.805+0000 7f6ee5e00640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6ec806be30 0x7f6ec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:40.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.805+0000 7f6ee5e00640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6ec806be30 0x7f6ec806e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80099c0 tx=0x7f6ed8003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:40.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.809+0000 7f6ede000640 1 -- 172.21.15.99:0/87722771 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ee0058a80 con 0x7f6ee815db60 2024-09-10T07:37:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.994+0000 7f6eeca00640 1 -- 172.21.15.99:0/87722771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ee806dc10 con 0x7f6ee815db60 2024-09-10T07:37:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.994+0000 7f6ede000640 1 -- 172.21.15.99:0/87722771 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7f6ee0058380 con 0x7f6ee815db60 2024-09-10T07:37:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.996+0000 7f6eeca00640 1 -- 172.21.15.99:0/87722771 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6ec806be30 msgr2=0x7f6ec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.996+0000 7f6eeca00640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6ec806be30 0x7f6ec806e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80099c0 tx=0x7f6ed8003990 comp rx=0 tx=0).stop 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.996+0000 7f6eeca00640 1 -- 172.21.15.99:0/87722771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee815db60 msgr2=0x7f6ee80b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.996+0000 7f6eeca00640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee815db60 0x7f6ee80b10f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c480 tx=0x7f6ee000c940 comp rx=0 tx=0).stop 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.996+0000 7f6eeca00640 1 -- 172.21.15.99:0/87722771 shutdown_connections 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.996+0000 7f6eeca00640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6ec806be30 0x7f6ec806e2f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.996+0000 7f6eeca00640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ee815db60 0x7f6ee80b10f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.996+0000 7f6eeca00640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ee80724d0 0x7f6ee80b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.996+0000 7f6eeca00640 1 --2- 172.21.15.99:0/87722771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ee806e580 0x7f6ee8148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.996+0000 7f6eeca00640 1 -- 172.21.15.99:0/87722771 >> 172.21.15.99:0/87722771 conn(0x7f6ee80b2630 msgr2=0x7f6ee815e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.997+0000 7f6eeca00640 1 -- 172.21.15.99:0/87722771 shutdown_connections 2024-09-10T07:37:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:40.997+0000 7f6eeca00640 1 -- 172.21.15.99:0/87722771 wait complete. 2024-09-10T07:37:41.012 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:37:41.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:37:41.013 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T07:37:41.081 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:37:41.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:37:41.082 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:37:41.119 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:37:41.119 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:37:41.119 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:37:41.155 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:37:41.155 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:37:41.155 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:37:41.155 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:37:41.194 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:37:41.194 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:37:41.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.347+0000 7f6366a00640 1 Processor -- start 2024-09-10T07:37:41.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.347+0000 7f6366a00640 1 -- start start 2024-09-10T07:37:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.348+0000 7f6366a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63600d2680 0x7f63600cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.348+0000 7f6366a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f63600cfac0 0x7f63600c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.348+0000 7f6366a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63600d2bd0 con 0x7f636015e970 2024-09-10T07:37:41.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.348+0000 7f6366a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f63600d37e0 con 0x7f63600cfac0 2024-09-10T07:37:41.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.348+0000 7f6366a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f63600d2eb0 con 0x7f63600d2680 2024-09-10T07:37:41.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.348+0000 7f6365600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f636015e970 0x7f63600d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43292/0 (socket says 172.21.15.99:43292) 2024-09-10T07:37:41.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.348+0000 7f6365600640 1 -- 172.21.15.99:0/1262103420 learned_addr learned my addr 172.21.15.99:0/1262103420 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:41.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.349+0000 7f6366000640 1 --2- 172.21.15.99:0/1262103420 >> v2:172.21.15.99:3300/0 conn(0x7f63600cfac0 0x7f63600c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.349+0000 7f6364c00640 1 --2- 172.21.15.99:0/1262103420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63600d2680 0x7f63600cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.349+0000 7f635fe00640 1 -- 172.21.15.99:0/1262103420 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374142262 0 0) 0x7f63600d2bd0 con 0x7f636015e970 2024-09-10T07:37:41.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.349+0000 7f635fe00640 1 -- 172.21.15.99:0/1262103420 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6348003520 con 0x7f636015e970 2024-09-10T07:37:41.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.349+0000 7f6366000640 1 -- 172.21.15.99:0/1262103420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63600d2680 msgr2=0x7f63600cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:41.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.349+0000 7f6366000640 1 --2- 172.21.15.99:0/1262103420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63600d2680 0x7f63600cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.349+0000 7f6366000640 1 -- 172.21.15.99:0/1262103420 >> v1:172.21.15.99:6789/0 conn(0x7f636015e970 legacy=0x7f63600d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:41.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.349+0000 7f6366000640 1 -- 172.21.15.99:0/1262103420 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63600d3190 con 0x7f63600cfac0 2024-09-10T07:37:41.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.350+0000 7f6366000640 1 --2- 172.21.15.99:0/1262103420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 0x7f63600c8700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6358009d90 tx=0x7f635802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac32a48930d8686c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:41.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.350+0000 7f635fe00640 1 -- 172.21.15.99:0/1262103420 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358007740 con 0x7f63600cfac0 2024-09-10T07:37:41.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.350+0000 7f635fe00640 1 -- 172.21.15.99:0/1262103420 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63580078e0 con 0x7f63600cfac0 2024-09-10T07:37:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.350+0000 7f635fe00640 1 -- 172.21.15.99:0/1262103420 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358007cb0 con 0x7f63600cfac0 2024-09-10T07:37:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.351+0000 7f6366a00640 1 -- 172.21.15.99:0/1262103420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 msgr2=0x7f63600c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.351+0000 7f6366a00640 1 --2- 172.21.15.99:0/1262103420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 0x7f63600c8700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6358009d90 tx=0x7f635802a6f0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.351+0000 7f6366a00640 1 -- 172.21.15.99:0/1262103420 shutdown_connections 2024-09-10T07:37:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.351+0000 7f6366a00640 1 --2- 172.21.15.99:0/1262103420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 0x7f63600c8700 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.351+0000 7f6366a00640 1 --2- 172.21.15.99:0/1262103420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63600d2680 0x7f63600cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.351+0000 7f6366a00640 1 -- 172.21.15.99:0/1262103420 >> 172.21.15.99:0/1262103420 conn(0x7f636009de00 msgr2=0x7f63600d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.351+0000 7f6366a00640 1 -- 172.21.15.99:0/1262103420 shutdown_connections 2024-09-10T07:37:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.351+0000 7f6366a00640 1 -- 172.21.15.99:0/1262103420 wait complete. 2024-09-10T07:37:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.353+0000 7f6366a00640 1 Processor -- start 2024-09-10T07:37:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.353+0000 7f6366a00640 1 -- start start 2024-09-10T07:37:41.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.353+0000 7f6366a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 0x7f6360153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.353+0000 7f6366a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63600d2680 0x7f63600ba260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.353+0000 7f6366a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636015e970 0x7f6360155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.353+0000 7f6366a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f636015ed50 con 0x7f63600cfac0 2024-09-10T07:37:41.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.353+0000 7f6366a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f63600cff70 con 0x7f63600d2680 2024-09-10T07:37:41.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.353+0000 7f6366a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f636015eed0 con 0x7f636015e970 2024-09-10T07:37:41.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6365600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 0x7f6360153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6365600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 0x7f6360153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56392/0 (socket says 172.21.15.99:56392) 2024-09-10T07:37:41.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6365600640 1 -- 172.21.15.99:0/2245703929 learned_addr learned my addr 172.21.15.99:0/2245703929 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:41.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6364c00640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63600d2680 0x7f63600ba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6366000640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636015e970 0x7f6360155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6365600640 1 -- 172.21.15.99:0/2245703929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636015e970 msgr2=0x7f6360155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:41.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6365600640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636015e970 0x7f6360155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6365600640 1 -- 172.21.15.99:0/2245703929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63600d2680 msgr2=0x7f63600ba260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:41.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6365600640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63600d2680 0x7f63600ba260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6365600640 1 -- 172.21.15.99:0/2245703929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63600b9360 con 0x7f63600cfac0 2024-09-10T07:37:41.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6364c00640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63600d2680 0x7f63600ba260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:37:41.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.354+0000 7f6366000640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636015e970 0x7f6360155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:37:41.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.355+0000 7f6365600640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 0x7f6360153e10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f635400c3c0 tx=0x7f635400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:41.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.355+0000 7f635d600640 1 -- 172.21.15.99:0/2245703929 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354017070 con 0x7f63600cfac0 2024-09-10T07:37:41.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.355+0000 7f635d600640 1 -- 172.21.15.99:0/2245703929 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6354005ce0 con 0x7f63600cfac0 2024-09-10T07:37:41.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.355+0000 7f635d600640 1 -- 172.21.15.99:0/2245703929 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63540072f0 con 0x7f63600cfac0 2024-09-10T07:37:41.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.355+0000 7f6366a00640 1 -- 172.21.15.99:0/2245703929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63600b9640 con 0x7f63600cfac0 2024-09-10T07:37:41.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.355+0000 7f6366a00640 1 -- 172.21.15.99:0/2245703929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f636015fb50 con 0x7f63600cfac0 2024-09-10T07:37:41.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.356+0000 7f6366a00640 1 -- 172.21.15.99:0/2245703929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63600ceee0 con 0x7f63600cfac0 2024-09-10T07:37:41.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.357+0000 7f635d600640 1 -- 172.21.15.99:0/2245703929 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f635401a070 con 0x7f63600cfac0 2024-09-10T07:37:41.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.358+0000 7f635d600640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634006be60 0x7f634006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.358+0000 7f635d600640 1 -- 172.21.15.99:0/2245703929 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f635408a300 con 0x7f63600cfac0 2024-09-10T07:37:41.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.358+0000 7f635d600640 1 -- 172.21.15.99:0/2245703929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=70}) -- 0x7f6340073990 con 0x7f63600cfac0 2024-09-10T07:37:41.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.358+0000 7f6364c00640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634006be60 0x7f634006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.359+0000 7f6364c00640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634006be60 0x7f634006e320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f63600b9fe0 tx=0x7f634c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:41.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.362+0000 7f635d600640 1 -- 172.21.15.99:0/2245703929 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6354058c10 con 0x7f63600cfac0 2024-09-10T07:37:41.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.658+0000 7f6366a00640 1 -- 172.21.15.99:0/2245703929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6360075500 con 0x7f63600cfac0 2024-09-10T07:37:41.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.659+0000 7f635d600640 1 -- 172.21.15.99:0/2245703929 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5229 (secure 0 0 0) 0x7f6354058510 con 0x7f63600cfac0 2024-09-10T07:37:41.659 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:41.659 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":34,"btime":"2024-09-10T07:36:30:406568+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/2770940747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2770940747},{"type":"v1","addr":"172.21.15.187:6834","nonce":2770940747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":4997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/1207587759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1207587759},{"type":"v1","addr":"172.21.15.99:6836","nonce":1207587759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5463,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3753955373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3753955373},{"type":"v1","addr":"172.21.15.187:6835","nonce":3753955373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:36:26.770809+0000","modified":"2024-09-10T07:36:29.817237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5466":{"gid":5466,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3805850931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3805850931},{"type":"v1","addr":"172.21.15.99:6837","nonce":3805850931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5466,"qdb_cluster":[5466]},"id":4}]} 2024-09-10T07:37:41.659 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 34 2024-09-10T07:37:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 -- 172.21.15.99:0/2245703929 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634006be60 msgr2=0x7f634006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634006be60 0x7f634006e320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f63600b9fe0 tx=0x7f634c008040 comp rx=0 tx=0).stop 2024-09-10T07:37:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 -- 172.21.15.99:0/2245703929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 msgr2=0x7f6360153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 0x7f6360153e10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f635400c3c0 tx=0x7f635400c880 comp rx=0 tx=0).stop 2024-09-10T07:37:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 -- 172.21.15.99:0/2245703929 shutdown_connections 2024-09-10T07:37:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636015e970 0x7f6360155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63600d2680 0x7f63600ba260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634006be60 0x7f634006e320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 --2- 172.21.15.99:0/2245703929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63600cfac0 0x7f6360153e10 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 -- 172.21.15.99:0/2245703929 >> 172.21.15.99:0/2245703929 conn(0x7f636009de00 msgr2=0x7f63600c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 -- 172.21.15.99:0/2245703929 shutdown_connections 2024-09-10T07:37:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.661+0000 7f6366a00640 1 -- 172.21.15.99:0/2245703929 wait complete. 2024-09-10T07:37:41.678 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:37:41.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.831+0000 7f7cda400640 1 Processor -- start 2024-09-10T07:37:41.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.831+0000 7f7cda400640 1 -- start start 2024-09-10T07:37:41.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.832+0000 7f7cda400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cd40cf010 0x7f7cd40cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7cda400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd415c4f0 con 0x7f7cd4162ba0 2024-09-10T07:37:41.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7cda400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd415b730 con 0x7f7cd4152210 2024-09-10T07:37:41.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7cda400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd415ba10 con 0x7f7cd40cf010 2024-09-10T07:37:41.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7ccaa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cd40cf010 0x7f7cd40cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7ccaa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cd40cf010 0x7f7cd40cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56398/0 (socket says 172.21.15.99:56398) 2024-09-10T07:37:41.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7ccaa00640 1 -- 172.21.15.99:0/1479340104 learned_addr learned my addr 172.21.15.99:0/1479340104 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:41.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7cd3e00640 1 --1- 172.21.15.99:0/1479340104 >> v1:172.21.15.99:6789/0 conn(0x7f7cd4162ba0 0x7f7cd4164f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43294/0 (socket says 172.21.15.99:43294) 2024-09-10T07:37:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7ccaa00640 1 -- 172.21.15.99:0/1479340104 >> v1:172.21.15.187:6789/0 conn(0x7f7cd4152210 legacy=0x7f7cd4071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7ccaa00640 1 -- 172.21.15.99:0/1479340104 >> v1:172.21.15.99:6789/0 conn(0x7f7cd4162ba0 legacy=0x7f7cd4164f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7cd2a00640 1 -- 172.21.15.99:0/1479340104 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233172314 0 0) 0x7f7cd415c4f0 con 0x7f7cd4162ba0 2024-09-10T07:37:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.833+0000 7f7ccaa00640 1 -- 172.21.15.99:0/1479340104 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd415bcf0 con 0x7f7cd40cf010 2024-09-10T07:37:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.834+0000 7f7ccaa00640 1 --2- 172.21.15.99:0/1479340104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd40cf010 0x7f7cd40cf4a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00bb00 tx=0x7f7cbc02c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0db105918b4c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:41.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.835+0000 7f7cd2a00640 1 -- 172.21.15.99:0/1479340104 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc03a070 con 0x7f7cd40cf010 2024-09-10T07:37:41.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.835+0000 7f7cd2a00640 1 -- 172.21.15.99:0/1479340104 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cbc032480 con 0x7f7cd40cf010 2024-09-10T07:37:41.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.835+0000 7f7cd2a00640 1 -- 172.21.15.99:0/1479340104 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc032850 con 0x7f7cd40cf010 2024-09-10T07:37:41.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.835+0000 7f7cda400640 1 -- 172.21.15.99:0/1479340104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd40cf010 msgr2=0x7f7cd40cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:41.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.835+0000 7f7cda400640 1 --2- 172.21.15.99:0/1479340104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd40cf010 0x7f7cd40cf4a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00bb00 tx=0x7f7cbc02c790 comp rx=0 tx=0).stop 2024-09-10T07:37:41.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.835+0000 7f7cda400640 1 -- 172.21.15.99:0/1479340104 shutdown_connections 2024-09-10T07:37:41.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.835+0000 7f7cda400640 1 --2- 172.21.15.99:0/1479340104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd40cf010 0x7f7cd40cf4a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.835+0000 7f7cda400640 1 -- 172.21.15.99:0/1479340104 >> 172.21.15.99:0/1479340104 conn(0x7f7cd406bc10 msgr2=0x7f7cd406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:41.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.835+0000 7f7cda400640 1 -- 172.21.15.99:0/1479340104 shutdown_connections 2024-09-10T07:37:41.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.835+0000 7f7cda400640 1 -- 172.21.15.99:0/1479340104 wait complete. 2024-09-10T07:37:41.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.837+0000 7f7cda400640 1 Processor -- start 2024-09-10T07:37:41.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.837+0000 7f7cda400640 1 -- start start 2024-09-10T07:37:41.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7cda400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cd40cf010 0x7f7cd4155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7cda400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd4152210 0x7f7cd4147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7cda400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cd4162ba0 0x7f7cd415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7cda400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd40725a0 con 0x7f7cd4152210 2024-09-10T07:37:41.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7cda400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd406f380 con 0x7f7cd4162ba0 2024-09-10T07:37:41.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7cda400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd406e6c0 con 0x7f7cd40cf010 2024-09-10T07:37:41.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7ccaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd4152210 0x7f7cd4147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7ccaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd4152210 0x7f7cd4147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56408/0 (socket says 172.21.15.99:56408) 2024-09-10T07:37:41.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7ccaa00640 1 -- 172.21.15.99:0/2878657705 learned_addr learned my addr 172.21.15.99:0/2878657705 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:41.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7cd3400640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cd40cf010 0x7f7cd4155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7cd3e00640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cd4162ba0 0x7f7cd415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7ccaa00640 1 -- 172.21.15.99:0/2878657705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cd40cf010 msgr2=0x7f7cd4155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7ccaa00640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cd40cf010 0x7f7cd4155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7ccaa00640 1 -- 172.21.15.99:0/2878657705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cd4162ba0 msgr2=0x7f7cd415e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7ccaa00640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cd4162ba0 0x7f7cd415e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.838+0000 7f7ccaa00640 1 -- 172.21.15.99:0/2878657705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd4154340 con 0x7f7cd4152210 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.839+0000 7f7ccaa00640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd4152210 0x7f7cd4147ad0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc000c00 tx=0x7f7cbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.839+0000 7f7ccbe00640 1 -- 172.21.15.99:0/2878657705 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc03a040 con 0x7f7cd4152210 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.839+0000 7f7ccbe00640 1 -- 172.21.15.99:0/2878657705 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cbc004030 con 0x7f7cd4152210 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.839+0000 7f7ccbe00640 1 -- 172.21.15.99:0/2878657705 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc004400 con 0x7f7cd4152210 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.839+0000 7f7cda400640 1 -- 172.21.15.99:0/2878657705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd4154620 con 0x7f7cd4152210 2024-09-10T07:37:41.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.839+0000 7f7cda400640 1 -- 172.21.15.99:0/2878657705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd4160d80 con 0x7f7cd4152210 2024-09-10T07:37:41.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.840+0000 7f7cda400640 1 -- 172.21.15.99:0/2878657705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd4160bb0 con 0x7f7cd4152210 2024-09-10T07:37:41.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.841+0000 7f7ccbe00640 1 -- 172.21.15.99:0/2878657705 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cbc03d070 con 0x7f7cd4152210 2024-09-10T07:37:41.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.842+0000 7f7ccbe00640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7cb006be60 0x7f7cb006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:41.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.843+0000 7f7ccbe00640 1 -- 172.21.15.99:0/2878657705 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f7cbc0ad660 con 0x7f7cd4152210 2024-09-10T07:37:41.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.843+0000 7f7cd3400640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7cb006be60 0x7f7cb006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:41.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.843+0000 7f7ccbe00640 1 -- 172.21.15.99:0/2878657705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=70}) -- 0x7f7cb0073990 con 0x7f7cd4152210 2024-09-10T07:37:41.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.843+0000 7f7cd3400640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7cb006be60 0x7f7cb006e320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4000f60 tx=0x7f7cc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:41.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:41.847+0000 7f7ccbe00640 1 -- 172.21.15.99:0/2878657705 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7cbc04d070 con 0x7f7cd4152210 2024-09-10T07:37:42.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.056+0000 7f7cda400640 1 -- 172.21.15.99:0/2878657705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cd40cf4a0 con 0x7f7cd4152210 2024-09-10T07:37:42.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.056+0000 7f7ccbe00640 1 -- 172.21.15.99:0/2878657705 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5229 (secure 0 0 0) 0x7f7cbc044020 con 0x7f7cd4152210 2024-09-10T07:37:42.056 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:42.056 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":34,"btime":"2024-09-10T07:36:30:406568+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/2770940747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2770940747},{"type":"v1","addr":"172.21.15.187:6834","nonce":2770940747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":4997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/1207587759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1207587759},{"type":"v1","addr":"172.21.15.99:6836","nonce":1207587759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5463,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3753955373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3753955373},{"type":"v1","addr":"172.21.15.187:6835","nonce":3753955373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:36:26.770809+0000","modified":"2024-09-10T07:36:29.817237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5466":{"gid":5466,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3805850931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3805850931},{"type":"v1","addr":"172.21.15.99:6837","nonce":3805850931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5466,"qdb_cluster":[5466]},"id":4}]} 2024-09-10T07:37:42.057 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 34 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.058+0000 7f7cda400640 1 -- 172.21.15.99:0/2878657705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7cb006be60 msgr2=0x7f7cb006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.058+0000 7f7cda400640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7cb006be60 0x7f7cb006e320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4000f60 tx=0x7f7cc4009040 comp rx=0 tx=0).stop 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.058+0000 7f7cda400640 1 -- 172.21.15.99:0/2878657705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd4152210 msgr2=0x7f7cd4147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.058+0000 7f7cda400640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd4152210 0x7f7cd4147ad0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc000c00 tx=0x7f7cbc0046c0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.059+0000 7f7cda400640 1 -- 172.21.15.99:0/2878657705 shutdown_connections 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.059+0000 7f7cda400640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cd4162ba0 0x7f7cd415e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.059+0000 7f7cda400640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7cb006be60 0x7f7cb006e320 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.059+0000 7f7cda400640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd4152210 0x7f7cd4147ad0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.059+0000 7f7cda400640 1 --2- 172.21.15.99:0/2878657705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cd40cf010 0x7f7cd4155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.059+0000 7f7cda400640 1 -- 172.21.15.99:0/2878657705 >> 172.21.15.99:0/2878657705 conn(0x7f7cd406bc10 msgr2=0x7f7cd40cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.059+0000 7f7cda400640 1 -- 172.21.15.99:0/2878657705 shutdown_connections 2024-09-10T07:37:42.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.059+0000 7f7cda400640 1 -- 172.21.15.99:0/2878657705 wait complete. 2024-09-10T07:37:42.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:37:42.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.227+0000 7f758e200640 1 Processor -- start 2024-09-10T07:37:42.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.227+0000 7f758e200640 1 -- start start 2024-09-10T07:37:42.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.228+0000 7f758e200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f758815e970 0x7f75880d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.228+0000 7f758e200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f75880cfc90 0x7f75880c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.228+0000 7f758e200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75880d2bd0 con 0x7f75880d2680 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.228+0000 7f758e200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f75880d37e0 con 0x7f758815e970 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.228+0000 7f758e200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f75880d2eb0 con 0x7f75880cfc90 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.228+0000 7f758ce00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f758815e970 0x7f75880d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.228+0000 7f758ce00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f758815e970 0x7f75880d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56412/0 (socket says 172.21.15.99:56412) 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.228+0000 7f758ce00640 1 -- 172.21.15.99:0/2154916676 learned_addr learned my addr 172.21.15.99:0/2154916676 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.228+0000 7f758d800640 1 --2- 172.21.15.99:0/2154916676 >> v2:172.21.15.187:3300/0 conn(0x7f75880cfc90 0x7f75880c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.229+0000 7f758ce00640 1 -- 172.21.15.99:0/2154916676 >> v2:172.21.15.187:3300/0 conn(0x7f75880cfc90 msgr2=0x7f75880c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.229+0000 7f758ce00640 1 --2- 172.21.15.99:0/2154916676 >> v2:172.21.15.187:3300/0 conn(0x7f75880cfc90 0x7f75880c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.229+0000 7f758ce00640 1 -- 172.21.15.99:0/2154916676 >> v1:172.21.15.99:6789/0 conn(0x7f75880d2680 legacy=0x7f75880cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.229+0000 7f758ce00640 1 -- 172.21.15.99:0/2154916676 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75880d3190 con 0x7f758815e970 2024-09-10T07:37:42.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.229+0000 7f7587400640 1 -- 172.21.15.99:0/2154916676 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3295980587 0 0) 0x7f75880d2bd0 con 0x7f75880d2680 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.230+0000 7f758ce00640 1 --2- 172.21.15.99:0/2154916676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758815e970 0x7f75880d0300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f758808e9c0 tx=0x7f757c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155b91ad0803fa91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.230+0000 7f7587400640 1 -- 172.21.15.99:0/2154916676 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c037070 con 0x7f758815e970 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.230+0000 7f7587400640 1 -- 172.21.15.99:0/2154916676 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757c02ae50 con 0x7f758815e970 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.230+0000 7f7587400640 1 -- 172.21.15.99:0/2154916676 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c032860 con 0x7f758815e970 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.230+0000 7f758e200640 1 -- 172.21.15.99:0/2154916676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758815e970 msgr2=0x7f75880d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.230+0000 7f758e200640 1 --2- 172.21.15.99:0/2154916676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758815e970 0x7f75880d0300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f758808e9c0 tx=0x7f757c02a300 comp rx=0 tx=0).stop 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.231+0000 7f758e200640 1 -- 172.21.15.99:0/2154916676 shutdown_connections 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.231+0000 7f758e200640 1 --2- 172.21.15.99:0/2154916676 >> v2:172.21.15.187:3300/0 conn(0x7f75880cfc90 0x7f75880c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.231+0000 7f758e200640 1 --2- 172.21.15.99:0/2154916676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758815e970 0x7f75880d0300 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.231+0000 7f758e200640 1 -- 172.21.15.99:0/2154916676 >> 172.21.15.99:0/2154916676 conn(0x7f758809de00 msgr2=0x7f75880d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:42.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.231+0000 7f758e200640 1 -- 172.21.15.99:0/2154916676 shutdown_connections 2024-09-10T07:37:42.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.231+0000 7f758e200640 1 -- 172.21.15.99:0/2154916676 wait complete. 2024-09-10T07:37:42.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.232+0000 7f758e200640 1 Processor -- start 2024-09-10T07:37:42.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.232+0000 7f758e200640 1 -- start start 2024-09-10T07:37:42.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.233+0000 7f758e200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75880cfc90 0x7f75880cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.233+0000 7f758e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75880d2680 0x7f7588160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.233+0000 7f758e200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f758815e970 0x7f75881f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.233+0000 7f758e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f758815ed50 con 0x7f75880d2680 2024-09-10T07:37:42.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.233+0000 7f758e200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f75880d0840 con 0x7f75880cfc90 2024-09-10T07:37:42.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.233+0000 7f758e200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f758815eed0 con 0x7f758815e970 2024-09-10T07:37:42.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f7587e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75880d2680 0x7f7588160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f7587e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75880d2680 0x7f7588160870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56426/0 (socket says 172.21.15.99:56426) 2024-09-10T07:37:42.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f7587e00640 1 -- 172.21.15.99:0/4210724695 learned_addr learned my addr 172.21.15.99:0/4210724695 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:42.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f758ce00640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75880cfc90 0x7f75880cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f758d800640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f758815e970 0x7f75881f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f7587e00640 1 -- 172.21.15.99:0/4210724695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f758815e970 msgr2=0x7f75881f86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f7587e00640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f758815e970 0x7f75881f86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f7587e00640 1 -- 172.21.15.99:0/4210724695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75880cfc90 msgr2=0x7f75880cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f7587e00640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75880cfc90 0x7f75880cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f7587e00640 1 -- 172.21.15.99:0/4210724695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75880cc2b0 con 0x7f75880d2680 2024-09-10T07:37:42.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.234+0000 7f7587e00640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75880d2680 0x7f7588160870 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f757400c4b0 tx=0x7f757400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:42.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.235+0000 7f7584c00640 1 -- 172.21.15.99:0/4210724695 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574017070 con 0x7f75880d2680 2024-09-10T07:37:42.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.235+0000 7f7584c00640 1 -- 172.21.15.99:0/4210724695 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7574005480 con 0x7f75880d2680 2024-09-10T07:37:42.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.235+0000 7f7584c00640 1 -- 172.21.15.99:0/4210724695 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574003830 con 0x7f75880d2680 2024-09-10T07:37:42.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.235+0000 7f758e200640 1 -- 172.21.15.99:0/4210724695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75880cc590 con 0x7f75880d2680 2024-09-10T07:37:42.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.235+0000 7f758e200640 1 -- 172.21.15.99:0/4210724695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7588160db0 con 0x7f75880d2680 2024-09-10T07:37:42.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.236+0000 7f758e200640 1 -- 172.21.15.99:0/4210724695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75880d3f00 con 0x7f75880d2680 2024-09-10T07:37:42.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.237+0000 7f7584c00640 1 -- 172.21.15.99:0/4210724695 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f757401a070 con 0x7f75880d2680 2024-09-10T07:37:42.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.237+0000 7f7584c00640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f756806be30 0x7f756806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.238+0000 7f7584c00640 1 -- 172.21.15.99:0/4210724695 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f757408a180 con 0x7f75880d2680 2024-09-10T07:37:42.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.238+0000 7f758ce00640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f756806be30 0x7f756806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.238+0000 7f7584c00640 1 -- 172.21.15.99:0/4210724695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=70}) -- 0x7f7568073960 con 0x7f75880d2680 2024-09-10T07:37:42.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.238+0000 7f758ce00640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f756806be30 0x7f756806e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f757c034000 tx=0x7f757c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:42.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.242+0000 7f7584c00640 1 -- 172.21.15.99:0/4210724695 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75880d3f00 con 0x7f75880d2680 2024-09-10T07:37:42.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.415+0000 7f758e200640 1 -- 172.21.15.99:0/4210724695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75880d0300 con 0x7f75880d2680 2024-09-10T07:37:42.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.416+0000 7f7584c00640 1 -- 172.21.15.99:0/4210724695 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16759 (secure 0 0 0) 0x7f75740584d0 con 0x7f75880d2680 2024-09-10T07:37:42.417 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:42.417 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":69,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:36:45.847204+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:36:24.546261+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T07:36:25.773175+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:37:42.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 -- 172.21.15.99:0/4210724695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f756806be30 msgr2=0x7f756806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f756806be30 0x7f756806e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f757c034000 tx=0x7f757c02e000 comp rx=0 tx=0).stop 2024-09-10T07:37:42.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 -- 172.21.15.99:0/4210724695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75880d2680 msgr2=0x7f7588160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75880d2680 0x7f7588160870 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f757400c4b0 tx=0x7f757400c970 comp rx=0 tx=0).stop 2024-09-10T07:37:42.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 -- 172.21.15.99:0/4210724695 shutdown_connections 2024-09-10T07:37:42.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f758815e970 0x7f75881f86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f756806be30 0x7f756806e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75880d2680 0x7f7588160870 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 --2- 172.21.15.99:0/4210724695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75880cfc90 0x7f75880cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 -- 172.21.15.99:0/4210724695 >> 172.21.15.99:0/4210724695 conn(0x7f758809de00 msgr2=0x7f75880c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:42.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 -- 172.21.15.99:0/4210724695 shutdown_connections 2024-09-10T07:37:42.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.419+0000 7f758e200640 1 -- 172.21.15.99:0/4210724695 wait complete. 2024-09-10T07:37:42.436 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:37:42.436 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:37:42.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.589+0000 7f06ad600640 1 Processor -- start 2024-09-10T07:37:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.589+0000 7f06ad600640 1 -- start start 2024-09-10T07:37:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f06ad600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06a8142150 0x7f06a8160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f06ad600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f06a8160a80 0x7f06a80cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f06ad600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a8142650 con 0x7f06a813fae0 2024-09-10T07:37:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f06ad600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f06a80ce780 con 0x7f06a8142150 2024-09-10T07:37:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f06ad600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f06a8142930 con 0x7f06a8160a80 2024-09-10T07:37:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f069e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06a8142150 0x7f06a8160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f069e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06a8142150 0x7f06a8160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56430/0 (socket says 172.21.15.99:56430) 2024-09-10T07:37:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f069e000640 1 -- 172.21.15.99:0/1875848992 learned_addr learned my addr 172.21.15.99:0/1875848992 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:42.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f069e000640 1 -- 172.21.15.99:0/1875848992 >> v2:172.21.15.187:3300/0 conn(0x7f06a8160a80 msgr2=0x7f06a80cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:42.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f069e000640 1 --2- 172.21.15.99:0/1875848992 >> v2:172.21.15.187:3300/0 conn(0x7f06a8160a80 0x7f06a80cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f069e000640 1 -- 172.21.15.99:0/1875848992 >> v1:172.21.15.187:6789/0 conn(0x7f06a813fae0 legacy=0x7f06a806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:42.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.591+0000 7f069e000640 1 -- 172.21.15.99:0/1875848992 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a8142c10 con 0x7f06a8142150 2024-09-10T07:37:42.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.592+0000 7f069e000640 1 --2- 172.21.15.99:0/1875848992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 0x7f06a8160540 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f06a80b39c0 tx=0x7f069002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98602ce542c8d2af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:42.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06a6000640 1 -- 172.21.15.99:0/1875848992 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690037070 con 0x7f06a8142150 2024-09-10T07:37:42.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06a6000640 1 -- 172.21.15.99:0/1875848992 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0690032440 con 0x7f06a8142150 2024-09-10T07:37:42.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06a6000640 1 -- 172.21.15.99:0/1875848992 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690032810 con 0x7f06a8142150 2024-09-10T07:37:42.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06ad600640 1 -- 172.21.15.99:0/1875848992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 msgr2=0x7f06a8160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06ad600640 1 --2- 172.21.15.99:0/1875848992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 0x7f06a8160540 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f06a80b39c0 tx=0x7f069002a1a0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06ad600640 1 -- 172.21.15.99:0/1875848992 shutdown_connections 2024-09-10T07:37:42.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06ad600640 1 --2- 172.21.15.99:0/1875848992 >> v2:172.21.15.187:3300/0 conn(0x7f06a8160a80 0x7f06a80cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06ad600640 1 --2- 172.21.15.99:0/1875848992 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 0x7f06a8160540 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06ad600640 1 -- 172.21.15.99:0/1875848992 >> 172.21.15.99:0/1875848992 conn(0x7f06a806bc10 msgr2=0x7f06a806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:42.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06ad600640 1 -- 172.21.15.99:0/1875848992 shutdown_connections 2024-09-10T07:37:42.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.593+0000 7f06ad600640 1 -- 172.21.15.99:0/1875848992 wait complete. 2024-09-10T07:37:42.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.595+0000 7f06ad600640 1 Processor -- start 2024-09-10T07:37:42.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.595+0000 7f06ad600640 1 -- start start 2024-09-10T07:37:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f06ad600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a813fae0 0x7f06a81ef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f06ad600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 0x7f06a8145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f06ad600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06a8160a80 0x7f06a81594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f06ad600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f06a80cf2d0 con 0x7f06a8142150 2024-09-10T07:37:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f06ad600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f06a80cf150 con 0x7f06a813fae0 2024-09-10T07:37:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f06ad600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f06a80cf450 con 0x7f06a8160a80 2024-09-10T07:37:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f069e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 0x7f06a8145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f069e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 0x7f06a8145b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56440/0 (socket says 172.21.15.99:56440) 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f069e000640 1 -- 172.21.15.99:0/930580014 learned_addr learned my addr 172.21.15.99:0/930580014 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f06a6a00640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a813fae0 0x7f06a81ef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.596+0000 7f06a7400640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06a8160a80 0x7f06a81594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f069e000640 1 -- 172.21.15.99:0/930580014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06a8160a80 msgr2=0x7f06a81594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f069e000640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06a8160a80 0x7f06a81594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f069e000640 1 -- 172.21.15.99:0/930580014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a813fae0 msgr2=0x7f06a81ef9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f069e000640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a813fae0 0x7f06a81ef9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f069e000640 1 -- 172.21.15.99:0/930580014 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a815b520 con 0x7f06a8142150 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f069e000640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 0x7f06a8145b90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f069002a1e0 tx=0x7f06900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f069f400640 1 -- 172.21.15.99:0/930580014 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690041070 con 0x7f06a8142150 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f069f400640 1 -- 172.21.15.99:0/930580014 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069003c870 con 0x7f06a8142150 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f069f400640 1 -- 172.21.15.99:0/930580014 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690037040 con 0x7f06a8142150 2024-09-10T07:37:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f06ad600640 1 -- 172.21.15.99:0/930580014 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a815b7c0 con 0x7f06a8142150 2024-09-10T07:37:42.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.597+0000 7f06ad600640 1 -- 172.21.15.99:0/930580014 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a815bd80 con 0x7f06a8142150 2024-09-10T07:37:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.598+0000 7f06ad600640 1 -- 172.21.15.99:0/930580014 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a8160540 con 0x7f06a8142150 2024-09-10T07:37:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.599+0000 7f069f400640 1 -- 172.21.15.99:0/930580014 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0690044070 con 0x7f06a8142150 2024-09-10T07:37:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.600+0000 7f069f400640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f068406be30 0x7f068406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.600+0000 7f069f400640 1 -- 172.21.15.99:0/930580014 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f06900ab930 con 0x7f06a8142150 2024-09-10T07:37:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.600+0000 7f06a6a00640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f068406be30 0x7f068406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.600+0000 7f069f400640 1 -- 172.21.15.99:0/930580014 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=70}) -- 0x7f0684073960 con 0x7f06a8142150 2024-09-10T07:37:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.601+0000 7f06a6a00640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f068406be30 0x7f068406e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f06a80d0270 tx=0x7f0698009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:42.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.605+0000 7f069f400640 1 -- 172.21.15.99:0/930580014 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0690079c80 con 0x7f06a8142150 2024-09-10T07:37:42.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.812+0000 7f06ad600640 1 -- 172.21.15.99:0/930580014 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06a8156c80 con 0x7f06a8142150 2024-09-10T07:37:42.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.813+0000 7f069f400640 1 -- 172.21.15.99:0/930580014 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5229 (secure 0 0 0) 0x7f069007df80 con 0x7f06a8142150 2024-09-10T07:37:42.813 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:42.813 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":34,"btime":"2024-09-10T07:36:30:406568+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/2770940747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2770940747},{"type":"v1","addr":"172.21.15.187:6834","nonce":2770940747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":4997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/1207587759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1207587759},{"type":"v1","addr":"172.21.15.99:6836","nonce":1207587759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5463,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3753955373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3753955373},{"type":"v1","addr":"172.21.15.187:6835","nonce":3753955373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:36:26.770809+0000","modified":"2024-09-10T07:36:29.817237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5466":{"gid":5466,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3805850931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3805850931},{"type":"v1","addr":"172.21.15.99:6837","nonce":3805850931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5466,"qdb_cluster":[5466]},"id":4}]} 2024-09-10T07:37:42.813 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 34 2024-09-10T07:37:42.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 -- 172.21.15.99:0/930580014 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f068406be30 msgr2=0x7f068406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f068406be30 0x7f068406e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f06a80d0270 tx=0x7f0698009040 comp rx=0 tx=0).stop 2024-09-10T07:37:42.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 -- 172.21.15.99:0/930580014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 msgr2=0x7f06a8145b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 0x7f06a8145b90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f069002a1e0 tx=0x7f06900046c0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 -- 172.21.15.99:0/930580014 shutdown_connections 2024-09-10T07:37:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06a8160a80 0x7f06a81594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f068406be30 0x7f068406e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a8142150 0x7f06a8145b90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 --2- 172.21.15.99:0/930580014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a813fae0 0x7f06a81ef9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 -- 172.21.15.99:0/930580014 >> 172.21.15.99:0/930580014 conn(0x7f06a806bc10 msgr2=0x7f06a815f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 -- 172.21.15.99:0/930580014 shutdown_connections 2024-09-10T07:37:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.815+0000 7f06ad600640 1 -- 172.21.15.99:0/930580014 wait complete. 2024-09-10T07:37:42.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:37:42.972 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:37:42.972+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2024-09-10T07:37:42.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.985+0000 7fec6ac00640 1 Processor -- start 2024-09-10T07:37:42.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.985+0000 7fec6ac00640 1 -- start start 2024-09-10T07:37:42.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.986+0000 7fec6ac00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fec6415e970 0x7fec640d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.986+0000 7fec6ac00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec640cfc90 0x7fec640c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.986+0000 7fec6ac00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec640d2bd0 con 0x7fec640d2680 2024-09-10T07:37:42.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.986+0000 7fec6ac00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fec640d37e0 con 0x7fec640cfc90 2024-09-10T07:37:42.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.986+0000 7fec6ac00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fec640d2eb0 con 0x7fec6415e970 2024-09-10T07:37:42.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.986+0000 7fec6a200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec640cfc90 0x7fec640c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.986+0000 7fec68e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fec640d2680 0x7fec640cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43304/0 (socket says 172.21.15.99:43304) 2024-09-10T07:37:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.986+0000 7fec68e00640 1 -- 172.21.15.99:0/1585363706 learned_addr learned my addr 172.21.15.99:0/1585363706 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.986+0000 7fec6a200640 1 --2- 172.21.15.99:0/1585363706 >> v2:172.21.15.99:3300/0 conn(0x7fec640cfc90 0x7fec640c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56452/0 (socket says 172.21.15.99:56452) 2024-09-10T07:37:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.987+0000 7fec69800640 1 --2- 172.21.15.99:0/1585363706 >> v2:172.21.15.187:3300/0 conn(0x7fec6415e970 0x7fec640d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.987+0000 7fec6a200640 1 -- 172.21.15.99:0/1585363706 >> v2:172.21.15.187:3300/0 conn(0x7fec6415e970 msgr2=0x7fec640d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:42.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.987+0000 7fec6a200640 1 --2- 172.21.15.99:0/1585363706 >> v2:172.21.15.187:3300/0 conn(0x7fec6415e970 0x7fec640d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.987+0000 7fec6a200640 1 -- 172.21.15.99:0/1585363706 >> v1:172.21.15.99:6789/0 conn(0x7fec640d2680 legacy=0x7fec640cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.987+0000 7fec6a200640 1 -- 172.21.15.99:0/1585363706 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec640d3190 con 0x7fec640cfc90 2024-09-10T07:37:42.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.987+0000 7fec63e00640 1 -- 172.21.15.99:0/1585363706 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687194220 0 0) 0x7fec640d2bd0 con 0x7fec640d2680 2024-09-10T07:37:42.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.987+0000 7fec69800640 1 --2- 172.21.15.99:0/1585363706 >> v2:172.21.15.187:3300/0 conn(0x7fec6415e970 0x7fec640d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:37:42.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.988+0000 7fec6a200640 1 --2- 172.21.15.99:0/1585363706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 0x7fec640c8700 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fec6406c1c0 tx=0x7fec5c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba151a3a96c0798 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:42.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.988+0000 7fec63e00640 1 -- 172.21.15.99:0/1585363706 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c007740 con 0x7fec640cfc90 2024-09-10T07:37:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.988+0000 7fec63e00640 1 -- 172.21.15.99:0/1585363706 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5c0078e0 con 0x7fec640cfc90 2024-09-10T07:37:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.988+0000 7fec63e00640 1 -- 172.21.15.99:0/1585363706 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c007cb0 con 0x7fec640cfc90 2024-09-10T07:37:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.988+0000 7fec6ac00640 1 -- 172.21.15.99:0/1585363706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 msgr2=0x7fec640c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.988+0000 7fec6ac00640 1 --2- 172.21.15.99:0/1585363706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 0x7fec640c8700 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fec6406c1c0 tx=0x7fec5c02a710 comp rx=0 tx=0).stop 2024-09-10T07:37:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.989+0000 7fec6ac00640 1 -- 172.21.15.99:0/1585363706 shutdown_connections 2024-09-10T07:37:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.989+0000 7fec6ac00640 1 --2- 172.21.15.99:0/1585363706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 0x7fec640c8700 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.989+0000 7fec6ac00640 1 --2- 172.21.15.99:0/1585363706 >> v2:172.21.15.187:3300/0 conn(0x7fec6415e970 0x7fec640d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.989+0000 7fec6ac00640 1 -- 172.21.15.99:0/1585363706 >> 172.21.15.99:0/1585363706 conn(0x7fec6409de00 msgr2=0x7fec640d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:42.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.989+0000 7fec6ac00640 1 -- 172.21.15.99:0/1585363706 shutdown_connections 2024-09-10T07:37:42.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.989+0000 7fec6ac00640 1 -- 172.21.15.99:0/1585363706 wait complete. 2024-09-10T07:37:42.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.990+0000 7fec6ac00640 1 Processor -- start 2024-09-10T07:37:42.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.990+0000 7fec6ac00640 1 -- start start 2024-09-10T07:37:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.991+0000 7fec6ac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 0x7fec640cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.991+0000 7fec6ac00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec640d2680 0x7fec64152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.991+0000 7fec6ac00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec6415e970 0x7fec640cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.991+0000 7fec6ac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fec6415ed50 con 0x7fec640cfc90 2024-09-10T07:37:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.991+0000 7fec6ac00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fec640d0840 con 0x7fec640d2680 2024-09-10T07:37:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.991+0000 7fec6ac00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fec6415eed0 con 0x7fec6415e970 2024-09-10T07:37:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec69800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 0x7fec640cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec69800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 0x7fec640cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56466/0 (socket says 172.21.15.99:56466) 2024-09-10T07:37:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec69800640 1 -- 172.21.15.99:0/2770183945 learned_addr learned my addr 172.21.15.99:0/2770183945 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec6a200640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec6415e970 0x7fec640cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec68e00640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec640d2680 0x7fec64152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec69800640 1 -- 172.21.15.99:0/2770183945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec6415e970 msgr2=0x7fec640cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec69800640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec6415e970 0x7fec640cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec69800640 1 -- 172.21.15.99:0/2770183945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec640d2680 msgr2=0x7fec64152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec69800640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec640d2680 0x7fec64152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec69800640 1 -- 172.21.15.99:0/2770183945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec64153340 con 0x7fec640cfc90 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.992+0000 7fec69800640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 0x7fec640cc940 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fec5800c7f0 tx=0x7fec5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.993+0000 7fec61600640 1 -- 172.21.15.99:0/2770183945 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58015070 con 0x7fec640cfc90 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.993+0000 7fec61600640 1 -- 172.21.15.99:0/2770183945 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec58007820 con 0x7fec640cfc90 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.993+0000 7fec61600640 1 -- 172.21.15.99:0/2770183945 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58007bd0 con 0x7fec640cfc90 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.993+0000 7fec6ac00640 1 -- 172.21.15.99:0/2770183945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec640ce3d0 con 0x7fec640cfc90 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.993+0000 7fec6ac00640 1 -- 172.21.15.99:0/2770183945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec640cbe60 con 0x7fec640cfc90 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.994+0000 7fec6ac00640 1 -- 172.21.15.99:0/2770183945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6406d1e0 con 0x7fec640cfc90 2024-09-10T07:37:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.994+0000 7fec61600640 1 -- 172.21.15.99:0/2770183945 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec58018070 con 0x7fec640cfc90 2024-09-10T07:37:42.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.995+0000 7fec61600640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec4406be30 0x7fec4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:42.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.995+0000 7fec61600640 1 -- 172.21.15.99:0/2770183945 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fec5808af50 con 0x7fec640cfc90 2024-09-10T07:37:42.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.996+0000 7fec68e00640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec4406be30 0x7fec4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:42.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.996+0000 7fec61600640 1 -- 172.21.15.99:0/2770183945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7fec44073960 con 0x7fec640cfc90 2024-09-10T07:37:42.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.996+0000 7fec68e00640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec4406be30 0x7fec4406e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fec641f7980 tx=0x7fec50007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:42.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:42.999+0000 7fec61600640 1 -- 172.21.15.99:0/2770183945 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec58059210 con 0x7fec640cfc90 2024-09-10T07:37:43.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.208+0000 7fec6ac00640 1 -- 172.21.15.99:0/2770183945 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec6406cf00 con 0x7fec640cfc90 2024-09-10T07:37:43.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.208+0000 7fec61600640 1 -- 172.21.15.99:0/2770183945 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5229 (secure 0 0 0) 0x7fec5805d510 con 0x7fec640cfc90 2024-09-10T07:37:43.208 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:43.209 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":34,"btime":"2024-09-10T07:36:30:406568+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/2770940747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2770940747},{"type":"v1","addr":"172.21.15.187:6834","nonce":2770940747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":4997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/1207587759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1207587759},{"type":"v1","addr":"172.21.15.99:6836","nonce":1207587759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5463,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3753955373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3753955373},{"type":"v1","addr":"172.21.15.187:6835","nonce":3753955373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:36:26.770809+0000","modified":"2024-09-10T07:36:29.817237+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5466":{"gid":5466,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/3805850931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3805850931},{"type":"v1","addr":"172.21.15.99:6837","nonce":3805850931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5466,"qdb_cluster":[5466]},"id":4}]} 2024-09-10T07:37:43.209 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 34 2024-09-10T07:37:43.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 -- 172.21.15.99:0/2770183945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec4406be30 msgr2=0x7fec4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec4406be30 0x7fec4406e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fec641f7980 tx=0x7fec50007d50 comp rx=0 tx=0).stop 2024-09-10T07:37:43.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 -- 172.21.15.99:0/2770183945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 msgr2=0x7fec640cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 0x7fec640cc940 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fec5800c7f0 tx=0x7fec5800ccb0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 -- 172.21.15.99:0/2770183945 shutdown_connections 2024-09-10T07:37:43.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec6415e970 0x7fec640cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec640d2680 0x7fec64152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec4406be30 0x7fec4406e2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 --2- 172.21.15.99:0/2770183945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec640cfc90 0x7fec640cc940 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 -- 172.21.15.99:0/2770183945 >> 172.21.15.99:0/2770183945 conn(0x7fec6409de00 msgr2=0x7fec640b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:43.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 -- 172.21.15.99:0/2770183945 shutdown_connections 2024-09-10T07:37:43.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.211+0000 7fec6ac00640 1 -- 172.21.15.99:0/2770183945 wait complete. 2024-09-10T07:37:43.227 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:37:43.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.381+0000 7faa08200640 1 Processor -- start 2024-09-10T07:37:43.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.381+0000 7faa08200640 1 -- start start 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.382+0000 7faa08200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa0015ede0 0x7faa000afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.382+0000 7faa08200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa000b4ac0 0x7faa00071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.382+0000 7faa08200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa000b0200 con 0x7faa000cf830 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.382+0000 7faa08200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7faa000aec20 con 0x7faa0015ede0 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.382+0000 7faa08200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faa000aef00 con 0x7faa000b4ac0 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.382+0000 7faa05800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa0015ede0 0x7faa000afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.382+0000 7faa05800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa0015ede0 0x7faa000afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56476/0 (socket says 172.21.15.99:56476) 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.383+0000 7faa05800640 1 -- 172.21.15.99:0/2030120022 learned_addr learned my addr 172.21.15.99:0/2030120022 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.383+0000 7faa06200640 1 --2- 172.21.15.99:0/2030120022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa000b4ac0 0x7faa00071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.383+0000 7faa05800640 1 -- 172.21.15.99:0/2030120022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa000b4ac0 msgr2=0x7faa00071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:43.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.383+0000 7faa05800640 1 --2- 172.21.15.99:0/2030120022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa000b4ac0 0x7faa00071960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.383+0000 7faa05800640 1 -- 172.21.15.99:0/2030120022 >> v1:172.21.15.99:6789/0 conn(0x7faa000cf830 legacy=0x7faa000b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.383+0000 7faa05800640 1 -- 172.21.15.99:0/2030120022 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa000af1e0 con 0x7faa0015ede0 2024-09-10T07:37:43.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.383+0000 7fa9ffe00640 1 -- 172.21.15.99:0/2030120022 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524447459 0 0) 0x7faa000b0200 con 0x7faa000cf830 2024-09-10T07:37:43.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.384+0000 7faa05800640 1 --2- 172.21.15.99:0/2030120022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa0015ede0 0x7faa000afcc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009870 tx=0x7fa9f402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4d054d57fbf8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:43.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.384+0000 7fa9ffe00640 1 -- 172.21.15.99:0/2030120022 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4037070 con 0x7faa0015ede0 2024-09-10T07:37:43.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.384+0000 7fa9ffe00640 1 -- 172.21.15.99:0/2030120022 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4032440 con 0x7faa0015ede0 2024-09-10T07:37:43.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.384+0000 7fa9ffe00640 1 -- 172.21.15.99:0/2030120022 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4032810 con 0x7faa0015ede0 2024-09-10T07:37:43.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.385+0000 7faa08200640 1 -- 172.21.15.99:0/2030120022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa0015ede0 msgr2=0x7faa000afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.385+0000 7faa08200640 1 --2- 172.21.15.99:0/2030120022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa0015ede0 0x7faa000afcc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009870 tx=0x7fa9f402a250 comp rx=0 tx=0).stop 2024-09-10T07:37:43.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.385+0000 7faa08200640 1 -- 172.21.15.99:0/2030120022 shutdown_connections 2024-09-10T07:37:43.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.385+0000 7faa08200640 1 --2- 172.21.15.99:0/2030120022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa000b4ac0 0x7faa00071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.385+0000 7faa08200640 1 --2- 172.21.15.99:0/2030120022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa0015ede0 0x7faa000afcc0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.385+0000 7faa08200640 1 -- 172.21.15.99:0/2030120022 >> 172.21.15.99:0/2030120022 conn(0x7faa0006bc10 msgr2=0x7faa0006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:43.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.385+0000 7faa08200640 1 -- 172.21.15.99:0/2030120022 shutdown_connections 2024-09-10T07:37:43.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.385+0000 7faa08200640 1 -- 172.21.15.99:0/2030120022 wait complete. 2024-09-10T07:37:43.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.386+0000 7faa08200640 1 Processor -- start 2024-09-10T07:37:43.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.387+0000 7faa08200640 1 -- start start 2024-09-10T07:37:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.387+0000 7faa08200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa000b4ac0 0x7faa00149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.387+0000 7faa08200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa000cf830 0x7faa0006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.387+0000 7faa08200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa0015ede0 0x7faa00155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.387+0000 7faa08200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faa000ae840 con 0x7faa000b4ac0 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.387+0000 7faa08200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faa000af7a0 con 0x7faa000cf830 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.387+0000 7faa08200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faa000ae9c0 con 0x7faa0015ede0 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa05800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa000b4ac0 0x7faa00149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa05800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa000b4ac0 0x7faa00149380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56482/0 (socket says 172.21.15.99:56482) 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa05800640 1 -- 172.21.15.99:0/1732347790 learned_addr learned my addr 172.21.15.99:0/1732347790 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa04e00640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa000cf830 0x7faa0006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa06200640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa0015ede0 0x7faa00155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa05800640 1 -- 172.21.15.99:0/1732347790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa0015ede0 msgr2=0x7faa00155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa05800640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa0015ede0 0x7faa00155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa05800640 1 -- 172.21.15.99:0/1732347790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa000cf830 msgr2=0x7faa0006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa05800640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa000cf830 0x7faa0006dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa05800640 1 -- 172.21.15.99:0/1732347790 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0006f780 con 0x7faa000b4ac0 2024-09-10T07:37:43.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa04e00640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa000cf830 0x7faa0006dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:37:43.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.388+0000 7faa05800640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa000b4ac0 0x7faa00149380 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009870 tx=0x7fa9f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:43.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.389+0000 7fa9fd600640 1 -- 172.21.15.99:0/1732347790 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4037040 con 0x7faa000b4ac0 2024-09-10T07:37:43.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.389+0000 7fa9fd600640 1 -- 172.21.15.99:0/1732347790 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4004230 con 0x7faa000b4ac0 2024-09-10T07:37:43.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.389+0000 7faa08200640 1 -- 172.21.15.99:0/1732347790 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0006f1c0 con 0x7faa000b4ac0 2024-09-10T07:37:43.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.389+0000 7fa9fd600640 1 -- 172.21.15.99:0/1732347790 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4003610 con 0x7faa000b4ac0 2024-09-10T07:37:43.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.389+0000 7faa08200640 1 -- 172.21.15.99:0/1732347790 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa001605e0 con 0x7faa000b4ac0 2024-09-10T07:37:43.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.390+0000 7faa08200640 1 -- 172.21.15.99:0/1732347790 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa000cfca0 con 0x7faa000b4ac0 2024-09-10T07:37:43.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.391+0000 7fa9fd600640 1 -- 172.21.15.99:0/1732347790 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9f40037b0 con 0x7faa000b4ac0 2024-09-10T07:37:43.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.392+0000 7fa9fd600640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa9e006be30 0x7fa9e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.392+0000 7fa9fd600640 1 -- 172.21.15.99:0/1732347790 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fa9f40abc50 con 0x7faa000b4ac0 2024-09-10T07:37:43.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.392+0000 7faa04e00640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa9e006be30 0x7fa9e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.392+0000 7fa9fd600640 1 -- 172.21.15.99:0/1732347790 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7fa9e0073960 con 0x7faa000b4ac0 2024-09-10T07:37:43.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.393+0000 7faa04e00640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa9e006be30 0x7fa9e006e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faa00159630 tx=0x7fa9ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:43.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.396+0000 7fa9fd600640 1 -- 172.21.15.99:0/1732347790 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9f407a5f0 con 0x7faa000b4ac0 2024-09-10T07:37:43.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.574+0000 7faa08200640 1 -- 172.21.15.99:0/1732347790 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa00073420 con 0x7faa000b4ac0 2024-09-10T07:37:43.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.575+0000 7fa9fd600640 1 -- 172.21.15.99:0/1732347790 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16752 (secure 0 0 0) 0x7fa9f4079ef0 con 0x7faa000b4ac0 2024-09-10T07:37:43.575 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:43.575 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":70,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:37:42.973064+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:36:24.546261+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T07:36:25.773175+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:37:43.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.577+0000 7faa08200640 1 -- 172.21.15.99:0/1732347790 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa9e006be30 msgr2=0x7fa9e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.577+0000 7faa08200640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa9e006be30 0x7fa9e006e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faa00159630 tx=0x7fa9ec009040 comp rx=0 tx=0).stop 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.577+0000 7faa08200640 1 -- 172.21.15.99:0/1732347790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa000b4ac0 msgr2=0x7faa00149380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.577+0000 7faa08200640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa000b4ac0 0x7faa00149380 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009870 tx=0x7fa9f40046c0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.577+0000 7faa08200640 1 -- 172.21.15.99:0/1732347790 shutdown_connections 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.577+0000 7faa08200640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa0015ede0 0x7faa00155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.577+0000 7faa08200640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa000cf830 0x7faa0006dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.577+0000 7faa08200640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa9e006be30 0x7fa9e006e2f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.577+0000 7faa08200640 1 --2- 172.21.15.99:0/1732347790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa000b4ac0 0x7faa00149380 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.577+0000 7faa08200640 1 -- 172.21.15.99:0/1732347790 >> 172.21.15.99:0/1732347790 conn(0x7faa0006bc10 msgr2=0x7faa000ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.578+0000 7faa08200640 1 -- 172.21.15.99:0/1732347790 shutdown_connections 2024-09-10T07:37:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.578+0000 7faa08200640 1 -- 172.21.15.99:0/1732347790 wait complete. 2024-09-10T07:37:43.594 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:37:43.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.748+0000 7f22aa800640 1 Processor -- start 2024-09-10T07:37:43.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.748+0000 7f22aa800640 1 -- start start 2024-09-10T07:37:43.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.749+0000 7f22aa800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22a415ed10 0x7f22a40d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.749+0000 7f22aa800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f22a40d51a0 0x7f22a40d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.749+0000 7f22aa800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a40cf740 con 0x7f22a40d3070 2024-09-10T07:37:43.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.749+0000 7f22aa800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f22a40d5910 con 0x7f22a40d51a0 2024-09-10T07:37:43.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.749+0000 7f22aa800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f22a40d5630 con 0x7f22a415ed10 2024-09-10T07:37:43.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.749+0000 7f22a9400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f22a40d3070 0x7f22a40d3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43322/0 (socket says 172.21.15.99:43322) 2024-09-10T07:37:43.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.749+0000 7f22a9400640 1 -- 172.21.15.99:0/1950455032 learned_addr learned my addr 172.21.15.99:0/1950455032 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:43.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.750+0000 7f22a9e00640 1 --2- 172.21.15.99:0/1950455032 >> v2:172.21.15.187:3300/0 conn(0x7f22a40d51a0 0x7f22a40d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.750+0000 7f22a8a00640 1 --2- 172.21.15.99:0/1950455032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22a415ed10 0x7f22a40d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.750+0000 7f22a3e00640 1 -- 172.21.15.99:0/1950455032 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640424790 0 0) 0x7f22a40cf740 con 0x7f22a40d3070 2024-09-10T07:37:43.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.750+0000 7f22a3e00640 1 -- 172.21.15.99:0/1950455032 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f228c003520 con 0x7f22a40d3070 2024-09-10T07:37:43.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.750+0000 7f22a9e00640 1 -- 172.21.15.99:0/1950455032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22a415ed10 msgr2=0x7f22a40d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:43.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.750+0000 7f22a9e00640 1 --2- 172.21.15.99:0/1950455032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22a415ed10 0x7f22a40d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.750+0000 7f22a9e00640 1 -- 172.21.15.99:0/1950455032 >> v1:172.21.15.99:6789/0 conn(0x7f22a40d3070 legacy=0x7f22a40d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.750+0000 7f22a9e00640 1 -- 172.21.15.99:0/1950455032 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a40cf9e0 con 0x7f22a40d51a0 2024-09-10T07:37:43.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.751+0000 7f22a9e00640 1 --2- 172.21.15.99:0/1950455032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22a40d51a0 0x7f22a40d01e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f229c009d90 tx=0x7f229c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32088052d020479d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:43.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.751+0000 7f22a3e00640 1 -- 172.21.15.99:0/1950455032 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c007740 con 0x7f22a40d51a0 2024-09-10T07:37:43.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.751+0000 7f22a3e00640 1 -- 172.21.15.99:0/1950455032 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229c0078e0 con 0x7f22a40d51a0 2024-09-10T07:37:43.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.751+0000 7f22a3e00640 1 -- 172.21.15.99:0/1950455032 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c007cb0 con 0x7f22a40d51a0 2024-09-10T07:37:43.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.752+0000 7f22aa800640 1 -- 172.21.15.99:0/1950455032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22a40d51a0 msgr2=0x7f22a40d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.752+0000 7f22aa800640 1 --2- 172.21.15.99:0/1950455032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22a40d51a0 0x7f22a40d01e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f229c009d90 tx=0x7f229c02a6f0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.752+0000 7f22aa800640 1 -- 172.21.15.99:0/1950455032 shutdown_connections 2024-09-10T07:37:43.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.752+0000 7f22aa800640 1 --2- 172.21.15.99:0/1950455032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22a40d51a0 0x7f22a40d01e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.752+0000 7f22aa800640 1 --2- 172.21.15.99:0/1950455032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22a415ed10 0x7f22a40d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.752+0000 7f22aa800640 1 -- 172.21.15.99:0/1950455032 >> 172.21.15.99:0/1950455032 conn(0x7f22a409dd60 msgr2=0x7f22a40d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:43.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.752+0000 7f22aa800640 1 -- 172.21.15.99:0/1950455032 shutdown_connections 2024-09-10T07:37:43.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.752+0000 7f22aa800640 1 -- 172.21.15.99:0/1950455032 wait complete. 2024-09-10T07:37:43.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.754+0000 7f22aa800640 1 Processor -- start 2024-09-10T07:37:43.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.754+0000 7f22aa800640 1 -- start start 2024-09-10T07:37:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22aa800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22a40d3070 0x7f22a40ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22aa800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22a415ed10 0x7f22a415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22aa800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22a415db60 0x7f22a40cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22aa800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22a40d2d20 con 0x7f22a415ed10 2024-09-10T07:37:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22aa800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f22a40d2ba0 con 0x7f22a415db60 2024-09-10T07:37:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22aa800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f22a40d0720 con 0x7f22a40d3070 2024-09-10T07:37:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22a8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22a415ed10 0x7f22a415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22a8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22a415ed10 0x7f22a415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56498/0 (socket says 172.21.15.99:56498) 2024-09-10T07:37:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22a8a00640 1 -- 172.21.15.99:0/2797761744 learned_addr learned my addr 172.21.15.99:0/2797761744 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:43.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22a9400640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22a40d3070 0x7f22a40ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22a9e00640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22a415db60 0x7f22a40cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22a8a00640 1 -- 172.21.15.99:0/2797761744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22a40d3070 msgr2=0x7f22a40ba470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22a8a00640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22a40d3070 0x7f22a40ba470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22a8a00640 1 -- 172.21.15.99:0/2797761744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22a415db60 msgr2=0x7f22a40cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22a8a00640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22a415db60 0x7f22a40cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.755+0000 7f22a8a00640 1 -- 172.21.15.99:0/2797761744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a40b79f0 con 0x7f22a415ed10 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.756+0000 7f22a8a00640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22a415ed10 0x7f22a415d340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f229000e8d0 tx=0x7f229000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.756+0000 7f22a1600640 1 -- 172.21.15.99:0/2797761744 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290017070 con 0x7f22a415ed10 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.756+0000 7f22a1600640 1 -- 172.21.15.99:0/2797761744 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229000c940 con 0x7f22a415ed10 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.756+0000 7f22aa800640 1 -- 172.21.15.99:0/2797761744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a415e3c0 con 0x7f22a415ed10 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.756+0000 7f22a1600640 1 -- 172.21.15.99:0/2797761744 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229000cd30 con 0x7f22a415ed10 2024-09-10T07:37:43.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.756+0000 7f22aa800640 1 -- 172.21.15.99:0/2797761744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a40b7f70 con 0x7f22a415ed10 2024-09-10T07:37:43.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.757+0000 7f22aa800640 1 -- 172.21.15.99:0/2797761744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a40d01e0 con 0x7f22a415ed10 2024-09-10T07:37:43.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.758+0000 7f22a1600640 1 -- 172.21.15.99:0/2797761744 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f229001a070 con 0x7f22a415ed10 2024-09-10T07:37:43.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.759+0000 7f22a1600640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f228406be60 0x7f228406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:43.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.759+0000 7f22a1600640 1 -- 172.21.15.99:0/2797761744 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f229008ad00 con 0x7f22a415ed10 2024-09-10T07:37:43.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.759+0000 7f22a9400640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f228406be60 0x7f228406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:43.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.759+0000 7f22a1600640 1 -- 172.21.15.99:0/2797761744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7f2284073990 con 0x7f22a415ed10 2024-09-10T07:37:43.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.760+0000 7f22a9400640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f228406be60 0x7f228406e320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2298007fd0 tx=0x7f2298009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:43.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.763+0000 7f22a1600640 1 -- 172.21.15.99:0/2797761744 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2290059760 con 0x7f22a415ed10 2024-09-10T07:37:43.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.969+0000 7f22aa800640 1 -- 172.21.15.99:0/2797761744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f22a40d4870 con 0x7f22a415ed10 2024-09-10T07:37:43.969 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:37:43.970+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:37:43.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.971+0000 7f22a1600640 1 -- 172.21.15.99:0/2797761744 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f2290059060 con 0x7f22a415ed10 2024-09-10T07:37:43.971 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:37:43.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.972+0000 7f22a1600640 1 -- 172.21.15.99:0/2797761744 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(71..71 src has 1..71) ==== 374+0+0 (secure 0 0 0) 0x7f2290057100 con 0x7f22a415ed10 2024-09-10T07:37:43.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.972+0000 7f22a1600640 1 -- 172.21.15.99:0/2797761744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=72}) -- 0x7f2284074300 con 0x7f22a415ed10 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.975+0000 7f22aa800640 1 -- 172.21.15.99:0/2797761744 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f228406be60 msgr2=0x7f228406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.975+0000 7f22aa800640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f228406be60 0x7f228406e320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2298007fd0 tx=0x7f2298009040 comp rx=0 tx=0).stop 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.975+0000 7f22aa800640 1 -- 172.21.15.99:0/2797761744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22a415ed10 msgr2=0x7f22a415d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.975+0000 7f22aa800640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22a415ed10 0x7f22a415d340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f229000e8d0 tx=0x7f229000ed90 comp rx=0 tx=0).stop 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.976+0000 7f22aa800640 1 -- 172.21.15.99:0/2797761744 shutdown_connections 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.976+0000 7f22aa800640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22a415db60 0x7f22a40cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.976+0000 7f22aa800640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f228406be60 0x7f228406e320 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.976+0000 7f22aa800640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22a415ed10 0x7f22a415d340 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.976+0000 7f22aa800640 1 --2- 172.21.15.99:0/2797761744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22a40d3070 0x7f22a40ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.976+0000 7f22aa800640 1 -- 172.21.15.99:0/2797761744 >> 172.21.15.99:0/2797761744 conn(0x7f22a409dd60 msgr2=0x7f22a4161100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.976+0000 7f22aa800640 1 -- 172.21.15.99:0/2797761744 shutdown_connections 2024-09-10T07:37:43.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:43.976+0000 7f22aa800640 1 -- 172.21.15.99:0/2797761744 wait complete. 2024-09-10T07:37:43.994 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:37:44.040 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:37:44.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.151+0000 7f4327000640 1 Processor -- start 2024-09-10T07:37:44.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.151+0000 7f4327000640 1 -- start start 2024-09-10T07:37:44.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.152+0000 7f4327000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4320071df0 0x7f4320073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:44.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.152+0000 7f4327000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43200722d0 con 0x7f43200d1010 2024-09-10T07:37:44.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.152+0000 7f4327000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43200725b0 con 0x7f432006e280 2024-09-10T07:37:44.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.152+0000 7f4327000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f43200738b0 con 0x7f4320071df0 2024-09-10T07:37:44.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.153+0000 7f4325000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f43200d1010 0x7f43200ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43330/0 (socket says 172.21.15.99:43330) 2024-09-10T07:37:44.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.153+0000 7f4325000640 1 -- 172.21.15.99:0/2772853044 learned_addr learned my addr 172.21.15.99:0/2772853044 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:44.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.153+0000 7f431f400640 1 --2- 172.21.15.99:0/2772853044 >> v2:172.21.15.187:3300/0 conn(0x7f4320071df0 0x7f4320073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:44.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.153+0000 7f431ea00640 1 -- 172.21.15.99:0/2772853044 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328232849 0 0) 0x7f43200722d0 con 0x7f43200d1010 2024-09-10T07:37:44.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.153+0000 7f431ea00640 1 -- 172.21.15.99:0/2772853044 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4304003520 con 0x7f43200d1010 2024-09-10T07:37:44.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.153+0000 7f431f400640 1 -- 172.21.15.99:0/2772853044 >> v1:172.21.15.187:6789/0 conn(0x7f432006e280 legacy=0x7f432006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:44.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.153+0000 7f431f400640 1 -- 172.21.15.99:0/2772853044 >> v1:172.21.15.99:6789/0 conn(0x7f43200d1010 legacy=0x7f43200ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:44.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.153+0000 7f431f400640 1 -- 172.21.15.99:0/2772853044 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4320072890 con 0x7f4320071df0 2024-09-10T07:37:44.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.154+0000 7f431f400640 1 --2- 172.21.15.99:0/2772853044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4320071df0 0x7f4320073370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f430c0097a0 tx=0x7f430c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc61c8ae1df86e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:44.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.154+0000 7f431ea00640 1 -- 172.21.15.99:0/2772853044 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c037070 con 0x7f4320071df0 2024-09-10T07:37:44.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.154+0000 7f431ea00640 1 -- 172.21.15.99:0/2772853044 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430c032440 con 0x7f4320071df0 2024-09-10T07:37:44.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.154+0000 7f431ea00640 1 -- 172.21.15.99:0/2772853044 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c032810 con 0x7f4320071df0 2024-09-10T07:37:44.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.155+0000 7f4327000640 1 -- 172.21.15.99:0/2772853044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4320071df0 msgr2=0x7f4320073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:44.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.155+0000 7f4327000640 1 --2- 172.21.15.99:0/2772853044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4320071df0 0x7f4320073370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f430c0097a0 tx=0x7f430c02a230 comp rx=0 tx=0).stop 2024-09-10T07:37:44.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.155+0000 7f4327000640 1 -- 172.21.15.99:0/2772853044 shutdown_connections 2024-09-10T07:37:44.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.155+0000 7f4327000640 1 --2- 172.21.15.99:0/2772853044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4320071df0 0x7f4320073370 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:44.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.155+0000 7f4327000640 1 -- 172.21.15.99:0/2772853044 >> 172.21.15.99:0/2772853044 conn(0x7f432006bc10 msgr2=0x7f432006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:44.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.155+0000 7f4327000640 1 -- 172.21.15.99:0/2772853044 shutdown_connections 2024-09-10T07:37:44.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.155+0000 7f4327000640 1 -- 172.21.15.99:0/2772853044 wait complete. 2024-09-10T07:37:44.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.157+0000 7f4327000640 1 Processor -- start 2024-09-10T07:37:44.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.157+0000 7f4327000640 1 -- start start 2024-09-10T07:37:44.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f4327000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f432006e280 0x7f43201f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:44.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f4327000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4320071df0 0x7f43201539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:44.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f4327000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43200d1010 0x7f4320151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:44.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f4327000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f432015db60 con 0x7f432006e280 2024-09-10T07:37:44.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f4327000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4320072e50 con 0x7f4320071df0 2024-09-10T07:37:44.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f4327000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f43200d14c0 con 0x7f43200d1010 2024-09-10T07:37:44.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f431fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f432006e280 0x7f43201f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:44.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f431fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f432006e280 0x7f43201f47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56528/0 (socket says 172.21.15.99:56528) 2024-09-10T07:37:44.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f431fe00640 1 -- 172.21.15.99:0/2528590513 learned_addr learned my addr 172.21.15.99:0/2528590513 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:44.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f431f400640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4320071df0 0x7f43201539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.158+0000 7f4325000640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43200d1010 0x7f4320151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f431fe00640 1 -- 172.21.15.99:0/2528590513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43200d1010 msgr2=0x7f4320151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f431fe00640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43200d1010 0x7f4320151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f431fe00640 1 -- 172.21.15.99:0/2528590513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4320071df0 msgr2=0x7f43201539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f431fe00640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4320071df0 0x7f43201539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f431fe00640 1 -- 172.21.15.99:0/2528590513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4320153ef0 con 0x7f432006e280 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f4325000640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43200d1010 0x7f4320151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f431f400640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4320071df0 0x7f43201539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f431fe00640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f432006e280 0x7f43201f47f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f431000c790 tx=0x7f431000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f4317e00640 1 -- 172.21.15.99:0/2528590513 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310016020 con 0x7f432006e280 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f4317e00640 1 -- 172.21.15.99:0/2528590513 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4310006d50 con 0x7f432006e280 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f4317e00640 1 -- 172.21.15.99:0/2528590513 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310003bb0 con 0x7f432006e280 2024-09-10T07:37:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f4327000640 1 -- 172.21.15.99:0/2528590513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43201f4ef0 con 0x7f432006e280 2024-09-10T07:37:44.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.159+0000 7f4327000640 1 -- 172.21.15.99:0/2528590513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43201f54b0 con 0x7f432006e280 2024-09-10T07:37:44.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.160+0000 7f4327000640 1 -- 172.21.15.99:0/2528590513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43201f56f0 con 0x7f432006e280 2024-09-10T07:37:44.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.161+0000 7f4317e00640 1 -- 172.21.15.99:0/2528590513 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f431000a850 con 0x7f432006e280 2024-09-10T07:37:44.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.162+0000 7f4317e00640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f430006be30 0x7f430006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:44.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.162+0000 7f4317e00640 1 -- 172.21.15.99:0/2528590513 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5795+0+0 (secure 0 0 0) 0x7f431008ab50 con 0x7f432006e280 2024-09-10T07:37:44.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.162+0000 7f4317e00640 1 -- 172.21.15.99:0/2528590513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=72}) -- 0x7f4300073a70 con 0x7f432006e280 2024-09-10T07:37:44.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.162+0000 7f431f400640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f430006be30 0x7f430006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:44.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.163+0000 7f431f400640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f430006be30 0x7f430006e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f430c034000 tx=0x7f430c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:44.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.166+0000 7f4317e00640 1 -- 172.21.15.99:0/2528590513 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43201f56f0 con 0x7f432006e280 2024-09-10T07:37:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.373+0000 7f4327000640 1 -- 172.21.15.99:0/2528590513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4320073370 con 0x7f432006e280 2024-09-10T07:37:44.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.989+0000 7f4317e00640 1 -- 172.21.15.99:0/2528590513 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7f4310020020 con 0x7f432006e280 2024-09-10T07:37:44.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.990+0000 7f4317e00640 1 -- 172.21.15.99:0/2528590513 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(72..72 src has 1..72) ==== 296+0+0 (secure 0 0 0) 0x7f4310089130 con 0x7f432006e280 2024-09-10T07:37:44.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.990+0000 7f4317e00640 1 -- 172.21.15.99:0/2528590513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=73}) -- 0x7f4300074530 con 0x7f432006e280 2024-09-10T07:37:44.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.993+0000 7f4327000640 1 -- 172.21.15.99:0/2528590513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f430006be30 msgr2=0x7f430006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.993+0000 7f4327000640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f430006be30 0x7f430006e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f430c034000 tx=0x7f430c02e000 comp rx=0 tx=0).stop 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.993+0000 7f4327000640 1 -- 172.21.15.99:0/2528590513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f432006e280 msgr2=0x7f43201f47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.993+0000 7f4327000640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f432006e280 0x7f43201f47f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f431000c790 tx=0x7f431000cc50 comp rx=0 tx=0).stop 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.993+0000 7f4327000640 1 -- 172.21.15.99:0/2528590513 shutdown_connections 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.993+0000 7f4327000640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f43200d1010 0x7f4320151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.993+0000 7f4327000640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4320071df0 0x7f43201539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.993+0000 7f4327000640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f430006be30 0x7f430006e2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.993+0000 7f4327000640 1 --2- 172.21.15.99:0/2528590513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f432006e280 0x7f43201f47f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.993+0000 7f4327000640 1 -- 172.21.15.99:0/2528590513 >> 172.21.15.99:0/2528590513 conn(0x7f432006bc10 msgr2=0x7f43200b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.994+0000 7f4327000640 1 -- 172.21.15.99:0/2528590513 shutdown_connections 2024-09-10T07:37:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:44.994+0000 7f4327000640 1 -- 172.21.15.99:0/2528590513 wait complete. 2024-09-10T07:37:45.013 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:37:45.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.173+0000 7f809f000640 1 Processor -- start 2024-09-10T07:37:45.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.174+0000 7f809f000640 1 -- start start 2024-09-10T07:37:45.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.175+0000 7f809f000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80980ced50 0x7f8098072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:45.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.175+0000 7f809f000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8098144980 0x7f8098072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:45.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.175+0000 7f809f000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8098160310 con 0x7f80981445a0 2024-09-10T07:37:45.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.175+0000 7f809f000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f80980b4d20 con 0x7f80980ced50 2024-09-10T07:37:45.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.175+0000 7f809f000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f809815fdd0 con 0x7f8098144980 2024-09-10T07:37:45.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.175+0000 7f808f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80980ced50 0x7f8098072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:45.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.175+0000 7f808f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80980ced50 0x7f8098072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56540/0 (socket says 172.21.15.99:56540) 2024-09-10T07:37:45.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.175+0000 7f808f400640 1 -- 172.21.15.99:0/3781019531 learned_addr learned my addr 172.21.15.99:0/3781019531 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:45.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.175+0000 7f809d000640 1 --2- 172.21.15.99:0/3781019531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8098144980 0x7f8098072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.176+0000 7f808f400640 1 -- 172.21.15.99:0/3781019531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8098144980 msgr2=0x7f8098072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.176+0000 7f808f400640 1 --2- 172.21.15.99:0/3781019531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8098144980 0x7f8098072bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.176+0000 7f808f400640 1 -- 172.21.15.99:0/3781019531 >> v1:172.21.15.187:6789/0 conn(0x7f80981445a0 legacy=0x7f80980cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.176+0000 7f808f400640 1 -- 172.21.15.99:0/3781019531 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8098160030 con 0x7f80980ced50 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.177+0000 7f808f400640 1 --2- 172.21.15.99:0/3781019531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80980ced50 0x7f8098072680 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f80800098a0 tx=0x7f808002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664797e9336fd582 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.177+0000 7f8097400640 1 -- 172.21.15.99:0/3781019531 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8080037070 con 0x7f80980ced50 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.177+0000 7f8097400640 1 -- 172.21.15.99:0/3781019531 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808002ae20 con 0x7f80980ced50 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.177+0000 7f8097400640 1 -- 172.21.15.99:0/3781019531 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8080032660 con 0x7f80980ced50 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.177+0000 7f809f000640 1 -- 172.21.15.99:0/3781019531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80980ced50 msgr2=0x7f8098072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.177+0000 7f809f000640 1 --2- 172.21.15.99:0/3781019531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80980ced50 0x7f8098072680 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f80800098a0 tx=0x7f808002a110 comp rx=0 tx=0).stop 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.177+0000 7f809f000640 1 -- 172.21.15.99:0/3781019531 shutdown_connections 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.177+0000 7f809f000640 1 --2- 172.21.15.99:0/3781019531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8098144980 0x7f8098072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:45.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.177+0000 7f809f000640 1 --2- 172.21.15.99:0/3781019531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80980ced50 0x7f8098072680 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:45.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.177+0000 7f809f000640 1 -- 172.21.15.99:0/3781019531 >> 172.21.15.99:0/3781019531 conn(0x7f80980b26a0 msgr2=0x7f80980b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:45.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.178+0000 7f809f000640 1 -- 172.21.15.99:0/3781019531 shutdown_connections 2024-09-10T07:37:45.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.178+0000 7f809f000640 1 -- 172.21.15.99:0/3781019531 wait complete. 2024-09-10T07:37:45.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.179+0000 7f809f000640 1 Processor -- start 2024-09-10T07:37:45.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.179+0000 7f809f000640 1 -- start start 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.180+0000 7f809f000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80980ced50 0x7f809815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.180+0000 7f809f000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80981445a0 0x7f80980cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.180+0000 7f809f000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098144980 0x7f80980cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.180+0000 7f809f000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f80980b5c20 con 0x7f8098144980 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.180+0000 7f809f000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f80980b5f00 con 0x7f80980ced50 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.180+0000 7f809f000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8098144ec0 con 0x7f80981445a0 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.180+0000 7f809d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098144980 0x7f80980cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f809d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098144980 0x7f80980cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56552/0 (socket says 172.21.15.99:56552) 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f809d000640 1 -- 172.21.15.99:0/1364317581 learned_addr learned my addr 172.21.15.99:0/1364317581 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f808f400640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80981445a0 0x7f80980cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f8097e00640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80980ced50 0x7f809815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f809d000640 1 -- 172.21.15.99:0/1364317581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80981445a0 msgr2=0x7f80980cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:45.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f809d000640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80981445a0 0x7f80980cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:45.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f809d000640 1 -- 172.21.15.99:0/1364317581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80980ced50 msgr2=0x7f809815b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:45.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f809d000640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80980ced50 0x7f809815b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:45.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f809d000640 1 -- 172.21.15.99:0/1364317581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8098143a90 con 0x7f8098144980 2024-09-10T07:37:45.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f809d000640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098144980 0x7f80980cf690 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8090007d40 tx=0x7f809000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:45.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.181+0000 7f8094c00640 1 -- 172.21.15.99:0/1364317581 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090014420 con 0x7f8098144980 2024-09-10T07:37:45.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.182+0000 7f8094c00640 1 -- 172.21.15.99:0/1364317581 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8090019070 con 0x7f8098144980 2024-09-10T07:37:45.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.182+0000 7f8094c00640 1 -- 172.21.15.99:0/1364317581 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090014820 con 0x7f8098144980 2024-09-10T07:37:45.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.182+0000 7f809f000640 1 -- 172.21.15.99:0/1364317581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809815e110 con 0x7f8098144980 2024-09-10T07:37:45.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.182+0000 7f809f000640 1 -- 172.21.15.99:0/1364317581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809815e6d0 con 0x7f8098144980 2024-09-10T07:37:45.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.183+0000 7f809f000640 1 -- 172.21.15.99:0/1364317581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809815bc00 con 0x7f8098144980 2024-09-10T07:37:45.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.184+0000 7f8094c00640 1 -- 172.21.15.99:0/1364317581 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80900149c0 con 0x7f8098144980 2024-09-10T07:37:45.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.184+0000 7f8094c00640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f807406be30 0x7f807406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:45.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.185+0000 7f8094c00640 1 -- 172.21.15.99:0/1364317581 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f809008b5b0 con 0x7f8098144980 2024-09-10T07:37:45.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.185+0000 7f8097e00640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f807406be30 0x7f807406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:45.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.185+0000 7f8094c00640 1 -- 172.21.15.99:0/1364317581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=73}) -- 0x7f8074073a70 con 0x7f8098144980 2024-09-10T07:37:45.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.185+0000 7f8097e00640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f807406be30 0x7f807406e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80980b1000 tx=0x7f8088007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:45.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.189+0000 7f8094c00640 1 -- 172.21.15.99:0/1364317581 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8090059810 con 0x7f8098144980 2024-09-10T07:37:45.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.360+0000 7f809f000640 1 -- 172.21.15.99:0/1364317581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f809815b690 con 0x7f8098144980 2024-09-10T07:37:45.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.991+0000 7f8094c00640 1 -- 172.21.15.99:0/1364317581 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) ==== 181+0+0 (secure 0 0 0) 0x7f809005db10 con 0x7f8098144980 2024-09-10T07:37:45.991 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:37:45.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.992+0000 7f8094c00640 1 -- 172.21.15.99:0/1364317581 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(73..73 src has 1..73) ==== 304+0+0 (secure 0 0 0) 0x7f80900bfd50 con 0x7f8098144980 2024-09-10T07:37:45.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.992+0000 7f8094c00640 1 -- 172.21.15.99:0/1364317581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=74}) -- 0x7f8074071ea0 con 0x7f8098144980 2024-09-10T07:37:45.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.997+0000 7f809f000640 1 -- 172.21.15.99:0/1364317581 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f807406be30 msgr2=0x7f807406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:45.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.997+0000 7f809f000640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f807406be30 0x7f807406e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80980b1000 tx=0x7f8088007e30 comp rx=0 tx=0).stop 2024-09-10T07:37:45.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.997+0000 7f809f000640 1 -- 172.21.15.99:0/1364317581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098144980 msgr2=0x7f80980cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:45.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.997+0000 7f809f000640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098144980 0x7f80980cf690 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8090007d40 tx=0x7f809000e4b0 comp rx=0 tx=0).stop 2024-09-10T07:37:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.999+0000 7f809f000640 1 -- 172.21.15.99:0/1364317581 shutdown_connections 2024-09-10T07:37:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.999+0000 7f809f000640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f807406be30 0x7f807406e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.999+0000 7f809f000640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8098144980 0x7f80980cf690 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.999+0000 7f809f000640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80981445a0 0x7f80980cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.999+0000 7f809f000640 1 --2- 172.21.15.99:0/1364317581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80980ced50 0x7f809815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:45.999+0000 7f809f000640 1 -- 172.21.15.99:0/1364317581 >> 172.21.15.99:0/1364317581 conn(0x7f80980b26a0 msgr2=0x7f809806d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:46.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.000+0000 7f809f000640 1 -- 172.21.15.99:0/1364317581 shutdown_connections 2024-09-10T07:37:46.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.000+0000 7f809f000640 1 -- 172.21.15.99:0/1364317581 wait complete. 2024-09-10T07:37:46.021 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:37:46.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.181+0000 7fd8b0400640 1 Processor -- start 2024-09-10T07:37:46.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.182+0000 7fd8b0400640 1 -- start start 2024-09-10T07:37:46.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.183+0000 7fd8b0400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80ced50 0x7fd8a8072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:46.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.183+0000 7fd8b0400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd8a8144980 0x7fd8a8072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:46.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.183+0000 7fd8b0400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a8160310 con 0x7fd8a81445a0 2024-09-10T07:37:46.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.183+0000 7fd8b0400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a80b4d20 con 0x7fd8a8144980 2024-09-10T07:37:46.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.183+0000 7fd8b0400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a815fdd0 con 0x7fd8a80ced50 2024-09-10T07:37:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.183+0000 7fd8ad000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80ced50 0x7fd8a8072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.183+0000 7fd8ae400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd8a8144980 0x7fd8a8072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.184+0000 7fd8ad000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80ced50 0x7fd8a8072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:37760/0 (socket says 172.21.15.99:37760) 2024-09-10T07:37:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.184+0000 7fd8ad000640 1 -- 172.21.15.99:0/1290415941 learned_addr learned my addr 172.21.15.99:0/1290415941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.184+0000 7fd8ada00640 1 --1- 172.21.15.99:0/1290415941 >> v1:172.21.15.187:6789/0 conn(0x7fd8a81445a0 0x7fd8a80cd380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:50458/0 (socket says 172.21.15.99:50458) 2024-09-10T07:37:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.184+0000 7fd8ad000640 1 -- 172.21.15.99:0/1290415941 >> v2:172.21.15.187:3300/0 conn(0x7fd8a8144980 msgr2=0x7fd8a8072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.184+0000 7fd8ad000640 1 --2- 172.21.15.99:0/1290415941 >> v2:172.21.15.187:3300/0 conn(0x7fd8a8144980 0x7fd8a8072bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.184+0000 7fd8ad000640 1 -- 172.21.15.99:0/1290415941 >> v1:172.21.15.187:6789/0 conn(0x7fd8a81445a0 legacy=0x7fd8a80cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.184+0000 7fd8ad000640 1 -- 172.21.15.99:0/1290415941 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a8160030 con 0x7fd8a80ced50 2024-09-10T07:37:46.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.184+0000 7fd8ae400640 1 --2- 172.21.15.99:0/1290415941 >> v2:172.21.15.187:3300/0 conn(0x7fd8a8144980 0x7fd8a8072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:37:46.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.185+0000 7fd8ad000640 1 --2- 172.21.15.99:0/1290415941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80ced50 0x7fd8a8072680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd894009870 tx=0x7fd89402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92ec2b5c5277407d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:46.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.185+0000 7fd8a7e00640 1 -- 172.21.15.99:0/1290415941 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894037070 con 0x7fd8a80ced50 2024-09-10T07:37:46.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.185+0000 7fd8a7e00640 1 -- 172.21.15.99:0/1290415941 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd894032440 con 0x7fd8a80ced50 2024-09-10T07:37:46.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.185+0000 7fd8a7e00640 1 -- 172.21.15.99:0/1290415941 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894032810 con 0x7fd8a80ced50 2024-09-10T07:37:46.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.186+0000 7fd8b0400640 1 -- 172.21.15.99:0/1290415941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80ced50 msgr2=0x7fd8a8072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:46.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.186+0000 7fd8b0400640 1 --2- 172.21.15.99:0/1290415941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80ced50 0x7fd8a8072680 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd894009870 tx=0x7fd89402a130 comp rx=0 tx=0).stop 2024-09-10T07:37:46.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.186+0000 7fd8b0400640 1 -- 172.21.15.99:0/1290415941 shutdown_connections 2024-09-10T07:37:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.186+0000 7fd8b0400640 1 --2- 172.21.15.99:0/1290415941 >> v2:172.21.15.187:3300/0 conn(0x7fd8a8144980 0x7fd8a8072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.186+0000 7fd8b0400640 1 --2- 172.21.15.99:0/1290415941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80ced50 0x7fd8a8072680 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.186+0000 7fd8b0400640 1 -- 172.21.15.99:0/1290415941 >> 172.21.15.99:0/1290415941 conn(0x7fd8a80b26a0 msgr2=0x7fd8a80b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.186+0000 7fd8b0400640 1 -- 172.21.15.99:0/1290415941 shutdown_connections 2024-09-10T07:37:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.186+0000 7fd8b0400640 1 -- 172.21.15.99:0/1290415941 wait complete. 2024-09-10T07:37:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.188+0000 7fd8b0400640 1 Processor -- start 2024-09-10T07:37:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.188+0000 7fd8b0400640 1 -- start start 2024-09-10T07:37:46.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8b0400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a80ced50 0x7fd8a81e5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:46.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8b0400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a81445a0 0x7fd8a815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:46.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8b0400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8a8144980 0x7fd8a813f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:46.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8b0400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a80b5c20 con 0x7fd8a8144980 2024-09-10T07:37:46.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8b0400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a80b5f00 con 0x7fd8a80ced50 2024-09-10T07:37:46.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8b0400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a8144ec0 con 0x7fd8a81445a0 2024-09-10T07:37:46.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8ae400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8a8144980 0x7fd8a813f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:46.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8ae400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8a8144980 0x7fd8a813f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56560/0 (socket says 172.21.15.99:56560) 2024-09-10T07:37:46.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8ae400640 1 -- 172.21.15.99:0/615119810 learned_addr learned my addr 172.21.15.99:0/615119810 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:46.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8ada00640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a80ced50 0x7fd8a81e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:46.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8ad000640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a81445a0 0x7fd8a815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:46.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8ae400640 1 -- 172.21.15.99:0/615119810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a81445a0 msgr2=0x7fd8a815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:46.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.189+0000 7fd8ae400640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a81445a0 0x7fd8a815c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:46.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.190+0000 7fd8ae400640 1 -- 172.21.15.99:0/615119810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a80ced50 msgr2=0x7fd8a81e5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:46.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.190+0000 7fd8ae400640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a80ced50 0x7fd8a81e5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:46.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.190+0000 7fd8ae400640 1 -- 172.21.15.99:0/615119810 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a81e5f00 con 0x7fd8a8144980 2024-09-10T07:37:46.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.190+0000 7fd8ae400640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8a8144980 0x7fd8a813f200 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009e10 tx=0x7fd8a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:46.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.190+0000 7fd8a5600640 1 -- 172.21.15.99:0/615119810 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0018020 con 0x7fd8a8144980 2024-09-10T07:37:46.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.190+0000 7fd8a5600640 1 -- 172.21.15.99:0/615119810 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a0014480 con 0x7fd8a8144980 2024-09-10T07:37:46.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.190+0000 7fd8b0400640 1 -- 172.21.15.99:0/615119810 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a81e61e0 con 0x7fd8a8144980 2024-09-10T07:37:46.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.190+0000 7fd8a5600640 1 -- 172.21.15.99:0/615119810 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0014850 con 0x7fd8a8144980 2024-09-10T07:37:46.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.190+0000 7fd8b0400640 1 -- 172.21.15.99:0/615119810 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a81e67a0 con 0x7fd8a8144980 2024-09-10T07:37:46.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.191+0000 7fd8b0400640 1 -- 172.21.15.99:0/615119810 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a815bc00 con 0x7fd8a8144980 2024-09-10T07:37:46.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.192+0000 7fd8a5600640 1 -- 172.21.15.99:0/615119810 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8a0005d10 con 0x7fd8a8144980 2024-09-10T07:37:46.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.193+0000 7fd8a5600640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd88806be60 0x7fd88806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:46.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.194+0000 7fd8a5600640 1 -- 172.21.15.99:0/615119810 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5357+0+0 (secure 0 0 0) 0x7fd8a008b880 con 0x7fd8a8144980 2024-09-10T07:37:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.194+0000 7fd8ada00640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd88806be60 0x7fd88806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.194+0000 7fd8a5600640 1 -- 172.21.15.99:0/615119810 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=74}) -- 0x7fd888072c30 con 0x7fd8a8144980 2024-09-10T07:37:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.194+0000 7fd8ada00640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd88806be60 0x7fd88806e320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd89c007fd0 tx=0x7fd89c007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:46.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.198+0000 7fd8a5600640 1 -- 172.21.15.99:0/615119810 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8a0022030 con 0x7fd8a8144980 2024-09-10T07:37:46.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:46.370+0000 7fd8b0400640 1 -- 172.21.15.99:0/615119810 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd8a80b1170 con 0x7fd8a8144980 2024-09-10T07:37:46.717 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:37:46.721 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:37:47.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.010+0000 7fd8a5600640 1 -- 172.21.15.99:0/615119810 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) ==== 169+0+0 (secure 0 0 0) 0x7fd8a006f020 con 0x7fd8a8144980 2024-09-10T07:37:47.010 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:37:47.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.010+0000 7fd8a5600640 1 -- 172.21.15.99:0/615119810 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(74..74 src has 1..74) ==== 682+0+0 (secure 0 0 0) 0x7fd8a008a020 con 0x7fd8a8144980 2024-09-10T07:37:47.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.011+0000 7fd8a5600640 1 -- 172.21.15.99:0/615119810 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=75}) -- 0x7fd888071a20 con 0x7fd8a8144980 2024-09-10T07:37:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.015+0000 7fd8b0400640 1 -- 172.21.15.99:0/615119810 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd88806be60 msgr2=0x7fd88806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.015+0000 7fd8b0400640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd88806be60 0x7fd88806e320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd89c007fd0 tx=0x7fd89c007e80 comp rx=0 tx=0).stop 2024-09-10T07:37:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.015+0000 7fd8b0400640 1 -- 172.21.15.99:0/615119810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8a8144980 msgr2=0x7fd8a813f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.015+0000 7fd8b0400640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8a8144980 0x7fd8a813f200 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009e10 tx=0x7fd8a000c490 comp rx=0 tx=0).stop 2024-09-10T07:37:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.015+0000 7fd8b0400640 1 -- 172.21.15.99:0/615119810 shutdown_connections 2024-09-10T07:37:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.015+0000 7fd8b0400640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd88806be60 0x7fd88806e320 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd89c007fd0 tx=0x7fd89c007e80 comp rx=0 tx=0).stop 2024-09-10T07:37:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.015+0000 7fd8b0400640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8a8144980 0x7fd8a813f200 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.015+0000 7fd8b0400640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a81445a0 0x7fd8a815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.015+0000 7fd8b0400640 1 --2- 172.21.15.99:0/615119810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a80ced50 0x7fd8a81e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.015+0000 7fd8b0400640 1 -- 172.21.15.99:0/615119810 >> 172.21.15.99:0/615119810 conn(0x7fd8a80b26a0 msgr2=0x7fd8a80b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:47.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.016+0000 7fd8b0400640 1 -- 172.21.15.99:0/615119810 shutdown_connections 2024-09-10T07:37:47.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.016+0000 7fd8b0400640 1 -- 172.21.15.99:0/615119810 wait complete. 2024-09-10T07:37:47.037 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T07:37:47.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.193+0000 7fcd83200640 1 Processor -- start 2024-09-10T07:37:47.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.193+0000 7fcd83200640 1 -- start start 2024-09-10T07:37:47.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.194+0000 7fcd83200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcd7c15e970 0x7fcd7c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.194+0000 7fcd83200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcd7c0d2680 0x7fcd7c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.194+0000 7fcd83200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd7c0d2bd0 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.194+0000 7fcd83200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7c0d37e0 con 0x7fcd7c15e970 2024-09-10T07:37:47.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.194+0000 7fcd83200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7c0d2eb0 con 0x7fcd7c0d2680 2024-09-10T07:37:47.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.194+0000 7fcd81e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcd7c15e970 0x7fcd7c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.195+0000 7fcd81e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcd7c15e970 0x7fcd7c0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56564/0 (socket says 172.21.15.99:56564) 2024-09-10T07:37:47.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.195+0000 7fcd81e00640 1 -- 172.21.15.99:0/4113759546 learned_addr learned my addr 172.21.15.99:0/4113759546 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:47.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.195+0000 7fcd81400640 1 --2- 172.21.15.99:0/4113759546 >> v2:172.21.15.187:3300/0 conn(0x7fcd7c0d2680 0x7fcd7c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.195+0000 7fcd81e00640 1 -- 172.21.15.99:0/4113759546 >> v2:172.21.15.187:3300/0 conn(0x7fcd7c0d2680 msgr2=0x7fcd7c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:47.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.195+0000 7fcd81e00640 1 --2- 172.21.15.99:0/4113759546 >> v2:172.21.15.187:3300/0 conn(0x7fcd7c0d2680 0x7fcd7c0cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.195+0000 7fcd81e00640 1 -- 172.21.15.99:0/4113759546 >> v1:172.21.15.187:6789/0 conn(0x7fcd7c0cfac0 legacy=0x7fcd7c0d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:47.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.195+0000 7fcd81e00640 1 -- 172.21.15.99:0/4113759546 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c0d3190 con 0x7fcd7c15e970 2024-09-10T07:37:47.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.195+0000 7fcd81400640 1 --2- 172.21.15.99:0/4113759546 >> v2:172.21.15.187:3300/0 conn(0x7fcd7c0d2680 0x7fcd7c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:37:47.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.196+0000 7fcd81e00640 1 --2- 172.21.15.99:0/4113759546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c15e970 0x7fcd7c0d0300 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c09e530 tx=0x7fcd7002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196773e1c834810a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:47.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.196+0000 7fcd80a00640 1 -- 172.21.15.99:0/4113759546 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70037070 con 0x7fcd7c15e970 2024-09-10T07:37:47.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.196+0000 7fcd80a00640 1 -- 172.21.15.99:0/4113759546 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd70032440 con 0x7fcd7c15e970 2024-09-10T07:37:47.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.196+0000 7fcd80a00640 1 -- 172.21.15.99:0/4113759546 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70032810 con 0x7fcd7c15e970 2024-09-10T07:37:47.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.197+0000 7fcd83200640 1 -- 172.21.15.99:0/4113759546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c15e970 msgr2=0x7fcd7c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.197+0000 7fcd83200640 1 --2- 172.21.15.99:0/4113759546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c15e970 0x7fcd7c0d0300 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c09e530 tx=0x7fcd7002a2c0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.197+0000 7fcd83200640 1 -- 172.21.15.99:0/4113759546 shutdown_connections 2024-09-10T07:37:47.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.197+0000 7fcd83200640 1 --2- 172.21.15.99:0/4113759546 >> v2:172.21.15.187:3300/0 conn(0x7fcd7c0d2680 0x7fcd7c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.197+0000 7fcd83200640 1 --2- 172.21.15.99:0/4113759546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c15e970 0x7fcd7c0d0300 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.197+0000 7fcd83200640 1 -- 172.21.15.99:0/4113759546 >> 172.21.15.99:0/4113759546 conn(0x7fcd7c09de00 msgr2=0x7fcd7c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:47.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.197+0000 7fcd83200640 1 -- 172.21.15.99:0/4113759546 shutdown_connections 2024-09-10T07:37:47.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.197+0000 7fcd83200640 1 -- 172.21.15.99:0/4113759546 wait complete. 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.198+0000 7fcd83200640 1 Processor -- start 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.199+0000 7fcd83200640 1 -- start start 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.199+0000 7fcd83200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c0cfac0 0x7fcd7c154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.199+0000 7fcd83200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd7c0d2680 0x7fcd7c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.199+0000 7fcd83200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7c15e970 0x7fcd7c15d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.199+0000 7fcd83200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c0d0840 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.199+0000 7fcd83200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c0cff10 con 0x7fcd7c15e970 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.199+0000 7fcd83200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7c15ed50 con 0x7fcd7c0d2680 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.200+0000 7fcd81e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c0cfac0 0x7fcd7c154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.200+0000 7fcd81e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c0cfac0 0x7fcd7c154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56574/0 (socket says 172.21.15.99:56574) 2024-09-10T07:37:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.200+0000 7fcd81e00640 1 -- 172.21.15.99:0/4126191502 learned_addr learned my addr 172.21.15.99:0/4126191502 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:47.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.200+0000 7fcd81400640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd7c0d2680 0x7fcd7c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.200+0000 7fcd82800640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7c15e970 0x7fcd7c15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.200+0000 7fcd81e00640 1 -- 172.21.15.99:0/4126191502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd7c0d2680 msgr2=0x7fcd7c15d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.200+0000 7fcd81e00640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd7c0d2680 0x7fcd7c15d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.200+0000 7fcd81e00640 1 -- 172.21.15.99:0/4126191502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7c15e970 msgr2=0x7fcd7c15d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.200+0000 7fcd81e00640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7c15e970 0x7fcd7c15d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.200+0000 7fcd81e00640 1 -- 172.21.15.99:0/4126191502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c0b78e0 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.201+0000 7fcd81e00640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c0cfac0 0x7fcd7c154c90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcd70000c00 tx=0x7fcd700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:47.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.201+0000 7fcd76000640 1 -- 172.21.15.99:0/4126191502 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70041020 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.201+0000 7fcd76000640 1 -- 172.21.15.99:0/4126191502 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd70030970 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.201+0000 7fcd76000640 1 -- 172.21.15.99:0/4126191502 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70037040 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.201+0000 7fcd83200640 1 -- 172.21.15.99:0/4126191502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7c0b7bc0 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.201+0000 7fcd83200640 1 -- 172.21.15.99:0/4126191502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7c0b8180 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.202+0000 7fcd83200640 1 -- 172.21.15.99:0/4126191502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd7c0cf580 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.203+0000 7fcd76000640 1 -- 172.21.15.99:0/4126191502 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd70044020 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.204+0000 7fcd76000640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd6006be30 0x7fcd6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.204+0000 7fcd76000640 1 -- 172.21.15.99:0/4126191502 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7fcd700ab640 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.204+0000 7fcd81400640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd6006be30 0x7fcd6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.204+0000 7fcd81400640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd6006be30 0x7fcd6006e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c1e88b0 tx=0x7fcd6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:47.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.208+0000 7fcd76000640 1 -- 172.21.15.99:0/4126191502 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd7004b030 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.380+0000 7fcd83200640 1 -- 172.21.15.99:0/4126191502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fcd7c06c610 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.384+0000 7fcd76000640 1 -- 172.21.15.99:0/4126191502 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) ==== 104+0+0 (secure 0 0 0) 0x7fcd7007a250 con 0x7fcd7c0cfac0 2024-09-10T07:37:47.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 -- 172.21.15.99:0/4126191502 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd6006be30 msgr2=0x7fcd6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd6006be30 0x7fcd6006e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c1e88b0 tx=0x7fcd6c008040 comp rx=0 tx=0).stop 2024-09-10T07:37:47.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 -- 172.21.15.99:0/4126191502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c0cfac0 msgr2=0x7fcd7c154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c0cfac0 0x7fcd7c154c90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcd70000c00 tx=0x7fcd700046c0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 -- 172.21.15.99:0/4126191502 shutdown_connections 2024-09-10T07:37:47.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7c15e970 0x7fcd7c15d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd7c0d2680 0x7fcd7c15d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd6006be30 0x7fcd6006e2f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 --2- 172.21.15.99:0/4126191502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd7c0cfac0 0x7fcd7c154c90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 -- 172.21.15.99:0/4126191502 >> 172.21.15.99:0/4126191502 conn(0x7fcd7c09de00 msgr2=0x7fcd7c0d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:47.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 -- 172.21.15.99:0/4126191502 shutdown_connections 2024-09-10T07:37:47.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.386+0000 7fcd83200640 1 -- 172.21.15.99:0/4126191502 wait complete. 2024-09-10T07:37:47.402 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-10T07:37:47.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.557+0000 7f5310e00640 1 Processor -- start 2024-09-10T07:37:47.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.557+0000 7f5310e00640 1 -- start start 2024-09-10T07:37:47.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.558+0000 7f5310e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f530c0d1ab0 0x7f530c0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.558+0000 7f5310e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f530c0d3240 0x7f530c0b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.558+0000 7f5310e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530c0b7a90 con 0x7f530c15ef50 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.558+0000 7f5310e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f530c0d3740 con 0x7f530c0d3240 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.558+0000 7f5310e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f530c0d3a20 con 0x7f530c0d1ab0 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.558+0000 7f5309e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f530c15ef50 0x7f530c0d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43344/0 (socket says 172.21.15.99:43344) 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.558+0000 7f5309e00640 1 -- 172.21.15.99:0/1083206054 learned_addr learned my addr 172.21.15.99:0/1083206054 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.558+0000 7f530a800640 1 --2- 172.21.15.99:0/1083206054 >> v2:172.21.15.99:3300/0 conn(0x7f530c0d3240 0x7f530c0b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.559+0000 7f5309400640 1 --2- 172.21.15.99:0/1083206054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f530c0d1ab0 0x7f530c0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.559+0000 7f530a800640 1 -- 172.21.15.99:0/1083206054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f530c0d1ab0 msgr2=0x7f530c0b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.559+0000 7f530a800640 1 --2- 172.21.15.99:0/1083206054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f530c0d1ab0 0x7f530c0b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.559+0000 7f530a800640 1 -- 172.21.15.99:0/1083206054 >> v1:172.21.15.99:6789/0 conn(0x7f530c15ef50 legacy=0x7f530c0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.559+0000 7f530a800640 1 -- 172.21.15.99:0/1083206054 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530c0b7d00 con 0x7f530c0d3240 2024-09-10T07:37:47.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.559+0000 7f5308a00640 1 -- 172.21.15.99:0/1083206054 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1525489631 0 0) 0x7f530c0b7a90 con 0x7f530c15ef50 2024-09-10T07:37:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.560+0000 7f530a800640 1 --2- 172.21.15.99:0/1083206054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c0d3240 0x7f530c0b8a40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5304009d90 tx=0x7f530402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a7a355eb0b86e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.560+0000 7f5308a00640 1 -- 172.21.15.99:0/1083206054 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304031600 con 0x7f530c0d3240 2024-09-10T07:37:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.560+0000 7f5308a00640 1 -- 172.21.15.99:0/1083206054 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53040317a0 con 0x7f530c0d3240 2024-09-10T07:37:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.560+0000 7f5308a00640 1 -- 172.21.15.99:0/1083206054 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304031b70 con 0x7f530c0d3240 2024-09-10T07:37:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.561+0000 7f5310e00640 1 -- 172.21.15.99:0/1083206054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c0d3240 msgr2=0x7f530c0b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.561+0000 7f5310e00640 1 --2- 172.21.15.99:0/1083206054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c0d3240 0x7f530c0b8a40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5304009d90 tx=0x7f530402a5d0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.561+0000 7f5310e00640 1 -- 172.21.15.99:0/1083206054 shutdown_connections 2024-09-10T07:37:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.561+0000 7f5310e00640 1 --2- 172.21.15.99:0/1083206054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c0d3240 0x7f530c0b8a40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.561+0000 7f5310e00640 1 --2- 172.21.15.99:0/1083206054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f530c0d1ab0 0x7f530c0b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.561+0000 7f5310e00640 1 -- 172.21.15.99:0/1083206054 >> 172.21.15.99:0/1083206054 conn(0x7f530c0d4c60 msgr2=0x7f530c0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.561+0000 7f5310e00640 1 -- 172.21.15.99:0/1083206054 shutdown_connections 2024-09-10T07:37:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.561+0000 7f5310e00640 1 -- 172.21.15.99:0/1083206054 wait complete. 2024-09-10T07:37:47.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.563+0000 7f5310e00640 1 Processor -- start 2024-09-10T07:37:47.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.563+0000 7f5310e00640 1 -- start start 2024-09-10T07:37:47.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f5310e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f530c0d1ab0 0x7f530c1f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f5310e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f530c0d3240 0x7f530c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f5310e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c15ef50 0x7f530c06d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f5310e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f530c0d21a0 con 0x7f530c15ef50 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f5310e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f530c0d2020 con 0x7f530c0d3240 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f5310e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f530c0d5780 con 0x7f530c0d1ab0 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f530a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c15ef50 0x7f530c06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f530a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c15ef50 0x7f530c06d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56602/0 (socket says 172.21.15.99:56602) 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f530a800640 1 -- 172.21.15.99:0/2511406094 learned_addr learned my addr 172.21.15.99:0/2511406094 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f5309e00640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f530c0d1ab0 0x7f530c1f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f5309400640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f530c0d3240 0x7f530c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f530a800640 1 -- 172.21.15.99:0/2511406094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f530c0d1ab0 msgr2=0x7f530c1f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f530a800640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f530c0d1ab0 0x7f530c1f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f530a800640 1 -- 172.21.15.99:0/2511406094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f530c0d3240 msgr2=0x7f530c15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:47.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f530a800640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f530c0d3240 0x7f530c15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:47.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.564+0000 7f530a800640 1 -- 172.21.15.99:0/2511406094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530c14e3d0 con 0x7f530c15ef50 2024-09-10T07:37:47.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.565+0000 7f530a800640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c15ef50 0x7f530c06d650 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5304009eb0 tx=0x7f5304004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:47.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.565+0000 7f5302000640 1 -- 172.21.15.99:0/2511406094 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304040070 con 0x7f530c15ef50 2024-09-10T07:37:47.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.565+0000 7f5302000640 1 -- 172.21.15.99:0/2511406094 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5304030be0 con 0x7f530c15ef50 2024-09-10T07:37:47.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.565+0000 7f5302000640 1 -- 172.21.15.99:0/2511406094 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304009450 con 0x7f530c15ef50 2024-09-10T07:37:47.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.565+0000 7f5310e00640 1 -- 172.21.15.99:0/2511406094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530c15ab20 con 0x7f530c15ef50 2024-09-10T07:37:47.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.565+0000 7f5310e00640 1 -- 172.21.15.99:0/2511406094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f530c15b0e0 con 0x7f530c15ef50 2024-09-10T07:37:47.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.566+0000 7f5310e00640 1 -- 172.21.15.99:0/2511406094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f530c0d13a0 con 0x7f530c15ef50 2024-09-10T07:37:47.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.567+0000 7f5302000640 1 -- 172.21.15.99:0/2511406094 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5304039040 con 0x7f530c15ef50 2024-09-10T07:37:47.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.568+0000 7f5302000640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f52ec06be60 0x7f52ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:47.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.568+0000 7f5302000640 1 -- 172.21.15.99:0/2511406094 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7f53040ab730 con 0x7f530c15ef50 2024-09-10T07:37:47.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.568+0000 7f5309e00640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f52ec06be60 0x7f52ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:47.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.569+0000 7f5309e00640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f52ec06be60 0x7f52ec06e320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f52fc007fd0 tx=0x7f52fc007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:47.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.572+0000 7f5302000640 1 -- 172.21.15.99:0/2511406094 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5304079e20 con 0x7f530c15ef50 2024-09-10T07:37:47.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:47.809+0000 7f5310e00640 1 -- 172.21.15.99:0/2511406094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) -- 0x7f530c06ce50 con 0x7f530c15ef50 2024-09-10T07:37:48.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.012+0000 7f5302000640 1 -- 172.21.15.99:0/2511406094 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v185) ==== 134+0+0 (secure 0 0 0) 0x7f530407e120 con 0x7f530c15ef50 2024-09-10T07:37:48.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 -- 172.21.15.99:0/2511406094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f52ec06be60 msgr2=0x7f52ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f52ec06be60 0x7f52ec06e320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f52fc007fd0 tx=0x7f52fc007de0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 -- 172.21.15.99:0/2511406094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c15ef50 msgr2=0x7f530c06d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c15ef50 0x7f530c06d650 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5304009eb0 tx=0x7f5304004a40 comp rx=0 tx=0).stop 2024-09-10T07:37:48.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 -- 172.21.15.99:0/2511406094 shutdown_connections 2024-09-10T07:37:48.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f52ec06be60 0x7f52ec06e320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f530c15ef50 0x7f530c06d650 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f530c0d3240 0x7f530c15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 --2- 172.21.15.99:0/2511406094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f530c0d1ab0 0x7f530c1f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 -- 172.21.15.99:0/2511406094 >> 172.21.15.99:0/2511406094 conn(0x7f530c0d4c60 msgr2=0x7f530c0d29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:48.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.014+0000 7f5310e00640 1 -- 172.21.15.99:0/2511406094 shutdown_connections 2024-09-10T07:37:48.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.015+0000 7f5310e00640 1 -- 172.21.15.99:0/2511406094 wait complete. 2024-09-10T07:37:48.031 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-10T07:37:48.031 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2024-09-10T07:37:48.031 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2024-09-10T07:37:48.032 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:37:48.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.192+0000 7fae82a00640 1 Processor -- start 2024-09-10T07:37:48.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.192+0000 7fae82a00640 1 -- start start 2024-09-10T07:37:48.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.193+0000 7fae82a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c15e970 0x7fae7c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.193+0000 7fae82a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae7c0d2680 0x7fae7c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.193+0000 7fae82a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fae7c0cfac0 0x7fae7c0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.193+0000 7fae82a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fae7c0d37e0 con 0x7fae7c0cfac0 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.193+0000 7fae82a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fae7c0d2bd0 con 0x7fae7c0d2680 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.193+0000 7fae82a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fae7c0d2eb0 con 0x7fae7c15e970 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.193+0000 7fae82000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fae7c0cfac0 0x7fae7c0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.193+0000 7fae82000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fae7c0cfac0 0x7fae7c0d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56608/0 (socket says 172.21.15.99:56608) 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.193+0000 7fae82000640 1 -- 172.21.15.99:0/2230201461 learned_addr learned my addr 172.21.15.99:0/2230201461 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.194+0000 7fae81600640 1 --2- 172.21.15.99:0/2230201461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c15e970 0x7fae7c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.194+0000 7fae80c00640 1 --2- 172.21.15.99:0/2230201461 >> v2:172.21.15.187:3300/0 conn(0x7fae7c0d2680 0x7fae7c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.194+0000 7fae82000640 1 -- 172.21.15.99:0/2230201461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c15e970 msgr2=0x7fae7c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.194+0000 7fae82000640 1 --2- 172.21.15.99:0/2230201461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c15e970 0x7fae7c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.194+0000 7fae82000640 1 -- 172.21.15.99:0/2230201461 >> v2:172.21.15.187:3300/0 conn(0x7fae7c0d2680 msgr2=0x7fae7c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.194+0000 7fae82000640 1 --2- 172.21.15.99:0/2230201461 >> v2:172.21.15.187:3300/0 conn(0x7fae7c0d2680 0x7fae7c0cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.194+0000 7fae82000640 1 -- 172.21.15.99:0/2230201461 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7c0d3190 con 0x7fae7c0cfac0 2024-09-10T07:37:48.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.195+0000 7fae82000640 1 --2- 172.21.15.99:0/2230201461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0cfac0 0x7fae7c0d0ff0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fae7c08dd70 tx=0x7fae7402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ede569bb2bf814 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:48.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.195+0000 7fae7be00640 1 -- 172.21.15.99:0/2230201461 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74036070 con 0x7fae7c0cfac0 2024-09-10T07:37:48.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.195+0000 7fae7be00640 1 -- 172.21.15.99:0/2230201461 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae74031600 con 0x7fae7c0cfac0 2024-09-10T07:37:48.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.195+0000 7fae7be00640 1 -- 172.21.15.99:0/2230201461 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740319d0 con 0x7fae7c0cfac0 2024-09-10T07:37:48.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.196+0000 7fae82a00640 1 -- 172.21.15.99:0/2230201461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0cfac0 msgr2=0x7fae7c0d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.196+0000 7fae82a00640 1 --2- 172.21.15.99:0/2230201461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0cfac0 0x7fae7c0d0ff0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fae7c08dd70 tx=0x7fae7402a730 comp rx=0 tx=0).stop 2024-09-10T07:37:48.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.196+0000 7fae82a00640 1 -- 172.21.15.99:0/2230201461 shutdown_connections 2024-09-10T07:37:48.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.196+0000 7fae82a00640 1 --2- 172.21.15.99:0/2230201461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0cfac0 0x7fae7c0d0ff0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.196+0000 7fae82a00640 1 --2- 172.21.15.99:0/2230201461 >> v2:172.21.15.187:3300/0 conn(0x7fae7c0d2680 0x7fae7c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.196+0000 7fae82a00640 1 --2- 172.21.15.99:0/2230201461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c15e970 0x7fae7c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.196+0000 7fae82a00640 1 -- 172.21.15.99:0/2230201461 >> 172.21.15.99:0/2230201461 conn(0x7fae7c09de00 msgr2=0x7fae7c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:48.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.196+0000 7fae82a00640 1 -- 172.21.15.99:0/2230201461 shutdown_connections 2024-09-10T07:37:48.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.196+0000 7fae82a00640 1 -- 172.21.15.99:0/2230201461 wait complete. 2024-09-10T07:37:48.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.197+0000 7fae82a00640 1 Processor -- start 2024-09-10T07:37:48.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.198+0000 7fae82a00640 1 -- start start 2024-09-10T07:37:48.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.198+0000 7fae82a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c0cfac0 0x7fae7c0b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.198+0000 7fae82a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0d2680 0x7fae7c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.198+0000 7fae82a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae7c15e970 0x7fae7c0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.198+0000 7fae82a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c0d0840 con 0x7fae7c0d2680 2024-09-10T07:37:48.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.198+0000 7fae82a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c0cff70 con 0x7fae7c15e970 2024-09-10T07:37:48.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.198+0000 7fae82a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fae7c15ed50 con 0x7fae7c0cfac0 2024-09-10T07:37:48.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae80c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0d2680 0x7fae7c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae80c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0d2680 0x7fae7c0cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56610/0 (socket says 172.21.15.99:56610) 2024-09-10T07:37:48.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae80c00640 1 -- 172.21.15.99:0/2597384868 learned_addr learned my addr 172.21.15.99:0/2597384868 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:48.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae81600640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c0cfac0 0x7fae7c0b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae82000640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae7c15e970 0x7fae7c0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae80c00640 1 -- 172.21.15.99:0/2597384868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c0cfac0 msgr2=0x7fae7c0b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae80c00640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c0cfac0 0x7fae7c0b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae80c00640 1 -- 172.21.15.99:0/2597384868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae7c15e970 msgr2=0x7fae7c0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae80c00640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae7c15e970 0x7fae7c0cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae80c00640 1 -- 172.21.15.99:0/2597384868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7c15f1e0 con 0x7fae7c0d2680 2024-09-10T07:37:48.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.199+0000 7fae80c00640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0d2680 0x7fae7c0cd7a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fae6800d800 tx=0x7fae6800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:48.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.200+0000 7fae79600640 1 -- 172.21.15.99:0/2597384868 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68004020 con 0x7fae7c0d2680 2024-09-10T07:37:48.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.200+0000 7fae79600640 1 -- 172.21.15.99:0/2597384868 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae680041c0 con 0x7fae7c0d2680 2024-09-10T07:37:48.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.200+0000 7fae82a00640 1 -- 172.21.15.99:0/2597384868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae7c15f480 con 0x7fae7c0d2680 2024-09-10T07:37:48.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.200+0000 7fae79600640 1 -- 172.21.15.99:0/2597384868 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68004390 con 0x7fae7c0d2680 2024-09-10T07:37:48.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.200+0000 7fae82a00640 1 -- 172.21.15.99:0/2597384868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae7c0b9820 con 0x7fae7c0d2680 2024-09-10T07:37:48.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.201+0000 7fae82a00640 1 -- 172.21.15.99:0/2597384868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7c0cf580 con 0x7fae7c0d2680 2024-09-10T07:37:48.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.202+0000 7fae79600640 1 -- 172.21.15.99:0/2597384868 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae6801b020 con 0x7fae7c0d2680 2024-09-10T07:37:48.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.203+0000 7fae79600640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae5c06be30 0x7fae5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.203+0000 7fae79600640 1 -- 172.21.15.99:0/2597384868 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7fae6808a970 con 0x7fae7c0d2680 2024-09-10T07:37:48.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.203+0000 7fae81600640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae5c06be30 0x7fae5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.204+0000 7fae81600640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae5c06be30 0x7fae5c06e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae70006fd0 tx=0x7fae70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:48.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.207+0000 7fae79600640 1 -- 172.21.15.99:0/2597384868 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae68058e20 con 0x7fae7c0d2680 2024-09-10T07:37:48.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.379+0000 7fae82a00640 1 -- 172.21.15.99:0/2597384868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae7c06c460 con 0x7fae7c0d2680 2024-09-10T07:37:48.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.380+0000 7fae79600640 1 -- 172.21.15.99:0/2597384868 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+13008 (secure 0 0 0) 0x7fae6805d120 con 0x7fae7c0d2680 2024-09-10T07:37:48.380 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:48.380 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":74,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:37:47.004082+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6837/3805850931":"2024-09-11T07:37:43.970994+0000","172.21.15.99:6835/3805850931":"2024-09-11T07:37:43.970994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:37:48.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 -- 172.21.15.99:0/2597384868 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae5c06be30 msgr2=0x7fae5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae5c06be30 0x7fae5c06e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae70006fd0 tx=0x7fae70008040 comp rx=0 tx=0).stop 2024-09-10T07:37:48.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 -- 172.21.15.99:0/2597384868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0d2680 msgr2=0x7fae7c0cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0d2680 0x7fae7c0cd7a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fae6800d800 tx=0x7fae6800dcc0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 -- 172.21.15.99:0/2597384868 shutdown_connections 2024-09-10T07:37:48.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae7c15e970 0x7fae7c0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fae5c06be30 0x7fae5c06e2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae7c0d2680 0x7fae7c0cd7a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 --2- 172.21.15.99:0/2597384868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c0cfac0 0x7fae7c0b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 -- 172.21.15.99:0/2597384868 >> 172.21.15.99:0/2597384868 conn(0x7fae7c09de00 msgr2=0x7fae7c0c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:48.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 -- 172.21.15.99:0/2597384868 shutdown_connections 2024-09-10T07:37:48.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.382+0000 7fae82a00640 1 -- 172.21.15.99:0/2597384868 wait complete. 2024-09-10T07:37:48.397 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:34:08.744575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:37:48.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:37:48.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.554+0000 7f0846e00640 1 Processor -- start 2024-09-10T07:37:48.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.554+0000 7f0846e00640 1 -- start start 2024-09-10T07:37:48.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.555+0000 7f0846e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08400d2680 0x7f08400cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.555+0000 7f0846e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f08400cfac0 0x7f08400c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.555+0000 7f0846e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08400d2bd0 con 0x7f084015e970 2024-09-10T07:37:48.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.555+0000 7f0846e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f08400d37e0 con 0x7f08400cfac0 2024-09-10T07:37:48.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.555+0000 7f0846e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f08400d2eb0 con 0x7f08400d2680 2024-09-10T07:37:48.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.555+0000 7f0846400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f08400cfac0 0x7f08400c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.555+0000 7f0846400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f08400cfac0 0x7f08400c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56612/0 (socket says 172.21.15.99:56612) 2024-09-10T07:37:48.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.555+0000 7f0846400640 1 -- 172.21.15.99:0/4282150195 learned_addr learned my addr 172.21.15.99:0/4282150195 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:48.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.555+0000 7f0845000640 1 --2- 172.21.15.99:0/4282150195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08400d2680 0x7f08400cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.556+0000 7f0846400640 1 -- 172.21.15.99:0/4282150195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08400d2680 msgr2=0x7f08400cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:48.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.556+0000 7f0846400640 1 --2- 172.21.15.99:0/4282150195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08400d2680 0x7f08400cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.556+0000 7f0846400640 1 -- 172.21.15.99:0/4282150195 >> v1:172.21.15.187:6789/0 conn(0x7f084015e970 legacy=0x7f08400d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.556+0000 7f0846400640 1 -- 172.21.15.99:0/4282150195 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08400d3190 con 0x7f08400cfac0 2024-09-10T07:37:48.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.557+0000 7f0846400640 1 --2- 172.21.15.99:0/4282150195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400cfac0 0x7f08400c8700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0838009e50 tx=0x7f083802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171a0538fe3206d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:48.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.557+0000 7f083fe00640 1 -- 172.21.15.99:0/4282150195 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838036070 con 0x7f08400cfac0 2024-09-10T07:37:48.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.557+0000 7f083fe00640 1 -- 172.21.15.99:0/4282150195 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0838031600 con 0x7f08400cfac0 2024-09-10T07:37:48.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.557+0000 7f083fe00640 1 -- 172.21.15.99:0/4282150195 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08380319d0 con 0x7f08400cfac0 2024-09-10T07:37:48.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.558+0000 7f0846e00640 1 -- 172.21.15.99:0/4282150195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400cfac0 msgr2=0x7f08400c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.558+0000 7f0846e00640 1 --2- 172.21.15.99:0/4282150195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400cfac0 0x7f08400c8700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0838009e50 tx=0x7f083802a7a0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.558+0000 7f0846e00640 1 -- 172.21.15.99:0/4282150195 shutdown_connections 2024-09-10T07:37:48.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.558+0000 7f0846e00640 1 --2- 172.21.15.99:0/4282150195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400cfac0 0x7f08400c8700 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.558+0000 7f0846e00640 1 --2- 172.21.15.99:0/4282150195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08400d2680 0x7f08400cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.558+0000 7f0846e00640 1 -- 172.21.15.99:0/4282150195 >> 172.21.15.99:0/4282150195 conn(0x7f084009de00 msgr2=0x7f08400d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:48.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.558+0000 7f0846e00640 1 -- 172.21.15.99:0/4282150195 shutdown_connections 2024-09-10T07:37:48.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.558+0000 7f0846e00640 1 -- 172.21.15.99:0/4282150195 wait complete. 2024-09-10T07:37:48.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.559+0000 7f0846e00640 1 Processor -- start 2024-09-10T07:37:48.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.559+0000 7f0846e00640 1 -- start start 2024-09-10T07:37:48.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.560+0000 7f0846e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08400cfac0 0x7f0840154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.560+0000 7f0846e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400d2680 0x7f08400b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.560+0000 7f0846e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084015e970 0x7f08400b7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.560+0000 7f0846e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f084015ed50 con 0x7f08400d2680 2024-09-10T07:37:48.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.560+0000 7f0846e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f08400cff70 con 0x7f084015e970 2024-09-10T07:37:48.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.560+0000 7f0846e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f084015eed0 con 0x7f08400cfac0 2024-09-10T07:37:48.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0845000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400d2680 0x7f08400b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0845000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400d2680 0x7f08400b78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56620/0 (socket says 172.21.15.99:56620) 2024-09-10T07:37:48.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0845000640 1 -- 172.21.15.99:0/1103126702 learned_addr learned my addr 172.21.15.99:0/1103126702 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:48.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0845a00640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08400cfac0 0x7f0840154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0846400640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084015e970 0x7f08400b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0845000640 1 -- 172.21.15.99:0/1103126702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08400cfac0 msgr2=0x7f0840154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0845000640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08400cfac0 0x7f0840154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0845000640 1 -- 172.21.15.99:0/1103126702 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084015e970 msgr2=0x7f08400b7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0845000640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084015e970 0x7f08400b7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0845000640 1 -- 172.21.15.99:0/1103126702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08400b9260 con 0x7f08400d2680 2024-09-10T07:37:48.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.561+0000 7f0845000640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400d2680 0x7f08400b78e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f082c00e9b0 tx=0x7f082c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:48.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.562+0000 7f083d600640 1 -- 172.21.15.99:0/1103126702 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c017070 con 0x7f08400d2680 2024-09-10T07:37:48.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.562+0000 7f083d600640 1 -- 172.21.15.99:0/1103126702 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c00c9a0 con 0x7f08400d2680 2024-09-10T07:37:48.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.562+0000 7f083d600640 1 -- 172.21.15.99:0/1103126702 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c00cd70 con 0x7f08400d2680 2024-09-10T07:37:48.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.562+0000 7f0846e00640 1 -- 172.21.15.99:0/1103126702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08400b8450 con 0x7f08400d2680 2024-09-10T07:37:48.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.562+0000 7f0846e00640 1 -- 172.21.15.99:0/1103126702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0840155660 con 0x7f08400d2680 2024-09-10T07:37:48.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.563+0000 7f0846e00640 1 -- 172.21.15.99:0/1103126702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08400cf580 con 0x7f08400d2680 2024-09-10T07:37:48.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.564+0000 7f083d600640 1 -- 172.21.15.99:0/1103126702 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f082c01a070 con 0x7f08400d2680 2024-09-10T07:37:48.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.564+0000 7f083d600640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f082006be30 0x7f082006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.564+0000 7f083d600640 1 -- 172.21.15.99:0/1103126702 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7f082c08af00 con 0x7f08400d2680 2024-09-10T07:37:48.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.565+0000 7f0845a00640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f082006be30 0x7f082006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.565+0000 7f0845a00640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f082006be30 0x7f082006e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f08340016e0 tx=0x7f0834009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:48.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.569+0000 7f083d600640 1 -- 172.21.15.99:0/1103126702 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f082c0594c0 con 0x7f08400d2680 2024-09-10T07:37:48.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.742+0000 7f0846e00640 1 -- 172.21.15.99:0/1103126702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f08400b59d0 con 0x7f08400d2680 2024-09-10T07:37:48.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.742+0000 7f083d600640 1 -- 172.21.15.99:0/1103126702 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f082c05d7c0 con 0x7f08400d2680 2024-09-10T07:37:48.742 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-10T07:37:48.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 -- 172.21.15.99:0/1103126702 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f082006be30 msgr2=0x7f082006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f082006be30 0x7f082006e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f08340016e0 tx=0x7f0834009040 comp rx=0 tx=0).stop 2024-09-10T07:37:48.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 -- 172.21.15.99:0/1103126702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400d2680 msgr2=0x7f08400b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400d2680 0x7f08400b78e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f082c00e9b0 tx=0x7f082c00ee70 comp rx=0 tx=0).stop 2024-09-10T07:37:48.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 -- 172.21.15.99:0/1103126702 shutdown_connections 2024-09-10T07:37:48.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f084015e970 0x7f08400b7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f082006be30 0x7f082006e2f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08400d2680 0x7f08400b78e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 --2- 172.21.15.99:0/1103126702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08400cfac0 0x7f0840154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 -- 172.21.15.99:0/1103126702 >> 172.21.15.99:0/1103126702 conn(0x7f084009de00 msgr2=0x7f08400d47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:48.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 -- 172.21.15.99:0/1103126702 shutdown_connections 2024-09-10T07:37:48.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.745+0000 7f0846e00640 1 -- 172.21.15.99:0/1103126702 wait complete. 2024-09-10T07:37:48.761 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-10T07:37:48.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.915+0000 7f5d20a00640 1 Processor -- start 2024-09-10T07:37:48.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.915+0000 7f5d20a00640 1 -- start start 2024-09-10T07:37:48.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.916+0000 7f5d20a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 0x7f5d1c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.916+0000 7f5d20a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5d1c0cfc90 0x7f5d1c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d20a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d1c0d2bd0 con 0x7f5d1c0d2680 2024-09-10T07:37:48.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d20a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f5d1c0d37e0 con 0x7f5d1c0cfc90 2024-09-10T07:37:48.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d20a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1c0d2eb0 con 0x7f5d1c15e970 2024-09-10T07:37:48.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d1be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5d1c0cfc90 0x7f5d1c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d1be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5d1c0cfc90 0x7f5d1c0c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56628/0 (socket says 172.21.15.99:56628) 2024-09-10T07:37:48.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d1be00640 1 -- 172.21.15.99:0/234978220 learned_addr learned my addr 172.21.15.99:0/234978220 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:48.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d1aa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5d1c0d2680 0x7f5d1c0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:43356/0 (socket says 172.21.15.99:43356) 2024-09-10T07:37:48.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d1b400640 1 --2- 172.21.15.99:0/234978220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 0x7f5d1c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d1be00640 1 -- 172.21.15.99:0/234978220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 msgr2=0x7f5d1c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:48.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d1be00640 1 --2- 172.21.15.99:0/234978220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 0x7f5d1c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d1be00640 1 -- 172.21.15.99:0/234978220 >> v1:172.21.15.99:6789/0 conn(0x7f5d1c0d2680 legacy=0x7f5d1c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d1be00640 1 -- 172.21.15.99:0/234978220 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1c0d3190 con 0x7f5d1c0cfc90 2024-09-10T07:37:48.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.917+0000 7f5d1a000640 1 -- 172.21.15.99:0/234978220 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964711801 0 0) 0x7f5d1c0d2bd0 con 0x7f5d1c0d2680 2024-09-10T07:37:48.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.918+0000 7f5d1be00640 1 --2- 172.21.15.99:0/234978220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0cfc90 0x7f5d1c0c8700 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009e50 tx=0x7f5d1402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ac8208de6c01ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:48.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d1a000640 1 -- 172.21.15.99:0/234978220 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14036070 con 0x7f5d1c0cfc90 2024-09-10T07:37:48.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d1a000640 1 -- 172.21.15.99:0/234978220 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d14031600 con 0x7f5d1c0cfc90 2024-09-10T07:37:48.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d1a000640 1 -- 172.21.15.99:0/234978220 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d140319d0 con 0x7f5d1c0cfc90 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d20a00640 1 -- 172.21.15.99:0/234978220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0cfc90 msgr2=0x7f5d1c0c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d20a00640 1 --2- 172.21.15.99:0/234978220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0cfc90 0x7f5d1c0c8700 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009e50 tx=0x7f5d1402a7a0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d20a00640 1 -- 172.21.15.99:0/234978220 shutdown_connections 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d20a00640 1 --2- 172.21.15.99:0/234978220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0cfc90 0x7f5d1c0c8700 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d20a00640 1 --2- 172.21.15.99:0/234978220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 0x7f5d1c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d20a00640 1 -- 172.21.15.99:0/234978220 >> 172.21.15.99:0/234978220 conn(0x7f5d1c09de00 msgr2=0x7f5d1c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d20a00640 1 -- 172.21.15.99:0/234978220 shutdown_connections 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.919+0000 7f5d20a00640 1 -- 172.21.15.99:0/234978220 wait complete. 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.921+0000 7f5d20a00640 1 Processor -- start 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.921+0000 7f5d20a00640 1 -- start start 2024-09-10T07:37:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d20a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d1c0cfc90 0x7f5d1c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d20a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0d2680 0x7f5d1c0b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d20a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 0x7f5d1c0ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d20a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c15ed50 con 0x7f5d1c0d2680 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d20a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c0d0840 con 0x7f5d1c0cfc90 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d20a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1c15eed0 con 0x7f5d1c15e970 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d1aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0d2680 0x7f5d1c0b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d1aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0d2680 0x7f5d1c0b9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56640/0 (socket says 172.21.15.99:56640) 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d1aa00640 1 -- 172.21.15.99:0/2358545797 learned_addr learned my addr 172.21.15.99:0/2358545797 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d1be00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 0x7f5d1c0ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.922+0000 7f5d1b400640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d1c0cfc90 0x7f5d1c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d1aa00640 1 -- 172.21.15.99:0/2358545797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 msgr2=0x7f5d1c0ba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d1aa00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 0x7f5d1c0ba4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d1aa00640 1 -- 172.21.15.99:0/2358545797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d1c0cfc90 msgr2=0x7f5d1c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:48.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d1aa00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d1c0cfc90 0x7f5d1c15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:48.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d1aa00640 1 -- 172.21.15.99:0/2358545797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1c15f080 con 0x7f5d1c0d2680 2024-09-10T07:37:48.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d1b400640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d1c0cfc90 0x7f5d1c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:37:48.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d1be00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 0x7f5d1c0ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:37:48.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d1aa00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0d2680 0x7f5d1c0b9fb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800c4b0 tx=0x7f5d0800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:48.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d13400640 1 -- 172.21.15.99:0/2358545797 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08018070 con 0x7f5d1c0d2680 2024-09-10T07:37:48.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d13400640 1 -- 172.21.15.99:0/2358545797 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d08007500 con 0x7f5d1c0d2680 2024-09-10T07:37:48.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d13400640 1 -- 172.21.15.99:0/2358545797 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08004a20 con 0x7f5d1c0d2680 2024-09-10T07:37:48.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d20a00640 1 -- 172.21.15.99:0/2358545797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d1c15f360 con 0x7f5d1c0d2680 2024-09-10T07:37:48.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.923+0000 7f5d20a00640 1 -- 172.21.15.99:0/2358545797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d1c15f920 con 0x7f5d1c0d2680 2024-09-10T07:37:48.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.925+0000 7f5d20a00640 1 -- 172.21.15.99:0/2358545797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d1c0c7f30 con 0x7f5d1c0d2680 2024-09-10T07:37:48.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.925+0000 7f5d13400640 1 -- 172.21.15.99:0/2358545797 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d08004bc0 con 0x7f5d1c0d2680 2024-09-10T07:37:48.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.926+0000 7f5d13400640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cfc06be60 0x7f5cfc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:48.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.926+0000 7f5d13400640 1 -- 172.21.15.99:0/2358545797 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7f5d08089ce0 con 0x7f5d1c0d2680 2024-09-10T07:37:48.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.926+0000 7f5d1b400640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cfc06be60 0x7f5cfc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:48.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.927+0000 7f5d1b400640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cfc06be60 0x7f5cfc06e320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009af0 tx=0x7f5d0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:48.931+0000 7f5d13400640 1 -- 172.21.15.99:0/2358545797 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d08058ae0 con 0x7f5d1c0d2680 2024-09-10T07:37:49.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:49.170+0000 7f5d20a00640 1 -- 172.21.15.99:0/2358545797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) -- 0x7f5d1c08e500 con 0x7f5d1c0d2680 2024-09-10T07:37:50.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.019+0000 7f5d13400640 1 -- 172.21.15.99:0/2358545797 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v187) ==== 136+0+0 (secure 0 0 0) 0x7f5d080583e0 con 0x7f5d1c0d2680 2024-09-10T07:37:50.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 -- 172.21.15.99:0/2358545797 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cfc06be60 msgr2=0x7f5cfc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cfc06be60 0x7f5cfc06e320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009af0 tx=0x7f5d0c008040 comp rx=0 tx=0).stop 2024-09-10T07:37:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 -- 172.21.15.99:0/2358545797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0d2680 msgr2=0x7f5d1c0b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0d2680 0x7f5d1c0b9fb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800c4b0 tx=0x7f5d0800c970 comp rx=0 tx=0).stop 2024-09-10T07:37:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 -- 172.21.15.99:0/2358545797 shutdown_connections 2024-09-10T07:37:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d1c15e970 0x7f5d1c0ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5cfc06be60 0x7f5cfc06e320 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d1c0d2680 0x7f5d1c0b9fb0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 --2- 172.21.15.99:0/2358545797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d1c0cfc90 0x7f5d1c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 -- 172.21.15.99:0/2358545797 >> 172.21.15.99:0/2358545797 conn(0x7f5d1c09de00 msgr2=0x7f5d1c06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 -- 172.21.15.99:0/2358545797 shutdown_connections 2024-09-10T07:37:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.022+0000 7f5d20a00640 1 -- 172.21.15.99:0/2358545797 wait complete. 2024-09-10T07:37:50.041 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-10T07:37:50.213 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_objectstore":"memstore"} 2024-09-10T07:37:50.213 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-10T07:37:50.213 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T07:37:50.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.371+0000 7f27d1c00640 1 Processor -- start 2024-09-10T07:37:50.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.372+0000 7f27d1c00640 1 -- start start 2024-09-10T07:37:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.373+0000 7f27d1c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f27cc15eab0 0x7f27cc0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.373+0000 7f27d1c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f27cc070b40 0x7f27cc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.373+0000 7f27d1c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27cc0d3710 con 0x7f27cc06d260 2024-09-10T07:37:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.373+0000 7f27d1c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f27cc0b6390 con 0x7f27cc070b40 2024-09-10T07:37:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.373+0000 7f27d1c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f27cc0b6670 con 0x7f27cc15eab0 2024-09-10T07:37:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.373+0000 7f27c3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f27cc070b40 0x7f27cc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.373+0000 7f27c3400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f27cc070b40 0x7f27cc06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51838/0 (socket says 172.21.15.99:51838) 2024-09-10T07:37:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.373+0000 7f27d1200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f27cc06d260 0x7f27cc0b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49692/0 (socket says 172.21.15.99:49692) 2024-09-10T07:37:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.373+0000 7f27c3400640 1 -- 172.21.15.99:0/3604754244 learned_addr learned my addr 172.21.15.99:0/3604754244 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:50.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.373+0000 7f27cbe00640 1 --2- 172.21.15.99:0/3604754244 >> v2:172.21.15.187:3300/0 conn(0x7f27cc15eab0 0x7f27cc0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:50.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.374+0000 7f27c3400640 1 -- 172.21.15.99:0/3604754244 >> v2:172.21.15.187:3300/0 conn(0x7f27cc15eab0 msgr2=0x7f27cc0b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.374+0000 7f27c3400640 1 --2- 172.21.15.99:0/3604754244 >> v2:172.21.15.187:3300/0 conn(0x7f27cc15eab0 0x7f27cc0b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.374+0000 7f27c3400640 1 -- 172.21.15.99:0/3604754244 >> v1:172.21.15.99:6789/0 conn(0x7f27cc06d260 legacy=0x7f27cc0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.374+0000 7f27c3400640 1 -- 172.21.15.99:0/3604754244 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc0b6950 con 0x7f27cc070b40 2024-09-10T07:37:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.374+0000 7f27cb400640 1 -- 172.21.15.99:0/3604754244 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 639961839 0 0) 0x7f27cc0d3710 con 0x7f27cc06d260 2024-09-10T07:37:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.375+0000 7f27c3400640 1 --2- 172.21.15.99:0/3604754244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc070b40 0x7f27cc06cd20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0b8900 tx=0x7f27b402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc2c477d0d6a13a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.375+0000 7f27cb400640 1 -- 172.21.15.99:0/3604754244 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4037070 con 0x7f27cc070b40 2024-09-10T07:37:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.375+0000 7f27cb400640 1 -- 172.21.15.99:0/3604754244 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b4032440 con 0x7f27cc070b40 2024-09-10T07:37:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.375+0000 7f27cb400640 1 -- 172.21.15.99:0/3604754244 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4032810 con 0x7f27cc070b40 2024-09-10T07:37:50.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.375+0000 7f27d1c00640 1 -- 172.21.15.99:0/3604754244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc070b40 msgr2=0x7f27cc06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:50.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.375+0000 7f27d1c00640 1 --2- 172.21.15.99:0/3604754244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc070b40 0x7f27cc06cd20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0b8900 tx=0x7f27b402a160 comp rx=0 tx=0).stop 2024-09-10T07:37:50.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.375+0000 7f27d1c00640 1 -- 172.21.15.99:0/3604754244 shutdown_connections 2024-09-10T07:37:50.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.375+0000 7f27d1c00640 1 --2- 172.21.15.99:0/3604754244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc070b40 0x7f27cc06cd20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.375+0000 7f27d1c00640 1 --2- 172.21.15.99:0/3604754244 >> v2:172.21.15.187:3300/0 conn(0x7f27cc15eab0 0x7f27cc0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.375+0000 7f27d1c00640 1 -- 172.21.15.99:0/3604754244 >> 172.21.15.99:0/3604754244 conn(0x7f27cc0b7cc0 msgr2=0x7f27cc0b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:50.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.376+0000 7f27d1c00640 1 -- 172.21.15.99:0/3604754244 shutdown_connections 2024-09-10T07:37:50.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.376+0000 7f27d1c00640 1 -- 172.21.15.99:0/3604754244 wait complete. 2024-09-10T07:37:50.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.377+0000 7f27d1c00640 1 Processor -- start 2024-09-10T07:37:50.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.377+0000 7f27d1c00640 1 -- start start 2024-09-10T07:37:50.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.378+0000 7f27d1c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27cc06d260 0x7f27cc1f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:50.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.378+0000 7f27d1c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27cc070b40 0x7f27cc159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.378+0000 7f27d1c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc15eab0 0x7f27cc14a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.378+0000 7f27d1c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc15ee90 con 0x7f27cc15eab0 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.378+0000 7f27d1c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc0b7860 con 0x7f27cc070b40 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.378+0000 7f27d1c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f27cc1f8b40 con 0x7f27cc06d260 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.378+0000 7f27d1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc15eab0 0x7f27cc14a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27d1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc15eab0 0x7f27cc14a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51840/0 (socket says 172.21.15.99:51840) 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27d1200640 1 -- 172.21.15.99:0/4089387736 learned_addr learned my addr 172.21.15.99:0/4089387736 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27c3400640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27cc070b40 0x7f27cc159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27cbe00640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27cc06d260 0x7f27cc1f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27d1200640 1 -- 172.21.15.99:0/4089387736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27cc06d260 msgr2=0x7f27cc1f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27d1200640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27cc06d260 0x7f27cc1f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27d1200640 1 -- 172.21.15.99:0/4089387736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27cc070b40 msgr2=0x7f27cc159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27d1200640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27cc070b40 0x7f27cc159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27d1200640 1 -- 172.21.15.99:0/4089387736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc1f82a0 con 0x7f27cc15eab0 2024-09-10T07:37:50.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27d1200640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc15eab0 0x7f27cc14a290 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c730 tx=0x7f27c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:50.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27c8c00640 1 -- 172.21.15.99:0/4089387736 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4018070 con 0x7f27cc15eab0 2024-09-10T07:37:50.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.379+0000 7f27c8c00640 1 -- 172.21.15.99:0/4089387736 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c400ce40 con 0x7f27cc15eab0 2024-09-10T07:37:50.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.380+0000 7f27d1c00640 1 -- 172.21.15.99:0/4089387736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27cc1f8580 con 0x7f27cc15eab0 2024-09-10T07:37:50.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.380+0000 7f27c8c00640 1 -- 172.21.15.99:0/4089387736 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c400a880 con 0x7f27cc15eab0 2024-09-10T07:37:50.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.380+0000 7f27d1c00640 1 -- 172.21.15.99:0/4089387736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27cc154da0 con 0x7f27cc15eab0 2024-09-10T07:37:50.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.381+0000 7f27d1c00640 1 -- 172.21.15.99:0/4089387736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27cc0d3230 con 0x7f27cc15eab0 2024-09-10T07:37:50.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.382+0000 7f27c8c00640 1 -- 172.21.15.99:0/4089387736 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27c401b070 con 0x7f27cc15eab0 2024-09-10T07:37:50.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.382+0000 7f27c8c00640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27a806be30 0x7f27a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:50.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.383+0000 7f27c8c00640 1 -- 172.21.15.99:0/4089387736 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7f27c408a0d0 con 0x7f27cc15eab0 2024-09-10T07:37:50.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.383+0000 7f27cbe00640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27a806be30 0x7f27a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:50.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.383+0000 7f27cbe00640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27a806be30 0x7f27a806e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009970 tx=0x7f27bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:50.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.387+0000 7f27c8c00640 1 -- 172.21.15.99:0/4089387736 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27c4058e10 con 0x7f27cc15eab0 2024-09-10T07:37:50.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.559+0000 7f27d1c00640 1 -- 172.21.15.99:0/4089387736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f27cc071500 con 0x7f27cc15eab0 2024-09-10T07:37:50.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.563+0000 7f27c8c00640 1 -- 172.21.15.99:0/4089387736 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f27c4058710 con 0x7f27cc15eab0 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.565+0000 7f27d1c00640 1 -- 172.21.15.99:0/4089387736 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27a806be30 msgr2=0x7f27a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.565+0000 7f27d1c00640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27a806be30 0x7f27a806e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009970 tx=0x7f27bc008040 comp rx=0 tx=0).stop 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.565+0000 7f27d1c00640 1 -- 172.21.15.99:0/4089387736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc15eab0 msgr2=0x7f27cc14a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.565+0000 7f27d1c00640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc15eab0 0x7f27cc14a290 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c730 tx=0x7f27c400cbf0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.566+0000 7f27d1c00640 1 -- 172.21.15.99:0/4089387736 shutdown_connections 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.566+0000 7f27d1c00640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f27a806be30 0x7f27a806e2f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.566+0000 7f27d1c00640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27cc15eab0 0x7f27cc14a290 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.566+0000 7f27d1c00640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27cc070b40 0x7f27cc159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.566+0000 7f27d1c00640 1 --2- 172.21.15.99:0/4089387736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27cc06d260 0x7f27cc1f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.566+0000 7f27d1c00640 1 -- 172.21.15.99:0/4089387736 >> 172.21.15.99:0/4089387736 conn(0x7f27cc0b7cc0 msgr2=0x7f27cc0b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:50.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.566+0000 7f27d1c00640 1 -- 172.21.15.99:0/4089387736 shutdown_connections 2024-09-10T07:37:50.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:50.566+0000 7f27d1c00640 1 -- 172.21.15.99:0/4089387736 wait complete. 2024-09-10T07:37:50.580 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:37:50.580 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:37:50.665 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:37:50.757 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:37:50.757 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:37:50.757 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:37:50.793 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:37:50.794 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:37:50.794 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:37:50.830 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:37:50.831 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:37:50.831 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:37:50.869 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:37:50.869 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:37:50.869 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:37:50.906 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:37:50.906 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T07:37:50.906 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:37:51.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.064+0000 7ff031e00640 1 Processor -- start 2024-09-10T07:37:51.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.064+0000 7ff031e00640 1 -- start start 2024-09-10T07:37:51.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.065+0000 7ff031e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff02c145290 0x7ff02c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.065+0000 7ff031e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff02c072f40 0x7ff02c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.065+0000 7ff031e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff02c06e3d0 con 0x7ff02c0ce780 2024-09-10T07:37:51.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.065+0000 7ff031e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff02c06efe0 con 0x7ff02c145290 2024-09-10T07:37:51.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.065+0000 7ff031e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff02c06e6b0 con 0x7ff02c072f40 2024-09-10T07:37:51.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.066+0000 7ff02aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff02c145290 0x7ff02c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.066+0000 7ff02aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff02c145290 0x7ff02c06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51844/0 (socket says 172.21.15.99:51844) 2024-09-10T07:37:51.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.066+0000 7ff02aa00640 1 -- 172.21.15.99:0/3895545803 learned_addr learned my addr 172.21.15.99:0/3895545803 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:51.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.066+0000 7ff02a000640 1 --1- 172.21.15.99:0/3895545803 >> v1:172.21.15.99:6789/0 conn(0x7ff02c0ce780 0x7ff02c072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49700/0 (socket says 172.21.15.99:49700) 2024-09-10T07:37:51.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.066+0000 7ff02b400640 1 --2- 172.21.15.99:0/3895545803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff02c072f40 0x7ff02c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.066+0000 7ff02aa00640 1 -- 172.21.15.99:0/3895545803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff02c072f40 msgr2=0x7ff02c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:51.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.066+0000 7ff02aa00640 1 --2- 172.21.15.99:0/3895545803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff02c072f40 0x7ff02c0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.066+0000 7ff02aa00640 1 -- 172.21.15.99:0/3895545803 >> v1:172.21.15.99:6789/0 conn(0x7ff02c0ce780 legacy=0x7ff02c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:51.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.066+0000 7ff02aa00640 1 -- 172.21.15.99:0/3895545803 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02c06e990 con 0x7ff02c145290 2024-09-10T07:37:51.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.067+0000 7ff02aa00640 1 --2- 172.21.15.99:0/3895545803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 0x7ff02c06f470 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009870 tx=0x7ff01c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9541b601c5516b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:51.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.067+0000 7ff029600640 1 -- 172.21.15.99:0/3895545803 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c037070 con 0x7ff02c145290 2024-09-10T07:37:51.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.067+0000 7ff029600640 1 -- 172.21.15.99:0/3895545803 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff01c032440 con 0x7ff02c145290 2024-09-10T07:37:51.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.067+0000 7ff029600640 1 -- 172.21.15.99:0/3895545803 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01c032810 con 0x7ff02c145290 2024-09-10T07:37:51.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.068+0000 7ff031e00640 1 -- 172.21.15.99:0/3895545803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 msgr2=0x7ff02c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:51.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.068+0000 7ff031e00640 1 --2- 172.21.15.99:0/3895545803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 0x7ff02c06f470 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009870 tx=0x7ff01c02a250 comp rx=0 tx=0).stop 2024-09-10T07:37:51.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.068+0000 7ff031e00640 1 -- 172.21.15.99:0/3895545803 shutdown_connections 2024-09-10T07:37:51.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.068+0000 7ff031e00640 1 --2- 172.21.15.99:0/3895545803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff02c072f40 0x7ff02c0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.068+0000 7ff031e00640 1 --2- 172.21.15.99:0/3895545803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 0x7ff02c06f470 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.068+0000 7ff031e00640 1 -- 172.21.15.99:0/3895545803 >> 172.21.15.99:0/3895545803 conn(0x7ff02c06bc10 msgr2=0x7ff02c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:51.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.068+0000 7ff031e00640 1 -- 172.21.15.99:0/3895545803 shutdown_connections 2024-09-10T07:37:51.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.068+0000 7ff031e00640 1 -- 172.21.15.99:0/3895545803 wait complete. 2024-09-10T07:37:51.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.070+0000 7ff031e00640 1 Processor -- start 2024-09-10T07:37:51.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.070+0000 7ff031e00640 1 -- start start 2024-09-10T07:37:51.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff031e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff02c072f40 0x7ff02c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff031e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff02c0ce780 0x7ff02c15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff031e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 0x7ff02c0aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff031e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c06df80 con 0x7ff02c145290 2024-09-10T07:37:51.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff031e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff02c145670 con 0x7ff02c0ce780 2024-09-10T07:37:51.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff031e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff02c06e100 con 0x7ff02c072f40 2024-09-10T07:37:51.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff02b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 0x7ff02c0aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff02b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 0x7ff02c0aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51852/0 (socket says 172.21.15.99:51852) 2024-09-10T07:37:51.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff02b400640 1 -- 172.21.15.99:0/3342519348 learned_addr learned my addr 172.21.15.99:0/3342519348 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff02a000640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff02c0ce780 0x7ff02c15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff02aa00640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff02c072f40 0x7ff02c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff02b400640 1 -- 172.21.15.99:0/3342519348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff02c072f40 msgr2=0x7ff02c13db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff02b400640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff02c072f40 0x7ff02c13db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff02b400640 1 -- 172.21.15.99:0/3342519348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff02c0ce780 msgr2=0x7ff02c15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff02b400640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff02c0ce780 0x7ff02c15b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.071+0000 7ff02b400640 1 -- 172.21.15.99:0/3342519348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02c0ab190 con 0x7ff02c145290 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.072+0000 7ff02b400640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 0x7ff02c0aa430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff02400ebe0 tx=0x7ff02400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.072+0000 7ff023400640 1 -- 172.21.15.99:0/3342519348 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024018020 con 0x7ff02c145290 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.072+0000 7ff023400640 1 -- 172.21.15.99:0/3342519348 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02400cd40 con 0x7ff02c145290 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.072+0000 7ff023400640 1 -- 172.21.15.99:0/3342519348 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240146c0 con 0x7ff02c145290 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.072+0000 7ff031e00640 1 -- 172.21.15.99:0/3342519348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff02c0ab470 con 0x7ff02c145290 2024-09-10T07:37:51.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.072+0000 7ff031e00640 1 -- 172.21.15.99:0/3342519348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff02c0aba30 con 0x7ff02c145290 2024-09-10T07:37:51.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.073+0000 7ff031e00640 1 -- 172.21.15.99:0/3342519348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff02c071510 con 0x7ff02c145290 2024-09-10T07:37:51.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.074+0000 7ff023400640 1 -- 172.21.15.99:0/3342519348 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff024005d10 con 0x7ff02c145290 2024-09-10T07:37:51.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.075+0000 7ff023400640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff00c06be60 0x7ff00c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.075+0000 7ff023400640 1 -- 172.21.15.99:0/3342519348 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7ff02408b7c0 con 0x7ff02c145290 2024-09-10T07:37:51.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.075+0000 7ff02aa00640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff00c06be60 0x7ff00c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.076+0000 7ff02aa00640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff00c06be60 0x7ff00c06e320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff01c034000 tx=0x7ff01c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:51.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.079+0000 7ff023400640 1 -- 172.21.15.99:0/3342519348 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff024022030 con 0x7ff02c145290 2024-09-10T07:37:51.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.285+0000 7ff031e00640 1 -- 172.21.15.99:0/3342519348 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff02c0b1090 con 0x7ff02c145290 2024-09-10T07:37:51.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.286+0000 7ff023400640 1 -- 172.21.15.99:0/3342519348 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3914 (secure 0 0 0) 0x7ff024010040 con 0x7ff02c145290 2024-09-10T07:37:51.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:51.285 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":36,"btime":"2024-09-10T07:37:44:982469+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/2770940747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2770940747},{"type":"v1","addr":"172.21.15.187:6834","nonce":2770940747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":4997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/1207587759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1207587759},{"type":"v1","addr":"172.21.15.99:6836","nonce":1207587759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5463,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3753955373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3753955373},{"type":"v1","addr":"172.21.15.187:6835","nonce":3753955373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/480136887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":480136887},{"type":"v1","addr":"172.21.15.99:6837","nonce":480136887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[]} 2024-09-10T07:37:51.285 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 36 2024-09-10T07:37:51.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 -- 172.21.15.99:0/3342519348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff00c06be60 msgr2=0x7ff00c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:51.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff00c06be60 0x7ff00c06e320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff01c034000 tx=0x7ff01c02e000 comp rx=0 tx=0).stop 2024-09-10T07:37:51.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 -- 172.21.15.99:0/3342519348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 msgr2=0x7ff02c0aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:51.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 0x7ff02c0aa430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff02400ebe0 tx=0x7ff02400c490 comp rx=0 tx=0).stop 2024-09-10T07:37:51.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 -- 172.21.15.99:0/3342519348 shutdown_connections 2024-09-10T07:37:51.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff00c06be60 0x7ff00c06e320 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c145290 0x7ff02c0aa430 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff02c0ce780 0x7ff02c15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 --2- 172.21.15.99:0/3342519348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff02c072f40 0x7ff02c13db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 -- 172.21.15.99:0/3342519348 >> 172.21.15.99:0/3342519348 conn(0x7ff02c06bc10 msgr2=0x7ff02c0b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:51.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 -- 172.21.15.99:0/3342519348 shutdown_connections 2024-09-10T07:37:51.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.288+0000 7ff031e00640 1 -- 172.21.15.99:0/3342519348 wait complete. 2024-09-10T07:37:51.303 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:37:51.303 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T07:37:51.304 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:37:51.304 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:37:51.304 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:37:51.304 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T07:37:51.304 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:37:51.304 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:37:51.304 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:37:51.305 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T07:37:51.305 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:37:51.305 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:37:51.305 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:37:51.305 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T07:37:51.305 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:37:51.305 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:37:51.319 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:37:51.319 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:37:51.320 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:37:51.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:37:51.321 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:37:51.321 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:37:51.322 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:37:51.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:37:51.364 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:37:51.364 DEBUG:teuthology.parallel:result is None 2024-09-10T07:37:51.366 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:37:51.366 DEBUG:teuthology.parallel:result is None 2024-09-10T07:37:51.366 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:37:51.367 DEBUG:teuthology.parallel:result is None 2024-09-10T07:37:51.368 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:37:51.368 DEBUG:teuthology.parallel:result is None 2024-09-10T07:37:51.368 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T07:37:51.496 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:37:51.497 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:37:51.497 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:37:51.497 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:37:51.498 INFO:tasks.ceph.mds.a.smithi099.stderr:2024-09-10T07:37:51.499+0000 7f3941e00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-10T07:37:51.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.529+0000 7f937a000640 1 Processor -- start 2024-09-10T07:37:51.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.529+0000 7f937a000640 1 -- start start 2024-09-10T07:37:51.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.531+0000 7f937a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93740b5650 0x7f937415be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.531+0000 7f937a000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9374073850 con 0x7f93740d1740 2024-09-10T07:37:51.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.531+0000 7f937a000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9374072cd0 con 0x7f93740727d0 2024-09-10T07:37:51.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.531+0000 7f937a000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9374072fb0 con 0x7f93740b5650 2024-09-10T07:37:51.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.531+0000 7f9372a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f93740d1740 0x7f93740b5a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49714/0 (socket says 172.21.15.99:49714) 2024-09-10T07:37:51.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.531+0000 7f9373400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93740b5650 0x7f937415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.531+0000 7f9372a00640 1 -- 172.21.15.99:0/2197497584 learned_addr learned my addr 172.21.15.99:0/2197497584 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:51.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.531+0000 7f9373400640 1 -- 172.21.15.99:0/2197497584 >> v1:172.21.15.187:6789/0 conn(0x7f93740727d0 legacy=0x7f937406eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:51.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.531+0000 7f9373400640 1 -- 172.21.15.99:0/2197497584 >> v1:172.21.15.99:6789/0 conn(0x7f93740d1740 legacy=0x7f93740b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:51.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.531+0000 7f9373400640 1 -- 172.21.15.99:0/2197497584 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9374073290 con 0x7f93740b5650 2024-09-10T07:37:51.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.532+0000 7f9373400640 1 --2- 172.21.15.99:0/2197497584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740b5650 0x7f937415be20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f93640097a0 tx=0x7f936402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7a5d1a2d054324 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:51.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.532+0000 7f9372000640 1 -- 172.21.15.99:0/2197497584 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364037070 con 0x7f93740b5650 2024-09-10T07:37:51.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.533+0000 7f9372000640 1 -- 172.21.15.99:0/2197497584 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9364032440 con 0x7f93740b5650 2024-09-10T07:37:51.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.533+0000 7f9372000640 1 -- 172.21.15.99:0/2197497584 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364032810 con 0x7f93740b5650 2024-09-10T07:37:51.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.533+0000 7f937a000640 1 -- 172.21.15.99:0/2197497584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740b5650 msgr2=0x7f937415be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:51.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.533+0000 7f937a000640 1 --2- 172.21.15.99:0/2197497584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740b5650 0x7f937415be20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f93640097a0 tx=0x7f936402a230 comp rx=0 tx=0).stop 2024-09-10T07:37:51.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.533+0000 7f937a000640 1 -- 172.21.15.99:0/2197497584 shutdown_connections 2024-09-10T07:37:51.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.533+0000 7f937a000640 1 --2- 172.21.15.99:0/2197497584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740b5650 0x7f937415be20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.533+0000 7f937a000640 1 -- 172.21.15.99:0/2197497584 >> 172.21.15.99:0/2197497584 conn(0x7f93740b3890 msgr2=0x7f93740b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:51.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.533+0000 7f937a000640 1 -- 172.21.15.99:0/2197497584 shutdown_connections 2024-09-10T07:37:51.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.533+0000 7f937a000640 1 -- 172.21.15.99:0/2197497584 wait complete. 2024-09-10T07:37:51.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.535+0000 7f937a000640 1 Processor -- start 2024-09-10T07:37:51.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.535+0000 7f937a000640 1 -- start start 2024-09-10T07:37:51.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f937a000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93740727d0 0x7f93740cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f937a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740b5650 0x7f937415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f937a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93740d1740 0x7f9374159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f937a000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9374159880 con 0x7f93740b5650 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f937a000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9374159700 con 0x7f93740727d0 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f937a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f937406f220 con 0x7f93740d1740 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9372a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740b5650 0x7f937415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9373400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93740727d0 0x7f93740cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9373400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93740727d0 0x7f93740cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:35012/0 (socket says 172.21.15.99:35012) 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9373400640 1 -- 172.21.15.99:0/864689847 learned_addr learned my addr 172.21.15.99:0/864689847 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9373e00640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93740d1740 0x7f9374159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9373400640 1 -- 172.21.15.99:0/864689847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93740d1740 msgr2=0x7f9374159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9373400640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93740d1740 0x7f9374159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9373400640 1 -- 172.21.15.99:0/864689847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740b5650 msgr2=0x7f937415dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9373400640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740b5650 0x7f937415dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9373400640 1 -- 172.21.15.99:0/864689847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93740cf4b0 con 0x7f93740727d0 2024-09-10T07:37:51.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.536+0000 7f9372a00640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740b5650 0x7f937415dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:37:51.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.537+0000 7f9373400640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93740727d0 0x7f93740cedd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f93640098c0 tx=0x7f93640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:51.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.537+0000 7f936b400640 1 -- 172.21.15.99:0/864689847 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364037040 con 0x7f93740727d0 2024-09-10T07:37:51.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.537+0000 7f936b400640 1 -- 172.21.15.99:0/864689847 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9364030770 con 0x7f93740727d0 2024-09-10T07:37:51.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.537+0000 7f936b400640 1 -- 172.21.15.99:0/864689847 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364030b40 con 0x7f93740727d0 2024-09-10T07:37:51.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.537+0000 7f937a000640 1 -- 172.21.15.99:0/864689847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93740cf790 con 0x7f93740727d0 2024-09-10T07:37:51.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.537+0000 7f937a000640 1 -- 172.21.15.99:0/864689847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93740cfd50 con 0x7f93740727d0 2024-09-10T07:37:51.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.538+0000 7f937a000640 1 -- 172.21.15.99:0/864689847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f937415be20 con 0x7f93740727d0 2024-09-10T07:37:51.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.539+0000 7f936b400640 1 -- 172.21.15.99:0/864689847 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9364044020 con 0x7f93740727d0 2024-09-10T07:37:51.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.540+0000 7f936b400640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f935406be30 0x7f935406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:51.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.540+0000 7f936b400640 1 -- 172.21.15.99:0/864689847 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7f93640aafd0 con 0x7f93740727d0 2024-09-10T07:37:51.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.540+0000 7f9372a00640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f935406be30 0x7f935406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:51.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.541+0000 7f9372a00640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f935406be30 0x7f935406e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f937414e640 tx=0x7f9360009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:51.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.545+0000 7f936b400640 1 -- 172.21.15.99:0/864689847 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9364032e20 con 0x7f93740727d0 2024-09-10T07:37:51.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:51.734+0000 7f937a000640 1 -- 172.21.15.99:0/864689847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f93740d0020 con 0x7f93740727d0 2024-09-10T07:37:52.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.579+0000 7f936b400640 1 -- 172.21.15.99:0/864689847 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v79) ==== 97+0+0 (secure 0 0 0) 0x7f9364079630 con 0x7f93740727d0 2024-09-10T07:37:52.578 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-09-10T07:37:52.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.581+0000 7f937a000640 1 -- 172.21.15.99:0/864689847 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f935406be30 msgr2=0x7f935406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:52.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.581+0000 7f937a000640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f935406be30 0x7f935406e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f937414e640 tx=0x7f9360009040 comp rx=0 tx=0).stop 2024-09-10T07:37:52.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.581+0000 7f937a000640 1 -- 172.21.15.99:0/864689847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93740727d0 msgr2=0x7f93740cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:52.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.581+0000 7f937a000640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93740727d0 0x7f93740cedd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f93640098c0 tx=0x7f93640046c0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.582+0000 7f937a000640 1 -- 172.21.15.99:0/864689847 shutdown_connections 2024-09-10T07:37:52.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.582+0000 7f937a000640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93740d1740 0x7f9374159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.582+0000 7f937a000640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f935406be30 0x7f935406e2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.582+0000 7f937a000640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93740b5650 0x7f937415dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.582+0000 7f937a000640 1 --2- 172.21.15.99:0/864689847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93740727d0 0x7f93740cedd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.582+0000 7f937a000640 1 -- 172.21.15.99:0/864689847 >> 172.21.15.99:0/864689847 conn(0x7f93740b3890 msgr2=0x7f937415f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:52.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.582+0000 7f937a000640 1 -- 172.21.15.99:0/864689847 shutdown_connections 2024-09-10T07:37:52.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.582+0000 7f937a000640 1 -- 172.21.15.99:0/864689847 wait complete. 2024-09-10T07:37:52.598 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T07:37:52.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.754+0000 7f9c7be00640 1 Processor -- start 2024-09-10T07:37:52.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.754+0000 7f9c7be00640 1 -- start start 2024-09-10T07:37:52.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.755+0000 7f9c7be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c7415ecc0 0x7f9c740d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:52.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.755+0000 7f9c7be00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9c740d57a0 0x7f9c740d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:52.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.755+0000 7f9c7be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 0x7f9c740cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:52.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.755+0000 7f9c7be00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9c740d3b20 con 0x7f9c7415ecc0 2024-09-10T07:37:52.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.755+0000 7f9c7be00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f9c740b42f0 con 0x7f9c740d57a0 2024-09-10T07:37:52.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.755+0000 7f9c7be00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9c740b45d0 con 0x7f9c740d1990 2024-09-10T07:37:52.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.755+0000 7f9c79400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c7415ecc0 0x7f9c740d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:52.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.756+0000 7f9c79400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c7415ecc0 0x7f9c740d3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51894/0 (socket says 172.21.15.99:51894) 2024-09-10T07:37:52.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.756+0000 7f9c79400640 1 -- 172.21.15.99:0/2039278753 learned_addr learned my addr 172.21.15.99:0/2039278753 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.756+0000 7f9c78a00640 1 --2- 172.21.15.99:0/2039278753 >> v2:172.21.15.187:3300/0 conn(0x7f9c740d57a0 0x7f9c740d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.756+0000 7f9c79e00640 1 --2- 172.21.15.99:0/2039278753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 0x7f9c740cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.756+0000 7f9c79400640 1 -- 172.21.15.99:0/2039278753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 msgr2=0x7f9c740cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.756+0000 7f9c79400640 1 --2- 172.21.15.99:0/2039278753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 0x7f9c740cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.756+0000 7f9c79400640 1 -- 172.21.15.99:0/2039278753 >> v2:172.21.15.187:3300/0 conn(0x7f9c740d57a0 msgr2=0x7f9c740d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.756+0000 7f9c79400640 1 --2- 172.21.15.99:0/2039278753 >> v2:172.21.15.187:3300/0 conn(0x7f9c740d57a0 0x7f9c740d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.756+0000 7f9c79400640 1 -- 172.21.15.99:0/2039278753 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c740b48b0 con 0x7f9c7415ecc0 2024-09-10T07:37:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.756+0000 7f9c78a00640 1 --2- 172.21.15.99:0/2039278753 >> v2:172.21.15.187:3300/0 conn(0x7f9c740d57a0 0x7f9c740d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:37:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.757+0000 7f9c79400640 1 --2- 172.21.15.99:0/2039278753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c7415ecc0 0x7f9c740d3170 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9c740d3e10 tx=0x7f9c6802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf3f46dea9c63e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.757+0000 7f9c73e00640 1 -- 172.21.15.99:0/2039278753 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68037070 con 0x7f9c7415ecc0 2024-09-10T07:37:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.757+0000 7f9c73e00640 1 -- 172.21.15.99:0/2039278753 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c68032440 con 0x7f9c7415ecc0 2024-09-10T07:37:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.757+0000 7f9c73e00640 1 -- 172.21.15.99:0/2039278753 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68032810 con 0x7f9c7415ecc0 2024-09-10T07:37:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.758+0000 7f9c7be00640 1 -- 172.21.15.99:0/2039278753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c7415ecc0 msgr2=0x7f9c740d3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.758+0000 7f9c7be00640 1 --2- 172.21.15.99:0/2039278753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c7415ecc0 0x7f9c740d3170 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9c740d3e10 tx=0x7f9c6802a1e0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.758+0000 7f9c7be00640 1 -- 172.21.15.99:0/2039278753 shutdown_connections 2024-09-10T07:37:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.758+0000 7f9c7be00640 1 --2- 172.21.15.99:0/2039278753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 0x7f9c740cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.758+0000 7f9c7be00640 1 --2- 172.21.15.99:0/2039278753 >> v2:172.21.15.187:3300/0 conn(0x7f9c740d57a0 0x7f9c740d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.758+0000 7f9c7be00640 1 --2- 172.21.15.99:0/2039278753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c7415ecc0 0x7f9c740d3170 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.758+0000 7f9c7be00640 1 -- 172.21.15.99:0/2039278753 >> 172.21.15.99:0/2039278753 conn(0x7f9c740d4bd0 msgr2=0x7f9c740d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.758+0000 7f9c7be00640 1 -- 172.21.15.99:0/2039278753 shutdown_connections 2024-09-10T07:37:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.758+0000 7f9c7be00640 1 -- 172.21.15.99:0/2039278753 wait complete. 2024-09-10T07:37:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.759+0000 7f9c7be00640 1 Processor -- start 2024-09-10T07:37:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.760+0000 7f9c7be00640 1 -- start start 2024-09-10T07:37:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.760+0000 7f9c7be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 0x7f9c7415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.760+0000 7f9c7be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c740d57a0 0x7f9c74161e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.760+0000 7f9c7be00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c7415ecc0 0x7f9c741603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c7be00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7415f220 con 0x7f9c740d57a0 2024-09-10T07:37:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c7be00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7415f0a0 con 0x7f9c7415ecc0 2024-09-10T07:37:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c7be00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9c740d36b0 con 0x7f9c740d1990 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c78a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c740d57a0 0x7f9c74161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c78a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c740d57a0 0x7f9c74161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51898/0 (socket says 172.21.15.99:51898) 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c78a00640 1 -- 172.21.15.99:0/1920692283 learned_addr learned my addr 172.21.15.99:0/1920692283 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c79400640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 0x7f9c7415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c79e00640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c7415ecc0 0x7f9c741603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c78a00640 1 -- 172.21.15.99:0/1920692283 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 msgr2=0x7f9c7415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c78a00640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 0x7f9c7415b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c78a00640 1 -- 172.21.15.99:0/1920692283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c7415ecc0 msgr2=0x7f9c741603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c78a00640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c7415ecc0 0x7f9c741603f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c78a00640 1 -- 172.21.15.99:0/1920692283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c74160db0 con 0x7f9c740d57a0 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.761+0000 7f9c79400640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 0x7f9c7415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.762+0000 7f9c78a00640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c740d57a0 0x7f9c74161e50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000e810 tx=0x7f9c6000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.762+0000 7f9c71600640 1 -- 172.21.15.99:0/1920692283 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000f040 con 0x7f9c740d57a0 2024-09-10T07:37:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.762+0000 7f9c71600640 1 -- 172.21.15.99:0/1920692283 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c60004030 con 0x7f9c740d57a0 2024-09-10T07:37:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.762+0000 7f9c7be00640 1 -- 172.21.15.99:0/1920692283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c74161090 con 0x7f9c740d57a0 2024-09-10T07:37:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.762+0000 7f9c71600640 1 -- 172.21.15.99:0/1920692283 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60004400 con 0x7f9c740d57a0 2024-09-10T07:37:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.762+0000 7f9c7be00640 1 -- 172.21.15.99:0/1920692283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c74161650 con 0x7f9c740d57a0 2024-09-10T07:37:52.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.763+0000 7f9c7be00640 1 -- 172.21.15.99:0/1920692283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c740d1450 con 0x7f9c740d57a0 2024-09-10T07:37:52.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.764+0000 7f9c71600640 1 -- 172.21.15.99:0/1920692283 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c6000c6d0 con 0x7f9c740d57a0 2024-09-10T07:37:52.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.765+0000 7f9c71600640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9c5406be30 0x7f9c5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:52.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.765+0000 7f9c71600640 1 -- 172.21.15.99:0/1920692283 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7f9c6008a9a0 con 0x7f9c740d57a0 2024-09-10T07:37:52.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.765+0000 7f9c79400640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9c5406be30 0x7f9c5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:52.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.766+0000 7f9c79400640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9c5406be30 0x7f9c5406e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9c68034000 tx=0x7f9c6802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:52.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:52.769+0000 7f9c71600640 1 -- 172.21.15.99:0/1920692283 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c60017020 con 0x7f9c740d57a0 2024-09-10T07:37:53.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.003+0000 7f9c7be00640 1 -- 172.21.15.99:0/1920692283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9c7408e3c0 con 0x7f9c740d57a0 2024-09-10T07:37:53.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.003+0000 7f9c71600640 1 -- 172.21.15.99:0/1920692283 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f9c60059600 con 0x7f9c740d57a0 2024-09-10T07:37:53.002 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw==", 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.003 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ==", 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw==", 2024-09-10T07:37:53.004 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw==", 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:37:53.005 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA==", 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A==", 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w==", 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:37:53.007 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA==", 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w==", 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw==", 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:37:53.009 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw==", 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.010 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg==", 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg==", 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow r", 2024-09-10T07:37:53.011 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ==", 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.012 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A==", 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw==", 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.013 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBc9t9m2Fs5JBAAQfJNCUhmbHevYDJWsG/oAg==", 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.014 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q==", 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw==", 2024-09-10T07:37:53.015 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:37:53.016 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:37:53.016 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:37:53.016 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:37:53.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.016 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:37:53.016 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:37:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.005+0000 7f9c7be00640 1 -- 172.21.15.99:0/1920692283 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9c5406be30 msgr2=0x7f9c5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.005+0000 7f9c7be00640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9c5406be30 0x7f9c5406e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9c68034000 tx=0x7f9c6802e000 comp rx=0 tx=0).stop 2024-09-10T07:37:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.005+0000 7f9c7be00640 1 -- 172.21.15.99:0/1920692283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c740d57a0 msgr2=0x7f9c74161e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.005+0000 7f9c7be00640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c740d57a0 0x7f9c74161e50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000e810 tx=0x7f9c6000ecd0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.005+0000 7f9c7be00640 1 -- 172.21.15.99:0/1920692283 shutdown_connections 2024-09-10T07:37:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.005+0000 7f9c7be00640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c7415ecc0 0x7f9c741603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.005+0000 7f9c7be00640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9c5406be30 0x7f9c5406e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.005+0000 7f9c7be00640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c740d57a0 0x7f9c74161e50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.005+0000 7f9c7be00640 1 --2- 172.21.15.99:0/1920692283 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c740d1990 0x7f9c7415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.005+0000 7f9c7be00640 1 -- 172.21.15.99:0/1920692283 >> 172.21.15.99:0/1920692283 conn(0x7f9c740d4bd0 msgr2=0x7f9c740b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.006+0000 7f9c7be00640 1 -- 172.21.15.99:0/1920692283 shutdown_connections 2024-09-10T07:37:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.006+0000 7f9c7be00640 1 -- 172.21.15.99:0/1920692283 wait complete. 2024-09-10T07:37:53.021 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:37:53.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.176+0000 7f986e000640 1 Processor -- start 2024-09-10T07:37:53.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.176+0000 7f986e000640 1 -- start start 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.177+0000 7f986e000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f98680d1190 0x7f98680b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.177+0000 7f986e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f986806eaa0 0x7f986815c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.177+0000 7f986e000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98680b4bd0 con 0x7f9868072310 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.177+0000 7f986e000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f98680b4eb0 con 0x7f986806eaa0 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.177+0000 7f986e000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f98680b5190 con 0x7f98680d1190 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.178+0000 7f986d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f986806eaa0 0x7f986815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.178+0000 7f986d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f986806eaa0 0x7f986815c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51910/0 (socket says 172.21.15.99:51910) 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.178+0000 7f986d600640 1 -- 172.21.15.99:0/1722785067 learned_addr learned my addr 172.21.15.99:0/1722785067 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.178+0000 7f986cc00640 1 --2- 172.21.15.99:0/1722785067 >> v2:172.21.15.187:3300/0 conn(0x7f98680d1190 0x7f98680b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.178+0000 7f986d600640 1 -- 172.21.15.99:0/1722785067 >> v2:172.21.15.187:3300/0 conn(0x7f98680d1190 msgr2=0x7f98680b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.178+0000 7f986d600640 1 --2- 172.21.15.99:0/1722785067 >> v2:172.21.15.187:3300/0 conn(0x7f98680d1190 0x7f98680b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.178+0000 7f986d600640 1 -- 172.21.15.99:0/1722785067 >> v1:172.21.15.187:6789/0 conn(0x7f9868072310 legacy=0x7f986806e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.178+0000 7f986d600640 1 -- 172.21.15.99:0/1722785067 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986815c010 con 0x7f986806eaa0 2024-09-10T07:37:53.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.179+0000 7f986d600640 1 --2- 172.21.15.99:0/1722785067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986806eaa0 0x7f986815c530 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f986806ef70 tx=0x7f986002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c936366f678a299d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:53.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.179+0000 7f9867400640 1 -- 172.21.15.99:0/1722785067 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860036070 con 0x7f986806eaa0 2024-09-10T07:37:53.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.179+0000 7f9867400640 1 -- 172.21.15.99:0/1722785067 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9860031600 con 0x7f986806eaa0 2024-09-10T07:37:53.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.179+0000 7f9867400640 1 -- 172.21.15.99:0/1722785067 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98600319d0 con 0x7f986806eaa0 2024-09-10T07:37:53.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.180+0000 7f986e000640 1 -- 172.21.15.99:0/1722785067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986806eaa0 msgr2=0x7f986815c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.180+0000 7f986e000640 1 --2- 172.21.15.99:0/1722785067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986806eaa0 0x7f986815c530 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f986806ef70 tx=0x7f986002a730 comp rx=0 tx=0).stop 2024-09-10T07:37:53.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.180+0000 7f986e000640 1 -- 172.21.15.99:0/1722785067 shutdown_connections 2024-09-10T07:37:53.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.180+0000 7f986e000640 1 --2- 172.21.15.99:0/1722785067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986806eaa0 0x7f986815c530 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.180+0000 7f986e000640 1 --2- 172.21.15.99:0/1722785067 >> v2:172.21.15.187:3300/0 conn(0x7f98680d1190 0x7f98680b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.180+0000 7f986e000640 1 -- 172.21.15.99:0/1722785067 >> 172.21.15.99:0/1722785067 conn(0x7f986806bc10 msgr2=0x7f986806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:53.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.180+0000 7f986e000640 1 -- 172.21.15.99:0/1722785067 shutdown_connections 2024-09-10T07:37:53.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.180+0000 7f986e000640 1 -- 172.21.15.99:0/1722785067 wait complete. 2024-09-10T07:37:53.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.182+0000 7f986e000640 1 Processor -- start 2024-09-10T07:37:53.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.182+0000 7f986e000640 1 -- start start 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986e000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f986806eaa0 0x7f9868152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9868072310 0x7f9868154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98680d1190 0x7f98680b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986e000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f986815bdd0 con 0x7f98680d1190 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986e000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f986815bc50 con 0x7f986806eaa0 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f986815ca70 con 0x7f9868072310 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98680d1190 0x7f98680b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986cc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f986806eaa0 0x7f9868152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98680d1190 0x7f98680b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51922/0 (socket says 172.21.15.99:51922) 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986d600640 1 -- 172.21.15.99:0/96319793 learned_addr learned my addr 172.21.15.99:0/96319793 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f9867e00640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9868072310 0x7f9868154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986d600640 1 -- 172.21.15.99:0/96319793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9868072310 msgr2=0x7f9868154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986d600640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9868072310 0x7f9868154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986d600640 1 -- 172.21.15.99:0/96319793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f986806eaa0 msgr2=0x7f9868152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986d600640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f986806eaa0 0x7f9868152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f986d600640 1 -- 172.21.15.99:0/96319793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98680cd980 con 0x7f98680d1190 2024-09-10T07:37:53.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.183+0000 7f9867e00640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9868072310 0x7f9868154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:37:53.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.184+0000 7f986d600640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98680d1190 0x7f98680b00d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9860034040 tx=0x7f9860004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:53.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.184+0000 7f9864c00640 1 -- 172.21.15.99:0/96319793 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860036050 con 0x7f98680d1190 2024-09-10T07:37:53.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.184+0000 7f9864c00640 1 -- 172.21.15.99:0/96319793 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9860042070 con 0x7f98680d1190 2024-09-10T07:37:53.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.184+0000 7f9864c00640 1 -- 172.21.15.99:0/96319793 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860009510 con 0x7f98680d1190 2024-09-10T07:37:53.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.184+0000 7f986e000640 1 -- 172.21.15.99:0/96319793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98680cdc60 con 0x7f98680d1190 2024-09-10T07:37:53.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.184+0000 7f986e000640 1 -- 172.21.15.99:0/96319793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98680ce220 con 0x7f98680d1190 2024-09-10T07:37:53.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.185+0000 7f986e000640 1 -- 172.21.15.99:0/96319793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98680ce560 con 0x7f98680d1190 2024-09-10T07:37:53.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.186+0000 7f9864c00640 1 -- 172.21.15.99:0/96319793 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9860007bf0 con 0x7f98680d1190 2024-09-10T07:37:53.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.187+0000 7f9864c00640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f984806be30 0x7f984806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.187+0000 7f9864c00640 1 -- 172.21.15.99:0/96319793 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7f98600ab890 con 0x7f98680d1190 2024-09-10T07:37:53.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.187+0000 7f986cc00640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f984806be30 0x7f984806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.188+0000 7f986cc00640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f984806be30 0x7f984806e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f985c013340 tx=0x7f985c00d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:53.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.191+0000 7f9864c00640 1 -- 172.21.15.99:0/96319793 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98680ce560 con 0x7f98680d1190 2024-09-10T07:37:53.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.365+0000 7f986e000640 1 -- 172.21.15.99:0/96319793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f986815c530 con 0x7f98680d1190 2024-09-10T07:37:53.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.365+0000 7f9864c00640 1 -- 172.21.15.99:0/96319793 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7f986007a610 con 0x7f98680d1190 2024-09-10T07:37:53.364 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:53.365 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:37:53.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:37:53.365 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:37:53.365 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:37:53.365 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:37:53.365 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.367+0000 7f986e000640 1 -- 172.21.15.99:0/96319793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f984806be30 msgr2=0x7f984806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.367+0000 7f986e000640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f984806be30 0x7f984806e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f985c013340 tx=0x7f985c00d040 comp rx=0 tx=0).stop 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.367+0000 7f986e000640 1 -- 172.21.15.99:0/96319793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98680d1190 msgr2=0x7f98680b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.367+0000 7f986e000640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98680d1190 0x7f98680b00d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9860034040 tx=0x7f9860004a40 comp rx=0 tx=0).stop 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.368+0000 7f986e000640 1 -- 172.21.15.99:0/96319793 shutdown_connections 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.368+0000 7f986e000640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f984806be30 0x7f984806e2f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.368+0000 7f986e000640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98680d1190 0x7f98680b00d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.368+0000 7f986e000640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9868072310 0x7f9868154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.368+0000 7f986e000640 1 --2- 172.21.15.99:0/96319793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f986806eaa0 0x7f9868152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.368+0000 7f986e000640 1 -- 172.21.15.99:0/96319793 >> 172.21.15.99:0/96319793 conn(0x7f986806bc10 msgr2=0x7f9868159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.368+0000 7f986e000640 1 -- 172.21.15.99:0/96319793 shutdown_connections 2024-09-10T07:37:53.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.368+0000 7f986e000640 1 -- 172.21.15.99:0/96319793 wait complete. 2024-09-10T07:37:53.382 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:37:53.382 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:37:53.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.541+0000 7f32ce800640 1 Processor -- start 2024-09-10T07:37:53.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.541+0000 7f32ce800640 1 -- start start 2024-09-10T07:37:53.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.542+0000 7f32ce800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f32c80ce460 0x7f32c80cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.542+0000 7f32ce800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f32c80d0420 0x7f32c806e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.542+0000 7f32ce800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32c815dfc0 con 0x7f32c806eb20 2024-09-10T07:37:53.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.542+0000 7f32ce800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f32c806ef70 con 0x7f32c80d0420 2024-09-10T07:37:53.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.542+0000 7f32ce800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f32c815d3b0 con 0x7f32c80ce460 2024-09-10T07:37:53.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.543+0000 7f32c6a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f32c80d0420 0x7f32c806e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.543+0000 7f32c6a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f32c80d0420 0x7f32c806e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51934/0 (socket says 172.21.15.99:51934) 2024-09-10T07:37:53.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.543+0000 7f32c6a00640 1 -- 172.21.15.99:0/1051319025 learned_addr learned my addr 172.21.15.99:0/1051319025 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:53.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.543+0000 7f32c7400640 1 --2- 172.21.15.99:0/1051319025 >> v2:172.21.15.187:3300/0 conn(0x7f32c80ce460 0x7f32c80cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.543+0000 7f32c6a00640 1 -- 172.21.15.99:0/1051319025 >> v2:172.21.15.187:3300/0 conn(0x7f32c80ce460 msgr2=0x7f32c80cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.543+0000 7f32c6a00640 1 --2- 172.21.15.99:0/1051319025 >> v2:172.21.15.187:3300/0 conn(0x7f32c80ce460 0x7f32c80cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.543+0000 7f32c6a00640 1 -- 172.21.15.99:0/1051319025 >> v1:172.21.15.187:6789/0 conn(0x7f32c806eb20 legacy=0x7f32c81605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.543+0000 7f32c6a00640 1 -- 172.21.15.99:0/1051319025 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c815d690 con 0x7f32c80d0420 2024-09-10T07:37:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.543+0000 7f32c7400640 1 --2- 172.21.15.99:0/1051319025 >> v2:172.21.15.187:3300/0 conn(0x7f32c80ce460 0x7f32c80cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:37:53.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.544+0000 7f32c6a00640 1 --2- 172.21.15.99:0/1051319025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c80d0420 0x7f32c806e5e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f32c8076810 tx=0x7f32b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a661e3dc3008fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:53.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.544+0000 7f32c6000640 1 -- 172.21.15.99:0/1051319025 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4037070 con 0x7f32c80d0420 2024-09-10T07:37:53.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.544+0000 7f32c6000640 1 -- 172.21.15.99:0/1051319025 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b4032440 con 0x7f32c80d0420 2024-09-10T07:37:53.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.544+0000 7f32c6000640 1 -- 172.21.15.99:0/1051319025 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4032810 con 0x7f32c80d0420 2024-09-10T07:37:53.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.545+0000 7f32ce800640 1 -- 172.21.15.99:0/1051319025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c80d0420 msgr2=0x7f32c806e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.545+0000 7f32ce800640 1 --2- 172.21.15.99:0/1051319025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c80d0420 0x7f32c806e5e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f32c8076810 tx=0x7f32b402a270 comp rx=0 tx=0).stop 2024-09-10T07:37:53.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.545+0000 7f32ce800640 1 -- 172.21.15.99:0/1051319025 shutdown_connections 2024-09-10T07:37:53.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.545+0000 7f32ce800640 1 --2- 172.21.15.99:0/1051319025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c80d0420 0x7f32c806e5e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.545+0000 7f32ce800640 1 --2- 172.21.15.99:0/1051319025 >> v2:172.21.15.187:3300/0 conn(0x7f32c80ce460 0x7f32c80cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.545+0000 7f32ce800640 1 -- 172.21.15.99:0/1051319025 >> 172.21.15.99:0/1051319025 conn(0x7f32c80b26a0 msgr2=0x7f32c80b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:53.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.545+0000 7f32ce800640 1 -- 172.21.15.99:0/1051319025 shutdown_connections 2024-09-10T07:37:53.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.545+0000 7f32ce800640 1 -- 172.21.15.99:0/1051319025 wait complete. 2024-09-10T07:37:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.547+0000 7f32ce800640 1 Processor -- start 2024-09-10T07:37:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.547+0000 7f32ce800640 1 -- start start 2024-09-10T07:37:53.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32ce800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c806eb20 0x7f32c80ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32ce800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c80ce460 0x7f32c81f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32ce800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32c80d0420 0x7f32c8151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32ce800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f32c80ce840 con 0x7f32c806eb20 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32ce800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f32c815dc50 con 0x7f32c80ce460 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32ce800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f32c815cfd0 con 0x7f32c80d0420 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c806eb20 0x7f32c80ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c806eb20 0x7f32c80ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51944/0 (socket says 172.21.15.99:51944) 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c7400640 1 -- 172.21.15.99:0/2225692185 learned_addr learned my addr 172.21.15.99:0/2225692185 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c6a00640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c80ce460 0x7f32c81f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c7e00640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32c80d0420 0x7f32c8151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c7400640 1 -- 172.21.15.99:0/2225692185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32c80d0420 msgr2=0x7f32c8151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c7400640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32c80d0420 0x7f32c8151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c7400640 1 -- 172.21.15.99:0/2225692185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c80ce460 msgr2=0x7f32c81f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:53.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c7400640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c80ce460 0x7f32c81f8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:53.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c7400640 1 -- 172.21.15.99:0/2225692185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c81f51b0 con 0x7f32c806eb20 2024-09-10T07:37:53.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.548+0000 7f32c6a00640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c80ce460 0x7f32c81f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:37:53.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.549+0000 7f32c7400640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c806eb20 0x7f32c80ae870 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f32b800c7f0 tx=0x7f32b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:53.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.549+0000 7f32bf400640 1 -- 172.21.15.99:0/2225692185 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8015070 con 0x7f32c806eb20 2024-09-10T07:37:53.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.549+0000 7f32bf400640 1 -- 172.21.15.99:0/2225692185 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b80079d0 con 0x7f32c806eb20 2024-09-10T07:37:53.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.549+0000 7f32ce800640 1 -- 172.21.15.99:0/2225692185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c81f5490 con 0x7f32c806eb20 2024-09-10T07:37:53.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.549+0000 7f32bf400640 1 -- 172.21.15.99:0/2225692185 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8007da0 con 0x7f32c806eb20 2024-09-10T07:37:53.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.549+0000 7f32ce800640 1 -- 172.21.15.99:0/2225692185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c81f5a50 con 0x7f32c806eb20 2024-09-10T07:37:53.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.550+0000 7f32ce800640 1 -- 172.21.15.99:0/2225692185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c80cfee0 con 0x7f32c806eb20 2024-09-10T07:37:53.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.551+0000 7f32bf400640 1 -- 172.21.15.99:0/2225692185 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32b8018070 con 0x7f32c806eb20 2024-09-10T07:37:53.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.552+0000 7f32bf400640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32a806be30 0x7f32a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:53.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.552+0000 7f32bf400640 1 -- 172.21.15.99:0/2225692185 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7f32b808aaa0 con 0x7f32c806eb20 2024-09-10T07:37:53.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.552+0000 7f32c6a00640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32a806be30 0x7f32a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:53.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.553+0000 7f32c6a00640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32a806be30 0x7f32a806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f32b4034000 tx=0x7f32b402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:53.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.556+0000 7f32bf400640 1 -- 172.21.15.99:0/2225692185 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32b8059790 con 0x7f32c806eb20 2024-09-10T07:37:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:53.730+0000 7f32ce800640 1 -- 172.21.15.99:0/2225692185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f32c8153470 con 0x7f32c806eb20 2024-09-10T07:37:54.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.578+0000 7f32bf400640 1 -- 172.21.15.99:0/2225692185 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7f32b8059090 con 0x7f32c806eb20 2024-09-10T07:37:54.578 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:37:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.581+0000 7f32ce800640 1 -- 172.21.15.99:0/2225692185 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32a806be30 msgr2=0x7f32a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.581+0000 7f32ce800640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32a806be30 0x7f32a806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f32b4034000 tx=0x7f32b402e000 comp rx=0 tx=0).stop 2024-09-10T07:37:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.581+0000 7f32ce800640 1 -- 172.21.15.99:0/2225692185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c806eb20 msgr2=0x7f32c80ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.581+0000 7f32ce800640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c806eb20 0x7f32c80ae870 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f32b800c7f0 tx=0x7f32b800cbf0 comp rx=0 tx=0).stop 2024-09-10T07:37:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.582+0000 7f32ce800640 1 -- 172.21.15.99:0/2225692185 shutdown_connections 2024-09-10T07:37:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.582+0000 7f32ce800640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32c80d0420 0x7f32c8151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.582+0000 7f32ce800640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32c80ce460 0x7f32c81f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.582+0000 7f32ce800640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f32a806be30 0x7f32a806e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.582+0000 7f32ce800640 1 --2- 172.21.15.99:0/2225692185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c806eb20 0x7f32c80ae870 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.582+0000 7f32ce800640 1 -- 172.21.15.99:0/2225692185 >> 172.21.15.99:0/2225692185 conn(0x7f32c80b26a0 msgr2=0x7f32c806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.583+0000 7f32ce800640 1 -- 172.21.15.99:0/2225692185 shutdown_connections 2024-09-10T07:37:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.583+0000 7f32ce800640 1 -- 172.21.15.99:0/2225692185 wait complete. 2024-09-10T07:37:54.603 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:37:54.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.769+0000 7fb5ab600640 1 Processor -- start 2024-09-10T07:37:54.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.769+0000 7fb5ab600640 1 -- start start 2024-09-10T07:37:54.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.770+0000 7fb5ab600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5a415b760 0x7fb5a40afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:54.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.770+0000 7fb5ab600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40d0630 0x7fb5a40d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:54.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.770+0000 7fb5ab600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a40b4300 con 0x7fb5a40b4a90 2024-09-10T07:37:54.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.770+0000 7fb5ab600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a40d0fa0 con 0x7fb5a415b760 2024-09-10T07:37:54.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.770+0000 7fb5ab600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a406d700 con 0x7fb5a40d0630 2024-09-10T07:37:54.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.770+0000 7fb5a8c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5a415b760 0x7fb5a40afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.770+0000 7fb5a8c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5a415b760 0x7fb5a40afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51960/0 (socket says 172.21.15.99:51960) 2024-09-10T07:37:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.770+0000 7fb5a8c00640 1 -- 172.21.15.99:0/1488286492 learned_addr learned my addr 172.21.15.99:0/1488286492 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.770+0000 7fb59be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb5a40b4a90 0x7fb5a406f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49728/0 (socket says 172.21.15.99:49728) 2024-09-10T07:37:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.771+0000 7fb5a9600640 1 --2- 172.21.15.99:0/1488286492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40d0630 0x7fb5a40d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.771+0000 7fb5a8c00640 1 -- 172.21.15.99:0/1488286492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40d0630 msgr2=0x7fb5a40d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.771+0000 7fb5a8c00640 1 --2- 172.21.15.99:0/1488286492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40d0630 0x7fb5a40d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.771+0000 7fb5a8c00640 1 -- 172.21.15.99:0/1488286492 >> v1:172.21.15.99:6789/0 conn(0x7fb5a40b4a90 legacy=0x7fb5a406f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.771+0000 7fb5a8c00640 1 -- 172.21.15.99:0/1488286492 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a406d9e0 con 0x7fb5a415b760 2024-09-10T07:37:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.771+0000 7fb5a3e00640 1 -- 172.21.15.99:0/1488286492 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1801256044 0 0) 0x7fb5a40b4300 con 0x7fb5a40b4a90 2024-09-10T07:37:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.772+0000 7fb5a8c00640 1 --2- 172.21.15.99:0/1488286492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 0x7fb5a40afa90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb594009870 tx=0x7fb59402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5565a5ffb37f689 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.772+0000 7fb5a3e00640 1 -- 172.21.15.99:0/1488286492 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594037070 con 0x7fb5a415b760 2024-09-10T07:37:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.772+0000 7fb5a3e00640 1 -- 172.21.15.99:0/1488286492 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb594032440 con 0x7fb5a415b760 2024-09-10T07:37:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.772+0000 7fb5a3e00640 1 -- 172.21.15.99:0/1488286492 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594032810 con 0x7fb5a415b760 2024-09-10T07:37:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.773+0000 7fb5ab600640 1 -- 172.21.15.99:0/1488286492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 msgr2=0x7fb5a40afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.773+0000 7fb5ab600640 1 --2- 172.21.15.99:0/1488286492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 0x7fb5a40afa90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb594009870 tx=0x7fb59402a130 comp rx=0 tx=0).stop 2024-09-10T07:37:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.773+0000 7fb5ab600640 1 -- 172.21.15.99:0/1488286492 shutdown_connections 2024-09-10T07:37:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.773+0000 7fb5ab600640 1 --2- 172.21.15.99:0/1488286492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40d0630 0x7fb5a40d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.773+0000 7fb5ab600640 1 --2- 172.21.15.99:0/1488286492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 0x7fb5a40afa90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.773+0000 7fb5ab600640 1 -- 172.21.15.99:0/1488286492 >> 172.21.15.99:0/1488286492 conn(0x7fb5a406bc10 msgr2=0x7fb5a406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.773+0000 7fb5ab600640 1 -- 172.21.15.99:0/1488286492 shutdown_connections 2024-09-10T07:37:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.773+0000 7fb5ab600640 1 -- 172.21.15.99:0/1488286492 wait complete. 2024-09-10T07:37:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.774+0000 7fb5ab600640 1 Processor -- start 2024-09-10T07:37:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.774+0000 7fb5ab600640 1 -- start start 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.775+0000 7fb5ab600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40b4a90 0x7fb5a41581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.775+0000 7fb5ab600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5a40d0630 0x7fb5a40ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.775+0000 7fb5ab600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 0x7fb5a40ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.775+0000 7fb5ab600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a40b4f20 con 0x7fb5a415b760 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.775+0000 7fb5ab600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a415bb40 con 0x7fb5a40d0630 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.775+0000 7fb5ab600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a40c57c0 con 0x7fb5a40b4a90 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 0x7fb5a40ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a8c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40b4a90 0x7fb5a41581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a8c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40b4a90 0x7fb5a41581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:42458/0 (socket says 172.21.15.99:42458) 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 0x7fb5a40ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51964/0 (socket says 172.21.15.99:51964) 2024-09-10T07:37:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a8c00640 1 -- 172.21.15.99:0/4283193072 learned_addr learned my addr 172.21.15.99:0/4283193072 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb59be00640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5a40d0630 0x7fb5a40ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a8c00640 1 -- 172.21.15.99:0/4283193072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5a40d0630 msgr2=0x7fb5a40ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a8c00640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5a40d0630 0x7fb5a40ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a8c00640 1 -- 172.21.15.99:0/4283193072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 msgr2=0x7fb5a40ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a8c00640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 0x7fb5a40ab7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a8c00640 1 -- 172.21.15.99:0/4283193072 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a40ad3d0 con 0x7fb5a40b4a90 2024-09-10T07:37:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a9600640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 0x7fb5a40ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:37:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.776+0000 7fb5a8c00640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40b4a90 0x7fb5a41581c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb594000c00 tx=0x7fb5940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.777+0000 7fb5a1600640 1 -- 172.21.15.99:0/4283193072 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594037040 con 0x7fb5a40b4a90 2024-09-10T07:37:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.777+0000 7fb5a1600640 1 -- 172.21.15.99:0/4283193072 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb594042070 con 0x7fb5a40b4a90 2024-09-10T07:37:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.777+0000 7fb5a1600640 1 -- 172.21.15.99:0/4283193072 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594030980 con 0x7fb5a40b4a90 2024-09-10T07:37:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.777+0000 7fb5ab600640 1 -- 172.21.15.99:0/4283193072 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a40ad6b0 con 0x7fb5a40b4a90 2024-09-10T07:37:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.777+0000 7fb5ab600640 1 -- 172.21.15.99:0/4283193072 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a40adc70 con 0x7fb5a40b4a90 2024-09-10T07:37:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.778+0000 7fb5ab600640 1 -- 172.21.15.99:0/4283193072 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a406dcc0 con 0x7fb5a40b4a90 2024-09-10T07:37:54.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.779+0000 7fb5a1600640 1 -- 172.21.15.99:0/4283193072 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb594030b20 con 0x7fb5a40b4a90 2024-09-10T07:37:54.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.780+0000 7fb5a1600640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb58006be60 0x7fb58006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:54.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.780+0000 7fb5a1600640 1 -- 172.21.15.99:0/4283193072 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(80..80 src has 1..80) ==== 5227+0+0 (secure 0 0 0) 0x7fb5940ab610 con 0x7fb5a40b4a90 2024-09-10T07:37:54.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.780+0000 7fb59be00640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb58006be60 0x7fb58006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:54.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.781+0000 7fb59be00640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb58006be60 0x7fb58006e320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb5a415e160 tx=0x7fb58c007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.785+0000 7fb5a1600640 1 -- 172.21.15.99:0/4283193072 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb594079bc0 con 0x7fb5a40b4a90 2024-09-10T07:37:54.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:54.959+0000 7fb5ab600640 1 -- 172.21.15.99:0/4283193072 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb5a4158ed0 con 0x7fb5a40b4a90 2024-09-10T07:37:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.591+0000 7fb5a1600640 1 -- 172.21.15.99:0/4283193072 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) ==== 170+0+0 (secure 0 0 0) 0x7fb59407dec0 con 0x7fb5a40b4a90 2024-09-10T07:37:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:37:55.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.599+0000 7fb5ab600640 1 -- 172.21.15.99:0/4283193072 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb58006be60 msgr2=0x7fb58006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:55.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.599+0000 7fb5ab600640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb58006be60 0x7fb58006e320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb5a415e160 tx=0x7fb58c007de0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.599+0000 7fb5ab600640 1 -- 172.21.15.99:0/4283193072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40b4a90 msgr2=0x7fb5a41581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:55.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.599+0000 7fb5ab600640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40b4a90 0x7fb5a41581c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb594000c00 tx=0x7fb5940046c0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.599+0000 7fb5ab600640 1 -- 172.21.15.99:0/4283193072 shutdown_connections 2024-09-10T07:37:55.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.599+0000 7fb5ab600640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb58006be60 0x7fb58006e320 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.599+0000 7fb5ab600640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5a415b760 0x7fb5a40ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.599+0000 7fb5ab600640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5a40d0630 0x7fb5a40ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.599+0000 7fb5ab600640 1 --2- 172.21.15.99:0/4283193072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5a40b4a90 0x7fb5a41581c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.599+0000 7fb5ab600640 1 -- 172.21.15.99:0/4283193072 >> 172.21.15.99:0/4283193072 conn(0x7fb5a406bc10 msgr2=0x7fb5a40b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:55.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.600+0000 7fb5ab600640 1 -- 172.21.15.99:0/4283193072 shutdown_connections 2024-09-10T07:37:55.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.600+0000 7fb5ab600640 1 -- 172.21.15.99:0/4283193072 wait complete. 2024-09-10T07:37:55.619 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:37:55.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.776+0000 7fac96a00640 1 Processor -- start 2024-09-10T07:37:55.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.776+0000 7fac96a00640 1 -- start start 2024-09-10T07:37:55.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.777+0000 7fac96a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90070b40 0x7fac900b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:55.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.777+0000 7fac96a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac900d3710 con 0x7fac9015eab0 2024-09-10T07:37:55.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.777+0000 7fac96a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac900b6390 con 0x7fac900d3230 2024-09-10T07:37:55.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.777+0000 7fac96a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fac900b6670 con 0x7fac90070b40 2024-09-10T07:37:55.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac95600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fac9015eab0 0x7fac9006cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49744/0 (socket says 172.21.15.99:49744) 2024-09-10T07:37:55.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac95600640 1 -- 172.21.15.99:0/1183049495 learned_addr learned my addr 172.21.15.99:0/1183049495 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:55.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac94c00640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90070b40 0x7fac900b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:55.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2426313094 0 0) 0x7fac900d3710 con 0x7fac9015eab0 2024-09-10T07:37:55.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac78003520 con 0x7fac9015eab0 2024-09-10T07:37:55.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 760101628 0 0) 0x7fac78003520 con 0x7fac9015eab0 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90070b40 msgr2=0x7fac900b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90070b40 0x7fac900b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 >> v1:172.21.15.187:6789/0 conn(0x7fac900d3230 legacy=0x7fac900b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac900b6950 con 0x7fac9015eab0 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fac84001670 con 0x7fac9015eab0 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 >> v1:172.21.15.99:6789/0 conn(0x7fac9015eab0 legacy=0x7fac9006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac780039e0 0x7fac78003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90070b40 0x7fac78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 0x7fac780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fac900b6670 con 0x7fac78004d40 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fac7800bc00 con 0x7fac780039e0 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.778+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fac7800be00 con 0x7fac90070b40 2024-09-10T07:37:55.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.779+0000 7fac96000640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 0x7fac780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:55.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.779+0000 7fac95600640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac780039e0 0x7fac78003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:55.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.779+0000 7fac94c00640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90070b40 0x7fac78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:55.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.779+0000 7fac96000640 1 -- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90070b40 msgr2=0x7fac78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:55.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.779+0000 7fac96000640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90070b40 0x7fac78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.779+0000 7fac96000640 1 -- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac780039e0 msgr2=0x7fac78003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:55.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.779+0000 7fac96000640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac780039e0 0x7fac78003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.779+0000 7fac96000640 1 -- 172.21.15.99:0/1183049495 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac78003520 con 0x7fac78004d40 2024-09-10T07:37:55.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.779+0000 7fac95600640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac780039e0 0x7fac78003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.780+0000 7fac96000640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 0x7fac780051c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fac900d3640 tx=0x7fac78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48282a096953df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.780+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88001a70 con 0x7fac78004d40 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.780+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8802ae10 con 0x7fac78004d40 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.780+0000 7fac8fe00640 1 -- 172.21.15.99:0/1183049495 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88003bb0 con 0x7fac78004d40 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.781+0000 7fac96a00640 1 -- 172.21.15.99:0/1183049495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 msgr2=0x7fac780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.781+0000 7fac96a00640 1 --2- 172.21.15.99:0/1183049495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 0x7fac780051c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fac900d3640 tx=0x7fac78005830 comp rx=0 tx=0).stop 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.781+0000 7fac96000640 1 -- 172.21.15.99:0/1183049495 reap_dead start 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.781+0000 7fac96a00640 1 -- 172.21.15.99:0/1183049495 shutdown_connections 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.781+0000 7fac96a00640 1 -- 172.21.15.99:0/1183049495 >> 172.21.15.99:0/1183049495 conn(0x7fac900b7cc0 msgr2=0x7fac900b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.781+0000 7fac96a00640 1 -- 172.21.15.99:0/1183049495 shutdown_connections 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.781+0000 7fac96a00640 1 -- 172.21.15.99:0/1183049495 wait complete. 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.783+0000 7fac96a00640 1 Processor -- start 2024-09-10T07:37:55.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.783+0000 7fac96a00640 1 -- start start 2024-09-10T07:37:55.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac96a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 0x7fac90161990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:55.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac96a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90157c60 0x7fac9014ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:55.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac96a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac9014d3d0 0x7fac901f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:55.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac96a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fac9015ee90 con 0x7fac78004d40 2024-09-10T07:37:55.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac96a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fac9006d430 con 0x7fac9014d3d0 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac96a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fac9014d880 con 0x7fac90157c60 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac95600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 0x7fac90161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac95600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 0x7fac90161990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51984/0 (socket says 172.21.15.99:51984) 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac95600640 1 -- 172.21.15.99:0/3382996245 learned_addr learned my addr 172.21.15.99:0/3382996245 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac94c00640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90157c60 0x7fac9014ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac95600640 1 -- 172.21.15.99:0/3382996245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90157c60 msgr2=0x7fac9014ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac95600640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90157c60 0x7fac9014ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac96000640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac9014d3d0 0x7fac901f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac95600640 1 -- 172.21.15.99:0/3382996245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac9014d3d0 msgr2=0x7fac901f7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac95600640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac9014d3d0 0x7fac901f7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac95600640 1 -- 172.21.15.99:0/3382996245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac90156ec0 con 0x7fac78004d40 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.784+0000 7fac96000640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac9014d3d0 0x7fac901f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.785+0000 7fac95600640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 0x7fac90161990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fac84007fd0 tx=0x7fac84007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.785+0000 7fac8d600640 1 -- 172.21.15.99:0/3382996245 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8400fab0 con 0x7fac78004d40 2024-09-10T07:37:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.785+0000 7fac8d600640 1 -- 172.21.15.99:0/3382996245 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac84018070 con 0x7fac78004d40 2024-09-10T07:37:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.785+0000 7fac8d600640 1 -- 172.21.15.99:0/3382996245 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8400fe50 con 0x7fac78004d40 2024-09-10T07:37:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.785+0000 7fac96a00640 1 -- 172.21.15.99:0/3382996245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac901f8880 con 0x7fac78004d40 2024-09-10T07:37:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.785+0000 7fac96a00640 1 -- 172.21.15.99:0/3382996245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac90157460 con 0x7fac78004d40 2024-09-10T07:37:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.786+0000 7fac96a00640 1 -- 172.21.15.99:0/3382996245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac90074120 con 0x7fac78004d40 2024-09-10T07:37:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.787+0000 7fac8d600640 1 -- 172.21.15.99:0/3382996245 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac8401d460 con 0x7fac78004d40 2024-09-10T07:37:55.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.788+0000 7fac8d600640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac7006be60 0x7fac7006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:55.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.789+0000 7fac8d600640 1 -- 172.21.15.99:0/3382996245 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5609+0+0 (secure 0 0 0) 0x7fac8408b180 con 0x7fac78004d40 2024-09-10T07:37:55.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.789+0000 7fac94c00640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac7006be60 0x7fac7006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.789+0000 7fac94c00640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac7006be60 0x7fac7006e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fac901616b0 tx=0x7fac7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:55.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:55.794+0000 7fac8d600640 1 -- 172.21.15.99:0/3382996245 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac90074120 con 0x7fac78004d40 2024-09-10T07:37:56.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.002+0000 7fac96a00640 1 -- 172.21.15.99:0/3382996245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fac9006e8a0 con 0x7fac78004d40 2024-09-10T07:37:56.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.586+0000 7fac8d600640 1 -- 172.21.15.99:0/3382996245 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v38) ==== 174+0+0 (secure 0 0 0) 0x7fac84059af0 con 0x7fac78004d40 2024-09-10T07:37:56.587 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 10 and data pool 11 2024-09-10T07:37:56.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.589+0000 7fac96a00640 1 -- 172.21.15.99:0/3382996245 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac7006be60 msgr2=0x7fac7006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:56.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.589+0000 7fac96a00640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac7006be60 0x7fac7006e320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fac901616b0 tx=0x7fac7c008040 comp rx=0 tx=0).stop 2024-09-10T07:37:56.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.589+0000 7fac96a00640 1 -- 172.21.15.99:0/3382996245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 msgr2=0x7fac90161990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:56.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.589+0000 7fac96a00640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 0x7fac90161990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fac84007fd0 tx=0x7fac84007790 comp rx=0 tx=0).stop 2024-09-10T07:37:56.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.590+0000 7fac96a00640 1 -- 172.21.15.99:0/3382996245 shutdown_connections 2024-09-10T07:37:56.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.590+0000 7fac96a00640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac9014d3d0 0x7fac901f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.590+0000 7fac96a00640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac90157c60 0x7fac9014ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.590+0000 7fac96a00640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac7006be60 0x7fac7006e320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.590+0000 7fac96a00640 1 --2- 172.21.15.99:0/3382996245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac78004d40 0x7fac90161990 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.590+0000 7fac96a00640 1 -- 172.21.15.99:0/3382996245 >> 172.21.15.99:0/3382996245 conn(0x7fac900b7cc0 msgr2=0x7fac900b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:56.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.591+0000 7fac96a00640 1 -- 172.21.15.99:0/3382996245 shutdown_connections 2024-09-10T07:37:56.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.592+0000 7fac96a00640 1 -- 172.21.15.99:0/3382996245 wait complete. 2024-09-10T07:37:56.621 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:37:56.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.776+0000 7f2390c00640 1 Processor -- start 2024-09-10T07:37:56.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.776+0000 7f2390c00640 1 -- start start 2024-09-10T07:37:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.777+0000 7f2390c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f238c0d2680 0x7f238c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.777+0000 7f2390c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0cfac0 0x7f238c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.777+0000 7f2390c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238c0d2bd0 con 0x7f238c15e970 2024-09-10T07:37:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.777+0000 7f2390c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f238c0d37e0 con 0x7f238c0d2680 2024-09-10T07:37:56.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.777+0000 7f2390c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f238c0d2eb0 con 0x7f238c0cfac0 2024-09-10T07:37:56.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.777+0000 7f238b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f238c15e970 0x7f238c0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49746/0 (socket says 172.21.15.99:49746) 2024-09-10T07:37:56.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.777+0000 7f238b400640 1 -- 172.21.15.99:0/3815873219 learned_addr learned my addr 172.21.15.99:0/3815873219 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f2382a00640 1 --2- 172.21.15.99:0/3815873219 >> v2:172.21.15.187:3300/0 conn(0x7f238c0d2680 0x7f238c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238be00640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0cfac0 0x7f238c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437640415 0 0) 0x7f238c0d2bd0 con 0x7f238c15e970 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2370003520 con 0x7f238c15e970 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1172919931 0 0) 0x7f2370003520 con 0x7f238c15e970 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0cfac0 msgr2=0x7f238c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0cfac0 0x7f238c0c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 >> v2:172.21.15.187:3300/0 conn(0x7f238c0d2680 msgr2=0x7f238c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 --2- 172.21.15.99:0/3815873219 >> v2:172.21.15.187:3300/0 conn(0x7f238c0d2680 0x7f238c0cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c0d3190 con 0x7f238c15e970 2024-09-10T07:37:56.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f237c001670 con 0x7f238c15e970 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 >> v1:172.21.15.99:6789/0 conn(0x7f238c15e970 legacy=0x7f238c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0cfac0 0x7f23700039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2370003f30 0x7f2370004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2370004d40 0x7f23700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f238c0d37e0 con 0x7f2370003f30 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f238c0d2eb0 con 0x7f2370004d40 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.778+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f237000b9f0 con 0x7f238c0cfac0 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.779+0000 7f2382a00640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2370003f30 0x7f2370004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.779+0000 7f238b400640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0cfac0 0x7f23700039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.779+0000 7f238be00640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2370004d40 0x7f23700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.779+0000 7f238b400640 1 -- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2370004d40 msgr2=0x7f23700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.779+0000 7f238b400640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2370004d40 0x7f23700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.779+0000 7f238b400640 1 -- 172.21.15.99:0/3815873219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2370003f30 msgr2=0x7f2370004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:56.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.779+0000 7f238b400640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2370003f30 0x7f2370004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.779+0000 7f238b400640 1 -- 172.21.15.99:0/3815873219 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2370003520 con 0x7f238c0cfac0 2024-09-10T07:37:56.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.779+0000 7f2382a00640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2370003f30 0x7f2370004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:37:56.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.780+0000 7f238b400640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0cfac0 0x7f23700039b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c240 tx=0x7f2370005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61eea3526c8fd866 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:56.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.780+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c02e070 con 0x7f238c0cfac0 2024-09-10T07:37:56.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.780+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237c005af0 con 0x7f238c0cfac0 2024-09-10T07:37:56.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.781+0000 7f238aa00640 1 -- 172.21.15.99:0/3815873219 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c007d30 con 0x7f238c0cfac0 2024-09-10T07:37:56.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.781+0000 7f2390c00640 1 -- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0cfac0 msgr2=0x7f23700039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:56.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.781+0000 7f2390c00640 1 --2- 172.21.15.99:0/3815873219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0cfac0 0x7f23700039b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c240 tx=0x7f2370005830 comp rx=0 tx=0).stop 2024-09-10T07:37:56.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.781+0000 7f238be00640 1 -- 172.21.15.99:0/3815873219 reap_dead start 2024-09-10T07:37:56.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.781+0000 7f2390c00640 1 -- 172.21.15.99:0/3815873219 shutdown_connections 2024-09-10T07:37:56.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.781+0000 7f2390c00640 1 -- 172.21.15.99:0/3815873219 >> 172.21.15.99:0/3815873219 conn(0x7f238c09de00 msgr2=0x7f238c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:56.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.781+0000 7f2390c00640 1 -- 172.21.15.99:0/3815873219 shutdown_connections 2024-09-10T07:37:56.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.781+0000 7f2390c00640 1 -- 172.21.15.99:0/3815873219 wait complete. 2024-09-10T07:37:56.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.783+0000 7f2390c00640 1 Processor -- start 2024-09-10T07:37:56.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.783+0000 7f2390c00640 1 -- start start 2024-09-10T07:37:56.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f2390c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238c0cfac0 0x7f238c0b9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:56.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f2390c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238c0ba590 0x7f238c0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:56.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f2390c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0b7e20 0x7f238c0b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:56.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f2390c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f238c15ed50 con 0x7f238c0cfac0 2024-09-10T07:37:56.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f2390c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f238c0cff50 con 0x7f238c0ba590 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f2390c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f238c15eed0 con 0x7f238c0b7e20 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f238b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238c0cfac0 0x7f238c0b9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f238b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238c0cfac0 0x7f238c0b9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52008/0 (socket says 172.21.15.99:52008) 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f238b400640 1 -- 172.21.15.99:0/17627485 learned_addr learned my addr 172.21.15.99:0/17627485 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f2382a00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238c0ba590 0x7f238c0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f238be00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0b7e20 0x7f238c0b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f238b400640 1 -- 172.21.15.99:0/17627485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0b7e20 msgr2=0x7f238c0b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f238b400640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0b7e20 0x7f238c0b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f238b400640 1 -- 172.21.15.99:0/17627485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238c0ba590 msgr2=0x7f238c0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f238b400640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238c0ba590 0x7f238c0b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.784+0000 7f238b400640 1 -- 172.21.15.99:0/17627485 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c0b9a80 con 0x7f238c0cfac0 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.785+0000 7f238b400640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238c0cfac0 0x7f238c0b9460 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f237c02ae30 tx=0x7f238c0d3750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.785+0000 7f2383e00640 1 -- 172.21.15.99:0/17627485 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c042070 con 0x7f238c0cfac0 2024-09-10T07:37:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.785+0000 7f2383e00640 1 -- 172.21.15.99:0/17627485 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237c007480 con 0x7f238c0cfac0 2024-09-10T07:37:56.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.785+0000 7f2383e00640 1 -- 172.21.15.99:0/17627485 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c007d30 con 0x7f238c0cfac0 2024-09-10T07:37:56.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.785+0000 7f2390c00640 1 -- 172.21.15.99:0/17627485 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c0cbd90 con 0x7f238c0cfac0 2024-09-10T07:37:56.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.785+0000 7f2390c00640 1 -- 172.21.15.99:0/17627485 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c155020 con 0x7f238c0cfac0 2024-09-10T07:37:56.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.786+0000 7f2390c00640 1 -- 172.21.15.99:0/17627485 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c0cf580 con 0x7f238c0cfac0 2024-09-10T07:37:56.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.787+0000 7f2383e00640 1 -- 172.21.15.99:0/17627485 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f237c045070 con 0x7f238c0cfac0 2024-09-10T07:37:56.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.788+0000 7f2383e00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236806be30 0x7f236806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:56.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.788+0000 7f2383e00640 1 -- 172.21.15.99:0/17627485 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f237c0ab810 con 0x7f238c0cfac0 2024-09-10T07:37:56.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.788+0000 7f2382a00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236806be30 0x7f236806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:56.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.789+0000 7f2382a00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236806be30 0x7f236806e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f238c15d900 tx=0x7f2374009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:56.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.793+0000 7f2383e00640 1 -- 172.21.15.99:0/17627485 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f237c079c90 con 0x7f238c0cfac0 2024-09-10T07:37:56.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.971+0000 7f2390c00640 1 -- 172.21.15.99:0/17627485 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f238c0cbb60 con 0x7f238c0cfac0 2024-09-10T07:37:56.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.972+0000 7f2383e00640 1 -- 172.21.15.99:0/17627485 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16717 (secure 0 0 0) 0x7f237c07df90 con 0x7f238c0cfac0 2024-09-10T07:37:56.972 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:56.973 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:37:56.003952+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:37:53.770507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T07:37:55.001057+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.974+0000 7f2390c00640 1 -- 172.21.15.99:0/17627485 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236806be30 msgr2=0x7f236806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.974+0000 7f2390c00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236806be30 0x7f236806e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f238c15d900 tx=0x7f2374009190 comp rx=0 tx=0).stop 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.974+0000 7f2390c00640 1 -- 172.21.15.99:0/17627485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238c0cfac0 msgr2=0x7f238c0b9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.974+0000 7f2390c00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238c0cfac0 0x7f238c0b9460 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f237c02ae30 tx=0x7f238c0d3750 comp rx=0 tx=0).stop 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.974+0000 7f2390c00640 1 -- 172.21.15.99:0/17627485 shutdown_connections 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.974+0000 7f2390c00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238c0b7e20 0x7f238c0b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.974+0000 7f2390c00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238c0ba590 0x7f238c0b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.974+0000 7f2390c00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236806be30 0x7f236806e2f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.974+0000 7f2390c00640 1 --2- 172.21.15.99:0/17627485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238c0cfac0 0x7f238c0b9460 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.974+0000 7f2390c00640 1 -- 172.21.15.99:0/17627485 >> 172.21.15.99:0/17627485 conn(0x7f238c09de00 msgr2=0x7f238c0c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.975+0000 7f2390c00640 1 -- 172.21.15.99:0/17627485 shutdown_connections 2024-09-10T07:37:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:56.975+0000 7f2390c00640 1 -- 172.21.15.99:0/17627485 wait complete. 2024-09-10T07:37:56.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:37:57.034 INFO:tasks.ceph.mds.d.smithi187.stderr:2024-09-10T07:37:57.035+0000 7f6040800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:37:57.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.145+0000 7f9fa9800640 1 Processor -- start 2024-09-10T07:37:57.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.145+0000 7f9fa9800640 1 -- start start 2024-09-10T07:37:57.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9fa9800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa4145290 0x7f9fa406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9fa9800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fa40ce780 0x7f9fa4072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9fa9800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9fa4071510 0x7f9fa4072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9fa9800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa406efe0 con 0x7f9fa40ce780 2024-09-10T07:37:57.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9fa9800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa406e3d0 con 0x7f9fa4071510 2024-09-10T07:37:57.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9fa9800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa406e6b0 con 0x7f9fa4145290 2024-09-10T07:37:57.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9f9a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fa40ce780 0x7f9fa4072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9f9a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fa40ce780 0x7f9fa4072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52018/0 (socket says 172.21.15.99:52018) 2024-09-10T07:37:57.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9f9a000640 1 -- 172.21.15.99:0/3940432421 learned_addr learned my addr 172.21.15.99:0/3940432421 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:57.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9fa2a00640 1 --2- 172.21.15.99:0/3940432421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa4145290 0x7f9fa406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9fa3400640 1 --2- 172.21.15.99:0/3940432421 >> v2:172.21.15.187:3300/0 conn(0x7f9fa4071510 0x7f9fa4072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9f9a000640 1 -- 172.21.15.99:0/3940432421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa4145290 msgr2=0x7f9fa406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:57.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9f9a000640 1 --2- 172.21.15.99:0/3940432421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa4145290 0x7f9fa406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9f9a000640 1 -- 172.21.15.99:0/3940432421 >> v2:172.21.15.187:3300/0 conn(0x7f9fa4071510 msgr2=0x7f9fa4072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:57.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9f9a000640 1 --2- 172.21.15.99:0/3940432421 >> v2:172.21.15.187:3300/0 conn(0x7f9fa4071510 0x7f9fa4072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.147+0000 7f9f9a000640 1 -- 172.21.15.99:0/3940432421 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa406e990 con 0x7f9fa40ce780 2024-09-10T07:37:57.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.148+0000 7f9f9a000640 1 --2- 172.21.15.99:0/3940432421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa40ce780 0x7f9fa4072830 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40714a0 tx=0x7f9f8c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df365d335770a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:57.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.148+0000 7f9fa2000640 1 -- 172.21.15.99:0/3940432421 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c037070 con 0x7f9fa40ce780 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa2000640 1 -- 172.21.15.99:0/3940432421 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f8c032440 con 0x7f9fa40ce780 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa2000640 1 -- 172.21.15.99:0/3940432421 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c032810 con 0x7f9fa40ce780 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa9800640 1 -- 172.21.15.99:0/3940432421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa40ce780 msgr2=0x7f9fa4072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa9800640 1 --2- 172.21.15.99:0/3940432421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa40ce780 0x7f9fa4072830 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40714a0 tx=0x7f9f8c02a1e0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa9800640 1 -- 172.21.15.99:0/3940432421 shutdown_connections 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa9800640 1 --2- 172.21.15.99:0/3940432421 >> v2:172.21.15.187:3300/0 conn(0x7f9fa4071510 0x7f9fa4072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa9800640 1 --2- 172.21.15.99:0/3940432421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa40ce780 0x7f9fa4072830 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa9800640 1 --2- 172.21.15.99:0/3940432421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa4145290 0x7f9fa406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa9800640 1 -- 172.21.15.99:0/3940432421 >> 172.21.15.99:0/3940432421 conn(0x7f9fa406bc10 msgr2=0x7f9fa406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa9800640 1 -- 172.21.15.99:0/3940432421 shutdown_connections 2024-09-10T07:37:57.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.149+0000 7f9fa9800640 1 -- 172.21.15.99:0/3940432421 wait complete. 2024-09-10T07:37:57.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.151+0000 7f9fa9800640 1 Processor -- start 2024-09-10T07:37:57.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.151+0000 7f9fa9800640 1 -- start start 2024-09-10T07:37:57.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9fa9800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa4071510 0x7f9fa40b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9fa9800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa40ce780 0x7f9fa4139420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9fa9800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa4145290 0x7f9fa41404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9fa9800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa406df80 con 0x7f9fa4145290 2024-09-10T07:37:57.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9fa9800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4145670 con 0x7f9fa4071510 2024-09-10T07:37:57.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9fa9800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa406e100 con 0x7f9fa40ce780 2024-09-10T07:37:57.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9fa3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa4145290 0x7f9fa41404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9fa2a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa4071510 0x7f9fa40b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9f9a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa40ce780 0x7f9fa4139420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9fa2a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa4071510 0x7f9fa40b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:35134/0 (socket says 172.21.15.99:35134) 2024-09-10T07:37:57.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.152+0000 7f9fa2a00640 1 -- 172.21.15.99:0/4225763915 learned_addr learned my addr 172.21.15.99:0/4225763915 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9f9a000640 1 -- 172.21.15.99:0/4225763915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa4071510 msgr2=0x7f9fa40b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9f9a000640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa4071510 0x7f9fa40b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9f9a000640 1 -- 172.21.15.99:0/4225763915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa4145290 msgr2=0x7f9fa41404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9f9a000640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa4145290 0x7f9fa41404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9f9a000640 1 -- 172.21.15.99:0/4225763915 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa40b3e70 con 0x7f9fa40ce780 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9f9a000640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa40ce780 0x7f9fa4139420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4068580 tx=0x7f9f8c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9f9b400640 1 -- 172.21.15.99:0/4225763915 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c041020 con 0x7f9fa40ce780 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9f9b400640 1 -- 172.21.15.99:0/4225763915 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f8c030700 con 0x7f9fa40ce780 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9f9b400640 1 -- 172.21.15.99:0/4225763915 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c037040 con 0x7f9fa40ce780 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9fa9800640 1 -- 172.21.15.99:0/4225763915 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa4139960 con 0x7f9fa40ce780 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.153+0000 7f9fa9800640 1 -- 172.21.15.99:0/4225763915 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa413fa10 con 0x7f9fa40ce780 2024-09-10T07:37:57.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.154+0000 7f9fa9800640 1 -- 172.21.15.99:0/4225763915 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa406f470 con 0x7f9fa40ce780 2024-09-10T07:37:57.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.156+0000 7f9f9b400640 1 -- 172.21.15.99:0/4225763915 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f8c044020 con 0x7f9fa40ce780 2024-09-10T07:37:57.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.157+0000 7f9f9b400640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f8006be30 0x7f9f8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.157+0000 7f9f9b400640 1 -- 172.21.15.99:0/4225763915 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f9f8c0ab7c0 con 0x7f9fa40ce780 2024-09-10T07:37:57.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.157+0000 7f9fa2a00640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f8006be30 0x7f9f8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.157+0000 7f9fa2a00640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f8006be30 0x7f9f8006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9f94006fd0 tx=0x7f9f94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:57.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.161+0000 7f9f9b400640 1 -- 172.21.15.99:0/4225763915 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f8c04b030 con 0x7f9fa40ce780 2024-09-10T07:37:57.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.333+0000 7f9fa9800640 1 -- 172.21.15.99:0/4225763915 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fa413f230 con 0x7f9fa40ce780 2024-09-10T07:37:57.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.335+0000 7f9f9b400640 1 -- 172.21.15.99:0/4225763915 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16717 (secure 0 0 0) 0x7f9f8c080020 con 0x7f9fa40ce780 2024-09-10T07:37:57.335 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:37:57.336 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:37:56.003952+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:37:53.770507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T07:37:55.001057+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:37:57.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 -- 172.21.15.99:0/4225763915 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f8006be30 msgr2=0x7f9f8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:57.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f8006be30 0x7f9f8006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9f94006fd0 tx=0x7f9f94008040 comp rx=0 tx=0).stop 2024-09-10T07:37:57.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 -- 172.21.15.99:0/4225763915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa40ce780 msgr2=0x7f9fa4139420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:57.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa40ce780 0x7f9fa4139420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4068580 tx=0x7f9f8c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 -- 172.21.15.99:0/4225763915 shutdown_connections 2024-09-10T07:37:57.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f8006be30 0x7f9f8006e2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa4145290 0x7f9fa41404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa40ce780 0x7f9fa4139420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 --2- 172.21.15.99:0/4225763915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa4071510 0x7f9fa40b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 -- 172.21.15.99:0/4225763915 >> 172.21.15.99:0/4225763915 conn(0x7f9fa406bc10 msgr2=0x7f9fa4143f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:57.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 -- 172.21.15.99:0/4225763915 shutdown_connections 2024-09-10T07:37:57.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.337+0000 7f9fa9800640 1 -- 172.21.15.99:0/4225763915 wait complete. 2024-09-10T07:37:57.355 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:37:57.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.512+0000 7fdff3e00640 1 Processor -- start 2024-09-10T07:37:57.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.512+0000 7fdff3e00640 1 -- start start 2024-09-10T07:37:57.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.513+0000 7fdff3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdff40d2680 0x7fdff40cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.513+0000 7fdff3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdff40cfac0 0x7fdff40c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.513+0000 7fdff3e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff40d2bd0 con 0x7fdff415e970 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.513+0000 7fdff3e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fdff40d37e0 con 0x7fdff40cfac0 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.513+0000 7fdff3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdff40d2eb0 con 0x7fdff40d2680 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.513+0000 7fdff2a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdff415e970 0x7fdff40d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49758/0 (socket says 172.21.15.99:49758) 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.513+0000 7fdff2a00640 1 -- 172.21.15.99:0/4176032088 learned_addr learned my addr 172.21.15.99:0/4176032088 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.513+0000 7fdff3400640 1 --2- 172.21.15.99:0/4176032088 >> v2:172.21.15.99:3300/0 conn(0x7fdff40cfac0 0x7fdff40c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.513+0000 7fdfea000640 1 --2- 172.21.15.99:0/4176032088 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdff40d2680 0x7fdff40cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.514+0000 7fdff2000640 1 -- 172.21.15.99:0/4176032088 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150137578 0 0) 0x7fdff40d2bd0 con 0x7fdff415e970 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.514+0000 7fdff2000640 1 -- 172.21.15.99:0/4176032088 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfd8003520 con 0x7fdff415e970 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.514+0000 7fdff3400640 1 -- 172.21.15.99:0/4176032088 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdff40d2680 msgr2=0x7fdff40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.514+0000 7fdff3400640 1 --2- 172.21.15.99:0/4176032088 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdff40d2680 0x7fdff40cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.514+0000 7fdff3400640 1 -- 172.21.15.99:0/4176032088 >> v1:172.21.15.99:6789/0 conn(0x7fdff415e970 legacy=0x7fdff40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:57.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.514+0000 7fdff3400640 1 -- 172.21.15.99:0/4176032088 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff40d3190 con 0x7fdff40cfac0 2024-09-10T07:37:57.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.515+0000 7fdff3400640 1 --2- 172.21.15.99:0/4176032088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 0x7fdff40c8700 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0097a0 tx=0x7fdfec02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9ae8b1f3dc1220 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:57.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.515+0000 7fdff2000640 1 -- 172.21.15.99:0/4176032088 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec037070 con 0x7fdff40cfac0 2024-09-10T07:37:57.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.515+0000 7fdff2000640 1 -- 172.21.15.99:0/4176032088 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfec032440 con 0x7fdff40cfac0 2024-09-10T07:37:57.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.515+0000 7fdff2000640 1 -- 172.21.15.99:0/4176032088 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0327f0 con 0x7fdff40cfac0 2024-09-10T07:37:57.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.516+0000 7fdff3e00640 1 -- 172.21.15.99:0/4176032088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 msgr2=0x7fdff40c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:57.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.516+0000 7fdff3e00640 1 --2- 172.21.15.99:0/4176032088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 0x7fdff40c8700 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0097a0 tx=0x7fdfec02a230 comp rx=0 tx=0).stop 2024-09-10T07:37:57.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.516+0000 7fdff3e00640 1 -- 172.21.15.99:0/4176032088 shutdown_connections 2024-09-10T07:37:57.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.516+0000 7fdff3e00640 1 --2- 172.21.15.99:0/4176032088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 0x7fdff40c8700 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.516+0000 7fdff3e00640 1 --2- 172.21.15.99:0/4176032088 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdff40d2680 0x7fdff40cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.516+0000 7fdff3e00640 1 -- 172.21.15.99:0/4176032088 >> 172.21.15.99:0/4176032088 conn(0x7fdff409de00 msgr2=0x7fdff40d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:57.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.516+0000 7fdff3e00640 1 -- 172.21.15.99:0/4176032088 shutdown_connections 2024-09-10T07:37:57.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.516+0000 7fdff3e00640 1 -- 172.21.15.99:0/4176032088 wait complete. 2024-09-10T07:37:57.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.517+0000 7fdff3e00640 1 Processor -- start 2024-09-10T07:37:57.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.518+0000 7fdff3e00640 1 -- start start 2024-09-10T07:37:57.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.518+0000 7fdff3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 0x7fdff4154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.518+0000 7fdff3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdff40d2680 0x7fdff415af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.518+0000 7fdff3e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdff415e970 0x7fdff415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.518+0000 7fdff3e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdff415ed50 con 0x7fdff40cfac0 2024-09-10T07:37:57.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff3e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdff40cff70 con 0x7fdff415e970 2024-09-10T07:37:57.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdff415eed0 con 0x7fdff40d2680 2024-09-10T07:37:57.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 0x7fdff4154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 0x7fdff4154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52044/0 (socket says 172.21.15.99:52044) 2024-09-10T07:37:57.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff2a00640 1 -- 172.21.15.99:0/2229901513 learned_addr learned my addr 172.21.15.99:0/2229901513 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:57.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff3400640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdff415e970 0x7fdff415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdfea000640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdff40d2680 0x7fdff415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff2a00640 1 -- 172.21.15.99:0/2229901513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdff40d2680 msgr2=0x7fdff415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:57.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff2a00640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdff40d2680 0x7fdff415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff2a00640 1 -- 172.21.15.99:0/2229901513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdff415e970 msgr2=0x7fdff415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:57.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff2a00640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdff415e970 0x7fdff415b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:57.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.519+0000 7fdff2a00640 1 -- 172.21.15.99:0/2229901513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff41f3fc0 con 0x7fdff40cfac0 2024-09-10T07:37:57.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.520+0000 7fdff2a00640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 0x7fdff4154660 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400caa0 tx=0x7fdfe400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:57.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.520+0000 7fdfeb400640 1 -- 172.21.15.99:0/2229901513 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4017070 con 0x7fdff40cfac0 2024-09-10T07:37:57.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.520+0000 7fdfeb400640 1 -- 172.21.15.99:0/2229901513 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe400ac00 con 0x7fdff40cfac0 2024-09-10T07:37:57.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.520+0000 7fdfeb400640 1 -- 172.21.15.99:0/2229901513 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4012400 con 0x7fdff40cfac0 2024-09-10T07:37:57.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.520+0000 7fdff3e00640 1 -- 172.21.15.99:0/2229901513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff4161350 con 0x7fdff40cfac0 2024-09-10T07:37:57.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.520+0000 7fdff3e00640 1 -- 172.21.15.99:0/2229901513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff41f4520 con 0x7fdff40cfac0 2024-09-10T07:37:57.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.521+0000 7fdff3e00640 1 -- 172.21.15.99:0/2229901513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff40cf580 con 0x7fdff40cfac0 2024-09-10T07:37:57.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.522+0000 7fdfeb400640 1 -- 172.21.15.99:0/2229901513 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdfe401a070 con 0x7fdff40cfac0 2024-09-10T07:37:57.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.523+0000 7fdfeb400640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfd006be30 0x7fdfd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:57.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.523+0000 7fdfeb400640 1 -- 172.21.15.99:0/2229901513 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fdfe408ac30 con 0x7fdff40cfac0 2024-09-10T07:37:57.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.523+0000 7fdfea000640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfd006be30 0x7fdfd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:57.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.524+0000 7fdfea000640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfd006be30 0x7fdfd006e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdff4161ed0 tx=0x7fdfdc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:57.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.527+0000 7fdfeb400640 1 -- 172.21.15.99:0/2229901513 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdff41f3fc0 con 0x7fdff40cfac0 2024-09-10T07:37:57.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:57.742+0000 7fdff3e00640 1 -- 172.21.15.99:0/2229901513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdff4075500 con 0x7fdff40cfac0 2024-09-10T07:37:58.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.730+0000 7fdfeb400640 1 -- 172.21.15.99:0/2229901513 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) ==== 118+0+0 (secure 0 0 0) 0x7fdfe4058ef0 con 0x7fdff40cfac0 2024-09-10T07:37:58.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 -- 172.21.15.99:0/2229901513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfd006be30 msgr2=0x7fdfd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:58.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfd006be30 0x7fdfd006e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdff4161ed0 tx=0x7fdfdc009190 comp rx=0 tx=0).stop 2024-09-10T07:37:58.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 -- 172.21.15.99:0/2229901513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 msgr2=0x7fdff4154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:58.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 0x7fdff4154660 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400caa0 tx=0x7fdfe400cf60 comp rx=0 tx=0).stop 2024-09-10T07:37:58.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 -- 172.21.15.99:0/2229901513 shutdown_connections 2024-09-10T07:37:58.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdff415e970 0x7fdff415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:58.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdff40d2680 0x7fdff415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:58.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfd006be30 0x7fdfd006e2f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:58.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 --2- 172.21.15.99:0/2229901513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdff40cfac0 0x7fdff4154660 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:58.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 -- 172.21.15.99:0/2229901513 >> 172.21.15.99:0/2229901513 conn(0x7fdff409de00 msgr2=0x7fdff40c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:58.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 -- 172.21.15.99:0/2229901513 shutdown_connections 2024-09-10T07:37:58.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.734+0000 7fdff3e00640 1 -- 172.21.15.99:0/2229901513 wait complete. 2024-09-10T07:37:58.753 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T07:37:58.753 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:37:58.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.913+0000 7f9036000640 1 Processor -- start 2024-09-10T07:37:58.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.914+0000 7f9036000640 1 -- start start 2024-09-10T07:37:58.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f9036000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f903006e280 0x7f9030073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:58.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f9036000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f90300d1010 0x7f90300ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f9036000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90300722d0 con 0x7f9030071df0 2024-09-10T07:37:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f9036000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f90300738b0 con 0x7f90300d1010 2024-09-10T07:37:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f9036000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f90300725b0 con 0x7f903006e280 2024-09-10T07:37:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f9026a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9030071df0 0x7f903006e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:49762/0 (socket says 172.21.15.99:49762) 2024-09-10T07:37:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f9026a00640 1 -- 172.21.15.99:0/3640086369 learned_addr learned my addr 172.21.15.99:0/3640086369 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f902fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f90300d1010 0x7f90300ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f902f400640 1 --2- 172.21.15.99:0/3640086369 >> v2:172.21.15.187:3300/0 conn(0x7f903006e280 0x7f9030073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f902fe00640 1 -- 172.21.15.99:0/3640086369 >> v2:172.21.15.187:3300/0 conn(0x7f903006e280 msgr2=0x7f9030073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f902fe00640 1 --2- 172.21.15.99:0/3640086369 >> v2:172.21.15.187:3300/0 conn(0x7f903006e280 0x7f9030073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f902fe00640 1 -- 172.21.15.99:0/3640086369 >> v1:172.21.15.99:6789/0 conn(0x7f9030071df0 legacy=0x7f903006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f902fe00640 1 -- 172.21.15.99:0/3640086369 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9030072890 con 0x7f90300d1010 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.915+0000 7f902f400640 1 --2- 172.21.15.99:0/3640086369 >> v2:172.21.15.187:3300/0 conn(0x7f903006e280 0x7f9030073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.916+0000 7f902fe00640 1 --2- 172.21.15.99:0/3640086369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 0x7f90300ce3d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f90300506f0 tx=0x7f902802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5886a90aff6edf95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f902ea00640 1 -- 172.21.15.99:0/3640086369 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028007740 con 0x7f90300d1010 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f902ea00640 1 -- 172.21.15.99:0/3640086369 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90280078e0 con 0x7f90300d1010 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f902ea00640 1 -- 172.21.15.99:0/3640086369 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028007cb0 con 0x7f90300d1010 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f9036000640 1 -- 172.21.15.99:0/3640086369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 msgr2=0x7f90300ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f9036000640 1 --2- 172.21.15.99:0/3640086369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 0x7f90300ce3d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f90300506f0 tx=0x7f902802a680 comp rx=0 tx=0).stop 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f9036000640 1 -- 172.21.15.99:0/3640086369 shutdown_connections 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f9036000640 1 --2- 172.21.15.99:0/3640086369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 0x7f90300ce3d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f9036000640 1 --2- 172.21.15.99:0/3640086369 >> v2:172.21.15.187:3300/0 conn(0x7f903006e280 0x7f9030073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f9036000640 1 -- 172.21.15.99:0/3640086369 >> 172.21.15.99:0/3640086369 conn(0x7f903006bc10 msgr2=0x7f903006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f9036000640 1 -- 172.21.15.99:0/3640086369 shutdown_connections 2024-09-10T07:37:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.917+0000 7f9036000640 1 -- 172.21.15.99:0/3640086369 wait complete. 2024-09-10T07:37:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.919+0000 7f9036000640 1 Processor -- start 2024-09-10T07:37:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.919+0000 7f9036000640 1 -- start start 2024-09-10T07:37:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f9036000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f903006e280 0x7f903013f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f9036000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9030071df0 0x7f90301514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f9036000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 0x7f903015b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f9036000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f903015db60 con 0x7f90300d1010 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f9036000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9030072e50 con 0x7f9030071df0 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f9036000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f90300d14c0 con 0x7f903006e280 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f902fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 0x7f903015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f902fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 0x7f903015b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52064/0 (socket says 172.21.15.99:52064) 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f902fe00640 1 -- 172.21.15.99:0/809078125 learned_addr learned my addr 172.21.15.99:0/809078125 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f902f400640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f903006e280 0x7f903013f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.920+0000 7f9026a00640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9030071df0 0x7f90301514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f902fe00640 1 -- 172.21.15.99:0/809078125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f903006e280 msgr2=0x7f903013f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f902fe00640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f903006e280 0x7f903013f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f902fe00640 1 -- 172.21.15.99:0/809078125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9030071df0 msgr2=0x7f90301514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:58.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f902fe00640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9030071df0 0x7f90301514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f902fe00640 1 -- 172.21.15.99:0/809078125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9030154180 con 0x7f90300d1010 2024-09-10T07:37:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f902fe00640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 0x7f903015b420 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f902802ac70 tx=0x7f9028004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f9027e00640 1 -- 172.21.15.99:0/809078125 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028040070 con 0x7f90300d1010 2024-09-10T07:37:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f9027e00640 1 -- 172.21.15.99:0/809078125 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9028031bc0 con 0x7f90300d1010 2024-09-10T07:37:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f9027e00640 1 -- 172.21.15.99:0/809078125 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028045460 con 0x7f90300d1010 2024-09-10T07:37:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f9036000640 1 -- 172.21.15.99:0/809078125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9030154420 con 0x7f90300d1010 2024-09-10T07:37:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.921+0000 7f9036000640 1 -- 172.21.15.99:0/809078125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90301549e0 con 0x7f90300d1010 2024-09-10T07:37:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.922+0000 7f9036000640 1 -- 172.21.15.99:0/809078125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9030073370 con 0x7f90300d1010 2024-09-10T07:37:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.923+0000 7f9027e00640 1 -- 172.21.15.99:0/809078125 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9028039040 con 0x7f90300d1010 2024-09-10T07:37:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.924+0000 7f9027e00640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f900c06be30 0x7f900c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.924+0000 7f9027e00640 1 -- 172.21.15.99:0/809078125 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f90280ac750 con 0x7f90300d1010 2024-09-10T07:37:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.924+0000 7f902f400640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f900c06be30 0x7f900c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.925+0000 7f902f400640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f900c06be30 0x7f900c06e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f90300b2520 tx=0x7f9020008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:58.929+0000 7f9027e00640 1 -- 172.21.15.99:0/809078125 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f902807b0f0 con 0x7f90300d1010 2024-09-10T07:37:59.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.136+0000 7f9036000640 1 -- 172.21.15.99:0/809078125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f903015ea30 con 0x7f90300d1010 2024-09-10T07:37:59.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.735+0000 7f9027e00640 1 -- 172.21.15.99:0/809078125 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) ==== 122+0+0 (secure 0 0 0) 0x7f902807a9f0 con 0x7f90300d1010 2024-09-10T07:37:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 -- 172.21.15.99:0/809078125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f900c06be30 msgr2=0x7f900c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f900c06be30 0x7f900c06e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f90300b2520 tx=0x7f9020008040 comp rx=0 tx=0).stop 2024-09-10T07:37:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 -- 172.21.15.99:0/809078125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 msgr2=0x7f903015b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 0x7f903015b420 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f902802ac70 tx=0x7f9028004a40 comp rx=0 tx=0).stop 2024-09-10T07:37:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 -- 172.21.15.99:0/809078125 shutdown_connections 2024-09-10T07:37:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f900c06be30 0x7f900c06e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90300d1010 0x7f903015b420 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9030071df0 0x7f90301514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 --2- 172.21.15.99:0/809078125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f903006e280 0x7f903013f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 -- 172.21.15.99:0/809078125 >> 172.21.15.99:0/809078125 conn(0x7f903006bc10 msgr2=0x7f903015f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 -- 172.21.15.99:0/809078125 shutdown_connections 2024-09-10T07:37:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.738+0000 7f9036000640 1 -- 172.21.15.99:0/809078125 wait complete. 2024-09-10T07:37:59.755 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:37:59.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:37:59.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.912+0000 7faba6200640 1 Processor -- start 2024-09-10T07:37:59.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.912+0000 7faba6200640 1 -- start start 2024-09-10T07:37:59.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.913+0000 7faba6200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faba015e970 0x7faba00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:59.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.913+0000 7faba6200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba00d2bd0 con 0x7faba00d2680 2024-09-10T07:37:59.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.913+0000 7faba6200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba00d2eb0 con 0x7faba00cfc90 2024-09-10T07:37:59.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.913+0000 7faba6200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7faba00d37e0 con 0x7faba015e970 2024-09-10T07:37:59.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.913+0000 7fab9fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faba00d2680 0x7faba00cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60050/0 (socket says 172.21.15.99:60050) 2024-09-10T07:37:59.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9fe00640 1 -- 172.21.15.99:0/44752829 learned_addr learned my addr 172.21.15.99:0/44752829 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:37:59.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7faba4e00640 1 --2- 172.21.15.99:0/44752829 >> v2:172.21.15.187:3300/0 conn(0x7faba015e970 0x7faba00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:59.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1388037437 0 0) 0x7faba00d2bd0 con 0x7faba00d2680 2024-09-10T07:37:59.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab88003520 con 0x7faba00d2680 2024-09-10T07:37:59.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1196750236 0 0) 0x7fab88003520 con 0x7faba00d2680 2024-09-10T07:37:59.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 >> v2:172.21.15.187:3300/0 conn(0x7faba015e970 msgr2=0x7faba00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:59.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 --2- 172.21.15.99:0/44752829 >> v2:172.21.15.187:3300/0 conn(0x7faba015e970 0x7faba00d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:59.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 >> v1:172.21.15.187:6789/0 conn(0x7faba00cfc90 legacy=0x7faba00c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:59.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba00d3190 con 0x7faba00d2680 2024-09-10T07:37:59.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fab8c001670 con 0x7faba00d2680 2024-09-10T07:37:59.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 >> v1:172.21.15.99:6789/0 conn(0x7faba00d2680 legacy=0x7faba00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:59.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880039b0 0x7fab88003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:59.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab88004800 0x7fab88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:59.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab880051c0 0x7fab8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:59.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faba00d37e0 con 0x7fab880051c0 2024-09-10T07:37:59.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fab8800c070 con 0x7fab880039b0 2024-09-10T07:37:59.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.914+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fab8800c270 con 0x7fab88004800 2024-09-10T07:37:59.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.915+0000 7faba4e00640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880039b0 0x7fab88003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:59.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.915+0000 7faba5800640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab880051c0 0x7fab8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:59.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.915+0000 7fab9fe00640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab88004800 0x7fab88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:59.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.915+0000 7faba5800640 1 -- 172.21.15.99:0/44752829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab88004800 msgr2=0x7fab88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:59.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.915+0000 7faba5800640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab88004800 0x7fab88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:59.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.915+0000 7faba5800640 1 -- 172.21.15.99:0/44752829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880039b0 msgr2=0x7fab88003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:37:59.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.915+0000 7faba5800640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880039b0 0x7fab88003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:59.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.915+0000 7faba5800640 1 -- 172.21.15.99:0/44752829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab88003520 con 0x7fab880051c0 2024-09-10T07:37:59.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.915+0000 7faba4e00640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880039b0 0x7fab88003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:37:59.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.916+0000 7faba5800640 1 -- 172.21.15.99:0/44752829 reap_dead start 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.916+0000 7faba5800640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab880051c0 0x7fab8800b9c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fab98001e50 tx=0x7fab88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6b4f37e090560e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.916+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94009690 con 0x7fab880051c0 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.916+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab98003970 con 0x7fab880051c0 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.916+0000 7fab9f400640 1 -- 172.21.15.99:0/44752829 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98001a70 con 0x7fab880051c0 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.917+0000 7faba6200640 1 -- 172.21.15.99:0/44752829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab880051c0 msgr2=0x7fab8800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.917+0000 7faba6200640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab880051c0 0x7fab8800b9c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fab98001e50 tx=0x7fab88005830 comp rx=0 tx=0).stop 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.917+0000 7faba6200640 1 -- 172.21.15.99:0/44752829 shutdown_connections 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.917+0000 7faba6200640 1 --2- 172.21.15.99:0/44752829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab880051c0 0x7fab8800b9c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.917+0000 7faba6200640 1 -- 172.21.15.99:0/44752829 >> 172.21.15.99:0/44752829 conn(0x7faba009de00 msgr2=0x7faba00d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.917+0000 7faba6200640 1 -- 172.21.15.99:0/44752829 shutdown_connections 2024-09-10T07:37:59.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.917+0000 7faba6200640 1 -- 172.21.15.99:0/44752829 wait complete. 2024-09-10T07:37:59.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.919+0000 7faba6200640 1 Processor -- start 2024-09-10T07:37:59.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.919+0000 7faba6200640 1 -- start start 2024-09-10T07:37:59.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7faba6200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880051c0 0x7faba01610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:59.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7faba6200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba0154ec0 0x7faba00b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:59.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7faba6200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faba0157580 0x7faba0157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7faba6200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faba015eed0 con 0x7faba0154ec0 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7faba6200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faba015ed50 con 0x7fab880051c0 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7faba6200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faba00cf580 con 0x7faba0157580 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7fab9fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba0154ec0 0x7faba00b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7fab9fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba0154ec0 0x7faba00b82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35886/0 (socket says 172.21.15.99:35886) 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7fab9fe00640 1 -- 172.21.15.99:0/519803351 learned_addr learned my addr 172.21.15.99:0/519803351 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7faba4e00640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880051c0 0x7faba01610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7faba5800640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faba0157580 0x7faba0157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7fab9fe00640 1 -- 172.21.15.99:0/519803351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faba0157580 msgr2=0x7faba0157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7fab9fe00640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faba0157580 0x7faba0157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7fab9fe00640 1 -- 172.21.15.99:0/519803351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880051c0 msgr2=0x7faba01610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7fab9fe00640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880051c0 0x7faba01610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.920+0000 7fab9fe00640 1 -- 172.21.15.99:0/519803351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba00b8ad0 con 0x7faba0154ec0 2024-09-10T07:37:59.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.921+0000 7fab9fe00640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba0154ec0 0x7faba00b82a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0073a0 tx=0x7fab8c0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.921+0000 7fab9cc00640 1 -- 172.21.15.99:0/519803351 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c01a070 con 0x7faba0154ec0 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.921+0000 7fab9cc00640 1 -- 172.21.15.99:0/519803351 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8c00f9c0 con 0x7faba0154ec0 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.921+0000 7faba6200640 1 -- 172.21.15.99:0/519803351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba00b8db0 con 0x7faba0154ec0 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.921+0000 7fab9cc00640 1 -- 172.21.15.99:0/519803351 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c00fd90 con 0x7faba0154ec0 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.921+0000 7faba6200640 1 -- 172.21.15.99:0/519803351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba00b9370 con 0x7faba0154ec0 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.922+0000 7faba6200640 1 -- 172.21.15.99:0/519803351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba00cf910 con 0x7faba0154ec0 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.923+0000 7fab9cc00640 1 -- 172.21.15.99:0/519803351 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab8c01d070 con 0x7faba0154ec0 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.924+0000 7fab9cc00640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab8006be60 0x7fab8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.924+0000 7fab9cc00640 1 -- 172.21.15.99:0/519803351 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fab8c08a990 con 0x7faba0154ec0 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.924+0000 7faba4e00640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab8006be60 0x7fab8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:37:59.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.925+0000 7faba4e00640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab8006be60 0x7fab8006e320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fab94009b40 tx=0x7fab94009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:37:59.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:37:59.928+0000 7fab9cc00640 1 -- 172.21.15.99:0/519803351 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab8c058c50 con 0x7faba0154ec0 2024-09-10T07:38:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.135+0000 7faba6200640 1 -- 172.21.15.99:0/519803351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faba00ca820 con 0x7faba0154ec0 2024-09-10T07:38:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.136+0000 7fab9cc00640 1 -- 172.21.15.99:0/519803351 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5231 (secure 0 0 0) 0x7fab8c05cf50 con 0x7faba0154ec0 2024-09-10T07:38:00.136 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:00.136 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":41,"btime":"2024-09-10T07:37:59:731705+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4097816103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4097816103},{"type":"v1","addr":"172.21.15.99:6836","nonce":4097816103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1085745704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1085745704},{"type":"v1","addr":"172.21.15.99:6837","nonce":1085745704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1939216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1939216203},{"type":"v1","addr":"172.21.15.187:6834","nonce":1939216203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:37:56.004324+0000","modified":"2024-09-10T07:37:59.138242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5596},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5596":{"gid":5596,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1298775214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1298775214},{"type":"v1","addr":"172.21.15.187:6835","nonce":1298775214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5596,"qdb_cluster":[5596]},"id":5}]} 2024-09-10T07:38:00.136 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 41 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 -- 172.21.15.99:0/519803351 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab8006be60 msgr2=0x7fab8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab8006be60 0x7fab8006e320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fab94009b40 tx=0x7fab94009190 comp rx=0 tx=0).stop 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 -- 172.21.15.99:0/519803351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba0154ec0 msgr2=0x7faba00b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba0154ec0 0x7faba00b82a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0073a0 tx=0x7fab8c0077a0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 -- 172.21.15.99:0/519803351 shutdown_connections 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faba0157580 0x7faba0157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab8006be60 0x7fab8006e320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba0154ec0 0x7faba00b82a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 --2- 172.21.15.99:0/519803351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880051c0 0x7faba01610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 -- 172.21.15.99:0/519803351 >> 172.21.15.99:0/519803351 conn(0x7faba009de00 msgr2=0x7faba00cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 -- 172.21.15.99:0/519803351 shutdown_connections 2024-09-10T07:38:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.138+0000 7faba6200640 1 -- 172.21.15.99:0/519803351 wait complete. 2024-09-10T07:38:00.154 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:38:00.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.306+0000 7f2c33800640 1 Processor -- start 2024-09-10T07:38:00.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.307+0000 7f2c33800640 1 -- start start 2024-09-10T07:38:00.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.308+0000 7f2c33800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c145290 0x7f2c2c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.308+0000 7f2c33800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2c2c072f40 0x7f2c2c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.308+0000 7f2c33800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c2c06e3d0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.308+0000 7f2c33800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f2c2c06efe0 con 0x7f2c2c072f40 2024-09-10T07:38:00.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.308+0000 7f2c33800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2c06e6b0 con 0x7f2c2c145290 2024-09-10T07:38:00.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.308+0000 7f2c31800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2c2c072f40 0x7f2c2c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.308+0000 7f2c2be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2c2c0ce780 0x7f2c2c072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60062/0 (socket says 172.21.15.99:60062) 2024-09-10T07:38:00.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.308+0000 7f2c2be00640 1 -- 172.21.15.99:0/767823409 learned_addr learned my addr 172.21.15.99:0/767823409 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:00.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.308+0000 7f2c30e00640 1 --2- 172.21.15.99:0/767823409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c145290 0x7f2c2c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.309+0000 7f2c31800640 1 -- 172.21.15.99:0/767823409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c145290 msgr2=0x7f2c2c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:00.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.309+0000 7f2c31800640 1 --2- 172.21.15.99:0/767823409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c145290 0x7f2c2c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.309+0000 7f2c31800640 1 -- 172.21.15.99:0/767823409 >> v1:172.21.15.99:6789/0 conn(0x7f2c2c0ce780 legacy=0x7f2c2c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.309+0000 7f2c31800640 1 -- 172.21.15.99:0/767823409 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c06e990 con 0x7f2c2c072f40 2024-09-10T07:38:00.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.309+0000 7f2c2b400640 1 -- 172.21.15.99:0/767823409 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253714799 0 0) 0x7f2c2c06e3d0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.310+0000 7f2c31800640 1 --2- 172.21.15.99:0/767823409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c072f40 0x7f2c2c0b3930 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009d90 tx=0x7f2c2402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1828dff066692774 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:00.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.310+0000 7f2c2b400640 1 -- 172.21.15.99:0/767823409 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24007740 con 0x7f2c2c072f40 2024-09-10T07:38:00.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.310+0000 7f2c2b400640 1 -- 172.21.15.99:0/767823409 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c240078e0 con 0x7f2c2c072f40 2024-09-10T07:38:00.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.310+0000 7f2c2b400640 1 -- 172.21.15.99:0/767823409 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24007cb0 con 0x7f2c2c072f40 2024-09-10T07:38:00.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.310+0000 7f2c33800640 1 -- 172.21.15.99:0/767823409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c072f40 msgr2=0x7f2c2c0b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.310+0000 7f2c33800640 1 --2- 172.21.15.99:0/767823409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c072f40 0x7f2c2c0b3930 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009d90 tx=0x7f2c2402a660 comp rx=0 tx=0).stop 2024-09-10T07:38:00.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.310+0000 7f2c33800640 1 -- 172.21.15.99:0/767823409 shutdown_connections 2024-09-10T07:38:00.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.310+0000 7f2c33800640 1 --2- 172.21.15.99:0/767823409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c072f40 0x7f2c2c0b3930 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.310+0000 7f2c33800640 1 --2- 172.21.15.99:0/767823409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c145290 0x7f2c2c06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.310+0000 7f2c33800640 1 -- 172.21.15.99:0/767823409 >> 172.21.15.99:0/767823409 conn(0x7f2c2c06bc10 msgr2=0x7f2c2c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:00.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.311+0000 7f2c33800640 1 -- 172.21.15.99:0/767823409 shutdown_connections 2024-09-10T07:38:00.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.311+0000 7f2c33800640 1 -- 172.21.15.99:0/767823409 wait complete. 2024-09-10T07:38:00.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.312+0000 7f2c33800640 1 Processor -- start 2024-09-10T07:38:00.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.312+0000 7f2c33800640 1 -- start start 2024-09-10T07:38:00.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c33800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c072f40 0x7f2c2c1559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c33800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c0ce780 0x7f2c2c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c33800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c2c145290 0x7f2c2c15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c33800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c06df80 con 0x7f2c2c0ce780 2024-09-10T07:38:00.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c33800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c145670 con 0x7f2c2c145290 2024-09-10T07:38:00.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c33800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2c06e100 con 0x7f2c2c072f40 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c2be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c0ce780 0x7f2c2c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c2be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c0ce780 0x7f2c2c15e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35900/0 (socket says 172.21.15.99:35900) 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c2be00640 1 -- 172.21.15.99:0/1793413270 learned_addr learned my addr 172.21.15.99:0/1793413270 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c30e00640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c072f40 0x7f2c2c1559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.313+0000 7f2c31800640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c2c145290 0x7f2c2c15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c2be00640 1 -- 172.21.15.99:0/1793413270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c072f40 msgr2=0x7f2c2c1559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c2be00640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c072f40 0x7f2c2c1559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c2be00640 1 -- 172.21.15.99:0/1793413270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c2c145290 msgr2=0x7f2c2c15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c2be00640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c2c145290 0x7f2c2c15e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c2be00640 1 -- 172.21.15.99:0/1793413270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c13b460 con 0x7f2c2c0ce780 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c30e00640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c072f40 0x7f2c2c1559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c2be00640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c0ce780 0x7f2c2c15e070 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800c410 tx=0x7f2c1800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c28c00640 1 -- 172.21.15.99:0/1793413270 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c180074e0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c28c00640 1 -- 172.21.15.99:0/1793413270 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c180047e0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c28c00640 1 -- 172.21.15.99:0/1793413270 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18004bd0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c33800640 1 -- 172.21.15.99:0/1793413270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2c15ebe0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.314+0000 7f2c33800640 1 -- 172.21.15.99:0/1793413270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2c13b9e0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.315+0000 7f2c33800640 1 -- 172.21.15.99:0/1793413270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c2c0715a0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.316+0000 7f2c28c00640 1 -- 172.21.15.99:0/1793413270 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c18011070 con 0x7f2c2c0ce780 2024-09-10T07:38:00.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.317+0000 7f2c28c00640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c0c06be30 0x7f2c0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.317+0000 7f2c28c00640 1 -- 172.21.15.99:0/1793413270 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f2c1808ab10 con 0x7f2c2c0ce780 2024-09-10T07:38:00.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.317+0000 7f2c30e00640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c0c06be30 0x7f2c0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.318+0000 7f2c30e00640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c0c06be30 0x7f2c0c06e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c006fd0 tx=0x7f2c1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:00.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.321+0000 7f2c28c00640 1 -- 172.21.15.99:0/1793413270 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c180594b0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.494+0000 7f2c33800640 1 -- 172.21.15.99:0/1793413270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c2c0b1bd0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.496+0000 7f2c28c00640 1 -- 172.21.15.99:0/1793413270 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+16704 (secure 0 0 0) 0x7f2c18058db0 con 0x7f2c2c0ce780 2024-09-10T07:38:00.496 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:00.496 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":83,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:37:57.587792+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:37:53.770507+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T07:37:55.001057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:38:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 -- 172.21.15.99:0/1793413270 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c0c06be30 msgr2=0x7f2c0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c0c06be30 0x7f2c0c06e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c006fd0 tx=0x7f2c1c008040 comp rx=0 tx=0).stop 2024-09-10T07:38:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 -- 172.21.15.99:0/1793413270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c0ce780 msgr2=0x7f2c2c15e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c0ce780 0x7f2c2c15e070 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800c410 tx=0x7f2c1800c8d0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 -- 172.21.15.99:0/1793413270 shutdown_connections 2024-09-10T07:38:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c2c145290 0x7f2c2c15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c0c06be30 0x7f2c0c06e2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c2c0ce780 0x7f2c2c15e070 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 --2- 172.21.15.99:0/1793413270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c2c072f40 0x7f2c2c1559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 -- 172.21.15.99:0/1793413270 >> 172.21.15.99:0/1793413270 conn(0x7f2c2c06bc10 msgr2=0x7f2c2c0b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 -- 172.21.15.99:0/1793413270 shutdown_connections 2024-09-10T07:38:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.498+0000 7f2c33800640 1 -- 172.21.15.99:0/1793413270 wait complete. 2024-09-10T07:38:00.514 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:38:00.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:38:00.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.668+0000 7f87a1a00640 1 Processor -- start 2024-09-10T07:38:00.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.669+0000 7f87a1a00640 1 -- start start 2024-09-10T07:38:00.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.670+0000 7f87a1a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c145290 0x7f879c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.670+0000 7f87a1a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879c06e3d0 con 0x7f879c072f40 2024-09-10T07:38:00.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.670+0000 7f87a1a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879c06e6b0 con 0x7f879c0ce780 2024-09-10T07:38:00.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.670+0000 7f87a1a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f879c06efe0 con 0x7f879c145290 2024-09-10T07:38:00.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.670+0000 7f879b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f879c072f40 0x7f879c0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60078/0 (socket says 172.21.15.99:60078) 2024-09-10T07:38:00.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.670+0000 7f879b400640 1 -- 172.21.15.99:0/2001858993 learned_addr learned my addr 172.21.15.99:0/2001858993 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:00.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.670+0000 7f879aa00640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c145290 0x7f879c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.670+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569254789 0 0) 0x7f879c06e3d0 con 0x7f879c072f40 2024-09-10T07:38:00.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8780003520 con 0x7f879c072f40 2024-09-10T07:38:00.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096587683 0 0) 0x7f879c06e6b0 con 0x7f879c0ce780 2024-09-10T07:38:00.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f879c06e3d0 con 0x7f879c0ce780 2024-09-10T07:38:00.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3116620732 0 0) 0x7f8780003520 con 0x7f879c072f40 2024-09-10T07:38:00.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c145290 msgr2=0x7f879c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:00.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c145290 0x7f879c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 >> v1:172.21.15.187:6789/0 conn(0x7f879c0ce780 legacy=0x7f879c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c06e990 con 0x7f879c072f40 2024-09-10T07:38:00.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f87940019f0 con 0x7f879c072f40 2024-09-10T07:38:00.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 >> v1:172.21.15.99:6789/0 conn(0x7f879c072f40 legacy=0x7f879c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8780003b70 0x7f8780003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c145290 0x7f8780004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8780004d40 0x7f87800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f879c06efe0 con 0x7f8780003b70 2024-09-10T07:38:00.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f878000ba70 con 0x7f8780004d40 2024-09-10T07:38:00.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f878000bc20 con 0x7f879c145290 2024-09-10T07:38:00.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879aa00640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8780003b70 0x7f8780003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f8793e00640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c145290 0x7f8780004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.671+0000 7f879b400640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8780004d40 0x7f87800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.672+0000 7f879aa00640 1 -- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c145290 msgr2=0x7f8780004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:00.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.672+0000 7f879aa00640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c145290 0x7f8780004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.672+0000 7f879aa00640 1 -- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8780004d40 msgr2=0x7f87800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:00.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.672+0000 7f879aa00640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8780004d40 0x7f87800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.672+0000 7f879aa00640 1 -- 172.21.15.99:0/2001858993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8780003520 con 0x7f8780003b70 2024-09-10T07:38:00.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.673+0000 7f879aa00640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8780003b70 0x7f8780003f70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f878c009ac0 tx=0x7f8780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64430d98cb58a6ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.673+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c036070 con 0x7f8780003b70 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.673+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878c031400 con 0x7f8780003b70 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.673+0000 7f879a000640 1 -- 172.21.15.99:0/2001858993 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c009690 con 0x7f8780003b70 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.673+0000 7f87a1a00640 1 -- 172.21.15.99:0/2001858993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8780003b70 msgr2=0x7f8780003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.673+0000 7f87a1a00640 1 --2- 172.21.15.99:0/2001858993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8780003b70 0x7f8780003f70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f878c009ac0 tx=0x7f8780005830 comp rx=0 tx=0).stop 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.674+0000 7f879b400640 1 -- 172.21.15.99:0/2001858993 reap_dead start 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.674+0000 7f87a1a00640 1 -- 172.21.15.99:0/2001858993 shutdown_connections 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.674+0000 7f87a1a00640 1 -- 172.21.15.99:0/2001858993 >> 172.21.15.99:0/2001858993 conn(0x7f879c06bc10 msgr2=0x7f879c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.674+0000 7f87a1a00640 1 -- 172.21.15.99:0/2001858993 shutdown_connections 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.674+0000 7f87a1a00640 1 -- 172.21.15.99:0/2001858993 wait complete. 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.675+0000 7f87a1a00640 1 Processor -- start 2024-09-10T07:38:00.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.675+0000 7f87a1a00640 1 -- start start 2024-09-10T07:38:00.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.676+0000 7f87a1a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8780003b70 0x7f879c15d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.676+0000 7f87a1a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c1445d0 0x7f879c15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.676+0000 7f87a1a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c13aab0 0x7f879c13af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.676+0000 7f87a1a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f879c06df80 con 0x7f879c1445d0 2024-09-10T07:38:00.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.676+0000 7f87a1a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f879c145670 con 0x7f8780003b70 2024-09-10T07:38:00.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.676+0000 7f87a1a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f879c06e100 con 0x7f879c13aab0 2024-09-10T07:38:00.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f8793e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c1445d0 0x7f879c15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f8793e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c1445d0 0x7f879c15b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35912/0 (socket says 172.21.15.99:35912) 2024-09-10T07:38:00.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f8793e00640 1 -- 172.21.15.99:0/1849322378 learned_addr learned my addr 172.21.15.99:0/1849322378 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:00.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f879aa00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8780003b70 0x7f879c15d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f879b400640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c13aab0 0x7f879c13af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f8793e00640 1 -- 172.21.15.99:0/1849322378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c13aab0 msgr2=0x7f879c13af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f8793e00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c13aab0 0x7f879c13af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f8793e00640 1 -- 172.21.15.99:0/1849322378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8780003b70 msgr2=0x7f879c15d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f8793e00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8780003b70 0x7f879c15d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f8793e00640 1 -- 172.21.15.99:0/1849322378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c15dec0 con 0x7f879c1445d0 2024-09-10T07:38:00.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f879b400640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c13aab0 0x7f879c13af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:00.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f8793e00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c1445d0 0x7f879c15b450 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f878400f7a0 tx=0x7f878400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:00.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.677+0000 7f8792a00640 1 -- 172.21.15.99:0/1849322378 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878400fe50 con 0x7f879c1445d0 2024-09-10T07:38:00.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.678+0000 7f8792a00640 1 -- 172.21.15.99:0/1849322378 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8784018070 con 0x7f879c1445d0 2024-09-10T07:38:00.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.678+0000 7f87a1a00640 1 -- 172.21.15.99:0/1849322378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879c15e1a0 con 0x7f879c1445d0 2024-09-10T07:38:00.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.678+0000 7f8792a00640 1 -- 172.21.15.99:0/1849322378 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878400d730 con 0x7f879c1445d0 2024-09-10T07:38:00.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.678+0000 7f87a1a00640 1 -- 172.21.15.99:0/1849322378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879c144a30 con 0x7f879c1445d0 2024-09-10T07:38:00.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.679+0000 7f87a1a00640 1 -- 172.21.15.99:0/1849322378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879c0715a0 con 0x7f879c1445d0 2024-09-10T07:38:00.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.679+0000 7f8792a00640 1 -- 172.21.15.99:0/1849322378 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f878400d8d0 con 0x7f879c1445d0 2024-09-10T07:38:00.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.680+0000 7f8792a00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f877806be30 0x7f877806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:00.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.680+0000 7f8792a00640 1 -- 172.21.15.99:0/1849322378 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f878408add0 con 0x7f879c1445d0 2024-09-10T07:38:00.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.681+0000 7f879aa00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f877806be30 0x7f877806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:00.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.681+0000 7f879aa00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f877806be30 0x7f877806e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f878c033000 tx=0x7f878c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:00.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.684+0000 7f8792a00640 1 -- 172.21.15.99:0/1849322378 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87840596e0 con 0x7f879c1445d0 2024-09-10T07:38:00.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.856+0000 7f87a1a00640 1 -- 172.21.15.99:0/1849322378 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f879c072be0 con 0x7f877806be30 2024-09-10T07:38:00.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.863+0000 7f8792a00640 1 -- 172.21.15.99:0/1849322378 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247591 (secure 0 0 0) 0x7f879c072be0 con 0x7f877806be30 2024-09-10T07:38:00.865 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:00.867 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:38:00.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 -- 172.21.15.99:0/1849322378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f877806be30 msgr2=0x7f877806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f877806be30 0x7f877806e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f878c033000 tx=0x7f878c008030 comp rx=0 tx=0).stop 2024-09-10T07:38:00.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 -- 172.21.15.99:0/1849322378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c1445d0 msgr2=0x7f879c15b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:00.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c1445d0 0x7f879c15b450 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f878400f7a0 tx=0x7f878400fc60 comp rx=0 tx=0).stop 2024-09-10T07:38:00.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 -- 172.21.15.99:0/1849322378 shutdown_connections 2024-09-10T07:38:00.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c13aab0 0x7f879c13af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f877806be30 0x7f877806e2f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c1445d0 0x7f879c15b450 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 --2- 172.21.15.99:0/1849322378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8780003b70 0x7f879c15d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:00.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 -- 172.21.15.99:0/1849322378 >> 172.21.15.99:0/1849322378 conn(0x7f879c06bc10 msgr2=0x7f879c0cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:00.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 -- 172.21.15.99:0/1849322378 shutdown_connections 2024-09-10T07:38:00.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:00.867+0000 7f87a1a00640 1 -- 172.21.15.99:0/1849322378 wait complete. 2024-09-10T07:38:00.883 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-10T07:38:00.740296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4586,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557913,"statfs":{"total":1600000000,"available":1595303152,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001199"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592412+0000","last_change":"2024-09-10T07:37:56.612344+0000","last_active":"2024-09-10T07:37:57.592412+0000","last_peered":"2024-09-10T07:37:57.592412+0000","last_clean":"2024-09-10T07:37:57.592412+0000","last_became_active":"2024-09-10T07:37:56.612082+0000","last_became_peered":"2024-09-10T07:37:56.612082+0000","last_unstale":"2024-09-10T07:37:57.592412+0000","last_undegraded":"2024-09-10T07:37:57.592412+0000","last_fullsized":"2024-09-10T07:37:57.592412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:11.233346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810582+0000","last_change":"2024-09-10T07:37:56.606323+0000","last_active":"2024-09-10T07:37:57.810582+0000","last_peered":"2024-09-10T07:37:57.810582+0000","last_clean":"2024-09-10T07:37:57.810582+0000","last_became_active":"2024-09-10T07:37:56.602781+0000","last_became_peered":"2024-09-10T07:37:56.602781+0000","last_unstale":"2024-09-10T07:37:57.810582+0000","last_undegraded":"2024-09-10T07:37:57.810582+0000","last_fullsized":"2024-09-10T07:37:57.810582+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:52.165087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591381+0000","last_change":"2024-09-10T07:37:56.595700+0000","last_active":"2024-09-10T07:37:57.591381+0000","last_peered":"2024-09-10T07:37:57.591381+0000","last_clean":"2024-09-10T07:37:57.591381+0000","last_became_active":"2024-09-10T07:37:56.595426+0000","last_became_peered":"2024-09-10T07:37:56.595426+0000","last_unstale":"2024-09-10T07:37:57.591381+0000","last_undegraded":"2024-09-10T07:37:57.591381+0000","last_fullsized":"2024-09-10T07:37:57.591381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:36.670198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.809838+0000","last_change":"2024-09-10T07:37:56.610478+0000","last_active":"2024-09-10T07:37:57.809838+0000","last_peered":"2024-09-10T07:37:57.809838+0000","last_clean":"2024-09-10T07:37:57.809838+0000","last_became_active":"2024-09-10T07:37:56.610251+0000","last_became_peered":"2024-09-10T07:37:56.610251+0000","last_unstale":"2024-09-10T07:37:57.809838+0000","last_undegraded":"2024-09-10T07:37:57.809838+0000","last_fullsized":"2024-09-10T07:37:57.809838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:21.630124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028458+0000","last_change":"2024-09-10T07:37:56.605866+0000","last_active":"2024-09-10T07:37:58.028458+0000","last_peered":"2024-09-10T07:37:58.028458+0000","last_clean":"2024-09-10T07:37:58.028458+0000","last_became_active":"2024-09-10T07:37:56.605645+0000","last_became_peered":"2024-09-10T07:37:56.605645+0000","last_unstale":"2024-09-10T07:37:58.028458+0000","last_undegraded":"2024-09-10T07:37:58.028458+0000","last_fullsized":"2024-09-10T07:37:58.028458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:03.385145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811302+0000","last_change":"2024-09-10T07:37:56.614507+0000","last_active":"2024-09-10T07:37:57.811302+0000","last_peered":"2024-09-10T07:37:57.811302+0000","last_clean":"2024-09-10T07:37:57.811302+0000","last_became_active":"2024-09-10T07:37:56.613456+0000","last_became_peered":"2024-09-10T07:37:56.613456+0000","last_unstale":"2024-09-10T07:37:57.811302+0000","last_undegraded":"2024-09-10T07:37:57.811302+0000","last_fullsized":"2024-09-10T07:37:57.811302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:07.096843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592891+0000","last_change":"2024-09-10T07:37:56.612134+0000","last_active":"2024-09-10T07:37:57.592891+0000","last_peered":"2024-09-10T07:37:57.592891+0000","last_clean":"2024-09-10T07:37:57.592891+0000","last_became_active":"2024-09-10T07:37:56.601678+0000","last_became_peered":"2024-09-10T07:37:56.601678+0000","last_unstale":"2024-09-10T07:37:57.592891+0000","last_undegraded":"2024-09-10T07:37:57.592891+0000","last_fullsized":"2024-09-10T07:37:57.592891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:13.308783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810650+0000","last_change":"2024-09-10T07:37:56.604848+0000","last_active":"2024-09-10T07:37:57.810650+0000","last_peered":"2024-09-10T07:37:57.810650+0000","last_clean":"2024-09-10T07:37:57.810650+0000","last_became_active":"2024-09-10T07:37:56.604118+0000","last_became_peered":"2024-09-10T07:37:56.604118+0000","last_unstale":"2024-09-10T07:37:57.810650+0000","last_undegraded":"2024-09-10T07:37:57.810650+0000","last_fullsized":"2024-09-10T07:37:57.810650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:14.826407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028215+0000","last_change":"2024-09-10T07:37:56.600137+0000","last_active":"2024-09-10T07:37:58.028215+0000","last_peered":"2024-09-10T07:37:58.028215+0000","last_clean":"2024-09-10T07:37:58.028215+0000","last_became_active":"2024-09-10T07:37:56.599880+0000","last_became_peered":"2024-09-10T07:37:56.599880+0000","last_unstale":"2024-09-10T07:37:58.028215+0000","last_undegraded":"2024-09-10T07:37:58.028215+0000","last_fullsized":"2024-09-10T07:37:58.028215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:44.578003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810597+0000","last_change":"2024-09-10T07:37:56.609379+0000","last_active":"2024-09-10T07:37:57.810597+0000","last_peered":"2024-09-10T07:37:57.810597+0000","last_clean":"2024-09-10T07:37:57.810597+0000","last_became_active":"2024-09-10T07:37:56.607799+0000","last_became_peered":"2024-09-10T07:37:56.607799+0000","last_unstale":"2024-09-10T07:37:57.810597+0000","last_undegraded":"2024-09-10T07:37:57.810597+0000","last_fullsized":"2024-09-10T07:37:57.810597+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:01.430389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592657+0000","last_change":"2024-09-10T07:37:56.619924+0000","last_active":"2024-09-10T07:37:57.592657+0000","last_peered":"2024-09-10T07:37:57.592657+0000","last_clean":"2024-09-10T07:37:57.592657+0000","last_became_active":"2024-09-10T07:37:56.618716+0000","last_became_peered":"2024-09-10T07:37:56.618716+0000","last_unstale":"2024-09-10T07:37:57.592657+0000","last_undegraded":"2024-09-10T07:37:57.592657+0000","last_fullsized":"2024-09-10T07:37:57.592657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:19.780491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.809930+0000","last_change":"2024-09-10T07:37:56.604923+0000","last_active":"2024-09-10T07:37:57.809930+0000","last_peered":"2024-09-10T07:37:57.809930+0000","last_clean":"2024-09-10T07:37:57.809930+0000","last_became_active":"2024-09-10T07:37:56.603862+0000","last_became_peered":"2024-09-10T07:37:56.603862+0000","last_unstale":"2024-09-10T07:37:57.809930+0000","last_undegraded":"2024-09-10T07:37:57.809930+0000","last_fullsized":"2024-09-10T07:37:57.809930+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:25.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604388+0000","last_change":"2024-09-10T07:37:56.605849+0000","last_active":"2024-09-10T07:37:57.604388+0000","last_peered":"2024-09-10T07:37:57.604388+0000","last_clean":"2024-09-10T07:37:57.604388+0000","last_became_active":"2024-09-10T07:37:56.605402+0000","last_became_peered":"2024-09-10T07:37:56.605402+0000","last_unstale":"2024-09-10T07:37:57.604388+0000","last_undegraded":"2024-09-10T07:37:57.604388+0000","last_fullsized":"2024-09-10T07:37:57.604388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:26.483721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028368+0000","last_change":"2024-09-10T07:37:56.613225+0000","last_active":"2024-09-10T07:37:58.028368+0000","last_peered":"2024-09-10T07:37:58.028368+0000","last_clean":"2024-09-10T07:37:58.028368+0000","last_became_active":"2024-09-10T07:37:56.612845+0000","last_became_peered":"2024-09-10T07:37:56.612845+0000","last_unstale":"2024-09-10T07:37:58.028368+0000","last_undegraded":"2024-09-10T07:37:58.028368+0000","last_fullsized":"2024-09-10T07:37:58.028368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:32.906246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604430+0000","last_change":"2024-09-10T07:37:56.597999+0000","last_active":"2024-09-10T07:37:57.604430+0000","last_peered":"2024-09-10T07:37:57.604430+0000","last_clean":"2024-09-10T07:37:57.604430+0000","last_became_active":"2024-09-10T07:37:56.597783+0000","last_became_peered":"2024-09-10T07:37:56.597783+0000","last_unstale":"2024-09-10T07:37:57.604430+0000","last_undegraded":"2024-09-10T07:37:57.604430+0000","last_fullsized":"2024-09-10T07:37:57.604430+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:54.109192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810730+0000","last_change":"2024-09-10T07:37:56.616478+0000","last_active":"2024-09-10T07:37:57.810730+0000","last_peered":"2024-09-10T07:37:57.810730+0000","last_clean":"2024-09-10T07:37:57.810730+0000","last_became_active":"2024-09-10T07:37:56.616262+0000","last_became_peered":"2024-09-10T07:37:56.616262+0000","last_unstale":"2024-09-10T07:37:57.810730+0000","last_undegraded":"2024-09-10T07:37:57.810730+0000","last_fullsized":"2024-09-10T07:37:57.810730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:39.356261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028473+0000","last_change":"2024-09-10T07:37:56.602921+0000","last_active":"2024-09-10T07:37:58.028473+0000","last_peered":"2024-09-10T07:37:58.028473+0000","last_clean":"2024-09-10T07:37:58.028473+0000","last_became_active":"2024-09-10T07:37:56.601934+0000","last_became_peered":"2024-09-10T07:37:56.601934+0000","last_unstale":"2024-09-10T07:37:58.028473+0000","last_undegraded":"2024-09-10T07:37:58.028473+0000","last_fullsized":"2024-09-10T07:37:58.028473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:18.932854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810005+0000","last_change":"2024-09-10T07:37:56.610429+0000","last_active":"2024-09-10T07:37:57.810005+0000","last_peered":"2024-09-10T07:37:57.810005+0000","last_clean":"2024-09-10T07:37:57.810005+0000","last_became_active":"2024-09-10T07:37:56.610127+0000","last_became_peered":"2024-09-10T07:37:56.610127+0000","last_unstale":"2024-09-10T07:37:57.810005+0000","last_undegraded":"2024-09-10T07:37:57.810005+0000","last_fullsized":"2024-09-10T07:37:57.810005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:29.359346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811354+0000","last_change":"2024-09-10T07:37:56.606308+0000","last_active":"2024-09-10T07:37:57.811354+0000","last_peered":"2024-09-10T07:37:57.811354+0000","last_clean":"2024-09-10T07:37:57.811354+0000","last_became_active":"2024-09-10T07:37:56.605055+0000","last_became_peered":"2024-09-10T07:37:56.605055+0000","last_unstale":"2024-09-10T07:37:57.811354+0000","last_undegraded":"2024-09-10T07:37:57.811354+0000","last_fullsized":"2024-09-10T07:37:57.811354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:13.603935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604506+0000","last_change":"2024-09-10T07:37:56.593624+0000","last_active":"2024-09-10T07:37:57.604506+0000","last_peered":"2024-09-10T07:37:57.604506+0000","last_clean":"2024-09-10T07:37:57.604506+0000","last_became_active":"2024-09-10T07:37:56.593251+0000","last_became_peered":"2024-09-10T07:37:56.593251+0000","last_unstale":"2024-09-10T07:37:57.604506+0000","last_undegraded":"2024-09-10T07:37:57.604506+0000","last_fullsized":"2024-09-10T07:37:57.604506+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:39.128529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810507+0000","last_change":"2024-09-10T07:37:56.602596+0000","last_active":"2024-09-10T07:37:57.810507+0000","last_peered":"2024-09-10T07:37:57.810507+0000","last_clean":"2024-09-10T07:37:57.810507+0000","last_became_active":"2024-09-10T07:37:56.601224+0000","last_became_peered":"2024-09-10T07:37:56.601224+0000","last_unstale":"2024-09-10T07:37:57.810507+0000","last_undegraded":"2024-09-10T07:37:57.810507+0000","last_fullsized":"2024-09-10T07:37:57.810507+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:31.062877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810624+0000","last_change":"2024-09-10T07:37:56.605546+0000","last_active":"2024-09-10T07:37:57.810624+0000","last_peered":"2024-09-10T07:37:57.810624+0000","last_clean":"2024-09-10T07:37:57.810624+0000","last_became_active":"2024-09-10T07:37:56.605109+0000","last_became_peered":"2024-09-10T07:37:56.605109+0000","last_unstale":"2024-09-10T07:37:57.810624+0000","last_undegraded":"2024-09-10T07:37:57.810624+0000","last_fullsized":"2024-09-10T07:37:57.810624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:09.545662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592380+0000","last_change":"2024-09-10T07:37:56.616973+0000","last_active":"2024-09-10T07:37:57.592380+0000","last_peered":"2024-09-10T07:37:57.592380+0000","last_clean":"2024-09-10T07:37:57.592380+0000","last_became_active":"2024-09-10T07:37:56.616729+0000","last_became_peered":"2024-09-10T07:37:56.616729+0000","last_unstale":"2024-09-10T07:37:57.592380+0000","last_undegraded":"2024-09-10T07:37:57.592380+0000","last_fullsized":"2024-09-10T07:37:57.592380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:53.962308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592074+0000","last_change":"2024-09-10T07:37:56.615513+0000","last_active":"2024-09-10T07:37:57.592074+0000","last_peered":"2024-09-10T07:37:57.592074+0000","last_clean":"2024-09-10T07:37:57.592074+0000","last_became_active":"2024-09-10T07:37:56.611951+0000","last_became_peered":"2024-09-10T07:37:56.611951+0000","last_unstale":"2024-09-10T07:37:57.592074+0000","last_undegraded":"2024-09-10T07:37:57.592074+0000","last_fullsized":"2024-09-10T07:37:57.592074+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:55.066132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810735+0000","last_change":"2024-09-10T07:37:56.609590+0000","last_active":"2024-09-10T07:37:57.810735+0000","last_peered":"2024-09-10T07:37:57.810735+0000","last_clean":"2024-09-10T07:37:57.810735+0000","last_became_active":"2024-09-10T07:37:56.609159+0000","last_became_peered":"2024-09-10T07:37:56.609159+0000","last_unstale":"2024-09-10T07:37:57.810735+0000","last_undegraded":"2024-09-10T07:37:57.810735+0000","last_fullsized":"2024-09-10T07:37:57.810735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:45.486394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593021+0000","last_change":"2024-09-10T07:37:56.615774+0000","last_active":"2024-09-10T07:37:57.593021+0000","last_peered":"2024-09-10T07:37:57.593021+0000","last_clean":"2024-09-10T07:37:57.593021+0000","last_became_active":"2024-09-10T07:37:56.615543+0000","last_became_peered":"2024-09-10T07:37:56.615543+0000","last_unstale":"2024-09-10T07:37:57.593021+0000","last_undegraded":"2024-09-10T07:37:57.593021+0000","last_fullsized":"2024-09-10T07:37:57.593021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:19.017998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591464+0000","last_change":"2024-09-10T07:37:56.604021+0000","last_active":"2024-09-10T07:37:57.591464+0000","last_peered":"2024-09-10T07:37:57.591464+0000","last_clean":"2024-09-10T07:37:57.591464+0000","last_became_active":"2024-09-10T07:37:56.603641+0000","last_became_peered":"2024-09-10T07:37:56.603641+0000","last_unstale":"2024-09-10T07:37:57.591464+0000","last_undegraded":"2024-09-10T07:37:57.591464+0000","last_fullsized":"2024-09-10T07:37:57.591464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:24.787824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810321+0000","last_change":"2024-09-10T07:37:56.597772+0000","last_active":"2024-09-10T07:37:57.810321+0000","last_peered":"2024-09-10T07:37:57.810321+0000","last_clean":"2024-09-10T07:37:57.810321+0000","last_became_active":"2024-09-10T07:37:56.597510+0000","last_became_peered":"2024-09-10T07:37:56.597510+0000","last_unstale":"2024-09-10T07:37:57.810321+0000","last_undegraded":"2024-09-10T07:37:57.810321+0000","last_fullsized":"2024-09-10T07:37:57.810321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:50.208867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591566+0000","last_change":"2024-09-10T07:37:56.601381+0000","last_active":"2024-09-10T07:37:57.591566+0000","last_peered":"2024-09-10T07:37:57.591566+0000","last_clean":"2024-09-10T07:37:57.591566+0000","last_became_active":"2024-09-10T07:37:56.600951+0000","last_became_peered":"2024-09-10T07:37:56.600951+0000","last_unstale":"2024-09-10T07:37:57.591566+0000","last_undegraded":"2024-09-10T07:37:57.591566+0000","last_fullsized":"2024-09-10T07:37:57.591566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:25.639087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593523+0000","last_change":"2024-09-10T07:37:56.614259+0000","last_active":"2024-09-10T07:37:57.593523+0000","last_peered":"2024-09-10T07:37:57.593523+0000","last_clean":"2024-09-10T07:37:57.593523+0000","last_became_active":"2024-09-10T07:37:56.613997+0000","last_became_peered":"2024-09-10T07:37:56.613997+0000","last_unstale":"2024-09-10T07:37:57.593523+0000","last_undegraded":"2024-09-10T07:37:57.593523+0000","last_fullsized":"2024-09-10T07:37:57.593523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:04.920761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593202+0000","last_change":"2024-09-10T07:37:56.595451+0000","last_active":"2024-09-10T07:37:57.593202+0000","last_peered":"2024-09-10T07:37:57.593202+0000","last_clean":"2024-09-10T07:37:57.593202+0000","last_became_active":"2024-09-10T07:37:56.595216+0000","last_became_peered":"2024-09-10T07:37:56.595216+0000","last_unstale":"2024-09-10T07:37:57.593202+0000","last_undegraded":"2024-09-10T07:37:57.593202+0000","last_fullsized":"2024-09-10T07:37:57.593202+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:35.380928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810731+0000","last_change":"2024-09-10T07:37:56.608263+0000","last_active":"2024-09-10T07:37:57.810731+0000","last_peered":"2024-09-10T07:37:57.810731+0000","last_clean":"2024-09-10T07:37:57.810731+0000","last_became_active":"2024-09-10T07:37:56.604867+0000","last_became_peered":"2024-09-10T07:37:56.604867+0000","last_unstale":"2024-09-10T07:37:57.810731+0000","last_undegraded":"2024-09-10T07:37:57.810731+0000","last_fullsized":"2024-09-10T07:37:57.810731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:12.250882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592284+0000","last_change":"2024-09-10T07:37:56.615736+0000","last_active":"2024-09-10T07:37:57.592284+0000","last_peered":"2024-09-10T07:37:57.592284+0000","last_clean":"2024-09-10T07:37:57.592284+0000","last_became_active":"2024-09-10T07:37:56.612284+0000","last_became_peered":"2024-09-10T07:37:56.612284+0000","last_unstale":"2024-09-10T07:37:57.592284+0000","last_undegraded":"2024-09-10T07:37:57.592284+0000","last_fullsized":"2024-09-10T07:37:57.592284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.760218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"82'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592497+0000","last_change":"2024-09-10T07:37:55.602351+0000","last_active":"2024-09-10T07:37:57.592497+0000","last_peered":"2024-09-10T07:37:57.592497+0000","last_clean":"2024-09-10T07:37:57.592497+0000","last_became_active":"2024-09-10T07:37:55.601751+0000","last_became_peered":"2024-09-10T07:37:55.601751+0000","last_unstale":"2024-09-10T07:37:57.592497+0000","last_undegraded":"2024-09-10T07:37:57.592497+0000","last_fullsized":"2024-09-10T07:37:57.592497+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:30.708018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028401+0000","last_change":"2024-09-10T07:37:56.597458+0000","last_active":"2024-09-10T07:37:58.028401+0000","last_peered":"2024-09-10T07:37:58.028401+0000","last_clean":"2024-09-10T07:37:58.028401+0000","last_became_active":"2024-09-10T07:37:56.597223+0000","last_became_peered":"2024-09-10T07:37:56.597223+0000","last_unstale":"2024-09-10T07:37:58.028401+0000","last_undegraded":"2024-09-10T07:37:58.028401+0000","last_fullsized":"2024-09-10T07:37:58.028401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:44.766409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604452+0000","last_change":"2024-09-10T07:37:55.597007+0000","last_active":"2024-09-10T07:37:57.604452+0000","last_peered":"2024-09-10T07:37:57.604452+0000","last_clean":"2024-09-10T07:37:57.604452+0000","last_became_active":"2024-09-10T07:37:55.596787+0000","last_became_peered":"2024-09-10T07:37:55.596787+0000","last_unstale":"2024-09-10T07:37:57.604452+0000","last_undegraded":"2024-09-10T07:37:57.604452+0000","last_fullsized":"2024-09-10T07:37:57.604452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:13.821869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811465+0000","last_change":"2024-09-10T07:37:56.614736+0000","last_active":"2024-09-10T07:37:57.811465+0000","last_peered":"2024-09-10T07:37:57.811465+0000","last_clean":"2024-09-10T07:37:57.811465+0000","last_became_active":"2024-09-10T07:37:56.613804+0000","last_became_peered":"2024-09-10T07:37:56.613804+0000","last_unstale":"2024-09-10T07:37:57.811465+0000","last_undegraded":"2024-09-10T07:37:57.811465+0000","last_fullsized":"2024-09-10T07:37:57.811465+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:47.319942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811181+0000","last_change":"2024-09-10T07:37:55.602489+0000","last_active":"2024-09-10T07:37:57.811181+0000","last_peered":"2024-09-10T07:37:57.811181+0000","last_clean":"2024-09-10T07:37:57.811181+0000","last_became_active":"2024-09-10T07:37:55.602036+0000","last_became_peered":"2024-09-10T07:37:55.602036+0000","last_unstale":"2024-09-10T07:37:57.811181+0000","last_undegraded":"2024-09-10T07:37:57.811181+0000","last_fullsized":"2024-09-10T07:37:57.811181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:49.162462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592431+0000","last_change":"2024-09-10T07:37:56.608766+0000","last_active":"2024-09-10T07:37:57.592431+0000","last_peered":"2024-09-10T07:37:57.592431+0000","last_clean":"2024-09-10T07:37:57.592431+0000","last_became_active":"2024-09-10T07:37:56.608515+0000","last_became_peered":"2024-09-10T07:37:56.608515+0000","last_unstale":"2024-09-10T07:37:57.592431+0000","last_undegraded":"2024-09-10T07:37:57.592431+0000","last_fullsized":"2024-09-10T07:37:57.592431+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:42.523198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811718+0000","last_change":"2024-09-10T07:37:55.606554+0000","last_active":"2024-09-10T07:37:57.811718+0000","last_peered":"2024-09-10T07:37:57.811718+0000","last_clean":"2024-09-10T07:37:57.811718+0000","last_became_active":"2024-09-10T07:37:55.605865+0000","last_became_peered":"2024-09-10T07:37:55.605865+0000","last_unstale":"2024-09-10T07:37:57.811718+0000","last_undegraded":"2024-09-10T07:37:57.811718+0000","last_fullsized":"2024-09-10T07:37:57.811718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:47.712925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592721+0000","last_change":"2024-09-10T07:37:56.599854+0000","last_active":"2024-09-10T07:37:57.592721+0000","last_peered":"2024-09-10T07:37:57.592721+0000","last_clean":"2024-09-10T07:37:57.592721+0000","last_became_active":"2024-09-10T07:37:56.599606+0000","last_became_peered":"2024-09-10T07:37:56.599606+0000","last_unstale":"2024-09-10T07:37:57.592721+0000","last_undegraded":"2024-09-10T07:37:57.592721+0000","last_fullsized":"2024-09-10T07:37:57.592721+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.331672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591617+0000","last_change":"2024-09-10T07:37:55.597441+0000","last_active":"2024-09-10T07:37:57.591617+0000","last_peered":"2024-09-10T07:37:57.591617+0000","last_clean":"2024-09-10T07:37:57.591617+0000","last_became_active":"2024-09-10T07:37:55.597190+0000","last_became_peered":"2024-09-10T07:37:55.597190+0000","last_unstale":"2024-09-10T07:37:57.591617+0000","last_undegraded":"2024-09-10T07:37:57.591617+0000","last_fullsized":"2024-09-10T07:37:57.591617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:00.565014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810798+0000","last_change":"2024-09-10T07:37:56.615626+0000","last_active":"2024-09-10T07:37:57.810798+0000","last_peered":"2024-09-10T07:37:57.810798+0000","last_clean":"2024-09-10T07:37:57.810798+0000","last_became_active":"2024-09-10T07:37:56.615085+0000","last_became_peered":"2024-09-10T07:37:56.615085+0000","last_unstale":"2024-09-10T07:37:57.810798+0000","last_undegraded":"2024-09-10T07:37:57.810798+0000","last_fullsized":"2024-09-10T07:37:57.810798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:51.864517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810889+0000","last_change":"2024-09-10T07:37:55.600419+0000","last_active":"2024-09-10T07:37:57.810889+0000","last_peered":"2024-09-10T07:37:57.810889+0000","last_clean":"2024-09-10T07:37:57.810889+0000","last_became_active":"2024-09-10T07:37:55.600135+0000","last_became_peered":"2024-09-10T07:37:55.600135+0000","last_unstale":"2024-09-10T07:37:57.810889+0000","last_undegraded":"2024-09-10T07:37:57.810889+0000","last_fullsized":"2024-09-10T07:37:57.810889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:34.929427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028662+0000","last_change":"2024-09-10T07:37:56.602461+0000","last_active":"2024-09-10T07:37:58.028662+0000","last_peered":"2024-09-10T07:37:58.028662+0000","last_clean":"2024-09-10T07:37:58.028662+0000","last_became_active":"2024-09-10T07:37:56.602092+0000","last_became_peered":"2024-09-10T07:37:56.602092+0000","last_unstale":"2024-09-10T07:37:58.028662+0000","last_undegraded":"2024-09-10T07:37:58.028662+0000","last_fullsized":"2024-09-10T07:37:58.028662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:00.578496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.809991+0000","last_change":"2024-09-10T07:37:55.595419+0000","last_active":"2024-09-10T07:37:57.809991+0000","last_peered":"2024-09-10T07:37:57.809991+0000","last_clean":"2024-09-10T07:37:57.809991+0000","last_became_active":"2024-09-10T07:37:55.595293+0000","last_became_peered":"2024-09-10T07:37:55.595293+0000","last_unstale":"2024-09-10T07:37:57.809991+0000","last_undegraded":"2024-09-10T07:37:57.809991+0000","last_fullsized":"2024-09-10T07:37:57.809991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:05.506211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604305+0000","last_change":"2024-09-10T07:37:56.610499+0000","last_active":"2024-09-10T07:37:57.604305+0000","last_peered":"2024-09-10T07:37:57.604305+0000","last_clean":"2024-09-10T07:37:57.604305+0000","last_became_active":"2024-09-10T07:37:56.610250+0000","last_became_peered":"2024-09-10T07:37:56.610250+0000","last_unstale":"2024-09-10T07:37:57.604305+0000","last_undegraded":"2024-09-10T07:37:57.604305+0000","last_fullsized":"2024-09-10T07:37:57.604305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:01.910819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028791+0000","last_change":"2024-09-10T07:37:55.595550+0000","last_active":"2024-09-10T07:37:58.028791+0000","last_peered":"2024-09-10T07:37:58.028791+0000","last_clean":"2024-09-10T07:37:58.028791+0000","last_became_active":"2024-09-10T07:37:55.594216+0000","last_became_peered":"2024-09-10T07:37:55.594216+0000","last_unstale":"2024-09-10T07:37:58.028791+0000","last_undegraded":"2024-09-10T07:37:58.028791+0000","last_fullsized":"2024-09-10T07:37:58.028791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:35.187063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593025+0000","last_change":"2024-09-10T07:37:56.614290+0000","last_active":"2024-09-10T07:37:57.593025+0000","last_peered":"2024-09-10T07:37:57.593025+0000","last_clean":"2024-09-10T07:37:57.593025+0000","last_became_active":"2024-09-10T07:37:56.613974+0000","last_became_peered":"2024-09-10T07:37:56.613974+0000","last_unstale":"2024-09-10T07:37:57.593025+0000","last_undegraded":"2024-09-10T07:37:57.593025+0000","last_fullsized":"2024-09-10T07:37:57.593025+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:09.619129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810872+0000","last_change":"2024-09-10T07:37:55.595893+0000","last_active":"2024-09-10T07:37:57.810872+0000","last_peered":"2024-09-10T07:37:57.810872+0000","last_clean":"2024-09-10T07:37:57.810872+0000","last_became_active":"2024-09-10T07:37:55.595647+0000","last_became_peered":"2024-09-10T07:37:55.595647+0000","last_unstale":"2024-09-10T07:37:57.810872+0000","last_undegraded":"2024-09-10T07:37:57.810872+0000","last_fullsized":"2024-09-10T07:37:57.810872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:11.162735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592798+0000","last_change":"2024-09-10T07:37:56.620344+0000","last_active":"2024-09-10T07:37:57.592798+0000","last_peered":"2024-09-10T07:37:57.592798+0000","last_clean":"2024-09-10T07:37:57.592798+0000","last_became_active":"2024-09-10T07:37:56.619598+0000","last_became_peered":"2024-09-10T07:37:56.619598+0000","last_unstale":"2024-09-10T07:37:57.592798+0000","last_undegraded":"2024-09-10T07:37:57.592798+0000","last_fullsized":"2024-09-10T07:37:57.592798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:45:17.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810823+0000","last_change":"2024-09-10T07:37:55.605447+0000","last_active":"2024-09-10T07:37:57.810823+0000","last_peered":"2024-09-10T07:37:57.810823+0000","last_clean":"2024-09-10T07:37:57.810823+0000","last_became_active":"2024-09-10T07:37:55.604179+0000","last_became_peered":"2024-09-10T07:37:55.604179+0000","last_unstale":"2024-09-10T07:37:57.810823+0000","last_undegraded":"2024-09-10T07:37:57.810823+0000","last_fullsized":"2024-09-10T07:37:57.810823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:17.353585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811449+0000","last_change":"2024-09-10T07:37:56.605941+0000","last_active":"2024-09-10T07:37:57.811449+0000","last_peered":"2024-09-10T07:37:57.811449+0000","last_clean":"2024-09-10T07:37:57.811449+0000","last_became_active":"2024-09-10T07:37:56.602673+0000","last_became_peered":"2024-09-10T07:37:56.602673+0000","last_unstale":"2024-09-10T07:37:57.811449+0000","last_undegraded":"2024-09-10T07:37:57.811449+0000","last_fullsized":"2024-09-10T07:37:57.811449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:44.825937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"82'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591626+0000","last_change":"2024-09-10T07:37:55.599147+0000","last_active":"2024-09-10T07:37:57.591626+0000","last_peered":"2024-09-10T07:37:57.591626+0000","last_clean":"2024-09-10T07:37:57.591626+0000","last_became_active":"2024-09-10T07:37:55.598863+0000","last_became_peered":"2024-09-10T07:37:55.598863+0000","last_unstale":"2024-09-10T07:37:57.591626+0000","last_undegraded":"2024-09-10T07:37:57.591626+0000","last_fullsized":"2024-09-10T07:37:57.591626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:35.073964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028495+0000","last_change":"2024-09-10T07:37:56.601006+0000","last_active":"2024-09-10T07:37:58.028495+0000","last_peered":"2024-09-10T07:37:58.028495+0000","last_clean":"2024-09-10T07:37:58.028495+0000","last_became_active":"2024-09-10T07:37:56.600747+0000","last_became_peered":"2024-09-10T07:37:56.600747+0000","last_unstale":"2024-09-10T07:37:58.028495+0000","last_undegraded":"2024-09-10T07:37:58.028495+0000","last_fullsized":"2024-09-10T07:37:58.028495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:46.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"82'6","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810116+0000","last_change":"2024-09-10T07:37:55.592738+0000","last_active":"2024-09-10T07:37:57.810116+0000","last_peered":"2024-09-10T07:37:57.810116+0000","last_clean":"2024-09-10T07:37:57.810116+0000","last_became_active":"2024-09-10T07:37:55.592475+0000","last_became_peered":"2024-09-10T07:37:55.592475+0000","last_unstale":"2024-09-10T07:37:57.810116+0000","last_undegraded":"2024-09-10T07:37:57.810116+0000","last_fullsized":"2024-09-10T07:37:57.810116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:35.226476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592936+0000","last_change":"2024-09-10T07:37:56.620118+0000","last_active":"2024-09-10T07:37:57.592936+0000","last_peered":"2024-09-10T07:37:57.592936+0000","last_clean":"2024-09-10T07:37:57.592936+0000","last_became_active":"2024-09-10T07:37:56.619068+0000","last_became_peered":"2024-09-10T07:37:56.619068+0000","last_unstale":"2024-09-10T07:37:57.592936+0000","last_undegraded":"2024-09-10T07:37:57.592936+0000","last_fullsized":"2024-09-10T07:37:57.592936+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:43.179173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810044+0000","last_change":"2024-09-10T07:37:55.598389+0000","last_active":"2024-09-10T07:37:57.810044+0000","last_peered":"2024-09-10T07:37:57.810044+0000","last_clean":"2024-09-10T07:37:57.810044+0000","last_became_active":"2024-09-10T07:37:55.598164+0000","last_became_peered":"2024-09-10T07:37:55.598164+0000","last_unstale":"2024-09-10T07:37:57.810044+0000","last_undegraded":"2024-09-10T07:37:57.810044+0000","last_fullsized":"2024-09-10T07:37:57.810044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:45.679549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593660+0000","last_change":"2024-09-10T07:37:56.608386+0000","last_active":"2024-09-10T07:37:57.593660+0000","last_peered":"2024-09-10T07:37:57.593660+0000","last_clean":"2024-09-10T07:37:57.593660+0000","last_became_active":"2024-09-10T07:37:56.608122+0000","last_became_peered":"2024-09-10T07:37:56.608122+0000","last_unstale":"2024-09-10T07:37:57.593660+0000","last_undegraded":"2024-09-10T07:37:57.593660+0000","last_fullsized":"2024-09-10T07:37:57.593660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:45.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811805+0000","last_change":"2024-09-10T07:37:55.606404+0000","last_active":"2024-09-10T07:37:57.811805+0000","last_peered":"2024-09-10T07:37:57.811805+0000","last_clean":"2024-09-10T07:37:57.811805+0000","last_became_active":"2024-09-10T07:37:55.605690+0000","last_became_peered":"2024-09-10T07:37:55.605690+0000","last_unstale":"2024-09-10T07:37:57.811805+0000","last_undegraded":"2024-09-10T07:37:57.811805+0000","last_fullsized":"2024-09-10T07:37:57.811805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:49.373194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604524+0000","last_change":"2024-09-10T07:37:56.605620+0000","last_active":"2024-09-10T07:37:57.604524+0000","last_peered":"2024-09-10T07:37:57.604524+0000","last_clean":"2024-09-10T07:37:57.604524+0000","last_became_active":"2024-09-10T07:37:56.605109+0000","last_became_peered":"2024-09-10T07:37:56.605109+0000","last_unstale":"2024-09-10T07:37:57.604524+0000","last_undegraded":"2024-09-10T07:37:57.604524+0000","last_fullsized":"2024-09-10T07:37:57.604524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:18.879949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593280+0000","last_change":"2024-09-10T07:37:55.593782+0000","last_active":"2024-09-10T07:37:57.593280+0000","last_peered":"2024-09-10T07:37:57.593280+0000","last_clean":"2024-09-10T07:37:57.593280+0000","last_became_active":"2024-09-10T07:37:55.592628+0000","last_became_peered":"2024-09-10T07:37:55.592628+0000","last_unstale":"2024-09-10T07:37:57.593280+0000","last_undegraded":"2024-09-10T07:37:57.593280+0000","last_fullsized":"2024-09-10T07:37:57.593280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:47.824838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028610+0000","last_change":"2024-09-10T07:37:56.603219+0000","last_active":"2024-09-10T07:37:58.028610+0000","last_peered":"2024-09-10T07:37:58.028610+0000","last_clean":"2024-09-10T07:37:58.028610+0000","last_became_active":"2024-09-10T07:37:56.602265+0000","last_became_peered":"2024-09-10T07:37:56.602265+0000","last_unstale":"2024-09-10T07:37:58.028610+0000","last_undegraded":"2024-09-10T07:37:58.028610+0000","last_fullsized":"2024-09-10T07:37:58.028610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:15.154622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"82'8","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811008+0000","last_change":"2024-09-10T07:37:55.599733+0000","last_active":"2024-09-10T07:37:57.811008+0000","last_peered":"2024-09-10T07:37:57.811008+0000","last_clean":"2024-09-10T07:37:57.811008+0000","last_became_active":"2024-09-10T07:37:55.599325+0000","last_became_peered":"2024-09-10T07:37:55.599325+0000","last_unstale":"2024-09-10T07:37:57.811008+0000","last_undegraded":"2024-09-10T07:37:57.811008+0000","last_fullsized":"2024-09-10T07:37:57.811008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:30.996371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810983+0000","last_change":"2024-09-10T07:37:56.601215+0000","last_active":"2024-09-10T07:37:57.810983+0000","last_peered":"2024-09-10T07:37:57.810983+0000","last_clean":"2024-09-10T07:37:57.810983+0000","last_became_active":"2024-09-10T07:37:56.600962+0000","last_became_peered":"2024-09-10T07:37:56.600962+0000","last_unstale":"2024-09-10T07:37:57.810983+0000","last_undegraded":"2024-09-10T07:37:57.810983+0000","last_fullsized":"2024-09-10T07:37:57.810983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:40.488732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811511+0000","last_change":"2024-09-10T07:37:55.603931+0000","last_active":"2024-09-10T07:37:57.811511+0000","last_peered":"2024-09-10T07:37:57.811511+0000","last_clean":"2024-09-10T07:37:57.811511+0000","last_became_active":"2024-09-10T07:37:55.603083+0000","last_became_peered":"2024-09-10T07:37:55.603083+0000","last_unstale":"2024-09-10T07:37:57.811511+0000","last_undegraded":"2024-09-10T07:37:57.811511+0000","last_fullsized":"2024-09-10T07:37:57.811511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:30.653972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592458+0000","last_change":"2024-09-10T07:37:56.614073+0000","last_active":"2024-09-10T07:37:57.592458+0000","last_peered":"2024-09-10T07:37:57.592458+0000","last_clean":"2024-09-10T07:37:57.592458+0000","last_became_active":"2024-09-10T07:37:56.611636+0000","last_became_peered":"2024-09-10T07:37:56.611636+0000","last_unstale":"2024-09-10T07:37:57.592458+0000","last_undegraded":"2024-09-10T07:37:57.592458+0000","last_fullsized":"2024-09-10T07:37:57.592458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:51.828966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811287+0000","last_change":"2024-09-10T07:37:55.602276+0000","last_active":"2024-09-10T07:37:57.811287+0000","last_peered":"2024-09-10T07:37:57.811287+0000","last_clean":"2024-09-10T07:37:57.811287+0000","last_became_active":"2024-09-10T07:37:55.601672+0000","last_became_peered":"2024-09-10T07:37:55.601672+0000","last_unstale":"2024-09-10T07:37:57.811287+0000","last_undegraded":"2024-09-10T07:37:57.811287+0000","last_fullsized":"2024-09-10T07:37:57.811287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:47.747991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810025+0000","last_change":"2024-09-10T07:37:56.604071+0000","last_active":"2024-09-10T07:37:57.810025+0000","last_peered":"2024-09-10T07:37:57.810025+0000","last_clean":"2024-09-10T07:37:57.810025+0000","last_became_active":"2024-09-10T07:37:56.603554+0000","last_became_peered":"2024-09-10T07:37:56.603554+0000","last_unstale":"2024-09-10T07:37:57.810025+0000","last_undegraded":"2024-09-10T07:37:57.810025+0000","last_fullsized":"2024-09-10T07:37:57.810025+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:58.511252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811968+0000","last_change":"2024-09-10T07:37:55.606195+0000","last_active":"2024-09-10T07:37:57.811968+0000","last_peered":"2024-09-10T07:37:57.811968+0000","last_clean":"2024-09-10T07:37:57.811968+0000","last_became_active":"2024-09-10T07:37:55.605178+0000","last_became_peered":"2024-09-10T07:37:55.605178+0000","last_unstale":"2024-09-10T07:37:57.811968+0000","last_undegraded":"2024-09-10T07:37:57.811968+0000","last_fullsized":"2024-09-10T07:37:57.811968+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:45.873801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028607+0000","last_change":"2024-09-10T07:37:56.601469+0000","last_active":"2024-09-10T07:37:58.028607+0000","last_peered":"2024-09-10T07:37:58.028607+0000","last_clean":"2024-09-10T07:37:58.028607+0000","last_became_active":"2024-09-10T07:37:56.601250+0000","last_became_peered":"2024-09-10T07:37:56.601250+0000","last_unstale":"2024-09-10T07:37:58.028607+0000","last_undegraded":"2024-09-10T07:37:58.028607+0000","last_fullsized":"2024-09-10T07:37:58.028607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:49.615508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592345+0000","last_change":"2024-09-10T07:37:55.600043+0000","last_active":"2024-09-10T07:37:57.592345+0000","last_peered":"2024-09-10T07:37:57.592345+0000","last_clean":"2024-09-10T07:37:57.592345+0000","last_became_active":"2024-09-10T07:37:55.599095+0000","last_became_peered":"2024-09-10T07:37:55.599095+0000","last_unstale":"2024-09-10T07:37:57.592345+0000","last_undegraded":"2024-09-10T07:37:57.592345+0000","last_fullsized":"2024-09-10T07:37:57.592345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:06.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591520+0000","last_change":"2024-09-10T07:37:56.600548+0000","last_active":"2024-09-10T07:37:57.591520+0000","last_peered":"2024-09-10T07:37:57.591520+0000","last_clean":"2024-09-10T07:37:57.591520+0000","last_became_active":"2024-09-10T07:37:56.599455+0000","last_became_peered":"2024-09-10T07:37:56.599455+0000","last_unstale":"2024-09-10T07:37:57.591520+0000","last_undegraded":"2024-09-10T07:37:57.591520+0000","last_fullsized":"2024-09-10T07:37:57.591520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:57.015404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811567+0000","last_change":"2024-09-10T07:37:55.600766+0000","last_active":"2024-09-10T07:37:57.811567+0000","last_peered":"2024-09-10T07:37:57.811567+0000","last_clean":"2024-09-10T07:37:57.811567+0000","last_became_active":"2024-09-10T07:37:55.600169+0000","last_became_peered":"2024-09-10T07:37:55.600169+0000","last_unstale":"2024-09-10T07:37:57.811567+0000","last_undegraded":"2024-09-10T07:37:57.811567+0000","last_fullsized":"2024-09-10T07:37:57.811567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:36.246819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591290+0000","last_change":"2024-09-10T07:37:56.614499+0000","last_active":"2024-09-10T07:37:57.591290+0000","last_peered":"2024-09-10T07:37:57.591290+0000","last_clean":"2024-09-10T07:37:57.591290+0000","last_became_active":"2024-09-10T07:37:56.614324+0000","last_became_peered":"2024-09-10T07:37:56.614324+0000","last_unstale":"2024-09-10T07:37:57.591290+0000","last_undegraded":"2024-09-10T07:37:57.591290+0000","last_fullsized":"2024-09-10T07:37:57.591290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:05.492983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593761+0000","last_change":"2024-09-10T07:37:55.594872+0000","last_active":"2024-09-10T07:37:57.593761+0000","last_peered":"2024-09-10T07:37:57.593761+0000","last_clean":"2024-09-10T07:37:57.593761+0000","last_became_active":"2024-09-10T07:37:55.594570+0000","last_became_peered":"2024-09-10T07:37:55.594570+0000","last_unstale":"2024-09-10T07:37:57.593761+0000","last_undegraded":"2024-09-10T07:37:57.593761+0000","last_fullsized":"2024-09-10T07:37:57.593761+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:38.376410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591285+0000","last_change":"2024-09-10T07:37:56.611081+0000","last_active":"2024-09-10T07:37:57.591285+0000","last_peered":"2024-09-10T07:37:57.591285+0000","last_clean":"2024-09-10T07:37:57.591285+0000","last_became_active":"2024-09-10T07:37:56.610851+0000","last_became_peered":"2024-09-10T07:37:56.610851+0000","last_unstale":"2024-09-10T07:37:57.591285+0000","last_undegraded":"2024-09-10T07:37:57.591285+0000","last_fullsized":"2024-09-10T07:37:57.591285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:04.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604365+0000","last_change":"2024-09-10T07:37:55.597977+0000","last_active":"2024-09-10T07:37:57.604365+0000","last_peered":"2024-09-10T07:37:57.604365+0000","last_clean":"2024-09-10T07:37:57.604365+0000","last_became_active":"2024-09-10T07:37:55.597754+0000","last_became_peered":"2024-09-10T07:37:55.597754+0000","last_unstale":"2024-09-10T07:37:57.604365+0000","last_undegraded":"2024-09-10T07:37:57.604365+0000","last_fullsized":"2024-09-10T07:37:57.604365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:36.154248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604612+0000","last_change":"2024-09-10T07:37:56.594963+0000","last_active":"2024-09-10T07:37:57.604612+0000","last_peered":"2024-09-10T07:37:57.604612+0000","last_clean":"2024-09-10T07:37:57.604612+0000","last_became_active":"2024-09-10T07:37:56.594540+0000","last_became_peered":"2024-09-10T07:37:56.594540+0000","last_unstale":"2024-09-10T07:37:57.604612+0000","last_undegraded":"2024-09-10T07:37:57.604612+0000","last_fullsized":"2024-09-10T07:37:57.604612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:51.531831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811235+0000","last_change":"2024-09-10T07:37:55.605236+0000","last_active":"2024-09-10T07:37:57.811235+0000","last_peered":"2024-09-10T07:37:57.811235+0000","last_clean":"2024-09-10T07:37:57.811235+0000","last_became_active":"2024-09-10T07:37:55.603776+0000","last_became_peered":"2024-09-10T07:37:55.603776+0000","last_unstale":"2024-09-10T07:37:57.811235+0000","last_undegraded":"2024-09-10T07:37:57.811235+0000","last_fullsized":"2024-09-10T07:37:57.811235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:13.110897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593176+0000","last_change":"2024-09-10T07:37:56.601906+0000","last_active":"2024-09-10T07:37:57.593176+0000","last_peered":"2024-09-10T07:37:57.593176+0000","last_clean":"2024-09-10T07:37:57.593176+0000","last_became_active":"2024-09-10T07:37:56.601361+0000","last_became_peered":"2024-09-10T07:37:56.601361+0000","last_unstale":"2024-09-10T07:37:57.593176+0000","last_undegraded":"2024-09-10T07:37:57.593176+0000","last_fullsized":"2024-09-10T07:37:57.593176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:18.156253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"83'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604232+0000","last_change":"2024-09-10T07:37:55.591172+0000","last_active":"2024-09-10T07:37:57.604232+0000","last_peered":"2024-09-10T07:37:57.604232+0000","last_clean":"2024-09-10T07:37:57.604232+0000","last_became_active":"2024-09-10T07:37:55.590906+0000","last_became_peered":"2024-09-10T07:37:55.590906+0000","last_unstale":"2024-09-10T07:37:57.604232+0000","last_undegraded":"2024-09-10T07:37:57.604232+0000","last_fullsized":"2024-09-10T07:37:57.604232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:18.649500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592533+0000","last_change":"2024-09-10T07:37:56.619056+0000","last_active":"2024-09-10T07:37:57.592533+0000","last_peered":"2024-09-10T07:37:57.592533+0000","last_clean":"2024-09-10T07:37:57.592533+0000","last_became_active":"2024-09-10T07:37:56.618813+0000","last_became_peered":"2024-09-10T07:37:56.618813+0000","last_unstale":"2024-09-10T07:37:57.592533+0000","last_undegraded":"2024-09-10T07:37:57.592533+0000","last_fullsized":"2024-09-10T07:37:57.592533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:18.184701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028604+0000","last_change":"2024-09-10T07:37:55.591462+0000","last_active":"2024-09-10T07:37:58.028604+0000","last_peered":"2024-09-10T07:37:58.028604+0000","last_clean":"2024-09-10T07:37:58.028604+0000","last_became_active":"2024-09-10T07:37:55.590884+0000","last_became_peered":"2024-09-10T07:37:55.590884+0000","last_unstale":"2024-09-10T07:37:58.028604+0000","last_undegraded":"2024-09-10T07:37:58.028604+0000","last_fullsized":"2024-09-10T07:37:58.028604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:44.596971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592627+0000","last_change":"2024-09-10T07:37:56.617543+0000","last_active":"2024-09-10T07:37:57.592627+0000","last_peered":"2024-09-10T07:37:57.592627+0000","last_clean":"2024-09-10T07:37:57.592627+0000","last_became_active":"2024-09-10T07:37:56.617007+0000","last_became_peered":"2024-09-10T07:37:56.617007+0000","last_unstale":"2024-09-10T07:37:57.592627+0000","last_undegraded":"2024-09-10T07:37:57.592627+0000","last_fullsized":"2024-09-10T07:37:57.592627+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:22.061400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604563+0000","last_change":"2024-09-10T07:37:55.598221+0000","last_active":"2024-09-10T07:37:57.604563+0000","last_peered":"2024-09-10T07:37:57.604563+0000","last_clean":"2024-09-10T07:37:57.604563+0000","last_became_active":"2024-09-10T07:37:55.597736+0000","last_became_peered":"2024-09-10T07:37:55.597736+0000","last_unstale":"2024-09-10T07:37:57.604563+0000","last_undegraded":"2024-09-10T07:37:57.604563+0000","last_fullsized":"2024-09-10T07:37:57.604563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:10.829015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028701+0000","last_change":"2024-09-10T07:37:56.603484+0000","last_active":"2024-09-10T07:37:58.028701+0000","last_peered":"2024-09-10T07:37:58.028701+0000","last_clean":"2024-09-10T07:37:58.028701+0000","last_became_active":"2024-09-10T07:37:56.602544+0000","last_became_peered":"2024-09-10T07:37:56.602544+0000","last_unstale":"2024-09-10T07:37:58.028701+0000","last_undegraded":"2024-09-10T07:37:58.028701+0000","last_fullsized":"2024-09-10T07:37:58.028701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:48.486584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028747+0000","last_change":"2024-09-10T07:37:55.596985+0000","last_active":"2024-09-10T07:37:58.028747+0000","last_peered":"2024-09-10T07:37:58.028747+0000","last_clean":"2024-09-10T07:37:58.028747+0000","last_became_active":"2024-09-10T07:37:55.595462+0000","last_became_peered":"2024-09-10T07:37:55.595462+0000","last_unstale":"2024-09-10T07:37:58.028747+0000","last_undegraded":"2024-09-10T07:37:58.028747+0000","last_fullsized":"2024-09-10T07:37:58.028747+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:23.814599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811618+0000","last_change":"2024-09-10T07:37:56.614928+0000","last_active":"2024-09-10T07:37:57.811618+0000","last_peered":"2024-09-10T07:37:57.811618+0000","last_clean":"2024-09-10T07:37:57.811618+0000","last_became_active":"2024-09-10T07:37:56.614280+0000","last_became_peered":"2024-09-10T07:37:56.614280+0000","last_unstale":"2024-09-10T07:37:57.811618+0000","last_undegraded":"2024-09-10T07:37:57.811618+0000","last_fullsized":"2024-09-10T07:37:57.811618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:58.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810127+0000","last_change":"2024-09-10T07:37:55.596381+0000","last_active":"2024-09-10T07:37:57.810127+0000","last_peered":"2024-09-10T07:37:57.810127+0000","last_clean":"2024-09-10T07:37:57.810127+0000","last_became_active":"2024-09-10T07:37:55.596161+0000","last_became_peered":"2024-09-10T07:37:55.596161+0000","last_unstale":"2024-09-10T07:37:57.810127+0000","last_undegraded":"2024-09-10T07:37:57.810127+0000","last_fullsized":"2024-09-10T07:37:57.810127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:06.699739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.809934+0000","last_change":"2024-09-10T07:37:56.599312+0000","last_active":"2024-09-10T07:37:57.809934+0000","last_peered":"2024-09-10T07:37:57.809934+0000","last_clean":"2024-09-10T07:37:57.809934+0000","last_became_active":"2024-09-10T07:37:56.599032+0000","last_became_peered":"2024-09-10T07:37:56.599032+0000","last_unstale":"2024-09-10T07:37:57.809934+0000","last_undegraded":"2024-09-10T07:37:57.809934+0000","last_fullsized":"2024-09-10T07:37:57.809934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:43.188129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811105+0000","last_change":"2024-09-10T07:37:55.599549+0000","last_active":"2024-09-10T07:37:57.811105+0000","last_peered":"2024-09-10T07:37:57.811105+0000","last_clean":"2024-09-10T07:37:57.811105+0000","last_became_active":"2024-09-10T07:37:55.598938+0000","last_became_peered":"2024-09-10T07:37:55.598938+0000","last_unstale":"2024-09-10T07:37:57.811105+0000","last_undegraded":"2024-09-10T07:37:57.811105+0000","last_fullsized":"2024-09-10T07:37:57.811105+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:52.794172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810788+0000","last_change":"2024-09-10T07:37:56.605102+0000","last_active":"2024-09-10T07:37:57.810788+0000","last_peered":"2024-09-10T07:37:57.810788+0000","last_clean":"2024-09-10T07:37:57.810788+0000","last_became_active":"2024-09-10T07:37:56.604558+0000","last_became_peered":"2024-09-10T07:37:56.604558+0000","last_unstale":"2024-09-10T07:37:57.810788+0000","last_undegraded":"2024-09-10T07:37:57.810788+0000","last_fullsized":"2024-09-10T07:37:57.810788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:43.528112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811623+0000","last_change":"2024-09-10T07:37:55.603524+0000","last_active":"2024-09-10T07:37:57.811623+0000","last_peered":"2024-09-10T07:37:57.811623+0000","last_clean":"2024-09-10T07:37:57.811623+0000","last_became_active":"2024-09-10T07:37:55.602239+0000","last_became_peered":"2024-09-10T07:37:55.602239+0000","last_unstale":"2024-09-10T07:37:57.811623+0000","last_undegraded":"2024-09-10T07:37:57.811623+0000","last_fullsized":"2024-09-10T07:37:57.811623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:55.974205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591675+0000","last_change":"2024-09-10T07:37:56.606491+0000","last_active":"2024-09-10T07:37:57.591675+0000","last_peered":"2024-09-10T07:37:57.591675+0000","last_clean":"2024-09-10T07:37:57.591675+0000","last_became_active":"2024-09-10T07:37:56.606269+0000","last_became_peered":"2024-09-10T07:37:56.606269+0000","last_unstale":"2024-09-10T07:37:57.591675+0000","last_undegraded":"2024-09-10T07:37:57.591675+0000","last_fullsized":"2024-09-10T07:37:57.591675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:03.636941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811102+0000","last_change":"2024-09-10T07:37:55.603413+0000","last_active":"2024-09-10T07:37:57.811102+0000","last_peered":"2024-09-10T07:37:57.811102+0000","last_clean":"2024-09-10T07:37:57.811102+0000","last_became_active":"2024-09-10T07:37:55.603163+0000","last_became_peered":"2024-09-10T07:37:55.603163+0000","last_unstale":"2024-09-10T07:37:57.811102+0000","last_undegraded":"2024-09-10T07:37:57.811102+0000","last_fullsized":"2024-09-10T07:37:57.811102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:16.853456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":292,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592683+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:37:57.592683+0000","last_peered":"2024-09-10T07:37:57.592683+0000","last_clean":"2024-09-10T07:37:57.592683+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:37:57.592683+0000","last_undegraded":"2024-09-10T07:37:57.592683+0000","last_fullsized":"2024-09-10T07:37:57.592683+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:36.212328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969317,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194883,"statfs":{"total":200000000,"available":199560209,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194883,"statfs":{"total":200000000,"available":199560211,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194883,"statfs":{"total":200000000,"available":199560231,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194882,"statfs":{"total":200000000,"available":199560189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":424,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194887,"statfs":{"total":200000000,"available":199564989,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":431,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194880,"statfs":{"total":200000000,"available":199558073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1005,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198969933,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:38:00.889 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:38:01.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.078+0000 7fa9a8a00640 1 Processor -- start 2024-09-10T07:38:01.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.078+0000 7fa9a8a00640 1 -- start start 2024-09-10T07:38:01.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.079+0000 7fa9a8a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9a40cfae0 0x7fa9a40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.079+0000 7fa9a8a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa9a406d730 0x7fa9a40cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.079+0000 7fa9a8a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9a40cd1a0 con 0x7fa9a415ef80 2024-09-10T07:38:01.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.079+0000 7fa9a8a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa9a40cd7d0 con 0x7fa9a406d730 2024-09-10T07:38:01.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.079+0000 7fa9a8a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a406dc30 con 0x7fa9a40cfae0 2024-09-10T07:38:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.080+0000 7fa9a1e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fa9a415ef80 0x7fa9a40cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:41856/0 (socket says 172.21.15.99:41856) 2024-09-10T07:38:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.080+0000 7fa9a1e00640 1 -- 172.21.15.99:0/443650649 learned_addr learned my addr 172.21.15.99:0/443650649 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.080+0000 7fa9a1400640 1 --2- 172.21.15.99:0/443650649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9a40cfae0 0x7fa9a40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.080+0000 7fa9a2800640 1 --2- 172.21.15.99:0/443650649 >> v2:172.21.15.187:3300/0 conn(0x7fa9a406d730 0x7fa9a40cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.080+0000 7fa9a0a00640 1 -- 172.21.15.99:0/443650649 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940202216 0 0) 0x7fa9a40cd1a0 con 0x7fa9a415ef80 2024-09-10T07:38:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.080+0000 7fa9a0a00640 1 -- 172.21.15.99:0/443650649 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa988003520 con 0x7fa9a415ef80 2024-09-10T07:38:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.080+0000 7fa9a2800640 1 -- 172.21.15.99:0/443650649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9a40cfae0 msgr2=0x7fa9a40b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.080+0000 7fa9a2800640 1 --2- 172.21.15.99:0/443650649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9a40cfae0 0x7fa9a40b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.080+0000 7fa9a2800640 1 -- 172.21.15.99:0/443650649 >> v1:172.21.15.187:6789/0 conn(0x7fa9a415ef80 legacy=0x7fa9a40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.080+0000 7fa9a2800640 1 -- 172.21.15.99:0/443650649 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a406df10 con 0x7fa9a406d730 2024-09-10T07:38:01.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.081+0000 7fa9a2800640 1 --2- 172.21.15.99:0/443650649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9a406d730 0x7fa9a40cdc60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009d90 tx=0x7fa99c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=920b1be866806c0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:01.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a0a00640 1 -- 172.21.15.99:0/443650649 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c007740 con 0x7fa9a406d730 2024-09-10T07:38:01.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a0a00640 1 -- 172.21.15.99:0/443650649 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99c0078e0 con 0x7fa9a406d730 2024-09-10T07:38:01.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a0a00640 1 -- 172.21.15.99:0/443650649 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c007cb0 con 0x7fa9a406d730 2024-09-10T07:38:01.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a8a00640 1 -- 172.21.15.99:0/443650649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9a406d730 msgr2=0x7fa9a40cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a8a00640 1 --2- 172.21.15.99:0/443650649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9a406d730 0x7fa9a40cdc60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009d90 tx=0x7fa99c02a660 comp rx=0 tx=0).stop 2024-09-10T07:38:01.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a8a00640 1 -- 172.21.15.99:0/443650649 shutdown_connections 2024-09-10T07:38:01.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a8a00640 1 --2- 172.21.15.99:0/443650649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9a406d730 0x7fa9a40cdc60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a8a00640 1 --2- 172.21.15.99:0/443650649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9a40cfae0 0x7fa9a40b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a8a00640 1 -- 172.21.15.99:0/443650649 >> 172.21.15.99:0/443650649 conn(0x7fa9a40b4700 msgr2=0x7fa9a40b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:01.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a8a00640 1 -- 172.21.15.99:0/443650649 shutdown_connections 2024-09-10T07:38:01.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.082+0000 7fa9a8a00640 1 -- 172.21.15.99:0/443650649 wait complete. 2024-09-10T07:38:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.084+0000 7fa9a8a00640 1 Processor -- start 2024-09-10T07:38:01.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.084+0000 7fa9a8a00640 1 -- start start 2024-09-10T07:38:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a8a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9a406d730 0x7fa9a40c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a8a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9a40cfae0 0x7fa9a40b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a415ef80 0x7fa9a4157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a8a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a40d0120 con 0x7fa9a415ef80 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a8a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a415f360 con 0x7fa9a40cfae0 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a8a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a40ce1a0 con 0x7fa9a406d730 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a415ef80 0x7fa9a4157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a415ef80 0x7fa9a4157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35914/0 (socket says 172.21.15.99:35914) 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a2800640 1 -- 172.21.15.99:0/2198223060 learned_addr learned my addr 172.21.15.99:0/2198223060 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a1e00640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9a406d730 0x7fa9a40c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.085+0000 7fa9a1400640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9a40cfae0 0x7fa9a40b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa9a2800640 1 -- 172.21.15.99:0/2198223060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9a406d730 msgr2=0x7fa9a40c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa9a2800640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9a406d730 0x7fa9a40c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa9a2800640 1 -- 172.21.15.99:0/2198223060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9a40cfae0 msgr2=0x7fa9a40b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa9a2800640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9a40cfae0 0x7fa9a40b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa9a2800640 1 -- 172.21.15.99:0/2198223060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a4158780 con 0x7fa9a415ef80 2024-09-10T07:38:01.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa9a2800640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a415ef80 0x7fa9a4157da0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009eb0 tx=0x7fa99c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:01.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa99a000640 1 -- 172.21.15.99:0/2198223060 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c040070 con 0x7fa9a415ef80 2024-09-10T07:38:01.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa99a000640 1 -- 172.21.15.99:0/2198223060 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99c031bc0 con 0x7fa9a415ef80 2024-09-10T07:38:01.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa99a000640 1 -- 172.21.15.99:0/2198223060 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c009450 con 0x7fa9a415ef80 2024-09-10T07:38:01.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa9a8a00640 1 -- 172.21.15.99:0/2198223060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a41582e0 con 0x7fa9a415ef80 2024-09-10T07:38:01.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.086+0000 7fa9a8a00640 1 -- 172.21.15.99:0/2198223060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a40c8f80 con 0x7fa9a415ef80 2024-09-10T07:38:01.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.087+0000 7fa9a8a00640 1 -- 172.21.15.99:0/2198223060 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a40cdc60 con 0x7fa9a415ef80 2024-09-10T07:38:01.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.088+0000 7fa99a000640 1 -- 172.21.15.99:0/2198223060 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa99c039040 con 0x7fa9a415ef80 2024-09-10T07:38:01.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.089+0000 7fa99a000640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa98406be30 0x7fa98406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.089+0000 7fa99a000640 1 -- 172.21.15.99:0/2198223060 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fa99c0abed0 con 0x7fa9a415ef80 2024-09-10T07:38:01.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.089+0000 7fa9a1e00640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa98406be30 0x7fa98406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.090+0000 7fa9a1e00640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa98406be30 0x7fa98406e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa9940011e0 tx=0x7fa994009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:01.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.093+0000 7fa99a000640 1 -- 172.21.15.99:0/2198223060 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9a4158780 con 0x7fa9a415ef80 2024-09-10T07:38:01.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.264+0000 7fa9a8a00640 1 -- 172.21.15.99:0/2198223060 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9a40c7ce0 con 0x7fa98406be30 2024-09-10T07:38:01.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.270+0000 7fa99a000640 1 -- 172.21.15.99:0/2198223060 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247591 (secure 0 0 0) 0x7fa9a40c7ce0 con 0x7fa98406be30 2024-09-10T07:38:01.272 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:01.273 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:38:01.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.273+0000 7fa9a8a00640 1 -- 172.21.15.99:0/2198223060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa98406be30 msgr2=0x7fa98406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.273+0000 7fa9a8a00640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa98406be30 0x7fa98406e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa9940011e0 tx=0x7fa994009040 comp rx=0 tx=0).stop 2024-09-10T07:38:01.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.273+0000 7fa9a8a00640 1 -- 172.21.15.99:0/2198223060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a415ef80 msgr2=0x7fa9a4157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.273+0000 7fa9a8a00640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a415ef80 0x7fa9a4157da0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009eb0 tx=0x7fa99c004a40 comp rx=0 tx=0).stop 2024-09-10T07:38:01.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.273+0000 7fa9a8a00640 1 -- 172.21.15.99:0/2198223060 shutdown_connections 2024-09-10T07:38:01.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.273+0000 7fa9a8a00640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa98406be30 0x7fa98406e2f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.273+0000 7fa9a8a00640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9a415ef80 0x7fa9a4157da0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.273+0000 7fa9a8a00640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9a40cfae0 0x7fa9a40b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.273+0000 7fa9a8a00640 1 --2- 172.21.15.99:0/2198223060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9a406d730 0x7fa9a40c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.273+0000 7fa9a8a00640 1 -- 172.21.15.99:0/2198223060 >> 172.21.15.99:0/2198223060 conn(0x7fa9a40b4700 msgr2=0x7fa9a40cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:01.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.274+0000 7fa9a8a00640 1 -- 172.21.15.99:0/2198223060 shutdown_connections 2024-09-10T07:38:01.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.274+0000 7fa9a8a00640 1 -- 172.21.15.99:0/2198223060 wait complete. 2024-09-10T07:38:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-10T07:38:00.740296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4586,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557913,"statfs":{"total":1600000000,"available":1595303152,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001199"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592412+0000","last_change":"2024-09-10T07:37:56.612344+0000","last_active":"2024-09-10T07:37:57.592412+0000","last_peered":"2024-09-10T07:37:57.592412+0000","last_clean":"2024-09-10T07:37:57.592412+0000","last_became_active":"2024-09-10T07:37:56.612082+0000","last_became_peered":"2024-09-10T07:37:56.612082+0000","last_unstale":"2024-09-10T07:37:57.592412+0000","last_undegraded":"2024-09-10T07:37:57.592412+0000","last_fullsized":"2024-09-10T07:37:57.592412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:11.233346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810582+0000","last_change":"2024-09-10T07:37:56.606323+0000","last_active":"2024-09-10T07:37:57.810582+0000","last_peered":"2024-09-10T07:37:57.810582+0000","last_clean":"2024-09-10T07:37:57.810582+0000","last_became_active":"2024-09-10T07:37:56.602781+0000","last_became_peered":"2024-09-10T07:37:56.602781+0000","last_unstale":"2024-09-10T07:37:57.810582+0000","last_undegraded":"2024-09-10T07:37:57.810582+0000","last_fullsized":"2024-09-10T07:37:57.810582+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:52.165087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591381+0000","last_change":"2024-09-10T07:37:56.595700+0000","last_active":"2024-09-10T07:37:57.591381+0000","last_peered":"2024-09-10T07:37:57.591381+0000","last_clean":"2024-09-10T07:37:57.591381+0000","last_became_active":"2024-09-10T07:37:56.595426+0000","last_became_peered":"2024-09-10T07:37:56.595426+0000","last_unstale":"2024-09-10T07:37:57.591381+0000","last_undegraded":"2024-09-10T07:37:57.591381+0000","last_fullsized":"2024-09-10T07:37:57.591381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:36.670198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.809838+0000","last_change":"2024-09-10T07:37:56.610478+0000","last_active":"2024-09-10T07:37:57.809838+0000","last_peered":"2024-09-10T07:37:57.809838+0000","last_clean":"2024-09-10T07:37:57.809838+0000","last_became_active":"2024-09-10T07:37:56.610251+0000","last_became_peered":"2024-09-10T07:37:56.610251+0000","last_unstale":"2024-09-10T07:37:57.809838+0000","last_undegraded":"2024-09-10T07:37:57.809838+0000","last_fullsized":"2024-09-10T07:37:57.809838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:21.630124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028458+0000","last_change":"2024-09-10T07:37:56.605866+0000","last_active":"2024-09-10T07:37:58.028458+0000","last_peered":"2024-09-10T07:37:58.028458+0000","last_clean":"2024-09-10T07:37:58.028458+0000","last_became_active":"2024-09-10T07:37:56.605645+0000","last_became_peered":"2024-09-10T07:37:56.605645+0000","last_unstale":"2024-09-10T07:37:58.028458+0000","last_undegraded":"2024-09-10T07:37:58.028458+0000","last_fullsized":"2024-09-10T07:37:58.028458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:03.385145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811302+0000","last_change":"2024-09-10T07:37:56.614507+0000","last_active":"2024-09-10T07:37:57.811302+0000","last_peered":"2024-09-10T07:37:57.811302+0000","last_clean":"2024-09-10T07:37:57.811302+0000","last_became_active":"2024-09-10T07:37:56.613456+0000","last_became_peered":"2024-09-10T07:37:56.613456+0000","last_unstale":"2024-09-10T07:37:57.811302+0000","last_undegraded":"2024-09-10T07:37:57.811302+0000","last_fullsized":"2024-09-10T07:37:57.811302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:07.096843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592891+0000","last_change":"2024-09-10T07:37:56.612134+0000","last_active":"2024-09-10T07:37:57.592891+0000","last_peered":"2024-09-10T07:37:57.592891+0000","last_clean":"2024-09-10T07:37:57.592891+0000","last_became_active":"2024-09-10T07:37:56.601678+0000","last_became_peered":"2024-09-10T07:37:56.601678+0000","last_unstale":"2024-09-10T07:37:57.592891+0000","last_undegraded":"2024-09-10T07:37:57.592891+0000","last_fullsized":"2024-09-10T07:37:57.592891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:13.308783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810650+0000","last_change":"2024-09-10T07:37:56.604848+0000","last_active":"2024-09-10T07:37:57.810650+0000","last_peered":"2024-09-10T07:37:57.810650+0000","last_clean":"2024-09-10T07:37:57.810650+0000","last_became_active":"2024-09-10T07:37:56.604118+0000","last_became_peered":"2024-09-10T07:37:56.604118+0000","last_unstale":"2024-09-10T07:37:57.810650+0000","last_undegraded":"2024-09-10T07:37:57.810650+0000","last_fullsized":"2024-09-10T07:37:57.810650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:14.826407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028215+0000","last_change":"2024-09-10T07:37:56.600137+0000","last_active":"2024-09-10T07:37:58.028215+0000","last_peered":"2024-09-10T07:37:58.028215+0000","last_clean":"2024-09-10T07:37:58.028215+0000","last_became_active":"2024-09-10T07:37:56.599880+0000","last_became_peered":"2024-09-10T07:37:56.599880+0000","last_unstale":"2024-09-10T07:37:58.028215+0000","last_undegraded":"2024-09-10T07:37:58.028215+0000","last_fullsized":"2024-09-10T07:37:58.028215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:44.578003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810597+0000","last_change":"2024-09-10T07:37:56.609379+0000","last_active":"2024-09-10T07:37:57.810597+0000","last_peered":"2024-09-10T07:37:57.810597+0000","last_clean":"2024-09-10T07:37:57.810597+0000","last_became_active":"2024-09-10T07:37:56.607799+0000","last_became_peered":"2024-09-10T07:37:56.607799+0000","last_unstale":"2024-09-10T07:37:57.810597+0000","last_undegraded":"2024-09-10T07:37:57.810597+0000","last_fullsized":"2024-09-10T07:37:57.810597+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:01.430389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592657+0000","last_change":"2024-09-10T07:37:56.619924+0000","last_active":"2024-09-10T07:37:57.592657+0000","last_peered":"2024-09-10T07:37:57.592657+0000","last_clean":"2024-09-10T07:37:57.592657+0000","last_became_active":"2024-09-10T07:37:56.618716+0000","last_became_peered":"2024-09-10T07:37:56.618716+0000","last_unstale":"2024-09-10T07:37:57.592657+0000","last_undegraded":"2024-09-10T07:37:57.592657+0000","last_fullsized":"2024-09-10T07:37:57.592657+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:19.780491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.809930+0000","last_change":"2024-09-10T07:37:56.604923+0000","last_active":"2024-09-10T07:37:57.809930+0000","last_peered":"2024-09-10T07:37:57.809930+0000","last_clean":"2024-09-10T07:37:57.809930+0000","last_became_active":"2024-09-10T07:37:56.603862+0000","last_became_peered":"2024-09-10T07:37:56.603862+0000","last_unstale":"2024-09-10T07:37:57.809930+0000","last_undegraded":"2024-09-10T07:37:57.809930+0000","last_fullsized":"2024-09-10T07:37:57.809930+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:25.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604388+0000","last_change":"2024-09-10T07:37:56.605849+0000","last_active":"2024-09-10T07:37:57.604388+0000","last_peered":"2024-09-10T07:37:57.604388+0000","last_clean":"2024-09-10T07:37:57.604388+0000","last_became_active":"2024-09-10T07:37:56.605402+0000","last_became_peered":"2024-09-10T07:37:56.605402+0000","last_unstale":"2024-09-10T07:37:57.604388+0000","last_undegraded":"2024-09-10T07:37:57.604388+0000","last_fullsized":"2024-09-10T07:37:57.604388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:26:26.483721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028368+0000","last_change":"2024-09-10T07:37:56.613225+0000","last_active":"2024-09-10T07:37:58.028368+0000","last_peered":"2024-09-10T07:37:58.028368+0000","last_clean":"2024-09-10T07:37:58.028368+0000","last_became_active":"2024-09-10T07:37:56.612845+0000","last_became_peered":"2024-09-10T07:37:56.612845+0000","last_unstale":"2024-09-10T07:37:58.028368+0000","last_undegraded":"2024-09-10T07:37:58.028368+0000","last_fullsized":"2024-09-10T07:37:58.028368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:32.906246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604430+0000","last_change":"2024-09-10T07:37:56.597999+0000","last_active":"2024-09-10T07:37:57.604430+0000","last_peered":"2024-09-10T07:37:57.604430+0000","last_clean":"2024-09-10T07:37:57.604430+0000","last_became_active":"2024-09-10T07:37:56.597783+0000","last_became_peered":"2024-09-10T07:37:56.597783+0000","last_unstale":"2024-09-10T07:37:57.604430+0000","last_undegraded":"2024-09-10T07:37:57.604430+0000","last_fullsized":"2024-09-10T07:37:57.604430+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:54.109192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810730+0000","last_change":"2024-09-10T07:37:56.616478+0000","last_active":"2024-09-10T07:37:57.810730+0000","last_peered":"2024-09-10T07:37:57.810730+0000","last_clean":"2024-09-10T07:37:57.810730+0000","last_became_active":"2024-09-10T07:37:56.616262+0000","last_became_peered":"2024-09-10T07:37:56.616262+0000","last_unstale":"2024-09-10T07:37:57.810730+0000","last_undegraded":"2024-09-10T07:37:57.810730+0000","last_fullsized":"2024-09-10T07:37:57.810730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:39.356261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028473+0000","last_change":"2024-09-10T07:37:56.602921+0000","last_active":"2024-09-10T07:37:58.028473+0000","last_peered":"2024-09-10T07:37:58.028473+0000","last_clean":"2024-09-10T07:37:58.028473+0000","last_became_active":"2024-09-10T07:37:56.601934+0000","last_became_peered":"2024-09-10T07:37:56.601934+0000","last_unstale":"2024-09-10T07:37:58.028473+0000","last_undegraded":"2024-09-10T07:37:58.028473+0000","last_fullsized":"2024-09-10T07:37:58.028473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:18.932854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810005+0000","last_change":"2024-09-10T07:37:56.610429+0000","last_active":"2024-09-10T07:37:57.810005+0000","last_peered":"2024-09-10T07:37:57.810005+0000","last_clean":"2024-09-10T07:37:57.810005+0000","last_became_active":"2024-09-10T07:37:56.610127+0000","last_became_peered":"2024-09-10T07:37:56.610127+0000","last_unstale":"2024-09-10T07:37:57.810005+0000","last_undegraded":"2024-09-10T07:37:57.810005+0000","last_fullsized":"2024-09-10T07:37:57.810005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:29.359346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811354+0000","last_change":"2024-09-10T07:37:56.606308+0000","last_active":"2024-09-10T07:37:57.811354+0000","last_peered":"2024-09-10T07:37:57.811354+0000","last_clean":"2024-09-10T07:37:57.811354+0000","last_became_active":"2024-09-10T07:37:56.605055+0000","last_became_peered":"2024-09-10T07:37:56.605055+0000","last_unstale":"2024-09-10T07:37:57.811354+0000","last_undegraded":"2024-09-10T07:37:57.811354+0000","last_fullsized":"2024-09-10T07:37:57.811354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:13.603935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604506+0000","last_change":"2024-09-10T07:37:56.593624+0000","last_active":"2024-09-10T07:37:57.604506+0000","last_peered":"2024-09-10T07:37:57.604506+0000","last_clean":"2024-09-10T07:37:57.604506+0000","last_became_active":"2024-09-10T07:37:56.593251+0000","last_became_peered":"2024-09-10T07:37:56.593251+0000","last_unstale":"2024-09-10T07:37:57.604506+0000","last_undegraded":"2024-09-10T07:37:57.604506+0000","last_fullsized":"2024-09-10T07:37:57.604506+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:39.128529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810507+0000","last_change":"2024-09-10T07:37:56.602596+0000","last_active":"2024-09-10T07:37:57.810507+0000","last_peered":"2024-09-10T07:37:57.810507+0000","last_clean":"2024-09-10T07:37:57.810507+0000","last_became_active":"2024-09-10T07:37:56.601224+0000","last_became_peered":"2024-09-10T07:37:56.601224+0000","last_unstale":"2024-09-10T07:37:57.810507+0000","last_undegraded":"2024-09-10T07:37:57.810507+0000","last_fullsized":"2024-09-10T07:37:57.810507+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:31.062877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810624+0000","last_change":"2024-09-10T07:37:56.605546+0000","last_active":"2024-09-10T07:37:57.810624+0000","last_peered":"2024-09-10T07:37:57.810624+0000","last_clean":"2024-09-10T07:37:57.810624+0000","last_became_active":"2024-09-10T07:37:56.605109+0000","last_became_peered":"2024-09-10T07:37:56.605109+0000","last_unstale":"2024-09-10T07:37:57.810624+0000","last_undegraded":"2024-09-10T07:37:57.810624+0000","last_fullsized":"2024-09-10T07:37:57.810624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:09.545662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592380+0000","last_change":"2024-09-10T07:37:56.616973+0000","last_active":"2024-09-10T07:37:57.592380+0000","last_peered":"2024-09-10T07:37:57.592380+0000","last_clean":"2024-09-10T07:37:57.592380+0000","last_became_active":"2024-09-10T07:37:56.616729+0000","last_became_peered":"2024-09-10T07:37:56.616729+0000","last_unstale":"2024-09-10T07:37:57.592380+0000","last_undegraded":"2024-09-10T07:37:57.592380+0000","last_fullsized":"2024-09-10T07:37:57.592380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:53.962308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592074+0000","last_change":"2024-09-10T07:37:56.615513+0000","last_active":"2024-09-10T07:37:57.592074+0000","last_peered":"2024-09-10T07:37:57.592074+0000","last_clean":"2024-09-10T07:37:57.592074+0000","last_became_active":"2024-09-10T07:37:56.611951+0000","last_became_peered":"2024-09-10T07:37:56.611951+0000","last_unstale":"2024-09-10T07:37:57.592074+0000","last_undegraded":"2024-09-10T07:37:57.592074+0000","last_fullsized":"2024-09-10T07:37:57.592074+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:55.066132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810735+0000","last_change":"2024-09-10T07:37:56.609590+0000","last_active":"2024-09-10T07:37:57.810735+0000","last_peered":"2024-09-10T07:37:57.810735+0000","last_clean":"2024-09-10T07:37:57.810735+0000","last_became_active":"2024-09-10T07:37:56.609159+0000","last_became_peered":"2024-09-10T07:37:56.609159+0000","last_unstale":"2024-09-10T07:37:57.810735+0000","last_undegraded":"2024-09-10T07:37:57.810735+0000","last_fullsized":"2024-09-10T07:37:57.810735+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:45.486394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593021+0000","last_change":"2024-09-10T07:37:56.615774+0000","last_active":"2024-09-10T07:37:57.593021+0000","last_peered":"2024-09-10T07:37:57.593021+0000","last_clean":"2024-09-10T07:37:57.593021+0000","last_became_active":"2024-09-10T07:37:56.615543+0000","last_became_peered":"2024-09-10T07:37:56.615543+0000","last_unstale":"2024-09-10T07:37:57.593021+0000","last_undegraded":"2024-09-10T07:37:57.593021+0000","last_fullsized":"2024-09-10T07:37:57.593021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:19.017998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591464+0000","last_change":"2024-09-10T07:37:56.604021+0000","last_active":"2024-09-10T07:37:57.591464+0000","last_peered":"2024-09-10T07:37:57.591464+0000","last_clean":"2024-09-10T07:37:57.591464+0000","last_became_active":"2024-09-10T07:37:56.603641+0000","last_became_peered":"2024-09-10T07:37:56.603641+0000","last_unstale":"2024-09-10T07:37:57.591464+0000","last_undegraded":"2024-09-10T07:37:57.591464+0000","last_fullsized":"2024-09-10T07:37:57.591464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:24.787824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810321+0000","last_change":"2024-09-10T07:37:56.597772+0000","last_active":"2024-09-10T07:37:57.810321+0000","last_peered":"2024-09-10T07:37:57.810321+0000","last_clean":"2024-09-10T07:37:57.810321+0000","last_became_active":"2024-09-10T07:37:56.597510+0000","last_became_peered":"2024-09-10T07:37:56.597510+0000","last_unstale":"2024-09-10T07:37:57.810321+0000","last_undegraded":"2024-09-10T07:37:57.810321+0000","last_fullsized":"2024-09-10T07:37:57.810321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:50.208867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591566+0000","last_change":"2024-09-10T07:37:56.601381+0000","last_active":"2024-09-10T07:37:57.591566+0000","last_peered":"2024-09-10T07:37:57.591566+0000","last_clean":"2024-09-10T07:37:57.591566+0000","last_became_active":"2024-09-10T07:37:56.600951+0000","last_became_peered":"2024-09-10T07:37:56.600951+0000","last_unstale":"2024-09-10T07:37:57.591566+0000","last_undegraded":"2024-09-10T07:37:57.591566+0000","last_fullsized":"2024-09-10T07:37:57.591566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:25.639087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593523+0000","last_change":"2024-09-10T07:37:56.614259+0000","last_active":"2024-09-10T07:37:57.593523+0000","last_peered":"2024-09-10T07:37:57.593523+0000","last_clean":"2024-09-10T07:37:57.593523+0000","last_became_active":"2024-09-10T07:37:56.613997+0000","last_became_peered":"2024-09-10T07:37:56.613997+0000","last_unstale":"2024-09-10T07:37:57.593523+0000","last_undegraded":"2024-09-10T07:37:57.593523+0000","last_fullsized":"2024-09-10T07:37:57.593523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:04.920761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593202+0000","last_change":"2024-09-10T07:37:56.595451+0000","last_active":"2024-09-10T07:37:57.593202+0000","last_peered":"2024-09-10T07:37:57.593202+0000","last_clean":"2024-09-10T07:37:57.593202+0000","last_became_active":"2024-09-10T07:37:56.595216+0000","last_became_peered":"2024-09-10T07:37:56.595216+0000","last_unstale":"2024-09-10T07:37:57.593202+0000","last_undegraded":"2024-09-10T07:37:57.593202+0000","last_fullsized":"2024-09-10T07:37:57.593202+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:35.380928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810731+0000","last_change":"2024-09-10T07:37:56.608263+0000","last_active":"2024-09-10T07:37:57.810731+0000","last_peered":"2024-09-10T07:37:57.810731+0000","last_clean":"2024-09-10T07:37:57.810731+0000","last_became_active":"2024-09-10T07:37:56.604867+0000","last_became_peered":"2024-09-10T07:37:56.604867+0000","last_unstale":"2024-09-10T07:37:57.810731+0000","last_undegraded":"2024-09-10T07:37:57.810731+0000","last_fullsized":"2024-09-10T07:37:57.810731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:12.250882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592284+0000","last_change":"2024-09-10T07:37:56.615736+0000","last_active":"2024-09-10T07:37:57.592284+0000","last_peered":"2024-09-10T07:37:57.592284+0000","last_clean":"2024-09-10T07:37:57.592284+0000","last_became_active":"2024-09-10T07:37:56.612284+0000","last_became_peered":"2024-09-10T07:37:56.612284+0000","last_unstale":"2024-09-10T07:37:57.592284+0000","last_undegraded":"2024-09-10T07:37:57.592284+0000","last_fullsized":"2024-09-10T07:37:57.592284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.760218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"82'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592497+0000","last_change":"2024-09-10T07:37:55.602351+0000","last_active":"2024-09-10T07:37:57.592497+0000","last_peered":"2024-09-10T07:37:57.592497+0000","last_clean":"2024-09-10T07:37:57.592497+0000","last_became_active":"2024-09-10T07:37:55.601751+0000","last_became_peered":"2024-09-10T07:37:55.601751+0000","last_unstale":"2024-09-10T07:37:57.592497+0000","last_undegraded":"2024-09-10T07:37:57.592497+0000","last_fullsized":"2024-09-10T07:37:57.592497+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:30.708018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028401+0000","last_change":"2024-09-10T07:37:56.597458+0000","last_active":"2024-09-10T07:37:58.028401+0000","last_peered":"2024-09-10T07:37:58.028401+0000","last_clean":"2024-09-10T07:37:58.028401+0000","last_became_active":"2024-09-10T07:37:56.597223+0000","last_became_peered":"2024-09-10T07:37:56.597223+0000","last_unstale":"2024-09-10T07:37:58.028401+0000","last_undegraded":"2024-09-10T07:37:58.028401+0000","last_fullsized":"2024-09-10T07:37:58.028401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:44.766409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604452+0000","last_change":"2024-09-10T07:37:55.597007+0000","last_active":"2024-09-10T07:37:57.604452+0000","last_peered":"2024-09-10T07:37:57.604452+0000","last_clean":"2024-09-10T07:37:57.604452+0000","last_became_active":"2024-09-10T07:37:55.596787+0000","last_became_peered":"2024-09-10T07:37:55.596787+0000","last_unstale":"2024-09-10T07:37:57.604452+0000","last_undegraded":"2024-09-10T07:37:57.604452+0000","last_fullsized":"2024-09-10T07:37:57.604452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:13.821869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811465+0000","last_change":"2024-09-10T07:37:56.614736+0000","last_active":"2024-09-10T07:37:57.811465+0000","last_peered":"2024-09-10T07:37:57.811465+0000","last_clean":"2024-09-10T07:37:57.811465+0000","last_became_active":"2024-09-10T07:37:56.613804+0000","last_became_peered":"2024-09-10T07:37:56.613804+0000","last_unstale":"2024-09-10T07:37:57.811465+0000","last_undegraded":"2024-09-10T07:37:57.811465+0000","last_fullsized":"2024-09-10T07:37:57.811465+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:47.319942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811181+0000","last_change":"2024-09-10T07:37:55.602489+0000","last_active":"2024-09-10T07:37:57.811181+0000","last_peered":"2024-09-10T07:37:57.811181+0000","last_clean":"2024-09-10T07:37:57.811181+0000","last_became_active":"2024-09-10T07:37:55.602036+0000","last_became_peered":"2024-09-10T07:37:55.602036+0000","last_unstale":"2024-09-10T07:37:57.811181+0000","last_undegraded":"2024-09-10T07:37:57.811181+0000","last_fullsized":"2024-09-10T07:37:57.811181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:49.162462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592431+0000","last_change":"2024-09-10T07:37:56.608766+0000","last_active":"2024-09-10T07:37:57.592431+0000","last_peered":"2024-09-10T07:37:57.592431+0000","last_clean":"2024-09-10T07:37:57.592431+0000","last_became_active":"2024-09-10T07:37:56.608515+0000","last_became_peered":"2024-09-10T07:37:56.608515+0000","last_unstale":"2024-09-10T07:37:57.592431+0000","last_undegraded":"2024-09-10T07:37:57.592431+0000","last_fullsized":"2024-09-10T07:37:57.592431+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:42.523198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811718+0000","last_change":"2024-09-10T07:37:55.606554+0000","last_active":"2024-09-10T07:37:57.811718+0000","last_peered":"2024-09-10T07:37:57.811718+0000","last_clean":"2024-09-10T07:37:57.811718+0000","last_became_active":"2024-09-10T07:37:55.605865+0000","last_became_peered":"2024-09-10T07:37:55.605865+0000","last_unstale":"2024-09-10T07:37:57.811718+0000","last_undegraded":"2024-09-10T07:37:57.811718+0000","last_fullsized":"2024-09-10T07:37:57.811718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:47.712925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592721+0000","last_change":"2024-09-10T07:37:56.599854+0000","last_active":"2024-09-10T07:37:57.592721+0000","last_peered":"2024-09-10T07:37:57.592721+0000","last_clean":"2024-09-10T07:37:57.592721+0000","last_became_active":"2024-09-10T07:37:56.599606+0000","last_became_peered":"2024-09-10T07:37:56.599606+0000","last_unstale":"2024-09-10T07:37:57.592721+0000","last_undegraded":"2024-09-10T07:37:57.592721+0000","last_fullsized":"2024-09-10T07:37:57.592721+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.331672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591617+0000","last_change":"2024-09-10T07:37:55.597441+0000","last_active":"2024-09-10T07:37:57.591617+0000","last_peered":"2024-09-10T07:37:57.591617+0000","last_clean":"2024-09-10T07:37:57.591617+0000","last_became_active":"2024-09-10T07:37:55.597190+0000","last_became_peered":"2024-09-10T07:37:55.597190+0000","last_unstale":"2024-09-10T07:37:57.591617+0000","last_undegraded":"2024-09-10T07:37:57.591617+0000","last_fullsized":"2024-09-10T07:37:57.591617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:00.565014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810798+0000","last_change":"2024-09-10T07:37:56.615626+0000","last_active":"2024-09-10T07:37:57.810798+0000","last_peered":"2024-09-10T07:37:57.810798+0000","last_clean":"2024-09-10T07:37:57.810798+0000","last_became_active":"2024-09-10T07:37:56.615085+0000","last_became_peered":"2024-09-10T07:37:56.615085+0000","last_unstale":"2024-09-10T07:37:57.810798+0000","last_undegraded":"2024-09-10T07:37:57.810798+0000","last_fullsized":"2024-09-10T07:37:57.810798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:51.864517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810889+0000","last_change":"2024-09-10T07:37:55.600419+0000","last_active":"2024-09-10T07:37:57.810889+0000","last_peered":"2024-09-10T07:37:57.810889+0000","last_clean":"2024-09-10T07:37:57.810889+0000","last_became_active":"2024-09-10T07:37:55.600135+0000","last_became_peered":"2024-09-10T07:37:55.600135+0000","last_unstale":"2024-09-10T07:37:57.810889+0000","last_undegraded":"2024-09-10T07:37:57.810889+0000","last_fullsized":"2024-09-10T07:37:57.810889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:34.929427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028662+0000","last_change":"2024-09-10T07:37:56.602461+0000","last_active":"2024-09-10T07:37:58.028662+0000","last_peered":"2024-09-10T07:37:58.028662+0000","last_clean":"2024-09-10T07:37:58.028662+0000","last_became_active":"2024-09-10T07:37:56.602092+0000","last_became_peered":"2024-09-10T07:37:56.602092+0000","last_unstale":"2024-09-10T07:37:58.028662+0000","last_undegraded":"2024-09-10T07:37:58.028662+0000","last_fullsized":"2024-09-10T07:37:58.028662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:00.578496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.809991+0000","last_change":"2024-09-10T07:37:55.595419+0000","last_active":"2024-09-10T07:37:57.809991+0000","last_peered":"2024-09-10T07:37:57.809991+0000","last_clean":"2024-09-10T07:37:57.809991+0000","last_became_active":"2024-09-10T07:37:55.595293+0000","last_became_peered":"2024-09-10T07:37:55.595293+0000","last_unstale":"2024-09-10T07:37:57.809991+0000","last_undegraded":"2024-09-10T07:37:57.809991+0000","last_fullsized":"2024-09-10T07:37:57.809991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:05.506211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604305+0000","last_change":"2024-09-10T07:37:56.610499+0000","last_active":"2024-09-10T07:37:57.604305+0000","last_peered":"2024-09-10T07:37:57.604305+0000","last_clean":"2024-09-10T07:37:57.604305+0000","last_became_active":"2024-09-10T07:37:56.610250+0000","last_became_peered":"2024-09-10T07:37:56.610250+0000","last_unstale":"2024-09-10T07:37:57.604305+0000","last_undegraded":"2024-09-10T07:37:57.604305+0000","last_fullsized":"2024-09-10T07:37:57.604305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:01.910819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028791+0000","last_change":"2024-09-10T07:37:55.595550+0000","last_active":"2024-09-10T07:37:58.028791+0000","last_peered":"2024-09-10T07:37:58.028791+0000","last_clean":"2024-09-10T07:37:58.028791+0000","last_became_active":"2024-09-10T07:37:55.594216+0000","last_became_peered":"2024-09-10T07:37:55.594216+0000","last_unstale":"2024-09-10T07:37:58.028791+0000","last_undegraded":"2024-09-10T07:37:58.028791+0000","last_fullsized":"2024-09-10T07:37:58.028791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:35.187063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593025+0000","last_change":"2024-09-10T07:37:56.614290+0000","last_active":"2024-09-10T07:37:57.593025+0000","last_peered":"2024-09-10T07:37:57.593025+0000","last_clean":"2024-09-10T07:37:57.593025+0000","last_became_active":"2024-09-10T07:37:56.613974+0000","last_became_peered":"2024-09-10T07:37:56.613974+0000","last_unstale":"2024-09-10T07:37:57.593025+0000","last_undegraded":"2024-09-10T07:37:57.593025+0000","last_fullsized":"2024-09-10T07:37:57.593025+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:09.619129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810872+0000","last_change":"2024-09-10T07:37:55.595893+0000","last_active":"2024-09-10T07:37:57.810872+0000","last_peered":"2024-09-10T07:37:57.810872+0000","last_clean":"2024-09-10T07:37:57.810872+0000","last_became_active":"2024-09-10T07:37:55.595647+0000","last_became_peered":"2024-09-10T07:37:55.595647+0000","last_unstale":"2024-09-10T07:37:57.810872+0000","last_undegraded":"2024-09-10T07:37:57.810872+0000","last_fullsized":"2024-09-10T07:37:57.810872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:11.162735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592798+0000","last_change":"2024-09-10T07:37:56.620344+0000","last_active":"2024-09-10T07:37:57.592798+0000","last_peered":"2024-09-10T07:37:57.592798+0000","last_clean":"2024-09-10T07:37:57.592798+0000","last_became_active":"2024-09-10T07:37:56.619598+0000","last_became_peered":"2024-09-10T07:37:56.619598+0000","last_unstale":"2024-09-10T07:37:57.592798+0000","last_undegraded":"2024-09-10T07:37:57.592798+0000","last_fullsized":"2024-09-10T07:37:57.592798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:45:17.876430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810823+0000","last_change":"2024-09-10T07:37:55.605447+0000","last_active":"2024-09-10T07:37:57.810823+0000","last_peered":"2024-09-10T07:37:57.810823+0000","last_clean":"2024-09-10T07:37:57.810823+0000","last_became_active":"2024-09-10T07:37:55.604179+0000","last_became_peered":"2024-09-10T07:37:55.604179+0000","last_unstale":"2024-09-10T07:37:57.810823+0000","last_undegraded":"2024-09-10T07:37:57.810823+0000","last_fullsized":"2024-09-10T07:37:57.810823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:17.353585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811449+0000","last_change":"2024-09-10T07:37:56.605941+0000","last_active":"2024-09-10T07:37:57.811449+0000","last_peered":"2024-09-10T07:37:57.811449+0000","last_clean":"2024-09-10T07:37:57.811449+0000","last_became_active":"2024-09-10T07:37:56.602673+0000","last_became_peered":"2024-09-10T07:37:56.602673+0000","last_unstale":"2024-09-10T07:37:57.811449+0000","last_undegraded":"2024-09-10T07:37:57.811449+0000","last_fullsized":"2024-09-10T07:37:57.811449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:44.825937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"82'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591626+0000","last_change":"2024-09-10T07:37:55.599147+0000","last_active":"2024-09-10T07:37:57.591626+0000","last_peered":"2024-09-10T07:37:57.591626+0000","last_clean":"2024-09-10T07:37:57.591626+0000","last_became_active":"2024-09-10T07:37:55.598863+0000","last_became_peered":"2024-09-10T07:37:55.598863+0000","last_unstale":"2024-09-10T07:37:57.591626+0000","last_undegraded":"2024-09-10T07:37:57.591626+0000","last_fullsized":"2024-09-10T07:37:57.591626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:35.073964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028495+0000","last_change":"2024-09-10T07:37:56.601006+0000","last_active":"2024-09-10T07:37:58.028495+0000","last_peered":"2024-09-10T07:37:58.028495+0000","last_clean":"2024-09-10T07:37:58.028495+0000","last_became_active":"2024-09-10T07:37:56.600747+0000","last_became_peered":"2024-09-10T07:37:56.600747+0000","last_unstale":"2024-09-10T07:37:58.028495+0000","last_undegraded":"2024-09-10T07:37:58.028495+0000","last_fullsized":"2024-09-10T07:37:58.028495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:46.369410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"82'6","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810116+0000","last_change":"2024-09-10T07:37:55.592738+0000","last_active":"2024-09-10T07:37:57.810116+0000","last_peered":"2024-09-10T07:37:57.810116+0000","last_clean":"2024-09-10T07:37:57.810116+0000","last_became_active":"2024-09-10T07:37:55.592475+0000","last_became_peered":"2024-09-10T07:37:55.592475+0000","last_unstale":"2024-09-10T07:37:57.810116+0000","last_undegraded":"2024-09-10T07:37:57.810116+0000","last_fullsized":"2024-09-10T07:37:57.810116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:35.226476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592936+0000","last_change":"2024-09-10T07:37:56.620118+0000","last_active":"2024-09-10T07:37:57.592936+0000","last_peered":"2024-09-10T07:37:57.592936+0000","last_clean":"2024-09-10T07:37:57.592936+0000","last_became_active":"2024-09-10T07:37:56.619068+0000","last_became_peered":"2024-09-10T07:37:56.619068+0000","last_unstale":"2024-09-10T07:37:57.592936+0000","last_undegraded":"2024-09-10T07:37:57.592936+0000","last_fullsized":"2024-09-10T07:37:57.592936+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:43.179173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810044+0000","last_change":"2024-09-10T07:37:55.598389+0000","last_active":"2024-09-10T07:37:57.810044+0000","last_peered":"2024-09-10T07:37:57.810044+0000","last_clean":"2024-09-10T07:37:57.810044+0000","last_became_active":"2024-09-10T07:37:55.598164+0000","last_became_peered":"2024-09-10T07:37:55.598164+0000","last_unstale":"2024-09-10T07:37:57.810044+0000","last_undegraded":"2024-09-10T07:37:57.810044+0000","last_fullsized":"2024-09-10T07:37:57.810044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:45.679549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593660+0000","last_change":"2024-09-10T07:37:56.608386+0000","last_active":"2024-09-10T07:37:57.593660+0000","last_peered":"2024-09-10T07:37:57.593660+0000","last_clean":"2024-09-10T07:37:57.593660+0000","last_became_active":"2024-09-10T07:37:56.608122+0000","last_became_peered":"2024-09-10T07:37:56.608122+0000","last_unstale":"2024-09-10T07:37:57.593660+0000","last_undegraded":"2024-09-10T07:37:57.593660+0000","last_fullsized":"2024-09-10T07:37:57.593660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:45.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811805+0000","last_change":"2024-09-10T07:37:55.606404+0000","last_active":"2024-09-10T07:37:57.811805+0000","last_peered":"2024-09-10T07:37:57.811805+0000","last_clean":"2024-09-10T07:37:57.811805+0000","last_became_active":"2024-09-10T07:37:55.605690+0000","last_became_peered":"2024-09-10T07:37:55.605690+0000","last_unstale":"2024-09-10T07:37:57.811805+0000","last_undegraded":"2024-09-10T07:37:57.811805+0000","last_fullsized":"2024-09-10T07:37:57.811805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:49.373194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604524+0000","last_change":"2024-09-10T07:37:56.605620+0000","last_active":"2024-09-10T07:37:57.604524+0000","last_peered":"2024-09-10T07:37:57.604524+0000","last_clean":"2024-09-10T07:37:57.604524+0000","last_became_active":"2024-09-10T07:37:56.605109+0000","last_became_peered":"2024-09-10T07:37:56.605109+0000","last_unstale":"2024-09-10T07:37:57.604524+0000","last_undegraded":"2024-09-10T07:37:57.604524+0000","last_fullsized":"2024-09-10T07:37:57.604524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:18.879949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593280+0000","last_change":"2024-09-10T07:37:55.593782+0000","last_active":"2024-09-10T07:37:57.593280+0000","last_peered":"2024-09-10T07:37:57.593280+0000","last_clean":"2024-09-10T07:37:57.593280+0000","last_became_active":"2024-09-10T07:37:55.592628+0000","last_became_peered":"2024-09-10T07:37:55.592628+0000","last_unstale":"2024-09-10T07:37:57.593280+0000","last_undegraded":"2024-09-10T07:37:57.593280+0000","last_fullsized":"2024-09-10T07:37:57.593280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:47.824838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028610+0000","last_change":"2024-09-10T07:37:56.603219+0000","last_active":"2024-09-10T07:37:58.028610+0000","last_peered":"2024-09-10T07:37:58.028610+0000","last_clean":"2024-09-10T07:37:58.028610+0000","last_became_active":"2024-09-10T07:37:56.602265+0000","last_became_peered":"2024-09-10T07:37:56.602265+0000","last_unstale":"2024-09-10T07:37:58.028610+0000","last_undegraded":"2024-09-10T07:37:58.028610+0000","last_fullsized":"2024-09-10T07:37:58.028610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:15.154622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"82'8","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811008+0000","last_change":"2024-09-10T07:37:55.599733+0000","last_active":"2024-09-10T07:37:57.811008+0000","last_peered":"2024-09-10T07:37:57.811008+0000","last_clean":"2024-09-10T07:37:57.811008+0000","last_became_active":"2024-09-10T07:37:55.599325+0000","last_became_peered":"2024-09-10T07:37:55.599325+0000","last_unstale":"2024-09-10T07:37:57.811008+0000","last_undegraded":"2024-09-10T07:37:57.811008+0000","last_fullsized":"2024-09-10T07:37:57.811008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:30.996371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810983+0000","last_change":"2024-09-10T07:37:56.601215+0000","last_active":"2024-09-10T07:37:57.810983+0000","last_peered":"2024-09-10T07:37:57.810983+0000","last_clean":"2024-09-10T07:37:57.810983+0000","last_became_active":"2024-09-10T07:37:56.600962+0000","last_became_peered":"2024-09-10T07:37:56.600962+0000","last_unstale":"2024-09-10T07:37:57.810983+0000","last_undegraded":"2024-09-10T07:37:57.810983+0000","last_fullsized":"2024-09-10T07:37:57.810983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:40.488732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811511+0000","last_change":"2024-09-10T07:37:55.603931+0000","last_active":"2024-09-10T07:37:57.811511+0000","last_peered":"2024-09-10T07:37:57.811511+0000","last_clean":"2024-09-10T07:37:57.811511+0000","last_became_active":"2024-09-10T07:37:55.603083+0000","last_became_peered":"2024-09-10T07:37:55.603083+0000","last_unstale":"2024-09-10T07:37:57.811511+0000","last_undegraded":"2024-09-10T07:37:57.811511+0000","last_fullsized":"2024-09-10T07:37:57.811511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:30.653972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592458+0000","last_change":"2024-09-10T07:37:56.614073+0000","last_active":"2024-09-10T07:37:57.592458+0000","last_peered":"2024-09-10T07:37:57.592458+0000","last_clean":"2024-09-10T07:37:57.592458+0000","last_became_active":"2024-09-10T07:37:56.611636+0000","last_became_peered":"2024-09-10T07:37:56.611636+0000","last_unstale":"2024-09-10T07:37:57.592458+0000","last_undegraded":"2024-09-10T07:37:57.592458+0000","last_fullsized":"2024-09-10T07:37:57.592458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:51.828966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811287+0000","last_change":"2024-09-10T07:37:55.602276+0000","last_active":"2024-09-10T07:37:57.811287+0000","last_peered":"2024-09-10T07:37:57.811287+0000","last_clean":"2024-09-10T07:37:57.811287+0000","last_became_active":"2024-09-10T07:37:55.601672+0000","last_became_peered":"2024-09-10T07:37:55.601672+0000","last_unstale":"2024-09-10T07:37:57.811287+0000","last_undegraded":"2024-09-10T07:37:57.811287+0000","last_fullsized":"2024-09-10T07:37:57.811287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:47.747991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810025+0000","last_change":"2024-09-10T07:37:56.604071+0000","last_active":"2024-09-10T07:37:57.810025+0000","last_peered":"2024-09-10T07:37:57.810025+0000","last_clean":"2024-09-10T07:37:57.810025+0000","last_became_active":"2024-09-10T07:37:56.603554+0000","last_became_peered":"2024-09-10T07:37:56.603554+0000","last_unstale":"2024-09-10T07:37:57.810025+0000","last_undegraded":"2024-09-10T07:37:57.810025+0000","last_fullsized":"2024-09-10T07:37:57.810025+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:58.511252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811968+0000","last_change":"2024-09-10T07:37:55.606195+0000","last_active":"2024-09-10T07:37:57.811968+0000","last_peered":"2024-09-10T07:37:57.811968+0000","last_clean":"2024-09-10T07:37:57.811968+0000","last_became_active":"2024-09-10T07:37:55.605178+0000","last_became_peered":"2024-09-10T07:37:55.605178+0000","last_unstale":"2024-09-10T07:37:57.811968+0000","last_undegraded":"2024-09-10T07:37:57.811968+0000","last_fullsized":"2024-09-10T07:37:57.811968+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:45.873801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028607+0000","last_change":"2024-09-10T07:37:56.601469+0000","last_active":"2024-09-10T07:37:58.028607+0000","last_peered":"2024-09-10T07:37:58.028607+0000","last_clean":"2024-09-10T07:37:58.028607+0000","last_became_active":"2024-09-10T07:37:56.601250+0000","last_became_peered":"2024-09-10T07:37:56.601250+0000","last_unstale":"2024-09-10T07:37:58.028607+0000","last_undegraded":"2024-09-10T07:37:58.028607+0000","last_fullsized":"2024-09-10T07:37:58.028607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:49.615508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592345+0000","last_change":"2024-09-10T07:37:55.600043+0000","last_active":"2024-09-10T07:37:57.592345+0000","last_peered":"2024-09-10T07:37:57.592345+0000","last_clean":"2024-09-10T07:37:57.592345+0000","last_became_active":"2024-09-10T07:37:55.599095+0000","last_became_peered":"2024-09-10T07:37:55.599095+0000","last_unstale":"2024-09-10T07:37:57.592345+0000","last_undegraded":"2024-09-10T07:37:57.592345+0000","last_fullsized":"2024-09-10T07:37:57.592345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:06.080986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591520+0000","last_change":"2024-09-10T07:37:56.600548+0000","last_active":"2024-09-10T07:37:57.591520+0000","last_peered":"2024-09-10T07:37:57.591520+0000","last_clean":"2024-09-10T07:37:57.591520+0000","last_became_active":"2024-09-10T07:37:56.599455+0000","last_became_peered":"2024-09-10T07:37:56.599455+0000","last_unstale":"2024-09-10T07:37:57.591520+0000","last_undegraded":"2024-09-10T07:37:57.591520+0000","last_fullsized":"2024-09-10T07:37:57.591520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:57.015404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811567+0000","last_change":"2024-09-10T07:37:55.600766+0000","last_active":"2024-09-10T07:37:57.811567+0000","last_peered":"2024-09-10T07:37:57.811567+0000","last_clean":"2024-09-10T07:37:57.811567+0000","last_became_active":"2024-09-10T07:37:55.600169+0000","last_became_peered":"2024-09-10T07:37:55.600169+0000","last_unstale":"2024-09-10T07:37:57.811567+0000","last_undegraded":"2024-09-10T07:37:57.811567+0000","last_fullsized":"2024-09-10T07:37:57.811567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:36.246819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591290+0000","last_change":"2024-09-10T07:37:56.614499+0000","last_active":"2024-09-10T07:37:57.591290+0000","last_peered":"2024-09-10T07:37:57.591290+0000","last_clean":"2024-09-10T07:37:57.591290+0000","last_became_active":"2024-09-10T07:37:56.614324+0000","last_became_peered":"2024-09-10T07:37:56.614324+0000","last_unstale":"2024-09-10T07:37:57.591290+0000","last_undegraded":"2024-09-10T07:37:57.591290+0000","last_fullsized":"2024-09-10T07:37:57.591290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:05.492983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593761+0000","last_change":"2024-09-10T07:37:55.594872+0000","last_active":"2024-09-10T07:37:57.593761+0000","last_peered":"2024-09-10T07:37:57.593761+0000","last_clean":"2024-09-10T07:37:57.593761+0000","last_became_active":"2024-09-10T07:37:55.594570+0000","last_became_peered":"2024-09-10T07:37:55.594570+0000","last_unstale":"2024-09-10T07:37:57.593761+0000","last_undegraded":"2024-09-10T07:37:57.593761+0000","last_fullsized":"2024-09-10T07:37:57.593761+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:38.376410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591285+0000","last_change":"2024-09-10T07:37:56.611081+0000","last_active":"2024-09-10T07:37:57.591285+0000","last_peered":"2024-09-10T07:37:57.591285+0000","last_clean":"2024-09-10T07:37:57.591285+0000","last_became_active":"2024-09-10T07:37:56.610851+0000","last_became_peered":"2024-09-10T07:37:56.610851+0000","last_unstale":"2024-09-10T07:37:57.591285+0000","last_undegraded":"2024-09-10T07:37:57.591285+0000","last_fullsized":"2024-09-10T07:37:57.591285+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:04.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604365+0000","last_change":"2024-09-10T07:37:55.597977+0000","last_active":"2024-09-10T07:37:57.604365+0000","last_peered":"2024-09-10T07:37:57.604365+0000","last_clean":"2024-09-10T07:37:57.604365+0000","last_became_active":"2024-09-10T07:37:55.597754+0000","last_became_peered":"2024-09-10T07:37:55.597754+0000","last_unstale":"2024-09-10T07:37:57.604365+0000","last_undegraded":"2024-09-10T07:37:57.604365+0000","last_fullsized":"2024-09-10T07:37:57.604365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:36.154248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604612+0000","last_change":"2024-09-10T07:37:56.594963+0000","last_active":"2024-09-10T07:37:57.604612+0000","last_peered":"2024-09-10T07:37:57.604612+0000","last_clean":"2024-09-10T07:37:57.604612+0000","last_became_active":"2024-09-10T07:37:56.594540+0000","last_became_peered":"2024-09-10T07:37:56.594540+0000","last_unstale":"2024-09-10T07:37:57.604612+0000","last_undegraded":"2024-09-10T07:37:57.604612+0000","last_fullsized":"2024-09-10T07:37:57.604612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:51.531831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811235+0000","last_change":"2024-09-10T07:37:55.605236+0000","last_active":"2024-09-10T07:37:57.811235+0000","last_peered":"2024-09-10T07:37:57.811235+0000","last_clean":"2024-09-10T07:37:57.811235+0000","last_became_active":"2024-09-10T07:37:55.603776+0000","last_became_peered":"2024-09-10T07:37:55.603776+0000","last_unstale":"2024-09-10T07:37:57.811235+0000","last_undegraded":"2024-09-10T07:37:57.811235+0000","last_fullsized":"2024-09-10T07:37:57.811235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:13.110897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.593176+0000","last_change":"2024-09-10T07:37:56.601906+0000","last_active":"2024-09-10T07:37:57.593176+0000","last_peered":"2024-09-10T07:37:57.593176+0000","last_clean":"2024-09-10T07:37:57.593176+0000","last_became_active":"2024-09-10T07:37:56.601361+0000","last_became_peered":"2024-09-10T07:37:56.601361+0000","last_unstale":"2024-09-10T07:37:57.593176+0000","last_undegraded":"2024-09-10T07:37:57.593176+0000","last_fullsized":"2024-09-10T07:37:57.593176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:18.156253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"83'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604232+0000","last_change":"2024-09-10T07:37:55.591172+0000","last_active":"2024-09-10T07:37:57.604232+0000","last_peered":"2024-09-10T07:37:57.604232+0000","last_clean":"2024-09-10T07:37:57.604232+0000","last_became_active":"2024-09-10T07:37:55.590906+0000","last_became_peered":"2024-09-10T07:37:55.590906+0000","last_unstale":"2024-09-10T07:37:57.604232+0000","last_undegraded":"2024-09-10T07:37:57.604232+0000","last_fullsized":"2024-09-10T07:37:57.604232+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:18.649500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592533+0000","last_change":"2024-09-10T07:37:56.619056+0000","last_active":"2024-09-10T07:37:57.592533+0000","last_peered":"2024-09-10T07:37:57.592533+0000","last_clean":"2024-09-10T07:37:57.592533+0000","last_became_active":"2024-09-10T07:37:56.618813+0000","last_became_peered":"2024-09-10T07:37:56.618813+0000","last_unstale":"2024-09-10T07:37:57.592533+0000","last_undegraded":"2024-09-10T07:37:57.592533+0000","last_fullsized":"2024-09-10T07:37:57.592533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:18.184701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028604+0000","last_change":"2024-09-10T07:37:55.591462+0000","last_active":"2024-09-10T07:37:58.028604+0000","last_peered":"2024-09-10T07:37:58.028604+0000","last_clean":"2024-09-10T07:37:58.028604+0000","last_became_active":"2024-09-10T07:37:55.590884+0000","last_became_peered":"2024-09-10T07:37:55.590884+0000","last_unstale":"2024-09-10T07:37:58.028604+0000","last_undegraded":"2024-09-10T07:37:58.028604+0000","last_fullsized":"2024-09-10T07:37:58.028604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:44.596971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592627+0000","last_change":"2024-09-10T07:37:56.617543+0000","last_active":"2024-09-10T07:37:57.592627+0000","last_peered":"2024-09-10T07:37:57.592627+0000","last_clean":"2024-09-10T07:37:57.592627+0000","last_became_active":"2024-09-10T07:37:56.617007+0000","last_became_peered":"2024-09-10T07:37:56.617007+0000","last_unstale":"2024-09-10T07:37:57.592627+0000","last_undegraded":"2024-09-10T07:37:57.592627+0000","last_fullsized":"2024-09-10T07:37:57.592627+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:22.061400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.604563+0000","last_change":"2024-09-10T07:37:55.598221+0000","last_active":"2024-09-10T07:37:57.604563+0000","last_peered":"2024-09-10T07:37:57.604563+0000","last_clean":"2024-09-10T07:37:57.604563+0000","last_became_active":"2024-09-10T07:37:55.597736+0000","last_became_peered":"2024-09-10T07:37:55.597736+0000","last_unstale":"2024-09-10T07:37:57.604563+0000","last_undegraded":"2024-09-10T07:37:57.604563+0000","last_fullsized":"2024-09-10T07:37:57.604563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:10.829015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028701+0000","last_change":"2024-09-10T07:37:56.603484+0000","last_active":"2024-09-10T07:37:58.028701+0000","last_peered":"2024-09-10T07:37:58.028701+0000","last_clean":"2024-09-10T07:37:58.028701+0000","last_became_active":"2024-09-10T07:37:56.602544+0000","last_became_peered":"2024-09-10T07:37:56.602544+0000","last_unstale":"2024-09-10T07:37:58.028701+0000","last_undegraded":"2024-09-10T07:37:58.028701+0000","last_fullsized":"2024-09-10T07:37:58.028701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:48.486584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:58.028747+0000","last_change":"2024-09-10T07:37:55.596985+0000","last_active":"2024-09-10T07:37:58.028747+0000","last_peered":"2024-09-10T07:37:58.028747+0000","last_clean":"2024-09-10T07:37:58.028747+0000","last_became_active":"2024-09-10T07:37:55.595462+0000","last_became_peered":"2024-09-10T07:37:55.595462+0000","last_unstale":"2024-09-10T07:37:58.028747+0000","last_undegraded":"2024-09-10T07:37:58.028747+0000","last_fullsized":"2024-09-10T07:37:58.028747+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:23.814599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811618+0000","last_change":"2024-09-10T07:37:56.614928+0000","last_active":"2024-09-10T07:37:57.811618+0000","last_peered":"2024-09-10T07:37:57.811618+0000","last_clean":"2024-09-10T07:37:57.811618+0000","last_became_active":"2024-09-10T07:37:56.614280+0000","last_became_peered":"2024-09-10T07:37:56.614280+0000","last_unstale":"2024-09-10T07:37:57.811618+0000","last_undegraded":"2024-09-10T07:37:57.811618+0000","last_fullsized":"2024-09-10T07:37:57.811618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:58.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810127+0000","last_change":"2024-09-10T07:37:55.596381+0000","last_active":"2024-09-10T07:37:57.810127+0000","last_peered":"2024-09-10T07:37:57.810127+0000","last_clean":"2024-09-10T07:37:57.810127+0000","last_became_active":"2024-09-10T07:37:55.596161+0000","last_became_peered":"2024-09-10T07:37:55.596161+0000","last_unstale":"2024-09-10T07:37:57.810127+0000","last_undegraded":"2024-09-10T07:37:57.810127+0000","last_fullsized":"2024-09-10T07:37:57.810127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:06.699739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.809934+0000","last_change":"2024-09-10T07:37:56.599312+0000","last_active":"2024-09-10T07:37:57.809934+0000","last_peered":"2024-09-10T07:37:57.809934+0000","last_clean":"2024-09-10T07:37:57.809934+0000","last_became_active":"2024-09-10T07:37:56.599032+0000","last_became_peered":"2024-09-10T07:37:56.599032+0000","last_unstale":"2024-09-10T07:37:57.809934+0000","last_undegraded":"2024-09-10T07:37:57.809934+0000","last_fullsized":"2024-09-10T07:37:57.809934+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:43.188129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811105+0000","last_change":"2024-09-10T07:37:55.599549+0000","last_active":"2024-09-10T07:37:57.811105+0000","last_peered":"2024-09-10T07:37:57.811105+0000","last_clean":"2024-09-10T07:37:57.811105+0000","last_became_active":"2024-09-10T07:37:55.598938+0000","last_became_peered":"2024-09-10T07:37:55.598938+0000","last_unstale":"2024-09-10T07:37:57.811105+0000","last_undegraded":"2024-09-10T07:37:57.811105+0000","last_fullsized":"2024-09-10T07:37:57.811105+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:52.794172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.810788+0000","last_change":"2024-09-10T07:37:56.605102+0000","last_active":"2024-09-10T07:37:57.810788+0000","last_peered":"2024-09-10T07:37:57.810788+0000","last_clean":"2024-09-10T07:37:57.810788+0000","last_became_active":"2024-09-10T07:37:56.604558+0000","last_became_peered":"2024-09-10T07:37:56.604558+0000","last_unstale":"2024-09-10T07:37:57.810788+0000","last_undegraded":"2024-09-10T07:37:57.810788+0000","last_fullsized":"2024-09-10T07:37:57.810788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:43.528112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811623+0000","last_change":"2024-09-10T07:37:55.603524+0000","last_active":"2024-09-10T07:37:57.811623+0000","last_peered":"2024-09-10T07:37:57.811623+0000","last_clean":"2024-09-10T07:37:57.811623+0000","last_became_active":"2024-09-10T07:37:55.602239+0000","last_became_peered":"2024-09-10T07:37:55.602239+0000","last_unstale":"2024-09-10T07:37:57.811623+0000","last_undegraded":"2024-09-10T07:37:57.811623+0000","last_fullsized":"2024-09-10T07:37:57.811623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:55.974205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.591675+0000","last_change":"2024-09-10T07:37:56.606491+0000","last_active":"2024-09-10T07:37:57.591675+0000","last_peered":"2024-09-10T07:37:57.591675+0000","last_clean":"2024-09-10T07:37:57.591675+0000","last_became_active":"2024-09-10T07:37:56.606269+0000","last_became_peered":"2024-09-10T07:37:56.606269+0000","last_unstale":"2024-09-10T07:37:57.591675+0000","last_undegraded":"2024-09-10T07:37:57.591675+0000","last_fullsized":"2024-09-10T07:37:57.591675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:55.579694+0000","last_clean_scrub_stamp":"2024-09-10T07:37:55.579694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:03.636941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.811102+0000","last_change":"2024-09-10T07:37:55.603413+0000","last_active":"2024-09-10T07:37:57.811102+0000","last_peered":"2024-09-10T07:37:57.811102+0000","last_clean":"2024-09-10T07:37:57.811102+0000","last_became_active":"2024-09-10T07:37:55.603163+0000","last_became_peered":"2024-09-10T07:37:55.603163+0000","last_unstale":"2024-09-10T07:37:57.811102+0000","last_undegraded":"2024-09-10T07:37:57.811102+0000","last_fullsized":"2024-09-10T07:37:57.811102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:37:54.576687+0000","last_clean_scrub_stamp":"2024-09-10T07:37:54.576687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:16.853456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":292,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T07:37:57.592683+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:37:57.592683+0000","last_peered":"2024-09-10T07:37:57.592683+0000","last_clean":"2024-09-10T07:37:57.592683+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:37:57.592683+0000","last_undegraded":"2024-09-10T07:37:57.592683+0000","last_fullsized":"2024-09-10T07:37:57.592683+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:36.212328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1006,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194305,"statfs":{"total":200000000,"available":198969317,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194883,"statfs":{"total":200000000,"available":199560209,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194883,"statfs":{"total":200000000,"available":199560211,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194883,"statfs":{"total":200000000,"available":199560231,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194882,"statfs":{"total":200000000,"available":199560189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":424,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194887,"statfs":{"total":200000000,"available":199564989,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":431,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194880,"statfs":{"total":200000000,"available":199558073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1005,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198969933,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:38:01.358 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:38:01.358 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T07:38:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.520+0000 7fab81000640 1 Processor -- start 2024-09-10T07:38:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.520+0000 7fab81000640 1 -- start start 2024-09-10T07:38:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.521+0000 7fab81000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab7c06e280 0x7fab7c073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.521+0000 7fab81000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fab7c071df0 0x7fab7c06e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.521+0000 7fab81000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab7c0d1010 0x7fab7c0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.521+0000 7fab81000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fab7c0738b0 con 0x7fab7c0d1010 2024-09-10T07:38:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.521+0000 7fab81000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fab7c06eba0 con 0x7fab7c071df0 2024-09-10T07:38:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.521+0000 7fab81000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fab7c0722d0 con 0x7fab7c06e280 2024-09-10T07:38:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab7a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab7c0d1010 0x7fab7c0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab7a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab7c0d1010 0x7fab7c0ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35922/0 (socket says 172.21.15.99:35922) 2024-09-10T07:38:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab7a800640 1 -- 172.21.15.99:0/2495270941 learned_addr learned my addr 172.21.15.99:0/2495270941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab79e00640 1 --2- 172.21.15.99:0/2495270941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab7c06e280 0x7fab7c073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab79400640 1 --2- 172.21.15.99:0/2495270941 >> v2:172.21.15.187:3300/0 conn(0x7fab7c071df0 0x7fab7c06e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab7a800640 1 -- 172.21.15.99:0/2495270941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab7c06e280 msgr2=0x7fab7c073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab7a800640 1 --2- 172.21.15.99:0/2495270941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab7c06e280 0x7fab7c073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab7a800640 1 -- 172.21.15.99:0/2495270941 >> v2:172.21.15.187:3300/0 conn(0x7fab7c071df0 msgr2=0x7fab7c06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab7a800640 1 --2- 172.21.15.99:0/2495270941 >> v2:172.21.15.187:3300/0 conn(0x7fab7c071df0 0x7fab7c06e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab7a800640 1 -- 172.21.15.99:0/2495270941 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c0725b0 con 0x7fab7c0d1010 2024-09-10T07:38:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.522+0000 7fab79400640 1 --2- 172.21.15.99:0/2495270941 >> v2:172.21.15.187:3300/0 conn(0x7fab7c071df0 0x7fab7c06e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:38:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.523+0000 7fab7a800640 1 --2- 172.21.15.99:0/2495270941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c0d1010 0x7fab7c0ce3d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fab7c073ee0 tx=0x7fab7402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ada8f4c3a9913a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.523+0000 7fab78a00640 1 -- 172.21.15.99:0/2495270941 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74036070 con 0x7fab7c0d1010 2024-09-10T07:38:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.523+0000 7fab78a00640 1 -- 172.21.15.99:0/2495270941 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab74031600 con 0x7fab7c0d1010 2024-09-10T07:38:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.523+0000 7fab78a00640 1 -- 172.21.15.99:0/2495270941 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab740319d0 con 0x7fab7c0d1010 2024-09-10T07:38:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.524+0000 7fab81000640 1 -- 172.21.15.99:0/2495270941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c0d1010 msgr2=0x7fab7c0ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.524+0000 7fab81000640 1 --2- 172.21.15.99:0/2495270941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c0d1010 0x7fab7c0ce3d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fab7c073ee0 tx=0x7fab7402a6a0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.524+0000 7fab81000640 1 -- 172.21.15.99:0/2495270941 shutdown_connections 2024-09-10T07:38:01.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.524+0000 7fab81000640 1 --2- 172.21.15.99:0/2495270941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c0d1010 0x7fab7c0ce3d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.524+0000 7fab81000640 1 --2- 172.21.15.99:0/2495270941 >> v2:172.21.15.187:3300/0 conn(0x7fab7c071df0 0x7fab7c06e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.524+0000 7fab81000640 1 --2- 172.21.15.99:0/2495270941 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab7c06e280 0x7fab7c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.524+0000 7fab81000640 1 -- 172.21.15.99:0/2495270941 >> 172.21.15.99:0/2495270941 conn(0x7fab7c06bc10 msgr2=0x7fab7c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:01.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.524+0000 7fab81000640 1 -- 172.21.15.99:0/2495270941 shutdown_connections 2024-09-10T07:38:01.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.524+0000 7fab81000640 1 -- 172.21.15.99:0/2495270941 wait complete. 2024-09-10T07:38:01.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.525+0000 7fab81000640 1 Processor -- start 2024-09-10T07:38:01.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.526+0000 7fab81000640 1 -- start start 2024-09-10T07:38:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.526+0000 7fab81000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c06e280 0x7fab7c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.526+0000 7fab81000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab7c071df0 0x7fab7c0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab81000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab7c0d1010 0x7fab7c0b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab81000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c072e50 con 0x7fab7c06e280 2024-09-10T07:38:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab81000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c072b70 con 0x7fab7c071df0 2024-09-10T07:38:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab81000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fab7c0d14c0 con 0x7fab7c0d1010 2024-09-10T07:38:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab79e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c06e280 0x7fab7c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab79e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c06e280 0x7fab7c0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35928/0 (socket says 172.21.15.99:35928) 2024-09-10T07:38:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab79e00640 1 -- 172.21.15.99:0/2300798480 learned_addr learned my addr 172.21.15.99:0/2300798480 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab7a800640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab7c0d1010 0x7fab7c0b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab79400640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab7c071df0 0x7fab7c0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab79e00640 1 -- 172.21.15.99:0/2300798480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab7c0d1010 msgr2=0x7fab7c0b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab79e00640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab7c0d1010 0x7fab7c0b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab79e00640 1 -- 172.21.15.99:0/2300798480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab7c071df0 msgr2=0x7fab7c0b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab79e00640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab7c071df0 0x7fab7c0b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab79e00640 1 -- 172.21.15.99:0/2300798480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c0b5880 con 0x7fab7c06e280 2024-09-10T07:38:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.527+0000 7fab79e00640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c06e280 0x7fab7c0c57c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00d830 tx=0x7fab6c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.528+0000 7fab72000640 1 -- 172.21.15.99:0/2300798480 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c00b6c0 con 0x7fab7c06e280 2024-09-10T07:38:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.528+0000 7fab72000640 1 -- 172.21.15.99:0/2300798480 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c019070 con 0x7fab7c06e280 2024-09-10T07:38:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.528+0000 7fab72000640 1 -- 172.21.15.99:0/2300798480 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c00ba80 con 0x7fab7c06e280 2024-09-10T07:38:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.528+0000 7fab81000640 1 -- 172.21.15.99:0/2300798480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7c15cb50 con 0x7fab7c06e280 2024-09-10T07:38:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.528+0000 7fab81000640 1 -- 172.21.15.99:0/2300798480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7c15d110 con 0x7fab7c06e280 2024-09-10T07:38:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.529+0000 7fab81000640 1 -- 172.21.15.99:0/2300798480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab7c073370 con 0x7fab7c06e280 2024-09-10T07:38:01.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.530+0000 7fab72000640 1 -- 172.21.15.99:0/2300798480 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab6c01e460 con 0x7fab7c06e280 2024-09-10T07:38:01.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.531+0000 7fab72000640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab5c06be30 0x7fab5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.531+0000 7fab72000640 1 -- 172.21.15.99:0/2300798480 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fab6c08b4b0 con 0x7fab7c06e280 2024-09-10T07:38:01.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.531+0000 7fab79400640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab5c06be30 0x7fab5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.531+0000 7fab79400640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab5c06be30 0x7fab5c06e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fab7c15f8a0 tx=0x7fab68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:01.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.535+0000 7fab72000640 1 -- 172.21.15.99:0/2300798480 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab6c059770 con 0x7fab7c06e280 2024-09-10T07:38:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.769+0000 7fab81000640 1 -- 172.21.15.99:0/2300798480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fab7c0ce6e0 con 0x7fab7c06e280 2024-09-10T07:38:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.772+0000 7fab72000640 1 -- 172.21.15.99:0/2300798480 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fab6c05da70 con 0x7fab7c06e280 2024-09-10T07:38:01.772 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:38:01.772 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:38:01.772 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-09-10T07:38:01.772 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-09-10T07:38:01.772 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T07:38:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-09-10T07:38:01.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 -- 172.21.15.99:0/2300798480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab5c06be30 msgr2=0x7fab5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab5c06be30 0x7fab5c06e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fab7c15f8a0 tx=0x7fab68008040 comp rx=0 tx=0).stop 2024-09-10T07:38:01.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 -- 172.21.15.99:0/2300798480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c06e280 msgr2=0x7fab7c0c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c06e280 0x7fab7c0c57c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00d830 tx=0x7fab6c00dcf0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 -- 172.21.15.99:0/2300798480 shutdown_connections 2024-09-10T07:38:01.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab7c0d1010 0x7fab7c0b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab7c071df0 0x7fab7c0b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fab5c06be30 0x7fab5c06e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 --2- 172.21.15.99:0/2300798480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab7c06e280 0x7fab7c0c57c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 -- 172.21.15.99:0/2300798480 >> 172.21.15.99:0/2300798480 conn(0x7fab7c06bc10 msgr2=0x7fab7c0b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 -- 172.21.15.99:0/2300798480 shutdown_connections 2024-09-10T07:38:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.774+0000 7fab81000640 1 -- 172.21.15.99:0/2300798480 wait complete. 2024-09-10T07:38:01.790 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:38:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.943+0000 7fbcfa600640 1 Processor -- start 2024-09-10T07:38:01.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.943+0000 7fbcfa600640 1 -- start start 2024-09-10T07:38:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.944+0000 7fbcfa600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbcf4145290 0x7fbcf406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.944+0000 7fbcfa600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf40ce780 0x7fbcf4072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.944+0000 7fbcfa600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbcf4071510 0x7fbcf4072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.944+0000 7fbcfa600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf406efe0 con 0x7fbcf4071510 2024-09-10T07:38:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.944+0000 7fbcfa600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf406e3d0 con 0x7fbcf4145290 2024-09-10T07:38:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.944+0000 7fbcfa600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf406e6b0 con 0x7fbcf40ce780 2024-09-10T07:38:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.945+0000 7fbcf3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbcf4071510 0x7fbcf4072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.945+0000 7fbcf3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbcf4071510 0x7fbcf4072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35932/0 (socket says 172.21.15.99:35932) 2024-09-10T07:38:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.945+0000 7fbcf3e00640 1 -- 172.21.15.99:0/4090645346 learned_addr learned my addr 172.21.15.99:0/4090645346 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:01.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.945+0000 7fbcf3400640 1 --2- 172.21.15.99:0/4090645346 >> v2:172.21.15.187:3300/0 conn(0x7fbcf4145290 0x7fbcf406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.945+0000 7fbcf2a00640 1 --2- 172.21.15.99:0/4090645346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf40ce780 0x7fbcf4072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.945+0000 7fbcf3e00640 1 -- 172.21.15.99:0/4090645346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf40ce780 msgr2=0x7fbcf4072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:01.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.945+0000 7fbcf3e00640 1 --2- 172.21.15.99:0/4090645346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf40ce780 0x7fbcf4072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.945+0000 7fbcf3e00640 1 -- 172.21.15.99:0/4090645346 >> v2:172.21.15.187:3300/0 conn(0x7fbcf4145290 msgr2=0x7fbcf406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:01.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.945+0000 7fbcf3e00640 1 --2- 172.21.15.99:0/4090645346 >> v2:172.21.15.187:3300/0 conn(0x7fbcf4145290 0x7fbcf406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.945+0000 7fbcf3e00640 1 -- 172.21.15.99:0/4090645346 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf406e990 con 0x7fbcf4071510 2024-09-10T07:38:01.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.946+0000 7fbcf3e00640 1 --2- 172.21.15.99:0/4090645346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4071510 0x7fbcf4072d70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4075940 tx=0x7fbcec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4e978e4648db1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:01.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.946+0000 7fbcf2000640 1 -- 172.21.15.99:0/4090645346 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec036070 con 0x7fbcf4071510 2024-09-10T07:38:01.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.946+0000 7fbcf2000640 1 -- 172.21.15.99:0/4090645346 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcec031600 con 0x7fbcf4071510 2024-09-10T07:38:01.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.946+0000 7fbcf2000640 1 -- 172.21.15.99:0/4090645346 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec0319d0 con 0x7fbcf4071510 2024-09-10T07:38:01.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.947+0000 7fbcfa600640 1 -- 172.21.15.99:0/4090645346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4071510 msgr2=0x7fbcf4072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.947+0000 7fbcfa600640 1 --2- 172.21.15.99:0/4090645346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4071510 0x7fbcf4072d70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4075940 tx=0x7fbcec02a6a0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.947+0000 7fbcfa600640 1 -- 172.21.15.99:0/4090645346 shutdown_connections 2024-09-10T07:38:01.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.947+0000 7fbcfa600640 1 --2- 172.21.15.99:0/4090645346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf40ce780 0x7fbcf4072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.947+0000 7fbcfa600640 1 --2- 172.21.15.99:0/4090645346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4071510 0x7fbcf4072d70 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.947+0000 7fbcfa600640 1 --2- 172.21.15.99:0/4090645346 >> v2:172.21.15.187:3300/0 conn(0x7fbcf4145290 0x7fbcf406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.947+0000 7fbcfa600640 1 -- 172.21.15.99:0/4090645346 >> 172.21.15.99:0/4090645346 conn(0x7fbcf406bc10 msgr2=0x7fbcf406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:01.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.947+0000 7fbcfa600640 1 -- 172.21.15.99:0/4090645346 shutdown_connections 2024-09-10T07:38:01.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.947+0000 7fbcfa600640 1 -- 172.21.15.99:0/4090645346 wait complete. 2024-09-10T07:38:01.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.949+0000 7fbcfa600640 1 Processor -- start 2024-09-10T07:38:01.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.949+0000 7fbcfa600640 1 -- start start 2024-09-10T07:38:01.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcfa600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf4071510 0x7fbcf4154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcfa600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf40ce780 0x7fbcf413dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcfa600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4145290 0x7fbcf40afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcfa600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf406df80 con 0x7fbcf4145290 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcfa600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4145670 con 0x7fbcf40ce780 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcfa600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf406e100 con 0x7fbcf4071510 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcf3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4145290 0x7fbcf40afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcf3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4145290 0x7fbcf40afb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35934/0 (socket says 172.21.15.99:35934) 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcf3e00640 1 -- 172.21.15.99:0/2970243065 learned_addr learned my addr 172.21.15.99:0/2970243065 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcf3400640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf4071510 0x7fbcf4154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.950+0000 7fbcf2a00640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf40ce780 0x7fbcf413dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbcf3e00640 1 -- 172.21.15.99:0/2970243065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf4071510 msgr2=0x7fbcf4154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbcf3e00640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf4071510 0x7fbcf4154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbcf3e00640 1 -- 172.21.15.99:0/2970243065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf40ce780 msgr2=0x7fbcf413dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:01.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbcf3e00640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf40ce780 0x7fbcf413dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:01.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbcf3e00640 1 -- 172.21.15.99:0/2970243065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf41545d0 con 0x7fbcf4145290 2024-09-10T07:38:01.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbcf3e00640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4145290 0x7fbcf40afb20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbcec009f40 tx=0x7fbcec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:01.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbceb400640 1 -- 172.21.15.99:0/2970243065 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec036050 con 0x7fbcf4145290 2024-09-10T07:38:01.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbceb400640 1 -- 172.21.15.99:0/2970243065 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcec042070 con 0x7fbcf4145290 2024-09-10T07:38:01.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbceb400640 1 -- 172.21.15.99:0/2970243065 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec009510 con 0x7fbcf4145290 2024-09-10T07:38:01.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbcfa600640 1 -- 172.21.15.99:0/2970243065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf413ce20 con 0x7fbcf4145290 2024-09-10T07:38:01.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.951+0000 7fbcfa600640 1 -- 172.21.15.99:0/2970243065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf413d3e0 con 0x7fbcf4145290 2024-09-10T07:38:01.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.952+0000 7fbcfa600640 1 -- 172.21.15.99:0/2970243065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf406f470 con 0x7fbcf4145290 2024-09-10T07:38:01.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.953+0000 7fbceb400640 1 -- 172.21.15.99:0/2970243065 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcec007bd0 con 0x7fbcf4145290 2024-09-10T07:38:01.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.954+0000 7fbceb400640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcd406be30 0x7fbcd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:01.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.954+0000 7fbceb400640 1 -- 172.21.15.99:0/2970243065 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fbcec0abdc0 con 0x7fbcf4145290 2024-09-10T07:38:01.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.954+0000 7fbcf3400640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcd406be30 0x7fbcd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:01.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.955+0000 7fbcf3400640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcd406be30 0x7fbcd406e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbce4006fd0 tx=0x7fbce4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:01.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:01.958+0000 7fbceb400640 1 -- 172.21.15.99:0/2970243065 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbcec07a6d0 con 0x7fbcf4145290 2024-09-10T07:38:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.166+0000 7fbcfa600640 1 -- 172.21.15.99:0/2970243065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcf40cf140 con 0x7fbcf4145290 2024-09-10T07:38:02.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.166+0000 7fbceb400640 1 -- 172.21.15.99:0/2970243065 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5231 (secure 0 0 0) 0x7fbcec079fd0 con 0x7fbcf4145290 2024-09-10T07:38:02.166 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:02.166 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":41,"btime":"2024-09-10T07:37:59:731705+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4097816103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4097816103},{"type":"v1","addr":"172.21.15.99:6836","nonce":4097816103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1085745704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1085745704},{"type":"v1","addr":"172.21.15.99:6837","nonce":1085745704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1939216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1939216203},{"type":"v1","addr":"172.21.15.187:6834","nonce":1939216203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:37:56.004324+0000","modified":"2024-09-10T07:37:59.138242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5596},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5596":{"gid":5596,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1298775214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1298775214},{"type":"v1","addr":"172.21.15.187:6835","nonce":1298775214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5596,"qdb_cluster":[5596]},"id":5}]} 2024-09-10T07:38:02.167 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 41 2024-09-10T07:38:02.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 -- 172.21.15.99:0/2970243065 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcd406be30 msgr2=0x7fbcd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcd406be30 0x7fbcd406e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbce4006fd0 tx=0x7fbce4008040 comp rx=0 tx=0).stop 2024-09-10T07:38:02.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 -- 172.21.15.99:0/2970243065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4145290 msgr2=0x7fbcf40afb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4145290 0x7fbcf40afb20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbcec009f40 tx=0x7fbcec004a40 comp rx=0 tx=0).stop 2024-09-10T07:38:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 -- 172.21.15.99:0/2970243065 shutdown_connections 2024-09-10T07:38:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbcd406be30 0x7fbcd406e2f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcf4145290 0x7fbcf40afb20 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf40ce780 0x7fbcf413dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 --2- 172.21.15.99:0/2970243065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf4071510 0x7fbcf4154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 -- 172.21.15.99:0/2970243065 >> 172.21.15.99:0/2970243065 conn(0x7fbcf406bc10 msgr2=0x7fbcf41436f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.168+0000 7fbcfa600640 1 -- 172.21.15.99:0/2970243065 shutdown_connections 2024-09-10T07:38:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.169+0000 7fbcfa600640 1 -- 172.21.15.99:0/2970243065 wait complete. 2024-09-10T07:38:02.586 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:37:56.004324+0000', 'modified': '2024-09-10T07:37:59.138242+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5596}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5596': {'gid': 5596, 'name': 'd', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6835/1298775214', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6833', 'nonce': 1298775214}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 1298775214}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5596, 'qdb_cluster': [5596]} 2024-09-10T07:38:02.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:38:02.587 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T07:38:02.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.745+0000 7f18a6800640 1 Processor -- start 2024-09-10T07:38:02.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.746+0000 7f18a6800640 1 -- start start 2024-09-10T07:38:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.747+0000 7f18a6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f18a00b5750 0x7f18a015d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.747+0000 7f18a6800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a015c800 con 0x7f18a00ce070 2024-09-10T07:38:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.747+0000 7f18a6800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a015cae0 con 0x7f18a00cf890 2024-09-10T07:38:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.747+0000 7f18a6800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f18a00b5bb0 con 0x7f18a00b5750 2024-09-10T07:38:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.747+0000 7f189f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f18a00ce070 0x7f18a015bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60094/0 (socket says 172.21.15.99:60094) 2024-09-10T07:38:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.747+0000 7f189f400640 1 -- 172.21.15.99:0/951662580 learned_addr learned my addr 172.21.15.99:0/951662580 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.747+0000 7f189ea00640 1 --2- 172.21.15.99:0/951662580 >> v2:172.21.15.99:3300/0 conn(0x7f18a00b5750 0x7f18a015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.748+0000 7f189ea00640 1 -- 172.21.15.99:0/951662580 >> v1:172.21.15.187:6789/0 conn(0x7f18a00cf890 legacy=0x7f18a006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.748+0000 7f189ea00640 1 -- 172.21.15.99:0/951662580 >> v1:172.21.15.99:6789/0 conn(0x7f18a00ce070 legacy=0x7f18a015bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.748+0000 7f189ea00640 1 -- 172.21.15.99:0/951662580 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a015cdc0 con 0x7f18a00b5750 2024-09-10T07:38:02.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.749+0000 7f189ea00640 1 --2- 172.21.15.99:0/951662580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 0x7f18a015d170 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097a0 tx=0x7f188c02c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a72293c701c3a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:02.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.749+0000 7f189e000640 1 -- 172.21.15.99:0/951662580 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c038070 con 0x7f18a00b5750 2024-09-10T07:38:02.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.749+0000 7f189e000640 1 -- 172.21.15.99:0/951662580 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c031710 con 0x7f18a00b5750 2024-09-10T07:38:02.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.749+0000 7f189e000640 1 -- 172.21.15.99:0/951662580 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c031ae0 con 0x7f18a00b5750 2024-09-10T07:38:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.750+0000 7f18a6800640 1 -- 172.21.15.99:0/951662580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 msgr2=0x7f18a015d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.750+0000 7f18a6800640 1 --2- 172.21.15.99:0/951662580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 0x7f18a015d170 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097a0 tx=0x7f188c02c440 comp rx=0 tx=0).stop 2024-09-10T07:38:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.750+0000 7f18a6800640 1 -- 172.21.15.99:0/951662580 shutdown_connections 2024-09-10T07:38:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.750+0000 7f18a6800640 1 --2- 172.21.15.99:0/951662580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 0x7f18a015d170 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.750+0000 7f18a6800640 1 -- 172.21.15.99:0/951662580 >> 172.21.15.99:0/951662580 conn(0x7f18a00b2630 msgr2=0x7f18a00b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.750+0000 7f18a6800640 1 -- 172.21.15.99:0/951662580 shutdown_connections 2024-09-10T07:38:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.750+0000 7f18a6800640 1 -- 172.21.15.99:0/951662580 wait complete. 2024-09-10T07:38:02.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.752+0000 7f18a6800640 1 Processor -- start 2024-09-10T07:38:02.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.752+0000 7f18a6800640 1 -- start start 2024-09-10T07:38:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f18a6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 0x7f18a0151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f18a6800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18a00ce070 0x7f18a00ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f18a6800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00cf890 0x7f18a00b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f18a6800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f18a006e790 con 0x7f18a00b5750 2024-09-10T07:38:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f18a6800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f18a00ce450 con 0x7f18a00ce070 2024-09-10T07:38:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f18a6800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f18a006e910 con 0x7f18a00cf890 2024-09-10T07:38:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 0x7f18a0151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 0x7f18a0151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35962/0 (socket says 172.21.15.99:35962) 2024-09-10T07:38:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189f400640 1 -- 172.21.15.99:0/3347899946 learned_addr learned my addr 172.21.15.99:0/3347899946 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189ea00640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18a00ce070 0x7f18a00ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189fe00640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00cf890 0x7f18a00b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189f400640 1 -- 172.21.15.99:0/3347899946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00cf890 msgr2=0x7f18a00b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189f400640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00cf890 0x7f18a00b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189f400640 1 -- 172.21.15.99:0/3347899946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18a00ce070 msgr2=0x7f18a00ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189f400640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18a00ce070 0x7f18a00ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189f400640 1 -- 172.21.15.99:0/3347899946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a015de20 con 0x7f18a00b5750 2024-09-10T07:38:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.753+0000 7f189fe00640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00cf890 0x7f18a00b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.754+0000 7f189f400640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 0x7f18a0151880 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f189000c4b0 tx=0x7f189000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.754+0000 7f1897400640 1 -- 172.21.15.99:0/3347899946 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890017070 con 0x7f18a00b5750 2024-09-10T07:38:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.754+0000 7f1897400640 1 -- 172.21.15.99:0/3347899946 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1890005ce0 con 0x7f18a00b5750 2024-09-10T07:38:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.754+0000 7f1897400640 1 -- 172.21.15.99:0/3347899946 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890007270 con 0x7f18a00b5750 2024-09-10T07:38:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.754+0000 7f18a6800640 1 -- 172.21.15.99:0/3347899946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a00ab7b0 con 0x7f18a00b5750 2024-09-10T07:38:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.754+0000 7f18a6800640 1 -- 172.21.15.99:0/3347899946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a015e0c0 con 0x7f18a00b5750 2024-09-10T07:38:02.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.757+0000 7f1897400640 1 -- 172.21.15.99:0/3347899946 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f189001a070 con 0x7f18a00b5750 2024-09-10T07:38:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.758+0000 7f1897400640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 0x7f188006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.758+0000 7f1897400640 1 -- 172.21.15.99:0/3347899946 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f189008a0a0 con 0x7f18a00b5750 2024-09-10T07:38:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.758+0000 7f189ea00640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 0x7f188006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.758+0000 7f18a95d5740 1 Processor -- start 2024-09-10T07:38:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.758+0000 7f18a95d5740 1 -- start start 2024-09-10T07:38:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.759+0000 7f189ea00640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 0x7f188006e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f188c035000 tx=0x7f188c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.759+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713c04490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.759+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bbc4b0 0x55f713bbf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.759+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713bb9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.759+0000 7f18a95d5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f713b1d3b0 con 0x55f713bbc4b0 2024-09-10T07:38:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.759+0000 7f18a95d5740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55f713b22410 con 0x55f713bc0480 2024-09-10T07:38:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.759+0000 7f18a95d5740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55f713aca620 con 0x55f713bbecf0 2024-09-10T07:38:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.759+0000 7f189ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bbc4b0 0x55f713bbf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.759+0000 7f189ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bbc4b0 0x55f713bbf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35966/0 (socket says 172.21.15.99:35966) 2024-09-10T07:38:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.759+0000 7f189ea00640 1 -- 172.21.15.99:0/2418133542 learned_addr learned my addr 172.21.15.99:0/2418133542 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.760+0000 7f189fe00640 1 --2- 172.21.15.99:0/2418133542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713bb9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.760+0000 7f189f400640 1 --2- 172.21.15.99:0/2418133542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713c04490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.760+0000 7f189ea00640 1 -- 172.21.15.99:0/2418133542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 msgr2=0x55f713c04490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.760+0000 7f189ea00640 1 --2- 172.21.15.99:0/2418133542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713c04490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.760+0000 7f189ea00640 1 -- 172.21.15.99:0/2418133542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 msgr2=0x55f713bb9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.760+0000 7f189ea00640 1 --2- 172.21.15.99:0/2418133542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713bb9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.760+0000 7f189ea00640 1 -- 172.21.15.99:0/2418133542 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7138352d0 con 0x55f713bbc4b0 2024-09-10T07:38:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.760+0000 7f189f400640 1 --2- 172.21.15.99:0/2418133542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713c04490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.760+0000 7f189ea00640 1 --2- 172.21.15.99:0/2418133542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bbc4b0 0x55f713bbf0d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f188c009890 tx=0x7f188c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73f474ad9c8c5d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:02.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.760+0000 7f188be00640 1 -- 172.21.15.99:0/2418133542 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c038040 con 0x55f713bbc4b0 2024-09-10T07:38:02.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f188be00640 1 -- 172.21.15.99:0/2418133542 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c03f520 con 0x55f713bbc4b0 2024-09-10T07:38:02.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f188be00640 1 -- 172.21.15.99:0/2418133542 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c03f930 con 0x55f713bbc4b0 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f18a95d5740 1 -- 172.21.15.99:0/2418133542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bbc4b0 msgr2=0x55f713bbf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f18a95d5740 1 --2- 172.21.15.99:0/2418133542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bbc4b0 0x55f713bbf0d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f188c009890 tx=0x7f188c030000 comp rx=0 tx=0).stop 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f18a95d5740 1 -- 172.21.15.99:0/2418133542 shutdown_connections 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f18a95d5740 1 --2- 172.21.15.99:0/2418133542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713bb9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f18a95d5740 1 --2- 172.21.15.99:0/2418133542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bbc4b0 0x55f713bbf0d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f18a95d5740 1 --2- 172.21.15.99:0/2418133542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713c04490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f18a95d5740 1 -- 172.21.15.99:0/2418133542 >> 172.21.15.99:0/2418133542 conn(0x55f713bbb740 msgr2=0x55f713c03960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f18a95d5740 1 -- 172.21.15.99:0/2418133542 shutdown_connections 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.761+0000 7f18a95d5740 1 -- 172.21.15.99:0/2418133542 wait complete. 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.762+0000 7f18a95d5740 1 -- start start 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.762+0000 7f18a95d5740 1 Processor -- start 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bbecf0 0x55f713c00f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bc0480 0x55f713bec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713c17050 0x55f713beca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f18a95d5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f713add780 con 0x55f713bc0480 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f18a95d5740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55f713b1e3d0 con 0x55f713bbecf0 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f18a95d5740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55f713bbabe0 con 0x55f713c17050 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f18a95d5740 10 client.0 _ll_register_callbacks cb 0x55f713b1b5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f189ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bc0480 0x55f713bec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f189ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bc0480 0x55f713bec4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35982/0 (socket says 172.21.15.99:35982) 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f189ea00640 1 -- 172.21.15.99:0/3965781565 learned_addr learned my addr 172.21.15.99:0/3965781565 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f189fe00640 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713c17050 0x55f713beca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.763+0000 7f189f400640 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bbecf0 0x55f713c00f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f189ea00640 1 -- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713c17050 msgr2=0x55f713beca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f189ea00640 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713c17050 0x55f713beca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f189ea00640 1 -- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bbecf0 msgr2=0x55f713c00f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f189ea00640 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bbecf0 0x55f713c00f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f189ea00640 1 -- 172.21.15.99:0/3965781565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7138ff6b0 con 0x55f713bc0480 2024-09-10T07:38:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f189f400640 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bbecf0 0x55f713c00f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f189ea00640 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bc0480 0x55f713bec4f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f188c04b040 tx=0x7f188c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e09524a13ce59e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f1888c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:38:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f1888c00640 1 -- 172.21.15.99:0/3965781565 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c057060 con 0x55f713bc0480 2024-09-10T07:38:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f18a95d5740 1 -- 172.21.15.99:0/3965781565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f188c03f520 con 0x55f713bc0480 2024-09-10T07:38:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f1888c00640 1 -- 172.21.15.99:0/3965781565 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f188c052460 con 0x55f713bc0480 2024-09-10T07:38:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f1888c00640 1 -- 172.21.15.99:0/3965781565 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f188c038040 con 0x55f713bc0480 2024-09-10T07:38:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f18a95d5740 10 client.5892 fetch_fsmap learned FSMap version 41 2024-09-10T07:38:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.764+0000 7f18a95d5740 1 -- 172.21.15.99:0/3965781565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55f713c014d0 con 0x55f713bc0480 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.765+0000 7f1888c00640 1 -- 172.21.15.99:0/3965781565 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c03f520 con 0x55f713bc0480 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.765+0000 7f1888c00640 1 -- 172.21.15.99:0/3965781565 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f188c052660 con 0x55f713bc0480 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.765+0000 7f18a95d5740 10 client.5892 fetch_fsmap finished waiting for FSMap version 41 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.765+0000 7f18a95d5740 10 client.5892 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.765+0000 7f18a95d5740 20 client.5892 populate_metadata read hostname 'smithi099' 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.765+0000 7f18a95d5740 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:6833/1298775214,v1:172.21.15.187:6835/1298775214] conn(0x55f713c13e10 0x55f713c141f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.765+0000 7f18a95d5740 4 client.5892 mds_command: new command op to 5596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.765+0000 7f18a95d5740 1 -- 172.21.15.99:0/3965781565 --> [v2:172.21.15.187:6833/1298775214,v1:172.21.15.187:6835/1298775214] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f713b2fb40 con 0x55f713c13e10 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.765+0000 7f189f400640 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:6833/1298775214,v1:172.21.15.187:6835/1298775214] conn(0x55f713c13e10 0x55f713c141f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.766+0000 7f189f400640 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:6833/1298775214,v1:172.21.15.187:6835/1298775214] conn(0x55f713c13e10 0x55f713c141f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e920b3521f3a8cf8 server_cookie=a8c9e46f9a43d10e in_seq=0 out_seq=0 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.766+0000 7f1888c00640 10 client.5892 ms_handle_connect on v2:172.21.15.187:6833/1298775214 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.767+0000 7f1888c00640 1 -- 172.21.15.99:0/3965781565 <== mds.0 v2:172.21.15.187:6833/1298775214 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f713b2fb40 con 0x55f713c13e10 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.767+0000 7f1888c00640 10 client.5892 handle_command_reply: tid=0 2024-09-10T07:38:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.767+0000 7f18a95d5740 1 client.5892 shutdown 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.767+0000 7f18a95d5740 1 -- 172.21.15.99:0/3965781565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bc0480 msgr2=0x55f713bec4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.767+0000 7f18a95d5740 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bc0480 0x55f713bec4f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f188c04b040 tx=0x7f188c004730 comp rx=0 tx=0).stop 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.768+0000 7f18a95d5740 1 -- 172.21.15.99:0/3965781565 shutdown_connections 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.768+0000 7f18a95d5740 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:6833/1298775214,v1:172.21.15.187:6835/1298775214] conn(0x55f713c13e10 0x55f713c141f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.768+0000 7f18a95d5740 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713c17050 0x55f713beca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.768+0000 7f18a95d5740 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713bc0480 0x55f713bec4f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.768+0000 7f18a95d5740 1 --2- 172.21.15.99:0/3965781565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bbecf0 0x55f713c00f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.768+0000 7f1888c00640 0 client.5892 ms_handle_reset on v2:172.21.15.187:6833/1298775214 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.768+0000 7f18a95d5740 1 -- 172.21.15.99:0/3965781565 >> 172.21.15.99:0/3965781565 conn(0x55f713bbc4b0 msgr2=0x55f713c01910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.768+0000 7f18a95d5740 1 -- 172.21.15.99:0/3965781565 shutdown_connections 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.768+0000 7f18a95d5740 1 -- 172.21.15.99:0/3965781565 wait complete. 2024-09-10T07:38:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.768+0000 7f18a95d5740 20 client.5892 trim_cache size 0 max 16384 2024-09-10T07:38:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.787+0000 7f18a95d5740 1 Processor -- start 2024-09-10T07:38:02.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.787+0000 7f18a95d5740 1 -- start start 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713becaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713c133f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f18a95d5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0200370 con 0x55f713c17050 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f18a95d5740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f18a015b710 con 0x55f713bc0480 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f18a95d5740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f18a015f4e0 con 0x55f713bbecf0 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35990/0 (socket says 172.21.15.99:35990) 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189fe00640 1 -- 172.21.15.99:0/650732864 learned_addr learned my addr 172.21.15.99:0/650732864 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189f400640 1 --2- 172.21.15.99:0/650732864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713becaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189ea00640 1 --2- 172.21.15.99:0/650732864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713c133f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189fe00640 1 -- 172.21.15.99:0/650732864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 msgr2=0x55f713becaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189fe00640 1 --2- 172.21.15.99:0/650732864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713becaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189fe00640 1 -- 172.21.15.99:0/650732864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 msgr2=0x55f713c133f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189fe00640 1 --2- 172.21.15.99:0/650732864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713c133f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189fe00640 1 -- 172.21.15.99:0/650732864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f713bea400 con 0x55f713c17050 2024-09-10T07:38:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.788+0000 7f189ea00640 1 --2- 172.21.15.99:0/650732864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713c133f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.789+0000 7f189fe00640 1 --2- 172.21.15.99:0/650732864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1898003cd0 tx=0x7f1898001d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35832bc81752ba00 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.789+0000 7f188b400640 1 -- 172.21.15.99:0/650732864 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18980020b0 con 0x55f713c17050 2024-09-10T07:38:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.789+0000 7f188b400640 1 -- 172.21.15.99:0/650732864 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1898005550 con 0x55f713c17050 2024-09-10T07:38:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.789+0000 7f188b400640 1 -- 172.21.15.99:0/650732864 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898016450 con 0x55f713c17050 2024-09-10T07:38:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.789+0000 7f18a95d5740 1 -- 172.21.15.99:0/650732864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 msgr2=0x55f713c17430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.789+0000 7f18a95d5740 1 --2- 172.21.15.99:0/650732864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1898003cd0 tx=0x7f1898001d70 comp rx=0 tx=0).stop 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.790+0000 7f18a95d5740 1 -- 172.21.15.99:0/650732864 shutdown_connections 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.790+0000 7f18a95d5740 1 --2- 172.21.15.99:0/650732864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17430 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.790+0000 7f18a95d5740 1 --2- 172.21.15.99:0/650732864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713c133f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.790+0000 7f18a95d5740 1 --2- 172.21.15.99:0/650732864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713becaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.790+0000 7f18a95d5740 1 -- 172.21.15.99:0/650732864 >> 172.21.15.99:0/650732864 conn(0x55f713bbc4b0 msgr2=0x55f713c03890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.790+0000 7f18a95d5740 1 -- 172.21.15.99:0/650732864 shutdown_connections 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.790+0000 7f18a95d5740 1 -- 172.21.15.99:0/650732864 wait complete. 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.790+0000 7f18a95d5740 1 -- start start 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.791+0000 7f18a95d5740 1 Processor -- start 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.791+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713c8a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.791+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713c17430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.791+0000 7f18a95d5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.791+0000 7f18a95d5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f713be96d0 con 0x55f713c17050 2024-09-10T07:38:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.791+0000 7f18a95d5740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55f713add780 con 0x55f713bc0480 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.791+0000 7f18a95d5740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55f713be7190 con 0x55f713bbecf0 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f18a95d5740 10 client.0 _ll_register_callbacks cb 0x7f1898001720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35994/0 (socket says 172.21.15.99:35994) 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189fe00640 1 -- 172.21.15.99:0/1834823118 learned_addr learned my addr 172.21.15.99:0/1834823118 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189f400640 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713c8a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189ea00640 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713c17430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189fe00640 1 -- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 msgr2=0x55f713c8a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189fe00640 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713c8a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189fe00640 1 -- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 msgr2=0x55f713c17430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189fe00640 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713c17430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189fe00640 1 -- 172.21.15.99:0/1834823118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f713c16e40 con 0x55f713c17050 2024-09-10T07:38:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f189fe00640 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17970 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1898000f80 tx=0x7f1898001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5030ee36b80c181b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.792+0000 7f1888c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f1888c00640 1 -- 172.21.15.99:0/1834823118 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898016e00 con 0x55f713c17050 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f1888c00640 1 -- 172.21.15.99:0/1834823118 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f1898006b50 con 0x55f713c17050 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f18a95d5740 1 -- 172.21.15.99:0/1834823118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1898005550 con 0x55f713c17050 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f1888c00640 1 -- 172.21.15.99:0/1834823118 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f18980020b0 con 0x55f713c17050 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f18a95d5740 10 client.5898 fetch_fsmap learned FSMap version 41 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f18a95d5740 1 -- 172.21.15.99:0/1834823118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55f713c02430 con 0x55f713c17050 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f1888c00640 1 -- 172.21.15.99:0/1834823118 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1898005550 con 0x55f713c17050 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f1888c00640 1 -- 172.21.15.99:0/1834823118 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f1898021440 con 0x55f713c17050 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f18a95d5740 10 client.5898 fetch_fsmap finished waiting for FSMap version 41 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f18a95d5740 10 client.5898 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f18a95d5740 20 client.5898 populate_metadata read hostname 'smithi099' 2024-09-10T07:38:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f18a95d5740 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:6833/1298775214,v1:172.21.15.187:6835/1298775214] conn(0x55f713c07370 0x55f713be2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f18a95d5740 4 client.5898 mds_command: new command op to 5596 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:38:02.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.793+0000 7f18a95d5740 1 -- 172.21.15.99:0/1834823118 --> [v2:172.21.15.187:6833/1298775214,v1:172.21.15.187:6835/1298775214] -- command(tid 0: {"prefix": "status"}) -- 0x55f713be8760 con 0x55f713c07370 2024-09-10T07:38:02.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.794+0000 7f189f400640 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:6833/1298775214,v1:172.21.15.187:6835/1298775214] conn(0x55f713c07370 0x55f713be2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.794+0000 7f189f400640 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:6833/1298775214,v1:172.21.15.187:6835/1298775214] conn(0x55f713c07370 0x55f713be2970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e7630a88935361 server_cookie=d6ba5fca70e7bcc8 in_seq=0 out_seq=0 2024-09-10T07:38:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.794+0000 7f1888c00640 10 client.5898 ms_handle_connect on v2:172.21.15.187:6833/1298775214 2024-09-10T07:38:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f1888c00640 1 -- 172.21.15.99:0/1834823118 <== mds.0 v2:172.21.15.187:6833/1298775214 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f713be8760 con 0x55f713c07370 2024-09-10T07:38:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f1888c00640 10 client.5898 handle_command_reply: tid=0 2024-09-10T07:38:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 client.5898 shutdown 2024-09-10T07:38:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 -- 172.21.15.99:0/1834823118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 msgr2=0x55f713c17970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17970 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1898000f80 tx=0x7f1898001250 comp rx=0 tx=0).stop 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 -- 172.21.15.99:0/1834823118 shutdown_connections 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:6833/1298775214,v1:172.21.15.187:6835/1298775214] conn(0x55f713c07370 0x55f713be2970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f713c17050 0x55f713c17970 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f713bc0480 0x55f713c17430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 --2- 172.21.15.99:0/1834823118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f713bbecf0 0x55f713c8a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 -- 172.21.15.99:0/1834823118 >> 172.21.15.99:0/1834823118 conn(0x55f713bbc4b0 msgr2=0x55f713c054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f1888c00640 0 client.5898 ms_handle_reset on v2:172.21.15.187:6833/1298775214 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 -- 172.21.15.99:0/1834823118 shutdown_connections 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 1 -- 172.21.15.99:0/1834823118 wait complete. 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.795+0000 7f18a95d5740 20 client.5898 trim_cache size 0 max 16384 2024-09-10T07:38:02.799 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 5596, 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 6.2063693750000004, 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 41, 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 83, 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 11.293112201 2024-09-10T07:38:02.800 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:38:02.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 -- 172.21.15.99:0/3347899946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 msgr2=0x7f188006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 0x7f188006e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f188c035000 tx=0x7f188c008030 comp rx=0 tx=0).stop 2024-09-10T07:38:02.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 -- 172.21.15.99:0/3347899946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 msgr2=0x7f18a0151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 0x7f18a0151880 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f189000c4b0 tx=0x7f189000c970 comp rx=0 tx=0).stop 2024-09-10T07:38:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 -- 172.21.15.99:0/3347899946 shutdown_connections 2024-09-10T07:38:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18a00cf890 0x7f18a00b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18a00ce070 0x7f18a00ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f188006be30 0x7f188006e2f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 --2- 172.21.15.99:0/3347899946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18a00b5750 0x7f18a0151880 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 -- 172.21.15.99:0/3347899946 >> 172.21.15.99:0/3347899946 conn(0x7f18a00b2630 msgr2=0x7f18a0153540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 -- 172.21.15.99:0/3347899946 shutdown_connections 2024-09-10T07:38:02.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.796+0000 7f18a6800640 1 -- 172.21.15.99:0/3347899946 wait complete. 2024-09-10T07:38:02.812 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:38:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.965+0000 7fa48b200640 1 Processor -- start 2024-09-10T07:38:02.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.965+0000 7fa48b200640 1 -- start start 2024-09-10T07:38:02.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.966+0000 7fa48b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa48415e970 0x7fa4840d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.966+0000 7fa48b200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4840d2bd0 con 0x7fa4840cfc90 2024-09-10T07:38:02.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.966+0000 7fa48b200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4840d2eb0 con 0x7fa4840d2680 2024-09-10T07:38:02.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.966+0000 7fa48b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa4840d37e0 con 0x7fa48415e970 2024-09-10T07:38:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.967+0000 7fa489e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa48415e970 0x7fa4840d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.967+0000 7fa48a800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa4840cfc90 0x7fa4840c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60108/0 (socket says 172.21.15.99:60108) 2024-09-10T07:38:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.967+0000 7fa48a800640 1 -- 172.21.15.99:0/912764560 learned_addr learned my addr 172.21.15.99:0/912764560 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.967+0000 7fa489e00640 1 -- 172.21.15.99:0/912764560 >> v1:172.21.15.187:6789/0 conn(0x7fa4840d2680 legacy=0x7fa4840cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.967+0000 7fa489e00640 1 -- 172.21.15.99:0/912764560 >> v1:172.21.15.99:6789/0 conn(0x7fa4840cfc90 legacy=0x7fa4840c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.967+0000 7fa489e00640 1 -- 172.21.15.99:0/912764560 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4840d3190 con 0x7fa48415e970 2024-09-10T07:38:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.967+0000 7fa488a00640 1 -- 172.21.15.99:0/912764560 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651646520 0 0) 0x7fa4840d2bd0 con 0x7fa4840cfc90 2024-09-10T07:38:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.968+0000 7fa489e00640 1 --2- 172.21.15.99:0/912764560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48415e970 0x7fa4840d0300 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa4840d3960 tx=0x7fa47802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48766bc20b60bd01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.968+0000 7fa488a00640 1 -- 172.21.15.99:0/912764560 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478037070 con 0x7fa48415e970 2024-09-10T07:38:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.968+0000 7fa488a00640 1 -- 172.21.15.99:0/912764560 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478032640 con 0x7fa48415e970 2024-09-10T07:38:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.968+0000 7fa488a00640 1 -- 172.21.15.99:0/912764560 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478032a10 con 0x7fa48415e970 2024-09-10T07:38:02.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.969+0000 7fa48b200640 1 -- 172.21.15.99:0/912764560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48415e970 msgr2=0x7fa4840d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.969+0000 7fa48b200640 1 --2- 172.21.15.99:0/912764560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48415e970 0x7fa4840d0300 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa4840d3960 tx=0x7fa47802a2c0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.969+0000 7fa48b200640 1 -- 172.21.15.99:0/912764560 shutdown_connections 2024-09-10T07:38:02.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.969+0000 7fa48b200640 1 --2- 172.21.15.99:0/912764560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48415e970 0x7fa4840d0300 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.969+0000 7fa48b200640 1 -- 172.21.15.99:0/912764560 >> 172.21.15.99:0/912764560 conn(0x7fa48409de00 msgr2=0x7fa4840d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:02.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.969+0000 7fa48b200640 1 -- 172.21.15.99:0/912764560 shutdown_connections 2024-09-10T07:38:02.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.969+0000 7fa48b200640 1 -- 172.21.15.99:0/912764560 wait complete. 2024-09-10T07:38:02.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.971+0000 7fa48b200640 1 Processor -- start 2024-09-10T07:38:02.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.971+0000 7fa48b200640 1 -- start start 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa48b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4840cfc90 0x7fa484159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa48b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4840d2680 0x7fa48406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa48b200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa48415e970 0x7fa48406d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa48b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa48415ed50 con 0x7fa4840d2680 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa48b200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa4840d0840 con 0x7fa48415e970 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa48b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa48415eed0 con 0x7fa4840cfc90 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa489400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4840d2680 0x7fa48406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa489400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4840d2680 0x7fa48406d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36020/0 (socket says 172.21.15.99:36020) 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa489400640 1 -- 172.21.15.99:0/2745021943 learned_addr learned my addr 172.21.15.99:0/2745021943 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa489e00640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4840cfc90 0x7fa484159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa48a800640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa48415e970 0x7fa48406d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa489400640 1 -- 172.21.15.99:0/2745021943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4840cfc90 msgr2=0x7fa484159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa489400640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4840cfc90 0x7fa484159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa489400640 1 -- 172.21.15.99:0/2745021943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa48415e970 msgr2=0x7fa48406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa489400640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa48415e970 0x7fa48406d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa489400640 1 -- 172.21.15.99:0/2745021943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4840b9830 con 0x7fa4840d2680 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.972+0000 7fa48a800640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa48415e970 0x7fa48406d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.973+0000 7fa489400640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4840d2680 0x7fa48406d410 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa47400c450 tx=0x7fa47400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.973+0000 7fa47e000640 1 -- 172.21.15.99:0/2745021943 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4740052d0 con 0x7fa4840d2680 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.973+0000 7fa47e000640 1 -- 172.21.15.99:0/2745021943 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa474005470 con 0x7fa4840d2680 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.973+0000 7fa47e000640 1 -- 172.21.15.99:0/2745021943 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474012870 con 0x7fa4840d2680 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.973+0000 7fa48b200640 1 -- 172.21.15.99:0/2745021943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4840b7a10 con 0x7fa4840d2680 2024-09-10T07:38:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.973+0000 7fa48b200640 1 -- 172.21.15.99:0/2745021943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4840b7cb0 con 0x7fa4840d2680 2024-09-10T07:38:02.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.974+0000 7fa48b200640 1 -- 172.21.15.99:0/2745021943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4840d0300 con 0x7fa4840d2680 2024-09-10T07:38:02.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.975+0000 7fa47e000640 1 -- 172.21.15.99:0/2745021943 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa474012a10 con 0x7fa4840d2680 2024-09-10T07:38:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.976+0000 7fa47e000640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 0x7fa46806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.976+0000 7fa47e000640 1 -- 172.21.15.99:0/2745021943 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fa47408a9d0 con 0x7fa4840d2680 2024-09-10T07:38:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.976+0000 7fa489e00640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 0x7fa46806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.977+0000 7fa489e00640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 0x7fa46806e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa478034000 tx=0x7fa47802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:02.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:02.980+0000 7fa47e000640 1 -- 172.21.15.99:0/2745021943 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa474059370 con 0x7fa4840d2680 2024-09-10T07:38:03.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.187+0000 7fa48b200640 1 -- 172.21.15.99:0/2745021943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa4840b5d50 con 0x7fa4840d2680 2024-09-10T07:38:03.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.187+0000 7fa47e000640 1 -- 172.21.15.99:0/2745021943 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7fa47405f030 con 0x7fa4840d2680 2024-09-10T07:38:03.187 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:38:03.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.189+0000 7fa48b200640 1 -- 172.21.15.99:0/2745021943 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 msgr2=0x7fa46806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.189+0000 7fa48b200640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 0x7fa46806e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa478034000 tx=0x7fa47802e000 comp rx=0 tx=0).stop 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.189+0000 7fa48b200640 1 -- 172.21.15.99:0/2745021943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4840d2680 msgr2=0x7fa48406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.189+0000 7fa48b200640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4840d2680 0x7fa48406d410 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa47400c450 tx=0x7fa47400c910 comp rx=0 tx=0).stop 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.189+0000 7fa48b200640 1 -- 172.21.15.99:0/2745021943 shutdown_connections 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.189+0000 7fa48b200640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa48415e970 0x7fa48406d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.189+0000 7fa48b200640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 0x7fa46806e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.189+0000 7fa48b200640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4840d2680 0x7fa48406d410 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.189+0000 7fa48b200640 1 --2- 172.21.15.99:0/2745021943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4840cfc90 0x7fa484159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.189+0000 7fa48b200640 1 -- 172.21.15.99:0/2745021943 >> 172.21.15.99:0/2745021943 conn(0x7fa48409de00 msgr2=0x7fa4840c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.190+0000 7fa48b200640 1 -- 172.21.15.99:0/2745021943 shutdown_connections 2024-09-10T07:38:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03.190+0000 7fa48b200640 1 -- 172.21.15.99:0/2745021943 wait complete. 2024-09-10T07:38:03.205 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:38:03.205 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:38:03.205 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:38:03.205 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:38:03.205 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:38:03.205 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:38:03.205 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:38:03.205 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:38:03.205 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:38:03.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:03.206 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:38:03.242 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:38:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:38:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:38:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:38:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:03.242 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:38:03.242 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42545sec preferred_lft 42545sec 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:38:03.243 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::1c1f:52ff:fe95:9fbe/64 scope link 2024-09-10T07:38:03.244 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:03.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:03.245 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:38:03.336 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:38:03.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:03.339 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:38:03.376 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:38:03.376 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:38:03.376 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:38:03.376 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:38:03.376 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:38:03.376 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:38:03.376 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:38:03.377 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:38:03.377 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:38:03.377 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:38:03.377 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:38:03.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:38:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:38:03.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:03.573 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:38:03.609 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:38:03.610 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:38:03.610 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:38:03.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:03.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:38:03.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:38:03.706 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:38:03.741 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:38:03.741 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:38:03.742 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:38:03.816 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:38:03.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:03.817 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:38:03.945 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:38:03.946 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:38:03.977 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:38:03.977 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:38:03.977 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:38:03.977 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:38:03.977 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:38:03.979 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:38:03.979 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:38:03.979 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:38:03.979 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:38:03.979 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:38:03.982 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:38:03.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:03.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:38:04.040 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:38:04.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:38:04.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:38:04.140 INFO:teuthology.orchestra.run.smithi099.stdout:client5710 2024-09-10T07:38:04.140 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:38:04.140 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:04.177 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:38:04.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.371+0000 7f2032400640 1 Processor -- start 2024-09-10T07:38:04.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.371+0000 7f2032400640 1 -- start start 2024-09-10T07:38:04.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.372+0000 7f2032400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c13fae0 0x7f202c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:04.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.373+0000 7f2032400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202c142650 con 0x7f202c160c50 2024-09-10T07:38:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.373+0000 7f2032400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202c142930 con 0x7f202c142150 2024-09-10T07:38:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.373+0000 7f2032400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f202c0ce780 con 0x7f202c13fae0 2024-09-10T07:38:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.373+0000 7f202be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f202c160c50 0x7f202c0cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60118/0 (socket says 172.21.15.99:60118) 2024-09-10T07:38:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.373+0000 7f202be00640 1 -- 172.21.15.99:0/3274502199 learned_addr learned my addr 172.21.15.99:0/3274502199 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.373+0000 7f202b400640 1 --2- 172.21.15.99:0/3274502199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c13fae0 0x7f202c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.373+0000 7f202aa00640 1 -- 172.21.15.99:0/3274502199 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 102057203 0 0) 0x7f202c142650 con 0x7f202c160c50 2024-09-10T07:38:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.373+0000 7f202aa00640 1 -- 172.21.15.99:0/3274502199 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2010003520 con 0x7f202c160c50 2024-09-10T07:38:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.373+0000 7f202aa00640 1 -- 172.21.15.99:0/3274502199 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885716125 0 0) 0x7f202c142930 con 0x7f202c142150 2024-09-10T07:38:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.373+0000 7f202aa00640 1 -- 172.21.15.99:0/3274502199 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f202c142650 con 0x7f202c142150 2024-09-10T07:38:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.374+0000 7f202aa00640 1 -- 172.21.15.99:0/3274502199 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2421062972 0 0) 0x7f2010003520 con 0x7f202c160c50 2024-09-10T07:38:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.374+0000 7f202b400640 1 -- 172.21.15.99:0/3274502199 >> v1:172.21.15.187:6789/0 conn(0x7f202c142150 legacy=0x7f202c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.374+0000 7f202b400640 1 -- 172.21.15.99:0/3274502199 >> v1:172.21.15.99:6789/0 conn(0x7f202c160c50 legacy=0x7f202c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.374+0000 7f202b400640 1 -- 172.21.15.99:0/3274502199 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c142c10 con 0x7f202c13fae0 2024-09-10T07:38:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.375+0000 7f202b400640 1 --2- 172.21.15.99:0/3274502199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c13fae0 0x7f202c06f1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097d0 tx=0x7f201c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214c4400a6d88f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.375+0000 7f202aa00640 1 -- 172.21.15.99:0/3274502199 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c037070 con 0x7f202c13fae0 2024-09-10T07:38:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.375+0000 7f202aa00640 1 -- 172.21.15.99:0/3274502199 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c02ab90 con 0x7f202c13fae0 2024-09-10T07:38:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.375+0000 7f202aa00640 1 -- 172.21.15.99:0/3274502199 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20240019f0 con 0x7f202c13fae0 2024-09-10T07:38:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.375+0000 7f2032400640 1 -- 172.21.15.99:0/3274502199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c13fae0 msgr2=0x7f202c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.375+0000 7f2032400640 1 --2- 172.21.15.99:0/3274502199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c13fae0 0x7f202c06f1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097d0 tx=0x7f201c02a100 comp rx=0 tx=0).stop 2024-09-10T07:38:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.376+0000 7f2032400640 1 -- 172.21.15.99:0/3274502199 shutdown_connections 2024-09-10T07:38:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.376+0000 7f2032400640 1 --2- 172.21.15.99:0/3274502199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c13fae0 0x7f202c06f1b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.376+0000 7f2032400640 1 -- 172.21.15.99:0/3274502199 >> 172.21.15.99:0/3274502199 conn(0x7f202c06bc10 msgr2=0x7f202c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.376+0000 7f2032400640 1 -- 172.21.15.99:0/3274502199 shutdown_connections 2024-09-10T07:38:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.376+0000 7f2032400640 1 -- 172.21.15.99:0/3274502199 wait complete. 2024-09-10T07:38:04.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.377+0000 7f2032400640 1 Processor -- start 2024-09-10T07:38:04.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.377+0000 7f2032400640 1 -- start start 2024-09-10T07:38:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.378+0000 7f2032400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c13fae0 0x7f202c13e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.378+0000 7f2032400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c142150 0x7f202c072870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.378+0000 7f2032400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f202c160c50 0x7f202c072db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.378+0000 7f2032400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f202c06f870 con 0x7f202c13fae0 2024-09-10T07:38:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.378+0000 7f2032400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f202c06f6f0 con 0x7f202c160c50 2024-09-10T07:38:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.378+0000 7f2032400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f202c0cf320 con 0x7f202c142150 2024-09-10T07:38:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f202b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c13fae0 0x7f202c13e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f202b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c13fae0 0x7f202c13e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36028/0 (socket says 172.21.15.99:36028) 2024-09-10T07:38:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f202b400640 1 -- 172.21.15.99:0/2225815144 learned_addr learned my addr 172.21.15.99:0/2225815144 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f2022a00640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c142150 0x7f202c072870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f202be00640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f202c160c50 0x7f202c072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f202b400640 1 -- 172.21.15.99:0/2225815144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c142150 msgr2=0x7f202c072870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f202b400640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c142150 0x7f202c072870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f202b400640 1 -- 172.21.15.99:0/2225815144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f202c160c50 msgr2=0x7f202c072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f202b400640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f202c160c50 0x7f202c072db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f202b400640 1 -- 172.21.15.99:0/2225815144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c145590 con 0x7f202c13fae0 2024-09-10T07:38:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.379+0000 7f202b400640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c13fae0 0x7f202c13e2d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097d0 tx=0x7f201c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:04.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.380+0000 7f2023e00640 1 -- 172.21.15.99:0/2225815144 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c042020 con 0x7f202c13fae0 2024-09-10T07:38:04.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.380+0000 7f2023e00640 1 -- 172.21.15.99:0/2225815144 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c003a40 con 0x7f202c13fae0 2024-09-10T07:38:04.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.380+0000 7f2023e00640 1 -- 172.21.15.99:0/2225815144 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c037040 con 0x7f202c13fae0 2024-09-10T07:38:04.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.380+0000 7f2032400640 1 -- 172.21.15.99:0/2225815144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202c0b3a30 con 0x7f202c13fae0 2024-09-10T07:38:04.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.380+0000 7f2032400640 1 -- 172.21.15.99:0/2225815144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f202c0b3ff0 con 0x7f202c13fae0 2024-09-10T07:38:04.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.381+0000 7f2032400640 1 -- 172.21.15.99:0/2225815144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f202c06f1b0 con 0x7f202c13fae0 2024-09-10T07:38:04.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.382+0000 7f2023e00640 1 -- 172.21.15.99:0/2225815144 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f201c045020 con 0x7f202c13fae0 2024-09-10T07:38:04.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.382+0000 7f2023e00640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f200806be30 0x7f200806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:04.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.383+0000 7f2023e00640 1 -- 172.21.15.99:0/2225815144 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f201c0ab5c0 con 0x7f202c13fae0 2024-09-10T07:38:04.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.383+0000 7f2022a00640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f200806be30 0x7f200806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:04.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.383+0000 7f2022a00640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f200806be30 0x7f200806e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f202c156e00 tx=0x7f2014009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:04.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.387+0000 7f2023e00640 1 -- 172.21.15.99:0/2225815144 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f201c04c030 con 0x7f202c13fae0 2024-09-10T07:38:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.592+0000 7f2032400640 1 -- 172.21.15.99:0/2225815144 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f202c161110 con 0x7f202c13fae0 2024-09-10T07:38:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.593+0000 7f2023e00640 1 -- 172.21.15.99:0/2225815144 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7f201c030340 con 0x7f202c13fae0 2024-09-10T07:38:04.593 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:38:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 -- 172.21.15.99:0/2225815144 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f200806be30 msgr2=0x7f200806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f200806be30 0x7f200806e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f202c156e00 tx=0x7f2014009040 comp rx=0 tx=0).stop 2024-09-10T07:38:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 -- 172.21.15.99:0/2225815144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c13fae0 msgr2=0x7f202c13e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c13fae0 0x7f202c13e2d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097d0 tx=0x7f201c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:38:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 -- 172.21.15.99:0/2225815144 shutdown_connections 2024-09-10T07:38:04.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f202c160c50 0x7f202c072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:04.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f202c142150 0x7f202c072870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:04.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f200806be30 0x7f200806e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:04.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 --2- 172.21.15.99:0/2225815144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c13fae0 0x7f202c13e2d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:04.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 -- 172.21.15.99:0/2225815144 >> 172.21.15.99:0/2225815144 conn(0x7f202c06bc10 msgr2=0x7f202c15f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:04.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 -- 172.21.15.99:0/2225815144 shutdown_connections 2024-09-10T07:38:04.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:04.595+0000 7f2032400640 1 -- 172.21.15.99:0/2225815144 wait complete. 2024-09-10T07:38:04.613 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:38:04.613 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:38:04.613 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:38:04.613 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:38:04.613 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:38:04.613 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:38:04.614 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:38:04.614 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:38:04.614 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:38:04.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:04.614 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:38:04.654 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:38:04.655 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:38:04.655 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:38:04.655 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:04.655 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:38:04.655 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:04.656 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:38:04.656 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:38:04.656 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:38:04.656 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:38:04.656 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:38:04.657 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:38:04.657 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:38:04.657 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:38:04.657 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:38:04.657 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:38:04.657 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:38:04.658 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42539sec preferred_lft 42539sec 2024-09-10T07:38:04.658 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:38:04.658 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:04.658 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:38:04.659 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:38:04.659 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:38:04.659 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:04.659 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:38:04.659 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:04.660 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:38:04.661 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:38:04.661 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:38:04.661 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:04.662 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:38:04.662 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:38:04.662 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::84a0:e5ff:fe75:1d2e/64 scope link 2024-09-10T07:38:04.662 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:38:04.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:04.663 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:38:04.751 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:38:04.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:04.754 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:38:04.792 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:38:04.792 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:38:04.792 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:38:04.792 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:38:04.792 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:38:04.792 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:38:04.792 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:38:04.793 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:38:04.793 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:38:04.793 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:38:04.793 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:38:04.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:38:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:38:04.979 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:38:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:38:04.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:04.988 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:38:05.023 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:38:05.023 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:38:05.024 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:38:05.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:05.024 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:38:05.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:38:05.120 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:38:05.155 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:38:05.156 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:38:05.156 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:38:05.230 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:38:05.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:05.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:38:05.358 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:38:05.359 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:38:05.384 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:38:05.384 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:38:05.384 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:38:05.384 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:38:05.385 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:38:05.386 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:38:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:38:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:38:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:38:05.386 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:38:05.389 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:38:05.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:05.390 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:38:05.445 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:38:05.524 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:38:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:38:05.527 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:38:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:38:05.535 INFO:teuthology.orchestra.run.smithi187.stdout:client5297 2024-09-10T07:38:05.535 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:38:05.535 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:05.571 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:38:05.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.732+0000 7f4840c00640 1 Processor -- start 2024-09-10T07:38:05.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.732+0000 7f4840c00640 1 -- start start 2024-09-10T07:38:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.733+0000 7f4840c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f483c155c80 0x7f483c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.733+0000 7f4840c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f483c06eb60 0x7f483c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.733+0000 7f4840c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c156060 con 0x7f483c15bb80 2024-09-10T07:38:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.733+0000 7f4840c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f483c0723d0 con 0x7f483c155c80 2024-09-10T07:38:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.733+0000 7f4840c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f483c15c6f0 con 0x7f483c06eb60 2024-09-10T07:38:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.733+0000 7f483b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f483c155c80 0x7f483c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.733+0000 7f4832a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f483c15bb80 0x7f483c06e450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60134/0 (socket says 172.21.15.99:60134) 2024-09-10T07:38:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.733+0000 7f4832a00640 1 -- 172.21.15.99:0/1513413245 learned_addr learned my addr 172.21.15.99:0/1513413245 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.733+0000 7f483be00640 1 --2- 172.21.15.99:0/1513413245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f483c06eb60 0x7f483c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.734+0000 7f483b400640 1 -- 172.21.15.99:0/1513413245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f483c06eb60 msgr2=0x7f483c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.734+0000 7f483b400640 1 --2- 172.21.15.99:0/1513413245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f483c06eb60 0x7f483c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.734+0000 7f483b400640 1 -- 172.21.15.99:0/1513413245 >> v1:172.21.15.99:6789/0 conn(0x7f483c15bb80 legacy=0x7f483c06e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.734+0000 7f483b400640 1 -- 172.21.15.99:0/1513413245 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c15c9d0 con 0x7f483c155c80 2024-09-10T07:38:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.734+0000 7f483aa00640 1 -- 172.21.15.99:0/1513413245 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900864983 0 0) 0x7f4824001110 con 0x7f483c15bb80 2024-09-10T07:38:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.735+0000 7f483b400640 1 --2- 172.21.15.99:0/1513413245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c155c80 0x7f483c15cd40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f482c0097a0 tx=0x7f482c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80dfd917cd01e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.735+0000 7f483aa00640 1 -- 172.21.15.99:0/1513413245 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c037070 con 0x7f483c155c80 2024-09-10T07:38:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.735+0000 7f483aa00640 1 -- 172.21.15.99:0/1513413245 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482c032440 con 0x7f483c155c80 2024-09-10T07:38:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.735+0000 7f483aa00640 1 -- 172.21.15.99:0/1513413245 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482c032810 con 0x7f483c155c80 2024-09-10T07:38:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.735+0000 7f4840c00640 1 -- 172.21.15.99:0/1513413245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c155c80 msgr2=0x7f483c15cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.735+0000 7f4840c00640 1 --2- 172.21.15.99:0/1513413245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c155c80 0x7f483c15cd40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f482c0097a0 tx=0x7f482c02a180 comp rx=0 tx=0).stop 2024-09-10T07:38:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.736+0000 7f4840c00640 1 -- 172.21.15.99:0/1513413245 shutdown_connections 2024-09-10T07:38:05.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.736+0000 7f4840c00640 1 --2- 172.21.15.99:0/1513413245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f483c06eb60 0x7f483c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:05.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.736+0000 7f4840c00640 1 --2- 172.21.15.99:0/1513413245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c155c80 0x7f483c15cd40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:05.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.736+0000 7f4840c00640 1 -- 172.21.15.99:0/1513413245 >> 172.21.15.99:0/1513413245 conn(0x7f483c0b2810 msgr2=0x7f483c0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:05.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.736+0000 7f4840c00640 1 -- 172.21.15.99:0/1513413245 shutdown_connections 2024-09-10T07:38:05.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.736+0000 7f4840c00640 1 -- 172.21.15.99:0/1513413245 wait complete. 2024-09-10T07:38:05.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.737+0000 7f4840c00640 1 Processor -- start 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.737+0000 7f4840c00640 1 -- start start 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.738+0000 7f4840c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f483c06eb60 0x7f483c146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.738+0000 7f4840c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f483c155c80 0x7f483c0ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.738+0000 7f4840c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c15bb80 0x7f483c154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.738+0000 7f4840c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f483c071ce0 con 0x7f483c15bb80 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.738+0000 7f4840c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f483c072900 con 0x7f483c06eb60 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.738+0000 7f4840c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f483c15d280 con 0x7f483c155c80 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.738+0000 7f483be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c15bb80 0x7f483c154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.738+0000 7f483be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c15bb80 0x7f483c154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36048/0 (socket says 172.21.15.99:36048) 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.738+0000 7f483be00640 1 -- 172.21.15.99:0/195947402 learned_addr learned my addr 172.21.15.99:0/195947402 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f4832a00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f483c155c80 0x7f483c0ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f483b400640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f483c06eb60 0x7f483c146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f483be00640 1 -- 172.21.15.99:0/195947402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f483c155c80 msgr2=0x7f483c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f483be00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f483c155c80 0x7f483c0ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f483be00640 1 -- 172.21.15.99:0/195947402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f483c06eb60 msgr2=0x7f483c146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f483be00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f483c06eb60 0x7f483c146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f483be00640 1 -- 172.21.15.99:0/195947402 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c0af4a0 con 0x7f483c15bb80 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f483be00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c15bb80 0x7f483c154600 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4834007e30 tx=0x7f483400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f4833e00640 1 -- 172.21.15.99:0/195947402 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4834014620 con 0x7f483c15bb80 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f4833e00640 1 -- 172.21.15.99:0/195947402 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4834019070 con 0x7f483c15bb80 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f4840c00640 1 -- 172.21.15.99:0/195947402 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483c0af780 con 0x7f483c15bb80 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f4833e00640 1 -- 172.21.15.99:0/195947402 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4834014a00 con 0x7f483c15bb80 2024-09-10T07:38:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.739+0000 7f4840c00640 1 -- 172.21.15.99:0/195947402 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f483c0afd40 con 0x7f483c15bb80 2024-09-10T07:38:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.740+0000 7f4840c00640 1 -- 172.21.15.99:0/195947402 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f483c15cd40 con 0x7f483c15bb80 2024-09-10T07:38:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.741+0000 7f4833e00640 1 -- 172.21.15.99:0/195947402 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4834014ba0 con 0x7f483c15bb80 2024-09-10T07:38:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.742+0000 7f4833e00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f481806be30 0x7f481806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.742+0000 7f4833e00640 1 -- 172.21.15.99:0/195947402 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f483408b6b0 con 0x7f483c15bb80 2024-09-10T07:38:05.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.743+0000 7f483b400640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f481806be30 0x7f481806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:05.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.743+0000 7f483b400640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f481806be30 0x7f481806e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f482c034000 tx=0x7f482c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:05.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.746+0000 7f4833e00640 1 -- 172.21.15.99:0/195947402 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4834059970 con 0x7f483c15bb80 2024-09-10T07:38:05.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.953+0000 7f4840c00640 1 -- 172.21.15.99:0/195947402 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f483c0b2ea0 con 0x7f483c15bb80 2024-09-10T07:38:05.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.954+0000 7f4833e00640 1 -- 172.21.15.99:0/195947402 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5231 (secure 0 0 0) 0x7f483405dc70 con 0x7f483c15bb80 2024-09-10T07:38:05.955 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:05.955 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":41,"btime":"2024-09-10T07:37:59:731705+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4097816103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4097816103},{"type":"v1","addr":"172.21.15.99:6836","nonce":4097816103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1085745704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1085745704},{"type":"v1","addr":"172.21.15.99:6837","nonce":1085745704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1939216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1939216203},{"type":"v1","addr":"172.21.15.187:6834","nonce":1939216203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:37:56.004324+0000","modified":"2024-09-10T07:37:59.138242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5596},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5596":{"gid":5596,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1298775214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1298775214},{"type":"v1","addr":"172.21.15.187:6835","nonce":1298775214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5596,"qdb_cluster":[5596]},"id":5}]} 2024-09-10T07:38:05.955 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 41 2024-09-10T07:38:05.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.956+0000 7f4840c00640 1 -- 172.21.15.99:0/195947402 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f481806be30 msgr2=0x7f481806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:05.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.956+0000 7f4840c00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f481806be30 0x7f481806e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f482c034000 tx=0x7f482c02e000 comp rx=0 tx=0).stop 2024-09-10T07:38:05.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.956+0000 7f4840c00640 1 -- 172.21.15.99:0/195947402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c15bb80 msgr2=0x7f483c154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.956+0000 7f4840c00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c15bb80 0x7f483c154600 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4834007e30 tx=0x7f483400e4b0 comp rx=0 tx=0).stop 2024-09-10T07:38:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.956+0000 7f4840c00640 1 -- 172.21.15.99:0/195947402 shutdown_connections 2024-09-10T07:38:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.956+0000 7f4840c00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f481806be30 0x7f481806e2f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.956+0000 7f4840c00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f483c15bb80 0x7f483c154600 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.956+0000 7f4840c00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f483c155c80 0x7f483c0ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.956+0000 7f4840c00640 1 --2- 172.21.15.99:0/195947402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f483c06eb60 0x7f483c146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.956+0000 7f4840c00640 1 -- 172.21.15.99:0/195947402 >> 172.21.15.99:0/195947402 conn(0x7f483c0b2810 msgr2=0x7f483c14cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.957+0000 7f4840c00640 1 -- 172.21.15.99:0/195947402 shutdown_connections 2024-09-10T07:38:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:05.957+0000 7f4840c00640 1 -- 172.21.15.99:0/195947402 wait complete. 2024-09-10T07:38:05.973 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2024-09-10T07:38:06.145 INFO:teuthology.orchestra.run.smithi187.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":5596,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.545327189,"mdsmap_epoch":41,"osdmap_epoch":83,"osdmap_epoch_barrier":83,"uptime":14.632068931999999} 2024-09-10T07:38:06.146 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 5596, "mdsmap_epoch": 41, "osdmap_epoch": 83, "osdmap_epoch_barrier": 83, "rank_uptime": 9.545327189, "state": "up:active", "uptime": 14.632068932, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:38:06.146 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-10T07:38:06.313 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_mon_report_interval":"5"} 2024-09-10T07:38:06.314 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-10T07:38:06.314 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-10T07:38:06.475 INFO:teuthology.orchestra.run.smithi099.stdout:{"mon_tick_interval":"5"} 2024-09-10T07:38:06.475 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-10T07:38:06.475 INFO:tasks.cephfs.test_full:pool capacity 557102656, 531MB should be enough to fill it 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> stdin-killer -- python3 -c ' 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> import time 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> import datetime 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> # Write some buffered data through before going full, all should be well 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> print("writing some data through which we expect to succeed") 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> bytes = 0 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-10T07:38:06.476 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(f) 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> # buffered IO, the error should always only appear from fsync and not 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> # from write 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> full = False 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> for n in range(0, int(531 * 1.1)): 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> try: 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> except OSError as e: 2024-09-10T07:38:06.477 DEBUG:teuthology.orchestra.run.smithi099:> if False: 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> raise 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> else: 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> full = True 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> break 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> try: 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(f) 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> print("fsync'"'"'ed successfully") 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> except OSError as e: 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> full = True 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> break 2024-09-10T07:38:06.478 DEBUG:teuthology.orchestra.run.smithi099:> else: 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> if n > 531 * 0.9: 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> # Be cautious in the last region where we expect to hit 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> time.sleep(15.0) 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> if not full: 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> # close() should not raise an error because we already caught it in 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> # since then because all IOs got cancelled on the full flag. 2024-09-10T07:38:06.479 DEBUG:teuthology.orchestra.run.smithi099:> print("calling close") 2024-09-10T07:38:06.480 DEBUG:teuthology.orchestra.run.smithi099:> os.close(f) 2024-09-10T07:38:06.480 DEBUG:teuthology.orchestra.run.smithi099:> print("close() did not raise error") 2024-09-10T07:38:06.480 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:38:06.480 DEBUG:teuthology.orchestra.run.smithi099:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-10T07:38:06.480 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-10T07:38:12.096 INFO:teuthology.orchestra.run.smithi099.stdout:writing some data through which we expect to succeed 2024-09-10T07:38:12.096 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-10T07:38:12.096 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.096 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 1.00 MB 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 2.00 MB 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 3.00 MB 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 4.00 MB 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.097 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 5.00 MB 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 6.00 MB 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 7.00 MB 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 8.00 MB 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 9.00 MB 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.098 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 10.00 MB 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 11.00 MB 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 12.00 MB 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 13.00 MB 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 14.00 MB 2024-09-10T07:38:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.100 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.100 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 15.00 MB 2024-09-10T07:38:12.100 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.100 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.100 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 16.00 MB 2024-09-10T07:38:12.100 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.100 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.100 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 17.00 MB 2024-09-10T07:38:12.100 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.100 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.101 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 18.00 MB 2024-09-10T07:38:12.101 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.101 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.101 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 19.00 MB 2024-09-10T07:38:12.101 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.101 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 20.00 MB 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 21.00 MB 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 22.00 MB 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 23.00 MB 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.102 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 24.00 MB 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 25.00 MB 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 26.00 MB 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 27.00 MB 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 28.00 MB 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 29.00 MB 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 30.00 MB 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 31.00 MB 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 32.00 MB 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.104 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 33.00 MB 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 34.00 MB 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 35.00 MB 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 36.00 MB 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.105 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 37.00 MB 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 38.00 MB 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 39.00 MB 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 40.00 MB 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 41.00 MB 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.106 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 42.00 MB 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 43.00 MB 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 44.00 MB 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 45.00 MB 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 46.00 MB 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 47.00 MB 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 48.00 MB 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 49.00 MB 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 50.00 MB 2024-09-10T07:38:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 51.00 MB 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 52.00 MB 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 53.00 MB 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 54.00 MB 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.109 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 55.00 MB 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 56.00 MB 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 57.00 MB 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 58.00 MB 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 59.00 MB 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 60.00 MB 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 61.00 MB 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 62.00 MB 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 63.00 MB 2024-09-10T07:38:12.111 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.112 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.112 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 64.00 MB 2024-09-10T07:38:12.112 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.112 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.112 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 65.00 MB 2024-09-10T07:38:12.112 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.113 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.113 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 66.00 MB 2024-09-10T07:38:12.113 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.113 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.113 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 67.00 MB 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 68.00 MB 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 69.00 MB 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 70.00 MB 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 71.00 MB 2024-09-10T07:38:12.114 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 72.00 MB 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 73.00 MB 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 74.00 MB 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 75.00 MB 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 76.00 MB 2024-09-10T07:38:12.115 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 77.00 MB 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 78.00 MB 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 79.00 MB 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 80.00 MB 2024-09-10T07:38:12.636 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 81.00 MB 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 82.00 MB 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 83.00 MB 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.637 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 84.00 MB 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 85.00 MB 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 86.00 MB 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 87.00 MB 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 88.00 MB 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 89.00 MB 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 90.00 MB 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 91.00 MB 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 92.00 MB 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.639 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 93.00 MB 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 94.00 MB 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 95.00 MB 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 96.00 MB 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.640 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 97.00 MB 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 98.00 MB 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 99.00 MB 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 100.00 MB 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 101.00 MB 2024-09-10T07:38:12.641 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 102.00 MB 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 103.00 MB 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 104.00 MB 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 105.00 MB 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.642 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 106.00 MB 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 107.00 MB 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 108.00 MB 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 109.00 MB 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.643 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 110.00 MB 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 111.00 MB 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 112.00 MB 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 113.00 MB 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 114.00 MB 2024-09-10T07:38:12.644 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 115.00 MB 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 116.00 MB 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 117.00 MB 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 118.00 MB 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.645 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 119.00 MB 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 120.00 MB 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 121.00 MB 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 122.00 MB 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 123.00 MB 2024-09-10T07:38:12.646 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 124.00 MB 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 125.00 MB 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 126.00 MB 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 127.00 MB 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 128.00 MB 2024-09-10T07:38:12.647 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 129.00 MB 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 130.00 MB 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 131.00 MB 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 132.00 MB 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.648 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 133.00 MB 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 134.00 MB 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 135.00 MB 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 136.00 MB 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 137.00 MB 2024-09-10T07:38:12.649 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 138.00 MB 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 139.00 MB 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 140.00 MB 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 141.00 MB 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.650 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 142.00 MB 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 143.00 MB 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 144.00 MB 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 145.00 MB 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.651 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 146.00 MB 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 147.00 MB 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 148.00 MB 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 149.00 MB 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 150.00 MB 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 151.00 MB 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 152.00 MB 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 153.00 MB 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 154.00 MB 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.653 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 155.00 MB 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 156.00 MB 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 157.00 MB 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 158.00 MB 2024-09-10T07:38:12.654 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.655 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.655 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 159.00 MB 2024-09-10T07:38:12.655 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:12.655 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:12.655 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 160.00 MB 2024-09-10T07:38:12.655 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 161.00 MB 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 162.00 MB 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 163.00 MB 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.187 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 164.00 MB 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 165.00 MB 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 166.00 MB 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 167.00 MB 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 168.00 MB 2024-09-10T07:38:13.188 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 169.00 MB 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 170.00 MB 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 171.00 MB 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 172.00 MB 2024-09-10T07:38:13.189 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 173.00 MB 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 174.00 MB 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 175.00 MB 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 176.00 MB 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 177.00 MB 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 178.00 MB 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 179.00 MB 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 180.00 MB 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 181.00 MB 2024-09-10T07:38:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 182.00 MB 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 183.00 MB 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 184.00 MB 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 185.00 MB 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.192 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 186.00 MB 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 187.00 MB 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 188.00 MB 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 189.00 MB 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.193 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 190.00 MB 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 191.00 MB 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 192.00 MB 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 193.00 MB 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 194.00 MB 2024-09-10T07:38:13.194 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 195.00 MB 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 196.00 MB 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 197.00 MB 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 198.00 MB 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.195 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 199.00 MB 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 200.00 MB 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 201.00 MB 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 202.00 MB 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.196 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 203.00 MB 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 204.00 MB 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 205.00 MB 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 206.00 MB 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 207.00 MB 2024-09-10T07:38:13.197 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 208.00 MB 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 209.00 MB 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 210.00 MB 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 211.00 MB 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.198 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 212.00 MB 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 213.00 MB 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 214.00 MB 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 215.00 MB 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 216.00 MB 2024-09-10T07:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 217.00 MB 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 218.00 MB 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 219.00 MB 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 220.00 MB 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.200 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 221.00 MB 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 222.00 MB 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 223.00 MB 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 224.00 MB 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.201 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 225.00 MB 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 226.00 MB 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 227.00 MB 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 228.00 MB 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 229.00 MB 2024-09-10T07:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 230.00 MB 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 231.00 MB 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 232.00 MB 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 233.00 MB 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 234.00 MB 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 235.00 MB 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 236.00 MB 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 237.00 MB 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 238.00 MB 2024-09-10T07:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 239.00 MB 2024-09-10T07:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 240.00 MB 2024-09-10T07:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 241.00 MB 2024-09-10T07:38:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 242.00 MB 2024-09-10T07:38:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 243.00 MB 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 244.00 MB 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 245.00 MB 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 246.00 MB 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.728 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 247.00 MB 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 248.00 MB 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 249.00 MB 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 250.00 MB 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.729 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 251.00 MB 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 252.00 MB 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 253.00 MB 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 254.00 MB 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 255.00 MB 2024-09-10T07:38:13.730 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 256.00 MB 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 257.00 MB 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 258.00 MB 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 259.00 MB 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.731 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 260.00 MB 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 261.00 MB 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 262.00 MB 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 263.00 MB 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 264.00 MB 2024-09-10T07:38:13.732 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 265.00 MB 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 266.00 MB 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 267.00 MB 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 268.00 MB 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.733 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 269.00 MB 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 270.00 MB 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 271.00 MB 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 272.00 MB 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 273.00 MB 2024-09-10T07:38:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 274.00 MB 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 275.00 MB 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 276.00 MB 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 277.00 MB 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.735 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 278.00 MB 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 279.00 MB 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 280.00 MB 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 281.00 MB 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 282.00 MB 2024-09-10T07:38:13.736 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 283.00 MB 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 284.00 MB 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 285.00 MB 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 286.00 MB 2024-09-10T07:38:13.737 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 287.00 MB 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 288.00 MB 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 289.00 MB 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 290.00 MB 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.738 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 291.00 MB 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 292.00 MB 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 293.00 MB 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 294.00 MB 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 295.00 MB 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.739 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 296.00 MB 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 297.00 MB 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 298.00 MB 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 299.00 MB 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.740 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 300.00 MB 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 301.00 MB 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 302.00 MB 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 303.00 MB 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 304.00 MB 2024-09-10T07:38:13.741 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 305.00 MB 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 306.00 MB 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 307.00 MB 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 308.00 MB 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.742 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 309.00 MB 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 310.00 MB 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 311.00 MB 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 312.00 MB 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 313.00 MB 2024-09-10T07:38:13.743 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 314.00 MB 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 315.00 MB 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 316.00 MB 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 317.00 MB 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.744 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 318.00 MB 2024-09-10T07:38:13.745 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.745 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.745 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 319.00 MB 2024-09-10T07:38:13.745 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.745 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.745 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 320.00 MB 2024-09-10T07:38:13.745 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:13.745 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:13.745 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 321.00 MB 2024-09-10T07:38:14.260 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.260 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.260 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 322.00 MB 2024-09-10T07:38:14.260 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.260 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.260 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 323.00 MB 2024-09-10T07:38:14.260 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.260 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 324.00 MB 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 325.00 MB 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 326.00 MB 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 327.00 MB 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.261 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 328.00 MB 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 329.00 MB 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 330.00 MB 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 331.00 MB 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 332.00 MB 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.262 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 333.00 MB 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 334.00 MB 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 335.00 MB 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 336.00 MB 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 337.00 MB 2024-09-10T07:38:14.263 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 338.00 MB 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 339.00 MB 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 340.00 MB 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.264 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 341.00 MB 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 342.00 MB 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 343.00 MB 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 344.00 MB 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.265 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 345.00 MB 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 346.00 MB 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 347.00 MB 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 348.00 MB 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 349.00 MB 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.266 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 350.00 MB 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 351.00 MB 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 352.00 MB 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 353.00 MB 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 354.00 MB 2024-09-10T07:38:14.268 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.268 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.268 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 355.00 MB 2024-09-10T07:38:14.268 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.268 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.268 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 356.00 MB 2024-09-10T07:38:14.268 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.268 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.268 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 357.00 MB 2024-09-10T07:38:14.268 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.269 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.269 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 358.00 MB 2024-09-10T07:38:14.269 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.269 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.269 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 359.00 MB 2024-09-10T07:38:14.269 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.269 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.269 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 360.00 MB 2024-09-10T07:38:14.270 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.270 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.270 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 361.00 MB 2024-09-10T07:38:14.270 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.270 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.270 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 362.00 MB 2024-09-10T07:38:14.270 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.270 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.270 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 363.00 MB 2024-09-10T07:38:14.270 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.271 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.271 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 364.00 MB 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 365.00 MB 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 366.00 MB 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 367.00 MB 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 368.00 MB 2024-09-10T07:38:14.273 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 369.00 MB 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 370.00 MB 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 371.00 MB 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 372.00 MB 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.274 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 373.00 MB 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 374.00 MB 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 375.00 MB 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 376.00 MB 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.275 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 377.00 MB 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 378.00 MB 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 379.00 MB 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 380.00 MB 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.276 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 381.00 MB 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 382.00 MB 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 383.00 MB 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 384.00 MB 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.277 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.278 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 385.00 MB 2024-09-10T07:38:14.278 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.278 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.278 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 386.00 MB 2024-09-10T07:38:14.278 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.278 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.278 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 387.00 MB 2024-09-10T07:38:14.278 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.278 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 388.00 MB 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 389.00 MB 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 390.00 MB 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 391.00 MB 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.279 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 392.00 MB 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 393.00 MB 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 394.00 MB 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 395.00 MB 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 396.00 MB 2024-09-10T07:38:14.280 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 397.00 MB 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 398.00 MB 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 399.00 MB 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 400.00 MB 2024-09-10T07:38:14.281 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:14.282 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:14.282 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 401.00 MB 2024-09-10T07:38:16.816 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:38:16.816+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2024-09-10T07:38:16.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:38:16.852 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:38:26.729 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:38:26.730+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-10T07:38:44.840 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.840 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.840 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 402.00 MB 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 403.00 MB 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 404.00 MB 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 405.00 MB 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.841 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 406.00 MB 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 407.00 MB 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 408.00 MB 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 409.00 MB 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.842 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 410.00 MB 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 411.00 MB 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 412.00 MB 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 413.00 MB 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.843 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 414.00 MB 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 415.00 MB 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 416.00 MB 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 417.00 MB 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.844 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 418.00 MB 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 419.00 MB 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 420.00 MB 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 421.00 MB 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 422.00 MB 2024-09-10T07:38:44.845 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 423.00 MB 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 424.00 MB 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 425.00 MB 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 426.00 MB 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.846 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.847 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 427.00 MB 2024-09-10T07:38:44.847 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.847 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.847 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 428.00 MB 2024-09-10T07:38:44.847 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.847 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.847 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 429.00 MB 2024-09-10T07:38:44.847 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.847 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.847 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 430.00 MB 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 431.00 MB 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 432.00 MB 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 433.00 MB 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.848 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 434.00 MB 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 435.00 MB 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 436.00 MB 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 437.00 MB 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.849 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 438.00 MB 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 439.00 MB 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 440.00 MB 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 441.00 MB 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 442.00 MB 2024-09-10T07:38:44.850 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 443.00 MB 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 444.00 MB 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 445.00 MB 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 446.00 MB 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 447.00 MB 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 448.00 MB 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 449.00 MB 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 450.00 MB 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.852 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 451.00 MB 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 452.00 MB 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 453.00 MB 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 454.00 MB 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.853 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 455.00 MB 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 456.00 MB 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 457.00 MB 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 458.00 MB 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 459.00 MB 2024-09-10T07:38:44.854 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 460.00 MB 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 461.00 MB 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 462.00 MB 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 463.00 MB 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.855 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 464.00 MB 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 465.00 MB 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 466.00 MB 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 467.00 MB 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.856 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 468.00 MB 2024-09-10T07:38:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 469.00 MB 2024-09-10T07:38:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 470.00 MB 2024-09-10T07:38:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 471.00 MB 2024-09-10T07:38:44.858 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.858 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.858 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 472.00 MB 2024-09-10T07:38:44.858 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.858 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.858 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 473.00 MB 2024-09-10T07:38:44.858 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.858 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.858 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 474.00 MB 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 475.00 MB 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 476.00 MB 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 477.00 MB 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 478.00 MB 2024-09-10T07:38:44.859 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.860 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.860 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 479.00 MB 2024-09-10T07:38:44.860 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:38:44.860 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:38:44.860 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:38:44.860 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 480.00 MB 2024-09-10T07:38:44.860 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:38:44.927 INFO:teuthology.orchestra.run.smithi099.stdout:Reached fullness after 480.00 MB 2024-09-10T07:38:44.928 INFO:teuthology.orchestra.run.smithi099.stdout:calling close 2024-09-10T07:38:44.928 INFO:teuthology.orchestra.run.smithi099.stdout:close() did not raise error 2024-09-10T07:38:44.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:38:44.942 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:38:44.943 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:38:45.033 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:38:45.114 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:38:45.114 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:38:45.114 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:38:45.114 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:45.150 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:38:45.150 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:45.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:38:45.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.419+0000 7f6374600640 1 Processor -- start 2024-09-10T07:38:45.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.419+0000 7f6374600640 1 -- start start 2024-09-10T07:38:45.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.421+0000 7f6374600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f636c0b58e0 0x7f636c0af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.421+0000 7f6374600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f636c15ff70 con 0x7f636c0d0080 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.421+0000 7f6374600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f636c0ae970 con 0x7f636c15f210 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.421+0000 7f6374600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f636c0af990 con 0x7f636c0b58e0 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.421+0000 7f6371c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f636c0d0080 0x7f636c0b51d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59496/0 (socket says 172.21.15.99:59496) 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.421+0000 7f6371c00640 1 -- 172.21.15.99:0/1163003097 learned_addr learned my addr 172.21.15.99:0/1163003097 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.421+0000 7f6371200640 1 --2- 172.21.15.99:0/1163003097 >> v2:172.21.15.187:3300/0 conn(0x7f636c0b58e0 0x7f636c0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.422+0000 7f636be00640 1 -- 172.21.15.99:0/1163003097 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315513471 0 0) 0x7f636c15ff70 con 0x7f636c0d0080 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.422+0000 7f636be00640 1 -- 172.21.15.99:0/1163003097 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6354003520 con 0x7f636c0d0080 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.422+0000 7f636be00640 1 -- 172.21.15.99:0/1163003097 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150991984 0 0) 0x7f636c0ae970 con 0x7f636c15f210 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.422+0000 7f636be00640 1 -- 172.21.15.99:0/1163003097 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f636c15ff70 con 0x7f636c15f210 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.422+0000 7f6371200640 1 -- 172.21.15.99:0/1163003097 >> v1:172.21.15.187:6789/0 conn(0x7f636c15f210 legacy=0x7f636c15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:45.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.422+0000 7f6371200640 1 -- 172.21.15.99:0/1163003097 >> v1:172.21.15.99:6789/0 conn(0x7f636c0d0080 legacy=0x7f636c0b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:45.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.422+0000 7f636be00640 1 -- 172.21.15.99:0/1163003097 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2221179118 0 0) 0x7f6354003520 con 0x7f636c0d0080 2024-09-10T07:38:45.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.422+0000 7f6371200640 1 -- 172.21.15.99:0/1163003097 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c0aec50 con 0x7f636c0b58e0 2024-09-10T07:38:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.423+0000 7f6371200640 1 --2- 172.21.15.99:0/1163003097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f636c0b58e0 0x7f636c0af450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f63580097a0 tx=0x7f635802a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f50c7fa23b0c8c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.423+0000 7f636be00640 1 -- 172.21.15.99:0/1163003097 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358037070 con 0x7f636c0b58e0 2024-09-10T07:38:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.424+0000 7f636be00640 1 -- 172.21.15.99:0/1163003097 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635802ab30 con 0x7f636c0b58e0 2024-09-10T07:38:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.424+0000 7f636be00640 1 -- 172.21.15.99:0/1163003097 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360001670 con 0x7f636c0b58e0 2024-09-10T07:38:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.424+0000 7f6374600640 1 -- 172.21.15.99:0/1163003097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f636c0b58e0 msgr2=0x7f636c0af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.424+0000 7f6374600640 1 --2- 172.21.15.99:0/1163003097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f636c0b58e0 0x7f636c0af450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f63580097a0 tx=0x7f635802a0a0 comp rx=0 tx=0).stop 2024-09-10T07:38:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.424+0000 7f6374600640 1 -- 172.21.15.99:0/1163003097 shutdown_connections 2024-09-10T07:38:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.424+0000 7f6374600640 1 --2- 172.21.15.99:0/1163003097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f636c0b58e0 0x7f636c0af450 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.424+0000 7f6374600640 1 -- 172.21.15.99:0/1163003097 >> 172.21.15.99:0/1163003097 conn(0x7f636c0b2630 msgr2=0x7f636c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:45.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.424+0000 7f6374600640 1 -- 172.21.15.99:0/1163003097 shutdown_connections 2024-09-10T07:38:45.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.424+0000 7f6374600640 1 -- 172.21.15.99:0/1163003097 wait complete. 2024-09-10T07:38:45.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.426+0000 7f6374600640 1 Processor -- start 2024-09-10T07:38:45.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.426+0000 7f6374600640 1 -- start start 2024-09-10T07:38:45.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6374600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f636c0b58e0 0x7f636c0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:45.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6374600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636c0d0080 0x7f636c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:45.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6374600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636c15f210 0x7f636c14d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:45.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6374600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f636c160250 con 0x7f636c15f210 2024-09-10T07:38:45.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6374600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f636c15fd50 con 0x7f636c0b58e0 2024-09-10T07:38:45.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6374600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f636c0d0460 con 0x7f636c0d0080 2024-09-10T07:38:45.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6372600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636c15f210 0x7f636c14d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:45.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6372600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636c15f210 0x7f636c14d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56530/0 (socket says 172.21.15.99:56530) 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6372600640 1 -- 172.21.15.99:0/2243003456 learned_addr learned my addr 172.21.15.99:0/2243003456 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6371200640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636c0d0080 0x7f636c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.427+0000 7f6371c00640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f636c0b58e0 0x7f636c0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.428+0000 7f6372600640 1 -- 172.21.15.99:0/2243003456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636c0d0080 msgr2=0x7f636c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.428+0000 7f6372600640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636c0d0080 0x7f636c0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.428+0000 7f6372600640 1 -- 172.21.15.99:0/2243003456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f636c0b58e0 msgr2=0x7f636c0c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.428+0000 7f6372600640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f636c0b58e0 0x7f636c0c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.428+0000 7f6372600640 1 -- 172.21.15.99:0/2243003456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c14d870 con 0x7f636c15f210 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.428+0000 7f6372600640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636c15f210 0x7f636c14d330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f636400c6e0 tx=0x7f636400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.428+0000 7f6369600640 1 -- 172.21.15.99:0/2243003456 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364003b70 con 0x7f636c15f210 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.428+0000 7f6369600640 1 -- 172.21.15.99:0/2243003456 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6364003d10 con 0x7f636c15f210 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.428+0000 7f6369600640 1 -- 172.21.15.99:0/2243003456 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63640052d0 con 0x7f636c15f210 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.428+0000 7f6374600640 1 -- 172.21.15.99:0/2243003456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636c0b0a00 con 0x7f636c15f210 2024-09-10T07:38:45.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.429+0000 7f6374600640 1 -- 172.21.15.99:0/2243003456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f636c0b0fc0 con 0x7f636c15f210 2024-09-10T07:38:45.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.430+0000 7f6374600640 1 -- 172.21.15.99:0/2243003456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f636c0af450 con 0x7f636c15f210 2024-09-10T07:38:45.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.431+0000 7f6369600640 1 -- 172.21.15.99:0/2243003456 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6364005470 con 0x7f636c15f210 2024-09-10T07:38:45.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.431+0000 7f6369600640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634c06be30 0x7f634c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:45.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.431+0000 7f6369600640 1 -- 172.21.15.99:0/2243003456 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5767+0+0 (secure 0 0 0) 0x7f636408ac40 con 0x7f636c15f210 2024-09-10T07:38:45.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.432+0000 7f6371c00640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634c06be30 0x7f634c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:45.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.432+0000 7f6369600640 1 -- 172.21.15.99:0/2243003456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7f634c073a20 con 0x7f636c15f210 2024-09-10T07:38:45.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.432+0000 7f6371c00640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634c06be30 0x7f634c06e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6360001eb0 tx=0x7f63600016d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:45.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.436+0000 7f6369600640 1 -- 172.21.15.99:0/2243003456 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f636c14d870 con 0x7f636c15f210 2024-09-10T07:38:45.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.621+0000 7f6374600640 1 -- 172.21.15.99:0/2243003456 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f636c15f9c0 con 0x7f636c15f210 2024-09-10T07:38:45.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.621+0000 7f6369600640 1 -- 172.21.15.99:0/2243003456 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v88) ==== 80+0+0 (secure 0 0 0) 0x7f6364058f60 con 0x7f636c15f210 2024-09-10T07:38:45.621 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.623+0000 7f6374600640 1 -- 172.21.15.99:0/2243003456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634c06be30 msgr2=0x7f634c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.623+0000 7f6374600640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634c06be30 0x7f634c06e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6360001eb0 tx=0x7f63600016d0 comp rx=0 tx=0).stop 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.623+0000 7f6374600640 1 -- 172.21.15.99:0/2243003456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636c15f210 msgr2=0x7f636c14d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.623+0000 7f6374600640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636c15f210 0x7f636c14d330 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f636400c6e0 tx=0x7f636400cba0 comp rx=0 tx=0).stop 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.624+0000 7f6374600640 1 -- 172.21.15.99:0/2243003456 shutdown_connections 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.624+0000 7f6374600640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f634c06be30 0x7f634c06e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.624+0000 7f6374600640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f636c15f210 0x7f636c14d330 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.624+0000 7f6374600640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f636c0d0080 0x7f636c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.624+0000 7f6374600640 1 --2- 172.21.15.99:0/2243003456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f636c0b58e0 0x7f636c0c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.624+0000 7f6374600640 1 -- 172.21.15.99:0/2243003456 >> 172.21.15.99:0/2243003456 conn(0x7f636c0b2630 msgr2=0x7f636c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.624+0000 7f6374600640 1 -- 172.21.15.99:0/2243003456 shutdown_connections 2024-09-10T07:38:45.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:45.624+0000 7f6374600640 1 -- 172.21.15.99:0/2243003456 wait complete. 2024-09-10T07:38:45.640 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:38:45.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:45.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:38:45.706 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:38:45.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:45.706 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:38:45.743 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:38:45.743 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:38:45.743 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:45.783 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:38:45.783 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:45.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:38:46.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.015+0000 7fe00aa00640 1 Processor -- start 2024-09-10T07:38:46.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.015+0000 7fe00aa00640 1 -- start start 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.016+0000 7fe00aa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe00415db60 0x7fe004071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.016+0000 7fe00aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe0040724d0 0x7fe00406e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.016+0000 7fe00aa00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe004153e50 con 0x7fe00406e580 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.016+0000 7fe00aa00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe00415df40 con 0x7fe0040724d0 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.016+0000 7fe00aa00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe004072ac0 con 0x7fe00415db60 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.017+0000 7fe003400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe0040724d0 0x7fe00406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.017+0000 7fe003400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe0040724d0 0x7fe00406e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56532/0 (socket says 172.21.15.99:56532) 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.017+0000 7fe003400640 1 -- 172.21.15.99:0/211418961 learned_addr learned my addr 172.21.15.99:0/211418961 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.017+0000 7fe003e00640 1 --2- 172.21.15.99:0/211418961 >> v2:172.21.15.187:3300/0 conn(0x7fe00415db60 0x7fe004071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.017+0000 7fe003400640 1 -- 172.21.15.99:0/211418961 >> v2:172.21.15.187:3300/0 conn(0x7fe00415db60 msgr2=0x7fe004071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.017+0000 7fe003400640 1 --2- 172.21.15.99:0/211418961 >> v2:172.21.15.187:3300/0 conn(0x7fe00415db60 0x7fe004071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.017+0000 7fe003400640 1 -- 172.21.15.99:0/211418961 >> v1:172.21.15.187:6789/0 conn(0x7fe00406e580 legacy=0x7fe004160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.017+0000 7fe003400640 1 -- 172.21.15.99:0/211418961 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe004072da0 con 0x7fe0040724d0 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.018+0000 7fe003400640 1 --2- 172.21.15.99:0/211418961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0040724d0 0x7fe00406e040 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe004073f30 tx=0x7fdff002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1974990085ffd768 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.018+0000 7fe002a00640 1 -- 172.21.15.99:0/211418961 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0037070 con 0x7fe0040724d0 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.018+0000 7fe002a00640 1 -- 172.21.15.99:0/211418961 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff0032440 con 0x7fe0040724d0 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.018+0000 7fe002a00640 1 -- 172.21.15.99:0/211418961 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0032810 con 0x7fe0040724d0 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.019+0000 7fe00aa00640 1 -- 172.21.15.99:0/211418961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0040724d0 msgr2=0x7fe00406e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.019+0000 7fe00aa00640 1 --2- 172.21.15.99:0/211418961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0040724d0 0x7fe00406e040 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe004073f30 tx=0x7fdff002a270 comp rx=0 tx=0).stop 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.019+0000 7fe00aa00640 1 -- 172.21.15.99:0/211418961 shutdown_connections 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.019+0000 7fe00aa00640 1 --2- 172.21.15.99:0/211418961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0040724d0 0x7fe00406e040 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.019+0000 7fe00aa00640 1 --2- 172.21.15.99:0/211418961 >> v2:172.21.15.187:3300/0 conn(0x7fe00415db60 0x7fe004071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.019+0000 7fe00aa00640 1 -- 172.21.15.99:0/211418961 >> 172.21.15.99:0/211418961 conn(0x7fe0040b2630 msgr2=0x7fe0040b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:46.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.019+0000 7fe00aa00640 1 -- 172.21.15.99:0/211418961 shutdown_connections 2024-09-10T07:38:46.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.019+0000 7fe00aa00640 1 -- 172.21.15.99:0/211418961 wait complete. 2024-09-10T07:38:46.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.021+0000 7fe00aa00640 1 Processor -- start 2024-09-10T07:38:46.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.021+0000 7fe00aa00640 1 -- start start 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.021+0000 7fe00aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe00406e580 0x7fe0040cff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.021+0000 7fe00aa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0040724d0 0x7fe0040ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe00aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe00415db60 0x7fe004153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe00aa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe004073640 con 0x7fe00406e580 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe00aa00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe004073360 con 0x7fe0040724d0 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe00aa00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe00415d1c0 con 0x7fe00415db60 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe003e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe00406e580 0x7fe0040cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe003e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe00406e580 0x7fe0040cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56546/0 (socket says 172.21.15.99:56546) 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe003e00640 1 -- 172.21.15.99:0/1360073387 learned_addr learned my addr 172.21.15.99:0/1360073387 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe003400640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0040724d0 0x7fe0040ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe008a00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe00415db60 0x7fe004153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe003e00640 1 -- 172.21.15.99:0/1360073387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe00415db60 msgr2=0x7fe004153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe003e00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe00415db60 0x7fe004153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe003e00640 1 -- 172.21.15.99:0/1360073387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0040724d0 msgr2=0x7fe0040ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe003e00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0040724d0 0x7fe0040ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.022+0000 7fe003e00640 1 -- 172.21.15.99:0/1360073387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0041400f0 con 0x7fe00406e580 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.023+0000 7fe003e00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe00406e580 0x7fe0040cff10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdff400e870 tx=0x7fdff400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.023+0000 7fdffbe00640 1 -- 172.21.15.99:0/1360073387 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4017070 con 0x7fe00406e580 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.023+0000 7fdffbe00640 1 -- 172.21.15.99:0/1360073387 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff400c940 con 0x7fe00406e580 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.023+0000 7fe00aa00640 1 -- 172.21.15.99:0/1360073387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0041403d0 con 0x7fe00406e580 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.023+0000 7fdffbe00640 1 -- 172.21.15.99:0/1360073387 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff400cd30 con 0x7fe00406e580 2024-09-10T07:38:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.023+0000 7fe00aa00640 1 -- 172.21.15.99:0/1360073387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe004140990 con 0x7fe00406e580 2024-09-10T07:38:46.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.024+0000 7fe00aa00640 1 -- 172.21.15.99:0/1360073387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe00406e040 con 0x7fe00406e580 2024-09-10T07:38:46.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.025+0000 7fdffbe00640 1 -- 172.21.15.99:0/1360073387 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdff401a070 con 0x7fe00406e580 2024-09-10T07:38:46.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.026+0000 7fdffbe00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfe406be30 0x7fdfe406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.026+0000 7fdffbe00640 1 -- 172.21.15.99:0/1360073387 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5767+0+0 (secure 0 0 0) 0x7fdff408b0b0 con 0x7fe00406e580 2024-09-10T07:38:46.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.026+0000 7fe003400640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfe406be30 0x7fdfe406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.026+0000 7fdffbe00640 1 -- 172.21.15.99:0/1360073387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7fdfe4073a80 con 0x7fe00406e580 2024-09-10T07:38:46.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.027+0000 7fe003400640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfe406be30 0x7fdfe406e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdff0034000 tx=0x7fdff002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:46.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.030+0000 7fdffbe00640 1 -- 172.21.15.99:0/1360073387 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdff4059330 con 0x7fe00406e580 2024-09-10T07:38:46.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.216+0000 7fe00aa00640 1 -- 172.21.15.99:0/1360073387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe00406dc10 con 0x7fe00406e580 2024-09-10T07:38:46.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.217+0000 7fdffbe00640 1 -- 172.21.15.99:0/1360073387 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v88) ==== 80+0+0 (secure 0 0 0) 0x7fdff405d630 con 0x7fe00406e580 2024-09-10T07:38:46.217 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:38:46.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 -- 172.21.15.99:0/1360073387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfe406be30 msgr2=0x7fdfe406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfe406be30 0x7fdfe406e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdff0034000 tx=0x7fdff002e000 comp rx=0 tx=0).stop 2024-09-10T07:38:46.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 -- 172.21.15.99:0/1360073387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe00406e580 msgr2=0x7fe0040cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe00406e580 0x7fe0040cff10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdff400e870 tx=0x7fdff400ed30 comp rx=0 tx=0).stop 2024-09-10T07:38:46.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 -- 172.21.15.99:0/1360073387 shutdown_connections 2024-09-10T07:38:46.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe00415db60 0x7fe004153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0040724d0 0x7fe0040ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdfe406be30 0x7fdfe406e2f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 --2- 172.21.15.99:0/1360073387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe00406e580 0x7fe0040cff10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 -- 172.21.15.99:0/1360073387 >> 172.21.15.99:0/1360073387 conn(0x7fe0040b2630 msgr2=0x7fe00415f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:46.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 -- 172.21.15.99:0/1360073387 shutdown_connections 2024-09-10T07:38:46.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.219+0000 7fe00aa00640 1 -- 172.21.15.99:0/1360073387 wait complete. 2024-09-10T07:38:46.235 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:38:46.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:46.235 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T07:38:46.303 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:38:46.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:38:46.304 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:38:46.341 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:38:46.342 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:38:46.342 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:46.377 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:38:46.378 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:38:46.378 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:38:46.378 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:46.417 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:38:46.417 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:38:46.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.570+0000 7f7b6ec00640 1 Processor -- start 2024-09-10T07:38:46.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.571+0000 7f7b6ec00640 1 -- start start 2024-09-10T07:38:46.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.572+0000 7f7b6ec00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b68145290 0x7f7b6806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.572+0000 7f7b6ec00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7b680ce780 0x7f7b68072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.572+0000 7f7b6ec00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b6806e3d0 con 0x7f7b68071510 2024-09-10T07:38:46.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.572+0000 7f7b6ec00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7b6806efe0 con 0x7f7b680ce780 2024-09-10T07:38:46.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.572+0000 7f7b6ec00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7b6806e6b0 con 0x7f7b68145290 2024-09-10T07:38:46.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.572+0000 7f7b6cc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7b68071510 0x7f7b680b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59504/0 (socket says 172.21.15.99:59504) 2024-09-10T07:38:46.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.572+0000 7f7b6cc00640 1 -- 172.21.15.99:0/3518789266 learned_addr learned my addr 172.21.15.99:0/3518789266 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:46.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.572+0000 7f7b5f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7b680ce780 0x7f7b68072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.572+0000 7f7b67e00640 1 --2- 172.21.15.99:0/3518789266 >> v2:172.21.15.187:3300/0 conn(0x7f7b68145290 0x7f7b6806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.573+0000 7f7b5f400640 1 -- 172.21.15.99:0/3518789266 >> v2:172.21.15.187:3300/0 conn(0x7f7b68145290 msgr2=0x7f7b6806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:46.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.573+0000 7f7b5f400640 1 --2- 172.21.15.99:0/3518789266 >> v2:172.21.15.187:3300/0 conn(0x7f7b68145290 0x7f7b6806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.573+0000 7f7b5f400640 1 -- 172.21.15.99:0/3518789266 >> v1:172.21.15.99:6789/0 conn(0x7f7b68071510 legacy=0x7f7b680b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.573+0000 7f7b5f400640 1 -- 172.21.15.99:0/3518789266 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6806e990 con 0x7f7b680ce780 2024-09-10T07:38:46.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.573+0000 7f7b67400640 1 -- 172.21.15.99:0/3518789266 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1032382873 0 0) 0x7f7b6806e3d0 con 0x7f7b68071510 2024-09-10T07:38:46.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.574+0000 7f7b5f400640 1 --2- 172.21.15.99:0/3518789266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b680ce780 0x7f7b68072830 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7b68075940 tx=0x7f7b5002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a60005fe028066 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:46.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.574+0000 7f7b67400640 1 -- 172.21.15.99:0/3518789266 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b50037070 con 0x7f7b680ce780 2024-09-10T07:38:46.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.574+0000 7f7b67400640 1 -- 172.21.15.99:0/3518789266 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b50032440 con 0x7f7b680ce780 2024-09-10T07:38:46.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.574+0000 7f7b67400640 1 -- 172.21.15.99:0/3518789266 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b50032810 con 0x7f7b680ce780 2024-09-10T07:38:46.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.574+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3518789266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b680ce780 msgr2=0x7f7b68072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.574+0000 7f7b6ec00640 1 --2- 172.21.15.99:0/3518789266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b680ce780 0x7f7b68072830 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7b68075940 tx=0x7f7b5002a1a0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.574+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3518789266 shutdown_connections 2024-09-10T07:38:46.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.574+0000 7f7b6ec00640 1 --2- 172.21.15.99:0/3518789266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b680ce780 0x7f7b68072830 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.574+0000 7f7b6ec00640 1 --2- 172.21.15.99:0/3518789266 >> v2:172.21.15.187:3300/0 conn(0x7f7b68145290 0x7f7b6806f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.574+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3518789266 >> 172.21.15.99:0/3518789266 conn(0x7f7b6806bc10 msgr2=0x7f7b6806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:46.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.575+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3518789266 shutdown_connections 2024-09-10T07:38:46.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.575+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3518789266 wait complete. 2024-09-10T07:38:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.576+0000 7f7b6ec00640 1 Processor -- start 2024-09-10T07:38:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.576+0000 7f7b6ec00640 1 -- start start 2024-09-10T07:38:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.577+0000 7f7b6ec00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b68071510 0x7f7b680c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.577+0000 7f7b6ec00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b680ce780 0x7f7b6815b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.577+0000 7f7b6ec00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b68145290 0x7f7b680cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.577+0000 7f7b6ec00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6806df80 con 0x7f7b68071510 2024-09-10T07:38:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.577+0000 7f7b6ec00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7b68145670 con 0x7f7b680ce780 2024-09-10T07:38:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.577+0000 7f7b6ec00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7b6806e100 con 0x7f7b68145290 2024-09-10T07:38:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.577+0000 7f7b67e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b68071510 0x7f7b680c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.577+0000 7f7b67e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b68071510 0x7f7b680c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56566/0 (socket says 172.21.15.99:56566) 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b67e00640 1 -- 172.21.15.99:0/3732916387 learned_addr learned my addr 172.21.15.99:0/3732916387 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b6cc00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b68145290 0x7f7b680cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b5f400640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b680ce780 0x7f7b6815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b67e00640 1 -- 172.21.15.99:0/3732916387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b68145290 msgr2=0x7f7b680cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b67e00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b68145290 0x7f7b680cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b67e00640 1 -- 172.21.15.99:0/3732916387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b680ce780 msgr2=0x7f7b6815b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b67e00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b680ce780 0x7f7b6815b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b67e00640 1 -- 172.21.15.99:0/3732916387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b68143760 con 0x7f7b68071510 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b5f400640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b680ce780 0x7f7b6815b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b6cc00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b68145290 0x7f7b680cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:38:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b67e00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b68071510 0x7f7b680c6de0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800d800 tx=0x7f7b5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:46.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b64c00640 1 -- 172.21.15.99:0/3732916387 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5800b6c0 con 0x7f7b68071510 2024-09-10T07:38:46.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b64c00640 1 -- 172.21.15.99:0/3732916387 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b58019070 con 0x7f7b68071510 2024-09-10T07:38:46.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3732916387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b68143a40 con 0x7f7b68071510 2024-09-10T07:38:46.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.578+0000 7f7b64c00640 1 -- 172.21.15.99:0/3732916387 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5800ba80 con 0x7f7b68071510 2024-09-10T07:38:46.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.579+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3732916387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b68144000 con 0x7f7b68071510 2024-09-10T07:38:46.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.580+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3732916387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b6806f470 con 0x7f7b68071510 2024-09-10T07:38:46.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.580+0000 7f7b64c00640 1 -- 172.21.15.99:0/3732916387 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b5800bc20 con 0x7f7b68071510 2024-09-10T07:38:46.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.581+0000 7f7b64c00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b4406be60 0x7f7b4406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:46.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.581+0000 7f7b64c00640 1 -- 172.21.15.99:0/3732916387 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5767+0+0 (secure 0 0 0) 0x7f7b5808b320 con 0x7f7b68071510 2024-09-10T07:38:46.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.581+0000 7f7b5f400640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b4406be60 0x7f7b4406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:46.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.582+0000 7f7b64c00640 1 -- 172.21.15.99:0/3732916387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7f7b44073ab0 con 0x7f7b68071510 2024-09-10T07:38:46.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.582+0000 7f7b5f400640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b4406be60 0x7f7b4406e320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7b50034000 tx=0x7f7b5002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:46.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.586+0000 7f7b64c00640 1 -- 172.21.15.99:0/3732916387 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b5801c360 con 0x7f7b68071510 2024-09-10T07:38:46.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.868+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3732916387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b680b0be0 con 0x7f7b68071510 2024-09-10T07:38:46.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.869+0000 7f7b64c00640 1 -- 172.21.15.99:0/3732916387 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5231 (secure 0 0 0) 0x7f7b58059c80 con 0x7f7b68071510 2024-09-10T07:38:46.870 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:46.870 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":41,"btime":"2024-09-10T07:37:59:731705+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4097816103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4097816103},{"type":"v1","addr":"172.21.15.99:6836","nonce":4097816103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1085745704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1085745704},{"type":"v1","addr":"172.21.15.99:6837","nonce":1085745704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1939216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1939216203},{"type":"v1","addr":"172.21.15.187:6834","nonce":1939216203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:37:56.004324+0000","modified":"2024-09-10T07:37:59.138242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5596},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5596":{"gid":5596,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1298775214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1298775214},{"type":"v1","addr":"172.21.15.187:6835","nonce":1298775214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5596,"qdb_cluster":[5596]},"id":5}]} 2024-09-10T07:38:46.870 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 41 2024-09-10T07:38:46.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.871+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3732916387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b4406be60 msgr2=0x7f7b4406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.871+0000 7f7b6ec00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b4406be60 0x7f7b4406e320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7b50034000 tx=0x7f7b5002e000 comp rx=0 tx=0).stop 2024-09-10T07:38:46.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.871+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3732916387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b68071510 msgr2=0x7f7b680c6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:46.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.871+0000 7f7b6ec00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b68071510 0x7f7b680c6de0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800d800 tx=0x7f7b5800dcc0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.871+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3732916387 shutdown_connections 2024-09-10T07:38:46.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.871+0000 7f7b6ec00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b68145290 0x7f7b680cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.871+0000 7f7b6ec00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b680ce780 0x7f7b6815b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.871+0000 7f7b6ec00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b4406be60 0x7f7b4406e320 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.871+0000 7f7b6ec00640 1 --2- 172.21.15.99:0/3732916387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b68071510 0x7f7b680c6de0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:46.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.871+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3732916387 >> 172.21.15.99:0/3732916387 conn(0x7f7b6806bc10 msgr2=0x7f7b680afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:46.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.872+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3732916387 shutdown_connections 2024-09-10T07:38:46.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:46.872+0000 7f7b6ec00640 1 -- 172.21.15.99:0/3732916387 wait complete. 2024-09-10T07:38:46.888 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:38:46.944 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:38:46.948 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:38:47.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.045+0000 7f7bb7e00640 1 Processor -- start 2024-09-10T07:38:47.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.045+0000 7f7bb7e00640 1 -- start start 2024-09-10T07:38:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.046+0000 7f7bb7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7bb80c9710 0x7f7bb81695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.046+0000 7f7bb7e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bb80d2bd0 con 0x7f7bb80d2680 2024-09-10T07:38:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.046+0000 7f7bb7e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bb80d2eb0 con 0x7f7bb815e970 2024-09-10T07:38:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.046+0000 7f7bb7e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7bb80d37e0 con 0x7f7bb80c9710 2024-09-10T07:38:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.046+0000 7f7bb7400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7bb80c9710 0x7f7bb81695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.046+0000 7f7bafe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7bb80d2680 0x7f7bb80cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59520/0 (socket says 172.21.15.99:59520) 2024-09-10T07:38:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.046+0000 7f7bafe00640 1 -- 172.21.15.99:0/51424694 learned_addr learned my addr 172.21.15.99:0/51424694 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:47.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.047+0000 7f7bb7400640 1 -- 172.21.15.99:0/51424694 >> v1:172.21.15.187:6789/0 conn(0x7f7bb815e970 legacy=0x7f7bb80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.047+0000 7f7bb7400640 1 -- 172.21.15.99:0/51424694 >> v1:172.21.15.99:6789/0 conn(0x7f7bb80d2680 legacy=0x7f7bb80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.047+0000 7f7bb6000640 1 -- 172.21.15.99:0/51424694 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1485991538 0 0) 0x7f7bb80d2eb0 con 0x7f7bb815e970 2024-09-10T07:38:47.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.047+0000 7f7bb7400640 1 -- 172.21.15.99:0/51424694 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb80d3190 con 0x7f7bb80c9710 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.048+0000 7f7bb7400640 1 --2- 172.21.15.99:0/51424694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb80c9710 0x7f7bb81695e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80d3960 tx=0x7f7bb002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8618172916d301f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.048+0000 7f7bb6000640 1 -- 172.21.15.99:0/51424694 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0007740 con 0x7f7bb80c9710 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.048+0000 7f7bb6000640 1 -- 172.21.15.99:0/51424694 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb00078e0 con 0x7f7bb80c9710 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.048+0000 7f7bb6000640 1 -- 172.21.15.99:0/51424694 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0007cb0 con 0x7f7bb80c9710 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.048+0000 7f7bb7e00640 1 -- 172.21.15.99:0/51424694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb80c9710 msgr2=0x7f7bb81695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.048+0000 7f7bb7e00640 1 --2- 172.21.15.99:0/51424694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb80c9710 0x7f7bb81695e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80d3960 tx=0x7f7bb002a680 comp rx=0 tx=0).stop 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.048+0000 7f7bb7e00640 1 -- 172.21.15.99:0/51424694 shutdown_connections 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.048+0000 7f7bb7e00640 1 --2- 172.21.15.99:0/51424694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb80c9710 0x7f7bb81695e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.049+0000 7f7bb7e00640 1 -- 172.21.15.99:0/51424694 >> 172.21.15.99:0/51424694 conn(0x7f7bb809de00 msgr2=0x7f7bb80d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.049+0000 7f7bb7e00640 1 -- 172.21.15.99:0/51424694 shutdown_connections 2024-09-10T07:38:47.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.049+0000 7f7bb7e00640 1 -- 172.21.15.99:0/51424694 wait complete. 2024-09-10T07:38:47.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.050+0000 7f7bb7e00640 1 Processor -- start 2024-09-10T07:38:47.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.050+0000 7f7bb7e00640 1 -- start start 2024-09-10T07:38:47.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.051+0000 7f7bb7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bb80c9710 0x7f7bb80cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.051+0000 7f7bb7e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb80d2680 0x7f7bb80ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.051+0000 7f7bb7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb815e970 0x7f7bb80ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.051+0000 7f7bb7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb815eed0 con 0x7f7bb815e970 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.051+0000 7f7bb7e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb815ed50 con 0x7f7bb80d2680 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.051+0000 7f7bb7e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb80cfc90 con 0x7f7bb80c9710 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.051+0000 7f7bb7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb815e970 0x7f7bb80ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.051+0000 7f7bb7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb815e970 0x7f7bb80ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56584/0 (socket says 172.21.15.99:56584) 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bb7400640 1 -- 172.21.15.99:0/2344218236 learned_addr learned my addr 172.21.15.99:0/2344218236 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bafe00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb80d2680 0x7f7bb80ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bb6a00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bb80c9710 0x7f7bb80cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bb7400640 1 -- 172.21.15.99:0/2344218236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bb80c9710 msgr2=0x7f7bb80cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bb7400640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bb80c9710 0x7f7bb80cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bb7400640 1 -- 172.21.15.99:0/2344218236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb80d2680 msgr2=0x7f7bb80ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bb7400640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb80d2680 0x7f7bb80ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bb7400640 1 -- 172.21.15.99:0/2344218236 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb80b8d40 con 0x7f7bb815e970 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bafe00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb80d2680 0x7f7bb80ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:38:47.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bb6a00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bb80c9710 0x7f7bb80cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:38:47.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7bb7400640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb815e970 0x7f7bb80ce630 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7bb002ac70 tx=0x7f7bb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:47.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.052+0000 7f7baea00640 1 -- 172.21.15.99:0/2344218236 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0040070 con 0x7f7bb815e970 2024-09-10T07:38:47.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.053+0000 7f7baea00640 1 -- 172.21.15.99:0/2344218236 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb0031bc0 con 0x7f7bb815e970 2024-09-10T07:38:47.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.053+0000 7f7baea00640 1 -- 172.21.15.99:0/2344218236 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0045460 con 0x7f7bb815e970 2024-09-10T07:38:47.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.053+0000 7f7bb7e00640 1 -- 172.21.15.99:0/2344218236 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb81f4f10 con 0x7f7bb815e970 2024-09-10T07:38:47.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.053+0000 7f7bb7e00640 1 -- 172.21.15.99:0/2344218236 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb81f54d0 con 0x7f7bb815e970 2024-09-10T07:38:47.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.054+0000 7f7bb7e00640 1 -- 172.21.15.99:0/2344218236 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb80cf580 con 0x7f7bb815e970 2024-09-10T07:38:47.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.055+0000 7f7baea00640 1 -- 172.21.15.99:0/2344218236 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bb0039040 con 0x7f7bb815e970 2024-09-10T07:38:47.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.055+0000 7f7baea00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b9406be30 0x7f7b9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.055+0000 7f7baea00640 1 -- 172.21.15.99:0/2344218236 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5767+0+0 (secure 0 0 0) 0x7f7bb00ac8f0 con 0x7f7bb815e970 2024-09-10T07:38:47.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.056+0000 7f7baea00640 1 -- 172.21.15.99:0/2344218236 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7f7b94073a20 con 0x7f7bb815e970 2024-09-10T07:38:47.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.056+0000 7f7bb6a00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b9406be30 0x7f7b9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.056+0000 7f7bb6a00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b9406be30 0x7f7b9406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8000f60 tx=0x7f7ba8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:47.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.060+0000 7f7baea00640 1 -- 172.21.15.99:0/2344218236 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bb007b250 con 0x7f7bb815e970 2024-09-10T07:38:47.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.267+0000 7f7bb7e00640 1 -- 172.21.15.99:0/2344218236 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bb80c9e70 con 0x7f7bb815e970 2024-09-10T07:38:47.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.267+0000 7f7baea00640 1 -- 172.21.15.99:0/2344218236 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5231 (secure 0 0 0) 0x7f7bb007ab50 con 0x7f7bb815e970 2024-09-10T07:38:47.267 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:47.267 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":41,"btime":"2024-09-10T07:37:59:731705+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4097816103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4097816103},{"type":"v1","addr":"172.21.15.99:6836","nonce":4097816103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1085745704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1085745704},{"type":"v1","addr":"172.21.15.99:6837","nonce":1085745704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1939216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1939216203},{"type":"v1","addr":"172.21.15.187:6834","nonce":1939216203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:37:56.004324+0000","modified":"2024-09-10T07:37:59.138242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5596},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5596":{"gid":5596,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1298775214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1298775214},{"type":"v1","addr":"172.21.15.187:6835","nonce":1298775214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5596,"qdb_cluster":[5596]},"id":5}]} 2024-09-10T07:38:47.268 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 41 2024-09-10T07:38:47.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 -- 172.21.15.99:0/2344218236 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b9406be30 msgr2=0x7f7b9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b9406be30 0x7f7b9406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8000f60 tx=0x7f7ba8009040 comp rx=0 tx=0).stop 2024-09-10T07:38:47.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 -- 172.21.15.99:0/2344218236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb815e970 msgr2=0x7f7bb80ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb815e970 0x7f7bb80ce630 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7bb002ac70 tx=0x7f7bb0004a40 comp rx=0 tx=0).stop 2024-09-10T07:38:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 -- 172.21.15.99:0/2344218236 shutdown_connections 2024-09-10T07:38:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b9406be30 0x7f7b9406e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb815e970 0x7f7bb80ce630 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb80d2680 0x7f7bb80ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 --2- 172.21.15.99:0/2344218236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7bb80c9710 0x7f7bb80cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 -- 172.21.15.99:0/2344218236 >> 172.21.15.99:0/2344218236 conn(0x7f7bb809de00 msgr2=0x7f7bb80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 -- 172.21.15.99:0/2344218236 shutdown_connections 2024-09-10T07:38:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.269+0000 7f7bb7e00640 1 -- 172.21.15.99:0/2344218236 wait complete. 2024-09-10T07:38:47.285 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:38:47.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.477+0000 7f93c6800640 1 Processor -- start 2024-09-10T07:38:47.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.477+0000 7f93c6800640 1 -- start start 2024-09-10T07:38:47.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93c6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93c0142150 0x7f93c0160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93c6800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f93c0160a80 0x7f93c00cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93c6800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c0142650 con 0x7f93c013fae0 2024-09-10T07:38:47.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93c6800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f93c00ce780 con 0x7f93c0142150 2024-09-10T07:38:47.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93c6800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f93c0142930 con 0x7f93c0160a80 2024-09-10T07:38:47.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93b6a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93c0142150 0x7f93c0160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93b6a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93c0142150 0x7f93c0160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56598/0 (socket says 172.21.15.99:56598) 2024-09-10T07:38:47.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93b6a00640 1 -- 172.21.15.99:0/2990719959 learned_addr learned my addr 172.21.15.99:0/2990719959 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:47.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93bf400640 1 --1- 172.21.15.99:0/2990719959 >> v1:172.21.15.99:6789/0 conn(0x7f93c013fae0 0x7f93c006f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59532/0 (socket says 172.21.15.99:59532) 2024-09-10T07:38:47.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93bfe00640 1 --2- 172.21.15.99:0/2990719959 >> v2:172.21.15.187:3300/0 conn(0x7f93c0160a80 0x7f93c00cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93b6a00640 1 -- 172.21.15.99:0/2990719959 >> v2:172.21.15.187:3300/0 conn(0x7f93c0160a80 msgr2=0x7f93c00cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:47.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93b6a00640 1 --2- 172.21.15.99:0/2990719959 >> v2:172.21.15.187:3300/0 conn(0x7f93c0160a80 0x7f93c00cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93b6a00640 1 -- 172.21.15.99:0/2990719959 >> v1:172.21.15.99:6789/0 conn(0x7f93c013fae0 legacy=0x7f93c006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.479+0000 7f93b6a00640 1 -- 172.21.15.99:0/2990719959 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c0142c10 con 0x7f93c0142150 2024-09-10T07:38:47.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.480+0000 7f93b6a00640 1 --2- 172.21.15.99:0/2990719959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 0x7f93c0160540 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f93c00b39c0 tx=0x7f93a802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b43a9422150cce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:47.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93bea00640 1 -- 172.21.15.99:0/2990719959 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a8037070 con 0x7f93c0142150 2024-09-10T07:38:47.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93bea00640 1 -- 172.21.15.99:0/2990719959 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a8032440 con 0x7f93c0142150 2024-09-10T07:38:47.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93bea00640 1 -- 172.21.15.99:0/2990719959 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a8032810 con 0x7f93c0142150 2024-09-10T07:38:47.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93c6800640 1 -- 172.21.15.99:0/2990719959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 msgr2=0x7f93c0160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93c6800640 1 --2- 172.21.15.99:0/2990719959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 0x7f93c0160540 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f93c00b39c0 tx=0x7f93a802a200 comp rx=0 tx=0).stop 2024-09-10T07:38:47.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93c6800640 1 -- 172.21.15.99:0/2990719959 shutdown_connections 2024-09-10T07:38:47.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93c6800640 1 --2- 172.21.15.99:0/2990719959 >> v2:172.21.15.187:3300/0 conn(0x7f93c0160a80 0x7f93c00cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93c6800640 1 --2- 172.21.15.99:0/2990719959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 0x7f93c0160540 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93c6800640 1 -- 172.21.15.99:0/2990719959 >> 172.21.15.99:0/2990719959 conn(0x7f93c006bc10 msgr2=0x7f93c006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:47.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93c6800640 1 -- 172.21.15.99:0/2990719959 shutdown_connections 2024-09-10T07:38:47.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.481+0000 7f93c6800640 1 -- 172.21.15.99:0/2990719959 wait complete. 2024-09-10T07:38:47.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.483+0000 7f93c6800640 1 Processor -- start 2024-09-10T07:38:47.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.483+0000 7f93c6800640 1 -- start start 2024-09-10T07:38:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93c6800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93c013fae0 0x7f93c013f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93c6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 0x7f93c01e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93c6800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93c0160a80 0x7f93c0144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93c6800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f93c00cf2d0 con 0x7f93c0142150 2024-09-10T07:38:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93c6800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f93c00cf150 con 0x7f93c013fae0 2024-09-10T07:38:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93c6800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f93c00cf450 con 0x7f93c0160a80 2024-09-10T07:38:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93b6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 0x7f93c01e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93bfe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93c0160a80 0x7f93c0144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93b6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 0x7f93c01e6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56614/0 (socket says 172.21.15.99:56614) 2024-09-10T07:38:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93b6a00640 1 -- 172.21.15.99:0/1940580095 learned_addr learned my addr 172.21.15.99:0/1940580095 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:47.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.484+0000 7f93bf400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93c013fae0 0x7f93c013f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93b6a00640 1 -- 172.21.15.99:0/1940580095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93c0160a80 msgr2=0x7f93c0144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93b6a00640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93c0160a80 0x7f93c0144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93b6a00640 1 -- 172.21.15.99:0/1940580095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93c013fae0 msgr2=0x7f93c013f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93b6a00640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93c013fae0 0x7f93c013f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93b6a00640 1 -- 172.21.15.99:0/1940580095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c01e7830 con 0x7f93c0142150 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93b6a00640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 0x7f93c01e6d70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f93a802a240 tx=0x7f93a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93b7e00640 1 -- 172.21.15.99:0/1940580095 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a8041020 con 0x7f93c0142150 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93b7e00640 1 -- 172.21.15.99:0/1940580095 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a80306c0 con 0x7f93c0142150 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93b7e00640 1 -- 172.21.15.99:0/1940580095 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a8037040 con 0x7f93c0142150 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93c6800640 1 -- 172.21.15.99:0/1940580095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c01e7b10 con 0x7f93c0142150 2024-09-10T07:38:47.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.485+0000 7f93c6800640 1 -- 172.21.15.99:0/1940580095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c0158040 con 0x7f93c0142150 2024-09-10T07:38:47.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.486+0000 7f93c6800640 1 -- 172.21.15.99:0/1940580095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c0160540 con 0x7f93c0142150 2024-09-10T07:38:47.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.487+0000 7f93b7e00640 1 -- 172.21.15.99:0/1940580095 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93a8044020 con 0x7f93c0142150 2024-09-10T07:38:47.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.488+0000 7f93b7e00640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f939c06be30 0x7f939c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.489+0000 7f93b7e00640 1 -- 172.21.15.99:0/1940580095 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5767+0+0 (secure 0 0 0) 0x7f93a80ab470 con 0x7f93c0142150 2024-09-10T07:38:47.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.489+0000 7f93bf400640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f939c06be30 0x7f939c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.489+0000 7f93b7e00640 1 -- 172.21.15.99:0/1940580095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7f939c073a20 con 0x7f93c0142150 2024-09-10T07:38:47.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.489+0000 7f93bf400640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f939c06be30 0x7f939c06e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f93c01f5d00 tx=0x7f93b0007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:47.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.493+0000 7f93b7e00640 1 -- 172.21.15.99:0/1940580095 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93a804b030 con 0x7f93c0142150 2024-09-10T07:38:47.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.667+0000 7f93c6800640 1 -- 172.21.15.99:0/1940580095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93c00b0640 con 0x7f93c0142150 2024-09-10T07:38:47.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.668+0000 7f93b7e00640 1 -- 172.21.15.99:0/1940580095 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16845 (secure 0 0 0) 0x7f93a8079820 con 0x7f93c0142150 2024-09-10T07:38:47.669 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:47.669 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:38:17.825225+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:37:53.770507+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T07:37:55.001057+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:38:47.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.670+0000 7f93c6800640 1 -- 172.21.15.99:0/1940580095 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f939c06be30 msgr2=0x7f939c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.670+0000 7f93c6800640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f939c06be30 0x7f939c06e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f93c01f5d00 tx=0x7f93b0007e80 comp rx=0 tx=0).stop 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.670+0000 7f93c6800640 1 -- 172.21.15.99:0/1940580095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 msgr2=0x7f93c01e6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.670+0000 7f93c6800640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 0x7f93c01e6d70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f93a802a240 tx=0x7f93a80046c0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.670+0000 7f93c6800640 1 -- 172.21.15.99:0/1940580095 shutdown_connections 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.670+0000 7f93c6800640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93c0160a80 0x7f93c0144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.670+0000 7f93c6800640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f939c06be30 0x7f939c06e2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.670+0000 7f93c6800640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93c0142150 0x7f93c01e6d70 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.670+0000 7f93c6800640 1 --2- 172.21.15.99:0/1940580095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93c013fae0 0x7f93c013f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.670+0000 7f93c6800640 1 -- 172.21.15.99:0/1940580095 >> 172.21.15.99:0/1940580095 conn(0x7f93c006bc10 msgr2=0x7f93c00b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.671+0000 7f93c6800640 1 -- 172.21.15.99:0/1940580095 shutdown_connections 2024-09-10T07:38:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.671+0000 7f93c6800640 1 -- 172.21.15.99:0/1940580095 wait complete. 2024-09-10T07:38:47.687 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:38:47.688 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:38:47.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.841+0000 7f8f83e00640 1 Processor -- start 2024-09-10T07:38:47.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.841+0000 7f8f83e00640 1 -- start start 2024-09-10T07:38:47.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.842+0000 7f8f83e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8f8415eca0 0x7f8f840b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.842+0000 7f8f83e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8f840d1aa0 0x7f8f840ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.842+0000 7f8f83e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f840b1fe0 0x7f8f840b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.842+0000 7f8f83e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8f840b6d50 con 0x7f8f840d1aa0 2024-09-10T07:38:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.842+0000 7f8f83e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8f840d1ef0 con 0x7f8f8415eca0 2024-09-10T07:38:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.842+0000 7f8f83e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8f8406bc10 con 0x7f8f840b1fe0 2024-09-10T07:38:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f82000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8f840d1aa0 0x7f8f840ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f82000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8f840d1aa0 0x7f8f840ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56618/0 (socket says 172.21.15.99:56618) 2024-09-10T07:38:47.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f82000640 1 -- 172.21.15.99:0/3536657104 learned_addr learned my addr 172.21.15.99:0/3536657104 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:47.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f82a00640 1 --2- 172.21.15.99:0/3536657104 >> v2:172.21.15.187:3300/0 conn(0x7f8f8415eca0 0x7f8f840b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f83400640 1 --2- 172.21.15.99:0/3536657104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f840b1fe0 0x7f8f840b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f82000640 1 -- 172.21.15.99:0/3536657104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f840b1fe0 msgr2=0x7f8f840b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:47.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f82000640 1 --2- 172.21.15.99:0/3536657104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f840b1fe0 0x7f8f840b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f82000640 1 -- 172.21.15.99:0/3536657104 >> v2:172.21.15.187:3300/0 conn(0x7f8f8415eca0 msgr2=0x7f8f840b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:47.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f82000640 1 --2- 172.21.15.99:0/3536657104 >> v2:172.21.15.187:3300/0 conn(0x7f8f8415eca0 0x7f8f840b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f82000640 1 -- 172.21.15.99:0/3536657104 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8415f080 con 0x7f8f840d1aa0 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.843+0000 7f8f82a00640 1 --2- 172.21.15.99:0/3536657104 >> v2:172.21.15.187:3300/0 conn(0x7f8f8415eca0 0x7f8f840b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.844+0000 7f8f82000640 1 --2- 172.21.15.99:0/3536657104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840d1aa0 0x7f8f840ae0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8f700098a0 tx=0x7f8f7002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8755764fda4137d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f81600640 1 -- 172.21.15.99:0/3536657104 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70037070 con 0x7f8f840d1aa0 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f81600640 1 -- 172.21.15.99:0/3536657104 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f70032440 con 0x7f8f840d1aa0 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f81600640 1 -- 172.21.15.99:0/3536657104 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70032810 con 0x7f8f840d1aa0 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f83e00640 1 -- 172.21.15.99:0/3536657104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840d1aa0 msgr2=0x7f8f840ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f83e00640 1 --2- 172.21.15.99:0/3536657104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840d1aa0 0x7f8f840ae0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8f700098a0 tx=0x7f8f7002a1a0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f83e00640 1 -- 172.21.15.99:0/3536657104 shutdown_connections 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f83e00640 1 --2- 172.21.15.99:0/3536657104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f840b1fe0 0x7f8f840b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f83e00640 1 --2- 172.21.15.99:0/3536657104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840d1aa0 0x7f8f840ae0d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f83e00640 1 --2- 172.21.15.99:0/3536657104 >> v2:172.21.15.187:3300/0 conn(0x7f8f8415eca0 0x7f8f840b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f83e00640 1 -- 172.21.15.99:0/3536657104 >> 172.21.15.99:0/3536657104 conn(0x7f8f840b6610 msgr2=0x7f8f840b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:47.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f83e00640 1 -- 172.21.15.99:0/3536657104 shutdown_connections 2024-09-10T07:38:47.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.845+0000 7f8f83e00640 1 -- 172.21.15.99:0/3536657104 wait complete. 2024-09-10T07:38:47.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.847+0000 7f8f83e00640 1 Processor -- start 2024-09-10T07:38:47.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.847+0000 7f8f83e00640 1 -- start start 2024-09-10T07:38:47.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f83e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840b1fe0 0x7f8f84161f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f83e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f840d1aa0 0x7f8f84146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f83e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8415eca0 0x7f8f840ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f83e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8406c140 con 0x7f8f840b1fe0 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f83e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8406be60 con 0x7f8f8415eca0 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f83e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8f8406c420 con 0x7f8f840d1aa0 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f82a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840b1fe0 0x7f8f84161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f82a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840b1fe0 0x7f8f84161f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56634/0 (socket says 172.21.15.99:56634) 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f82a00640 1 -- 172.21.15.99:0/1841785602 learned_addr learned my addr 172.21.15.99:0/1841785602 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f82000640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f840d1aa0 0x7f8f84146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f83400640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8415eca0 0x7f8f840ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f82a00640 1 -- 172.21.15.99:0/1841785602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f840d1aa0 msgr2=0x7f8f84146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.848+0000 7f8f82a00640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f840d1aa0 0x7f8f84146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.849+0000 7f8f82a00640 1 -- 172.21.15.99:0/1841785602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8415eca0 msgr2=0x7f8f840ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.849+0000 7f8f82a00640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8415eca0 0x7f8f840ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.849+0000 7f8f82a00640 1 -- 172.21.15.99:0/1841785602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f841624a0 con 0x7f8f840b1fe0 2024-09-10T07:38:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.849+0000 7f8f83400640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8415eca0 0x7f8f840ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.849+0000 7f8f82a00640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840b1fe0 0x7f8f84161f60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400e960 tx=0x7f8f7400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.849+0000 7f8f7aa00640 1 -- 172.21.15.99:0/1841785602 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74017070 con 0x7f8f840b1fe0 2024-09-10T07:38:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.849+0000 7f8f7aa00640 1 -- 172.21.15.99:0/1841785602 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7400ca00 con 0x7f8f840b1fe0 2024-09-10T07:38:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.849+0000 7f8f7aa00640 1 -- 172.21.15.99:0/1841785602 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400cdd0 con 0x7f8f840b1fe0 2024-09-10T07:38:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.849+0000 7f8f83e00640 1 -- 172.21.15.99:0/1841785602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f84156940 con 0x7f8f840b1fe0 2024-09-10T07:38:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.849+0000 7f8f83e00640 1 -- 172.21.15.99:0/1841785602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f84156f00 con 0x7f8f840b1fe0 2024-09-10T07:38:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.850+0000 7f8f83e00640 1 -- 172.21.15.99:0/1841785602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f84069050 con 0x7f8f840b1fe0 2024-09-10T07:38:47.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.851+0000 7f8f7aa00640 1 -- 172.21.15.99:0/1841785602 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f7401a070 con 0x7f8f840b1fe0 2024-09-10T07:38:47.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.852+0000 7f8f7aa00640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f6406be60 0x7f8f6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:47.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.852+0000 7f8f7aa00640 1 -- 172.21.15.99:0/1841785602 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5767+0+0 (secure 0 0 0) 0x7f8f7408acd0 con 0x7f8f840b1fe0 2024-09-10T07:38:47.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.852+0000 7f8f82000640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f6406be60 0x7f8f6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:47.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.852+0000 7f8f7aa00640 1 -- 172.21.15.99:0/1841785602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7f8f64073a50 con 0x7f8f840b1fe0 2024-09-10T07:38:47.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.853+0000 7f8f82000640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f6406be60 0x7f8f6406e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8f70034000 tx=0x7f8f7002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:47.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:47.856+0000 7f8f7aa00640 1 -- 172.21.15.99:0/1841785602 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f84069050 con 0x7f8f840b1fe0 2024-09-10T07:38:48.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.065+0000 7f8f83e00640 1 -- 172.21.15.99:0/1841785602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f840b2470 con 0x7f8f840b1fe0 2024-09-10T07:38:48.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.066+0000 7f8f7aa00640 1 -- 172.21.15.99:0/1841785602 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5231 (secure 0 0 0) 0x7f8f74058fe0 con 0x7f8f840b1fe0 2024-09-10T07:38:48.066 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:48.066 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":41,"btime":"2024-09-10T07:37:59:731705+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4097816103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4097816103},{"type":"v1","addr":"172.21.15.99:6836","nonce":4097816103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1085745704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1085745704},{"type":"v1","addr":"172.21.15.99:6837","nonce":1085745704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1939216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1939216203},{"type":"v1","addr":"172.21.15.187:6834","nonce":1939216203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:37:56.004324+0000","modified":"2024-09-10T07:37:59.138242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5596},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5596":{"gid":5596,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1298775214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1298775214},{"type":"v1","addr":"172.21.15.187:6835","nonce":1298775214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5596,"qdb_cluster":[5596]},"id":5}]} 2024-09-10T07:38:48.066 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 41 2024-09-10T07:38:48.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 -- 172.21.15.99:0/1841785602 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f6406be60 msgr2=0x7f8f6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f6406be60 0x7f8f6406e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8f70034000 tx=0x7f8f7002e000 comp rx=0 tx=0).stop 2024-09-10T07:38:48.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 -- 172.21.15.99:0/1841785602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840b1fe0 msgr2=0x7f8f84161f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840b1fe0 0x7f8f84161f60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400e960 tx=0x7f8f7400ee20 comp rx=0 tx=0).stop 2024-09-10T07:38:48.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 -- 172.21.15.99:0/1841785602 shutdown_connections 2024-09-10T07:38:48.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f8415eca0 0x7f8f840ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f840d1aa0 0x7f8f84146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f6406be60 0x7f8f6406e320 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 --2- 172.21.15.99:0/1841785602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f840b1fe0 0x7f8f84161f60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 -- 172.21.15.99:0/1841785602 >> 172.21.15.99:0/1841785602 conn(0x7f8f840b6610 msgr2=0x7f8f840b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:48.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 -- 172.21.15.99:0/1841785602 shutdown_connections 2024-09-10T07:38:48.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.068+0000 7f8f83e00640 1 -- 172.21.15.99:0/1841785602 wait complete. 2024-09-10T07:38:48.084 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:38:48.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.235+0000 7f3044800640 1 Processor -- start 2024-09-10T07:38:48.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.236+0000 7f3044800640 1 -- start start 2024-09-10T07:38:48.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3044800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f303c142150 0x7f303c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3044800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f303c160a80 0x7f303c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3044800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303c142650 con 0x7f303c13fae0 2024-09-10T07:38:48.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3044800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f303c0ce780 con 0x7f303c142150 2024-09-10T07:38:48.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3044800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f303c142930 con 0x7f303c160a80 2024-09-10T07:38:48.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3041400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f303c142150 0x7f303c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:48.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3041400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f303c142150 0x7f303c160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56642/0 (socket says 172.21.15.99:56642) 2024-09-10T07:38:48.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3041400640 1 -- 172.21.15.99:0/4266346979 learned_addr learned my addr 172.21.15.99:0/4266346979 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:48.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3042800640 1 --2- 172.21.15.99:0/4266346979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f303c160a80 0x7f303c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:48.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3041400640 1 -- 172.21.15.99:0/4266346979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f303c160a80 msgr2=0x7f303c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:48.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3041400640 1 --2- 172.21.15.99:0/4266346979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f303c160a80 0x7f303c0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3041400640 1 -- 172.21.15.99:0/4266346979 >> v1:172.21.15.187:6789/0 conn(0x7f303c13fae0 legacy=0x7f303c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:48.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.237+0000 7f3041400640 1 -- 172.21.15.99:0/4266346979 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303c142c10 con 0x7f303c142150 2024-09-10T07:38:48.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.238+0000 7f3041400640 1 --2- 172.21.15.99:0/4266346979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 0x7f303c160540 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f302c009870 tx=0x7f302c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df38749a6a00399e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:48.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.239+0000 7f3040a00640 1 -- 172.21.15.99:0/4266346979 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c037070 con 0x7f303c142150 2024-09-10T07:38:48.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.239+0000 7f3040a00640 1 -- 172.21.15.99:0/4266346979 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302c032440 con 0x7f303c142150 2024-09-10T07:38:48.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.239+0000 7f3040a00640 1 -- 172.21.15.99:0/4266346979 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c032810 con 0x7f303c142150 2024-09-10T07:38:48.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.239+0000 7f3044800640 1 -- 172.21.15.99:0/4266346979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 msgr2=0x7f303c160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.239+0000 7f3044800640 1 --2- 172.21.15.99:0/4266346979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 0x7f303c160540 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f302c009870 tx=0x7f302c02a180 comp rx=0 tx=0).stop 2024-09-10T07:38:48.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.239+0000 7f3044800640 1 -- 172.21.15.99:0/4266346979 shutdown_connections 2024-09-10T07:38:48.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.239+0000 7f3044800640 1 --2- 172.21.15.99:0/4266346979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f303c160a80 0x7f303c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.239+0000 7f3044800640 1 --2- 172.21.15.99:0/4266346979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 0x7f303c160540 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.239+0000 7f3044800640 1 -- 172.21.15.99:0/4266346979 >> 172.21.15.99:0/4266346979 conn(0x7f303c06bc10 msgr2=0x7f303c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:48.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.240+0000 7f3044800640 1 -- 172.21.15.99:0/4266346979 shutdown_connections 2024-09-10T07:38:48.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.240+0000 7f3044800640 1 -- 172.21.15.99:0/4266346979 wait complete. 2024-09-10T07:38:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.241+0000 7f3044800640 1 Processor -- start 2024-09-10T07:38:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.241+0000 7f3044800640 1 -- start start 2024-09-10T07:38:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3044800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f303c13fae0 0x7f303c1448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3044800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 0x7f303c1455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3044800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303c160a80 0x7f303c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3044800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f303c0cf2d0 con 0x7f303c142150 2024-09-10T07:38:48.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3044800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f303c0cf150 con 0x7f303c160a80 2024-09-10T07:38:48.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3044800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f303c0cf450 con 0x7f303c13fae0 2024-09-10T07:38:48.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3041400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 0x7f303c1455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:48.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3042800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303c160a80 0x7f303c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:48.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3041400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 0x7f303c1455d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56654/0 (socket says 172.21.15.99:56654) 2024-09-10T07:38:48.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3041400640 1 -- 172.21.15.99:0/3378886224 learned_addr learned my addr 172.21.15.99:0/3378886224 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:48.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.242+0000 7f3041e00640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f303c13fae0 0x7f303c1448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:48.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.243+0000 7f3041400640 1 -- 172.21.15.99:0/3378886224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f303c13fae0 msgr2=0x7f303c1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.243+0000 7f3041400640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f303c13fae0 0x7f303c1448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.243+0000 7f3041400640 1 -- 172.21.15.99:0/3378886224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303c160a80 msgr2=0x7f303c145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.243+0000 7f3041400640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303c160a80 0x7f303c145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.243+0000 7f3041400640 1 -- 172.21.15.99:0/3378886224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303c143850 con 0x7f303c142150 2024-09-10T07:38:48.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.243+0000 7f3041400640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 0x7f303c1455d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f302c000c00 tx=0x7f302c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:48.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.243+0000 7f3036000640 1 -- 172.21.15.99:0/3378886224 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c041020 con 0x7f303c142150 2024-09-10T07:38:48.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.244+0000 7f3036000640 1 -- 172.21.15.99:0/3378886224 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f302c0306c0 con 0x7f303c142150 2024-09-10T07:38:48.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.244+0000 7f3044800640 1 -- 172.21.15.99:0/3378886224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303c143b30 con 0x7f303c142150 2024-09-10T07:38:48.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.244+0000 7f3036000640 1 -- 172.21.15.99:0/3378886224 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c037040 con 0x7f303c142150 2024-09-10T07:38:48.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.244+0000 7f3044800640 1 -- 172.21.15.99:0/3378886224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f303c1440f0 con 0x7f303c142150 2024-09-10T07:38:48.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.245+0000 7f3044800640 1 -- 172.21.15.99:0/3378886224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f303c160540 con 0x7f303c142150 2024-09-10T07:38:48.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.246+0000 7f3036000640 1 -- 172.21.15.99:0/3378886224 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f302c044020 con 0x7f303c142150 2024-09-10T07:38:48.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.247+0000 7f3036000640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f302006be30 0x7f302006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.247+0000 7f3036000640 1 -- 172.21.15.99:0/3378886224 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5767+0+0 (secure 0 0 0) 0x7f302c0ab580 con 0x7f303c142150 2024-09-10T07:38:48.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.247+0000 7f3041e00640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f302006be30 0x7f302006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:48.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.247+0000 7f3036000640 1 -- 172.21.15.99:0/3378886224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7f3020073a20 con 0x7f303c142150 2024-09-10T07:38:48.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.248+0000 7f3041e00640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f302006be30 0x7f302006e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f303c073540 tx=0x7f3030007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:48.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.251+0000 7f3036000640 1 -- 172.21.15.99:0/3378886224 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f302c04b030 con 0x7f303c142150 2024-09-10T07:38:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.460+0000 7f3044800640 1 -- 172.21.15.99:0/3378886224 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f303c0cfb30 con 0x7f303c142150 2024-09-10T07:38:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.461+0000 7f3036000640 1 -- 172.21.15.99:0/3378886224 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5231 (secure 0 0 0) 0x7f302c079890 con 0x7f303c142150 2024-09-10T07:38:48.461 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:48.461 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":41,"btime":"2024-09-10T07:37:59:731705+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4097816103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4097816103},{"type":"v1","addr":"172.21.15.99:6836","nonce":4097816103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1085745704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1085745704},{"type":"v1","addr":"172.21.15.99:6837","nonce":1085745704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1939216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1939216203},{"type":"v1","addr":"172.21.15.187:6834","nonce":1939216203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:37:56.004324+0000","modified":"2024-09-10T07:37:59.138242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5596},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5596":{"gid":5596,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1298775214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1298775214},{"type":"v1","addr":"172.21.15.187:6835","nonce":1298775214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5596,"qdb_cluster":[5596]},"id":5}]} 2024-09-10T07:38:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 41 2024-09-10T07:38:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 -- 172.21.15.99:0/3378886224 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f302006be30 msgr2=0x7f302006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f302006be30 0x7f302006e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f303c073540 tx=0x7f3030007e30 comp rx=0 tx=0).stop 2024-09-10T07:38:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 -- 172.21.15.99:0/3378886224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 msgr2=0x7f303c1455d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 0x7f303c1455d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f302c000c00 tx=0x7f302c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 -- 172.21.15.99:0/3378886224 shutdown_connections 2024-09-10T07:38:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303c160a80 0x7f303c145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f302006be30 0x7f302006e2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f303c142150 0x7f303c1455d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 --2- 172.21.15.99:0/3378886224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f303c13fae0 0x7f303c1448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 -- 172.21.15.99:0/3378886224 >> 172.21.15.99:0/3378886224 conn(0x7f303c06bc10 msgr2=0x7f303c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 -- 172.21.15.99:0/3378886224 shutdown_connections 2024-09-10T07:38:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.463+0000 7f3044800640 1 -- 172.21.15.99:0/3378886224 wait complete. 2024-09-10T07:38:48.479 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:38:48.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.632+0000 7fe1dfc00640 1 Processor -- start 2024-09-10T07:38:48.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.632+0000 7fe1dfc00640 1 -- start start 2024-09-10T07:38:48.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.634+0000 7fe1dfc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1d8072f40 0x7fe1d806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.634+0000 7fe1dfc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d806e3d0 con 0x7fe1d8145290 2024-09-10T07:38:48.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.634+0000 7fe1dfc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d806e6b0 con 0x7fe1d80ce780 2024-09-10T07:38:48.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.634+0000 7fe1dfc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d806efe0 con 0x7fe1d8072f40 2024-09-10T07:38:48.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.634+0000 7fe1dd200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe1d8145290 0x7fe1d8072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59546/0 (socket says 172.21.15.99:59546) 2024-09-10T07:38:48.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.634+0000 7fe1dd200640 1 -- 172.21.15.99:0/4179486010 learned_addr learned my addr 172.21.15.99:0/4179486010 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:48.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.634+0000 7fe1cfe00640 1 --2- 172.21.15.99:0/4179486010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1d8072f40 0x7fe1d806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:48.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.634+0000 7fe1d7e00640 1 -- 172.21.15.99:0/4179486010 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888737055 0 0) 0x7fe1d806e3d0 con 0x7fe1d8145290 2024-09-10T07:38:48.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.634+0000 7fe1d7e00640 1 -- 172.21.15.99:0/4179486010 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1bc003520 con 0x7fe1d8145290 2024-09-10T07:38:48.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.635+0000 7fe1cfe00640 1 -- 172.21.15.99:0/4179486010 >> v1:172.21.15.187:6789/0 conn(0x7fe1d80ce780 legacy=0x7fe1d80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.635+0000 7fe1d7e00640 1 -- 172.21.15.99:0/4179486010 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4125615194 0 0) 0x7fe1bc003520 con 0x7fe1d8145290 2024-09-10T07:38:48.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.635+0000 7fe1cfe00640 1 -- 172.21.15.99:0/4179486010 >> v1:172.21.15.99:6789/0 conn(0x7fe1d8145290 legacy=0x7fe1d8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.635+0000 7fe1cfe00640 1 -- 172.21.15.99:0/4179486010 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d806e990 con 0x7fe1d8072f40 2024-09-10T07:38:48.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.636+0000 7fe1cfe00640 1 --2- 172.21.15.99:0/4179486010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1d8072f40 0x7fe1d806f470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00097d0 tx=0x7fe1c002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bf2dfb7dcb03182 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:48.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.636+0000 7fe1d7e00640 1 -- 172.21.15.99:0/4179486010 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0037070 con 0x7fe1d8072f40 2024-09-10T07:38:48.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.636+0000 7fe1d7e00640 1 -- 172.21.15.99:0/4179486010 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c002ac30 con 0x7fe1d8072f40 2024-09-10T07:38:48.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.636+0000 7fe1d7e00640 1 -- 172.21.15.99:0/4179486010 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8001670 con 0x7fe1d8072f40 2024-09-10T07:38:48.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.636+0000 7fe1dfc00640 1 -- 172.21.15.99:0/4179486010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1d8072f40 msgr2=0x7fe1d806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.636+0000 7fe1dfc00640 1 --2- 172.21.15.99:0/4179486010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1d8072f40 0x7fe1d806f470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00097d0 tx=0x7fe1c002a1a0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.637+0000 7fe1dfc00640 1 -- 172.21.15.99:0/4179486010 shutdown_connections 2024-09-10T07:38:48.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.637+0000 7fe1dfc00640 1 --2- 172.21.15.99:0/4179486010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1d8072f40 0x7fe1d806f470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.637+0000 7fe1dfc00640 1 -- 172.21.15.99:0/4179486010 >> 172.21.15.99:0/4179486010 conn(0x7fe1d806bc10 msgr2=0x7fe1d806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:48.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.637+0000 7fe1dfc00640 1 -- 172.21.15.99:0/4179486010 shutdown_connections 2024-09-10T07:38:48.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.637+0000 7fe1dfc00640 1 -- 172.21.15.99:0/4179486010 wait complete. 2024-09-10T07:38:48.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.638+0000 7fe1dfc00640 1 Processor -- start 2024-09-10T07:38:48.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.638+0000 7fe1dfc00640 1 -- start start 2024-09-10T07:38:48.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.639+0000 7fe1dfc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1d8072f40 0x7fe1d815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.639+0000 7fe1dfc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1d80ce780 0x7fe1d815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.639+0000 7fe1dfc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8145290 0x7fe1d813a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.639+0000 7fe1dfc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d806df80 con 0x7fe1d8072f40 2024-09-10T07:38:48.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.639+0000 7fe1dfc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8145670 con 0x7fe1d8145290 2024-09-10T07:38:48.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.639+0000 7fe1dfc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d806e100 con 0x7fe1d80ce780 2024-09-10T07:38:48.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.639+0000 7fe1dd200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1d8072f40 0x7fe1d815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:48.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.639+0000 7fe1dd200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1d8072f40 0x7fe1d815b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56662/0 (socket says 172.21.15.99:56662) 2024-09-10T07:38:48.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.639+0000 7fe1dd200640 1 -- 172.21.15.99:0/3481369931 learned_addr learned my addr 172.21.15.99:0/3481369931 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:48.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1dd200640 1 -- 172.21.15.99:0/3481369931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1d80ce780 msgr2=0x7fe1d815aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1dd200640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1d80ce780 0x7fe1d815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1dd200640 1 -- 172.21.15.99:0/3481369931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8145290 msgr2=0x7fe1d813a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1ddc00640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8145290 0x7fe1d813a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1dd200640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8145290 0x7fe1d813a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1dd200640 1 -- 172.21.15.99:0/3481369931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d815dd60 con 0x7fe1d8072f40 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1ddc00640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8145290 0x7fe1d813a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1dd200640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1d8072f40 0x7fe1d815b730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c580 tx=0x7fe1c800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1d5600640 1 -- 172.21.15.99:0/3481369931 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8017070 con 0x7fe1d8072f40 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1d5600640 1 -- 172.21.15.99:0/3481369931 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c8005ce0 con 0x7fe1d8072f40 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1dfc00640 1 -- 172.21.15.99:0/3481369931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d8139eb0 con 0x7fe1d8072f40 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.640+0000 7fe1d5600640 1 -- 172.21.15.99:0/3481369931 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8007330 con 0x7fe1d8072f40 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.641+0000 7fe1dfc00640 1 -- 172.21.15.99:0/3481369931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d815dfe0 con 0x7fe1d8072f40 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.641+0000 7fe1dfc00640 1 -- 172.21.15.99:0/3481369931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d80715a0 con 0x7fe1d8072f40 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.642+0000 7fe1d5600640 1 -- 172.21.15.99:0/3481369931 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1c801a070 con 0x7fe1d8072f40 2024-09-10T07:38:48.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.643+0000 7fe1d5600640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1b406be30 0x7fe1b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:48.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.643+0000 7fe1d5600640 1 -- 172.21.15.99:0/3481369931 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5767+0+0 (secure 0 0 0) 0x7fe1c808a460 con 0x7fe1d8072f40 2024-09-10T07:38:48.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.643+0000 7fe1cfe00640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1b406be30 0x7fe1b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:48.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.644+0000 7fe1d5600640 1 -- 172.21.15.99:0/3481369931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=89}) -- 0x7fe1b4073a80 con 0x7fe1d8072f40 2024-09-10T07:38:48.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.644+0000 7fe1cfe00640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1b406be30 0x7fe1b406e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0034000 tx=0x7fe1c002c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:48.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.647+0000 7fe1d5600640 1 -- 172.21.15.99:0/3481369931 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1d815dd60 con 0x7fe1d8072f40 2024-09-10T07:38:48.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.826+0000 7fe1dfc00640 1 -- 172.21.15.99:0/3481369931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1d8072c40 con 0x7fe1d8072f40 2024-09-10T07:38:48.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.827+0000 7fe1d5600640 1 -- 172.21.15.99:0/3481369931 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16845 (secure 0 0 0) 0x7fe1c8058d40 con 0x7fe1d8072f40 2024-09-10T07:38:48.828 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:48.828 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":88,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:38:17.825225+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:37:53.770507+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T07:37:55.001057+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.14","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 -- 172.21.15.99:0/3481369931 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1b406be30 msgr2=0x7fe1b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1b406be30 0x7fe1b406e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0034000 tx=0x7fe1c002c000 comp rx=0 tx=0).stop 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 -- 172.21.15.99:0/3481369931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1d8072f40 msgr2=0x7fe1d815b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1d8072f40 0x7fe1d815b730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c580 tx=0x7fe1c800ca40 comp rx=0 tx=0).stop 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 -- 172.21.15.99:0/3481369931 shutdown_connections 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8145290 0x7fe1d813a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1d80ce780 0x7fe1d815aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1b406be30 0x7fe1b406e2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 --2- 172.21.15.99:0/3481369931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1d8072f40 0x7fe1d815b730 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 -- 172.21.15.99:0/3481369931 >> 172.21.15.99:0/3481369931 conn(0x7fe1d806bc10 msgr2=0x7fe1d80afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:48.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 -- 172.21.15.99:0/3481369931 shutdown_connections 2024-09-10T07:38:48.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:48.830+0000 7fe1dfc00640 1 -- 172.21.15.99:0/3481369931 wait complete. 2024-09-10T07:38:48.850 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:38:48.896 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:38:48.896+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2024-09-10T07:38:49.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.008+0000 7f0cb5800640 1 Processor -- start 2024-09-10T07:38:49.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.008+0000 7f0cb5800640 1 -- start start 2024-09-10T07:38:49.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.009+0000 7f0cb5800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0cb006e040 0x7f0cb006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0cb5800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cb00ce8d0 0x7f0cb00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0cb5800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cb0153e50 con 0x7f0cb015db60 2024-09-10T07:38:49.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0cb5800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0cb015df40 con 0x7f0cb006e040 2024-09-10T07:38:49.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0cb5800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb006e9d0 con 0x7f0cb00ce8d0 2024-09-10T07:38:49.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0ca6000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0cb006e040 0x7f0cb006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0ca6000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0cb006e040 0x7f0cb006e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56674/0 (socket says 172.21.15.99:56674) 2024-09-10T07:38:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0ca6000640 1 -- 172.21.15.99:0/1431603415 learned_addr learned my addr 172.21.15.99:0/1431603415 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0caf400640 1 --2- 172.21.15.99:0/1431603415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cb00ce8d0 0x7f0cb00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0ca6000640 1 -- 172.21.15.99:0/1431603415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cb00ce8d0 msgr2=0x7f0cb00ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0ca6000640 1 --2- 172.21.15.99:0/1431603415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cb00ce8d0 0x7f0cb00ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0ca6000640 1 -- 172.21.15.99:0/1431603415 >> v1:172.21.15.187:6789/0 conn(0x7f0cb015db60 legacy=0x7f0cb0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0ca6000640 1 -- 172.21.15.99:0/1431603415 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb0072ac0 con 0x7f0cb006e040 2024-09-10T07:38:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.010+0000 7f0cae000640 1 -- 172.21.15.99:0/1431603415 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2438663019 0 0) 0x7f0cb0153e50 con 0x7f0cb015db60 2024-09-10T07:38:49.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.011+0000 7f0ca6000640 1 --2- 172.21.15.99:0/1431603415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb006e040 0x7f0cb006e490 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009870 tx=0x7f0c9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9aa64ac7ce8ccd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:49.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.011+0000 7f0cae000640 1 -- 172.21.15.99:0/1431603415 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98037070 con 0x7f0cb006e040 2024-09-10T07:38:49.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.012+0000 7f0cae000640 1 -- 172.21.15.99:0/1431603415 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c98032440 con 0x7f0cb006e040 2024-09-10T07:38:49.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.012+0000 7f0cae000640 1 -- 172.21.15.99:0/1431603415 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98032810 con 0x7f0cb006e040 2024-09-10T07:38:49.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.012+0000 7f0cb5800640 1 -- 172.21.15.99:0/1431603415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb006e040 msgr2=0x7f0cb006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:49.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.012+0000 7f0cb5800640 1 --2- 172.21.15.99:0/1431603415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb006e040 0x7f0cb006e490 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009870 tx=0x7f0c9802a270 comp rx=0 tx=0).stop 2024-09-10T07:38:49.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.012+0000 7f0cb5800640 1 -- 172.21.15.99:0/1431603415 shutdown_connections 2024-09-10T07:38:49.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.012+0000 7f0cb5800640 1 --2- 172.21.15.99:0/1431603415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cb00ce8d0 0x7f0cb00ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.012+0000 7f0cb5800640 1 --2- 172.21.15.99:0/1431603415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb006e040 0x7f0cb006e490 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.012+0000 7f0cb5800640 1 -- 172.21.15.99:0/1431603415 >> 172.21.15.99:0/1431603415 conn(0x7f0cb00b2630 msgr2=0x7f0cb00b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:49.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.012+0000 7f0cb5800640 1 -- 172.21.15.99:0/1431603415 shutdown_connections 2024-09-10T07:38:49.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.012+0000 7f0cb5800640 1 -- 172.21.15.99:0/1431603415 wait complete. 2024-09-10T07:38:49.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.014+0000 7f0cb5800640 1 Processor -- start 2024-09-10T07:38:49.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.014+0000 7f0cb5800640 1 -- start start 2024-09-10T07:38:49.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0cb5800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cb006e040 0x7f0cb00cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0cb5800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb00ce8d0 0x7f0cb014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0cb5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb015db60 0x7f0cb01e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0cb5800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb0073360 con 0x7f0cb015db60 2024-09-10T07:38:49.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0cb5800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb0072e30 con 0x7f0cb00ce8d0 2024-09-10T07:38:49.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0cb5800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb0073640 con 0x7f0cb006e040 2024-09-10T07:38:49.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0caf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb015db60 0x7f0cb01e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0caf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb015db60 0x7f0cb01e83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56686/0 (socket says 172.21.15.99:56686) 2024-09-10T07:38:49.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0caf400640 1 -- 172.21.15.99:0/1188424191 learned_addr learned my addr 172.21.15.99:0/1188424191 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:49.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0caea00640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cb006e040 0x7f0cb00cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0ca6000640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb00ce8d0 0x7f0cb014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.015+0000 7f0caf400640 1 -- 172.21.15.99:0/1188424191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cb006e040 msgr2=0x7f0cb00cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.016+0000 7f0caf400640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cb006e040 0x7f0cb00cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.016+0000 7f0caf400640 1 -- 172.21.15.99:0/1188424191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb00ce8d0 msgr2=0x7f0cb014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.016+0000 7f0caf400640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb00ce8d0 0x7f0cb014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.016+0000 7f0caf400640 1 -- 172.21.15.99:0/1188424191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb014b0b0 con 0x7f0cb015db60 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.016+0000 7f0caf400640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb015db60 0x7f0cb01e83e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800efc0 tx=0x7f0ca800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.016+0000 7f0ca7400640 1 -- 172.21.15.99:0/1188424191 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8018020 con 0x7f0cb015db60 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.016+0000 7f0ca7400640 1 -- 172.21.15.99:0/1188424191 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca8014480 con 0x7f0cb015db60 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.016+0000 7f0cb5800640 1 -- 172.21.15.99:0/1188424191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb0148440 con 0x7f0cb015db60 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.016+0000 7f0ca7400640 1 -- 172.21.15.99:0/1188424191 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8014870 con 0x7f0cb015db60 2024-09-10T07:38:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.016+0000 7f0cb5800640 1 -- 172.21.15.99:0/1188424191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb0148a00 con 0x7f0cb015db60 2024-09-10T07:38:49.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.017+0000 7f0cb5800640 1 -- 172.21.15.99:0/1188424191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb006e490 con 0x7f0cb015db60 2024-09-10T07:38:49.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.018+0000 7f0ca7400640 1 -- 172.21.15.99:0/1188424191 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ca8005d10 con 0x7f0cb015db60 2024-09-10T07:38:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.019+0000 7f0ca7400640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c8c06be30 0x7f0c8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.020+0000 7f0ca7400640 1 -- 172.21.15.99:0/1188424191 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5767+0+0 (secure 0 0 0) 0x7f0ca808ba50 con 0x7f0cb015db60 2024-09-10T07:38:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.020+0000 7f0caea00640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c8c06be30 0x7f0c8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.020+0000 7f0ca7400640 1 -- 172.21.15.99:0/1188424191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7f0c8c073a20 con 0x7f0cb015db60 2024-09-10T07:38:49.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.020+0000 7f0caea00640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c8c06be30 0x7f0c8c06e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000f60 tx=0x7f0ca0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:49.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.024+0000 7f0ca7400640 1 -- 172.21.15.99:0/1188424191 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ca8022070 con 0x7f0cb015db60 2024-09-10T07:38:49.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.235+0000 7f0cb5800640 1 -- 172.21.15.99:0/1188424191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0cb00cdd60 con 0x7f0cb015db60 2024-09-10T07:38:49.235 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:38:49.235+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:38:49.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.237+0000 7f0ca7400640 1 -- 172.21.15.99:0/1188424191 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) ==== 161+0+0 (secure 0 0 0) 0x7f0cb014b0b0 con 0x7f0cb015db60 2024-09-10T07:38:49.237 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:38:49.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.238+0000 7f0ca7400640 1 -- 172.21.15.99:0/1188424191 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(90..90 src has 1..90) ==== 382+0+0 (secure 0 0 0) 0x7f0ca8057cc0 con 0x7f0cb015db60 2024-09-10T07:38:49.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.238+0000 7f0ca7400640 1 -- 172.21.15.99:0/1188424191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=91}) -- 0x7f0c8c074390 con 0x7f0cb015db60 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.241+0000 7f0cb5800640 1 -- 172.21.15.99:0/1188424191 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c8c06be30 msgr2=0x7f0c8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.241+0000 7f0cb5800640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c8c06be30 0x7f0c8c06e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000f60 tx=0x7f0ca0009040 comp rx=0 tx=0).stop 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.241+0000 7f0cb5800640 1 -- 172.21.15.99:0/1188424191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb015db60 msgr2=0x7f0cb01e83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.241+0000 7f0cb5800640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb015db60 0x7f0cb01e83e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0ca800efc0 tx=0x7f0ca800c490 comp rx=0 tx=0).stop 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.242+0000 7f0cb5800640 1 -- 172.21.15.99:0/1188424191 shutdown_connections 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.242+0000 7f0cb5800640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c8c06be30 0x7f0c8c06e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.242+0000 7f0cb5800640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cb015db60 0x7f0cb01e83e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.242+0000 7f0cb5800640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb00ce8d0 0x7f0cb014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.242+0000 7f0cb5800640 1 --2- 172.21.15.99:0/1188424191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cb006e040 0x7f0cb00cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.242+0000 7f0cb5800640 1 -- 172.21.15.99:0/1188424191 >> 172.21.15.99:0/1188424191 conn(0x7f0cb00b2630 msgr2=0x7f0cb015c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.242+0000 7f0cb5800640 1 -- 172.21.15.99:0/1188424191 shutdown_connections 2024-09-10T07:38:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.242+0000 7f0cb5800640 1 -- 172.21.15.99:0/1188424191 wait complete. 2024-09-10T07:38:49.258 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:38:49.310 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:38:49.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.415+0000 7f7b4f000640 1 Processor -- start 2024-09-10T07:38:49.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.415+0000 7f7b4f000640 1 -- start start 2024-09-10T07:38:49.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.416+0000 7f7b4f000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 0x7f7b480d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.416+0000 7f7b4f000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b480d2680 0x7f7b480cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.416+0000 7f7b4f000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b480d2bd0 con 0x7f7b480cfac0 2024-09-10T07:38:49.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.416+0000 7f7b4f000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7b480d37e0 con 0x7f7b480d2680 2024-09-10T07:38:49.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.416+0000 7f7b4f000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7b480d2eb0 con 0x7f7b4815e970 2024-09-10T07:38:49.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.416+0000 7f7b4d200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b480d2680 0x7f7b480cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.416+0000 7f7b4dc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 0x7f7b480d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.416+0000 7f7b4d200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b480d2680 0x7f7b480cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:46054/0 (socket says 172.21.15.99:46054) 2024-09-10T07:38:49.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.416+0000 7f7b4dc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 0x7f7b480d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:39698/0 (socket says 172.21.15.99:39698) 2024-09-10T07:38:49.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.416+0000 7f7b4d200640 1 -- 172.21.15.99:0/2442155520 learned_addr learned my addr 172.21.15.99:0/2442155520 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:49.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.417+0000 7f7b4d200640 1 -- 172.21.15.99:0/2442155520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 msgr2=0x7f7b480d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:49.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.417+0000 7f7b4d200640 1 --2- 172.21.15.99:0/2442155520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 0x7f7b480d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.417+0000 7f7b4d200640 1 -- 172.21.15.99:0/2442155520 >> v1:172.21.15.187:6789/0 conn(0x7f7b480cfac0 legacy=0x7f7b480d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:49.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.417+0000 7f7b4d200640 1 -- 172.21.15.99:0/2442155520 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b480d3190 con 0x7f7b480d2680 2024-09-10T07:38:49.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.418+0000 7f7b4d200640 1 --2- 172.21.15.99:0/2442155520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b480d2680 0x7f7b480cf580 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009870 tx=0x7f7b3402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c983ce38b2a3e506 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:49.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.418+0000 7f7b47e00640 1 -- 172.21.15.99:0/2442155520 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34037070 con 0x7f7b480d2680 2024-09-10T07:38:49.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.418+0000 7f7b47e00640 1 -- 172.21.15.99:0/2442155520 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3402ae50 con 0x7f7b480d2680 2024-09-10T07:38:49.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.418+0000 7f7b47e00640 1 -- 172.21.15.99:0/2442155520 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34032860 con 0x7f7b480d2680 2024-09-10T07:38:49.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.419+0000 7f7b4f000640 1 -- 172.21.15.99:0/2442155520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b480d2680 msgr2=0x7f7b480cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:49.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.419+0000 7f7b4f000640 1 --2- 172.21.15.99:0/2442155520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b480d2680 0x7f7b480cf580 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009870 tx=0x7f7b3402a300 comp rx=0 tx=0).stop 2024-09-10T07:38:49.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.419+0000 7f7b4f000640 1 -- 172.21.15.99:0/2442155520 shutdown_connections 2024-09-10T07:38:49.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.419+0000 7f7b4f000640 1 --2- 172.21.15.99:0/2442155520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b480d2680 0x7f7b480cf580 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.419+0000 7f7b4f000640 1 --2- 172.21.15.99:0/2442155520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 0x7f7b480d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.419+0000 7f7b4f000640 1 -- 172.21.15.99:0/2442155520 >> 172.21.15.99:0/2442155520 conn(0x7f7b4809de00 msgr2=0x7f7b480d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:49.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.419+0000 7f7b4f000640 1 -- 172.21.15.99:0/2442155520 shutdown_connections 2024-09-10T07:38:49.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.419+0000 7f7b4f000640 1 -- 172.21.15.99:0/2442155520 wait complete. 2024-09-10T07:38:49.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.420+0000 7f7b4f000640 1 Processor -- start 2024-09-10T07:38:49.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.421+0000 7f7b4f000640 1 -- start start 2024-09-10T07:38:49.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.421+0000 7f7b4f000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b480cfac0 0x7f7b481561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.421+0000 7f7b4f000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b480d2680 0x7f7b481e6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.421+0000 7f7b4f000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 0x7f7b48160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4f000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7b480d0840 con 0x7f7b480d2680 2024-09-10T07:38:49.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4f000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7b480cff70 con 0x7f7b480cfac0 2024-09-10T07:38:49.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4f000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4815ed50 con 0x7f7b4815e970 2024-09-10T07:38:49.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b480d2680 0x7f7b481e6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b480d2680 0x7f7b481e6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56696/0 (socket says 172.21.15.99:56696) 2024-09-10T07:38:49.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4d200640 1 -- 172.21.15.99:0/2589648568 learned_addr learned my addr 172.21.15.99:0/2589648568 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:49.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4dc00640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b480cfac0 0x7f7b481561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4e600640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 0x7f7b48160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4d200640 1 -- 172.21.15.99:0/2589648568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 msgr2=0x7f7b48160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:49.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4d200640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 0x7f7b48160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4d200640 1 -- 172.21.15.99:0/2589648568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b480cfac0 msgr2=0x7f7b481561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:49.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4d200640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b480cfac0 0x7f7b481561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:49.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.422+0000 7f7b4d200640 1 -- 172.21.15.99:0/2589648568 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b481559c0 con 0x7f7b480d2680 2024-09-10T07:38:49.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.423+0000 7f7b4d200640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b480d2680 0x7f7b481e6ff0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7b34000c00 tx=0x7f7b340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:49.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.423+0000 7f7b45600640 1 -- 172.21.15.99:0/2589648568 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34041070 con 0x7f7b480d2680 2024-09-10T07:38:49.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.423+0000 7f7b45600640 1 -- 172.21.15.99:0/2589648568 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3403c660 con 0x7f7b480d2680 2024-09-10T07:38:49.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.423+0000 7f7b45600640 1 -- 172.21.15.99:0/2589648568 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34037040 con 0x7f7b480d2680 2024-09-10T07:38:49.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.423+0000 7f7b4f000640 1 -- 172.21.15.99:0/2589648568 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b48155ca0 con 0x7f7b480d2680 2024-09-10T07:38:49.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.423+0000 7f7b4f000640 1 -- 172.21.15.99:0/2589648568 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b480b94b0 con 0x7f7b480d2680 2024-09-10T07:38:49.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.424+0000 7f7b4f000640 1 -- 172.21.15.99:0/2589648568 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b480c9420 con 0x7f7b480d2680 2024-09-10T07:38:49.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.425+0000 7f7b45600640 1 -- 172.21.15.99:0/2589648568 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b34044070 con 0x7f7b480d2680 2024-09-10T07:38:49.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.426+0000 7f7b45600640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b2806be30 0x7f7b2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:49.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.426+0000 7f7b45600640 1 -- 172.21.15.99:0/2589648568 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5853+0+0 (secure 0 0 0) 0x7f7b340ab470 con 0x7f7b480d2680 2024-09-10T07:38:49.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.426+0000 7f7b4dc00640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b2806be30 0x7f7b2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:49.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.426+0000 7f7b45600640 1 -- 172.21.15.99:0/2589648568 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=91}) -- 0x7f7b28073b20 con 0x7f7b480d2680 2024-09-10T07:38:49.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.427+0000 7f7b4dc00640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b2806be30 0x7f7b2806e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7b481f7f00 tx=0x7f7b3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:49.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.430+0000 7f7b45600640 1 -- 172.21.15.99:0/2589648568 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b480c9420 con 0x7f7b480d2680 2024-09-10T07:38:49.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:49.641+0000 7f7b4f000640 1 -- 172.21.15.99:0/2589648568 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7b48162100 con 0x7f7b480d2680 2024-09-10T07:38:50.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.240+0000 7f7b45600640 1 -- 172.21.15.99:0/2589648568 <== mon.0 v2:172.21.15.99:3300/0 7 ==== osd_map(91..91 src has 1..91) ==== 296+0+0 (secure 0 0 0) 0x7f7b340dfd50 con 0x7f7b480d2680 2024-09-10T07:38:50.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.240+0000 7f7b45600640 1 -- 172.21.15.99:0/2589648568 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=92}) -- 0x7f7b280743a0 con 0x7f7b480d2680 2024-09-10T07:38:50.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.245+0000 7f7b45600640 1 -- 172.21.15.99:0/2589648568 <== mon.0 v2:172.21.15.99:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7f7b48162100 con 0x7f7b480d2680 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.248+0000 7f7b4f000640 1 -- 172.21.15.99:0/2589648568 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b2806be30 msgr2=0x7f7b2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.248+0000 7f7b4f000640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b2806be30 0x7f7b2806e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7b481f7f00 tx=0x7f7b3c008040 comp rx=0 tx=0).stop 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.248+0000 7f7b4f000640 1 -- 172.21.15.99:0/2589648568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b480d2680 msgr2=0x7f7b481e6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.248+0000 7f7b4f000640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b480d2680 0x7f7b481e6ff0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7b34000c00 tx=0x7f7b340046c0 comp rx=0 tx=0).stop 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.249+0000 7f7b4f000640 1 -- 172.21.15.99:0/2589648568 shutdown_connections 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.249+0000 7f7b4f000640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b4815e970 0x7f7b48160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.249+0000 7f7b4f000640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b2806be30 0x7f7b2806e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.249+0000 7f7b4f000640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b480d2680 0x7f7b481e6ff0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.249+0000 7f7b4f000640 1 --2- 172.21.15.99:0/2589648568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b480cfac0 0x7f7b481561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.249+0000 7f7b4f000640 1 -- 172.21.15.99:0/2589648568 >> 172.21.15.99:0/2589648568 conn(0x7f7b4809de00 msgr2=0x7f7b480c9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.249+0000 7f7b4f000640 1 -- 172.21.15.99:0/2589648568 shutdown_connections 2024-09-10T07:38:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.249+0000 7f7b4f000640 1 -- 172.21.15.99:0/2589648568 wait complete. 2024-09-10T07:38:50.267 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:38:50.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.427+0000 7fc57a000640 1 Processor -- start 2024-09-10T07:38:50.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.427+0000 7fc57a000640 1 -- start start 2024-09-10T07:38:50.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.428+0000 7fc57a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc57406e5e0 0x7fc57406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:50.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.428+0000 7fc57a000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc57415dfc0 con 0x7fc57415e470 2024-09-10T07:38:50.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.428+0000 7fc57a000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc57415d3b0 con 0x7fc5740ce460 2024-09-10T07:38:50.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.428+0000 7fc57a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc57406ef80 con 0x7fc57406e5e0 2024-09-10T07:38:50.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.428+0000 7fc573e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc57415e470 0x7fc57415e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34074/0 (socket says 172.21.15.99:34074) 2024-09-10T07:38:50.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.428+0000 7fc573e00640 1 -- 172.21.15.99:0/1439515605 learned_addr learned my addr 172.21.15.99:0/1439515605 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:50.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.428+0000 7fc572a00640 1 --2- 172.21.15.99:0/1439515605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc57406e5e0 0x7fc57406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:50.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.429+0000 7fc572000640 1 -- 172.21.15.99:0/1439515605 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471413551 0 0) 0x7fc57415dfc0 con 0x7fc57415e470 2024-09-10T07:38:50.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.429+0000 7fc572000640 1 -- 172.21.15.99:0/1439515605 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc558003520 con 0x7fc57415e470 2024-09-10T07:38:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.429+0000 7fc572000640 1 -- 172.21.15.99:0/1439515605 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581177684 0 0) 0x7fc57415d3b0 con 0x7fc5740ce460 2024-09-10T07:38:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.429+0000 7fc572000640 1 -- 172.21.15.99:0/1439515605 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc57415dfc0 con 0x7fc5740ce460 2024-09-10T07:38:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.429+0000 7fc572000640 1 -- 172.21.15.99:0/1439515605 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1311844623 0 0) 0x7fc558003520 con 0x7fc57415e470 2024-09-10T07:38:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.429+0000 7fc572a00640 1 -- 172.21.15.99:0/1439515605 >> v1:172.21.15.187:6789/0 conn(0x7fc5740ce460 legacy=0x7fc5740cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.429+0000 7fc572a00640 1 -- 172.21.15.99:0/1439515605 >> v1:172.21.15.99:6789/0 conn(0x7fc57415e470 legacy=0x7fc57415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.429+0000 7fc572a00640 1 -- 172.21.15.99:0/1439515605 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57415d690 con 0x7fc57406e5e0 2024-09-10T07:38:50.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.430+0000 7fc572a00640 1 --2- 172.21.15.99:0/1439515605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc57406e5e0 0x7fc57406ea40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5600097d0 tx=0x7fc56002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4668c05f74b9c8ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:50.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.431+0000 7fc572000640 1 -- 172.21.15.99:0/1439515605 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560037070 con 0x7fc57406e5e0 2024-09-10T07:38:50.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.431+0000 7fc572000640 1 -- 172.21.15.99:0/1439515605 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56002ac30 con 0x7fc57406e5e0 2024-09-10T07:38:50.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.431+0000 7fc572000640 1 -- 172.21.15.99:0/1439515605 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c0019f0 con 0x7fc57406e5e0 2024-09-10T07:38:50.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.431+0000 7fc57a000640 1 -- 172.21.15.99:0/1439515605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc57406e5e0 msgr2=0x7fc57406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:50.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.431+0000 7fc57a000640 1 --2- 172.21.15.99:0/1439515605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc57406e5e0 0x7fc57406ea40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5600097d0 tx=0x7fc56002a1a0 comp rx=0 tx=0).stop 2024-09-10T07:38:50.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.431+0000 7fc57a000640 1 -- 172.21.15.99:0/1439515605 shutdown_connections 2024-09-10T07:38:50.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.431+0000 7fc57a000640 1 --2- 172.21.15.99:0/1439515605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc57406e5e0 0x7fc57406ea40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:50.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.431+0000 7fc57a000640 1 -- 172.21.15.99:0/1439515605 >> 172.21.15.99:0/1439515605 conn(0x7fc5740b26a0 msgr2=0x7fc5740b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:50.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.431+0000 7fc57a000640 1 -- 172.21.15.99:0/1439515605 shutdown_connections 2024-09-10T07:38:50.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.431+0000 7fc57a000640 1 -- 172.21.15.99:0/1439515605 wait complete. 2024-09-10T07:38:50.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.433+0000 7fc57a000640 1 Processor -- start 2024-09-10T07:38:50.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.433+0000 7fc57a000640 1 -- start start 2024-09-10T07:38:50.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc57a000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57406e5e0 0x7fc5740c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:50.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc57a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5740ce460 0x7fc574153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:50.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc57a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc57415e470 0x7fc5740ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:50.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc57a000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740ce840 con 0x7fc57415e470 2024-09-10T07:38:50.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc57a000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc57415dc50 con 0x7fc57406e5e0 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc57a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc5740d05f0 con 0x7fc5740ce460 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc573e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc57415e470 0x7fc5740ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc573e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc57415e470 0x7fc5740ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47432/0 (socket says 172.21.15.99:47432) 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc573e00640 1 -- 172.21.15.99:0/2775949620 learned_addr learned my addr 172.21.15.99:0/2775949620 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc573400640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57406e5e0 0x7fc5740c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.434+0000 7fc572a00640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5740ce460 0x7fc574153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.435+0000 7fc573e00640 1 -- 172.21.15.99:0/2775949620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5740ce460 msgr2=0x7fc574153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.435+0000 7fc573e00640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5740ce460 0x7fc574153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.435+0000 7fc573e00640 1 -- 172.21.15.99:0/2775949620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57406e5e0 msgr2=0x7fc5740c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.435+0000 7fc573e00640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57406e5e0 0x7fc5740c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.435+0000 7fc573e00640 1 -- 172.21.15.99:0/2775949620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5741f55f0 con 0x7fc57415e470 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.435+0000 7fc573e00640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc57415e470 0x7fc5740ca0d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00cbf0 tx=0x7fc56c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:50.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.435+0000 7fc56b400640 1 -- 172.21.15.99:0/2775949620 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c017070 con 0x7fc57415e470 2024-09-10T07:38:50.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.435+0000 7fc56b400640 1 -- 172.21.15.99:0/2775949620 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c00ad50 con 0x7fc57415e470 2024-09-10T07:38:50.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.435+0000 7fc56b400640 1 -- 172.21.15.99:0/2775949620 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c012600 con 0x7fc57415e470 2024-09-10T07:38:50.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.435+0000 7fc57a000640 1 -- 172.21.15.99:0/2775949620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5741f4a70 con 0x7fc57415e470 2024-09-10T07:38:50.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.436+0000 7fc57a000640 1 -- 172.21.15.99:0/2775949620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5741f5030 con 0x7fc57415e470 2024-09-10T07:38:50.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.436+0000 7fc57a000640 1 -- 172.21.15.99:0/2775949620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57415cfd0 con 0x7fc57415e470 2024-09-10T07:38:50.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.437+0000 7fc56b400640 1 -- 172.21.15.99:0/2775949620 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc56c01a070 con 0x7fc57415e470 2024-09-10T07:38:50.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.438+0000 7fc56b400640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc55406be30 0x7fc55406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:50.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.438+0000 7fc56b400640 1 -- 172.21.15.99:0/2775949620 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5853+0+0 (secure 0 0 0) 0x7fc56c08ac90 con 0x7fc57415e470 2024-09-10T07:38:50.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.439+0000 7fc573400640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc55406be30 0x7fc55406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:50.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.439+0000 7fc56b400640 1 -- 172.21.15.99:0/2775949620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=92}) -- 0x7fc554073b30 con 0x7fc57415e470 2024-09-10T07:38:50.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.439+0000 7fc573400640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc55406be30 0x7fc55406e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc5640011e0 tx=0x7fc564009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:50.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.442+0000 7fc56b400640 1 -- 172.21.15.99:0/2775949620 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc56c058f50 con 0x7fc57415e470 2024-09-10T07:38:50.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:50.615+0000 7fc57a000640 1 -- 172.21.15.99:0/2775949620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc574161460 con 0x7fc57415e470 2024-09-10T07:38:51.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.253+0000 7fc56b400640 1 -- 172.21.15.99:0/2775949620 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7fc56c05d250 con 0x7fc57415e470 2024-09-10T07:38:51.253 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:38:51.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.255+0000 7fc57a000640 1 -- 172.21.15.99:0/2775949620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc55406be30 msgr2=0x7fc55406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:51.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.255+0000 7fc57a000640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc55406be30 0x7fc55406e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc5640011e0 tx=0x7fc564009040 comp rx=0 tx=0).stop 2024-09-10T07:38:51.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.255+0000 7fc57a000640 1 -- 172.21.15.99:0/2775949620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc57415e470 msgr2=0x7fc5740ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:51.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.255+0000 7fc57a000640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc57415e470 0x7fc5740ca0d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00cbf0 tx=0x7fc56c00a430 comp rx=0 tx=0).stop 2024-09-10T07:38:51.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.256+0000 7fc57a000640 1 -- 172.21.15.99:0/2775949620 shutdown_connections 2024-09-10T07:38:51.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.256+0000 7fc57a000640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc55406be30 0x7fc55406e2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:51.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.256+0000 7fc57a000640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc57415e470 0x7fc5740ca0d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:51.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.256+0000 7fc57a000640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5740ce460 0x7fc574153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:51.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.256+0000 7fc57a000640 1 --2- 172.21.15.99:0/2775949620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc57406e5e0 0x7fc5740c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:51.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.256+0000 7fc57a000640 1 -- 172.21.15.99:0/2775949620 >> 172.21.15.99:0/2775949620 conn(0x7fc5740b26a0 msgr2=0x7fc57415e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:51.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.257+0000 7fc57a000640 1 -- 172.21.15.99:0/2775949620 shutdown_connections 2024-09-10T07:38:51.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.259+0000 7fc57a000640 1 -- 172.21.15.99:0/2775949620 wait complete. 2024-09-10T07:38:51.279 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:38:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.437+0000 7f4d3d600640 1 Processor -- start 2024-09-10T07:38:51.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.438+0000 7f4d3d600640 1 -- start start 2024-09-10T07:38:51.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.439+0000 7f4d3d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d381445a0 0x7f4d380cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:51.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.439+0000 7f4d3d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4d380ced50 0x7f4d38072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:51.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.439+0000 7f4d3d600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d380cd8c0 con 0x7f4d38144980 2024-09-10T07:38:51.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.439+0000 7f4d3d600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4d380b4d20 con 0x7f4d380ced50 2024-09-10T07:38:51.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.439+0000 7f4d3d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4d3815fdd0 con 0x7f4d381445a0 2024-09-10T07:38:51.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.439+0000 7f4d36000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4d380ced50 0x7f4d38072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:51.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.439+0000 7f4d36000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4d380ced50 0x7f4d38072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47434/0 (socket says 172.21.15.99:47434) 2024-09-10T07:38:51.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.439+0000 7f4d36000640 1 -- 172.21.15.99:0/4151885591 learned_addr learned my addr 172.21.15.99:0/4151885591 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:51.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.439+0000 7f4d36a00640 1 --2- 172.21.15.99:0/4151885591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d381445a0 0x7f4d380cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:51.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.440+0000 7f4d36000640 1 -- 172.21.15.99:0/4151885591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d381445a0 msgr2=0x7f4d380cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:51.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.440+0000 7f4d36000640 1 --2- 172.21.15.99:0/4151885591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d381445a0 0x7f4d380cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:51.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.440+0000 7f4d36000640 1 -- 172.21.15.99:0/4151885591 >> v1:172.21.15.187:6789/0 conn(0x7f4d38144980 legacy=0x7f4d3806e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:51.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.440+0000 7f4d36000640 1 -- 172.21.15.99:0/4151885591 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d38160310 con 0x7f4d380ced50 2024-09-10T07:38:51.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.441+0000 7f4d36000640 1 --2- 172.21.15.99:0/4151885591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d380ced50 0x7f4d38072680 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4d240098a0 tx=0x7f4d2402c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e824ce51f0522cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:51.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.441+0000 7f4d35600640 1 -- 172.21.15.99:0/4151885591 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24039070 con 0x7f4d380ced50 2024-09-10T07:38:51.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.441+0000 7f4d35600640 1 -- 172.21.15.99:0/4151885591 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d24034640 con 0x7f4d380ced50 2024-09-10T07:38:51.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.441+0000 7f4d35600640 1 -- 172.21.15.99:0/4151885591 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24034a10 con 0x7f4d380ced50 2024-09-10T07:38:51.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.441+0000 7f4d3d600640 1 -- 172.21.15.99:0/4151885591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d380ced50 msgr2=0x7f4d38072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:51.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.441+0000 7f4d3d600640 1 --2- 172.21.15.99:0/4151885591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d380ced50 0x7f4d38072680 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4d240098a0 tx=0x7f4d2402c370 comp rx=0 tx=0).stop 2024-09-10T07:38:51.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.441+0000 7f4d3d600640 1 -- 172.21.15.99:0/4151885591 shutdown_connections 2024-09-10T07:38:51.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.441+0000 7f4d3d600640 1 --2- 172.21.15.99:0/4151885591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d380ced50 0x7f4d38072680 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:51.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.441+0000 7f4d3d600640 1 --2- 172.21.15.99:0/4151885591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d381445a0 0x7f4d380cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:51.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.441+0000 7f4d3d600640 1 -- 172.21.15.99:0/4151885591 >> 172.21.15.99:0/4151885591 conn(0x7f4d380b26a0 msgr2=0x7f4d380b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:51.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.442+0000 7f4d3d600640 1 -- 172.21.15.99:0/4151885591 shutdown_connections 2024-09-10T07:38:51.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.442+0000 7f4d3d600640 1 -- 172.21.15.99:0/4151885591 wait complete. 2024-09-10T07:38:51.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.443+0000 7f4d3d600640 1 Processor -- start 2024-09-10T07:38:51.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.443+0000 7f4d3d600640 1 -- start start 2024-09-10T07:38:51.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.444+0000 7f4d3d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d380ced50 0x7f4d3815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:51.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.444+0000 7f4d3d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d381445a0 0x7f4d3813b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:51.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.444+0000 7f4d3d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d38144980 0x7f4d381e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:51.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.444+0000 7f4d3d600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d380b5c20 con 0x7f4d381445a0 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.444+0000 7f4d3d600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4d380b5940 con 0x7f4d380ced50 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.444+0000 7f4d3d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4d38144ec0 con 0x7f4d38144980 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.444+0000 7f4d36000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d381445a0 0x7f4d3813b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.444+0000 7f4d36000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d381445a0 0x7f4d3813b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47446/0 (socket says 172.21.15.99:47446) 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.444+0000 7f4d36000640 1 -- 172.21.15.99:0/795408869 learned_addr learned my addr 172.21.15.99:0/795408869 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d37400640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d38144980 0x7f4d381e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d36a00640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d380ced50 0x7f4d3815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d36000640 1 -- 172.21.15.99:0/795408869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d38144980 msgr2=0x7f4d381e62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d36000640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d38144980 0x7f4d381e62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d36000640 1 -- 172.21.15.99:0/795408869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d380ced50 msgr2=0x7f4d3815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d36000640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d380ced50 0x7f4d3815b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d36000640 1 -- 172.21.15.99:0/795408869 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3813c920 con 0x7f4d381445a0 2024-09-10T07:38:51.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d37400640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d38144980 0x7f4d381e62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:51.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d36000640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d381445a0 0x7f4d3813b030 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4d240098a0 tx=0x7f4d240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:51.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d2ea00640 1 -- 172.21.15.99:0/795408869 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24044070 con 0x7f4d381445a0 2024-09-10T07:38:51.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d2ea00640 1 -- 172.21.15.99:0/795408869 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d24032980 con 0x7f4d381445a0 2024-09-10T07:38:51.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d2ea00640 1 -- 172.21.15.99:0/795408869 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24039070 con 0x7f4d381445a0 2024-09-10T07:38:51.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.445+0000 7f4d3d600640 1 -- 172.21.15.99:0/795408869 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3815b7c0 con 0x7f4d381445a0 2024-09-10T07:38:51.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.446+0000 7f4d3d600640 1 -- 172.21.15.99:0/795408869 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3813bb60 con 0x7f4d381445a0 2024-09-10T07:38:51.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.447+0000 7f4d3d600640 1 -- 172.21.15.99:0/795408869 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d3815bc00 con 0x7f4d381445a0 2024-09-10T07:38:51.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.447+0000 7f4d2ea00640 1 -- 172.21.15.99:0/795408869 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d24047070 con 0x7f4d381445a0 2024-09-10T07:38:51.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.448+0000 7f4d2ea00640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4d1806be30 0x7f4d1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:51.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.448+0000 7f4d2ea00640 1 -- 172.21.15.99:0/795408869 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5415+0+0 (secure 0 0 0) 0x7f4d240aae70 con 0x7f4d381445a0 2024-09-10T07:38:51.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.448+0000 7f4d36a00640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4d1806be30 0x7f4d1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:51.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.449+0000 7f4d36a00640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4d1806be30 0x7f4d1806e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4d3813d230 tx=0x7f4d28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:51.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.452+0000 7f4d2ea00640 1 -- 172.21.15.99:0/795408869 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d3815b7c0 con 0x7f4d381445a0 2024-09-10T07:38:51.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:51.625+0000 7f4d3d600640 1 -- 172.21.15.99:0/795408869 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4d380cfd00 con 0x7f4d381445a0 2024-09-10T07:38:52.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.255+0000 7f4d2ea00640 1 -- 172.21.15.99:0/795408869 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7f4d3813c920 con 0x7f4d381445a0 2024-09-10T07:38:52.256 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:38:52.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 -- 172.21.15.99:0/795408869 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4d1806be30 msgr2=0x7f4d1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4d1806be30 0x7f4d1806e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4d3813d230 tx=0x7f4d28008040 comp rx=0 tx=0).stop 2024-09-10T07:38:52.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 -- 172.21.15.99:0/795408869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d381445a0 msgr2=0x7f4d3813b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d381445a0 0x7f4d3813b030 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4d240098a0 tx=0x7f4d240046c0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 -- 172.21.15.99:0/795408869 shutdown_connections 2024-09-10T07:38:52.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d38144980 0x7f4d381e62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4d1806be30 0x7f4d1806e2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d381445a0 0x7f4d3813b030 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 --2- 172.21.15.99:0/795408869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d380ced50 0x7f4d3815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 -- 172.21.15.99:0/795408869 >> 172.21.15.99:0/795408869 conn(0x7f4d380b26a0 msgr2=0x7f4d38074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:52.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 -- 172.21.15.99:0/795408869 shutdown_connections 2024-09-10T07:38:52.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.258+0000 7f4d3d600640 1 -- 172.21.15.99:0/795408869 wait complete. 2024-09-10T07:38:52.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T07:38:52.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.441+0000 7fec34e00640 1 Processor -- start 2024-09-10T07:38:52.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.441+0000 7fec34e00640 1 -- start start 2024-09-10T07:38:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.442+0000 7fec34e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fec30147f40 0x7fec300b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec34e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec3006d620 0x7fec3006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec34e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3006d120 0x7fec300ae840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec34e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fec30148320 con 0x7fec3006d620 2024-09-10T07:38:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec34e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fec3006c750 con 0x7fec30147f40 2024-09-10T07:38:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec34e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fec300b63d0 con 0x7fec3006d120 2024-09-10T07:38:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec26a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec3006d620 0x7fec3006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec26a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec3006d620 0x7fec3006cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47460/0 (socket says 172.21.15.99:47460) 2024-09-10T07:38:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec26a00640 1 -- 172.21.15.99:0/85538751 learned_addr learned my addr 172.21.15.99:0/85538751 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec2f400640 1 --2- 172.21.15.99:0/85538751 >> v2:172.21.15.187:3300/0 conn(0x7fec30147f40 0x7fec300b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec2fe00640 1 --2- 172.21.15.99:0/85538751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3006d120 0x7fec300ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec26a00640 1 -- 172.21.15.99:0/85538751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3006d120 msgr2=0x7fec300ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec26a00640 1 --2- 172.21.15.99:0/85538751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3006d120 0x7fec300ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec26a00640 1 -- 172.21.15.99:0/85538751 >> v2:172.21.15.187:3300/0 conn(0x7fec30147f40 msgr2=0x7fec300b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec26a00640 1 --2- 172.21.15.99:0/85538751 >> v2:172.21.15.187:3300/0 conn(0x7fec30147f40 0x7fec300b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.443+0000 7fec26a00640 1 -- 172.21.15.99:0/85538751 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec300b6c50 con 0x7fec3006d620 2024-09-10T07:38:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.444+0000 7fec26a00640 1 --2- 172.21.15.99:0/85538751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d620 0x7fec3006cbe0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fec300b4640 tx=0x7fec1802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67630e999355e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec2ea00640 1 -- 172.21.15.99:0/85538751 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18037070 con 0x7fec3006d620 2024-09-10T07:38:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec2ea00640 1 -- 172.21.15.99:0/85538751 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec18032440 con 0x7fec3006d620 2024-09-10T07:38:52.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec2ea00640 1 -- 172.21.15.99:0/85538751 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18032810 con 0x7fec3006d620 2024-09-10T07:38:52.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec34e00640 1 -- 172.21.15.99:0/85538751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d620 msgr2=0x7fec3006cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec34e00640 1 --2- 172.21.15.99:0/85538751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d620 0x7fec3006cbe0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fec300b4640 tx=0x7fec1802a1e0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec34e00640 1 -- 172.21.15.99:0/85538751 shutdown_connections 2024-09-10T07:38:52.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec34e00640 1 --2- 172.21.15.99:0/85538751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3006d120 0x7fec300ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec34e00640 1 --2- 172.21.15.99:0/85538751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d620 0x7fec3006cbe0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec34e00640 1 --2- 172.21.15.99:0/85538751 >> v2:172.21.15.187:3300/0 conn(0x7fec30147f40 0x7fec300b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec34e00640 1 -- 172.21.15.99:0/85538751 >> 172.21.15.99:0/85538751 conn(0x7fec300b3720 msgr2=0x7fec300b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:52.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec34e00640 1 -- 172.21.15.99:0/85538751 shutdown_connections 2024-09-10T07:38:52.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.445+0000 7fec34e00640 1 -- 172.21.15.99:0/85538751 wait complete. 2024-09-10T07:38:52.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.447+0000 7fec34e00640 1 Processor -- start 2024-09-10T07:38:52.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.447+0000 7fec34e00640 1 -- start start 2024-09-10T07:38:52.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec34e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d120 0x7fec301e8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec34e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec3006d620 0x7fec300c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec34e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec30147f40 0x7fec30135240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec34e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fec3006da60 con 0x7fec3006d120 2024-09-10T07:38:52.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec34e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fec300b6970 con 0x7fec3006d620 2024-09-10T07:38:52.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec34e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fec300aed80 con 0x7fec30147f40 2024-09-10T07:38:52.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec2f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d120 0x7fec301e8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec2f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d120 0x7fec301e8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47464/0 (socket says 172.21.15.99:47464) 2024-09-10T07:38:52.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec2f400640 1 -- 172.21.15.99:0/4291327480 learned_addr learned my addr 172.21.15.99:0/4291327480 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:52.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec2f400640 1 -- 172.21.15.99:0/4291327480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec30147f40 msgr2=0x7fec30135240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec2f400640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec30147f40 0x7fec30135240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec2f400640 1 -- 172.21.15.99:0/4291327480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec3006d620 msgr2=0x7fec300c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec2f400640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec3006d620 0x7fec300c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.448+0000 7fec2f400640 1 -- 172.21.15.99:0/4291327480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec30135a80 con 0x7fec3006d120 2024-09-10T07:38:52.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.449+0000 7fec2f400640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d120 0x7fec301e8ce0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fec2000e7f0 tx=0x7fec2000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:52.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.449+0000 7fec27e00640 1 -- 172.21.15.99:0/4291327480 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20017070 con 0x7fec3006d120 2024-09-10T07:38:52.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.449+0000 7fec27e00640 1 -- 172.21.15.99:0/4291327480 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2000c940 con 0x7fec3006d120 2024-09-10T07:38:52.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.449+0000 7fec34e00640 1 -- 172.21.15.99:0/4291327480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec30135d60 con 0x7fec3006d120 2024-09-10T07:38:52.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.449+0000 7fec27e00640 1 -- 172.21.15.99:0/4291327480 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2000eea0 con 0x7fec3006d120 2024-09-10T07:38:52.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.449+0000 7fec34e00640 1 -- 172.21.15.99:0/4291327480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec30133420 con 0x7fec3006d120 2024-09-10T07:38:52.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.450+0000 7fec34e00640 1 -- 172.21.15.99:0/4291327480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec30133210 con 0x7fec3006d120 2024-09-10T07:38:52.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.451+0000 7fec27e00640 1 -- 172.21.15.99:0/4291327480 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec2001a070 con 0x7fec3006d120 2024-09-10T07:38:52.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.452+0000 7fec27e00640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec0c06be30 0x7fec0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.452+0000 7fec27e00640 1 -- 172.21.15.99:0/4291327480 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7fec2008add0 con 0x7fec3006d120 2024-09-10T07:38:52.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.452+0000 7fec26a00640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec0c06be30 0x7fec0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.453+0000 7fec26a00640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec0c06be30 0x7fec0c06e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fec18034000 tx=0x7fec1802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:52.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.456+0000 7fec27e00640 1 -- 172.21.15.99:0/4291327480 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec200599e0 con 0x7fec3006d120 2024-09-10T07:38:52.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.630+0000 7fec34e00640 1 -- 172.21.15.99:0/4291327480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fec300af110 con 0x7fec3006d120 2024-09-10T07:38:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.636+0000 7fec27e00640 1 -- 172.21.15.99:0/4291327480 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fec200592e0 con 0x7fec3006d120 2024-09-10T07:38:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 -- 172.21.15.99:0/4291327480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec0c06be30 msgr2=0x7fec0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec0c06be30 0x7fec0c06e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fec18034000 tx=0x7fec1802c000 comp rx=0 tx=0).stop 2024-09-10T07:38:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 -- 172.21.15.99:0/4291327480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d120 msgr2=0x7fec301e8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d120 0x7fec301e8ce0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fec2000e7f0 tx=0x7fec2000ecb0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 -- 172.21.15.99:0/4291327480 shutdown_connections 2024-09-10T07:38:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec30147f40 0x7fec30135240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec3006d620 0x7fec300c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fec0c06be30 0x7fec0c06e2f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 --2- 172.21.15.99:0/4291327480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec3006d120 0x7fec301e8ce0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 -- 172.21.15.99:0/4291327480 >> 172.21.15.99:0/4291327480 conn(0x7fec300b3720 msgr2=0x7fec300b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:52.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 -- 172.21.15.99:0/4291327480 shutdown_connections 2024-09-10T07:38:52.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.638+0000 7fec34e00640 1 -- 172.21.15.99:0/4291327480 wait complete. 2024-09-10T07:38:52.654 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-10T07:38:52.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.807+0000 7f9af9a00640 1 Processor -- start 2024-09-10T07:38:52.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.807+0000 7f9af9a00640 1 -- start start 2024-09-10T07:38:52.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.808+0000 7f9af9a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 0x7f9af406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.808+0000 7f9af9a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9af4072f40 0x7f9af40b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af9a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af406e3d0 con 0x7f9af40ce780 2024-09-10T07:38:52.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af9a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f9af406efe0 con 0x7f9af4072f40 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af9a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9af406e6b0 con 0x7f9af4145290 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af2000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9af40ce780 0x7f9af4072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34078/0 (socket says 172.21.15.99:34078) 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af2000640 1 -- 172.21.15.99:0/2344678754 learned_addr learned my addr 172.21.15.99:0/2344678754 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af2a00640 1 --2- 172.21.15.99:0/2344678754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 0x7f9af406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af3400640 1 --2- 172.21.15.99:0/2344678754 >> v2:172.21.15.187:3300/0 conn(0x7f9af4072f40 0x7f9af40b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af1600640 1 -- 172.21.15.99:0/2344678754 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3857390293 0 0) 0x7f9af406e3d0 con 0x7f9af40ce780 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af1600640 1 -- 172.21.15.99:0/2344678754 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ad8003520 con 0x7f9af40ce780 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af3400640 1 -- 172.21.15.99:0/2344678754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 msgr2=0x7f9af406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af3400640 1 --2- 172.21.15.99:0/2344678754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 0x7f9af406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.809+0000 7f9af3400640 1 -- 172.21.15.99:0/2344678754 >> v1:172.21.15.99:6789/0 conn(0x7f9af40ce780 legacy=0x7f9af4072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.810+0000 7f9af3400640 1 -- 172.21.15.99:0/2344678754 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af406e990 con 0x7f9af4072f40 2024-09-10T07:38:52.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.810+0000 7f9af2a00640 1 --2- 172.21.15.99:0/2344678754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 0x7f9af406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:38:52.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.811+0000 7f9af3400640 1 --2- 172.21.15.99:0/2344678754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af4072f40 0x7f9af40b3930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009d90 tx=0x7f9aec02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=160930ce92a21f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:52.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.811+0000 7f9af1600640 1 -- 172.21.15.99:0/2344678754 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec007740 con 0x7f9af4072f40 2024-09-10T07:38:52.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.811+0000 7f9af1600640 1 -- 172.21.15.99:0/2344678754 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aec0078e0 con 0x7f9af4072f40 2024-09-10T07:38:52.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.811+0000 7f9af1600640 1 -- 172.21.15.99:0/2344678754 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec007cb0 con 0x7f9af4072f40 2024-09-10T07:38:52.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.811+0000 7f9af9a00640 1 -- 172.21.15.99:0/2344678754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af4072f40 msgr2=0x7f9af40b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.811+0000 7f9af9a00640 1 --2- 172.21.15.99:0/2344678754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af4072f40 0x7f9af40b3930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009d90 tx=0x7f9aec02a660 comp rx=0 tx=0).stop 2024-09-10T07:38:52.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.811+0000 7f9af9a00640 1 -- 172.21.15.99:0/2344678754 shutdown_connections 2024-09-10T07:38:52.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.811+0000 7f9af9a00640 1 --2- 172.21.15.99:0/2344678754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af4072f40 0x7f9af40b3930 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.811+0000 7f9af9a00640 1 --2- 172.21.15.99:0/2344678754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 0x7f9af406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.811+0000 7f9af9a00640 1 -- 172.21.15.99:0/2344678754 >> 172.21.15.99:0/2344678754 conn(0x7f9af406bc10 msgr2=0x7f9af406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:52.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.812+0000 7f9af9a00640 1 -- 172.21.15.99:0/2344678754 shutdown_connections 2024-09-10T07:38:52.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.812+0000 7f9af9a00640 1 -- 172.21.15.99:0/2344678754 wait complete. 2024-09-10T07:38:52.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.813+0000 7f9af9a00640 1 Processor -- start 2024-09-10T07:38:52.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.813+0000 7f9af9a00640 1 -- start start 2024-09-10T07:38:52.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.814+0000 7f9af9a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9af4072f40 0x7f9af41f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.814+0000 7f9af9a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af40ce780 0x7f9af415b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.814+0000 7f9af9a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 0x7f9af415df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.814+0000 7f9af9a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9af406df80 con 0x7f9af4072f40 2024-09-10T07:38:52.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.814+0000 7f9af9a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4145670 con 0x7f9af40ce780 2024-09-10T07:38:52.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.814+0000 7f9af9a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9af406e100 con 0x7f9af4145290 2024-09-10T07:38:52.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.814+0000 7f9af2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9af4072f40 0x7f9af41f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9af4072f40 0x7f9af41f4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47476/0 (socket says 172.21.15.99:47476) 2024-09-10T07:38:52.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af2a00640 1 -- 172.21.15.99:0/1726503475 learned_addr learned my addr 172.21.15.99:0/1726503475 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:52.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af3400640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 0x7f9af415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af2000640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af40ce780 0x7f9af415b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af2a00640 1 -- 172.21.15.99:0/1726503475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 msgr2=0x7f9af415df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af2a00640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 0x7f9af415df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af2a00640 1 -- 172.21.15.99:0/1726503475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af40ce780 msgr2=0x7f9af415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:52.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af2a00640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af40ce780 0x7f9af415b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:52.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af2a00640 1 -- 172.21.15.99:0/1726503475 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af4167790 con 0x7f9af4072f40 2024-09-10T07:38:52.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af2a00640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9af4072f40 0x7f9af41f4ad0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400ec10 tx=0x7f9ae400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:52.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9aeaa00640 1 -- 172.21.15.99:0/1726503475 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4017070 con 0x7f9af4072f40 2024-09-10T07:38:52.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9aeaa00640 1 -- 172.21.15.99:0/1726503475 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae400cc30 con 0x7f9af4072f40 2024-09-10T07:38:52.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9aeaa00640 1 -- 172.21.15.99:0/1726503475 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4013470 con 0x7f9af4072f40 2024-09-10T07:38:52.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.815+0000 7f9af9a00640 1 -- 172.21.15.99:0/1726503475 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af4167a70 con 0x7f9af4072f40 2024-09-10T07:38:52.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.816+0000 7f9af9a00640 1 -- 172.21.15.99:0/1726503475 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af4168030 con 0x7f9af4072f40 2024-09-10T07:38:52.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.817+0000 7f9af9a00640 1 -- 172.21.15.99:0/1726503475 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af4071510 con 0x7f9af4072f40 2024-09-10T07:38:52.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.818+0000 7f9aeaa00640 1 -- 172.21.15.99:0/1726503475 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ae401a070 con 0x7f9af4072f40 2024-09-10T07:38:52.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.818+0000 7f9aeaa00640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ad406be30 0x7f9ad406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:52.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.819+0000 7f9aeaa00640 1 -- 172.21.15.99:0/1726503475 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7f9ae408ad90 con 0x7f9af4072f40 2024-09-10T07:38:52.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.819+0000 7f9af2000640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ad406be30 0x7f9ad406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:52.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.819+0000 7f9af2000640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ad406be30 0x7f9ad406e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9af4137cb0 tx=0x7f9ae0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:52.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:52.823+0000 7f9aeaa00640 1 -- 172.21.15.99:0/1726503475 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ae4059ad0 con 0x7f9af4072f40 2024-09-10T07:38:53.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.056+0000 7f9af9a00640 1 -- 172.21.15.99:0/1726503475 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) -- 0x7f9af4071ce0 con 0x7f9af4072f40 2024-09-10T07:38:53.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.257+0000 7f9aeaa00640 1 -- 172.21.15.99:0/1726503475 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v234) ==== 133+0+0 (secure 0 0 0) 0x7f9ae40593d0 con 0x7f9af4072f40 2024-09-10T07:38:53.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.259+0000 7f9af9a00640 1 -- 172.21.15.99:0/1726503475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ad406be30 msgr2=0x7f9ad406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ad406be30 0x7f9ad406e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9af4137cb0 tx=0x7f9ae0009040 comp rx=0 tx=0).stop 2024-09-10T07:38:53.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 -- 172.21.15.99:0/1726503475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9af4072f40 msgr2=0x7f9af41f4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9af4072f40 0x7f9af41f4ad0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400ec10 tx=0x7f9ae400c520 comp rx=0 tx=0).stop 2024-09-10T07:38:53.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 -- 172.21.15.99:0/1726503475 shutdown_connections 2024-09-10T07:38:53.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9af4145290 0x7f9af415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9af40ce780 0x7f9af415b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9ad406be30 0x7f9ad406e2f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 --2- 172.21.15.99:0/1726503475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9af4072f40 0x7f9af41f4ad0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 -- 172.21.15.99:0/1726503475 >> 172.21.15.99:0/1726503475 conn(0x7f9af406bc10 msgr2=0x7f9af4138520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:53.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 -- 172.21.15.99:0/1726503475 shutdown_connections 2024-09-10T07:38:53.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.260+0000 7f9af9a00640 1 -- 172.21.15.99:0/1726503475 wait complete. 2024-09-10T07:38:53.276 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-10T07:38:53.276 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-10T07:38:53.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:38:53.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.430+0000 7fbd65000640 1 Processor -- start 2024-09-10T07:38:53.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.430+0000 7fbd65000640 1 -- start start 2024-09-10T07:38:53.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.431+0000 7fbd65000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd6015e970 0x7fbd600d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.431+0000 7fbd65000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cfc90 0x7fbd600c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.431+0000 7fbd65000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd600d2bd0 con 0x7fbd600d2680 2024-09-10T07:38:53.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.431+0000 7fbd65000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbd600d37e0 con 0x7fbd6015e970 2024-09-10T07:38:53.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.431+0000 7fbd65000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbd600d2eb0 con 0x7fbd600cfc90 2024-09-10T07:38:53.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.431+0000 7fbd56a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbd600d2680 0x7fbd600cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34090/0 (socket says 172.21.15.99:34090) 2024-09-10T07:38:53.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.431+0000 7fbd56a00640 1 -- 172.21.15.99:0/3024869834 learned_addr learned my addr 172.21.15.99:0/3024869834 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:53.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.431+0000 7fbd5f400640 1 --2- 172.21.15.99:0/3024869834 >> v2:172.21.15.187:3300/0 conn(0x7fbd6015e970 0x7fbd600d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.431+0000 7fbd5fe00640 1 --2- 172.21.15.99:0/3024869834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cfc90 0x7fbd600c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.432+0000 7fbd5ea00640 1 -- 172.21.15.99:0/3024869834 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2368685172 0 0) 0x7fbd600d2bd0 con 0x7fbd600d2680 2024-09-10T07:38:53.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.432+0000 7fbd5ea00640 1 -- 172.21.15.99:0/3024869834 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd44003520 con 0x7fbd600d2680 2024-09-10T07:38:53.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.432+0000 7fbd5f400640 1 -- 172.21.15.99:0/3024869834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cfc90 msgr2=0x7fbd600c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:53.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.432+0000 7fbd5f400640 1 --2- 172.21.15.99:0/3024869834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cfc90 0x7fbd600c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.432+0000 7fbd5f400640 1 -- 172.21.15.99:0/3024869834 >> v1:172.21.15.99:6789/0 conn(0x7fbd600d2680 legacy=0x7fbd600cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.432+0000 7fbd5f400640 1 -- 172.21.15.99:0/3024869834 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd600d3190 con 0x7fbd6015e970 2024-09-10T07:38:53.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.432+0000 7fbd5fe00640 1 --2- 172.21.15.99:0/3024869834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cfc90 0x7fbd600c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:38:53.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.433+0000 7fbd5f400640 1 --2- 172.21.15.99:0/3024869834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd6015e970 0x7fbd600d0300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbd500097a0 tx=0x7fbd5002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af86a769a49a223b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:53.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.433+0000 7fbd5ea00640 1 -- 172.21.15.99:0/3024869834 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50037070 con 0x7fbd6015e970 2024-09-10T07:38:53.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.433+0000 7fbd5ea00640 1 -- 172.21.15.99:0/3024869834 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd50032440 con 0x7fbd6015e970 2024-09-10T07:38:53.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.433+0000 7fbd5ea00640 1 -- 172.21.15.99:0/3024869834 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50032810 con 0x7fbd6015e970 2024-09-10T07:38:53.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.434+0000 7fbd65000640 1 -- 172.21.15.99:0/3024869834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd6015e970 msgr2=0x7fbd600d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.434+0000 7fbd65000640 1 --2- 172.21.15.99:0/3024869834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd6015e970 0x7fbd600d0300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbd500097a0 tx=0x7fbd5002a180 comp rx=0 tx=0).stop 2024-09-10T07:38:53.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.434+0000 7fbd65000640 1 -- 172.21.15.99:0/3024869834 shutdown_connections 2024-09-10T07:38:53.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.434+0000 7fbd65000640 1 --2- 172.21.15.99:0/3024869834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600cfc90 0x7fbd600c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.434+0000 7fbd65000640 1 --2- 172.21.15.99:0/3024869834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd6015e970 0x7fbd600d0300 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.434+0000 7fbd65000640 1 -- 172.21.15.99:0/3024869834 >> 172.21.15.99:0/3024869834 conn(0x7fbd6009de00 msgr2=0x7fbd600d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:53.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.434+0000 7fbd65000640 1 -- 172.21.15.99:0/3024869834 shutdown_connections 2024-09-10T07:38:53.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.434+0000 7fbd65000640 1 -- 172.21.15.99:0/3024869834 wait complete. 2024-09-10T07:38:53.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.436+0000 7fbd65000640 1 Processor -- start 2024-09-10T07:38:53.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.436+0000 7fbd65000640 1 -- start start 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd65000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd600cfc90 0x7fbd60156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd65000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600d2680 0x7fbd600ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd65000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd6015e970 0x7fbd600b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd65000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6015ed50 con 0x7fbd6015e970 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd65000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbd600d0840 con 0x7fbd600cfc90 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd65000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6015eed0 con 0x7fbd600d2680 2024-09-10T07:38:53.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd5fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd6015e970 0x7fbd600b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd5fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd6015e970 0x7fbd600b8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47490/0 (socket says 172.21.15.99:47490) 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd5fe00640 1 -- 172.21.15.99:0/918954473 learned_addr learned my addr 172.21.15.99:0/918954473 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd5f400640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd600cfc90 0x7fbd60156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd56a00640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600d2680 0x7fbd600ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd5fe00640 1 -- 172.21.15.99:0/918954473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600d2680 msgr2=0x7fbd600ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd5fe00640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600d2680 0x7fbd600ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd5fe00640 1 -- 172.21.15.99:0/918954473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd600cfc90 msgr2=0x7fbd60156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd5fe00640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd600cfc90 0x7fbd60156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd5fe00640 1 -- 172.21.15.99:0/918954473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd600b96a0 con 0x7fbd6015e970 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.437+0000 7fbd56a00640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600d2680 0x7fbd600ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:53.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.438+0000 7fbd5fe00640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd6015e970 0x7fbd600b8e50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800efc0 tx=0x7fbd58009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.438+0000 7fbd57e00640 1 -- 172.21.15.99:0/918954473 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58018030 con 0x7fbd6015e970 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.438+0000 7fbd57e00640 1 -- 172.21.15.99:0/918954473 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5800cde0 con 0x7fbd6015e970 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.438+0000 7fbd57e00640 1 -- 172.21.15.99:0/918954473 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58003bb0 con 0x7fbd6015e970 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.438+0000 7fbd65000640 1 -- 172.21.15.99:0/918954473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd600b9980 con 0x7fbd6015e970 2024-09-10T07:38:53.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.438+0000 7fbd65000640 1 -- 172.21.15.99:0/918954473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd600b9f40 con 0x7fbd6015e970 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.439+0000 7fbd65000640 1 -- 172.21.15.99:0/918954473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd600d0300 con 0x7fbd6015e970 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.440+0000 7fbd57e00640 1 -- 172.21.15.99:0/918954473 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd5801b070 con 0x7fbd6015e970 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.441+0000 7fbd57e00640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd3c06be30 0x7fbd3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.441+0000 7fbd57e00640 1 -- 172.21.15.99:0/918954473 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7fbd5808b550 con 0x7fbd6015e970 2024-09-10T07:38:53.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.441+0000 7fbd5f400640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd3c06be30 0x7fbd3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.442+0000 7fbd5f400640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd3c06be30 0x7fbd3c06e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbd50034000 tx=0x7fbd5002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:53.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.445+0000 7fbd57e00640 1 -- 172.21.15.99:0/918954473 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd58010040 con 0x7fbd6015e970 2024-09-10T07:38:53.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.622+0000 7fbd65000640 1 -- 172.21.15.99:0/918954473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd60161d70 con 0x7fbd6015e970 2024-09-10T07:38:53.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.623+0000 7fbd57e00640 1 -- 172.21.15.99:0/918954473 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+13011 (secure 0 0 0) 0x7fbd5805a1f0 con 0x7fbd6015e970 2024-09-10T07:38:53.623 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:53.623 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":93,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:38:52.254369+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.187:6835/1298775214":"2024-09-11T07:38:49.236534+0000","172.21.15.187:6833/1298775214":"2024-09-11T07:38:49.236534+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:38:53.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 -- 172.21.15.99:0/918954473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd3c06be30 msgr2=0x7fbd3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd3c06be30 0x7fbd3c06e2f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbd50034000 tx=0x7fbd5002e000 comp rx=0 tx=0).stop 2024-09-10T07:38:53.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 -- 172.21.15.99:0/918954473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd6015e970 msgr2=0x7fbd600b8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd6015e970 0x7fbd600b8e50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800efc0 tx=0x7fbd58009f90 comp rx=0 tx=0).stop 2024-09-10T07:38:53.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 -- 172.21.15.99:0/918954473 shutdown_connections 2024-09-10T07:38:53.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbd3c06be30 0x7fbd3c06e2f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd6015e970 0x7fbd600b8e50 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd600d2680 0x7fbd600ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 --2- 172.21.15.99:0/918954473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd600cfc90 0x7fbd60156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 -- 172.21.15.99:0/918954473 >> 172.21.15.99:0/918954473 conn(0x7fbd6009de00 msgr2=0x7fbd600c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:53.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 -- 172.21.15.99:0/918954473 shutdown_connections 2024-09-10T07:38:53.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.625+0000 7fbd65000640 1 -- 172.21.15.99:0/918954473 wait complete. 2024-09-10T07:38:53.642 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:34:08.744575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:38:53.642 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:38:53.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.798+0000 7f488d400640 1 Processor -- start 2024-09-10T07:38:53.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.798+0000 7f488d400640 1 -- start start 2024-09-10T07:38:53.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.799+0000 7f488d400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f488815e970 0x7f48880d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.799+0000 7f488d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f48880cfc90 0x7f48880c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.799+0000 7f488d400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48880d2bd0 con 0x7f48880d2680 2024-09-10T07:38:53.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.799+0000 7f488d400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f48880d37e0 con 0x7f48880cfc90 2024-09-10T07:38:53.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.799+0000 7f488d400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f48880d2eb0 con 0x7f488815e970 2024-09-10T07:38:53.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.800+0000 7f488ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f48880cfc90 0x7f48880c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.800+0000 7f488ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f48880cfc90 0x7f48880c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47504/0 (socket says 172.21.15.99:47504) 2024-09-10T07:38:53.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.800+0000 7f488ca00640 1 -- 172.21.15.99:0/2172676936 learned_addr learned my addr 172.21.15.99:0/2172676936 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:53.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.800+0000 7f4887e00640 1 --2- 172.21.15.99:0/2172676936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f488815e970 0x7f48880d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.800+0000 7f488ca00640 1 -- 172.21.15.99:0/2172676936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f488815e970 msgr2=0x7f48880d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:53.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.800+0000 7f488ca00640 1 --2- 172.21.15.99:0/2172676936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f488815e970 0x7f48880d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.800+0000 7f488ca00640 1 -- 172.21.15.99:0/2172676936 >> v1:172.21.15.187:6789/0 conn(0x7f48880d2680 legacy=0x7f48880cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.800+0000 7f488ca00640 1 -- 172.21.15.99:0/2172676936 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48880d3190 con 0x7f48880cfc90 2024-09-10T07:38:53.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.801+0000 7f488ca00640 1 --2- 172.21.15.99:0/2172676936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880cfc90 0x7f48880c8700 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4880009e50 tx=0x7f488002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48cb0c8af24bb7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:53.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.801+0000 7f4886a00640 1 -- 172.21.15.99:0/2172676936 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4880036070 con 0x7f48880cfc90 2024-09-10T07:38:53.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.801+0000 7f4886a00640 1 -- 172.21.15.99:0/2172676936 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4880031600 con 0x7f48880cfc90 2024-09-10T07:38:53.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.801+0000 7f4886a00640 1 -- 172.21.15.99:0/2172676936 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48800319d0 con 0x7f48880cfc90 2024-09-10T07:38:53.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.802+0000 7f488d400640 1 -- 172.21.15.99:0/2172676936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880cfc90 msgr2=0x7f48880c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.802+0000 7f488d400640 1 --2- 172.21.15.99:0/2172676936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880cfc90 0x7f48880c8700 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4880009e50 tx=0x7f488002a7a0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.802+0000 7f488d400640 1 -- 172.21.15.99:0/2172676936 shutdown_connections 2024-09-10T07:38:53.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.802+0000 7f488d400640 1 --2- 172.21.15.99:0/2172676936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880cfc90 0x7f48880c8700 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.802+0000 7f488d400640 1 --2- 172.21.15.99:0/2172676936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f488815e970 0x7f48880d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.802+0000 7f488d400640 1 -- 172.21.15.99:0/2172676936 >> 172.21.15.99:0/2172676936 conn(0x7f488809de00 msgr2=0x7f48880d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:53.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.802+0000 7f488d400640 1 -- 172.21.15.99:0/2172676936 shutdown_connections 2024-09-10T07:38:53.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.802+0000 7f488d400640 1 -- 172.21.15.99:0/2172676936 wait complete. 2024-09-10T07:38:53.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.804+0000 7f488d400640 1 Processor -- start 2024-09-10T07:38:53.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.804+0000 7f488d400640 1 -- start start 2024-09-10T07:38:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f488d400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48880cfc90 0x7f48881572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f488d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880d2680 0x7f48881608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f488d400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f488815e970 0x7f4888160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f488d400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f488815ed50 con 0x7f48880d2680 2024-09-10T07:38:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f488d400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f48880d0840 con 0x7f488815e970 2024-09-10T07:38:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f488d400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f488815eed0 con 0x7f48880cfc90 2024-09-10T07:38:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f4887400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880d2680 0x7f48881608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f4887400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880d2680 0x7f48881608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47510/0 (socket says 172.21.15.99:47510) 2024-09-10T07:38:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f4887400640 1 -- 172.21.15.99:0/3593863445 learned_addr learned my addr 172.21.15.99:0/3593863445 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:53.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f4887e00640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48880cfc90 0x7f48881572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f4887400640 1 -- 172.21.15.99:0/3593863445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48880cfc90 msgr2=0x7f48881572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f4887400640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48880cfc90 0x7f48881572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f4887400640 1 -- 172.21.15.99:0/3593863445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f488815e970 msgr2=0x7f4888160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f488ca00640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f488815e970 0x7f4888160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f4887400640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f488815e970 0x7f4888160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f4887400640 1 -- 172.21.15.99:0/3593863445 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48880ba630 con 0x7f48880d2680 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.805+0000 7f488ca00640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f488815e970 0x7f4888160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.806+0000 7f4887400640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880d2680 0x7f48881608e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f487400c470 tx=0x7f4874001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.806+0000 7f487fe00640 1 -- 172.21.15.99:0/3593863445 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48740052d0 con 0x7f48880d2680 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.806+0000 7f487fe00640 1 -- 172.21.15.99:0/3593863445 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4874005470 con 0x7f48880d2680 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.806+0000 7f487fe00640 1 -- 172.21.15.99:0/3593863445 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874007260 con 0x7f48880d2680 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.806+0000 7f488d400640 1 -- 172.21.15.99:0/3593863445 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48881554e0 con 0x7f48880d2680 2024-09-10T07:38:53.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.806+0000 7f488d400640 1 -- 172.21.15.99:0/3593863445 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4888155aa0 con 0x7f48880d2680 2024-09-10T07:38:53.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.807+0000 7f488d400640 1 -- 172.21.15.99:0/3593863445 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4888068d90 con 0x7f48880d2680 2024-09-10T07:38:53.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.808+0000 7f487fe00640 1 -- 172.21.15.99:0/3593863445 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4874007400 con 0x7f48880d2680 2024-09-10T07:38:53.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.809+0000 7f487fe00640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f486806be30 0x7f486806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:53.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.809+0000 7f487fe00640 1 -- 172.21.15.99:0/3593863445 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7f487408a0a0 con 0x7f48880d2680 2024-09-10T07:38:53.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.809+0000 7f4887e00640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f486806be30 0x7f486806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:53.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.810+0000 7f4887e00640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f486806be30 0x7f486806e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4878009970 tx=0x7f4878008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:53.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.813+0000 7f487fe00640 1 -- 172.21.15.99:0/3593863445 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4888068d90 con 0x7f48880d2680 2024-09-10T07:38:53.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.986+0000 7f488d400640 1 -- 172.21.15.99:0/3593863445 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f488806c800 con 0x7f48880d2680 2024-09-10T07:38:53.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.986+0000 7f487fe00640 1 -- 172.21.15.99:0/3593863445 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f4874058d40 con 0x7f48880d2680 2024-09-10T07:38:53.987 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-10T07:38:53.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.988+0000 7f488d400640 1 -- 172.21.15.99:0/3593863445 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f486806be30 msgr2=0x7f486806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.988+0000 7f488d400640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f486806be30 0x7f486806e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4878009970 tx=0x7f4878008040 comp rx=0 tx=0).stop 2024-09-10T07:38:53.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.988+0000 7f488d400640 1 -- 172.21.15.99:0/3593863445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880d2680 msgr2=0x7f48881608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:53.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.988+0000 7f488d400640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880d2680 0x7f48881608e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f487400c470 tx=0x7f4874001e70 comp rx=0 tx=0).stop 2024-09-10T07:38:53.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.988+0000 7f488d400640 1 -- 172.21.15.99:0/3593863445 shutdown_connections 2024-09-10T07:38:53.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.988+0000 7f488d400640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f488815e970 0x7f4888160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.988+0000 7f488d400640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f486806be30 0x7f486806e2f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.988+0000 7f488d400640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48880d2680 0x7f48881608e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.988+0000 7f488d400640 1 --2- 172.21.15.99:0/3593863445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48880cfc90 0x7f48881572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:53.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.988+0000 7f488d400640 1 -- 172.21.15.99:0/3593863445 >> 172.21.15.99:0/3593863445 conn(0x7f488809de00 msgr2=0x7f48880c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:53.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.989+0000 7f488d400640 1 -- 172.21.15.99:0/3593863445 shutdown_connections 2024-09-10T07:38:53.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:53.989+0000 7f488d400640 1 -- 172.21.15.99:0/3593863445 wait complete. 2024-09-10T07:38:54.005 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-10T07:38:54.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.158+0000 7fd872200640 1 Processor -- start 2024-09-10T07:38:54.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.158+0000 7fd872200640 1 -- start start 2024-09-10T07:38:54.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.159+0000 7fd872200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd86c142150 0x7fd86c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:54.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.159+0000 7fd872200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd86c142650 con 0x7fd86c160a80 2024-09-10T07:38:54.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.159+0000 7fd872200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd86c142930 con 0x7fd86c13fae0 2024-09-10T07:38:54.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.159+0000 7fd872200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd86c0ce780 con 0x7fd86c142150 2024-09-10T07:38:54.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.160+0000 7fd86be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd86c160a80 0x7fd86c0cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34100/0 (socket says 172.21.15.99:34100) 2024-09-10T07:38:54.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.160+0000 7fd86be00640 1 -- 172.21.15.99:0/1594766448 learned_addr learned my addr 172.21.15.99:0/1594766448 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:54.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.160+0000 7fd862a00640 1 --2- 172.21.15.99:0/1594766448 >> v2:172.21.15.187:3300/0 conn(0x7fd86c142150 0x7fd86c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:54.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.160+0000 7fd86aa00640 1 -- 172.21.15.99:0/1594766448 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290592182 0 0) 0x7fd86c142650 con 0x7fd86c160a80 2024-09-10T07:38:54.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.160+0000 7fd86aa00640 1 -- 172.21.15.99:0/1594766448 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd850003520 con 0x7fd86c160a80 2024-09-10T07:38:54.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.160+0000 7fd862a00640 1 -- 172.21.15.99:0/1594766448 >> v1:172.21.15.187:6789/0 conn(0x7fd86c13fae0 legacy=0x7fd86c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:54.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.160+0000 7fd862a00640 1 -- 172.21.15.99:0/1594766448 >> v1:172.21.15.99:6789/0 conn(0x7fd86c160a80 legacy=0x7fd86c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:54.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.160+0000 7fd862a00640 1 -- 172.21.15.99:0/1594766448 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86c142c10 con 0x7fd86c142150 2024-09-10T07:38:54.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.161+0000 7fd862a00640 1 --2- 172.21.15.99:0/1594766448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd86c142150 0x7fd86c160540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd8540097a0 tx=0x7fd85402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2d66eecccc2d0ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:54.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.162+0000 7fd86aa00640 1 -- 172.21.15.99:0/1594766448 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854037070 con 0x7fd86c142150 2024-09-10T07:38:54.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.162+0000 7fd86aa00640 1 -- 172.21.15.99:0/1594766448 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd854032440 con 0x7fd86c142150 2024-09-10T07:38:54.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.162+0000 7fd86aa00640 1 -- 172.21.15.99:0/1594766448 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854032810 con 0x7fd86c142150 2024-09-10T07:38:54.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.162+0000 7fd872200640 1 -- 172.21.15.99:0/1594766448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd86c142150 msgr2=0x7fd86c160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:54.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.162+0000 7fd872200640 1 --2- 172.21.15.99:0/1594766448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd86c142150 0x7fd86c160540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd8540097a0 tx=0x7fd85402a1a0 comp rx=0 tx=0).stop 2024-09-10T07:38:54.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.162+0000 7fd872200640 1 -- 172.21.15.99:0/1594766448 shutdown_connections 2024-09-10T07:38:54.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.162+0000 7fd872200640 1 --2- 172.21.15.99:0/1594766448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd86c142150 0x7fd86c160540 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:54.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.162+0000 7fd872200640 1 -- 172.21.15.99:0/1594766448 >> 172.21.15.99:0/1594766448 conn(0x7fd86c06bc10 msgr2=0x7fd86c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:54.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.162+0000 7fd872200640 1 -- 172.21.15.99:0/1594766448 shutdown_connections 2024-09-10T07:38:54.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.162+0000 7fd872200640 1 -- 172.21.15.99:0/1594766448 wait complete. 2024-09-10T07:38:54.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.164+0000 7fd872200640 1 Processor -- start 2024-09-10T07:38:54.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.164+0000 7fd872200640 1 -- start start 2024-09-10T07:38:54.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd872200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd86c13fae0 0x7fd86c1f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:54.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd872200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd86c142150 0x7fd86c143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:54.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd872200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd86c160a80 0x7fd86c15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:54.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd872200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c0cf4a0 con 0x7fd86c13fae0 2024-09-10T07:38:54.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd872200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c0cf320 con 0x7fd86c160a80 2024-09-10T07:38:54.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd872200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd86c0cf620 con 0x7fd86c142150 2024-09-10T07:38:54.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd86b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd86c13fae0 0x7fd86c1f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:54.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd86b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd86c13fae0 0x7fd86c1f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47518/0 (socket says 172.21.15.99:47518) 2024-09-10T07:38:54.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd86b400640 1 -- 172.21.15.99:0/2648355811 learned_addr learned my addr 172.21.15.99:0/2648355811 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd86be00640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd86c160a80 0x7fd86c15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd862a00640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd86c142150 0x7fd86c143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd86b400640 1 -- 172.21.15.99:0/2648355811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd86c142150 msgr2=0x7fd86c143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.165+0000 7fd86b400640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd86c142150 0x7fd86c143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.166+0000 7fd86b400640 1 -- 172.21.15.99:0/2648355811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd86c160a80 msgr2=0x7fd86c15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.166+0000 7fd86b400640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd86c160a80 0x7fd86c15b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.166+0000 7fd86b400640 1 -- 172.21.15.99:0/2648355811 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86c1f4c90 con 0x7fd86c13fae0 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.166+0000 7fd86b400640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd86c13fae0 0x7fd86c1f1d70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00c400 tx=0x7fd85c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.166+0000 7fd863e00640 1 -- 172.21.15.99:0/2648355811 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0052d0 con 0x7fd86c13fae0 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.166+0000 7fd863e00640 1 -- 172.21.15.99:0/2648355811 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd85c005490 con 0x7fd86c13fae0 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.166+0000 7fd863e00640 1 -- 172.21.15.99:0/2648355811 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85c007260 con 0x7fd86c13fae0 2024-09-10T07:38:54.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.166+0000 7fd872200640 1 -- 172.21.15.99:0/2648355811 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86c1f4f70 con 0x7fd86c13fae0 2024-09-10T07:38:54.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.166+0000 7fd872200640 1 -- 172.21.15.99:0/2648355811 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd86c1f5530 con 0x7fd86c13fae0 2024-09-10T07:38:54.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.167+0000 7fd872200640 1 -- 172.21.15.99:0/2648355811 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd86c160540 con 0x7fd86c13fae0 2024-09-10T07:38:54.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.168+0000 7fd863e00640 1 -- 172.21.15.99:0/2648355811 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd85c007400 con 0x7fd86c13fae0 2024-09-10T07:38:54.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.169+0000 7fd863e00640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd84806be30 0x7fd84806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:54.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.169+0000 7fd863e00640 1 -- 172.21.15.99:0/2648355811 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7fd85c08a140 con 0x7fd86c13fae0 2024-09-10T07:38:54.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.169+0000 7fd862a00640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd84806be30 0x7fd84806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:54.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.170+0000 7fd862a00640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd84806be30 0x7fd84806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd854034000 tx=0x7fd85402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:54.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.173+0000 7fd863e00640 1 -- 172.21.15.99:0/2648355811 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd85c058d50 con 0x7fd86c13fae0 2024-09-10T07:38:54.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:54.409+0000 7fd872200640 1 -- 172.21.15.99:0/2648355811 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) -- 0x7fd86c0b0fe0 con 0x7fd86c13fae0 2024-09-10T07:38:55.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.265+0000 7fd863e00640 1 -- 172.21.15.99:0/2648355811 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v236) ==== 140+0+0 (secure 0 0 0) 0x7fd85c058650 con 0x7fd86c13fae0 2024-09-10T07:38:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.268+0000 7fd872200640 1 -- 172.21.15.99:0/2648355811 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd84806be30 msgr2=0x7fd84806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.268+0000 7fd872200640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd84806be30 0x7fd84806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd854034000 tx=0x7fd85402e000 comp rx=0 tx=0).stop 2024-09-10T07:38:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.268+0000 7fd872200640 1 -- 172.21.15.99:0/2648355811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd86c13fae0 msgr2=0x7fd86c1f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.268+0000 7fd872200640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd86c13fae0 0x7fd86c1f1d70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00c400 tx=0x7fd85c00c8c0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.268+0000 7fd872200640 1 -- 172.21.15.99:0/2648355811 shutdown_connections 2024-09-10T07:38:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.268+0000 7fd872200640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd86c160a80 0x7fd86c15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.268+0000 7fd872200640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd86c142150 0x7fd86c143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.268+0000 7fd872200640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd84806be30 0x7fd84806e2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.268+0000 7fd872200640 1 --2- 172.21.15.99:0/2648355811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd86c13fae0 0x7fd86c1f1d70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.268+0000 7fd872200640 1 -- 172.21.15.99:0/2648355811 >> 172.21.15.99:0/2648355811 conn(0x7fd86c06bc10 msgr2=0x7fd86c0b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:55.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.269+0000 7fd872200640 1 -- 172.21.15.99:0/2648355811 shutdown_connections 2024-09-10T07:38:55.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.269+0000 7fd872200640 1 -- 172.21.15.99:0/2648355811 wait complete. 2024-09-10T07:38:55.287 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-10T07:38:55.459 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_objectstore":"memstore"} 2024-09-10T07:38:55.460 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-10T07:38:55.460 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T07:38:55.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.618+0000 7f1fc3e00640 1 Processor -- start 2024-09-10T07:38:55.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.618+0000 7f1fc3e00640 1 -- start start 2024-09-10T07:38:55.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.619+0000 7f1fc3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc415bb80 0x7f1fc415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:55.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.619+0000 7f1fc3e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc415d450 con 0x7f1fc406e450 2024-09-10T07:38:55.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.619+0000 7f1fc3e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc4156060 con 0x7f1fc4155c80 2024-09-10T07:38:55.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.619+0000 7f1fc3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc40723d0 con 0x7f1fc415bb80 2024-09-10T07:38:55.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.619+0000 7f1fc3400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1fc406e450 0x7f1fc4072e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34104/0 (socket says 172.21.15.99:34104) 2024-09-10T07:38:55.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.620+0000 7f1fc3400640 1 -- 172.21.15.99:0/585690791 learned_addr learned my addr 172.21.15.99:0/585690791 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:55.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.620+0000 7f1fc2000640 1 --2- 172.21.15.99:0/585690791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc415bb80 0x7f1fc415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:55.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.620+0000 7f1fc1600640 1 -- 172.21.15.99:0/585690791 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861744802 0 0) 0x7f1fc415d450 con 0x7f1fc406e450 2024-09-10T07:38:55.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.620+0000 7f1fc1600640 1 -- 172.21.15.99:0/585690791 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa8003520 con 0x7f1fc406e450 2024-09-10T07:38:55.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.620+0000 7f1fc1600640 1 -- 172.21.15.99:0/585690791 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944896229 0 0) 0x7f1fb4001110 con 0x7f1fc4155c80 2024-09-10T07:38:55.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.620+0000 7f1fc1600640 1 -- 172.21.15.99:0/585690791 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fc415d450 con 0x7f1fc4155c80 2024-09-10T07:38:55.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.620+0000 7f1fc2000640 1 -- 172.21.15.99:0/585690791 >> v1:172.21.15.187:6789/0 conn(0x7f1fc4155c80 legacy=0x7f1fc415cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:55.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.620+0000 7f1fc1600640 1 -- 172.21.15.99:0/585690791 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2321106617 0 0) 0x7f1fa8003520 con 0x7f1fc406e450 2024-09-10T07:38:55.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.620+0000 7f1fc2000640 1 -- 172.21.15.99:0/585690791 >> v1:172.21.15.99:6789/0 conn(0x7f1fc406e450 legacy=0x7f1fc4072e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:55.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.620+0000 7f1fc2000640 1 -- 172.21.15.99:0/585690791 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc415c6f0 con 0x7f1fc415bb80 2024-09-10T07:38:55.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.621+0000 7f1fc2000640 1 --2- 172.21.15.99:0/585690791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc415bb80 0x7f1fc415bfe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00097d0 tx=0x7f1fb002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e7864fa6a9e2af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:55.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.622+0000 7f1fc1600640 1 -- 172.21.15.99:0/585690791 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0037070 con 0x7f1fc415bb80 2024-09-10T07:38:55.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.622+0000 7f1fc1600640 1 -- 172.21.15.99:0/585690791 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb002ac30 con 0x7f1fc415bb80 2024-09-10T07:38:55.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.622+0000 7f1fc1600640 1 -- 172.21.15.99:0/585690791 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0019f0 con 0x7f1fc415bb80 2024-09-10T07:38:55.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.622+0000 7f1fc3e00640 1 -- 172.21.15.99:0/585690791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc415bb80 msgr2=0x7f1fc415bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:55.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.622+0000 7f1fc3e00640 1 --2- 172.21.15.99:0/585690791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc415bb80 0x7f1fc415bfe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00097d0 tx=0x7f1fb002a1a0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.622+0000 7f1fc3e00640 1 -- 172.21.15.99:0/585690791 shutdown_connections 2024-09-10T07:38:55.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.622+0000 7f1fc3e00640 1 --2- 172.21.15.99:0/585690791 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc415bb80 0x7f1fc415bfe0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.622+0000 7f1fc3e00640 1 -- 172.21.15.99:0/585690791 >> 172.21.15.99:0/585690791 conn(0x7f1fc40b2810 msgr2=0x7f1fc40b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:55.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.622+0000 7f1fc3e00640 1 -- 172.21.15.99:0/585690791 shutdown_connections 2024-09-10T07:38:55.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.622+0000 7f1fc3e00640 1 -- 172.21.15.99:0/585690791 wait complete. 2024-09-10T07:38:55.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.624+0000 7f1fc3e00640 1 Processor -- start 2024-09-10T07:38:55.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.624+0000 7f1fc3e00640 1 -- start start 2024-09-10T07:38:55.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.625+0000 7f1fc3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc406e450 0x7f1fc40ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.625+0000 7f1fc3e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc4155c80 0x7f1fc4150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.625+0000 7f1fc3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415bb80 0x7f1fc415da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.625+0000 7f1fc3e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc4072900 con 0x7f1fc415bb80 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.625+0000 7f1fc3e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc4072620 con 0x7f1fc4155c80 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.625+0000 7f1fc3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc4071ce0 con 0x7f1fc406e450 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.625+0000 7f1fc3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415bb80 0x7f1fc415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fc3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415bb80 0x7f1fc415da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47532/0 (socket says 172.21.15.99:47532) 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fc3400640 1 -- 172.21.15.99:0/2757724737 learned_addr learned my addr 172.21.15.99:0/2757724737 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fc2000640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc4155c80 0x7f1fc4150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fc2a00640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc406e450 0x7f1fc40ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fc3400640 1 -- 172.21.15.99:0/2757724737 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc406e450 msgr2=0x7f1fc40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fc3400640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc406e450 0x7f1fc40ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fc3400640 1 -- 172.21.15.99:0/2757724737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc4155c80 msgr2=0x7f1fc4150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:55.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fc3400640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc4155c80 0x7f1fc4150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fc3400640 1 -- 172.21.15.99:0/2757724737 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc40cec30 con 0x7f1fc415bb80 2024-09-10T07:38:55.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fc3400640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415bb80 0x7f1fc415da40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00cca0 tx=0x7f1fbc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:55.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.626+0000 7f1fbb400640 1 -- 172.21.15.99:0/2757724737 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc017070 con 0x7f1fc415bb80 2024-09-10T07:38:55.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.627+0000 7f1fbb400640 1 -- 172.21.15.99:0/2757724737 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fbc012400 con 0x7f1fc415bb80 2024-09-10T07:38:55.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.627+0000 7f1fbb400640 1 -- 172.21.15.99:0/2757724737 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0127f0 con 0x7f1fc415bb80 2024-09-10T07:38:55.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.627+0000 7f1fc3e00640 1 -- 172.21.15.99:0/2757724737 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc40cef10 con 0x7f1fc415bb80 2024-09-10T07:38:55.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.627+0000 7f1fc3e00640 1 -- 172.21.15.99:0/2757724737 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc40cf4d0 con 0x7f1fc415bb80 2024-09-10T07:38:55.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.628+0000 7f1fc3e00640 1 -- 172.21.15.99:0/2757724737 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc40b5640 con 0x7f1fc415bb80 2024-09-10T07:38:55.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.629+0000 7f1fbb400640 1 -- 172.21.15.99:0/2757724737 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fbc01a070 con 0x7f1fc415bb80 2024-09-10T07:38:55.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.630+0000 7f1fbb400640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 0x7f1fa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:55.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.630+0000 7f1fbb400640 1 -- 172.21.15.99:0/2757724737 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7f1fbc08a9f0 con 0x7f1fc415bb80 2024-09-10T07:38:55.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.630+0000 7f1fc2a00640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 0x7f1fa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:55.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.631+0000 7f1fc2a00640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 0x7f1fa406e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40013b0 tx=0x7f1fb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:55.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.634+0000 7f1fbb400640 1 -- 172.21.15.99:0/2757724737 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fc40b5640 con 0x7f1fc415bb80 2024-09-10T07:38:55.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.806+0000 7f1fc3e00640 1 -- 172.21.15.99:0/2757724737 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1fc415bfe0 con 0x7f1fc415bb80 2024-09-10T07:38:55.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.810+0000 7f1fbb400640 1 -- 172.21.15.99:0/2757724737 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f1fbc0590e0 con 0x7f1fc415bb80 2024-09-10T07:38:55.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 -- 172.21.15.99:0/2757724737 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 msgr2=0x7f1fa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:55.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 0x7f1fa406e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40013b0 tx=0x7f1fb4009040 comp rx=0 tx=0).stop 2024-09-10T07:38:55.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 -- 172.21.15.99:0/2757724737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415bb80 msgr2=0x7f1fc415da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:55.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415bb80 0x7f1fc415da40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00cca0 tx=0x7f1fbc00a430 comp rx=0 tx=0).stop 2024-09-10T07:38:55.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 -- 172.21.15.99:0/2757724737 shutdown_connections 2024-09-10T07:38:55.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1fa406be30 0x7f1fa406e2f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fc415bb80 0x7f1fc415da40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fc4155c80 0x7f1fc4150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 --2- 172.21.15.99:0/2757724737 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1fc406e450 0x7f1fc40ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:55.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 -- 172.21.15.99:0/2757724737 >> 172.21.15.99:0/2757724737 conn(0x7f1fc40b2810 msgr2=0x7f1fc4154840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:55.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 -- 172.21.15.99:0/2757724737 shutdown_connections 2024-09-10T07:38:55.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:55.812+0000 7f1fc3e00640 1 -- 172.21.15.99:0/2757724737 wait complete. 2024-09-10T07:38:55.829 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:38:55.829 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:38:55.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:38:56.022 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:38:56.023 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:38:56.023 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:56.058 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:38:56.058 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:38:56.058 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:56.095 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:38:56.095 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:38:56.096 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:56.133 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:38:56.134 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:38:56.134 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:38:56.172 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:38:56.172 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T07:38:56.172 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:38:56.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.327+0000 7f1b27e00640 1 Processor -- start 2024-09-10T07:38:56.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.327+0000 7f1b27e00640 1 -- start start 2024-09-10T07:38:56.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.328+0000 7f1b27e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1b280c9710 0x7f1b281695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.328+0000 7f1b27e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b280d2bd0 con 0x7f1b2815e970 2024-09-10T07:38:56.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.328+0000 7f1b27e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b280d2eb0 con 0x7f1b280d2680 2024-09-10T07:38:56.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.328+0000 7f1b27e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f1b280d37e0 con 0x7f1b280c9710 2024-09-10T07:38:56.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.328+0000 7f1b26a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1b2815e970 0x7f1b280d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34106/0 (socket says 172.21.15.99:34106) 2024-09-10T07:38:56.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.328+0000 7f1b26a00640 1 -- 172.21.15.99:0/4158382563 learned_addr learned my addr 172.21.15.99:0/4158382563 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:56.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.329+0000 7f1b27400640 1 --2- 172.21.15.99:0/4158382563 >> v2:172.21.15.187:3300/0 conn(0x7f1b280c9710 0x7f1b281695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.329+0000 7f1b25600640 1 -- 172.21.15.99:0/4158382563 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98373986 0 0) 0x7f1b280d2bd0 con 0x7f1b2815e970 2024-09-10T07:38:56.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.329+0000 7f1b25600640 1 -- 172.21.15.99:0/4158382563 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b0c003520 con 0x7f1b2815e970 2024-09-10T07:38:56.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.329+0000 7f1b25600640 1 -- 172.21.15.99:0/4158382563 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 847182501 0 0) 0x7f1b0c003520 con 0x7f1b2815e970 2024-09-10T07:38:56.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.329+0000 7f1b27400640 1 -- 172.21.15.99:0/4158382563 >> v1:172.21.15.187:6789/0 conn(0x7f1b280d2680 legacy=0x7f1b280cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.329+0000 7f1b27400640 1 -- 172.21.15.99:0/4158382563 >> v1:172.21.15.99:6789/0 conn(0x7f1b2815e970 legacy=0x7f1b280d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.329+0000 7f1b27400640 1 -- 172.21.15.99:0/4158382563 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b280d3190 con 0x7f1b280c9710 2024-09-10T07:38:56.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.330+0000 7f1b27400640 1 --2- 172.21.15.99:0/4158382563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b280c9710 0x7f1b281695e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1b280d3960 tx=0x7f1b2002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6f017737d6a4ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:56.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.331+0000 7f1b25600640 1 -- 172.21.15.99:0/4158382563 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18001670 con 0x7f1b280c9710 2024-09-10T07:38:56.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.331+0000 7f1b25600640 1 -- 172.21.15.99:0/4158382563 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b20007540 con 0x7f1b280c9710 2024-09-10T07:38:56.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.331+0000 7f1b25600640 1 -- 172.21.15.99:0/4158382563 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20007910 con 0x7f1b280c9710 2024-09-10T07:38:56.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.331+0000 7f1b27e00640 1 -- 172.21.15.99:0/4158382563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b280c9710 msgr2=0x7f1b281695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.331+0000 7f1b27e00640 1 --2- 172.21.15.99:0/4158382563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b280c9710 0x7f1b281695e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1b280d3960 tx=0x7f1b2002a710 comp rx=0 tx=0).stop 2024-09-10T07:38:56.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.331+0000 7f1b27e00640 1 -- 172.21.15.99:0/4158382563 shutdown_connections 2024-09-10T07:38:56.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.331+0000 7f1b27e00640 1 --2- 172.21.15.99:0/4158382563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b280c9710 0x7f1b281695e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.331+0000 7f1b27e00640 1 -- 172.21.15.99:0/4158382563 >> 172.21.15.99:0/4158382563 conn(0x7f1b2809de00 msgr2=0x7f1b280d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:56.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.331+0000 7f1b27e00640 1 -- 172.21.15.99:0/4158382563 shutdown_connections 2024-09-10T07:38:56.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.331+0000 7f1b27e00640 1 -- 172.21.15.99:0/4158382563 wait complete. 2024-09-10T07:38:56.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.333+0000 7f1b27e00640 1 Processor -- start 2024-09-10T07:38:56.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.333+0000 7f1b27e00640 1 -- start start 2024-09-10T07:38:56.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b27e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b280c9710 0x7f1b281583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b27e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b280d2680 0x7f1b281610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b27e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b2815e970 0x7f1b2815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b27e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2815eed0 con 0x7f1b2815e970 2024-09-10T07:38:56.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b27e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2815ed50 con 0x7f1b280c9710 2024-09-10T07:38:56.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b27e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1b280cfc90 con 0x7f1b280d2680 2024-09-10T07:38:56.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b27400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b2815e970 0x7f1b2815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b27400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b2815e970 0x7f1b2815d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47534/0 (socket says 172.21.15.99:47534) 2024-09-10T07:38:56.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b27400640 1 -- 172.21.15.99:0/651550347 learned_addr learned my addr 172.21.15.99:0/651550347 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b26a00640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b280c9710 0x7f1b281583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.334+0000 7f1b26000640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b280d2680 0x7f1b281610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b27400640 1 -- 172.21.15.99:0/651550347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b280d2680 msgr2=0x7f1b281610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b27400640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b280d2680 0x7f1b281610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b27400640 1 -- 172.21.15.99:0/651550347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b280c9710 msgr2=0x7f1b281583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b27400640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b280c9710 0x7f1b281583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b27400640 1 -- 172.21.15.99:0/651550347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b28161750 con 0x7f1b2815e970 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b26000640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b280d2680 0x7f1b281610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b27400640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b2815e970 0x7f1b2815d1a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009e80 tx=0x7f1b20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b1ea00640 1 -- 172.21.15.99:0/651550347 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20040070 con 0x7f1b2815e970 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b1ea00640 1 -- 172.21.15.99:0/651550347 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b20031bc0 con 0x7f1b2815e970 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b27e00640 1 -- 172.21.15.99:0/651550347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b281f4f20 con 0x7f1b2815e970 2024-09-10T07:38:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b1ea00640 1 -- 172.21.15.99:0/651550347 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20009450 con 0x7f1b2815e970 2024-09-10T07:38:56.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.335+0000 7f1b27e00640 1 -- 172.21.15.99:0/651550347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b281f54e0 con 0x7f1b2815e970 2024-09-10T07:38:56.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.336+0000 7f1b27e00640 1 -- 172.21.15.99:0/651550347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b280cf580 con 0x7f1b2815e970 2024-09-10T07:38:56.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.337+0000 7f1b1ea00640 1 -- 172.21.15.99:0/651550347 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b20039040 con 0x7f1b2815e970 2024-09-10T07:38:56.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.338+0000 7f1b1ea00640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b0806be30 0x7f1b0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.338+0000 7f1b1ea00640 1 -- 172.21.15.99:0/651550347 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7f1b200ac470 con 0x7f1b2815e970 2024-09-10T07:38:56.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.338+0000 7f1b26a00640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b0806be30 0x7f1b0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.339+0000 7f1b26a00640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b0806be30 0x7f1b0806e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1b180011e0 tx=0x7f1b180016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:56.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.342+0000 7f1b1ea00640 1 -- 172.21.15.99:0/651550347 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b2007b080 con 0x7f1b2815e970 2024-09-10T07:38:56.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.547+0000 7f1b27e00640 1 -- 172.21.15.99:0/651550347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b281f56b0 con 0x7f1b2815e970 2024-09-10T07:38:56.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.547+0000 7f1b1ea00640 1 -- 172.21.15.99:0/651550347 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+3914 (secure 0 0 0) 0x7f1b2007a980 con 0x7f1b2815e970 2024-09-10T07:38:56.547 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:56.547 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":43,"btime":"2024-09-10T07:38:50:239528+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5336,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/104682621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":104682621},{"type":"v1","addr":"172.21.15.187:6835","nonce":104682621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5587,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4097816103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4097816103},{"type":"v1","addr":"172.21.15.99:6836","nonce":4097816103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1085745704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":1085745704},{"type":"v1","addr":"172.21.15.99:6837","nonce":1085745704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1939216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1939216203},{"type":"v1","addr":"172.21.15.187:6834","nonce":1939216203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[]} 2024-09-10T07:38:56.547 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 43 2024-09-10T07:38:56.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 -- 172.21.15.99:0/651550347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b0806be30 msgr2=0x7f1b0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b0806be30 0x7f1b0806e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1b180011e0 tx=0x7f1b180016f0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 -- 172.21.15.99:0/651550347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b2815e970 msgr2=0x7f1b2815d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b2815e970 0x7f1b2815d1a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009e80 tx=0x7f1b20004a40 comp rx=0 tx=0).stop 2024-09-10T07:38:56.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 -- 172.21.15.99:0/651550347 shutdown_connections 2024-09-10T07:38:56.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1b0806be30 0x7f1b0806e2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b2815e970 0x7f1b2815d1a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b280d2680 0x7f1b281610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 --2- 172.21.15.99:0/651550347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b280c9710 0x7f1b281583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 -- 172.21.15.99:0/651550347 >> 172.21.15.99:0/651550347 conn(0x7f1b2809de00 msgr2=0x7f1b2806d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:56.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 -- 172.21.15.99:0/651550347 shutdown_connections 2024-09-10T07:38:56.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.549+0000 7f1b27e00640 1 -- 172.21.15.99:0/651550347 wait complete. 2024-09-10T07:38:56.566 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:38:56.566 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T07:38:56.567 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:38:56.567 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:38:56.567 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:38:56.567 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T07:38:56.567 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:38:56.567 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:38:56.568 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:38:56.568 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T07:38:56.568 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:38:56.568 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:38:56.568 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:38:56.568 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T07:38:56.568 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:38:56.569 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:38:56.581 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:38:56.581 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:38:56.582 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:38:56.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:38:56.584 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:38:56.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:38:56.585 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:38:56.586 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:38:56.626 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:38:56.627 DEBUG:teuthology.parallel:result is None 2024-09-10T07:38:56.629 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:38:56.629 DEBUG:teuthology.parallel:result is None 2024-09-10T07:38:56.629 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:38:56.630 DEBUG:teuthology.parallel:result is None 2024-09-10T07:38:56.631 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:38:56.631 DEBUG:teuthology.parallel:result is None 2024-09-10T07:38:56.631 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T07:38:56.757 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:38:56.759 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:38:56.763 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:38:56.763 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:38:56.764 INFO:tasks.ceph.mds.b.smithi187.stderr:2024-09-10T07:38:56.766+0000 7fb8b7a00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-10T07:38:56.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.796+0000 7fefdf800640 1 Processor -- start 2024-09-10T07:38:56.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.796+0000 7fefdf800640 1 -- start start 2024-09-10T07:38:56.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.797+0000 7fefdf800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fefd80ba7e0 0x7fefd80d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.797+0000 7fefdf800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fefd80d5870 0x7fefd80d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.797+0000 7fefdf800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd80d3640 con 0x7fefd80d3230 2024-09-10T07:38:56.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.797+0000 7fefdf800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fefd80babc0 con 0x7fefd80ba7e0 2024-09-10T07:38:56.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.797+0000 7fefdf800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fefd80d0aa0 con 0x7fefd80d5870 2024-09-10T07:38:56.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.797+0000 7fefdce00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fefd80ba7e0 0x7fefd80d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.797+0000 7fefdce00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fefd80ba7e0 0x7fefd80d0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47574/0 (socket says 172.21.15.99:47574) 2024-09-10T07:38:56.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.797+0000 7fefdce00640 1 -- 172.21.15.99:0/2302285603 learned_addr learned my addr 172.21.15.99:0/2302285603 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:56.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.797+0000 7fefd7e00640 1 --2- 172.21.15.99:0/2302285603 >> v2:172.21.15.187:3300/0 conn(0x7fefd80d5870 0x7fefd80d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.798+0000 7fefdce00640 1 -- 172.21.15.99:0/2302285603 >> v2:172.21.15.187:3300/0 conn(0x7fefd80d5870 msgr2=0x7fefd80d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:56.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.798+0000 7fefdce00640 1 --2- 172.21.15.99:0/2302285603 >> v2:172.21.15.187:3300/0 conn(0x7fefd80d5870 0x7fefd80d2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.798+0000 7fefdce00640 1 -- 172.21.15.99:0/2302285603 >> v1:172.21.15.187:6789/0 conn(0x7fefd80d3230 legacy=0x7fefd81618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.798+0000 7fefdce00640 1 -- 172.21.15.99:0/2302285603 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd80b7b60 con 0x7fefd80ba7e0 2024-09-10T07:38:56.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.799+0000 7fefdce00640 1 --2- 172.21.15.99:0/2302285603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80ba7e0 0x7fefd80d0220 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fefd808eec0 tx=0x7fefcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775b8b9658e9b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:56.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.799+0000 7fefd7400640 1 -- 172.21.15.99:0/2302285603 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc037070 con 0x7fefd80ba7e0 2024-09-10T07:38:56.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.799+0000 7fefd7400640 1 -- 172.21.15.99:0/2302285603 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefcc032440 con 0x7fefd80ba7e0 2024-09-10T07:38:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.799+0000 7fefd7400640 1 -- 172.21.15.99:0/2302285603 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc032810 con 0x7fefd80ba7e0 2024-09-10T07:38:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.800+0000 7fefdf800640 1 -- 172.21.15.99:0/2302285603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80ba7e0 msgr2=0x7fefd80d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.800+0000 7fefdf800640 1 --2- 172.21.15.99:0/2302285603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80ba7e0 0x7fefd80d0220 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fefd808eec0 tx=0x7fefcc02a270 comp rx=0 tx=0).stop 2024-09-10T07:38:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.800+0000 7fefdf800640 1 -- 172.21.15.99:0/2302285603 shutdown_connections 2024-09-10T07:38:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.800+0000 7fefdf800640 1 --2- 172.21.15.99:0/2302285603 >> v2:172.21.15.187:3300/0 conn(0x7fefd80d5870 0x7fefd80d2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.800+0000 7fefdf800640 1 --2- 172.21.15.99:0/2302285603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80ba7e0 0x7fefd80d0220 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.800+0000 7fefdf800640 1 -- 172.21.15.99:0/2302285603 >> 172.21.15.99:0/2302285603 conn(0x7fefd80d4c70 msgr2=0x7fefd80d5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.800+0000 7fefdf800640 1 -- 172.21.15.99:0/2302285603 shutdown_connections 2024-09-10T07:38:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.800+0000 7fefdf800640 1 -- 172.21.15.99:0/2302285603 wait complete. 2024-09-10T07:38:56.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.801+0000 7fefdf800640 1 Processor -- start 2024-09-10T07:38:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.802+0000 7fefdf800640 1 -- start start 2024-09-10T07:38:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.802+0000 7fefdf800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefd80ba7e0 0x7fefd81d4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.802+0000 7fefdf800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefd80d3230 0x7fefd80b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.802+0000 7fefdf800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80d5870 0x7fefd81e7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.802+0000 7fefdf800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fefd80b8400 con 0x7fefd80d5870 2024-09-10T07:38:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.802+0000 7fefdf800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fefd80b8120 con 0x7fefd80d3230 2024-09-10T07:38:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.802+0000 7fefdf800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fefd80d0760 con 0x7fefd80ba7e0 2024-09-10T07:38:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefdd800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80d5870 0x7fefd81e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefdce00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefd80ba7e0 0x7fefd81d4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefd7e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefd80d3230 0x7fefd80b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefdd800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80d5870 0x7fefd81e7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47580/0 (socket says 172.21.15.99:47580) 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefdd800640 1 -- 172.21.15.99:0/3233512352 learned_addr learned my addr 172.21.15.99:0/3233512352 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefdce00640 1 -- 172.21.15.99:0/3233512352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefd80d3230 msgr2=0x7fefd80b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefdce00640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefd80d3230 0x7fefd80b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefdce00640 1 -- 172.21.15.99:0/3233512352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80d5870 msgr2=0x7fefd81e7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefdce00640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80d5870 0x7fefd81e7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefdce00640 1 -- 172.21.15.99:0/3233512352 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd81e7e70 con 0x7fefd80ba7e0 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.803+0000 7fefdd800640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80d5870 0x7fefd81e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.804+0000 7fefdce00640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefd80ba7e0 0x7fefd81d4ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fefcc031000 tx=0x7fefcc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.804+0000 7fefd4c00640 1 -- 172.21.15.99:0/3233512352 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc041030 con 0x7fefd80ba7e0 2024-09-10T07:38:56.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.804+0000 7fefd4c00640 1 -- 172.21.15.99:0/3233512352 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefcc030440 con 0x7fefd80ba7e0 2024-09-10T07:38:56.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.804+0000 7fefd4c00640 1 -- 172.21.15.99:0/3233512352 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc037040 con 0x7fefd80ba7e0 2024-09-10T07:38:56.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.804+0000 7fefdf800640 1 -- 172.21.15.99:0/3233512352 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd81e8150 con 0x7fefd80ba7e0 2024-09-10T07:38:56.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.804+0000 7fefdf800640 1 -- 172.21.15.99:0/3233512352 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd81e8710 con 0x7fefd80ba7e0 2024-09-10T07:38:56.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.805+0000 7fefdf800640 1 -- 172.21.15.99:0/3233512352 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd80d0220 con 0x7fefd80ba7e0 2024-09-10T07:38:56.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.806+0000 7fefd4c00640 1 -- 172.21.15.99:0/3233512352 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fefcc044070 con 0x7fefd80ba7e0 2024-09-10T07:38:56.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.807+0000 7fefd4c00640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fefb806be30 0x7fefb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:56.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.807+0000 7fefd4c00640 1 -- 172.21.15.99:0/3233512352 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7fefcc0ab920 con 0x7fefd80ba7e0 2024-09-10T07:38:56.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.807+0000 7fefd7e00640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fefb806be30 0x7fefb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:56.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.808+0000 7fefd7e00640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fefb806be30 0x7fefb806e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fefd81f7f60 tx=0x7fefc4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:56.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.811+0000 7fefd4c00640 1 -- 172.21.15.99:0/3233512352 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fefcc079f60 con 0x7fefd80ba7e0 2024-09-10T07:38:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:56.995+0000 7fefdf800640 1 -- 172.21.15.99:0/3233512352 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fefd80cfe70 con 0x7fefd80ba7e0 2024-09-10T07:38:57.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.282+0000 7fefd4c00640 1 -- 172.21.15.99:0/3233512352 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v95) ==== 97+0+0 (secure 0 0 0) 0x7fefcc07e260 con 0x7fefd80ba7e0 2024-09-10T07:38:57.282 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-09-10T07:38:57.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 -- 172.21.15.99:0/3233512352 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fefb806be30 msgr2=0x7fefb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fefb806be30 0x7fefb806e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fefd81f7f60 tx=0x7fefc4009190 comp rx=0 tx=0).stop 2024-09-10T07:38:57.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 -- 172.21.15.99:0/3233512352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefd80ba7e0 msgr2=0x7fefd81d4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefd80ba7e0 0x7fefd81d4ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fefcc031000 tx=0x7fefcc0046c0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 -- 172.21.15.99:0/3233512352 shutdown_connections 2024-09-10T07:38:57.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fefb806be30 0x7fefb806e2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd80d5870 0x7fefd81e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefd80d3230 0x7fefd80b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 --2- 172.21.15.99:0/3233512352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefd80ba7e0 0x7fefd81d4ff0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 -- 172.21.15.99:0/3233512352 >> 172.21.15.99:0/3233512352 conn(0x7fefd80d4c70 msgr2=0x7fefd806ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:57.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 -- 172.21.15.99:0/3233512352 shutdown_connections 2024-09-10T07:38:57.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.285+0000 7fefdf800640 1 -- 172.21.15.99:0/3233512352 wait complete. 2024-09-10T07:38:57.301 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T07:38:57.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.456+0000 7ff9f7200640 1 Processor -- start 2024-09-10T07:38:57.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.456+0000 7ff9f7200640 1 -- start start 2024-09-10T07:38:57.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.457+0000 7ff9f7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9f815c960 0x7ff9f806d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.457+0000 7ff9f7200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f806d920 con 0x7ff9f80b5960 2024-09-10T07:38:57.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.457+0000 7ff9f7200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f806dc00 con 0x7ff9f815c580 2024-09-10T07:38:57.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.457+0000 7ff9f7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f80b3930 con 0x7ff9f815c960 2024-09-10T07:38:57.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.457+0000 7ff9f6800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff9f80b5960 0x7ff9f806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34118/0 (socket says 172.21.15.99:34118) 2024-09-10T07:38:57.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.457+0000 7ff9f6800640 1 -- 172.21.15.99:0/1059946850 learned_addr learned my addr 172.21.15.99:0/1059946850 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f5400640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9f815c960 0x7ff9f806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2771209578 0 0) 0x7ff9f806d920 con 0x7ff9f80b5960 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9dc003520 con 0x7ff9f80b5960 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331599848 0 0) 0x7ff9f806dc00 con 0x7ff9f815c580 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9f806d920 con 0x7ff9f815c580 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2176710742 0 0) 0x7ff9dc003520 con 0x7ff9f80b5960 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9f815c960 msgr2=0x7ff9f806d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9f815c960 0x7ff9f806d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 >> v1:172.21.15.187:6789/0 conn(0x7ff9f815c580 legacy=0x7ff9f80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f806dee0 con 0x7ff9f80b5960 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7ff9f00019f0 con 0x7ff9f80b5960 2024-09-10T07:38:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 >> v1:172.21.15.99:6789/0 conn(0x7ff9f80b5960 legacy=0x7ff9f806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 0x7ff9dc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9dc004800 0x7ff9dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9dc0051c0 0x7ff9dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f80b3930 con 0x7ff9dc003b70 2024-09-10T07:38:57.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc00bf00 con 0x7ff9dc004800 2024-09-10T07:38:57.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff9dc00c080 con 0x7ff9dc0051c0 2024-09-10T07:38:57.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f5e00640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 0x7ff9dc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.458+0000 7ff9f5400640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9dc004800 0x7ff9dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.459+0000 7ff9f6800640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9dc0051c0 0x7ff9dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.459+0000 7ff9f5e00640 1 -- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9dc0051c0 msgr2=0x7ff9dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:57.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.459+0000 7ff9f5e00640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9dc0051c0 0x7ff9dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.459+0000 7ff9f5e00640 1 -- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9dc004800 msgr2=0x7ff9dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:57.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.459+0000 7ff9f5e00640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9dc004800 0x7ff9dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.459+0000 7ff9f5e00640 1 -- 172.21.15.99:0/1059946850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9dc003520 con 0x7ff9dc003b70 2024-09-10T07:38:57.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.460+0000 7ff9f5e00640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 0x7ff9dc003f70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80018d0 tx=0x7ff9dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8137a1bcd20bc2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:57.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.460+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80014f0 con 0x7ff9dc003b70 2024-09-10T07:38:57.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.460+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e80052d0 con 0x7ff9dc003b70 2024-09-10T07:38:57.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.460+0000 7ff9f4a00640 1 -- 172.21.15.99:0/1059946850 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e802aca0 con 0x7ff9dc003b70 2024-09-10T07:38:57.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.460+0000 7ff9f7200640 1 -- 172.21.15.99:0/1059946850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 msgr2=0x7ff9dc003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.460+0000 7ff9f7200640 1 --2- 172.21.15.99:0/1059946850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 0x7ff9dc003f70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80018d0 tx=0x7ff9dc005830 comp rx=0 tx=0).stop 2024-09-10T07:38:57.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.461+0000 7ff9f6800640 1 -- 172.21.15.99:0/1059946850 reap_dead start 2024-09-10T07:38:57.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.461+0000 7ff9f7200640 1 -- 172.21.15.99:0/1059946850 shutdown_connections 2024-09-10T07:38:57.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.461+0000 7ff9f7200640 1 -- 172.21.15.99:0/1059946850 >> 172.21.15.99:0/1059946850 conn(0x7ff9f80b2810 msgr2=0x7ff9f80b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:57.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.461+0000 7ff9f7200640 1 -- 172.21.15.99:0/1059946850 shutdown_connections 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.461+0000 7ff9f7200640 1 -- 172.21.15.99:0/1059946850 wait complete. 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.462+0000 7ff9f7200640 1 Processor -- start 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.463+0000 7ff9f7200640 1 -- start start 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.463+0000 7ff9f7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 0x7ff9f8146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.463+0000 7ff9f7200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9f81e6f80 0x7ff9f8149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.463+0000 7ff9f7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9f8149cd0 0x7ff9f8148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.463+0000 7ff9f7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f806c320 con 0x7ff9dc003b70 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.463+0000 7ff9f7200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f80b5d60 con 0x7ff9f81e6f80 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.463+0000 7ff9f7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f806c4a0 con 0x7ff9f8149cd0 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 0x7ff9f8146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 0x7ff9f8146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47586/0 (socket says 172.21.15.99:47586) 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f5e00640 1 -- 172.21.15.99:0/1797539579 learned_addr learned my addr 172.21.15.99:0/1797539579 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f5400640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9f81e6f80 0x7ff9f8149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f6800640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9f8149cd0 0x7ff9f8148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f5e00640 1 -- 172.21.15.99:0/1797539579 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9f8149cd0 msgr2=0x7ff9f8148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f5e00640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9f8149cd0 0x7ff9f8148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f5e00640 1 -- 172.21.15.99:0/1797539579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9f81e6f80 msgr2=0x7ff9f8149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f5e00640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9f81e6f80 0x7ff9f8149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f5e00640 1 -- 172.21.15.99:0/1797539579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f8147420 con 0x7ff9dc003b70 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.464+0000 7ff9f5e00640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 0x7ff9f8146ee0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80018d0 tx=0x7ff9e80012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.465+0000 7ff9ee000640 1 -- 172.21.15.99:0/1797539579 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e803f020 con 0x7ff9dc003b70 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.465+0000 7ff9ee000640 1 -- 172.21.15.99:0/1797539579 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e8006e50 con 0x7ff9dc003b70 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.465+0000 7ff9ee000640 1 -- 172.21.15.99:0/1797539579 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8037040 con 0x7ff9dc003b70 2024-09-10T07:38:57.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.465+0000 7ff9f7200640 1 -- 172.21.15.99:0/1797539579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f81478a0 con 0x7ff9dc003b70 2024-09-10T07:38:57.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.465+0000 7ff9f7200640 1 -- 172.21.15.99:0/1797539579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f8147e60 con 0x7ff9dc003b70 2024-09-10T07:38:57.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.466+0000 7ff9f7200640 1 -- 172.21.15.99:0/1797539579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f80b4ee0 con 0x7ff9dc003b70 2024-09-10T07:38:57.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.467+0000 7ff9ee000640 1 -- 172.21.15.99:0/1797539579 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9e8042020 con 0x7ff9dc003b70 2024-09-10T07:38:57.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.468+0000 7ff9ee000640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff9d806be30 0x7ff9d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.468+0000 7ff9ee000640 1 -- 172.21.15.99:0/1797539579 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4857+0+0 (secure 0 0 0) 0x7ff9e80aa700 con 0x7ff9dc003b70 2024-09-10T07:38:57.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.468+0000 7ff9f5400640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff9d806be30 0x7ff9d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.469+0000 7ff9f5400640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff9d806be30 0x7ff9d806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff9f81e7360 tx=0x7ff9e4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:57.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.473+0000 7ff9ee000640 1 -- 172.21.15.99:0/1797539579 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9f80b4ee0 con 0x7ff9dc003b70 2024-09-10T07:38:57.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.706+0000 7ff9f7200640 1 -- 172.21.15.99:0/1797539579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff9f814a0e0 con 0x7ff9dc003b70 2024-09-10T07:38:57.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.707+0000 7ff9ee000640 1 -- 172.21.15.99:0/1797539579 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7ff9f814a0e0 con 0x7ff9dc003b70 2024-09-10T07:38:57.708 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:57.708 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:38:57.708 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-09-10T07:38:57.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.708 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-09-10T07:38:57.709 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw==", 2024-09-10T07:38:57.709 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.709 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:38:57.709 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:38:57.709 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:38:57.709 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.710 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.710 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-09-10T07:38:57.710 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ==", 2024-09-10T07:38:57.711 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.712 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:38:57.712 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:38:57.712 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:38:57.712 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.713 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-09-10T07:38:57.713 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw==", 2024-09-10T07:38:57.713 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.713 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:38:57.713 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:38:57.713 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:38:57.714 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.714 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-09-10T07:38:57.714 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw==", 2024-09-10T07:38:57.714 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.714 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:38:57.714 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:38:57.715 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:38:57.715 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.715 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-09-10T07:38:57.715 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA==", 2024-09-10T07:38:57.715 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.715 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:38:57.716 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:38:57.716 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.716 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.717 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-09-10T07:38:57.717 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A==", 2024-09-10T07:38:57.717 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.717 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:38:57.717 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:38:57.718 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.718 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-09-10T07:38:57.718 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w==", 2024-09-10T07:38:57.718 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.718 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:38:57.718 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:38:57.719 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.719 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-09-10T07:38:57.719 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA==", 2024-09-10T07:38:57.719 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.719 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:38:57.720 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:38:57.720 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.720 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-09-10T07:38:57.720 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w==", 2024-09-10T07:38:57.720 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.721 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:38:57.721 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:38:57.721 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.721 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-09-10T07:38:57.721 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw==", 2024-09-10T07:38:57.721 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.722 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:38:57.722 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:38:57.722 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.722 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.722 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-09-10T07:38:57.722 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw==", 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg==", 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:38:57.723 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg==", 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow r", 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.724 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ==", 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A==", 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.725 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw==", 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:38:57.726 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBc9t9m2Fs5JBAAQfJNCUhmbHevYDJWsG/oAg==", 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-09-10T07:38:57.727 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q==", 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw==", 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:38:57.728 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:57.729 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:38:57.729 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:38:57.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 -- 172.21.15.99:0/1797539579 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff9d806be30 msgr2=0x7ff9d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff9d806be30 0x7ff9d806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff9f81e7360 tx=0x7ff9e4009190 comp rx=0 tx=0).stop 2024-09-10T07:38:57.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 -- 172.21.15.99:0/1797539579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 msgr2=0x7ff9f8146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 0x7ff9f8146ee0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80018d0 tx=0x7ff9e80012d0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 -- 172.21.15.99:0/1797539579 shutdown_connections 2024-09-10T07:38:57.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9f8149cd0 0x7ff9f8148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9f81e6f80 0x7ff9f8149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff9d806be30 0x7ff9d806e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 --2- 172.21.15.99:0/1797539579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9dc003b70 0x7ff9f8146ee0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 -- 172.21.15.99:0/1797539579 >> 172.21.15.99:0/1797539579 conn(0x7ff9f80b2810 msgr2=0x7ff9f815f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:57.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 -- 172.21.15.99:0/1797539579 shutdown_connections 2024-09-10T07:38:57.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.709+0000 7ff9f7200640 1 -- 172.21.15.99:0/1797539579 wait complete. 2024-09-10T07:38:57.732 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:38:57.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.886+0000 7f6e4fe00640 1 Processor -- start 2024-09-10T07:38:57.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.886+0000 7f6e4fe00640 1 -- start start 2024-09-10T07:38:57.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.887+0000 7f6e4fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e50162160 0x7f6e500d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.887+0000 7f6e4fe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e500d37e0 con 0x7f6e500b37a0 2024-09-10T07:38:57.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.887+0000 7f6e4fe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e500d1990 con 0x7f6e500cf670 2024-09-10T07:38:57.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.887+0000 7f6e4fe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6e500d35b0 con 0x7f6e50162160 2024-09-10T07:38:57.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.887+0000 7f6e4e000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6e500b37a0 0x7f6e500d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34124/0 (socket says 172.21.15.99:34124) 2024-09-10T07:38:57.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.887+0000 7f6e4e000640 1 -- 172.21.15.99:0/558856359 learned_addr learned my addr 172.21.15.99:0/558856359 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:57.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.887+0000 7f6e4ea00640 1 --2- 172.21.15.99:0/558856359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e50162160 0x7f6e500d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.888+0000 7f6e4d600640 1 -- 172.21.15.99:0/558856359 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200634824 0 0) 0x7f6e500d37e0 con 0x7f6e500b37a0 2024-09-10T07:38:57.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.888+0000 7f6e4d600640 1 -- 172.21.15.99:0/558856359 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e34003520 con 0x7f6e500b37a0 2024-09-10T07:38:57.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.888+0000 7f6e4d600640 1 -- 172.21.15.99:0/558856359 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4079804594 0 0) 0x7f6e500d1990 con 0x7f6e500cf670 2024-09-10T07:38:57.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.888+0000 7f6e4d600640 1 -- 172.21.15.99:0/558856359 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e500d37e0 con 0x7f6e500cf670 2024-09-10T07:38:57.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.888+0000 7f6e4ea00640 1 -- 172.21.15.99:0/558856359 >> v1:172.21.15.187:6789/0 conn(0x7f6e500cf670 legacy=0x7f6e500cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.888+0000 7f6e4ea00640 1 -- 172.21.15.99:0/558856359 >> v1:172.21.15.99:6789/0 conn(0x7f6e500b37a0 legacy=0x7f6e500d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.888+0000 7f6e4ea00640 1 -- 172.21.15.99:0/558856359 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e500d1c70 con 0x7f6e50162160 2024-09-10T07:38:57.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.889+0000 7f6e4ea00640 1 --2- 172.21.15.99:0/558856359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e50162160 0x7f6e500d2960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009dc0 tx=0x7f6e4002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=925f5f2a1d4661d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.889+0000 7f6e4d600640 1 -- 172.21.15.99:0/558856359 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4002ae60 con 0x7f6e50162160 2024-09-10T07:38:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.889+0000 7f6e4d600640 1 -- 172.21.15.99:0/558856359 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e40007740 con 0x7f6e50162160 2024-09-10T07:38:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.889+0000 7f6e4d600640 1 -- 172.21.15.99:0/558856359 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40007b10 con 0x7f6e50162160 2024-09-10T07:38:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.890+0000 7f6e4fe00640 1 -- 172.21.15.99:0/558856359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e50162160 msgr2=0x7f6e500d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.890+0000 7f6e4fe00640 1 --2- 172.21.15.99:0/558856359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e50162160 0x7f6e500d2960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009dc0 tx=0x7f6e4002a640 comp rx=0 tx=0).stop 2024-09-10T07:38:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.890+0000 7f6e4fe00640 1 -- 172.21.15.99:0/558856359 shutdown_connections 2024-09-10T07:38:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.890+0000 7f6e4fe00640 1 --2- 172.21.15.99:0/558856359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e50162160 0x7f6e500d2960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.890+0000 7f6e4fe00640 1 -- 172.21.15.99:0/558856359 >> 172.21.15.99:0/558856359 conn(0x7f6e500d4a60 msgr2=0x7f6e500d4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.890+0000 7f6e4fe00640 1 -- 172.21.15.99:0/558856359 shutdown_connections 2024-09-10T07:38:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.890+0000 7f6e4fe00640 1 -- 172.21.15.99:0/558856359 wait complete. 2024-09-10T07:38:57.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.891+0000 7f6e4fe00640 1 Processor -- start 2024-09-10T07:38:57.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.891+0000 7f6e4fe00640 1 -- start start 2024-09-10T07:38:57.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.892+0000 7f6e4fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e500b37a0 0x7f6e500b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.892+0000 7f6e4fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e500cf670 0x7f6e500ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.892+0000 7f6e4fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e50162160 0x7f6e5015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.892+0000 7f6e4fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6e500b2700 con 0x7f6e500b37a0 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.892+0000 7f6e4fe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6e500d3ac0 con 0x7f6e50162160 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.892+0000 7f6e4fe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6e500b2880 con 0x7f6e500cf670 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.892+0000 7f6e4ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e500b37a0 0x7f6e500b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.892+0000 7f6e4ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e500b37a0 0x7f6e500b97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47596/0 (socket says 172.21.15.99:47596) 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.892+0000 7f6e4ea00640 1 -- 172.21.15.99:0/3059974258 learned_addr learned my addr 172.21.15.99:0/3059974258 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e4e000640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e500cf670 0x7f6e500ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e4f400640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e50162160 0x7f6e5015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e4ea00640 1 -- 172.21.15.99:0/3059974258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e500cf670 msgr2=0x7f6e500ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e4ea00640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e500cf670 0x7f6e500ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e4ea00640 1 -- 172.21.15.99:0/3059974258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e50162160 msgr2=0x7f6e5015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e4ea00640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e50162160 0x7f6e5015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:57.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e4ea00640 1 -- 172.21.15.99:0/3059974258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e500ba050 con 0x7f6e500b37a0 2024-09-10T07:38:57.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e4ea00640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e500b37a0 0x7f6e500b97f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6e40000f80 tx=0x7f6e40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:57.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e46a00640 1 -- 172.21.15.99:0/3059974258 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4003f070 con 0x7f6e500b37a0 2024-09-10T07:38:57.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e46a00640 1 -- 172.21.15.99:0/3059974258 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4002ae60 con 0x7f6e500b37a0 2024-09-10T07:38:57.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e46a00640 1 -- 172.21.15.99:0/3059974258 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40031c60 con 0x7f6e500b37a0 2024-09-10T07:38:57.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.893+0000 7f6e4fe00640 1 -- 172.21.15.99:0/3059974258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5015d0d0 con 0x7f6e500b37a0 2024-09-10T07:38:57.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.894+0000 7f6e4fe00640 1 -- 172.21.15.99:0/3059974258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5015d690 con 0x7f6e500b37a0 2024-09-10T07:38:57.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.895+0000 7f6e4fe00640 1 -- 172.21.15.99:0/3059974258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e50162540 con 0x7f6e500b37a0 2024-09-10T07:38:57.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.896+0000 7f6e46a00640 1 -- 172.21.15.99:0/3059974258 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e4003b410 con 0x7f6e500b37a0 2024-09-10T07:38:57.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.896+0000 7f6e46a00640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e3006be30 0x7f6e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:57.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.896+0000 7f6e46a00640 1 -- 172.21.15.99:0/3059974258 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4857+0+0 (secure 0 0 0) 0x7f6e400ac0a0 con 0x7f6e500b37a0 2024-09-10T07:38:57.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.897+0000 7f6e4e000640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e3006be30 0x7f6e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:57.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.897+0000 7f6e4e000640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e3006be30 0x7f6e3006e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6e500ba520 tx=0x7f6e3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:57.901+0000 7f6e46a00640 1 -- 172.21.15.99:0/3059974258 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e4007ae30 con 0x7f6e500b37a0 2024-09-10T07:38:58.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.075+0000 7f6e4fe00640 1 -- 172.21.15.99:0/3059974258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6e500b50e0 con 0x7f6e500b37a0 2024-09-10T07:38:58.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.075+0000 7f6e46a00640 1 -- 172.21.15.99:0/3059974258 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) ==== 84+0+65 (secure 0 0 0) 0x7f6e4007a730 con 0x7f6e500b37a0 2024-09-10T07:38:58.075 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:38:58.075 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:38:58.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:38:58.076 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:38:58.076 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:38:58.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:38:58.076 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:38:58.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 -- 172.21.15.99:0/3059974258 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e3006be30 msgr2=0x7f6e3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:58.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e3006be30 0x7f6e3006e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6e500ba520 tx=0x7f6e3c009040 comp rx=0 tx=0).stop 2024-09-10T07:38:58.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 -- 172.21.15.99:0/3059974258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e500b37a0 msgr2=0x7f6e500b97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:58.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e500b37a0 0x7f6e500b97f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6e40000f80 tx=0x7f6e40004a40 comp rx=0 tx=0).stop 2024-09-10T07:38:58.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 -- 172.21.15.99:0/3059974258 shutdown_connections 2024-09-10T07:38:58.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e50162160 0x7f6e5015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:58.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e500cf670 0x7f6e500ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:58.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e3006be30 0x7f6e3006e2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:58.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 --2- 172.21.15.99:0/3059974258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e500b37a0 0x7f6e500b97f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:58.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 -- 172.21.15.99:0/3059974258 >> 172.21.15.99:0/3059974258 conn(0x7f6e500d4a60 msgr2=0x7f6e500b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:58.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 -- 172.21.15.99:0/3059974258 shutdown_connections 2024-09-10T07:38:58.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.077+0000 7f6e4fe00640 1 -- 172.21.15.99:0/3059974258 wait complete. 2024-09-10T07:38:58.093 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:38:58.093 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:38:58.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.251+0000 7f9836600640 1 Processor -- start 2024-09-10T07:38:58.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.251+0000 7f9836600640 1 -- start start 2024-09-10T07:38:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f9836600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f983015b7d0 0x7f98300b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f9836600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f983006e560 0x7f98300b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f9836600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983006f620 con 0x7f98300b08d0 2024-09-10T07:38:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f9836600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f983006f900 con 0x7f983015b7d0 2024-09-10T07:38:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f9836600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f983006fbe0 con 0x7f983006e560 2024-09-10T07:38:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f9835c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f98300b08d0 0x7f98300723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34128/0 (socket says 172.21.15.99:34128) 2024-09-10T07:38:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f9835c00640 1 -- 172.21.15.99:0/205225430 learned_addr learned my addr 172.21.15.99:0/205225430 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:58.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f982fe00640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f983006e560 0x7f98300b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f9835200640 1 --2- 172.21.15.99:0/205225430 >> v2:172.21.15.187:3300/0 conn(0x7f983015b7d0 0x7f98300b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639543079 0 0) 0x7f983006f620 con 0x7f98300b08d0 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.253+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9814003520 con 0x7f98300b08d0 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 474376212 0 0) 0x7f9814003520 con 0x7f98300b08d0 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f983006e560 msgr2=0x7f98300b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f983006e560 0x7f98300b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 >> v2:172.21.15.187:3300/0 conn(0x7f983015b7d0 msgr2=0x7f98300b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 --2- 172.21.15.99:0/205225430 >> v2:172.21.15.187:3300/0 conn(0x7f983015b7d0 0x7f98300b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983015bfb0 con 0x7f98300b08d0 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f98280019f0 con 0x7f98300b08d0 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 >> v1:172.21.15.99:6789/0 conn(0x7f98300b08d0 legacy=0x7f98300723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98140039b0 0x7f9814003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9814004800 0x7f9814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98140051c0 0x7f981400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f983006f900 con 0x7f9814004800 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f983006fbe0 con 0x7f98140039b0 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f981400bf00 con 0x7f98140051c0 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982fe00640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f983006e560 0x7f98300b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f9835200640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98140039b0 0x7f9814003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f982fe00640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9814004800 0x7f9814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.254+0000 7f9835c00640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98140051c0 0x7f981400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.255+0000 7f982fe00640 1 -- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98140051c0 msgr2=0x7f981400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.255+0000 7f982fe00640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98140051c0 0x7f981400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.255+0000 7f982fe00640 1 -- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98140039b0 msgr2=0x7f9814003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.255+0000 7f982fe00640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98140039b0 0x7f9814003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.255+0000 7f982fe00640 1 -- 172.21.15.99:0/205225430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9814003520 con 0x7f9814004800 2024-09-10T07:38:58.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.255+0000 7f9835200640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98140039b0 0x7f9814003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:38:58.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.256+0000 7f982fe00640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9814004800 0x7f9814004c80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f98300b68b0 tx=0x7f9814005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e056c14abe00b749 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:58.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.256+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c036070 con 0x7f9814004800 2024-09-10T07:38:58.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.256+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981c004030 con 0x7f9814004800 2024-09-10T07:38:58.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.256+0000 7f982f400640 1 -- 172.21.15.99:0/205225430 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c0097f0 con 0x7f9814004800 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.256+0000 7f9836600640 1 -- 172.21.15.99:0/205225430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9814004800 msgr2=0x7f9814004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.256+0000 7f9836600640 1 --2- 172.21.15.99:0/205225430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9814004800 0x7f9814004c80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f98300b68b0 tx=0x7f9814005830 comp rx=0 tx=0).stop 2024-09-10T07:38:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.256+0000 7f9835c00640 1 -- 172.21.15.99:0/205225430 reap_dead start 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.256+0000 7f9836600640 1 -- 172.21.15.99:0/205225430 shutdown_connections 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.256+0000 7f9836600640 1 -- 172.21.15.99:0/205225430 >> 172.21.15.99:0/205225430 conn(0x7f983006cd20 msgr2=0x7f983006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.257+0000 7f9836600640 1 -- 172.21.15.99:0/205225430 shutdown_connections 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.257+0000 7f9836600640 1 -- 172.21.15.99:0/205225430 wait complete. 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.258+0000 7f9836600640 1 Processor -- start 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.258+0000 7f9836600640 1 -- start start 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.259+0000 7f9836600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9814004800 0x7f9830149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.259+0000 7f9836600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f983014e8b0 0x7f9830167780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.259+0000 7f9836600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983014ed10 0x7f9830152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.259+0000 7f9836600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f983015bd30 con 0x7f983014ed10 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.259+0000 7f9836600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f983015bbb0 con 0x7f983014e8b0 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.259+0000 7f9836600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f983015d7c0 con 0x7f9814004800 2024-09-10T07:38:58.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.259+0000 7f9835c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983014ed10 0x7f9830152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.259+0000 7f9835c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983014ed10 0x7f9830152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47610/0 (socket says 172.21.15.99:47610) 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.259+0000 7f9835c00640 1 -- 172.21.15.99:0/3535946923 learned_addr learned my addr 172.21.15.99:0/3535946923 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f9835200640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9814004800 0x7f9830149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f982fe00640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f983014e8b0 0x7f9830167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f9835c00640 1 -- 172.21.15.99:0/3535946923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9814004800 msgr2=0x7f9830149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f9835c00640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9814004800 0x7f9830149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f9835c00640 1 -- 172.21.15.99:0/3535946923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f983014e8b0 msgr2=0x7f9830167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f9835c00640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f983014e8b0 0x7f9830167780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f9835c00640 1 -- 172.21.15.99:0/3535946923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983014daf0 con 0x7f983014ed10 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f982fe00640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f983014e8b0 0x7f9830167780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f9835c00640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983014ed10 0x7f9830152780 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f983006e9d0 tx=0x7f9828007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f982cc00640 1 -- 172.21.15.99:0/3535946923 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820009690 con 0x7f983014ed10 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f982cc00640 1 -- 172.21.15.99:0/3535946923 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9828018070 con 0x7f983014ed10 2024-09-10T07:38:58.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f982cc00640 1 -- 172.21.15.99:0/3535946923 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98280133f0 con 0x7f983014ed10 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.260+0000 7f9836600640 1 -- 172.21.15.99:0/3535946923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983014ddd0 con 0x7f983014ed10 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.261+0000 7f9836600640 1 -- 172.21.15.99:0/3535946923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98300b03f0 con 0x7f983014ed10 2024-09-10T07:38:58.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.262+0000 7f9836600640 1 -- 172.21.15.99:0/3535946923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98300b5210 con 0x7f983014ed10 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.263+0000 7f982cc00640 1 -- 172.21.15.99:0/3535946923 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9828013590 con 0x7f983014ed10 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.263+0000 7f982cc00640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f981006be30 0x7f981006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.263+0000 7f982cc00640 1 -- 172.21.15.99:0/3535946923 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4857+0+0 (secure 0 0 0) 0x7f982808af90 con 0x7f983014ed10 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.264+0000 7f9835200640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f981006be30 0x7f981006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:58.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.264+0000 7f9835200640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f981006be30 0x7f981006e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9820009ca0 tx=0x7f9820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:58.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.268+0000 7f982cc00640 1 -- 172.21.15.99:0/3535946923 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9828059bf0 con 0x7f983014ed10 2024-09-10T07:38:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:58.444+0000 7f9836600640 1 -- 172.21.15.99:0/3535946923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f98300b49c0 con 0x7f983014ed10 2024-09-10T07:38:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.285+0000 7f982cc00640 1 -- 172.21.15.99:0/3535946923 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) ==== 138+0+0 (secure 0 0 0) 0x7f98280594f0 con 0x7f983014ed10 2024-09-10T07:38:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:38:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.288+0000 7f9836600640 1 -- 172.21.15.99:0/3535946923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f981006be30 msgr2=0x7f981006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.288+0000 7f9836600640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f981006be30 0x7f981006e2f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9820009ca0 tx=0x7f9820008040 comp rx=0 tx=0).stop 2024-09-10T07:38:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.288+0000 7f9836600640 1 -- 172.21.15.99:0/3535946923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983014ed10 msgr2=0x7f9830152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.288+0000 7f9836600640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983014ed10 0x7f9830152780 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f983006e9d0 tx=0x7f9828007b20 comp rx=0 tx=0).stop 2024-09-10T07:38:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.288+0000 7f9836600640 1 -- 172.21.15.99:0/3535946923 shutdown_connections 2024-09-10T07:38:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.288+0000 7f9836600640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f981006be30 0x7f981006e2f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.288+0000 7f9836600640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f983014ed10 0x7f9830152780 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:59.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.288+0000 7f9836600640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f983014e8b0 0x7f9830167780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:59.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.288+0000 7f9836600640 1 --2- 172.21.15.99:0/3535946923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9814004800 0x7f9830149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:59.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.288+0000 7f9836600640 1 -- 172.21.15.99:0/3535946923 >> 172.21.15.99:0/3535946923 conn(0x7f983006cd20 msgr2=0x7f983015cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:59.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.289+0000 7f9836600640 1 -- 172.21.15.99:0/3535946923 shutdown_connections 2024-09-10T07:38:59.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.289+0000 7f9836600640 1 -- 172.21.15.99:0/3535946923 wait complete. 2024-09-10T07:38:59.308 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:38:59.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.470+0000 7f44fd800640 1 Processor -- start 2024-09-10T07:38:59.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.471+0000 7f44fd800640 1 -- start start 2024-09-10T07:38:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.472+0000 7f44fd800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f44f80d0630 0x7f44f80d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.472+0000 7f44fd800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f80b4300 con 0x7f44f80afa90 2024-09-10T07:38:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.472+0000 7f44fd800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f80d0fa0 con 0x7f44f815b760 2024-09-10T07:38:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.472+0000 7f44fd800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f44f806d700 con 0x7f44f80d0630 2024-09-10T07:38:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.472+0000 7f44f6000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f44f80afa90 0x7f44f806f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:34144/0 (socket says 172.21.15.99:34144) 2024-09-10T07:38:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.472+0000 7f44f6000640 1 -- 172.21.15.99:0/2323481419 learned_addr learned my addr 172.21.15.99:0/2323481419 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:38:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.472+0000 7f44f7400640 1 --2- 172.21.15.99:0/2323481419 >> v2:172.21.15.99:3300/0 conn(0x7f44f80d0630 0x7f44f80d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:59.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.473+0000 7f44f5600640 1 -- 172.21.15.99:0/2323481419 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184290062 0 0) 0x7f44f80b4300 con 0x7f44f80afa90 2024-09-10T07:38:59.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.473+0000 7f44f5600640 1 -- 172.21.15.99:0/2323481419 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44dc003520 con 0x7f44f80afa90 2024-09-10T07:38:59.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.473+0000 7f44f7400640 1 -- 172.21.15.99:0/2323481419 >> v1:172.21.15.187:6789/0 conn(0x7f44f815b760 legacy=0x7f44f80b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:59.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.473+0000 7f44f7400640 1 -- 172.21.15.99:0/2323481419 >> v1:172.21.15.99:6789/0 conn(0x7f44f80afa90 legacy=0x7f44f806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:59.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.473+0000 7f44f7400640 1 -- 172.21.15.99:0/2323481419 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f806d9e0 con 0x7f44f80d0630 2024-09-10T07:38:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.474+0000 7f44f7400640 1 --2- 172.21.15.99:0/2323481419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80d0630 0x7f44f80d0a60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009d90 tx=0x7f44f002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ea59e5dfbf6c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.474+0000 7f44f5600640 1 -- 172.21.15.99:0/2323481419 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0031600 con 0x7f44f80d0630 2024-09-10T07:38:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.474+0000 7f44f5600640 1 -- 172.21.15.99:0/2323481419 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f00317a0 con 0x7f44f80d0630 2024-09-10T07:38:59.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.474+0000 7f44f5600640 1 -- 172.21.15.99:0/2323481419 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0031b70 con 0x7f44f80d0630 2024-09-10T07:38:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.474+0000 7f44fd800640 1 -- 172.21.15.99:0/2323481419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80d0630 msgr2=0x7f44f80d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.474+0000 7f44fd800640 1 --2- 172.21.15.99:0/2323481419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80d0630 0x7f44f80d0a60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009d90 tx=0x7f44f002a5d0 comp rx=0 tx=0).stop 2024-09-10T07:38:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.475+0000 7f44fd800640 1 -- 172.21.15.99:0/2323481419 shutdown_connections 2024-09-10T07:38:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.475+0000 7f44fd800640 1 --2- 172.21.15.99:0/2323481419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80d0630 0x7f44f80d0a60 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.475+0000 7f44fd800640 1 -- 172.21.15.99:0/2323481419 >> 172.21.15.99:0/2323481419 conn(0x7f44f806bc10 msgr2=0x7f44f806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:38:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.475+0000 7f44fd800640 1 -- 172.21.15.99:0/2323481419 shutdown_connections 2024-09-10T07:38:59.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.475+0000 7f44fd800640 1 -- 172.21.15.99:0/2323481419 wait complete. 2024-09-10T07:38:59.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.476+0000 7f44fd800640 1 Processor -- start 2024-09-10T07:38:59.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.476+0000 7f44fd800640 1 -- start start 2024-09-10T07:38:59.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.477+0000 7f44fd800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80afa90 0x7f44f8158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:59.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.477+0000 7f44fd800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f80d0630 0x7f44f8147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:59.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.477+0000 7f44fd800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f815b760 0x7f44f814f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.477+0000 7f44fd800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f44f815bcc0 con 0x7f44f80afa90 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.477+0000 7f44fd800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f44f815bb40 con 0x7f44f80d0630 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.477+0000 7f44fd800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f44f806dcc0 con 0x7f44f815b760 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.477+0000 7f44f6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80afa90 0x7f44f8158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.477+0000 7f44f6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80afa90 0x7f44f8158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47622/0 (socket says 172.21.15.99:47622) 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.477+0000 7f44f6a00640 1 -- 172.21.15.99:0/274841071 learned_addr learned my addr 172.21.15.99:0/274841071 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.478+0000 7f44f6000640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f80d0630 0x7f44f8147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.478+0000 7f44f7400640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f815b760 0x7f44f814f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.478+0000 7f44f6a00640 1 -- 172.21.15.99:0/274841071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f815b760 msgr2=0x7f44f814f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.478+0000 7f44f6a00640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f815b760 0x7f44f814f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.478+0000 7f44f6a00640 1 -- 172.21.15.99:0/274841071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f80d0630 msgr2=0x7f44f8147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.478+0000 7f44f6a00640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f80d0630 0x7f44f8147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.478+0000 7f44f6a00640 1 -- 172.21.15.99:0/274841071 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f8167e90 con 0x7f44f80afa90 2024-09-10T07:38:59.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.478+0000 7f44f6a00640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80afa90 0x7f44f8158470 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c430 tx=0x7f44e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:59.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.478+0000 7f44eea00640 1 -- 172.21.15.99:0/274841071 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8017070 con 0x7f44f80afa90 2024-09-10T07:38:59.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.479+0000 7f44eea00640 1 -- 172.21.15.99:0/274841071 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e80052d0 con 0x7f44f80afa90 2024-09-10T07:38:59.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.479+0000 7f44fd800640 1 -- 172.21.15.99:0/274841071 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f8168130 con 0x7f44f80afa90 2024-09-10T07:38:59.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.479+0000 7f44eea00640 1 -- 172.21.15.99:0/274841071 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8003830 con 0x7f44f80afa90 2024-09-10T07:38:59.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.479+0000 7f44fd800640 1 -- 172.21.15.99:0/274841071 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f81686f0 con 0x7f44f80afa90 2024-09-10T07:38:59.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.480+0000 7f44fd800640 1 -- 172.21.15.99:0/274841071 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f80d0a60 con 0x7f44f80afa90 2024-09-10T07:38:59.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.481+0000 7f44eea00640 1 -- 172.21.15.99:0/274841071 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44e801a070 con 0x7f44f80afa90 2024-09-10T07:38:59.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.482+0000 7f44eea00640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d806be30 0x7f44d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:38:59.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.482+0000 7f44eea00640 1 -- 172.21.15.99:0/274841071 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5227+0+0 (secure 0 0 0) 0x7f44e808a090 con 0x7f44f80afa90 2024-09-10T07:38:59.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.482+0000 7f44f6000640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d806be30 0x7f44d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:38:59.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.483+0000 7f44f6000640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d806be30 0x7f44d806e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f44f80b1230 tx=0x7f44e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:38:59.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.487+0000 7f44eea00640 1 -- 172.21.15.99:0/274841071 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44e8058b80 con 0x7f44f80afa90 2024-09-10T07:38:59.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:38:59.660+0000 7f44fd800640 1 -- 172.21.15.99:0/274841071 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f44f80b0ab0 con 0x7f44f80afa90 2024-09-10T07:39:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.289+0000 7f44eea00640 1 -- 172.21.15.99:0/274841071 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) ==== 170+0+0 (secure 0 0 0) 0x7f44e8058480 con 0x7f44f80afa90 2024-09-10T07:39:00.289 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:39:00.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.292+0000 7f44fd800640 1 -- 172.21.15.99:0/274841071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d806be30 msgr2=0x7f44d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:00.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.292+0000 7f44fd800640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d806be30 0x7f44d806e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f44f80b1230 tx=0x7f44e4009040 comp rx=0 tx=0).stop 2024-09-10T07:39:00.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.292+0000 7f44fd800640 1 -- 172.21.15.99:0/274841071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80afa90 msgr2=0x7f44f8158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:00.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.292+0000 7f44fd800640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80afa90 0x7f44f8158470 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c430 tx=0x7f44e800c8f0 comp rx=0 tx=0).stop 2024-09-10T07:39:00.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.292+0000 7f44fd800640 1 -- 172.21.15.99:0/274841071 shutdown_connections 2024-09-10T07:39:00.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.292+0000 7f44fd800640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f815b760 0x7f44f814f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:00.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.292+0000 7f44fd800640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f80d0630 0x7f44f8147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:00.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.292+0000 7f44fd800640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d806be30 0x7f44d806e2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:00.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.292+0000 7f44fd800640 1 --2- 172.21.15.99:0/274841071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f80afa90 0x7f44f8158470 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:00.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.292+0000 7f44fd800640 1 -- 172.21.15.99:0/274841071 >> 172.21.15.99:0/274841071 conn(0x7f44f806bc10 msgr2=0x7f44f80b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:00.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.293+0000 7f44fd800640 1 -- 172.21.15.99:0/274841071 shutdown_connections 2024-09-10T07:39:00.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.293+0000 7f44fd800640 1 -- 172.21.15.99:0/274841071 wait complete. 2024-09-10T07:39:00.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:39:00.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.478+0000 7f027d600640 1 Processor -- start 2024-09-10T07:39:00.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.478+0000 7f027d600640 1 -- start start 2024-09-10T07:39:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.479+0000 7f027d600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f02780d2680 0x7f02780cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.479+0000 7f027d600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02780d2bd0 con 0x7f02780cfac0 2024-09-10T07:39:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.479+0000 7f027d600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02780d2eb0 con 0x7f027815e970 2024-09-10T07:39:00.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.479+0000 7f027d600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f02780d37e0 con 0x7f02780d2680 2024-09-10T07:39:00.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.480+0000 7f027cc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f02780cfac0 0x7f02780c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58278/0 (socket says 172.21.15.99:58278) 2024-09-10T07:39:00.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.480+0000 7f027cc00640 1 -- 172.21.15.99:0/73715805 learned_addr learned my addr 172.21.15.99:0/73715805 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:00.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.480+0000 7f026f400640 1 --2- 172.21.15.99:0/73715805 >> v2:172.21.15.187:3300/0 conn(0x7f02780d2680 0x7f02780cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:00.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.480+0000 7f0277400640 1 -- 172.21.15.99:0/73715805 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976844734 0 0) 0x7f02780d2bd0 con 0x7f02780cfac0 2024-09-10T07:39:00.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.480+0000 7f0277400640 1 -- 172.21.15.99:0/73715805 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f025c003520 con 0x7f02780cfac0 2024-09-10T07:39:00.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.480+0000 7f026f400640 1 -- 172.21.15.99:0/73715805 >> v1:172.21.15.187:6789/0 conn(0x7f027815e970 legacy=0x7f02780d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:00.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.480+0000 7f026f400640 1 -- 172.21.15.99:0/73715805 >> v1:172.21.15.99:6789/0 conn(0x7f02780cfac0 legacy=0x7f02780c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:00.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.480+0000 7f026f400640 1 -- 172.21.15.99:0/73715805 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02780d3190 con 0x7f02780d2680 2024-09-10T07:39:00.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.481+0000 7f026f400640 1 --2- 172.21.15.99:0/73715805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02780d2680 0x7f02780cf580 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f02780d3960 tx=0x7f026002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92148247b89ae233 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:00.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.482+0000 7f0277400640 1 -- 172.21.15.99:0/73715805 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260037070 con 0x7f02780d2680 2024-09-10T07:39:00.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.482+0000 7f0277400640 1 -- 172.21.15.99:0/73715805 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0260032640 con 0x7f02780d2680 2024-09-10T07:39:00.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.482+0000 7f0277400640 1 -- 172.21.15.99:0/73715805 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260032a10 con 0x7f02780d2680 2024-09-10T07:39:00.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.482+0000 7f027d600640 1 -- 172.21.15.99:0/73715805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02780d2680 msgr2=0x7f02780cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:00.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.482+0000 7f027d600640 1 --2- 172.21.15.99:0/73715805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02780d2680 0x7f02780cf580 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f02780d3960 tx=0x7f026002a2c0 comp rx=0 tx=0).stop 2024-09-10T07:39:00.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.482+0000 7f027d600640 1 -- 172.21.15.99:0/73715805 shutdown_connections 2024-09-10T07:39:00.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.482+0000 7f027d600640 1 --2- 172.21.15.99:0/73715805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02780d2680 0x7f02780cf580 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:00.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.482+0000 7f027d600640 1 -- 172.21.15.99:0/73715805 >> 172.21.15.99:0/73715805 conn(0x7f027809de00 msgr2=0x7f02780d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:00.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.482+0000 7f027d600640 1 -- 172.21.15.99:0/73715805 shutdown_connections 2024-09-10T07:39:00.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.482+0000 7f027d600640 1 -- 172.21.15.99:0/73715805 wait complete. 2024-09-10T07:39:00.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.484+0000 7f027d600640 1 Processor -- start 2024-09-10T07:39:00.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.484+0000 7f027d600640 1 -- start start 2024-09-10T07:39:00.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f027d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02780cfac0 0x7f0278152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:00.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f027d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02780d2680 0x7f0278160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:00.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f027d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f027815e970 0x7f027806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:00.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f027d600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f027815ed50 con 0x7f027815e970 2024-09-10T07:39:00.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f027d600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f02780cff10 con 0x7f02780cfac0 2024-09-10T07:39:00.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f027d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f027815eed0 con 0x7f02780d2680 2024-09-10T07:39:00.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f027cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f027815e970 0x7f027806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:00.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f027cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f027815e970 0x7f027806d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40454/0 (socket says 172.21.15.99:40454) 2024-09-10T07:39:00.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f027cc00640 1 -- 172.21.15.99:0/2167705932 learned_addr learned my addr 172.21.15.99:0/2167705932 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f026f400640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02780d2680 0x7f0278160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.485+0000 7f0277e00640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02780cfac0 0x7f0278152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f027cc00640 1 -- 172.21.15.99:0/2167705932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02780d2680 msgr2=0x7f0278160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f027cc00640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02780d2680 0x7f0278160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f027cc00640 1 -- 172.21.15.99:0/2167705932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02780cfac0 msgr2=0x7f0278152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f027cc00640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02780cfac0 0x7f0278152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f027cc00640 1 -- 172.21.15.99:0/2167705932 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02780b89d0 con 0x7f027815e970 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f0277e00640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02780cfac0 0x7f0278152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f027cc00640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f027815e970 0x7f027806d540 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f027000cb40 tx=0x7f027000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f0274c00640 1 -- 172.21.15.99:0/2167705932 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270017070 con 0x7f027815e970 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f0274c00640 1 -- 172.21.15.99:0/2167705932 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027000aca0 con 0x7f027815e970 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f0274c00640 1 -- 172.21.15.99:0/2167705932 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270012620 con 0x7f027815e970 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f027d600640 1 -- 172.21.15.99:0/2167705932 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02780b9750 con 0x7f027815e970 2024-09-10T07:39:00.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.486+0000 7f027d600640 1 -- 172.21.15.99:0/2167705932 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02780b8f50 con 0x7f027815e970 2024-09-10T07:39:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.487+0000 7f027d600640 1 -- 172.21.15.99:0/2167705932 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02780cf580 con 0x7f027815e970 2024-09-10T07:39:00.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.488+0000 7f0274c00640 1 -- 172.21.15.99:0/2167705932 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f027001a070 con 0x7f027815e970 2024-09-10T07:39:00.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.489+0000 7f0274c00640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f025406be30 0x7f025406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:00.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.489+0000 7f0274c00640 1 -- 172.21.15.99:0/2167705932 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5609+0+0 (secure 0 0 0) 0x7f027008ad10 con 0x7f027815e970 2024-09-10T07:39:00.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.489+0000 7f0277e00640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f025406be30 0x7f025406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:00.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.490+0000 7f0277e00640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f025406be30 0x7f025406e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f02680015e0 tx=0x7f0268009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:00.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.494+0000 7f0274c00640 1 -- 172.21.15.99:0/2167705932 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0270090020 con 0x7f027815e970 2024-09-10T07:39:00.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:00.701+0000 7f027d600640 1 -- 172.21.15.99:0/2167705932 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f02780d1700 con 0x7f027815e970 2024-09-10T07:39:01.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.313+0000 7f0274c00640 1 -- 172.21.15.99:0/2167705932 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v46) ==== 174+0+0 (secure 0 0 0) 0x7f0270059680 con 0x7f027815e970 2024-09-10T07:39:01.314 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 12 and data pool 13 2024-09-10T07:39:01.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.321+0000 7f027d600640 1 -- 172.21.15.99:0/2167705932 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f025406be30 msgr2=0x7f025406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.321+0000 7f027d600640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f025406be30 0x7f025406e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f02680015e0 tx=0x7f0268009040 comp rx=0 tx=0).stop 2024-09-10T07:39:01.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.321+0000 7f027d600640 1 -- 172.21.15.99:0/2167705932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f027815e970 msgr2=0x7f027806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.321+0000 7f027d600640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f027815e970 0x7f027806d540 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f027000cb40 tx=0x7f027000a060 comp rx=0 tx=0).stop 2024-09-10T07:39:01.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.323+0000 7f027d600640 1 -- 172.21.15.99:0/2167705932 shutdown_connections 2024-09-10T07:39:01.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.323+0000 7f027d600640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f025406be30 0x7f025406e2f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.323+0000 7f027d600640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f027815e970 0x7f027806d540 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.323+0000 7f027d600640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02780d2680 0x7f0278160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.323+0000 7f027d600640 1 --2- 172.21.15.99:0/2167705932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02780cfac0 0x7f0278152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.323+0000 7f027d600640 1 -- 172.21.15.99:0/2167705932 >> 172.21.15.99:0/2167705932 conn(0x7f027809de00 msgr2=0x7f0278154640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:01.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.325+0000 7f027d600640 1 -- 172.21.15.99:0/2167705932 shutdown_connections 2024-09-10T07:39:01.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.325+0000 7f027d600640 1 -- 172.21.15.99:0/2167705932 wait complete. 2024-09-10T07:39:01.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:39:01.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.499+0000 7f8afc800640 1 Processor -- start 2024-09-10T07:39:01.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.499+0000 7f8afc800640 1 -- start start 2024-09-10T07:39:01.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.501+0000 7f8afc800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8af4160c50 0x7f8af4167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.501+0000 7f8afc800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af4142650 con 0x7f8af413fae0 2024-09-10T07:39:01.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.501+0000 7f8afc800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af4142930 con 0x7f8af4142150 2024-09-10T07:39:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.501+0000 7f8afc800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8af40ce780 con 0x7f8af4160c50 2024-09-10T07:39:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.501+0000 7f8af9e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8af413fae0 0x7f8af406f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58290/0 (socket says 172.21.15.99:58290) 2024-09-10T07:39:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.501+0000 7f8af9e00640 1 -- 172.21.15.99:0/688478741 learned_addr learned my addr 172.21.15.99:0/688478741 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.501+0000 7f8afa800640 1 --2- 172.21.15.99:0/688478741 >> v2:172.21.15.187:3300/0 conn(0x7f8af4160c50 0x7f8af4167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.501+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 863681401 0 0) 0x7f8af4142650 con 0x7f8af413fae0 2024-09-10T07:39:01.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.501+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8adc003520 con 0x7f8af413fae0 2024-09-10T07:39:01.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3859975894 0 0) 0x7f8adc003520 con 0x7f8af413fae0 2024-09-10T07:39:01.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 >> v2:172.21.15.187:3300/0 conn(0x7f8af4160c50 msgr2=0x7f8af4167680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:01.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 --2- 172.21.15.99:0/688478741 >> v2:172.21.15.187:3300/0 conn(0x7f8af4160c50 0x7f8af4167680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 >> v1:172.21.15.187:6789/0 conn(0x7f8af4142150 legacy=0x7f8af4160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af4142c10 con 0x7f8af413fae0 2024-09-10T07:39:01.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f8ae8001670 con 0x7f8af413fae0 2024-09-10T07:39:01.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 >> v1:172.21.15.99:6789/0 conn(0x7f8af413fae0 legacy=0x7f8af406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8adc0039b0 0x7f8adc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8adc004800 0x7f8adc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8adc0051c0 0x7f8adc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc00c130 con 0x7f8adc0039b0 2024-09-10T07:39:01.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc00c2e0 con 0x7f8adc004800 2024-09-10T07:39:01.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8adc00c4e0 con 0x7f8adc0051c0 2024-09-10T07:39:01.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af9e00640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8adc0039b0 0x7f8adc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af9400640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8adc004800 0x7f8adc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8afa800640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8adc0051c0 0x7f8adc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af9e00640 1 -- 172.21.15.99:0/688478741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8adc0051c0 msgr2=0x7f8adc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:01.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af9e00640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8adc0051c0 0x7f8adc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af9e00640 1 -- 172.21.15.99:0/688478741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8adc004800 msgr2=0x7f8adc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:01.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af9e00640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8adc004800 0x7f8adc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.502+0000 7f8af9e00640 1 -- 172.21.15.99:0/688478741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc003520 con 0x7f8adc0039b0 2024-09-10T07:39:01.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.503+0000 7f8afa800640 1 -- 172.21.15.99:0/688478741 reap_dead start 2024-09-10T07:39:01.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.503+0000 7f8af9e00640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8adc0039b0 0x7f8adc003dd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800c240 tx=0x7f8adc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af08e613a6513cde server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.504+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8007cf0 con 0x7f8adc0039b0 2024-09-10T07:39:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.504+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae8005af0 con 0x7f8adc0039b0 2024-09-10T07:39:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.504+0000 7f8af8a00640 1 -- 172.21.15.99:0/688478741 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8007070 con 0x7f8adc0039b0 2024-09-10T07:39:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.504+0000 7f8afc800640 1 -- 172.21.15.99:0/688478741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8adc0039b0 msgr2=0x7f8adc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.504+0000 7f8afc800640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8adc0039b0 0x7f8adc003dd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800c240 tx=0x7f8adc005830 comp rx=0 tx=0).stop 2024-09-10T07:39:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.504+0000 7f8afc800640 1 -- 172.21.15.99:0/688478741 shutdown_connections 2024-09-10T07:39:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.504+0000 7f8afc800640 1 --2- 172.21.15.99:0/688478741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8adc0039b0 0x7f8adc003dd0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.504+0000 7f8afc800640 1 -- 172.21.15.99:0/688478741 >> 172.21.15.99:0/688478741 conn(0x7f8af406bc10 msgr2=0x7f8af406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.504+0000 7f8afc800640 1 -- 172.21.15.99:0/688478741 shutdown_connections 2024-09-10T07:39:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.504+0000 7f8afc800640 1 -- 172.21.15.99:0/688478741 wait complete. 2024-09-10T07:39:01.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.506+0000 7f8afc800640 1 Processor -- start 2024-09-10T07:39:01.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.506+0000 7f8afc800640 1 -- start start 2024-09-10T07:39:01.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8afc800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8adc0039b0 0x7f8af4146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8afc800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8af413ae80 0x7f8af4132f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8afc800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8af41f4770 0x7f8af41f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8afc800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8af41606c0 con 0x7f8af413ae80 2024-09-10T07:39:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8afc800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8af4160540 con 0x7f8adc0039b0 2024-09-10T07:39:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8afc800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8af4160840 con 0x7f8af41f4770 2024-09-10T07:39:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8af9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8af413ae80 0x7f8af4132f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8af9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8af413ae80 0x7f8af4132f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40470/0 (socket says 172.21.15.99:40470) 2024-09-10T07:39:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8af9400640 1 -- 172.21.15.99:0/3020489844 learned_addr learned my addr 172.21.15.99:0/3020489844 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8af9e00640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8adc0039b0 0x7f8af4146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.507+0000 7f8afa800640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8af41f4770 0x7f8af41f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8af9400640 1 -- 172.21.15.99:0/3020489844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8af41f4770 msgr2=0x7f8af41f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8af9400640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8af41f4770 0x7f8af41f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8af9400640 1 -- 172.21.15.99:0/3020489844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8adc0039b0 msgr2=0x7f8af4146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8af9400640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8adc0039b0 0x7f8af4146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8af9400640 1 -- 172.21.15.99:0/3020489844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af40b4380 con 0x7f8af413ae80 2024-09-10T07:39:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8af9e00640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8adc0039b0 0x7f8af4146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8af9400640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8af413ae80 0x7f8af4132f60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400f620 tx=0x7f8ae400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8aee000640 1 -- 172.21.15.99:0/3020489844 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40052e0 con 0x7f8af413ae80 2024-09-10T07:39:01.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8aee000640 1 -- 172.21.15.99:0/3020489844 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae4018070 con 0x7f8af413ae80 2024-09-10T07:39:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8aee000640 1 -- 172.21.15.99:0/3020489844 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4003810 con 0x7f8af413ae80 2024-09-10T07:39:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.508+0000 7f8afc800640 1 -- 172.21.15.99:0/3020489844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af40b4620 con 0x7f8af413ae80 2024-09-10T07:39:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.509+0000 7f8afc800640 1 -- 172.21.15.99:0/3020489844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af40b4be0 con 0x7f8af413ae80 2024-09-10T07:39:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.509+0000 7f8afc800640 1 -- 172.21.15.99:0/3020489844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af406f1b0 con 0x7f8af413ae80 2024-09-10T07:39:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.510+0000 7f8aee000640 1 -- 172.21.15.99:0/3020489844 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ae40039b0 con 0x7f8af413ae80 2024-09-10T07:39:01.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.512+0000 7f8aee000640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ad806be60 0x7f8ad806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.512+0000 7f8aee000640 1 -- 172.21.15.99:0/3020489844 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f8ae408aa30 con 0x7f8af413ae80 2024-09-10T07:39:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.512+0000 7f8af9e00640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ad806be60 0x7f8ad806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.513+0000 7f8af9e00640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ad806be60 0x7f8ad806e320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8032000 tx=0x7f8ae8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:01.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.516+0000 7f8aee000640 1 -- 172.21.15.99:0/3020489844 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ae4058d80 con 0x7f8af413ae80 2024-09-10T07:39:01.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.689+0000 7f8afc800640 1 -- 172.21.15.99:0/3020489844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8af41610d0 con 0x7f8af413ae80 2024-09-10T07:39:01.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.690+0000 7f8aee000640 1 -- 172.21.15.99:0/3020489844 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16712 (secure 0 0 0) 0x7f8ae405d080 con 0x7f8af413ae80 2024-09-10T07:39:01.690 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:01.690 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":100,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:39:00.702960+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:38:58.485547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T07:38:59.701338+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:39:01.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 -- 172.21.15.99:0/3020489844 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ad806be60 msgr2=0x7f8ad806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ad806be60 0x7f8ad806e320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8032000 tx=0x7f8ae8009030 comp rx=0 tx=0).stop 2024-09-10T07:39:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 -- 172.21.15.99:0/3020489844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8af413ae80 msgr2=0x7f8af4132f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8af413ae80 0x7f8af4132f60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400f620 tx=0x7f8ae400fae0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 -- 172.21.15.99:0/3020489844 shutdown_connections 2024-09-10T07:39:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8af41f4770 0x7f8af41f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8ad806be60 0x7f8ad806e320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8af413ae80 0x7f8af4132f60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 --2- 172.21.15.99:0/3020489844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8adc0039b0 0x7f8af4146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 -- 172.21.15.99:0/3020489844 >> 172.21.15.99:0/3020489844 conn(0x7f8af406bc10 msgr2=0x7f8af40b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 -- 172.21.15.99:0/3020489844 shutdown_connections 2024-09-10T07:39:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.692+0000 7f8afc800640 1 -- 172.21.15.99:0/3020489844 wait complete. 2024-09-10T07:39:01.708 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:39:01.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.863+0000 7fb430800640 1 Processor -- start 2024-09-10T07:39:01.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.863+0000 7fb430800640 1 -- start start 2024-09-10T07:39:01.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.864+0000 7fb430800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb42813fae0 0x7fb42806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.864+0000 7fb430800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb428142650 con 0x7fb428142150 2024-09-10T07:39:01.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.864+0000 7fb430800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb428142930 con 0x7fb428160c50 2024-09-10T07:39:01.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.864+0000 7fb430800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb4280ce780 con 0x7fb42813fae0 2024-09-10T07:39:01.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.865+0000 7fb42de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb42813fae0 0x7fb42806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.865+0000 7fb42de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb42813fae0 0x7fb42806f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40478/0 (socket says 172.21.15.99:40478) 2024-09-10T07:39:01.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.865+0000 7fb42de00640 1 -- 172.21.15.99:0/4198928812 learned_addr learned my addr 172.21.15.99:0/4198928812 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:01.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.865+0000 7fb42de00640 1 -- 172.21.15.99:0/4198928812 >> v1:172.21.15.187:6789/0 conn(0x7fb428160c50 legacy=0x7fb4280cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:01.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.865+0000 7fb42de00640 1 -- 172.21.15.99:0/4198928812 >> v1:172.21.15.99:6789/0 conn(0x7fb428142150 legacy=0x7fb428160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.865+0000 7fb42ca00640 1 -- 172.21.15.99:0/4198928812 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718937156 0 0) 0x7fb428142650 con 0x7fb428142150 2024-09-10T07:39:01.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.865+0000 7fb42de00640 1 -- 172.21.15.99:0/4198928812 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb428142c10 con 0x7fb42813fae0 2024-09-10T07:39:01.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.866+0000 7fb42de00640 1 --2- 172.21.15.99:0/4198928812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb42813fae0 0x7fb42806f1b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009870 tx=0x7fb41c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf66583452bbc1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:01.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.866+0000 7fb42ca00640 1 -- 172.21.15.99:0/4198928812 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c037070 con 0x7fb42813fae0 2024-09-10T07:39:01.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.866+0000 7fb42ca00640 1 -- 172.21.15.99:0/4198928812 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41c032440 con 0x7fb42813fae0 2024-09-10T07:39:01.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.866+0000 7fb42ca00640 1 -- 172.21.15.99:0/4198928812 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c032810 con 0x7fb42813fae0 2024-09-10T07:39:01.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.867+0000 7fb430800640 1 -- 172.21.15.99:0/4198928812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb42813fae0 msgr2=0x7fb42806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.867+0000 7fb430800640 1 --2- 172.21.15.99:0/4198928812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb42813fae0 0x7fb42806f1b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009870 tx=0x7fb41c02a210 comp rx=0 tx=0).stop 2024-09-10T07:39:01.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.867+0000 7fb430800640 1 -- 172.21.15.99:0/4198928812 shutdown_connections 2024-09-10T07:39:01.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.867+0000 7fb430800640 1 --2- 172.21.15.99:0/4198928812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb42813fae0 0x7fb42806f1b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.867+0000 7fb430800640 1 -- 172.21.15.99:0/4198928812 >> 172.21.15.99:0/4198928812 conn(0x7fb42806bc10 msgr2=0x7fb42806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:01.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.867+0000 7fb430800640 1 -- 172.21.15.99:0/4198928812 shutdown_connections 2024-09-10T07:39:01.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.867+0000 7fb430800640 1 -- 172.21.15.99:0/4198928812 wait complete. 2024-09-10T07:39:01.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.869+0000 7fb430800640 1 Processor -- start 2024-09-10T07:39:01.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.869+0000 7fb430800640 1 -- start start 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb430800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb42813fae0 0x7fb42813f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb430800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb428142150 0x7fb428144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb430800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb428160c50 0x7fb42815bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb430800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb42806f870 con 0x7fb428160c50 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb430800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb42806f6f0 con 0x7fb428142150 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb430800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb4280cf320 con 0x7fb42813fae0 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb428160c50 0x7fb42815bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb428160c50 0x7fb42815bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40494/0 (socket says 172.21.15.99:40494) 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42e800640 1 -- 172.21.15.99:0/3286146055 learned_addr learned my addr 172.21.15.99:0/3286146055 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42de00640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb42813fae0 0x7fb42813f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42d400640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb428142150 0x7fb428144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42e800640 1 -- 172.21.15.99:0/3286146055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb42813fae0 msgr2=0x7fb42813f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42e800640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb42813fae0 0x7fb42813f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42e800640 1 -- 172.21.15.99:0/3286146055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb428142150 msgr2=0x7fb428144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:01.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42e800640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb428142150 0x7fb428144270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:01.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42e800640 1 -- 172.21.15.99:0/3286146055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4281f2690 con 0x7fb428160c50 2024-09-10T07:39:01.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.870+0000 7fb42e800640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb428160c50 0x7fb42815bbc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb42400be60 tx=0x7fb42400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:01.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.871+0000 7fb422000640 1 -- 172.21.15.99:0/3286146055 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424019070 con 0x7fb428160c50 2024-09-10T07:39:01.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.871+0000 7fb422000640 1 -- 172.21.15.99:0/3286146055 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb424014440 con 0x7fb428160c50 2024-09-10T07:39:01.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.871+0000 7fb422000640 1 -- 172.21.15.99:0/3286146055 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424014830 con 0x7fb428160c50 2024-09-10T07:39:01.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.871+0000 7fb430800640 1 -- 172.21.15.99:0/3286146055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42815ae00 con 0x7fb428160c50 2024-09-10T07:39:01.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.871+0000 7fb430800640 1 -- 172.21.15.99:0/3286146055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42815b3c0 con 0x7fb428160c50 2024-09-10T07:39:01.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.872+0000 7fb430800640 1 -- 172.21.15.99:0/3286146055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42806f1b0 con 0x7fb428160c50 2024-09-10T07:39:01.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.873+0000 7fb422000640 1 -- 172.21.15.99:0/3286146055 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb42401c070 con 0x7fb428160c50 2024-09-10T07:39:01.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.874+0000 7fb422000640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb40c06be30 0x7fb40c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:01.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.874+0000 7fb422000640 1 -- 172.21.15.99:0/3286146055 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7fb42408ae60 con 0x7fb428160c50 2024-09-10T07:39:01.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.874+0000 7fb42de00640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb40c06be30 0x7fb40c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:01.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.875+0000 7fb42de00640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb40c06be30 0x7fb40c06e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb41c034000 tx=0x7fb41c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:01.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:01.879+0000 7fb422000640 1 -- 172.21.15.99:0/3286146055 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb424059800 con 0x7fb428160c50 2024-09-10T07:39:02.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.053+0000 7fb430800640 1 -- 172.21.15.99:0/3286146055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb42815b850 con 0x7fb428160c50 2024-09-10T07:39:02.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.054+0000 7fb422000640 1 -- 172.21.15.99:0/3286146055 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16712 (secure 0 0 0) 0x7fb424059100 con 0x7fb428160c50 2024-09-10T07:39:02.055 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:02.055 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":100,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:39:00.702960+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:38:58.485547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T07:38:59.701338+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:39:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 -- 172.21.15.99:0/3286146055 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb40c06be30 msgr2=0x7fb40c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb40c06be30 0x7fb40c06e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb41c034000 tx=0x7fb41c02e000 comp rx=0 tx=0).stop 2024-09-10T07:39:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 -- 172.21.15.99:0/3286146055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb428160c50 msgr2=0x7fb42815bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb428160c50 0x7fb42815bbc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb42400be60 tx=0x7fb42400bf50 comp rx=0 tx=0).stop 2024-09-10T07:39:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 -- 172.21.15.99:0/3286146055 shutdown_connections 2024-09-10T07:39:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb40c06be30 0x7fb40c06e2f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb428160c50 0x7fb42815bbc0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb428142150 0x7fb428144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 --2- 172.21.15.99:0/3286146055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb42813fae0 0x7fb42813f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 -- 172.21.15.99:0/3286146055 >> 172.21.15.99:0/3286146055 conn(0x7fb42806bc10 msgr2=0x7fb4280cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 -- 172.21.15.99:0/3286146055 shutdown_connections 2024-09-10T07:39:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.056+0000 7fb430800640 1 -- 172.21.15.99:0/3286146055 wait complete. 2024-09-10T07:39:02.075 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:39:02.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.231+0000 7fc0ba600640 1 Processor -- start 2024-09-10T07:39:02.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.231+0000 7fc0ba600640 1 -- start start 2024-09-10T07:39:02.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.232+0000 7fc0ba600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc0b415e970 0x7fc0b40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:02.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.232+0000 7fc0ba600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b40d2bd0 con 0x7fc0b40d2680 2024-09-10T07:39:02.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.232+0000 7fc0ba600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b40d2eb0 con 0x7fc0b40cfc90 2024-09-10T07:39:02.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.232+0000 7fc0ba600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b40d37e0 con 0x7fc0b415e970 2024-09-10T07:39:02.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.232+0000 7fc0b9200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc0b415e970 0x7fc0b40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:02.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.232+0000 7fc0b3e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc0b40d2680 0x7fc0b40cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58308/0 (socket says 172.21.15.99:58308) 2024-09-10T07:39:02.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.232+0000 7fc0b3e00640 1 -- 172.21.15.99:0/2561213277 learned_addr learned my addr 172.21.15.99:0/2561213277 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.233+0000 7fc0b9200640 1 -- 172.21.15.99:0/2561213277 >> v1:172.21.15.187:6789/0 conn(0x7fc0b40cfc90 legacy=0x7fc0b40c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.233+0000 7fc0b9200640 1 -- 172.21.15.99:0/2561213277 >> v1:172.21.15.99:6789/0 conn(0x7fc0b40d2680 legacy=0x7fc0b40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.233+0000 7fc0b9200640 1 -- 172.21.15.99:0/2561213277 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b40d3190 con 0x7fc0b415e970 2024-09-10T07:39:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.233+0000 7fc0b3400640 1 -- 172.21.15.99:0/2561213277 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361944747 0 0) 0x7fc0b40d2bd0 con 0x7fc0b40d2680 2024-09-10T07:39:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.234+0000 7fc0b9200640 1 --2- 172.21.15.99:0/2561213277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b415e970 0x7fc0b40d0300 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40d3960 tx=0x7fc0a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581bb88da7756406 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.234+0000 7fc0b3400640 1 -- 172.21.15.99:0/2561213277 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8037070 con 0x7fc0b415e970 2024-09-10T07:39:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.234+0000 7fc0b3400640 1 -- 172.21.15.99:0/2561213277 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a8032440 con 0x7fc0b415e970 2024-09-10T07:39:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.234+0000 7fc0b3400640 1 -- 172.21.15.99:0/2561213277 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8032810 con 0x7fc0b415e970 2024-09-10T07:39:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.234+0000 7fc0ba600640 1 -- 172.21.15.99:0/2561213277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b415e970 msgr2=0x7fc0b40d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.234+0000 7fc0ba600640 1 --2- 172.21.15.99:0/2561213277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b415e970 0x7fc0b40d0300 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40d3960 tx=0x7fc0a802a270 comp rx=0 tx=0).stop 2024-09-10T07:39:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.235+0000 7fc0ba600640 1 -- 172.21.15.99:0/2561213277 shutdown_connections 2024-09-10T07:39:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.235+0000 7fc0ba600640 1 --2- 172.21.15.99:0/2561213277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b415e970 0x7fc0b40d0300 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.235+0000 7fc0ba600640 1 -- 172.21.15.99:0/2561213277 >> 172.21.15.99:0/2561213277 conn(0x7fc0b409de00 msgr2=0x7fc0b40d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.235+0000 7fc0ba600640 1 -- 172.21.15.99:0/2561213277 shutdown_connections 2024-09-10T07:39:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.235+0000 7fc0ba600640 1 -- 172.21.15.99:0/2561213277 wait complete. 2024-09-10T07:39:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.236+0000 7fc0ba600640 1 Processor -- start 2024-09-10T07:39:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.236+0000 7fc0ba600640 1 -- start start 2024-09-10T07:39:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.237+0000 7fc0ba600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b40cfc90 0x7fc0b4157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.237+0000 7fc0ba600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0b40d2680 0x7fc0b41e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.237+0000 7fc0ba600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0b415e970 0x7fc0b406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.237+0000 7fc0ba600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b415ed50 con 0x7fc0b40cfc90 2024-09-10T07:39:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.237+0000 7fc0ba600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b40d0840 con 0x7fc0b415e970 2024-09-10T07:39:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.237+0000 7fc0ba600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b415eed0 con 0x7fc0b40d2680 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.237+0000 7fc0b9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b40cfc90 0x7fc0b4157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.237+0000 7fc0b9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b40cfc90 0x7fc0b4157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40526/0 (socket says 172.21.15.99:40526) 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.237+0000 7fc0b9200640 1 -- 172.21.15.99:0/190148149 learned_addr learned my addr 172.21.15.99:0/190148149 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b3e00640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0b40d2680 0x7fc0b41e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b9c00640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0b415e970 0x7fc0b406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b9200640 1 -- 172.21.15.99:0/190148149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0b40d2680 msgr2=0x7fc0b41e8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b9200640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0b40d2680 0x7fc0b41e8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b9200640 1 -- 172.21.15.99:0/190148149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0b415e970 msgr2=0x7fc0b406c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b9200640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0b415e970 0x7fc0b406c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b9200640 1 -- 172.21.15.99:0/190148149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b41f7e00 con 0x7fc0b40cfc90 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b3e00640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0b40d2680 0x7fc0b41e8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b9c00640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0b415e970 0x7fc0b406c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b9200640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b40cfc90 0x7fc0b4157870 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8035040 tx=0x7fc0a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b0c00640 1 -- 172.21.15.99:0/190148149 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8037040 con 0x7fc0b40cfc90 2024-09-10T07:39:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b0c00640 1 -- 172.21.15.99:0/190148149 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a8004230 con 0x7fc0b40cfc90 2024-09-10T07:39:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0b0c00640 1 -- 172.21.15.99:0/190148149 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8032e20 con 0x7fc0b40cfc90 2024-09-10T07:39:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.238+0000 7fc0ba600640 1 -- 172.21.15.99:0/190148149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b41f80e0 con 0x7fc0b40cfc90 2024-09-10T07:39:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.239+0000 7fc0ba600640 1 -- 172.21.15.99:0/190148149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b41f86a0 con 0x7fc0b40cfc90 2024-09-10T07:39:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.239+0000 7fc0ba600640 1 -- 172.21.15.99:0/190148149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b40d0300 con 0x7fc0b40cfc90 2024-09-10T07:39:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.241+0000 7fc0b0c00640 1 -- 172.21.15.99:0/190148149 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0a8030770 con 0x7fc0b40cfc90 2024-09-10T07:39:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.241+0000 7fc0b0c00640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc09406be30 0x7fc09406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.241+0000 7fc0b0c00640 1 -- 172.21.15.99:0/190148149 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7fc0a80ac180 con 0x7fc0b40cfc90 2024-09-10T07:39:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.242+0000 7fc0b3e00640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc09406be30 0x7fc09406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.242+0000 7fc0b3e00640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc09406be30 0x7fc09406e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4161f70 tx=0x7fc0a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:02.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.246+0000 7fc0b0c00640 1 -- 172.21.15.99:0/190148149 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0a807ac50 con 0x7fc0b40cfc90 2024-09-10T07:39:02.276 INFO:tasks.ceph.mds.a.smithi099.stderr:2024-09-10T07:39:02.276+0000 7f0ac7200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:39:02.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:02.456+0000 7fc0ba600640 1 -- 172.21.15.99:0/190148149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc0b40d0dd0 con 0x7fc0b40cfc90 2024-09-10T07:39:03.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.324+0000 7fc0b0c00640 1 -- 172.21.15.99:0/190148149 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) ==== 118+0+0 (secure 0 0 0) 0x7fc0a807a550 con 0x7fc0b40cfc90 2024-09-10T07:39:03.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 -- 172.21.15.99:0/190148149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc09406be30 msgr2=0x7fc09406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:03.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc09406be30 0x7fc09406e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4161f70 tx=0x7fc0a0009040 comp rx=0 tx=0).stop 2024-09-10T07:39:03.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 -- 172.21.15.99:0/190148149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b40cfc90 msgr2=0x7fc0b4157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:03.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b40cfc90 0x7fc0b4157870 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8035040 tx=0x7fc0a80046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:03.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 -- 172.21.15.99:0/190148149 shutdown_connections 2024-09-10T07:39:03.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0b415e970 0x7fc0b406c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:03.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0b40d2680 0x7fc0b41e8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:03.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc09406be30 0x7fc09406e2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:03.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 --2- 172.21.15.99:0/190148149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0b40cfc90 0x7fc0b4157870 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:03.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 -- 172.21.15.99:0/190148149 >> 172.21.15.99:0/190148149 conn(0x7fc0b409de00 msgr2=0x7fc0b406da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:03.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 -- 172.21.15.99:0/190148149 shutdown_connections 2024-09-10T07:39:03.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.327+0000 7fc0ba600640 1 -- 172.21.15.99:0/190148149 wait complete. 2024-09-10T07:39:03.344 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T07:39:03.344 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:39:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.501+0000 7f06e3e00640 1 Processor -- start 2024-09-10T07:39:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.501+0000 7f06e3e00640 1 -- start start 2024-09-10T07:39:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.502+0000 7f06e3e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f06e415e970 0x7f06e40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.502+0000 7f06e3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06e40d2680 0x7f06e40cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.502+0000 7f06e3e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e40d2bd0 con 0x7f06e40cfac0 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.502+0000 7f06e3e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f06e40d37e0 con 0x7f06e40d2680 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.502+0000 7f06e3e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f06e40d2eb0 con 0x7f06e415e970 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.502+0000 7f06da000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06e40d2680 0x7f06e40cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.502+0000 7f06da000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06e40d2680 0x7f06e40cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40530/0 (socket says 172.21.15.99:40530) 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.502+0000 7f06da000640 1 -- 172.21.15.99:0/2600054771 learned_addr learned my addr 172.21.15.99:0/2600054771 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.503+0000 7f06e2a00640 1 --2- 172.21.15.99:0/2600054771 >> v2:172.21.15.187:3300/0 conn(0x7f06e415e970 0x7f06e40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.503+0000 7f06da000640 1 -- 172.21.15.99:0/2600054771 >> v2:172.21.15.187:3300/0 conn(0x7f06e415e970 msgr2=0x7f06e40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.503+0000 7f06da000640 1 --2- 172.21.15.99:0/2600054771 >> v2:172.21.15.187:3300/0 conn(0x7f06e415e970 0x7f06e40d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.503+0000 7f06da000640 1 -- 172.21.15.99:0/2600054771 >> v1:172.21.15.99:6789/0 conn(0x7f06e40cfac0 legacy=0x7f06e40d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.503+0000 7f06da000640 1 -- 172.21.15.99:0/2600054771 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e40d3190 con 0x7f06e40d2680 2024-09-10T07:39:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.504+0000 7f06da000640 1 --2- 172.21.15.99:0/2600054771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 0x7f06e40cf580 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f06e406c1c0 tx=0x7f06cc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0223783ac4fbc7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.504+0000 7f06e2000640 1 -- 172.21.15.99:0/2600054771 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc037070 con 0x7f06e40d2680 2024-09-10T07:39:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.504+0000 7f06e2000640 1 -- 172.21.15.99:0/2600054771 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc02ae50 con 0x7f06e40d2680 2024-09-10T07:39:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.504+0000 7f06e2000640 1 -- 172.21.15.99:0/2600054771 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc032860 con 0x7f06e40d2680 2024-09-10T07:39:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.505+0000 7f06e3e00640 1 -- 172.21.15.99:0/2600054771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 msgr2=0x7f06e40cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.505+0000 7f06e3e00640 1 --2- 172.21.15.99:0/2600054771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 0x7f06e40cf580 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f06e406c1c0 tx=0x7f06cc02a300 comp rx=0 tx=0).stop 2024-09-10T07:39:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.505+0000 7f06e3e00640 1 -- 172.21.15.99:0/2600054771 shutdown_connections 2024-09-10T07:39:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.505+0000 7f06e3e00640 1 --2- 172.21.15.99:0/2600054771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 0x7f06e40cf580 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.505+0000 7f06e3e00640 1 --2- 172.21.15.99:0/2600054771 >> v2:172.21.15.187:3300/0 conn(0x7f06e415e970 0x7f06e40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.505+0000 7f06e3e00640 1 -- 172.21.15.99:0/2600054771 >> 172.21.15.99:0/2600054771 conn(0x7f06e409de00 msgr2=0x7f06e40d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.505+0000 7f06e3e00640 1 -- 172.21.15.99:0/2600054771 shutdown_connections 2024-09-10T07:39:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.505+0000 7f06e3e00640 1 -- 172.21.15.99:0/2600054771 wait complete. 2024-09-10T07:39:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.506+0000 7f06e3e00640 1 Processor -- start 2024-09-10T07:39:03.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.507+0000 7f06e3e00640 1 -- start start 2024-09-10T07:39:03.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.507+0000 7f06e3e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e40cfac0 0x7f06e41548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:03.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.507+0000 7f06e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 0x7f06e40b9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:03.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06e3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e415e970 0x7f06e4160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:03.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06e3e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f06e40d0840 con 0x7f06e40d2680 2024-09-10T07:39:03.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06e3e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f06e40cff10 con 0x7f06e40cfac0 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06e3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f06e415ed50 con 0x7f06e415e970 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 0x7f06e40b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 0x7f06e40b9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40534/0 (socket says 172.21.15.99:40534) 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06da000640 1 -- 172.21.15.99:0/1453741384 learned_addr learned my addr 172.21.15.99:0/1453741384 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06e2a00640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e40cfac0 0x7f06e41548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06e3400640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e415e970 0x7f06e4160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06da000640 1 -- 172.21.15.99:0/1453741384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e415e970 msgr2=0x7f06e4160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06da000640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e415e970 0x7f06e4160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06da000640 1 -- 172.21.15.99:0/1453741384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e40cfac0 msgr2=0x7f06e41548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06da000640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e40cfac0 0x7f06e41548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06da000640 1 -- 172.21.15.99:0/1453741384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e40cbb80 con 0x7f06e40d2680 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.508+0000 7f06e3400640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e415e970 0x7f06e4160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.509+0000 7f06da000640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 0x7f06e40b9770 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f06cc02a340 tx=0x7f06cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.509+0000 7f06db400640 1 -- 172.21.15.99:0/1453741384 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc041070 con 0x7f06e40d2680 2024-09-10T07:39:03.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.509+0000 7f06db400640 1 -- 172.21.15.99:0/1453741384 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc03c670 con 0x7f06e40d2680 2024-09-10T07:39:03.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.509+0000 7f06e3e00640 1 -- 172.21.15.99:0/1453741384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e40cbe60 con 0x7f06e40d2680 2024-09-10T07:39:03.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.509+0000 7f06db400640 1 -- 172.21.15.99:0/1453741384 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc037040 con 0x7f06e40d2680 2024-09-10T07:39:03.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.509+0000 7f06e3e00640 1 -- 172.21.15.99:0/1453741384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e40cc420 con 0x7f06e40d2680 2024-09-10T07:39:03.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.510+0000 7f06e3e00640 1 -- 172.21.15.99:0/1453741384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e40cf580 con 0x7f06e40d2680 2024-09-10T07:39:03.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.511+0000 7f06db400640 1 -- 172.21.15.99:0/1453741384 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06cc044070 con 0x7f06e40d2680 2024-09-10T07:39:03.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.512+0000 7f06db400640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f06c006be30 0x7f06c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:03.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.512+0000 7f06db400640 1 -- 172.21.15.99:0/1453741384 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f06cc0ab6b0 con 0x7f06e40d2680 2024-09-10T07:39:03.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.512+0000 7f06e2a00640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f06c006be30 0x7f06c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:03.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.512+0000 7f06e2a00640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f06c006be30 0x7f06c006e2f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f06d4006fd0 tx=0x7f06d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:03.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.516+0000 7f06db400640 1 -- 172.21.15.99:0/1453741384 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06cc079970 con 0x7f06e40d2680 2024-09-10T07:39:03.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:03.725+0000 7f06e3e00640 1 -- 172.21.15.99:0/1453741384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f06e406c7d0 con 0x7f06e40d2680 2024-09-10T07:39:04.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.325+0000 7f06db400640 1 -- 172.21.15.99:0/1453741384 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) ==== 122+0+0 (secure 0 0 0) 0x7f06cc07dc70 con 0x7f06e40d2680 2024-09-10T07:39:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 -- 172.21.15.99:0/1453741384 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f06c006be30 msgr2=0x7f06c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f06c006be30 0x7f06c006e2f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f06d4006fd0 tx=0x7f06d4008040 comp rx=0 tx=0).stop 2024-09-10T07:39:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 -- 172.21.15.99:0/1453741384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 msgr2=0x7f06e40b9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 0x7f06e40b9770 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f06cc02a340 tx=0x7f06cc0046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 -- 172.21.15.99:0/1453741384 shutdown_connections 2024-09-10T07:39:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e415e970 0x7f06e4160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f06c006be30 0x7f06c006e2f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40d2680 0x7f06e40b9770 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 --2- 172.21.15.99:0/1453741384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e40cfac0 0x7f06e41548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 -- 172.21.15.99:0/1453741384 >> 172.21.15.99:0/1453741384 conn(0x7f06e409de00 msgr2=0x7f06e40d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 -- 172.21.15.99:0/1453741384 shutdown_connections 2024-09-10T07:39:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.328+0000 7f06e3e00640 1 -- 172.21.15.99:0/1453741384 wait complete. 2024-09-10T07:39:04.346 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:39:04.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:04.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.501+0000 7ffb87400640 1 Processor -- start 2024-09-10T07:39:04.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.502+0000 7ffb87400640 1 -- start start 2024-09-10T07:39:04.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.503+0000 7ffb87400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb80145290 0x7ffb8006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.503+0000 7ffb87400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ffb800ce780 0x7ffb80072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.503+0000 7ffb87400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8006e3d0 con 0x7ffb80071510 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.503+0000 7ffb87400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ffb8006efe0 con 0x7ffb800ce780 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.503+0000 7ffb87400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8006e6b0 con 0x7ffb80145290 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.503+0000 7ffb85400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ffb80071510 0x7ffb800b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58334/0 (socket says 172.21.15.99:58334) 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.503+0000 7ffb85400640 1 -- 172.21.15.99:0/881116420 learned_addr learned my addr 172.21.15.99:0/881116420 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.503+0000 7ffb84a00640 1 --2- 172.21.15.99:0/881116420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb80145290 0x7ffb8006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.503+0000 7ffb77e00640 1 --2- 172.21.15.99:0/881116420 >> v2:172.21.15.187:3300/0 conn(0x7ffb800ce780 0x7ffb80072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.504+0000 7ffb7fe00640 1 -- 172.21.15.99:0/881116420 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245024393 0 0) 0x7ffb8006e3d0 con 0x7ffb80071510 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.504+0000 7ffb7fe00640 1 -- 172.21.15.99:0/881116420 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb64003520 con 0x7ffb80071510 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.504+0000 7ffb84a00640 1 -- 172.21.15.99:0/881116420 >> v2:172.21.15.187:3300/0 conn(0x7ffb800ce780 msgr2=0x7ffb80072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.504+0000 7ffb84a00640 1 --2- 172.21.15.99:0/881116420 >> v2:172.21.15.187:3300/0 conn(0x7ffb800ce780 0x7ffb80072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.504+0000 7ffb84a00640 1 -- 172.21.15.99:0/881116420 >> v1:172.21.15.99:6789/0 conn(0x7ffb80071510 legacy=0x7ffb800b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.504+0000 7ffb84a00640 1 -- 172.21.15.99:0/881116420 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8006e990 con 0x7ffb80145290 2024-09-10T07:39:04.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.504+0000 7ffb77e00640 1 --2- 172.21.15.99:0/881116420 >> v2:172.21.15.187:3300/0 conn(0x7ffb800ce780 0x7ffb80072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.505+0000 7ffb84a00640 1 --2- 172.21.15.99:0/881116420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb80145290 0x7ffb8006f470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffb700097a0 tx=0x7ffb7002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d2a3a900a38876 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.505+0000 7ffb7fe00640 1 -- 172.21.15.99:0/881116420 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70037070 con 0x7ffb80145290 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.505+0000 7ffb7fe00640 1 -- 172.21.15.99:0/881116420 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb70032440 con 0x7ffb80145290 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.505+0000 7ffb7fe00640 1 -- 172.21.15.99:0/881116420 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70032810 con 0x7ffb80145290 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.506+0000 7ffb87400640 1 -- 172.21.15.99:0/881116420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb80145290 msgr2=0x7ffb8006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.506+0000 7ffb87400640 1 --2- 172.21.15.99:0/881116420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb80145290 0x7ffb8006f470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffb700097a0 tx=0x7ffb7002a180 comp rx=0 tx=0).stop 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.506+0000 7ffb87400640 1 -- 172.21.15.99:0/881116420 shutdown_connections 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.506+0000 7ffb87400640 1 --2- 172.21.15.99:0/881116420 >> v2:172.21.15.187:3300/0 conn(0x7ffb800ce780 0x7ffb80072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.506+0000 7ffb87400640 1 --2- 172.21.15.99:0/881116420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb80145290 0x7ffb8006f470 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.506+0000 7ffb87400640 1 -- 172.21.15.99:0/881116420 >> 172.21.15.99:0/881116420 conn(0x7ffb8006bc10 msgr2=0x7ffb8006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:04.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.506+0000 7ffb87400640 1 -- 172.21.15.99:0/881116420 shutdown_connections 2024-09-10T07:39:04.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.506+0000 7ffb87400640 1 -- 172.21.15.99:0/881116420 wait complete. 2024-09-10T07:39:04.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.507+0000 7ffb87400640 1 Processor -- start 2024-09-10T07:39:04.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.508+0000 7ffb87400640 1 -- start start 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.508+0000 7ffb87400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb80071510 0x7ffb80141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.508+0000 7ffb87400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb800ce780 0x7ffb80144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb87400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb80145290 0x7ffb801f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb87400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8006df80 con 0x7ffb80071510 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb87400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ffb80145670 con 0x7ffb80145290 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb87400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8006e100 con 0x7ffb800ce780 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb84a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb80071510 0x7ffb80141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb84a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb80071510 0x7ffb80141830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40542/0 (socket says 172.21.15.99:40542) 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb84a00640 1 -- 172.21.15.99:0/3423579074 learned_addr learned my addr 172.21.15.99:0/3423579074 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb77e00640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb800ce780 0x7ffb80144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb84a00640 1 -- 172.21.15.99:0/3423579074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb800ce780 msgr2=0x7ffb80144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb84a00640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb800ce780 0x7ffb80144420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb85400640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb80145290 0x7ffb801f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb84a00640 1 -- 172.21.15.99:0/3423579074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb80145290 msgr2=0x7ffb801f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb84a00640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb80145290 0x7ffb801f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb84a00640 1 -- 172.21.15.99:0/3423579074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb80141f30 con 0x7ffb80071510 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb77e00640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb800ce780 0x7ffb80144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.509+0000 7ffb85400640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb80145290 0x7ffb801f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.510+0000 7ffb84a00640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb80071510 0x7ffb80141830 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ffb70035040 tx=0x7ffb700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.510+0000 7ffb7d600640 1 -- 172.21.15.99:0/3423579074 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70041030 con 0x7ffb80071510 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.510+0000 7ffb7d600640 1 -- 172.21.15.99:0/3423579074 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7003d4e0 con 0x7ffb80071510 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.510+0000 7ffb87400640 1 -- 172.21.15.99:0/3423579074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb80142210 con 0x7ffb80071510 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.510+0000 7ffb7d600640 1 -- 172.21.15.99:0/3423579074 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70037040 con 0x7ffb80071510 2024-09-10T07:39:04.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.510+0000 7ffb87400640 1 -- 172.21.15.99:0/3423579074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb801427d0 con 0x7ffb80071510 2024-09-10T07:39:04.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.511+0000 7ffb87400640 1 -- 172.21.15.99:0/3423579074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb8006f470 con 0x7ffb80071510 2024-09-10T07:39:04.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.512+0000 7ffb7d600640 1 -- 172.21.15.99:0/3423579074 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb70044070 con 0x7ffb80071510 2024-09-10T07:39:04.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.513+0000 7ffb7d600640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffb5c06be30 0x7ffb5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.513+0000 7ffb7d600640 1 -- 172.21.15.99:0/3423579074 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7ffb700ab5a0 con 0x7ffb80071510 2024-09-10T07:39:04.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.513+0000 7ffb77e00640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffb5c06be30 0x7ffb5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.513+0000 7ffb77e00640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffb5c06be30 0x7ffb5c06e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffb80140180 tx=0x7ffb68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:04.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.517+0000 7ffb7d600640 1 -- 172.21.15.99:0/3423579074 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb70044e40 con 0x7ffb80071510 2024-09-10T07:39:04.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.724+0000 7ffb87400640 1 -- 172.21.15.99:0/3423579074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb800b5920 con 0x7ffb80071510 2024-09-10T07:39:04.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.725+0000 7ffb7d600640 1 -- 172.21.15.99:0/3423579074 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7ffb70079ec0 con 0x7ffb80071510 2024-09-10T07:39:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:04.725 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":49,"btime":"2024-09-10T07:39:04:324940+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/224049994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":224049994},{"type":"v1","addr":"172.21.15.187:6834","nonce":224049994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2009047482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2009047482},{"type":"v1","addr":"172.21.15.187:6835","nonce":2009047482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3952584402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3952584402},{"type":"v1","addr":"172.21.15.99:6837","nonce":3952584402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:00.703298+0000","modified":"2024-09-10T07:39:03.726531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/1858150570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1858150570},{"type":"v1","addr":"172.21.15.99:6835","nonce":1858150570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":6}]} 2024-09-10T07:39:04.725 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 49 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 -- 172.21.15.99:0/3423579074 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffb5c06be30 msgr2=0x7ffb5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffb5c06be30 0x7ffb5c06e2f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffb80140180 tx=0x7ffb68008040 comp rx=0 tx=0).stop 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 -- 172.21.15.99:0/3423579074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb80071510 msgr2=0x7ffb80141830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb80071510 0x7ffb80141830 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ffb70035040 tx=0x7ffb700046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 -- 172.21.15.99:0/3423579074 shutdown_connections 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb80145290 0x7ffb801f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb800ce780 0x7ffb80144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffb5c06be30 0x7ffb5c06e2f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 --2- 172.21.15.99:0/3423579074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb80071510 0x7ffb80141830 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 -- 172.21.15.99:0/3423579074 >> 172.21.15.99:0/3423579074 conn(0x7ffb8006bc10 msgr2=0x7ffb80072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 -- 172.21.15.99:0/3423579074 shutdown_connections 2024-09-10T07:39:04.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.727+0000 7ffb87400640 1 -- 172.21.15.99:0/3423579074 wait complete. 2024-09-10T07:39:04.743 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:39:04.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.897+0000 7f364a600640 1 Processor -- start 2024-09-10T07:39:04.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.897+0000 7f364a600640 1 -- start start 2024-09-10T07:39:04.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f364a600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f364415eab0 0x7f36440b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f364a600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3644070b40 0x7f364406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f364a600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f364406d260 0x7f36440b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f364a600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f36440d3710 con 0x7f364406d260 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f364a600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f36440b6390 con 0x7f3644070b40 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f364a600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f36440b6670 con 0x7f364415eab0 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f3649c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f364406d260 0x7f36440b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f3649c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f364406d260 0x7f36440b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40550/0 (socket says 172.21.15.99:40550) 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f3649c00640 1 -- 172.21.15.99:0/757959999 learned_addr learned my addr 172.21.15.99:0/757959999 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f3649200640 1 --2- 172.21.15.99:0/757959999 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f364415eab0 0x7f36440b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.898+0000 7f363be00640 1 --2- 172.21.15.99:0/757959999 >> v2:172.21.15.187:3300/0 conn(0x7f3644070b40 0x7f364406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.899+0000 7f3649c00640 1 -- 172.21.15.99:0/757959999 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f364415eab0 msgr2=0x7f36440b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.899+0000 7f3649c00640 1 --2- 172.21.15.99:0/757959999 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f364415eab0 0x7f36440b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.899+0000 7f3649c00640 1 -- 172.21.15.99:0/757959999 >> v2:172.21.15.187:3300/0 conn(0x7f3644070b40 msgr2=0x7f364406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:04.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.899+0000 7f3649c00640 1 --2- 172.21.15.99:0/757959999 >> v2:172.21.15.187:3300/0 conn(0x7f3644070b40 0x7f364406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.899+0000 7f3649c00640 1 -- 172.21.15.99:0/757959999 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36440b6950 con 0x7f364406d260 2024-09-10T07:39:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.900+0000 7f3649c00640 1 --2- 172.21.15.99:0/757959999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 0x7f36440b7150 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f363c009e50 tx=0x7f363c02a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8d1743f1b24053 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.900+0000 7f3643e00640 1 -- 172.21.15.99:0/757959999 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c036070 con 0x7f364406d260 2024-09-10T07:39:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.900+0000 7f3643e00640 1 -- 172.21.15.99:0/757959999 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363c031600 con 0x7f364406d260 2024-09-10T07:39:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.900+0000 7f3643e00640 1 -- 172.21.15.99:0/757959999 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c0319d0 con 0x7f364406d260 2024-09-10T07:39:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.901+0000 7f364a600640 1 -- 172.21.15.99:0/757959999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 msgr2=0x7f36440b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.901+0000 7f364a600640 1 --2- 172.21.15.99:0/757959999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 0x7f36440b7150 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f363c009e50 tx=0x7f363c02a5b0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.901+0000 7f364a600640 1 -- 172.21.15.99:0/757959999 shutdown_connections 2024-09-10T07:39:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.901+0000 7f364a600640 1 --2- 172.21.15.99:0/757959999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 0x7f36440b7150 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.901+0000 7f364a600640 1 --2- 172.21.15.99:0/757959999 >> v2:172.21.15.187:3300/0 conn(0x7f3644070b40 0x7f364406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.901+0000 7f364a600640 1 --2- 172.21.15.99:0/757959999 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f364415eab0 0x7f36440b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.901+0000 7f364a600640 1 -- 172.21.15.99:0/757959999 >> 172.21.15.99:0/757959999 conn(0x7f36440b7cc0 msgr2=0x7f36440b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.901+0000 7f364a600640 1 -- 172.21.15.99:0/757959999 shutdown_connections 2024-09-10T07:39:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.901+0000 7f364a600640 1 -- 172.21.15.99:0/757959999 wait complete. 2024-09-10T07:39:04.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.902+0000 7f364a600640 1 Processor -- start 2024-09-10T07:39:04.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.903+0000 7f364a600640 1 -- start start 2024-09-10T07:39:04.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.903+0000 7f364a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 0x7f364414b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.903+0000 7f364a600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3644070b40 0x7f36441563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.903+0000 7f364a600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f364415eab0 0x7f3644159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.903+0000 7f364a600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f364415ee90 con 0x7f364406d260 2024-09-10T07:39:04.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.903+0000 7f364a600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f36440d3230 con 0x7f364415eab0 2024-09-10T07:39:04.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.903+0000 7f364a600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f364409f220 con 0x7f3644070b40 2024-09-10T07:39:04.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f3649200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 0x7f364414b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f3649200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 0x7f364414b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40558/0 (socket says 172.21.15.99:40558) 2024-09-10T07:39:04.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f3649200640 1 -- 172.21.15.99:0/1501711357 learned_addr learned my addr 172.21.15.99:0/1501711357 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:04.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f3649c00640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f364415eab0 0x7f3644159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f363be00640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3644070b40 0x7f36441563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f3649200640 1 -- 172.21.15.99:0/1501711357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3644070b40 msgr2=0x7f36441563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f3649200640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3644070b40 0x7f36441563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f3649200640 1 -- 172.21.15.99:0/1501711357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f364415eab0 msgr2=0x7f3644159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:04.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f3649200640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f364415eab0 0x7f3644159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:04.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f3649200640 1 -- 172.21.15.99:0/1501711357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364409f4c0 con 0x7f364406d260 2024-09-10T07:39:04.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.904+0000 7f3649200640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 0x7f364414b2c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f363400e9e0 tx=0x7f363400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.905+0000 7f3641600640 1 -- 172.21.15.99:0/1501711357 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634017070 con 0x7f364406d260 2024-09-10T07:39:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.905+0000 7f3641600640 1 -- 172.21.15.99:0/1501711357 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363400c9d0 con 0x7f364406d260 2024-09-10T07:39:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.905+0000 7f3641600640 1 -- 172.21.15.99:0/1501711357 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363400cdc0 con 0x7f364406d260 2024-09-10T07:39:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.905+0000 7f364a600640 1 -- 172.21.15.99:0/1501711357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364409f7a0 con 0x7f364406d260 2024-09-10T07:39:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.905+0000 7f364a600640 1 -- 172.21.15.99:0/1501711357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f364409fd60 con 0x7f364406d260 2024-09-10T07:39:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.906+0000 7f364a600640 1 -- 172.21.15.99:0/1501711357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364406cd20 con 0x7f364406d260 2024-09-10T07:39:04.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.907+0000 7f3641600640 1 -- 172.21.15.99:0/1501711357 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f363401a070 con 0x7f364406d260 2024-09-10T07:39:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.908+0000 7f3641600640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f362006be30 0x7f362006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.908+0000 7f3641600640 1 -- 172.21.15.99:0/1501711357 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f363408b1f0 con 0x7f364406d260 2024-09-10T07:39:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.908+0000 7f363be00640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f362006be30 0x7f362006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.908+0000 7f363be00640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f362006be30 0x7f362006e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f36441f7fc0 tx=0x7f362c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:04.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:04.912+0000 7f3641600640 1 -- 172.21.15.99:0/1501711357 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3634059b90 con 0x7f364406d260 2024-09-10T07:39:05.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.088+0000 7f364a600640 1 -- 172.21.15.99:0/1501711357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36441623e0 con 0x7f364406d260 2024-09-10T07:39:05.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.090+0000 7f3641600640 1 -- 172.21.15.99:0/1501711357 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16699 (secure 0 0 0) 0x7f3634059490 con 0x7f364406d260 2024-09-10T07:39:05.090 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:05.090 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":101,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:39:02.302729+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:38:58.485547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T07:38:59.701338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:39:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 -- 172.21.15.99:0/1501711357 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f362006be30 msgr2=0x7f362006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f362006be30 0x7f362006e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f36441f7fc0 tx=0x7f362c008040 comp rx=0 tx=0).stop 2024-09-10T07:39:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 -- 172.21.15.99:0/1501711357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 msgr2=0x7f364414b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 0x7f364414b2c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f363400e9e0 tx=0x7f363400eea0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 -- 172.21.15.99:0/1501711357 shutdown_connections 2024-09-10T07:39:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f364415eab0 0x7f3644159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3644070b40 0x7f36441563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f362006be30 0x7f362006e2f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 --2- 172.21.15.99:0/1501711357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f364406d260 0x7f364414b2c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 -- 172.21.15.99:0/1501711357 >> 172.21.15.99:0/1501711357 conn(0x7f36440b7cc0 msgr2=0x7f3644161b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:05.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 -- 172.21.15.99:0/1501711357 shutdown_connections 2024-09-10T07:39:05.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.092+0000 7f364a600640 1 -- 172.21.15.99:0/1501711357 wait complete. 2024-09-10T07:39:05.108 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:39:05.108 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:39:05.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.263+0000 7fb005200640 1 Processor -- start 2024-09-10T07:39:05.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.263+0000 7fb005200640 1 -- start start 2024-09-10T07:39:05.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.264+0000 7fb005200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb0000d2680 0x7fb0000cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.264+0000 7fb005200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0000cfac0 0x7fb0000c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.264+0000 7fb005200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0000d2bd0 con 0x7fb00015e970 2024-09-10T07:39:05.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.264+0000 7fb005200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb0000d37e0 con 0x7fb0000d2680 2024-09-10T07:39:05.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.264+0000 7fb005200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb0000d2eb0 con 0x7fb0000cfac0 2024-09-10T07:39:05.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.264+0000 7fafff400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb00015e970 0x7fb0000d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58350/0 (socket says 172.21.15.99:58350) 2024-09-10T07:39:05.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.264+0000 7fafff400640 1 -- 172.21.15.99:0/1370109111 learned_addr learned my addr 172.21.15.99:0/1370109111 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7fafffe00640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0000cfac0 0x7fb0000c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2239694649 0 0) 0x7fb0000d2bd0 con 0x7fb00015e970 2024-09-10T07:39:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faff7e00640 1 --2- 172.21.15.99:0/1370109111 >> v2:172.21.15.187:3300/0 conn(0x7fb0000d2680 0x7fb0000cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafe4003520 con 0x7fb00015e970 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2938871065 0 0) 0x7fafe4003520 con 0x7fb00015e970 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0000cfac0 msgr2=0x7fb0000c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0000cfac0 0x7fb0000c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 >> v2:172.21.15.187:3300/0 conn(0x7fb0000d2680 msgr2=0x7fb0000cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 --2- 172.21.15.99:0/1370109111 >> v2:172.21.15.187:3300/0 conn(0x7fb0000d2680 0x7fb0000cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0000d3190 con 0x7fb00015e970 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7faff0001670 con 0x7fb00015e970 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 >> v1:172.21.15.99:6789/0 conn(0x7fb00015e970 legacy=0x7fb0000d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafe40039b0 0x7fafe4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe4004800 0x7fafe4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0000cfac0 0x7fafe40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb0000d37e0 con 0x7fafe4004800 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb0000d2eb0 con 0x7fafe40039b0 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fafe400b9f0 con 0x7fb0000cfac0 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7faff7e00640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe4004800 0x7fafe4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.265+0000 7fafff400640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafe40039b0 0x7fafe4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.266+0000 7fafffe00640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0000cfac0 0x7fafe40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.266+0000 7fafff400640 1 -- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0000cfac0 msgr2=0x7fafe40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.266+0000 7fafff400640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0000cfac0 0x7fafe40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.266+0000 7fafff400640 1 -- 172.21.15.99:0/1370109111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe4004800 msgr2=0x7fafe4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.266+0000 7fafff400640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe4004800 0x7fafe4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.266+0000 7fafff400640 1 -- 172.21.15.99:0/1370109111 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe4003520 con 0x7fafe40039b0 2024-09-10T07:39:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.266+0000 7faff7e00640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe4004800 0x7fafe4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:05.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.267+0000 7fafff400640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafe40039b0 0x7fafe4003dd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faff000c190 tx=0x7fafe4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe5f4b124afa01e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.267+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0007c60 con 0x7fafe40039b0 2024-09-10T07:39:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.267+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff0005af0 con 0x7fafe40039b0 2024-09-10T07:39:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.267+0000 7faffea00640 1 -- 172.21.15.99:0/1370109111 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0007070 con 0x7fafe40039b0 2024-09-10T07:39:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.268+0000 7fb005200640 1 -- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafe40039b0 msgr2=0x7fafe4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.268+0000 7fb005200640 1 --2- 172.21.15.99:0/1370109111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafe40039b0 0x7fafe4003dd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faff000c190 tx=0x7fafe4005830 comp rx=0 tx=0).stop 2024-09-10T07:39:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.268+0000 7fafffe00640 1 -- 172.21.15.99:0/1370109111 reap_dead start 2024-09-10T07:39:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.268+0000 7fb005200640 1 -- 172.21.15.99:0/1370109111 shutdown_connections 2024-09-10T07:39:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.268+0000 7fb005200640 1 -- 172.21.15.99:0/1370109111 >> 172.21.15.99:0/1370109111 conn(0x7fb00009de00 msgr2=0x7fb0000d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.268+0000 7fb005200640 1 -- 172.21.15.99:0/1370109111 shutdown_connections 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.268+0000 7fb005200640 1 -- 172.21.15.99:0/1370109111 wait complete. 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.269+0000 7fb005200640 1 Processor -- start 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.270+0000 7fb005200640 1 -- start start 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.270+0000 7fb005200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe40039b0 0x7fb0000ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.270+0000 7fb005200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb000159d70 0x7fb0000c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.270+0000 7fb005200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb00015a1f0 0x7fb0000c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.270+0000 7fb005200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb00015ed50 con 0x7fafe40039b0 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.270+0000 7fb005200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb0000cff50 con 0x7fb00015a1f0 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.270+0000 7fb005200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb00015eed0 con 0x7fb000159d70 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7fafff400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe40039b0 0x7fb0000ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7fafff400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe40039b0 0x7fb0000ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40576/0 (socket says 172.21.15.99:40576) 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7fafff400640 1 -- 172.21.15.99:0/3706285370 learned_addr learned my addr 172.21.15.99:0/3706285370 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7fafffe00640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb00015a1f0 0x7fb0000c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7faff7e00640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb000159d70 0x7fb0000c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7fafff400640 1 -- 172.21.15.99:0/3706285370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb000159d70 msgr2=0x7fb0000c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7fafff400640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb000159d70 0x7fb0000c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7fafff400640 1 -- 172.21.15.99:0/3706285370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb00015a1f0 msgr2=0x7fb0000c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7fafff400640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb00015a1f0 0x7fb0000c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7fafff400640 1 -- 172.21.15.99:0/3706285370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00015f080 con 0x7fafe40039b0 2024-09-10T07:39:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.271+0000 7fafff400640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe40039b0 0x7fb0000ce9b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7faff000c2b0 tx=0x7fb0000d3750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:05.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.272+0000 7faff7400640 1 -- 172.21.15.99:0/3706285370 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0041020 con 0x7fafe40039b0 2024-09-10T07:39:05.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.272+0000 7faff7400640 1 -- 172.21.15.99:0/3706285370 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff0001430 con 0x7fafe40039b0 2024-09-10T07:39:05.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.272+0000 7fb005200640 1 -- 172.21.15.99:0/3706285370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00015a750 con 0x7fafe40039b0 2024-09-10T07:39:05.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.272+0000 7faff7400640 1 -- 172.21.15.99:0/3706285370 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0007070 con 0x7fafe40039b0 2024-09-10T07:39:05.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.272+0000 7fb005200640 1 -- 172.21.15.99:0/3706285370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00015f600 con 0x7fafe40039b0 2024-09-10T07:39:05.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.273+0000 7fb005200640 1 -- 172.21.15.99:0/3706285370 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0000cf580 con 0x7fafe40039b0 2024-09-10T07:39:05.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.274+0000 7faff7400640 1 -- 172.21.15.99:0/3706285370 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faff0044020 con 0x7fafe40039b0 2024-09-10T07:39:05.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.275+0000 7faff7400640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafdc06be60 0x7fafdc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.275+0000 7faff7400640 1 -- 172.21.15.99:0/3706285370 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7faff00aaf90 con 0x7fafe40039b0 2024-09-10T07:39:05.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.275+0000 7faff7e00640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafdc06be60 0x7fafdc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.275+0000 7faff7e00640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafdc06be60 0x7fafdc06e320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb0001f7d70 tx=0x7fafe8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:05.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.279+0000 7faff7400640 1 -- 172.21.15.99:0/3706285370 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faff0079380 con 0x7fafe40039b0 2024-09-10T07:39:05.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.452+0000 7fb005200640 1 -- 172.21.15.99:0/3706285370 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0000d14c0 con 0x7fafdc06be60 2024-09-10T07:39:05.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.458+0000 7faff7400640 1 -- 172.21.15.99:0/3706285370 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247768 (secure 0 0 0) 0x7fb0000d14c0 con 0x7fafdc06be60 2024-09-10T07:39:05.461 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:05.463 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:39:05.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.462+0000 7fb005200640 1 -- 172.21.15.99:0/3706285370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafdc06be60 msgr2=0x7fafdc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.462+0000 7fb005200640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafdc06be60 0x7fafdc06e320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb0001f7d70 tx=0x7fafe8009190 comp rx=0 tx=0).stop 2024-09-10T07:39:05.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.462+0000 7fb005200640 1 -- 172.21.15.99:0/3706285370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe40039b0 msgr2=0x7fb0000ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.462+0000 7fb005200640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe40039b0 0x7fb0000ce9b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7faff000c2b0 tx=0x7fb0000d3750 comp rx=0 tx=0).stop 2024-09-10T07:39:05.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.462+0000 7fb005200640 1 -- 172.21.15.99:0/3706285370 shutdown_connections 2024-09-10T07:39:05.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.462+0000 7fb005200640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb00015a1f0 0x7fb0000c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.462+0000 7fb005200640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb000159d70 0x7fb0000c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.462+0000 7fb005200640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fafdc06be60 0x7fafdc06e320 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.462+0000 7fb005200640 1 --2- 172.21.15.99:0/3706285370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafe40039b0 0x7fb0000ce9b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.462+0000 7fb005200640 1 -- 172.21.15.99:0/3706285370 >> 172.21.15.99:0/3706285370 conn(0x7fb00009de00 msgr2=0x7fb00006dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:05.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.463+0000 7fb005200640 1 -- 172.21.15.99:0/3706285370 shutdown_connections 2024-09-10T07:39:05.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.463+0000 7fb005200640 1 -- 172.21.15.99:0/3706285370 wait complete. 2024-09-10T07:39:05.479 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2024-09-10T07:39:04.754853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557072,"statfs":{"total":1600000000,"available":1594441868,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.467474"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006925+0000","last_change":"2024-09-10T07:39:01.324499+0000","last_active":"2024-09-10T07:39:03.006925+0000","last_peered":"2024-09-10T07:39:03.006925+0000","last_clean":"2024-09-10T07:39:03.006925+0000","last_became_active":"2024-09-10T07:39:01.322161+0000","last_became_peered":"2024-09-10T07:39:01.322161+0000","last_unstale":"2024-09-10T07:39:03.006925+0000","last_undegraded":"2024-09-10T07:39:03.006925+0000","last_fullsized":"2024-09-10T07:39:03.006925+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:17.593202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325360+0000","last_change":"2024-09-10T07:39:01.325516+0000","last_active":"2024-09-10T07:39:02.325360+0000","last_peered":"2024-09-10T07:39:02.325360+0000","last_clean":"2024-09-10T07:39:02.325360+0000","last_became_active":"2024-09-10T07:39:01.324717+0000","last_became_peered":"2024-09-10T07:39:01.324717+0000","last_unstale":"2024-09-10T07:39:02.325360+0000","last_undegraded":"2024-09-10T07:39:02.325360+0000","last_fullsized":"2024-09-10T07:39:02.325360+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:38.930884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309385+0000","last_change":"2024-09-10T07:39:01.324480+0000","last_active":"2024-09-10T07:39:02.309385+0000","last_peered":"2024-09-10T07:39:02.309385+0000","last_clean":"2024-09-10T07:39:02.309385+0000","last_became_active":"2024-09-10T07:39:01.324254+0000","last_became_peered":"2024-09-10T07:39:01.324254+0000","last_unstale":"2024-09-10T07:39:02.309385+0000","last_undegraded":"2024-09-10T07:39:02.309385+0000","last_fullsized":"2024-09-10T07:39:02.309385+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:30.431700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.005856+0000","last_change":"2024-09-10T07:39:01.320078+0000","last_active":"2024-09-10T07:39:03.005856+0000","last_peered":"2024-09-10T07:39:03.005856+0000","last_clean":"2024-09-10T07:39:03.005856+0000","last_became_active":"2024-09-10T07:39:01.319453+0000","last_became_peered":"2024-09-10T07:39:01.319453+0000","last_unstale":"2024-09-10T07:39:03.005856+0000","last_undegraded":"2024-09-10T07:39:03.005856+0000","last_fullsized":"2024-09-10T07:39:03.005856+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:43:42.607313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006594+0000","last_change":"2024-09-10T07:39:01.315761+0000","last_active":"2024-09-10T07:39:03.006594+0000","last_peered":"2024-09-10T07:39:03.006594+0000","last_clean":"2024-09-10T07:39:03.006594+0000","last_became_active":"2024-09-10T07:39:01.315495+0000","last_became_peered":"2024-09-10T07:39:01.315495+0000","last_unstale":"2024-09-10T07:39:03.006594+0000","last_undegraded":"2024-09-10T07:39:03.006594+0000","last_fullsized":"2024-09-10T07:39:03.006594+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:18.053574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309334+0000","last_change":"2024-09-10T07:39:01.313968+0000","last_active":"2024-09-10T07:39:02.309334+0000","last_peered":"2024-09-10T07:39:02.309334+0000","last_clean":"2024-09-10T07:39:02.309334+0000","last_became_active":"2024-09-10T07:39:01.313552+0000","last_became_peered":"2024-09-10T07:39:01.313552+0000","last_unstale":"2024-09-10T07:39:02.309334+0000","last_undegraded":"2024-09-10T07:39:02.309334+0000","last_fullsized":"2024-09-10T07:39:02.309334+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:08.713532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006013+0000","last_change":"2024-09-10T07:39:01.316748+0000","last_active":"2024-09-10T07:39:03.006013+0000","last_peered":"2024-09-10T07:39:03.006013+0000","last_clean":"2024-09-10T07:39:03.006013+0000","last_became_active":"2024-09-10T07:39:01.315754+0000","last_became_peered":"2024-09-10T07:39:01.315754+0000","last_unstale":"2024-09-10T07:39:03.006013+0000","last_undegraded":"2024-09-10T07:39:03.006013+0000","last_fullsized":"2024-09-10T07:39:03.006013+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:36.441660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.308962+0000","last_change":"2024-09-10T07:39:01.317063+0000","last_active":"2024-09-10T07:39:02.308962+0000","last_peered":"2024-09-10T07:39:02.308962+0000","last_clean":"2024-09-10T07:39:02.308962+0000","last_became_active":"2024-09-10T07:39:01.316801+0000","last_became_peered":"2024-09-10T07:39:01.316801+0000","last_unstale":"2024-09-10T07:39:02.308962+0000","last_undegraded":"2024-09-10T07:39:02.308962+0000","last_fullsized":"2024-09-10T07:39:02.308962+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:09.256864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.308999+0000","last_change":"2024-09-10T07:39:01.310920+0000","last_active":"2024-09-10T07:39:02.308999+0000","last_peered":"2024-09-10T07:39:02.308999+0000","last_clean":"2024-09-10T07:39:02.308999+0000","last_became_active":"2024-09-10T07:39:01.310669+0000","last_became_peered":"2024-09-10T07:39:01.310669+0000","last_unstale":"2024-09-10T07:39:02.308999+0000","last_undegraded":"2024-09-10T07:39:02.308999+0000","last_fullsized":"2024-09-10T07:39:02.308999+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:16.380905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006978+0000","last_change":"2024-09-10T07:39:01.321085+0000","last_active":"2024-09-10T07:39:03.006978+0000","last_peered":"2024-09-10T07:39:03.006978+0000","last_clean":"2024-09-10T07:39:03.006978+0000","last_became_active":"2024-09-10T07:39:01.320602+0000","last_became_peered":"2024-09-10T07:39:01.320602+0000","last_unstale":"2024-09-10T07:39:03.006978+0000","last_undegraded":"2024-09-10T07:39:03.006978+0000","last_fullsized":"2024-09-10T07:39:03.006978+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:05.891895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325684+0000","last_change":"2024-09-10T07:39:01.322127+0000","last_active":"2024-09-10T07:39:02.325684+0000","last_peered":"2024-09-10T07:39:02.325684+0000","last_clean":"2024-09-10T07:39:02.325684+0000","last_became_active":"2024-09-10T07:39:01.321823+0000","last_became_peered":"2024-09-10T07:39:01.321823+0000","last_unstale":"2024-09-10T07:39:02.325684+0000","last_undegraded":"2024-09-10T07:39:02.325684+0000","last_fullsized":"2024-09-10T07:39:02.325684+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:39.797480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006517+0000","last_change":"2024-09-10T07:39:01.324165+0000","last_active":"2024-09-10T07:39:03.006517+0000","last_peered":"2024-09-10T07:39:03.006517+0000","last_clean":"2024-09-10T07:39:03.006517+0000","last_became_active":"2024-09-10T07:39:01.323519+0000","last_became_peered":"2024-09-10T07:39:01.323519+0000","last_unstale":"2024-09-10T07:39:03.006517+0000","last_undegraded":"2024-09-10T07:39:03.006517+0000","last_fullsized":"2024-09-10T07:39:03.006517+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:20.999644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309557+0000","last_change":"2024-09-10T07:39:01.318247+0000","last_active":"2024-09-10T07:39:02.309557+0000","last_peered":"2024-09-10T07:39:02.309557+0000","last_clean":"2024-09-10T07:39:02.309557+0000","last_became_active":"2024-09-10T07:39:01.318013+0000","last_became_peered":"2024-09-10T07:39:01.318013+0000","last_unstale":"2024-09-10T07:39:02.309557+0000","last_undegraded":"2024-09-10T07:39:02.309557+0000","last_fullsized":"2024-09-10T07:39:02.309557+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:35.393209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006053+0000","last_change":"2024-09-10T07:39:01.319890+0000","last_active":"2024-09-10T07:39:03.006053+0000","last_peered":"2024-09-10T07:39:03.006053+0000","last_clean":"2024-09-10T07:39:03.006053+0000","last_became_active":"2024-09-10T07:39:01.319130+0000","last_became_peered":"2024-09-10T07:39:01.319130+0000","last_unstale":"2024-09-10T07:39:03.006053+0000","last_undegraded":"2024-09-10T07:39:03.006053+0000","last_fullsized":"2024-09-10T07:39:03.006053+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:32.061226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305962+0000","last_change":"2024-09-10T07:39:01.321781+0000","last_active":"2024-09-10T07:39:02.305962+0000","last_peered":"2024-09-10T07:39:02.305962+0000","last_clean":"2024-09-10T07:39:02.305962+0000","last_became_active":"2024-09-10T07:39:01.321372+0000","last_became_peered":"2024-09-10T07:39:01.321372+0000","last_unstale":"2024-09-10T07:39:02.305962+0000","last_undegraded":"2024-09-10T07:39:02.305962+0000","last_fullsized":"2024-09-10T07:39:02.305962+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:33.335683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007176+0000","last_change":"2024-09-10T07:39:01.324168+0000","last_active":"2024-09-10T07:39:03.007176+0000","last_peered":"2024-09-10T07:39:03.007176+0000","last_clean":"2024-09-10T07:39:03.007176+0000","last_became_active":"2024-09-10T07:39:01.323882+0000","last_became_peered":"2024-09-10T07:39:01.323882+0000","last_unstale":"2024-09-10T07:39:03.007176+0000","last_undegraded":"2024-09-10T07:39:03.007176+0000","last_fullsized":"2024-09-10T07:39:03.007176+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:19.677478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006925+0000","last_change":"2024-09-10T07:39:01.314487+0000","last_active":"2024-09-10T07:39:03.006925+0000","last_peered":"2024-09-10T07:39:03.006925+0000","last_clean":"2024-09-10T07:39:03.006925+0000","last_became_active":"2024-09-10T07:39:01.314056+0000","last_became_peered":"2024-09-10T07:39:01.314056+0000","last_unstale":"2024-09-10T07:39:03.006925+0000","last_undegraded":"2024-09-10T07:39:03.006925+0000","last_fullsized":"2024-09-10T07:39:03.006925+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:39.951789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006090+0000","last_change":"2024-09-10T07:39:01.322497+0000","last_active":"2024-09-10T07:39:03.006090+0000","last_peered":"2024-09-10T07:39:03.006090+0000","last_clean":"2024-09-10T07:39:03.006090+0000","last_became_active":"2024-09-10T07:39:01.322267+0000","last_became_peered":"2024-09-10T07:39:01.322267+0000","last_unstale":"2024-09-10T07:39:03.006090+0000","last_undegraded":"2024-09-10T07:39:03.006090+0000","last_fullsized":"2024-09-10T07:39:03.006090+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:08.673299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326803+0000","last_change":"2024-09-10T07:39:01.308634+0000","last_active":"2024-09-10T07:39:02.326803+0000","last_peered":"2024-09-10T07:39:02.326803+0000","last_clean":"2024-09-10T07:39:02.326803+0000","last_became_active":"2024-09-10T07:39:01.308317+0000","last_became_peered":"2024-09-10T07:39:01.308317+0000","last_unstale":"2024-09-10T07:39:02.326803+0000","last_undegraded":"2024-09-10T07:39:02.326803+0000","last_fullsized":"2024-09-10T07:39:02.326803+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:27.542078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006283+0000","last_change":"2024-09-10T07:39:01.308691+0000","last_active":"2024-09-10T07:39:03.006283+0000","last_peered":"2024-09-10T07:39:03.006283+0000","last_clean":"2024-09-10T07:39:03.006283+0000","last_became_active":"2024-09-10T07:39:01.308413+0000","last_became_peered":"2024-09-10T07:39:01.308413+0000","last_unstale":"2024-09-10T07:39:03.006283+0000","last_undegraded":"2024-09-10T07:39:03.006283+0000","last_fullsized":"2024-09-10T07:39:03.006283+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:00:41.354227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006063+0000","last_change":"2024-09-10T07:39:01.308636+0000","last_active":"2024-09-10T07:39:03.006063+0000","last_peered":"2024-09-10T07:39:03.006063+0000","last_clean":"2024-09-10T07:39:03.006063+0000","last_became_active":"2024-09-10T07:39:01.308393+0000","last_became_peered":"2024-09-10T07:39:01.308393+0000","last_unstale":"2024-09-10T07:39:03.006063+0000","last_undegraded":"2024-09-10T07:39:03.006063+0000","last_fullsized":"2024-09-10T07:39:03.006063+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:25.975093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325493+0000","last_change":"2024-09-10T07:39:01.320336+0000","last_active":"2024-09-10T07:39:02.325493+0000","last_peered":"2024-09-10T07:39:02.325493+0000","last_clean":"2024-09-10T07:39:02.325493+0000","last_became_active":"2024-09-10T07:39:01.315758+0000","last_became_peered":"2024-09-10T07:39:01.315758+0000","last_unstale":"2024-09-10T07:39:02.325493+0000","last_undegraded":"2024-09-10T07:39:02.325493+0000","last_fullsized":"2024-09-10T07:39:02.325493+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:09.172382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006495+0000","last_change":"2024-09-10T07:39:01.322859+0000","last_active":"2024-09-10T07:39:03.006495+0000","last_peered":"2024-09-10T07:39:03.006495+0000","last_clean":"2024-09-10T07:39:03.006495+0000","last_became_active":"2024-09-10T07:39:01.321881+0000","last_became_peered":"2024-09-10T07:39:01.321881+0000","last_unstale":"2024-09-10T07:39:03.006495+0000","last_undegraded":"2024-09-10T07:39:03.006495+0000","last_fullsized":"2024-09-10T07:39:03.006495+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:31.746680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006234+0000","last_change":"2024-09-10T07:39:01.308370+0000","last_active":"2024-09-10T07:39:03.006234+0000","last_peered":"2024-09-10T07:39:03.006234+0000","last_clean":"2024-09-10T07:39:03.006234+0000","last_became_active":"2024-09-10T07:39:01.308078+0000","last_became_peered":"2024-09-10T07:39:01.308078+0000","last_unstale":"2024-09-10T07:39:03.006234+0000","last_undegraded":"2024-09-10T07:39:03.006234+0000","last_fullsized":"2024-09-10T07:39:03.006234+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:23.299702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325460+0000","last_change":"2024-09-10T07:39:01.323026+0000","last_active":"2024-09-10T07:39:02.325460+0000","last_peered":"2024-09-10T07:39:02.325460+0000","last_clean":"2024-09-10T07:39:02.325460+0000","last_became_active":"2024-09-10T07:39:01.321996+0000","last_became_peered":"2024-09-10T07:39:01.321996+0000","last_unstale":"2024-09-10T07:39:02.325460+0000","last_undegraded":"2024-09-10T07:39:02.325460+0000","last_fullsized":"2024-09-10T07:39:02.325460+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:42.223193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309684+0000","last_change":"2024-09-10T07:39:01.323360+0000","last_active":"2024-09-10T07:39:02.309684+0000","last_peered":"2024-09-10T07:39:02.309684+0000","last_clean":"2024-09-10T07:39:02.309684+0000","last_became_active":"2024-09-10T07:39:01.322904+0000","last_became_peered":"2024-09-10T07:39:01.322904+0000","last_unstale":"2024-09-10T07:39:02.309684+0000","last_undegraded":"2024-09-10T07:39:02.309684+0000","last_fullsized":"2024-09-10T07:39:02.309684+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:24.549894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007479+0000","last_change":"2024-09-10T07:39:01.311960+0000","last_active":"2024-09-10T07:39:03.007479+0000","last_peered":"2024-09-10T07:39:03.007479+0000","last_clean":"2024-09-10T07:39:03.007479+0000","last_became_active":"2024-09-10T07:39:01.311730+0000","last_became_peered":"2024-09-10T07:39:01.311730+0000","last_unstale":"2024-09-10T07:39:03.007479+0000","last_undegraded":"2024-09-10T07:39:03.007479+0000","last_fullsized":"2024-09-10T07:39:03.007479+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:51.154025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006787+0000","last_change":"2024-09-10T07:39:01.322591+0000","last_active":"2024-09-10T07:39:03.006787+0000","last_peered":"2024-09-10T07:39:03.006787+0000","last_clean":"2024-09-10T07:39:03.006787+0000","last_became_active":"2024-09-10T07:39:01.321334+0000","last_became_peered":"2024-09-10T07:39:01.321334+0000","last_unstale":"2024-09-10T07:39:03.006787+0000","last_undegraded":"2024-09-10T07:39:03.006787+0000","last_fullsized":"2024-09-10T07:39:03.006787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:03.237607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325540+0000","last_change":"2024-09-10T07:39:01.318054+0000","last_active":"2024-09-10T07:39:02.325540+0000","last_peered":"2024-09-10T07:39:02.325540+0000","last_clean":"2024-09-10T07:39:02.325540+0000","last_became_active":"2024-09-10T07:39:01.317636+0000","last_became_peered":"2024-09-10T07:39:01.317636+0000","last_unstale":"2024-09-10T07:39:02.325540+0000","last_undegraded":"2024-09-10T07:39:02.325540+0000","last_fullsized":"2024-09-10T07:39:02.325540+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:02.675660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325612+0000","last_change":"2024-09-10T07:39:01.314583+0000","last_active":"2024-09-10T07:39:02.325612+0000","last_peered":"2024-09-10T07:39:02.325612+0000","last_clean":"2024-09-10T07:39:02.325612+0000","last_became_active":"2024-09-10T07:39:01.314259+0000","last_became_peered":"2024-09-10T07:39:01.314259+0000","last_unstale":"2024-09-10T07:39:02.325612+0000","last_undegraded":"2024-09-10T07:39:02.325612+0000","last_fullsized":"2024-09-10T07:39:02.325612+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:18.429886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007365+0000","last_change":"2024-09-10T07:39:01.311712+0000","last_active":"2024-09-10T07:39:03.007365+0000","last_peered":"2024-09-10T07:39:03.007365+0000","last_clean":"2024-09-10T07:39:03.007365+0000","last_became_active":"2024-09-10T07:39:01.311453+0000","last_became_peered":"2024-09-10T07:39:01.311453+0000","last_unstale":"2024-09-10T07:39:03.007365+0000","last_undegraded":"2024-09-10T07:39:03.007365+0000","last_fullsized":"2024-09-10T07:39:03.007365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:45.264655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006672+0000","last_change":"2024-09-10T07:39:01.324467+0000","last_active":"2024-09-10T07:39:03.006672+0000","last_peered":"2024-09-10T07:39:03.006672+0000","last_clean":"2024-09-10T07:39:03.006672+0000","last_became_active":"2024-09-10T07:39:01.323914+0000","last_became_peered":"2024-09-10T07:39:01.323914+0000","last_unstale":"2024-09-10T07:39:03.006672+0000","last_undegraded":"2024-09-10T07:39:03.006672+0000","last_fullsized":"2024-09-10T07:39:03.006672+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:33.902638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006305+0000","last_change":"2024-09-10T07:39:01.325948+0000","last_active":"2024-09-10T07:39:03.006305+0000","last_peered":"2024-09-10T07:39:03.006305+0000","last_clean":"2024-09-10T07:39:03.006305+0000","last_became_active":"2024-09-10T07:39:01.325610+0000","last_became_peered":"2024-09-10T07:39:01.325610+0000","last_unstale":"2024-09-10T07:39:03.006305+0000","last_undegraded":"2024-09-10T07:39:03.006305+0000","last_fullsized":"2024-09-10T07:39:03.006305+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:13.432473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"100'4","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007127+0000","last_change":"2024-09-10T07:39:00.303359+0000","last_active":"2024-09-10T07:39:03.007127+0000","last_peered":"2024-09-10T07:39:03.007127+0000","last_clean":"2024-09-10T07:39:03.007127+0000","last_became_active":"2024-09-10T07:39:00.302872+0000","last_became_peered":"2024-09-10T07:39:00.302872+0000","last_unstale":"2024-09-10T07:39:03.007127+0000","last_undegraded":"2024-09-10T07:39:03.007127+0000","last_fullsized":"2024-09-10T07:39:03.007127+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:37.853763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007003+0000","last_change":"2024-09-10T07:39:01.322351+0000","last_active":"2024-09-10T07:39:03.007003+0000","last_peered":"2024-09-10T07:39:03.007003+0000","last_clean":"2024-09-10T07:39:03.007003+0000","last_became_active":"2024-09-10T07:39:01.321049+0000","last_became_peered":"2024-09-10T07:39:01.321049+0000","last_unstale":"2024-09-10T07:39:03.007003+0000","last_undegraded":"2024-09-10T07:39:03.007003+0000","last_fullsized":"2024-09-10T07:39:03.007003+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:10.062192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006607+0000","last_change":"2024-09-10T07:39:00.294447+0000","last_active":"2024-09-10T07:39:03.006607+0000","last_peered":"2024-09-10T07:39:03.006607+0000","last_clean":"2024-09-10T07:39:03.006607+0000","last_became_active":"2024-09-10T07:39:00.294211+0000","last_became_peered":"2024-09-10T07:39:00.294211+0000","last_unstale":"2024-09-10T07:39:03.006607+0000","last_undegraded":"2024-09-10T07:39:03.006607+0000","last_fullsized":"2024-09-10T07:39:03.006607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:33.031311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007092+0000","last_change":"2024-09-10T07:39:01.324709+0000","last_active":"2024-09-10T07:39:03.007092+0000","last_peered":"2024-09-10T07:39:03.007092+0000","last_clean":"2024-09-10T07:39:03.007092+0000","last_became_active":"2024-09-10T07:39:01.322550+0000","last_became_peered":"2024-09-10T07:39:01.322550+0000","last_unstale":"2024-09-10T07:39:03.007092+0000","last_undegraded":"2024-09-10T07:39:03.007092+0000","last_fullsized":"2024-09-10T07:39:03.007092+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:02.097479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326895+0000","last_change":"2024-09-10T07:39:00.303061+0000","last_active":"2024-09-10T07:39:02.326895+0000","last_peered":"2024-09-10T07:39:02.326895+0000","last_clean":"2024-09-10T07:39:02.326895+0000","last_became_active":"2024-09-10T07:39:00.302309+0000","last_became_peered":"2024-09-10T07:39:00.302309+0000","last_unstale":"2024-09-10T07:39:02.326895+0000","last_undegraded":"2024-09-10T07:39:02.326895+0000","last_fullsized":"2024-09-10T07:39:02.326895+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:47.004019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.310210+0000","last_change":"2024-09-10T07:39:01.318458+0000","last_active":"2024-09-10T07:39:02.310210+0000","last_peered":"2024-09-10T07:39:02.310210+0000","last_clean":"2024-09-10T07:39:02.310210+0000","last_became_active":"2024-09-10T07:39:01.318245+0000","last_became_peered":"2024-09-10T07:39:01.318245+0000","last_unstale":"2024-09-10T07:39:02.310210+0000","last_undegraded":"2024-09-10T07:39:02.310210+0000","last_fullsized":"2024-09-10T07:39:02.310210+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:54.926735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326928+0000","last_change":"2024-09-10T07:39:00.306490+0000","last_active":"2024-09-10T07:39:02.326928+0000","last_peered":"2024-09-10T07:39:02.326928+0000","last_clean":"2024-09-10T07:39:02.326928+0000","last_became_active":"2024-09-10T07:39:00.306056+0000","last_became_peered":"2024-09-10T07:39:00.306056+0000","last_unstale":"2024-09-10T07:39:02.326928+0000","last_undegraded":"2024-09-10T07:39:02.326928+0000","last_fullsized":"2024-09-10T07:39:02.326928+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:57.596869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325542+0000","last_change":"2024-09-10T07:39:01.319073+0000","last_active":"2024-09-10T07:39:02.325542+0000","last_peered":"2024-09-10T07:39:02.325542+0000","last_clean":"2024-09-10T07:39:02.325542+0000","last_became_active":"2024-09-10T07:39:01.318540+0000","last_became_peered":"2024-09-10T07:39:01.318540+0000","last_unstale":"2024-09-10T07:39:02.325542+0000","last_undegraded":"2024-09-10T07:39:02.325542+0000","last_fullsized":"2024-09-10T07:39:02.325542+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:26.522789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007317+0000","last_change":"2024-09-10T07:39:00.306915+0000","last_active":"2024-09-10T07:39:03.007317+0000","last_peered":"2024-09-10T07:39:03.007317+0000","last_clean":"2024-09-10T07:39:03.007317+0000","last_became_active":"2024-09-10T07:39:00.306547+0000","last_became_peered":"2024-09-10T07:39:00.306547+0000","last_unstale":"2024-09-10T07:39:03.007317+0000","last_undegraded":"2024-09-10T07:39:03.007317+0000","last_fullsized":"2024-09-10T07:39:03.007317+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:34.533072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007116+0000","last_change":"2024-09-10T07:39:01.314301+0000","last_active":"2024-09-10T07:39:03.007116+0000","last_peered":"2024-09-10T07:39:03.007116+0000","last_clean":"2024-09-10T07:39:03.007116+0000","last_became_active":"2024-09-10T07:39:01.313755+0000","last_became_peered":"2024-09-10T07:39:01.313755+0000","last_unstale":"2024-09-10T07:39:03.007116+0000","last_undegraded":"2024-09-10T07:39:03.007116+0000","last_fullsized":"2024-09-10T07:39:03.007116+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:12:47.465603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006886+0000","last_change":"2024-09-10T07:39:00.293850+0000","last_active":"2024-09-10T07:39:03.006886+0000","last_peered":"2024-09-10T07:39:03.006886+0000","last_clean":"2024-09-10T07:39:03.006886+0000","last_became_active":"2024-09-10T07:39:00.293619+0000","last_became_peered":"2024-09-10T07:39:00.293619+0000","last_unstale":"2024-09-10T07:39:03.006886+0000","last_undegraded":"2024-09-10T07:39:03.006886+0000","last_fullsized":"2024-09-10T07:39:03.006886+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:56.516103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309992+0000","last_change":"2024-09-10T07:39:01.317233+0000","last_active":"2024-09-10T07:39:02.309992+0000","last_peered":"2024-09-10T07:39:02.309992+0000","last_clean":"2024-09-10T07:39:02.309992+0000","last_became_active":"2024-09-10T07:39:01.316894+0000","last_became_peered":"2024-09-10T07:39:01.316894+0000","last_unstale":"2024-09-10T07:39:02.309992+0000","last_undegraded":"2024-09-10T07:39:02.309992+0000","last_fullsized":"2024-09-10T07:39:02.309992+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:11.873625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326954+0000","last_change":"2024-09-10T07:39:00.301830+0000","last_active":"2024-09-10T07:39:02.326954+0000","last_peered":"2024-09-10T07:39:02.326954+0000","last_clean":"2024-09-10T07:39:02.326954+0000","last_became_active":"2024-09-10T07:39:00.301190+0000","last_became_peered":"2024-09-10T07:39:00.301190+0000","last_unstale":"2024-09-10T07:39:02.326954+0000","last_undegraded":"2024-09-10T07:39:02.326954+0000","last_fullsized":"2024-09-10T07:39:02.326954+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:02.114814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305798+0000","last_change":"2024-09-10T07:39:01.313865+0000","last_active":"2024-09-10T07:39:02.305798+0000","last_peered":"2024-09-10T07:39:02.305798+0000","last_clean":"2024-09-10T07:39:02.305798+0000","last_became_active":"2024-09-10T07:39:01.313609+0000","last_became_peered":"2024-09-10T07:39:01.313609+0000","last_unstale":"2024-09-10T07:39:02.305798+0000","last_undegraded":"2024-09-10T07:39:02.305798+0000","last_fullsized":"2024-09-10T07:39:02.305798+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:09.210063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325706+0000","last_change":"2024-09-10T07:39:00.309242+0000","last_active":"2024-09-10T07:39:02.325706+0000","last_peered":"2024-09-10T07:39:02.325706+0000","last_clean":"2024-09-10T07:39:02.325706+0000","last_became_active":"2024-09-10T07:39:00.308832+0000","last_became_peered":"2024-09-10T07:39:00.308832+0000","last_unstale":"2024-09-10T07:39:02.325706+0000","last_undegraded":"2024-09-10T07:39:02.325706+0000","last_fullsized":"2024-09-10T07:39:02.325706+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:26.155917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305933+0000","last_change":"2024-09-10T07:39:01.318243+0000","last_active":"2024-09-10T07:39:02.305933+0000","last_peered":"2024-09-10T07:39:02.305933+0000","last_clean":"2024-09-10T07:39:02.305933+0000","last_became_active":"2024-09-10T07:39:01.317997+0000","last_became_peered":"2024-09-10T07:39:01.317997+0000","last_unstale":"2024-09-10T07:39:02.305933+0000","last_undegraded":"2024-09-10T07:39:02.305933+0000","last_fullsized":"2024-09-10T07:39:02.305933+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:04.113678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007226+0000","last_change":"2024-09-10T07:39:00.303642+0000","last_active":"2024-09-10T07:39:03.007226+0000","last_peered":"2024-09-10T07:39:03.007226+0000","last_clean":"2024-09-10T07:39:03.007226+0000","last_became_active":"2024-09-10T07:39:00.303380+0000","last_became_peered":"2024-09-10T07:39:00.303380+0000","last_unstale":"2024-09-10T07:39:03.007226+0000","last_undegraded":"2024-09-10T07:39:03.007226+0000","last_fullsized":"2024-09-10T07:39:03.007226+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:22.919859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309493+0000","last_change":"2024-09-10T07:39:01.313774+0000","last_active":"2024-09-10T07:39:02.309493+0000","last_peered":"2024-09-10T07:39:02.309493+0000","last_clean":"2024-09-10T07:39:02.309493+0000","last_became_active":"2024-09-10T07:39:01.312817+0000","last_became_peered":"2024-09-10T07:39:01.312817+0000","last_unstale":"2024-09-10T07:39:02.309493+0000","last_undegraded":"2024-09-10T07:39:02.309493+0000","last_fullsized":"2024-09-10T07:39:02.309493+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:38.303795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006781+0000","last_change":"2024-09-10T07:39:00.305925+0000","last_active":"2024-09-10T07:39:03.006781+0000","last_peered":"2024-09-10T07:39:03.006781+0000","last_clean":"2024-09-10T07:39:03.006781+0000","last_became_active":"2024-09-10T07:39:00.305693+0000","last_became_peered":"2024-09-10T07:39:00.305693+0000","last_unstale":"2024-09-10T07:39:03.006781+0000","last_undegraded":"2024-09-10T07:39:03.006781+0000","last_fullsized":"2024-09-10T07:39:03.006781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:46.132691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326532+0000","last_change":"2024-09-10T07:39:01.325368+0000","last_active":"2024-09-10T07:39:02.326532+0000","last_peered":"2024-09-10T07:39:02.326532+0000","last_clean":"2024-09-10T07:39:02.326532+0000","last_became_active":"2024-09-10T07:39:01.325168+0000","last_became_peered":"2024-09-10T07:39:01.325168+0000","last_unstale":"2024-09-10T07:39:02.326532+0000","last_undegraded":"2024-09-10T07:39:02.326532+0000","last_fullsized":"2024-09-10T07:39:02.326532+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:44.797021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"100'3","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007413+0000","last_change":"2024-09-10T07:39:00.307132+0000","last_active":"2024-09-10T07:39:03.007413+0000","last_peered":"2024-09-10T07:39:03.007413+0000","last_clean":"2024-09-10T07:39:03.007413+0000","last_became_active":"2024-09-10T07:39:00.305640+0000","last_became_peered":"2024-09-10T07:39:00.305640+0000","last_unstale":"2024-09-10T07:39:03.007413+0000","last_undegraded":"2024-09-10T07:39:03.007413+0000","last_fullsized":"2024-09-10T07:39:03.007413+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:17.730519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006614+0000","last_change":"2024-09-10T07:39:01.312688+0000","last_active":"2024-09-10T07:39:03.006614+0000","last_peered":"2024-09-10T07:39:03.006614+0000","last_clean":"2024-09-10T07:39:03.006614+0000","last_became_active":"2024-09-10T07:39:01.312342+0000","last_became_peered":"2024-09-10T07:39:01.312342+0000","last_unstale":"2024-09-10T07:39:03.006614+0000","last_undegraded":"2024-09-10T07:39:03.006614+0000","last_fullsized":"2024-09-10T07:39:03.006614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:17.289866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"100'6","reported_seq":20,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309116+0000","last_change":"2024-09-10T07:39:00.297377+0000","last_active":"2024-09-10T07:39:02.309116+0000","last_peered":"2024-09-10T07:39:02.309116+0000","last_clean":"2024-09-10T07:39:02.309116+0000","last_became_active":"2024-09-10T07:39:00.296688+0000","last_became_peered":"2024-09-10T07:39:00.296688+0000","last_unstale":"2024-09-10T07:39:02.309116+0000","last_undegraded":"2024-09-10T07:39:02.309116+0000","last_fullsized":"2024-09-10T07:39:02.309116+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:43.771253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326677+0000","last_change":"2024-09-10T07:39:01.313094+0000","last_active":"2024-09-10T07:39:02.326677+0000","last_peered":"2024-09-10T07:39:02.326677+0000","last_clean":"2024-09-10T07:39:02.326677+0000","last_became_active":"2024-09-10T07:39:01.312447+0000","last_became_peered":"2024-09-10T07:39:01.312447+0000","last_unstale":"2024-09-10T07:39:02.326677+0000","last_undegraded":"2024-09-10T07:39:02.326677+0000","last_fullsized":"2024-09-10T07:39:02.326677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:31.843917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325797+0000","last_change":"2024-09-10T07:39:00.309058+0000","last_active":"2024-09-10T07:39:02.325797+0000","last_peered":"2024-09-10T07:39:02.325797+0000","last_clean":"2024-09-10T07:39:02.325797+0000","last_became_active":"2024-09-10T07:39:00.308545+0000","last_became_peered":"2024-09-10T07:39:00.308545+0000","last_unstale":"2024-09-10T07:39:02.325797+0000","last_undegraded":"2024-09-10T07:39:02.325797+0000","last_fullsized":"2024-09-10T07:39:02.325797+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:32.219839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.310113+0000","last_change":"2024-09-10T07:39:01.321282+0000","last_active":"2024-09-10T07:39:02.310113+0000","last_peered":"2024-09-10T07:39:02.310113+0000","last_clean":"2024-09-10T07:39:02.310113+0000","last_became_active":"2024-09-10T07:39:01.320996+0000","last_became_peered":"2024-09-10T07:39:01.320996+0000","last_unstale":"2024-09-10T07:39:02.310113+0000","last_undegraded":"2024-09-10T07:39:02.310113+0000","last_fullsized":"2024-09-10T07:39:02.310113+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:15.891701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305831+0000","last_change":"2024-09-10T07:39:00.305145+0000","last_active":"2024-09-10T07:39:02.305831+0000","last_peered":"2024-09-10T07:39:02.305831+0000","last_clean":"2024-09-10T07:39:02.305831+0000","last_became_active":"2024-09-10T07:39:00.304902+0000","last_became_peered":"2024-09-10T07:39:00.304902+0000","last_unstale":"2024-09-10T07:39:02.305831+0000","last_undegraded":"2024-09-10T07:39:02.305831+0000","last_fullsized":"2024-09-10T07:39:02.305831+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:01.016242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325388+0000","last_change":"2024-09-10T07:39:01.319278+0000","last_active":"2024-09-10T07:39:02.325388+0000","last_peered":"2024-09-10T07:39:02.325388+0000","last_clean":"2024-09-10T07:39:02.325388+0000","last_became_active":"2024-09-10T07:39:01.318844+0000","last_became_peered":"2024-09-10T07:39:01.318844+0000","last_unstale":"2024-09-10T07:39:02.325388+0000","last_undegraded":"2024-09-10T07:39:02.325388+0000","last_fullsized":"2024-09-10T07:39:02.325388+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:32.221158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309209+0000","last_change":"2024-09-10T07:39:00.300406+0000","last_active":"2024-09-10T07:39:02.309209+0000","last_peered":"2024-09-10T07:39:02.309209+0000","last_clean":"2024-09-10T07:39:02.309209+0000","last_became_active":"2024-09-10T07:39:00.298658+0000","last_became_peered":"2024-09-10T07:39:00.298658+0000","last_unstale":"2024-09-10T07:39:02.309209+0000","last_undegraded":"2024-09-10T07:39:02.309209+0000","last_fullsized":"2024-09-10T07:39:02.309209+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:20.444903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325636+0000","last_change":"2024-09-10T07:39:01.325205+0000","last_active":"2024-09-10T07:39:02.325636+0000","last_peered":"2024-09-10T07:39:02.325636+0000","last_clean":"2024-09-10T07:39:02.325636+0000","last_became_active":"2024-09-10T07:39:01.324394+0000","last_became_peered":"2024-09-10T07:39:01.324394+0000","last_unstale":"2024-09-10T07:39:02.325636+0000","last_undegraded":"2024-09-10T07:39:02.325636+0000","last_fullsized":"2024-09-10T07:39:02.325636+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:21.746308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"100'8","reported_seq":22,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326722+0000","last_change":"2024-09-10T07:39:00.309068+0000","last_active":"2024-09-10T07:39:02.326722+0000","last_peered":"2024-09-10T07:39:02.326722+0000","last_clean":"2024-09-10T07:39:02.326722+0000","last_became_active":"2024-09-10T07:39:00.308231+0000","last_became_peered":"2024-09-10T07:39:00.308231+0000","last_unstale":"2024-09-10T07:39:02.326722+0000","last_undegraded":"2024-09-10T07:39:02.326722+0000","last_fullsized":"2024-09-10T07:39:02.326722+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:16.617408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.310291+0000","last_change":"2024-09-10T07:39:01.318970+0000","last_active":"2024-09-10T07:39:02.310291+0000","last_peered":"2024-09-10T07:39:02.310291+0000","last_clean":"2024-09-10T07:39:02.310291+0000","last_became_active":"2024-09-10T07:39:01.318748+0000","last_became_peered":"2024-09-10T07:39:01.318748+0000","last_unstale":"2024-09-10T07:39:02.310291+0000","last_undegraded":"2024-09-10T07:39:02.310291+0000","last_fullsized":"2024-09-10T07:39:02.310291+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:02.710545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006527+0000","last_change":"2024-09-10T07:39:00.307865+0000","last_active":"2024-09-10T07:39:03.006527+0000","last_peered":"2024-09-10T07:39:03.006527+0000","last_clean":"2024-09-10T07:39:03.006527+0000","last_became_active":"2024-09-10T07:39:00.307627+0000","last_became_peered":"2024-09-10T07:39:00.307627+0000","last_unstale":"2024-09-10T07:39:03.006527+0000","last_undegraded":"2024-09-10T07:39:03.006527+0000","last_fullsized":"2024-09-10T07:39:03.006527+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:05.291881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006277+0000","last_change":"2024-09-10T07:39:01.324223+0000","last_active":"2024-09-10T07:39:03.006277+0000","last_peered":"2024-09-10T07:39:03.006277+0000","last_clean":"2024-09-10T07:39:03.006277+0000","last_became_active":"2024-09-10T07:39:01.323967+0000","last_became_peered":"2024-09-10T07:39:01.323967+0000","last_unstale":"2024-09-10T07:39:03.006277+0000","last_undegraded":"2024-09-10T07:39:03.006277+0000","last_fullsized":"2024-09-10T07:39:03.006277+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:21.467018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326987+0000","last_change":"2024-09-10T07:39:00.299765+0000","last_active":"2024-09-10T07:39:02.326987+0000","last_peered":"2024-09-10T07:39:02.326987+0000","last_clean":"2024-09-10T07:39:02.326987+0000","last_became_active":"2024-09-10T07:39:00.299542+0000","last_became_peered":"2024-09-10T07:39:00.299542+0000","last_unstale":"2024-09-10T07:39:02.326987+0000","last_undegraded":"2024-09-10T07:39:02.326987+0000","last_fullsized":"2024-09-10T07:39:02.326987+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:45:23.511155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007461+0000","last_change":"2024-09-10T07:39:01.320190+0000","last_active":"2024-09-10T07:39:03.007461+0000","last_peered":"2024-09-10T07:39:03.007461+0000","last_clean":"2024-09-10T07:39:03.007461+0000","last_became_active":"2024-09-10T07:39:01.319885+0000","last_became_peered":"2024-09-10T07:39:01.319885+0000","last_unstale":"2024-09-10T07:39:03.007461+0000","last_undegraded":"2024-09-10T07:39:03.007461+0000","last_fullsized":"2024-09-10T07:39:03.007461+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:38.588877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326563+0000","last_change":"2024-09-10T07:39:00.299537+0000","last_active":"2024-09-10T07:39:02.326563+0000","last_peered":"2024-09-10T07:39:02.326563+0000","last_clean":"2024-09-10T07:39:02.326563+0000","last_became_active":"2024-09-10T07:39:00.299116+0000","last_became_peered":"2024-09-10T07:39:00.299116+0000","last_unstale":"2024-09-10T07:39:02.326563+0000","last_undegraded":"2024-09-10T07:39:02.326563+0000","last_fullsized":"2024-09-10T07:39:02.326563+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:29.415024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006387+0000","last_change":"2024-09-10T07:39:01.319683+0000","last_active":"2024-09-10T07:39:03.006387+0000","last_peered":"2024-09-10T07:39:03.006387+0000","last_clean":"2024-09-10T07:39:03.006387+0000","last_became_active":"2024-09-10T07:39:01.318772+0000","last_became_peered":"2024-09-10T07:39:01.318772+0000","last_unstale":"2024-09-10T07:39:03.006387+0000","last_undegraded":"2024-09-10T07:39:03.006387+0000","last_fullsized":"2024-09-10T07:39:03.006387+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:15.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305845+0000","last_change":"2024-09-10T07:39:00.299710+0000","last_active":"2024-09-10T07:39:02.305845+0000","last_peered":"2024-09-10T07:39:02.305845+0000","last_clean":"2024-09-10T07:39:02.305845+0000","last_became_active":"2024-09-10T07:39:00.299480+0000","last_became_peered":"2024-09-10T07:39:00.299480+0000","last_unstale":"2024-09-10T07:39:02.305845+0000","last_undegraded":"2024-09-10T07:39:02.305845+0000","last_fullsized":"2024-09-10T07:39:02.305845+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:48:19.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309173+0000","last_change":"2024-09-10T07:39:01.316497+0000","last_active":"2024-09-10T07:39:02.309173+0000","last_peered":"2024-09-10T07:39:02.309173+0000","last_clean":"2024-09-10T07:39:02.309173+0000","last_became_active":"2024-09-10T07:39:01.312685+0000","last_became_peered":"2024-09-10T07:39:01.312685+0000","last_unstale":"2024-09-10T07:39:02.309173+0000","last_undegraded":"2024-09-10T07:39:02.309173+0000","last_fullsized":"2024-09-10T07:39:02.309173+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:43.625289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006482+0000","last_change":"2024-09-10T07:39:00.303261+0000","last_active":"2024-09-10T07:39:03.006482+0000","last_peered":"2024-09-10T07:39:03.006482+0000","last_clean":"2024-09-10T07:39:03.006482+0000","last_became_active":"2024-09-10T07:39:00.303022+0000","last_became_peered":"2024-09-10T07:39:00.303022+0000","last_unstale":"2024-09-10T07:39:03.006482+0000","last_undegraded":"2024-09-10T07:39:03.006482+0000","last_fullsized":"2024-09-10T07:39:03.006482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:13.408950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006233+0000","last_change":"2024-09-10T07:39:01.312999+0000","last_active":"2024-09-10T07:39:03.006233+0000","last_peered":"2024-09-10T07:39:03.006233+0000","last_clean":"2024-09-10T07:39:03.006233+0000","last_became_active":"2024-09-10T07:39:01.312767+0000","last_became_peered":"2024-09-10T07:39:01.312767+0000","last_unstale":"2024-09-10T07:39:03.006233+0000","last_undegraded":"2024-09-10T07:39:03.006233+0000","last_fullsized":"2024-09-10T07:39:03.006233+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:11.181732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006464+0000","last_change":"2024-09-10T07:39:00.307493+0000","last_active":"2024-09-10T07:39:03.006464+0000","last_peered":"2024-09-10T07:39:03.006464+0000","last_clean":"2024-09-10T07:39:03.006464+0000","last_became_active":"2024-09-10T07:39:00.307065+0000","last_became_peered":"2024-09-10T07:39:00.307065+0000","last_unstale":"2024-09-10T07:39:03.006464+0000","last_undegraded":"2024-09-10T07:39:03.006464+0000","last_fullsized":"2024-09-10T07:39:03.006464+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:07.543638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309409+0000","last_change":"2024-09-10T07:39:01.315543+0000","last_active":"2024-09-10T07:39:02.309409+0000","last_peered":"2024-09-10T07:39:02.309409+0000","last_clean":"2024-09-10T07:39:02.309409+0000","last_became_active":"2024-09-10T07:39:01.314429+0000","last_became_peered":"2024-09-10T07:39:01.314429+0000","last_unstale":"2024-09-10T07:39:02.309409+0000","last_undegraded":"2024-09-10T07:39:02.309409+0000","last_fullsized":"2024-09-10T07:39:02.309409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:13.726990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305959+0000","last_change":"2024-09-10T07:39:00.303081+0000","last_active":"2024-09-10T07:39:02.305959+0000","last_peered":"2024-09-10T07:39:02.305959+0000","last_clean":"2024-09-10T07:39:02.305959+0000","last_became_active":"2024-09-10T07:39:00.302788+0000","last_became_peered":"2024-09-10T07:39:00.302788+0000","last_unstale":"2024-09-10T07:39:02.305959+0000","last_undegraded":"2024-09-10T07:39:02.305959+0000","last_fullsized":"2024-09-10T07:39:02.305959+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:50.697795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006775+0000","last_change":"2024-09-10T07:39:01.318088+0000","last_active":"2024-09-10T07:39:03.006775+0000","last_peered":"2024-09-10T07:39:03.006775+0000","last_clean":"2024-09-10T07:39:03.006775+0000","last_became_active":"2024-09-10T07:39:01.317076+0000","last_became_peered":"2024-09-10T07:39:01.317076+0000","last_unstale":"2024-09-10T07:39:03.006775+0000","last_undegraded":"2024-09-10T07:39:03.006775+0000","last_fullsized":"2024-09-10T07:39:03.006775+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:31.053527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325911+0000","last_change":"2024-09-10T07:39:00.306764+0000","last_active":"2024-09-10T07:39:02.325911+0000","last_peered":"2024-09-10T07:39:02.325911+0000","last_clean":"2024-09-10T07:39:02.325911+0000","last_became_active":"2024-09-10T07:39:00.306414+0000","last_became_peered":"2024-09-10T07:39:00.306414+0000","last_unstale":"2024-09-10T07:39:02.325911+0000","last_undegraded":"2024-09-10T07:39:02.325911+0000","last_fullsized":"2024-09-10T07:39:02.325911+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:17.902037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309979+0000","last_change":"2024-09-10T07:39:01.327102+0000","last_active":"2024-09-10T07:39:02.309979+0000","last_peered":"2024-09-10T07:39:02.309979+0000","last_clean":"2024-09-10T07:39:02.309979+0000","last_became_active":"2024-09-10T07:39:01.326879+0000","last_became_peered":"2024-09-10T07:39:01.326879+0000","last_unstale":"2024-09-10T07:39:02.309979+0000","last_undegraded":"2024-09-10T07:39:02.309979+0000","last_fullsized":"2024-09-10T07:39:02.309979+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:56.312590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"101'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326819+0000","last_change":"2024-09-10T07:39:00.308218+0000","last_active":"2024-09-10T07:39:02.326819+0000","last_peered":"2024-09-10T07:39:02.326819+0000","last_clean":"2024-09-10T07:39:02.326819+0000","last_became_active":"2024-09-10T07:39:00.307782+0000","last_became_peered":"2024-09-10T07:39:00.307782+0000","last_unstale":"2024-09-10T07:39:02.326819+0000","last_undegraded":"2024-09-10T07:39:02.326819+0000","last_fullsized":"2024-09-10T07:39:02.326819+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:48.192359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007143+0000","last_change":"2024-09-10T07:39:01.320900+0000","last_active":"2024-09-10T07:39:03.007143+0000","last_peered":"2024-09-10T07:39:03.007143+0000","last_clean":"2024-09-10T07:39:03.007143+0000","last_became_active":"2024-09-10T07:39:01.320332+0000","last_became_peered":"2024-09-10T07:39:01.320332+0000","last_unstale":"2024-09-10T07:39:03.007143+0000","last_undegraded":"2024-09-10T07:39:03.007143+0000","last_fullsized":"2024-09-10T07:39:03.007143+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:22.288648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006624+0000","last_change":"2024-09-10T07:39:00.303075+0000","last_active":"2024-09-10T07:39:03.006624+0000","last_peered":"2024-09-10T07:39:03.006624+0000","last_clean":"2024-09-10T07:39:03.006624+0000","last_became_active":"2024-09-10T07:39:00.302780+0000","last_became_peered":"2024-09-10T07:39:00.302780+0000","last_unstale":"2024-09-10T07:39:03.006624+0000","last_undegraded":"2024-09-10T07:39:03.006624+0000","last_fullsized":"2024-09-10T07:39:03.006624+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:39.804301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006484+0000","last_change":"2024-09-10T07:39:01.311130+0000","last_active":"2024-09-10T07:39:03.006484+0000","last_peered":"2024-09-10T07:39:03.006484+0000","last_clean":"2024-09-10T07:39:03.006484+0000","last_became_active":"2024-09-10T07:39:01.310889+0000","last_became_peered":"2024-09-10T07:39:01.310889+0000","last_unstale":"2024-09-10T07:39:03.006484+0000","last_undegraded":"2024-09-10T07:39:03.006484+0000","last_fullsized":"2024-09-10T07:39:03.006484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:49.798948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007270+0000","last_change":"2024-09-10T07:39:00.303840+0000","last_active":"2024-09-10T07:39:03.007270+0000","last_peered":"2024-09-10T07:39:03.007270+0000","last_clean":"2024-09-10T07:39:03.007270+0000","last_became_active":"2024-09-10T07:39:00.303435+0000","last_became_peered":"2024-09-10T07:39:00.303435+0000","last_unstale":"2024-09-10T07:39:03.007270+0000","last_undegraded":"2024-09-10T07:39:03.007270+0000","last_fullsized":"2024-09-10T07:39:03.007270+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:48.649836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309089+0000","last_change":"2024-09-10T07:39:01.316064+0000","last_active":"2024-09-10T07:39:02.309089+0000","last_peered":"2024-09-10T07:39:02.309089+0000","last_clean":"2024-09-10T07:39:02.309089+0000","last_became_active":"2024-09-10T07:39:01.315816+0000","last_became_peered":"2024-09-10T07:39:01.315816+0000","last_unstale":"2024-09-10T07:39:02.309089+0000","last_undegraded":"2024-09-10T07:39:02.309089+0000","last_fullsized":"2024-09-10T07:39:02.309089+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:44.389268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326999+0000","last_change":"2024-09-10T07:39:00.306282+0000","last_active":"2024-09-10T07:39:02.326999+0000","last_peered":"2024-09-10T07:39:02.326999+0000","last_clean":"2024-09-10T07:39:02.326999+0000","last_became_active":"2024-09-10T07:39:00.305742+0000","last_became_peered":"2024-09-10T07:39:00.305742+0000","last_unstale":"2024-09-10T07:39:02.326999+0000","last_undegraded":"2024-09-10T07:39:02.326999+0000","last_fullsized":"2024-09-10T07:39:02.326999+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:35.139749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326826+0000","last_change":"2024-09-10T07:39:01.313309+0000","last_active":"2024-09-10T07:39:02.326826+0000","last_peered":"2024-09-10T07:39:02.326826+0000","last_clean":"2024-09-10T07:39:02.326826+0000","last_became_active":"2024-09-10T07:39:01.312784+0000","last_became_peered":"2024-09-10T07:39:01.312784+0000","last_unstale":"2024-09-10T07:39:02.326826+0000","last_undegraded":"2024-09-10T07:39:02.326826+0000","last_fullsized":"2024-09-10T07:39:02.326826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:43.945413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007569+0000","last_change":"2024-09-10T07:39:00.298968+0000","last_active":"2024-09-10T07:39:03.007569+0000","last_peered":"2024-09-10T07:39:03.007569+0000","last_clean":"2024-09-10T07:39:03.007569+0000","last_became_active":"2024-09-10T07:39:00.298707+0000","last_became_peered":"2024-09-10T07:39:00.298707+0000","last_unstale":"2024-09-10T07:39:03.007569+0000","last_undegraded":"2024-09-10T07:39:03.007569+0000","last_fullsized":"2024-09-10T07:39:03.007569+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:26.058791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309330+0000","last_change":"2024-09-10T07:39:01.325638+0000","last_active":"2024-09-10T07:39:02.309330+0000","last_peered":"2024-09-10T07:39:02.309330+0000","last_clean":"2024-09-10T07:39:02.309330+0000","last_became_active":"2024-09-10T07:39:01.325259+0000","last_became_peered":"2024-09-10T07:39:01.325259+0000","last_unstale":"2024-09-10T07:39:02.309330+0000","last_undegraded":"2024-09-10T07:39:02.309330+0000","last_fullsized":"2024-09-10T07:39:02.309330+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:59.597768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007512+0000","last_change":"2024-09-10T07:39:00.303134+0000","last_active":"2024-09-10T07:39:03.007512+0000","last_peered":"2024-09-10T07:39:03.007512+0000","last_clean":"2024-09-10T07:39:03.007512+0000","last_became_active":"2024-09-10T07:39:00.302504+0000","last_became_peered":"2024-09-10T07:39:00.302504+0000","last_unstale":"2024-09-10T07:39:03.007512+0000","last_undegraded":"2024-09-10T07:39:03.007512+0000","last_fullsized":"2024-09-10T07:39:03.007512+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:36.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007307+0000","last_change":"2024-09-10T07:39:01.322126+0000","last_active":"2024-09-10T07:39:03.007307+0000","last_peered":"2024-09-10T07:39:03.007307+0000","last_clean":"2024-09-10T07:39:03.007307+0000","last_became_active":"2024-09-10T07:39:01.320788+0000","last_became_peered":"2024-09-10T07:39:01.320788+0000","last_unstale":"2024-09-10T07:39:03.007307+0000","last_undegraded":"2024-09-10T07:39:03.007307+0000","last_fullsized":"2024-09-10T07:39:03.007307+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:32.471954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006717+0000","last_change":"2024-09-10T07:39:00.305818+0000","last_active":"2024-09-10T07:39:03.006717+0000","last_peered":"2024-09-10T07:39:03.006717+0000","last_clean":"2024-09-10T07:39:03.006717+0000","last_became_active":"2024-09-10T07:39:00.305607+0000","last_became_peered":"2024-09-10T07:39:00.305607+0000","last_unstale":"2024-09-10T07:39:03.006717+0000","last_undegraded":"2024-09-10T07:39:03.006717+0000","last_fullsized":"2024-09-10T07:39:03.006717+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:08.924902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325824+0000","last_change":"2024-09-10T07:39:01.323834+0000","last_active":"2024-09-10T07:39:02.325824+0000","last_peered":"2024-09-10T07:39:02.325824+0000","last_clean":"2024-09-10T07:39:02.325824+0000","last_became_active":"2024-09-10T07:39:01.323565+0000","last_became_peered":"2024-09-10T07:39:01.323565+0000","last_unstale":"2024-09-10T07:39:02.325824+0000","last_undegraded":"2024-09-10T07:39:02.325824+0000","last_fullsized":"2024-09-10T07:39:02.325824+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:38.181675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309851+0000","last_change":"2024-09-10T07:39:00.306783+0000","last_active":"2024-09-10T07:39:02.309851+0000","last_peered":"2024-09-10T07:39:02.309851+0000","last_clean":"2024-09-10T07:39:02.309851+0000","last_became_active":"2024-09-10T07:39:00.306514+0000","last_became_peered":"2024-09-10T07:39:00.306514+0000","last_unstale":"2024-09-10T07:39:02.309851+0000","last_undegraded":"2024-09-10T07:39:02.309851+0000","last_fullsized":"2024-09-10T07:39:02.309851+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:43.789537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":330,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309392+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:39:02.309392+0000","last_peered":"2024-09-10T07:39:02.309392+0000","last_clean":"2024-09-10T07:39:02.309392+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:39:02.309392+0000","last_undegraded":"2024-09-10T07:39:02.309392+0000","last_fullsized":"2024-09-10T07:39:02.309392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:00.501878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194200,"statfs":{"total":200000000,"available":198861415,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194775,"statfs":{"total":200000000,"available":199450219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194783,"statfs":{"total":200000000,"available":199458153,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194775,"statfs":{"total":200000000,"available":199450241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199451271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194777,"statfs":{"total":200000000,"available":199451659,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194200,"statfs":{"total":200000000,"available":198861451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:39:05.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:39:05.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.672+0000 7f7efb000640 1 Processor -- start 2024-09-10T07:39:05.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.673+0000 7f7efb000640 1 -- start start 2024-09-10T07:39:05.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.674+0000 7f7efb000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7ef4070b40 0x7f7ef40b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.674+0000 7f7efb000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef40d3230 0x7f7ef40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.674+0000 7f7efb000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef40d3710 con 0x7f7ef415eab0 2024-09-10T07:39:05.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.674+0000 7f7efb000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef40b6390 con 0x7f7ef4070b40 2024-09-10T07:39:05.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.674+0000 7f7efb000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef40b6670 con 0x7f7ef40d3230 2024-09-10T07:39:05.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.674+0000 7f7ef9c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7ef415eab0 0x7f7ef406cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58364/0 (socket says 172.21.15.99:58364) 2024-09-10T07:39:05.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.674+0000 7f7ef9c00640 1 -- 172.21.15.99:0/3412277832 learned_addr learned my addr 172.21.15.99:0/3412277832 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:05.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.674+0000 7f7efa600640 1 --2- 172.21.15.99:0/3412277832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef40d3230 0x7f7ef40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.674+0000 7f7ef9200640 1 --2- 172.21.15.99:0/3412277832 >> v2:172.21.15.187:3300/0 conn(0x7f7ef4070b40 0x7f7ef40b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.675+0000 7f7ef3e00640 1 -- 172.21.15.99:0/3412277832 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187930003 0 0) 0x7f7ef40d3710 con 0x7f7ef415eab0 2024-09-10T07:39:05.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.675+0000 7f7ef3e00640 1 -- 172.21.15.99:0/3412277832 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7edc003520 con 0x7f7ef415eab0 2024-09-10T07:39:05.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.675+0000 7f7ef9200640 1 -- 172.21.15.99:0/3412277832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef40d3230 msgr2=0x7f7ef40b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:05.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.675+0000 7f7ef9200640 1 --2- 172.21.15.99:0/3412277832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef40d3230 0x7f7ef40b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.675+0000 7f7ef9200640 1 -- 172.21.15.99:0/3412277832 >> v1:172.21.15.99:6789/0 conn(0x7f7ef415eab0 legacy=0x7f7ef406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.675+0000 7f7ef9200640 1 -- 172.21.15.99:0/3412277832 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef40b6950 con 0x7f7ef4070b40 2024-09-10T07:39:05.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.675+0000 7f7efa600640 1 --2- 172.21.15.99:0/3412277832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef40d3230 0x7f7ef40b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.676+0000 7f7ef9200640 1 --2- 172.21.15.99:0/3412277832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ef4070b40 0x7f7ef40b1c40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00097a0 tx=0x7f7ee002a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef529238eeb53719 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.676+0000 7f7ef3e00640 1 -- 172.21.15.99:0/3412277832 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0037070 con 0x7f7ef4070b40 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.676+0000 7f7ef3e00640 1 -- 172.21.15.99:0/3412277832 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee002ae40 con 0x7f7ef4070b40 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.676+0000 7f7ef3e00640 1 -- 172.21.15.99:0/3412277832 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0032660 con 0x7f7ef4070b40 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.677+0000 7f7efb000640 1 -- 172.21.15.99:0/3412277832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ef4070b40 msgr2=0x7f7ef40b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.677+0000 7f7efb000640 1 --2- 172.21.15.99:0/3412277832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ef4070b40 0x7f7ef40b1c40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00097a0 tx=0x7f7ee002a0f0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.677+0000 7f7efb000640 1 -- 172.21.15.99:0/3412277832 shutdown_connections 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.677+0000 7f7efb000640 1 --2- 172.21.15.99:0/3412277832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef40d3230 0x7f7ef40b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.677+0000 7f7efb000640 1 --2- 172.21.15.99:0/3412277832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ef4070b40 0x7f7ef40b1c40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.677+0000 7f7efb000640 1 -- 172.21.15.99:0/3412277832 >> 172.21.15.99:0/3412277832 conn(0x7f7ef40b7cc0 msgr2=0x7f7ef40b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.677+0000 7f7efb000640 1 -- 172.21.15.99:0/3412277832 shutdown_connections 2024-09-10T07:39:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.677+0000 7f7efb000640 1 -- 172.21.15.99:0/3412277832 wait complete. 2024-09-10T07:39:05.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.678+0000 7f7efb000640 1 Processor -- start 2024-09-10T07:39:05.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.679+0000 7f7efb000640 1 -- start start 2024-09-10T07:39:05.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.679+0000 7f7efb000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ef4070b40 0x7f7ef40a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.679+0000 7f7efb000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ef40d3230 0x7f7ef4151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.679+0000 7f7efb000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef415eab0 0x7f7ef40b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7efb000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef415ee90 con 0x7f7ef40d3230 2024-09-10T07:39:05.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7efb000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef406d430 con 0x7f7ef4070b40 2024-09-10T07:39:05.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7efb000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef4152b50 con 0x7f7ef415eab0 2024-09-10T07:39:05.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7ef9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ef40d3230 0x7f7ef4151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7ef9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ef40d3230 0x7f7ef4151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40584/0 (socket says 172.21.15.99:40584) 2024-09-10T07:39:05.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7ef9200640 1 -- 172.21.15.99:0/2098062472 learned_addr learned my addr 172.21.15.99:0/2098062472 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:05.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7ef9c00640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ef4070b40 0x7f7ef40a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7efa600640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef415eab0 0x7f7ef40b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7ef9200640 1 -- 172.21.15.99:0/2098062472 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef415eab0 msgr2=0x7f7ef40b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7ef9200640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef415eab0 0x7f7ef40b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7ef9200640 1 -- 172.21.15.99:0/2098062472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ef4070b40 msgr2=0x7f7ef40a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7ef9200640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ef4070b40 0x7f7ef40a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.680+0000 7f7ef9200640 1 -- 172.21.15.99:0/2098062472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef4151e90 con 0x7f7ef40d3230 2024-09-10T07:39:05.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.681+0000 7f7ef9200640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ef40d3230 0x7f7ef4151950 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0035040 tx=0x7f7ee00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.681+0000 7f7ef1600640 1 -- 172.21.15.99:0/2098062472 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0041070 con 0x7f7ef40d3230 2024-09-10T07:39:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.681+0000 7f7ef1600640 1 -- 172.21.15.99:0/2098062472 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee003c460 con 0x7f7ef40d3230 2024-09-10T07:39:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.681+0000 7f7ef1600640 1 -- 172.21.15.99:0/2098062472 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0037040 con 0x7f7ef40d3230 2024-09-10T07:39:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.681+0000 7f7efb000640 1 -- 172.21.15.99:0/2098062472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef40b0f80 con 0x7f7ef40d3230 2024-09-10T07:39:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.681+0000 7f7efb000640 1 -- 172.21.15.99:0/2098062472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef40b1540 con 0x7f7ef40d3230 2024-09-10T07:39:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.682+0000 7f7efb000640 1 -- 172.21.15.99:0/2098062472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef406c740 con 0x7f7ef40d3230 2024-09-10T07:39:05.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.683+0000 7f7ef1600640 1 -- 172.21.15.99:0/2098062472 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ee003a070 con 0x7f7ef40d3230 2024-09-10T07:39:05.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.684+0000 7f7ef1600640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ed406be30 0x7f7ed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:05.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.684+0000 7f7ef1600640 1 -- 172.21.15.99:0/2098062472 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f7ee00aaf40 con 0x7f7ef40d3230 2024-09-10T07:39:05.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.684+0000 7f7ef9c00640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ed406be30 0x7f7ed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:05.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.685+0000 7f7ef9c00640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ed406be30 0x7f7ed406e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8005c00 tx=0x7f7ee8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:05.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.689+0000 7f7ef1600640 1 -- 172.21.15.99:0/2098062472 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ef406c740 con 0x7f7ef40d3230 2024-09-10T07:39:05.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.859+0000 7f7efb000640 1 -- 172.21.15.99:0/2098062472 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ef4074120 con 0x7f7ed406be30 2024-09-10T07:39:05.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.865+0000 7f7ef1600640 1 -- 172.21.15.99:0/2098062472 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247768 (secure 0 0 0) 0x7f7ef4074120 con 0x7f7ed406be30 2024-09-10T07:39:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:05.869 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 -- 172.21.15.99:0/2098062472 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ed406be30 msgr2=0x7f7ed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ed406be30 0x7f7ed406e2f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8005c00 tx=0x7f7ee8009040 comp rx=0 tx=0).stop 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 -- 172.21.15.99:0/2098062472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ef40d3230 msgr2=0x7f7ef4151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ef40d3230 0x7f7ef4151950 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0035040 tx=0x7f7ee00046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 -- 172.21.15.99:0/2098062472 shutdown_connections 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ef415eab0 0x7f7ef40b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ed406be30 0x7f7ed406e2f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ef40d3230 0x7f7ef4151950 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 --2- 172.21.15.99:0/2098062472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ef4070b40 0x7f7ef40a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 -- 172.21.15.99:0/2098062472 >> 172.21.15.99:0/2098062472 conn(0x7f7ef40b7cc0 msgr2=0x7f7ef415d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:05.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 -- 172.21.15.99:0/2098062472 shutdown_connections 2024-09-10T07:39:05.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:05.869+0000 7f7efb000640 1 -- 172.21.15.99:0/2098062472 wait complete. 2024-09-10T07:39:05.885 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2024-09-10T07:39:04.754853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557072,"statfs":{"total":1600000000,"available":1594441868,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.467474"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006925+0000","last_change":"2024-09-10T07:39:01.324499+0000","last_active":"2024-09-10T07:39:03.006925+0000","last_peered":"2024-09-10T07:39:03.006925+0000","last_clean":"2024-09-10T07:39:03.006925+0000","last_became_active":"2024-09-10T07:39:01.322161+0000","last_became_peered":"2024-09-10T07:39:01.322161+0000","last_unstale":"2024-09-10T07:39:03.006925+0000","last_undegraded":"2024-09-10T07:39:03.006925+0000","last_fullsized":"2024-09-10T07:39:03.006925+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:17.593202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325360+0000","last_change":"2024-09-10T07:39:01.325516+0000","last_active":"2024-09-10T07:39:02.325360+0000","last_peered":"2024-09-10T07:39:02.325360+0000","last_clean":"2024-09-10T07:39:02.325360+0000","last_became_active":"2024-09-10T07:39:01.324717+0000","last_became_peered":"2024-09-10T07:39:01.324717+0000","last_unstale":"2024-09-10T07:39:02.325360+0000","last_undegraded":"2024-09-10T07:39:02.325360+0000","last_fullsized":"2024-09-10T07:39:02.325360+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:38.930884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309385+0000","last_change":"2024-09-10T07:39:01.324480+0000","last_active":"2024-09-10T07:39:02.309385+0000","last_peered":"2024-09-10T07:39:02.309385+0000","last_clean":"2024-09-10T07:39:02.309385+0000","last_became_active":"2024-09-10T07:39:01.324254+0000","last_became_peered":"2024-09-10T07:39:01.324254+0000","last_unstale":"2024-09-10T07:39:02.309385+0000","last_undegraded":"2024-09-10T07:39:02.309385+0000","last_fullsized":"2024-09-10T07:39:02.309385+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:30.431700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.005856+0000","last_change":"2024-09-10T07:39:01.320078+0000","last_active":"2024-09-10T07:39:03.005856+0000","last_peered":"2024-09-10T07:39:03.005856+0000","last_clean":"2024-09-10T07:39:03.005856+0000","last_became_active":"2024-09-10T07:39:01.319453+0000","last_became_peered":"2024-09-10T07:39:01.319453+0000","last_unstale":"2024-09-10T07:39:03.005856+0000","last_undegraded":"2024-09-10T07:39:03.005856+0000","last_fullsized":"2024-09-10T07:39:03.005856+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:43:42.607313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006594+0000","last_change":"2024-09-10T07:39:01.315761+0000","last_active":"2024-09-10T07:39:03.006594+0000","last_peered":"2024-09-10T07:39:03.006594+0000","last_clean":"2024-09-10T07:39:03.006594+0000","last_became_active":"2024-09-10T07:39:01.315495+0000","last_became_peered":"2024-09-10T07:39:01.315495+0000","last_unstale":"2024-09-10T07:39:03.006594+0000","last_undegraded":"2024-09-10T07:39:03.006594+0000","last_fullsized":"2024-09-10T07:39:03.006594+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:18.053574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309334+0000","last_change":"2024-09-10T07:39:01.313968+0000","last_active":"2024-09-10T07:39:02.309334+0000","last_peered":"2024-09-10T07:39:02.309334+0000","last_clean":"2024-09-10T07:39:02.309334+0000","last_became_active":"2024-09-10T07:39:01.313552+0000","last_became_peered":"2024-09-10T07:39:01.313552+0000","last_unstale":"2024-09-10T07:39:02.309334+0000","last_undegraded":"2024-09-10T07:39:02.309334+0000","last_fullsized":"2024-09-10T07:39:02.309334+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:08.713532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006013+0000","last_change":"2024-09-10T07:39:01.316748+0000","last_active":"2024-09-10T07:39:03.006013+0000","last_peered":"2024-09-10T07:39:03.006013+0000","last_clean":"2024-09-10T07:39:03.006013+0000","last_became_active":"2024-09-10T07:39:01.315754+0000","last_became_peered":"2024-09-10T07:39:01.315754+0000","last_unstale":"2024-09-10T07:39:03.006013+0000","last_undegraded":"2024-09-10T07:39:03.006013+0000","last_fullsized":"2024-09-10T07:39:03.006013+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:36.441660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.308962+0000","last_change":"2024-09-10T07:39:01.317063+0000","last_active":"2024-09-10T07:39:02.308962+0000","last_peered":"2024-09-10T07:39:02.308962+0000","last_clean":"2024-09-10T07:39:02.308962+0000","last_became_active":"2024-09-10T07:39:01.316801+0000","last_became_peered":"2024-09-10T07:39:01.316801+0000","last_unstale":"2024-09-10T07:39:02.308962+0000","last_undegraded":"2024-09-10T07:39:02.308962+0000","last_fullsized":"2024-09-10T07:39:02.308962+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:09.256864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.308999+0000","last_change":"2024-09-10T07:39:01.310920+0000","last_active":"2024-09-10T07:39:02.308999+0000","last_peered":"2024-09-10T07:39:02.308999+0000","last_clean":"2024-09-10T07:39:02.308999+0000","last_became_active":"2024-09-10T07:39:01.310669+0000","last_became_peered":"2024-09-10T07:39:01.310669+0000","last_unstale":"2024-09-10T07:39:02.308999+0000","last_undegraded":"2024-09-10T07:39:02.308999+0000","last_fullsized":"2024-09-10T07:39:02.308999+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:16.380905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006978+0000","last_change":"2024-09-10T07:39:01.321085+0000","last_active":"2024-09-10T07:39:03.006978+0000","last_peered":"2024-09-10T07:39:03.006978+0000","last_clean":"2024-09-10T07:39:03.006978+0000","last_became_active":"2024-09-10T07:39:01.320602+0000","last_became_peered":"2024-09-10T07:39:01.320602+0000","last_unstale":"2024-09-10T07:39:03.006978+0000","last_undegraded":"2024-09-10T07:39:03.006978+0000","last_fullsized":"2024-09-10T07:39:03.006978+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:05.891895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325684+0000","last_change":"2024-09-10T07:39:01.322127+0000","last_active":"2024-09-10T07:39:02.325684+0000","last_peered":"2024-09-10T07:39:02.325684+0000","last_clean":"2024-09-10T07:39:02.325684+0000","last_became_active":"2024-09-10T07:39:01.321823+0000","last_became_peered":"2024-09-10T07:39:01.321823+0000","last_unstale":"2024-09-10T07:39:02.325684+0000","last_undegraded":"2024-09-10T07:39:02.325684+0000","last_fullsized":"2024-09-10T07:39:02.325684+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:18:39.797480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006517+0000","last_change":"2024-09-10T07:39:01.324165+0000","last_active":"2024-09-10T07:39:03.006517+0000","last_peered":"2024-09-10T07:39:03.006517+0000","last_clean":"2024-09-10T07:39:03.006517+0000","last_became_active":"2024-09-10T07:39:01.323519+0000","last_became_peered":"2024-09-10T07:39:01.323519+0000","last_unstale":"2024-09-10T07:39:03.006517+0000","last_undegraded":"2024-09-10T07:39:03.006517+0000","last_fullsized":"2024-09-10T07:39:03.006517+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:20.999644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309557+0000","last_change":"2024-09-10T07:39:01.318247+0000","last_active":"2024-09-10T07:39:02.309557+0000","last_peered":"2024-09-10T07:39:02.309557+0000","last_clean":"2024-09-10T07:39:02.309557+0000","last_became_active":"2024-09-10T07:39:01.318013+0000","last_became_peered":"2024-09-10T07:39:01.318013+0000","last_unstale":"2024-09-10T07:39:02.309557+0000","last_undegraded":"2024-09-10T07:39:02.309557+0000","last_fullsized":"2024-09-10T07:39:02.309557+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:35.393209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006053+0000","last_change":"2024-09-10T07:39:01.319890+0000","last_active":"2024-09-10T07:39:03.006053+0000","last_peered":"2024-09-10T07:39:03.006053+0000","last_clean":"2024-09-10T07:39:03.006053+0000","last_became_active":"2024-09-10T07:39:01.319130+0000","last_became_peered":"2024-09-10T07:39:01.319130+0000","last_unstale":"2024-09-10T07:39:03.006053+0000","last_undegraded":"2024-09-10T07:39:03.006053+0000","last_fullsized":"2024-09-10T07:39:03.006053+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:32.061226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305962+0000","last_change":"2024-09-10T07:39:01.321781+0000","last_active":"2024-09-10T07:39:02.305962+0000","last_peered":"2024-09-10T07:39:02.305962+0000","last_clean":"2024-09-10T07:39:02.305962+0000","last_became_active":"2024-09-10T07:39:01.321372+0000","last_became_peered":"2024-09-10T07:39:01.321372+0000","last_unstale":"2024-09-10T07:39:02.305962+0000","last_undegraded":"2024-09-10T07:39:02.305962+0000","last_fullsized":"2024-09-10T07:39:02.305962+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:33.335683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007176+0000","last_change":"2024-09-10T07:39:01.324168+0000","last_active":"2024-09-10T07:39:03.007176+0000","last_peered":"2024-09-10T07:39:03.007176+0000","last_clean":"2024-09-10T07:39:03.007176+0000","last_became_active":"2024-09-10T07:39:01.323882+0000","last_became_peered":"2024-09-10T07:39:01.323882+0000","last_unstale":"2024-09-10T07:39:03.007176+0000","last_undegraded":"2024-09-10T07:39:03.007176+0000","last_fullsized":"2024-09-10T07:39:03.007176+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:19.677478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006925+0000","last_change":"2024-09-10T07:39:01.314487+0000","last_active":"2024-09-10T07:39:03.006925+0000","last_peered":"2024-09-10T07:39:03.006925+0000","last_clean":"2024-09-10T07:39:03.006925+0000","last_became_active":"2024-09-10T07:39:01.314056+0000","last_became_peered":"2024-09-10T07:39:01.314056+0000","last_unstale":"2024-09-10T07:39:03.006925+0000","last_undegraded":"2024-09-10T07:39:03.006925+0000","last_fullsized":"2024-09-10T07:39:03.006925+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:39.951789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006090+0000","last_change":"2024-09-10T07:39:01.322497+0000","last_active":"2024-09-10T07:39:03.006090+0000","last_peered":"2024-09-10T07:39:03.006090+0000","last_clean":"2024-09-10T07:39:03.006090+0000","last_became_active":"2024-09-10T07:39:01.322267+0000","last_became_peered":"2024-09-10T07:39:01.322267+0000","last_unstale":"2024-09-10T07:39:03.006090+0000","last_undegraded":"2024-09-10T07:39:03.006090+0000","last_fullsized":"2024-09-10T07:39:03.006090+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:08.673299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326803+0000","last_change":"2024-09-10T07:39:01.308634+0000","last_active":"2024-09-10T07:39:02.326803+0000","last_peered":"2024-09-10T07:39:02.326803+0000","last_clean":"2024-09-10T07:39:02.326803+0000","last_became_active":"2024-09-10T07:39:01.308317+0000","last_became_peered":"2024-09-10T07:39:01.308317+0000","last_unstale":"2024-09-10T07:39:02.326803+0000","last_undegraded":"2024-09-10T07:39:02.326803+0000","last_fullsized":"2024-09-10T07:39:02.326803+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:27.542078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006283+0000","last_change":"2024-09-10T07:39:01.308691+0000","last_active":"2024-09-10T07:39:03.006283+0000","last_peered":"2024-09-10T07:39:03.006283+0000","last_clean":"2024-09-10T07:39:03.006283+0000","last_became_active":"2024-09-10T07:39:01.308413+0000","last_became_peered":"2024-09-10T07:39:01.308413+0000","last_unstale":"2024-09-10T07:39:03.006283+0000","last_undegraded":"2024-09-10T07:39:03.006283+0000","last_fullsized":"2024-09-10T07:39:03.006283+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:00:41.354227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006063+0000","last_change":"2024-09-10T07:39:01.308636+0000","last_active":"2024-09-10T07:39:03.006063+0000","last_peered":"2024-09-10T07:39:03.006063+0000","last_clean":"2024-09-10T07:39:03.006063+0000","last_became_active":"2024-09-10T07:39:01.308393+0000","last_became_peered":"2024-09-10T07:39:01.308393+0000","last_unstale":"2024-09-10T07:39:03.006063+0000","last_undegraded":"2024-09-10T07:39:03.006063+0000","last_fullsized":"2024-09-10T07:39:03.006063+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:25.975093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325493+0000","last_change":"2024-09-10T07:39:01.320336+0000","last_active":"2024-09-10T07:39:02.325493+0000","last_peered":"2024-09-10T07:39:02.325493+0000","last_clean":"2024-09-10T07:39:02.325493+0000","last_became_active":"2024-09-10T07:39:01.315758+0000","last_became_peered":"2024-09-10T07:39:01.315758+0000","last_unstale":"2024-09-10T07:39:02.325493+0000","last_undegraded":"2024-09-10T07:39:02.325493+0000","last_fullsized":"2024-09-10T07:39:02.325493+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:09.172382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006495+0000","last_change":"2024-09-10T07:39:01.322859+0000","last_active":"2024-09-10T07:39:03.006495+0000","last_peered":"2024-09-10T07:39:03.006495+0000","last_clean":"2024-09-10T07:39:03.006495+0000","last_became_active":"2024-09-10T07:39:01.321881+0000","last_became_peered":"2024-09-10T07:39:01.321881+0000","last_unstale":"2024-09-10T07:39:03.006495+0000","last_undegraded":"2024-09-10T07:39:03.006495+0000","last_fullsized":"2024-09-10T07:39:03.006495+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:31.746680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006234+0000","last_change":"2024-09-10T07:39:01.308370+0000","last_active":"2024-09-10T07:39:03.006234+0000","last_peered":"2024-09-10T07:39:03.006234+0000","last_clean":"2024-09-10T07:39:03.006234+0000","last_became_active":"2024-09-10T07:39:01.308078+0000","last_became_peered":"2024-09-10T07:39:01.308078+0000","last_unstale":"2024-09-10T07:39:03.006234+0000","last_undegraded":"2024-09-10T07:39:03.006234+0000","last_fullsized":"2024-09-10T07:39:03.006234+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:23.299702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325460+0000","last_change":"2024-09-10T07:39:01.323026+0000","last_active":"2024-09-10T07:39:02.325460+0000","last_peered":"2024-09-10T07:39:02.325460+0000","last_clean":"2024-09-10T07:39:02.325460+0000","last_became_active":"2024-09-10T07:39:01.321996+0000","last_became_peered":"2024-09-10T07:39:01.321996+0000","last_unstale":"2024-09-10T07:39:02.325460+0000","last_undegraded":"2024-09-10T07:39:02.325460+0000","last_fullsized":"2024-09-10T07:39:02.325460+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:42.223193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309684+0000","last_change":"2024-09-10T07:39:01.323360+0000","last_active":"2024-09-10T07:39:02.309684+0000","last_peered":"2024-09-10T07:39:02.309684+0000","last_clean":"2024-09-10T07:39:02.309684+0000","last_became_active":"2024-09-10T07:39:01.322904+0000","last_became_peered":"2024-09-10T07:39:01.322904+0000","last_unstale":"2024-09-10T07:39:02.309684+0000","last_undegraded":"2024-09-10T07:39:02.309684+0000","last_fullsized":"2024-09-10T07:39:02.309684+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:24.549894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007479+0000","last_change":"2024-09-10T07:39:01.311960+0000","last_active":"2024-09-10T07:39:03.007479+0000","last_peered":"2024-09-10T07:39:03.007479+0000","last_clean":"2024-09-10T07:39:03.007479+0000","last_became_active":"2024-09-10T07:39:01.311730+0000","last_became_peered":"2024-09-10T07:39:01.311730+0000","last_unstale":"2024-09-10T07:39:03.007479+0000","last_undegraded":"2024-09-10T07:39:03.007479+0000","last_fullsized":"2024-09-10T07:39:03.007479+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:51.154025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006787+0000","last_change":"2024-09-10T07:39:01.322591+0000","last_active":"2024-09-10T07:39:03.006787+0000","last_peered":"2024-09-10T07:39:03.006787+0000","last_clean":"2024-09-10T07:39:03.006787+0000","last_became_active":"2024-09-10T07:39:01.321334+0000","last_became_peered":"2024-09-10T07:39:01.321334+0000","last_unstale":"2024-09-10T07:39:03.006787+0000","last_undegraded":"2024-09-10T07:39:03.006787+0000","last_fullsized":"2024-09-10T07:39:03.006787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:03.237607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325540+0000","last_change":"2024-09-10T07:39:01.318054+0000","last_active":"2024-09-10T07:39:02.325540+0000","last_peered":"2024-09-10T07:39:02.325540+0000","last_clean":"2024-09-10T07:39:02.325540+0000","last_became_active":"2024-09-10T07:39:01.317636+0000","last_became_peered":"2024-09-10T07:39:01.317636+0000","last_unstale":"2024-09-10T07:39:02.325540+0000","last_undegraded":"2024-09-10T07:39:02.325540+0000","last_fullsized":"2024-09-10T07:39:02.325540+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:02.675660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325612+0000","last_change":"2024-09-10T07:39:01.314583+0000","last_active":"2024-09-10T07:39:02.325612+0000","last_peered":"2024-09-10T07:39:02.325612+0000","last_clean":"2024-09-10T07:39:02.325612+0000","last_became_active":"2024-09-10T07:39:01.314259+0000","last_became_peered":"2024-09-10T07:39:01.314259+0000","last_unstale":"2024-09-10T07:39:02.325612+0000","last_undegraded":"2024-09-10T07:39:02.325612+0000","last_fullsized":"2024-09-10T07:39:02.325612+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:18.429886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007365+0000","last_change":"2024-09-10T07:39:01.311712+0000","last_active":"2024-09-10T07:39:03.007365+0000","last_peered":"2024-09-10T07:39:03.007365+0000","last_clean":"2024-09-10T07:39:03.007365+0000","last_became_active":"2024-09-10T07:39:01.311453+0000","last_became_peered":"2024-09-10T07:39:01.311453+0000","last_unstale":"2024-09-10T07:39:03.007365+0000","last_undegraded":"2024-09-10T07:39:03.007365+0000","last_fullsized":"2024-09-10T07:39:03.007365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:45.264655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006672+0000","last_change":"2024-09-10T07:39:01.324467+0000","last_active":"2024-09-10T07:39:03.006672+0000","last_peered":"2024-09-10T07:39:03.006672+0000","last_clean":"2024-09-10T07:39:03.006672+0000","last_became_active":"2024-09-10T07:39:01.323914+0000","last_became_peered":"2024-09-10T07:39:01.323914+0000","last_unstale":"2024-09-10T07:39:03.006672+0000","last_undegraded":"2024-09-10T07:39:03.006672+0000","last_fullsized":"2024-09-10T07:39:03.006672+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:33.902638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006305+0000","last_change":"2024-09-10T07:39:01.325948+0000","last_active":"2024-09-10T07:39:03.006305+0000","last_peered":"2024-09-10T07:39:03.006305+0000","last_clean":"2024-09-10T07:39:03.006305+0000","last_became_active":"2024-09-10T07:39:01.325610+0000","last_became_peered":"2024-09-10T07:39:01.325610+0000","last_unstale":"2024-09-10T07:39:03.006305+0000","last_undegraded":"2024-09-10T07:39:03.006305+0000","last_fullsized":"2024-09-10T07:39:03.006305+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:13.432473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"100'4","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007127+0000","last_change":"2024-09-10T07:39:00.303359+0000","last_active":"2024-09-10T07:39:03.007127+0000","last_peered":"2024-09-10T07:39:03.007127+0000","last_clean":"2024-09-10T07:39:03.007127+0000","last_became_active":"2024-09-10T07:39:00.302872+0000","last_became_peered":"2024-09-10T07:39:00.302872+0000","last_unstale":"2024-09-10T07:39:03.007127+0000","last_undegraded":"2024-09-10T07:39:03.007127+0000","last_fullsized":"2024-09-10T07:39:03.007127+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:37.853763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007003+0000","last_change":"2024-09-10T07:39:01.322351+0000","last_active":"2024-09-10T07:39:03.007003+0000","last_peered":"2024-09-10T07:39:03.007003+0000","last_clean":"2024-09-10T07:39:03.007003+0000","last_became_active":"2024-09-10T07:39:01.321049+0000","last_became_peered":"2024-09-10T07:39:01.321049+0000","last_unstale":"2024-09-10T07:39:03.007003+0000","last_undegraded":"2024-09-10T07:39:03.007003+0000","last_fullsized":"2024-09-10T07:39:03.007003+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:10.062192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006607+0000","last_change":"2024-09-10T07:39:00.294447+0000","last_active":"2024-09-10T07:39:03.006607+0000","last_peered":"2024-09-10T07:39:03.006607+0000","last_clean":"2024-09-10T07:39:03.006607+0000","last_became_active":"2024-09-10T07:39:00.294211+0000","last_became_peered":"2024-09-10T07:39:00.294211+0000","last_unstale":"2024-09-10T07:39:03.006607+0000","last_undegraded":"2024-09-10T07:39:03.006607+0000","last_fullsized":"2024-09-10T07:39:03.006607+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:33.031311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007092+0000","last_change":"2024-09-10T07:39:01.324709+0000","last_active":"2024-09-10T07:39:03.007092+0000","last_peered":"2024-09-10T07:39:03.007092+0000","last_clean":"2024-09-10T07:39:03.007092+0000","last_became_active":"2024-09-10T07:39:01.322550+0000","last_became_peered":"2024-09-10T07:39:01.322550+0000","last_unstale":"2024-09-10T07:39:03.007092+0000","last_undegraded":"2024-09-10T07:39:03.007092+0000","last_fullsized":"2024-09-10T07:39:03.007092+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:02.097479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326895+0000","last_change":"2024-09-10T07:39:00.303061+0000","last_active":"2024-09-10T07:39:02.326895+0000","last_peered":"2024-09-10T07:39:02.326895+0000","last_clean":"2024-09-10T07:39:02.326895+0000","last_became_active":"2024-09-10T07:39:00.302309+0000","last_became_peered":"2024-09-10T07:39:00.302309+0000","last_unstale":"2024-09-10T07:39:02.326895+0000","last_undegraded":"2024-09-10T07:39:02.326895+0000","last_fullsized":"2024-09-10T07:39:02.326895+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:47.004019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.310210+0000","last_change":"2024-09-10T07:39:01.318458+0000","last_active":"2024-09-10T07:39:02.310210+0000","last_peered":"2024-09-10T07:39:02.310210+0000","last_clean":"2024-09-10T07:39:02.310210+0000","last_became_active":"2024-09-10T07:39:01.318245+0000","last_became_peered":"2024-09-10T07:39:01.318245+0000","last_unstale":"2024-09-10T07:39:02.310210+0000","last_undegraded":"2024-09-10T07:39:02.310210+0000","last_fullsized":"2024-09-10T07:39:02.310210+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:54.926735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326928+0000","last_change":"2024-09-10T07:39:00.306490+0000","last_active":"2024-09-10T07:39:02.326928+0000","last_peered":"2024-09-10T07:39:02.326928+0000","last_clean":"2024-09-10T07:39:02.326928+0000","last_became_active":"2024-09-10T07:39:00.306056+0000","last_became_peered":"2024-09-10T07:39:00.306056+0000","last_unstale":"2024-09-10T07:39:02.326928+0000","last_undegraded":"2024-09-10T07:39:02.326928+0000","last_fullsized":"2024-09-10T07:39:02.326928+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:57.596869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325542+0000","last_change":"2024-09-10T07:39:01.319073+0000","last_active":"2024-09-10T07:39:02.325542+0000","last_peered":"2024-09-10T07:39:02.325542+0000","last_clean":"2024-09-10T07:39:02.325542+0000","last_became_active":"2024-09-10T07:39:01.318540+0000","last_became_peered":"2024-09-10T07:39:01.318540+0000","last_unstale":"2024-09-10T07:39:02.325542+0000","last_undegraded":"2024-09-10T07:39:02.325542+0000","last_fullsized":"2024-09-10T07:39:02.325542+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:26.522789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007317+0000","last_change":"2024-09-10T07:39:00.306915+0000","last_active":"2024-09-10T07:39:03.007317+0000","last_peered":"2024-09-10T07:39:03.007317+0000","last_clean":"2024-09-10T07:39:03.007317+0000","last_became_active":"2024-09-10T07:39:00.306547+0000","last_became_peered":"2024-09-10T07:39:00.306547+0000","last_unstale":"2024-09-10T07:39:03.007317+0000","last_undegraded":"2024-09-10T07:39:03.007317+0000","last_fullsized":"2024-09-10T07:39:03.007317+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:34.533072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007116+0000","last_change":"2024-09-10T07:39:01.314301+0000","last_active":"2024-09-10T07:39:03.007116+0000","last_peered":"2024-09-10T07:39:03.007116+0000","last_clean":"2024-09-10T07:39:03.007116+0000","last_became_active":"2024-09-10T07:39:01.313755+0000","last_became_peered":"2024-09-10T07:39:01.313755+0000","last_unstale":"2024-09-10T07:39:03.007116+0000","last_undegraded":"2024-09-10T07:39:03.007116+0000","last_fullsized":"2024-09-10T07:39:03.007116+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:12:47.465603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006886+0000","last_change":"2024-09-10T07:39:00.293850+0000","last_active":"2024-09-10T07:39:03.006886+0000","last_peered":"2024-09-10T07:39:03.006886+0000","last_clean":"2024-09-10T07:39:03.006886+0000","last_became_active":"2024-09-10T07:39:00.293619+0000","last_became_peered":"2024-09-10T07:39:00.293619+0000","last_unstale":"2024-09-10T07:39:03.006886+0000","last_undegraded":"2024-09-10T07:39:03.006886+0000","last_fullsized":"2024-09-10T07:39:03.006886+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:56.516103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309992+0000","last_change":"2024-09-10T07:39:01.317233+0000","last_active":"2024-09-10T07:39:02.309992+0000","last_peered":"2024-09-10T07:39:02.309992+0000","last_clean":"2024-09-10T07:39:02.309992+0000","last_became_active":"2024-09-10T07:39:01.316894+0000","last_became_peered":"2024-09-10T07:39:01.316894+0000","last_unstale":"2024-09-10T07:39:02.309992+0000","last_undegraded":"2024-09-10T07:39:02.309992+0000","last_fullsized":"2024-09-10T07:39:02.309992+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:11.873625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326954+0000","last_change":"2024-09-10T07:39:00.301830+0000","last_active":"2024-09-10T07:39:02.326954+0000","last_peered":"2024-09-10T07:39:02.326954+0000","last_clean":"2024-09-10T07:39:02.326954+0000","last_became_active":"2024-09-10T07:39:00.301190+0000","last_became_peered":"2024-09-10T07:39:00.301190+0000","last_unstale":"2024-09-10T07:39:02.326954+0000","last_undegraded":"2024-09-10T07:39:02.326954+0000","last_fullsized":"2024-09-10T07:39:02.326954+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:02.114814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305798+0000","last_change":"2024-09-10T07:39:01.313865+0000","last_active":"2024-09-10T07:39:02.305798+0000","last_peered":"2024-09-10T07:39:02.305798+0000","last_clean":"2024-09-10T07:39:02.305798+0000","last_became_active":"2024-09-10T07:39:01.313609+0000","last_became_peered":"2024-09-10T07:39:01.313609+0000","last_unstale":"2024-09-10T07:39:02.305798+0000","last_undegraded":"2024-09-10T07:39:02.305798+0000","last_fullsized":"2024-09-10T07:39:02.305798+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:09.210063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325706+0000","last_change":"2024-09-10T07:39:00.309242+0000","last_active":"2024-09-10T07:39:02.325706+0000","last_peered":"2024-09-10T07:39:02.325706+0000","last_clean":"2024-09-10T07:39:02.325706+0000","last_became_active":"2024-09-10T07:39:00.308832+0000","last_became_peered":"2024-09-10T07:39:00.308832+0000","last_unstale":"2024-09-10T07:39:02.325706+0000","last_undegraded":"2024-09-10T07:39:02.325706+0000","last_fullsized":"2024-09-10T07:39:02.325706+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:26.155917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305933+0000","last_change":"2024-09-10T07:39:01.318243+0000","last_active":"2024-09-10T07:39:02.305933+0000","last_peered":"2024-09-10T07:39:02.305933+0000","last_clean":"2024-09-10T07:39:02.305933+0000","last_became_active":"2024-09-10T07:39:01.317997+0000","last_became_peered":"2024-09-10T07:39:01.317997+0000","last_unstale":"2024-09-10T07:39:02.305933+0000","last_undegraded":"2024-09-10T07:39:02.305933+0000","last_fullsized":"2024-09-10T07:39:02.305933+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:04.113678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007226+0000","last_change":"2024-09-10T07:39:00.303642+0000","last_active":"2024-09-10T07:39:03.007226+0000","last_peered":"2024-09-10T07:39:03.007226+0000","last_clean":"2024-09-10T07:39:03.007226+0000","last_became_active":"2024-09-10T07:39:00.303380+0000","last_became_peered":"2024-09-10T07:39:00.303380+0000","last_unstale":"2024-09-10T07:39:03.007226+0000","last_undegraded":"2024-09-10T07:39:03.007226+0000","last_fullsized":"2024-09-10T07:39:03.007226+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:22.919859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309493+0000","last_change":"2024-09-10T07:39:01.313774+0000","last_active":"2024-09-10T07:39:02.309493+0000","last_peered":"2024-09-10T07:39:02.309493+0000","last_clean":"2024-09-10T07:39:02.309493+0000","last_became_active":"2024-09-10T07:39:01.312817+0000","last_became_peered":"2024-09-10T07:39:01.312817+0000","last_unstale":"2024-09-10T07:39:02.309493+0000","last_undegraded":"2024-09-10T07:39:02.309493+0000","last_fullsized":"2024-09-10T07:39:02.309493+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:38.303795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006781+0000","last_change":"2024-09-10T07:39:00.305925+0000","last_active":"2024-09-10T07:39:03.006781+0000","last_peered":"2024-09-10T07:39:03.006781+0000","last_clean":"2024-09-10T07:39:03.006781+0000","last_became_active":"2024-09-10T07:39:00.305693+0000","last_became_peered":"2024-09-10T07:39:00.305693+0000","last_unstale":"2024-09-10T07:39:03.006781+0000","last_undegraded":"2024-09-10T07:39:03.006781+0000","last_fullsized":"2024-09-10T07:39:03.006781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:46.132691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326532+0000","last_change":"2024-09-10T07:39:01.325368+0000","last_active":"2024-09-10T07:39:02.326532+0000","last_peered":"2024-09-10T07:39:02.326532+0000","last_clean":"2024-09-10T07:39:02.326532+0000","last_became_active":"2024-09-10T07:39:01.325168+0000","last_became_peered":"2024-09-10T07:39:01.325168+0000","last_unstale":"2024-09-10T07:39:02.326532+0000","last_undegraded":"2024-09-10T07:39:02.326532+0000","last_fullsized":"2024-09-10T07:39:02.326532+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:44.797021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"100'3","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007413+0000","last_change":"2024-09-10T07:39:00.307132+0000","last_active":"2024-09-10T07:39:03.007413+0000","last_peered":"2024-09-10T07:39:03.007413+0000","last_clean":"2024-09-10T07:39:03.007413+0000","last_became_active":"2024-09-10T07:39:00.305640+0000","last_became_peered":"2024-09-10T07:39:00.305640+0000","last_unstale":"2024-09-10T07:39:03.007413+0000","last_undegraded":"2024-09-10T07:39:03.007413+0000","last_fullsized":"2024-09-10T07:39:03.007413+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:17.730519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006614+0000","last_change":"2024-09-10T07:39:01.312688+0000","last_active":"2024-09-10T07:39:03.006614+0000","last_peered":"2024-09-10T07:39:03.006614+0000","last_clean":"2024-09-10T07:39:03.006614+0000","last_became_active":"2024-09-10T07:39:01.312342+0000","last_became_peered":"2024-09-10T07:39:01.312342+0000","last_unstale":"2024-09-10T07:39:03.006614+0000","last_undegraded":"2024-09-10T07:39:03.006614+0000","last_fullsized":"2024-09-10T07:39:03.006614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:17.289866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"100'6","reported_seq":20,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309116+0000","last_change":"2024-09-10T07:39:00.297377+0000","last_active":"2024-09-10T07:39:02.309116+0000","last_peered":"2024-09-10T07:39:02.309116+0000","last_clean":"2024-09-10T07:39:02.309116+0000","last_became_active":"2024-09-10T07:39:00.296688+0000","last_became_peered":"2024-09-10T07:39:00.296688+0000","last_unstale":"2024-09-10T07:39:02.309116+0000","last_undegraded":"2024-09-10T07:39:02.309116+0000","last_fullsized":"2024-09-10T07:39:02.309116+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:43.771253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326677+0000","last_change":"2024-09-10T07:39:01.313094+0000","last_active":"2024-09-10T07:39:02.326677+0000","last_peered":"2024-09-10T07:39:02.326677+0000","last_clean":"2024-09-10T07:39:02.326677+0000","last_became_active":"2024-09-10T07:39:01.312447+0000","last_became_peered":"2024-09-10T07:39:01.312447+0000","last_unstale":"2024-09-10T07:39:02.326677+0000","last_undegraded":"2024-09-10T07:39:02.326677+0000","last_fullsized":"2024-09-10T07:39:02.326677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:31.843917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325797+0000","last_change":"2024-09-10T07:39:00.309058+0000","last_active":"2024-09-10T07:39:02.325797+0000","last_peered":"2024-09-10T07:39:02.325797+0000","last_clean":"2024-09-10T07:39:02.325797+0000","last_became_active":"2024-09-10T07:39:00.308545+0000","last_became_peered":"2024-09-10T07:39:00.308545+0000","last_unstale":"2024-09-10T07:39:02.325797+0000","last_undegraded":"2024-09-10T07:39:02.325797+0000","last_fullsized":"2024-09-10T07:39:02.325797+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:32.219839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.310113+0000","last_change":"2024-09-10T07:39:01.321282+0000","last_active":"2024-09-10T07:39:02.310113+0000","last_peered":"2024-09-10T07:39:02.310113+0000","last_clean":"2024-09-10T07:39:02.310113+0000","last_became_active":"2024-09-10T07:39:01.320996+0000","last_became_peered":"2024-09-10T07:39:01.320996+0000","last_unstale":"2024-09-10T07:39:02.310113+0000","last_undegraded":"2024-09-10T07:39:02.310113+0000","last_fullsized":"2024-09-10T07:39:02.310113+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:15.891701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305831+0000","last_change":"2024-09-10T07:39:00.305145+0000","last_active":"2024-09-10T07:39:02.305831+0000","last_peered":"2024-09-10T07:39:02.305831+0000","last_clean":"2024-09-10T07:39:02.305831+0000","last_became_active":"2024-09-10T07:39:00.304902+0000","last_became_peered":"2024-09-10T07:39:00.304902+0000","last_unstale":"2024-09-10T07:39:02.305831+0000","last_undegraded":"2024-09-10T07:39:02.305831+0000","last_fullsized":"2024-09-10T07:39:02.305831+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:01.016242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325388+0000","last_change":"2024-09-10T07:39:01.319278+0000","last_active":"2024-09-10T07:39:02.325388+0000","last_peered":"2024-09-10T07:39:02.325388+0000","last_clean":"2024-09-10T07:39:02.325388+0000","last_became_active":"2024-09-10T07:39:01.318844+0000","last_became_peered":"2024-09-10T07:39:01.318844+0000","last_unstale":"2024-09-10T07:39:02.325388+0000","last_undegraded":"2024-09-10T07:39:02.325388+0000","last_fullsized":"2024-09-10T07:39:02.325388+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:32.221158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309209+0000","last_change":"2024-09-10T07:39:00.300406+0000","last_active":"2024-09-10T07:39:02.309209+0000","last_peered":"2024-09-10T07:39:02.309209+0000","last_clean":"2024-09-10T07:39:02.309209+0000","last_became_active":"2024-09-10T07:39:00.298658+0000","last_became_peered":"2024-09-10T07:39:00.298658+0000","last_unstale":"2024-09-10T07:39:02.309209+0000","last_undegraded":"2024-09-10T07:39:02.309209+0000","last_fullsized":"2024-09-10T07:39:02.309209+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:20.444903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325636+0000","last_change":"2024-09-10T07:39:01.325205+0000","last_active":"2024-09-10T07:39:02.325636+0000","last_peered":"2024-09-10T07:39:02.325636+0000","last_clean":"2024-09-10T07:39:02.325636+0000","last_became_active":"2024-09-10T07:39:01.324394+0000","last_became_peered":"2024-09-10T07:39:01.324394+0000","last_unstale":"2024-09-10T07:39:02.325636+0000","last_undegraded":"2024-09-10T07:39:02.325636+0000","last_fullsized":"2024-09-10T07:39:02.325636+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:21.746308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"100'8","reported_seq":22,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326722+0000","last_change":"2024-09-10T07:39:00.309068+0000","last_active":"2024-09-10T07:39:02.326722+0000","last_peered":"2024-09-10T07:39:02.326722+0000","last_clean":"2024-09-10T07:39:02.326722+0000","last_became_active":"2024-09-10T07:39:00.308231+0000","last_became_peered":"2024-09-10T07:39:00.308231+0000","last_unstale":"2024-09-10T07:39:02.326722+0000","last_undegraded":"2024-09-10T07:39:02.326722+0000","last_fullsized":"2024-09-10T07:39:02.326722+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:16.617408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.310291+0000","last_change":"2024-09-10T07:39:01.318970+0000","last_active":"2024-09-10T07:39:02.310291+0000","last_peered":"2024-09-10T07:39:02.310291+0000","last_clean":"2024-09-10T07:39:02.310291+0000","last_became_active":"2024-09-10T07:39:01.318748+0000","last_became_peered":"2024-09-10T07:39:01.318748+0000","last_unstale":"2024-09-10T07:39:02.310291+0000","last_undegraded":"2024-09-10T07:39:02.310291+0000","last_fullsized":"2024-09-10T07:39:02.310291+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:02.710545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006527+0000","last_change":"2024-09-10T07:39:00.307865+0000","last_active":"2024-09-10T07:39:03.006527+0000","last_peered":"2024-09-10T07:39:03.006527+0000","last_clean":"2024-09-10T07:39:03.006527+0000","last_became_active":"2024-09-10T07:39:00.307627+0000","last_became_peered":"2024-09-10T07:39:00.307627+0000","last_unstale":"2024-09-10T07:39:03.006527+0000","last_undegraded":"2024-09-10T07:39:03.006527+0000","last_fullsized":"2024-09-10T07:39:03.006527+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:05.291881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006277+0000","last_change":"2024-09-10T07:39:01.324223+0000","last_active":"2024-09-10T07:39:03.006277+0000","last_peered":"2024-09-10T07:39:03.006277+0000","last_clean":"2024-09-10T07:39:03.006277+0000","last_became_active":"2024-09-10T07:39:01.323967+0000","last_became_peered":"2024-09-10T07:39:01.323967+0000","last_unstale":"2024-09-10T07:39:03.006277+0000","last_undegraded":"2024-09-10T07:39:03.006277+0000","last_fullsized":"2024-09-10T07:39:03.006277+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:21.467018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326987+0000","last_change":"2024-09-10T07:39:00.299765+0000","last_active":"2024-09-10T07:39:02.326987+0000","last_peered":"2024-09-10T07:39:02.326987+0000","last_clean":"2024-09-10T07:39:02.326987+0000","last_became_active":"2024-09-10T07:39:00.299542+0000","last_became_peered":"2024-09-10T07:39:00.299542+0000","last_unstale":"2024-09-10T07:39:02.326987+0000","last_undegraded":"2024-09-10T07:39:02.326987+0000","last_fullsized":"2024-09-10T07:39:02.326987+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:45:23.511155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007461+0000","last_change":"2024-09-10T07:39:01.320190+0000","last_active":"2024-09-10T07:39:03.007461+0000","last_peered":"2024-09-10T07:39:03.007461+0000","last_clean":"2024-09-10T07:39:03.007461+0000","last_became_active":"2024-09-10T07:39:01.319885+0000","last_became_peered":"2024-09-10T07:39:01.319885+0000","last_unstale":"2024-09-10T07:39:03.007461+0000","last_undegraded":"2024-09-10T07:39:03.007461+0000","last_fullsized":"2024-09-10T07:39:03.007461+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:38.588877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326563+0000","last_change":"2024-09-10T07:39:00.299537+0000","last_active":"2024-09-10T07:39:02.326563+0000","last_peered":"2024-09-10T07:39:02.326563+0000","last_clean":"2024-09-10T07:39:02.326563+0000","last_became_active":"2024-09-10T07:39:00.299116+0000","last_became_peered":"2024-09-10T07:39:00.299116+0000","last_unstale":"2024-09-10T07:39:02.326563+0000","last_undegraded":"2024-09-10T07:39:02.326563+0000","last_fullsized":"2024-09-10T07:39:02.326563+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:29.415024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006387+0000","last_change":"2024-09-10T07:39:01.319683+0000","last_active":"2024-09-10T07:39:03.006387+0000","last_peered":"2024-09-10T07:39:03.006387+0000","last_clean":"2024-09-10T07:39:03.006387+0000","last_became_active":"2024-09-10T07:39:01.318772+0000","last_became_peered":"2024-09-10T07:39:01.318772+0000","last_unstale":"2024-09-10T07:39:03.006387+0000","last_undegraded":"2024-09-10T07:39:03.006387+0000","last_fullsized":"2024-09-10T07:39:03.006387+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:15.085859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305845+0000","last_change":"2024-09-10T07:39:00.299710+0000","last_active":"2024-09-10T07:39:02.305845+0000","last_peered":"2024-09-10T07:39:02.305845+0000","last_clean":"2024-09-10T07:39:02.305845+0000","last_became_active":"2024-09-10T07:39:00.299480+0000","last_became_peered":"2024-09-10T07:39:00.299480+0000","last_unstale":"2024-09-10T07:39:02.305845+0000","last_undegraded":"2024-09-10T07:39:02.305845+0000","last_fullsized":"2024-09-10T07:39:02.305845+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:48:19.653097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309173+0000","last_change":"2024-09-10T07:39:01.316497+0000","last_active":"2024-09-10T07:39:02.309173+0000","last_peered":"2024-09-10T07:39:02.309173+0000","last_clean":"2024-09-10T07:39:02.309173+0000","last_became_active":"2024-09-10T07:39:01.312685+0000","last_became_peered":"2024-09-10T07:39:01.312685+0000","last_unstale":"2024-09-10T07:39:02.309173+0000","last_undegraded":"2024-09-10T07:39:02.309173+0000","last_fullsized":"2024-09-10T07:39:02.309173+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:43.625289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006482+0000","last_change":"2024-09-10T07:39:00.303261+0000","last_active":"2024-09-10T07:39:03.006482+0000","last_peered":"2024-09-10T07:39:03.006482+0000","last_clean":"2024-09-10T07:39:03.006482+0000","last_became_active":"2024-09-10T07:39:00.303022+0000","last_became_peered":"2024-09-10T07:39:00.303022+0000","last_unstale":"2024-09-10T07:39:03.006482+0000","last_undegraded":"2024-09-10T07:39:03.006482+0000","last_fullsized":"2024-09-10T07:39:03.006482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:13.408950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006233+0000","last_change":"2024-09-10T07:39:01.312999+0000","last_active":"2024-09-10T07:39:03.006233+0000","last_peered":"2024-09-10T07:39:03.006233+0000","last_clean":"2024-09-10T07:39:03.006233+0000","last_became_active":"2024-09-10T07:39:01.312767+0000","last_became_peered":"2024-09-10T07:39:01.312767+0000","last_unstale":"2024-09-10T07:39:03.006233+0000","last_undegraded":"2024-09-10T07:39:03.006233+0000","last_fullsized":"2024-09-10T07:39:03.006233+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:11.181732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006464+0000","last_change":"2024-09-10T07:39:00.307493+0000","last_active":"2024-09-10T07:39:03.006464+0000","last_peered":"2024-09-10T07:39:03.006464+0000","last_clean":"2024-09-10T07:39:03.006464+0000","last_became_active":"2024-09-10T07:39:00.307065+0000","last_became_peered":"2024-09-10T07:39:00.307065+0000","last_unstale":"2024-09-10T07:39:03.006464+0000","last_undegraded":"2024-09-10T07:39:03.006464+0000","last_fullsized":"2024-09-10T07:39:03.006464+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:07.543638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309409+0000","last_change":"2024-09-10T07:39:01.315543+0000","last_active":"2024-09-10T07:39:02.309409+0000","last_peered":"2024-09-10T07:39:02.309409+0000","last_clean":"2024-09-10T07:39:02.309409+0000","last_became_active":"2024-09-10T07:39:01.314429+0000","last_became_peered":"2024-09-10T07:39:01.314429+0000","last_unstale":"2024-09-10T07:39:02.309409+0000","last_undegraded":"2024-09-10T07:39:02.309409+0000","last_fullsized":"2024-09-10T07:39:02.309409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:13.726990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.305959+0000","last_change":"2024-09-10T07:39:00.303081+0000","last_active":"2024-09-10T07:39:02.305959+0000","last_peered":"2024-09-10T07:39:02.305959+0000","last_clean":"2024-09-10T07:39:02.305959+0000","last_became_active":"2024-09-10T07:39:00.302788+0000","last_became_peered":"2024-09-10T07:39:00.302788+0000","last_unstale":"2024-09-10T07:39:02.305959+0000","last_undegraded":"2024-09-10T07:39:02.305959+0000","last_fullsized":"2024-09-10T07:39:02.305959+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:50.697795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006775+0000","last_change":"2024-09-10T07:39:01.318088+0000","last_active":"2024-09-10T07:39:03.006775+0000","last_peered":"2024-09-10T07:39:03.006775+0000","last_clean":"2024-09-10T07:39:03.006775+0000","last_became_active":"2024-09-10T07:39:01.317076+0000","last_became_peered":"2024-09-10T07:39:01.317076+0000","last_unstale":"2024-09-10T07:39:03.006775+0000","last_undegraded":"2024-09-10T07:39:03.006775+0000","last_fullsized":"2024-09-10T07:39:03.006775+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:31.053527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325911+0000","last_change":"2024-09-10T07:39:00.306764+0000","last_active":"2024-09-10T07:39:02.325911+0000","last_peered":"2024-09-10T07:39:02.325911+0000","last_clean":"2024-09-10T07:39:02.325911+0000","last_became_active":"2024-09-10T07:39:00.306414+0000","last_became_peered":"2024-09-10T07:39:00.306414+0000","last_unstale":"2024-09-10T07:39:02.325911+0000","last_undegraded":"2024-09-10T07:39:02.325911+0000","last_fullsized":"2024-09-10T07:39:02.325911+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:17.902037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309979+0000","last_change":"2024-09-10T07:39:01.327102+0000","last_active":"2024-09-10T07:39:02.309979+0000","last_peered":"2024-09-10T07:39:02.309979+0000","last_clean":"2024-09-10T07:39:02.309979+0000","last_became_active":"2024-09-10T07:39:01.326879+0000","last_became_peered":"2024-09-10T07:39:01.326879+0000","last_unstale":"2024-09-10T07:39:02.309979+0000","last_undegraded":"2024-09-10T07:39:02.309979+0000","last_fullsized":"2024-09-10T07:39:02.309979+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:56.312590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"101'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326819+0000","last_change":"2024-09-10T07:39:00.308218+0000","last_active":"2024-09-10T07:39:02.326819+0000","last_peered":"2024-09-10T07:39:02.326819+0000","last_clean":"2024-09-10T07:39:02.326819+0000","last_became_active":"2024-09-10T07:39:00.307782+0000","last_became_peered":"2024-09-10T07:39:00.307782+0000","last_unstale":"2024-09-10T07:39:02.326819+0000","last_undegraded":"2024-09-10T07:39:02.326819+0000","last_fullsized":"2024-09-10T07:39:02.326819+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:48.192359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007143+0000","last_change":"2024-09-10T07:39:01.320900+0000","last_active":"2024-09-10T07:39:03.007143+0000","last_peered":"2024-09-10T07:39:03.007143+0000","last_clean":"2024-09-10T07:39:03.007143+0000","last_became_active":"2024-09-10T07:39:01.320332+0000","last_became_peered":"2024-09-10T07:39:01.320332+0000","last_unstale":"2024-09-10T07:39:03.007143+0000","last_undegraded":"2024-09-10T07:39:03.007143+0000","last_fullsized":"2024-09-10T07:39:03.007143+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:22.288648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006624+0000","last_change":"2024-09-10T07:39:00.303075+0000","last_active":"2024-09-10T07:39:03.006624+0000","last_peered":"2024-09-10T07:39:03.006624+0000","last_clean":"2024-09-10T07:39:03.006624+0000","last_became_active":"2024-09-10T07:39:00.302780+0000","last_became_peered":"2024-09-10T07:39:00.302780+0000","last_unstale":"2024-09-10T07:39:03.006624+0000","last_undegraded":"2024-09-10T07:39:03.006624+0000","last_fullsized":"2024-09-10T07:39:03.006624+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:39.804301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006484+0000","last_change":"2024-09-10T07:39:01.311130+0000","last_active":"2024-09-10T07:39:03.006484+0000","last_peered":"2024-09-10T07:39:03.006484+0000","last_clean":"2024-09-10T07:39:03.006484+0000","last_became_active":"2024-09-10T07:39:01.310889+0000","last_became_peered":"2024-09-10T07:39:01.310889+0000","last_unstale":"2024-09-10T07:39:03.006484+0000","last_undegraded":"2024-09-10T07:39:03.006484+0000","last_fullsized":"2024-09-10T07:39:03.006484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:49.798948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007270+0000","last_change":"2024-09-10T07:39:00.303840+0000","last_active":"2024-09-10T07:39:03.007270+0000","last_peered":"2024-09-10T07:39:03.007270+0000","last_clean":"2024-09-10T07:39:03.007270+0000","last_became_active":"2024-09-10T07:39:00.303435+0000","last_became_peered":"2024-09-10T07:39:00.303435+0000","last_unstale":"2024-09-10T07:39:03.007270+0000","last_undegraded":"2024-09-10T07:39:03.007270+0000","last_fullsized":"2024-09-10T07:39:03.007270+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:48.649836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309089+0000","last_change":"2024-09-10T07:39:01.316064+0000","last_active":"2024-09-10T07:39:02.309089+0000","last_peered":"2024-09-10T07:39:02.309089+0000","last_clean":"2024-09-10T07:39:02.309089+0000","last_became_active":"2024-09-10T07:39:01.315816+0000","last_became_peered":"2024-09-10T07:39:01.315816+0000","last_unstale":"2024-09-10T07:39:02.309089+0000","last_undegraded":"2024-09-10T07:39:02.309089+0000","last_fullsized":"2024-09-10T07:39:02.309089+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:44.389268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326999+0000","last_change":"2024-09-10T07:39:00.306282+0000","last_active":"2024-09-10T07:39:02.326999+0000","last_peered":"2024-09-10T07:39:02.326999+0000","last_clean":"2024-09-10T07:39:02.326999+0000","last_became_active":"2024-09-10T07:39:00.305742+0000","last_became_peered":"2024-09-10T07:39:00.305742+0000","last_unstale":"2024-09-10T07:39:02.326999+0000","last_undegraded":"2024-09-10T07:39:02.326999+0000","last_fullsized":"2024-09-10T07:39:02.326999+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:35.139749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.326826+0000","last_change":"2024-09-10T07:39:01.313309+0000","last_active":"2024-09-10T07:39:02.326826+0000","last_peered":"2024-09-10T07:39:02.326826+0000","last_clean":"2024-09-10T07:39:02.326826+0000","last_became_active":"2024-09-10T07:39:01.312784+0000","last_became_peered":"2024-09-10T07:39:01.312784+0000","last_unstale":"2024-09-10T07:39:02.326826+0000","last_undegraded":"2024-09-10T07:39:02.326826+0000","last_fullsized":"2024-09-10T07:39:02.326826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:43.945413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007569+0000","last_change":"2024-09-10T07:39:00.298968+0000","last_active":"2024-09-10T07:39:03.007569+0000","last_peered":"2024-09-10T07:39:03.007569+0000","last_clean":"2024-09-10T07:39:03.007569+0000","last_became_active":"2024-09-10T07:39:00.298707+0000","last_became_peered":"2024-09-10T07:39:00.298707+0000","last_unstale":"2024-09-10T07:39:03.007569+0000","last_undegraded":"2024-09-10T07:39:03.007569+0000","last_fullsized":"2024-09-10T07:39:03.007569+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:26.058791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309330+0000","last_change":"2024-09-10T07:39:01.325638+0000","last_active":"2024-09-10T07:39:02.309330+0000","last_peered":"2024-09-10T07:39:02.309330+0000","last_clean":"2024-09-10T07:39:02.309330+0000","last_became_active":"2024-09-10T07:39:01.325259+0000","last_became_peered":"2024-09-10T07:39:01.325259+0000","last_unstale":"2024-09-10T07:39:02.309330+0000","last_undegraded":"2024-09-10T07:39:02.309330+0000","last_fullsized":"2024-09-10T07:39:02.309330+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:59.597768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007512+0000","last_change":"2024-09-10T07:39:00.303134+0000","last_active":"2024-09-10T07:39:03.007512+0000","last_peered":"2024-09-10T07:39:03.007512+0000","last_clean":"2024-09-10T07:39:03.007512+0000","last_became_active":"2024-09-10T07:39:00.302504+0000","last_became_peered":"2024-09-10T07:39:00.302504+0000","last_unstale":"2024-09-10T07:39:03.007512+0000","last_undegraded":"2024-09-10T07:39:03.007512+0000","last_fullsized":"2024-09-10T07:39:03.007512+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:36.260340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.007307+0000","last_change":"2024-09-10T07:39:01.322126+0000","last_active":"2024-09-10T07:39:03.007307+0000","last_peered":"2024-09-10T07:39:03.007307+0000","last_clean":"2024-09-10T07:39:03.007307+0000","last_became_active":"2024-09-10T07:39:01.320788+0000","last_became_peered":"2024-09-10T07:39:01.320788+0000","last_unstale":"2024-09-10T07:39:03.007307+0000","last_undegraded":"2024-09-10T07:39:03.007307+0000","last_fullsized":"2024-09-10T07:39:03.007307+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:32.471954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:03.006717+0000","last_change":"2024-09-10T07:39:00.305818+0000","last_active":"2024-09-10T07:39:03.006717+0000","last_peered":"2024-09-10T07:39:03.006717+0000","last_clean":"2024-09-10T07:39:03.006717+0000","last_became_active":"2024-09-10T07:39:00.305607+0000","last_became_peered":"2024-09-10T07:39:00.305607+0000","last_unstale":"2024-09-10T07:39:03.006717+0000","last_undegraded":"2024-09-10T07:39:03.006717+0000","last_fullsized":"2024-09-10T07:39:03.006717+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:08.924902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.325824+0000","last_change":"2024-09-10T07:39:01.323834+0000","last_active":"2024-09-10T07:39:02.325824+0000","last_peered":"2024-09-10T07:39:02.325824+0000","last_clean":"2024-09-10T07:39:02.325824+0000","last_became_active":"2024-09-10T07:39:01.323565+0000","last_became_peered":"2024-09-10T07:39:01.323565+0000","last_unstale":"2024-09-10T07:39:02.325824+0000","last_undegraded":"2024-09-10T07:39:02.325824+0000","last_fullsized":"2024-09-10T07:39:02.325824+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:00.286612+0000","last_clean_scrub_stamp":"2024-09-10T07:39:00.286612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:38.181675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309851+0000","last_change":"2024-09-10T07:39:00.306783+0000","last_active":"2024-09-10T07:39:02.309851+0000","last_peered":"2024-09-10T07:39:02.309851+0000","last_clean":"2024-09-10T07:39:02.309851+0000","last_became_active":"2024-09-10T07:39:00.306514+0000","last_became_peered":"2024-09-10T07:39:00.306514+0000","last_unstale":"2024-09-10T07:39:02.309851+0000","last_undegraded":"2024-09-10T07:39:02.309851+0000","last_fullsized":"2024-09-10T07:39:02.309851+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:38:59.280992+0000","last_clean_scrub_stamp":"2024-09-10T07:38:59.280992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:43.789537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":330,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-10T07:39:02.309392+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:39:02.309392+0000","last_peered":"2024-09-10T07:39:02.309392+0000","last_clean":"2024-09-10T07:39:02.309392+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:39:02.309392+0000","last_undegraded":"2024-09-10T07:39:02.309392+0000","last_fullsized":"2024-09-10T07:39:02.309392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:00.501878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194200,"statfs":{"total":200000000,"available":198861415,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194775,"statfs":{"total":200000000,"available":199450219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194783,"statfs":{"total":200000000,"available":199458153,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194775,"statfs":{"total":200000000,"available":199450241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194776,"statfs":{"total":200000000,"available":199451271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194777,"statfs":{"total":200000000,"available":199451659,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1111,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194200,"statfs":{"total":200000000,"available":198861451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:39:05.889 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:39:05.889 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T07:39:06.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.085+0000 7f7659c00640 1 Processor -- start 2024-09-10T07:39:06.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.086+0000 7f7659c00640 1 -- start start 2024-09-10T07:39:06.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7659c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f765415aff0 0x7f76540af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7659c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f76540ce830 0x7f765406e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7659c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76540b02c0 con 0x7f76540ce3d0 2024-09-10T07:39:06.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7659c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f765415b3d0 con 0x7f765415aff0 2024-09-10T07:39:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7659c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7654071cf0 con 0x7f76540ce830 2024-09-10T07:39:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7652a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f765415aff0 0x7f76540af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7652a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f765415aff0 0x7f76540af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40588/0 (socket says 172.21.15.99:40588) 2024-09-10T07:39:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7652a00640 1 -- 172.21.15.99:0/4013169559 learned_addr learned my addr 172.21.15.99:0/4013169559 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7653400640 1 --2- 172.21.15.99:0/4013169559 >> v2:172.21.15.187:3300/0 conn(0x7f76540ce830 0x7f765406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7652a00640 1 -- 172.21.15.99:0/4013169559 >> v2:172.21.15.187:3300/0 conn(0x7f76540ce830 msgr2=0x7f765406e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.087+0000 7f7652a00640 1 --2- 172.21.15.99:0/4013169559 >> v2:172.21.15.187:3300/0 conn(0x7f76540ce830 0x7f765406e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.088+0000 7f7652a00640 1 -- 172.21.15.99:0/4013169559 >> v1:172.21.15.187:6789/0 conn(0x7f76540ce3d0 legacy=0x7f7654072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.088+0000 7f7652a00640 1 -- 172.21.15.99:0/4013169559 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76540affe0 con 0x7f765415aff0 2024-09-10T07:39:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.088+0000 7f7652a00640 1 --2- 172.21.15.99:0/4013169559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 0x7f76540af9b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7654071500 tx=0x7f764402c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ff138402bb295 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:06.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7651600640 1 -- 172.21.15.99:0/4013169559 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764403a070 con 0x7f765415aff0 2024-09-10T07:39:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7651600640 1 -- 172.21.15.99:0/4013169559 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7644032480 con 0x7f765415aff0 2024-09-10T07:39:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7651600640 1 -- 172.21.15.99:0/4013169559 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644032850 con 0x7f765415aff0 2024-09-10T07:39:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7659c00640 1 -- 172.21.15.99:0/4013169559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 msgr2=0x7f76540af9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7659c00640 1 --2- 172.21.15.99:0/4013169559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 0x7f76540af9b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7654071500 tx=0x7f764402c690 comp rx=0 tx=0).stop 2024-09-10T07:39:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7659c00640 1 -- 172.21.15.99:0/4013169559 shutdown_connections 2024-09-10T07:39:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7659c00640 1 --2- 172.21.15.99:0/4013169559 >> v2:172.21.15.187:3300/0 conn(0x7f76540ce830 0x7f765406e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7659c00640 1 --2- 172.21.15.99:0/4013169559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 0x7f76540af9b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7659c00640 1 -- 172.21.15.99:0/4013169559 >> 172.21.15.99:0/4013169559 conn(0x7f765406bc10 msgr2=0x7f765406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7659c00640 1 -- 172.21.15.99:0/4013169559 shutdown_connections 2024-09-10T07:39:06.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.089+0000 7f7659c00640 1 -- 172.21.15.99:0/4013169559 wait complete. 2024-09-10T07:39:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.091+0000 7f7659c00640 1 Processor -- start 2024-09-10T07:39:06.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.091+0000 7f7659c00640 1 -- start start 2024-09-10T07:39:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7659c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76540ce3d0 0x7f7654150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7659c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76540ce830 0x7f765414d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7659c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 0x7f765415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7659c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f76540d12c0 con 0x7f765415aff0 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7659c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7654071980 con 0x7f76540ce830 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7659c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7654072890 con 0x7f76540ce3d0 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7653400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 0x7f765415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7653400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 0x7f765415c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40590/0 (socket says 172.21.15.99:40590) 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7653400640 1 -- 172.21.15.99:0/729791971 learned_addr learned my addr 172.21.15.99:0/729791971 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7652000640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76540ce830 0x7f765414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.092+0000 7f7652a00640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76540ce3d0 0x7f7654150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f7653400640 1 -- 172.21.15.99:0/729791971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76540ce3d0 msgr2=0x7f7654150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f7653400640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76540ce3d0 0x7f7654150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f7653400640 1 -- 172.21.15.99:0/729791971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76540ce830 msgr2=0x7f765414d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f7653400640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76540ce830 0x7f765414d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f7653400640 1 -- 172.21.15.99:0/729791971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76541581a0 con 0x7f765415aff0 2024-09-10T07:39:06.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f7653400640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 0x7f765415c210 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f764c009dd0 tx=0x7f764c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:06.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f764aa00640 1 -- 172.21.15.99:0/729791971 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c018020 con 0x7f765415aff0 2024-09-10T07:39:06.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f764aa00640 1 -- 172.21.15.99:0/729791971 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c014480 con 0x7f765415aff0 2024-09-10T07:39:06.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f764aa00640 1 -- 172.21.15.99:0/729791971 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c014870 con 0x7f765415aff0 2024-09-10T07:39:06.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f7659c00640 1 -- 172.21.15.99:0/729791971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7654158480 con 0x7f765415aff0 2024-09-10T07:39:06.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.093+0000 7f7659c00640 1 -- 172.21.15.99:0/729791971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7654158a40 con 0x7f765415aff0 2024-09-10T07:39:06.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.094+0000 7f7659c00640 1 -- 172.21.15.99:0/729791971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76540af9b0 con 0x7f765415aff0 2024-09-10T07:39:06.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.095+0000 7f764aa00640 1 -- 172.21.15.99:0/729791971 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f764c01b020 con 0x7f765415aff0 2024-09-10T07:39:06.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.096+0000 7f764aa00640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f763406be30 0x7f763406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.096+0000 7f764aa00640 1 -- 172.21.15.99:0/729791971 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f764c08bc70 con 0x7f765415aff0 2024-09-10T07:39:06.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.097+0000 7f7652a00640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f763406be30 0x7f763406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.097+0000 7f7652a00640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f763406be30 0x7f763406e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7644037000 tx=0x7f7644030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:06.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.100+0000 7f764aa00640 1 -- 172.21.15.99:0/729791971 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f764c022020 con 0x7f765415aff0 2024-09-10T07:39:06.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.336+0000 7f7659c00640 1 -- 172.21.15.99:0/729791971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f76540cd010 con 0x7f765415aff0 2024-09-10T07:39:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.339+0000 7f764aa00640 1 -- 172.21.15.99:0/729791971 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f764c010040 con 0x7f765415aff0 2024-09-10T07:39:06.340 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:39:06.340 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:39:06.340 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-09-10T07:39:06.340 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-09-10T07:39:06.340 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T07:39:06.340 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-09-10T07:39:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 -- 172.21.15.99:0/729791971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f763406be30 msgr2=0x7f763406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f763406be30 0x7f763406e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7644037000 tx=0x7f7644030000 comp rx=0 tx=0).stop 2024-09-10T07:39:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 -- 172.21.15.99:0/729791971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 msgr2=0x7f765415c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 0x7f765415c210 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f764c009dd0 tx=0x7f764c00c490 comp rx=0 tx=0).stop 2024-09-10T07:39:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 -- 172.21.15.99:0/729791971 shutdown_connections 2024-09-10T07:39:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f763406be30 0x7f763406e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f765415aff0 0x7f765415c210 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76540ce830 0x7f765414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 --2- 172.21.15.99:0/729791971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76540ce3d0 0x7f7654150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 -- 172.21.15.99:0/729791971 >> 172.21.15.99:0/729791971 conn(0x7f765406bc10 msgr2=0x7f76540cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 -- 172.21.15.99:0/729791971 shutdown_connections 2024-09-10T07:39:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.342+0000 7f7659c00640 1 -- 172.21.15.99:0/729791971 wait complete. 2024-09-10T07:39:06.358 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:06.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.511+0000 7f6c72200640 1 Processor -- start 2024-09-10T07:39:06.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.511+0000 7f6c72200640 1 -- start start 2024-09-10T07:39:06.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.512+0000 7f6c72200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 0x7f6c6c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.512+0000 7f6c72200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c6c142650 con 0x7f6c6c13fae0 2024-09-10T07:39:06.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.512+0000 7f6c72200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c6c142930 con 0x7f6c6c160a80 2024-09-10T07:39:06.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.512+0000 7f6c72200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c0ce780 con 0x7f6c6c142150 2024-09-10T07:39:06.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.513+0000 7f6c6b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6c6c13fae0 0x7f6c6c06f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58378/0 (socket says 172.21.15.99:58378) 2024-09-10T07:39:06.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.513+0000 7f6c6b400640 1 -- 172.21.15.99:0/885931103 learned_addr learned my addr 172.21.15.99:0/885931103 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:06.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.513+0000 7f6c6aa00640 1 --2- 172.21.15.99:0/885931103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 0x7f6c6c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.513+0000 7f6c6a000640 1 -- 172.21.15.99:0/885931103 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2526560046 0 0) 0x7f6c6c142650 con 0x7f6c6c13fae0 2024-09-10T07:39:06.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.513+0000 7f6c6a000640 1 -- 172.21.15.99:0/885931103 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c50003520 con 0x7f6c6c13fae0 2024-09-10T07:39:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.513+0000 7f6c6a000640 1 -- 172.21.15.99:0/885931103 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201950925 0 0) 0x7f6c6c142930 con 0x7f6c6c160a80 2024-09-10T07:39:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.513+0000 7f6c6a000640 1 -- 172.21.15.99:0/885931103 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c6c142650 con 0x7f6c6c160a80 2024-09-10T07:39:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.513+0000 7f6c6aa00640 1 -- 172.21.15.99:0/885931103 >> v1:172.21.15.187:6789/0 conn(0x7f6c6c160a80 legacy=0x7f6c6c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.513+0000 7f6c6aa00640 1 -- 172.21.15.99:0/885931103 >> v1:172.21.15.99:6789/0 conn(0x7f6c6c13fae0 legacy=0x7f6c6c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.513+0000 7f6c6aa00640 1 -- 172.21.15.99:0/885931103 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c142c10 con 0x7f6c6c142150 2024-09-10T07:39:06.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.514+0000 7f6c6aa00640 1 --2- 172.21.15.99:0/885931103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 0x7f6c6c160540 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6c580097d0 tx=0x7f6c5802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4f02dde34e8e49b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:06.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.515+0000 7f6c6a000640 1 -- 172.21.15.99:0/885931103 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58037070 con 0x7f6c6c142150 2024-09-10T07:39:06.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.515+0000 7f6c6a000640 1 -- 172.21.15.99:0/885931103 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c58032440 con 0x7f6c6c142150 2024-09-10T07:39:06.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.515+0000 7f6c6a000640 1 -- 172.21.15.99:0/885931103 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c580327f0 con 0x7f6c6c142150 2024-09-10T07:39:06.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.515+0000 7f6c72200640 1 -- 172.21.15.99:0/885931103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 msgr2=0x7f6c6c160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.515+0000 7f6c72200640 1 --2- 172.21.15.99:0/885931103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 0x7f6c6c160540 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6c580097d0 tx=0x7f6c5802a180 comp rx=0 tx=0).stop 2024-09-10T07:39:06.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.515+0000 7f6c72200640 1 -- 172.21.15.99:0/885931103 shutdown_connections 2024-09-10T07:39:06.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.515+0000 7f6c72200640 1 --2- 172.21.15.99:0/885931103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 0x7f6c6c160540 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.515+0000 7f6c72200640 1 -- 172.21.15.99:0/885931103 >> 172.21.15.99:0/885931103 conn(0x7f6c6c06bc10 msgr2=0x7f6c6c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.515+0000 7f6c72200640 1 -- 172.21.15.99:0/885931103 shutdown_connections 2024-09-10T07:39:06.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.515+0000 7f6c72200640 1 -- 172.21.15.99:0/885931103 wait complete. 2024-09-10T07:39:06.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.517+0000 7f6c72200640 1 Processor -- start 2024-09-10T07:39:06.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.517+0000 7f6c72200640 1 -- start start 2024-09-10T07:39:06.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c72200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c6c13fae0 0x7f6c6c13ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c72200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 0x7f6c6c141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c72200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c6c160a80 0x7f6c6c141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c72200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c0cf4a0 con 0x7f6c6c13fae0 2024-09-10T07:39:06.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c72200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c0cf320 con 0x7f6c6c160a80 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c72200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c0cf620 con 0x7f6c6c142150 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c6b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c6c13fae0 0x7f6c6c13ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c6b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c6c13fae0 0x7f6c6c13ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40594/0 (socket says 172.21.15.99:40594) 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c6b400640 1 -- 172.21.15.99:0/3917191898 learned_addr learned my addr 172.21.15.99:0/3917191898 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c6be00640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c6c160a80 0x7f6c6c141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.518+0000 7f6c6aa00640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 0x7f6c6c141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c6b400640 1 -- 172.21.15.99:0/3917191898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 msgr2=0x7f6c6c141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c6b400640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 0x7f6c6c141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c6b400640 1 -- 172.21.15.99:0/3917191898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c6c160a80 msgr2=0x7f6c6c141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c6b400640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c6c160a80 0x7f6c6c141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c6b400640 1 -- 172.21.15.99:0/3917191898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c1f5420 con 0x7f6c6c13fae0 2024-09-10T07:39:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c6be00640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c6c160a80 0x7f6c6c141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:06.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c6b400640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c6c13fae0 0x7f6c6c13ea20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c530 tx=0x7f6c5c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:06.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c63400640 1 -- 172.21.15.99:0/3917191898 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c017070 con 0x7f6c6c13fae0 2024-09-10T07:39:06.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c63400640 1 -- 172.21.15.99:0/3917191898 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c5c005ce0 con 0x7f6c6c13fae0 2024-09-10T07:39:06.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c63400640 1 -- 172.21.15.99:0/3917191898 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c007270 con 0x7f6c6c13fae0 2024-09-10T07:39:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c72200640 1 -- 172.21.15.99:0/3917191898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c15d1a0 con 0x7f6c6c13fae0 2024-09-10T07:39:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.519+0000 7f6c72200640 1 -- 172.21.15.99:0/3917191898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c13ef60 con 0x7f6c6c13fae0 2024-09-10T07:39:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.520+0000 7f6c72200640 1 -- 172.21.15.99:0/3917191898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6c160540 con 0x7f6c6c13fae0 2024-09-10T07:39:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.521+0000 7f6c63400640 1 -- 172.21.15.99:0/3917191898 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c5c01a070 con 0x7f6c6c13fae0 2024-09-10T07:39:06.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.522+0000 7f6c63400640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:06.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.522+0000 7f6c63400640 1 -- 172.21.15.99:0/3917191898 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f6c5c08a180 con 0x7f6c6c13fae0 2024-09-10T07:39:06.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.522+0000 7f6c6aa00640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:06.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.523+0000 7f6c6aa00640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6c58034000 tx=0x7f6c5802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:06.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.526+0000 7f6c63400640 1 -- 172.21.15.99:0/3917191898 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c5c0584d0 con 0x7f6c6c13fae0 2024-09-10T07:39:06.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.734+0000 7f6c72200640 1 -- 172.21.15.99:0/3917191898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c6c15cf50 con 0x7f6c6c13fae0 2024-09-10T07:39:06.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.734+0000 7f6c63400640 1 -- 172.21.15.99:0/3917191898 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7f6c5c05c7d0 con 0x7f6c6c13fae0 2024-09-10T07:39:06.734 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:06.735 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":49,"btime":"2024-09-10T07:39:04:324940+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/224049994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":224049994},{"type":"v1","addr":"172.21.15.187:6834","nonce":224049994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2009047482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2009047482},{"type":"v1","addr":"172.21.15.187:6835","nonce":2009047482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3952584402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3952584402},{"type":"v1","addr":"172.21.15.99:6837","nonce":3952584402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:00.703298+0000","modified":"2024-09-10T07:39:03.726531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/1858150570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1858150570},{"type":"v1","addr":"172.21.15.99:6835","nonce":1858150570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":6}]} 2024-09-10T07:39:06.735 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 49 2024-09-10T07:39:06.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.737+0000 7f6c72200640 1 -- 172.21.15.99:0/3917191898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6c4c06be30 msgr2=0x7f6c4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.737+0000 7f6c72200640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6c58034000 tx=0x7f6c5802e000 comp rx=0 tx=0).stop 2024-09-10T07:39:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.737+0000 7f6c72200640 1 -- 172.21.15.99:0/3917191898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c6c13fae0 msgr2=0x7f6c6c13ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.737+0000 7f6c72200640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c6c13fae0 0x7f6c6c13ea20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c530 tx=0x7f6c5c00c9f0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.737+0000 7f6c72200640 1 -- 172.21.15.99:0/3917191898 shutdown_connections 2024-09-10T07:39:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.737+0000 7f6c72200640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c6c160a80 0x7f6c6c141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.737+0000 7f6c72200640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c6c142150 0x7f6c6c141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.737+0000 7f6c72200640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.737+0000 7f6c72200640 1 --2- 172.21.15.99:0/3917191898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c6c13fae0 0x7f6c6c13ea20 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.737+0000 7f6c72200640 1 -- 172.21.15.99:0/3917191898 >> 172.21.15.99:0/3917191898 conn(0x7f6c6c06bc10 msgr2=0x7f6c6c06f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.738+0000 7f6c72200640 1 -- 172.21.15.99:0/3917191898 shutdown_connections 2024-09-10T07:39:06.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:06.738+0000 7f6c72200640 1 -- 172.21.15.99:0/3917191898 wait complete. 2024-09-10T07:39:07.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:39:00.703298+0000', 'modified': '2024-09-10T07:39:03.726531+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6069}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6069': {'gid': 6069, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6835/1858150570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6834', 'nonce': 1858150570}, {'type': 'v1', 'addr': '172.21.15.99:6835', 'nonce': 1858150570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6069, 'qdb_cluster': [6069]} 2024-09-10T07:39:07.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:39:07.156 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T07:39:07.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.312+0000 7f47c9c00640 1 Processor -- start 2024-09-10T07:39:07.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.312+0000 7f47c9c00640 1 -- start start 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.313+0000 7f47c9c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47c40d3070 0x7f47c40d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.313+0000 7f47c9c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f47c415ed10 0x7f47c40d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.313+0000 7f47c9c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c40cf740 con 0x7f47c40d51a0 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.313+0000 7f47c9c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f47c40d3990 con 0x7f47c40d3070 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.313+0000 7f47c9c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f47c40d08f0 con 0x7f47c415ed10 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.313+0000 7f47c3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47c40d3070 0x7f47c40d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.314+0000 7f47c3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47c40d3070 0x7f47c40d3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40608/0 (socket says 172.21.15.99:40608) 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.314+0000 7f47c3e00640 1 -- 172.21.15.99:0/1603188004 learned_addr learned my addr 172.21.15.99:0/1603188004 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.314+0000 7f47c9200640 1 --1- 172.21.15.99:0/1603188004 >> v1:172.21.15.99:6789/0 conn(0x7f47c40d51a0 0x7f47c40d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58388/0 (socket says 172.21.15.99:58388) 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.314+0000 7f47c3400640 1 --2- 172.21.15.99:0/1603188004 >> v2:172.21.15.187:3300/0 conn(0x7f47c415ed10 0x7f47c40d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.314+0000 7f47c3e00640 1 -- 172.21.15.99:0/1603188004 >> v2:172.21.15.187:3300/0 conn(0x7f47c415ed10 msgr2=0x7f47c40d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.314+0000 7f47c3e00640 1 --2- 172.21.15.99:0/1603188004 >> v2:172.21.15.187:3300/0 conn(0x7f47c415ed10 0x7f47c40d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.314+0000 7f47c3e00640 1 -- 172.21.15.99:0/1603188004 >> v1:172.21.15.99:6789/0 conn(0x7f47c40d51a0 legacy=0x7f47c40d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.314+0000 7f47c3e00640 1 -- 172.21.15.99:0/1603188004 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c40d5910 con 0x7f47c40d3070 2024-09-10T07:39:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.315+0000 7f47c3e00640 1 --2- 172.21.15.99:0/1603188004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 0x7f47c40d3450 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f47c40c8110 tx=0x7f47b402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fd5391ab004ee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.315+0000 7f47c2a00640 1 -- 172.21.15.99:0/1603188004 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4037070 con 0x7f47c40d3070 2024-09-10T07:39:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.315+0000 7f47c2a00640 1 -- 172.21.15.99:0/1603188004 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b402ae50 con 0x7f47c40d3070 2024-09-10T07:39:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.315+0000 7f47c2a00640 1 -- 172.21.15.99:0/1603188004 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4032860 con 0x7f47c40d3070 2024-09-10T07:39:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.316+0000 7f47c9c00640 1 -- 172.21.15.99:0/1603188004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 msgr2=0x7f47c40d3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.316+0000 7f47c9c00640 1 --2- 172.21.15.99:0/1603188004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 0x7f47c40d3450 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f47c40c8110 tx=0x7f47b402a300 comp rx=0 tx=0).stop 2024-09-10T07:39:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.316+0000 7f47c9c00640 1 -- 172.21.15.99:0/1603188004 shutdown_connections 2024-09-10T07:39:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.316+0000 7f47c9c00640 1 --2- 172.21.15.99:0/1603188004 >> v2:172.21.15.187:3300/0 conn(0x7f47c415ed10 0x7f47c40d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.316+0000 7f47c9c00640 1 --2- 172.21.15.99:0/1603188004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 0x7f47c40d3450 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.316+0000 7f47c9c00640 1 -- 172.21.15.99:0/1603188004 >> 172.21.15.99:0/1603188004 conn(0x7f47c409dd60 msgr2=0x7f47c40d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:07.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.316+0000 7f47c9c00640 1 -- 172.21.15.99:0/1603188004 shutdown_connections 2024-09-10T07:39:07.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.316+0000 7f47c9c00640 1 -- 172.21.15.99:0/1603188004 wait complete. 2024-09-10T07:39:07.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.318+0000 7f47c9c00640 1 Processor -- start 2024-09-10T07:39:07.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.318+0000 7f47c9c00640 1 -- start start 2024-09-10T07:39:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c9c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 0x7f47c41566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c9c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c415ed10 0x7f47c40b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c9c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47c40b4080 0x7f47c41f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c9c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f47c40cfcc0 con 0x7f47c40d3070 2024-09-10T07:39:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c9c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f47c40cf9e0 con 0x7f47c415ed10 2024-09-10T07:39:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c9c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f47c40d2ba0 con 0x7f47c40b4080 2024-09-10T07:39:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 0x7f47c41566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 0x7f47c41566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40618/0 (socket says 172.21.15.99:40618) 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c3e00640 1 -- 172.21.15.99:0/3320067491 learned_addr learned my addr 172.21.15.99:0/3320067491 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c9200640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47c40b4080 0x7f47c41f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c3400640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c415ed10 0x7f47c40b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c3e00640 1 -- 172.21.15.99:0/3320067491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47c40b4080 msgr2=0x7f47c41f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c3e00640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47c40b4080 0x7f47c41f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c3e00640 1 -- 172.21.15.99:0/3320067491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c415ed10 msgr2=0x7f47c40b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c3e00640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c415ed10 0x7f47c40b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.319+0000 7f47c3e00640 1 -- 172.21.15.99:0/3320067491 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c4156fd0 con 0x7f47c40d3070 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.320+0000 7f47c3e00640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 0x7f47c41566d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f47b402a340 tx=0x7f47b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.320+0000 7f47bbe00640 1 -- 172.21.15.99:0/3320067491 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4041070 con 0x7f47c40d3070 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.320+0000 7f47bbe00640 1 -- 172.21.15.99:0/3320067491 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b403c670 con 0x7f47c40d3070 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.320+0000 7f47c9c00640 1 -- 172.21.15.99:0/3320067491 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c40b5b10 con 0x7f47c40d3070 2024-09-10T07:39:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.320+0000 7f47bbe00640 1 -- 172.21.15.99:0/3320067491 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4037040 con 0x7f47c40d3070 2024-09-10T07:39:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.320+0000 7f47c9c00640 1 -- 172.21.15.99:0/3320067491 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c40b60d0 con 0x7f47c40d3070 2024-09-10T07:39:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.322+0000 7f47bbe00640 1 -- 172.21.15.99:0/3320067491 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47b4044070 con 0x7f47c40d3070 2024-09-10T07:39:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.323+0000 7f47bbe00640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47a406be30 0x7f47a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.323+0000 7f47bbe00640 1 -- 172.21.15.99:0/3320067491 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f47b40ab8a0 con 0x7f47c40d3070 2024-09-10T07:39:07.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.323+0000 7f47c3400640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47a406be30 0x7f47a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.324+0000 7f47ce20d740 1 Processor -- start 2024-09-10T07:39:07.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.324+0000 7f47ce20d740 1 -- start start 2024-09-10T07:39:07.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.324+0000 7f47c3400640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47a406be30 0x7f47a406e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f47c40cb360 tx=0x7f47b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.324+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950ddea0 0x561295123640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950db660 0x5612950de280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950df630 0x5612950d8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47ce20d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56129503c3b0 con 0x5612950ddea0 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47ce20d740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x561295041410 con 0x5612950df630 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47ce20d740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x561294fe9620 con 0x5612950db660 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950ddea0 0x561295123640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950ddea0 0x561295123640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40634/0 (socket says 172.21.15.99:40634) 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3e00640 1 -- 172.21.15.99:0/2473422852 learned_addr learned my addr 172.21.15.99:0/2473422852 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3400640 1 --2- 172.21.15.99:0/2473422852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950db660 0x5612950de280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c9200640 1 --2- 172.21.15.99:0/2473422852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950df630 0x5612950d8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3e00640 1 -- 172.21.15.99:0/2473422852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950db660 msgr2=0x5612950de280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3e00640 1 --2- 172.21.15.99:0/2473422852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950db660 0x5612950de280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3e00640 1 -- 172.21.15.99:0/2473422852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950df630 msgr2=0x5612950d8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3e00640 1 --2- 172.21.15.99:0/2473422852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950df630 0x5612950d8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3e00640 1 -- 172.21.15.99:0/2473422852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561294d542d0 con 0x5612950ddea0 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3400640 1 --2- 172.21.15.99:0/2473422852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950db660 0x5612950de280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.325+0000 7f47c3e00640 1 --2- 172.21.15.99:0/2473422852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950ddea0 0x561295123640 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f47b4079920 tx=0x7f47b4079730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20ca39b4f62d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47b8c00640 1 -- 172.21.15.99:0/2473422852 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4082840 con 0x5612950ddea0 2024-09-10T07:39:07.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47b8c00640 1 -- 172.21.15.99:0/2473422852 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b402ae50 con 0x5612950ddea0 2024-09-10T07:39:07.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47b8c00640 1 -- 172.21.15.99:0/2473422852 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4076380 con 0x5612950ddea0 2024-09-10T07:39:07.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47ce20d740 1 -- 172.21.15.99:0/2473422852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950ddea0 msgr2=0x561295123640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47ce20d740 1 --2- 172.21.15.99:0/2473422852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950ddea0 0x561295123640 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f47b4079920 tx=0x7f47b4079730 comp rx=0 tx=0).stop 2024-09-10T07:39:07.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47ce20d740 1 -- 172.21.15.99:0/2473422852 shutdown_connections 2024-09-10T07:39:07.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47ce20d740 1 --2- 172.21.15.99:0/2473422852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950df630 0x5612950d8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47ce20d740 1 --2- 172.21.15.99:0/2473422852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950db660 0x5612950de280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47ce20d740 1 --2- 172.21.15.99:0/2473422852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950ddea0 0x561295123640 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47ce20d740 1 -- 172.21.15.99:0/2473422852 >> 172.21.15.99:0/2473422852 conn(0x5612950da8f0 msgr2=0x561295122b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:07.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47ce20d740 1 -- 172.21.15.99:0/2473422852 shutdown_connections 2024-09-10T07:39:07.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.326+0000 7f47ce20d740 1 -- 172.21.15.99:0/2473422852 wait complete. 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.327+0000 7f47ce20d740 1 -- start start 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.327+0000 7f47ce20d740 1 Processor -- start 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.328+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 0x5612951200e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.328+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 0x5612950d87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.328+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x5612950d8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.328+0000 7f47ce20d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561294ffc780 con 0x5612950d75e0 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.328+0000 7f47ce20d740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56129503d3d0 con 0x5612950ddea0 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.328+0000 7f47ce20d740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x56129503c3b0 con 0x5612950df630 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.328+0000 7f47ce20d740 10 client.0 _ll_register_callbacks cb 0x56129503a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x5612950d8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x5612950d8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40646/0 (socket says 172.21.15.99:40646) 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c9200640 1 -- 172.21.15.99:0/3695348493 learned_addr learned my addr 172.21.15.99:0/3695348493 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c3400640 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 0x5612950d87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c3e00640 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 0x5612951200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c9200640 1 -- 172.21.15.99:0/3695348493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 msgr2=0x5612950d87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c9200640 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 0x5612950d87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c9200640 1 -- 172.21.15.99:0/3695348493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 msgr2=0x5612951200e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c9200640 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 0x5612951200e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c9200640 1 -- 172.21.15.99:0/3695348493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561294e1e6b0 con 0x5612950d75e0 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c3400640 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 0x5612950d87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c3e00640 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 0x5612951200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47c9200640 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x5612950d8d20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f47bc004e80 tx=0x7f47bc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b041a35b8993ccef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47ad600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.329+0000 7f47ad600640 1 -- 172.21.15.99:0/3695348493 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc013600 con 0x5612950d75e0 2024-09-10T07:39:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ad600640 1 -- 172.21.15.99:0/3695348493 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f47bc0137a0 con 0x5612950d75e0 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ce20d740 1 -- 172.21.15.99:0/3695348493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47b402ae50 con 0x5612950d75e0 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ad600640 1 -- 172.21.15.99:0/3695348493 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f47bc0139a0 con 0x5612950d75e0 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ce20d740 10 client.6201 fetch_fsmap learned FSMap version 49 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ce20d740 1 -- 172.21.15.99:0/3695348493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) -- 0x5612950d82f0 con 0x5612950d75e0 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ad600640 1 -- 172.21.15.99:0/3695348493 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b402ae50 con 0x5612950d75e0 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ad600640 1 -- 172.21.15.99:0/3695348493 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 49) ==== 3502+0+0 (secure 0 0 0) 0x7f47bc013b40 con 0x5612950d75e0 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ce20d740 10 client.6201 fetch_fsmap finished waiting for FSMap version 49 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ce20d740 10 client.6201 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ce20d740 20 client.6201 populate_metadata read hostname 'smithi099' 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.99:6834/1858150570,v1:172.21.15.99:6835/1858150570] conn(0x561295136530 0x561295107490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ce20d740 4 client.6201 mds_command: new command op to 6069 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.330+0000 7f47ce20d740 1 -- 172.21.15.99:0/3695348493 --> [v2:172.21.15.99:6834/1858150570,v1:172.21.15.99:6835/1858150570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56129504eb40 con 0x561295136530 2024-09-10T07:39:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.331+0000 7f47c3e00640 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.99:6834/1858150570,v1:172.21.15.99:6835/1858150570] conn(0x561295136530 0x561295107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.331+0000 7f47c3e00640 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.99:6834/1858150570,v1:172.21.15.99:6835/1858150570] conn(0x561295136530 0x561295107490 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4c7835e59e81b71 server_cookie=8d2b089f53dc78f4 in_seq=0 out_seq=0 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.331+0000 7f47ad600640 10 client.6201 ms_handle_connect on v2:172.21.15.99:6834/1858150570 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ad600640 1 -- 172.21.15.99:0/3695348493 <== mds.0 v2:172.21.15.99:6834/1858150570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56129504eb40 con 0x561295136530 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ad600640 10 client.6201 handle_command_reply: tid=0 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 client.6201 shutdown 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 -- 172.21.15.99:0/3695348493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 msgr2=0x5612950d8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x5612950d8d20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f47bc004e80 tx=0x7f47bc007430 comp rx=0 tx=0).stop 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 -- 172.21.15.99:0/3695348493 shutdown_connections 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.99:6834/1858150570,v1:172.21.15.99:6835/1858150570] conn(0x561295136530 0x561295107490 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x5612950d8d20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 0x5612950d87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ad600640 0 client.6201 ms_handle_reset on v2:172.21.15.99:6834/1858150570 2024-09-10T07:39:07.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3695348493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 0x5612951200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 -- 172.21.15.99:0/3695348493 >> 172.21.15.99:0/3695348493 conn(0x5612950db660 msgr2=0x561295122100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:07.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 -- 172.21.15.99:0/3695348493 shutdown_connections 2024-09-10T07:39:07.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 1 -- 172.21.15.99:0/3695348493 wait complete. 2024-09-10T07:39:07.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.332+0000 7f47ce20d740 20 client.6201 trim_cache size 0 max 16384 2024-09-10T07:39:07.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.351+0000 7f47ce20d740 1 Processor -- start 2024-09-10T07:39:07.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.351+0000 7f47ce20d740 1 -- start start 2024-09-10T07:39:07.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.352+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295121040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.352+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950ddea0 0x5612951465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.352+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950df630 0x561295146b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.352+0000 7f47ce20d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f47c42001b0 con 0x5612950d75e0 2024-09-10T07:39:07.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.352+0000 7f47ce20d740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f47c40ba230 con 0x5612950df630 2024-09-10T07:39:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.352+0000 7f47ce20d740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f47c40b8c60 con 0x5612950ddea0 2024-09-10T07:39:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.352+0000 7f47c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295121040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295121040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40656/0 (socket says 172.21.15.99:40656) 2024-09-10T07:39:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47c3e00640 1 -- 172.21.15.99:0/1259521355 learned_addr learned my addr 172.21.15.99:0/1259521355 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47c9200640 1 --2- 172.21.15.99:0/1259521355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950df630 0x561295146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47c3400640 1 --2- 172.21.15.99:0/1259521355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950ddea0 0x5612951465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47c3e00640 1 -- 172.21.15.99:0/1259521355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950ddea0 msgr2=0x5612951465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47c3e00640 1 --2- 172.21.15.99:0/1259521355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950ddea0 0x5612951465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47c3e00640 1 -- 172.21.15.99:0/1259521355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950df630 msgr2=0x561295146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47c3e00640 1 --2- 172.21.15.99:0/1259521355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950df630 0x561295146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47c3e00640 1 -- 172.21.15.99:0/1259521355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612951027c0 con 0x5612950d75e0 2024-09-10T07:39:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47c3e00640 1 --2- 172.21.15.99:0/1259521355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295121040 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f47b4079a10 tx=0x7f47b4009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba68d98a89a38def server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47afe00640 1 -- 172.21.15.99:0/1259521355 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4078010 con 0x5612950d75e0 2024-09-10T07:39:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47afe00640 1 -- 172.21.15.99:0/1259521355 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b408c070 con 0x5612950d75e0 2024-09-10T07:39:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.353+0000 7f47afe00640 1 -- 172.21.15.99:0/1259521355 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b40823b0 con 0x5612950d75e0 2024-09-10T07:39:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.354+0000 7f47ce20d740 1 -- 172.21.15.99:0/1259521355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 msgr2=0x561295121040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.354+0000 7f47ce20d740 1 --2- 172.21.15.99:0/1259521355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295121040 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f47b4079a10 tx=0x7f47b4009070 comp rx=0 tx=0).stop 2024-09-10T07:39:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.354+0000 7f47ce20d740 1 -- 172.21.15.99:0/1259521355 shutdown_connections 2024-09-10T07:39:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.354+0000 7f47ce20d740 1 --2- 172.21.15.99:0/1259521355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950df630 0x561295146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.354+0000 7f47ce20d740 1 --2- 172.21.15.99:0/1259521355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950ddea0 0x5612951465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.354+0000 7f47ce20d740 1 --2- 172.21.15.99:0/1259521355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295121040 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.354+0000 7f47ce20d740 1 -- 172.21.15.99:0/1259521355 >> 172.21.15.99:0/1259521355 conn(0x5612950db660 msgr2=0x561295121fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.354+0000 7f47ce20d740 1 -- 172.21.15.99:0/1259521355 shutdown_connections 2024-09-10T07:39:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.354+0000 7f47ce20d740 1 -- 172.21.15.99:0/1259521355 wait complete. 2024-09-10T07:39:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.355+0000 7f47ce20d740 1 -- start start 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.355+0000 7f47ce20d740 1 Processor -- start 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295186b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 0x5612951463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47ce20d740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 0x5612951a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47ce20d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5612951363b0 con 0x5612950d75e0 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47ce20d740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x561295107de0 con 0x5612950ddea0 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47ce20d740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x561295136a00 con 0x5612950df630 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47ce20d740 10 client.0 _ll_register_callbacks cb 0x7f47bc004c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295186b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295186b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40670/0 (socket says 172.21.15.99:40670) 2024-09-10T07:39:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47c3e00640 1 -- 172.21.15.99:0/3699401142 learned_addr learned my addr 172.21.15.99:0/3699401142 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47c3400640 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 0x5612951463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.356+0000 7f47c9200640 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 0x5612951a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47c3e00640 1 -- 172.21.15.99:0/3699401142 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 msgr2=0x5612951a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47c3e00640 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 0x5612951a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47c3e00640 1 -- 172.21.15.99:0/3699401142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 msgr2=0x5612951463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47c3e00640 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 0x5612951463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47c3e00640 1 -- 172.21.15.99:0/3699401142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561295121580 con 0x5612950d75e0 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47c3e00640 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295186b70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f47b40a9d00 tx=0x7f47b4007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db25e2f5bc2eef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47ad600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47ad600640 1 -- 172.21.15.99:0/3699401142 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4096060 con 0x5612950d75e0 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47ad600640 1 -- 172.21.15.99:0/3699401142 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f47b4076380 con 0x5612950d75e0 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47ce20d740 1 -- 172.21.15.99:0/3699401142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47b408c070 con 0x5612950d75e0 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47ad600640 1 -- 172.21.15.99:0/3699401142 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f47b409c050 con 0x5612950d75e0 2024-09-10T07:39:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47ce20d740 10 client.6207 fetch_fsmap learned FSMap version 49 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47ce20d740 1 -- 172.21.15.99:0/3699401142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) -- 0x561295121580 con 0x5612950d75e0 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.357+0000 7f47ad600640 1 -- 172.21.15.99:0/3699401142 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b408c070 con 0x5612950d75e0 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.358+0000 7f47ad600640 1 -- 172.21.15.99:0/3699401142 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 49) ==== 3502+0+0 (secure 0 0 0) 0x7f47b409f020 con 0x5612950d75e0 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.358+0000 7f47ce20d740 10 client.6207 fetch_fsmap finished waiting for FSMap version 49 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.358+0000 7f47ce20d740 10 client.6207 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.358+0000 7f47ce20d740 20 client.6207 populate_metadata read hostname 'smithi099' 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.358+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.99:6834/1858150570,v1:172.21.15.99:6835/1858150570] conn(0x5612951a4df0 0x561295103140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.358+0000 7f47ce20d740 4 client.6207 mds_command: new command op to 6069 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.358+0000 7f47ce20d740 1 -- 172.21.15.99:0/3699401142 --> [v2:172.21.15.99:6834/1858150570,v1:172.21.15.99:6835/1858150570] -- command(tid 0: {"prefix": "status"}) -- 0x561295048e90 con 0x5612951a4df0 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.358+0000 7f47c3400640 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.99:6834/1858150570,v1:172.21.15.99:6835/1858150570] conn(0x5612951a4df0 0x561295103140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.358+0000 7f47ad600640 10 client.6207 ms_handle_connect on v2:172.21.15.99:6834/1858150570 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.358+0000 7f47c3400640 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.99:6834/1858150570,v1:172.21.15.99:6835/1858150570] conn(0x5612951a4df0 0x561295103140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54990b4945053d1f server_cookie=8a77aec9450bbaad in_seq=0 out_seq=0 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ad600640 1 -- 172.21.15.99:0/3699401142 <== mds.0 v2:172.21.15.99:6834/1858150570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561295048e90 con 0x5612951a4df0 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ad600640 10 client.6207 handle_command_reply: tid=0 2024-09-10T07:39:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 client.6207 shutdown 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 -- 172.21.15.99:0/3699401142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 msgr2=0x561295186b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295186b70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f47b40a9d00 tx=0x7f47b4007000 comp rx=0 tx=0).stop 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 -- 172.21.15.99:0/3699401142 shutdown_connections 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.99:6834/1858150570,v1:172.21.15.99:6835/1858150570] conn(0x5612951a4df0 0x561295103140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5612950df630 0x5612951a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5612950ddea0 0x5612951463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ad600640 0 client.6207 ms_handle_reset on v2:172.21.15.99:6834/1858150570 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 --2- 172.21.15.99:0/3699401142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612950d75e0 0x561295186b70 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 -- 172.21.15.99:0/3699401142 >> 172.21.15.99:0/3699401142 conn(0x5612950db660 msgr2=0x5612950d8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 -- 172.21.15.99:0/3699401142 shutdown_connections 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 1 -- 172.21.15.99:0/3699401142 wait complete. 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.359+0000 7f47ce20d740 20 client.6207 trim_cache size 0 max 16384 2024-09-10T07:39:07.364 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 6069, 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 6.0442169479999999, 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 49, 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 101, 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 101, 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 10.597575135 2024-09-10T07:39:07.365 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:39:07.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 -- 172.21.15.99:0/3320067491 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47a406be30 msgr2=0x7f47a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47a406be30 0x7f47a406e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f47c40cb360 tx=0x7f47b0008040 comp rx=0 tx=0).stop 2024-09-10T07:39:07.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 -- 172.21.15.99:0/3320067491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 msgr2=0x7f47c41566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 0x7f47c41566d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f47b402a340 tx=0x7f47b40046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 -- 172.21.15.99:0/3320067491 shutdown_connections 2024-09-10T07:39:07.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47c40b4080 0x7f47c41f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c415ed10 0x7f47c40b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f47a406be30 0x7f47a406e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 --2- 172.21.15.99:0/3320067491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47c40d3070 0x7f47c41566d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 -- 172.21.15.99:0/3320067491 >> 172.21.15.99:0/3320067491 conn(0x7f47c409dd60 msgr2=0x7f47c4162600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:07.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 -- 172.21.15.99:0/3320067491 shutdown_connections 2024-09-10T07:39:07.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.360+0000 7f47c9c00640 1 -- 172.21.15.99:0/3320067491 wait complete. 2024-09-10T07:39:07.376 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:39:07.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.530+0000 7f762b600640 1 Processor -- start 2024-09-10T07:39:07.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.530+0000 7f762b600640 1 -- start start 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.531+0000 7f762b600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7624145290 0x7f762406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.531+0000 7f762b600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7624072f40 0x7f76240b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.531+0000 7f762b600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762406e3d0 con 0x7f76240ce780 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.531+0000 7f762b600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f762406efe0 con 0x7f7624072f40 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.531+0000 7f762b600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f762406e6b0 con 0x7f7624145290 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.532+0000 7f7629600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7624072f40 0x7f76240b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.532+0000 7f7629600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7624072f40 0x7f76240b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40686/0 (socket says 172.21.15.99:40686) 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.532+0000 7f7629600640 1 -- 172.21.15.99:0/675193312 learned_addr learned my addr 172.21.15.99:0/675193312 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.532+0000 7f7628c00640 1 --2- 172.21.15.99:0/675193312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7624145290 0x7f762406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.532+0000 7f7629600640 1 -- 172.21.15.99:0/675193312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7624145290 msgr2=0x7f762406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.532+0000 7f7629600640 1 --2- 172.21.15.99:0/675193312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7624145290 0x7f762406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.532+0000 7f7629600640 1 -- 172.21.15.99:0/675193312 >> v1:172.21.15.187:6789/0 conn(0x7f76240ce780 legacy=0x7f7624072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.532+0000 7f7629600640 1 -- 172.21.15.99:0/675193312 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762406e990 con 0x7f7624072f40 2024-09-10T07:39:07.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.533+0000 7f7629600640 1 --2- 172.21.15.99:0/675193312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624072f40 0x7f76240b3930 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f761c009e50 tx=0x7f761c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9370d1cb5a26c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:07.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.533+0000 7f7623400640 1 -- 172.21.15.99:0/675193312 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c036070 con 0x7f7624072f40 2024-09-10T07:39:07.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.533+0000 7f7623400640 1 -- 172.21.15.99:0/675193312 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c031600 con 0x7f7624072f40 2024-09-10T07:39:07.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.533+0000 7f7623400640 1 -- 172.21.15.99:0/675193312 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c0319d0 con 0x7f7624072f40 2024-09-10T07:39:07.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.534+0000 7f762b600640 1 -- 172.21.15.99:0/675193312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624072f40 msgr2=0x7f76240b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.534+0000 7f762b600640 1 --2- 172.21.15.99:0/675193312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624072f40 0x7f76240b3930 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f761c009e50 tx=0x7f761c02a710 comp rx=0 tx=0).stop 2024-09-10T07:39:07.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.534+0000 7f762b600640 1 -- 172.21.15.99:0/675193312 shutdown_connections 2024-09-10T07:39:07.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.534+0000 7f762b600640 1 --2- 172.21.15.99:0/675193312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624072f40 0x7f76240b3930 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.534+0000 7f762b600640 1 --2- 172.21.15.99:0/675193312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7624145290 0x7f762406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.534+0000 7f762b600640 1 -- 172.21.15.99:0/675193312 >> 172.21.15.99:0/675193312 conn(0x7f762406bc10 msgr2=0x7f762406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:07.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.534+0000 7f762b600640 1 -- 172.21.15.99:0/675193312 shutdown_connections 2024-09-10T07:39:07.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.534+0000 7f762b600640 1 -- 172.21.15.99:0/675193312 wait complete. 2024-09-10T07:39:07.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.536+0000 7f762b600640 1 Processor -- start 2024-09-10T07:39:07.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.536+0000 7f762b600640 1 -- start start 2024-09-10T07:39:07.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f762b600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7624072f40 0x7f762413e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f762b600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76240ce780 0x7f76241511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f762b600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624145290 0x7f76240b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f762b600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f762406df80 con 0x7f7624145290 2024-09-10T07:39:07.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f762b600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7624145670 con 0x7f76240ce780 2024-09-10T07:39:07.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f762b600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f762406e100 con 0x7f7624072f40 2024-09-10T07:39:07.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f7629600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624145290 0x7f76240b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f7629600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624145290 0x7f76240b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40698/0 (socket says 172.21.15.99:40698) 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f7629600640 1 -- 172.21.15.99:0/1739947611 learned_addr learned my addr 172.21.15.99:0/1739947611 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f7628c00640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7624072f40 0x7f762413e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f7623e00640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76240ce780 0x7f76241511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f7629600640 1 -- 172.21.15.99:0/1739947611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7624072f40 msgr2=0x7f762413e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f7629600640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7624072f40 0x7f762413e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f7629600640 1 -- 172.21.15.99:0/1739947611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76240ce780 msgr2=0x7f76241511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f7629600640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76240ce780 0x7f76241511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.537+0000 7f7629600640 1 -- 172.21.15.99:0/1739947611 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76240b4880 con 0x7f7624145290 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.538+0000 7f7629600640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624145290 0x7f76240b4340 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f761c034040 tx=0x7f761c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.538+0000 7f7620c00640 1 -- 172.21.15.99:0/1739947611 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c036050 con 0x7f7624145290 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.538+0000 7f7620c00640 1 -- 172.21.15.99:0/1739947611 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c042070 con 0x7f7624145290 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.538+0000 7f762b600640 1 -- 172.21.15.99:0/1739947611 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76240b5590 con 0x7f7624145290 2024-09-10T07:39:07.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.538+0000 7f7620c00640 1 -- 172.21.15.99:0/1739947611 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c009510 con 0x7f7624145290 2024-09-10T07:39:07.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.538+0000 7f762b600640 1 -- 172.21.15.99:0/1739947611 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762413cb90 con 0x7f7624145290 2024-09-10T07:39:07.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.539+0000 7f762b600640 1 -- 172.21.15.99:0/1739947611 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7624071510 con 0x7f7624145290 2024-09-10T07:39:07.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.540+0000 7f7620c00640 1 -- 172.21.15.99:0/1739947611 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f761c007bd0 con 0x7f7624145290 2024-09-10T07:39:07.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.541+0000 7f7620c00640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f760406be60 0x7f760406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:07.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.541+0000 7f7620c00640 1 -- 172.21.15.99:0/1739947611 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f761c0abb90 con 0x7f7624145290 2024-09-10T07:39:07.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.541+0000 7f7628c00640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f760406be60 0x7f760406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:07.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.542+0000 7f7628c00640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f760406be60 0x7f760406e320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7614006fd0 tx=0x7f7614008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:07.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.545+0000 7f7620c00640 1 -- 172.21.15.99:0/1739947611 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76240b4880 con 0x7f7624145290 2024-09-10T07:39:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.752+0000 7f762b600640 1 -- 172.21.15.99:0/1739947611 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f76240729d0 con 0x7f7624145290 2024-09-10T07:39:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.753+0000 7f7620c00640 1 -- 172.21.15.99:0/1739947611 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) ==== 53+0+73 (secure 0 0 0) 0x7f761c079ee0 con 0x7f7624145290 2024-09-10T07:39:07.753 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:39:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.754+0000 7f762b600640 1 -- 172.21.15.99:0/1739947611 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f760406be60 msgr2=0x7f760406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.754+0000 7f762b600640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f760406be60 0x7f760406e320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7614006fd0 tx=0x7f7614008040 comp rx=0 tx=0).stop 2024-09-10T07:39:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.755+0000 7f762b600640 1 -- 172.21.15.99:0/1739947611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624145290 msgr2=0x7f76240b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.755+0000 7f762b600640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624145290 0x7f76240b4340 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f761c034040 tx=0x7f761c004a40 comp rx=0 tx=0).stop 2024-09-10T07:39:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.755+0000 7f762b600640 1 -- 172.21.15.99:0/1739947611 shutdown_connections 2024-09-10T07:39:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.755+0000 7f762b600640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f760406be60 0x7f760406e320 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.755+0000 7f762b600640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7624145290 0x7f76240b4340 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.755+0000 7f762b600640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76240ce780 0x7f76241511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.755+0000 7f762b600640 1 --2- 172.21.15.99:0/1739947611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7624072f40 0x7f762413e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.755+0000 7f762b600640 1 -- 172.21.15.99:0/1739947611 >> 172.21.15.99:0/1739947611 conn(0x7f762406bc10 msgr2=0x7f76240cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.755+0000 7f762b600640 1 -- 172.21.15.99:0/1739947611 shutdown_connections 2024-09-10T07:39:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:07.755+0000 7f762b600640 1 -- 172.21.15.99:0/1739947611 wait complete. 2024-09-10T07:39:07.771 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:39:07.771 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:39:07.771 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:39:07.771 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:39:07.771 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:39:07.771 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:39:07.771 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:39:07.772 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:39:07.772 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:39:07.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:07.772 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:39:07.808 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:39:07.808 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:39:07.808 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:39:07.808 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:07.808 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:39:07.808 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:07.808 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42480sec preferred_lft 42480sec 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:39:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::1c1f:52ff:fe95:9fbe/64 scope link 2024-09-10T07:39:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:07.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:07.811 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:39:07.902 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:39:07.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:07.905 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:39:07.942 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:39:07.942 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:39:07.942 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:39:07.942 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:39:07.942 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:39:07.943 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:39:07.943 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:39:07.943 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:39:07.943 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:39:07.943 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:39:07.943 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:39:08.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:39:08.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:39:08.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:08.140 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:39:08.175 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:39:08.175 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:39:08.176 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:39:08.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:08.176 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:39:08.273 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:39:08.273 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:39:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:39:08.310 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:39:08.311 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:39:08.386 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:39:08.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:08.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:39:08.575 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:39:08.575 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:39:08.602 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:39:08.602 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:39:08.602 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:39:08.602 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:39:08.603 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:39:08.605 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:39:08.605 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:39:08.605 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:39:08.605 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:39:08.605 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:39:08.608 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:39:08.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:08.608 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:39:08.664 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:39:08.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:39:08.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:39:08.760 INFO:teuthology.orchestra.run.smithi099.stdout:client5486 2024-09-10T07:39:08.761 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:08.761 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:08.797 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:39:08.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.989+0000 7fc3b7800640 1 Processor -- start 2024-09-10T07:39:08.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.989+0000 7fc3b7800640 1 -- start start 2024-09-10T07:39:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.990+0000 7fc3b7800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b015ede0 0x7fc3b00afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.990+0000 7fc3b7800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc3b00cf830 0x7fc3b00b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.990+0000 7fc3b7800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b00b0200 con 0x7fc3b00cfc70 2024-09-10T07:39:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.990+0000 7fc3b7800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b00aec20 con 0x7fc3b00cf830 2024-09-10T07:39:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.990+0000 7fc3b7800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b00aef00 con 0x7fc3b015ede0 2024-09-10T07:39:08.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.991+0000 7fc3a7e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc3b00cf830 0x7fc3b00b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:08.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.991+0000 7fc3b4e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b015ede0 0x7fc3b00afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:08.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.991+0000 7fc3a7e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc3b00cf830 0x7fc3b00b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:52326/0 (socket says 172.21.15.99:52326) 2024-09-10T07:39:08.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.991+0000 7fc3b4e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b015ede0 0x7fc3b00afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:44698/0 (socket says 172.21.15.99:44698) 2024-09-10T07:39:08.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.991+0000 7fc3a7e00640 1 -- 172.21.15.99:0/3136291236 learned_addr learned my addr 172.21.15.99:0/3136291236 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:08.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.992+0000 7fc3afe00640 1 -- 172.21.15.99:0/3136291236 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506393262 0 0) 0x7fc3b00b0200 con 0x7fc3b00cfc70 2024-09-10T07:39:08.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.992+0000 7fc3afe00640 1 -- 172.21.15.99:0/3136291236 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc394003520 con 0x7fc3b00cfc70 2024-09-10T07:39:08.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.992+0000 7fc3b4e00640 1 -- 172.21.15.99:0/3136291236 >> v2:172.21.15.187:3300/0 conn(0x7fc3b00cf830 msgr2=0x7fc3b00b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:08.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.992+0000 7fc3b4e00640 1 --2- 172.21.15.99:0/3136291236 >> v2:172.21.15.187:3300/0 conn(0x7fc3b00cf830 0x7fc3b00b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:08.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.992+0000 7fc3b4e00640 1 -- 172.21.15.99:0/3136291236 >> v1:172.21.15.187:6789/0 conn(0x7fc3b00cfc70 legacy=0x7fc3b0071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:08.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.992+0000 7fc3b4e00640 1 -- 172.21.15.99:0/3136291236 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b00af1e0 con 0x7fc3b015ede0 2024-09-10T07:39:08.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.992+0000 7fc3a7e00640 1 --2- 172.21.15.99:0/3136291236 >> v2:172.21.15.187:3300/0 conn(0x7fc3b00cf830 0x7fc3b00b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.993+0000 7fc3b4e00640 1 --2- 172.21.15.99:0/3136291236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b015ede0 0x7fc3b00afcc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00097a0 tx=0x7fc3a002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57022a9f4274a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.993+0000 7fc3afe00640 1 -- 172.21.15.99:0/3136291236 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0037070 con 0x7fc3b015ede0 2024-09-10T07:39:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.993+0000 7fc3afe00640 1 -- 172.21.15.99:0/3136291236 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a0032440 con 0x7fc3b015ede0 2024-09-10T07:39:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.993+0000 7fc3afe00640 1 -- 172.21.15.99:0/3136291236 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0032810 con 0x7fc3b015ede0 2024-09-10T07:39:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.993+0000 7fc3b7800640 1 -- 172.21.15.99:0/3136291236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b015ede0 msgr2=0x7fc3b00afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.993+0000 7fc3b7800640 1 --2- 172.21.15.99:0/3136291236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b015ede0 0x7fc3b00afcc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00097a0 tx=0x7fc3a002a180 comp rx=0 tx=0).stop 2024-09-10T07:39:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.994+0000 7fc3b7800640 1 -- 172.21.15.99:0/3136291236 shutdown_connections 2024-09-10T07:39:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.994+0000 7fc3b7800640 1 --2- 172.21.15.99:0/3136291236 >> v2:172.21.15.187:3300/0 conn(0x7fc3b00cf830 0x7fc3b00b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.994+0000 7fc3b7800640 1 --2- 172.21.15.99:0/3136291236 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b015ede0 0x7fc3b00afcc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.994+0000 7fc3b7800640 1 -- 172.21.15.99:0/3136291236 >> 172.21.15.99:0/3136291236 conn(0x7fc3b006bc10 msgr2=0x7fc3b006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.994+0000 7fc3b7800640 1 -- 172.21.15.99:0/3136291236 shutdown_connections 2024-09-10T07:39:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.994+0000 7fc3b7800640 1 -- 172.21.15.99:0/3136291236 wait complete. 2024-09-10T07:39:08.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.995+0000 7fc3b7800640 1 Processor -- start 2024-09-10T07:39:08.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.995+0000 7fc3b7800640 1 -- start start 2024-09-10T07:39:08.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.996+0000 7fc3b7800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b00cf830 0x7fc3b0156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:08.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.996+0000 7fc3b7800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b00cfc70 0x7fc3b0152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:08.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.996+0000 7fc3b7800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b015ede0 0x7fc3b015d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:08.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.996+0000 7fc3b7800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b00ae840 con 0x7fc3b015ede0 2024-09-10T07:39:08.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.996+0000 7fc3b7800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b00af7a0 con 0x7fc3b00cf830 2024-09-10T07:39:08.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.996+0000 7fc3b7800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b00ae9c0 con 0x7fc3b00cfc70 2024-09-10T07:39:08.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.996+0000 7fc3b5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b015ede0 0x7fc3b015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:08.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3b5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b015ede0 0x7fc3b015d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40712/0 (socket says 172.21.15.99:40712) 2024-09-10T07:39:08.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3b5800640 1 -- 172.21.15.99:0/945724102 learned_addr learned my addr 172.21.15.99:0/945724102 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:08.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3b4e00640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b00cf830 0x7fc3b0156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:08.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3a7e00640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b00cfc70 0x7fc3b0152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:08.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3b5800640 1 -- 172.21.15.99:0/945724102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b00cfc70 msgr2=0x7fc3b0152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:08.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3b5800640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b00cfc70 0x7fc3b0152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:08.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3b5800640 1 -- 172.21.15.99:0/945724102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b00cf830 msgr2=0x7fc3b0156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:08.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3b5800640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b00cf830 0x7fc3b0156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:08.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3b5800640 1 -- 172.21.15.99:0/945724102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b0156780 con 0x7fc3b015ede0 2024-09-10T07:39:08.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3a7e00640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b00cfc70 0x7fc3b0152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:08.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3b5800640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b015ede0 0x7fc3b015d350 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800c7c0 tx=0x7fc3a800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:08.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.997+0000 7fc3ad600640 1 -- 172.21.15.99:0/945724102 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8003b70 con 0x7fc3b015ede0 2024-09-10T07:39:08.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.998+0000 7fc3ad600640 1 -- 172.21.15.99:0/945724102 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a8003d10 con 0x7fc3b015ede0 2024-09-10T07:39:08.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.998+0000 7fc3ad600640 1 -- 172.21.15.99:0/945724102 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a800aa50 con 0x7fc3b015ede0 2024-09-10T07:39:08.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.998+0000 7fc3b7800640 1 -- 172.21.15.99:0/945724102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b01528c0 con 0x7fc3b015ede0 2024-09-10T07:39:08.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.998+0000 7fc3b7800640 1 -- 172.21.15.99:0/945724102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b0159ec0 con 0x7fc3b015ede0 2024-09-10T07:39:08.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:08.999+0000 7fc3b7800640 1 -- 172.21.15.99:0/945724102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b00afcc0 con 0x7fc3b015ede0 2024-09-10T07:39:08.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.000+0000 7fc3ad600640 1 -- 172.21.15.99:0/945724102 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3a800abf0 con 0x7fc3b015ede0 2024-09-10T07:39:09.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.000+0000 7fc3ad600640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc38c06be30 0x7fc38c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:09.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.001+0000 7fc3ad600640 1 -- 172.21.15.99:0/945724102 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5738+0+0 (secure 0 0 0) 0x7fc3a808ad20 con 0x7fc3b015ede0 2024-09-10T07:39:09.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.001+0000 7fc3b4e00640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc38c06be30 0x7fc38c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:09.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.001+0000 7fc3b4e00640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc38c06be30 0x7fc38c06e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0034000 tx=0x7fc3a002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:09.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.005+0000 7fc3ad600640 1 -- 172.21.15.99:0/945724102 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3b01528c0 con 0x7fc3b015ede0 2024-09-10T07:39:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.211+0000 7fc3b7800640 1 -- 172.21.15.99:0/945724102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc3b006e020 con 0x7fc3b015ede0 2024-09-10T07:39:09.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.211+0000 7fc3ad600640 1 -- 172.21.15.99:0/945724102 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) ==== 53+0+73 (secure 0 0 0) 0x7fc3a8059740 con 0x7fc3b015ede0 2024-09-10T07:39:09.212 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:39:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.213+0000 7fc3b7800640 1 -- 172.21.15.99:0/945724102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc38c06be30 msgr2=0x7fc38c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc38c06be30 0x7fc38c06e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0034000 tx=0x7fc3a002e000 comp rx=0 tx=0).stop 2024-09-10T07:39:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 -- 172.21.15.99:0/945724102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b015ede0 msgr2=0x7fc3b015d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b015ede0 0x7fc3b015d350 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800c7c0 tx=0x7fc3a800cc80 comp rx=0 tx=0).stop 2024-09-10T07:39:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 -- 172.21.15.99:0/945724102 shutdown_connections 2024-09-10T07:39:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc38c06be30 0x7fc38c06e2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b015ede0 0x7fc3b015d350 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b00cfc70 0x7fc3b0152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 --2- 172.21.15.99:0/945724102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b00cf830 0x7fc3b0156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 -- 172.21.15.99:0/945724102 >> 172.21.15.99:0/945724102 conn(0x7fc3b006bc10 msgr2=0x7fc3b006d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:09.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 -- 172.21.15.99:0/945724102 shutdown_connections 2024-09-10T07:39:09.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:09.214+0000 7fc3b7800640 1 -- 172.21.15.99:0/945724102 wait complete. 2024-09-10T07:39:09.230 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:39:09.230 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:39:09.230 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:39:09.230 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:39:09.230 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:39:09.230 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:39:09.230 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:39:09.230 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:39:09.230 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:39:09.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:09.230 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:39:09.270 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:09.271 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42475sec preferred_lft 42475sec 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:09.272 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:39:09.273 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:39:09.273 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:39:09.273 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:09.273 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:39:09.273 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:39:09.273 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::84a0:e5ff:fe75:1d2e/64 scope link 2024-09-10T07:39:09.273 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:09.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:09.274 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:39:09.374 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:39:09.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:09.378 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:39:09.415 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:39:09.415 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:39:09.415 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:39:09.415 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:39:09.416 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:39:09.416 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:39:09.416 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:39:09.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:39:09.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:39:09.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:39:09.416 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:39:09.533 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:39:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:39:09.603 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:39:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:39:09.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:09.611 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:39:09.646 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:39:09.646 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:39:09.646 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:39:09.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:09.646 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:39:09.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:39:09.744 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:39:09.779 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:39:09.779 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:39:09.779 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:39:09.855 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:39:09.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:09.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:39:09.985 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:39:09.985 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:39:10.011 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:39:10.011 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:39:10.011 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:39:10.011 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:39:10.011 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:39:10.014 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:39:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:39:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:39:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:39:10.014 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:39:10.017 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:39:10.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:10.017 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:39:10.072 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:39:10.149 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:39:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:39:10.153 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:39:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:39:10.160 INFO:teuthology.orchestra.run.smithi187.stdout:client5495 2024-09-10T07:39:10.160 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:39:10.161 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:10.196 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:10.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.361+0000 7fe7f7e00640 1 Processor -- start 2024-09-10T07:39:10.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.361+0000 7fe7f7e00640 1 -- start start 2024-09-10T07:39:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.362+0000 7fe7f7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7f80c9710 0x7fe7f81695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.362+0000 7fe7f7e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f80d2bd0 con 0x7fe7f80d2680 2024-09-10T07:39:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.362+0000 7fe7f7e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f80d2eb0 con 0x7fe7f815e970 2024-09-10T07:39:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.362+0000 7fe7f7e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f80d37e0 con 0x7fe7f80c9710 2024-09-10T07:39:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.362+0000 7fe7f7400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7f80c9710 0x7fe7f81695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.362+0000 7fe7f6000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe7f80d2680 0x7fe7f80cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56750/0 (socket says 172.21.15.99:56750) 2024-09-10T07:39:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.362+0000 7fe7f6000640 1 -- 172.21.15.99:0/1593384109 learned_addr learned my addr 172.21.15.99:0/1593384109 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.363+0000 7fe7f7400640 1 -- 172.21.15.99:0/1593384109 >> v1:172.21.15.187:6789/0 conn(0x7fe7f815e970 legacy=0x7fe7f80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.363+0000 7fe7f7400640 1 -- 172.21.15.99:0/1593384109 >> v1:172.21.15.99:6789/0 conn(0x7fe7f80d2680 legacy=0x7fe7f80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.363+0000 7fe7f7400640 1 -- 172.21.15.99:0/1593384109 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f80d3190 con 0x7fe7f80c9710 2024-09-10T07:39:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.364+0000 7fe7f7400640 1 --2- 172.21.15.99:0/1593384109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80c9710 0x7fe7f81695e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80d3960 tx=0x7fe7f002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8690d3b90237340d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.364+0000 7fe7f5600640 1 -- 172.21.15.99:0/1593384109 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0037070 con 0x7fe7f80c9710 2024-09-10T07:39:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.364+0000 7fe7f5600640 1 -- 172.21.15.99:0/1593384109 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f0007740 con 0x7fe7f80c9710 2024-09-10T07:39:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.364+0000 7fe7f5600640 1 -- 172.21.15.99:0/1593384109 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0007b10 con 0x7fe7f80c9710 2024-09-10T07:39:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.364+0000 7fe7f7e00640 1 -- 172.21.15.99:0/1593384109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80c9710 msgr2=0x7fe7f81695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.364+0000 7fe7f7e00640 1 --2- 172.21.15.99:0/1593384109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80c9710 0x7fe7f81695e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80d3960 tx=0x7fe7f002a780 comp rx=0 tx=0).stop 2024-09-10T07:39:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.365+0000 7fe7f7e00640 1 -- 172.21.15.99:0/1593384109 shutdown_connections 2024-09-10T07:39:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.365+0000 7fe7f7e00640 1 --2- 172.21.15.99:0/1593384109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80c9710 0x7fe7f81695e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.365+0000 7fe7f7e00640 1 -- 172.21.15.99:0/1593384109 >> 172.21.15.99:0/1593384109 conn(0x7fe7f809de00 msgr2=0x7fe7f80d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.365+0000 7fe7f7e00640 1 -- 172.21.15.99:0/1593384109 shutdown_connections 2024-09-10T07:39:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.365+0000 7fe7f7e00640 1 -- 172.21.15.99:0/1593384109 wait complete. 2024-09-10T07:39:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.366+0000 7fe7f7e00640 1 Processor -- start 2024-09-10T07:39:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.366+0000 7fe7f7e00640 1 -- start start 2024-09-10T07:39:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.367+0000 7fe7f7e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7f80c9710 0x7fe7f815b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.367+0000 7fe7f7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80d2680 0x7fe7f80ba260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.367+0000 7fe7f7e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7f815e970 0x7fe7f80cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.367+0000 7fe7f7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f815eed0 con 0x7fe7f80d2680 2024-09-10T07:39:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.367+0000 7fe7f7e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f815ed50 con 0x7fe7f80c9710 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.367+0000 7fe7f7e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f80cfc90 con 0x7fe7f815e970 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.367+0000 7fe7f6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80d2680 0x7fe7f80ba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80d2680 0x7fe7f80ba260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48204/0 (socket says 172.21.15.99:48204) 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f6000640 1 -- 172.21.15.99:0/622939926 learned_addr learned my addr 172.21.15.99:0/622939926 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f7400640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7f815e970 0x7fe7f80cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f6a00640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7f80c9710 0x7fe7f815b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f6000640 1 -- 172.21.15.99:0/622939926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7f815e970 msgr2=0x7fe7f80cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f6000640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7f815e970 0x7fe7f80cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f6000640 1 -- 172.21.15.99:0/622939926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7f80c9710 msgr2=0x7fe7f815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f6000640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7f80c9710 0x7fe7f815b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f6000640 1 -- 172.21.15.99:0/622939926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f815a240 con 0x7fe7f80d2680 2024-09-10T07:39:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f6a00640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7f80c9710 0x7fe7f815b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f6000640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80d2680 0x7fe7f80ba260 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400c4d0 tx=0x7fe7e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7ef400640 1 -- 172.21.15.99:0/622939926 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4017070 con 0x7fe7f80d2680 2024-09-10T07:39:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7ef400640 1 -- 172.21.15.99:0/622939926 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e4005ce0 con 0x7fe7f80d2680 2024-09-10T07:39:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7ef400640 1 -- 172.21.15.99:0/622939926 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4007270 con 0x7fe7f80d2680 2024-09-10T07:39:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.368+0000 7fe7f7e00640 1 -- 172.21.15.99:0/622939926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f815a510 con 0x7fe7f80d2680 2024-09-10T07:39:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.369+0000 7fe7f7e00640 1 -- 172.21.15.99:0/622939926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f815ad50 con 0x7fe7f80d2680 2024-09-10T07:39:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.370+0000 7fe7f7e00640 1 -- 172.21.15.99:0/622939926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f80cf580 con 0x7fe7f80d2680 2024-09-10T07:39:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.371+0000 7fe7ef400640 1 -- 172.21.15.99:0/622939926 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe7e401a070 con 0x7fe7f80d2680 2024-09-10T07:39:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.371+0000 7fe7ef400640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7d806be30 0x7fe7d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.372+0000 7fe7ef400640 1 -- 172.21.15.99:0/622939926 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5738+0+0 (secure 0 0 0) 0x7fe7e408a140 con 0x7fe7f80d2680 2024-09-10T07:39:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.372+0000 7fe7f6a00640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7d806be30 0x7fe7d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:10.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.372+0000 7fe7f6a00640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7d806be30 0x7fe7d806e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8001660 tx=0x7fe7e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:10.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.376+0000 7fe7ef400640 1 -- 172.21.15.99:0/622939926 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7f815a510 con 0x7fe7f80d2680 2024-09-10T07:39:10.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.584+0000 7fe7f7e00640 1 -- 172.21.15.99:0/622939926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7f80ca070 con 0x7fe7f80d2680 2024-09-10T07:39:10.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.585+0000 7fe7ef400640 1 -- 172.21.15.99:0/622939926 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7fe7e40583e0 con 0x7fe7f80d2680 2024-09-10T07:39:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:10.585 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":49,"btime":"2024-09-10T07:39:04:324940+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/224049994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":224049994},{"type":"v1","addr":"172.21.15.187:6834","nonce":224049994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2009047482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2009047482},{"type":"v1","addr":"172.21.15.187:6835","nonce":2009047482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3952584402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3952584402},{"type":"v1","addr":"172.21.15.99:6837","nonce":3952584402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:00.703298+0000","modified":"2024-09-10T07:39:03.726531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/1858150570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1858150570},{"type":"v1","addr":"172.21.15.99:6835","nonce":1858150570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":6}]} 2024-09-10T07:39:10.585 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 49 2024-09-10T07:39:10.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 -- 172.21.15.99:0/622939926 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7d806be30 msgr2=0x7fe7d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:10.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7d806be30 0x7fe7d806e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8001660 tx=0x7fe7e8009040 comp rx=0 tx=0).stop 2024-09-10T07:39:10.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 -- 172.21.15.99:0/622939926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80d2680 msgr2=0x7fe7f80ba260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:10.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80d2680 0x7fe7f80ba260 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400c4d0 tx=0x7fe7e400c990 comp rx=0 tx=0).stop 2024-09-10T07:39:10.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 -- 172.21.15.99:0/622939926 shutdown_connections 2024-09-10T07:39:10.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7f815e970 0x7fe7f80cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:10.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe7d806be30 0x7fe7d806e2f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:10.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7f80d2680 0x7fe7f80ba260 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:10.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 --2- 172.21.15.99:0/622939926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7f80c9710 0x7fe7f815b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:10.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 -- 172.21.15.99:0/622939926 >> 172.21.15.99:0/622939926 conn(0x7fe7f809de00 msgr2=0x7fe7f815d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:10.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 -- 172.21.15.99:0/622939926 shutdown_connections 2024-09-10T07:39:10.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:10.587+0000 7fe7f7e00640 1 -- 172.21.15.99:0/622939926 wait complete. 2024-09-10T07:39:10.602 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:39:10.777 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":6069,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.4505770770000002,"mdsmap_epoch":49,"osdmap_epoch":103,"osdmap_epoch_barrier":101,"uptime":14.003935534} 2024-09-10T07:39:10.778 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 6069, "mdsmap_epoch": 49, "osdmap_epoch": 103, "osdmap_epoch_barrier": 101, "rank_uptime": 9.450577077, "state": "up:active", "uptime": 14.003935534, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:39:10.778 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-10T07:39:10.947 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_mon_report_interval":"5"} 2024-09-10T07:39:10.947 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-10T07:39:10.947 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-10T07:39:10.947 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:10.947 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:10.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:10.983 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-10T07:39:12.947 INFO:teuthology.orchestra.run.smithi099.stderr:265+0 records in 2024-09-10T07:39:12.947 INFO:teuthology.orchestra.run.smithi099.stderr:265+0 records out 2024-09-10T07:39:12.947 INFO:teuthology.orchestra.run.smithi099.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.88594 s, 147 MB/s 2024-09-10T07:39:12.948 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:12.948 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:12.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:12.985 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-10T07:39:15.162 INFO:teuthology.orchestra.run.smithi099.stderr:292+0 records in 2024-09-10T07:39:15.162 INFO:teuthology.orchestra.run.smithi099.stderr:292+0 records out 2024-09-10T07:39:15.162 INFO:teuthology.orchestra.run.smithi099.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.10026 s, 146 MB/s 2024-09-10T07:39:15.163 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-10T07:39:15.163 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:39:15.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.317+0000 7f5de0a00640 1 Processor -- start 2024-09-10T07:39:15.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.317+0000 7f5de0a00640 1 -- start start 2024-09-10T07:39:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.318+0000 7f5de0a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c960 0x7f5ddc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.318+0000 7f5de0a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ddc06d920 con 0x7f5ddc15c580 2024-09-10T07:39:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.318+0000 7f5de0a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ddc06dc00 con 0x7f5ddc0b5960 2024-09-10T07:39:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.318+0000 7f5de0a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5ddc0b3930 con 0x7f5ddc15c960 2024-09-10T07:39:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.318+0000 7f5ddb400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5ddc15c580 0x7f5ddc0cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56754/0 (socket says 172.21.15.99:56754) 2024-09-10T07:39:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.318+0000 7f5ddb400640 1 -- 172.21.15.99:0/1067910297 learned_addr learned my addr 172.21.15.99:0/1067910297 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:15.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.318+0000 7f5dd2a00640 1 --2- 172.21.15.99:0/1067910297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c960 0x7f5ddc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.319+0000 7f5ddaa00640 1 -- 172.21.15.99:0/1067910297 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2727431020 0 0) 0x7f5ddc06d920 con 0x7f5ddc15c580 2024-09-10T07:39:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.319+0000 7f5ddaa00640 1 -- 172.21.15.99:0/1067910297 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dc0003520 con 0x7f5ddc15c580 2024-09-10T07:39:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.319+0000 7f5ddaa00640 1 -- 172.21.15.99:0/1067910297 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998205066 0 0) 0x7f5ddc06dc00 con 0x7f5ddc0b5960 2024-09-10T07:39:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.319+0000 7f5ddaa00640 1 -- 172.21.15.99:0/1067910297 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ddc06d920 con 0x7f5ddc0b5960 2024-09-10T07:39:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.319+0000 7f5dd2a00640 1 -- 172.21.15.99:0/1067910297 >> v1:172.21.15.187:6789/0 conn(0x7f5ddc0b5960 legacy=0x7f5ddc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:15.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.319+0000 7f5dd2a00640 1 -- 172.21.15.99:0/1067910297 >> v1:172.21.15.99:6789/0 conn(0x7f5ddc15c580 legacy=0x7f5ddc0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.319+0000 7f5dd2a00640 1 -- 172.21.15.99:0/1067910297 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ddc06dee0 con 0x7f5ddc15c960 2024-09-10T07:39:15.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.320+0000 7f5dd2a00640 1 --2- 172.21.15.99:0/1067910297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c960 0x7f5ddc06d340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009dc0 tx=0x7f5dc402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=785bd921caaaed88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.320+0000 7f5ddaa00640 1 -- 172.21.15.99:0/1067910297 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4007740 con 0x7f5ddc15c960 2024-09-10T07:39:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.320+0000 7f5ddaa00640 1 -- 172.21.15.99:0/1067910297 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc40078e0 con 0x7f5ddc15c960 2024-09-10T07:39:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.320+0000 7f5ddaa00640 1 -- 172.21.15.99:0/1067910297 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4007cb0 con 0x7f5ddc15c960 2024-09-10T07:39:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.321+0000 7f5de0a00640 1 -- 172.21.15.99:0/1067910297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c960 msgr2=0x7f5ddc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.321+0000 7f5de0a00640 1 --2- 172.21.15.99:0/1067910297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c960 0x7f5ddc06d340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009dc0 tx=0x7f5dc402a6d0 comp rx=0 tx=0).stop 2024-09-10T07:39:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.321+0000 7f5de0a00640 1 -- 172.21.15.99:0/1067910297 shutdown_connections 2024-09-10T07:39:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.321+0000 7f5de0a00640 1 --2- 172.21.15.99:0/1067910297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c960 0x7f5ddc06d340 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.321+0000 7f5de0a00640 1 -- 172.21.15.99:0/1067910297 >> 172.21.15.99:0/1067910297 conn(0x7f5ddc0b2810 msgr2=0x7f5ddc0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.321+0000 7f5de0a00640 1 -- 172.21.15.99:0/1067910297 shutdown_connections 2024-09-10T07:39:15.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.321+0000 7f5de0a00640 1 -- 172.21.15.99:0/1067910297 wait complete. 2024-09-10T07:39:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.322+0000 7f5de0a00640 1 Processor -- start 2024-09-10T07:39:15.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.323+0000 7f5de0a00640 1 -- start start 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.323+0000 7f5de0a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ddc0b5960 0x7f5ddc1f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.323+0000 7f5de0a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c580 0x7f5ddc1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.323+0000 7f5de0a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ddc141050 0x7f5ddc151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.323+0000 7f5de0a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc06c320 con 0x7f5ddc0b5960 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.323+0000 7f5de0a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc0b5d60 con 0x7f5ddc141050 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.323+0000 7f5de0a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5ddc06c4a0 con 0x7f5ddc15c580 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ddc0b5960 0x7f5ddc1f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ddc0b5960 0x7f5ddc1f3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48208/0 (socket says 172.21.15.99:48208) 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddb400640 1 -- 172.21.15.99:0/991287301 learned_addr learned my addr 172.21.15.99:0/991287301 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddbe00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ddc141050 0x7f5ddc151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5dd2a00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c580 0x7f5ddc1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:15.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddb400640 1 -- 172.21.15.99:0/991287301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c580 msgr2=0x7f5ddc1514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddb400640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c580 0x7f5ddc1514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddb400640 1 -- 172.21.15.99:0/991287301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ddc141050 msgr2=0x7f5ddc151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddb400640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ddc141050 0x7f5ddc151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddb400640 1 -- 172.21.15.99:0/991287301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ddc141510 con 0x7f5ddc0b5960 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddbe00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ddc141050 0x7f5ddc151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.324+0000 7f5ddb400640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ddc0b5960 0x7f5ddc1f3370 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c530 tx=0x7f5dcc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.325+0000 7f5dd3e00640 1 -- 172.21.15.99:0/991287301 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc017070 con 0x7f5ddc0b5960 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.325+0000 7f5dd3e00640 1 -- 172.21.15.99:0/991287301 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dcc005ce0 con 0x7f5ddc0b5960 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.325+0000 7f5dd3e00640 1 -- 172.21.15.99:0/991287301 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc007270 con 0x7f5ddc0b5960 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.325+0000 7f5de0a00640 1 -- 172.21.15.99:0/991287301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ddc1417f0 con 0x7f5ddc0b5960 2024-09-10T07:39:15.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.325+0000 7f5de0a00640 1 -- 172.21.15.99:0/991287301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ddc141db0 con 0x7f5ddc0b5960 2024-09-10T07:39:15.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.326+0000 7f5de0a00640 1 -- 172.21.15.99:0/991287301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ddc06d340 con 0x7f5ddc0b5960 2024-09-10T07:39:15.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.327+0000 7f5dd3e00640 1 -- 172.21.15.99:0/991287301 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5dcc01a070 con 0x7f5ddc0b5960 2024-09-10T07:39:15.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.327+0000 7f5dd3e00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5db806be60 0x7f5db806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:15.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.328+0000 7f5dd3e00640 1 -- 172.21.15.99:0/991287301 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5738+0+0 (secure 0 0 0) 0x7f5dcc08a1c0 con 0x7f5ddc0b5960 2024-09-10T07:39:15.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.328+0000 7f5dd2a00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5db806be60 0x7f5db806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:15.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.328+0000 7f5dd2a00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5db806be60 0x7f5db806e320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4034000 tx=0x7f5dc4033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:15.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.332+0000 7f5dd3e00640 1 -- 172.21.15.99:0/991287301 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5dcc058460 con 0x7f5ddc0b5960 2024-09-10T07:39:15.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.507+0000 7f5de0a00640 1 -- 172.21.15.99:0/991287301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f5ddc15f9b0 con 0x7f5ddc0b5960 2024-09-10T07:39:15.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.508+0000 7f5dd3e00640 1 -- 172.21.15.99:0/991287301 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v103) ==== 81+0+34423 (secure 0 0 0) 0x7f5dcc05c760 con 0x7f5ddc0b5960 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 103, 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:39:09.348371+0000", 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:39:15.509 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 13, 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "luminous", 2024-09-10T07:39:15.510 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:15.511 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:15.512 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "92", 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:15.513 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:15.514 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:15.515 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:15.516 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:39:15.516 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:39:15.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.516 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:15.516 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:39:15.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:15.517 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 12, 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:58.485547+0000", 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:15.518 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:15.519 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "100", 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:15.520 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:15.521 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:15.522 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 13, 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:59.701338+0000", 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:15.525 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:15.526 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:15.527 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:15.527 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:15.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.527 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "101", 2024-09-10T07:39:15.527 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:15.527 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:15.527 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:15.527 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:15.527 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:15.528 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:15.529 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:39:15.530 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:15.532 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.533 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:15.537 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.540 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.541 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:15.543 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.545 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.546 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:15.548 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.549 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.550 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.551 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:39:15.553 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:15.554 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 102, 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:15.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:39:15.556 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:15.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:15.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:15.559 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:15.560 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.561 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.562 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:39:15.570 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:15.571 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.572 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:39:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:39:15.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:15.577 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:39:15.578 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:15.579 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:15.580 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.581 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [ 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "13.3b", 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:39:15.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 1, 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 3 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:39:15.583 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:39:15.584 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:39:15.585 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:39:15.585 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:39:15.585 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:15.585 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 -- 172.21.15.99:0/991287301 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5db806be60 msgr2=0x7f5db806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5db806be60 0x7f5db806e320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4034000 tx=0x7f5dc4033040 comp rx=0 tx=0).stop 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 -- 172.21.15.99:0/991287301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ddc0b5960 msgr2=0x7f5ddc1f3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ddc0b5960 0x7f5ddc1f3370 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c530 tx=0x7f5dcc00c9f0 comp rx=0 tx=0).stop 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 -- 172.21.15.99:0/991287301 shutdown_connections 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ddc141050 0x7f5ddc151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ddc15c580 0x7f5ddc1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5db806be60 0x7f5db806e320 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 --2- 172.21.15.99:0/991287301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ddc0b5960 0x7f5ddc1f3370 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 -- 172.21.15.99:0/991287301 >> 172.21.15.99:0/991287301 conn(0x7f5ddc0b2810 msgr2=0x7f5ddc0b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 -- 172.21.15.99:0/991287301 shutdown_connections 2024-09-10T07:39:15.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:15.511+0000 7f5de0a00640 1 -- 172.21.15.99:0/991287301 wait complete. 2024-09-10T07:39:15.588 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:39:16.825 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:39:16.825+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-10T07:39:17.050 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:39:17.055 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:39:20.589 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:39:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.754+0000 7f95a7400640 1 Processor -- start 2024-09-10T07:39:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.754+0000 7f95a7400640 1 -- start start 2024-09-10T07:39:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.755+0000 7f95a7400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a0152210 0x7f95a0071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.755+0000 7f95a7400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f95a00cf720 0x7f95a0164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.755+0000 7f95a7400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a015c4f0 con 0x7f95a00723d0 2024-09-10T07:39:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.755+0000 7f95a7400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f95a015b730 con 0x7f95a00cf720 2024-09-10T07:39:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.755+0000 7f95a7400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f95a015ba10 con 0x7f95a0152210 2024-09-10T07:39:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.755+0000 7f95a5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f95a00cf720 0x7f95a0164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.755+0000 7f95a5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f95a00cf720 0x7f95a0164bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47874/0 (socket says 172.21.15.99:47874) 2024-09-10T07:39:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.755+0000 7f95a5400640 1 -- 172.21.15.99:0/4074470965 learned_addr learned my addr 172.21.15.99:0/4074470965 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.756+0000 7f95a4a00640 1 --2- 172.21.15.99:0/4074470965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a0152210 0x7f95a0071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.756+0000 7f95a5400640 1 -- 172.21.15.99:0/4074470965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a0152210 msgr2=0x7f95a0071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.756+0000 7f95a5400640 1 --2- 172.21.15.99:0/4074470965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a0152210 0x7f95a0071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:20.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.756+0000 7f95a5400640 1 -- 172.21.15.99:0/4074470965 >> v1:172.21.15.187:6789/0 conn(0x7f95a00723d0 legacy=0x7f95a00cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:20.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.756+0000 7f95a5400640 1 -- 172.21.15.99:0/4074470965 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a015bcf0 con 0x7f95a00cf720 2024-09-10T07:39:20.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.756+0000 7f95a4a00640 1 --2- 172.21.15.99:0/4074470965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a0152210 0x7f95a0071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:20.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.757+0000 7f95a5400640 1 --2- 172.21.15.99:0/4074470965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a00cf720 0x7f95a0164bb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9598009e50 tx=0x7f959802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27933cc3c8db4f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:20.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.757+0000 7f959fe00640 1 -- 172.21.15.99:0/4074470965 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598036070 con 0x7f95a00cf720 2024-09-10T07:39:20.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.757+0000 7f959fe00640 1 -- 172.21.15.99:0/4074470965 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9598031600 con 0x7f95a00cf720 2024-09-10T07:39:20.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.757+0000 7f959fe00640 1 -- 172.21.15.99:0/4074470965 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95980319d0 con 0x7f95a00cf720 2024-09-10T07:39:20.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.758+0000 7f95a7400640 1 -- 172.21.15.99:0/4074470965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a00cf720 msgr2=0x7f95a0164bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:20.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.758+0000 7f95a7400640 1 --2- 172.21.15.99:0/4074470965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a00cf720 0x7f95a0164bb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9598009e50 tx=0x7f959802a6c0 comp rx=0 tx=0).stop 2024-09-10T07:39:20.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.758+0000 7f95a7400640 1 -- 172.21.15.99:0/4074470965 shutdown_connections 2024-09-10T07:39:20.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.758+0000 7f95a7400640 1 --2- 172.21.15.99:0/4074470965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a00cf720 0x7f95a0164bb0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:20.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.758+0000 7f95a7400640 1 --2- 172.21.15.99:0/4074470965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a0152210 0x7f95a0071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:20.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.758+0000 7f95a7400640 1 -- 172.21.15.99:0/4074470965 >> 172.21.15.99:0/4074470965 conn(0x7f95a006bc10 msgr2=0x7f95a006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:20.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.758+0000 7f95a7400640 1 -- 172.21.15.99:0/4074470965 shutdown_connections 2024-09-10T07:39:20.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.758+0000 7f95a7400640 1 -- 172.21.15.99:0/4074470965 wait complete. 2024-09-10T07:39:20.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.760+0000 7f95a7400640 1 Processor -- start 2024-09-10T07:39:20.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.760+0000 7f95a7400640 1 -- start start 2024-09-10T07:39:20.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a7400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95a00723d0 0x7f95a0149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:20.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a7400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a00cf720 0x7f95a00b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:20.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a0152210 0x7f95a0147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:20.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a7400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f95a006e6c0 con 0x7f95a0152210 2024-09-10T07:39:20.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a7400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f95a006f380 con 0x7f95a00723d0 2024-09-10T07:39:20.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a7400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f95a006e840 con 0x7f95a00cf720 2024-09-10T07:39:20.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a0152210 0x7f95a0147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:20.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a0152210 0x7f95a0147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47888/0 (socket says 172.21.15.99:47888) 2024-09-10T07:39:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a5400640 1 -- 172.21.15.99:0/4185559713 learned_addr learned my addr 172.21.15.99:0/4185559713 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f9597e00640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a00cf720 0x7f95a00b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a4a00640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95a00723d0 0x7f95a0149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a5400640 1 -- 172.21.15.99:0/4185559713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a00cf720 msgr2=0x7f95a00b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a5400640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a00cf720 0x7f95a00b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a5400640 1 -- 172.21.15.99:0/4185559713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95a00723d0 msgr2=0x7f95a0149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a5400640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95a00723d0 0x7f95a0149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.761+0000 7f95a5400640 1 -- 172.21.15.99:0/4185559713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a014a110 con 0x7f95a0152210 2024-09-10T07:39:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.762+0000 7f95a5400640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a0152210 0x7f95a0147520 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9598009f70 tx=0x7f9598004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.762+0000 7f959d600640 1 -- 172.21.15.99:0/4185559713 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598036050 con 0x7f95a0152210 2024-09-10T07:39:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.762+0000 7f959d600640 1 -- 172.21.15.99:0/4185559713 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9598042070 con 0x7f95a0152210 2024-09-10T07:39:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.762+0000 7f959d600640 1 -- 172.21.15.99:0/4185559713 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598009510 con 0x7f95a0152210 2024-09-10T07:39:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.762+0000 7f95a7400640 1 -- 172.21.15.99:0/4185559713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a014e660 con 0x7f95a0152210 2024-09-10T07:39:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.762+0000 7f95a7400640 1 -- 172.21.15.99:0/4185559713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a014ec20 con 0x7f95a0152210 2024-09-10T07:39:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.763+0000 7f95a7400640 1 -- 172.21.15.99:0/4185559713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a015cd80 con 0x7f95a0152210 2024-09-10T07:39:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.764+0000 7f959d600640 1 -- 172.21.15.99:0/4185559713 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9598007bd0 con 0x7f95a0152210 2024-09-10T07:39:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.765+0000 7f959d600640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957c06be30 0x7f957c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.765+0000 7f959d600640 1 -- 172.21.15.99:0/4185559713 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5738+0+0 (secure 0 0 0) 0x7f95980abe10 con 0x7f95a0152210 2024-09-10T07:39:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.766+0000 7f95a4a00640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957c06be30 0x7f957c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.766+0000 7f959d600640 1 -- 172.21.15.99:0/4185559713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=107}) -- 0x7f957c0739c0 con 0x7f95a0152210 2024-09-10T07:39:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.766+0000 7f95a4a00640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957c06be30 0x7f957c06e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f959000aac0 tx=0x7f9590008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:20.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.770+0000 7f959d600640 1 -- 172.21.15.99:0/4185559713 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95a015cd80 con 0x7f95a0152210 2024-09-10T07:39:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.910+0000 7f959d600640 1 -- 172.21.15.99:0/4185559713 <== mon.0 v2:172.21.15.99:3300/0 7 ==== osd_map(107..107 src has 1..107) ==== 296+0+0 (secure 0 0 0) 0x7f95980780c0 con 0x7f95a0152210 2024-09-10T07:39:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.910+0000 7f959d600640 1 -- 172.21.15.99:0/4185559713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=108}) -- 0x7f957c0741e0 con 0x7f95a0152210 2024-09-10T07:39:20.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.950+0000 7f95a7400640 1 -- 172.21.15.99:0/4185559713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f95a00b41d0 con 0x7f95a0152210 2024-09-10T07:39:20.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.951+0000 7f959d600640 1 -- 172.21.15.99:0/4185559713 <== mon.0 v2:172.21.15.99:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) ==== 81+0+34591 (secure 0 0 0) 0x7f95980af030 con 0x7f95a0152210 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 107, 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:39:20.901767+0000", 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:39:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 13, 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:39:20.952 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "luminous", 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:20.953 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:39:20.954 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:20.955 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:20.956 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:20.957 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:20.957 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:20.957 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:20.957 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:20.957 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:20.957 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:20.957 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:20.957 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:20.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.957 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:20.958 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:20.959 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:39:20.959 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:39:20.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.959 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:20.959 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:39:20.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.959 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:20.959 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:20.959 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:39:20.959 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 12, 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:58.485547+0000", 2024-09-10T07:39:20.960 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:20.961 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.962 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:20.963 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:20.964 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:20.965 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:39:20.966 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 13, 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:59.701338+0000", 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:20.967 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:39:20.968 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:20.969 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:20.970 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:39:20.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:20.973 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:20.974 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.975 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.976 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:39:20.977 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:20.979 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:20.980 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.982 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.983 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:20.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.985 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:20.986 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:20.988 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.989 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.990 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.992 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:39:20.992 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:39:20.992 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:39:20.993 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:39:20.993 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:20.993 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:20.993 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:20.993 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:20.993 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.994 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:20.994 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:20.994 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:20.994 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:20.994 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:20.994 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:20.994 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:20.994 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:20.994 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:39:20.995 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:39:20.996 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.997 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:20.998 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:20.999 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 102, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.000 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.001 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.002 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.005 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.006 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.007 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.009 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.011 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.015 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:21.016 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.017 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.018 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.019 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:39:21.020 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull", 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.022 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.024 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.025 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.027 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.028 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [ 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "13.3b", 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 1, 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 3 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.029 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:39:21.030 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:39:21.031 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.032 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:39:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.953+0000 7f95a7400640 1 -- 172.21.15.99:0/4185559713 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957c06be30 msgr2=0x7f957c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.953+0000 7f95a7400640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957c06be30 0x7f957c06e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f959000aac0 tx=0x7f9590008040 comp rx=0 tx=0).stop 2024-09-10T07:39:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.953+0000 7f95a7400640 1 -- 172.21.15.99:0/4185559713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a0152210 msgr2=0x7f95a0147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.953+0000 7f95a7400640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a0152210 0x7f95a0147520 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9598009f70 tx=0x7f9598004a40 comp rx=0 tx=0).stop 2024-09-10T07:39:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.954+0000 7f95a7400640 1 -- 172.21.15.99:0/4185559713 shutdown_connections 2024-09-10T07:39:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.954+0000 7f95a7400640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957c06be30 0x7f957c06e2f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.954+0000 7f95a7400640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a0152210 0x7f95a0147520 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.954+0000 7f95a7400640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95a00cf720 0x7f95a00b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.954+0000 7f95a7400640 1 --2- 172.21.15.99:0/4185559713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95a00723d0 0x7f95a0149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.954+0000 7f95a7400640 1 -- 172.21.15.99:0/4185559713 >> 172.21.15.99:0/4185559713 conn(0x7f95a006bc10 msgr2=0x7f95a006d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.954+0000 7f95a7400640 1 -- 172.21.15.99:0/4185559713 shutdown_connections 2024-09-10T07:39:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:20.954+0000 7f95a7400640 1 -- 172.21.15.99:0/4185559713 wait complete. 2024-09-10T07:39:21.035 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-10T07:39:21.035 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:21.035 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:21.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:21.071 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-10T07:39:21.470 INFO:teuthology.orchestra.run.smithi099.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-10T07:39:21.470 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records in 2024-09-10T07:39:21.470 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records out 2024-09-10T07:39:21.470 INFO:teuthology.orchestra.run.smithi099.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.313055 s, 167 MB/s 2024-09-10T07:39:21.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:39:21.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:39:21.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.625+0000 7f5a8f400640 1 Processor -- start 2024-09-10T07:39:21.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.625+0000 7f5a8f400640 1 -- start start 2024-09-10T07:39:21.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.626+0000 7f5a8f400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a88072f40 0x7f5a8806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:21.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.626+0000 7f5a8f400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5a880ce780 0x7f5a880b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:21.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.626+0000 7f5a8f400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8806e3d0 con 0x7f5a88145290 2024-09-10T07:39:21.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.626+0000 7f5a8f400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f5a8806efe0 con 0x7f5a880ce780 2024-09-10T07:39:21.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.626+0000 7f5a8f400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5a8806e6b0 con 0x7f5a88072f40 2024-09-10T07:39:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.627+0000 7f5a87e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a88072f40 0x7f5a8806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.627+0000 7f5a8d400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5a880ce780 0x7f5a880b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.627+0000 7f5a87e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a88072f40 0x7f5a8806f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:56390/0 (socket says 172.21.15.99:56390) 2024-09-10T07:39:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.627+0000 7f5a87e00640 1 -- 172.21.15.99:0/1708343520 learned_addr learned my addr 172.21.15.99:0/1708343520 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:21.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.627+0000 7f5a87e00640 1 -- 172.21.15.99:0/1708343520 >> v2:172.21.15.187:3300/0 conn(0x7f5a880ce780 msgr2=0x7f5a880b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:21.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.627+0000 7f5a87e00640 1 --2- 172.21.15.99:0/1708343520 >> v2:172.21.15.187:3300/0 conn(0x7f5a880ce780 0x7f5a880b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.627+0000 7f5a87e00640 1 -- 172.21.15.99:0/1708343520 >> v1:172.21.15.187:6789/0 conn(0x7f5a88145290 legacy=0x7f5a88072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:21.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.627+0000 7f5a87e00640 1 -- 172.21.15.99:0/1708343520 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8806e990 con 0x7f5a88072f40 2024-09-10T07:39:21.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.627+0000 7f5a8d400640 1 --2- 172.21.15.99:0/1708343520 >> v2:172.21.15.187:3300/0 conn(0x7f5a880ce780 0x7f5a880b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.628+0000 7f5a87e00640 1 --2- 172.21.15.99:0/1708343520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a88072f40 0x7f5a8806f470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400bb10 tx=0x7f5a7402c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1592358f8dac41c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a87400640 1 -- 172.21.15.99:0/1708343520 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74036020 con 0x7f5a88072f40 2024-09-10T07:39:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a87400640 1 -- 172.21.15.99:0/1708343520 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a74032820 con 0x7f5a88072f40 2024-09-10T07:39:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a87400640 1 -- 172.21.15.99:0/1708343520 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74032bf0 con 0x7f5a88072f40 2024-09-10T07:39:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a8f400640 1 -- 172.21.15.99:0/1708343520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a88072f40 msgr2=0x7f5a8806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a8f400640 1 --2- 172.21.15.99:0/1708343520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a88072f40 0x7f5a8806f470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400bb10 tx=0x7f5a7402c920 comp rx=0 tx=0).stop 2024-09-10T07:39:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a8f400640 1 -- 172.21.15.99:0/1708343520 shutdown_connections 2024-09-10T07:39:21.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a8f400640 1 --2- 172.21.15.99:0/1708343520 >> v2:172.21.15.187:3300/0 conn(0x7f5a880ce780 0x7f5a880b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a8f400640 1 --2- 172.21.15.99:0/1708343520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a88072f40 0x7f5a8806f470 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a8f400640 1 -- 172.21.15.99:0/1708343520 >> 172.21.15.99:0/1708343520 conn(0x7f5a8806bc10 msgr2=0x7f5a8806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:21.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a8f400640 1 -- 172.21.15.99:0/1708343520 shutdown_connections 2024-09-10T07:39:21.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.629+0000 7f5a8f400640 1 -- 172.21.15.99:0/1708343520 wait complete. 2024-09-10T07:39:21.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.631+0000 7f5a8f400640 1 Processor -- start 2024-09-10T07:39:21.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.631+0000 7f5a8f400640 1 -- start start 2024-09-10T07:39:21.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a8f400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a88072f40 0x7f5a8813d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:21.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a8f400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a880ce780 0x7f5a88143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a8f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a88145290 0x7f5a881441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a8f400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8806df80 con 0x7f5a88145290 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a8f400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5a88145670 con 0x7f5a88072f40 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a8f400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5a8806e100 con 0x7f5a880ce780 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a8d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a88145290 0x7f5a881441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a8d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a88145290 0x7f5a881441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47890/0 (socket says 172.21.15.99:47890) 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a8d400640 1 -- 172.21.15.99:0/581802032 learned_addr learned my addr 172.21.15.99:0/581802032 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a8ca00640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a88072f40 0x7f5a8813d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.632+0000 7f5a87e00640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a880ce780 0x7f5a88143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a8d400640 1 -- 172.21.15.99:0/581802032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a880ce780 msgr2=0x7f5a88143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a8d400640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a880ce780 0x7f5a88143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a8d400640 1 -- 172.21.15.99:0/581802032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a88072f40 msgr2=0x7f5a8813d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a8d400640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a88072f40 0x7f5a8813d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a8d400640 1 -- 172.21.15.99:0/581802032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8813d890 con 0x7f5a88145290 2024-09-10T07:39:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a87e00640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a880ce780 0x7f5a88143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a8d400640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a88145290 0x7f5a881441f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000ef90 tx=0x7f5a80009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a84c00640 1 -- 172.21.15.99:0/581802032 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80018020 con 0x7f5a88145290 2024-09-10T07:39:21.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a84c00640 1 -- 172.21.15.99:0/581802032 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a80014480 con 0x7f5a88145290 2024-09-10T07:39:21.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a84c00640 1 -- 172.21.15.99:0/581802032 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80014870 con 0x7f5a88145290 2024-09-10T07:39:21.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a8f400640 1 -- 172.21.15.99:0/581802032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a880aa8b0 con 0x7f5a88145290 2024-09-10T07:39:21.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.633+0000 7f5a8f400640 1 -- 172.21.15.99:0/581802032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a880aae30 con 0x7f5a88145290 2024-09-10T07:39:21.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.634+0000 7f5a8f400640 1 -- 172.21.15.99:0/581802032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a88071510 con 0x7f5a88145290 2024-09-10T07:39:21.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.635+0000 7f5a84c00640 1 -- 172.21.15.99:0/581802032 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a80005d10 con 0x7f5a88145290 2024-09-10T07:39:21.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.636+0000 7f5a84c00640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5a6806be30 0x7f5a6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:21.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.636+0000 7f5a84c00640 1 -- 172.21.15.99:0/581802032 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5738+0+0 (secure 0 0 0) 0x7f5a8008baf0 con 0x7f5a88145290 2024-09-10T07:39:21.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.636+0000 7f5a84c00640 1 -- 172.21.15.99:0/581802032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=108}) -- 0x7f5a680739c0 con 0x7f5a88145290 2024-09-10T07:39:21.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.636+0000 7f5a8ca00640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5a6806be30 0x7f5a6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:21.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.637+0000 7f5a8ca00640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5a6806be30 0x7f5a6806e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c001780 tx=0x7f5a7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:21.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.640+0000 7f5a84c00640 1 -- 172.21.15.99:0/581802032 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a80022030 con 0x7f5a88145290 2024-09-10T07:39:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.817+0000 7f5a8f400640 1 -- 172.21.15.99:0/581802032 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f5a880cd010 con 0x7f5a88145290 2024-09-10T07:39:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.818+0000 7f5a84c00640 1 -- 172.21.15.99:0/581802032 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) ==== 81+0+34591 (secure 0 0 0) 0x7f5a80010040 con 0x7f5a88145290 2024-09-10T07:39:21.817 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 107, 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:39:20.901767+0000", 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:39:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 13, 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:39:21.819 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "luminous", 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:21.820 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:21.821 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:21.822 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:21.823 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:21.824 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:21.825 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 12, 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:58.485547+0000", 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:21.827 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:21.828 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:21.829 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:21.830 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:21.831 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.832 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 13, 2024-09-10T07:39:21.833 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:59.701338+0000", 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:21.834 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:21.835 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:21.836 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:21.837 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:21.838 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:39:21.839 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:21.840 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.841 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.842 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.843 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.844 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:39:21.845 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.846 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:39:21.847 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:39:21.848 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:39:21.849 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:21.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:21.851 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.854 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.855 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:39:21.856 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.860 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.861 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:39:21.862 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.863 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 102, 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.864 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.865 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:39:21.868 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.869 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:39:21.870 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.871 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.874 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.875 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.876 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.877 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.878 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:21.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.882 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.883 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.885 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull", 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:21.886 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.887 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.888 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.889 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.890 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [ 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.892 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "13.3b", 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 1, 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 3 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:39:21.893 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:39:21.894 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:39:21.895 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:39:21.895 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:39:21.895 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:39:21.895 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:39:21.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:21.895 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:39:21.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 -- 172.21.15.99:0/581802032 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5a6806be30 msgr2=0x7f5a6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:21.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5a6806be30 0x7f5a6806e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c001780 tx=0x7f5a7c009040 comp rx=0 tx=0).stop 2024-09-10T07:39:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 -- 172.21.15.99:0/581802032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a88145290 msgr2=0x7f5a881441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a88145290 0x7f5a881441f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000ef90 tx=0x7f5a80009f90 comp rx=0 tx=0).stop 2024-09-10T07:39:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 -- 172.21.15.99:0/581802032 shutdown_connections 2024-09-10T07:39:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5a6806be30 0x7f5a6806e2f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a88145290 0x7f5a881441f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a880ce780 0x7f5a88143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 --2- 172.21.15.99:0/581802032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a88072f40 0x7f5a8813d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 -- 172.21.15.99:0/581802032 >> 172.21.15.99:0/581802032 conn(0x7f5a8806bc10 msgr2=0x7f5a880b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 -- 172.21.15.99:0/581802032 shutdown_connections 2024-09-10T07:39:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:21.821+0000 7f5a8f400640 1 -- 172.21.15.99:0/581802032 wait complete. 2024-09-10T07:39:21.898 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.053+0000 7f45bf200640 1 Processor -- start 2024-09-10T07:39:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.053+0000 7f45bf200640 1 -- start start 2024-09-10T07:39:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.054+0000 7f45bf200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f45b813fae0 0x7f45b806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.054+0000 7f45bf200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45b8142150 0x7f45b8160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.054+0000 7f45bf200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b8142650 con 0x7f45b8160a80 2024-09-10T07:39:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.055+0000 7f45bf200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f45b80ce780 con 0x7f45b813fae0 2024-09-10T07:39:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.055+0000 7f45bf200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f45b8142930 con 0x7f45b8142150 2024-09-10T07:39:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.055+0000 7f45b7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f45b813fae0 0x7f45b806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.055+0000 7f45b7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f45b813fae0 0x7f45b806f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47904/0 (socket says 172.21.15.99:47904) 2024-09-10T07:39:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.055+0000 7f45b7e00640 1 -- 172.21.15.99:0/4077624704 learned_addr learned my addr 172.21.15.99:0/4077624704 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.055+0000 7f45b7e00640 1 -- 172.21.15.99:0/4077624704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45b8142150 msgr2=0x7f45b8160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.055+0000 7f45b7e00640 1 --2- 172.21.15.99:0/4077624704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45b8142150 0x7f45b8160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.055+0000 7f45b7e00640 1 -- 172.21.15.99:0/4077624704 >> v1:172.21.15.99:6789/0 conn(0x7f45b8160a80 legacy=0x7f45b815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.055+0000 7f45b7e00640 1 -- 172.21.15.99:0/4077624704 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b8142c10 con 0x7f45b813fae0 2024-09-10T07:39:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.056+0000 7f45b7e00640 1 --2- 172.21.15.99:0/4077624704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 0x7f45b806f1b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009870 tx=0x7f45a802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6715c0abf077bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.056+0000 7f45b7400640 1 -- 172.21.15.99:0/4077624704 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8037070 con 0x7f45b813fae0 2024-09-10T07:39:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.056+0000 7f45b7400640 1 -- 172.21.15.99:0/4077624704 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a8032440 con 0x7f45b813fae0 2024-09-10T07:39:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.056+0000 7f45b7400640 1 -- 172.21.15.99:0/4077624704 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8032810 con 0x7f45b813fae0 2024-09-10T07:39:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.057+0000 7f45bf200640 1 -- 172.21.15.99:0/4077624704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 msgr2=0x7f45b806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.057+0000 7f45bf200640 1 --2- 172.21.15.99:0/4077624704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 0x7f45b806f1b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009870 tx=0x7f45a802a1f0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.057+0000 7f45bf200640 1 -- 172.21.15.99:0/4077624704 shutdown_connections 2024-09-10T07:39:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.057+0000 7f45bf200640 1 --2- 172.21.15.99:0/4077624704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45b8142150 0x7f45b8160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.057+0000 7f45bf200640 1 --2- 172.21.15.99:0/4077624704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 0x7f45b806f1b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.057+0000 7f45bf200640 1 -- 172.21.15.99:0/4077624704 >> 172.21.15.99:0/4077624704 conn(0x7f45b806bc10 msgr2=0x7f45b806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.057+0000 7f45bf200640 1 -- 172.21.15.99:0/4077624704 shutdown_connections 2024-09-10T07:39:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.057+0000 7f45bf200640 1 -- 172.21.15.99:0/4077624704 wait complete. 2024-09-10T07:39:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.059+0000 7f45bf200640 1 Processor -- start 2024-09-10T07:39:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.059+0000 7f45bf200640 1 -- start start 2024-09-10T07:39:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45bf200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 0x7f45b8145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45bf200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45b8142150 0x7f45b80b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45bf200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45b8160a80 0x7f45b813dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45bf200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f45b806f870 con 0x7f45b813fae0 2024-09-10T07:39:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45bf200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f45b806f6f0 con 0x7f45b8160a80 2024-09-10T07:39:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45bf200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f45b80cfc20 con 0x7f45b8142150 2024-09-10T07:39:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 0x7f45b8145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 0x7f45b8145840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47908/0 (socket says 172.21.15.99:47908) 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45b7e00640 1 -- 172.21.15.99:0/4128037304 learned_addr learned my addr 172.21.15.99:0/4128037304 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45af400640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45b8142150 0x7f45b80b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45bd200640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45b8160a80 0x7f45b813dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45b7e00640 1 -- 172.21.15.99:0/4128037304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45b8142150 msgr2=0x7f45b80b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45b7e00640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45b8142150 0x7f45b80b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45b7e00640 1 -- 172.21.15.99:0/4128037304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45b8160a80 msgr2=0x7f45b813dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45b7e00640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45b8160a80 0x7f45b813dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45b7e00640 1 -- 172.21.15.99:0/4128037304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b813e210 con 0x7f45b813fae0 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.060+0000 7f45bd200640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45b8160a80 0x7f45b813dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.061+0000 7f45b7e00640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 0x7f45b8145840 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009870 tx=0x7f45a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.061+0000 7f45b4c00640 1 -- 172.21.15.99:0/4128037304 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8041020 con 0x7f45b813fae0 2024-09-10T07:39:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.061+0000 7f45b4c00640 1 -- 172.21.15.99:0/4128037304 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a8030970 con 0x7f45b813fae0 2024-09-10T07:39:22.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.061+0000 7f45b4c00640 1 -- 172.21.15.99:0/4128037304 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8037040 con 0x7f45b813fae0 2024-09-10T07:39:22.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.061+0000 7f45bf200640 1 -- 172.21.15.99:0/4128037304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b8144a80 con 0x7f45b813fae0 2024-09-10T07:39:22.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.061+0000 7f45bf200640 1 -- 172.21.15.99:0/4128037304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b8145040 con 0x7f45b813fae0 2024-09-10T07:39:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.062+0000 7f45bf200640 1 -- 172.21.15.99:0/4128037304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b806f1b0 con 0x7f45b813fae0 2024-09-10T07:39:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.063+0000 7f45b4c00640 1 -- 172.21.15.99:0/4128037304 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45a8044020 con 0x7f45b813fae0 2024-09-10T07:39:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.064+0000 7f45b4c00640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f459406be30 0x7f459406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.064+0000 7f45b4c00640 1 -- 172.21.15.99:0/4128037304 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5738+0+0 (secure 0 0 0) 0x7f45a80ab860 con 0x7f45b813fae0 2024-09-10T07:39:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.064+0000 7f45b4c00640 1 -- 172.21.15.99:0/4128037304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=108}) -- 0x7f45940739c0 con 0x7f45b813fae0 2024-09-10T07:39:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.064+0000 7f45af400640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f459406be30 0x7f459406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.065+0000 7f45af400640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f459406be30 0x7f459406e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f45b8146580 tx=0x7f45a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.069+0000 7f45b4c00640 1 -- 172.21.15.99:0/4128037304 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45a804b030 con 0x7f45b813fae0 2024-09-10T07:39:22.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.272+0000 7f45bf200640 1 -- 172.21.15.99:0/4128037304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45b81610f0 con 0x7f45b813fae0 2024-09-10T07:39:22.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.273+0000 7f45b4c00640 1 -- 172.21.15.99:0/4128037304 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7f45a807ae20 con 0x7f45b813fae0 2024-09-10T07:39:22.273 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:22.273 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":49,"btime":"2024-09-10T07:39:04:324940+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/224049994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":224049994},{"type":"v1","addr":"172.21.15.187:6834","nonce":224049994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2009047482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2009047482},{"type":"v1","addr":"172.21.15.187:6835","nonce":2009047482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3952584402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3952584402},{"type":"v1","addr":"172.21.15.99:6837","nonce":3952584402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:00.703298+0000","modified":"2024-09-10T07:39:03.726531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/1858150570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1858150570},{"type":"v1","addr":"172.21.15.99:6835","nonce":1858150570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":6}]} 2024-09-10T07:39:22.273 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 49 2024-09-10T07:39:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 -- 172.21.15.99:0/4128037304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f459406be30 msgr2=0x7f459406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f459406be30 0x7f459406e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f45b8146580 tx=0x7f45a0008040 comp rx=0 tx=0).stop 2024-09-10T07:39:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 -- 172.21.15.99:0/4128037304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 msgr2=0x7f45b8145840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 0x7f45b8145840 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009870 tx=0x7f45a80046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 -- 172.21.15.99:0/4128037304 shutdown_connections 2024-09-10T07:39:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45b8160a80 0x7f45b813dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45b8142150 0x7f45b80b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f459406be30 0x7f459406e2f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 --2- 172.21.15.99:0/4128037304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45b813fae0 0x7f45b8145840 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 -- 172.21.15.99:0/4128037304 >> 172.21.15.99:0/4128037304 conn(0x7f45b806bc10 msgr2=0x7f45b815ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 -- 172.21.15.99:0/4128037304 shutdown_connections 2024-09-10T07:39:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.275+0000 7f45bf200640 1 -- 172.21.15.99:0/4128037304 wait complete. 2024-09-10T07:39:22.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:39:22.464 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":6069,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.137591917000002,"mdsmap_epoch":49,"osdmap_epoch":107,"osdmap_epoch_barrier":107,"uptime":25.690953543999999} 2024-09-10T07:39:22.465 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 6069, "mdsmap_epoch": 49, "osdmap_epoch": 107, "osdmap_epoch_barrier": 107, "rank_uptime": 21.137591917, "state": "up:active", "uptime": 25.690953544, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:39:22.465 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T07:39:22.465 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:22.465 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:22.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:22.501 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-10T07:39:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-10T07:39:22.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:39:22.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:22.578 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-10T07:39:22.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:22.656 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-10T07:39:22.800 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:39:22.910 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:39:22.911+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-10T07:39:22.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.956+0000 7f215cc00640 1 Processor -- start 2024-09-10T07:39:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.957+0000 7f215cc00640 1 -- start start 2024-09-10T07:39:22.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.958+0000 7f215cc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2158145290 0x7f215806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.958+0000 7f215cc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 0x7f21580b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.958+0000 7f215cc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215806e3d0 con 0x7f21580ce780 2024-09-10T07:39:22.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.958+0000 7f215cc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f215806efe0 con 0x7f2158145290 2024-09-10T07:39:22.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.958+0000 7f215cc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f215806e6b0 con 0x7f2158072f40 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.958+0000 7f2155e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2158145290 0x7f215806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.958+0000 7f2155400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f21580ce780 0x7f2158072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38574/0 (socket says 172.21.15.99:38574) 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.958+0000 7f2155e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2158145290 0x7f215806f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47914/0 (socket says 172.21.15.99:47914) 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.958+0000 7f2155400640 1 -- 172.21.15.99:0/3820359667 learned_addr learned my addr 172.21.15.99:0/3820359667 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.958+0000 7f2156800640 1 --2- 172.21.15.99:0/3820359667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 0x7f21580b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.959+0000 7f2155e00640 1 -- 172.21.15.99:0/3820359667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 msgr2=0x7f21580b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.959+0000 7f2155e00640 1 --2- 172.21.15.99:0/3820359667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 0x7f21580b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.959+0000 7f2155e00640 1 -- 172.21.15.99:0/3820359667 >> v1:172.21.15.99:6789/0 conn(0x7f21580ce780 legacy=0x7f2158072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.959+0000 7f2154a00640 1 -- 172.21.15.99:0/3820359667 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 218559427 0 0) 0x7f215806e3d0 con 0x7f21580ce780 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.959+0000 7f2155e00640 1 -- 172.21.15.99:0/3820359667 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215806e990 con 0x7f2158145290 2024-09-10T07:39:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.959+0000 7f2156800640 1 --2- 172.21.15.99:0/3820359667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 0x7f21580b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:22.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f2155e00640 1 --2- 172.21.15.99:0/3820359667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2158145290 0x7f215806f470 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f21480097a0 tx=0x7f214802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1215e3946df6c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:22.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f2154a00640 1 -- 172.21.15.99:0/3820359667 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148037070 con 0x7f2158145290 2024-09-10T07:39:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f2154a00640 1 -- 172.21.15.99:0/3820359667 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2148032440 con 0x7f2158145290 2024-09-10T07:39:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f2154a00640 1 -- 172.21.15.99:0/3820359667 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148032810 con 0x7f2158145290 2024-09-10T07:39:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f215cc00640 1 -- 172.21.15.99:0/3820359667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2158145290 msgr2=0x7f215806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f215cc00640 1 --2- 172.21.15.99:0/3820359667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2158145290 0x7f215806f470 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f21480097a0 tx=0x7f214802a180 comp rx=0 tx=0).stop 2024-09-10T07:39:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f215cc00640 1 -- 172.21.15.99:0/3820359667 shutdown_connections 2024-09-10T07:39:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f215cc00640 1 --2- 172.21.15.99:0/3820359667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 0x7f21580b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f215cc00640 1 --2- 172.21.15.99:0/3820359667 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2158145290 0x7f215806f470 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f215cc00640 1 -- 172.21.15.99:0/3820359667 >> 172.21.15.99:0/3820359667 conn(0x7f215806bc10 msgr2=0x7f215806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f215cc00640 1 -- 172.21.15.99:0/3820359667 shutdown_connections 2024-09-10T07:39:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.960+0000 7f215cc00640 1 -- 172.21.15.99:0/3820359667 wait complete. 2024-09-10T07:39:22.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.962+0000 7f215cc00640 1 Processor -- start 2024-09-10T07:39:22.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.962+0000 7f215cc00640 1 -- start start 2024-09-10T07:39:22.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f215cc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 0x7f2158135eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f215cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21580ce780 0x7f2158138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f215cc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2158145290 0x7f215815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f215cc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f215806df80 con 0x7f21580ce780 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f215cc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2158145670 con 0x7f2158145290 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f215cc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f215806e100 con 0x7f2158072f40 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f2155400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21580ce780 0x7f2158138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f2155400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21580ce780 0x7f2158138cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47928/0 (socket says 172.21.15.99:47928) 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f2155400640 1 -- 172.21.15.99:0/3758880256 learned_addr learned my addr 172.21.15.99:0/3758880256 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f2156800640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2158145290 0x7f215815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.963+0000 7f2155e00640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 0x7f2158135eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f2155400640 1 -- 172.21.15.99:0/3758880256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 msgr2=0x7f2158135eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f2155400640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 0x7f2158135eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f2155400640 1 -- 172.21.15.99:0/3758880256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2158145290 msgr2=0x7f215815b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:22.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f2155400640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2158145290 0x7f215815b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:22.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f2155400640 1 -- 172.21.15.99:0/3758880256 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21581365e0 con 0x7f21580ce780 2024-09-10T07:39:22.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f2155400640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21580ce780 0x7f2158138cf0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f214400c4b0 tx=0x7f214400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:22.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f214e000640 1 -- 172.21.15.99:0/3758880256 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144018070 con 0x7f21580ce780 2024-09-10T07:39:22.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f214e000640 1 -- 172.21.15.99:0/3758880256 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2144007500 con 0x7f21580ce780 2024-09-10T07:39:22.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f215cc00640 1 -- 172.21.15.99:0/3758880256 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21581368c0 con 0x7f21580ce780 2024-09-10T07:39:22.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f214e000640 1 -- 172.21.15.99:0/3758880256 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144004a20 con 0x7f21580ce780 2024-09-10T07:39:22.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.964+0000 7f215cc00640 1 -- 172.21.15.99:0/3758880256 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2158136e80 con 0x7f21580ce780 2024-09-10T07:39:22.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.965+0000 7f215cc00640 1 -- 172.21.15.99:0/3758880256 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2158071d60 con 0x7f21580ce780 2024-09-10T07:39:22.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.966+0000 7f214e000640 1 -- 172.21.15.99:0/3758880256 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f214401b070 con 0x7f21580ce780 2024-09-10T07:39:22.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.967+0000 7f214e000640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f213806be60 0x7f213806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:22.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.968+0000 7f214e000640 1 -- 172.21.15.99:0/3758880256 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5738+0+0 (secure 0 0 0) 0x7f214408a110 con 0x7f21580ce780 2024-09-10T07:39:22.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.968+0000 7f2155e00640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f213806be60 0x7f213806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:22.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.968+0000 7f214e000640 1 -- 172.21.15.99:0/3758880256 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=109}) -- 0x7f21380739f0 con 0x7f21580ce780 2024-09-10T07:39:22.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.968+0000 7f2155e00640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f213806be60 0x7f213806e320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2148034000 tx=0x7f214802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:22.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:22.971+0000 7f214e000640 1 -- 172.21.15.99:0/3758880256 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2144058500 con 0x7f21580ce780 2024-09-10T07:39:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.145+0000 7f215cc00640 1 -- 172.21.15.99:0/3758880256 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f215813e9c0 con 0x7f21580ce780 2024-09-10T07:39:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.146+0000 7f214e000640 1 -- 172.21.15.99:0/3758880256 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v108) ==== 81+0+34599 (secure 0 0 0) 0x7f214405c800 con 0x7f21580ce780 2024-09-10T07:39:23.146 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 108, 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:39:22.912226+0000", 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:39:23.147 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 13, 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:39:23.148 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "luminous", 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:39:23.150 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:23.151 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:23.152 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:23.153 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.154 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 12, 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:58.485547+0000", 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:23.156 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:23.157 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:23.158 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:23.159 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:23.160 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:23.161 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 13, 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:39:23.162 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:59.701338+0000", 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:23.163 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.164 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:23.165 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:39:23.167 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:39:23.168 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:23.169 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.170 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:23.174 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:23.175 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.176 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:23.177 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:23.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:39:23.179 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:23.181 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.186 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:23.188 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:23.189 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:39:23.191 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:23.192 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 102, 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.193 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.194 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull", 2024-09-10T07:39:23.197 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:23.198 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.199 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:23.200 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:39:23.201 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:39:23.202 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:23.204 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:23.205 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.206 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.207 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.208 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:23.209 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.210 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.211 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.212 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:23.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:39:23.214 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull", 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:23.215 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:39:23.216 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:23.217 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:23.218 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:23.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:23.220 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [ 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "13.3b", 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:23.221 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 1, 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 3 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:39:23.222 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:39:23.223 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:39:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:39:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:39:23.224 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:23.224 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:39:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 -- 172.21.15.99:0/3758880256 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f213806be60 msgr2=0x7f213806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:23.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f213806be60 0x7f213806e320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2148034000 tx=0x7f214802e000 comp rx=0 tx=0).stop 2024-09-10T07:39:23.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 -- 172.21.15.99:0/3758880256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21580ce780 msgr2=0x7f2158138cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:23.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21580ce780 0x7f2158138cf0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f214400c4b0 tx=0x7f214400c970 comp rx=0 tx=0).stop 2024-09-10T07:39:23.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 -- 172.21.15.99:0/3758880256 shutdown_connections 2024-09-10T07:39:23.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2158145290 0x7f215815b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:23.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f213806be60 0x7f213806e320 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:23.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21580ce780 0x7f2158138cf0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:23.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 --2- 172.21.15.99:0/3758880256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2158072f40 0x7f2158135eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:23.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 -- 172.21.15.99:0/3758880256 >> 172.21.15.99:0/3758880256 conn(0x7f215806bc10 msgr2=0x7f21580b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:23.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.148+0000 7f215cc00640 1 -- 172.21.15.99:0/3758880256 shutdown_connections 2024-09-10T07:39:23.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:23.149+0000 7f215cc00640 1 -- 172.21.15.99:0/3758880256 wait complete. 2024-09-10T07:39:23.227 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:39:27.929 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:39:27.929+0000 7f6528800640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2024-09-10T07:39:28.228 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:39:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.392+0000 7fadc7000640 1 Processor -- start 2024-09-10T07:39:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.393+0000 7fadc7000640 1 -- start start 2024-09-10T07:39:28.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.394+0000 7fadc7000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc013fae0 0x7fadc006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:28.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.394+0000 7fadc7000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fadc0160c50 0x7fadc00cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:28.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.394+0000 7fadc7000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc0142650 con 0x7fadc0142150 2024-09-10T07:39:28.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.394+0000 7fadc7000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fadc00ce780 con 0x7fadc0160c50 2024-09-10T07:39:28.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.394+0000 7fadc7000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fadc0142930 con 0x7fadc013fae0 2024-09-10T07:39:28.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.394+0000 7fadbf400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fadc0142150 0x7fadc0160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38588/0 (socket says 172.21.15.99:38588) 2024-09-10T07:39:28.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.394+0000 7fadbf400640 1 -- 172.21.15.99:0/1737845042 learned_addr learned my addr 172.21.15.99:0/1737845042 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:28.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.394+0000 7fadc5000640 1 --2- 172.21.15.99:0/1737845042 >> v2:172.21.15.99:3300/0 conn(0x7fadc0160c50 0x7fadc00cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:28.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.395+0000 7fadbfe00640 1 --2- 172.21.15.99:0/1737845042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc013fae0 0x7fadc006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:28.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.395+0000 7fadc5000640 1 -- 172.21.15.99:0/1737845042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc013fae0 msgr2=0x7fadc006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.395+0000 7fadc5000640 1 --2- 172.21.15.99:0/1737845042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc013fae0 0x7fadc006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.395+0000 7fadc5000640 1 -- 172.21.15.99:0/1737845042 >> v1:172.21.15.99:6789/0 conn(0x7fadc0142150 legacy=0x7fadc0160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.395+0000 7fadc5000640 1 -- 172.21.15.99:0/1737845042 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc0142c10 con 0x7fadc0160c50 2024-09-10T07:39:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.395+0000 7fadbfe00640 1 --2- 172.21.15.99:0/1737845042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc013fae0 0x7fadc006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.396+0000 7fadc5000640 1 --2- 172.21.15.99:0/1737845042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0160c50 0x7fadc00cec10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009d90 tx=0x7fadb802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7343ece5140ee5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.396+0000 7fadbea00640 1 -- 172.21.15.99:0/1737845042 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8031600 con 0x7fadc0160c50 2024-09-10T07:39:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.396+0000 7fadbea00640 1 -- 172.21.15.99:0/1737845042 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb80317a0 con 0x7fadc0160c50 2024-09-10T07:39:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.396+0000 7fadbea00640 1 -- 172.21.15.99:0/1737845042 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8031b70 con 0x7fadc0160c50 2024-09-10T07:39:28.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.396+0000 7fadc7000640 1 -- 172.21.15.99:0/1737845042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0160c50 msgr2=0x7fadc00cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:28.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.396+0000 7fadc7000640 1 --2- 172.21.15.99:0/1737845042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0160c50 0x7fadc00cec10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009d90 tx=0x7fadb802a5d0 comp rx=0 tx=0).stop 2024-09-10T07:39:28.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.396+0000 7fadc7000640 1 -- 172.21.15.99:0/1737845042 shutdown_connections 2024-09-10T07:39:28.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.396+0000 7fadc7000640 1 --2- 172.21.15.99:0/1737845042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0160c50 0x7fadc00cec10 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:28.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.396+0000 7fadc7000640 1 --2- 172.21.15.99:0/1737845042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc013fae0 0x7fadc006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:28.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.396+0000 7fadc7000640 1 -- 172.21.15.99:0/1737845042 >> 172.21.15.99:0/1737845042 conn(0x7fadc006bc10 msgr2=0x7fadc006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:28.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.397+0000 7fadc7000640 1 -- 172.21.15.99:0/1737845042 shutdown_connections 2024-09-10T07:39:28.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.397+0000 7fadc7000640 1 -- 172.21.15.99:0/1737845042 wait complete. 2024-09-10T07:39:28.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.398+0000 7fadc7000640 1 Processor -- start 2024-09-10T07:39:28.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.398+0000 7fadc7000640 1 -- start start 2024-09-10T07:39:28.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.399+0000 7fadc7000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadc013fae0 0x7fadc01f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:28.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.399+0000 7fadc7000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0142150 0x7fadc013d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:28.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.399+0000 7fadc7000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc0160c50 0x7fadc00b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:28.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.399+0000 7fadc7000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fadc006f870 con 0x7fadc0142150 2024-09-10T07:39:28.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.399+0000 7fadc7000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fadc006f6f0 con 0x7fadc013fae0 2024-09-10T07:39:28.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.399+0000 7fadc7000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fadc00cf150 con 0x7fadc0160c50 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.399+0000 7fadbf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0142150 0x7fadc013d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadbf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0142150 0x7fadc013d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47948/0 (socket says 172.21.15.99:47948) 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadbf400640 1 -- 172.21.15.99:0/707376461 learned_addr learned my addr 172.21.15.99:0/707376461 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadc5000640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc0160c50 0x7fadc00b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadbfe00640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadc013fae0 0x7fadc01f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadbf400640 1 -- 172.21.15.99:0/707376461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc0160c50 msgr2=0x7fadc00b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadbf400640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc0160c50 0x7fadc00b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadbf400640 1 -- 172.21.15.99:0/707376461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadc013fae0 msgr2=0x7fadc01f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadbf400640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadc013fae0 0x7fadc01f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadbf400640 1 -- 172.21.15.99:0/707376461 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc01f5260 con 0x7fadc0142150 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadbf400640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0142150 0x7fadc013d850 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c3a0 tx=0x7fadac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadb7e00640 1 -- 172.21.15.99:0/707376461 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac017070 con 0x7fadc0142150 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadb7e00640 1 -- 172.21.15.99:0/707376461 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac005ce0 con 0x7fadc0142150 2024-09-10T07:39:28.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadb7e00640 1 -- 172.21.15.99:0/707376461 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac0072f0 con 0x7fadc0142150 2024-09-10T07:39:28.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.400+0000 7fadc7000640 1 -- 172.21.15.99:0/707376461 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc00b4270 con 0x7fadc0142150 2024-09-10T07:39:28.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.401+0000 7fadc7000640 1 -- 172.21.15.99:0/707376461 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc00b4b10 con 0x7fadc0142150 2024-09-10T07:39:28.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.402+0000 7fadc7000640 1 -- 172.21.15.99:0/707376461 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc006f1b0 con 0x7fadc0142150 2024-09-10T07:39:28.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.403+0000 7fadb7e00640 1 -- 172.21.15.99:0/707376461 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadac01a070 con 0x7fadc0142150 2024-09-10T07:39:28.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.403+0000 7fadb7e00640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fada006be30 0x7fada006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:28.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.403+0000 7fadb7e00640 1 -- 172.21.15.99:0/707376461 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5738+0+0 (secure 0 0 0) 0x7fadac08a1d0 con 0x7fadc0142150 2024-09-10T07:39:28.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.404+0000 7fadbfe00640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fada006be30 0x7fada006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:28.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.404+0000 7fadb7e00640 1 -- 172.21.15.99:0/707376461 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=110}) -- 0x7fada00739c0 con 0x7fadc0142150 2024-09-10T07:39:28.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.404+0000 7fadbfe00640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fada006be30 0x7fada006e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fadb000a990 tx=0x7fadb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:28.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.408+0000 7fadb7e00640 1 -- 172.21.15.99:0/707376461 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fadc01f5260 con 0x7fadc0142150 2024-09-10T07:39:28.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.581+0000 7fadc7000640 1 -- 172.21.15.99:0/707376461 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fadc00b4600 con 0x7fadc0142150 2024-09-10T07:39:28.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.582+0000 7fadb7e00640 1 -- 172.21.15.99:0/707376461 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v109) ==== 81+0+34575 (secure 0 0 0) 0x7fadac058bf0 con 0x7fadc0142150 2024-09-10T07:39:28.583 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:28.583 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:39:28.583 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 109, 2024-09-10T07:39:28.583 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:39:28.583 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:39:28.583 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:39:27.930159+0000", 2024-09-10T07:39:28.583 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:39:28.583 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:39:28.583 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:39:28.584 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 13, 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "luminous", 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:28.585 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:39:28.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:28.587 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:28.588 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.589 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.590 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:28.591 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 12, 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:58.485547+0000", 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:28.592 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:28.593 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:28.594 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:28.595 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:28.596 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:28.597 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 13, 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:59.701338+0000", 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 3, 2024-09-10T07:39:28.598 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full", 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:39:28.599 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "104", 2024-09-10T07:39:28.600 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:39:28.603 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:39:28.604 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:28.605 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.606 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.607 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.608 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.609 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:28.611 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.612 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.614 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:39:28.615 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:28.616 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:28.621 INFO:teuthology.orchestra.run.smithi099.stdout: "full", 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:28.622 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:39:28.623 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.624 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:39:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:39:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:28.627 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 102, 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.628 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:28.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull", 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:28.635 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:39:28.636 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:39:28.637 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.639 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.640 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:39:28.641 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:28.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:28.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:28.644 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.647 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.648 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull", 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:28.649 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:28.650 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:28.651 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:28.653 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:28.654 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:28.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [ 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "13.3b", 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 1, 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 3 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:39:28.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:28.658 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:39:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.584+0000 7fadc7000640 1 -- 172.21.15.99:0/707376461 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fada006be30 msgr2=0x7fada006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.584+0000 7fadc7000640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fada006be30 0x7fada006e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fadb000a990 tx=0x7fadb0008040 comp rx=0 tx=0).stop 2024-09-10T07:39:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.584+0000 7fadc7000640 1 -- 172.21.15.99:0/707376461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0142150 msgr2=0x7fadc013d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.584+0000 7fadc7000640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0142150 0x7fadc013d850 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c3a0 tx=0x7fadac00c860 comp rx=0 tx=0).stop 2024-09-10T07:39:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.585+0000 7fadc7000640 1 -- 172.21.15.99:0/707376461 shutdown_connections 2024-09-10T07:39:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.585+0000 7fadc7000640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadc0160c50 0x7fadc00b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.585+0000 7fadc7000640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fada006be30 0x7fada006e2f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.585+0000 7fadc7000640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadc0142150 0x7fadc013d850 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.585+0000 7fadc7000640 1 --2- 172.21.15.99:0/707376461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadc013fae0 0x7fadc01f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.585+0000 7fadc7000640 1 -- 172.21.15.99:0/707376461 >> 172.21.15.99:0/707376461 conn(0x7fadc006bc10 msgr2=0x7fadc0160460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.585+0000 7fadc7000640 1 -- 172.21.15.99:0/707376461 shutdown_connections 2024-09-10T07:39:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:28.585+0000 7fadc7000640 1 -- 172.21.15.99:0/707376461 wait complete. 2024-09-10T07:39:28.662 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:39:33.662 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:39:33.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.828+0000 7fe216800640 1 Processor -- start 2024-09-10T07:39:33.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.828+0000 7fe216800640 1 -- start start 2024-09-10T07:39:33.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.829+0000 7fe216800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe21006eb60 0x7fe21015c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:33.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.829+0000 7fe216800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21015d450 con 0x7fe210155c80 2024-09-10T07:39:33.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.829+0000 7fe216800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe210156060 con 0x7fe21015bb80 2024-09-10T07:39:33.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.829+0000 7fe216800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe2100723d0 con 0x7fe21006eb60 2024-09-10T07:39:33.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.829+0000 7fe215e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe21006eb60 0x7fe21015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:33.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.829+0000 7fe215e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe21006eb60 0x7fe21015c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60334/0 (socket says 172.21.15.99:60334) 2024-09-10T07:39:33.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.829+0000 7fe215e00640 1 -- 172.21.15.99:0/674459842 learned_addr learned my addr 172.21.15.99:0/674459842 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:33.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.830+0000 7fe215e00640 1 -- 172.21.15.99:0/674459842 >> v1:172.21.15.187:6789/0 conn(0x7fe21015bb80 legacy=0x7fe21006e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:33.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.830+0000 7fe215e00640 1 -- 172.21.15.99:0/674459842 >> v1:172.21.15.99:6789/0 conn(0x7fe210155c80 legacy=0x7fe21015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:33.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.830+0000 7fe215e00640 1 -- 172.21.15.99:0/674459842 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21015c6f0 con 0x7fe21006eb60 2024-09-10T07:39:33.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.830+0000 7fe20fe00640 1 -- 172.21.15.99:0/674459842 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4141122219 0 0) 0x7fe21015d450 con 0x7fe210155c80 2024-09-10T07:39:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.831+0000 7fe215e00640 1 --2- 172.21.15.99:0/674459842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe21006eb60 0x7fe21015c010 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe208009e80 tx=0x7fe20802a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3298928c3318b7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.831+0000 7fe20fe00640 1 -- 172.21.15.99:0/674459842 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208036070 con 0x7fe21006eb60 2024-09-10T07:39:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.831+0000 7fe20fe00640 1 -- 172.21.15.99:0/674459842 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe208031600 con 0x7fe21006eb60 2024-09-10T07:39:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.831+0000 7fe20fe00640 1 -- 172.21.15.99:0/674459842 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2080319d0 con 0x7fe21006eb60 2024-09-10T07:39:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.831+0000 7fe216800640 1 -- 172.21.15.99:0/674459842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe21006eb60 msgr2=0x7fe21015c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:33.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.831+0000 7fe216800640 1 --2- 172.21.15.99:0/674459842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe21006eb60 0x7fe21015c010 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe208009e80 tx=0x7fe20802a7e0 comp rx=0 tx=0).stop 2024-09-10T07:39:33.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.831+0000 7fe216800640 1 -- 172.21.15.99:0/674459842 shutdown_connections 2024-09-10T07:39:33.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.831+0000 7fe216800640 1 --2- 172.21.15.99:0/674459842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe21006eb60 0x7fe21015c010 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:33.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.831+0000 7fe216800640 1 -- 172.21.15.99:0/674459842 >> 172.21.15.99:0/674459842 conn(0x7fe2100b2810 msgr2=0x7fe2100b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:33.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.832+0000 7fe216800640 1 -- 172.21.15.99:0/674459842 shutdown_connections 2024-09-10T07:39:33.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.832+0000 7fe216800640 1 -- 172.21.15.99:0/674459842 wait complete. 2024-09-10T07:39:33.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.833+0000 7fe216800640 1 Processor -- start 2024-09-10T07:39:33.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.833+0000 7fe216800640 1 -- start start 2024-09-10T07:39:33.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.834+0000 7fe216800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe21006eb60 0x7fe21014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:33.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.834+0000 7fe216800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe210155c80 0x7fe210149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:33.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.834+0000 7fe216800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21015bb80 0x7fe21014e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:33.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.834+0000 7fe216800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe210072900 con 0x7fe210155c80 2024-09-10T07:39:33.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.834+0000 7fe216800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe210072620 con 0x7fe21006eb60 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.834+0000 7fe216800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe210071ce0 con 0x7fe21015bb80 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.834+0000 7fe214a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe210155c80 0x7fe210149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.834+0000 7fe214a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe210155c80 0x7fe210149f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60344/0 (socket says 172.21.15.99:60344) 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.834+0000 7fe214a00640 1 -- 172.21.15.99:0/3577639011 learned_addr learned my addr 172.21.15.99:0/3577639011 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.834+0000 7fe215400640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe21006eb60 0x7fe21014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe215e00640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21015bb80 0x7fe21014e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe214a00640 1 -- 172.21.15.99:0/3577639011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21015bb80 msgr2=0x7fe21014e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe214a00640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21015bb80 0x7fe21014e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe214a00640 1 -- 172.21.15.99:0/3577639011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe21006eb60 msgr2=0x7fe21014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe214a00640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe21006eb60 0x7fe21014a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe214a00640 1 -- 172.21.15.99:0/3577639011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2100cdaa0 con 0x7fe210155c80 2024-09-10T07:39:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe215e00640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21015bb80 0x7fe21014e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe214a00640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe210155c80 0x7fe210149f10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00c400 tx=0x7fe1fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe20d600640 1 -- 172.21.15.99:0/3577639011 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc017070 con 0x7fe210155c80 2024-09-10T07:39:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe20d600640 1 -- 172.21.15.99:0/3577639011 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc0052d0 con 0x7fe210155c80 2024-09-10T07:39:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe20d600640 1 -- 172.21.15.99:0/3577639011 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc003830 con 0x7fe210155c80 2024-09-10T07:39:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.835+0000 7fe216800640 1 -- 172.21.15.99:0/3577639011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21014e9e0 con 0x7fe210155c80 2024-09-10T07:39:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.836+0000 7fe216800640 1 -- 172.21.15.99:0/3577639011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2100ce020 con 0x7fe210155c80 2024-09-10T07:39:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.837+0000 7fe216800640 1 -- 172.21.15.99:0/3577639011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2100cfd40 con 0x7fe210155c80 2024-09-10T07:39:33.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.837+0000 7fe20d600640 1 -- 172.21.15.99:0/3577639011 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1fc01a070 con 0x7fe210155c80 2024-09-10T07:39:33.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.838+0000 7fe20d600640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1f006be60 0x7fe1f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:33.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.838+0000 7fe20d600640 1 -- 172.21.15.99:0/3577639011 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7fe1fc08a110 con 0x7fe210155c80 2024-09-10T07:39:33.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.838+0000 7fe215400640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1f006be60 0x7fe1f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:33.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.839+0000 7fe215400640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1f006be60 0x7fe1f006e320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe204000f60 tx=0x7fe204009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:33.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:33.843+0000 7fe20d600640 1 -- 172.21.15.99:0/3577639011 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2100cfd40 con 0x7fe210155c80 2024-09-10T07:39:34.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.020+0000 7fe216800640 1 -- 172.21.15.99:0/3577639011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fe21015c010 con 0x7fe210155c80 2024-09-10T07:39:34.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.021+0000 7fe20d600640 1 -- 172.21.15.99:0/3577639011 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) ==== 81+0+34424 (secure 0 0 0) 0x7fe210156060 con 0x7fe210155c80 2024-09-10T07:39:34.022 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:34.022 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:39:34.022 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 113, 2024-09-10T07:39:34.022 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:39:34.022 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:39:34.022 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:39:32.958523+0000", 2024-09-10T07:39:34.022 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:39:34.022 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:39:34.023 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:39:34.023 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:39:34.023 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:39:34.023 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:39:34.023 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:39:34.023 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:39:34.023 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:39:34.023 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:34.023 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:39:34.023 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 13, 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "luminous", 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:39:34.024 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:34.025 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:34.026 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:34.027 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:34.028 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:34.029 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:39:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 12, 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:58.485547+0000", 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:39:34.032 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:34.033 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:34.034 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:34.035 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:34.036 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 13, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:59.701338+0000", 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:34.038 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:34.039 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:34.040 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:34.041 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:34.042 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:39:34.043 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.044 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.046 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.047 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.049 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.050 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.051 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.052 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.052 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.052 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:39:34.052 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.052 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.052 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:39:34.052 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:39:34.053 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.054 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.056 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.057 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.058 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.059 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.060 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.061 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:39:34.062 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:39:34.063 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.064 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.065 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:39:34.066 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.067 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 102, 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:39:34.068 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.071 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.072 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.074 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:39:34.076 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.078 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:39:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:39:34.083 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.084 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:39:34.085 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.089 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.091 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.093 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:39:34.094 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [ 2024-09-10T07:39:34.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "13.3b", 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 1, 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 3 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:39:34.096 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:39:34.097 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:39:34.098 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:39:34.098 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:39:34.098 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:39:34.098 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:39:34.098 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:39:34.098 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:39:34.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.098 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:39:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 -- 172.21.15.99:0/3577639011 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1f006be60 msgr2=0x7fe1f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1f006be60 0x7fe1f006e320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe204000f60 tx=0x7fe204009040 comp rx=0 tx=0).stop 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 -- 172.21.15.99:0/3577639011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe210155c80 msgr2=0x7fe210149f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe210155c80 0x7fe210149f10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00c400 tx=0x7fe1fc00c8c0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 -- 172.21.15.99:0/3577639011 shutdown_connections 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21015bb80 0x7fe21014e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe1f006be60 0x7fe1f006e320 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe210155c80 0x7fe210149f10 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 --2- 172.21.15.99:0/3577639011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe21006eb60 0x7fe21014a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 -- 172.21.15.99:0/3577639011 >> 172.21.15.99:0/3577639011 conn(0x7fe2100b2810 msgr2=0x7fe2100b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 -- 172.21.15.99:0/3577639011 shutdown_connections 2024-09-10T07:39:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.024+0000 7fe216800640 1 -- 172.21.15.99:0/3577639011 wait complete. 2024-09-10T07:39:34.101 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-10T07:39:34.101 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:39:34.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.256+0000 7efc77000640 1 Processor -- start 2024-09-10T07:39:34.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.256+0000 7efc77000640 1 -- start start 2024-09-10T07:39:34.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.257+0000 7efc77000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efc700afe70 0x7efc700b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:34.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.257+0000 7efc77000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc700b0310 con 0x7efc700b19d0 2024-09-10T07:39:34.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.257+0000 7efc77000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc700b05f0 con 0x7efc7015c6f0 2024-09-10T07:39:34.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.257+0000 7efc77000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7efc700b0f20 con 0x7efc700afe70 2024-09-10T07:39:34.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.257+0000 7efc76600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7efc700b19d0 0x7efc7006f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37466/0 (socket says 172.21.15.99:37466) 2024-09-10T07:39:34.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.257+0000 7efc76600640 1 -- 172.21.15.99:0/1895122251 learned_addr learned my addr 172.21.15.99:0/1895122251 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:34.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.257+0000 7efc75200640 1 --2- 172.21.15.99:0/1895122251 >> v2:172.21.15.187:3300/0 conn(0x7efc700afe70 0x7efc700b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:34.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.258+0000 7efc6fe00640 1 -- 172.21.15.99:0/1895122251 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006503049 0 0) 0x7efc700b0310 con 0x7efc700b19d0 2024-09-10T07:39:34.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.258+0000 7efc6fe00640 1 -- 172.21.15.99:0/1895122251 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc58003520 con 0x7efc700b19d0 2024-09-10T07:39:34.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.258+0000 7efc75200640 1 -- 172.21.15.99:0/1895122251 >> v1:172.21.15.187:6789/0 conn(0x7efc7015c6f0 legacy=0x7efc700b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.258+0000 7efc75200640 1 -- 172.21.15.99:0/1895122251 >> v1:172.21.15.99:6789/0 conn(0x7efc700b19d0 legacy=0x7efc7006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.258+0000 7efc75200640 1 -- 172.21.15.99:0/1895122251 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc700b08d0 con 0x7efc700afe70 2024-09-10T07:39:34.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.259+0000 7efc75200640 1 --2- 172.21.15.99:0/1895122251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc700afe70 0x7efc700b1e40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efc700b10a0 tx=0x7efc5c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67a1162e62ebe77c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:34.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.259+0000 7efc6fe00640 1 -- 172.21.15.99:0/1895122251 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c037070 con 0x7efc700afe70 2024-09-10T07:39:34.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.259+0000 7efc6fe00640 1 -- 172.21.15.99:0/1895122251 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5c032440 con 0x7efc700afe70 2024-09-10T07:39:34.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.259+0000 7efc6fe00640 1 -- 172.21.15.99:0/1895122251 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c032810 con 0x7efc700afe70 2024-09-10T07:39:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.260+0000 7efc77000640 1 -- 172.21.15.99:0/1895122251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc700afe70 msgr2=0x7efc700b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.260+0000 7efc77000640 1 --2- 172.21.15.99:0/1895122251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc700afe70 0x7efc700b1e40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efc700b10a0 tx=0x7efc5c02a180 comp rx=0 tx=0).stop 2024-09-10T07:39:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.260+0000 7efc77000640 1 -- 172.21.15.99:0/1895122251 shutdown_connections 2024-09-10T07:39:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.260+0000 7efc77000640 1 --2- 172.21.15.99:0/1895122251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc700afe70 0x7efc700b1e40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.260+0000 7efc77000640 1 -- 172.21.15.99:0/1895122251 >> 172.21.15.99:0/1895122251 conn(0x7efc700b7cc0 msgr2=0x7efc700b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.260+0000 7efc77000640 1 -- 172.21.15.99:0/1895122251 shutdown_connections 2024-09-10T07:39:34.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.260+0000 7efc77000640 1 -- 172.21.15.99:0/1895122251 wait complete. 2024-09-10T07:39:34.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.262+0000 7efc77000640 1 Processor -- start 2024-09-10T07:39:34.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.262+0000 7efc77000640 1 -- start start 2024-09-10T07:39:34.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.262+0000 7efc77000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc700afe70 0x7efc7014a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.262+0000 7efc77000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc700b19d0 0x7efc701566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc77000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7015c6f0 0x7efc70156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc77000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7efc7015cad0 con 0x7efc700afe70 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc77000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7efc700b13b0 con 0x7efc700b19d0 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc77000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7efc7015cc50 con 0x7efc7015c6f0 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc75c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc700afe70 0x7efc7014a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc75c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc700afe70 0x7efc7014a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60356/0 (socket says 172.21.15.99:60356) 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc75c00640 1 -- 172.21.15.99:0/4071476912 learned_addr learned my addr 172.21.15.99:0/4071476912 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc75200640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc700b19d0 0x7efc701566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc76600640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7015c6f0 0x7efc70156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc75c00640 1 -- 172.21.15.99:0/4071476912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7015c6f0 msgr2=0x7efc70156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc75c00640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7015c6f0 0x7efc70156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc75c00640 1 -- 172.21.15.99:0/4071476912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc700b19d0 msgr2=0x7efc701566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc75c00640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc700b19d0 0x7efc701566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc75c00640 1 -- 172.21.15.99:0/4071476912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7015a950 con 0x7efc700afe70 2024-09-10T07:39:34.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.263+0000 7efc75c00640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc700afe70 0x7efc7014a290 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c3c0 tx=0x7efc6400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:34.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.264+0000 7efc6d600640 1 -- 172.21.15.99:0/4071476912 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc640052d0 con 0x7efc700afe70 2024-09-10T07:39:34.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.264+0000 7efc6d600640 1 -- 172.21.15.99:0/4071476912 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc64005490 con 0x7efc700afe70 2024-09-10T07:39:34.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.264+0000 7efc77000640 1 -- 172.21.15.99:0/4071476912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7009fb80 con 0x7efc700afe70 2024-09-10T07:39:34.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.264+0000 7efc6d600640 1 -- 172.21.15.99:0/4071476912 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64007260 con 0x7efc700afe70 2024-09-10T07:39:34.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.264+0000 7efc77000640 1 -- 172.21.15.99:0/4071476912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7009ca50 con 0x7efc700afe70 2024-09-10T07:39:34.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.265+0000 7efc77000640 1 -- 172.21.15.99:0/4071476912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc700b69e0 con 0x7efc700afe70 2024-09-10T07:39:34.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.266+0000 7efc6d600640 1 -- 172.21.15.99:0/4071476912 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc64007400 con 0x7efc700afe70 2024-09-10T07:39:34.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.266+0000 7efc6d600640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efc5006be60 0x7efc5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:34.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.267+0000 7efc6d600640 1 -- 172.21.15.99:0/4071476912 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7efc6408a310 con 0x7efc700afe70 2024-09-10T07:39:34.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.267+0000 7efc75200640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efc5006be60 0x7efc5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:34.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.267+0000 7efc75200640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efc5006be60 0x7efc5006e320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efc5c034000 tx=0x7efc5c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:34.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.271+0000 7efc6d600640 1 -- 172.21.15.99:0/4071476912 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc64058c90 con 0x7efc700afe70 2024-09-10T07:39:34.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.445+0000 7efc77000640 1 -- 172.21.15.99:0/4071476912 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7efc700cec40 con 0x7efc700afe70 2024-09-10T07:39:34.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.446+0000 7efc6d600640 1 -- 172.21.15.99:0/4071476912 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) ==== 81+0+34424 (secure 0 0 0) 0x7efc6408a0d0 con 0x7efc700afe70 2024-09-10T07:39:34.446 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 113, 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:39:32.958523+0000", 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:39:34.447 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 13, 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "luminous", 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:39:34.448 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:34.449 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:34.450 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:34.451 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:34.452 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:34.453 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:39:34.454 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 12, 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:58.485547+0000", 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:34.455 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:39:34.456 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:39:34.457 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:34.458 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:34.459 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.460 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:34.461 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 13, 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:38:59.701338+0000", 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:39:34.462 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:39:34.463 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:39:34.464 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:39:34.465 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:39:34.466 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:39:34.467 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:34.468 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:39:34.473 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.474 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.475 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.478 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.479 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:39:34.484 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.485 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.490 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 102, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.491 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.494 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.495 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.496 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:39:34.497 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:39:34.498 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:39:34.499 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:39:34.500 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:39:34.501 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.502 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:39:34.503 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:39:34.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:39:34.507 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 99, 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:39:34.508 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.510 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.510 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:39:34.510 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.510 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.510 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:39:34.511 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.512 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.513 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.514 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.515 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.517 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:39:34.518 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:39:34.519 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [ 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: "pgid": "13.3b", 2024-09-10T07:39:34.520 INFO:teuthology.orchestra.run.smithi099.stdout: "mappings": [ 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: "from": 1, 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: "to": 3 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:39:34.521 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:39:34.522 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:39:34.523 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:39:34.523 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:39:34.523 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:39:34.523 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:39:34.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:34.523 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:39:34.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 -- 172.21.15.99:0/4071476912 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efc5006be60 msgr2=0x7efc5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efc5006be60 0x7efc5006e320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efc5c034000 tx=0x7efc5c02e000 comp rx=0 tx=0).stop 2024-09-10T07:39:34.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 -- 172.21.15.99:0/4071476912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc700afe70 msgr2=0x7efc7014a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc700afe70 0x7efc7014a290 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c3c0 tx=0x7efc6400c880 comp rx=0 tx=0).stop 2024-09-10T07:39:34.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 -- 172.21.15.99:0/4071476912 shutdown_connections 2024-09-10T07:39:34.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7015c6f0 0x7efc70156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc700b19d0 0x7efc701566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efc5006be60 0x7efc5006e320 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 --2- 172.21.15.99:0/4071476912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc700afe70 0x7efc7014a290 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 -- 172.21.15.99:0/4071476912 >> 172.21.15.99:0/4071476912 conn(0x7efc700b7cc0 msgr2=0x7efc700b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:34.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.448+0000 7efc77000640 1 -- 172.21.15.99:0/4071476912 shutdown_connections 2024-09-10T07:39:34.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.449+0000 7efc77000640 1 -- 172.21.15.99:0/4071476912 wait complete. 2024-09-10T07:39:34.526 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:34.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.685+0000 7f9b29e00640 1 Processor -- start 2024-09-10T07:39:34.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.685+0000 7f9b29e00640 1 -- start start 2024-09-10T07:39:34.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.686+0000 7f9b29e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24142150 0x7f9b24160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:34.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.686+0000 7f9b29e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b24142650 con 0x7f9b24160a80 2024-09-10T07:39:34.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.686+0000 7f9b29e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b24142930 con 0x7f9b2413fae0 2024-09-10T07:39:34.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.686+0000 7f9b29e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9b240ce780 con 0x7f9b24142150 2024-09-10T07:39:34.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.687+0000 7f9b23400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9b24160a80 0x7f9b240cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37476/0 (socket says 172.21.15.99:37476) 2024-09-10T07:39:34.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.687+0000 7f9b23400640 1 -- 172.21.15.99:0/3251021829 learned_addr learned my addr 172.21.15.99:0/3251021829 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.687+0000 7f9b1a000640 1 --2- 172.21.15.99:0/3251021829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24142150 0x7f9b24160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.687+0000 7f9b22000640 1 -- 172.21.15.99:0/3251021829 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566505418 0 0) 0x7f9b24142650 con 0x7f9b24160a80 2024-09-10T07:39:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.687+0000 7f9b22000640 1 -- 172.21.15.99:0/3251021829 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b08003520 con 0x7f9b24160a80 2024-09-10T07:39:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.687+0000 7f9b22000640 1 -- 172.21.15.99:0/3251021829 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155871214 0 0) 0x7f9b24142930 con 0x7f9b2413fae0 2024-09-10T07:39:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.687+0000 7f9b22000640 1 -- 172.21.15.99:0/3251021829 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b24142650 con 0x7f9b2413fae0 2024-09-10T07:39:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.687+0000 7f9b1a000640 1 -- 172.21.15.99:0/3251021829 >> v1:172.21.15.187:6789/0 conn(0x7f9b2413fae0 legacy=0x7f9b2406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.687+0000 7f9b1a000640 1 -- 172.21.15.99:0/3251021829 >> v1:172.21.15.99:6789/0 conn(0x7f9b24160a80 legacy=0x7f9b240cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.688+0000 7f9b1a000640 1 -- 172.21.15.99:0/3251021829 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b24142c10 con 0x7f9b24142150 2024-09-10T07:39:34.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.689+0000 7f9b1a000640 1 --2- 172.21.15.99:0/3251021829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24142150 0x7f9b24160540 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0097d0 tx=0x7f9b0c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5b63e9f48bd86c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:34.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.689+0000 7f9b22000640 1 -- 172.21.15.99:0/3251021829 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c037070 con 0x7f9b24142150 2024-09-10T07:39:34.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.689+0000 7f9b22000640 1 -- 172.21.15.99:0/3251021829 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c032440 con 0x7f9b24142150 2024-09-10T07:39:34.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.689+0000 7f9b22000640 1 -- 172.21.15.99:0/3251021829 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c032810 con 0x7f9b24142150 2024-09-10T07:39:34.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.689+0000 7f9b29e00640 1 -- 172.21.15.99:0/3251021829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24142150 msgr2=0x7f9b24160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.689+0000 7f9b29e00640 1 --2- 172.21.15.99:0/3251021829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24142150 0x7f9b24160540 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0097d0 tx=0x7f9b0c02a180 comp rx=0 tx=0).stop 2024-09-10T07:39:34.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.690+0000 7f9b29e00640 1 -- 172.21.15.99:0/3251021829 shutdown_connections 2024-09-10T07:39:34.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.690+0000 7f9b29e00640 1 --2- 172.21.15.99:0/3251021829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24142150 0x7f9b24160540 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.690+0000 7f9b29e00640 1 -- 172.21.15.99:0/3251021829 >> 172.21.15.99:0/3251021829 conn(0x7f9b2406bc10 msgr2=0x7f9b2406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:34.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.690+0000 7f9b29e00640 1 -- 172.21.15.99:0/3251021829 shutdown_connections 2024-09-10T07:39:34.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.690+0000 7f9b29e00640 1 -- 172.21.15.99:0/3251021829 wait complete. 2024-09-10T07:39:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.691+0000 7f9b29e00640 1 Processor -- start 2024-09-10T07:39:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.691+0000 7f9b29e00640 1 -- start start 2024-09-10T07:39:34.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.692+0000 7f9b29e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b2413fae0 0x7f9b240b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:34.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.692+0000 7f9b29e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b24142150 0x7f9b2413ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:34.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.692+0000 7f9b29e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24160a80 0x7f9b2415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.692+0000 7f9b29e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9b240cf4a0 con 0x7f9b24142150 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.692+0000 7f9b29e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9b240cf320 con 0x7f9b2413fae0 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.692+0000 7f9b29e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9b240cf620 con 0x7f9b24160a80 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.692+0000 7f9b1a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b24142150 0x7f9b2413ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b1a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b24142150 0x7f9b2413ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60372/0 (socket says 172.21.15.99:60372) 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b1a000640 1 -- 172.21.15.99:0/3263721261 learned_addr learned my addr 172.21.15.99:0/3263721261 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b23400640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24160a80 0x7f9b2415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b22a00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b2413fae0 0x7f9b240b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b1a000640 1 -- 172.21.15.99:0/3263721261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24160a80 msgr2=0x7f9b2415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b1a000640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24160a80 0x7f9b2415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b1a000640 1 -- 172.21.15.99:0/3263721261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b2413fae0 msgr2=0x7f9b240b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b1a000640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b2413fae0 0x7f9b240b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b1a000640 1 -- 172.21.15.99:0/3263721261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2413f240 con 0x7f9b24142150 2024-09-10T07:39:34.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b23400640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24160a80 0x7f9b2415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:34.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b22a00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b2413fae0 0x7f9b240b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:34.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b1a000640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b24142150 0x7f9b2413ed00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c035040 tx=0x7f9b0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:34.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.693+0000 7f9b1be00640 1 -- 172.21.15.99:0/3263721261 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c037040 con 0x7f9b24142150 2024-09-10T07:39:34.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.694+0000 7f9b1be00640 1 -- 172.21.15.99:0/3263721261 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c03b430 con 0x7f9b24142150 2024-09-10T07:39:34.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.694+0000 7f9b29e00640 1 -- 172.21.15.99:0/3263721261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b241e6750 con 0x7f9b24142150 2024-09-10T07:39:34.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.694+0000 7f9b1be00640 1 -- 172.21.15.99:0/3263721261 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c03b820 con 0x7f9b24142150 2024-09-10T07:39:34.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.694+0000 7f9b29e00640 1 -- 172.21.15.99:0/3263721261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b241e6d10 con 0x7f9b24142150 2024-09-10T07:39:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.695+0000 7f9b29e00640 1 -- 172.21.15.99:0/3263721261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b24160540 con 0x7f9b24142150 2024-09-10T07:39:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.696+0000 7f9b1be00640 1 -- 172.21.15.99:0/3263721261 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b0c03b9c0 con 0x7f9b24142150 2024-09-10T07:39:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.696+0000 7f9b1be00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b0006be60 0x7f9b0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.696+0000 7f9b1be00640 1 -- 172.21.15.99:0/3263721261 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7f9b0c0aae90 con 0x7f9b24142150 2024-09-10T07:39:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.697+0000 7f9b22a00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b0006be60 0x7f9b0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.697+0000 7f9b22a00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b0006be60 0x7f9b0006e320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9b140016b0 tx=0x7f9b14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:34.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.701+0000 7f9b1be00640 1 -- 172.21.15.99:0/3263721261 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b0c079820 con 0x7f9b24142150 2024-09-10T07:39:34.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.909+0000 7f9b29e00640 1 -- 172.21.15.99:0/3263721261 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b24156eb0 con 0x7f9b24142150 2024-09-10T07:39:34.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.910+0000 7f9b1be00640 1 -- 172.21.15.99:0/3263721261 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7f9b0c079120 con 0x7f9b24142150 2024-09-10T07:39:34.910 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:34.910 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":49,"btime":"2024-09-10T07:39:04:324940+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/224049994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":224049994},{"type":"v1","addr":"172.21.15.187:6834","nonce":224049994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2009047482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2009047482},{"type":"v1","addr":"172.21.15.187:6835","nonce":2009047482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3952584402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3952584402},{"type":"v1","addr":"172.21.15.99:6837","nonce":3952584402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:00.703298+0000","modified":"2024-09-10T07:39:03.726531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/1858150570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1858150570},{"type":"v1","addr":"172.21.15.99:6835","nonce":1858150570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":6}]} 2024-09-10T07:39:34.910 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 49 2024-09-10T07:39:34.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 -- 172.21.15.99:0/3263721261 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b0006be60 msgr2=0x7f9b0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b0006be60 0x7f9b0006e320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9b140016b0 tx=0x7f9b14009040 comp rx=0 tx=0).stop 2024-09-10T07:39:34.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 -- 172.21.15.99:0/3263721261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b24142150 msgr2=0x7f9b2413ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:34.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b24142150 0x7f9b2413ed00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c035040 tx=0x7f9b0c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 -- 172.21.15.99:0/3263721261 shutdown_connections 2024-09-10T07:39:34.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b24160a80 0x7f9b2415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b0006be60 0x7f9b0006e320 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b24142150 0x7f9b2413ed00 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 --2- 172.21.15.99:0/3263721261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b2413fae0 0x7f9b240b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:34.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 -- 172.21.15.99:0/3263721261 >> 172.21.15.99:0/3263721261 conn(0x7f9b2406bc10 msgr2=0x7f9b24074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:34.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 -- 172.21.15.99:0/3263721261 shutdown_connections 2024-09-10T07:39:34.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:34.912+0000 7f9b29e00640 1 -- 172.21.15.99:0/3263721261 wait complete. 2024-09-10T07:39:34.928 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:39:35.103 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":6069,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":33.776245277999998,"mdsmap_epoch":49,"osdmap_epoch":113,"osdmap_epoch_barrier":107,"uptime":38.329605317999999} 2024-09-10T07:39:35.103 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 6069, "mdsmap_epoch": 49, "osdmap_epoch": 113, "osdmap_epoch_barrier": 107, "rank_uptime": 33.776245278, "state": "up:active", "uptime": 38.329605318, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:39:35.103 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T07:39:35.103 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:35.103 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:35.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:35.139 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-10T07:39:35.580 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records in 2024-09-10T07:39:35.580 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records out 2024-09-10T07:39:35.581 INFO:teuthology.orchestra.run.smithi099.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.365103 s, 144 MB/s 2024-09-10T07:39:35.582 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:39:35.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:39:35.657 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:39:35.750 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:39:35.750 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:39:35.750 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:35.751 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:35.788 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:35.788 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:35.865 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:39:36.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.062+0000 7fbc4f800640 1 Processor -- start 2024-09-10T07:39:36.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.062+0000 7fbc4f800640 1 -- start start 2024-09-10T07:39:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.063+0000 7fbc4f800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480b4fe0 0x7fbc4815c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.063+0000 7fbc4f800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbc480ce170 0x7fbc480b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc4f800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc480730f0 con 0x7fbc48072190 2024-09-10T07:39:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc4f800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbc4815c660 con 0x7fbc480ce170 2024-09-10T07:39:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc4f800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbc480b5900 con 0x7fbc480b4fe0 2024-09-10T07:39:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc47e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbc480ce170 0x7fbc480b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc47e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbc480ce170 0x7fbc480b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60376/0 (socket says 172.21.15.99:60376) 2024-09-10T07:39:36.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc47e00640 1 -- 172.21.15.99:0/2447921640 learned_addr learned my addr 172.21.15.99:0/2447921640 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:36.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc4ce00640 1 --2- 172.21.15.99:0/2447921640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480b4fe0 0x7fbc4815c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc47e00640 1 -- 172.21.15.99:0/2447921640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480b4fe0 msgr2=0x7fbc4815c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:36.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc47e00640 1 --2- 172.21.15.99:0/2447921640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480b4fe0 0x7fbc4815c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc47e00640 1 -- 172.21.15.99:0/2447921640 >> v1:172.21.15.187:6789/0 conn(0x7fbc48072190 legacy=0x7fbc480ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:36.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc47e00640 1 -- 172.21.15.99:0/2447921640 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc48073390 con 0x7fbc480ce170 2024-09-10T07:39:36.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.064+0000 7fbc4ce00640 1 --2- 172.21.15.99:0/2447921640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480b4fe0 0x7fbc4815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:36.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.065+0000 7fbc47e00640 1 --2- 172.21.15.99:0/2447921640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc480ce170 0x7fbc480b53c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009870 tx=0x7fbc3402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e098e3d428cb0fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:36.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc47400640 1 -- 172.21.15.99:0/2447921640 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34037070 con 0x7fbc480ce170 2024-09-10T07:39:36.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc47400640 1 -- 172.21.15.99:0/2447921640 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc34032440 con 0x7fbc480ce170 2024-09-10T07:39:36.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc47400640 1 -- 172.21.15.99:0/2447921640 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34032810 con 0x7fbc480ce170 2024-09-10T07:39:36.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc4f800640 1 -- 172.21.15.99:0/2447921640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc480ce170 msgr2=0x7fbc480b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:36.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc4f800640 1 --2- 172.21.15.99:0/2447921640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc480ce170 0x7fbc480b53c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009870 tx=0x7fbc3402a210 comp rx=0 tx=0).stop 2024-09-10T07:39:36.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc4f800640 1 -- 172.21.15.99:0/2447921640 shutdown_connections 2024-09-10T07:39:36.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc4f800640 1 --2- 172.21.15.99:0/2447921640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc480ce170 0x7fbc480b53c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc4f800640 1 --2- 172.21.15.99:0/2447921640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480b4fe0 0x7fbc4815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc4f800640 1 -- 172.21.15.99:0/2447921640 >> 172.21.15.99:0/2447921640 conn(0x7fbc480b2630 msgr2=0x7fbc480b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:36.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc4f800640 1 -- 172.21.15.99:0/2447921640 shutdown_connections 2024-09-10T07:39:36.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.066+0000 7fbc4f800640 1 -- 172.21.15.99:0/2447921640 wait complete. 2024-09-10T07:39:36.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.068+0000 7fbc4f800640 1 Processor -- start 2024-09-10T07:39:36.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.068+0000 7fbc4f800640 1 -- start start 2024-09-10T07:39:36.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4f800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc48072190 0x7fbc4815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4f800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480b4fe0 0x7fbc4813ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4f800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480ce170 0x7fbc4813d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4f800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbc48071c70 con 0x7fbc48072190 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4f800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbc48071990 con 0x7fbc480b4fe0 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4f800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbc480cee90 con 0x7fbc480ce170 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc48072190 0x7fbc4815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc48072190 0x7fbc4815a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60388/0 (socket says 172.21.15.99:60388) 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4ce00640 1 -- 172.21.15.99:0/357157263 learned_addr learned my addr 172.21.15.99:0/357157263 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc47e00640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480b4fe0 0x7fbc4813ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4d800640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480ce170 0x7fbc4813d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4ce00640 1 -- 172.21.15.99:0/357157263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480ce170 msgr2=0x7fbc4813d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4ce00640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480ce170 0x7fbc4813d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4ce00640 1 -- 172.21.15.99:0/357157263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480b4fe0 msgr2=0x7fbc4813ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.069+0000 7fbc4ce00640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480b4fe0 0x7fbc4813ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.070+0000 7fbc4ce00640 1 -- 172.21.15.99:0/357157263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc48149770 con 0x7fbc48072190 2024-09-10T07:39:36.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.070+0000 7fbc47e00640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480b4fe0 0x7fbc4813ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:36.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.070+0000 7fbc4d800640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480ce170 0x7fbc4813d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:36.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.070+0000 7fbc4ce00640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc48072190 0x7fbc4815a3a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800c7f0 tx=0x7fbc3800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:36.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.070+0000 7fbc44c00640 1 -- 172.21.15.99:0/357157263 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38015070 con 0x7fbc48072190 2024-09-10T07:39:36.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.070+0000 7fbc44c00640 1 -- 172.21.15.99:0/357157263 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc38007a30 con 0x7fbc48072190 2024-09-10T07:39:36.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.070+0000 7fbc44c00640 1 -- 172.21.15.99:0/357157263 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38007e00 con 0x7fbc48072190 2024-09-10T07:39:36.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.070+0000 7fbc4f800640 1 -- 172.21.15.99:0/357157263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc48149a50 con 0x7fbc48072190 2024-09-10T07:39:36.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.070+0000 7fbc4f800640 1 -- 172.21.15.99:0/357157263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4814a010 con 0x7fbc48072190 2024-09-10T07:39:36.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.071+0000 7fbc4f800640 1 -- 172.21.15.99:0/357157263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4815c120 con 0x7fbc48072190 2024-09-10T07:39:36.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.072+0000 7fbc44c00640 1 -- 172.21.15.99:0/357157263 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc38018070 con 0x7fbc48072190 2024-09-10T07:39:36.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.073+0000 7fbc44c00640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbc2806be30 0x7fbc2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.073+0000 7fbc44c00640 1 -- 172.21.15.99:0/357157263 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7fbc3808afa0 con 0x7fbc48072190 2024-09-10T07:39:36.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.073+0000 7fbc47e00640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbc2806be30 0x7fbc2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.074+0000 7fbc47e00640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbc2806be30 0x7fbc2806e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbc34034000 tx=0x7fbc3402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:36.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.077+0000 7fbc44c00640 1 -- 172.21.15.99:0/357157263 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc38059800 con 0x7fbc48072190 2024-09-10T07:39:36.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.259+0000 7fbc4f800640 1 -- 172.21.15.99:0/357157263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbc480cdec0 con 0x7fbc48072190 2024-09-10T07:39:36.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.259+0000 7fbc44c00640 1 -- 172.21.15.99:0/357157263 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) ==== 80+0+0 (secure 0 0 0) 0x7fbc38059100 con 0x7fbc48072190 2024-09-10T07:39:36.259 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:39:36.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.261+0000 7fbc4f800640 1 -- 172.21.15.99:0/357157263 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbc2806be30 msgr2=0x7fbc2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.261+0000 7fbc4f800640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbc2806be30 0x7fbc2806e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbc34034000 tx=0x7fbc3402e000 comp rx=0 tx=0).stop 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.261+0000 7fbc4f800640 1 -- 172.21.15.99:0/357157263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc48072190 msgr2=0x7fbc4815a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.261+0000 7fbc4f800640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc48072190 0x7fbc4815a3a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800c7f0 tx=0x7fbc3800cbf0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.261+0000 7fbc4f800640 1 -- 172.21.15.99:0/357157263 shutdown_connections 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.261+0000 7fbc4f800640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc480ce170 0x7fbc4813d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.261+0000 7fbc4f800640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480b4fe0 0x7fbc4813ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.261+0000 7fbc4f800640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbc2806be30 0x7fbc2806e2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.261+0000 7fbc4f800640 1 --2- 172.21.15.99:0/357157263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc48072190 0x7fbc4815a3a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.261+0000 7fbc4f800640 1 -- 172.21.15.99:0/357157263 >> 172.21.15.99:0/357157263 conn(0x7fbc480b2630 msgr2=0x7fbc480ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.262+0000 7fbc4f800640 1 -- 172.21.15.99:0/357157263 shutdown_connections 2024-09-10T07:39:36.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.262+0000 7fbc4f800640 1 -- 172.21.15.99:0/357157263 wait complete. 2024-09-10T07:39:36.276 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:39:36.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:36.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:39:36.383 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:39:36.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:36.384 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:39:36.420 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:39:36.420 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:39:36.420 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:36.456 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:39:36.457 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:36.532 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:39:36.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.687+0000 7f2632c00640 1 Processor -- start 2024-09-10T07:39:36.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.687+0000 7f2632c00640 1 -- start start 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.688+0000 7f2632c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f262c0d3070 0x7f262c0d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.688+0000 7f2632c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f262c15ed10 0x7f262c0d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.688+0000 7f2632c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d51a0 0x7f262c0d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.688+0000 7f2632c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f262c0cf740 con 0x7f262c15ed10 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.688+0000 7f2632c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f262c0d3990 con 0x7f262c0d3070 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.688+0000 7f2632c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f262c0d5910 con 0x7f262c0d51a0 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.688+0000 7f2630e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f262c15ed10 0x7f262c0d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.689+0000 7f2630e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f262c15ed10 0x7f262c0d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60394/0 (socket says 172.21.15.99:60394) 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.689+0000 7f2630e00640 1 -- 172.21.15.99:0/27721765 learned_addr learned my addr 172.21.15.99:0/27721765 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.689+0000 7f2631800640 1 --2- 172.21.15.99:0/27721765 >> v2:172.21.15.187:3300/0 conn(0x7f262c0d3070 0x7f262c0d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.689+0000 7f2632200640 1 --2- 172.21.15.99:0/27721765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d51a0 0x7f262c0d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.689+0000 7f2630e00640 1 -- 172.21.15.99:0/27721765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d51a0 msgr2=0x7f262c0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:36.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.689+0000 7f2630e00640 1 --2- 172.21.15.99:0/27721765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d51a0 0x7f262c0d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.689+0000 7f2630e00640 1 -- 172.21.15.99:0/27721765 >> v2:172.21.15.187:3300/0 conn(0x7f262c0d3070 msgr2=0x7f262c0d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:36.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.689+0000 7f2630e00640 1 --2- 172.21.15.99:0/27721765 >> v2:172.21.15.187:3300/0 conn(0x7f262c0d3070 0x7f262c0d3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.689+0000 7f2630e00640 1 -- 172.21.15.99:0/27721765 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262c0d5630 con 0x7f262c15ed10 2024-09-10T07:39:36.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.689+0000 7f2631800640 1 --2- 172.21.15.99:0/27721765 >> v2:172.21.15.187:3300/0 conn(0x7f262c0d3070 0x7f262c0d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:36.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.690+0000 7f2630e00640 1 --2- 172.21.15.99:0/27721765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c15ed10 0x7f262c0d2660 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f262c08f0a0 tx=0x7f261802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78ec9de6096a36a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:36.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.690+0000 7f262be00640 1 -- 172.21.15.99:0/27721765 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618037070 con 0x7f262c15ed10 2024-09-10T07:39:36.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.690+0000 7f262be00640 1 -- 172.21.15.99:0/27721765 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2618032440 con 0x7f262c15ed10 2024-09-10T07:39:36.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.690+0000 7f262be00640 1 -- 172.21.15.99:0/27721765 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618032810 con 0x7f262c15ed10 2024-09-10T07:39:36.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.691+0000 7f2632c00640 1 -- 172.21.15.99:0/27721765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c15ed10 msgr2=0x7f262c0d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:36.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.691+0000 7f2632c00640 1 --2- 172.21.15.99:0/27721765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c15ed10 0x7f262c0d2660 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f262c08f0a0 tx=0x7f261802a270 comp rx=0 tx=0).stop 2024-09-10T07:39:36.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.691+0000 7f2632c00640 1 -- 172.21.15.99:0/27721765 shutdown_connections 2024-09-10T07:39:36.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.691+0000 7f2632c00640 1 --2- 172.21.15.99:0/27721765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d51a0 0x7f262c0d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.691+0000 7f2632c00640 1 --2- 172.21.15.99:0/27721765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c15ed10 0x7f262c0d2660 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.691+0000 7f2632c00640 1 --2- 172.21.15.99:0/27721765 >> v2:172.21.15.187:3300/0 conn(0x7f262c0d3070 0x7f262c0d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.691+0000 7f2632c00640 1 -- 172.21.15.99:0/27721765 >> 172.21.15.99:0/27721765 conn(0x7f262c09dd60 msgr2=0x7f262c0d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:36.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.691+0000 7f2632c00640 1 -- 172.21.15.99:0/27721765 shutdown_connections 2024-09-10T07:39:36.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.691+0000 7f2632c00640 1 -- 172.21.15.99:0/27721765 wait complete. 2024-09-10T07:39:36.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.693+0000 7f2632c00640 1 Processor -- start 2024-09-10T07:39:36.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.693+0000 7f2632c00640 1 -- start start 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.693+0000 7f2632c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d3070 0x7f262c14a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f262c15ed10 0x7f262c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c06d7d0 0x7f262c0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f262c0d2ba0 con 0x7f262c06d7d0 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f262c0cfcc0 con 0x7f262c15ed10 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f262c0d2d20 con 0x7f262c0d3070 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c06d7d0 0x7f262c0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2631800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d3070 0x7f262c14a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2631800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d3070 0x7f262c14a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:41572/0 (socket says 172.21.15.99:41572) 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c06d7d0 0x7f262c0b5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60408/0 (socket says 172.21.15.99:60408) 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2631800640 1 -- 172.21.15.99:0/2999204411 learned_addr learned my addr 172.21.15.99:0/2999204411 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:36.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2630e00640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f262c15ed10 0x7f262c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632200640 1 -- 172.21.15.99:0/2999204411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d3070 msgr2=0x7f262c14a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632200640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d3070 0x7f262c14a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632200640 1 -- 172.21.15.99:0/2999204411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f262c15ed10 msgr2=0x7f262c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632200640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f262c15ed10 0x7f262c06d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2632200640 1 -- 172.21.15.99:0/2999204411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262c14aba0 con 0x7f262c06d7d0 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2631800640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d3070 0x7f262c14a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.694+0000 7f2630e00640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f262c15ed10 0x7f262c06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.695+0000 7f2632200640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c06d7d0 0x7f262c0b5510 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2624007cc0 tx=0x7f262400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.695+0000 7f2629600640 1 -- 172.21.15.99:0/2999204411 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262400ed70 con 0x7f262c06d7d0 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.695+0000 7f2629600640 1 -- 172.21.15.99:0/2999204411 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2624003990 con 0x7f262c06d7d0 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.695+0000 7f2632c00640 1 -- 172.21.15.99:0/2999204411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f262c1e8780 con 0x7f262c06d7d0 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.695+0000 7f2629600640 1 -- 172.21.15.99:0/2999204411 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2624003d80 con 0x7f262c06d7d0 2024-09-10T07:39:36.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.695+0000 7f2632c00640 1 -- 172.21.15.99:0/2999204411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f262c1e8d40 con 0x7f262c06d7d0 2024-09-10T07:39:36.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.696+0000 7f2632c00640 1 -- 172.21.15.99:0/2999204411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f262c0d07b0 con 0x7f262c06d7d0 2024-09-10T07:39:36.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.697+0000 7f2629600640 1 -- 172.21.15.99:0/2999204411 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f262401b020 con 0x7f262c06d7d0 2024-09-10T07:39:36.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.698+0000 7f2629600640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f260c06be60 0x7f260c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:36.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.698+0000 7f2629600640 1 -- 172.21.15.99:0/2999204411 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7f262408ad50 con 0x7f262c06d7d0 2024-09-10T07:39:36.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.698+0000 7f2631800640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f260c06be60 0x7f260c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:36.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.698+0000 7f2631800640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f260c06be60 0x7f260c06e320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2620006fd0 tx=0x7f2620008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:36.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.702+0000 7f2629600640 1 -- 172.21.15.99:0/2999204411 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2624058ff0 con 0x7f262c06d7d0 2024-09-10T07:39:36.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.885+0000 7f2632c00640 1 -- 172.21.15.99:0/2999204411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f262c0d4870 con 0x7f262c06d7d0 2024-09-10T07:39:36.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.886+0000 7f2629600640 1 -- 172.21.15.99:0/2999204411 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) ==== 80+0+0 (secure 0 0 0) 0x7f262405d2f0 con 0x7f262c06d7d0 2024-09-10T07:39:36.886 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:39:36.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 -- 172.21.15.99:0/2999204411 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f260c06be60 msgr2=0x7f260c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:36.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f260c06be60 0x7f260c06e320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2620006fd0 tx=0x7f2620008040 comp rx=0 tx=0).stop 2024-09-10T07:39:36.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 -- 172.21.15.99:0/2999204411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c06d7d0 msgr2=0x7f262c0b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:36.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c06d7d0 0x7f262c0b5510 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2624007cc0 tx=0x7f262400e4b0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 -- 172.21.15.99:0/2999204411 shutdown_connections 2024-09-10T07:39:36.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f260c06be60 0x7f260c06e320 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f262c06d7d0 0x7f262c0b5510 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f262c15ed10 0x7f262c06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 --2- 172.21.15.99:0/2999204411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f262c0d3070 0x7f262c14a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:36.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 -- 172.21.15.99:0/2999204411 >> 172.21.15.99:0/2999204411 conn(0x7f262c09dd60 msgr2=0x7f262c0b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:36.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 -- 172.21.15.99:0/2999204411 shutdown_connections 2024-09-10T07:39:36.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:36.888+0000 7f2632c00640 1 -- 172.21.15.99:0/2999204411 wait complete. 2024-09-10T07:39:36.904 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:39:36.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:36.904 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T07:39:36.969 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:39:36.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:36.970 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:39:37.006 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:39:37.006 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:37.006 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:37.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:39:37.042 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:39:37.042 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:39:37.042 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:37.081 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:39:37.082 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.235+0000 7fc3c5c00640 1 Processor -- start 2024-09-10T07:39:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.235+0000 7fc3c5c00640 1 -- start start 2024-09-10T07:39:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.236+0000 7fc3c5c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc3c015e970 0x7fc3c00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.236+0000 7fc3c5c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c00d2bd0 con 0x7fc3c00d2680 2024-09-10T07:39:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.236+0000 7fc3c5c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c00d2eb0 con 0x7fc3c00cfc90 2024-09-10T07:39:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.236+0000 7fc3c5c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c00d37e0 con 0x7fc3c015e970 2024-09-10T07:39:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.236+0000 7fc3bfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc3c015e970 0x7fc3c00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.236+0000 7fc3bfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc3c015e970 0x7fc3c00d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60412/0 (socket says 172.21.15.99:60412) 2024-09-10T07:39:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.236+0000 7fc3bfe00640 1 -- 172.21.15.99:0/4197107085 learned_addr learned my addr 172.21.15.99:0/4197107085 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.237+0000 7fc3bfe00640 1 -- 172.21.15.99:0/4197107085 >> v1:172.21.15.187:6789/0 conn(0x7fc3c00cfc90 legacy=0x7fc3c00c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.237+0000 7fc3bfe00640 1 -- 172.21.15.99:0/4197107085 >> v1:172.21.15.99:6789/0 conn(0x7fc3c00d2680 legacy=0x7fc3c00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.237+0000 7fc3bfe00640 1 -- 172.21.15.99:0/4197107085 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c00d3190 con 0x7fc3c015e970 2024-09-10T07:39:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.238+0000 7fc3bfe00640 1 --2- 172.21.15.99:0/4197107085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c015e970 0x7fc3c00d0300 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00d3960 tx=0x7fc3b002a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c602d8dab1e9cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.238+0000 7fc3bf400640 1 -- 172.21.15.99:0/4197107085 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0037070 con 0x7fc3c015e970 2024-09-10T07:39:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.238+0000 7fc3bf400640 1 -- 172.21.15.99:0/4197107085 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b0032640 con 0x7fc3c015e970 2024-09-10T07:39:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.238+0000 7fc3bf400640 1 -- 172.21.15.99:0/4197107085 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0032a10 con 0x7fc3c015e970 2024-09-10T07:39:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.239+0000 7fc3c5c00640 1 -- 172.21.15.99:0/4197107085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c015e970 msgr2=0x7fc3c00d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.239+0000 7fc3c5c00640 1 --2- 172.21.15.99:0/4197107085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c015e970 0x7fc3c00d0300 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00d3960 tx=0x7fc3b002a370 comp rx=0 tx=0).stop 2024-09-10T07:39:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.239+0000 7fc3c5c00640 1 -- 172.21.15.99:0/4197107085 shutdown_connections 2024-09-10T07:39:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.239+0000 7fc3c5c00640 1 --2- 172.21.15.99:0/4197107085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c015e970 0x7fc3c00d0300 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.239+0000 7fc3c5c00640 1 -- 172.21.15.99:0/4197107085 >> 172.21.15.99:0/4197107085 conn(0x7fc3c009de00 msgr2=0x7fc3c00d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.239+0000 7fc3c5c00640 1 -- 172.21.15.99:0/4197107085 shutdown_connections 2024-09-10T07:39:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.239+0000 7fc3c5c00640 1 -- 172.21.15.99:0/4197107085 wait complete. 2024-09-10T07:39:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.240+0000 7fc3c5c00640 1 Processor -- start 2024-09-10T07:39:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.240+0000 7fc3c5c00640 1 -- start start 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.241+0000 7fc3c5c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c00cfc90 0x7fc3c0155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.241+0000 7fc3c5c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3c00d2680 0x7fc3c01f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.241+0000 7fc3c5c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3c015e970 0x7fc3c015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.241+0000 7fc3c5c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c015ed50 con 0x7fc3c00cfc90 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.241+0000 7fc3c5c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c00d0840 con 0x7fc3c015e970 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.241+0000 7fc3c5c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c015eed0 con 0x7fc3c00d2680 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.241+0000 7fc3bfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c00cfc90 0x7fc3c0155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3bfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c00cfc90 0x7fc3c0155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60414/0 (socket says 172.21.15.99:60414) 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3bfe00640 1 -- 172.21.15.99:0/2488496661 learned_addr learned my addr 172.21.15.99:0/2488496661 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3c5200640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3c015e970 0x7fc3c015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3b7400640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3c00d2680 0x7fc3c01f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3bfe00640 1 -- 172.21.15.99:0/2488496661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3c00d2680 msgr2=0x7fc3c01f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3bfe00640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3c00d2680 0x7fc3c01f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3bfe00640 1 -- 172.21.15.99:0/2488496661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3c015e970 msgr2=0x7fc3c015d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3bfe00640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3c015e970 0x7fc3c015d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3bfe00640 1 -- 172.21.15.99:0/2488496661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c00cd550 con 0x7fc3c00cfc90 2024-09-10T07:39:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3bfe00640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c00cfc90 0x7fc3c0155b10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc3b002a3b0 tx=0x7fc3b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.242+0000 7fc3bcc00640 1 -- 172.21.15.99:0/2488496661 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0037040 con 0x7fc3c00cfc90 2024-09-10T07:39:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.243+0000 7fc3bcc00640 1 -- 172.21.15.99:0/2488496661 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b0042070 con 0x7fc3c00cfc90 2024-09-10T07:39:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.243+0000 7fc3bcc00640 1 -- 172.21.15.99:0/2488496661 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0030bb0 con 0x7fc3c00cfc90 2024-09-10T07:39:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.243+0000 7fc3c5c00640 1 -- 172.21.15.99:0/2488496661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c00cd830 con 0x7fc3c00cfc90 2024-09-10T07:39:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.243+0000 7fc3c5c00640 1 -- 172.21.15.99:0/2488496661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c00cddf0 con 0x7fc3c00cfc90 2024-09-10T07:39:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.244+0000 7fc3c5c00640 1 -- 172.21.15.99:0/2488496661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c00d0300 con 0x7fc3c00cfc90 2024-09-10T07:39:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.245+0000 7fc3bcc00640 1 -- 172.21.15.99:0/2488496661 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3b0032500 con 0x7fc3c00cfc90 2024-09-10T07:39:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.246+0000 7fc3bcc00640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39c06be60 0x7fc39c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.246+0000 7fc3bcc00640 1 -- 172.21.15.99:0/2488496661 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7fc3b00ab7f0 con 0x7fc3c00cfc90 2024-09-10T07:39:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.246+0000 7fc3b7400640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39c06be60 0x7fc39c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.247+0000 7fc3b7400640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39c06be60 0x7fc39c06e320 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0156050 tx=0x7fc3a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.251+0000 7fc3bcc00640 1 -- 172.21.15.99:0/2488496661 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3b0079b10 con 0x7fc3c00cfc90 2024-09-10T07:39:37.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.460+0000 7fc3c5c00640 1 -- 172.21.15.99:0/2488496661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3c015e4e0 con 0x7fc3c00cfc90 2024-09-10T07:39:37.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.461+0000 7fc3bcc00640 1 -- 172.21.15.99:0/2488496661 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7fc3b007de10 con 0x7fc3c00cfc90 2024-09-10T07:39:37.461 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:37.461 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":49,"btime":"2024-09-10T07:39:04:324940+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/224049994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":224049994},{"type":"v1","addr":"172.21.15.187:6834","nonce":224049994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2009047482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2009047482},{"type":"v1","addr":"172.21.15.187:6835","nonce":2009047482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3952584402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3952584402},{"type":"v1","addr":"172.21.15.99:6837","nonce":3952584402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:00.703298+0000","modified":"2024-09-10T07:39:03.726531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/1858150570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1858150570},{"type":"v1","addr":"172.21.15.99:6835","nonce":1858150570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":6}]} 2024-09-10T07:39:37.461 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 49 2024-09-10T07:39:37.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 -- 172.21.15.99:0/2488496661 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39c06be60 msgr2=0x7fc39c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39c06be60 0x7fc39c06e320 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0156050 tx=0x7fc3a8009040 comp rx=0 tx=0).stop 2024-09-10T07:39:37.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 -- 172.21.15.99:0/2488496661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c00cfc90 msgr2=0x7fc3c0155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c00cfc90 0x7fc3c0155b10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc3b002a3b0 tx=0x7fc3b00046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 -- 172.21.15.99:0/2488496661 shutdown_connections 2024-09-10T07:39:37.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3c015e970 0x7fc3c015d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3c00d2680 0x7fc3c01f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39c06be60 0x7fc39c06e320 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 --2- 172.21.15.99:0/2488496661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3c00cfc90 0x7fc3c0155b10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 -- 172.21.15.99:0/2488496661 >> 172.21.15.99:0/2488496661 conn(0x7fc3c009de00 msgr2=0x7fc3c00c94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:37.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 -- 172.21.15.99:0/2488496661 shutdown_connections 2024-09-10T07:39:37.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.463+0000 7fc3c5c00640 1 -- 172.21.15.99:0/2488496661 wait complete. 2024-09-10T07:39:37.479 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:37.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.631+0000 7fa6ffc00640 1 Processor -- start 2024-09-10T07:39:37.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.631+0000 7fa6ffc00640 1 -- start start 2024-09-10T07:39:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.632+0000 7fa6ffc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f8145290 0x7fa6f806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.632+0000 7fa6ffc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa6f80ce780 0x7fa6f8072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6ffc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6f806e3d0 con 0x7fa6f8071510 2024-09-10T07:39:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6ffc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa6f806efe0 con 0x7fa6f80ce780 2024-09-10T07:39:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6ffc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f806e6b0 con 0x7fa6f8145290 2024-09-10T07:39:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6efe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa6f80ce780 0x7fa6f8072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6fd200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f8145290 0x7fa6f806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6fdc00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fa6f8071510 0x7fa6f80b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:41948/0 (socket says 172.21.15.99:41948) 2024-09-10T07:39:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6fd200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f8145290 0x7fa6f806f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:41588/0 (socket says 172.21.15.99:41588) 2024-09-10T07:39:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6fdc00640 1 -- 172.21.15.99:0/3430094787 learned_addr learned my addr 172.21.15.99:0/3430094787 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6efe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa6f80ce780 0x7fa6f8072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:51244/0 (socket says 172.21.15.99:51244) 2024-09-10T07:39:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6fd200640 1 -- 172.21.15.99:0/3430094787 >> v2:172.21.15.187:3300/0 conn(0x7fa6f80ce780 msgr2=0x7fa6f8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6fd200640 1 --2- 172.21.15.99:0/3430094787 >> v2:172.21.15.187:3300/0 conn(0x7fa6f80ce780 0x7fa6f8072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6fd200640 1 -- 172.21.15.99:0/3430094787 >> v1:172.21.15.187:6789/0 conn(0x7fa6f8071510 legacy=0x7fa6f80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6fd200640 1 -- 172.21.15.99:0/3430094787 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f806e990 con 0x7fa6f8145290 2024-09-10T07:39:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.633+0000 7fa6f7e00640 1 -- 172.21.15.99:0/3430094787 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3857719534 0 0) 0x7fa6f806e3d0 con 0x7fa6f8071510 2024-09-10T07:39:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.635+0000 7fa6fd200640 1 --2- 172.21.15.99:0/3430094787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f8145290 0x7fa6f806f470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80097a0 tx=0x7fa6e802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92b5e609fd4dfeec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.635+0000 7fa6f7e00640 1 -- 172.21.15.99:0/3430094787 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8037070 con 0x7fa6f8145290 2024-09-10T07:39:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.635+0000 7fa6f7e00640 1 -- 172.21.15.99:0/3430094787 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e8032440 con 0x7fa6f8145290 2024-09-10T07:39:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.635+0000 7fa6f7e00640 1 -- 172.21.15.99:0/3430094787 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8032810 con 0x7fa6f8145290 2024-09-10T07:39:37.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.636+0000 7fa6ffc00640 1 -- 172.21.15.99:0/3430094787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f8145290 msgr2=0x7fa6f806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.636+0000 7fa6ffc00640 1 --2- 172.21.15.99:0/3430094787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f8145290 0x7fa6f806f470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80097a0 tx=0x7fa6e802a180 comp rx=0 tx=0).stop 2024-09-10T07:39:37.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.636+0000 7fa6ffc00640 1 -- 172.21.15.99:0/3430094787 shutdown_connections 2024-09-10T07:39:37.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.636+0000 7fa6ffc00640 1 --2- 172.21.15.99:0/3430094787 >> v2:172.21.15.187:3300/0 conn(0x7fa6f80ce780 0x7fa6f8072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.636+0000 7fa6ffc00640 1 --2- 172.21.15.99:0/3430094787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f8145290 0x7fa6f806f470 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.636+0000 7fa6ffc00640 1 -- 172.21.15.99:0/3430094787 >> 172.21.15.99:0/3430094787 conn(0x7fa6f806bc10 msgr2=0x7fa6f806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:37.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.636+0000 7fa6ffc00640 1 -- 172.21.15.99:0/3430094787 shutdown_connections 2024-09-10T07:39:37.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.636+0000 7fa6ffc00640 1 -- 172.21.15.99:0/3430094787 wait complete. 2024-09-10T07:39:37.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.638+0000 7fa6ffc00640 1 Processor -- start 2024-09-10T07:39:37.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.638+0000 7fa6ffc00640 1 -- start start 2024-09-10T07:39:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.638+0000 7fa6ffc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f8071510 0x7fa6f8168580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6ffc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f80ce780 0x7fa6f80aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6ffc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6f8145290 0x7fa6f80abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6ffc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f806df80 con 0x7fa6f8071510 2024-09-10T07:39:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6ffc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f8145670 con 0x7fa6f8145290 2024-09-10T07:39:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6ffc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f806e100 con 0x7fa6f80ce780 2024-09-10T07:39:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6fd200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f8071510 0x7fa6f8168580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6fd200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f8071510 0x7fa6f8168580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60418/0 (socket says 172.21.15.99:60418) 2024-09-10T07:39:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6fd200640 1 -- 172.21.15.99:0/2913188364 learned_addr learned my addr 172.21.15.99:0/2913188364 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6efe00640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f80ce780 0x7fa6f80aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6fdc00640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6f8145290 0x7fa6f80abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6fd200640 1 -- 172.21.15.99:0/2913188364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f80ce780 msgr2=0x7fa6f80aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6fd200640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f80ce780 0x7fa6f80aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6fd200640 1 -- 172.21.15.99:0/2913188364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6f8145290 msgr2=0x7fa6f80abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6fd200640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6f8145290 0x7fa6f80abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.639+0000 7fa6fd200640 1 -- 172.21.15.99:0/2913188364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f80aa970 con 0x7fa6f8071510 2024-09-10T07:39:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.640+0000 7fa6fd200640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f8071510 0x7fa6f8168580 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8035040 tx=0x7fa6e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.640+0000 7fa6f5600640 1 -- 172.21.15.99:0/2913188364 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8037040 con 0x7fa6f8071510 2024-09-10T07:39:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.640+0000 7fa6f5600640 1 -- 172.21.15.99:0/2913188364 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e8030500 con 0x7fa6f8071510 2024-09-10T07:39:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.640+0000 7fa6f5600640 1 -- 172.21.15.99:0/2913188364 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80308d0 con 0x7fa6f8071510 2024-09-10T07:39:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.640+0000 7fa6ffc00640 1 -- 172.21.15.99:0/2913188364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f80aac40 con 0x7fa6f8071510 2024-09-10T07:39:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.640+0000 7fa6ffc00640 1 -- 172.21.15.99:0/2913188364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f80ab200 con 0x7fa6f8071510 2024-09-10T07:39:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.641+0000 7fa6ffc00640 1 -- 172.21.15.99:0/2913188364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f806f470 con 0x7fa6f8071510 2024-09-10T07:39:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.642+0000 7fa6f5600640 1 -- 172.21.15.99:0/2913188364 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6e8044020 con 0x7fa6f8071510 2024-09-10T07:39:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.643+0000 7fa6f5600640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa6d406be30 0x7fa6d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.643+0000 7fa6f5600640 1 -- 172.21.15.99:0/2913188364 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7fa6e80aafa0 con 0x7fa6f8071510 2024-09-10T07:39:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.643+0000 7fa6efe00640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa6d406be30 0x7fa6d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:37.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.644+0000 7fa6efe00640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa6d406be30 0x7fa6d406e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa6f81603a0 tx=0x7fa6e0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:37.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.647+0000 7fa6f5600640 1 -- 172.21.15.99:0/2913188364 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6e80792e0 con 0x7fa6f8071510 2024-09-10T07:39:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.853+0000 7fa6ffc00640 1 -- 172.21.15.99:0/2913188364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6f813bc20 con 0x7fa6f8071510 2024-09-10T07:39:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.854+0000 7fa6f5600640 1 -- 172.21.15.99:0/2913188364 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7fa6e807d5e0 con 0x7fa6f8071510 2024-09-10T07:39:37.854 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:37.854 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":49,"btime":"2024-09-10T07:39:04:324940+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/224049994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":224049994},{"type":"v1","addr":"172.21.15.187:6834","nonce":224049994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2009047482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2009047482},{"type":"v1","addr":"172.21.15.187:6835","nonce":2009047482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3952584402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3952584402},{"type":"v1","addr":"172.21.15.99:6837","nonce":3952584402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:00.703298+0000","modified":"2024-09-10T07:39:03.726531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/1858150570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1858150570},{"type":"v1","addr":"172.21.15.99:6835","nonce":1858150570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":6}]} 2024-09-10T07:39:37.854 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 49 2024-09-10T07:39:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 -- 172.21.15.99:0/2913188364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa6d406be30 msgr2=0x7fa6d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa6d406be30 0x7fa6d406e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa6f81603a0 tx=0x7fa6e0009190 comp rx=0 tx=0).stop 2024-09-10T07:39:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 -- 172.21.15.99:0/2913188364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f8071510 msgr2=0x7fa6f8168580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f8071510 0x7fa6f8168580 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8035040 tx=0x7fa6e80046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 -- 172.21.15.99:0/2913188364 shutdown_connections 2024-09-10T07:39:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6f8145290 0x7fa6f80abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6f80ce780 0x7fa6f80aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa6d406be30 0x7fa6d406e2f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 --2- 172.21.15.99:0/2913188364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f8071510 0x7fa6f8168580 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:37.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 -- 172.21.15.99:0/2913188364 >> 172.21.15.99:0/2913188364 conn(0x7fa6f806bc10 msgr2=0x7fa6f80b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:37.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 -- 172.21.15.99:0/2913188364 shutdown_connections 2024-09-10T07:39:37.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:37.856+0000 7fa6ffc00640 1 -- 172.21.15.99:0/2913188364 wait complete. 2024-09-10T07:39:37.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:39:38.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.026+0000 7f4487a00640 1 Processor -- start 2024-09-10T07:39:38.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.026+0000 7f4487a00640 1 -- start start 2024-09-10T07:39:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.027+0000 7f4487a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480145290 0x7f448006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4487a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4480072f40 0x7f44800b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4487a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448006e3d0 con 0x7f44800ce780 2024-09-10T07:39:38.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4487a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f448006efe0 con 0x7f4480072f40 2024-09-10T07:39:38.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4487a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f448006e6b0 con 0x7f4480145290 2024-09-10T07:39:38.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4477e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f44800ce780 0x7f4480072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37494/0 (socket says 172.21.15.99:37494) 2024-09-10T07:39:38.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4477e00640 1 -- 172.21.15.99:0/4980858 learned_addr learned my addr 172.21.15.99:0/4980858 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:38.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4485a00640 1 --2- 172.21.15.99:0/4980858 >> v2:172.21.15.187:3300/0 conn(0x7f4480072f40 0x7f44800b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4485000640 1 --2- 172.21.15.99:0/4980858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480145290 0x7f448006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f447fe00640 1 -- 172.21.15.99:0/4980858 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731790940 0 0) 0x7f448006e3d0 con 0x7f44800ce780 2024-09-10T07:39:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f447fe00640 1 -- 172.21.15.99:0/4980858 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4464003520 con 0x7f44800ce780 2024-09-10T07:39:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4485a00640 1 -- 172.21.15.99:0/4980858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480145290 msgr2=0x7f448006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4485a00640 1 --2- 172.21.15.99:0/4980858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480145290 0x7f448006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.028+0000 7f4485a00640 1 -- 172.21.15.99:0/4980858 >> v1:172.21.15.99:6789/0 conn(0x7f44800ce780 legacy=0x7f4480072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.029+0000 7f4485a00640 1 -- 172.21.15.99:0/4980858 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448006e990 con 0x7f4480072f40 2024-09-10T07:39:38.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.029+0000 7f4485000640 1 --2- 172.21.15.99:0/4980858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480145290 0x7f448006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:38.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.030+0000 7f4485a00640 1 --2- 172.21.15.99:0/4980858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4480072f40 0x7f44800b3930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4478009d90 tx=0x7f447802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2a0e316b6b9d231 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:38.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.030+0000 7f447fe00640 1 -- 172.21.15.99:0/4980858 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478007740 con 0x7f4480072f40 2024-09-10T07:39:38.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.030+0000 7f447fe00640 1 -- 172.21.15.99:0/4980858 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44780078e0 con 0x7f4480072f40 2024-09-10T07:39:38.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.030+0000 7f447fe00640 1 -- 172.21.15.99:0/4980858 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478007cb0 con 0x7f4480072f40 2024-09-10T07:39:38.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.030+0000 7f4487a00640 1 -- 172.21.15.99:0/4980858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4480072f40 msgr2=0x7f44800b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.030+0000 7f4487a00640 1 --2- 172.21.15.99:0/4980858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4480072f40 0x7f44800b3930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4478009d90 tx=0x7f447802a660 comp rx=0 tx=0).stop 2024-09-10T07:39:38.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.030+0000 7f4487a00640 1 -- 172.21.15.99:0/4980858 shutdown_connections 2024-09-10T07:39:38.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.030+0000 7f4487a00640 1 --2- 172.21.15.99:0/4980858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4480072f40 0x7f44800b3930 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.030+0000 7f4487a00640 1 --2- 172.21.15.99:0/4980858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480145290 0x7f448006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.030+0000 7f4487a00640 1 -- 172.21.15.99:0/4980858 >> 172.21.15.99:0/4980858 conn(0x7f448006bc10 msgr2=0x7f448006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:38.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.031+0000 7f4487a00640 1 -- 172.21.15.99:0/4980858 shutdown_connections 2024-09-10T07:39:38.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.031+0000 7f4487a00640 1 -- 172.21.15.99:0/4980858 wait complete. 2024-09-10T07:39:38.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.032+0000 7f4487a00640 1 Processor -- start 2024-09-10T07:39:38.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.032+0000 7f4487a00640 1 -- start start 2024-09-10T07:39:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4487a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480072f40 0x7f4480155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4487a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44800ce780 0x7f44801f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4487a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4480145290 0x7f448015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4487a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f448006df80 con 0x7f44800ce780 2024-09-10T07:39:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4487a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4480145670 con 0x7f4480145290 2024-09-10T07:39:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4487a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f448006e100 con 0x7f4480072f40 2024-09-10T07:39:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4477e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44800ce780 0x7f44801f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4477e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44800ce780 0x7f44801f88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60428/0 (socket says 172.21.15.99:60428) 2024-09-10T07:39:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4477e00640 1 -- 172.21.15.99:0/910178872 learned_addr learned my addr 172.21.15.99:0/910178872 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4485000640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480072f40 0x7f4480155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.033+0000 7f4485a00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4480145290 0x7f448015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f4477e00640 1 -- 172.21.15.99:0/910178872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480072f40 msgr2=0x7f4480155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f4477e00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480072f40 0x7f4480155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f4477e00640 1 -- 172.21.15.99:0/910178872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4480145290 msgr2=0x7f448015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f4477e00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4480145290 0x7f448015aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f4477e00640 1 -- 172.21.15.99:0/910178872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448013c9a0 con 0x7f44800ce780 2024-09-10T07:39:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f4485a00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4480145290 0x7f448015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f4477e00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44800ce780 0x7f44801f88d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f446800c430 tx=0x7f446800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f447d600640 1 -- 172.21.15.99:0/910178872 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468017070 con 0x7f44800ce780 2024-09-10T07:39:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f447d600640 1 -- 172.21.15.99:0/910178872 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4468005d00 con 0x7f44800ce780 2024-09-10T07:39:38.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f4487a00640 1 -- 172.21.15.99:0/910178872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448015c8e0 con 0x7f44800ce780 2024-09-10T07:39:38.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f447d600640 1 -- 172.21.15.99:0/910178872 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468007310 con 0x7f44800ce780 2024-09-10T07:39:38.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.034+0000 7f4487a00640 1 -- 172.21.15.99:0/910178872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448015cea0 con 0x7f44800ce780 2024-09-10T07:39:38.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.035+0000 7f4487a00640 1 -- 172.21.15.99:0/910178872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44800b5b60 con 0x7f44800ce780 2024-09-10T07:39:38.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.036+0000 7f447d600640 1 -- 172.21.15.99:0/910178872 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f446801a070 con 0x7f44800ce780 2024-09-10T07:39:38.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.037+0000 7f447d600640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f445c06be30 0x7f445c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.037+0000 7f447d600640 1 -- 172.21.15.99:0/910178872 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7f446808a2b0 con 0x7f44800ce780 2024-09-10T07:39:38.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.037+0000 7f4485000640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f445c06be30 0x7f445c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.038+0000 7f4485000640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f445c06be30 0x7f445c06e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f44800b4960 tx=0x7f4470009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:38.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.042+0000 7f447d600640 1 -- 172.21.15.99:0/910178872 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44800b5b60 con 0x7f44800ce780 2024-09-10T07:39:38.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.218+0000 7f4487a00640 1 -- 172.21.15.99:0/910178872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4480071510 con 0x7f44800ce780 2024-09-10T07:39:38.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.219+0000 7f447d600640 1 -- 172.21.15.99:0/910178872 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16751 (secure 0 0 0) 0x7f448013c9a0 con 0x7f44800ce780 2024-09-10T07:39:38.219 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:38.220 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":113,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:39:32.958523+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:38:58.485547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T07:38:59.701338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3b","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 -- 172.21.15.99:0/910178872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f445c06be30 msgr2=0x7f445c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f445c06be30 0x7f445c06e2f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f44800b4960 tx=0x7f4470009190 comp rx=0 tx=0).stop 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 -- 172.21.15.99:0/910178872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44800ce780 msgr2=0x7f44801f88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44800ce780 0x7f44801f88d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f446800c430 tx=0x7f446800c8f0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 -- 172.21.15.99:0/910178872 shutdown_connections 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4480145290 0x7f448015aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f445c06be30 0x7f445c06e2f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44800ce780 0x7f44801f88d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 --2- 172.21.15.99:0/910178872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4480072f40 0x7f4480155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 -- 172.21.15.99:0/910178872 >> 172.21.15.99:0/910178872 conn(0x7f448006bc10 msgr2=0x7f44800b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 -- 172.21.15.99:0/910178872 shutdown_connections 2024-09-10T07:39:38.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.222+0000 7f4487a00640 1 -- 172.21.15.99:0/910178872 wait complete. 2024-09-10T07:39:38.237 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:39:38.238 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:38.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.391+0000 7f9534a00640 1 Processor -- start 2024-09-10T07:39:38.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.391+0000 7f9534a00640 1 -- start start 2024-09-10T07:39:38.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.392+0000 7f9534a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f95300d2680 0x7f95300cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.392+0000 7f9534a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95300cfac0 0x7f95300c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.392+0000 7f9534a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95300d2bd0 con 0x7f953015e970 2024-09-10T07:39:38.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.392+0000 7f9534a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f95300d37e0 con 0x7f95300d2680 2024-09-10T07:39:38.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.392+0000 7f9534a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f95300d2eb0 con 0x7f95300cfac0 2024-09-10T07:39:38.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.392+0000 7f952e800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f953015e970 0x7f95300d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37496/0 (socket says 172.21.15.99:37496) 2024-09-10T07:39:38.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.392+0000 7f952e800640 1 -- 172.21.15.99:0/3230648447 learned_addr learned my addr 172.21.15.99:0/3230648447 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:38.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.392+0000 7f9525e00640 1 --2- 172.21.15.99:0/3230648447 >> v2:172.21.15.99:3300/0 conn(0x7f95300d2680 0x7f95300cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.393+0000 7f952f200640 1 --2- 172.21.15.99:0/3230648447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95300cfac0 0x7f95300c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.393+0000 7f952de00640 1 -- 172.21.15.99:0/3230648447 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990982539 0 0) 0x7f95300d2bd0 con 0x7f953015e970 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.393+0000 7f952de00640 1 -- 172.21.15.99:0/3230648447 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9514003520 con 0x7f953015e970 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.393+0000 7f9525e00640 1 -- 172.21.15.99:0/3230648447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95300cfac0 msgr2=0x7f95300c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.393+0000 7f9525e00640 1 --2- 172.21.15.99:0/3230648447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95300cfac0 0x7f95300c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.393+0000 7f9525e00640 1 -- 172.21.15.99:0/3230648447 >> v1:172.21.15.99:6789/0 conn(0x7f953015e970 legacy=0x7f95300d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.393+0000 7f9525e00640 1 -- 172.21.15.99:0/3230648447 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95300d3190 con 0x7f95300d2680 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.394+0000 7f9525e00640 1 --2- 172.21.15.99:0/3230648447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 0x7f95300cf580 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f95180097a0 tx=0x7f951802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e9e967600fcfa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.394+0000 7f952de00640 1 -- 172.21.15.99:0/3230648447 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518037070 con 0x7f95300d2680 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.394+0000 7f952de00640 1 -- 172.21.15.99:0/3230648447 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9518032440 con 0x7f95300d2680 2024-09-10T07:39:38.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.394+0000 7f952de00640 1 -- 172.21.15.99:0/3230648447 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518032810 con 0x7f95300d2680 2024-09-10T07:39:38.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.395+0000 7f9534a00640 1 -- 172.21.15.99:0/3230648447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 msgr2=0x7f95300cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.395+0000 7f9534a00640 1 --2- 172.21.15.99:0/3230648447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 0x7f95300cf580 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f95180097a0 tx=0x7f951802a210 comp rx=0 tx=0).stop 2024-09-10T07:39:38.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.395+0000 7f9534a00640 1 -- 172.21.15.99:0/3230648447 shutdown_connections 2024-09-10T07:39:38.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.395+0000 7f9534a00640 1 --2- 172.21.15.99:0/3230648447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95300cfac0 0x7f95300c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.395+0000 7f9534a00640 1 --2- 172.21.15.99:0/3230648447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 0x7f95300cf580 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.395+0000 7f9534a00640 1 -- 172.21.15.99:0/3230648447 >> 172.21.15.99:0/3230648447 conn(0x7f953009de00 msgr2=0x7f95300d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:38.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.395+0000 7f9534a00640 1 -- 172.21.15.99:0/3230648447 shutdown_connections 2024-09-10T07:39:38.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.395+0000 7f9534a00640 1 -- 172.21.15.99:0/3230648447 wait complete. 2024-09-10T07:39:38.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.396+0000 7f9534a00640 1 Processor -- start 2024-09-10T07:39:38.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.397+0000 7f9534a00640 1 -- start start 2024-09-10T07:39:38.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.397+0000 7f9534a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95300cfac0 0x7f95301f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.397+0000 7f9534a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 0x7f953015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.397+0000 7f9534a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f953015e970 0x7f953015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.397+0000 7f9534a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f953015ed50 con 0x7f95300d2680 2024-09-10T07:39:38.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.397+0000 7f9534a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f95300cff50 con 0x7f953015e970 2024-09-10T07:39:38.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.397+0000 7f9534a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f953015eed0 con 0x7f95300cfac0 2024-09-10T07:39:38.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f9525e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 0x7f953015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f9525e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 0x7f953015b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60454/0 (socket says 172.21.15.99:60454) 2024-09-10T07:39:38.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f9525e00640 1 -- 172.21.15.99:0/4260024117 learned_addr learned my addr 172.21.15.99:0/4260024117 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:38.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f952e800640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95300cfac0 0x7f95301f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f952f200640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f953015e970 0x7f953015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f9525e00640 1 -- 172.21.15.99:0/4260024117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95300cfac0 msgr2=0x7f95301f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f9525e00640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95300cfac0 0x7f95301f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f9525e00640 1 -- 172.21.15.99:0/4260024117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f953015e970 msgr2=0x7f953015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f9525e00640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f953015e970 0x7f953015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f9525e00640 1 -- 172.21.15.99:0/4260024117 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95300b9ec0 con 0x7f95300d2680 2024-09-10T07:39:38.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.398+0000 7f9525e00640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 0x7f953015b230 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9518035040 tx=0x7f95180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:38.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.399+0000 7f9527400640 1 -- 172.21.15.99:0/4260024117 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518037040 con 0x7f95300d2680 2024-09-10T07:39:38.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.399+0000 7f9527400640 1 -- 172.21.15.99:0/4260024117 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9518030500 con 0x7f95300d2680 2024-09-10T07:39:38.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.399+0000 7f9527400640 1 -- 172.21.15.99:0/4260024117 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518030910 con 0x7f95300d2680 2024-09-10T07:39:38.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.399+0000 7f9534a00640 1 -- 172.21.15.99:0/4260024117 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95300ba1a0 con 0x7f95300d2680 2024-09-10T07:39:38.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.399+0000 7f9534a00640 1 -- 172.21.15.99:0/4260024117 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95300ba760 con 0x7f95300d2680 2024-09-10T07:39:38.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.400+0000 7f9534a00640 1 -- 172.21.15.99:0/4260024117 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95300cf580 con 0x7f95300d2680 2024-09-10T07:39:38.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.401+0000 7f9527400640 1 -- 172.21.15.99:0/4260024117 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9518044020 con 0x7f95300d2680 2024-09-10T07:39:38.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.401+0000 7f9527400640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f950c06be30 0x7f950c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.402+0000 7f9527400640 1 -- 172.21.15.99:0/4260024117 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7f95180ab080 con 0x7f95300d2680 2024-09-10T07:39:38.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.402+0000 7f952e800640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f950c06be30 0x7f950c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.402+0000 7f952e800640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f950c06be30 0x7f950c06e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9520007fd0 tx=0x7f9520009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:38.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.406+0000 7f9527400640 1 -- 172.21.15.99:0/4260024117 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9518079aa0 con 0x7f95300d2680 2024-09-10T07:39:38.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.613+0000 7f9534a00640 1 -- 172.21.15.99:0/4260024117 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95300cb120 con 0x7f95300d2680 2024-09-10T07:39:38.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.613+0000 7f9527400640 1 -- 172.21.15.99:0/4260024117 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7f95180793a0 con 0x7f95300d2680 2024-09-10T07:39:38.614 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:38.614 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":49,"btime":"2024-09-10T07:39:04:324940+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/224049994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":224049994},{"type":"v1","addr":"172.21.15.187:6834","nonce":224049994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2009047482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2009047482},{"type":"v1","addr":"172.21.15.187:6835","nonce":2009047482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3952584402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3952584402},{"type":"v1","addr":"172.21.15.99:6837","nonce":3952584402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:00.703298+0000","modified":"2024-09-10T07:39:03.726531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/1858150570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1858150570},{"type":"v1","addr":"172.21.15.99:6835","nonce":1858150570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":6}]} 2024-09-10T07:39:38.614 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 49 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 -- 172.21.15.99:0/4260024117 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f950c06be30 msgr2=0x7f950c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f950c06be30 0x7f950c06e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9520007fd0 tx=0x7f9520009040 comp rx=0 tx=0).stop 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 -- 172.21.15.99:0/4260024117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 msgr2=0x7f953015b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 0x7f953015b230 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9518035040 tx=0x7f95180046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 -- 172.21.15.99:0/4260024117 shutdown_connections 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f953015e970 0x7f953015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f950c06be30 0x7f950c06e2f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95300d2680 0x7f953015b230 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 --2- 172.21.15.99:0/4260024117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95300cfac0 0x7f95301f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 -- 172.21.15.99:0/4260024117 >> 172.21.15.99:0/4260024117 conn(0x7f953009de00 msgr2=0x7f9530157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 -- 172.21.15.99:0/4260024117 shutdown_connections 2024-09-10T07:39:38.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.616+0000 7f9534a00640 1 -- 172.21.15.99:0/4260024117 wait complete. 2024-09-10T07:39:38.632 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:38.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.786+0000 7fddd3e00640 1 Processor -- start 2024-09-10T07:39:38.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.786+0000 7fddd3e00640 1 -- start start 2024-09-10T07:39:38.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.787+0000 7fddd3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40d2680 0x7fddd40cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.787+0000 7fddd3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fddd40cfac0 0x7fddd40c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.787+0000 7fddd3e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd40d2bd0 con 0x7fddd415e970 2024-09-10T07:39:38.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.787+0000 7fddd3e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fddd40d37e0 con 0x7fddd40cfac0 2024-09-10T07:39:38.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.787+0000 7fddd3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fddd40d2eb0 con 0x7fddd40d2680 2024-09-10T07:39:38.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.788+0000 7fddd2a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fddd415e970 0x7fddd40d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37502/0 (socket says 172.21.15.99:37502) 2024-09-10T07:39:38.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.788+0000 7fddd2a00640 1 -- 172.21.15.99:0/892042358 learned_addr learned my addr 172.21.15.99:0/892042358 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:38.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.788+0000 7fddd3400640 1 --2- 172.21.15.99:0/892042358 >> v2:172.21.15.99:3300/0 conn(0x7fddd40cfac0 0x7fddd40c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.788+0000 7fddca000640 1 --2- 172.21.15.99:0/892042358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40d2680 0x7fddd40cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.788+0000 7fddd2000640 1 -- 172.21.15.99:0/892042358 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3100973640 0 0) 0x7fddd40d2bd0 con 0x7fddd415e970 2024-09-10T07:39:38.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.788+0000 7fddd2000640 1 -- 172.21.15.99:0/892042358 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddb8003520 con 0x7fddd415e970 2024-09-10T07:39:38.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.788+0000 7fddd3400640 1 -- 172.21.15.99:0/892042358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40d2680 msgr2=0x7fddd40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:38.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.788+0000 7fddd3400640 1 --2- 172.21.15.99:0/892042358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40d2680 0x7fddd40cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.788+0000 7fddd3400640 1 -- 172.21.15.99:0/892042358 >> v1:172.21.15.99:6789/0 conn(0x7fddd415e970 legacy=0x7fddd40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.788+0000 7fddd3400640 1 -- 172.21.15.99:0/892042358 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd40d3190 con 0x7fddd40cfac0 2024-09-10T07:39:38.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.789+0000 7fddd3400640 1 --2- 172.21.15.99:0/892042358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 0x7fddd40c8700 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009d90 tx=0x7fddcc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36796d07e21a2b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:38.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.789+0000 7fddd2000640 1 -- 172.21.15.99:0/892042358 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc007740 con 0x7fddd40cfac0 2024-09-10T07:39:38.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.789+0000 7fddd2000640 1 -- 172.21.15.99:0/892042358 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc0078e0 con 0x7fddd40cfac0 2024-09-10T07:39:38.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.789+0000 7fddd2000640 1 -- 172.21.15.99:0/892042358 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc007c90 con 0x7fddd40cfac0 2024-09-10T07:39:38.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.790+0000 7fddd3e00640 1 -- 172.21.15.99:0/892042358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 msgr2=0x7fddd40c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.790+0000 7fddd3e00640 1 --2- 172.21.15.99:0/892042358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 0x7fddd40c8700 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009d90 tx=0x7fddcc02a6f0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.790+0000 7fddd3e00640 1 -- 172.21.15.99:0/892042358 shutdown_connections 2024-09-10T07:39:38.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.790+0000 7fddd3e00640 1 --2- 172.21.15.99:0/892042358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 0x7fddd40c8700 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.790+0000 7fddd3e00640 1 --2- 172.21.15.99:0/892042358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40d2680 0x7fddd40cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.790+0000 7fddd3e00640 1 -- 172.21.15.99:0/892042358 >> 172.21.15.99:0/892042358 conn(0x7fddd409de00 msgr2=0x7fddd40d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:38.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.790+0000 7fddd3e00640 1 -- 172.21.15.99:0/892042358 shutdown_connections 2024-09-10T07:39:38.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.790+0000 7fddd3e00640 1 -- 172.21.15.99:0/892042358 wait complete. 2024-09-10T07:39:38.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.792+0000 7fddd3e00640 1 Processor -- start 2024-09-10T07:39:38.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.792+0000 7fddd3e00640 1 -- start start 2024-09-10T07:39:38.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 0x7fddd40b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40d2680 0x7fddd4161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd3e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddd415e970 0x7fddd4161570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd3e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fddd415ed50 con 0x7fddd40cfac0 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd3e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40cff70 con 0x7fddd415e970 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fddd415eed0 con 0x7fddd40d2680 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 0x7fddd40b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 0x7fddd40b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60470/0 (socket says 172.21.15.99:60470) 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd2a00640 1 -- 172.21.15.99:0/3694854315 learned_addr learned my addr 172.21.15.99:0/3694854315 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddca000640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40d2680 0x7fddd4161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd3400640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddd415e970 0x7fddd4161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd2a00640 1 -- 172.21.15.99:0/3694854315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40d2680 msgr2=0x7fddd4161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd2a00640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40d2680 0x7fddd4161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd2a00640 1 -- 172.21.15.99:0/3694854315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddd415e970 msgr2=0x7fddd4161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:38.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd2a00640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddd415e970 0x7fddd4161570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:38.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.793+0000 7fddd2a00640 1 -- 172.21.15.99:0/3694854315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd4160270 con 0x7fddd40cfac0 2024-09-10T07:39:38.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.794+0000 7fddd2a00640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 0x7fddd40b7bb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c390 tx=0x7fddc400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:38.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.794+0000 7fddcb400640 1 -- 172.21.15.99:0/3694854315 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4017070 con 0x7fddd40cfac0 2024-09-10T07:39:38.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.794+0000 7fddcb400640 1 -- 172.21.15.99:0/3694854315 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc4005ce0 con 0x7fddd40cfac0 2024-09-10T07:39:38.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.794+0000 7fddd3e00640 1 -- 172.21.15.99:0/3694854315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd4160550 con 0x7fddd40cfac0 2024-09-10T07:39:38.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.794+0000 7fddcb400640 1 -- 172.21.15.99:0/3694854315 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40072f0 con 0x7fddd40cfac0 2024-09-10T07:39:38.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.794+0000 7fddd3e00640 1 -- 172.21.15.99:0/3694854315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd4160b10 con 0x7fddd40cfac0 2024-09-10T07:39:38.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.795+0000 7fddd3e00640 1 -- 172.21.15.99:0/3694854315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd40c8680 con 0x7fddd40cfac0 2024-09-10T07:39:38.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.796+0000 7fddcb400640 1 -- 172.21.15.99:0/3694854315 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddc401a070 con 0x7fddd40cfac0 2024-09-10T07:39:38.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.797+0000 7fddcb400640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fddb006be30 0x7fddb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:38.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.797+0000 7fddcb400640 1 -- 172.21.15.99:0/3694854315 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7fddc408a160 con 0x7fddd40cfac0 2024-09-10T07:39:38.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.797+0000 7fddca000640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fddb006be30 0x7fddb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:38.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.798+0000 7fddca000640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fddb006be30 0x7fddb006e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fddd40b96f0 tx=0x7fddbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:38.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:38.801+0000 7fddcb400640 1 -- 172.21.15.99:0/3694854315 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fddc40584a0 con 0x7fddd40cfac0 2024-09-10T07:39:39.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.012+0000 7fddd3e00640 1 -- 172.21.15.99:0/3694854315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddd4075500 con 0x7fddd40cfac0 2024-09-10T07:39:39.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.012+0000 7fddcb400640 1 -- 172.21.15.99:0/3694854315 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5228 (secure 0 0 0) 0x7fddc405c7a0 con 0x7fddd40cfac0 2024-09-10T07:39:39.013 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:39.013 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":49,"btime":"2024-09-10T07:39:04:324940+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/224049994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":224049994},{"type":"v1","addr":"172.21.15.187:6834","nonce":224049994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2009047482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2009047482},{"type":"v1","addr":"172.21.15.187:6835","nonce":2009047482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3952584402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3952584402},{"type":"v1","addr":"172.21.15.99:6837","nonce":3952584402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:00.703298+0000","modified":"2024-09-10T07:39:03.726531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6069":{"gid":6069,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6835/1858150570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1858150570},{"type":"v1","addr":"172.21.15.99:6835","nonce":1858150570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6069,"qdb_cluster":[6069]},"id":6}]} 2024-09-10T07:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 49 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.014+0000 7fddd3e00640 1 -- 172.21.15.99:0/3694854315 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fddb006be30 msgr2=0x7fddb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.014+0000 7fddd3e00640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fddb006be30 0x7fddb006e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fddd40b96f0 tx=0x7fddbc008040 comp rx=0 tx=0).stop 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.014+0000 7fddd3e00640 1 -- 172.21.15.99:0/3694854315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 msgr2=0x7fddd40b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.014+0000 7fddd3e00640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 0x7fddd40b7bb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c390 tx=0x7fddc400c850 comp rx=0 tx=0).stop 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.014+0000 7fddd3e00640 1 -- 172.21.15.99:0/3694854315 shutdown_connections 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.014+0000 7fddd3e00640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddd415e970 0x7fddd4161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.014+0000 7fddd3e00640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40d2680 0x7fddd4161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.014+0000 7fddd3e00640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fddb006be30 0x7fddb006e2f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.014+0000 7fddd3e00640 1 --2- 172.21.15.99:0/3694854315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cfac0 0x7fddd40b7bb0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.014+0000 7fddd3e00640 1 -- 172.21.15.99:0/3694854315 >> 172.21.15.99:0/3694854315 conn(0x7fddd409de00 msgr2=0x7fddd40d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:39.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.015+0000 7fddd3e00640 1 -- 172.21.15.99:0/3694854315 shutdown_connections 2024-09-10T07:39:39.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.015+0000 7fddd3e00640 1 -- 172.21.15.99:0/3694854315 wait complete. 2024-09-10T07:39:39.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:39:39.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.183+0000 7f61a0c00640 1 Processor -- start 2024-09-10T07:39:39.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.183+0000 7f61a0c00640 1 -- start start 2024-09-10T07:39:39.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f61a0c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 0x7f619c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f61a0c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f619c160a80 0x7f619c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f61a0c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f619c142650 con 0x7f619c13fae0 2024-09-10T07:39:39.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f61a0c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f619c0ce780 con 0x7f619c160a80 2024-09-10T07:39:39.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f61a0c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f619c142930 con 0x7f619c142150 2024-09-10T07:39:39.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f619a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f619c160a80 0x7f619c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f6199e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f619c13fae0 0x7f619c06f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37508/0 (socket says 172.21.15.99:37508) 2024-09-10T07:39:39.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f6199e00640 1 -- 172.21.15.99:0/2111499629 learned_addr learned my addr 172.21.15.99:0/2111499629 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:39.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f6199400640 1 --2- 172.21.15.99:0/2111499629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 0x7f619c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f619a800640 1 -- 172.21.15.99:0/2111499629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 msgr2=0x7f619c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:39.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f619a800640 1 --2- 172.21.15.99:0/2111499629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 0x7f619c160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f619a800640 1 -- 172.21.15.99:0/2111499629 >> v1:172.21.15.99:6789/0 conn(0x7f619c13fae0 legacy=0x7f619c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f619a800640 1 -- 172.21.15.99:0/2111499629 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619c142c10 con 0x7f619c160a80 2024-09-10T07:39:39.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.185+0000 7f6199400640 1 --2- 172.21.15.99:0/2111499629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 0x7f619c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:39.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.186+0000 7f619a800640 1 --2- 172.21.15.99:0/2111499629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 0x7f619c0cec10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6194009d90 tx=0x7f619402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8f7bc7cdd2d76a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:39.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f6198a00640 1 -- 172.21.15.99:0/2111499629 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194031600 con 0x7f619c160a80 2024-09-10T07:39:39.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f6198a00640 1 -- 172.21.15.99:0/2111499629 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61940317a0 con 0x7f619c160a80 2024-09-10T07:39:39.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f6198a00640 1 -- 172.21.15.99:0/2111499629 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194031b70 con 0x7f619c160a80 2024-09-10T07:39:39.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f61a0c00640 1 -- 172.21.15.99:0/2111499629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 msgr2=0x7f619c0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f61a0c00640 1 --2- 172.21.15.99:0/2111499629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 0x7f619c0cec10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6194009d90 tx=0x7f619402a5d0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f61a0c00640 1 -- 172.21.15.99:0/2111499629 shutdown_connections 2024-09-10T07:39:39.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f61a0c00640 1 --2- 172.21.15.99:0/2111499629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 0x7f619c0cec10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f61a0c00640 1 --2- 172.21.15.99:0/2111499629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 0x7f619c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f61a0c00640 1 -- 172.21.15.99:0/2111499629 >> 172.21.15.99:0/2111499629 conn(0x7f619c06bc10 msgr2=0x7f619c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:39.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f61a0c00640 1 -- 172.21.15.99:0/2111499629 shutdown_connections 2024-09-10T07:39:39.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.187+0000 7f61a0c00640 1 -- 172.21.15.99:0/2111499629 wait complete. 2024-09-10T07:39:39.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.189+0000 7f61a0c00640 1 Processor -- start 2024-09-10T07:39:39.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.189+0000 7f61a0c00640 1 -- start start 2024-09-10T07:39:39.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f61a0c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f619c13fae0 0x7f619c13e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f61a0c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 0x7f619c15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f61a0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 0x7f619c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f61a0c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f619c0cf2d0 con 0x7f619c160a80 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f61a0c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f619c0cf150 con 0x7f619c13fae0 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f61a0c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f619c0cf450 con 0x7f619c142150 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f619a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 0x7f619c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f619a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 0x7f619c15bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60490/0 (socket says 172.21.15.99:60490) 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f619a800640 1 -- 172.21.15.99:0/469058015 learned_addr learned my addr 172.21.15.99:0/469058015 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f6199400640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 0x7f619c15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f6199e00640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f619c13fae0 0x7f619c13e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f619a800640 1 -- 172.21.15.99:0/469058015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 msgr2=0x7f619c15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f619a800640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 0x7f619c15b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f619a800640 1 -- 172.21.15.99:0/469058015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f619c13fae0 msgr2=0x7f619c13e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f619a800640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f619c13fae0 0x7f619c13e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f619a800640 1 -- 172.21.15.99:0/469058015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619c143380 con 0x7f619c160a80 2024-09-10T07:39:39.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.191+0000 7f6199e00640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f619c13fae0 0x7f619c13e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:39.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.190+0000 7f6199400640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 0x7f619c15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:39.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.191+0000 7f619a800640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 0x7f619c15bed0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6194009eb0 tx=0x7f6194004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:39.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.191+0000 7f6192000640 1 -- 172.21.15.99:0/469058015 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619403f070 con 0x7f619c160a80 2024-09-10T07:39:39.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.191+0000 7f6192000640 1 -- 172.21.15.99:0/469058015 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6194030b60 con 0x7f619c160a80 2024-09-10T07:39:39.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.191+0000 7f61a0c00640 1 -- 172.21.15.99:0/469058015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619c143660 con 0x7f619c160a80 2024-09-10T07:39:39.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.191+0000 7f6192000640 1 -- 172.21.15.99:0/469058015 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194044460 con 0x7f619c160a80 2024-09-10T07:39:39.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.191+0000 7f61a0c00640 1 -- 172.21.15.99:0/469058015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f619c143c20 con 0x7f619c160a80 2024-09-10T07:39:39.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.192+0000 7f61a0c00640 1 -- 172.21.15.99:0/469058015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f619c143e20 con 0x7f619c160a80 2024-09-10T07:39:39.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.193+0000 7f6192000640 1 -- 172.21.15.99:0/469058015 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f619403b410 con 0x7f619c160a80 2024-09-10T07:39:39.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.194+0000 7f6192000640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f617c06be30 0x7f617c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.194+0000 7f6192000640 1 -- 172.21.15.99:0/469058015 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7f61940ac5a0 con 0x7f619c160a80 2024-09-10T07:39:39.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.194+0000 7f6199e00640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f617c06be30 0x7f617c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.195+0000 7f6199e00640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f617c06be30 0x7f617c06e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f618c000f60 tx=0x7f618c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:39.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.198+0000 7f6192000640 1 -- 172.21.15.99:0/469058015 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f619407a990 con 0x7f619c160a80 2024-09-10T07:39:39.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.374+0000 7f61a0c00640 1 -- 172.21.15.99:0/469058015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f619c15f870 con 0x7f619c160a80 2024-09-10T07:39:39.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.375+0000 7f6192000640 1 -- 172.21.15.99:0/469058015 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16751 (secure 0 0 0) 0x7f619407fe20 con 0x7f619c160a80 2024-09-10T07:39:39.376 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:39.376 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":113,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:39:32.958523+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:38:58.485547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T07:38:59.701338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3b","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:39:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 -- 172.21.15.99:0/469058015 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f617c06be30 msgr2=0x7f617c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f617c06be30 0x7f617c06e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f618c000f60 tx=0x7f618c009040 comp rx=0 tx=0).stop 2024-09-10T07:39:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 -- 172.21.15.99:0/469058015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 msgr2=0x7f619c15bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 0x7f619c15bed0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6194009eb0 tx=0x7f6194004a40 comp rx=0 tx=0).stop 2024-09-10T07:39:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 -- 172.21.15.99:0/469058015 shutdown_connections 2024-09-10T07:39:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f617c06be30 0x7f617c06e2f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f619c160a80 0x7f619c15bed0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f619c142150 0x7f619c15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 --2- 172.21.15.99:0/469058015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f619c13fae0 0x7f619c13e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 -- 172.21.15.99:0/469058015 >> 172.21.15.99:0/469058015 conn(0x7f619c06bc10 msgr2=0x7f619c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:39.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 -- 172.21.15.99:0/469058015 shutdown_connections 2024-09-10T07:39:39.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.378+0000 7f61a0c00640 1 -- 172.21.15.99:0/469058015 wait complete. 2024-09-10T07:39:39.394 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:39:39.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.549+0000 7fa2d4000640 1 Processor -- start 2024-09-10T07:39:39.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.549+0000 7fa2d4000640 1 -- start start 2024-09-10T07:39:39.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.550+0000 7fa2d4000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 0x7fa2cc06f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.550+0000 7fa2d4000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa2cc073140 0x7fa2cc073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.550+0000 7fa2d4000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2cc0b6fa0 con 0x7fa2cc073aa0 2024-09-10T07:39:39.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.550+0000 7fa2d4000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa2cc160480 con 0x7fa2cc073140 2024-09-10T07:39:39.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.550+0000 7fa2d4000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa2cc15fa50 con 0x7fa2cc15c720 2024-09-10T07:39:39.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.551+0000 7fa2d0c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa2cc073140 0x7fa2cc073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.551+0000 7fa2d0c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa2cc073140 0x7fa2cc073560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60496/0 (socket says 172.21.15.99:60496) 2024-09-10T07:39:39.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.551+0000 7fa2d0c00640 1 -- 172.21.15.99:0/3721613451 learned_addr learned my addr 172.21.15.99:0/3721613451 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:39.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.551+0000 7fa2d2000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa2cc073aa0 0x7fa2cc06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:37516/0 (socket says 172.21.15.99:37516) 2024-09-10T07:39:39.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.551+0000 7fa2d1600640 1 --2- 172.21.15.99:0/3721613451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 0x7fa2cc06f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.551+0000 7fa2d0c00640 1 -- 172.21.15.99:0/3721613451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 msgr2=0x7fa2cc06f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:39.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.551+0000 7fa2d0c00640 1 --2- 172.21.15.99:0/3721613451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 0x7fa2cc06f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.551+0000 7fa2d0c00640 1 -- 172.21.15.99:0/3721613451 >> v1:172.21.15.99:6789/0 conn(0x7fa2cc073aa0 legacy=0x7fa2cc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.551+0000 7fa2d0c00640 1 -- 172.21.15.99:0/3721613451 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2cc073f50 con 0x7fa2cc073140 2024-09-10T07:39:39.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.551+0000 7fa2cbe00640 1 -- 172.21.15.99:0/3721613451 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902726408 0 0) 0x7fa2c4001490 con 0x7fa2cc073aa0 2024-09-10T07:39:39.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.552+0000 7fa2d0c00640 1 --2- 172.21.15.99:0/3721613451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 0x7fa2cc073560 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009870 tx=0x7fa2b802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd6d991fd71ff01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:39.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.552+0000 7fa2cbe00640 1 -- 172.21.15.99:0/3721613451 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8037070 con 0x7fa2cc073140 2024-09-10T07:39:39.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.552+0000 7fa2cbe00640 1 -- 172.21.15.99:0/3721613451 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b802ae50 con 0x7fa2cc073140 2024-09-10T07:39:39.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.552+0000 7fa2cbe00640 1 -- 172.21.15.99:0/3721613451 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8032860 con 0x7fa2cc073140 2024-09-10T07:39:39.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.553+0000 7fa2d4000640 1 -- 172.21.15.99:0/3721613451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 msgr2=0x7fa2cc073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.553+0000 7fa2d4000640 1 --2- 172.21.15.99:0/3721613451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 0x7fa2cc073560 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009870 tx=0x7fa2b802a300 comp rx=0 tx=0).stop 2024-09-10T07:39:39.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.553+0000 7fa2d4000640 1 -- 172.21.15.99:0/3721613451 shutdown_connections 2024-09-10T07:39:39.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.553+0000 7fa2d4000640 1 --2- 172.21.15.99:0/3721613451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 0x7fa2cc073560 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.553+0000 7fa2d4000640 1 --2- 172.21.15.99:0/3721613451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 0x7fa2cc06f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.553+0000 7fa2d4000640 1 -- 172.21.15.99:0/3721613451 >> 172.21.15.99:0/3721613451 conn(0x7fa2cc0b5eb0 msgr2=0x7fa2cc0b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:39.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.553+0000 7fa2d4000640 1 -- 172.21.15.99:0/3721613451 shutdown_connections 2024-09-10T07:39:39.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.553+0000 7fa2d4000640 1 -- 172.21.15.99:0/3721613451 wait complete. 2024-09-10T07:39:39.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.555+0000 7fa2d4000640 1 Processor -- start 2024-09-10T07:39:39.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.555+0000 7fa2d4000640 1 -- start start 2024-09-10T07:39:39.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d4000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 0x7fa2cc0b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d4000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2cc073aa0 0x7fa2cc09eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d4000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 0x7fa2cc14a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d4000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc15f6e0 con 0x7fa2cc073140 2024-09-10T07:39:39.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d4000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc15f400 con 0x7fa2cc073aa0 2024-09-10T07:39:39.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d4000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa2cc15f0b0 con 0x7fa2cc15c720 2024-09-10T07:39:39.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d1600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 0x7fa2cc0b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d1600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 0x7fa2cc0b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60500/0 (socket says 172.21.15.99:60500) 2024-09-10T07:39:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d1600640 1 -- 172.21.15.99:0/417884376 learned_addr learned my addr 172.21.15.99:0/417884376 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d2000640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 0x7fa2cc14a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d0c00640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2cc073aa0 0x7fa2cc09eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d1600640 1 -- 172.21.15.99:0/417884376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 msgr2=0x7fa2cc14a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d1600640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 0x7fa2cc14a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d1600640 1 -- 172.21.15.99:0/417884376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2cc073aa0 msgr2=0x7fa2cc09eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d1600640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2cc073aa0 0x7fa2cc09eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d1600640 1 -- 172.21.15.99:0/417884376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2cc09f000 con 0x7fa2cc073140 2024-09-10T07:39:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.556+0000 7fa2d2000640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 0x7fa2cc14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:39.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.557+0000 7fa2d1600640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 0x7fa2cc0b2120 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000e8a0 tx=0x7fa2c000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:39.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.557+0000 7fa2c9600640 1 -- 172.21.15.99:0/417884376 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0017070 con 0x7fa2cc073140 2024-09-10T07:39:39.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.557+0000 7fa2c9600640 1 -- 172.21.15.99:0/417884376 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c000c940 con 0x7fa2cc073140 2024-09-10T07:39:39.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.557+0000 7fa2c9600640 1 -- 172.21.15.99:0/417884376 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000cd30 con 0x7fa2cc073140 2024-09-10T07:39:39.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.557+0000 7fa2d4000640 1 -- 172.21.15.99:0/417884376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2cc0b37f0 con 0x7fa2cc073140 2024-09-10T07:39:39.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.557+0000 7fa2d4000640 1 -- 172.21.15.99:0/417884376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2cc0b2a30 con 0x7fa2cc073140 2024-09-10T07:39:39.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.558+0000 7fa2d4000640 1 -- 172.21.15.99:0/417884376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2cc072960 con 0x7fa2cc073140 2024-09-10T07:39:39.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.559+0000 7fa2c9600640 1 -- 172.21.15.99:0/417884376 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2c001a070 con 0x7fa2cc073140 2024-09-10T07:39:39.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.560+0000 7fa2c9600640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa2ac06be30 0x7fa2ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.560+0000 7fa2c9600640 1 -- 172.21.15.99:0/417884376 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5738+0+0 (secure 0 0 0) 0x7fa2c008ad30 con 0x7fa2cc073140 2024-09-10T07:39:39.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.560+0000 7fa2d0c00640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa2ac06be30 0x7fa2ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.561+0000 7fa2d0c00640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa2ac06be30 0x7fa2ac06e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8034000 tx=0x7fa2b802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:39.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.564+0000 7fa2c9600640 1 -- 172.21.15.99:0/417884376 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa2c0058fd0 con 0x7fa2cc073140 2024-09-10T07:39:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.770+0000 7fa2d4000640 1 -- 172.21.15.99:0/417884376 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa2cc06f980 con 0x7fa2cc073140 2024-09-10T07:39:39.771 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:39:39.771+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:39:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.773+0000 7fa2c9600640 1 -- 172.21.15.99:0/417884376 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) ==== 161+0+0 (secure 0 0 0) 0x7fa2c005d2d0 con 0x7fa2cc073140 2024-09-10T07:39:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:39:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 -- 172.21.15.99:0/417884376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa2ac06be30 msgr2=0x7fa2ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa2ac06be30 0x7fa2ac06e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8034000 tx=0x7fa2b802e000 comp rx=0 tx=0).stop 2024-09-10T07:39:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 -- 172.21.15.99:0/417884376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 msgr2=0x7fa2cc0b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 0x7fa2cc0b2120 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000e8a0 tx=0x7fa2c000ed60 comp rx=0 tx=0).stop 2024-09-10T07:39:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 -- 172.21.15.99:0/417884376 shutdown_connections 2024-09-10T07:39:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2cc15c720 0x7fa2cc14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2cc073aa0 0x7fa2cc09eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa2ac06be30 0x7fa2ac06e2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 --2- 172.21.15.99:0/417884376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2cc073140 0x7fa2cc0b2120 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 -- 172.21.15.99:0/417884376 >> 172.21.15.99:0/417884376 conn(0x7fa2cc0b5eb0 msgr2=0x7fa2cc162280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 -- 172.21.15.99:0/417884376 shutdown_connections 2024-09-10T07:39:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.776+0000 7fa2d4000640 1 -- 172.21.15.99:0/417884376 wait complete. 2024-09-10T07:39:39.799 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:39:39.849 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:39:39.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.955+0000 7fd0bf200640 1 Processor -- start 2024-09-10T07:39:39.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.956+0000 7fd0bf200640 1 -- start start 2024-09-10T07:39:39.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0bf200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd0b806e280 0x7fd0b8073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0bf200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b80d1010 0x7fd0b80ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0bf200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0b80722d0 con 0x7fd0b8071df0 2024-09-10T07:39:39.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0bf200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd0b80738b0 con 0x7fd0b806e280 2024-09-10T07:39:39.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0bf200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b80725b0 con 0x7fd0b80d1010 2024-09-10T07:39:39.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0b7400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd0b8071df0 0x7fd0b806e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45676/0 (socket says 172.21.15.99:45676) 2024-09-10T07:39:39.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0b7400640 1 -- 172.21.15.99:0/2004498667 learned_addr learned my addr 172.21.15.99:0/2004498667 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:39.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0bd200640 1 --2- 172.21.15.99:0/2004498667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b80d1010 0x7fd0b80ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0b7e00640 1 --2- 172.21.15.99:0/2004498667 >> v2:172.21.15.187:3300/0 conn(0x7fd0b806e280 0x7fd0b8073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0bd200640 1 -- 172.21.15.99:0/2004498667 >> v2:172.21.15.187:3300/0 conn(0x7fd0b806e280 msgr2=0x7fd0b8073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:39.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.957+0000 7fd0bd200640 1 --2- 172.21.15.99:0/2004498667 >> v2:172.21.15.187:3300/0 conn(0x7fd0b806e280 0x7fd0b8073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.958+0000 7fd0bd200640 1 -- 172.21.15.99:0/2004498667 >> v1:172.21.15.99:6789/0 conn(0x7fd0b8071df0 legacy=0x7fd0b806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.958+0000 7fd0b6a00640 1 -- 172.21.15.99:0/2004498667 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071678035 0 0) 0x7fd0b80722d0 con 0x7fd0b8071df0 2024-09-10T07:39:39.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.958+0000 7fd0bd200640 1 -- 172.21.15.99:0/2004498667 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b8072890 con 0x7fd0b80d1010 2024-09-10T07:39:39.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.959+0000 7fd0bd200640 1 --2- 172.21.15.99:0/2004498667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b80d1010 0x7fd0b80ce3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009d90 tx=0x7fd0b002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a240eba21f724e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:39.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.959+0000 7fd0b6a00640 1 -- 172.21.15.99:0/2004498667 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0007740 con 0x7fd0b80d1010 2024-09-10T07:39:39.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.959+0000 7fd0b6a00640 1 -- 172.21.15.99:0/2004498667 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b00078e0 con 0x7fd0b80d1010 2024-09-10T07:39:39.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.959+0000 7fd0b6a00640 1 -- 172.21.15.99:0/2004498667 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0007cb0 con 0x7fd0b80d1010 2024-09-10T07:39:39.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.959+0000 7fd0bf200640 1 -- 172.21.15.99:0/2004498667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b80d1010 msgr2=0x7fd0b80ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.959+0000 7fd0bf200640 1 --2- 172.21.15.99:0/2004498667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b80d1010 0x7fd0b80ce3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009d90 tx=0x7fd0b002a660 comp rx=0 tx=0).stop 2024-09-10T07:39:39.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.959+0000 7fd0bf200640 1 -- 172.21.15.99:0/2004498667 shutdown_connections 2024-09-10T07:39:39.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.959+0000 7fd0bf200640 1 --2- 172.21.15.99:0/2004498667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b80d1010 0x7fd0b80ce3d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.959+0000 7fd0bf200640 1 --2- 172.21.15.99:0/2004498667 >> v2:172.21.15.187:3300/0 conn(0x7fd0b806e280 0x7fd0b8073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.959+0000 7fd0bf200640 1 -- 172.21.15.99:0/2004498667 >> 172.21.15.99:0/2004498667 conn(0x7fd0b806bc10 msgr2=0x7fd0b806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:39.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.960+0000 7fd0bf200640 1 -- 172.21.15.99:0/2004498667 shutdown_connections 2024-09-10T07:39:39.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.960+0000 7fd0bf200640 1 -- 172.21.15.99:0/2004498667 wait complete. 2024-09-10T07:39:39.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.961+0000 7fd0bf200640 1 Processor -- start 2024-09-10T07:39:39.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.961+0000 7fd0bf200640 1 -- start start 2024-09-10T07:39:39.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.962+0000 7fd0bf200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b806e280 0x7fd0b8159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.962+0000 7fd0bf200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b8071df0 0x7fd0b80b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.962+0000 7fd0bf200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0b80d1010 0x7fd0b814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.962+0000 7fd0bf200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b815db60 con 0x7fd0b806e280 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.962+0000 7fd0bf200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b8072e50 con 0x7fd0b80d1010 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.962+0000 7fd0bf200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b80d14c0 con 0x7fd0b8071df0 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.962+0000 7fd0b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b806e280 0x7fd0b8159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.962+0000 7fd0b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b806e280 0x7fd0b8159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47878/0 (socket says 172.21.15.99:47878) 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.962+0000 7fd0b7e00640 1 -- 172.21.15.99:0/1206878084 learned_addr learned my addr 172.21.15.99:0/1206878084 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0b7400640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b8071df0 0x7fd0b80b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0bd200640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0b80d1010 0x7fd0b814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0b7e00640 1 -- 172.21.15.99:0/1206878084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b8071df0 msgr2=0x7fd0b80b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0b7e00640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b8071df0 0x7fd0b80b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0b7e00640 1 -- 172.21.15.99:0/1206878084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0b80d1010 msgr2=0x7fd0b814a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0b7e00640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0b80d1010 0x7fd0b814a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:39.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0b7e00640 1 -- 172.21.15.99:0/1206878084 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b814a800 con 0x7fd0b806e280 2024-09-10T07:39:39.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0b7400640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b8071df0 0x7fd0b80b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:39.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0bd200640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0b80d1010 0x7fd0b814a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:39.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0b7e00640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b806e280 0x7fd0b8159180 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800e9e0 tx=0x7fd0a800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:39.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0afe00640 1 -- 172.21.15.99:0/1206878084 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8017070 con 0x7fd0b806e280 2024-09-10T07:39:39.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0afe00640 1 -- 172.21.15.99:0/1206878084 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a800c9d0 con 0x7fd0b806e280 2024-09-10T07:39:39.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0afe00640 1 -- 172.21.15.99:0/1206878084 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800cdc0 con 0x7fd0b806e280 2024-09-10T07:39:39.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.963+0000 7fd0bf200640 1 -- 172.21.15.99:0/1206878084 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b80b4670 con 0x7fd0b806e280 2024-09-10T07:39:39.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.964+0000 7fd0bf200640 1 -- 172.21.15.99:0/1206878084 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b80b4c30 con 0x7fd0b806e280 2024-09-10T07:39:39.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.965+0000 7fd0bf200640 1 -- 172.21.15.99:0/1206878084 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b8073370 con 0x7fd0b806e280 2024-09-10T07:39:39.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.965+0000 7fd0afe00640 1 -- 172.21.15.99:0/1206878084 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0a801a070 con 0x7fd0b806e280 2024-09-10T07:39:39.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.967+0000 7fd0afe00640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd09806be30 0x7fd09806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:39.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.967+0000 7fd0afe00640 1 -- 172.21.15.99:0/1206878084 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5824+0+0 (secure 0 0 0) 0x7fd0a808b1c0 con 0x7fd0b806e280 2024-09-10T07:39:39.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.967+0000 7fd0b7400640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd09806be30 0x7fd09806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:39.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.968+0000 7fd0b7400640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd09806be30 0x7fd09806e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80b1a00 tx=0x7fd0a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:39.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:39.971+0000 7fd0afe00640 1 -- 172.21.15.99:0/1206878084 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0b814a800 con 0x7fd0b806e280 2024-09-10T07:39:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.183+0000 7fd0bf200640 1 -- 172.21.15.99:0/1206878084 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd0b806e820 con 0x7fd0b806e280 2024-09-10T07:39:40.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.775+0000 7fd0afe00640 1 -- 172.21.15.99:0/1206878084 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) ==== 104+0+0 (secure 0 0 0) 0x7fd0a8059b90 con 0x7fd0b806e280 2024-09-10T07:39:40.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 -- 172.21.15.99:0/1206878084 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd09806be30 msgr2=0x7fd09806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:40.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd09806be30 0x7fd09806e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80b1a00 tx=0x7fd0a4009040 comp rx=0 tx=0).stop 2024-09-10T07:39:40.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 -- 172.21.15.99:0/1206878084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b806e280 msgr2=0x7fd0b8159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:40.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b806e280 0x7fd0b8159180 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800e9e0 tx=0x7fd0a800eea0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 -- 172.21.15.99:0/1206878084 shutdown_connections 2024-09-10T07:39:40.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0b80d1010 0x7fd0b814a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0b8071df0 0x7fd0b80b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd09806be30 0x7fd09806e2f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 --2- 172.21.15.99:0/1206878084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0b806e280 0x7fd0b8159180 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 -- 172.21.15.99:0/1206878084 >> 172.21.15.99:0/1206878084 conn(0x7fd0b806bc10 msgr2=0x7fd0b815bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:40.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 -- 172.21.15.99:0/1206878084 shutdown_connections 2024-09-10T07:39:40.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.778+0000 7fd0bf200640 1 -- 172.21.15.99:0/1206878084 wait complete. 2024-09-10T07:39:40.797 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:39:40.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.956+0000 7f1d23e00640 1 Processor -- start 2024-09-10T07:39:40.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.956+0000 7f1d23e00640 1 -- start start 2024-09-10T07:39:40.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.957+0000 7f1d23e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1d240d16b0 0x7f1d240b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:40.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.957+0000 7f1d23e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1d240d1a90 0x7f1d240d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:40.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.957+0000 7f1d23e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d24162de0 0x7f1d24163230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:40.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.957+0000 7f1d23e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1d240d59d0 con 0x7f1d240d16b0 2024-09-10T07:39:40.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.957+0000 7f1d23e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f1d240d0a60 con 0x7f1d240d1a90 2024-09-10T07:39:40.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.957+0000 7f1d23e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1d240d3800 con 0x7f1d24162de0 2024-09-10T07:39:40.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.957+0000 7f1d22a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1d240d16b0 0x7f1d240b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:40.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.958+0000 7f1d22a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1d240d16b0 0x7f1d240b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47880/0 (socket says 172.21.15.99:47880) 2024-09-10T07:39:40.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.958+0000 7f1d22a00640 1 -- 172.21.15.99:0/1520274478 learned_addr learned my addr 172.21.15.99:0/1520274478 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:40.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.958+0000 7f1d22000640 1 --2- 172.21.15.99:0/1520274478 >> v2:172.21.15.187:3300/0 conn(0x7f1d240d1a90 0x7f1d240d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:40.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.958+0000 7f1d23400640 1 --2- 172.21.15.99:0/1520274478 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d24162de0 0x7f1d24163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:40.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.958+0000 7f1d22a00640 1 -- 172.21.15.99:0/1520274478 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d24162de0 msgr2=0x7f1d24163230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:40.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.958+0000 7f1d22a00640 1 --2- 172.21.15.99:0/1520274478 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d24162de0 0x7f1d24163230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.958+0000 7f1d22a00640 1 -- 172.21.15.99:0/1520274478 >> v2:172.21.15.187:3300/0 conn(0x7f1d240d1a90 msgr2=0x7f1d240d1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:40.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.958+0000 7f1d22a00640 1 --2- 172.21.15.99:0/1520274478 >> v2:172.21.15.187:3300/0 conn(0x7f1d240d1a90 0x7f1d240d1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.958+0000 7f1d22a00640 1 -- 172.21.15.99:0/1520274478 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d240d56f0 con 0x7f1d240d16b0 2024-09-10T07:39:40.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.958+0000 7f1d22000640 1 --2- 172.21.15.99:0/1520274478 >> v2:172.21.15.187:3300/0 conn(0x7f1d240d1a90 0x7f1d240d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:40.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.959+0000 7f1d22a00640 1 --2- 172.21.15.99:0/1520274478 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d16b0 0x7f1d240b57a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1d240b63a0 tx=0x7f1d1402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404a865e384e39b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:40.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.959+0000 7f1d21600640 1 -- 172.21.15.99:0/1520274478 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14037070 con 0x7f1d240d16b0 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.959+0000 7f1d21600640 1 -- 172.21.15.99:0/1520274478 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d14032440 con 0x7f1d240d16b0 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.959+0000 7f1d21600640 1 -- 172.21.15.99:0/1520274478 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14032810 con 0x7f1d240d16b0 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.960+0000 7f1d23e00640 1 -- 172.21.15.99:0/1520274478 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d16b0 msgr2=0x7f1d240b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.960+0000 7f1d23e00640 1 --2- 172.21.15.99:0/1520274478 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d16b0 0x7f1d240b57a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1d240b63a0 tx=0x7f1d1402a140 comp rx=0 tx=0).stop 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.960+0000 7f1d23e00640 1 -- 172.21.15.99:0/1520274478 shutdown_connections 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.960+0000 7f1d23e00640 1 --2- 172.21.15.99:0/1520274478 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d24162de0 0x7f1d24163230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.960+0000 7f1d23e00640 1 --2- 172.21.15.99:0/1520274478 >> v2:172.21.15.187:3300/0 conn(0x7f1d240d1a90 0x7f1d240d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.960+0000 7f1d23e00640 1 --2- 172.21.15.99:0/1520274478 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d16b0 0x7f1d240b57a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.960+0000 7f1d23e00640 1 -- 172.21.15.99:0/1520274478 >> 172.21.15.99:0/1520274478 conn(0x7f1d240d4a30 msgr2=0x7f1d240d4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.960+0000 7f1d23e00640 1 -- 172.21.15.99:0/1520274478 shutdown_connections 2024-09-10T07:39:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.960+0000 7f1d23e00640 1 -- 172.21.15.99:0/1520274478 wait complete. 2024-09-10T07:39:40.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.962+0000 7f1d23e00640 1 Processor -- start 2024-09-10T07:39:40.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.962+0000 7f1d23e00640 1 -- start start 2024-09-10T07:39:40.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d23e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d240d16b0 0x7f1d240cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:40.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d23e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d1a90 0x7f1d240cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:40.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d23e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d24162de0 0x7f1d240b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:40.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d23e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1d24163770 con 0x7f1d240d1a90 2024-09-10T07:39:40.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d23e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1d240d3490 con 0x7f1d24162de0 2024-09-10T07:39:40.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d23e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1d241638f0 con 0x7f1d240d16b0 2024-09-10T07:39:40.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d22000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d1a90 0x7f1d240cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:40.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d22000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d1a90 0x7f1d240cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47886/0 (socket says 172.21.15.99:47886) 2024-09-10T07:39:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d22000640 1 -- 172.21.15.99:0/420050902 learned_addr learned my addr 172.21.15.99:0/420050902 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d22a00640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d240d16b0 0x7f1d240cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d23400640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d24162de0 0x7f1d240b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d22000640 1 -- 172.21.15.99:0/420050902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d240d16b0 msgr2=0x7f1d240cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d22000640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d240d16b0 0x7f1d240cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d22000640 1 -- 172.21.15.99:0/420050902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d24162de0 msgr2=0x7f1d240b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d22000640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d24162de0 0x7f1d240b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d22000640 1 -- 172.21.15.99:0/420050902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d241f5ba0 con 0x7f1d240d1a90 2024-09-10T07:39:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.963+0000 7f1d23400640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d24162de0 0x7f1d240b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:40.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.964+0000 7f1d22000640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d1a90 0x7f1d240cd6f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000e840 tx=0x7f1d1000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:40.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.964+0000 7f1d1b400640 1 -- 172.21.15.99:0/420050902 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000f040 con 0x7f1d240d1a90 2024-09-10T07:39:40.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.964+0000 7f1d1b400640 1 -- 172.21.15.99:0/420050902 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d10004030 con 0x7f1d240d1a90 2024-09-10T07:39:40.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.964+0000 7f1d1b400640 1 -- 172.21.15.99:0/420050902 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10004400 con 0x7f1d240d1a90 2024-09-10T07:39:40.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.964+0000 7f1d23e00640 1 -- 172.21.15.99:0/420050902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d240cdd90 con 0x7f1d240d1a90 2024-09-10T07:39:40.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.964+0000 7f1d23e00640 1 -- 172.21.15.99:0/420050902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d241f8700 con 0x7f1d240d1a90 2024-09-10T07:39:40.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.965+0000 7f1d23e00640 1 -- 172.21.15.99:0/420050902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d240d0520 con 0x7f1d240d1a90 2024-09-10T07:39:40.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.966+0000 7f1d1b400640 1 -- 172.21.15.99:0/420050902 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d1000c6d0 con 0x7f1d240d1a90 2024-09-10T07:39:40.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.967+0000 7f1d1b400640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1d0406be30 0x7f1d0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:40.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.967+0000 7f1d1b400640 1 -- 172.21.15.99:0/420050902 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5824+0+0 (secure 0 0 0) 0x7f1d1008ab20 con 0x7f1d240d1a90 2024-09-10T07:39:40.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.967+0000 7f1d22a00640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1d0406be30 0x7f1d0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:40.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.968+0000 7f1d22a00640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1d0406be30 0x7f1d0406e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1d14034000 tx=0x7f1d1402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:40.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:40.971+0000 7f1d1b400640 1 -- 172.21.15.99:0/420050902 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d240d0520 con 0x7f1d240d1a90 2024-09-10T07:39:41.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:41.145+0000 7f1d23e00640 1 -- 172.21.15.99:0/420050902 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1d24163230 con 0x7f1d240d1a90 2024-09-10T07:39:41.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:41.997+0000 7f1d1b400640 1 -- 172.21.15.99:0/420050902 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) ==== 181+0+0 (secure 0 0 0) 0x7f1d10017020 con 0x7f1d240d1a90 2024-09-10T07:39:41.997 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:39:42.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.000+0000 7f1d23e00640 1 -- 172.21.15.99:0/420050902 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1d0406be30 msgr2=0x7f1d0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.000+0000 7f1d23e00640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1d0406be30 0x7f1d0406e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1d14034000 tx=0x7f1d1402e000 comp rx=0 tx=0).stop 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.000+0000 7f1d23e00640 1 -- 172.21.15.99:0/420050902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d1a90 msgr2=0x7f1d240cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.000+0000 7f1d23e00640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d1a90 0x7f1d240cd6f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000e840 tx=0x7f1d1000ed00 comp rx=0 tx=0).stop 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.000+0000 7f1d23e00640 1 -- 172.21.15.99:0/420050902 shutdown_connections 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.000+0000 7f1d23e00640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d24162de0 0x7f1d240b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.001+0000 7f1d23e00640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1d0406be30 0x7f1d0406e2f0 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1d14034000 tx=0x7f1d1402e000 comp rx=0 tx=0).stop 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.001+0000 7f1d23e00640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d240d1a90 0x7f1d240cd6f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.001+0000 7f1d23e00640 1 --2- 172.21.15.99:0/420050902 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d240d16b0 0x7f1d240cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.001+0000 7f1d23e00640 1 -- 172.21.15.99:0/420050902 >> 172.21.15.99:0/420050902 conn(0x7f1d240d4a30 msgr2=0x7f1d24162640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.001+0000 7f1d23e00640 1 -- 172.21.15.99:0/420050902 shutdown_connections 2024-09-10T07:39:42.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.001+0000 7f1d23e00640 1 -- 172.21.15.99:0/420050902 wait complete. 2024-09-10T07:39:42.020 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:39:42.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.180+0000 7f1634600640 1 Processor -- start 2024-09-10T07:39:42.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.180+0000 7f1634600640 1 -- start start 2024-09-10T07:39:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1634600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f162c0ce460 0x7f162c0cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1634600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f162c06ecf0 0x7f162c15e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1634600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f162c15dfc0 con 0x7f162c0d0420 2024-09-10T07:39:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1634600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f162c15d3b0 con 0x7f162c0ce460 2024-09-10T07:39:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1634600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f162c15d690 con 0x7f162c06ecf0 2024-09-10T07:39:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1631c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f162c0ce460 0x7f162c0cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1631c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f162c0ce460 0x7f162c0cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47892/0 (socket says 172.21.15.99:47892) 2024-09-10T07:39:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1631c00640 1 -- 172.21.15.99:0/1982019417 learned_addr learned my addr 172.21.15.99:0/1982019417 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1632600640 1 --2- 172.21.15.99:0/1982019417 >> v2:172.21.15.187:3300/0 conn(0x7f162c06ecf0 0x7f162c15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1631c00640 1 -- 172.21.15.99:0/1982019417 >> v2:172.21.15.187:3300/0 conn(0x7f162c06ecf0 msgr2=0x7f162c15e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1631c00640 1 --2- 172.21.15.99:0/1982019417 >> v2:172.21.15.187:3300/0 conn(0x7f162c06ecf0 0x7f162c15e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1631c00640 1 -- 172.21.15.99:0/1982019417 >> v1:172.21.15.187:6789/0 conn(0x7f162c0d0420 legacy=0x7f162c06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.182+0000 7f1631c00640 1 -- 172.21.15.99:0/1982019417 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162c15d970 con 0x7f162c0ce460 2024-09-10T07:39:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.183+0000 7f1631c00640 1 --2- 172.21.15.99:0/1982019417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c0ce460 0x7f162c0cfee0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f162c0b33b0 tx=0x7f162002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4457c577ab6c87be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f162be00640 1 -- 172.21.15.99:0/1982019417 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620037070 con 0x7f162c0ce460 2024-09-10T07:39:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f162be00640 1 -- 172.21.15.99:0/1982019417 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1620032440 con 0x7f162c0ce460 2024-09-10T07:39:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f162be00640 1 -- 172.21.15.99:0/1982019417 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620032810 con 0x7f162c0ce460 2024-09-10T07:39:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f1634600640 1 -- 172.21.15.99:0/1982019417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c0ce460 msgr2=0x7f162c0cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f1634600640 1 --2- 172.21.15.99:0/1982019417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c0ce460 0x7f162c0cfee0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f162c0b33b0 tx=0x7f162002a230 comp rx=0 tx=0).stop 2024-09-10T07:39:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f1634600640 1 -- 172.21.15.99:0/1982019417 shutdown_connections 2024-09-10T07:39:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f1634600640 1 --2- 172.21.15.99:0/1982019417 >> v2:172.21.15.187:3300/0 conn(0x7f162c06ecf0 0x7f162c15e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f1634600640 1 --2- 172.21.15.99:0/1982019417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c0ce460 0x7f162c0cfee0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f1634600640 1 -- 172.21.15.99:0/1982019417 >> 172.21.15.99:0/1982019417 conn(0x7f162c0b26a0 msgr2=0x7f162c0b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f1634600640 1 -- 172.21.15.99:0/1982019417 shutdown_connections 2024-09-10T07:39:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.184+0000 7f1634600640 1 -- 172.21.15.99:0/1982019417 wait complete. 2024-09-10T07:39:42.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.186+0000 7f1634600640 1 Processor -- start 2024-09-10T07:39:42.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.186+0000 7f1634600640 1 -- start start 2024-09-10T07:39:42.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1634600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06ecf0 0x7f162c14e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:42.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1634600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c0ce460 0x7f162c14e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:42.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1634600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c0d0420 0x7f162c14ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:42.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1634600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f162c15cfd0 con 0x7f162c06ecf0 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1634600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f162c0ce840 con 0x7f162c0ce460 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1634600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f162c15d150 con 0x7f162c0d0420 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1631c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06ecf0 0x7f162c14e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1631c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06ecf0 0x7f162c14e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47906/0 (socket says 172.21.15.99:47906) 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1631c00640 1 -- 172.21.15.99:0/1862809735 learned_addr learned my addr 172.21.15.99:0/1862809735 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1632600640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c0d0420 0x7f162c14ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.187+0000 7f1631200640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c0ce460 0x7f162c14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1631c00640 1 -- 172.21.15.99:0/1862809735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c0d0420 msgr2=0x7f162c14ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1631c00640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c0d0420 0x7f162c14ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1631c00640 1 -- 172.21.15.99:0/1862809735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c0ce460 msgr2=0x7f162c14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1631c00640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c0ce460 0x7f162c14e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1631c00640 1 -- 172.21.15.99:0/1862809735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162c14efc0 con 0x7f162c06ecf0 2024-09-10T07:39:42.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1631200640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c0ce460 0x7f162c14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1631c00640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06ecf0 0x7f162c14e000 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1620000c00 tx=0x7f16200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1629600640 1 -- 172.21.15.99:0/1862809735 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620041020 con 0x7f162c06ecf0 2024-09-10T07:39:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1629600640 1 -- 172.21.15.99:0/1862809735 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16200306c0 con 0x7f162c06ecf0 2024-09-10T07:39:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1629600640 1 -- 172.21.15.99:0/1862809735 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620037040 con 0x7f162c06ecf0 2024-09-10T07:39:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1634600640 1 -- 172.21.15.99:0/1862809735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f162c13f6a0 con 0x7f162c06ecf0 2024-09-10T07:39:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.188+0000 7f1634600640 1 -- 172.21.15.99:0/1862809735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f162c14d520 con 0x7f162c06ecf0 2024-09-10T07:39:42.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.189+0000 7f1634600640 1 -- 172.21.15.99:0/1862809735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f162c0b2480 con 0x7f162c06ecf0 2024-09-10T07:39:42.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.190+0000 7f1629600640 1 -- 172.21.15.99:0/1862809735 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1620044020 con 0x7f162c06ecf0 2024-09-10T07:39:42.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.191+0000 7f1629600640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f160c06be30 0x7f160c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:42.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.191+0000 7f1629600640 1 -- 172.21.15.99:0/1862809735 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5386+0+0 (secure 0 0 0) 0x7f16200ab570 con 0x7f162c06ecf0 2024-09-10T07:39:42.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.191+0000 7f1631200640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f160c06be30 0x7f160c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:42.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.192+0000 7f1631200640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f160c06be30 0x7f160c06e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f162c0b0af0 tx=0x7f1618008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:42.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.196+0000 7f1629600640 1 -- 172.21.15.99:0/1862809735 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f162c0b2480 con 0x7f162c06ecf0 2024-09-10T07:39:42.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:42.369+0000 7f1634600640 1 -- 172.21.15.99:0/1862809735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f162c0cfee0 con 0x7f162c06ecf0 2024-09-10T07:39:43.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.003+0000 7f1629600640 1 -- 172.21.15.99:0/1862809735 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) ==== 169+0+0 (secure 0 0 0) 0x7f162004b030 con 0x7f162c06ecf0 2024-09-10T07:39:43.003 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:39:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.006+0000 7f1634600640 1 -- 172.21.15.99:0/1862809735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f160c06be30 msgr2=0x7f160c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.006+0000 7f1634600640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f160c06be30 0x7f160c06e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f162c0b0af0 tx=0x7f1618008040 comp rx=0 tx=0).stop 2024-09-10T07:39:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.006+0000 7f1634600640 1 -- 172.21.15.99:0/1862809735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06ecf0 msgr2=0x7f162c14e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.006+0000 7f1634600640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06ecf0 0x7f162c14e000 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1620000c00 tx=0x7f16200046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.006+0000 7f1634600640 1 -- 172.21.15.99:0/1862809735 shutdown_connections 2024-09-10T07:39:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.007+0000 7f1634600640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f162c0d0420 0x7f162c14ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.007+0000 7f1634600640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f162c0ce460 0x7f162c14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.007+0000 7f1634600640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f160c06be30 0x7f160c06e2f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.007+0000 7f1634600640 1 --2- 172.21.15.99:0/1862809735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06ecf0 0x7f162c14e000 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.007+0000 7f1634600640 1 -- 172.21.15.99:0/1862809735 >> 172.21.15.99:0/1862809735 conn(0x7f162c0b26a0 msgr2=0x7f162c160200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.007+0000 7f1634600640 1 -- 172.21.15.99:0/1862809735 shutdown_connections 2024-09-10T07:39:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.007+0000 7f1634600640 1 -- 172.21.15.99:0/1862809735 wait complete. 2024-09-10T07:39:43.024 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T07:39:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.179+0000 7fb4b3000640 1 Processor -- start 2024-09-10T07:39:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.179+0000 7fb4b3000640 1 -- start start 2024-09-10T07:39:43.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.180+0000 7fb4b3000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb4ac15c670 0x7fb4ac0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.180+0000 7fb4b3000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb4ac06deb0 0x7fb4ac160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.180+0000 7fb4b3000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4ac0b6a60 con 0x7fb4ac15f1a0 2024-09-10T07:39:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.180+0000 7fb4b3000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb4ac0b6d40 con 0x7fb4ac15c670 2024-09-10T07:39:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.180+0000 7fb4b3000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb4ac0b7020 con 0x7fb4ac06deb0 2024-09-10T07:39:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.180+0000 7fb4abe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb4ac15c670 0x7fb4ac0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.180+0000 7fb4a3400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb4ac15f1a0 0x7fb4ac06d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45686/0 (socket says 172.21.15.99:45686) 2024-09-10T07:39:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.180+0000 7fb4a3400640 1 -- 172.21.15.99:0/3739720135 learned_addr learned my addr 172.21.15.99:0/3739720135 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.181+0000 7fb4b1000640 1 --2- 172.21.15.99:0/3739720135 >> v2:172.21.15.187:3300/0 conn(0x7fb4ac06deb0 0x7fb4ac160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.181+0000 7fb4abe00640 1 -- 172.21.15.99:0/3739720135 >> v2:172.21.15.187:3300/0 conn(0x7fb4ac06deb0 msgr2=0x7fb4ac160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:43.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.181+0000 7fb4abe00640 1 --2- 172.21.15.99:0/3739720135 >> v2:172.21.15.187:3300/0 conn(0x7fb4ac06deb0 0x7fb4ac160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.181+0000 7fb4abe00640 1 -- 172.21.15.99:0/3739720135 >> v1:172.21.15.99:6789/0 conn(0x7fb4ac15f1a0 legacy=0x7fb4ac06d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.181+0000 7fb4abe00640 1 -- 172.21.15.99:0/3739720135 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ac0b7300 con 0x7fb4ac15c670 2024-09-10T07:39:43.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.181+0000 7fb4b1000640 1 --2- 172.21.15.99:0/3739720135 >> v2:172.21.15.187:3300/0 conn(0x7fb4ac06deb0 0x7fb4ac160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:43.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.182+0000 7fb4abe00640 1 --2- 172.21.15.99:0/3739720135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac15c670 0x7fb4ac0b6410 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0b5ca0 tx=0x7fb49c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4eb61359ecc36ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:43.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.182+0000 7fb4ab400640 1 -- 172.21.15.99:0/3739720135 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c007740 con 0x7fb4ac15c670 2024-09-10T07:39:43.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.182+0000 7fb4ab400640 1 -- 172.21.15.99:0/3739720135 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49c0078e0 con 0x7fb4ac15c670 2024-09-10T07:39:43.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.182+0000 7fb4ab400640 1 -- 172.21.15.99:0/3739720135 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c007cb0 con 0x7fb4ac15c670 2024-09-10T07:39:43.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.183+0000 7fb4b3000640 1 -- 172.21.15.99:0/3739720135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac15c670 msgr2=0x7fb4ac0b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.183+0000 7fb4b3000640 1 --2- 172.21.15.99:0/3739720135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac15c670 0x7fb4ac0b6410 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0b5ca0 tx=0x7fb49c02a680 comp rx=0 tx=0).stop 2024-09-10T07:39:43.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.183+0000 7fb4b3000640 1 -- 172.21.15.99:0/3739720135 shutdown_connections 2024-09-10T07:39:43.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.183+0000 7fb4b3000640 1 --2- 172.21.15.99:0/3739720135 >> v2:172.21.15.187:3300/0 conn(0x7fb4ac06deb0 0x7fb4ac160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.183+0000 7fb4b3000640 1 --2- 172.21.15.99:0/3739720135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac15c670 0x7fb4ac0b6410 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.183+0000 7fb4b3000640 1 -- 172.21.15.99:0/3739720135 >> 172.21.15.99:0/3739720135 conn(0x7fb4ac09b9d0 msgr2=0x7fb4ac09bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:43.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.183+0000 7fb4b3000640 1 -- 172.21.15.99:0/3739720135 shutdown_connections 2024-09-10T07:39:43.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.183+0000 7fb4b3000640 1 -- 172.21.15.99:0/3739720135 wait complete. 2024-09-10T07:39:43.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.184+0000 7fb4b3000640 1 Processor -- start 2024-09-10T07:39:43.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.185+0000 7fb4b3000640 1 -- start start 2024-09-10T07:39:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.185+0000 7fb4b3000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac06deb0 0x7fb4ac070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.185+0000 7fb4b3000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4ac15c670 0x7fb4ac0cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.185+0000 7fb4b3000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac15f1a0 0x7fb4ac0cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.185+0000 7fb4b3000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ac0b7b00 con 0x7fb4ac06deb0 2024-09-10T07:39:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.185+0000 7fb4b3000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ac09c560 con 0x7fb4ac15f1a0 2024-09-10T07:39:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.185+0000 7fb4b3000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb4ac0cbcf0 con 0x7fb4ac15c670 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4abe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac06deb0 0x7fb4ac070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4abe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac06deb0 0x7fb4ac070c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47924/0 (socket says 172.21.15.99:47924) 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4abe00640 1 -- 172.21.15.99:0/508289853 learned_addr learned my addr 172.21.15.99:0/508289853 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4b1000640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac15f1a0 0x7fb4ac0cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4a3400640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4ac15c670 0x7fb4ac0cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4abe00640 1 -- 172.21.15.99:0/508289853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4ac15c670 msgr2=0x7fb4ac0cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4abe00640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4ac15c670 0x7fb4ac0cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4abe00640 1 -- 172.21.15.99:0/508289853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac15f1a0 msgr2=0x7fb4ac0cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4abe00640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac15f1a0 0x7fb4ac0cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4abe00640 1 -- 172.21.15.99:0/508289853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ac0ce2a0 con 0x7fb4ac06deb0 2024-09-10T07:39:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4b1000640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac15f1a0 0x7fb4ac0cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.186+0000 7fb4abe00640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac06deb0 0x7fb4ac070c10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009e80 tx=0x7fb49c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.187+0000 7fb4a8c00640 1 -- 172.21.15.99:0/508289853 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c040070 con 0x7fb4ac06deb0 2024-09-10T07:39:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.187+0000 7fb4a8c00640 1 -- 172.21.15.99:0/508289853 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49c031c40 con 0x7fb4ac06deb0 2024-09-10T07:39:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.187+0000 7fb4a8c00640 1 -- 172.21.15.99:0/508289853 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c03c420 con 0x7fb4ac06deb0 2024-09-10T07:39:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.187+0000 7fb4b3000640 1 -- 172.21.15.99:0/508289853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ac0ccd00 con 0x7fb4ac06deb0 2024-09-10T07:39:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.187+0000 7fb4b3000640 1 -- 172.21.15.99:0/508289853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ac0cc220 con 0x7fb4ac06deb0 2024-09-10T07:39:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.188+0000 7fb4b3000640 1 -- 172.21.15.99:0/508289853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4ac15ca50 con 0x7fb4ac06deb0 2024-09-10T07:39:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.189+0000 7fb4a8c00640 1 -- 172.21.15.99:0/508289853 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb49c039040 con 0x7fb4ac06deb0 2024-09-10T07:39:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.189+0000 7fb4a8c00640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb48806be30 0x7fb48806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.189+0000 7fb4a8c00640 1 -- 172.21.15.99:0/508289853 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7fb49c0ac270 con 0x7fb4ac06deb0 2024-09-10T07:39:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.190+0000 7fb4a3400640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb48806be30 0x7fb48806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.190+0000 7fb4a3400640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb48806be30 0x7fb48806e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac1560a0 tx=0x7fb494009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:43.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.194+0000 7fb4a8c00640 1 -- 172.21.15.99:0/508289853 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb49c07af10 con 0x7fb4ac06deb0 2024-09-10T07:39:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.366+0000 7fb4b3000640 1 -- 172.21.15.99:0/508289853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb4ac15ec70 con 0x7fb4ac06deb0 2024-09-10T07:39:43.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.370+0000 7fb4a8c00640 1 -- 172.21.15.99:0/508289853 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fb49c0aae20 con 0x7fb4ac06deb0 2024-09-10T07:39:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 -- 172.21.15.99:0/508289853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb48806be30 msgr2=0x7fb48806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb48806be30 0x7fb48806e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac1560a0 tx=0x7fb494009040 comp rx=0 tx=0).stop 2024-09-10T07:39:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 -- 172.21.15.99:0/508289853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac06deb0 msgr2=0x7fb4ac070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac06deb0 0x7fb4ac070c10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009e80 tx=0x7fb49c004a40 comp rx=0 tx=0).stop 2024-09-10T07:39:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 -- 172.21.15.99:0/508289853 shutdown_connections 2024-09-10T07:39:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac15f1a0 0x7fb4ac0cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4ac15c670 0x7fb4ac0cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb48806be30 0x7fb48806e2f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 --2- 172.21.15.99:0/508289853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4ac06deb0 0x7fb4ac070c10 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 -- 172.21.15.99:0/508289853 >> 172.21.15.99:0/508289853 conn(0x7fb4ac09b9d0 msgr2=0x7fb4ac162750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:43.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 -- 172.21.15.99:0/508289853 shutdown_connections 2024-09-10T07:39:43.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.373+0000 7fb4b3000640 1 -- 172.21.15.99:0/508289853 wait complete. 2024-09-10T07:39:43.389 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-10T07:39:43.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.542+0000 7faa7ac00640 1 Processor -- start 2024-09-10T07:39:43.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.542+0000 7faa7ac00640 1 -- start start 2024-09-10T07:39:43.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.543+0000 7faa7ac00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa740d2ea0 0x7faa740d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.543+0000 7faa7ac00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa74162550 0x7faa740b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.543+0000 7faa7ac00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa740d04e0 con 0x7faa740d37c0 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.543+0000 7faa7ac00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7faa740b45a0 con 0x7faa740d2ea0 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.543+0000 7faa7ac00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faa740d07c0 con 0x7faa74162550 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.543+0000 7faa73e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa740d2ea0 0x7faa740d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.543+0000 7faa73400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faa740d37c0 0x7faa74161e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45700/0 (socket says 172.21.15.99:45700) 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.543+0000 7faa73400640 1 -- 172.21.15.99:0/4005085164 learned_addr learned my addr 172.21.15.99:0/4005085164 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.544+0000 7faa78c00640 1 --2- 172.21.15.99:0/4005085164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa74162550 0x7faa740b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.544+0000 7faa73e00640 1 -- 172.21.15.99:0/4005085164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa74162550 msgr2=0x7faa740b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.544+0000 7faa73e00640 1 --2- 172.21.15.99:0/4005085164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa74162550 0x7faa740b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.544+0000 7faa73e00640 1 -- 172.21.15.99:0/4005085164 >> v1:172.21.15.99:6789/0 conn(0x7faa740d37c0 legacy=0x7faa74161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.544+0000 7faa73e00640 1 -- 172.21.15.99:0/4005085164 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740d0aa0 con 0x7faa740d2ea0 2024-09-10T07:39:43.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.544+0000 7faa72a00640 1 -- 172.21.15.99:0/4005085164 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145097465 0 0) 0x7faa740d04e0 con 0x7faa740d37c0 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.545+0000 7faa73e00640 1 --2- 172.21.15.99:0/4005085164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d2ea0 0x7faa740d3280 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7faa640097a0 tx=0x7faa6402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0ee949fbb2abad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.545+0000 7faa72a00640 1 -- 172.21.15.99:0/4005085164 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64037070 con 0x7faa740d2ea0 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.545+0000 7faa72a00640 1 -- 172.21.15.99:0/4005085164 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa64032440 con 0x7faa740d2ea0 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.545+0000 7faa72a00640 1 -- 172.21.15.99:0/4005085164 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64032810 con 0x7faa740d2ea0 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.545+0000 7faa7ac00640 1 -- 172.21.15.99:0/4005085164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d2ea0 msgr2=0x7faa740d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.545+0000 7faa7ac00640 1 --2- 172.21.15.99:0/4005085164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d2ea0 0x7faa740d3280 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7faa640097a0 tx=0x7faa6402a180 comp rx=0 tx=0).stop 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.546+0000 7faa7ac00640 1 -- 172.21.15.99:0/4005085164 shutdown_connections 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.546+0000 7faa7ac00640 1 --2- 172.21.15.99:0/4005085164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa74162550 0x7faa740b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.546+0000 7faa7ac00640 1 --2- 172.21.15.99:0/4005085164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d2ea0 0x7faa740d3280 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.546+0000 7faa7ac00640 1 -- 172.21.15.99:0/4005085164 >> 172.21.15.99:0/4005085164 conn(0x7faa740d4bb0 msgr2=0x7faa740d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.546+0000 7faa7ac00640 1 -- 172.21.15.99:0/4005085164 shutdown_connections 2024-09-10T07:39:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.546+0000 7faa7ac00640 1 -- 172.21.15.99:0/4005085164 wait complete. 2024-09-10T07:39:43.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.547+0000 7faa7ac00640 1 Processor -- start 2024-09-10T07:39:43.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.547+0000 7faa7ac00640 1 -- start start 2024-09-10T07:39:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.548+0000 7faa7ac00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa740d2ea0 0x7faa7415e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.548+0000 7faa7ac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d37c0 0x7faa741f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.548+0000 7faa7ac00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa74162550 0x7faa740cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.548+0000 7faa7ac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faa740d5850 con 0x7faa740d37c0 2024-09-10T07:39:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.548+0000 7faa7ac00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faa740d56d0 con 0x7faa74162550 2024-09-10T07:39:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.548+0000 7faa7ac00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faa740d59d0 con 0x7faa740d2ea0 2024-09-10T07:39:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d37c0 0x7faa741f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d37c0 0x7faa741f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47952/0 (socket says 172.21.15.99:47952) 2024-09-10T07:39:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73400640 1 -- 172.21.15.99:0/1541732029 learned_addr learned my addr 172.21.15.99:0/1541732029 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:43.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa78c00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa74162550 0x7faa740cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73e00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa740d2ea0 0x7faa7415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73400640 1 -- 172.21.15.99:0/1541732029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa740d2ea0 msgr2=0x7faa7415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73400640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa740d2ea0 0x7faa7415e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73400640 1 -- 172.21.15.99:0/1541732029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa74162550 msgr2=0x7faa740cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73400640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa74162550 0x7faa740cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73400640 1 -- 172.21.15.99:0/1541732029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa741f5720 con 0x7faa740d37c0 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa78c00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa74162550 0x7faa740cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73e00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa740d2ea0 0x7faa7415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa73400640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d37c0 0x7faa741f51e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c4d0 tx=0x7faa6000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.549+0000 7faa6be00640 1 -- 172.21.15.99:0/1541732029 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60018070 con 0x7faa740d37c0 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.550+0000 7faa6be00640 1 -- 172.21.15.99:0/1541732029 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa60007500 con 0x7faa740d37c0 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.550+0000 7faa6be00640 1 -- 172.21.15.99:0/1541732029 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60004a20 con 0x7faa740d37c0 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.550+0000 7faa7ac00640 1 -- 172.21.15.99:0/1541732029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa740c8880 con 0x7faa740d37c0 2024-09-10T07:39:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.550+0000 7faa7ac00640 1 -- 172.21.15.99:0/1541732029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa740b2da0 con 0x7faa740d37c0 2024-09-10T07:39:43.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.551+0000 7faa7ac00640 1 -- 172.21.15.99:0/1541732029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa7406d540 con 0x7faa740d37c0 2024-09-10T07:39:43.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.552+0000 7faa6be00640 1 -- 172.21.15.99:0/1541732029 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa60004bc0 con 0x7faa740d37c0 2024-09-10T07:39:43.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.553+0000 7faa6be00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faa5406be30 0x7faa5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:43.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.553+0000 7faa6be00640 1 -- 172.21.15.99:0/1541732029 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7faa60089d70 con 0x7faa740d37c0 2024-09-10T07:39:43.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.553+0000 7faa73e00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faa5406be30 0x7faa5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:43.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.554+0000 7faa73e00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faa5406be30 0x7faa5406e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faa64034000 tx=0x7faa6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:43.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.558+0000 7faa6be00640 1 -- 172.21.15.99:0/1541732029 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa7406d540 con 0x7faa740d37c0 2024-09-10T07:39:43.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:43.795+0000 7faa7ac00640 1 -- 172.21.15.99:0/1541732029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) -- 0x7faa740ca240 con 0x7faa740d37c0 2024-09-10T07:39:44.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.005+0000 7faa6be00640 1 -- 172.21.15.99:0/1541732029 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v281) ==== 137+0+0 (secure 0 0 0) 0x7faa741f5720 con 0x7faa740d37c0 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 -- 172.21.15.99:0/1541732029 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faa5406be30 msgr2=0x7faa5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faa5406be30 0x7faa5406e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faa64034000 tx=0x7faa6402e000 comp rx=0 tx=0).stop 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 -- 172.21.15.99:0/1541732029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d37c0 msgr2=0x7faa741f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d37c0 0x7faa741f51e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c4d0 tx=0x7faa6000c990 comp rx=0 tx=0).stop 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 -- 172.21.15.99:0/1541732029 shutdown_connections 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa74162550 0x7faa740cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faa5406be30 0x7faa5406e2f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa740d37c0 0x7faa741f51e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 --2- 172.21.15.99:0/1541732029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa740d2ea0 0x7faa7415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 -- 172.21.15.99:0/1541732029 >> 172.21.15.99:0/1541732029 conn(0x7faa740d4bb0 msgr2=0x7faa740b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 -- 172.21.15.99:0/1541732029 shutdown_connections 2024-09-10T07:39:44.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.007+0000 7faa7ac00640 1 -- 172.21.15.99:0/1541732029 wait complete. 2024-09-10T07:39:44.023 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-10T07:39:44.023 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-10T07:39:44.023 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2024-09-10T07:39:44.024 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:39:44.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.177+0000 7fd957000640 1 Processor -- start 2024-09-10T07:39:44.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.178+0000 7fd957000640 1 -- start start 2024-09-10T07:39:44.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.179+0000 7fd957000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd950072f40 0x7fd95006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.179+0000 7fd957000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd9500ce780 0x7fd9500b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.179+0000 7fd957000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95006e3d0 con 0x7fd950145290 2024-09-10T07:39:44.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.179+0000 7fd957000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd95006efe0 con 0x7fd9500ce780 2024-09-10T07:39:44.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.179+0000 7fd957000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd95006e6b0 con 0x7fd950072f40 2024-09-10T07:39:44.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.179+0000 7fd955000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd9500ce780 0x7fd9500b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.179+0000 7fd955000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd9500ce780 0x7fd9500b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47968/0 (socket says 172.21.15.99:47968) 2024-09-10T07:39:44.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.179+0000 7fd955000640 1 -- 172.21.15.99:0/278372250 learned_addr learned my addr 172.21.15.99:0/278372250 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:44.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.179+0000 7fd94f400640 1 --2- 172.21.15.99:0/278372250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd950072f40 0x7fd95006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.179+0000 7fd955000640 1 -- 172.21.15.99:0/278372250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd950072f40 msgr2=0x7fd95006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:44.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.180+0000 7fd955000640 1 --2- 172.21.15.99:0/278372250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd950072f40 0x7fd95006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.180+0000 7fd955000640 1 -- 172.21.15.99:0/278372250 >> v1:172.21.15.99:6789/0 conn(0x7fd950145290 legacy=0x7fd950072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.180+0000 7fd955000640 1 -- 172.21.15.99:0/278372250 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95006e990 con 0x7fd9500ce780 2024-09-10T07:39:44.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.180+0000 7fd955000640 1 --2- 172.21.15.99:0/278372250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 0x7fd9500b3930 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd948009e50 tx=0x7fd94802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f8eda3d9936eed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.181+0000 7fd94ea00640 1 -- 172.21.15.99:0/278372250 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948032610 con 0x7fd9500ce780 2024-09-10T07:39:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.181+0000 7fd94ea00640 1 -- 172.21.15.99:0/278372250 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd948037070 con 0x7fd9500ce780 2024-09-10T07:39:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.181+0000 7fd94ea00640 1 -- 172.21.15.99:0/278372250 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9480329d0 con 0x7fd9500ce780 2024-09-10T07:39:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.181+0000 7fd957000640 1 -- 172.21.15.99:0/278372250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 msgr2=0x7fd9500b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.181+0000 7fd957000640 1 --2- 172.21.15.99:0/278372250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 0x7fd9500b3930 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd948009e50 tx=0x7fd94802c920 comp rx=0 tx=0).stop 2024-09-10T07:39:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.181+0000 7fd957000640 1 -- 172.21.15.99:0/278372250 shutdown_connections 2024-09-10T07:39:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.181+0000 7fd957000640 1 --2- 172.21.15.99:0/278372250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 0x7fd9500b3930 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.181+0000 7fd957000640 1 --2- 172.21.15.99:0/278372250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd950072f40 0x7fd95006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.181+0000 7fd957000640 1 -- 172.21.15.99:0/278372250 >> 172.21.15.99:0/278372250 conn(0x7fd95006bc10 msgr2=0x7fd95006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.182+0000 7fd957000640 1 -- 172.21.15.99:0/278372250 shutdown_connections 2024-09-10T07:39:44.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.182+0000 7fd957000640 1 -- 172.21.15.99:0/278372250 wait complete. 2024-09-10T07:39:44.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.183+0000 7fd957000640 1 Processor -- start 2024-09-10T07:39:44.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.183+0000 7fd957000640 1 -- start start 2024-09-10T07:39:44.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.184+0000 7fd957000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd950072f40 0x7fd9501e5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.184+0000 7fd957000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 0x7fd9501428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.184+0000 7fd957000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd950145290 0x7fd95015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.184+0000 7fd957000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd95006df80 con 0x7fd9500ce780 2024-09-10T07:39:44.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.184+0000 7fd957000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd950145670 con 0x7fd950145290 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.184+0000 7fd957000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd95006e100 con 0x7fd950072f40 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.184+0000 7fd94f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 0x7fd9501428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd94f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 0x7fd9501428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47980/0 (socket says 172.21.15.99:47980) 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd94f400640 1 -- 172.21.15.99:0/156619916 learned_addr learned my addr 172.21.15.99:0/156619916 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd94fe00640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd950072f40 0x7fd9501e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd955000640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd950145290 0x7fd95015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd94f400640 1 -- 172.21.15.99:0/156619916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd950072f40 msgr2=0x7fd9501e5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd94f400640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd950072f40 0x7fd9501e5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd94f400640 1 -- 172.21.15.99:0/156619916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd950145290 msgr2=0x7fd95015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd94f400640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd950145290 0x7fd95015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd94f400640 1 -- 172.21.15.99:0/156619916 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd950142de0 con 0x7fd9500ce780 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd955000640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd950145290 0x7fd95015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd94f400640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 0x7fd9501428a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00d5d0 tx=0x7fd93c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:44.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd947e00640 1 -- 172.21.15.99:0/156619916 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0125f0 con 0x7fd9500ce780 2024-09-10T07:39:44.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.185+0000 7fd947e00640 1 -- 172.21.15.99:0/156619916 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c019070 con 0x7fd9500ce780 2024-09-10T07:39:44.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.186+0000 7fd957000640 1 -- 172.21.15.99:0/156619916 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95015b990 con 0x7fd9500ce780 2024-09-10T07:39:44.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.186+0000 7fd947e00640 1 -- 172.21.15.99:0/156619916 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0129b0 con 0x7fd9500ce780 2024-09-10T07:39:44.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.186+0000 7fd957000640 1 -- 172.21.15.99:0/156619916 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9501e5ee0 con 0x7fd9500ce780 2024-09-10T07:39:44.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.187+0000 7fd957000640 1 -- 172.21.15.99:0/156619916 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd950071510 con 0x7fd9500ce780 2024-09-10T07:39:44.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.188+0000 7fd947e00640 1 -- 172.21.15.99:0/156619916 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd93c012b50 con 0x7fd9500ce780 2024-09-10T07:39:44.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.188+0000 7fd947e00640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd93006be30 0x7fd93006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.188+0000 7fd947e00640 1 -- 172.21.15.99:0/156619916 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7fd93c08af00 con 0x7fd9500ce780 2024-09-10T07:39:44.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.189+0000 7fd94fe00640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd93006be30 0x7fd93006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.189+0000 7fd94fe00640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd93006be30 0x7fd93006e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd95015edb0 tx=0x7fd940009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:44.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.193+0000 7fd947e00640 1 -- 172.21.15.99:0/156619916 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd93c059b20 con 0x7fd9500ce780 2024-09-10T07:39:44.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.366+0000 7fd957000640 1 -- 172.21.15.99:0/156619916 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9500d0070 con 0x7fd9500ce780 2024-09-10T07:39:44.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.367+0000 7fd947e00640 1 -- 172.21.15.99:0/156619916 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+13012 (secure 0 0 0) 0x7fd93c059420 con 0x7fd9500ce780 2024-09-10T07:39:44.367 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:44.368 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":116,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:39:42.998558+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6835/1858150570":"2024-09-11T07:39:39.772243+0000","172.21.15.99:6834/1858150570":"2024-09-11T07:39:39.772243+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:39:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.369+0000 7fd957000640 1 -- 172.21.15.99:0/156619916 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd93006be30 msgr2=0x7fd93006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.369+0000 7fd957000640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd93006be30 0x7fd93006e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd95015edb0 tx=0x7fd940009040 comp rx=0 tx=0).stop 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.369+0000 7fd957000640 1 -- 172.21.15.99:0/156619916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 msgr2=0x7fd9501428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.369+0000 7fd957000640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 0x7fd9501428a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00d5d0 tx=0x7fd93c00da90 comp rx=0 tx=0).stop 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.370+0000 7fd957000640 1 -- 172.21.15.99:0/156619916 shutdown_connections 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.370+0000 7fd957000640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd950145290 0x7fd95015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.370+0000 7fd957000640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd93006be30 0x7fd93006e2f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.370+0000 7fd957000640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9500ce780 0x7fd9501428a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.370+0000 7fd957000640 1 --2- 172.21.15.99:0/156619916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd950072f40 0x7fd9501e5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.370+0000 7fd957000640 1 -- 172.21.15.99:0/156619916 >> 172.21.15.99:0/156619916 conn(0x7fd95006bc10 msgr2=0x7fd9500cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.370+0000 7fd957000640 1 -- 172.21.15.99:0/156619916 shutdown_connections 2024-09-10T07:39:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.370+0000 7fd957000640 1 -- 172.21.15.99:0/156619916 wait complete. 2024-09-10T07:39:44.386 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:34:08.744575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:39:44.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:39:44.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.542+0000 7fea9ee00640 1 Processor -- start 2024-09-10T07:39:44.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.542+0000 7fea9ee00640 1 -- start start 2024-09-10T07:39:44.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.543+0000 7fea9ee00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fea98071df0 0x7fea98073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea9ee00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea980722d0 con 0x7fea980d1010 2024-09-10T07:39:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea9ee00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea980725b0 con 0x7fea9806e280 2024-09-10T07:39:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea9ee00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fea980738b0 con 0x7fea98071df0 2024-09-10T07:39:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea97400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fea98071df0 0x7fea98073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea97400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fea98071df0 0x7fea98073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47984/0 (socket says 172.21.15.99:47984) 2024-09-10T07:39:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea97400640 1 -- 172.21.15.99:0/3163283130 learned_addr learned my addr 172.21.15.99:0/3163283130 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:44.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea9ce00640 1 --1- 172.21.15.99:0/3163283130 >> v1:172.21.15.99:6789/0 conn(0x7fea980d1010 0x7fea980ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45724/0 (socket says 172.21.15.99:45724) 2024-09-10T07:39:44.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea97400640 1 -- 172.21.15.99:0/3163283130 >> v1:172.21.15.187:6789/0 conn(0x7fea9806e280 legacy=0x7fea9806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea97400640 1 -- 172.21.15.99:0/3163283130 >> v1:172.21.15.99:6789/0 conn(0x7fea980d1010 legacy=0x7fea980ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea97400640 1 -- 172.21.15.99:0/3163283130 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea98072890 con 0x7fea98071df0 2024-09-10T07:39:44.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.544+0000 7fea96a00640 1 -- 172.21.15.99:0/3163283130 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2008790994 0 0) 0x7fea980722d0 con 0x7fea980d1010 2024-09-10T07:39:44.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.545+0000 7fea97400640 1 --2- 172.21.15.99:0/3163283130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea98071df0 0x7fea98073370 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fea84009870 tx=0x7fea8402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e931e195ef25c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.545+0000 7fea96a00640 1 -- 172.21.15.99:0/3163283130 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84037070 con 0x7fea98071df0 2024-09-10T07:39:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.545+0000 7fea96a00640 1 -- 172.21.15.99:0/3163283130 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8402ae50 con 0x7fea98071df0 2024-09-10T07:39:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.546+0000 7fea96a00640 1 -- 172.21.15.99:0/3163283130 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84032860 con 0x7fea98071df0 2024-09-10T07:39:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.546+0000 7fea9ee00640 1 -- 172.21.15.99:0/3163283130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea98071df0 msgr2=0x7fea98073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.546+0000 7fea9ee00640 1 --2- 172.21.15.99:0/3163283130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea98071df0 0x7fea98073370 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fea84009870 tx=0x7fea8402a300 comp rx=0 tx=0).stop 2024-09-10T07:39:44.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.546+0000 7fea9ee00640 1 -- 172.21.15.99:0/3163283130 shutdown_connections 2024-09-10T07:39:44.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.546+0000 7fea9ee00640 1 --2- 172.21.15.99:0/3163283130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea98071df0 0x7fea98073370 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.546+0000 7fea9ee00640 1 -- 172.21.15.99:0/3163283130 >> 172.21.15.99:0/3163283130 conn(0x7fea9806bc10 msgr2=0x7fea9806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:44.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.546+0000 7fea9ee00640 1 -- 172.21.15.99:0/3163283130 shutdown_connections 2024-09-10T07:39:44.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.546+0000 7fea9ee00640 1 -- 172.21.15.99:0/3163283130 wait complete. 2024-09-10T07:39:44.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.548+0000 7fea9ee00640 1 Processor -- start 2024-09-10T07:39:44.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.548+0000 7fea9ee00640 1 -- start start 2024-09-10T07:39:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea9ee00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9806e280 0x7fea98157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea9ee00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea98071df0 0x7fea9815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea9ee00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea980d1010 0x7fea9815f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea9ee00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fea9815db60 con 0x7fea9806e280 2024-09-10T07:39:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea9ee00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fea98072e50 con 0x7fea980d1010 2024-09-10T07:39:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea9ee00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fea980d14c0 con 0x7fea98071df0 2024-09-10T07:39:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea97e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9806e280 0x7fea98157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea97e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9806e280 0x7fea98157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47994/0 (socket says 172.21.15.99:47994) 2024-09-10T07:39:44.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea97e00640 1 -- 172.21.15.99:0/3861914244 learned_addr learned my addr 172.21.15.99:0/3861914244 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea97400640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea98071df0 0x7fea9815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea9ce00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea980d1010 0x7fea9815f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea97e00640 1 -- 172.21.15.99:0/3861914244 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea98071df0 msgr2=0x7fea9815ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea97e00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea98071df0 0x7fea9815ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea97e00640 1 -- 172.21.15.99:0/3861914244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea980d1010 msgr2=0x7fea9815f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.549+0000 7fea97e00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea980d1010 0x7fea9815f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.550+0000 7fea97e00640 1 -- 172.21.15.99:0/3861914244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea980ae0b0 con 0x7fea9806e280 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.550+0000 7fea9ce00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea980d1010 0x7fea9815f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.550+0000 7fea97e00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9806e280 0x7fea98157ea0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fea8800c480 tx=0x7fea8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.550+0000 7fea8fe00640 1 -- 172.21.15.99:0/3861914244 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea880052d0 con 0x7fea9806e280 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.550+0000 7fea8fe00640 1 -- 172.21.15.99:0/3861914244 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea88005470 con 0x7fea9806e280 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.550+0000 7fea9ee00640 1 -- 172.21.15.99:0/3861914244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea980ad010 con 0x7fea9806e280 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.550+0000 7fea8fe00640 1 -- 172.21.15.99:0/3861914244 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88012870 con 0x7fea9806e280 2024-09-10T07:39:44.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.550+0000 7fea9ee00640 1 -- 172.21.15.99:0/3861914244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea980ad5d0 con 0x7fea9806e280 2024-09-10T07:39:44.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.551+0000 7fea9ee00640 1 -- 172.21.15.99:0/3861914244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea98073370 con 0x7fea9806e280 2024-09-10T07:39:44.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.552+0000 7fea8fe00640 1 -- 172.21.15.99:0/3861914244 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea88012a10 con 0x7fea9806e280 2024-09-10T07:39:44.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.553+0000 7fea8fe00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7806be30 0x7fea7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.553+0000 7fea8fe00640 1 -- 172.21.15.99:0/3861914244 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7fea8808a760 con 0x7fea9806e280 2024-09-10T07:39:44.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.553+0000 7fea97400640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7806be30 0x7fea7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.554+0000 7fea97400640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7806be30 0x7fea7806e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea84034000 tx=0x7fea8402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:44.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.557+0000 7fea8fe00640 1 -- 172.21.15.99:0/3861914244 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea88059400 con 0x7fea9806e280 2024-09-10T07:39:44.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.730+0000 7fea9ee00640 1 -- 172.21.15.99:0/3861914244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fea9806e7e0 con 0x7fea9806e280 2024-09-10T07:39:44.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.730+0000 7fea8fe00640 1 -- 172.21.15.99:0/3861914244 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) ==== 93+0+10 (secure 0 0 0) 0x7fea88058d00 con 0x7fea9806e280 2024-09-10T07:39:44.730 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-10T07:39:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.732+0000 7fea9ee00640 1 -- 172.21.15.99:0/3861914244 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7806be30 msgr2=0x7fea7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.732+0000 7fea9ee00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7806be30 0x7fea7806e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea84034000 tx=0x7fea8402e000 comp rx=0 tx=0).stop 2024-09-10T07:39:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.732+0000 7fea9ee00640 1 -- 172.21.15.99:0/3861914244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9806e280 msgr2=0x7fea98157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.732+0000 7fea9ee00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9806e280 0x7fea98157ea0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fea8800c480 tx=0x7fea8800c940 comp rx=0 tx=0).stop 2024-09-10T07:39:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.732+0000 7fea9ee00640 1 -- 172.21.15.99:0/3861914244 shutdown_connections 2024-09-10T07:39:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.732+0000 7fea9ee00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea980d1010 0x7fea9815f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.732+0000 7fea9ee00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea98071df0 0x7fea9815ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.732+0000 7fea9ee00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fea7806be30 0x7fea7806e2f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.732+0000 7fea9ee00640 1 --2- 172.21.15.99:0/3861914244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9806e280 0x7fea98157ea0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.732+0000 7fea9ee00640 1 -- 172.21.15.99:0/3861914244 >> 172.21.15.99:0/3861914244 conn(0x7fea9806bc10 msgr2=0x7fea9815bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.733+0000 7fea9ee00640 1 -- 172.21.15.99:0/3861914244 shutdown_connections 2024-09-10T07:39:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.733+0000 7fea9ee00640 1 -- 172.21.15.99:0/3861914244 wait complete. 2024-09-10T07:39:44.749 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-10T07:39:44.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.904+0000 7fa8c3c00640 1 Processor -- start 2024-09-10T07:39:44.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.904+0000 7fa8c3c00640 1 -- start start 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.905+0000 7fa8c3c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc15eea0 0x7fa8bc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.905+0000 7fa8c3c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa8bc0ced00 0x7fa8bc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.905+0000 7fa8c3c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc0b6db0 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.905+0000 7fa8c3c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa8bc0b7070 con 0x7fa8bc0ced00 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.905+0000 7fa8c3c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc0b1390 con 0x7fa8bc15eea0 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.905+0000 7fa8c1c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa8bc0b60a0 0x7fa8bc0b6550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45738/0 (socket says 172.21.15.99:45738) 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.905+0000 7fa8c1c00640 1 -- 172.21.15.99:0/2896874529 learned_addr learned my addr 172.21.15.99:0/2896874529 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.906+0000 7fa8c1200640 1 --2- 172.21.15.99:0/2896874529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc15eea0 0x7fa8bc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.906+0000 7fa8bbe00640 1 --2- 172.21.15.99:0/2896874529 >> v2:172.21.15.99:3300/0 conn(0x7fa8bc0ced00 0x7fa8bc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.906+0000 7fa8bb400640 1 -- 172.21.15.99:0/2896874529 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806177787 0 0) 0x7fa8bc0b6db0 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.906+0000 7fa8bb400640 1 -- 172.21.15.99:0/2896874529 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a0003520 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.906+0000 7fa8c1200640 1 -- 172.21.15.99:0/2896874529 >> v2:172.21.15.99:3300/0 conn(0x7fa8bc0ced00 msgr2=0x7fa8bc06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:44.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.906+0000 7fa8c1200640 1 --2- 172.21.15.99:0/2896874529 >> v2:172.21.15.99:3300/0 conn(0x7fa8bc0ced00 0x7fa8bc06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.906+0000 7fa8c1200640 1 -- 172.21.15.99:0/2896874529 >> v1:172.21.15.99:6789/0 conn(0x7fa8bc0b60a0 legacy=0x7fa8bc0b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.906+0000 7fa8c1200640 1 -- 172.21.15.99:0/2896874529 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc0b1670 con 0x7fa8bc15eea0 2024-09-10T07:39:44.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.907+0000 7fa8c1200640 1 --2- 172.21.15.99:0/2896874529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc15eea0 0x7fa8bc06bc10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0097a0 tx=0x7fa8ac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5beaaf87a9d4c89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:44.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8bb400640 1 -- 172.21.15.99:0/2896874529 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac037070 con 0x7fa8bc15eea0 2024-09-10T07:39:44.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8bb400640 1 -- 172.21.15.99:0/2896874529 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac032440 con 0x7fa8bc15eea0 2024-09-10T07:39:44.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8bb400640 1 -- 172.21.15.99:0/2896874529 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac032810 con 0x7fa8bc15eea0 2024-09-10T07:39:44.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8c3c00640 1 -- 172.21.15.99:0/2896874529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc15eea0 msgr2=0x7fa8bc06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8c3c00640 1 --2- 172.21.15.99:0/2896874529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc15eea0 0x7fa8bc06bc10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0097a0 tx=0x7fa8ac02a180 comp rx=0 tx=0).stop 2024-09-10T07:39:44.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8c3c00640 1 -- 172.21.15.99:0/2896874529 shutdown_connections 2024-09-10T07:39:44.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8c3c00640 1 --2- 172.21.15.99:0/2896874529 >> v2:172.21.15.99:3300/0 conn(0x7fa8bc0ced00 0x7fa8bc06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8c3c00640 1 --2- 172.21.15.99:0/2896874529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc15eea0 0x7fa8bc06bc10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8c3c00640 1 -- 172.21.15.99:0/2896874529 >> 172.21.15.99:0/2896874529 conn(0x7fa8bc0731b0 msgr2=0x7fa8bc0735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:44.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8c3c00640 1 -- 172.21.15.99:0/2896874529 shutdown_connections 2024-09-10T07:39:44.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.908+0000 7fa8c3c00640 1 -- 172.21.15.99:0/2896874529 wait complete. 2024-09-10T07:39:44.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.910+0000 7fa8c3c00640 1 Processor -- start 2024-09-10T07:39:44.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.910+0000 7fa8c3c00640 1 -- start start 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c3c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc0b60a0 0x7fa8bc0af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c3c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc0ced00 0x7fa8bc161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c3c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8bc15eea0 0x7fa8bc0ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c3c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc0b1b90 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c3c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc0b1040 con 0x7fa8bc15eea0 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c3c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc0b1d10 con 0x7fa8bc0ced00 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc0b60a0 0x7fa8bc0af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc0b60a0 0x7fa8bc0af880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48008/0 (socket says 172.21.15.99:48008) 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c1200640 1 -- 172.21.15.99:0/3289883927 learned_addr learned my addr 172.21.15.99:0/3289883927 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8bbe00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc0ced00 0x7fa8bc161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c1c00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8bc15eea0 0x7fa8bc0ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c1200640 1 -- 172.21.15.99:0/3289883927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc0ced00 msgr2=0x7fa8bc161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c1200640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc0ced00 0x7fa8bc161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c1200640 1 -- 172.21.15.99:0/3289883927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8bc15eea0 msgr2=0x7fa8bc0ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c1200640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8bc15eea0 0x7fa8bc0ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8c1200640 1 -- 172.21.15.99:0/3289883927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc155f90 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.911+0000 7fa8bbe00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc0ced00 0x7fa8bc161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.912+0000 7fa8c1200640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc0b60a0 0x7fa8bc0af880 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac000c00 tx=0x7fa8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.912+0000 7fa8b8c00640 1 -- 172.21.15.99:0/3289883927 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac037040 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.912+0000 7fa8b8c00640 1 -- 172.21.15.99:0/3289883927 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac042070 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.912+0000 7fa8b8c00640 1 -- 172.21.15.99:0/3289883927 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac030920 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.912+0000 7fa8c3c00640 1 -- 172.21.15.99:0/3289883927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8bc1623e0 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.912+0000 7fa8c3c00640 1 -- 172.21.15.99:0/3289883927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8bc155cb0 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.913+0000 7fa8c3c00640 1 -- 172.21.15.99:0/3289883927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8bc0b6550 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.914+0000 7fa8b8c00640 1 -- 172.21.15.99:0/3289883927 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8ac030ac0 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.915+0000 7fa8b8c00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa89c06be30 0x7fa89c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:44.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.915+0000 7fa8b8c00640 1 -- 172.21.15.99:0/3289883927 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7fa8ac0ab490 con 0x7fa8bc0b60a0 2024-09-10T07:39:44.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.915+0000 7fa8bbe00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa89c06be30 0x7fa89c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:44.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.916+0000 7fa8bbe00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa89c06be30 0x7fa89c06e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc15db50 tx=0x7fa8a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:44.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:44.919+0000 7fa8b8c00640 1 -- 172.21.15.99:0/3289883927 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8ac079b80 con 0x7fa8bc0b60a0 2024-09-10T07:39:45.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:45.156+0000 7fa8c3c00640 1 -- 172.21.15.99:0/3289883927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) -- 0x7fa8bc0695c0 con 0x7fa8bc0b60a0 2024-09-10T07:39:46.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.014+0000 7fa8b8c00640 1 -- 172.21.15.99:0/3289883927 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v283) ==== 131+0+0 (secure 0 0 0) 0x7fa8ac07de80 con 0x7fa8bc0b60a0 2024-09-10T07:39:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 -- 172.21.15.99:0/3289883927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa89c06be30 msgr2=0x7fa89c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa89c06be30 0x7fa89c06e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc15db50 tx=0x7fa8a8008040 comp rx=0 tx=0).stop 2024-09-10T07:39:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 -- 172.21.15.99:0/3289883927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc0b60a0 msgr2=0x7fa8bc0af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc0b60a0 0x7fa8bc0af880 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac000c00 tx=0x7fa8ac0046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 -- 172.21.15.99:0/3289883927 shutdown_connections 2024-09-10T07:39:46.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8bc15eea0 0x7fa8bc0ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8bc0ced00 0x7fa8bc161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa89c06be30 0x7fa89c06e2f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 --2- 172.21.15.99:0/3289883927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8bc0b60a0 0x7fa8bc0af880 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 -- 172.21.15.99:0/3289883927 >> 172.21.15.99:0/3289883927 conn(0x7fa8bc0731b0 msgr2=0x7fa8bc1523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:46.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 -- 172.21.15.99:0/3289883927 shutdown_connections 2024-09-10T07:39:46.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.017+0000 7fa8c3c00640 1 -- 172.21.15.99:0/3289883927 wait complete. 2024-09-10T07:39:46.037 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T07:39:46.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.197+0000 7f8122200640 1 Processor -- start 2024-09-10T07:39:46.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.197+0000 7f8122200640 1 -- start start 2024-09-10T07:39:46.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.199+0000 7f8122200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c15b760 0x7f811c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.199+0000 7f8122200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f811c0b4a90 0x7f811c06f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.199+0000 7f8122200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f811c0b4300 con 0x7f811c0d0630 2024-09-10T07:39:46.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.199+0000 7f8122200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f811c06d700 con 0x7f811c0b4a90 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.199+0000 7f8122200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f811c06d9e0 con 0x7f811c15b760 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.199+0000 7f811aa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f811c0b4a90 0x7f811c06f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.199+0000 7f811b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c15b760 0x7f811c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.199+0000 7f811aa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f811c0b4a90 0x7f811c06f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:35498/0 (socket says 172.21.15.99:35498) 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.199+0000 7f811aa00640 1 -- 172.21.15.99:0/1128416439 learned_addr learned my addr 172.21.15.99:0/1128416439 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.200+0000 7f811b400640 1 -- 172.21.15.99:0/1128416439 >> v2:172.21.15.187:3300/0 conn(0x7f811c0b4a90 msgr2=0x7f811c06f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.200+0000 7f811b400640 1 --2- 172.21.15.99:0/1128416439 >> v2:172.21.15.187:3300/0 conn(0x7f811c0b4a90 0x7f811c06f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.200+0000 7f811b400640 1 -- 172.21.15.99:0/1128416439 >> v1:172.21.15.187:6789/0 conn(0x7f811c0d0630 legacy=0x7f811c0d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.200+0000 7f811a000640 1 -- 172.21.15.99:0/1128416439 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780307222 0 0) 0x7f811c0b4300 con 0x7f811c0d0630 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.200+0000 7f811b400640 1 -- 172.21.15.99:0/1128416439 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c0b4570 con 0x7f811c15b760 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.200+0000 7f811aa00640 1 --2- 172.21.15.99:0/1128416439 >> v2:172.21.15.187:3300/0 conn(0x7f811c0b4a90 0x7f811c06f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.201+0000 7f811b400640 1 --2- 172.21.15.99:0/1128416439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c15b760 0x7f811c0afa90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f810c0097a0 tx=0x7f810c02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddcd87bf49e3afdc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.201+0000 7f811a000640 1 -- 172.21.15.99:0/1128416439 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c037070 con 0x7f811c15b760 2024-09-10T07:39:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.201+0000 7f811a000640 1 -- 172.21.15.99:0/1128416439 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810c02adb0 con 0x7f811c15b760 2024-09-10T07:39:46.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.201+0000 7f811a000640 1 -- 172.21.15.99:0/1128416439 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c032660 con 0x7f811c15b760 2024-09-10T07:39:46.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.202+0000 7f8122200640 1 -- 172.21.15.99:0/1128416439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c15b760 msgr2=0x7f811c0afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.202+0000 7f8122200640 1 --2- 172.21.15.99:0/1128416439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c15b760 0x7f811c0afa90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f810c0097a0 tx=0x7f810c02a060 comp rx=0 tx=0).stop 2024-09-10T07:39:46.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.202+0000 7f8122200640 1 -- 172.21.15.99:0/1128416439 shutdown_connections 2024-09-10T07:39:46.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.202+0000 7f8122200640 1 --2- 172.21.15.99:0/1128416439 >> v2:172.21.15.187:3300/0 conn(0x7f811c0b4a90 0x7f811c06f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.202+0000 7f8122200640 1 --2- 172.21.15.99:0/1128416439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c15b760 0x7f811c0afa90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.202+0000 7f8122200640 1 -- 172.21.15.99:0/1128416439 >> 172.21.15.99:0/1128416439 conn(0x7f811c06bc10 msgr2=0x7f811c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:46.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.202+0000 7f8122200640 1 -- 172.21.15.99:0/1128416439 shutdown_connections 2024-09-10T07:39:46.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.202+0000 7f8122200640 1 -- 172.21.15.99:0/1128416439 wait complete. 2024-09-10T07:39:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.204+0000 7f8122200640 1 Processor -- start 2024-09-10T07:39:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.204+0000 7f8122200640 1 -- start start 2024-09-10T07:39:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f8122200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811c0b4a90 0x7f811c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f8122200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c0d0630 0x7f811c1f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f8122200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c15b760 0x7f811c14e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f8122200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f811c0b5070 con 0x7f811c0b4a90 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f8122200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f811c0b4ef0 con 0x7f811c15b760 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f8122200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f811c15bb40 con 0x7f811c0d0630 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f811b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811c0b4a90 0x7f811c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f811b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811c0b4a90 0x7f811c0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48024/0 (socket says 172.21.15.99:48024) 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f811b400640 1 -- 172.21.15.99:0/3541433575 learned_addr learned my addr 172.21.15.99:0/3541433575 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f811aa00640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c0d0630 0x7f811c1f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f811be00640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c15b760 0x7f811c14e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f811b400640 1 -- 172.21.15.99:0/3541433575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c0d0630 msgr2=0x7f811c1f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f811b400640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c0d0630 0x7f811c1f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f811b400640 1 -- 172.21.15.99:0/3541433575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c15b760 msgr2=0x7f811c14e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f811b400640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c15b760 0x7f811c14e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.205+0000 7f811b400640 1 -- 172.21.15.99:0/3541433575 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c1f5580 con 0x7f811c0b4a90 2024-09-10T07:39:46.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.206+0000 7f811b400640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811c0b4a90 0x7f811c0c57c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f810c0098c0 tx=0x7f810c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:46.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.206+0000 7f8113400640 1 -- 172.21.15.99:0/3541433575 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c041020 con 0x7f811c0b4a90 2024-09-10T07:39:46.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.206+0000 7f8113400640 1 -- 172.21.15.99:0/3541433575 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810c03c670 con 0x7f811c0b4a90 2024-09-10T07:39:46.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.206+0000 7f8113400640 1 -- 172.21.15.99:0/3541433575 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c037040 con 0x7f811c0b4a90 2024-09-10T07:39:46.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.206+0000 7f8122200640 1 -- 172.21.15.99:0/3541433575 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c1f5860 con 0x7f811c0b4a90 2024-09-10T07:39:46.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.206+0000 7f8122200640 1 -- 172.21.15.99:0/3541433575 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c1f5e20 con 0x7f811c0b4a90 2024-09-10T07:39:46.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.207+0000 7f8122200640 1 -- 172.21.15.99:0/3541433575 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c06dcc0 con 0x7f811c0b4a90 2024-09-10T07:39:46.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.208+0000 7f8113400640 1 -- 172.21.15.99:0/3541433575 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f810c044020 con 0x7f811c0b4a90 2024-09-10T07:39:46.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.209+0000 7f8113400640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80fc06be30 0x7f80fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.209+0000 7f8113400640 1 -- 172.21.15.99:0/3541433575 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7f810c0ab190 con 0x7f811c0b4a90 2024-09-10T07:39:46.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.209+0000 7f811aa00640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80fc06be30 0x7f80fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.210+0000 7f811aa00640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80fc06be30 0x7f80fc06e2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f811c0cee60 tx=0x7f8108009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.213+0000 7f8113400640 1 -- 172.21.15.99:0/3541433575 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f810c04b030 con 0x7f811c0b4a90 2024-09-10T07:39:46.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.397+0000 7f8122200640 1 -- 172.21.15.99:0/3541433575 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f811c075620 con 0x7f811c0b4a90 2024-09-10T07:39:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.402+0000 7f8113400640 1 -- 172.21.15.99:0/3541433575 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f810c079750 con 0x7f811c0b4a90 2024-09-10T07:39:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 -- 172.21.15.99:0/3541433575 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80fc06be30 msgr2=0x7f80fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80fc06be30 0x7f80fc06e2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f811c0cee60 tx=0x7f8108009240 comp rx=0 tx=0).stop 2024-09-10T07:39:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 -- 172.21.15.99:0/3541433575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811c0b4a90 msgr2=0x7f811c0c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811c0b4a90 0x7f811c0c57c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f810c0098c0 tx=0x7f810c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 -- 172.21.15.99:0/3541433575 shutdown_connections 2024-09-10T07:39:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c15b760 0x7f811c14e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f811c0d0630 0x7f811c1f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f80fc06be30 0x7f80fc06e2f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 --2- 172.21.15.99:0/3541433575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811c0b4a90 0x7f811c0c57c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 -- 172.21.15.99:0/3541433575 >> 172.21.15.99:0/3541433575 conn(0x7f811c06bc10 msgr2=0x7f811c0d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 -- 172.21.15.99:0/3541433575 shutdown_connections 2024-09-10T07:39:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.405+0000 7f8122200640 1 -- 172.21.15.99:0/3541433575 wait complete. 2024-09-10T07:39:46.422 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:39:46.422 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:39:46.518 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:39:46.611 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:39:46.611 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:46.611 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:46.646 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:39:46.647 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:39:46.647 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:46.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:39:46.683 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:46.683 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:46.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:39:46.721 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:39:46.722 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:46.759 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:39:46.759 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T07:39:46.759 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.916+0000 7fac52a00640 1 Processor -- start 2024-09-10T07:39:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.916+0000 7fac52a00640 1 -- start start 2024-09-10T07:39:46.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.917+0000 7fac52a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac4c15ecc0 0x7fac4c0d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.917+0000 7fac52a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fac4c0d57a0 0x7fac4c0d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.917+0000 7fac52a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac4c0d3b20 con 0x7fac4c0d1990 2024-09-10T07:39:46.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.917+0000 7fac52a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fac4c0b42f0 con 0x7fac4c0d57a0 2024-09-10T07:39:46.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.917+0000 7fac52a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fac4c0b45d0 con 0x7fac4c15ecc0 2024-09-10T07:39:46.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.917+0000 7fac4b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fac4c0d57a0 0x7fac4c0d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.917+0000 7fac4b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fac4c0d57a0 0x7fac4c0d1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48028/0 (socket says 172.21.15.99:48028) 2024-09-10T07:39:46.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.917+0000 7fac4b400640 1 -- 172.21.15.99:0/87748473 learned_addr learned my addr 172.21.15.99:0/87748473 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:46.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.918+0000 7fac4b400640 1 -- 172.21.15.99:0/87748473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac4c15ecc0 msgr2=0x7fac4c0d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:46.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.918+0000 7fac4b400640 1 --2- 172.21.15.99:0/87748473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac4c15ecc0 0x7fac4c0d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.918+0000 7fac4b400640 1 -- 172.21.15.99:0/87748473 >> v1:172.21.15.99:6789/0 conn(0x7fac4c0d1990 legacy=0x7fac4c0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.918+0000 7fac4b400640 1 -- 172.21.15.99:0/87748473 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4c0b48b0 con 0x7fac4c0d57a0 2024-09-10T07:39:46.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.919+0000 7fac4b400640 1 --2- 172.21.15.99:0/87748473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d57a0 0x7fac4c0d1450 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fac38009870 tx=0x7fac3802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19215f51d76cdf22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:46.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.919+0000 7fac4aa00640 1 -- 172.21.15.99:0/87748473 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38037070 con 0x7fac4c0d57a0 2024-09-10T07:39:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.919+0000 7fac4aa00640 1 -- 172.21.15.99:0/87748473 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac38032440 con 0x7fac4c0d57a0 2024-09-10T07:39:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.919+0000 7fac4aa00640 1 -- 172.21.15.99:0/87748473 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38032810 con 0x7fac4c0d57a0 2024-09-10T07:39:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.919+0000 7fac52a00640 1 -- 172.21.15.99:0/87748473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d57a0 msgr2=0x7fac4c0d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.919+0000 7fac52a00640 1 --2- 172.21.15.99:0/87748473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d57a0 0x7fac4c0d1450 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fac38009870 tx=0x7fac3802a250 comp rx=0 tx=0).stop 2024-09-10T07:39:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.920+0000 7fac52a00640 1 -- 172.21.15.99:0/87748473 shutdown_connections 2024-09-10T07:39:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.920+0000 7fac52a00640 1 --2- 172.21.15.99:0/87748473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d57a0 0x7fac4c0d1450 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.920+0000 7fac52a00640 1 --2- 172.21.15.99:0/87748473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac4c15ecc0 0x7fac4c0d3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.920+0000 7fac52a00640 1 -- 172.21.15.99:0/87748473 >> 172.21.15.99:0/87748473 conn(0x7fac4c0d4bd0 msgr2=0x7fac4c0d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.920+0000 7fac52a00640 1 -- 172.21.15.99:0/87748473 shutdown_connections 2024-09-10T07:39:46.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.920+0000 7fac52a00640 1 -- 172.21.15.99:0/87748473 wait complete. 2024-09-10T07:39:46.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.921+0000 7fac52a00640 1 Processor -- start 2024-09-10T07:39:46.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.921+0000 7fac52a00640 1 -- start start 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.922+0000 7fac52a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d1990 0x7fac4c15f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.922+0000 7fac52a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac4c0d57a0 0x7fac4c0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.922+0000 7fac52a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac4c15ecc0 0x7fac4c154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.922+0000 7fac52a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fac4c15f220 con 0x7fac4c0d1990 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.922+0000 7fac52a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fac4c15f0a0 con 0x7fac4c0d57a0 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.922+0000 7fac52a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fac4c0d36b0 con 0x7fac4c15ecc0 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.922+0000 7fac4be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d1990 0x7fac4c15f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.922+0000 7fac4be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d1990 0x7fac4c15f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48040/0 (socket says 172.21.15.99:48040) 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.922+0000 7fac4be00640 1 -- 172.21.15.99:0/1615855149 learned_addr learned my addr 172.21.15.99:0/1615855149 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac50a00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac4c15ecc0 0x7fac4c154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac4b400640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac4c0d57a0 0x7fac4c0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac4be00640 1 -- 172.21.15.99:0/1615855149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac4c15ecc0 msgr2=0x7fac4c154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac4be00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac4c15ecc0 0x7fac4c154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac4be00640 1 -- 172.21.15.99:0/1615855149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac4c0d57a0 msgr2=0x7fac4c0cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:46.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac4be00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac4c0d57a0 0x7fac4c0cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:46.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac4be00640 1 -- 172.21.15.99:0/1615855149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4c1f8a50 con 0x7fac4c0d1990 2024-09-10T07:39:46.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac4be00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d1990 0x7fac4c15f990 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00b410 tx=0x7fac3c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:46.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac43e00640 1 -- 172.21.15.99:0/1615855149 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c015020 con 0x7fac4c0d1990 2024-09-10T07:39:46.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac43e00640 1 -- 172.21.15.99:0/1615855149 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3c011850 con 0x7fac4c0d1990 2024-09-10T07:39:46.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac43e00640 1 -- 172.21.15.99:0/1615855149 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c011c40 con 0x7fac4c0d1990 2024-09-10T07:39:46.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.923+0000 7fac52a00640 1 -- 172.21.15.99:0/1615855149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4c1f8d30 con 0x7fac4c0d1990 2024-09-10T07:39:46.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.924+0000 7fac52a00640 1 -- 172.21.15.99:0/1615855149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac4c1f92f0 con 0x7fac4c0d1990 2024-09-10T07:39:46.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.925+0000 7fac52a00640 1 -- 172.21.15.99:0/1615855149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4c1f9630 con 0x7fac4c0d1990 2024-09-10T07:39:46.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.925+0000 7fac43e00640 1 -- 172.21.15.99:0/1615855149 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac3c018020 con 0x7fac4c0d1990 2024-09-10T07:39:46.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.926+0000 7fac43e00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac2c06be30 0x7fac2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:46.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.926+0000 7fac43e00640 1 -- 172.21.15.99:0/1615855149 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7fac3c08a990 con 0x7fac4c0d1990 2024-09-10T07:39:46.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.927+0000 7fac4b400640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac2c06be30 0x7fac2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:46.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.927+0000 7fac4b400640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac2c06be30 0x7fac2c06e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fac38034000 tx=0x7fac3802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:46.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:46.931+0000 7fac43e00640 1 -- 172.21.15.99:0/1615855149 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac4c1f9630 con 0x7fac4c0d1990 2024-09-10T07:39:47.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.141+0000 7fac52a00640 1 -- 172.21.15.99:0/1615855149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac4c0d1450 con 0x7fac4c0d1990 2024-09-10T07:39:47.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.142+0000 7fac43e00640 1 -- 172.21.15.99:0/1615855149 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+3914 (secure 0 0 0) 0x7fac3c01f020 con 0x7fac4c0d1990 2024-09-10T07:39:47.142 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:47.142 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":51,"btime":"2024-09-10T07:39:40:774264+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5399,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/224049994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":224049994},{"type":"v1","addr":"172.21.15.187:6834","nonce":224049994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2009047482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2009047482},{"type":"v1","addr":"172.21.15.187:6835","nonce":2009047482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3952584402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":3952584402},{"type":"v1","addr":"172.21.15.99:6837","nonce":3952584402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1696118888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1696118888},{"type":"v1","addr":"172.21.15.99:6835","nonce":1696118888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[]} 2024-09-10T07:39:47.142 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 51 2024-09-10T07:39:47.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 -- 172.21.15.99:0/1615855149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac2c06be30 msgr2=0x7fac2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:47.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac2c06be30 0x7fac2c06e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fac38034000 tx=0x7fac3802e000 comp rx=0 tx=0).stop 2024-09-10T07:39:47.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 -- 172.21.15.99:0/1615855149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d1990 msgr2=0x7fac4c15f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:47.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d1990 0x7fac4c15f990 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00b410 tx=0x7fac3c00b8d0 comp rx=0 tx=0).stop 2024-09-10T07:39:47.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 -- 172.21.15.99:0/1615855149 shutdown_connections 2024-09-10T07:39:47.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac4c15ecc0 0x7fac4c154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:47.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac4c0d57a0 0x7fac4c0cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:47.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac2c06be30 0x7fac2c06e2f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:47.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 --2- 172.21.15.99:0/1615855149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac4c0d1990 0x7fac4c15f990 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:47.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 -- 172.21.15.99:0/1615855149 >> 172.21.15.99:0/1615855149 conn(0x7fac4c0d4bd0 msgr2=0x7fac4c0b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:47.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 -- 172.21.15.99:0/1615855149 shutdown_connections 2024-09-10T07:39:47.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.144+0000 7fac52a00640 1 -- 172.21.15.99:0/1615855149 wait complete. 2024-09-10T07:39:47.155 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:39:47.160 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:39:47.162 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:39:47.162 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T07:39:47.162 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:39:47.162 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:39:47.163 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:39:47.163 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T07:39:47.163 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:39:47.163 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:39:47.163 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:39:47.163 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T07:39:47.163 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:39:47.164 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:39:47.164 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:39:47.164 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T07:39:47.164 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:39:47.164 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:39:47.179 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:39:47.180 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:39:47.194 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:39:47.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:39:47.215 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:39:47.216 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:39:47.217 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:39:47.217 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:39:47.237 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:39:47.238 DEBUG:teuthology.parallel:result is None 2024-09-10T07:39:47.240 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:39:47.240 DEBUG:teuthology.parallel:result is None 2024-09-10T07:39:47.259 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:39:47.260 DEBUG:teuthology.parallel:result is None 2024-09-10T07:39:47.262 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:39:47.262 DEBUG:teuthology.parallel:result is None 2024-09-10T07:39:47.262 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T07:39:47.366 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:39:47.366 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:39:47.390 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:39:47.392 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:39:47.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.468+0000 7fbef8000640 1 Processor -- start 2024-09-10T07:39:47.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.468+0000 7fbef8000640 1 -- start start 2024-09-10T07:39:47.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef8000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbef015db60 0x7fbef0071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:47.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef8000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbef006e750 0x7fbef00ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:47.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef8000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef0153e50 con 0x7fbef00724d0 2024-09-10T07:39:47.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef8000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbef015df40 con 0x7fbef015db60 2024-09-10T07:39:47.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef8000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbef0072ac0 con 0x7fbef006e750 2024-09-10T07:39:47.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef5600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbef015db60 0x7fbef0071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:47.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef5600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbef015db60 0x7fbef0071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48086/0 (socket says 172.21.15.99:48086) 2024-09-10T07:39:47.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef5600640 1 -- 172.21.15.99:0/4069128936 learned_addr learned my addr 172.21.15.99:0/4069128936 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:47.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef4c00640 1 --1- 172.21.15.99:0/4069128936 >> v1:172.21.15.99:6789/0 conn(0x7fbef00724d0 0x7fbef006e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45786/0 (socket says 172.21.15.99:45786) 2024-09-10T07:39:47.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef6000640 1 --2- 172.21.15.99:0/4069128936 >> v2:172.21.15.187:3300/0 conn(0x7fbef006e750 0x7fbef00ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:47.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef5600640 1 -- 172.21.15.99:0/4069128936 >> v2:172.21.15.187:3300/0 conn(0x7fbef006e750 msgr2=0x7fbef00ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:47.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef5600640 1 --2- 172.21.15.99:0/4069128936 >> v2:172.21.15.187:3300/0 conn(0x7fbef006e750 0x7fbef00ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:47.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef5600640 1 -- 172.21.15.99:0/4069128936 >> v1:172.21.15.99:6789/0 conn(0x7fbef00724d0 legacy=0x7fbef006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:47.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef5600640 1 -- 172.21.15.99:0/4069128936 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef0072da0 con 0x7fbef015db60 2024-09-10T07:39:47.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.470+0000 7fbef6000640 1 --2- 172.21.15.99:0/4069128936 >> v2:172.21.15.187:3300/0 conn(0x7fbef006e750 0x7fbef00ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:47.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.471+0000 7fbef5600640 1 --2- 172.21.15.99:0/4069128936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef015db60 0x7fbef0071f90 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbef006ed50 tx=0x7fbee402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca372c4aafabd72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:47.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbeefe00640 1 -- 172.21.15.99:0/4069128936 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4036070 con 0x7fbef015db60 2024-09-10T07:39:47.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbeefe00640 1 -- 172.21.15.99:0/4069128936 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee4031600 con 0x7fbef015db60 2024-09-10T07:39:47.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbeefe00640 1 -- 172.21.15.99:0/4069128936 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee40319d0 con 0x7fbef015db60 2024-09-10T07:39:47.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbef8000640 1 -- 172.21.15.99:0/4069128936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef015db60 msgr2=0x7fbef0071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:47.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbef8000640 1 --2- 172.21.15.99:0/4069128936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef015db60 0x7fbef0071f90 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbef006ed50 tx=0x7fbee402a730 comp rx=0 tx=0).stop 2024-09-10T07:39:47.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbef8000640 1 -- 172.21.15.99:0/4069128936 shutdown_connections 2024-09-10T07:39:47.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbef8000640 1 --2- 172.21.15.99:0/4069128936 >> v2:172.21.15.187:3300/0 conn(0x7fbef006e750 0x7fbef00ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:47.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbef8000640 1 --2- 172.21.15.99:0/4069128936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef015db60 0x7fbef0071f90 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:47.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbef8000640 1 -- 172.21.15.99:0/4069128936 >> 172.21.15.99:0/4069128936 conn(0x7fbef00b2630 msgr2=0x7fbef00b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:47.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbef8000640 1 -- 172.21.15.99:0/4069128936 shutdown_connections 2024-09-10T07:39:47.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.472+0000 7fbef8000640 1 -- 172.21.15.99:0/4069128936 wait complete. 2024-09-10T07:39:47.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.474+0000 7fbef8000640 1 Processor -- start 2024-09-10T07:39:47.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.474+0000 7fbef8000640 1 -- start start 2024-09-10T07:39:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef8000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef006e750 0x7fbef014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef8000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbef00724d0 0x7fbef014c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef8000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef015db60 0x7fbef01f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef8000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0073640 con 0x7fbef006e750 2024-09-10T07:39:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef8000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0073360 con 0x7fbef00724d0 2024-09-10T07:39:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef8000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbef015d1c0 con 0x7fbef015db60 2024-09-10T07:39:47.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef006e750 0x7fbef014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:47.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef006e750 0x7fbef014e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48096/0 (socket says 172.21.15.99:48096) 2024-09-10T07:39:47.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef5600640 1 -- 172.21.15.99:0/1102588304 learned_addr learned my addr 172.21.15.99:0/1102588304 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:47.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef6000640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef015db60 0x7fbef01f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:47.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef4c00640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbef00724d0 0x7fbef014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:47.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef5600640 1 -- 172.21.15.99:0/1102588304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef015db60 msgr2=0x7fbef01f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:47.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef5600640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef015db60 0x7fbef01f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:47.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef5600640 1 -- 172.21.15.99:0/1102588304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbef00724d0 msgr2=0x7fbef014c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:47.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.475+0000 7fbef5600640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbef00724d0 0x7fbef014c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:47.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.476+0000 7fbef5600640 1 -- 172.21.15.99:0/1102588304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef014e950 con 0x7fbef006e750 2024-09-10T07:39:47.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.476+0000 7fbef5600640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef006e750 0x7fbef014e1b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbee4034040 tx=0x7fbee4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:47.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.476+0000 7fbeed600640 1 -- 172.21.15.99:0/1102588304 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4036050 con 0x7fbef006e750 2024-09-10T07:39:47.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.476+0000 7fbeed600640 1 -- 172.21.15.99:0/1102588304 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee4042070 con 0x7fbef006e750 2024-09-10T07:39:47.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.476+0000 7fbeed600640 1 -- 172.21.15.99:0/1102588304 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4009510 con 0x7fbef006e750 2024-09-10T07:39:47.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.476+0000 7fbef8000640 1 -- 172.21.15.99:0/1102588304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef0155110 con 0x7fbef006e750 2024-09-10T07:39:47.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.476+0000 7fbef8000640 1 -- 172.21.15.99:0/1102588304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef01556d0 con 0x7fbef006e750 2024-09-10T07:39:47.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.477+0000 7fbef8000640 1 -- 172.21.15.99:0/1102588304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef0071f90 con 0x7fbef006e750 2024-09-10T07:39:47.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.478+0000 7fbeed600640 1 -- 172.21.15.99:0/1102588304 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbee4007c50 con 0x7fbef006e750 2024-09-10T07:39:47.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.480+0000 7fbeed600640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 0x7fbed006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:47.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.480+0000 7fbeed600640 1 -- 172.21.15.99:0/1102588304 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7fbee40ab900 con 0x7fbef006e750 2024-09-10T07:39:47.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.480+0000 7fbef4c00640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 0x7fbed006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:47.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.480+0000 7fbef4c00640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 0x7fbed006e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbef0156db0 tx=0x7fbedc007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:47.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.484+0000 7fbeed600640 1 -- 172.21.15.99:0/1102588304 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbee407a070 con 0x7fbef006e750 2024-09-10T07:39:47.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:47.666+0000 7fbef8000640 1 -- 172.21.15.99:0/1102588304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fbef0160d30 con 0x7fbef006e750 2024-09-10T07:39:48.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.422+0000 7fbeed600640 1 -- 172.21.15.99:0/1102588304 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v121) ==== 97+0+0 (secure 0 0 0) 0x7fbee407e370 con 0x7fbef006e750 2024-09-10T07:39:48.423 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-09-10T07:39:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 -- 172.21.15.99:0/1102588304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 msgr2=0x7fbed006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 0x7fbed006e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbef0156db0 tx=0x7fbedc007e80 comp rx=0 tx=0).stop 2024-09-10T07:39:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 -- 172.21.15.99:0/1102588304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef006e750 msgr2=0x7fbef014e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef006e750 0x7fbef014e1b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbee4034040 tx=0x7fbee4004a40 comp rx=0 tx=0).stop 2024-09-10T07:39:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 -- 172.21.15.99:0/1102588304 shutdown_connections 2024-09-10T07:39:48.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbef015db60 0x7fbef01f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbef00724d0 0x7fbef014c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbed006be30 0x7fbed006e2f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 --2- 172.21.15.99:0/1102588304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbef006e750 0x7fbef014e1b0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 -- 172.21.15.99:0/1102588304 >> 172.21.15.99:0/1102588304 conn(0x7fbef00b2630 msgr2=0x7fbef015e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:48.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 -- 172.21.15.99:0/1102588304 shutdown_connections 2024-09-10T07:39:48.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.426+0000 7fbef8000640 1 -- 172.21.15.99:0/1102588304 wait complete. 2024-09-10T07:39:48.444 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T07:39:48.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.602+0000 7fb50e800640 1 Processor -- start 2024-09-10T07:39:48.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.602+0000 7fb50e800640 1 -- start start 2024-09-10T07:39:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.603+0000 7fb50e800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5080d2680 0x7fb5080cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.603+0000 7fb50e800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb5080cfac0 0x7fb5080c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.603+0000 7fb50e800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5080d2bd0 con 0x7fb50815e970 2024-09-10T07:39:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.603+0000 7fb50e800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb5080d37e0 con 0x7fb5080d2680 2024-09-10T07:39:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.603+0000 7fb50e800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb5080d2eb0 con 0x7fb5080cfac0 2024-09-10T07:39:48.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.603+0000 7fb50ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5080d2680 0x7fb5080cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:48.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.604+0000 7fb50ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5080d2680 0x7fb5080cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48108/0 (socket says 172.21.15.99:48108) 2024-09-10T07:39:48.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.604+0000 7fb50ca00640 1 -- 172.21.15.99:0/2836295971 learned_addr learned my addr 172.21.15.99:0/2836295971 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:48.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.604+0000 7fb50de00640 1 --2- 172.21.15.99:0/2836295971 >> v2:172.21.15.187:3300/0 conn(0x7fb5080cfac0 0x7fb5080c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:48.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.604+0000 7fb50ca00640 1 -- 172.21.15.99:0/2836295971 >> v2:172.21.15.187:3300/0 conn(0x7fb5080cfac0 msgr2=0x7fb5080c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:48.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.604+0000 7fb50ca00640 1 --2- 172.21.15.99:0/2836295971 >> v2:172.21.15.187:3300/0 conn(0x7fb5080cfac0 0x7fb5080c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.604+0000 7fb50ca00640 1 -- 172.21.15.99:0/2836295971 >> v1:172.21.15.187:6789/0 conn(0x7fb50815e970 legacy=0x7fb5080d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:48.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.604+0000 7fb50ca00640 1 -- 172.21.15.99:0/2836295971 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5080d3190 con 0x7fb5080d2680 2024-09-10T07:39:48.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.605+0000 7fb50ca00640 1 --2- 172.21.15.99:0/2836295971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080d2680 0x7fb5080cf580 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb50808e9c0 tx=0x7fb4f402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815af6c87095fe0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.605+0000 7fb507e00640 1 -- 172.21.15.99:0/2836295971 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4037070 con 0x7fb5080d2680 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.605+0000 7fb507e00640 1 -- 172.21.15.99:0/2836295971 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f4032440 con 0x7fb5080d2680 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.605+0000 7fb507e00640 1 -- 172.21.15.99:0/2836295971 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4032810 con 0x7fb5080d2680 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.606+0000 7fb50e800640 1 -- 172.21.15.99:0/2836295971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080d2680 msgr2=0x7fb5080cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.606+0000 7fb50e800640 1 --2- 172.21.15.99:0/2836295971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080d2680 0x7fb5080cf580 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb50808e9c0 tx=0x7fb4f402a2c0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.606+0000 7fb50e800640 1 -- 172.21.15.99:0/2836295971 shutdown_connections 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.606+0000 7fb50e800640 1 --2- 172.21.15.99:0/2836295971 >> v2:172.21.15.187:3300/0 conn(0x7fb5080cfac0 0x7fb5080c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.606+0000 7fb50e800640 1 --2- 172.21.15.99:0/2836295971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080d2680 0x7fb5080cf580 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.606+0000 7fb50e800640 1 -- 172.21.15.99:0/2836295971 >> 172.21.15.99:0/2836295971 conn(0x7fb50809de00 msgr2=0x7fb5080d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.606+0000 7fb50e800640 1 -- 172.21.15.99:0/2836295971 shutdown_connections 2024-09-10T07:39:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.606+0000 7fb50e800640 1 -- 172.21.15.99:0/2836295971 wait complete. 2024-09-10T07:39:48.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.607+0000 7fb50e800640 1 Processor -- start 2024-09-10T07:39:48.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.608+0000 7fb50e800640 1 -- start start 2024-09-10T07:39:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.608+0000 7fb50e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080cfac0 0x7fb5080ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.608+0000 7fb50e800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5080d2680 0x7fb5080cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50e800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50815e970 0x7fb508156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50e800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb50815ed50 con 0x7fb5080cfac0 2024-09-10T07:39:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50e800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb5080cff10 con 0x7fb5080d2680 2024-09-10T07:39:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50e800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb50815eed0 con 0x7fb50815e970 2024-09-10T07:39:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080cfac0 0x7fb5080ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080cfac0 0x7fb5080ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48124/0 (socket says 172.21.15.99:48124) 2024-09-10T07:39:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50d400640 1 -- 172.21.15.99:0/1342743480 learned_addr learned my addr 172.21.15.99:0/1342743480 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50ca00640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5080d2680 0x7fb5080cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50de00640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50815e970 0x7fb508156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50d400640 1 -- 172.21.15.99:0/1342743480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50815e970 msgr2=0x7fb508156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50d400640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50815e970 0x7fb508156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50d400640 1 -- 172.21.15.99:0/1342743480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5080d2680 msgr2=0x7fb5080cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50d400640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5080d2680 0x7fb5080cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.609+0000 7fb50d400640 1 -- 172.21.15.99:0/1342743480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5080cd030 con 0x7fb5080cfac0 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.610+0000 7fb50d400640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080cfac0 0x7fb5080ce8c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00b3f0 tx=0x7fb4fc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.610+0000 7fb505600640 1 -- 172.21.15.99:0/1342743480 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc015020 con 0x7fb5080cfac0 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.610+0000 7fb505600640 1 -- 172.21.15.99:0/1342743480 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4fc011830 con 0x7fb5080cfac0 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.610+0000 7fb50e800640 1 -- 172.21.15.99:0/1342743480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb508160530 con 0x7fb5080cfac0 2024-09-10T07:39:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.610+0000 7fb505600640 1 -- 172.21.15.99:0/1342743480 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc011c20 con 0x7fb5080cfac0 2024-09-10T07:39:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.610+0000 7fb50e800640 1 -- 172.21.15.99:0/1342743480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb508160af0 con 0x7fb5080cfac0 2024-09-10T07:39:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.611+0000 7fb50e800640 1 -- 172.21.15.99:0/1342743480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5080cee60 con 0x7fb5080cfac0 2024-09-10T07:39:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.612+0000 7fb505600640 1 -- 172.21.15.99:0/1342743480 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4fc018020 con 0x7fb5080cfac0 2024-09-10T07:39:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.613+0000 7fb505600640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb4e806be30 0x7fb4e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.613+0000 7fb505600640 1 -- 172.21.15.99:0/1342743480 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4857+0+0 (secure 0 0 0) 0x7fb4fc08a6e0 con 0x7fb5080cfac0 2024-09-10T07:39:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.613+0000 7fb50ca00640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb4e806be30 0x7fb4e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.614+0000 7fb50ca00640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb4e806be30 0x7fb4e806e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4034000 tx=0x7fb4f402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:48.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.617+0000 7fb505600640 1 -- 172.21.15.99:0/1342743480 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4fc01f030 con 0x7fb5080cfac0 2024-09-10T07:39:48.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.852+0000 7fb50e800640 1 -- 172.21.15.99:0/1342743480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb5080cf580 con 0x7fb5080cfac0 2024-09-10T07:39:48.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.853+0000 7fb505600640 1 -- 172.21.15.99:0/1342743480 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fb4fc058cf0 con 0x7fb5080cfac0 2024-09-10T07:39:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:48.856 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw==", 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-09-10T07:39:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ==", 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw==", 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:39:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw==", 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA==", 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A==", 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w==", 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA==", 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w==", 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw==", 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw==", 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg==", 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:39:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg==", 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow r", 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ==", 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A==", 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw==", 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:39:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBc9t9m2Fs5JBAAQfJNCUhmbHevYDJWsG/oAg==", 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-09-10T07:39:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q==", 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw==", 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:39:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:39:48.870 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:39:48.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 -- 172.21.15.99:0/1342743480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb4e806be30 msgr2=0x7fb4e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb4e806be30 0x7fb4e806e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4034000 tx=0x7fb4f402e000 comp rx=0 tx=0).stop 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 -- 172.21.15.99:0/1342743480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080cfac0 msgr2=0x7fb5080ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080cfac0 0x7fb5080ce8c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00b3f0 tx=0x7fb4fc00b8b0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 -- 172.21.15.99:0/1342743480 shutdown_connections 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb50815e970 0x7fb508156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5080d2680 0x7fb5080cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb4e806be30 0x7fb4e806e2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 --2- 172.21.15.99:0/1342743480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5080cfac0 0x7fb5080ce8c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 -- 172.21.15.99:0/1342743480 >> 172.21.15.99:0/1342743480 conn(0x7fb50809de00 msgr2=0x7fb5080d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 -- 172.21.15.99:0/1342743480 shutdown_connections 2024-09-10T07:39:48.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:48.855+0000 7fb50e800640 1 -- 172.21.15.99:0/1342743480 wait complete. 2024-09-10T07:39:48.873 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:39:49.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.027+0000 7fe70fe00640 1 Processor -- start 2024-09-10T07:39:49.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.027+0000 7fe70fe00640 1 -- start start 2024-09-10T07:39:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.028+0000 7fe70fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7100b37a0 0x7fe7100d3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.028+0000 7fe70fe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe7100cf670 0x7fe7100cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.028+0000 7fe70fe00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7100d37e0 con 0x7fe710162160 2024-09-10T07:39:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.028+0000 7fe70fe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe7100d35b0 con 0x7fe7100b37a0 2024-09-10T07:39:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.028+0000 7fe70fe00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe7100d1990 con 0x7fe7100cf670 2024-09-10T07:39:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.029+0000 7fe707e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7100b37a0 0x7fe7100d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.029+0000 7fe707e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7100b37a0 0x7fe7100d3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48132/0 (socket says 172.21.15.99:48132) 2024-09-10T07:39:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.029+0000 7fe707e00640 1 -- 172.21.15.99:0/3590782970 learned_addr learned my addr 172.21.15.99:0/3590782970 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.029+0000 7fe70f400640 1 --2- 172.21.15.99:0/3590782970 >> v2:172.21.15.187:3300/0 conn(0x7fe7100cf670 0x7fe7100cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.029+0000 7fe707e00640 1 -- 172.21.15.99:0/3590782970 >> v2:172.21.15.187:3300/0 conn(0x7fe7100cf670 msgr2=0x7fe7100cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.029+0000 7fe707e00640 1 --2- 172.21.15.99:0/3590782970 >> v2:172.21.15.187:3300/0 conn(0x7fe7100cf670 0x7fe7100cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.029+0000 7fe707e00640 1 -- 172.21.15.99:0/3590782970 >> v1:172.21.15.187:6789/0 conn(0x7fe710162160 legacy=0x7fe7100d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.029+0000 7fe707e00640 1 -- 172.21.15.99:0/3590782970 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7100d1c70 con 0x7fe7100b37a0 2024-09-10T07:39:49.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.030+0000 7fe707e00640 1 --2- 172.21.15.99:0/3590782970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100b37a0 0x7fe7100d3070 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe7100b75d0 tx=0x7fe6f802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6366966a3aa166d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:49.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.030+0000 7fe70e000640 1 -- 172.21.15.99:0/3590782970 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8037070 con 0x7fe7100b37a0 2024-09-10T07:39:49.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.030+0000 7fe70e000640 1 -- 172.21.15.99:0/3590782970 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f8032440 con 0x7fe7100b37a0 2024-09-10T07:39:49.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.030+0000 7fe70e000640 1 -- 172.21.15.99:0/3590782970 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8032810 con 0x7fe7100b37a0 2024-09-10T07:39:49.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.031+0000 7fe70fe00640 1 -- 172.21.15.99:0/3590782970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100b37a0 msgr2=0x7fe7100d3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:49.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.031+0000 7fe70fe00640 1 --2- 172.21.15.99:0/3590782970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100b37a0 0x7fe7100d3070 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe7100b75d0 tx=0x7fe6f802a200 comp rx=0 tx=0).stop 2024-09-10T07:39:49.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.031+0000 7fe70fe00640 1 -- 172.21.15.99:0/3590782970 shutdown_connections 2024-09-10T07:39:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.031+0000 7fe70fe00640 1 --2- 172.21.15.99:0/3590782970 >> v2:172.21.15.187:3300/0 conn(0x7fe7100cf670 0x7fe7100cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.031+0000 7fe70fe00640 1 --2- 172.21.15.99:0/3590782970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100b37a0 0x7fe7100d3070 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.031+0000 7fe70fe00640 1 -- 172.21.15.99:0/3590782970 >> 172.21.15.99:0/3590782970 conn(0x7fe7100d4a60 msgr2=0x7fe7100d4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.031+0000 7fe70fe00640 1 -- 172.21.15.99:0/3590782970 shutdown_connections 2024-09-10T07:39:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.031+0000 7fe70fe00640 1 -- 172.21.15.99:0/3590782970 wait complete. 2024-09-10T07:39:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.033+0000 7fe70fe00640 1 Processor -- start 2024-09-10T07:39:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.033+0000 7fe70fe00640 1 -- start start 2024-09-10T07:39:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe70fe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7100b37a0 0x7fe7101f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe70fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100cf670 0x7fe7101501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe70fe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe710162160 0x7fe7100b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe70fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe7100b2700 con 0x7fe7100cf670 2024-09-10T07:39:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe70fe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe7100d3ac0 con 0x7fe710162160 2024-09-10T07:39:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe70fe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe7100b2880 con 0x7fe7100b37a0 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe707e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100cf670 0x7fe7101501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe707e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100cf670 0x7fe7101501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48142/0 (socket says 172.21.15.99:48142) 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe707e00640 1 -- 172.21.15.99:0/1433724056 learned_addr learned my addr 172.21.15.99:0/1433724056 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe70ea00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7100b37a0 0x7fe7101f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe70f400640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe710162160 0x7fe7100b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe707e00640 1 -- 172.21.15.99:0/1433724056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7100b37a0 msgr2=0x7fe7101f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe707e00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7100b37a0 0x7fe7101f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe707e00640 1 -- 172.21.15.99:0/1433724056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe710162160 msgr2=0x7fe7100b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe707e00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe710162160 0x7fe7100b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.034+0000 7fe707e00640 1 -- 172.21.15.99:0/1433724056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7101f5620 con 0x7fe7100cf670 2024-09-10T07:39:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.035+0000 7fe707e00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100cf670 0x7fe7101501d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe6f802a240 tx=0x7fe6f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:49.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.035+0000 7fe706a00640 1 -- 172.21.15.99:0/1433724056 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8041020 con 0x7fe7100cf670 2024-09-10T07:39:49.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.035+0000 7fe706a00640 1 -- 172.21.15.99:0/1433724056 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f80306c0 con 0x7fe7100cf670 2024-09-10T07:39:49.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.035+0000 7fe706a00640 1 -- 172.21.15.99:0/1433724056 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8037040 con 0x7fe7100cf670 2024-09-10T07:39:49.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.035+0000 7fe70fe00640 1 -- 172.21.15.99:0/1433724056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe710153040 con 0x7fe7100cf670 2024-09-10T07:39:49.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.035+0000 7fe70fe00640 1 -- 172.21.15.99:0/1433724056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe710153600 con 0x7fe7100cf670 2024-09-10T07:39:49.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.036+0000 7fe70fe00640 1 -- 172.21.15.99:0/1433724056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe710162540 con 0x7fe7100cf670 2024-09-10T07:39:49.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.037+0000 7fe706a00640 1 -- 172.21.15.99:0/1433724056 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6f8044020 con 0x7fe7100cf670 2024-09-10T07:39:49.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.038+0000 7fe706a00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe6ec06be30 0x7fe6ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.038+0000 7fe706a00640 1 -- 172.21.15.99:0/1433724056 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4857+0+0 (secure 0 0 0) 0x7fe6f80ab260 con 0x7fe7100cf670 2024-09-10T07:39:49.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.038+0000 7fe70ea00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe6ec06be30 0x7fe6ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.038+0000 7fe70ea00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe6ec06be30 0x7fe6ec06e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe7000016e0 tx=0x7fe700009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:49.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.042+0000 7fe706a00640 1 -- 172.21.15.99:0/1433724056 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6f804b030 con 0x7fe7100cf670 2024-09-10T07:39:49.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.218+0000 7fe70fe00640 1 -- 172.21.15.99:0/1433724056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe71006dd80 con 0x7fe7100cf670 2024-09-10T07:39:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.218+0000 7fe706a00640 1 -- 172.21.15.99:0/1433724056 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v121) ==== 84+0+65 (secure 0 0 0) 0x7fe7101f5620 con 0x7fe7100cf670 2024-09-10T07:39:49.218 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:49.218 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:39:49.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:39:49.219 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:39:49.219 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:39:49.219 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:39:49.219 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:39:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 -- 172.21.15.99:0/1433724056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe6ec06be30 msgr2=0x7fe6ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe6ec06be30 0x7fe6ec06e2f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe7000016e0 tx=0x7fe700009040 comp rx=0 tx=0).stop 2024-09-10T07:39:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 -- 172.21.15.99:0/1433724056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100cf670 msgr2=0x7fe7101501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100cf670 0x7fe7101501d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe6f802a240 tx=0x7fe6f80046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 -- 172.21.15.99:0/1433724056 shutdown_connections 2024-09-10T07:39:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe710162160 0x7fe7100b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe6ec06be30 0x7fe6ec06e2f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7100cf670 0x7fe7101501d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 --2- 172.21.15.99:0/1433724056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7100b37a0 0x7fe7101f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 -- 172.21.15.99:0/1433724056 >> 172.21.15.99:0/1433724056 conn(0x7fe7100d4a60 msgr2=0x7fe71006c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 -- 172.21.15.99:0/1433724056 shutdown_connections 2024-09-10T07:39:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.220+0000 7fe70fe00640 1 -- 172.21.15.99:0/1433724056 wait complete. 2024-09-10T07:39:49.236 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:39:49.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:39:49.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.393+0000 7f8eaf200640 1 Processor -- start 2024-09-10T07:39:49.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.393+0000 7f8eaf200640 1 -- start start 2024-09-10T07:39:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.394+0000 7f8eaf200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8eb00afde0 0x7f8eb015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.394+0000 7f8eaf200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8eb006d8d0 0x7f8eb006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.394+0000 7f8eaf200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb015d370 con 0x7f8eb00cccf0 2024-09-10T07:39:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.394+0000 7f8eaf200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb006e260 con 0x7f8eb006d8d0 2024-09-10T07:39:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.394+0000 7f8eaf200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb015dc10 con 0x7f8eb00afde0 2024-09-10T07:39:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.395+0000 7f8eae800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8eb006d8d0 0x7f8eb006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.395+0000 7f8eae800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8eb006d8d0 0x7f8eb006dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48158/0 (socket says 172.21.15.99:48158) 2024-09-10T07:39:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.395+0000 7f8eae800640 1 -- 172.21.15.99:0/2281636944 learned_addr learned my addr 172.21.15.99:0/2281636944 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.395+0000 7f8eade00640 1 --2- 172.21.15.99:0/2281636944 >> v2:172.21.15.187:3300/0 conn(0x7f8eb00afde0 0x7f8eb015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.395+0000 7f8eae800640 1 -- 172.21.15.99:0/2281636944 >> v2:172.21.15.187:3300/0 conn(0x7f8eb00afde0 msgr2=0x7f8eb015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:49.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.395+0000 7f8eae800640 1 --2- 172.21.15.99:0/2281636944 >> v2:172.21.15.187:3300/0 conn(0x7f8eb00afde0 0x7f8eb015cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.395+0000 7f8eae800640 1 -- 172.21.15.99:0/2281636944 >> v1:172.21.15.187:6789/0 conn(0x7f8eb00cccf0 legacy=0x7f8eb00712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:49.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.395+0000 7f8eae800640 1 -- 172.21.15.99:0/2281636944 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb015d650 con 0x7f8eb006d8d0 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.396+0000 7f8eae800640 1 --2- 172.21.15.99:0/2281636944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 0x7f8eb006dd20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00d16e0 tx=0x7f8ea802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648483db5dc8dda7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.396+0000 7f8ead400640 1 -- 172.21.15.99:0/2281636944 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8036070 con 0x7f8eb006d8d0 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.396+0000 7f8ead400640 1 -- 172.21.15.99:0/2281636944 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea8031600 con 0x7f8eb006d8d0 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.396+0000 7f8ead400640 1 -- 172.21.15.99:0/2281636944 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea80319d0 con 0x7f8eb006d8d0 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.397+0000 7f8eaf200640 1 -- 172.21.15.99:0/2281636944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 msgr2=0x7f8eb006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.397+0000 7f8eaf200640 1 --2- 172.21.15.99:0/2281636944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 0x7f8eb006dd20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00d16e0 tx=0x7f8ea802a5d0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.397+0000 7f8eaf200640 1 -- 172.21.15.99:0/2281636944 shutdown_connections 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.397+0000 7f8eaf200640 1 --2- 172.21.15.99:0/2281636944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 0x7f8eb006dd20 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.397+0000 7f8eaf200640 1 --2- 172.21.15.99:0/2281636944 >> v2:172.21.15.187:3300/0 conn(0x7f8eb00afde0 0x7f8eb015cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.397+0000 7f8eaf200640 1 -- 172.21.15.99:0/2281636944 >> 172.21.15.99:0/2281636944 conn(0x7f8eb006bc10 msgr2=0x7f8eb006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.397+0000 7f8eaf200640 1 -- 172.21.15.99:0/2281636944 shutdown_connections 2024-09-10T07:39:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.397+0000 7f8eaf200640 1 -- 172.21.15.99:0/2281636944 wait complete. 2024-09-10T07:39:49.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.399+0000 7f8eaf200640 1 Processor -- start 2024-09-10T07:39:49.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.399+0000 7f8eaf200640 1 -- start start 2024-09-10T07:39:49.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eaf200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 0x7f8eb0154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eaf200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8eb00afde0 0x7f8eb0156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eaf200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8eb00cccf0 0x7f8eb0153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eaf200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb00cd180 con 0x7f8eb006d8d0 2024-09-10T07:39:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eaf200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb006d3b0 con 0x7f8eb00afde0 2024-09-10T07:39:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eaf200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb00719e0 con 0x7f8eb00cccf0 2024-09-10T07:39:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eade00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 0x7f8eb0154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eade00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 0x7f8eb0154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48166/0 (socket says 172.21.15.99:48166) 2024-09-10T07:39:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eade00640 1 -- 172.21.15.99:0/1341611368 learned_addr learned my addr 172.21.15.99:0/1341611368 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:49.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8ea5400640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8eb00afde0 0x7f8eb0156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eae800640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8eb00cccf0 0x7f8eb0153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eade00640 1 -- 172.21.15.99:0/1341611368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8eb00cccf0 msgr2=0x7f8eb0153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:49.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eade00640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8eb00cccf0 0x7f8eb0153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eade00640 1 -- 172.21.15.99:0/1341611368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8eb00afde0 msgr2=0x7f8eb0156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:49.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eade00640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8eb00afde0 0x7f8eb0156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:49.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.400+0000 7f8eade00640 1 -- 172.21.15.99:0/1341611368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb0156ba0 con 0x7f8eb006d8d0 2024-09-10T07:39:49.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.401+0000 7f8eade00640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 0x7f8eb0154e10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000d830 tx=0x7f8ea000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:49.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.401+0000 7f8ea6a00640 1 -- 172.21.15.99:0/1341611368 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000b6c0 con 0x7f8eb006d8d0 2024-09-10T07:39:49.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.401+0000 7f8ea6a00640 1 -- 172.21.15.99:0/1341611368 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea0019070 con 0x7f8eb006d8d0 2024-09-10T07:39:49.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.401+0000 7f8ea6a00640 1 -- 172.21.15.99:0/1341611368 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000ba80 con 0x7f8eb006d8d0 2024-09-10T07:39:49.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.401+0000 7f8eaf200640 1 -- 172.21.15.99:0/1341611368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb0156e80 con 0x7f8eb006d8d0 2024-09-10T07:39:49.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.401+0000 7f8eaf200640 1 -- 172.21.15.99:0/1341611368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb0157440 con 0x7f8eb006d8d0 2024-09-10T07:39:49.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.402+0000 7f8eaf200640 1 -- 172.21.15.99:0/1341611368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb006dd20 con 0x7f8eb006d8d0 2024-09-10T07:39:49.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.403+0000 7f8ea6a00640 1 -- 172.21.15.99:0/1341611368 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ea001e460 con 0x7f8eb006d8d0 2024-09-10T07:39:49.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.404+0000 7f8ea6a00640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e8c06be30 0x7f8e8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:49.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.404+0000 7f8ea6a00640 1 -- 172.21.15.99:0/1341611368 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4857+0+0 (secure 0 0 0) 0x7f8ea008b160 con 0x7f8eb006d8d0 2024-09-10T07:39:49.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.404+0000 7f8ea5400640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e8c06be30 0x7f8e8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:49.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.405+0000 7f8ea5400640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e8c06be30 0x7f8e8c06e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8eb01554a0 tx=0x7f8e98007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:49.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.408+0000 7f8ea6a00640 1 -- 172.21.15.99:0/1341611368 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ea0059770 con 0x7f8eb006d8d0 2024-09-10T07:39:49.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:49.582+0000 7f8eaf200640 1 -- 172.21.15.99:0/1341611368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8eb00ae8e0 con 0x7f8eb006d8d0 2024-09-10T07:39:50.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.427+0000 7f8ea6a00640 1 -- 172.21.15.99:0/1341611368 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v122) ==== 138+0+0 (secure 0 0 0) 0x7f8ea005da70 con 0x7f8eb006d8d0 2024-09-10T07:39:50.427 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:39:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.430+0000 7f8eaf200640 1 -- 172.21.15.99:0/1341611368 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e8c06be30 msgr2=0x7f8e8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.430+0000 7f8eaf200640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e8c06be30 0x7f8e8c06e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8eb01554a0 tx=0x7f8e98007e30 comp rx=0 tx=0).stop 2024-09-10T07:39:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.430+0000 7f8eaf200640 1 -- 172.21.15.99:0/1341611368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 msgr2=0x7f8eb0154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.430+0000 7f8eaf200640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 0x7f8eb0154e10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000d830 tx=0x7f8ea000dcf0 comp rx=0 tx=0).stop 2024-09-10T07:39:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.430+0000 7f8eaf200640 1 -- 172.21.15.99:0/1341611368 shutdown_connections 2024-09-10T07:39:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.430+0000 7f8eaf200640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8eb00cccf0 0x7f8eb0153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.430+0000 7f8eaf200640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8eb00afde0 0x7f8eb0156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:50.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.430+0000 7f8eaf200640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e8c06be30 0x7f8e8c06e2f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:50.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.430+0000 7f8eaf200640 1 --2- 172.21.15.99:0/1341611368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8eb006d8d0 0x7f8eb0154e10 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:50.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.430+0000 7f8eaf200640 1 -- 172.21.15.99:0/1341611368 >> 172.21.15.99:0/1341611368 conn(0x7f8eb006bc10 msgr2=0x7f8eb00aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:50.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.431+0000 7f8eaf200640 1 -- 172.21.15.99:0/1341611368 shutdown_connections 2024-09-10T07:39:50.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.432+0000 7f8eaf200640 1 -- 172.21.15.99:0/1341611368 wait complete. 2024-09-10T07:39:50.452 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:39:50.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.616+0000 7f905de00640 1 Processor -- start 2024-09-10T07:39:50.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.616+0000 7f905de00640 1 -- start start 2024-09-10T07:39:50.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.617+0000 7f905de00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 0x7f90580b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:50.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.617+0000 7f905de00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f90580d1470 0x7f90580d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:50.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.617+0000 7f905de00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90580d3700 con 0x7f90580d56b0 2024-09-10T07:39:50.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.617+0000 7f905de00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f90580d21a0 con 0x7f90580d1470 2024-09-10T07:39:50.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.617+0000 7f905de00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f90580d0080 con 0x7f90581623c0 2024-09-10T07:39:50.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.617+0000 7f904e000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f90580d56b0 0x7f90580d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54280/0 (socket says 172.21.15.99:54280) 2024-09-10T07:39:50.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.617+0000 7f904e000640 1 -- 172.21.15.99:0/602839267 learned_addr learned my addr 172.21.15.99:0/602839267 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:50.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.618+0000 7f9057400640 1 --2- 172.21.15.99:0/602839267 >> v2:172.21.15.187:3300/0 conn(0x7f90580d1470 0x7f90580d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:50.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.618+0000 7f9056a00640 1 --2- 172.21.15.99:0/602839267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 0x7f90580b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:50.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.618+0000 7f9056000640 1 -- 172.21.15.99:0/602839267 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787067058 0 0) 0x7f90580d3700 con 0x7f90580d56b0 2024-09-10T07:39:50.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.618+0000 7f9056000640 1 -- 172.21.15.99:0/602839267 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f903c003520 con 0x7f90580d56b0 2024-09-10T07:39:50.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.618+0000 7f9056000640 1 -- 172.21.15.99:0/602839267 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2336179346 0 0) 0x7f903c003520 con 0x7f90580d56b0 2024-09-10T07:39:50.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.618+0000 7f9056a00640 1 -- 172.21.15.99:0/602839267 >> v2:172.21.15.187:3300/0 conn(0x7f90580d1470 msgr2=0x7f90580d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:50.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.618+0000 7f9056a00640 1 --2- 172.21.15.99:0/602839267 >> v2:172.21.15.187:3300/0 conn(0x7f90580d1470 0x7f90580d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:50.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.618+0000 7f9056a00640 1 -- 172.21.15.99:0/602839267 >> v1:172.21.15.99:6789/0 conn(0x7f90580d56b0 legacy=0x7f90580d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:50.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.618+0000 7f9056a00640 1 -- 172.21.15.99:0/602839267 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90580cfa70 con 0x7f90581623c0 2024-09-10T07:39:50.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.618+0000 7f9057400640 1 --2- 172.21.15.99:0/602839267 >> v2:172.21.15.187:3300/0 conn(0x7f90580d1470 0x7f90580d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:39:50.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.619+0000 7f9056a00640 1 --2- 172.21.15.99:0/602839267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 0x7f90580b6260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90480097a0 tx=0x7f904802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2105e63390aa50b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:50.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f9056000640 1 -- 172.21.15.99:0/602839267 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048037070 con 0x7f90581623c0 2024-09-10T07:39:50.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f9056000640 1 -- 172.21.15.99:0/602839267 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904802aba0 con 0x7f90581623c0 2024-09-10T07:39:50.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f9056000640 1 -- 172.21.15.99:0/602839267 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040001670 con 0x7f90581623c0 2024-09-10T07:39:50.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f905de00640 1 -- 172.21.15.99:0/602839267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 msgr2=0x7f90580b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:50.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f905de00640 1 --2- 172.21.15.99:0/602839267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 0x7f90580b6260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90480097a0 tx=0x7f904802a110 comp rx=0 tx=0).stop 2024-09-10T07:39:50.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f905de00640 1 -- 172.21.15.99:0/602839267 shutdown_connections 2024-09-10T07:39:50.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f905de00640 1 --2- 172.21.15.99:0/602839267 >> v2:172.21.15.187:3300/0 conn(0x7f90580d1470 0x7f90580d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:50.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f905de00640 1 --2- 172.21.15.99:0/602839267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 0x7f90580b6260 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:50.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f905de00640 1 -- 172.21.15.99:0/602839267 >> 172.21.15.99:0/602839267 conn(0x7f905809df30 msgr2=0x7f90580d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:50.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f905de00640 1 -- 172.21.15.99:0/602839267 shutdown_connections 2024-09-10T07:39:50.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.620+0000 7f905de00640 1 -- 172.21.15.99:0/602839267 wait complete. 2024-09-10T07:39:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.622+0000 7f905de00640 1 Processor -- start 2024-09-10T07:39:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.622+0000 7f905de00640 1 -- start start 2024-09-10T07:39:50.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.623+0000 7f905de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90580d1470 0x7f905815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:50.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.623+0000 7f905de00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90580d56b0 0x7f905815cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:50.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.623+0000 7f905de00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 0x7f90580c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:50.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.623+0000 7f905de00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f90580cfd10 con 0x7f90580d1470 2024-09-10T07:39:50.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.623+0000 7f905de00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f90580d39a0 con 0x7f90580d56b0 2024-09-10T07:39:50.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.623+0000 7f905de00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f90581627a0 con 0x7f90581623c0 2024-09-10T07:39:50.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.623+0000 7f9056a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90580d1470 0x7f905815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.623+0000 7f9056a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90580d1470 0x7f905815a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55392/0 (socket says 172.21.15.99:55392) 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.623+0000 7f9056a00640 1 -- 172.21.15.99:0/85299624 learned_addr learned my addr 172.21.15.99:0/85299624 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f904e000640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90580d56b0 0x7f905815cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f9057400640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 0x7f90580c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f9056a00640 1 -- 172.21.15.99:0/85299624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 msgr2=0x7f90580c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f9056a00640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 0x7f90580c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f9056a00640 1 -- 172.21.15.99:0/85299624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90580d56b0 msgr2=0x7f905815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f9056a00640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90580d56b0 0x7f905815cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f9056a00640 1 -- 172.21.15.99:0/85299624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90580ba680 con 0x7f90580d1470 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f904e000640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90580d56b0 0x7f905815cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f9057400640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 0x7f90580c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f9056a00640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90580d1470 0x7f905815a2d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9048035040 tx=0x7f90480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f904fe00640 1 -- 172.21.15.99:0/85299624 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048037050 con 0x7f90580d1470 2024-09-10T07:39:50.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f904fe00640 1 -- 172.21.15.99:0/85299624 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9048043070 con 0x7f90580d1470 2024-09-10T07:39:50.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f904fe00640 1 -- 172.21.15.99:0/85299624 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904803ca70 con 0x7f90580d1470 2024-09-10T07:39:50.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f905de00640 1 -- 172.21.15.99:0/85299624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90580cb310 con 0x7f90580d1470 2024-09-10T07:39:50.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.624+0000 7f905de00640 1 -- 172.21.15.99:0/85299624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905815a810 con 0x7f90580d1470 2024-09-10T07:39:50.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.625+0000 7f905de00640 1 -- 172.21.15.99:0/85299624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90580d3c80 con 0x7f90580d1470 2024-09-10T07:39:50.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.627+0000 7f904fe00640 1 -- 172.21.15.99:0/85299624 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f904803cc10 con 0x7f90580d1470 2024-09-10T07:39:50.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.627+0000 7f904fe00640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903406be60 0x7f903406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:50.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.627+0000 7f904fe00640 1 -- 172.21.15.99:0/85299624 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5227+0+0 (secure 0 0 0) 0x7f90480ab6b0 con 0x7f90580d1470 2024-09-10T07:39:50.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.628+0000 7f904e000640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903406be60 0x7f903406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:50.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.628+0000 7f904e000640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903406be60 0x7f903406e320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f905815b920 tx=0x7f9040009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.633+0000 7f904fe00640 1 -- 172.21.15.99:0/85299624 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f904807a350 con 0x7f90580d1470 2024-09-10T07:39:50.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:50.806+0000 7f905de00640 1 -- 172.21.15.99:0/85299624 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f90580cb920 con 0x7f90580d1470 2024-09-10T07:39:51.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.433+0000 7f904fe00640 1 -- 172.21.15.99:0/85299624 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v123) ==== 170+0+0 (secure 0 0 0) 0x7f9048079c50 con 0x7f90580d1470 2024-09-10T07:39:51.433 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.436+0000 7f905de00640 1 -- 172.21.15.99:0/85299624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903406be60 msgr2=0x7f903406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.436+0000 7f905de00640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903406be60 0x7f903406e320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f905815b920 tx=0x7f9040009040 comp rx=0 tx=0).stop 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.437+0000 7f905de00640 1 -- 172.21.15.99:0/85299624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90580d1470 msgr2=0x7f905815a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.437+0000 7f905de00640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90580d1470 0x7f905815a2d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9048035040 tx=0x7f90480046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.437+0000 7f905de00640 1 -- 172.21.15.99:0/85299624 shutdown_connections 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.437+0000 7f905de00640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90581623c0 0x7f90580c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.437+0000 7f905de00640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90580d56b0 0x7f905815cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.437+0000 7f905de00640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903406be60 0x7f903406e320 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.437+0000 7f905de00640 1 --2- 172.21.15.99:0/85299624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90580d1470 0x7f905815a2d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.437+0000 7f905de00640 1 -- 172.21.15.99:0/85299624 >> 172.21.15.99:0/85299624 conn(0x7f905809df30 msgr2=0x7f90580b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:51.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.437+0000 7f905de00640 1 -- 172.21.15.99:0/85299624 shutdown_connections 2024-09-10T07:39:51.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.437+0000 7f905de00640 1 -- 172.21.15.99:0/85299624 wait complete. 2024-09-10T07:39:51.465 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:39:51.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.623+0000 7fbee4c00640 1 Processor -- start 2024-09-10T07:39:51.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.623+0000 7fbee4c00640 1 -- start start 2024-09-10T07:39:51.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.624+0000 7fbee4c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbee0162ff0 0x7fbee006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:51.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.625+0000 7fbee4c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbee00d11d0 0x7fbee00d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:51.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.625+0000 7fbee4c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbee006f610 con 0x7fbee00d0b70 2024-09-10T07:39:51.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.625+0000 7fbee4c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbee00b5470 con 0x7fbee0162ff0 2024-09-10T07:39:51.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.625+0000 7fbee4c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbee00b3980 con 0x7fbee00d11d0 2024-09-10T07:39:51.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.625+0000 7fbede800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbee00d0b70 0x7fbee00ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54288/0 (socket says 172.21.15.99:54288) 2024-09-10T07:39:51.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.625+0000 7fbede800640 1 -- 172.21.15.99:0/202397385 learned_addr learned my addr 172.21.15.99:0/202397385 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:51.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.625+0000 7fbedde00640 1 --2- 172.21.15.99:0/202397385 >> v2:172.21.15.187:3300/0 conn(0x7fbee0162ff0 0x7fbee006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:51.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.625+0000 7fbedd400640 1 --2- 172.21.15.99:0/202397385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbee00d11d0 0x7fbee00d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:51.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.625+0000 7fbedca00640 1 -- 172.21.15.99:0/202397385 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324285080 0 0) 0x7fbee006f610 con 0x7fbee00d0b70 2024-09-10T07:39:51.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.625+0000 7fbedca00640 1 -- 172.21.15.99:0/202397385 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbec4003520 con 0x7fbee00d0b70 2024-09-10T07:39:51.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.626+0000 7fbedde00640 1 -- 172.21.15.99:0/202397385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbee00d11d0 msgr2=0x7fbee00d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:51.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.626+0000 7fbedde00640 1 --2- 172.21.15.99:0/202397385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbee00d11d0 0x7fbee00d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.626+0000 7fbedde00640 1 -- 172.21.15.99:0/202397385 >> v1:172.21.15.99:6789/0 conn(0x7fbee00d0b70 legacy=0x7fbee00ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:51.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.626+0000 7fbedde00640 1 -- 172.21.15.99:0/202397385 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee00b3c60 con 0x7fbee0162ff0 2024-09-10T07:39:51.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.627+0000 7fbedde00640 1 --2- 172.21.15.99:0/202397385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbee0162ff0 0x7fbee006ed10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009d90 tx=0x7fbed002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=119838057aab55ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:51.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.627+0000 7fbedca00640 1 -- 172.21.15.99:0/202397385 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0031600 con 0x7fbee0162ff0 2024-09-10T07:39:51.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.627+0000 7fbedca00640 1 -- 172.21.15.99:0/202397385 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed00317a0 con 0x7fbee0162ff0 2024-09-10T07:39:51.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.627+0000 7fbedca00640 1 -- 172.21.15.99:0/202397385 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0031b70 con 0x7fbee0162ff0 2024-09-10T07:39:51.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.628+0000 7fbee4c00640 1 -- 172.21.15.99:0/202397385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbee0162ff0 msgr2=0x7fbee006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:51.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.628+0000 7fbee4c00640 1 --2- 172.21.15.99:0/202397385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbee0162ff0 0x7fbee006ed10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009d90 tx=0x7fbed002a5d0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.628+0000 7fbee4c00640 1 -- 172.21.15.99:0/202397385 shutdown_connections 2024-09-10T07:39:51.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.628+0000 7fbee4c00640 1 --2- 172.21.15.99:0/202397385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbee00d11d0 0x7fbee00d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.628+0000 7fbee4c00640 1 --2- 172.21.15.99:0/202397385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbee0162ff0 0x7fbee006ed10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.628+0000 7fbee4c00640 1 -- 172.21.15.99:0/202397385 >> 172.21.15.99:0/202397385 conn(0x7fbee006bc10 msgr2=0x7fbee006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:51.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.628+0000 7fbee4c00640 1 -- 172.21.15.99:0/202397385 shutdown_connections 2024-09-10T07:39:51.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.628+0000 7fbee4c00640 1 -- 172.21.15.99:0/202397385 wait complete. 2024-09-10T07:39:51.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.630+0000 7fbee4c00640 1 Processor -- start 2024-09-10T07:39:51.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.630+0000 7fbee4c00640 1 -- start start 2024-09-10T07:39:51.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.630+0000 7fbee4c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbee00d0b70 0x7fbee015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:51.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbee4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbee00d11d0 0x7fbee01455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:51.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbee4c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbee0162ff0 0x7fbee015f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:51.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbee4c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbee006f250 con 0x7fbee00d11d0 2024-09-10T07:39:51.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbee4c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbee01633d0 con 0x7fbee00d0b70 2024-09-10T07:39:51.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbee4c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbee006f3d0 con 0x7fbee0162ff0 2024-09-10T07:39:51.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbedd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbee00d11d0 0x7fbee01455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:51.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbedd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbee00d11d0 0x7fbee01455b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55404/0 (socket says 172.21.15.99:55404) 2024-09-10T07:39:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbedd400640 1 -- 172.21.15.99:0/1558821183 learned_addr learned my addr 172.21.15.99:0/1558821183 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbedde00640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbee00d0b70 0x7fbee015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbede800640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbee0162ff0 0x7fbee015f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbedd400640 1 -- 172.21.15.99:0/1558821183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbee0162ff0 msgr2=0x7fbee015f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbedd400640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbee0162ff0 0x7fbee015f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbedd400640 1 -- 172.21.15.99:0/1558821183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbee00d0b70 msgr2=0x7fbee015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbedd400640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbee00d0b70 0x7fbee015a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.631+0000 7fbedd400640 1 -- 172.21.15.99:0/1558821183 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee0145af0 con 0x7fbee00d11d0 2024-09-10T07:39:51.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.632+0000 7fbedd400640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbee00d11d0 0x7fbee01455b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00e980 tx=0x7fbecc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:51.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.632+0000 7fbed6000640 1 -- 172.21.15.99:0/1558821183 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc017070 con 0x7fbee00d11d0 2024-09-10T07:39:51.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.632+0000 7fbed6000640 1 -- 172.21.15.99:0/1558821183 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc00ca00 con 0x7fbee00d11d0 2024-09-10T07:39:51.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.632+0000 7fbed6000640 1 -- 172.21.15.99:0/1558821183 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00cdd0 con 0x7fbee00d11d0 2024-09-10T07:39:51.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.632+0000 7fbee4c00640 1 -- 172.21.15.99:0/1558821183 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee0159500 con 0x7fbee00d11d0 2024-09-10T07:39:51.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.632+0000 7fbee4c00640 1 -- 172.21.15.99:0/1558821183 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee0159ac0 con 0x7fbee00d11d0 2024-09-10T07:39:51.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.633+0000 7fbee4c00640 1 -- 172.21.15.99:0/1558821183 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee0161a80 con 0x7fbee00d11d0 2024-09-10T07:39:51.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.634+0000 7fbed6000640 1 -- 172.21.15.99:0/1558821183 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbecc01a070 con 0x7fbee00d11d0 2024-09-10T07:39:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.635+0000 7fbed6000640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbec006be30 0x7fbec006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.635+0000 7fbed6000640 1 -- 172.21.15.99:0/1558821183 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5609+0+0 (secure 0 0 0) 0x7fbecc08ad00 con 0x7fbee00d11d0 2024-09-10T07:39:51.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.635+0000 7fbedde00640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbec006be30 0x7fbec006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:51.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.636+0000 7fbedde00640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbec006be30 0x7fbec006e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbed0034000 tx=0x7fbed002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:51.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.640+0000 7fbed6000640 1 -- 172.21.15.99:0/1558821183 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbecc059150 con 0x7fbee00d11d0 2024-09-10T07:39:51.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:51.848+0000 7fbee4c00640 1 -- 172.21.15.99:0/1558821183 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbee0071d40 con 0x7fbee00d11d0 2024-09-10T07:39:52.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.435+0000 7fbed6000640 1 -- 172.21.15.99:0/1558821183 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v53) ==== 174+0+0 (secure 0 0 0) 0x7fbecc05d450 con 0x7fbee00d11d0 2024-09-10T07:39:52.436 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 14 and data pool 15 2024-09-10T07:39:52.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.440+0000 7fbee4c00640 1 -- 172.21.15.99:0/1558821183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbec006be30 msgr2=0x7fbec006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.440+0000 7fbee4c00640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbec006be30 0x7fbec006e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbed0034000 tx=0x7fbed002f000 comp rx=0 tx=0).stop 2024-09-10T07:39:52.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.440+0000 7fbee4c00640 1 -- 172.21.15.99:0/1558821183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbee00d11d0 msgr2=0x7fbee01455b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.440+0000 7fbee4c00640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbee00d11d0 0x7fbee01455b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00e980 tx=0x7fbecc00ee40 comp rx=0 tx=0).stop 2024-09-10T07:39:52.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.440+0000 7fbee4c00640 1 -- 172.21.15.99:0/1558821183 shutdown_connections 2024-09-10T07:39:52.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.440+0000 7fbee4c00640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbee0162ff0 0x7fbee015f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.440+0000 7fbee4c00640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbec006be30 0x7fbec006e2f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.441+0000 7fbee4c00640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbee00d11d0 0x7fbee01455b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.441+0000 7fbee4c00640 1 --2- 172.21.15.99:0/1558821183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbee00d0b70 0x7fbee015a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.441+0000 7fbee4c00640 1 -- 172.21.15.99:0/1558821183 >> 172.21.15.99:0/1558821183 conn(0x7fbee006bc10 msgr2=0x7fbee0072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.441+0000 7fbee4c00640 1 -- 172.21.15.99:0/1558821183 shutdown_connections 2024-09-10T07:39:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.443+0000 7fbee4c00640 1 -- 172.21.15.99:0/1558821183 wait complete. 2024-09-10T07:39:52.473 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:39:52.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.628+0000 7ff861400640 1 Processor -- start 2024-09-10T07:39:52.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.628+0000 7ff861400640 1 -- start start 2024-09-10T07:39:52.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.630+0000 7ff861400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff85c13fae0 0x7ff85c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:52.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.630+0000 7ff861400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff85c142650 con 0x7ff85c142150 2024-09-10T07:39:52.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.630+0000 7ff861400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff85c142930 con 0x7ff85c160c50 2024-09-10T07:39:52.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.630+0000 7ff861400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff85c0ce780 con 0x7ff85c13fae0 2024-09-10T07:39:52.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.630+0000 7ff859e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff85c142150 0x7ff85c160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54302/0 (socket says 172.21.15.99:54302) 2024-09-10T07:39:52.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.630+0000 7ff859e00640 1 -- 172.21.15.99:0/2204674037 learned_addr learned my addr 172.21.15.99:0/2204674037 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:52.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.630+0000 7ff85a800640 1 --2- 172.21.15.99:0/2204674037 >> v2:172.21.15.187:3300/0 conn(0x7ff85c13fae0 0x7ff85c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:52.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.630+0000 7ff859400640 1 -- 172.21.15.99:0/2204674037 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763510341 0 0) 0x7ff85c142650 con 0x7ff85c142150 2024-09-10T07:39:52.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.630+0000 7ff859400640 1 -- 172.21.15.99:0/2204674037 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff840003520 con 0x7ff85c142150 2024-09-10T07:39:52.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.631+0000 7ff85a800640 1 -- 172.21.15.99:0/2204674037 >> v1:172.21.15.187:6789/0 conn(0x7ff85c160c50 legacy=0x7ff85c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.631+0000 7ff85a800640 1 -- 172.21.15.99:0/2204674037 >> v1:172.21.15.99:6789/0 conn(0x7ff85c142150 legacy=0x7ff85c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.631+0000 7ff85a800640 1 -- 172.21.15.99:0/2204674037 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85c142c10 con 0x7ff85c13fae0 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.632+0000 7ff85a800640 1 --2- 172.21.15.99:0/2204674037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff85c13fae0 0x7ff85c06f1b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0097a0 tx=0x7ff84c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57ebdceb9c3bbf5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.632+0000 7ff859400640 1 -- 172.21.15.99:0/2204674037 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c037070 con 0x7ff85c13fae0 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.632+0000 7ff859400640 1 -- 172.21.15.99:0/2204674037 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84c032440 con 0x7ff85c13fae0 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.632+0000 7ff859400640 1 -- 172.21.15.99:0/2204674037 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c032810 con 0x7ff85c13fae0 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.633+0000 7ff861400640 1 -- 172.21.15.99:0/2204674037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff85c13fae0 msgr2=0x7ff85c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.633+0000 7ff861400640 1 --2- 172.21.15.99:0/2204674037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff85c13fae0 0x7ff85c06f1b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0097a0 tx=0x7ff84c02a1a0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.633+0000 7ff861400640 1 -- 172.21.15.99:0/2204674037 shutdown_connections 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.633+0000 7ff861400640 1 --2- 172.21.15.99:0/2204674037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff85c13fae0 0x7ff85c06f1b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.633+0000 7ff861400640 1 -- 172.21.15.99:0/2204674037 >> 172.21.15.99:0/2204674037 conn(0x7ff85c06bc10 msgr2=0x7ff85c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.633+0000 7ff861400640 1 -- 172.21.15.99:0/2204674037 shutdown_connections 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.633+0000 7ff861400640 1 -- 172.21.15.99:0/2204674037 wait complete. 2024-09-10T07:39:52.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.634+0000 7ff861400640 1 Processor -- start 2024-09-10T07:39:52.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.635+0000 7ff861400640 1 -- start start 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.635+0000 7ff861400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff85c13fae0 0x7ff85c13e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff861400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff85c142150 0x7ff85c1f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff861400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff85c160c50 0x7ff85c072d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff861400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c06f870 con 0x7ff85c13fae0 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff861400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c06f6f0 con 0x7ff85c142150 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff861400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff85c0cf320 con 0x7ff85c160c50 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff85a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff85c13fae0 0x7ff85c13e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff85a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff85c13fae0 0x7ff85c13e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55408/0 (socket says 172.21.15.99:55408) 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff85a800640 1 -- 172.21.15.99:0/3234875717 learned_addr learned my addr 172.21.15.99:0/3234875717 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff859e00640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff85c142150 0x7ff85c1f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff85b200640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff85c160c50 0x7ff85c072d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:52.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff85a800640 1 -- 172.21.15.99:0/3234875717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff85c160c50 msgr2=0x7ff85c072d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff85a800640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff85c160c50 0x7ff85c072d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff85a800640 1 -- 172.21.15.99:0/3234875717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff85c142150 msgr2=0x7ff85c1f86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff85a800640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff85c142150 0x7ff85c1f86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff85a800640 1 -- 172.21.15.99:0/3234875717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85c0b4920 con 0x7ff85c13fae0 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff859e00640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff85c142150 0x7ff85c1f86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.636+0000 7ff85a800640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff85c13fae0 0x7ff85c13e600 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff84c000c00 tx=0x7ff84c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.637+0000 7ff852a00640 1 -- 172.21.15.99:0/3234875717 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c037040 con 0x7ff85c13fae0 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.637+0000 7ff852a00640 1 -- 172.21.15.99:0/3234875717 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84c042070 con 0x7ff85c13fae0 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.637+0000 7ff861400640 1 -- 172.21.15.99:0/3234875717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85c0b4be0 con 0x7ff85c13fae0 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.637+0000 7ff852a00640 1 -- 172.21.15.99:0/3234875717 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c030940 con 0x7ff85c13fae0 2024-09-10T07:39:52.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.637+0000 7ff861400640 1 -- 172.21.15.99:0/3234875717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85c1e6500 con 0x7ff85c13fae0 2024-09-10T07:39:52.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.638+0000 7ff861400640 1 -- 172.21.15.99:0/3234875717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff85c0b5100 con 0x7ff85c13fae0 2024-09-10T07:39:52.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.639+0000 7ff852a00640 1 -- 172.21.15.99:0/3234875717 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff84c030ae0 con 0x7ff85c13fae0 2024-09-10T07:39:52.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.640+0000 7ff852a00640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff83c06be30 0x7ff83c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:52.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.640+0000 7ff852a00640 1 -- 172.21.15.99:0/3234875717 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7ff84c0ab870 con 0x7ff85c13fae0 2024-09-10T07:39:52.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.640+0000 7ff859e00640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff83c06be30 0x7ff83c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:52.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.640+0000 7ff859e00640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff83c06be30 0x7ff83c06e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff85c146300 tx=0x7ff848009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:52.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.644+0000 7ff852a00640 1 -- 172.21.15.99:0/3234875717 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff84c045360 con 0x7ff85c13fae0 2024-09-10T07:39:52.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.820+0000 7ff861400640 1 -- 172.21.15.99:0/3234875717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff85c06f1b0 con 0x7ff85c13fae0 2024-09-10T07:39:52.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.821+0000 7ff852a00640 1 -- 172.21.15.99:0/3234875717 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+16669 (secure 0 0 0) 0x7ff84c07a180 con 0x7ff85c13fae0 2024-09-10T07:39:52.822 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:52.822 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":124,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:39:51.849897+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:39:49.623236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T07:39:50.847068+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:39:52.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 -- 172.21.15.99:0/3234875717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff83c06be30 msgr2=0x7ff83c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff83c06be30 0x7ff83c06e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff85c146300 tx=0x7ff848009040 comp rx=0 tx=0).stop 2024-09-10T07:39:52.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 -- 172.21.15.99:0/3234875717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff85c13fae0 msgr2=0x7ff85c13e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff85c13fae0 0x7ff85c13e600 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff84c000c00 tx=0x7ff84c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 -- 172.21.15.99:0/3234875717 shutdown_connections 2024-09-10T07:39:52.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff85c160c50 0x7ff85c072d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff85c142150 0x7ff85c1f86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff83c06be30 0x7ff83c06e2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 --2- 172.21.15.99:0/3234875717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff85c13fae0 0x7ff85c13e600 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:52.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 -- 172.21.15.99:0/3234875717 >> 172.21.15.99:0/3234875717 conn(0x7ff85c06bc10 msgr2=0x7ff85c0cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:52.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 -- 172.21.15.99:0/3234875717 shutdown_connections 2024-09-10T07:39:52.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.824+0000 7ff861400640 1 -- 172.21.15.99:0/3234875717 wait complete. 2024-09-10T07:39:52.842 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:39:52.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.995+0000 7f552b400640 1 Processor -- start 2024-09-10T07:39:52.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.995+0000 7f552b400640 1 -- start start 2024-09-10T07:39:52.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.997+0000 7f552b400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f55240ce780 0x7f552406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.997+0000 7f552b400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552406e3d0 con 0x7f5524072f40 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.997+0000 7f552b400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552406e6b0 con 0x7f5524145290 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.997+0000 7f552b400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f552406efe0 con 0x7f55240ce780 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.997+0000 7f551be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5524072f40 0x7f55240b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54318/0 (socket says 172.21.15.99:54318) 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.997+0000 7f551be00640 1 -- 172.21.15.99:0/2574053777 learned_addr learned my addr 172.21.15.99:0/2574053777 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.997+0000 7f5529400640 1 --2- 172.21.15.99:0/2574053777 >> v2:172.21.15.187:3300/0 conn(0x7f55240ce780 0x7f552406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.997+0000 7f5523e00640 1 -- 172.21.15.99:0/2574053777 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 39516467 0 0) 0x7f552406e3d0 con 0x7f5524072f40 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.998+0000 7f5523e00640 1 -- 172.21.15.99:0/2574053777 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5508003520 con 0x7f5524072f40 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.998+0000 7f5523e00640 1 -- 172.21.15.99:0/2574053777 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196827429 0 0) 0x7f552406e6b0 con 0x7f5524145290 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.998+0000 7f5523e00640 1 -- 172.21.15.99:0/2574053777 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f552406e3d0 con 0x7f5524145290 2024-09-10T07:39:52.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.998+0000 7f5529400640 1 -- 172.21.15.99:0/2574053777 >> v1:172.21.15.187:6789/0 conn(0x7f5524145290 legacy=0x7f5524072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.998+0000 7f5529400640 1 -- 172.21.15.99:0/2574053777 >> v1:172.21.15.99:6789/0 conn(0x7f5524072f40 legacy=0x7f55240b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:52.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.998+0000 7f5529400640 1 -- 172.21.15.99:0/2574053777 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552406e990 con 0x7f55240ce780 2024-09-10T07:39:53.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.999+0000 7f5529400640 1 --2- 172.21.15.99:0/2574053777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55240ce780 0x7f552406f470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f551c009d90 tx=0x7f551c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8adcb2d1934f3f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:53.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.999+0000 7f5523e00640 1 -- 172.21.15.99:0/2574053777 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c007740 con 0x7f55240ce780 2024-09-10T07:39:53.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.999+0000 7f5523e00640 1 -- 172.21.15.99:0/2574053777 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c0078e0 con 0x7f55240ce780 2024-09-10T07:39:53.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.999+0000 7f5523e00640 1 -- 172.21.15.99:0/2574053777 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c007c90 con 0x7f55240ce780 2024-09-10T07:39:53.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.999+0000 7f552b400640 1 -- 172.21.15.99:0/2574053777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55240ce780 msgr2=0x7f552406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:53.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:52.999+0000 7f552b400640 1 --2- 172.21.15.99:0/2574053777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55240ce780 0x7f552406f470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f551c009d90 tx=0x7f551c02a6f0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.000+0000 7f552b400640 1 -- 172.21.15.99:0/2574053777 shutdown_connections 2024-09-10T07:39:53.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.000+0000 7f552b400640 1 --2- 172.21.15.99:0/2574053777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55240ce780 0x7f552406f470 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.000+0000 7f552b400640 1 -- 172.21.15.99:0/2574053777 >> 172.21.15.99:0/2574053777 conn(0x7f552406bc10 msgr2=0x7f552406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:53.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.000+0000 7f552b400640 1 -- 172.21.15.99:0/2574053777 shutdown_connections 2024-09-10T07:39:53.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.000+0000 7f552b400640 1 -- 172.21.15.99:0/2574053777 wait complete. 2024-09-10T07:39:53.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.001+0000 7f552b400640 1 Processor -- start 2024-09-10T07:39:53.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.001+0000 7f552b400640 1 -- start start 2024-09-10T07:39:53.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.002+0000 7f552b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5524072f40 0x7f5524144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:53.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.002+0000 7f552b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55240ce780 0x7f552414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:53.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.002+0000 7f552b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5524145290 0x7f55240cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.002+0000 7f552b400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f552406df80 con 0x7f5524072f40 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.002+0000 7f552b400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5524145670 con 0x7f5524145290 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.002+0000 7f552b400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f552406e100 con 0x7f55240ce780 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.002+0000 7f5528a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5524072f40 0x7f5524144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.003+0000 7f5528a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5524072f40 0x7f5524144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55418/0 (socket says 172.21.15.99:55418) 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.003+0000 7f5528a00640 1 -- 172.21.15.99:0/1851582476 learned_addr learned my addr 172.21.15.99:0/1851582476 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.003+0000 7f5529400640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5524145290 0x7f55240cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.003+0000 7f551be00640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55240ce780 0x7f552414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.003+0000 7f5528a00640 1 -- 172.21.15.99:0/1851582476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55240ce780 msgr2=0x7f552414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.003+0000 7f5528a00640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55240ce780 0x7f552414d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.003+0000 7f5528a00640 1 -- 172.21.15.99:0/1851582476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5524145290 msgr2=0x7f55240cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:53.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.003+0000 7f5528a00640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5524145290 0x7f55240cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.003+0000 7f5528a00640 1 -- 172.21.15.99:0/1851582476 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552414b160 con 0x7f5524072f40 2024-09-10T07:39:53.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.003+0000 7f5528a00640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5524072f40 0x7f5524144650 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f551400c500 tx=0x7f551400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:53.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.004+0000 7f5521600640 1 -- 172.21.15.99:0/1851582476 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55140052d0 con 0x7f5524072f40 2024-09-10T07:39:53.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.004+0000 7f5521600640 1 -- 172.21.15.99:0/1851582476 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514005490 con 0x7f5524072f40 2024-09-10T07:39:53.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.004+0000 7f5521600640 1 -- 172.21.15.99:0/1851582476 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514012870 con 0x7f5524072f40 2024-09-10T07:39:53.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.004+0000 7f552b400640 1 -- 172.21.15.99:0/1851582476 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552414b440 con 0x7f5524072f40 2024-09-10T07:39:53.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.004+0000 7f552b400640 1 -- 172.21.15.99:0/1851582476 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552414ba00 con 0x7f5524072f40 2024-09-10T07:39:53.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.005+0000 7f552b400640 1 -- 172.21.15.99:0/1851582476 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55240715a0 con 0x7f5524072f40 2024-09-10T07:39:53.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.006+0000 7f5521600640 1 -- 172.21.15.99:0/1851582476 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5514012a10 con 0x7f5524072f40 2024-09-10T07:39:53.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.006+0000 7f5521600640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f550006be60 0x7f550006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:53.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.007+0000 7f5521600640 1 -- 172.21.15.99:0/1851582476 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f551408aa30 con 0x7f5524072f40 2024-09-10T07:39:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.007+0000 7f551be00640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f550006be60 0x7f550006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.007+0000 7f551be00640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f550006be60 0x7f550006e320 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f552415e590 tx=0x7f550c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:53.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.011+0000 7f5521600640 1 -- 172.21.15.99:0/1851582476 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5514058d00 con 0x7f5524072f40 2024-09-10T07:39:53.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.187+0000 7f552b400640 1 -- 172.21.15.99:0/1851582476 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f552415df20 con 0x7f5524072f40 2024-09-10T07:39:53.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.188+0000 7f5521600640 1 -- 172.21.15.99:0/1851582476 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+16669 (secure 0 0 0) 0x7f551405d000 con 0x7f5524072f40 2024-09-10T07:39:53.188 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:53.188 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":124,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:39:51.849897+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:39:49.623236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T07:39:50.847068+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:39:53.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 -- 172.21.15.99:0/1851582476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f550006be60 msgr2=0x7f550006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:53.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f550006be60 0x7f550006e320 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f552415e590 tx=0x7f550c007d30 comp rx=0 tx=0).stop 2024-09-10T07:39:53.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 -- 172.21.15.99:0/1851582476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5524072f40 msgr2=0x7f5524144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:53.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5524072f40 0x7f5524144650 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f551400c500 tx=0x7f551400c9c0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 -- 172.21.15.99:0/1851582476 shutdown_connections 2024-09-10T07:39:53.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5524145290 0x7f55240cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55240ce780 0x7f552414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f550006be60 0x7f550006e320 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 --2- 172.21.15.99:0/1851582476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5524072f40 0x7f5524144650 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 -- 172.21.15.99:0/1851582476 >> 172.21.15.99:0/1851582476 conn(0x7f552406bc10 msgr2=0x7f552415bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:53.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 -- 172.21.15.99:0/1851582476 shutdown_connections 2024-09-10T07:39:53.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.190+0000 7f552b400640 1 -- 172.21.15.99:0/1851582476 wait complete. 2024-09-10T07:39:53.207 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:39:53.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.363+0000 7f139b400640 1 Processor -- start 2024-09-10T07:39:53.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.364+0000 7f139b400640 1 -- start start 2024-09-10T07:39:53.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f139b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f139406e280 0x7f1394073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:53.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f139b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13940d1010 0x7f13940ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:53.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f139b400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13940722d0 con 0x7f1394071df0 2024-09-10T07:39:53.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f139b400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f13940738b0 con 0x7f139406e280 2024-09-10T07:39:53.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f139b400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f13940725b0 con 0x7f13940d1010 2024-09-10T07:39:53.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f1398a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f139406e280 0x7f1394073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:53.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f1398a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f139406e280 0x7f1394073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55428/0 (socket says 172.21.15.99:55428) 2024-09-10T07:39:53.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f1398a00640 1 -- 172.21.15.99:0/2704243214 learned_addr learned my addr 172.21.15.99:0/2704243214 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:53.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f1399400640 1 --2- 172.21.15.99:0/2704243214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13940d1010 0x7f13940ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:53.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f1398a00640 1 -- 172.21.15.99:0/2704243214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13940d1010 msgr2=0x7f13940ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:53.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f1398a00640 1 --2- 172.21.15.99:0/2704243214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13940d1010 0x7f13940ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f1398a00640 1 -- 172.21.15.99:0/2704243214 >> v1:172.21.15.187:6789/0 conn(0x7f1394071df0 legacy=0x7f139406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:53.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f1398a00640 1 -- 172.21.15.99:0/2704243214 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1394072890 con 0x7f139406e280 2024-09-10T07:39:53.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.365+0000 7f1399400640 1 --2- 172.21.15.99:0/2704243214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13940d1010 0x7f13940ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:53.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.366+0000 7f1398a00640 1 --2- 172.21.15.99:0/2704243214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f139406e280 0x7f1394073370 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1384009870 tx=0x7f138402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc6b1ed547ca75b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:53.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f1393e00640 1 -- 172.21.15.99:0/2704243214 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384037070 con 0x7f139406e280 2024-09-10T07:39:53.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f1393e00640 1 -- 172.21.15.99:0/2704243214 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1384032440 con 0x7f139406e280 2024-09-10T07:39:53.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f1393e00640 1 -- 172.21.15.99:0/2704243214 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384032810 con 0x7f139406e280 2024-09-10T07:39:53.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f139b400640 1 -- 172.21.15.99:0/2704243214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f139406e280 msgr2=0x7f1394073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:53.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f139b400640 1 --2- 172.21.15.99:0/2704243214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f139406e280 0x7f1394073370 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1384009870 tx=0x7f138402a210 comp rx=0 tx=0).stop 2024-09-10T07:39:53.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f139b400640 1 -- 172.21.15.99:0/2704243214 shutdown_connections 2024-09-10T07:39:53.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f139b400640 1 --2- 172.21.15.99:0/2704243214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13940d1010 0x7f13940ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f139b400640 1 --2- 172.21.15.99:0/2704243214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f139406e280 0x7f1394073370 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f139b400640 1 -- 172.21.15.99:0/2704243214 >> 172.21.15.99:0/2704243214 conn(0x7f139406bc10 msgr2=0x7f139406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:53.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f139b400640 1 -- 172.21.15.99:0/2704243214 shutdown_connections 2024-09-10T07:39:53.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.367+0000 7f139b400640 1 -- 172.21.15.99:0/2704243214 wait complete. 2024-09-10T07:39:53.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.369+0000 7f139b400640 1 Processor -- start 2024-09-10T07:39:53.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.369+0000 7f139b400640 1 -- start start 2024-09-10T07:39:53.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f139b400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f139406e280 0x7f13940c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f139b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1394071df0 0x7f13940c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f139b400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13940d1010 0x7f13941f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f139b400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f139415db60 con 0x7f1394071df0 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f139b400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1394072e50 con 0x7f13940d1010 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f139b400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f13940d14c0 con 0x7f139406e280 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f138be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1394071df0 0x7f13940c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f138be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1394071df0 0x7f13940c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55438/0 (socket says 172.21.15.99:55438) 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f138be00640 1 -- 172.21.15.99:0/1592114799 learned_addr learned my addr 172.21.15.99:0/1592114799 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f1399400640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13940d1010 0x7f13941f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.370+0000 7f1398a00640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f139406e280 0x7f13940c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f138be00640 1 -- 172.21.15.99:0/1592114799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f139406e280 msgr2=0x7f13940c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f138be00640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f139406e280 0x7f13940c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f138be00640 1 -- 172.21.15.99:0/1592114799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13940d1010 msgr2=0x7f13941f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f138be00640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13940d1010 0x7f13941f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f138be00640 1 -- 172.21.15.99:0/1592114799 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13941588f0 con 0x7f1394071df0 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f1398a00640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f139406e280 0x7f13940c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f1399400640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13940d1010 0x7f13941f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f138be00640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1394071df0 0x7f13940c61f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f137c00c430 tx=0x7f137c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f1391600640 1 -- 172.21.15.99:0/1592114799 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c011790 con 0x7f1394071df0 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f1391600640 1 -- 172.21.15.99:0/1592114799 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f137c017070 con 0x7f1394071df0 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f1391600640 1 -- 172.21.15.99:0/1592114799 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c011bb0 con 0x7f1394071df0 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f139b400640 1 -- 172.21.15.99:0/1592114799 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13940ab3d0 con 0x7f1394071df0 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.371+0000 7f139b400640 1 -- 172.21.15.99:0/1592114799 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13940ab990 con 0x7f1394071df0 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.372+0000 7f139b400640 1 -- 172.21.15.99:0/1592114799 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1394076190 con 0x7f1394071df0 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.373+0000 7f1391600640 1 -- 172.21.15.99:0/1592114799 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f137c01c460 con 0x7f1394071df0 2024-09-10T07:39:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.374+0000 7f1391600640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f137006be30 0x7f137006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:53.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.374+0000 7f1391600640 1 -- 172.21.15.99:0/1592114799 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f137c08ad50 con 0x7f1394071df0 2024-09-10T07:39:53.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.374+0000 7f1398a00640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f137006be30 0x7f137006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:53.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.375+0000 7f1398a00640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f137006be30 0x7f137006e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1384034000 tx=0x7f138402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:53.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.378+0000 7f1391600640 1 -- 172.21.15.99:0/1592114799 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1394076190 con 0x7f1394071df0 2024-09-10T07:39:53.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:53.593+0000 7f139b400640 1 -- 172.21.15.99:0/1592114799 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1394073370 con 0x7f1394071df0 2024-09-10T07:39:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.459+0000 7f1391600640 1 -- 172.21.15.99:0/1592114799 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) ==== 118+0+0 (secure 0 0 0) 0x7f137c0596f0 con 0x7f1394071df0 2024-09-10T07:39:54.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.462+0000 7f139b400640 1 -- 172.21.15.99:0/1592114799 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f137006be30 msgr2=0x7f137006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.462+0000 7f139b400640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f137006be30 0x7f137006e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1384034000 tx=0x7f138402e000 comp rx=0 tx=0).stop 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.462+0000 7f139b400640 1 -- 172.21.15.99:0/1592114799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1394071df0 msgr2=0x7f13940c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.462+0000 7f139b400640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1394071df0 0x7f13940c61f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f137c00c430 tx=0x7f137c00c8f0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.462+0000 7f139b400640 1 -- 172.21.15.99:0/1592114799 shutdown_connections 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.462+0000 7f139b400640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13940d1010 0x7f13941f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.462+0000 7f139b400640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f137006be30 0x7f137006e2f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.462+0000 7f139b400640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1394071df0 0x7f13940c61f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.462+0000 7f139b400640 1 --2- 172.21.15.99:0/1592114799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f139406e280 0x7f13940c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.462+0000 7f139b400640 1 -- 172.21.15.99:0/1592114799 >> 172.21.15.99:0/1592114799 conn(0x7f139406bc10 msgr2=0x7f13940d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.463+0000 7f139b400640 1 -- 172.21.15.99:0/1592114799 shutdown_connections 2024-09-10T07:39:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.463+0000 7f139b400640 1 -- 172.21.15.99:0/1592114799 wait complete. 2024-09-10T07:39:54.481 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T07:39:54.481 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:39:54.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.641+0000 7f1228a00640 1 Processor -- start 2024-09-10T07:39:54.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.641+0000 7f1228a00640 1 -- start start 2024-09-10T07:39:54.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f1228a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f122415e970 0x7f12240d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:54.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f1228a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12240d2680 0x7f12240cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:54.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f1228a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12240cfac0 0x7f12240d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:54.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f1228a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f12240d37e0 con 0x7f12240cfac0 2024-09-10T07:39:54.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f1228a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f12240d2bd0 con 0x7f122415e970 2024-09-10T07:39:54.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f1228a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f12240d2eb0 con 0x7f12240d2680 2024-09-10T07:39:54.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f1223e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12240cfac0 0x7f12240d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:54.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f1223e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12240cfac0 0x7f12240d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55448/0 (socket says 172.21.15.99:55448) 2024-09-10T07:39:54.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f1223e00640 1 -- 172.21.15.99:0/2709138542 learned_addr learned my addr 172.21.15.99:0/2709138542 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:54.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f1223400640 1 --2- 172.21.15.99:0/2709138542 >> v2:172.21.15.187:3300/0 conn(0x7f122415e970 0x7f12240d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:54.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.642+0000 7f121be00640 1 --2- 172.21.15.99:0/2709138542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12240d2680 0x7f12240cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:54.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.643+0000 7f1223e00640 1 -- 172.21.15.99:0/2709138542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12240d2680 msgr2=0x7f12240cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:54.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.643+0000 7f1223e00640 1 --2- 172.21.15.99:0/2709138542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12240d2680 0x7f12240cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.643+0000 7f1223e00640 1 -- 172.21.15.99:0/2709138542 >> v2:172.21.15.187:3300/0 conn(0x7f122415e970 msgr2=0x7f12240d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:54.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.643+0000 7f1223e00640 1 --2- 172.21.15.99:0/2709138542 >> v2:172.21.15.187:3300/0 conn(0x7f122415e970 0x7f12240d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.643+0000 7f1223e00640 1 -- 172.21.15.99:0/2709138542 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12240d3190 con 0x7f12240cfac0 2024-09-10T07:39:54.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.643+0000 7f121be00640 1 --2- 172.21.15.99:0/2709138542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12240d2680 0x7f12240cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:54.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.643+0000 7f1223400640 1 --2- 172.21.15.99:0/2709138542 >> v2:172.21.15.187:3300/0 conn(0x7f122415e970 0x7f12240d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:54.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.644+0000 7f1223e00640 1 --2- 172.21.15.99:0/2709138542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 0x7f12240d0ff0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f122406c1c0 tx=0x7f121c02a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b1dd37479dc3f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:54.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.644+0000 7f1222a00640 1 -- 172.21.15.99:0/2709138542 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c036070 con 0x7f12240cfac0 2024-09-10T07:39:54.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.644+0000 7f1222a00640 1 -- 172.21.15.99:0/2709138542 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121c031600 con 0x7f12240cfac0 2024-09-10T07:39:54.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.644+0000 7f1222a00640 1 -- 172.21.15.99:0/2709138542 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c0319d0 con 0x7f12240cfac0 2024-09-10T07:39:54.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.645+0000 7f1228a00640 1 -- 172.21.15.99:0/2709138542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 msgr2=0x7f12240d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:54.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.645+0000 7f1228a00640 1 --2- 172.21.15.99:0/2709138542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 0x7f12240d0ff0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f122406c1c0 tx=0x7f121c02a720 comp rx=0 tx=0).stop 2024-09-10T07:39:54.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.645+0000 7f1228a00640 1 -- 172.21.15.99:0/2709138542 shutdown_connections 2024-09-10T07:39:54.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.645+0000 7f1228a00640 1 --2- 172.21.15.99:0/2709138542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12240d2680 0x7f12240cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.645+0000 7f1228a00640 1 --2- 172.21.15.99:0/2709138542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 0x7f12240d0ff0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.645+0000 7f1228a00640 1 --2- 172.21.15.99:0/2709138542 >> v2:172.21.15.187:3300/0 conn(0x7f122415e970 0x7f12240d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.645+0000 7f1228a00640 1 -- 172.21.15.99:0/2709138542 >> 172.21.15.99:0/2709138542 conn(0x7f122409de00 msgr2=0x7f12240d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:54.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.645+0000 7f1228a00640 1 -- 172.21.15.99:0/2709138542 shutdown_connections 2024-09-10T07:39:54.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.645+0000 7f1228a00640 1 -- 172.21.15.99:0/2709138542 wait complete. 2024-09-10T07:39:54.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.646+0000 7f1228a00640 1 Processor -- start 2024-09-10T07:39:54.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.646+0000 7f1228a00640 1 -- start start 2024-09-10T07:39:54.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.647+0000 7f1228a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 0x7f1224159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:54.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.647+0000 7f1228a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12240d2680 0x7f12240b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:54.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.647+0000 7f1228a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f122415e970 0x7f1224157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:54.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.647+0000 7f1228a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f12240d0840 con 0x7f12240cfac0 2024-09-10T07:39:54.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.647+0000 7f1228a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f12240cff70 con 0x7f12240d2680 2024-09-10T07:39:54.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.647+0000 7f1228a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f122415ed50 con 0x7f122415e970 2024-09-10T07:39:54.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.647+0000 7f1223400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 0x7f1224159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:54.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.647+0000 7f1223400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 0x7f1224159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55452/0 (socket says 172.21.15.99:55452) 2024-09-10T07:39:54.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.647+0000 7f1223400640 1 -- 172.21.15.99:0/3885243325 learned_addr learned my addr 172.21.15.99:0/3885243325 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:54.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f1223e00640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f122415e970 0x7f1224157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:54.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f121be00640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12240d2680 0x7f12240b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:54.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f1223400640 1 -- 172.21.15.99:0/3885243325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f122415e970 msgr2=0x7f1224157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:54.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f1223400640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f122415e970 0x7f1224157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f1223400640 1 -- 172.21.15.99:0/3885243325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12240d2680 msgr2=0x7f12240b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:54.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f1223400640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12240d2680 0x7f12240b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:54.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f1223400640 1 -- 172.21.15.99:0/3885243325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12240b8050 con 0x7f12240cfac0 2024-09-10T07:39:54.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f1223400640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 0x7f1224159bc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f121400e730 tx=0x7f121400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:54.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f121b400640 1 -- 172.21.15.99:0/3885243325 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121400f040 con 0x7f12240cfac0 2024-09-10T07:39:54.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f121b400640 1 -- 172.21.15.99:0/3885243325 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1214004230 con 0x7f12240cfac0 2024-09-10T07:39:54.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f1228a00640 1 -- 172.21.15.99:0/3885243325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12240b8330 con 0x7f12240cfac0 2024-09-10T07:39:54.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.648+0000 7f121b400640 1 -- 172.21.15.99:0/3885243325 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121400ee40 con 0x7f12240cfac0 2024-09-10T07:39:54.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.649+0000 7f1228a00640 1 -- 172.21.15.99:0/3885243325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12240b8e10 con 0x7f12240cfac0 2024-09-10T07:39:54.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.650+0000 7f1228a00640 1 -- 172.21.15.99:0/3885243325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12240cf580 con 0x7f12240cfac0 2024-09-10T07:39:54.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.651+0000 7f121b400640 1 -- 172.21.15.99:0/3885243325 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f121400c670 con 0x7f12240cfac0 2024-09-10T07:39:54.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.652+0000 7f121b400640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f120006be30 0x7f120006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:54.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.652+0000 7f121b400640 1 -- 172.21.15.99:0/3885243325 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7f121408aa30 con 0x7f12240cfac0 2024-09-10T07:39:54.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.652+0000 7f121be00640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f120006be30 0x7f120006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:54.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.653+0000 7f121be00640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f120006be30 0x7f120006e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1224158770 tx=0x7f120c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:54.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.656+0000 7f121b400640 1 -- 172.21.15.99:0/3885243325 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1214017020 con 0x7f12240cfac0 2024-09-10T07:39:54.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:54.866+0000 7f1228a00640 1 -- 172.21.15.99:0/3885243325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f12240b5d60 con 0x7f12240cfac0 2024-09-10T07:39:55.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.466+0000 7f121b400640 1 -- 172.21.15.99:0/3885243325 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v57) ==== 122+0+0 (secure 0 0 0) 0x7f1214059470 con 0x7f12240cfac0 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.468+0000 7f1228a00640 1 -- 172.21.15.99:0/3885243325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f120006be30 msgr2=0x7f120006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.468+0000 7f1228a00640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f120006be30 0x7f120006e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1224158770 tx=0x7f120c008040 comp rx=0 tx=0).stop 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.469+0000 7f1228a00640 1 -- 172.21.15.99:0/3885243325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 msgr2=0x7f1224159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.469+0000 7f1228a00640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 0x7f1224159bc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f121400e730 tx=0x7f121400ebf0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.469+0000 7f1228a00640 1 -- 172.21.15.99:0/3885243325 shutdown_connections 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.469+0000 7f1228a00640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f122415e970 0x7f1224157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.469+0000 7f1228a00640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12240d2680 0x7f12240b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.469+0000 7f1228a00640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f120006be30 0x7f120006e2f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.469+0000 7f1228a00640 1 --2- 172.21.15.99:0/3885243325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12240cfac0 0x7f1224159bc0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.469+0000 7f1228a00640 1 -- 172.21.15.99:0/3885243325 >> 172.21.15.99:0/3885243325 conn(0x7f122409de00 msgr2=0x7f12240d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.469+0000 7f1228a00640 1 -- 172.21.15.99:0/3885243325 shutdown_connections 2024-09-10T07:39:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.469+0000 7f1228a00640 1 -- 172.21.15.99:0/3885243325 wait complete. 2024-09-10T07:39:55.487 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:39:55.487 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:55.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.643+0000 7fc12c000640 1 Processor -- start 2024-09-10T07:39:55.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.644+0000 7fc12c000640 1 -- start start 2024-09-10T07:39:55.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.645+0000 7fc12c000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc12413fae0 0x7fc12406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:55.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.645+0000 7fc12c000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc124142650 con 0x7fc124160c50 2024-09-10T07:39:55.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.645+0000 7fc12c000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc124142930 con 0x7fc124142150 2024-09-10T07:39:55.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.645+0000 7fc12c000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fc1240ce780 con 0x7fc12413fae0 2024-09-10T07:39:55.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.645+0000 7fc12a000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc124160c50 0x7fc1240cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54324/0 (socket says 172.21.15.99:54324) 2024-09-10T07:39:55.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.645+0000 7fc12a000640 1 -- 172.21.15.99:0/2969162935 learned_addr learned my addr 172.21.15.99:0/2969162935 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.645+0000 7fc129600640 1 --2- 172.21.15.99:0/2969162935 >> v2:172.21.15.187:3300/0 conn(0x7fc12413fae0 0x7fc12406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.645+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471455721 0 0) 0x7fc124142650 con 0x7fc124160c50 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc10c003520 con 0x7fc124160c50 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382134236 0 0) 0x7fc124142930 con 0x7fc124142150 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc124142650 con 0x7fc124142150 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2236371856 0 0) 0x7fc10c003520 con 0x7fc124160c50 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 >> v2:172.21.15.187:3300/0 conn(0x7fc12413fae0 msgr2=0x7fc12406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 --2- 172.21.15.99:0/2969162935 >> v2:172.21.15.187:3300/0 conn(0x7fc12413fae0 0x7fc12406f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 >> v1:172.21.15.187:6789/0 conn(0x7fc124142150 legacy=0x7fc124160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc124142c10 con 0x7fc124160c50 2024-09-10T07:39:55.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fc11c0019f0 con 0x7fc124160c50 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 >> v1:172.21.15.99:6789/0 conn(0x7fc124160c50 legacy=0x7fc1240cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c003b40 0x7fc10c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc10c004800 0x7fc10c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10c0051c0 0x7fc10c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c00c0c0 con 0x7fc10c0051c0 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c00c270 con 0x7fc10c004800 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c00c470 con 0x7fc10c003b40 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc12a000640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10c0051c0 0x7fc10c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc129600640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c003b40 0x7fc10c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.646+0000 7fc128c00640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc10c004800 0x7fc10c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.647+0000 7fc12a000640 1 -- 172.21.15.99:0/2969162935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c003b40 msgr2=0x7fc10c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.647+0000 7fc12a000640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c003b40 0x7fc10c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.647+0000 7fc12a000640 1 -- 172.21.15.99:0/2969162935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc10c004800 msgr2=0x7fc10c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:55.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.647+0000 7fc12a000640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc10c004800 0x7fc10c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.647+0000 7fc12a000640 1 -- 172.21.15.99:0/2969162935 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c003520 con 0x7fc10c0051c0 2024-09-10T07:39:55.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.647+0000 7fc12a000640 1 -- 172.21.15.99:0/2969162935 reap_dead start 2024-09-10T07:39:55.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.648+0000 7fc12a000640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10c0051c0 0x7fc10c00b9c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc12406cd10 tx=0x7fc10c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54364b2620640d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:55.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.648+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00a410 con 0x7fc10c0051c0 2024-09-10T07:39:55.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.648+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11c02f070 con 0x7fc10c0051c0 2024-09-10T07:39:55.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.648+0000 7fc123e00640 1 -- 172.21.15.99:0/2969162935 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c02bbe0 con 0x7fc10c0051c0 2024-09-10T07:39:55.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.648+0000 7fc12c000640 1 -- 172.21.15.99:0/2969162935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10c0051c0 msgr2=0x7fc10c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:55.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.648+0000 7fc12c000640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10c0051c0 0x7fc10c00b9c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc12406cd10 tx=0x7fc10c005830 comp rx=0 tx=0).stop 2024-09-10T07:39:55.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.648+0000 7fc12c000640 1 -- 172.21.15.99:0/2969162935 shutdown_connections 2024-09-10T07:39:55.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.648+0000 7fc12c000640 1 --2- 172.21.15.99:0/2969162935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10c0051c0 0x7fc10c00b9c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.648+0000 7fc12c000640 1 -- 172.21.15.99:0/2969162935 >> 172.21.15.99:0/2969162935 conn(0x7fc12406bc10 msgr2=0x7fc12406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:55.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.649+0000 7fc12c000640 1 -- 172.21.15.99:0/2969162935 shutdown_connections 2024-09-10T07:39:55.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.649+0000 7fc12c000640 1 -- 172.21.15.99:0/2969162935 wait complete. 2024-09-10T07:39:55.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.650+0000 7fc12c000640 1 Processor -- start 2024-09-10T07:39:55.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.650+0000 7fc12c000640 1 -- start start 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.651+0000 7fc12c000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c0051c0 0x7fc12415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.651+0000 7fc12c000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc124144f70 0x7fc1241453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.651+0000 7fc12c000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc12413c440 0x7fc12413c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.651+0000 7fc12c000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc1241606c0 con 0x7fc12413c440 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.651+0000 7fc12c000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc124160540 con 0x7fc124144f70 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.651+0000 7fc12c000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc124160840 con 0x7fc10c0051c0 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.651+0000 7fc12a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc12413c440 0x7fc12413c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.651+0000 7fc12a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc12413c440 0x7fc12413c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55474/0 (socket says 172.21.15.99:55474) 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.651+0000 7fc12a000640 1 -- 172.21.15.99:0/2421941102 learned_addr learned my addr 172.21.15.99:0/2421941102 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc129600640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c0051c0 0x7fc12415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc128c00640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc124144f70 0x7fc1241453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc12a000640 1 -- 172.21.15.99:0/2421941102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c0051c0 msgr2=0x7fc12415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc12a000640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c0051c0 0x7fc12415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc12a000640 1 -- 172.21.15.99:0/2421941102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc124144f70 msgr2=0x7fc1241453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc12a000640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc124144f70 0x7fc1241453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc12a000640 1 -- 172.21.15.99:0/2421941102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12415cf50 con 0x7fc12413c440 2024-09-10T07:39:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc128c00640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc124144f70 0x7fc1241453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc12a000640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc12413c440 0x7fc12413c8d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc11c001c70 tx=0x7fc124142820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc121600640 1 -- 172.21.15.99:0/2421941102 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c045070 con 0x7fc12413c440 2024-09-10T07:39:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc121600640 1 -- 172.21.15.99:0/2421941102 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11c00a3f0 con 0x7fc12413c440 2024-09-10T07:39:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc121600640 1 -- 172.21.15.99:0/2421941102 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0406e0 con 0x7fc12413c440 2024-09-10T07:39:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.652+0000 7fc12c000640 1 -- 172.21.15.99:0/2421941102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc12415d210 con 0x7fc12413c440 2024-09-10T07:39:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.653+0000 7fc12c000640 1 -- 172.21.15.99:0/2421941102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc12415d7d0 con 0x7fc12413c440 2024-09-10T07:39:55.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.653+0000 7fc12c000640 1 -- 172.21.15.99:0/2421941102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc12406f1b0 con 0x7fc12413c440 2024-09-10T07:39:55.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.654+0000 7fc121600640 1 -- 172.21.15.99:0/2421941102 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc11c007070 con 0x7fc12413c440 2024-09-10T07:39:55.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.656+0000 7fc121600640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc10406be30 0x7fc10406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:55.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.656+0000 7fc121600640 1 -- 172.21.15.99:0/2421941102 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7fc11c0aab50 con 0x7fc12413c440 2024-09-10T07:39:55.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.656+0000 7fc129600640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc10406be30 0x7fc10406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:55.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.656+0000 7fc129600640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc10406be30 0x7fc10406e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc1241584b0 tx=0x7fc118009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:55.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.660+0000 7fc121600640 1 -- 172.21.15.99:0/2421941102 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc11c079460 con 0x7fc12413c440 2024-09-10T07:39:55.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.867+0000 7fc12c000640 1 -- 172.21.15.99:0/2421941102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc12406e120 con 0x7fc12413c440 2024-09-10T07:39:55.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.867+0000 7fc121600640 1 -- 172.21.15.99:0/2421941102 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7fc11c078d60 con 0x7fc12413c440 2024-09-10T07:39:55.867 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:55.867 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":57,"btime":"2024-09-10T07:39:55:461034+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/269606175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":269606175},{"type":"v1","addr":"172.21.15.187:6834","nonce":269606175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2513906672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2513906672},{"type":"v1","addr":"172.21.15.187:6835","nonce":2513906672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3548731230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3548731230},{"type":"v1","addr":"172.21.15.99:6835","nonce":3548731230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:51.850274+0000","modified":"2024-09-10T07:39:54.867555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/106508261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":106508261},{"type":"v1","addr":"172.21.15.99:6837","nonce":106508261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6465,"qdb_cluster":[6465]},"id":7}]} 2024-09-10T07:39:55.868 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 57 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 -- 172.21.15.99:0/2421941102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc10406be30 msgr2=0x7fc10406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc10406be30 0x7fc10406e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc1241584b0 tx=0x7fc118009190 comp rx=0 tx=0).stop 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 -- 172.21.15.99:0/2421941102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc12413c440 msgr2=0x7fc12413c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc12413c440 0x7fc12413c8d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc11c001c70 tx=0x7fc124142820 comp rx=0 tx=0).stop 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 -- 172.21.15.99:0/2421941102 shutdown_connections 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc10406be30 0x7fc10406e2f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc12413c440 0x7fc12413c8d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc124144f70 0x7fc1241453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 --2- 172.21.15.99:0/2421941102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c0051c0 0x7fc12415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 -- 172.21.15.99:0/2421941102 >> 172.21.15.99:0/2421941102 conn(0x7fc12406bc10 msgr2=0x7fc124072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 -- 172.21.15.99:0/2421941102 shutdown_connections 2024-09-10T07:39:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:55.870+0000 7fc12c000640 1 -- 172.21.15.99:0/2421941102 wait complete. 2024-09-10T07:39:55.886 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:39:56.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.041+0000 7f1bcd600640 1 Processor -- start 2024-09-10T07:39:56.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.041+0000 7f1bcd600640 1 -- start start 2024-09-10T07:39:56.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.042+0000 7f1bcd600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1bc815e970 0x7f1bc80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.042+0000 7f1bcd600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc80d2680 0x7f1bc80cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.042+0000 7f1bcd600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bc80d2bd0 con 0x7f1bc80cfac0 2024-09-10T07:39:56.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.042+0000 7f1bcd600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f1bc80d37e0 con 0x7f1bc815e970 2024-09-10T07:39:56.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.042+0000 7f1bcd600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc80d2eb0 con 0x7f1bc80d2680 2024-09-10T07:39:56.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.043+0000 7f1bccc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1bc80cfac0 0x7f1bc80d0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54332/0 (socket says 172.21.15.99:54332) 2024-09-10T07:39:56.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.043+0000 7f1bccc00640 1 -- 172.21.15.99:0/2290889224 learned_addr learned my addr 172.21.15.99:0/2290889224 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:56.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.043+0000 7f1bc7e00640 1 --2- 172.21.15.99:0/2290889224 >> v2:172.21.15.187:3300/0 conn(0x7f1bc815e970 0x7f1bc80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.043+0000 7f1bc7400640 1 --2- 172.21.15.99:0/2290889224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc80d2680 0x7f1bc80cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.043+0000 7f1bc6a00640 1 -- 172.21.15.99:0/2290889224 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168238823 0 0) 0x7f1bc80d2bd0 con 0x7f1bc80cfac0 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.043+0000 7f1bc6a00640 1 -- 172.21.15.99:0/2290889224 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bac003520 con 0x7f1bc80cfac0 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.043+0000 7f1bc7e00640 1 -- 172.21.15.99:0/2290889224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc80d2680 msgr2=0x7f1bc80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.043+0000 7f1bc7e00640 1 --2- 172.21.15.99:0/2290889224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc80d2680 0x7f1bc80cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.043+0000 7f1bc7e00640 1 -- 172.21.15.99:0/2290889224 >> v1:172.21.15.99:6789/0 conn(0x7f1bc80cfac0 legacy=0x7f1bc80d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.043+0000 7f1bc7e00640 1 -- 172.21.15.99:0/2290889224 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc80d3190 con 0x7f1bc815e970 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.044+0000 7f1bc7e00640 1 --2- 172.21.15.99:0/2290889224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc815e970 0x7f1bc80d0300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80097a0 tx=0x7f1bb802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7672ac096b3058fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bc6a00640 1 -- 172.21.15.99:0/2290889224 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8037070 con 0x7f1bc815e970 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bc6a00640 1 -- 172.21.15.99:0/2290889224 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb8032440 con 0x7f1bc815e970 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bc6a00640 1 -- 172.21.15.99:0/2290889224 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80327f0 con 0x7f1bc815e970 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bcd600640 1 -- 172.21.15.99:0/2290889224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc815e970 msgr2=0x7f1bc80d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bcd600640 1 --2- 172.21.15.99:0/2290889224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc815e970 0x7f1bc80d0300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80097a0 tx=0x7f1bb802a230 comp rx=0 tx=0).stop 2024-09-10T07:39:56.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bcd600640 1 -- 172.21.15.99:0/2290889224 shutdown_connections 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bcd600640 1 --2- 172.21.15.99:0/2290889224 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc80d2680 0x7f1bc80cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bcd600640 1 --2- 172.21.15.99:0/2290889224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc815e970 0x7f1bc80d0300 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bcd600640 1 -- 172.21.15.99:0/2290889224 >> 172.21.15.99:0/2290889224 conn(0x7f1bc809de00 msgr2=0x7f1bc80d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bcd600640 1 -- 172.21.15.99:0/2290889224 shutdown_connections 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.045+0000 7f1bcd600640 1 -- 172.21.15.99:0/2290889224 wait complete. 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.047+0000 7f1bcd600640 1 Processor -- start 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.047+0000 7f1bcd600640 1 -- start start 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bcd600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80cfac0 0x7f1bc80cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bcd600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80d2680 0x7f1bc806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bcd600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc815e970 0x7f1bc806d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bcd600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc80d0840 con 0x7f1bc80cfac0 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bcd600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc80cff70 con 0x7f1bc80d2680 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bcd600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc815ed50 con 0x7f1bc815e970 2024-09-10T07:39:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bc7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80cfac0 0x7f1bc80cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bc7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80cfac0 0x7f1bc80cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55488/0 (socket says 172.21.15.99:55488) 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bc7e00640 1 -- 172.21.15.99:0/3559661230 learned_addr learned my addr 172.21.15.99:0/3559661230 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bc7400640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80d2680 0x7f1bc806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bccc00640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc815e970 0x7f1bc806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bc7e00640 1 -- 172.21.15.99:0/3559661230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc815e970 msgr2=0x7f1bc806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bc7e00640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc815e970 0x7f1bc806d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bc7e00640 1 -- 172.21.15.99:0/3559661230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80d2680 msgr2=0x7f1bc806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bc7e00640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80d2680 0x7f1bc806d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.048+0000 7f1bc7e00640 1 -- 172.21.15.99:0/3559661230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc80cbb80 con 0x7f1bc80cfac0 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.049+0000 7f1bc7e00640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80cfac0 0x7f1bc80cd960 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8035040 tx=0x7f1bb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.049+0000 7f1bbfe00640 1 -- 172.21.15.99:0/3559661230 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8037040 con 0x7f1bc80cfac0 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.049+0000 7f1bbfe00640 1 -- 172.21.15.99:0/3559661230 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb80044c0 con 0x7f1bc80cfac0 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.049+0000 7f1bbfe00640 1 -- 172.21.15.99:0/3559661230 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80325f0 con 0x7f1bc80cfac0 2024-09-10T07:39:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.049+0000 7f1bcd600640 1 -- 172.21.15.99:0/3559661230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc80cbe60 con 0x7f1bc80cfac0 2024-09-10T07:39:56.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.049+0000 7f1bcd600640 1 -- 172.21.15.99:0/3559661230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc80cc420 con 0x7f1bc80cfac0 2024-09-10T07:39:56.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.050+0000 7f1bcd600640 1 -- 172.21.15.99:0/3559661230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc80cf580 con 0x7f1bc80cfac0 2024-09-10T07:39:56.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.051+0000 7f1bbfe00640 1 -- 172.21.15.99:0/3559661230 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bb8044020 con 0x7f1bc80cfac0 2024-09-10T07:39:56.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.052+0000 7f1bbfe00640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1ba806be30 0x7f1ba806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.053+0000 7f1bbfe00640 1 -- 172.21.15.99:0/3559661230 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7f1bb80ab030 con 0x7f1bc80cfac0 2024-09-10T07:39:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.053+0000 7f1bc7400640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1ba806be30 0x7f1ba806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.053+0000 7f1bc7400640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1ba806be30 0x7f1ba806e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1bc809e390 tx=0x7f1bb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:56.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.057+0000 7f1bbfe00640 1 -- 172.21.15.99:0/3559661230 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1bb8079a70 con 0x7f1bc80cfac0 2024-09-10T07:39:56.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.231+0000 7f1bcd600640 1 -- 172.21.15.99:0/3559661230 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bc80c8a00 con 0x7f1bc80cfac0 2024-09-10T07:39:56.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.232+0000 7f1bbfe00640 1 -- 172.21.15.99:0/3559661230 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16656 (secure 0 0 0) 0x7f1bb8079370 con 0x7f1bc80cfac0 2024-09-10T07:39:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:56.233 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":125,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:39:53.436768+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:39:49.623236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T07:39:50.847068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:39:56.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.234+0000 7f1bcd600640 1 -- 172.21.15.99:0/3559661230 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1ba806be30 msgr2=0x7f1ba806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.234+0000 7f1bcd600640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1ba806be30 0x7f1ba806e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1bc809e390 tx=0x7f1bb4008040 comp rx=0 tx=0).stop 2024-09-10T07:39:56.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.234+0000 7f1bcd600640 1 -- 172.21.15.99:0/3559661230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80cfac0 msgr2=0x7f1bc80cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.234+0000 7f1bcd600640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80cfac0 0x7f1bc80cd960 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8035040 tx=0x7f1bb80046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.235+0000 7f1bcd600640 1 -- 172.21.15.99:0/3559661230 shutdown_connections 2024-09-10T07:39:56.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.235+0000 7f1bcd600640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc815e970 0x7f1bc806d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.235+0000 7f1bcd600640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80d2680 0x7f1bc806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.235+0000 7f1bcd600640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1ba806be30 0x7f1ba806e2f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.235+0000 7f1bcd600640 1 --2- 172.21.15.99:0/3559661230 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80cfac0 0x7f1bc80cd960 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.235+0000 7f1bcd600640 1 -- 172.21.15.99:0/3559661230 >> 172.21.15.99:0/3559661230 conn(0x7f1bc809de00 msgr2=0x7f1bc80c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:56.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.235+0000 7f1bcd600640 1 -- 172.21.15.99:0/3559661230 shutdown_connections 2024-09-10T07:39:56.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.235+0000 7f1bcd600640 1 -- 172.21.15.99:0/3559661230 wait complete. 2024-09-10T07:39:56.251 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:39:56.251 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:39:56.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.405+0000 7fcc78a00640 1 Processor -- start 2024-09-10T07:39:56.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.406+0000 7fcc78a00640 1 -- start start 2024-09-10T07:39:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc78a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcc7415e970 0x7fcc740d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc78a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcc740d2680 0x7fcc740cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc78a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc740d2bd0 con 0x7fcc740cfac0 2024-09-10T07:39:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc78a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcc740d37e0 con 0x7fcc7415e970 2024-09-10T07:39:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc78a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fcc740d2eb0 con 0x7fcc740d2680 2024-09-10T07:39:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc72800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcc7415e970 0x7fcc740d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc72800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcc7415e970 0x7fcc740d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55498/0 (socket says 172.21.15.99:55498) 2024-09-10T07:39:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc72800640 1 -- 172.21.15.99:0/2991587876 learned_addr learned my addr 172.21.15.99:0/2991587876 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:56.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc69e00640 1 --2- 172.21.15.99:0/2991587876 >> v2:172.21.15.187:3300/0 conn(0x7fcc740d2680 0x7fcc740cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc72800640 1 -- 172.21.15.99:0/2991587876 >> v2:172.21.15.187:3300/0 conn(0x7fcc740d2680 msgr2=0x7fcc740cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:56.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc72800640 1 --2- 172.21.15.99:0/2991587876 >> v2:172.21.15.187:3300/0 conn(0x7fcc740d2680 0x7fcc740cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc72800640 1 -- 172.21.15.99:0/2991587876 >> v1:172.21.15.187:6789/0 conn(0x7fcc740cfac0 legacy=0x7fcc740d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.407+0000 7fcc72800640 1 -- 172.21.15.99:0/2991587876 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc740d3190 con 0x7fcc7415e970 2024-09-10T07:39:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.408+0000 7fcc72800640 1 --2- 172.21.15.99:0/2991587876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7415e970 0x7fcc740d0300 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcc7409e530 tx=0x7fcc6402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614a77483a91feda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc71e00640 1 -- 172.21.15.99:0/2991587876 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64037070 con 0x7fcc7415e970 2024-09-10T07:39:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc71e00640 1 -- 172.21.15.99:0/2991587876 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6402ae50 con 0x7fcc7415e970 2024-09-10T07:39:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc71e00640 1 -- 172.21.15.99:0/2991587876 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64032860 con 0x7fcc7415e970 2024-09-10T07:39:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc78a00640 1 -- 172.21.15.99:0/2991587876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7415e970 msgr2=0x7fcc740d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc78a00640 1 --2- 172.21.15.99:0/2991587876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7415e970 0x7fcc740d0300 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcc7409e530 tx=0x7fcc6402a300 comp rx=0 tx=0).stop 2024-09-10T07:39:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc78a00640 1 -- 172.21.15.99:0/2991587876 shutdown_connections 2024-09-10T07:39:56.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc78a00640 1 --2- 172.21.15.99:0/2991587876 >> v2:172.21.15.187:3300/0 conn(0x7fcc740d2680 0x7fcc740cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc78a00640 1 --2- 172.21.15.99:0/2991587876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc7415e970 0x7fcc740d0300 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc78a00640 1 -- 172.21.15.99:0/2991587876 >> 172.21.15.99:0/2991587876 conn(0x7fcc7409de00 msgr2=0x7fcc740d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:56.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc78a00640 1 -- 172.21.15.99:0/2991587876 shutdown_connections 2024-09-10T07:39:56.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.409+0000 7fcc78a00640 1 -- 172.21.15.99:0/2991587876 wait complete. 2024-09-10T07:39:56.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.411+0000 7fcc78a00640 1 Processor -- start 2024-09-10T07:39:56.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.411+0000 7fcc78a00640 1 -- start start 2024-09-10T07:39:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc78a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc740cfac0 0x7fcc74154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc78a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc740d2680 0x7fcc7415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc78a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc7415e970 0x7fcc7415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc78a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740d0840 con 0x7fcc740d2680 2024-09-10T07:39:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc78a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740cff10 con 0x7fcc740cfac0 2024-09-10T07:39:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc78a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7415ed50 con 0x7fcc7415e970 2024-09-10T07:39:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc69e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc740d2680 0x7fcc7415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc69e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc740d2680 0x7fcc7415ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55504/0 (socket says 172.21.15.99:55504) 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc69e00640 1 -- 172.21.15.99:0/3501467483 learned_addr learned my addr 172.21.15.99:0/3501467483 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc72800640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc740cfac0 0x7fcc74154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.412+0000 7fcc73200640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc7415e970 0x7fcc7415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc69e00640 1 -- 172.21.15.99:0/3501467483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc7415e970 msgr2=0x7fcc7415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc69e00640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc7415e970 0x7fcc7415cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc69e00640 1 -- 172.21.15.99:0/3501467483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc740cfac0 msgr2=0x7fcc74154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc69e00640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc740cfac0 0x7fcc74154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc69e00640 1 -- 172.21.15.99:0/3501467483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc740cd560 con 0x7fcc740d2680 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc72800640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc740cfac0 0x7fcc74154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc69e00640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc740d2680 0x7fcc7415ca10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00e9b0 tx=0x7fcc5c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc6b400640 1 -- 172.21.15.99:0/3501467483 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c017070 con 0x7fcc740d2680 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc6b400640 1 -- 172.21.15.99:0/3501467483 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5c00c9a0 con 0x7fcc740d2680 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc6b400640 1 -- 172.21.15.99:0/3501467483 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c00cd90 con 0x7fcc740d2680 2024-09-10T07:39:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc78a00640 1 -- 172.21.15.99:0/3501467483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc740b9a90 con 0x7fcc740d2680 2024-09-10T07:39:56.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.413+0000 7fcc78a00640 1 -- 172.21.15.99:0/3501467483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc740ba050 con 0x7fcc740d2680 2024-09-10T07:39:56.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.415+0000 7fcc78a00640 1 -- 172.21.15.99:0/3501467483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc740cf580 con 0x7fcc740d2680 2024-09-10T07:39:56.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.415+0000 7fcc6b400640 1 -- 172.21.15.99:0/3501467483 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc5c01a070 con 0x7fcc740d2680 2024-09-10T07:39:56.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.416+0000 7fcc6b400640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.416+0000 7fcc6b400640 1 -- 172.21.15.99:0/3501467483 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7fcc5c08b130 con 0x7fcc740d2680 2024-09-10T07:39:56.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.417+0000 7fcc72800640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.417+0000 7fcc72800640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc5006be30 0x7fcc5006e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcc64034000 tx=0x7fcc6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:56.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.421+0000 7fcc6b400640 1 -- 172.21.15.99:0/3501467483 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc5c059490 con 0x7fcc740d2680 2024-09-10T07:39:56.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.592+0000 7fcc78a00640 1 -- 172.21.15.99:0/3501467483 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc74155150 con 0x7fcc5006be30 2024-09-10T07:39:56.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.598+0000 7fcc6b400640 1 -- 172.21.15.99:0/3501467483 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247955 (secure 0 0 0) 0x7fcc6407e8b0 con 0x7fcc5006be30 2024-09-10T07:39:56.602 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:56.603 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:39:56.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.602+0000 7fcc78a00640 1 -- 172.21.15.99:0/3501467483 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc5006be30 msgr2=0x7fcc5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.602+0000 7fcc78a00640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc5006be30 0x7fcc5006e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcc64034000 tx=0x7fcc6402e000 comp rx=0 tx=0).stop 2024-09-10T07:39:56.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.602+0000 7fcc78a00640 1 -- 172.21.15.99:0/3501467483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc740d2680 msgr2=0x7fcc7415ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.602+0000 7fcc78a00640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc740d2680 0x7fcc7415ca10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00e9b0 tx=0x7fcc5c00ee70 comp rx=0 tx=0).stop 2024-09-10T07:39:56.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.603+0000 7fcc78a00640 1 -- 172.21.15.99:0/3501467483 shutdown_connections 2024-09-10T07:39:56.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.603+0000 7fcc78a00640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc7415e970 0x7fcc7415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.603+0000 7fcc78a00640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.603+0000 7fcc78a00640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc740d2680 0x7fcc7415ca10 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.603+0000 7fcc78a00640 1 --2- 172.21.15.99:0/3501467483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc740cfac0 0x7fcc74154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.603+0000 7fcc78a00640 1 -- 172.21.15.99:0/3501467483 >> 172.21.15.99:0/3501467483 conn(0x7fcc7409de00 msgr2=0x7fcc740d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:56.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.603+0000 7fcc78a00640 1 -- 172.21.15.99:0/3501467483 shutdown_connections 2024-09-10T07:39:56.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.603+0000 7fcc78a00640 1 -- 172.21.15.99:0/3501467483 wait complete. 2024-09-10T07:39:56.618 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-09-10T07:39:54.765668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6512,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555987,"statfs":{"total":1600000000,"available":1593331644,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.336917"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441652+0000","last_change":"2024-09-10T07:39:52.459711+0000","last_active":"2024-09-10T07:39:53.441652+0000","last_peered":"2024-09-10T07:39:53.441652+0000","last_clean":"2024-09-10T07:39:53.441652+0000","last_became_active":"2024-09-10T07:39:52.459144+0000","last_became_peered":"2024-09-10T07:39:52.459144+0000","last_unstale":"2024-09-10T07:39:53.441652+0000","last_undegraded":"2024-09-10T07:39:53.441652+0000","last_fullsized":"2024-09-10T07:39:53.441652+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:10.395094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440603+0000","last_change":"2024-09-10T07:39:52.451626+0000","last_active":"2024-09-10T07:39:53.440603+0000","last_peered":"2024-09-10T07:39:53.440603+0000","last_clean":"2024-09-10T07:39:53.440603+0000","last_became_active":"2024-09-10T07:39:52.451119+0000","last_became_peered":"2024-09-10T07:39:52.451119+0000","last_unstale":"2024-09-10T07:39:53.440603+0000","last_undegraded":"2024-09-10T07:39:53.440603+0000","last_fullsized":"2024-09-10T07:39:53.440603+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:54.012372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441615+0000","last_change":"2024-09-10T07:39:52.461224+0000","last_active":"2024-09-10T07:39:53.441615+0000","last_peered":"2024-09-10T07:39:53.441615+0000","last_clean":"2024-09-10T07:39:53.441615+0000","last_became_active":"2024-09-10T07:39:52.459269+0000","last_became_peered":"2024-09-10T07:39:52.459269+0000","last_unstale":"2024-09-10T07:39:53.441615+0000","last_undegraded":"2024-09-10T07:39:53.441615+0000","last_fullsized":"2024-09-10T07:39:53.441615+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:08.309118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455284+0000","last_change":"2024-09-10T07:39:52.454307+0000","last_active":"2024-09-10T07:39:52.455284+0000","last_peered":"2024-09-10T07:39:52.455284+0000","last_clean":"2024-09-10T07:39:52.455284+0000","last_became_active":"2024-09-10T07:39:52.448678+0000","last_became_peered":"2024-09-10T07:39:52.448678+0000","last_unstale":"2024-09-10T07:39:52.455284+0000","last_undegraded":"2024-09-10T07:39:52.455284+0000","last_fullsized":"2024-09-10T07:39:52.455284+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:59.121028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.457000+0000","last_change":"2024-09-10T07:39:52.456786+0000","last_active":"2024-09-10T07:39:52.457000+0000","last_peered":"2024-09-10T07:39:52.457000+0000","last_clean":"2024-09-10T07:39:52.457000+0000","last_became_active":"2024-09-10T07:39:52.456536+0000","last_became_peered":"2024-09-10T07:39:52.456536+0000","last_unstale":"2024-09-10T07:39:52.457000+0000","last_undegraded":"2024-09-10T07:39:52.457000+0000","last_fullsized":"2024-09-10T07:39:52.457000+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:17.660052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.444698+0000","last_change":"2024-09-10T07:39:52.444433+0000","last_active":"2024-09-10T07:39:52.444698+0000","last_peered":"2024-09-10T07:39:52.444698+0000","last_clean":"2024-09-10T07:39:52.444698+0000","last_became_active":"2024-09-10T07:39:52.444126+0000","last_became_peered":"2024-09-10T07:39:52.444126+0000","last_unstale":"2024-09-10T07:39:52.444698+0000","last_undegraded":"2024-09-10T07:39:52.444698+0000","last_fullsized":"2024-09-10T07:39:52.444698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:31.662473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.444681+0000","last_change":"2024-09-10T07:39:52.443559+0000","last_active":"2024-09-10T07:39:52.444681+0000","last_peered":"2024-09-10T07:39:52.444681+0000","last_clean":"2024-09-10T07:39:52.444681+0000","last_became_active":"2024-09-10T07:39:52.443264+0000","last_became_peered":"2024-09-10T07:39:52.443264+0000","last_unstale":"2024-09-10T07:39:52.444681+0000","last_undegraded":"2024-09-10T07:39:52.444681+0000","last_fullsized":"2024-09-10T07:39:52.444681+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:54.917209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440589+0000","last_change":"2024-09-10T07:39:52.450050+0000","last_active":"2024-09-10T07:39:53.440589+0000","last_peered":"2024-09-10T07:39:53.440589+0000","last_clean":"2024-09-10T07:39:53.440589+0000","last_became_active":"2024-09-10T07:39:52.448973+0000","last_became_peered":"2024-09-10T07:39:52.448973+0000","last_unstale":"2024-09-10T07:39:53.440589+0000","last_undegraded":"2024-09-10T07:39:53.440589+0000","last_fullsized":"2024-09-10T07:39:53.440589+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:52.447914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.459015+0000","last_change":"2024-09-10T07:39:52.458891+0000","last_active":"2024-09-10T07:39:52.459015+0000","last_peered":"2024-09-10T07:39:52.459015+0000","last_clean":"2024-09-10T07:39:52.459015+0000","last_became_active":"2024-09-10T07:39:52.458645+0000","last_became_peered":"2024-09-10T07:39:52.458645+0000","last_unstale":"2024-09-10T07:39:52.459015+0000","last_undegraded":"2024-09-10T07:39:52.459015+0000","last_fullsized":"2024-09-10T07:39:52.459015+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:22.735161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.460188+0000","last_change":"2024-09-10T07:39:52.460092+0000","last_active":"2024-09-10T07:39:52.460188+0000","last_peered":"2024-09-10T07:39:52.460188+0000","last_clean":"2024-09-10T07:39:52.460188+0000","last_became_active":"2024-09-10T07:39:52.459824+0000","last_became_peered":"2024-09-10T07:39:52.459824+0000","last_unstale":"2024-09-10T07:39:52.460188+0000","last_undegraded":"2024-09-10T07:39:52.460188+0000","last_fullsized":"2024-09-10T07:39:52.460188+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:10.471561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455986+0000","last_change":"2024-09-10T07:39:52.455722+0000","last_active":"2024-09-10T07:39:52.455986+0000","last_peered":"2024-09-10T07:39:52.455986+0000","last_clean":"2024-09-10T07:39:52.455986+0000","last_became_active":"2024-09-10T07:39:52.455088+0000","last_became_peered":"2024-09-10T07:39:52.455088+0000","last_unstale":"2024-09-10T07:39:52.455986+0000","last_undegraded":"2024-09-10T07:39:52.455986+0000","last_fullsized":"2024-09-10T07:39:52.455986+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:40.027505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.462086+0000","last_change":"2024-09-10T07:39:52.461936+0000","last_active":"2024-09-10T07:39:52.462086+0000","last_peered":"2024-09-10T07:39:52.462086+0000","last_clean":"2024-09-10T07:39:52.462086+0000","last_became_active":"2024-09-10T07:39:52.461676+0000","last_became_peered":"2024-09-10T07:39:52.461676+0000","last_unstale":"2024-09-10T07:39:52.462086+0000","last_undegraded":"2024-09-10T07:39:52.462086+0000","last_fullsized":"2024-09-10T07:39:52.462086+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:52.536660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455204+0000","last_change":"2024-09-10T07:39:52.450997+0000","last_active":"2024-09-10T07:39:52.455204+0000","last_peered":"2024-09-10T07:39:52.455204+0000","last_clean":"2024-09-10T07:39:52.455204+0000","last_became_active":"2024-09-10T07:39:52.450151+0000","last_became_peered":"2024-09-10T07:39:52.450151+0000","last_unstale":"2024-09-10T07:39:52.455204+0000","last_undegraded":"2024-09-10T07:39:52.455204+0000","last_fullsized":"2024-09-10T07:39:52.455204+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:03.705488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456628+0000","last_change":"2024-09-10T07:39:52.453616+0000","last_active":"2024-09-10T07:39:53.456628+0000","last_peered":"2024-09-10T07:39:53.456628+0000","last_clean":"2024-09-10T07:39:53.456628+0000","last_became_active":"2024-09-10T07:39:52.452917+0000","last_became_peered":"2024-09-10T07:39:52.452917+0000","last_unstale":"2024-09-10T07:39:53.456628+0000","last_undegraded":"2024-09-10T07:39:53.456628+0000","last_fullsized":"2024-09-10T07:39:53.456628+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:19.939947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.460493+0000","last_change":"2024-09-10T07:39:52.460386+0000","last_active":"2024-09-10T07:39:52.460493+0000","last_peered":"2024-09-10T07:39:52.460493+0000","last_clean":"2024-09-10T07:39:52.460493+0000","last_became_active":"2024-09-10T07:39:52.459805+0000","last_became_peered":"2024-09-10T07:39:52.459805+0000","last_unstale":"2024-09-10T07:39:52.460493+0000","last_undegraded":"2024-09-10T07:39:52.460493+0000","last_fullsized":"2024-09-10T07:39:52.460493+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:48.209419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.449887+0000","last_change":"2024-09-10T07:39:52.449211+0000","last_active":"2024-09-10T07:39:52.449887+0000","last_peered":"2024-09-10T07:39:52.449887+0000","last_clean":"2024-09-10T07:39:52.449887+0000","last_became_active":"2024-09-10T07:39:52.448898+0000","last_became_peered":"2024-09-10T07:39:52.448898+0000","last_unstale":"2024-09-10T07:39:52.449887+0000","last_undegraded":"2024-09-10T07:39:52.449887+0000","last_fullsized":"2024-09-10T07:39:52.449887+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:20.152296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440737+0000","last_change":"2024-09-10T07:39:52.457355+0000","last_active":"2024-09-10T07:39:53.440737+0000","last_peered":"2024-09-10T07:39:53.440737+0000","last_clean":"2024-09-10T07:39:53.440737+0000","last_became_active":"2024-09-10T07:39:52.457147+0000","last_became_peered":"2024-09-10T07:39:52.457147+0000","last_unstale":"2024-09-10T07:39:53.440737+0000","last_undegraded":"2024-09-10T07:39:53.440737+0000","last_fullsized":"2024-09-10T07:39:53.440737+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:24.260785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455226+0000","last_change":"2024-09-10T07:39:52.451271+0000","last_active":"2024-09-10T07:39:52.455226+0000","last_peered":"2024-09-10T07:39:52.455226+0000","last_clean":"2024-09-10T07:39:52.455226+0000","last_became_active":"2024-09-10T07:39:52.450457+0000","last_became_peered":"2024-09-10T07:39:52.450457+0000","last_unstale":"2024-09-10T07:39:52.455226+0000","last_undegraded":"2024-09-10T07:39:52.455226+0000","last_fullsized":"2024-09-10T07:39:52.455226+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:41.864473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456760+0000","last_change":"2024-09-10T07:39:52.462641+0000","last_active":"2024-09-10T07:39:53.456760+0000","last_peered":"2024-09-10T07:39:53.456760+0000","last_clean":"2024-09-10T07:39:53.456760+0000","last_became_active":"2024-09-10T07:39:52.462401+0000","last_became_peered":"2024-09-10T07:39:52.462401+0000","last_unstale":"2024-09-10T07:39:53.456760+0000","last_undegraded":"2024-09-10T07:39:53.456760+0000","last_fullsized":"2024-09-10T07:39:53.456760+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:36.814517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.453557+0000","last_change":"2024-09-10T07:39:52.452465+0000","last_active":"2024-09-10T07:39:52.453557+0000","last_peered":"2024-09-10T07:39:52.453557+0000","last_clean":"2024-09-10T07:39:52.453557+0000","last_became_active":"2024-09-10T07:39:52.452206+0000","last_became_peered":"2024-09-10T07:39:52.452206+0000","last_unstale":"2024-09-10T07:39:52.453557+0000","last_undegraded":"2024-09-10T07:39:52.453557+0000","last_fullsized":"2024-09-10T07:39:52.453557+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:47.071871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456845+0000","last_change":"2024-09-10T07:39:52.442293+0000","last_active":"2024-09-10T07:39:53.456845+0000","last_peered":"2024-09-10T07:39:53.456845+0000","last_clean":"2024-09-10T07:39:53.456845+0000","last_became_active":"2024-09-10T07:39:52.442044+0000","last_became_peered":"2024-09-10T07:39:52.442044+0000","last_unstale":"2024-09-10T07:39:53.456845+0000","last_undegraded":"2024-09-10T07:39:53.456845+0000","last_fullsized":"2024-09-10T07:39:53.456845+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:15.758207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440849+0000","last_change":"2024-09-10T07:39:52.452088+0000","last_active":"2024-09-10T07:39:53.440849+0000","last_peered":"2024-09-10T07:39:53.440849+0000","last_clean":"2024-09-10T07:39:53.440849+0000","last_became_active":"2024-09-10T07:39:52.451407+0000","last_became_peered":"2024-09-10T07:39:52.451407+0000","last_unstale":"2024-09-10T07:39:53.440849+0000","last_undegraded":"2024-09-10T07:39:53.440849+0000","last_fullsized":"2024-09-10T07:39:53.440849+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:31.662124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440741+0000","last_change":"2024-09-10T07:39:52.450298+0000","last_active":"2024-09-10T07:39:53.440741+0000","last_peered":"2024-09-10T07:39:53.440741+0000","last_clean":"2024-09-10T07:39:53.440741+0000","last_became_active":"2024-09-10T07:39:52.449828+0000","last_became_peered":"2024-09-10T07:39:52.449828+0000","last_unstale":"2024-09-10T07:39:53.440741+0000","last_undegraded":"2024-09-10T07:39:53.440741+0000","last_fullsized":"2024-09-10T07:39:53.440741+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:09.701628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.457760+0000","last_change":"2024-09-10T07:39:52.457619+0000","last_active":"2024-09-10T07:39:52.457760+0000","last_peered":"2024-09-10T07:39:52.457760+0000","last_clean":"2024-09-10T07:39:52.457760+0000","last_became_active":"2024-09-10T07:39:52.457357+0000","last_became_peered":"2024-09-10T07:39:52.457357+0000","last_unstale":"2024-09-10T07:39:52.457760+0000","last_undegraded":"2024-09-10T07:39:52.457760+0000","last_fullsized":"2024-09-10T07:39:52.457760+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:51.518140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.451080+0000","last_change":"2024-09-10T07:39:52.450279+0000","last_active":"2024-09-10T07:39:52.451080+0000","last_peered":"2024-09-10T07:39:52.451080+0000","last_clean":"2024-09-10T07:39:52.451080+0000","last_became_active":"2024-09-10T07:39:52.449925+0000","last_became_peered":"2024-09-10T07:39:52.449925+0000","last_unstale":"2024-09-10T07:39:52.451080+0000","last_undegraded":"2024-09-10T07:39:52.451080+0000","last_fullsized":"2024-09-10T07:39:52.451080+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:15.095533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440793+0000","last_change":"2024-09-10T07:39:52.461724+0000","last_active":"2024-09-10T07:39:53.440793+0000","last_peered":"2024-09-10T07:39:53.440793+0000","last_clean":"2024-09-10T07:39:53.440793+0000","last_became_active":"2024-09-10T07:39:52.461468+0000","last_became_peered":"2024-09-10T07:39:52.461468+0000","last_unstale":"2024-09-10T07:39:53.440793+0000","last_undegraded":"2024-09-10T07:39:53.440793+0000","last_fullsized":"2024-09-10T07:39:53.440793+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:29.474508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.444659+0000","last_change":"2024-09-10T07:39:52.442863+0000","last_active":"2024-09-10T07:39:52.444659+0000","last_peered":"2024-09-10T07:39:52.444659+0000","last_clean":"2024-09-10T07:39:52.444659+0000","last_became_active":"2024-09-10T07:39:52.442507+0000","last_became_peered":"2024-09-10T07:39:52.442507+0000","last_unstale":"2024-09-10T07:39:52.444659+0000","last_undegraded":"2024-09-10T07:39:52.444659+0000","last_fullsized":"2024-09-10T07:39:52.444659+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:22.325020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.451097+0000","last_change":"2024-09-10T07:39:52.450917+0000","last_active":"2024-09-10T07:39:52.451097+0000","last_peered":"2024-09-10T07:39:52.451097+0000","last_clean":"2024-09-10T07:39:52.451097+0000","last_became_active":"2024-09-10T07:39:52.448743+0000","last_became_peered":"2024-09-10T07:39:52.448743+0000","last_unstale":"2024-09-10T07:39:52.451097+0000","last_undegraded":"2024-09-10T07:39:52.451097+0000","last_fullsized":"2024-09-10T07:39:52.451097+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:14.594800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440454+0000","last_change":"2024-09-10T07:39:52.461650+0000","last_active":"2024-09-10T07:39:53.440454+0000","last_peered":"2024-09-10T07:39:53.440454+0000","last_clean":"2024-09-10T07:39:53.440454+0000","last_became_active":"2024-09-10T07:39:52.461431+0000","last_became_peered":"2024-09-10T07:39:52.461431+0000","last_unstale":"2024-09-10T07:39:53.440454+0000","last_undegraded":"2024-09-10T07:39:53.440454+0000","last_fullsized":"2024-09-10T07:39:53.440454+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:47:25.354318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457073+0000","last_change":"2024-09-10T07:39:52.454453+0000","last_active":"2024-09-10T07:39:53.457073+0000","last_peered":"2024-09-10T07:39:53.457073+0000","last_clean":"2024-09-10T07:39:53.457073+0000","last_became_active":"2024-09-10T07:39:52.454213+0000","last_became_peered":"2024-09-10T07:39:52.454213+0000","last_unstale":"2024-09-10T07:39:53.457073+0000","last_undegraded":"2024-09-10T07:39:53.457073+0000","last_fullsized":"2024-09-10T07:39:53.457073+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:30.989871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.457240+0000","last_change":"2024-09-10T07:39:52.457088+0000","last_active":"2024-09-10T07:39:52.457240+0000","last_peered":"2024-09-10T07:39:52.457240+0000","last_clean":"2024-09-10T07:39:52.457240+0000","last_became_active":"2024-09-10T07:39:52.456696+0000","last_became_peered":"2024-09-10T07:39:52.456696+0000","last_unstale":"2024-09-10T07:39:52.457240+0000","last_undegraded":"2024-09-10T07:39:52.457240+0000","last_fullsized":"2024-09-10T07:39:52.457240+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:00.479153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441544+0000","last_change":"2024-09-10T07:39:52.461702+0000","last_active":"2024-09-10T07:39:53.441544+0000","last_peered":"2024-09-10T07:39:53.441544+0000","last_clean":"2024-09-10T07:39:53.441544+0000","last_became_active":"2024-09-10T07:39:52.460781+0000","last_became_peered":"2024-09-10T07:39:52.460781+0000","last_unstale":"2024-09-10T07:39:53.441544+0000","last_undegraded":"2024-09-10T07:39:53.441544+0000","last_fullsized":"2024-09-10T07:39:53.441544+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:11.844832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456898+0000","last_change":"2024-09-10T07:39:52.443683+0000","last_active":"2024-09-10T07:39:53.456898+0000","last_peered":"2024-09-10T07:39:53.456898+0000","last_clean":"2024-09-10T07:39:53.456898+0000","last_became_active":"2024-09-10T07:39:52.443421+0000","last_became_peered":"2024-09-10T07:39:52.443421+0000","last_unstale":"2024-09-10T07:39:53.456898+0000","last_undegraded":"2024-09-10T07:39:53.456898+0000","last_fullsized":"2024-09-10T07:39:53.456898+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:55.369313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"124'4","reported_seq":18,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441070+0000","last_change":"2024-09-10T07:39:51.450327+0000","last_active":"2024-09-10T07:39:53.441070+0000","last_peered":"2024-09-10T07:39:53.441070+0000","last_clean":"2024-09-10T07:39:53.441070+0000","last_became_active":"2024-09-10T07:39:51.449840+0000","last_became_peered":"2024-09-10T07:39:51.449840+0000","last_unstale":"2024-09-10T07:39:53.441070+0000","last_undegraded":"2024-09-10T07:39:53.441070+0000","last_fullsized":"2024-09-10T07:39:53.441070+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:49.478326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455244+0000","last_change":"2024-09-10T07:39:52.451455+0000","last_active":"2024-09-10T07:39:52.455244+0000","last_peered":"2024-09-10T07:39:52.455244+0000","last_clean":"2024-09-10T07:39:52.455244+0000","last_became_active":"2024-09-10T07:39:52.450747+0000","last_became_peered":"2024-09-10T07:39:52.450747+0000","last_unstale":"2024-09-10T07:39:52.455244+0000","last_undegraded":"2024-09-10T07:39:52.455244+0000","last_fullsized":"2024-09-10T07:39:52.455244+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:46.701444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"124'1","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.463966+0000","last_change":"2024-09-10T07:39:51.454830+0000","last_active":"2024-09-10T07:39:52.463966+0000","last_peered":"2024-09-10T07:39:52.463966+0000","last_clean":"2024-09-10T07:39:52.463966+0000","last_became_active":"2024-09-10T07:39:51.454689+0000","last_became_peered":"2024-09-10T07:39:51.454689+0000","last_unstale":"2024-09-10T07:39:52.463966+0000","last_undegraded":"2024-09-10T07:39:52.463966+0000","last_fullsized":"2024-09-10T07:39:52.463966+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:24.704865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441781+0000","last_change":"2024-09-10T07:39:52.459451+0000","last_active":"2024-09-10T07:39:53.441781+0000","last_peered":"2024-09-10T07:39:53.441781+0000","last_clean":"2024-09-10T07:39:53.441781+0000","last_became_active":"2024-09-10T07:39:52.458867+0000","last_became_peered":"2024-09-10T07:39:52.458867+0000","last_unstale":"2024-09-10T07:39:53.441781+0000","last_undegraded":"2024-09-10T07:39:53.441781+0000","last_fullsized":"2024-09-10T07:39:53.441781+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:07.517269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441296+0000","last_change":"2024-09-10T07:39:51.445366+0000","last_active":"2024-09-10T07:39:53.441296+0000","last_peered":"2024-09-10T07:39:53.441296+0000","last_clean":"2024-09-10T07:39:53.441296+0000","last_became_active":"2024-09-10T07:39:51.445052+0000","last_became_peered":"2024-09-10T07:39:51.445052+0000","last_unstale":"2024-09-10T07:39:53.441296+0000","last_undegraded":"2024-09-10T07:39:53.441296+0000","last_fullsized":"2024-09-10T07:39:53.441296+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:42.677459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.452391+0000","last_change":"2024-09-10T07:39:52.450297+0000","last_active":"2024-09-10T07:39:52.452391+0000","last_peered":"2024-09-10T07:39:52.452391+0000","last_clean":"2024-09-10T07:39:52.452391+0000","last_became_active":"2024-09-10T07:39:52.449995+0000","last_became_peered":"2024-09-10T07:39:52.449995+0000","last_unstale":"2024-09-10T07:39:52.452391+0000","last_undegraded":"2024-09-10T07:39:52.452391+0000","last_fullsized":"2024-09-10T07:39:52.452391+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:42.622061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440904+0000","last_change":"2024-09-10T07:39:51.446957+0000","last_active":"2024-09-10T07:39:53.440904+0000","last_peered":"2024-09-10T07:39:53.440904+0000","last_clean":"2024-09-10T07:39:53.440904+0000","last_became_active":"2024-09-10T07:39:51.446387+0000","last_became_peered":"2024-09-10T07:39:51.446387+0000","last_unstale":"2024-09-10T07:39:53.440904+0000","last_undegraded":"2024-09-10T07:39:53.440904+0000","last_fullsized":"2024-09-10T07:39:53.440904+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:21.707896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441099+0000","last_change":"2024-09-10T07:39:52.450668+0000","last_active":"2024-09-10T07:39:53.441099+0000","last_peered":"2024-09-10T07:39:53.441099+0000","last_clean":"2024-09-10T07:39:53.441099+0000","last_became_active":"2024-09-10T07:39:52.450388+0000","last_became_peered":"2024-09-10T07:39:52.450388+0000","last_unstale":"2024-09-10T07:39:53.441099+0000","last_undegraded":"2024-09-10T07:39:53.441099+0000","last_fullsized":"2024-09-10T07:39:53.441099+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.158246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.442032+0000","last_change":"2024-09-10T07:39:51.453685+0000","last_active":"2024-09-10T07:39:53.442032+0000","last_peered":"2024-09-10T07:39:53.442032+0000","last_clean":"2024-09-10T07:39:53.442032+0000","last_became_active":"2024-09-10T07:39:51.453209+0000","last_became_peered":"2024-09-10T07:39:51.453209+0000","last_unstale":"2024-09-10T07:39:53.442032+0000","last_undegraded":"2024-09-10T07:39:53.442032+0000","last_fullsized":"2024-09-10T07:39:53.442032+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:30.714159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.446825+0000","last_change":"2024-09-10T07:39:52.446574+0000","last_active":"2024-09-10T07:39:52.446825+0000","last_peered":"2024-09-10T07:39:52.446825+0000","last_clean":"2024-09-10T07:39:52.446825+0000","last_became_active":"2024-09-10T07:39:52.445868+0000","last_became_peered":"2024-09-10T07:39:52.445868+0000","last_unstale":"2024-09-10T07:39:52.446825+0000","last_undegraded":"2024-09-10T07:39:52.446825+0000","last_fullsized":"2024-09-10T07:39:52.446825+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:57.331119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441189+0000","last_change":"2024-09-10T07:39:51.452042+0000","last_active":"2024-09-10T07:39:53.441189+0000","last_peered":"2024-09-10T07:39:53.441189+0000","last_clean":"2024-09-10T07:39:53.441189+0000","last_became_active":"2024-09-10T07:39:51.451565+0000","last_became_peered":"2024-09-10T07:39:51.451565+0000","last_unstale":"2024-09-10T07:39:53.441189+0000","last_undegraded":"2024-09-10T07:39:53.441189+0000","last_fullsized":"2024-09-10T07:39:53.441189+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:02.821941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.460294+0000","last_change":"2024-09-10T07:39:52.460030+0000","last_active":"2024-09-10T07:39:52.460294+0000","last_peered":"2024-09-10T07:39:52.460294+0000","last_clean":"2024-09-10T07:39:52.460294+0000","last_became_active":"2024-09-10T07:39:52.459489+0000","last_became_peered":"2024-09-10T07:39:52.459489+0000","last_unstale":"2024-09-10T07:39:52.460294+0000","last_undegraded":"2024-09-10T07:39:52.460294+0000","last_fullsized":"2024-09-10T07:39:52.460294+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:23.501070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.446946+0000","last_change":"2024-09-10T07:39:51.449888+0000","last_active":"2024-09-10T07:39:52.446946+0000","last_peered":"2024-09-10T07:39:52.446946+0000","last_clean":"2024-09-10T07:39:52.446946+0000","last_became_active":"2024-09-10T07:39:51.449679+0000","last_became_peered":"2024-09-10T07:39:51.449679+0000","last_unstale":"2024-09-10T07:39:52.446946+0000","last_undegraded":"2024-09-10T07:39:52.446946+0000","last_fullsized":"2024-09-10T07:39:52.446946+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:08.342473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.452414+0000","last_change":"2024-09-10T07:39:52.451141+0000","last_active":"2024-09-10T07:39:52.452414+0000","last_peered":"2024-09-10T07:39:52.452414+0000","last_clean":"2024-09-10T07:39:52.452414+0000","last_became_active":"2024-09-10T07:39:52.450890+0000","last_became_peered":"2024-09-10T07:39:52.450890+0000","last_unstale":"2024-09-10T07:39:52.452414+0000","last_undegraded":"2024-09-10T07:39:52.452414+0000","last_fullsized":"2024-09-10T07:39:52.452414+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:49.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.442281+0000","last_change":"2024-09-10T07:39:51.454608+0000","last_active":"2024-09-10T07:39:53.442281+0000","last_peered":"2024-09-10T07:39:53.442281+0000","last_clean":"2024-09-10T07:39:53.442281+0000","last_became_active":"2024-09-10T07:39:51.454199+0000","last_became_peered":"2024-09-10T07:39:51.454199+0000","last_unstale":"2024-09-10T07:39:53.442281+0000","last_undegraded":"2024-09-10T07:39:53.442281+0000","last_fullsized":"2024-09-10T07:39:53.442281+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:50.305163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440963+0000","last_change":"2024-09-10T07:39:52.452278+0000","last_active":"2024-09-10T07:39:53.440963+0000","last_peered":"2024-09-10T07:39:53.440963+0000","last_clean":"2024-09-10T07:39:53.440963+0000","last_became_active":"2024-09-10T07:39:52.451872+0000","last_became_peered":"2024-09-10T07:39:52.451872+0000","last_unstale":"2024-09-10T07:39:53.440963+0000","last_undegraded":"2024-09-10T07:39:53.440963+0000","last_fullsized":"2024-09-10T07:39:53.440963+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:42.086073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.442072+0000","last_change":"2024-09-10T07:39:51.451833+0000","last_active":"2024-09-10T07:39:53.442072+0000","last_peered":"2024-09-10T07:39:53.442072+0000","last_clean":"2024-09-10T07:39:53.442072+0000","last_became_active":"2024-09-10T07:39:51.451569+0000","last_became_peered":"2024-09-10T07:39:51.451569+0000","last_unstale":"2024-09-10T07:39:53.442072+0000","last_undegraded":"2024-09-10T07:39:53.442072+0000","last_fullsized":"2024-09-10T07:39:53.442072+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:32.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.457127+0000","last_change":"2024-09-10T07:39:52.456849+0000","last_active":"2024-09-10T07:39:52.457127+0000","last_peered":"2024-09-10T07:39:52.457127+0000","last_clean":"2024-09-10T07:39:52.457127+0000","last_became_active":"2024-09-10T07:39:52.456294+0000","last_became_peered":"2024-09-10T07:39:52.456294+0000","last_unstale":"2024-09-10T07:39:52.457127+0000","last_undegraded":"2024-09-10T07:39:52.457127+0000","last_fullsized":"2024-09-10T07:39:52.457127+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:23.966345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.444283+0000","last_change":"2024-09-10T07:39:51.449761+0000","last_active":"2024-09-10T07:39:52.444283+0000","last_peered":"2024-09-10T07:39:52.444283+0000","last_clean":"2024-09-10T07:39:52.444283+0000","last_became_active":"2024-09-10T07:39:51.449542+0000","last_became_peered":"2024-09-10T07:39:51.449542+0000","last_unstale":"2024-09-10T07:39:52.444283+0000","last_undegraded":"2024-09-10T07:39:52.444283+0000","last_fullsized":"2024-09-10T07:39:52.444283+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:52.354702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.451642+0000","last_change":"2024-09-10T07:39:52.451107+0000","last_active":"2024-09-10T07:39:52.451642+0000","last_peered":"2024-09-10T07:39:52.451642+0000","last_clean":"2024-09-10T07:39:52.451642+0000","last_became_active":"2024-09-10T07:39:52.450572+0000","last_became_peered":"2024-09-10T07:39:52.450572+0000","last_unstale":"2024-09-10T07:39:52.451642+0000","last_undegraded":"2024-09-10T07:39:52.451642+0000","last_fullsized":"2024-09-10T07:39:52.451642+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:01.297386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"124'3","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.463974+0000","last_change":"2024-09-10T07:39:51.448449+0000","last_active":"2024-09-10T07:39:52.463974+0000","last_peered":"2024-09-10T07:39:52.463974+0000","last_clean":"2024-09-10T07:39:52.463974+0000","last_became_active":"2024-09-10T07:39:51.448142+0000","last_became_peered":"2024-09-10T07:39:51.448142+0000","last_unstale":"2024-09-10T07:39:52.463974+0000","last_undegraded":"2024-09-10T07:39:52.463974+0000","last_fullsized":"2024-09-10T07:39:52.463974+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:10.578948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.454934+0000","last_change":"2024-09-10T07:39:52.453333+0000","last_active":"2024-09-10T07:39:52.454934+0000","last_peered":"2024-09-10T07:39:52.454934+0000","last_clean":"2024-09-10T07:39:52.454934+0000","last_became_active":"2024-09-10T07:39:52.452880+0000","last_became_peered":"2024-09-10T07:39:52.452880+0000","last_unstale":"2024-09-10T07:39:52.454934+0000","last_undegraded":"2024-09-10T07:39:52.454934+0000","last_fullsized":"2024-09-10T07:39:52.454934+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:40.378350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"124'6","reported_seq":18,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.469102+0000","last_change":"2024-09-10T07:39:51.444342+0000","last_active":"2024-09-10T07:39:52.469102+0000","last_peered":"2024-09-10T07:39:52.469102+0000","last_clean":"2024-09-10T07:39:52.469102+0000","last_became_active":"2024-09-10T07:39:51.443961+0000","last_became_peered":"2024-09-10T07:39:51.443961+0000","last_unstale":"2024-09-10T07:39:52.469102+0000","last_undegraded":"2024-09-10T07:39:52.469102+0000","last_fullsized":"2024-09-10T07:39:52.469102+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:54.012609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455262+0000","last_change":"2024-09-10T07:39:52.451651+0000","last_active":"2024-09-10T07:39:52.455262+0000","last_peered":"2024-09-10T07:39:52.455262+0000","last_clean":"2024-09-10T07:39:52.455262+0000","last_became_active":"2024-09-10T07:39:52.451423+0000","last_became_peered":"2024-09-10T07:39:52.451423+0000","last_unstale":"2024-09-10T07:39:52.455262+0000","last_undegraded":"2024-09-10T07:39:52.455262+0000","last_fullsized":"2024-09-10T07:39:52.455262+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:39.123043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457257+0000","last_change":"2024-09-10T07:39:51.447987+0000","last_active":"2024-09-10T07:39:53.457257+0000","last_peered":"2024-09-10T07:39:53.457257+0000","last_clean":"2024-09-10T07:39:53.457257+0000","last_became_active":"2024-09-10T07:39:51.447081+0000","last_became_peered":"2024-09-10T07:39:51.447081+0000","last_unstale":"2024-09-10T07:39:53.457257+0000","last_undegraded":"2024-09-10T07:39:53.457257+0000","last_fullsized":"2024-09-10T07:39:53.457257+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:12.372208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.442043+0000","last_change":"2024-09-10T07:39:52.453883+0000","last_active":"2024-09-10T07:39:53.442043+0000","last_peered":"2024-09-10T07:39:53.442043+0000","last_clean":"2024-09-10T07:39:53.442043+0000","last_became_active":"2024-09-10T07:39:52.453662+0000","last_became_peered":"2024-09-10T07:39:52.453662+0000","last_unstale":"2024-09-10T07:39:53.442043+0000","last_undegraded":"2024-09-10T07:39:53.442043+0000","last_fullsized":"2024-09-10T07:39:53.442043+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:51.539624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457083+0000","last_change":"2024-09-10T07:39:51.452053+0000","last_active":"2024-09-10T07:39:53.457083+0000","last_peered":"2024-09-10T07:39:53.457083+0000","last_clean":"2024-09-10T07:39:53.457083+0000","last_became_active":"2024-09-10T07:39:51.451835+0000","last_became_peered":"2024-09-10T07:39:51.451835+0000","last_unstale":"2024-09-10T07:39:53.457083+0000","last_undegraded":"2024-09-10T07:39:53.457083+0000","last_fullsized":"2024-09-10T07:39:53.457083+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:49.237588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.452449+0000","last_change":"2024-09-10T07:39:52.451430+0000","last_active":"2024-09-10T07:39:52.452449+0000","last_peered":"2024-09-10T07:39:52.452449+0000","last_clean":"2024-09-10T07:39:52.452449+0000","last_became_active":"2024-09-10T07:39:52.451160+0000","last_became_peered":"2024-09-10T07:39:52.451160+0000","last_unstale":"2024-09-10T07:39:52.452449+0000","last_undegraded":"2024-09-10T07:39:52.452449+0000","last_fullsized":"2024-09-10T07:39:52.452449+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:04.084033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.448914+0000","last_change":"2024-09-10T07:39:51.444543+0000","last_active":"2024-09-10T07:39:52.448914+0000","last_peered":"2024-09-10T07:39:52.448914+0000","last_clean":"2024-09-10T07:39:52.448914+0000","last_became_active":"2024-09-10T07:39:51.444218+0000","last_became_peered":"2024-09-10T07:39:51.444218+0000","last_unstale":"2024-09-10T07:39:52.448914+0000","last_undegraded":"2024-09-10T07:39:52.448914+0000","last_fullsized":"2024-09-10T07:39:52.448914+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:48:06.630564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456946+0000","last_change":"2024-09-10T07:39:52.452884+0000","last_active":"2024-09-10T07:39:53.456946+0000","last_peered":"2024-09-10T07:39:53.456946+0000","last_clean":"2024-09-10T07:39:53.456946+0000","last_became_active":"2024-09-10T07:39:52.451582+0000","last_became_peered":"2024-09-10T07:39:52.451582+0000","last_unstale":"2024-09-10T07:39:53.456946+0000","last_undegraded":"2024-09-10T07:39:53.456946+0000","last_fullsized":"2024-09-10T07:39:53.456946+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:35.464670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"124'8","reported_seq":22,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441830+0000","last_change":"2024-09-10T07:39:51.453483+0000","last_active":"2024-09-10T07:39:53.441830+0000","last_peered":"2024-09-10T07:39:53.441830+0000","last_clean":"2024-09-10T07:39:53.441830+0000","last_became_active":"2024-09-10T07:39:51.453303+0000","last_became_peered":"2024-09-10T07:39:51.453303+0000","last_unstale":"2024-09-10T07:39:53.441830+0000","last_undegraded":"2024-09-10T07:39:53.441830+0000","last_fullsized":"2024-09-10T07:39:53.441830+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:20.838098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.452011+0000","last_change":"2024-09-10T07:39:52.451874+0000","last_active":"2024-09-10T07:39:52.452011+0000","last_peered":"2024-09-10T07:39:52.452011+0000","last_clean":"2024-09-10T07:39:52.452011+0000","last_became_active":"2024-09-10T07:39:52.450874+0000","last_became_peered":"2024-09-10T07:39:52.450874+0000","last_unstale":"2024-09-10T07:39:52.452011+0000","last_undegraded":"2024-09-10T07:39:52.452011+0000","last_fullsized":"2024-09-10T07:39:52.452011+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:33.101676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"124'2","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.468330+0000","last_change":"2024-09-10T07:39:51.445547+0000","last_active":"2024-09-10T07:39:52.468330+0000","last_peered":"2024-09-10T07:39:52.468330+0000","last_clean":"2024-09-10T07:39:52.468330+0000","last_became_active":"2024-09-10T07:39:51.444917+0000","last_became_peered":"2024-09-10T07:39:51.444917+0000","last_unstale":"2024-09-10T07:39:52.468330+0000","last_undegraded":"2024-09-10T07:39:52.468330+0000","last_fullsized":"2024-09-10T07:39:52.468330+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:35.354732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441069+0000","last_change":"2024-09-10T07:39:52.449424+0000","last_active":"2024-09-10T07:39:53.441069+0000","last_peered":"2024-09-10T07:39:53.441069+0000","last_clean":"2024-09-10T07:39:53.441069+0000","last_became_active":"2024-09-10T07:39:52.447291+0000","last_became_peered":"2024-09-10T07:39:52.447291+0000","last_unstale":"2024-09-10T07:39:53.441069+0000","last_undegraded":"2024-09-10T07:39:53.441069+0000","last_fullsized":"2024-09-10T07:39:53.441069+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:50.439685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"124'1","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.460889+0000","last_change":"2024-09-10T07:39:51.446456+0000","last_active":"2024-09-10T07:39:52.460889+0000","last_peered":"2024-09-10T07:39:52.460889+0000","last_clean":"2024-09-10T07:39:52.460889+0000","last_became_active":"2024-09-10T07:39:51.446236+0000","last_became_peered":"2024-09-10T07:39:51.446236+0000","last_unstale":"2024-09-10T07:39:52.460889+0000","last_undegraded":"2024-09-10T07:39:52.460889+0000","last_fullsized":"2024-09-10T07:39:52.460889+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:42.735081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455966+0000","last_change":"2024-09-10T07:39:52.455499+0000","last_active":"2024-09-10T07:39:52.455966+0000","last_peered":"2024-09-10T07:39:52.455966+0000","last_clean":"2024-09-10T07:39:52.455966+0000","last_became_active":"2024-09-10T07:39:52.454785+0000","last_became_peered":"2024-09-10T07:39:52.454785+0000","last_unstale":"2024-09-10T07:39:52.455966+0000","last_undegraded":"2024-09-10T07:39:52.455966+0000","last_fullsized":"2024-09-10T07:39:52.455966+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:47.942327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441037+0000","last_change":"2024-09-10T07:39:51.442472+0000","last_active":"2024-09-10T07:39:53.441037+0000","last_peered":"2024-09-10T07:39:53.441037+0000","last_clean":"2024-09-10T07:39:53.441037+0000","last_became_active":"2024-09-10T07:39:51.442261+0000","last_became_peered":"2024-09-10T07:39:51.442261+0000","last_unstale":"2024-09-10T07:39:53.441037+0000","last_undegraded":"2024-09-10T07:39:53.441037+0000","last_fullsized":"2024-09-10T07:39:53.441037+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:03.784565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457201+0000","last_change":"2024-09-10T07:39:52.453233+0000","last_active":"2024-09-10T07:39:53.457201+0000","last_peered":"2024-09-10T07:39:53.457201+0000","last_clean":"2024-09-10T07:39:53.457201+0000","last_became_active":"2024-09-10T07:39:52.452330+0000","last_became_peered":"2024-09-10T07:39:52.452330+0000","last_unstale":"2024-09-10T07:39:53.457201+0000","last_undegraded":"2024-09-10T07:39:53.457201+0000","last_fullsized":"2024-09-10T07:39:53.457201+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:09.466054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441285+0000","last_change":"2024-09-10T07:39:51.445897+0000","last_active":"2024-09-10T07:39:53.441285+0000","last_peered":"2024-09-10T07:39:53.441285+0000","last_clean":"2024-09-10T07:39:53.441285+0000","last_became_active":"2024-09-10T07:39:51.444665+0000","last_became_peered":"2024-09-10T07:39:51.444665+0000","last_unstale":"2024-09-10T07:39:53.441285+0000","last_undegraded":"2024-09-10T07:39:53.441285+0000","last_fullsized":"2024-09-10T07:39:53.441285+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:40.958252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456661+0000","last_change":"2024-09-10T07:39:52.450466+0000","last_active":"2024-09-10T07:39:53.456661+0000","last_peered":"2024-09-10T07:39:53.456661+0000","last_clean":"2024-09-10T07:39:53.456661+0000","last_became_active":"2024-09-10T07:39:52.449518+0000","last_became_peered":"2024-09-10T07:39:52.449518+0000","last_unstale":"2024-09-10T07:39:53.456661+0000","last_undegraded":"2024-09-10T07:39:53.456661+0000","last_fullsized":"2024-09-10T07:39:53.456661+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:39.711370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440818+0000","last_change":"2024-09-10T07:39:51.452076+0000","last_active":"2024-09-10T07:39:53.440818+0000","last_peered":"2024-09-10T07:39:53.440818+0000","last_clean":"2024-09-10T07:39:53.440818+0000","last_became_active":"2024-09-10T07:39:51.451830+0000","last_became_peered":"2024-09-10T07:39:51.451830+0000","last_unstale":"2024-09-10T07:39:53.440818+0000","last_undegraded":"2024-09-10T07:39:53.440818+0000","last_fullsized":"2024-09-10T07:39:53.440818+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:31.024974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456992+0000","last_change":"2024-09-10T07:39:52.448839+0000","last_active":"2024-09-10T07:39:53.456992+0000","last_peered":"2024-09-10T07:39:53.456992+0000","last_clean":"2024-09-10T07:39:53.456992+0000","last_became_active":"2024-09-10T07:39:52.448617+0000","last_became_peered":"2024-09-10T07:39:52.448617+0000","last_unstale":"2024-09-10T07:39:53.456992+0000","last_undegraded":"2024-09-10T07:39:53.456992+0000","last_fullsized":"2024-09-10T07:39:53.456992+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:02.978194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440906+0000","last_change":"2024-09-10T07:39:51.442175+0000","last_active":"2024-09-10T07:39:53.440906+0000","last_peered":"2024-09-10T07:39:53.440906+0000","last_clean":"2024-09-10T07:39:53.440906+0000","last_became_active":"2024-09-10T07:39:51.441874+0000","last_became_peered":"2024-09-10T07:39:51.441874+0000","last_unstale":"2024-09-10T07:39:53.440906+0000","last_undegraded":"2024-09-10T07:39:53.440906+0000","last_fullsized":"2024-09-10T07:39:53.440906+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:39.581861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.459611+0000","last_change":"2024-09-10T07:39:52.459519+0000","last_active":"2024-09-10T07:39:52.459611+0000","last_peered":"2024-09-10T07:39:52.459611+0000","last_clean":"2024-09-10T07:39:52.459611+0000","last_became_active":"2024-09-10T07:39:52.459333+0000","last_became_peered":"2024-09-10T07:39:52.459333+0000","last_unstale":"2024-09-10T07:39:52.459611+0000","last_undegraded":"2024-09-10T07:39:52.459611+0000","last_fullsized":"2024-09-10T07:39:52.459611+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:54.875142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440999+0000","last_change":"2024-09-10T07:39:51.452819+0000","last_active":"2024-09-10T07:39:53.440999+0000","last_peered":"2024-09-10T07:39:53.440999+0000","last_clean":"2024-09-10T07:39:53.440999+0000","last_became_active":"2024-09-10T07:39:51.452592+0000","last_became_peered":"2024-09-10T07:39:51.452592+0000","last_unstale":"2024-09-10T07:39:53.440999+0000","last_undegraded":"2024-09-10T07:39:53.440999+0000","last_fullsized":"2024-09-10T07:39:53.440999+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:44.071953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440883+0000","last_change":"2024-09-10T07:39:52.452787+0000","last_active":"2024-09-10T07:39:53.440883+0000","last_peered":"2024-09-10T07:39:53.440883+0000","last_clean":"2024-09-10T07:39:53.440883+0000","last_became_active":"2024-09-10T07:39:52.452576+0000","last_became_peered":"2024-09-10T07:39:52.452576+0000","last_unstale":"2024-09-10T07:39:53.440883+0000","last_undegraded":"2024-09-10T07:39:53.440883+0000","last_fullsized":"2024-09-10T07:39:53.440883+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:56.294891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441197+0000","last_change":"2024-09-10T07:39:51.441548+0000","last_active":"2024-09-10T07:39:53.441197+0000","last_peered":"2024-09-10T07:39:53.441197+0000","last_clean":"2024-09-10T07:39:53.441197+0000","last_became_active":"2024-09-10T07:39:51.441308+0000","last_became_peered":"2024-09-10T07:39:51.441308+0000","last_unstale":"2024-09-10T07:39:53.441197+0000","last_undegraded":"2024-09-10T07:39:53.441197+0000","last_fullsized":"2024-09-10T07:39:53.441197+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:43.171925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441905+0000","last_change":"2024-09-10T07:39:52.461494+0000","last_active":"2024-09-10T07:39:53.441905+0000","last_peered":"2024-09-10T07:39:53.441905+0000","last_clean":"2024-09-10T07:39:53.441905+0000","last_became_active":"2024-09-10T07:39:52.459618+0000","last_became_peered":"2024-09-10T07:39:52.459618+0000","last_unstale":"2024-09-10T07:39:53.441905+0000","last_undegraded":"2024-09-10T07:39:53.441905+0000","last_fullsized":"2024-09-10T07:39:53.441905+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:48.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"125'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456572+0000","last_change":"2024-09-10T07:39:51.445710+0000","last_active":"2024-09-10T07:39:53.456572+0000","last_peered":"2024-09-10T07:39:53.456572+0000","last_clean":"2024-09-10T07:39:53.456572+0000","last_became_active":"2024-09-10T07:39:51.444323+0000","last_became_peered":"2024-09-10T07:39:51.444323+0000","last_unstale":"2024-09-10T07:39:53.456572+0000","last_undegraded":"2024-09-10T07:39:53.456572+0000","last_fullsized":"2024-09-10T07:39:53.456572+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:27.031348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.442194+0000","last_change":"2024-09-10T07:39:52.453398+0000","last_active":"2024-09-10T07:39:53.442194+0000","last_peered":"2024-09-10T07:39:53.442194+0000","last_clean":"2024-09-10T07:39:53.442194+0000","last_became_active":"2024-09-10T07:39:52.452069+0000","last_became_peered":"2024-09-10T07:39:52.452069+0000","last_unstale":"2024-09-10T07:39:53.442194+0000","last_undegraded":"2024-09-10T07:39:53.442194+0000","last_fullsized":"2024-09-10T07:39:53.442194+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:26.963581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440519+0000","last_change":"2024-09-10T07:39:51.447858+0000","last_active":"2024-09-10T07:39:53.440519+0000","last_peered":"2024-09-10T07:39:53.440519+0000","last_clean":"2024-09-10T07:39:53.440519+0000","last_became_active":"2024-09-10T07:39:51.446419+0000","last_became_peered":"2024-09-10T07:39:51.446419+0000","last_unstale":"2024-09-10T07:39:53.440519+0000","last_undegraded":"2024-09-10T07:39:53.440519+0000","last_fullsized":"2024-09-10T07:39:53.440519+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:12.629947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.449309+0000","last_change":"2024-09-10T07:39:52.449190+0000","last_active":"2024-09-10T07:39:52.449309+0000","last_peered":"2024-09-10T07:39:52.449309+0000","last_clean":"2024-09-10T07:39:52.449309+0000","last_became_active":"2024-09-10T07:39:52.448946+0000","last_became_peered":"2024-09-10T07:39:52.448946+0000","last_unstale":"2024-09-10T07:39:52.449309+0000","last_undegraded":"2024-09-10T07:39:52.449309+0000","last_fullsized":"2024-09-10T07:39:52.449309+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:05.402844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.446128+0000","last_change":"2024-09-10T07:39:51.448683+0000","last_active":"2024-09-10T07:39:52.446128+0000","last_peered":"2024-09-10T07:39:52.446128+0000","last_clean":"2024-09-10T07:39:52.446128+0000","last_became_active":"2024-09-10T07:39:51.448445+0000","last_became_peered":"2024-09-10T07:39:51.448445+0000","last_unstale":"2024-09-10T07:39:52.446128+0000","last_undegraded":"2024-09-10T07:39:52.446128+0000","last_fullsized":"2024-09-10T07:39:52.446128+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:05.419314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457136+0000","last_change":"2024-09-10T07:39:52.452449+0000","last_active":"2024-09-10T07:39:53.457136+0000","last_peered":"2024-09-10T07:39:53.457136+0000","last_clean":"2024-09-10T07:39:53.457136+0000","last_became_active":"2024-09-10T07:39:52.450742+0000","last_became_peered":"2024-09-10T07:39:52.450742+0000","last_unstale":"2024-09-10T07:39:53.457136+0000","last_undegraded":"2024-09-10T07:39:53.457136+0000","last_fullsized":"2024-09-10T07:39:53.457136+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:26.283672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441084+0000","last_change":"2024-09-10T07:39:51.447150+0000","last_active":"2024-09-10T07:39:53.441084+0000","last_peered":"2024-09-10T07:39:53.441084+0000","last_clean":"2024-09-10T07:39:53.441084+0000","last_became_active":"2024-09-10T07:39:51.446683+0000","last_became_peered":"2024-09-10T07:39:51.446683+0000","last_unstale":"2024-09-10T07:39:53.441084+0000","last_undegraded":"2024-09-10T07:39:53.441084+0000","last_fullsized":"2024-09-10T07:39:53.441084+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:13.712054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.453584+0000","last_change":"2024-09-10T07:39:52.452969+0000","last_active":"2024-09-10T07:39:52.453584+0000","last_peered":"2024-09-10T07:39:52.453584+0000","last_clean":"2024-09-10T07:39:52.453584+0000","last_became_active":"2024-09-10T07:39:52.452632+0000","last_became_peered":"2024-09-10T07:39:52.452632+0000","last_unstale":"2024-09-10T07:39:52.453584+0000","last_undegraded":"2024-09-10T07:39:52.453584+0000","last_fullsized":"2024-09-10T07:39:52.453584+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:54.977989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.444761+0000","last_change":"2024-09-10T07:39:51.452610+0000","last_active":"2024-09-10T07:39:52.444761+0000","last_peered":"2024-09-10T07:39:52.444761+0000","last_clean":"2024-09-10T07:39:52.444761+0000","last_became_active":"2024-09-10T07:39:51.452383+0000","last_became_peered":"2024-09-10T07:39:51.452383+0000","last_unstale":"2024-09-10T07:39:52.444761+0000","last_undegraded":"2024-09-10T07:39:52.444761+0000","last_fullsized":"2024-09-10T07:39:52.444761+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:26.022277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457331+0000","last_change":"2024-09-10T07:39:52.453428+0000","last_active":"2024-09-10T07:39:53.457331+0000","last_peered":"2024-09-10T07:39:53.457331+0000","last_clean":"2024-09-10T07:39:53.457331+0000","last_became_active":"2024-09-10T07:39:52.452623+0000","last_became_peered":"2024-09-10T07:39:52.452623+0000","last_unstale":"2024-09-10T07:39:53.457331+0000","last_undegraded":"2024-09-10T07:39:53.457331+0000","last_fullsized":"2024-09-10T07:39:53.457331+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:33.568574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.445093+0000","last_change":"2024-09-10T07:39:51.452758+0000","last_active":"2024-09-10T07:39:52.445093+0000","last_peered":"2024-09-10T07:39:52.445093+0000","last_clean":"2024-09-10T07:39:52.445093+0000","last_became_active":"2024-09-10T07:39:51.452526+0000","last_became_peered":"2024-09-10T07:39:51.452526+0000","last_unstale":"2024-09-10T07:39:52.445093+0000","last_undegraded":"2024-09-10T07:39:52.445093+0000","last_fullsized":"2024-09-10T07:39:52.445093+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:52.848544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.452686+0000","last_change":"2024-09-10T07:39:52.451246+0000","last_active":"2024-09-10T07:39:52.452686+0000","last_peered":"2024-09-10T07:39:52.452686+0000","last_clean":"2024-09-10T07:39:52.452686+0000","last_became_active":"2024-09-10T07:39:52.449464+0000","last_became_peered":"2024-09-10T07:39:52.449464+0000","last_unstale":"2024-09-10T07:39:52.452686+0000","last_undegraded":"2024-09-10T07:39:52.452686+0000","last_fullsized":"2024-09-10T07:39:52.452686+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:25.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457416+0000","last_change":"2024-09-10T07:39:51.450475+0000","last_active":"2024-09-10T07:39:53.457416+0000","last_peered":"2024-09-10T07:39:53.457416+0000","last_clean":"2024-09-10T07:39:53.457416+0000","last_became_active":"2024-09-10T07:39:51.450262+0000","last_became_peered":"2024-09-10T07:39:51.450262+0000","last_unstale":"2024-09-10T07:39:53.457416+0000","last_undegraded":"2024-09-10T07:39:53.457416+0000","last_fullsized":"2024-09-10T07:39:53.457416+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:43.430271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456926+0000","last_change":"2024-09-10T07:39:52.452750+0000","last_active":"2024-09-10T07:39:53.456926+0000","last_peered":"2024-09-10T07:39:53.456926+0000","last_clean":"2024-09-10T07:39:53.456926+0000","last_became_active":"2024-09-10T07:39:52.452478+0000","last_became_peered":"2024-09-10T07:39:52.452478+0000","last_unstale":"2024-09-10T07:39:53.456926+0000","last_undegraded":"2024-09-10T07:39:53.456926+0000","last_fullsized":"2024-09-10T07:39:53.456926+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:15.070104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"124'1","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.464383+0000","last_change":"2024-09-10T07:39:51.449244+0000","last_active":"2024-09-10T07:39:52.464383+0000","last_peered":"2024-09-10T07:39:52.464383+0000","last_clean":"2024-09-10T07:39:52.464383+0000","last_became_active":"2024-09-10T07:39:51.449038+0000","last_became_peered":"2024-09-10T07:39:51.449038+0000","last_unstale":"2024-09-10T07:39:52.464383+0000","last_undegraded":"2024-09-10T07:39:52.464383+0000","last_fullsized":"2024-09-10T07:39:52.464383+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:33.530414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":377,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.440623+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:39:52.440623+0000","last_peered":"2024-09-10T07:39:52.440623+0000","last_clean":"2024-09-10T07:39:52.440623+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:39:52.440623+0000","last_undegraded":"2024-09-10T07:39:52.440623+0000","last_fullsized":"2024-09-10T07:39:52.440623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1245,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194066,"statfs":{"total":200000000,"available":198724170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194642,"statfs":{"total":200000000,"available":199313998,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":670,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194641,"statfs":{"total":200000000,"available":199312914,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":670,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194641,"statfs":{"total":200000000,"available":199313016,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314616,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1246,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194066,"statfs":{"total":200000000,"available":198723700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:39:56.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:39:56.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.812+0000 7f41ec000640 1 Processor -- start 2024-09-10T07:39:56.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.812+0000 7f41ec000640 1 -- start start 2024-09-10T07:39:56.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.813+0000 7f41ec000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e4142150 0x7f41e4160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.813+0000 7f41ec000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e4142650 con 0x7f41e4160a80 2024-09-10T07:39:56.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.813+0000 7f41ec000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e4142930 con 0x7f41e413fae0 2024-09-10T07:39:56.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.813+0000 7f41ec000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f41e40ce780 con 0x7f41e4142150 2024-09-10T07:39:56.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.813+0000 7f41ea000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f41e4160a80 0x7f41e40cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54340/0 (socket says 172.21.15.99:54340) 2024-09-10T07:39:56.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.813+0000 7f41ea000640 1 -- 172.21.15.99:0/1320521672 learned_addr learned my addr 172.21.15.99:0/1320521672 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:56.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.814+0000 7f41e8c00640 1 --2- 172.21.15.99:0/1320521672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e4142150 0x7f41e4160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.814+0000 7f41e3e00640 1 -- 172.21.15.99:0/1320521672 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3676555769 0 0) 0x7f41e4142650 con 0x7f41e4160a80 2024-09-10T07:39:56.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.814+0000 7f41e3e00640 1 -- 172.21.15.99:0/1320521672 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41cc003520 con 0x7f41e4160a80 2024-09-10T07:39:56.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.814+0000 7f41e8c00640 1 -- 172.21.15.99:0/1320521672 >> v1:172.21.15.187:6789/0 conn(0x7f41e413fae0 legacy=0x7f41e406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.814+0000 7f41e3e00640 1 -- 172.21.15.99:0/1320521672 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282662242 0 0) 0x7f41e4142930 con 0x7f41e413fae0 2024-09-10T07:39:56.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.814+0000 7f41e8c00640 1 -- 172.21.15.99:0/1320521672 >> v1:172.21.15.99:6789/0 conn(0x7f41e4160a80 legacy=0x7f41e40cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.814+0000 7f41e8c00640 1 -- 172.21.15.99:0/1320521672 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e4142c10 con 0x7f41e4142150 2024-09-10T07:39:56.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.815+0000 7f41e8c00640 1 --2- 172.21.15.99:0/1320521672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e4142150 0x7f41e4160540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f41d00097d0 tx=0x7f41d002a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac166e79390821a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:56.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.816+0000 7f41e3e00640 1 -- 172.21.15.99:0/1320521672 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0037070 con 0x7f41e4142150 2024-09-10T07:39:56.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.816+0000 7f41e3e00640 1 -- 172.21.15.99:0/1320521672 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d002ab70 con 0x7f41e4142150 2024-09-10T07:39:56.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.816+0000 7f41e3e00640 1 -- 172.21.15.99:0/1320521672 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc001970 con 0x7f41e4142150 2024-09-10T07:39:56.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.816+0000 7f41ec000640 1 -- 172.21.15.99:0/1320521672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e4142150 msgr2=0x7f41e4160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.816+0000 7f41ec000640 1 --2- 172.21.15.99:0/1320521672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e4142150 0x7f41e4160540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f41d00097d0 tx=0x7f41d002a0e0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.816+0000 7f41ec000640 1 -- 172.21.15.99:0/1320521672 shutdown_connections 2024-09-10T07:39:56.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.816+0000 7f41ec000640 1 --2- 172.21.15.99:0/1320521672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e4142150 0x7f41e4160540 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.816+0000 7f41ec000640 1 -- 172.21.15.99:0/1320521672 >> 172.21.15.99:0/1320521672 conn(0x7f41e406bc10 msgr2=0x7f41e406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:56.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.816+0000 7f41ec000640 1 -- 172.21.15.99:0/1320521672 shutdown_connections 2024-09-10T07:39:56.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.816+0000 7f41ec000640 1 -- 172.21.15.99:0/1320521672 wait complete. 2024-09-10T07:39:56.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.818+0000 7f41ec000640 1 Processor -- start 2024-09-10T07:39:56.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.818+0000 7f41ec000640 1 -- start start 2024-09-10T07:39:56.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41ec000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e413fae0 0x7f41e4141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41ec000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41e4142150 0x7f41e40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41ec000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41e4160a80 0x7f41e40b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41ec000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f41e40cf4a0 con 0x7f41e4142150 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41ec000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f41e40cf320 con 0x7f41e4160a80 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41ec000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f41e40cf620 con 0x7f41e413fae0 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41e8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41e4142150 0x7f41e40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41e8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41e4142150 0x7f41e40b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55514/0 (socket says 172.21.15.99:55514) 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41e8c00640 1 -- 172.21.15.99:0/1988297865 learned_addr learned my addr 172.21.15.99:0/1988297865 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41e9600640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e413fae0 0x7f41e4141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.819+0000 7f41ea000640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41e4160a80 0x7f41e40b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41e8c00640 1 -- 172.21.15.99:0/1988297865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e413fae0 msgr2=0x7f41e4141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41e8c00640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e413fae0 0x7f41e4141800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41e8c00640 1 -- 172.21.15.99:0/1988297865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41e4160a80 msgr2=0x7f41e40b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:56.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41e8c00640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41e4160a80 0x7f41e40b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:56.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41e8c00640 1 -- 172.21.15.99:0/1988297865 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e41431d0 con 0x7f41e4142150 2024-09-10T07:39:56.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41e8c00640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41e4142150 0x7f41e40b4f30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009720 tx=0x7f41d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:56.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41e1600640 1 -- 172.21.15.99:0/1988297865 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0037040 con 0x7f41e4142150 2024-09-10T07:39:56.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41e1600640 1 -- 172.21.15.99:0/1988297865 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d0004030 con 0x7f41e4142150 2024-09-10T07:39:56.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41e1600640 1 -- 172.21.15.99:0/1988297865 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0004400 con 0x7f41e4142150 2024-09-10T07:39:56.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41ec000640 1 -- 172.21.15.99:0/1988297865 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e41434b0 con 0x7f41e4142150 2024-09-10T07:39:56.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.820+0000 7f41ec000640 1 -- 172.21.15.99:0/1988297865 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e4143a70 con 0x7f41e4142150 2024-09-10T07:39:56.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.821+0000 7f41ec000640 1 -- 172.21.15.99:0/1988297865 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e4160540 con 0x7f41e4142150 2024-09-10T07:39:56.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.822+0000 7f41e1600640 1 -- 172.21.15.99:0/1988297865 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41d003a040 con 0x7f41e4142150 2024-09-10T07:39:56.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.823+0000 7f41e1600640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41c406be30 0x7f41c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:56.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.823+0000 7f41e1600640 1 -- 172.21.15.99:0/1988297865 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7f41d00ab300 con 0x7f41e4142150 2024-09-10T07:39:56.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.824+0000 7f41e9600640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41c406be30 0x7f41c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:56.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.824+0000 7f41e9600640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41c406be30 0x7f41c406e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f41d8001120 tx=0x7f41d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:56.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.828+0000 7f41e1600640 1 -- 172.21.15.99:0/1988297865 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41d0042020 con 0x7f41e4142150 2024-09-10T07:39:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:56.998+0000 7f41ec000640 1 -- 172.21.15.99:0/1988297865 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41e4160ef0 con 0x7f41c406be30 2024-09-10T07:39:57.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.004+0000 7f41e1600640 1 -- 172.21.15.99:0/1988297865 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247955 (secure 0 0 0) 0x7f41e4160ef0 con 0x7f41c406be30 2024-09-10T07:39:57.007 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:57.008 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:39:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 -- 172.21.15.99:0/1988297865 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41c406be30 msgr2=0x7f41c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41c406be30 0x7f41c406e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f41d8001120 tx=0x7f41d8009040 comp rx=0 tx=0).stop 2024-09-10T07:39:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 -- 172.21.15.99:0/1988297865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41e4142150 msgr2=0x7f41e40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41e4142150 0x7f41e40b4f30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009720 tx=0x7f41d00046c0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 -- 172.21.15.99:0/1988297865 shutdown_connections 2024-09-10T07:39:57.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41e4160a80 0x7f41e40b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41c406be30 0x7f41c406e2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41e4142150 0x7f41e40b4f30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 --2- 172.21.15.99:0/1988297865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41e413fae0 0x7f41e4141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 -- 172.21.15.99:0/1988297865 >> 172.21.15.99:0/1988297865 conn(0x7f41e406bc10 msgr2=0x7f41e406f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:57.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 -- 172.21.15.99:0/1988297865 shutdown_connections 2024-09-10T07:39:57.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.008+0000 7f41ec000640 1 -- 172.21.15.99:0/1988297865 wait complete. 2024-09-10T07:39:57.025 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-10T07:39:56.766130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6512,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555987,"statfs":{"total":1600000000,"available":1593331644,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001113"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441652+0000","last_change":"2024-09-10T07:39:52.459711+0000","last_active":"2024-09-10T07:39:53.441652+0000","last_peered":"2024-09-10T07:39:53.441652+0000","last_clean":"2024-09-10T07:39:53.441652+0000","last_became_active":"2024-09-10T07:39:52.459144+0000","last_became_peered":"2024-09-10T07:39:52.459144+0000","last_unstale":"2024-09-10T07:39:53.441652+0000","last_undegraded":"2024-09-10T07:39:53.441652+0000","last_fullsized":"2024-09-10T07:39:53.441652+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:10.395094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440603+0000","last_change":"2024-09-10T07:39:52.451626+0000","last_active":"2024-09-10T07:39:53.440603+0000","last_peered":"2024-09-10T07:39:53.440603+0000","last_clean":"2024-09-10T07:39:53.440603+0000","last_became_active":"2024-09-10T07:39:52.451119+0000","last_became_peered":"2024-09-10T07:39:52.451119+0000","last_unstale":"2024-09-10T07:39:53.440603+0000","last_undegraded":"2024-09-10T07:39:53.440603+0000","last_fullsized":"2024-09-10T07:39:53.440603+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:54.012372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441615+0000","last_change":"2024-09-10T07:39:52.461224+0000","last_active":"2024-09-10T07:39:53.441615+0000","last_peered":"2024-09-10T07:39:53.441615+0000","last_clean":"2024-09-10T07:39:53.441615+0000","last_became_active":"2024-09-10T07:39:52.459269+0000","last_became_peered":"2024-09-10T07:39:52.459269+0000","last_unstale":"2024-09-10T07:39:53.441615+0000","last_undegraded":"2024-09-10T07:39:53.441615+0000","last_fullsized":"2024-09-10T07:39:53.441615+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:08.309118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455284+0000","last_change":"2024-09-10T07:39:52.454307+0000","last_active":"2024-09-10T07:39:52.455284+0000","last_peered":"2024-09-10T07:39:52.455284+0000","last_clean":"2024-09-10T07:39:52.455284+0000","last_became_active":"2024-09-10T07:39:52.448678+0000","last_became_peered":"2024-09-10T07:39:52.448678+0000","last_unstale":"2024-09-10T07:39:52.455284+0000","last_undegraded":"2024-09-10T07:39:52.455284+0000","last_fullsized":"2024-09-10T07:39:52.455284+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:59.121028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.457000+0000","last_change":"2024-09-10T07:39:52.456786+0000","last_active":"2024-09-10T07:39:52.457000+0000","last_peered":"2024-09-10T07:39:52.457000+0000","last_clean":"2024-09-10T07:39:52.457000+0000","last_became_active":"2024-09-10T07:39:52.456536+0000","last_became_peered":"2024-09-10T07:39:52.456536+0000","last_unstale":"2024-09-10T07:39:52.457000+0000","last_undegraded":"2024-09-10T07:39:52.457000+0000","last_fullsized":"2024-09-10T07:39:52.457000+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:17.660052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.444698+0000","last_change":"2024-09-10T07:39:52.444433+0000","last_active":"2024-09-10T07:39:52.444698+0000","last_peered":"2024-09-10T07:39:52.444698+0000","last_clean":"2024-09-10T07:39:52.444698+0000","last_became_active":"2024-09-10T07:39:52.444126+0000","last_became_peered":"2024-09-10T07:39:52.444126+0000","last_unstale":"2024-09-10T07:39:52.444698+0000","last_undegraded":"2024-09-10T07:39:52.444698+0000","last_fullsized":"2024-09-10T07:39:52.444698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:31.662473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.444681+0000","last_change":"2024-09-10T07:39:52.443559+0000","last_active":"2024-09-10T07:39:52.444681+0000","last_peered":"2024-09-10T07:39:52.444681+0000","last_clean":"2024-09-10T07:39:52.444681+0000","last_became_active":"2024-09-10T07:39:52.443264+0000","last_became_peered":"2024-09-10T07:39:52.443264+0000","last_unstale":"2024-09-10T07:39:52.444681+0000","last_undegraded":"2024-09-10T07:39:52.444681+0000","last_fullsized":"2024-09-10T07:39:52.444681+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:54.917209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440589+0000","last_change":"2024-09-10T07:39:52.450050+0000","last_active":"2024-09-10T07:39:53.440589+0000","last_peered":"2024-09-10T07:39:53.440589+0000","last_clean":"2024-09-10T07:39:53.440589+0000","last_became_active":"2024-09-10T07:39:52.448973+0000","last_became_peered":"2024-09-10T07:39:52.448973+0000","last_unstale":"2024-09-10T07:39:53.440589+0000","last_undegraded":"2024-09-10T07:39:53.440589+0000","last_fullsized":"2024-09-10T07:39:53.440589+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:52.447914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.459015+0000","last_change":"2024-09-10T07:39:52.458891+0000","last_active":"2024-09-10T07:39:52.459015+0000","last_peered":"2024-09-10T07:39:52.459015+0000","last_clean":"2024-09-10T07:39:52.459015+0000","last_became_active":"2024-09-10T07:39:52.458645+0000","last_became_peered":"2024-09-10T07:39:52.458645+0000","last_unstale":"2024-09-10T07:39:52.459015+0000","last_undegraded":"2024-09-10T07:39:52.459015+0000","last_fullsized":"2024-09-10T07:39:52.459015+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:22.735161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.460188+0000","last_change":"2024-09-10T07:39:52.460092+0000","last_active":"2024-09-10T07:39:52.460188+0000","last_peered":"2024-09-10T07:39:52.460188+0000","last_clean":"2024-09-10T07:39:52.460188+0000","last_became_active":"2024-09-10T07:39:52.459824+0000","last_became_peered":"2024-09-10T07:39:52.459824+0000","last_unstale":"2024-09-10T07:39:52.460188+0000","last_undegraded":"2024-09-10T07:39:52.460188+0000","last_fullsized":"2024-09-10T07:39:52.460188+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:10.471561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455986+0000","last_change":"2024-09-10T07:39:52.455722+0000","last_active":"2024-09-10T07:39:52.455986+0000","last_peered":"2024-09-10T07:39:52.455986+0000","last_clean":"2024-09-10T07:39:52.455986+0000","last_became_active":"2024-09-10T07:39:52.455088+0000","last_became_peered":"2024-09-10T07:39:52.455088+0000","last_unstale":"2024-09-10T07:39:52.455986+0000","last_undegraded":"2024-09-10T07:39:52.455986+0000","last_fullsized":"2024-09-10T07:39:52.455986+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:40.027505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.462086+0000","last_change":"2024-09-10T07:39:52.461936+0000","last_active":"2024-09-10T07:39:52.462086+0000","last_peered":"2024-09-10T07:39:52.462086+0000","last_clean":"2024-09-10T07:39:52.462086+0000","last_became_active":"2024-09-10T07:39:52.461676+0000","last_became_peered":"2024-09-10T07:39:52.461676+0000","last_unstale":"2024-09-10T07:39:52.462086+0000","last_undegraded":"2024-09-10T07:39:52.462086+0000","last_fullsized":"2024-09-10T07:39:52.462086+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:52.536660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455204+0000","last_change":"2024-09-10T07:39:52.450997+0000","last_active":"2024-09-10T07:39:52.455204+0000","last_peered":"2024-09-10T07:39:52.455204+0000","last_clean":"2024-09-10T07:39:52.455204+0000","last_became_active":"2024-09-10T07:39:52.450151+0000","last_became_peered":"2024-09-10T07:39:52.450151+0000","last_unstale":"2024-09-10T07:39:52.455204+0000","last_undegraded":"2024-09-10T07:39:52.455204+0000","last_fullsized":"2024-09-10T07:39:52.455204+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:03.705488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456628+0000","last_change":"2024-09-10T07:39:52.453616+0000","last_active":"2024-09-10T07:39:53.456628+0000","last_peered":"2024-09-10T07:39:53.456628+0000","last_clean":"2024-09-10T07:39:53.456628+0000","last_became_active":"2024-09-10T07:39:52.452917+0000","last_became_peered":"2024-09-10T07:39:52.452917+0000","last_unstale":"2024-09-10T07:39:53.456628+0000","last_undegraded":"2024-09-10T07:39:53.456628+0000","last_fullsized":"2024-09-10T07:39:53.456628+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:19.939947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.460493+0000","last_change":"2024-09-10T07:39:52.460386+0000","last_active":"2024-09-10T07:39:52.460493+0000","last_peered":"2024-09-10T07:39:52.460493+0000","last_clean":"2024-09-10T07:39:52.460493+0000","last_became_active":"2024-09-10T07:39:52.459805+0000","last_became_peered":"2024-09-10T07:39:52.459805+0000","last_unstale":"2024-09-10T07:39:52.460493+0000","last_undegraded":"2024-09-10T07:39:52.460493+0000","last_fullsized":"2024-09-10T07:39:52.460493+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:48.209419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.449887+0000","last_change":"2024-09-10T07:39:52.449211+0000","last_active":"2024-09-10T07:39:52.449887+0000","last_peered":"2024-09-10T07:39:52.449887+0000","last_clean":"2024-09-10T07:39:52.449887+0000","last_became_active":"2024-09-10T07:39:52.448898+0000","last_became_peered":"2024-09-10T07:39:52.448898+0000","last_unstale":"2024-09-10T07:39:52.449887+0000","last_undegraded":"2024-09-10T07:39:52.449887+0000","last_fullsized":"2024-09-10T07:39:52.449887+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:20.152296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440737+0000","last_change":"2024-09-10T07:39:52.457355+0000","last_active":"2024-09-10T07:39:53.440737+0000","last_peered":"2024-09-10T07:39:53.440737+0000","last_clean":"2024-09-10T07:39:53.440737+0000","last_became_active":"2024-09-10T07:39:52.457147+0000","last_became_peered":"2024-09-10T07:39:52.457147+0000","last_unstale":"2024-09-10T07:39:53.440737+0000","last_undegraded":"2024-09-10T07:39:53.440737+0000","last_fullsized":"2024-09-10T07:39:53.440737+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:24.260785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455226+0000","last_change":"2024-09-10T07:39:52.451271+0000","last_active":"2024-09-10T07:39:52.455226+0000","last_peered":"2024-09-10T07:39:52.455226+0000","last_clean":"2024-09-10T07:39:52.455226+0000","last_became_active":"2024-09-10T07:39:52.450457+0000","last_became_peered":"2024-09-10T07:39:52.450457+0000","last_unstale":"2024-09-10T07:39:52.455226+0000","last_undegraded":"2024-09-10T07:39:52.455226+0000","last_fullsized":"2024-09-10T07:39:52.455226+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:41.864473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456760+0000","last_change":"2024-09-10T07:39:52.462641+0000","last_active":"2024-09-10T07:39:53.456760+0000","last_peered":"2024-09-10T07:39:53.456760+0000","last_clean":"2024-09-10T07:39:53.456760+0000","last_became_active":"2024-09-10T07:39:52.462401+0000","last_became_peered":"2024-09-10T07:39:52.462401+0000","last_unstale":"2024-09-10T07:39:53.456760+0000","last_undegraded":"2024-09-10T07:39:53.456760+0000","last_fullsized":"2024-09-10T07:39:53.456760+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:36.814517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.453557+0000","last_change":"2024-09-10T07:39:52.452465+0000","last_active":"2024-09-10T07:39:52.453557+0000","last_peered":"2024-09-10T07:39:52.453557+0000","last_clean":"2024-09-10T07:39:52.453557+0000","last_became_active":"2024-09-10T07:39:52.452206+0000","last_became_peered":"2024-09-10T07:39:52.452206+0000","last_unstale":"2024-09-10T07:39:52.453557+0000","last_undegraded":"2024-09-10T07:39:52.453557+0000","last_fullsized":"2024-09-10T07:39:52.453557+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:47.071871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456845+0000","last_change":"2024-09-10T07:39:52.442293+0000","last_active":"2024-09-10T07:39:53.456845+0000","last_peered":"2024-09-10T07:39:53.456845+0000","last_clean":"2024-09-10T07:39:53.456845+0000","last_became_active":"2024-09-10T07:39:52.442044+0000","last_became_peered":"2024-09-10T07:39:52.442044+0000","last_unstale":"2024-09-10T07:39:53.456845+0000","last_undegraded":"2024-09-10T07:39:53.456845+0000","last_fullsized":"2024-09-10T07:39:53.456845+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:15.758207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440849+0000","last_change":"2024-09-10T07:39:52.452088+0000","last_active":"2024-09-10T07:39:53.440849+0000","last_peered":"2024-09-10T07:39:53.440849+0000","last_clean":"2024-09-10T07:39:53.440849+0000","last_became_active":"2024-09-10T07:39:52.451407+0000","last_became_peered":"2024-09-10T07:39:52.451407+0000","last_unstale":"2024-09-10T07:39:53.440849+0000","last_undegraded":"2024-09-10T07:39:53.440849+0000","last_fullsized":"2024-09-10T07:39:53.440849+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:31.662124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440741+0000","last_change":"2024-09-10T07:39:52.450298+0000","last_active":"2024-09-10T07:39:53.440741+0000","last_peered":"2024-09-10T07:39:53.440741+0000","last_clean":"2024-09-10T07:39:53.440741+0000","last_became_active":"2024-09-10T07:39:52.449828+0000","last_became_peered":"2024-09-10T07:39:52.449828+0000","last_unstale":"2024-09-10T07:39:53.440741+0000","last_undegraded":"2024-09-10T07:39:53.440741+0000","last_fullsized":"2024-09-10T07:39:53.440741+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:09.701628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.457760+0000","last_change":"2024-09-10T07:39:52.457619+0000","last_active":"2024-09-10T07:39:52.457760+0000","last_peered":"2024-09-10T07:39:52.457760+0000","last_clean":"2024-09-10T07:39:52.457760+0000","last_became_active":"2024-09-10T07:39:52.457357+0000","last_became_peered":"2024-09-10T07:39:52.457357+0000","last_unstale":"2024-09-10T07:39:52.457760+0000","last_undegraded":"2024-09-10T07:39:52.457760+0000","last_fullsized":"2024-09-10T07:39:52.457760+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:51.518140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.451080+0000","last_change":"2024-09-10T07:39:52.450279+0000","last_active":"2024-09-10T07:39:52.451080+0000","last_peered":"2024-09-10T07:39:52.451080+0000","last_clean":"2024-09-10T07:39:52.451080+0000","last_became_active":"2024-09-10T07:39:52.449925+0000","last_became_peered":"2024-09-10T07:39:52.449925+0000","last_unstale":"2024-09-10T07:39:52.451080+0000","last_undegraded":"2024-09-10T07:39:52.451080+0000","last_fullsized":"2024-09-10T07:39:52.451080+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:15.095533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440793+0000","last_change":"2024-09-10T07:39:52.461724+0000","last_active":"2024-09-10T07:39:53.440793+0000","last_peered":"2024-09-10T07:39:53.440793+0000","last_clean":"2024-09-10T07:39:53.440793+0000","last_became_active":"2024-09-10T07:39:52.461468+0000","last_became_peered":"2024-09-10T07:39:52.461468+0000","last_unstale":"2024-09-10T07:39:53.440793+0000","last_undegraded":"2024-09-10T07:39:53.440793+0000","last_fullsized":"2024-09-10T07:39:53.440793+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:29.474508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.444659+0000","last_change":"2024-09-10T07:39:52.442863+0000","last_active":"2024-09-10T07:39:52.444659+0000","last_peered":"2024-09-10T07:39:52.444659+0000","last_clean":"2024-09-10T07:39:52.444659+0000","last_became_active":"2024-09-10T07:39:52.442507+0000","last_became_peered":"2024-09-10T07:39:52.442507+0000","last_unstale":"2024-09-10T07:39:52.444659+0000","last_undegraded":"2024-09-10T07:39:52.444659+0000","last_fullsized":"2024-09-10T07:39:52.444659+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:22.325020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.451097+0000","last_change":"2024-09-10T07:39:52.450917+0000","last_active":"2024-09-10T07:39:52.451097+0000","last_peered":"2024-09-10T07:39:52.451097+0000","last_clean":"2024-09-10T07:39:52.451097+0000","last_became_active":"2024-09-10T07:39:52.448743+0000","last_became_peered":"2024-09-10T07:39:52.448743+0000","last_unstale":"2024-09-10T07:39:52.451097+0000","last_undegraded":"2024-09-10T07:39:52.451097+0000","last_fullsized":"2024-09-10T07:39:52.451097+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:14.594800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440454+0000","last_change":"2024-09-10T07:39:52.461650+0000","last_active":"2024-09-10T07:39:53.440454+0000","last_peered":"2024-09-10T07:39:53.440454+0000","last_clean":"2024-09-10T07:39:53.440454+0000","last_became_active":"2024-09-10T07:39:52.461431+0000","last_became_peered":"2024-09-10T07:39:52.461431+0000","last_unstale":"2024-09-10T07:39:53.440454+0000","last_undegraded":"2024-09-10T07:39:53.440454+0000","last_fullsized":"2024-09-10T07:39:53.440454+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:47:25.354318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457073+0000","last_change":"2024-09-10T07:39:52.454453+0000","last_active":"2024-09-10T07:39:53.457073+0000","last_peered":"2024-09-10T07:39:53.457073+0000","last_clean":"2024-09-10T07:39:53.457073+0000","last_became_active":"2024-09-10T07:39:52.454213+0000","last_became_peered":"2024-09-10T07:39:52.454213+0000","last_unstale":"2024-09-10T07:39:53.457073+0000","last_undegraded":"2024-09-10T07:39:53.457073+0000","last_fullsized":"2024-09-10T07:39:53.457073+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:30.989871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.457240+0000","last_change":"2024-09-10T07:39:52.457088+0000","last_active":"2024-09-10T07:39:52.457240+0000","last_peered":"2024-09-10T07:39:52.457240+0000","last_clean":"2024-09-10T07:39:52.457240+0000","last_became_active":"2024-09-10T07:39:52.456696+0000","last_became_peered":"2024-09-10T07:39:52.456696+0000","last_unstale":"2024-09-10T07:39:52.457240+0000","last_undegraded":"2024-09-10T07:39:52.457240+0000","last_fullsized":"2024-09-10T07:39:52.457240+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:00.479153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441544+0000","last_change":"2024-09-10T07:39:52.461702+0000","last_active":"2024-09-10T07:39:53.441544+0000","last_peered":"2024-09-10T07:39:53.441544+0000","last_clean":"2024-09-10T07:39:53.441544+0000","last_became_active":"2024-09-10T07:39:52.460781+0000","last_became_peered":"2024-09-10T07:39:52.460781+0000","last_unstale":"2024-09-10T07:39:53.441544+0000","last_undegraded":"2024-09-10T07:39:53.441544+0000","last_fullsized":"2024-09-10T07:39:53.441544+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:11.844832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456898+0000","last_change":"2024-09-10T07:39:52.443683+0000","last_active":"2024-09-10T07:39:53.456898+0000","last_peered":"2024-09-10T07:39:53.456898+0000","last_clean":"2024-09-10T07:39:53.456898+0000","last_became_active":"2024-09-10T07:39:52.443421+0000","last_became_peered":"2024-09-10T07:39:52.443421+0000","last_unstale":"2024-09-10T07:39:53.456898+0000","last_undegraded":"2024-09-10T07:39:53.456898+0000","last_fullsized":"2024-09-10T07:39:53.456898+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:55.369313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"124'4","reported_seq":18,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441070+0000","last_change":"2024-09-10T07:39:51.450327+0000","last_active":"2024-09-10T07:39:53.441070+0000","last_peered":"2024-09-10T07:39:53.441070+0000","last_clean":"2024-09-10T07:39:53.441070+0000","last_became_active":"2024-09-10T07:39:51.449840+0000","last_became_peered":"2024-09-10T07:39:51.449840+0000","last_unstale":"2024-09-10T07:39:53.441070+0000","last_undegraded":"2024-09-10T07:39:53.441070+0000","last_fullsized":"2024-09-10T07:39:53.441070+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:49.478326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455244+0000","last_change":"2024-09-10T07:39:52.451455+0000","last_active":"2024-09-10T07:39:52.455244+0000","last_peered":"2024-09-10T07:39:52.455244+0000","last_clean":"2024-09-10T07:39:52.455244+0000","last_became_active":"2024-09-10T07:39:52.450747+0000","last_became_peered":"2024-09-10T07:39:52.450747+0000","last_unstale":"2024-09-10T07:39:52.455244+0000","last_undegraded":"2024-09-10T07:39:52.455244+0000","last_fullsized":"2024-09-10T07:39:52.455244+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:46.701444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"124'1","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.463966+0000","last_change":"2024-09-10T07:39:51.454830+0000","last_active":"2024-09-10T07:39:52.463966+0000","last_peered":"2024-09-10T07:39:52.463966+0000","last_clean":"2024-09-10T07:39:52.463966+0000","last_became_active":"2024-09-10T07:39:51.454689+0000","last_became_peered":"2024-09-10T07:39:51.454689+0000","last_unstale":"2024-09-10T07:39:52.463966+0000","last_undegraded":"2024-09-10T07:39:52.463966+0000","last_fullsized":"2024-09-10T07:39:52.463966+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:24.704865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441781+0000","last_change":"2024-09-10T07:39:52.459451+0000","last_active":"2024-09-10T07:39:53.441781+0000","last_peered":"2024-09-10T07:39:53.441781+0000","last_clean":"2024-09-10T07:39:53.441781+0000","last_became_active":"2024-09-10T07:39:52.458867+0000","last_became_peered":"2024-09-10T07:39:52.458867+0000","last_unstale":"2024-09-10T07:39:53.441781+0000","last_undegraded":"2024-09-10T07:39:53.441781+0000","last_fullsized":"2024-09-10T07:39:53.441781+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:07.517269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441296+0000","last_change":"2024-09-10T07:39:51.445366+0000","last_active":"2024-09-10T07:39:53.441296+0000","last_peered":"2024-09-10T07:39:53.441296+0000","last_clean":"2024-09-10T07:39:53.441296+0000","last_became_active":"2024-09-10T07:39:51.445052+0000","last_became_peered":"2024-09-10T07:39:51.445052+0000","last_unstale":"2024-09-10T07:39:53.441296+0000","last_undegraded":"2024-09-10T07:39:53.441296+0000","last_fullsized":"2024-09-10T07:39:53.441296+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:42.677459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.452391+0000","last_change":"2024-09-10T07:39:52.450297+0000","last_active":"2024-09-10T07:39:52.452391+0000","last_peered":"2024-09-10T07:39:52.452391+0000","last_clean":"2024-09-10T07:39:52.452391+0000","last_became_active":"2024-09-10T07:39:52.449995+0000","last_became_peered":"2024-09-10T07:39:52.449995+0000","last_unstale":"2024-09-10T07:39:52.452391+0000","last_undegraded":"2024-09-10T07:39:52.452391+0000","last_fullsized":"2024-09-10T07:39:52.452391+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:42.622061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440904+0000","last_change":"2024-09-10T07:39:51.446957+0000","last_active":"2024-09-10T07:39:53.440904+0000","last_peered":"2024-09-10T07:39:53.440904+0000","last_clean":"2024-09-10T07:39:53.440904+0000","last_became_active":"2024-09-10T07:39:51.446387+0000","last_became_peered":"2024-09-10T07:39:51.446387+0000","last_unstale":"2024-09-10T07:39:53.440904+0000","last_undegraded":"2024-09-10T07:39:53.440904+0000","last_fullsized":"2024-09-10T07:39:53.440904+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:21.707896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441099+0000","last_change":"2024-09-10T07:39:52.450668+0000","last_active":"2024-09-10T07:39:53.441099+0000","last_peered":"2024-09-10T07:39:53.441099+0000","last_clean":"2024-09-10T07:39:53.441099+0000","last_became_active":"2024-09-10T07:39:52.450388+0000","last_became_peered":"2024-09-10T07:39:52.450388+0000","last_unstale":"2024-09-10T07:39:53.441099+0000","last_undegraded":"2024-09-10T07:39:53.441099+0000","last_fullsized":"2024-09-10T07:39:53.441099+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.158246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.442032+0000","last_change":"2024-09-10T07:39:51.453685+0000","last_active":"2024-09-10T07:39:53.442032+0000","last_peered":"2024-09-10T07:39:53.442032+0000","last_clean":"2024-09-10T07:39:53.442032+0000","last_became_active":"2024-09-10T07:39:51.453209+0000","last_became_peered":"2024-09-10T07:39:51.453209+0000","last_unstale":"2024-09-10T07:39:53.442032+0000","last_undegraded":"2024-09-10T07:39:53.442032+0000","last_fullsized":"2024-09-10T07:39:53.442032+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:30.714159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.446825+0000","last_change":"2024-09-10T07:39:52.446574+0000","last_active":"2024-09-10T07:39:52.446825+0000","last_peered":"2024-09-10T07:39:52.446825+0000","last_clean":"2024-09-10T07:39:52.446825+0000","last_became_active":"2024-09-10T07:39:52.445868+0000","last_became_peered":"2024-09-10T07:39:52.445868+0000","last_unstale":"2024-09-10T07:39:52.446825+0000","last_undegraded":"2024-09-10T07:39:52.446825+0000","last_fullsized":"2024-09-10T07:39:52.446825+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:57.331119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441189+0000","last_change":"2024-09-10T07:39:51.452042+0000","last_active":"2024-09-10T07:39:53.441189+0000","last_peered":"2024-09-10T07:39:53.441189+0000","last_clean":"2024-09-10T07:39:53.441189+0000","last_became_active":"2024-09-10T07:39:51.451565+0000","last_became_peered":"2024-09-10T07:39:51.451565+0000","last_unstale":"2024-09-10T07:39:53.441189+0000","last_undegraded":"2024-09-10T07:39:53.441189+0000","last_fullsized":"2024-09-10T07:39:53.441189+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:02.821941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.460294+0000","last_change":"2024-09-10T07:39:52.460030+0000","last_active":"2024-09-10T07:39:52.460294+0000","last_peered":"2024-09-10T07:39:52.460294+0000","last_clean":"2024-09-10T07:39:52.460294+0000","last_became_active":"2024-09-10T07:39:52.459489+0000","last_became_peered":"2024-09-10T07:39:52.459489+0000","last_unstale":"2024-09-10T07:39:52.460294+0000","last_undegraded":"2024-09-10T07:39:52.460294+0000","last_fullsized":"2024-09-10T07:39:52.460294+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:23.501070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.446946+0000","last_change":"2024-09-10T07:39:51.449888+0000","last_active":"2024-09-10T07:39:52.446946+0000","last_peered":"2024-09-10T07:39:52.446946+0000","last_clean":"2024-09-10T07:39:52.446946+0000","last_became_active":"2024-09-10T07:39:51.449679+0000","last_became_peered":"2024-09-10T07:39:51.449679+0000","last_unstale":"2024-09-10T07:39:52.446946+0000","last_undegraded":"2024-09-10T07:39:52.446946+0000","last_fullsized":"2024-09-10T07:39:52.446946+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:08.342473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.452414+0000","last_change":"2024-09-10T07:39:52.451141+0000","last_active":"2024-09-10T07:39:52.452414+0000","last_peered":"2024-09-10T07:39:52.452414+0000","last_clean":"2024-09-10T07:39:52.452414+0000","last_became_active":"2024-09-10T07:39:52.450890+0000","last_became_peered":"2024-09-10T07:39:52.450890+0000","last_unstale":"2024-09-10T07:39:52.452414+0000","last_undegraded":"2024-09-10T07:39:52.452414+0000","last_fullsized":"2024-09-10T07:39:52.452414+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:49.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.442281+0000","last_change":"2024-09-10T07:39:51.454608+0000","last_active":"2024-09-10T07:39:53.442281+0000","last_peered":"2024-09-10T07:39:53.442281+0000","last_clean":"2024-09-10T07:39:53.442281+0000","last_became_active":"2024-09-10T07:39:51.454199+0000","last_became_peered":"2024-09-10T07:39:51.454199+0000","last_unstale":"2024-09-10T07:39:53.442281+0000","last_undegraded":"2024-09-10T07:39:53.442281+0000","last_fullsized":"2024-09-10T07:39:53.442281+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:50.305163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440963+0000","last_change":"2024-09-10T07:39:52.452278+0000","last_active":"2024-09-10T07:39:53.440963+0000","last_peered":"2024-09-10T07:39:53.440963+0000","last_clean":"2024-09-10T07:39:53.440963+0000","last_became_active":"2024-09-10T07:39:52.451872+0000","last_became_peered":"2024-09-10T07:39:52.451872+0000","last_unstale":"2024-09-10T07:39:53.440963+0000","last_undegraded":"2024-09-10T07:39:53.440963+0000","last_fullsized":"2024-09-10T07:39:53.440963+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:42.086073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.442072+0000","last_change":"2024-09-10T07:39:51.451833+0000","last_active":"2024-09-10T07:39:53.442072+0000","last_peered":"2024-09-10T07:39:53.442072+0000","last_clean":"2024-09-10T07:39:53.442072+0000","last_became_active":"2024-09-10T07:39:51.451569+0000","last_became_peered":"2024-09-10T07:39:51.451569+0000","last_unstale":"2024-09-10T07:39:53.442072+0000","last_undegraded":"2024-09-10T07:39:53.442072+0000","last_fullsized":"2024-09-10T07:39:53.442072+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:32.445924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.457127+0000","last_change":"2024-09-10T07:39:52.456849+0000","last_active":"2024-09-10T07:39:52.457127+0000","last_peered":"2024-09-10T07:39:52.457127+0000","last_clean":"2024-09-10T07:39:52.457127+0000","last_became_active":"2024-09-10T07:39:52.456294+0000","last_became_peered":"2024-09-10T07:39:52.456294+0000","last_unstale":"2024-09-10T07:39:52.457127+0000","last_undegraded":"2024-09-10T07:39:52.457127+0000","last_fullsized":"2024-09-10T07:39:52.457127+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:23.966345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.444283+0000","last_change":"2024-09-10T07:39:51.449761+0000","last_active":"2024-09-10T07:39:52.444283+0000","last_peered":"2024-09-10T07:39:52.444283+0000","last_clean":"2024-09-10T07:39:52.444283+0000","last_became_active":"2024-09-10T07:39:51.449542+0000","last_became_peered":"2024-09-10T07:39:51.449542+0000","last_unstale":"2024-09-10T07:39:52.444283+0000","last_undegraded":"2024-09-10T07:39:52.444283+0000","last_fullsized":"2024-09-10T07:39:52.444283+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:21:52.354702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.451642+0000","last_change":"2024-09-10T07:39:52.451107+0000","last_active":"2024-09-10T07:39:52.451642+0000","last_peered":"2024-09-10T07:39:52.451642+0000","last_clean":"2024-09-10T07:39:52.451642+0000","last_became_active":"2024-09-10T07:39:52.450572+0000","last_became_peered":"2024-09-10T07:39:52.450572+0000","last_unstale":"2024-09-10T07:39:52.451642+0000","last_undegraded":"2024-09-10T07:39:52.451642+0000","last_fullsized":"2024-09-10T07:39:52.451642+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:01.297386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"124'3","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.463974+0000","last_change":"2024-09-10T07:39:51.448449+0000","last_active":"2024-09-10T07:39:52.463974+0000","last_peered":"2024-09-10T07:39:52.463974+0000","last_clean":"2024-09-10T07:39:52.463974+0000","last_became_active":"2024-09-10T07:39:51.448142+0000","last_became_peered":"2024-09-10T07:39:51.448142+0000","last_unstale":"2024-09-10T07:39:52.463974+0000","last_undegraded":"2024-09-10T07:39:52.463974+0000","last_fullsized":"2024-09-10T07:39:52.463974+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:10.578948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.454934+0000","last_change":"2024-09-10T07:39:52.453333+0000","last_active":"2024-09-10T07:39:52.454934+0000","last_peered":"2024-09-10T07:39:52.454934+0000","last_clean":"2024-09-10T07:39:52.454934+0000","last_became_active":"2024-09-10T07:39:52.452880+0000","last_became_peered":"2024-09-10T07:39:52.452880+0000","last_unstale":"2024-09-10T07:39:52.454934+0000","last_undegraded":"2024-09-10T07:39:52.454934+0000","last_fullsized":"2024-09-10T07:39:52.454934+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:40.378350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"124'6","reported_seq":18,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.469102+0000","last_change":"2024-09-10T07:39:51.444342+0000","last_active":"2024-09-10T07:39:52.469102+0000","last_peered":"2024-09-10T07:39:52.469102+0000","last_clean":"2024-09-10T07:39:52.469102+0000","last_became_active":"2024-09-10T07:39:51.443961+0000","last_became_peered":"2024-09-10T07:39:51.443961+0000","last_unstale":"2024-09-10T07:39:52.469102+0000","last_undegraded":"2024-09-10T07:39:52.469102+0000","last_fullsized":"2024-09-10T07:39:52.469102+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:54.012609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455262+0000","last_change":"2024-09-10T07:39:52.451651+0000","last_active":"2024-09-10T07:39:52.455262+0000","last_peered":"2024-09-10T07:39:52.455262+0000","last_clean":"2024-09-10T07:39:52.455262+0000","last_became_active":"2024-09-10T07:39:52.451423+0000","last_became_peered":"2024-09-10T07:39:52.451423+0000","last_unstale":"2024-09-10T07:39:52.455262+0000","last_undegraded":"2024-09-10T07:39:52.455262+0000","last_fullsized":"2024-09-10T07:39:52.455262+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:39.123043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457257+0000","last_change":"2024-09-10T07:39:51.447987+0000","last_active":"2024-09-10T07:39:53.457257+0000","last_peered":"2024-09-10T07:39:53.457257+0000","last_clean":"2024-09-10T07:39:53.457257+0000","last_became_active":"2024-09-10T07:39:51.447081+0000","last_became_peered":"2024-09-10T07:39:51.447081+0000","last_unstale":"2024-09-10T07:39:53.457257+0000","last_undegraded":"2024-09-10T07:39:53.457257+0000","last_fullsized":"2024-09-10T07:39:53.457257+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:12.372208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.442043+0000","last_change":"2024-09-10T07:39:52.453883+0000","last_active":"2024-09-10T07:39:53.442043+0000","last_peered":"2024-09-10T07:39:53.442043+0000","last_clean":"2024-09-10T07:39:53.442043+0000","last_became_active":"2024-09-10T07:39:52.453662+0000","last_became_peered":"2024-09-10T07:39:52.453662+0000","last_unstale":"2024-09-10T07:39:53.442043+0000","last_undegraded":"2024-09-10T07:39:53.442043+0000","last_fullsized":"2024-09-10T07:39:53.442043+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:51.539624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457083+0000","last_change":"2024-09-10T07:39:51.452053+0000","last_active":"2024-09-10T07:39:53.457083+0000","last_peered":"2024-09-10T07:39:53.457083+0000","last_clean":"2024-09-10T07:39:53.457083+0000","last_became_active":"2024-09-10T07:39:51.451835+0000","last_became_peered":"2024-09-10T07:39:51.451835+0000","last_unstale":"2024-09-10T07:39:53.457083+0000","last_undegraded":"2024-09-10T07:39:53.457083+0000","last_fullsized":"2024-09-10T07:39:53.457083+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:49.237588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.452449+0000","last_change":"2024-09-10T07:39:52.451430+0000","last_active":"2024-09-10T07:39:52.452449+0000","last_peered":"2024-09-10T07:39:52.452449+0000","last_clean":"2024-09-10T07:39:52.452449+0000","last_became_active":"2024-09-10T07:39:52.451160+0000","last_became_peered":"2024-09-10T07:39:52.451160+0000","last_unstale":"2024-09-10T07:39:52.452449+0000","last_undegraded":"2024-09-10T07:39:52.452449+0000","last_fullsized":"2024-09-10T07:39:52.452449+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:04.084033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.448914+0000","last_change":"2024-09-10T07:39:51.444543+0000","last_active":"2024-09-10T07:39:52.448914+0000","last_peered":"2024-09-10T07:39:52.448914+0000","last_clean":"2024-09-10T07:39:52.448914+0000","last_became_active":"2024-09-10T07:39:51.444218+0000","last_became_peered":"2024-09-10T07:39:51.444218+0000","last_unstale":"2024-09-10T07:39:52.448914+0000","last_undegraded":"2024-09-10T07:39:52.448914+0000","last_fullsized":"2024-09-10T07:39:52.448914+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:48:06.630564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456946+0000","last_change":"2024-09-10T07:39:52.452884+0000","last_active":"2024-09-10T07:39:53.456946+0000","last_peered":"2024-09-10T07:39:53.456946+0000","last_clean":"2024-09-10T07:39:53.456946+0000","last_became_active":"2024-09-10T07:39:52.451582+0000","last_became_peered":"2024-09-10T07:39:52.451582+0000","last_unstale":"2024-09-10T07:39:53.456946+0000","last_undegraded":"2024-09-10T07:39:53.456946+0000","last_fullsized":"2024-09-10T07:39:53.456946+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:35.464670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"124'8","reported_seq":22,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441830+0000","last_change":"2024-09-10T07:39:51.453483+0000","last_active":"2024-09-10T07:39:53.441830+0000","last_peered":"2024-09-10T07:39:53.441830+0000","last_clean":"2024-09-10T07:39:53.441830+0000","last_became_active":"2024-09-10T07:39:51.453303+0000","last_became_peered":"2024-09-10T07:39:51.453303+0000","last_unstale":"2024-09-10T07:39:53.441830+0000","last_undegraded":"2024-09-10T07:39:53.441830+0000","last_fullsized":"2024-09-10T07:39:53.441830+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:20.838098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.452011+0000","last_change":"2024-09-10T07:39:52.451874+0000","last_active":"2024-09-10T07:39:52.452011+0000","last_peered":"2024-09-10T07:39:52.452011+0000","last_clean":"2024-09-10T07:39:52.452011+0000","last_became_active":"2024-09-10T07:39:52.450874+0000","last_became_peered":"2024-09-10T07:39:52.450874+0000","last_unstale":"2024-09-10T07:39:52.452011+0000","last_undegraded":"2024-09-10T07:39:52.452011+0000","last_fullsized":"2024-09-10T07:39:52.452011+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:33.101676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"124'2","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.468330+0000","last_change":"2024-09-10T07:39:51.445547+0000","last_active":"2024-09-10T07:39:52.468330+0000","last_peered":"2024-09-10T07:39:52.468330+0000","last_clean":"2024-09-10T07:39:52.468330+0000","last_became_active":"2024-09-10T07:39:51.444917+0000","last_became_peered":"2024-09-10T07:39:51.444917+0000","last_unstale":"2024-09-10T07:39:52.468330+0000","last_undegraded":"2024-09-10T07:39:52.468330+0000","last_fullsized":"2024-09-10T07:39:52.468330+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:35.354732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441069+0000","last_change":"2024-09-10T07:39:52.449424+0000","last_active":"2024-09-10T07:39:53.441069+0000","last_peered":"2024-09-10T07:39:53.441069+0000","last_clean":"2024-09-10T07:39:53.441069+0000","last_became_active":"2024-09-10T07:39:52.447291+0000","last_became_peered":"2024-09-10T07:39:52.447291+0000","last_unstale":"2024-09-10T07:39:53.441069+0000","last_undegraded":"2024-09-10T07:39:53.441069+0000","last_fullsized":"2024-09-10T07:39:53.441069+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:50.439685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"124'1","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.460889+0000","last_change":"2024-09-10T07:39:51.446456+0000","last_active":"2024-09-10T07:39:52.460889+0000","last_peered":"2024-09-10T07:39:52.460889+0000","last_clean":"2024-09-10T07:39:52.460889+0000","last_became_active":"2024-09-10T07:39:51.446236+0000","last_became_peered":"2024-09-10T07:39:51.446236+0000","last_unstale":"2024-09-10T07:39:52.460889+0000","last_undegraded":"2024-09-10T07:39:52.460889+0000","last_fullsized":"2024-09-10T07:39:52.460889+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:42.735081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.455966+0000","last_change":"2024-09-10T07:39:52.455499+0000","last_active":"2024-09-10T07:39:52.455966+0000","last_peered":"2024-09-10T07:39:52.455966+0000","last_clean":"2024-09-10T07:39:52.455966+0000","last_became_active":"2024-09-10T07:39:52.454785+0000","last_became_peered":"2024-09-10T07:39:52.454785+0000","last_unstale":"2024-09-10T07:39:52.455966+0000","last_undegraded":"2024-09-10T07:39:52.455966+0000","last_fullsized":"2024-09-10T07:39:52.455966+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:47.942327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441037+0000","last_change":"2024-09-10T07:39:51.442472+0000","last_active":"2024-09-10T07:39:53.441037+0000","last_peered":"2024-09-10T07:39:53.441037+0000","last_clean":"2024-09-10T07:39:53.441037+0000","last_became_active":"2024-09-10T07:39:51.442261+0000","last_became_peered":"2024-09-10T07:39:51.442261+0000","last_unstale":"2024-09-10T07:39:53.441037+0000","last_undegraded":"2024-09-10T07:39:53.441037+0000","last_fullsized":"2024-09-10T07:39:53.441037+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:03.784565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457201+0000","last_change":"2024-09-10T07:39:52.453233+0000","last_active":"2024-09-10T07:39:53.457201+0000","last_peered":"2024-09-10T07:39:53.457201+0000","last_clean":"2024-09-10T07:39:53.457201+0000","last_became_active":"2024-09-10T07:39:52.452330+0000","last_became_peered":"2024-09-10T07:39:52.452330+0000","last_unstale":"2024-09-10T07:39:53.457201+0000","last_undegraded":"2024-09-10T07:39:53.457201+0000","last_fullsized":"2024-09-10T07:39:53.457201+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:09.466054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441285+0000","last_change":"2024-09-10T07:39:51.445897+0000","last_active":"2024-09-10T07:39:53.441285+0000","last_peered":"2024-09-10T07:39:53.441285+0000","last_clean":"2024-09-10T07:39:53.441285+0000","last_became_active":"2024-09-10T07:39:51.444665+0000","last_became_peered":"2024-09-10T07:39:51.444665+0000","last_unstale":"2024-09-10T07:39:53.441285+0000","last_undegraded":"2024-09-10T07:39:53.441285+0000","last_fullsized":"2024-09-10T07:39:53.441285+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:40.958252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456661+0000","last_change":"2024-09-10T07:39:52.450466+0000","last_active":"2024-09-10T07:39:53.456661+0000","last_peered":"2024-09-10T07:39:53.456661+0000","last_clean":"2024-09-10T07:39:53.456661+0000","last_became_active":"2024-09-10T07:39:52.449518+0000","last_became_peered":"2024-09-10T07:39:52.449518+0000","last_unstale":"2024-09-10T07:39:53.456661+0000","last_undegraded":"2024-09-10T07:39:53.456661+0000","last_fullsized":"2024-09-10T07:39:53.456661+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:39.711370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440818+0000","last_change":"2024-09-10T07:39:51.452076+0000","last_active":"2024-09-10T07:39:53.440818+0000","last_peered":"2024-09-10T07:39:53.440818+0000","last_clean":"2024-09-10T07:39:53.440818+0000","last_became_active":"2024-09-10T07:39:51.451830+0000","last_became_peered":"2024-09-10T07:39:51.451830+0000","last_unstale":"2024-09-10T07:39:53.440818+0000","last_undegraded":"2024-09-10T07:39:53.440818+0000","last_fullsized":"2024-09-10T07:39:53.440818+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:31.024974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456992+0000","last_change":"2024-09-10T07:39:52.448839+0000","last_active":"2024-09-10T07:39:53.456992+0000","last_peered":"2024-09-10T07:39:53.456992+0000","last_clean":"2024-09-10T07:39:53.456992+0000","last_became_active":"2024-09-10T07:39:52.448617+0000","last_became_peered":"2024-09-10T07:39:52.448617+0000","last_unstale":"2024-09-10T07:39:53.456992+0000","last_undegraded":"2024-09-10T07:39:53.456992+0000","last_fullsized":"2024-09-10T07:39:53.456992+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:02.978194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440906+0000","last_change":"2024-09-10T07:39:51.442175+0000","last_active":"2024-09-10T07:39:53.440906+0000","last_peered":"2024-09-10T07:39:53.440906+0000","last_clean":"2024-09-10T07:39:53.440906+0000","last_became_active":"2024-09-10T07:39:51.441874+0000","last_became_peered":"2024-09-10T07:39:51.441874+0000","last_unstale":"2024-09-10T07:39:53.440906+0000","last_undegraded":"2024-09-10T07:39:53.440906+0000","last_fullsized":"2024-09-10T07:39:53.440906+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:39.581861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.459611+0000","last_change":"2024-09-10T07:39:52.459519+0000","last_active":"2024-09-10T07:39:52.459611+0000","last_peered":"2024-09-10T07:39:52.459611+0000","last_clean":"2024-09-10T07:39:52.459611+0000","last_became_active":"2024-09-10T07:39:52.459333+0000","last_became_peered":"2024-09-10T07:39:52.459333+0000","last_unstale":"2024-09-10T07:39:52.459611+0000","last_undegraded":"2024-09-10T07:39:52.459611+0000","last_fullsized":"2024-09-10T07:39:52.459611+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:54.875142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440999+0000","last_change":"2024-09-10T07:39:51.452819+0000","last_active":"2024-09-10T07:39:53.440999+0000","last_peered":"2024-09-10T07:39:53.440999+0000","last_clean":"2024-09-10T07:39:53.440999+0000","last_became_active":"2024-09-10T07:39:51.452592+0000","last_became_peered":"2024-09-10T07:39:51.452592+0000","last_unstale":"2024-09-10T07:39:53.440999+0000","last_undegraded":"2024-09-10T07:39:53.440999+0000","last_fullsized":"2024-09-10T07:39:53.440999+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:44.071953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440883+0000","last_change":"2024-09-10T07:39:52.452787+0000","last_active":"2024-09-10T07:39:53.440883+0000","last_peered":"2024-09-10T07:39:53.440883+0000","last_clean":"2024-09-10T07:39:53.440883+0000","last_became_active":"2024-09-10T07:39:52.452576+0000","last_became_peered":"2024-09-10T07:39:52.452576+0000","last_unstale":"2024-09-10T07:39:53.440883+0000","last_undegraded":"2024-09-10T07:39:53.440883+0000","last_fullsized":"2024-09-10T07:39:53.440883+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:56.294891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441197+0000","last_change":"2024-09-10T07:39:51.441548+0000","last_active":"2024-09-10T07:39:53.441197+0000","last_peered":"2024-09-10T07:39:53.441197+0000","last_clean":"2024-09-10T07:39:53.441197+0000","last_became_active":"2024-09-10T07:39:51.441308+0000","last_became_peered":"2024-09-10T07:39:51.441308+0000","last_unstale":"2024-09-10T07:39:53.441197+0000","last_undegraded":"2024-09-10T07:39:53.441197+0000","last_fullsized":"2024-09-10T07:39:53.441197+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:43.171925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441905+0000","last_change":"2024-09-10T07:39:52.461494+0000","last_active":"2024-09-10T07:39:53.441905+0000","last_peered":"2024-09-10T07:39:53.441905+0000","last_clean":"2024-09-10T07:39:53.441905+0000","last_became_active":"2024-09-10T07:39:52.459618+0000","last_became_peered":"2024-09-10T07:39:52.459618+0000","last_unstale":"2024-09-10T07:39:53.441905+0000","last_undegraded":"2024-09-10T07:39:53.441905+0000","last_fullsized":"2024-09-10T07:39:53.441905+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:48.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"125'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456572+0000","last_change":"2024-09-10T07:39:51.445710+0000","last_active":"2024-09-10T07:39:53.456572+0000","last_peered":"2024-09-10T07:39:53.456572+0000","last_clean":"2024-09-10T07:39:53.456572+0000","last_became_active":"2024-09-10T07:39:51.444323+0000","last_became_peered":"2024-09-10T07:39:51.444323+0000","last_unstale":"2024-09-10T07:39:53.456572+0000","last_undegraded":"2024-09-10T07:39:53.456572+0000","last_fullsized":"2024-09-10T07:39:53.456572+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:27.031348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.442194+0000","last_change":"2024-09-10T07:39:52.453398+0000","last_active":"2024-09-10T07:39:53.442194+0000","last_peered":"2024-09-10T07:39:53.442194+0000","last_clean":"2024-09-10T07:39:53.442194+0000","last_became_active":"2024-09-10T07:39:52.452069+0000","last_became_peered":"2024-09-10T07:39:52.452069+0000","last_unstale":"2024-09-10T07:39:53.442194+0000","last_undegraded":"2024-09-10T07:39:53.442194+0000","last_fullsized":"2024-09-10T07:39:53.442194+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:26.963581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.440519+0000","last_change":"2024-09-10T07:39:51.447858+0000","last_active":"2024-09-10T07:39:53.440519+0000","last_peered":"2024-09-10T07:39:53.440519+0000","last_clean":"2024-09-10T07:39:53.440519+0000","last_became_active":"2024-09-10T07:39:51.446419+0000","last_became_peered":"2024-09-10T07:39:51.446419+0000","last_unstale":"2024-09-10T07:39:53.440519+0000","last_undegraded":"2024-09-10T07:39:53.440519+0000","last_fullsized":"2024-09-10T07:39:53.440519+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:12.629947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.449309+0000","last_change":"2024-09-10T07:39:52.449190+0000","last_active":"2024-09-10T07:39:52.449309+0000","last_peered":"2024-09-10T07:39:52.449309+0000","last_clean":"2024-09-10T07:39:52.449309+0000","last_became_active":"2024-09-10T07:39:52.448946+0000","last_became_peered":"2024-09-10T07:39:52.448946+0000","last_unstale":"2024-09-10T07:39:52.449309+0000","last_undegraded":"2024-09-10T07:39:52.449309+0000","last_fullsized":"2024-09-10T07:39:52.449309+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:05.402844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.446128+0000","last_change":"2024-09-10T07:39:51.448683+0000","last_active":"2024-09-10T07:39:52.446128+0000","last_peered":"2024-09-10T07:39:52.446128+0000","last_clean":"2024-09-10T07:39:52.446128+0000","last_became_active":"2024-09-10T07:39:51.448445+0000","last_became_peered":"2024-09-10T07:39:51.448445+0000","last_unstale":"2024-09-10T07:39:52.446128+0000","last_undegraded":"2024-09-10T07:39:52.446128+0000","last_fullsized":"2024-09-10T07:39:52.446128+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:05.419314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457136+0000","last_change":"2024-09-10T07:39:52.452449+0000","last_active":"2024-09-10T07:39:53.457136+0000","last_peered":"2024-09-10T07:39:53.457136+0000","last_clean":"2024-09-10T07:39:53.457136+0000","last_became_active":"2024-09-10T07:39:52.450742+0000","last_became_peered":"2024-09-10T07:39:52.450742+0000","last_unstale":"2024-09-10T07:39:53.457136+0000","last_undegraded":"2024-09-10T07:39:53.457136+0000","last_fullsized":"2024-09-10T07:39:53.457136+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:26.283672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.441084+0000","last_change":"2024-09-10T07:39:51.447150+0000","last_active":"2024-09-10T07:39:53.441084+0000","last_peered":"2024-09-10T07:39:53.441084+0000","last_clean":"2024-09-10T07:39:53.441084+0000","last_became_active":"2024-09-10T07:39:51.446683+0000","last_became_peered":"2024-09-10T07:39:51.446683+0000","last_unstale":"2024-09-10T07:39:53.441084+0000","last_undegraded":"2024-09-10T07:39:53.441084+0000","last_fullsized":"2024-09-10T07:39:53.441084+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:13.712054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.453584+0000","last_change":"2024-09-10T07:39:52.452969+0000","last_active":"2024-09-10T07:39:52.453584+0000","last_peered":"2024-09-10T07:39:52.453584+0000","last_clean":"2024-09-10T07:39:52.453584+0000","last_became_active":"2024-09-10T07:39:52.452632+0000","last_became_peered":"2024-09-10T07:39:52.452632+0000","last_unstale":"2024-09-10T07:39:52.453584+0000","last_undegraded":"2024-09-10T07:39:52.453584+0000","last_fullsized":"2024-09-10T07:39:52.453584+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:54.977989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.444761+0000","last_change":"2024-09-10T07:39:51.452610+0000","last_active":"2024-09-10T07:39:52.444761+0000","last_peered":"2024-09-10T07:39:52.444761+0000","last_clean":"2024-09-10T07:39:52.444761+0000","last_became_active":"2024-09-10T07:39:51.452383+0000","last_became_peered":"2024-09-10T07:39:51.452383+0000","last_unstale":"2024-09-10T07:39:52.444761+0000","last_undegraded":"2024-09-10T07:39:52.444761+0000","last_fullsized":"2024-09-10T07:39:52.444761+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:26.022277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457331+0000","last_change":"2024-09-10T07:39:52.453428+0000","last_active":"2024-09-10T07:39:53.457331+0000","last_peered":"2024-09-10T07:39:53.457331+0000","last_clean":"2024-09-10T07:39:53.457331+0000","last_became_active":"2024-09-10T07:39:52.452623+0000","last_became_peered":"2024-09-10T07:39:52.452623+0000","last_unstale":"2024-09-10T07:39:53.457331+0000","last_undegraded":"2024-09-10T07:39:53.457331+0000","last_fullsized":"2024-09-10T07:39:53.457331+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:33.568574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.445093+0000","last_change":"2024-09-10T07:39:51.452758+0000","last_active":"2024-09-10T07:39:52.445093+0000","last_peered":"2024-09-10T07:39:52.445093+0000","last_clean":"2024-09-10T07:39:52.445093+0000","last_became_active":"2024-09-10T07:39:51.452526+0000","last_became_peered":"2024-09-10T07:39:51.452526+0000","last_unstale":"2024-09-10T07:39:52.445093+0000","last_undegraded":"2024-09-10T07:39:52.445093+0000","last_fullsized":"2024-09-10T07:39:52.445093+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:52.848544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.452686+0000","last_change":"2024-09-10T07:39:52.451246+0000","last_active":"2024-09-10T07:39:52.452686+0000","last_peered":"2024-09-10T07:39:52.452686+0000","last_clean":"2024-09-10T07:39:52.452686+0000","last_became_active":"2024-09-10T07:39:52.449464+0000","last_became_peered":"2024-09-10T07:39:52.449464+0000","last_unstale":"2024-09-10T07:39:52.452686+0000","last_undegraded":"2024-09-10T07:39:52.452686+0000","last_fullsized":"2024-09-10T07:39:52.452686+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:25.477547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.457416+0000","last_change":"2024-09-10T07:39:51.450475+0000","last_active":"2024-09-10T07:39:53.457416+0000","last_peered":"2024-09-10T07:39:53.457416+0000","last_clean":"2024-09-10T07:39:53.457416+0000","last_became_active":"2024-09-10T07:39:51.450262+0000","last_became_peered":"2024-09-10T07:39:51.450262+0000","last_unstale":"2024-09-10T07:39:53.457416+0000","last_undegraded":"2024-09-10T07:39:53.457416+0000","last_fullsized":"2024-09-10T07:39:53.457416+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:43.430271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-10T07:39:53.456926+0000","last_change":"2024-09-10T07:39:52.452750+0000","last_active":"2024-09-10T07:39:53.456926+0000","last_peered":"2024-09-10T07:39:53.456926+0000","last_clean":"2024-09-10T07:39:53.456926+0000","last_became_active":"2024-09-10T07:39:52.452478+0000","last_became_peered":"2024-09-10T07:39:52.452478+0000","last_unstale":"2024-09-10T07:39:53.456926+0000","last_undegraded":"2024-09-10T07:39:53.456926+0000","last_fullsized":"2024-09-10T07:39:53.456926+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:51.428685+0000","last_clean_scrub_stamp":"2024-09-10T07:39:51.428685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:15.070104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"124'1","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.464383+0000","last_change":"2024-09-10T07:39:51.449244+0000","last_active":"2024-09-10T07:39:52.464383+0000","last_peered":"2024-09-10T07:39:52.464383+0000","last_clean":"2024-09-10T07:39:52.464383+0000","last_became_active":"2024-09-10T07:39:51.449038+0000","last_became_peered":"2024-09-10T07:39:51.449038+0000","last_unstale":"2024-09-10T07:39:52.464383+0000","last_undegraded":"2024-09-10T07:39:52.464383+0000","last_fullsized":"2024-09-10T07:39:52.464383+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:39:50.425471+0000","last_clean_scrub_stamp":"2024-09-10T07:39:50.425471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:33.530414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":377,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T07:39:52.440623+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:39:52.440623+0000","last_peered":"2024-09-10T07:39:52.440623+0000","last_clean":"2024-09-10T07:39:52.440623+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:39:52.440623+0000","last_undegraded":"2024-09-10T07:39:52.440623+0000","last_fullsized":"2024-09-10T07:39:52.440623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1245,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194066,"statfs":{"total":200000000,"available":198724170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194642,"statfs":{"total":200000000,"available":199313998,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":670,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194641,"statfs":{"total":200000000,"available":199312914,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":670,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194641,"statfs":{"total":200000000,"available":199313016,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314616,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1246,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194066,"statfs":{"total":200000000,"available":198723700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:39:57.028 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:39:57.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T07:39:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.225+0000 7f8f62000640 1 Processor -- start 2024-09-10T07:39:57.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.225+0000 7f8f62000640 1 -- start start 2024-09-10T07:39:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.226+0000 7f8f62000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8f5c071df0 0x7f8f5c073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f62000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f5c0722d0 con 0x7f8f5c06e280 2024-09-10T07:39:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f62000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f5c0725b0 con 0x7f8f5c0d1010 2024-09-10T07:39:57.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f62000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8f5c0738b0 con 0x7f8f5c071df0 2024-09-10T07:39:57.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f5b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8f5c06e280 0x7f8f5c06e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54346/0 (socket says 172.21.15.99:54346) 2024-09-10T07:39:57.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f5b400640 1 -- 172.21.15.99:0/1892121915 learned_addr learned my addr 172.21.15.99:0/1892121915 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:39:57.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f5aa00640 1 --2- 172.21.15.99:0/1892121915 >> v2:172.21.15.187:3300/0 conn(0x7f8f5c071df0 0x7f8f5c073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:57.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f5a000640 1 -- 172.21.15.99:0/1892121915 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 131386571 0 0) 0x7f8f5c0722d0 con 0x7f8f5c06e280 2024-09-10T07:39:57.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f5a000640 1 -- 172.21.15.99:0/1892121915 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f40003520 con 0x7f8f5c06e280 2024-09-10T07:39:57.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f5aa00640 1 -- 172.21.15.99:0/1892121915 >> v1:172.21.15.187:6789/0 conn(0x7f8f5c0d1010 legacy=0x7f8f5c0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f5aa00640 1 -- 172.21.15.99:0/1892121915 >> v1:172.21.15.99:6789/0 conn(0x7f8f5c06e280 legacy=0x7f8f5c06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.227+0000 7f8f5aa00640 1 -- 172.21.15.99:0/1892121915 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c072890 con 0x7f8f5c071df0 2024-09-10T07:39:57.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.229+0000 7f8f5aa00640 1 --2- 172.21.15.99:0/1892121915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f5c071df0 0x7f8f5c073370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8f480097a0 tx=0x7f8f4802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11df40566875307d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:57.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.229+0000 7f8f5a000640 1 -- 172.21.15.99:0/1892121915 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48037070 con 0x7f8f5c071df0 2024-09-10T07:39:57.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.229+0000 7f8f5a000640 1 -- 172.21.15.99:0/1892121915 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f48032440 con 0x7f8f5c071df0 2024-09-10T07:39:57.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.229+0000 7f8f5a000640 1 -- 172.21.15.99:0/1892121915 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48032810 con 0x7f8f5c071df0 2024-09-10T07:39:57.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.229+0000 7f8f62000640 1 -- 172.21.15.99:0/1892121915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f5c071df0 msgr2=0x7f8f5c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.229+0000 7f8f62000640 1 --2- 172.21.15.99:0/1892121915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f5c071df0 0x7f8f5c073370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8f480097a0 tx=0x7f8f4802a230 comp rx=0 tx=0).stop 2024-09-10T07:39:57.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.229+0000 7f8f62000640 1 -- 172.21.15.99:0/1892121915 shutdown_connections 2024-09-10T07:39:57.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.229+0000 7f8f62000640 1 --2- 172.21.15.99:0/1892121915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f5c071df0 0x7f8f5c073370 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.229+0000 7f8f62000640 1 -- 172.21.15.99:0/1892121915 >> 172.21.15.99:0/1892121915 conn(0x7f8f5c06bc10 msgr2=0x7f8f5c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:57.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.229+0000 7f8f62000640 1 -- 172.21.15.99:0/1892121915 shutdown_connections 2024-09-10T07:39:57.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.230+0000 7f8f62000640 1 -- 172.21.15.99:0/1892121915 wait complete. 2024-09-10T07:39:57.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.231+0000 7f8f62000640 1 Processor -- start 2024-09-10T07:39:57.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.231+0000 7f8f62000640 1 -- start start 2024-09-10T07:39:57.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.232+0000 7f8f62000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f5c06e280 0x7f8f5c140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.232+0000 7f8f62000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f5c071df0 0x7f8f5c1f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.232+0000 7f8f62000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f5c0d1010 0x7f8f5c141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.232+0000 7f8f62000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c15db60 con 0x7f8f5c0d1010 2024-09-10T07:39:57.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.232+0000 7f8f62000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c072e50 con 0x7f8f5c071df0 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.232+0000 7f8f62000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5c0d14c0 con 0x7f8f5c06e280 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.232+0000 7f8f5be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f5c0d1010 0x7f8f5c141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.232+0000 7f8f5be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f5c0d1010 0x7f8f5c141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55518/0 (socket says 172.21.15.99:55518) 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.232+0000 7f8f5be00640 1 -- 172.21.15.99:0/2038052837 learned_addr learned my addr 172.21.15.99:0/2038052837 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f5aa00640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f5c071df0 0x7f8f5c1f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f5b400640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f5c06e280 0x7f8f5c140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f5be00640 1 -- 172.21.15.99:0/2038052837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f5c06e280 msgr2=0x7f8f5c140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f5be00640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f5c06e280 0x7f8f5c140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f5be00640 1 -- 172.21.15.99:0/2038052837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f5c071df0 msgr2=0x7f8f5c1f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f5be00640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f5c071df0 0x7f8f5c1f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f5be00640 1 -- 172.21.15.99:0/2038052837 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c156250 con 0x7f8f5c0d1010 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f5b400640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f5c06e280 0x7f8f5c140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:57.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f5be00640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f5c0d1010 0x7f8f5c141390 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c6e0 tx=0x7f8f5400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f53400640 1 -- 172.21.15.99:0/2038052837 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54003b70 con 0x7f8f5c0d1010 2024-09-10T07:39:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f53400640 1 -- 172.21.15.99:0/2038052837 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f54003d30 con 0x7f8f5c0d1010 2024-09-10T07:39:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.233+0000 7f8f53400640 1 -- 172.21.15.99:0/2038052837 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54005310 con 0x7f8f5c0d1010 2024-09-10T07:39:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.234+0000 7f8f62000640 1 -- 172.21.15.99:0/2038052837 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f5c1410b0 con 0x7f8f5c0d1010 2024-09-10T07:39:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.234+0000 7f8f62000640 1 -- 172.21.15.99:0/2038052837 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f5c1f33f0 con 0x7f8f5c0d1010 2024-09-10T07:39:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.235+0000 7f8f62000640 1 -- 172.21.15.99:0/2038052837 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f5c073370 con 0x7f8f5c0d1010 2024-09-10T07:39:57.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.235+0000 7f8f53400640 1 -- 172.21.15.99:0/2038052837 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f540054b0 con 0x7f8f5c0d1010 2024-09-10T07:39:57.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.236+0000 7f8f53400640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f3c06be30 0x7f8f3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.236+0000 7f8f53400640 1 -- 172.21.15.99:0/2038052837 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7f8f5408ab80 con 0x7f8f5c0d1010 2024-09-10T07:39:57.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.237+0000 7f8f5b400640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f3c06be30 0x7f8f3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:57.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.237+0000 7f8f5b400640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f3c06be30 0x7f8f3c06e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c007fd0 tx=0x7f8f4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:57.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.241+0000 7f8f53400640 1 -- 172.21.15.99:0/2038052837 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f5c1410b0 con 0x7f8f5c0d1010 2024-09-10T07:39:57.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.474+0000 7f8f62000640 1 -- 172.21.15.99:0/2038052837 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8f5c06de00 con 0x7f8f5c0d1010 2024-09-10T07:39:57.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.477+0000 7f8f53400640 1 -- 172.21.15.99:0/2038052837 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f8f540595c0 con 0x7f8f5c0d1010 2024-09-10T07:39:57.477 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:39:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:39:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-09-10T07:39:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-09-10T07:39:57.477 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T07:39:57.477 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-09-10T07:39:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 -- 172.21.15.99:0/2038052837 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f3c06be30 msgr2=0x7f8f3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f3c06be30 0x7f8f3c06e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c007fd0 tx=0x7f8f4c009040 comp rx=0 tx=0).stop 2024-09-10T07:39:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 -- 172.21.15.99:0/2038052837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f5c0d1010 msgr2=0x7f8f5c141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f5c0d1010 0x7f8f5c141390 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c6e0 tx=0x7f8f5400cba0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 -- 172.21.15.99:0/2038052837 shutdown_connections 2024-09-10T07:39:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8f3c06be30 0x7f8f3c06e2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f5c0d1010 0x7f8f5c141390 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f5c071df0 0x7f8f5c1f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 --2- 172.21.15.99:0/2038052837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f5c06e280 0x7f8f5c140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 -- 172.21.15.99:0/2038052837 >> 172.21.15.99:0/2038052837 conn(0x7f8f5c06bc10 msgr2=0x7f8f5c15f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 -- 172.21.15.99:0/2038052837 shutdown_connections 2024-09-10T07:39:57.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.479+0000 7f8f62000640 1 -- 172.21.15.99:0/2038052837 wait complete. 2024-09-10T07:39:57.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:39:57.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.649+0000 7fe44f200640 1 Processor -- start 2024-09-10T07:39:57.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.649+0000 7fe44f200640 1 -- start start 2024-09-10T07:39:57.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.650+0000 7fe44f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe4500d2680 0x7fe4500cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.650+0000 7fe44f200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe4500cfac0 0x7fe4500c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.650+0000 7fe44f200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4500d2bd0 con 0x7fe45015e970 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.650+0000 7fe44f200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe4500d37e0 con 0x7fe4500d2680 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.650+0000 7fe44f200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe4500d2eb0 con 0x7fe4500cfac0 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.650+0000 7fe44d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe4500d2680 0x7fe4500cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.650+0000 7fe44d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe4500d2680 0x7fe4500cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55520/0 (socket says 172.21.15.99:55520) 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.650+0000 7fe44d400640 1 -- 172.21.15.99:0/1465816020 learned_addr learned my addr 172.21.15.99:0/1465816020 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.650+0000 7fe44de00640 1 --1- 172.21.15.99:0/1465816020 >> v1:172.21.15.99:6789/0 conn(0x7fe45015e970 0x7fe4500d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54354/0 (socket says 172.21.15.99:54354) 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.651+0000 7fe44e800640 1 --2- 172.21.15.99:0/1465816020 >> v2:172.21.15.187:3300/0 conn(0x7fe4500cfac0 0x7fe4500c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.651+0000 7fe44d400640 1 -- 172.21.15.99:0/1465816020 >> v2:172.21.15.187:3300/0 conn(0x7fe4500cfac0 msgr2=0x7fe4500c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.651+0000 7fe44d400640 1 --2- 172.21.15.99:0/1465816020 >> v2:172.21.15.187:3300/0 conn(0x7fe4500cfac0 0x7fe4500c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.651+0000 7fe44d400640 1 -- 172.21.15.99:0/1465816020 >> v1:172.21.15.99:6789/0 conn(0x7fe45015e970 legacy=0x7fe4500d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.651+0000 7fe44d400640 1 -- 172.21.15.99:0/1465816020 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4500d3190 con 0x7fe4500d2680 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.652+0000 7fe44d400640 1 --2- 172.21.15.99:0/1465816020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4500d2680 0x7fe4500cf580 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe45008e9c0 tx=0x7fe43c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e0ed62447e59f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.652+0000 7fe44ca00640 1 -- 172.21.15.99:0/1465816020 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c037070 con 0x7fe4500d2680 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.652+0000 7fe44ca00640 1 -- 172.21.15.99:0/1465816020 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43c02ae50 con 0x7fe4500d2680 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.652+0000 7fe44ca00640 1 -- 172.21.15.99:0/1465816020 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c032860 con 0x7fe4500d2680 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.653+0000 7fe44f200640 1 -- 172.21.15.99:0/1465816020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4500d2680 msgr2=0x7fe4500cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.653+0000 7fe44f200640 1 --2- 172.21.15.99:0/1465816020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4500d2680 0x7fe4500cf580 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe45008e9c0 tx=0x7fe43c02a300 comp rx=0 tx=0).stop 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.653+0000 7fe44f200640 1 -- 172.21.15.99:0/1465816020 shutdown_connections 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.653+0000 7fe44f200640 1 --2- 172.21.15.99:0/1465816020 >> v2:172.21.15.187:3300/0 conn(0x7fe4500cfac0 0x7fe4500c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.653+0000 7fe44f200640 1 --2- 172.21.15.99:0/1465816020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4500d2680 0x7fe4500cf580 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.653+0000 7fe44f200640 1 -- 172.21.15.99:0/1465816020 >> 172.21.15.99:0/1465816020 conn(0x7fe45009de00 msgr2=0x7fe4500d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.653+0000 7fe44f200640 1 -- 172.21.15.99:0/1465816020 shutdown_connections 2024-09-10T07:39:57.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.653+0000 7fe44f200640 1 -- 172.21.15.99:0/1465816020 wait complete. 2024-09-10T07:39:57.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.654+0000 7fe44f200640 1 Processor -- start 2024-09-10T07:39:57.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.655+0000 7fe44f200640 1 -- start start 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.655+0000 7fe44f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4500cfac0 0x7fe450156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.655+0000 7fe44f200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4500d2680 0x7fe4500cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45015e970 0x7fe4501600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe45015ed50 con 0x7fe45015e970 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44f200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe4500cff10 con 0x7fe4500d2680 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe45015eed0 con 0x7fe4500cfac0 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45015e970 0x7fe4501600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45015e970 0x7fe4501600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55534/0 (socket says 172.21.15.99:55534) 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44e800640 1 -- 172.21.15.99:0/1057134820 learned_addr learned my addr 172.21.15.99:0/1057134820 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44e800640 1 -- 172.21.15.99:0/1057134820 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4500cfac0 msgr2=0x7fe450156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44e800640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4500cfac0 0x7fe450156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44d400640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4500d2680 0x7fe4500cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:57.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44e800640 1 -- 172.21.15.99:0/1057134820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4500d2680 msgr2=0x7fe4500cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44e800640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4500d2680 0x7fe4500cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44e800640 1 -- 172.21.15.99:0/1057134820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4500cdf60 con 0x7fe45015e970 2024-09-10T07:39:57.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.656+0000 7fe44e800640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45015e970 0x7fe4501600a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe448007e40 tx=0x7fe44800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:57.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.657+0000 7fe446000640 1 -- 172.21.15.99:0/1057134820 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448014620 con 0x7fe45015e970 2024-09-10T07:39:57.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.657+0000 7fe446000640 1 -- 172.21.15.99:0/1057134820 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe448019070 con 0x7fe45015e970 2024-09-10T07:39:57.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.657+0000 7fe446000640 1 -- 172.21.15.99:0/1057134820 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448014a20 con 0x7fe45015e970 2024-09-10T07:39:57.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.657+0000 7fe44f200640 1 -- 172.21.15.99:0/1057134820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4500ce200 con 0x7fe45015e970 2024-09-10T07:39:57.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.657+0000 7fe44f200640 1 -- 172.21.15.99:0/1057134820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4500ce780 con 0x7fe45015e970 2024-09-10T07:39:57.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.658+0000 7fe44f200640 1 -- 172.21.15.99:0/1057134820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4500cf580 con 0x7fe45015e970 2024-09-10T07:39:57.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.659+0000 7fe446000640 1 -- 172.21.15.99:0/1057134820 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe448014bc0 con 0x7fe45015e970 2024-09-10T07:39:57.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.659+0000 7fe446000640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe43006be30 0x7fe43006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:57.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.660+0000 7fe446000640 1 -- 172.21.15.99:0/1057134820 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7fe44808b810 con 0x7fe45015e970 2024-09-10T07:39:57.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.660+0000 7fe44de00640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe43006be30 0x7fe43006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:57.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.660+0000 7fe44de00640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe43006be30 0x7fe43006e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe440000f60 tx=0x7fe440007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:57.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.664+0000 7fe446000640 1 -- 172.21.15.99:0/1057134820 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe44805a120 con 0x7fe45015e970 2024-09-10T07:39:57.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.872+0000 7fe44f200640 1 -- 172.21.15.99:0/1057134820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4500d0b40 con 0x7fe45015e970 2024-09-10T07:39:57.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.873+0000 7fe446000640 1 -- 172.21.15.99:0/1057134820 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7fe448059a20 con 0x7fe45015e970 2024-09-10T07:39:57.873 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:39:57.873 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":57,"btime":"2024-09-10T07:39:55:461034+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/269606175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":269606175},{"type":"v1","addr":"172.21.15.187:6834","nonce":269606175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2513906672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2513906672},{"type":"v1","addr":"172.21.15.187:6835","nonce":2513906672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3548731230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3548731230},{"type":"v1","addr":"172.21.15.99:6835","nonce":3548731230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:51.850274+0000","modified":"2024-09-10T07:39:54.867555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/106508261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":106508261},{"type":"v1","addr":"172.21.15.99:6837","nonce":106508261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6465,"qdb_cluster":[6465]},"id":7}]} 2024-09-10T07:39:57.873 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 57 2024-09-10T07:39:57.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 -- 172.21.15.99:0/1057134820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe43006be30 msgr2=0x7fe43006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe43006be30 0x7fe43006e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe440000f60 tx=0x7fe440007a00 comp rx=0 tx=0).stop 2024-09-10T07:39:57.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 -- 172.21.15.99:0/1057134820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45015e970 msgr2=0x7fe4501600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:57.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45015e970 0x7fe4501600a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe448007e40 tx=0x7fe44800e4b0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 -- 172.21.15.99:0/1057134820 shutdown_connections 2024-09-10T07:39:57.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe43006be30 0x7fe43006e2f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45015e970 0x7fe4501600a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4500d2680 0x7fe4500cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 --2- 172.21.15.99:0/1057134820 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4500cfac0 0x7fe450156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:57.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 -- 172.21.15.99:0/1057134820 >> 172.21.15.99:0/1057134820 conn(0x7fe45009de00 msgr2=0x7fe4500c8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:57.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 -- 172.21.15.99:0/1057134820 shutdown_connections 2024-09-10T07:39:57.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:57.875+0000 7fe44f200640 1 -- 172.21.15.99:0/1057134820 wait complete. 2024-09-10T07:39:58.026 INFO:tasks.ceph.mds.a.smithi099.stderr:2024-09-10T07:39:58.026+0000 7fed1f000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:39:58.294 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:39:51.850274+0000', 'modified': '2024-09-10T07:39:54.867555+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6465}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6465': {'gid': 6465, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/106508261', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 106508261}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 106508261}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6465, 'qdb_cluster': [6465]} 2024-09-10T07:39:58.294 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:39:58.294 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T07:39:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.451+0000 7fa603000640 1 Processor -- start 2024-09-10T07:39:58.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.451+0000 7fa603000640 1 -- start start 2024-09-10T07:39:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.452+0000 7fa603000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa5fc06bc10 0x7fa5fc072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.452+0000 7fa603000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa5fc072740 0x7fa5fc15c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.452+0000 7fa603000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5fc06efc0 con 0x7fa5fc070060 2024-09-10T07:39:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.452+0000 7fa603000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa5fc0734c0 con 0x7fa5fc072740 2024-09-10T07:39:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.452+0000 7fa603000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa5fc06f2a0 con 0x7fa5fc06bc10 2024-09-10T07:39:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.452+0000 7fa602600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa5fc072740 0x7fa5fc15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.452+0000 7fa602600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa5fc072740 0x7fa5fc15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55542/0 (socket says 172.21.15.99:55542) 2024-09-10T07:39:58.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.452+0000 7fa602600640 1 -- 172.21.15.99:0/2922762385 learned_addr learned my addr 172.21.15.99:0/2922762385 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.452+0000 7fa601200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa5fc070060 0x7fa5fc06bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54356/0 (socket says 172.21.15.99:54356) 2024-09-10T07:39:58.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.453+0000 7fa601c00640 1 --2- 172.21.15.99:0/2922762385 >> v2:172.21.15.187:3300/0 conn(0x7fa5fc06bc10 0x7fa5fc072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.453+0000 7fa602600640 1 -- 172.21.15.99:0/2922762385 >> v2:172.21.15.187:3300/0 conn(0x7fa5fc06bc10 msgr2=0x7fa5fc072f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.453+0000 7fa602600640 1 --2- 172.21.15.99:0/2922762385 >> v2:172.21.15.187:3300/0 conn(0x7fa5fc06bc10 0x7fa5fc072f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.453+0000 7fa602600640 1 -- 172.21.15.99:0/2922762385 >> v1:172.21.15.99:6789/0 conn(0x7fa5fc070060 legacy=0x7fa5fc06bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.453+0000 7fa602600640 1 -- 172.21.15.99:0/2922762385 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc06f580 con 0x7fa5fc072740 2024-09-10T07:39:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.453+0000 7fa601c00640 1 --2- 172.21.15.99:0/2922762385 >> v2:172.21.15.187:3300/0 conn(0x7fa5fc06bc10 0x7fa5fc072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.454+0000 7fa602600640 1 --2- 172.21.15.99:0/2922762385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc072740 0x7fa5fc15c980 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc073db0 tx=0x7fa5f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279786c37bc3aaec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.454+0000 7fa5fbe00640 1 -- 172.21.15.99:0/2922762385 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4037070 con 0x7fa5fc072740 2024-09-10T07:39:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.454+0000 7fa5fbe00640 1 -- 172.21.15.99:0/2922762385 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f4032440 con 0x7fa5fc072740 2024-09-10T07:39:58.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.454+0000 7fa5fbe00640 1 -- 172.21.15.99:0/2922762385 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4032810 con 0x7fa5fc072740 2024-09-10T07:39:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.455+0000 7fa603000640 1 -- 172.21.15.99:0/2922762385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc072740 msgr2=0x7fa5fc15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.455+0000 7fa603000640 1 --2- 172.21.15.99:0/2922762385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc072740 0x7fa5fc15c980 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc073db0 tx=0x7fa5f402a270 comp rx=0 tx=0).stop 2024-09-10T07:39:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.455+0000 7fa603000640 1 -- 172.21.15.99:0/2922762385 shutdown_connections 2024-09-10T07:39:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.455+0000 7fa603000640 1 --2- 172.21.15.99:0/2922762385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc072740 0x7fa5fc15c980 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.455+0000 7fa603000640 1 --2- 172.21.15.99:0/2922762385 >> v2:172.21.15.187:3300/0 conn(0x7fa5fc06bc10 0x7fa5fc072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.455+0000 7fa603000640 1 -- 172.21.15.99:0/2922762385 >> 172.21.15.99:0/2922762385 conn(0x7fa5fc06cd20 msgr2=0x7fa5fc06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.455+0000 7fa603000640 1 -- 172.21.15.99:0/2922762385 shutdown_connections 2024-09-10T07:39:58.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.455+0000 7fa603000640 1 -- 172.21.15.99:0/2922762385 wait complete. 2024-09-10T07:39:58.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.456+0000 7fa603000640 1 Processor -- start 2024-09-10T07:39:58.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.456+0000 7fa603000640 1 -- start start 2024-09-10T07:39:58.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.457+0000 7fa603000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5fc06bc10 0x7fa5fc151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.457+0000 7fa603000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc070060 0x7fa5fc154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.457+0000 7fa603000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5fc072740 0x7fa5fc13e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.457+0000 7fa603000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc15cec0 con 0x7fa5fc070060 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.457+0000 7fa603000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc06fb40 con 0x7fa5fc06bc10 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.457+0000 7fa603000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc15d040 con 0x7fa5fc072740 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa601200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc070060 0x7fa5fc154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa601200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc070060 0x7fa5fc154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55558/0 (socket says 172.21.15.99:55558) 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa601200640 1 -- 172.21.15.99:0/1869065042 learned_addr learned my addr 172.21.15.99:0/1869065042 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa601c00640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5fc06bc10 0x7fa5fc151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa602600640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5fc072740 0x7fa5fc13e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa601200640 1 -- 172.21.15.99:0/1869065042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5fc072740 msgr2=0x7fa5fc13e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa601200640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5fc072740 0x7fa5fc13e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa601200640 1 -- 172.21.15.99:0/1869065042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5fc06bc10 msgr2=0x7fa5fc151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa601200640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5fc06bc10 0x7fa5fc151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa601200640 1 -- 172.21.15.99:0/1869065042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc1525d0 con 0x7fa5fc070060 2024-09-10T07:39:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa602600640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5fc072740 0x7fa5fc13e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.458+0000 7fa601200640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc070060 0x7fa5fc154a70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c450 tx=0x7fa5e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.459+0000 7fa5f9600640 1 -- 172.21.15.99:0/1869065042 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8018070 con 0x7fa5fc070060 2024-09-10T07:39:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.459+0000 7fa5f9600640 1 -- 172.21.15.99:0/1869065042 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e8007480 con 0x7fa5fc070060 2024-09-10T07:39:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.459+0000 7fa5f9600640 1 -- 172.21.15.99:0/1869065042 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80047e0 con 0x7fa5fc070060 2024-09-10T07:39:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.459+0000 7fa603000640 1 -- 172.21.15.99:0/1869065042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5fc1528b0 con 0x7fa5fc070060 2024-09-10T07:39:58.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.459+0000 7fa603000640 1 -- 172.21.15.99:0/1869065042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5fc154550 con 0x7fa5fc070060 2024-09-10T07:39:58.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.461+0000 7fa5f9600640 1 -- 172.21.15.99:0/1869065042 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5e8004980 con 0x7fa5fc070060 2024-09-10T07:39:58.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.461+0000 7fa5f9600640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5dc06be30 0x7fa5dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.462+0000 7fa5f9600640 1 -- 172.21.15.99:0/1869065042 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7fa5e808a080 con 0x7fa5fc070060 2024-09-10T07:39:58.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.462+0000 7fa601c00640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5dc06be30 0x7fa5dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.462+0000 7fa60749f740 1 Processor -- start 2024-09-10T07:39:58.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.462+0000 7fa601c00640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5dc06be30 0x7fa5dc06e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00075b0 tx=0x7fa5f0007540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:58.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.463+0000 7fa60749f740 1 -- start start 2024-09-10T07:39:58.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.463+0000 7fa60749f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 0x5585256ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.463+0000 7fa60749f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525682660 0x558525685280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.463+0000 7fa60749f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.463+0000 7fa60749f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5585255e33b0 con 0x558525686630 2024-09-10T07:39:58.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.463+0000 7fa60749f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x5585255e8410 con 0x558525684ea0 2024-09-10T07:39:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.463+0000 7fa60749f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x558525590620 con 0x558525682660 2024-09-10T07:39:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa602600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa602600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55570/0 (socket says 172.21.15.99:55570) 2024-09-10T07:39:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa602600640 1 -- 172.21.15.99:0/2711719506 learned_addr learned my addr 172.21.15.99:0/2711719506 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa601c00640 1 --2- 172.21.15.99:0/2711719506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 0x5585256ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa601200640 1 --2- 172.21.15.99:0/2711719506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525682660 0x558525685280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa602600640 1 -- 172.21.15.99:0/2711719506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525682660 msgr2=0x558525685280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa602600640 1 --2- 172.21.15.99:0/2711719506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525682660 0x558525685280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa602600640 1 -- 172.21.15.99:0/2711719506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 msgr2=0x5585256ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa602600640 1 --2- 172.21.15.99:0/2711719506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 0x5585256ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa602600640 1 -- 172.21.15.99:0/2711719506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585252fb2d0 con 0x558525686630 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.464+0000 7fa602600640 1 --2- 172.21.15.99:0/2711719506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567f720 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa5f402a860 tx=0x7fa5f402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2537b0be418b7dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa5ee000640 1 -- 172.21.15.99:0/2711719506 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4037040 con 0x558525686630 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa5ee000640 1 -- 172.21.15.99:0/2711719506 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f4032800 con 0x558525686630 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa5ee000640 1 -- 172.21.15.99:0/2711719506 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4032bb0 con 0x558525686630 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa60749f740 1 -- 172.21.15.99:0/2711719506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 msgr2=0x55852567f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa60749f740 1 --2- 172.21.15.99:0/2711719506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567f720 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa5f402a860 tx=0x7fa5f402c000 comp rx=0 tx=0).stop 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa60749f740 1 -- 172.21.15.99:0/2711719506 shutdown_connections 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa60749f740 1 --2- 172.21.15.99:0/2711719506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567f720 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa60749f740 1 --2- 172.21.15.99:0/2711719506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525682660 0x558525685280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa60749f740 1 --2- 172.21.15.99:0/2711719506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 0x5585256ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa60749f740 1 -- 172.21.15.99:0/2711719506 >> 172.21.15.99:0/2711719506 conn(0x5585256818f0 msgr2=0x5585256c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:58.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa60749f740 1 -- 172.21.15.99:0/2711719506 shutdown_connections 2024-09-10T07:39:58.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.465+0000 7fa60749f740 1 -- 172.21.15.99:0/2711719506 wait complete. 2024-09-10T07:39:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.466+0000 7fa60749f740 1 -- start start 2024-09-10T07:39:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.466+0000 7fa60749f740 1 Processor -- start 2024-09-10T07:39:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.467+0000 7fa60749f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525684ea0 0x5585256a3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.467+0000 7fa60749f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.467+0000 7fa60749f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 0x558525683400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.467+0000 7fa60749f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5585255a3780 con 0x558525686630 2024-09-10T07:39:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.467+0000 7fa60749f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x5585255e43d0 con 0x558525680320 2024-09-10T07:39:58.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.467+0000 7fa60749f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x558525680d90 con 0x558525684ea0 2024-09-10T07:39:58.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.467+0000 7fa60749f740 10 client.0 _ll_register_callbacks cb 0x5585255e15d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:39:58.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55584/0 (socket says 172.21.15.99:55584) 2024-09-10T07:39:58.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601200640 1 -- 172.21.15.99:0/3698026544 learned_addr learned my addr 172.21.15.99:0/3698026544 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:58.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601c00640 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525684ea0 0x5585256a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa602600640 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 0x558525683400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601200640 1 -- 172.21.15.99:0/3698026544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525684ea0 msgr2=0x5585256a3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601200640 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525684ea0 0x5585256a3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601200640 1 -- 172.21.15.99:0/3698026544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 msgr2=0x558525683400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601200640 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 0x558525683400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601200640 1 -- 172.21.15.99:0/3698026544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585253c56b0 con 0x558525686630 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601c00640 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525684ea0 0x5585256a3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa601200640 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567fde0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80885d0 tx=0x7fa5e805c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30aeb121f7244f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa5e2a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa5e2a00640 1 -- 172.21.15.99:0/3698026544 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80566f0 con 0x558525686630 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa5e2a00640 1 -- 172.21.15.99:0/3698026544 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7fa5e806de70 con 0x558525686630 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.468+0000 7fa60749f740 1 -- 172.21.15.99:0/3698026544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f4032800 con 0x558525686630 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa5e2a00640 1 -- 172.21.15.99:0/3698026544 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fa5e8086050 con 0x558525686630 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa60749f740 10 client.6582 fetch_fsmap learned FSMap version 57 2024-09-10T07:39:58.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa60749f740 1 -- 172.21.15.99:0/3698026544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) -- 0x5585256a4ab0 con 0x558525686630 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa5e2a00640 1 -- 172.21.15.99:0/3698026544 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f4032800 con 0x558525686630 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa5e2a00640 1 -- 172.21.15.99:0/3698026544 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 57) ==== 3502+0+0 (secure 0 0 0) 0x7fa5e80701b0 con 0x558525686630 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa60749f740 10 client.6582 fetch_fsmap finished waiting for FSMap version 57 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa60749f740 10 client.6582 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa60749f740 20 client.6582 populate_metadata read hostname 'smithi099' 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa60749f740 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.99:6836/106508261,v1:172.21.15.99:6837/106508261] conn(0x55852567eab0 0x5585256dda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa60749f740 4 client.6582 mds_command: new command op to 6465 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa60749f740 1 -- 172.21.15.99:0/3698026544 --> [v2:172.21.15.99:6836/106508261,v1:172.21.15.99:6837/106508261] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585255f5b40 con 0x55852567eab0 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.469+0000 7fa601c00640 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.99:6836/106508261,v1:172.21.15.99:6837/106508261] conn(0x55852567eab0 0x5585256dda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.470+0000 7fa601c00640 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.99:6836/106508261,v1:172.21.15.99:6837/106508261] conn(0x55852567eab0 0x5585256dda70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a72eabbcb561d2aa server_cookie=1f10b0b9054263a4 in_seq=0 out_seq=0 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.470+0000 7fa5e2a00640 10 client.6582 ms_handle_connect on v2:172.21.15.99:6836/106508261 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.470+0000 7fa5e2a00640 1 -- 172.21.15.99:0/3698026544 <== mds.0 v2:172.21.15.99:6836/106508261 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585255f5b40 con 0x55852567eab0 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.470+0000 7fa5e2a00640 10 client.6582 handle_command_reply: tid=0 2024-09-10T07:39:58.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 client.6582 shutdown 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 -- 172.21.15.99:0/3698026544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 msgr2=0x55852567fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567fde0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80885d0 tx=0x7fa5e805c6e0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 -- 172.21.15.99:0/3698026544 shutdown_connections 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.99:6836/106508261,v1:172.21.15.99:6837/106508261] conn(0x55852567eab0 0x5585256dda70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 0x558525683400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525686630 0x55852567fde0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 --2- 172.21.15.99:0/3698026544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525684ea0 0x5585256a3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa5e2a00640 0 client.6582 ms_handle_reset on v2:172.21.15.99:6836/106508261 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 -- 172.21.15.99:0/3698026544 >> 172.21.15.99:0/3698026544 conn(0x558525682660 msgr2=0x5585256c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 -- 172.21.15.99:0/3698026544 shutdown_connections 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 1 -- 172.21.15.99:0/3698026544 wait complete. 2024-09-10T07:39:58.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.471+0000 7fa60749f740 20 client.6582 trim_cache size 0 max 16384 2024-09-10T07:39:58.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.490+0000 7fa60749f740 1 Processor -- start 2024-09-10T07:39:58.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.490+0000 7fa60749f740 1 -- start start 2024-09-10T07:39:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.491+0000 7fa60749f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525680320 0x5585256c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.491+0000 7fa60749f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 0x5585256ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.491+0000 7fa60749f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 0x5585256edef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.491+0000 7fa60749f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc1ffe60 con 0x558525680320 2024-09-10T07:39:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.491+0000 7fa60749f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc155590 con 0x558525684ea0 2024-09-10T07:39:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.491+0000 7fa60749f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc155be0 con 0x558525686630 2024-09-10T07:39:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.491+0000 7fa601c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525680320 0x5585256c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.491+0000 7fa601c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525680320 0x5585256c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55592/0 (socket says 172.21.15.99:55592) 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.491+0000 7fa601c00640 1 -- 172.21.15.99:0/428371122 learned_addr learned my addr 172.21.15.99:0/428371122 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa602600640 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 0x5585256edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa601200640 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 0x5585256ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa601c00640 1 -- 172.21.15.99:0/428371122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 msgr2=0x5585256edef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa601c00640 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 0x5585256edef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa601c00640 1 -- 172.21.15.99:0/428371122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 msgr2=0x5585256ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa601c00640 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 0x5585256ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa601c00640 1 -- 172.21.15.99:0/428371122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585256ee580 con 0x558525680320 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa601200640 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 0x5585256ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa602600640 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 0x5585256edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa601c00640 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525680320 0x5585256c7d80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0010010 tx=0x7fa5f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d644e261323429 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:58.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa5ed600640 1 -- 172.21.15.99:0/428371122 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f002b020 con 0x558525680320 2024-09-10T07:39:58.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa5ed600640 1 -- 172.21.15.99:0/428371122 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f0019790 con 0x558525680320 2024-09-10T07:39:58.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.492+0000 7fa5ed600640 1 -- 172.21.15.99:0/428371122 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0019b60 con 0x558525680320 2024-09-10T07:39:58.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.493+0000 7fa60749f740 1 -- 172.21.15.99:0/428371122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525680320 msgr2=0x5585256c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.493+0000 7fa60749f740 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525680320 0x5585256c7d80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0010010 tx=0x7fa5f0015000 comp rx=0 tx=0).stop 2024-09-10T07:39:58.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.493+0000 7fa60749f740 1 -- 172.21.15.99:0/428371122 shutdown_connections 2024-09-10T07:39:58.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.493+0000 7fa60749f740 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 0x5585256edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.493+0000 7fa60749f740 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525684ea0 0x5585256ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.493+0000 7fa60749f740 1 --2- 172.21.15.99:0/428371122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525680320 0x5585256c7d80 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.493+0000 7fa60749f740 1 -- 172.21.15.99:0/428371122 >> 172.21.15.99:0/428371122 conn(0x558525682660 msgr2=0x5585256cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.493+0000 7fa60749f740 1 -- 172.21.15.99:0/428371122 shutdown_connections 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.493+0000 7fa60749f740 1 -- 172.21.15.99:0/428371122 wait complete. 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.494+0000 7fa60749f740 1 -- start start 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.494+0000 7fa60749f740 1 Processor -- start 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa60749f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 0x5585256aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa60749f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525684ea0 0x55852572e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa60749f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 0x558525682b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa60749f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5585256a3e50 con 0x558525684ea0 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa60749f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x5585256a4d90 con 0x558525680320 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa60749f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55852567ef50 con 0x558525686630 2024-09-10T07:39:58.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa60749f740 10 client.0 _ll_register_callbacks cb 0x7fa5e8058100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa601200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525684ea0 0x55852572e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa601200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525684ea0 0x55852572e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55596/0 (socket says 172.21.15.99:55596) 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa601200640 1 -- 172.21.15.99:0/4085056278 learned_addr learned my addr 172.21.15.99:0/4085056278 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa601c00640 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 0x5585256aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.495+0000 7fa602600640 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 0x558525682b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa601200640 1 -- 172.21.15.99:0/4085056278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 msgr2=0x558525682b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa601200640 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 0x558525682b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa601200640 1 -- 172.21.15.99:0/4085056278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 msgr2=0x5585256aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa601200640 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 0x5585256aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa601200640 1 -- 172.21.15.99:0/4085056278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585256a8ab0 con 0x558525684ea0 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa601c00640 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 0x5585256aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa601200640 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525684ea0 0x55852572e0f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8054cb0 tx=0x7fa5e8088480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cd0376c40c4c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:58.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa5e2a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa5e2a00640 1 -- 172.21.15.99:0/4085056278 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8074030 con 0x558525684ea0 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa5e2a00640 1 -- 172.21.15.99:0/4085056278 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7fa5e8077350 con 0x558525684ea0 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa60749f740 1 -- 172.21.15.99:0/4085056278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f0019790 con 0x558525684ea0 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa5e2a00640 1 -- 172.21.15.99:0/4085056278 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fa5e80566f0 con 0x558525684ea0 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa60749f740 10 client.6588 fetch_fsmap learned FSMap version 57 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.496+0000 7fa60749f740 1 -- 172.21.15.99:0/4085056278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) -- 0x5585256ec990 con 0x558525684ea0 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa5e2a00640 1 -- 172.21.15.99:0/4085056278 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f0019790 con 0x558525684ea0 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa5e2a00640 1 -- 172.21.15.99:0/4085056278 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 57) ==== 3502+0+0 (secure 0 0 0) 0x7fa5e8054080 con 0x558525684ea0 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa60749f740 10 client.6588 fetch_fsmap finished waiting for FSMap version 57 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa60749f740 10 client.6588 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa60749f740 20 client.6588 populate_metadata read hostname 'smithi099' 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa60749f740 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.99:6836/106508261,v1:172.21.15.99:6837/106508261] conn(0x558525748dc0 0x5585256aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa60749f740 4 client.6588 mds_command: new command op to 6465 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa60749f740 1 -- 172.21.15.99:0/4085056278 --> [v2:172.21.15.99:6836/106508261,v1:172.21.15.99:6837/106508261] -- command(tid 0: {"prefix": "status"}) -- 0x5585255efe90 con 0x558525748dc0 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa601c00640 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.99:6836/106508261,v1:172.21.15.99:6837/106508261] conn(0x558525748dc0 0x5585256aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa601c00640 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.99:6836/106508261,v1:172.21.15.99:6837/106508261] conn(0x558525748dc0 0x5585256aaca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3709c69ae975758f server_cookie=b851ddffac46f642 in_seq=0 out_seq=0 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.497+0000 7fa5e2a00640 10 client.6588 ms_handle_connect on v2:172.21.15.99:6836/106508261 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa5e2a00640 1 -- 172.21.15.99:0/4085056278 <== mds.0 v2:172.21.15.99:6836/106508261 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5585255efe90 con 0x558525748dc0 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa5e2a00640 10 client.6588 handle_command_reply: tid=0 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 client.6588 shutdown 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 -- 172.21.15.99:0/4085056278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525684ea0 msgr2=0x55852572e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525684ea0 0x55852572e0f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8054cb0 tx=0x7fa5e8088480 comp rx=0 tx=0).stop 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 -- 172.21.15.99:0/4085056278 shutdown_connections 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x558525686630 0x558525682b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558525684ea0 0x55852572e0f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.99:6836/106508261,v1:172.21.15.99:6837/106508261] conn(0x558525748dc0 0x5585256aaca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 --2- 172.21.15.99:0/4085056278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558525680320 0x5585256aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 -- 172.21.15.99:0/4085056278 >> 172.21.15.99:0/4085056278 conn(0x558525682660 msgr2=0x5585256c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa5e2a00640 0 client.6588 ms_handle_reset on v2:172.21.15.99:6836/106508261 2024-09-10T07:39:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 -- 172.21.15.99:0/4085056278 shutdown_connections 2024-09-10T07:39:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 1 -- 172.21.15.99:0/4085056278 wait complete. 2024-09-10T07:39:58.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.498+0000 7fa60749f740 20 client.6588 trim_cache size 0 max 16384 2024-09-10T07:39:58.503 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:39:58.503 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:39:58.503 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:39:58.504 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 6465, 2024-09-10T07:39:58.504 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:39:58.504 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:39:58.504 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:39:58.504 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 6.0612549790000001, 2024-09-10T07:39:58.504 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 57, 2024-09-10T07:39:58.504 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 125, 2024-09-10T07:39:58.504 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 125, 2024-09-10T07:39:58.504 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 11.10075432 2024-09-10T07:39:58.504 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:39:58.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 -- 172.21.15.99:0/1869065042 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5dc06be30 msgr2=0x7fa5dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5dc06be30 0x7fa5dc06e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00075b0 tx=0x7fa5f0007540 comp rx=0 tx=0).stop 2024-09-10T07:39:58.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 -- 172.21.15.99:0/1869065042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc070060 msgr2=0x7fa5fc154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc070060 0x7fa5fc154a70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c450 tx=0x7fa5e800c910 comp rx=0 tx=0).stop 2024-09-10T07:39:58.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 -- 172.21.15.99:0/1869065042 shutdown_connections 2024-09-10T07:39:58.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5fc072740 0x7fa5fc13e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5dc06be30 0x7fa5dc06e2f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5fc070060 0x7fa5fc154a70 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 --2- 172.21.15.99:0/1869065042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5fc06bc10 0x7fa5fc151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 -- 172.21.15.99:0/1869065042 >> 172.21.15.99:0/1869065042 conn(0x7fa5fc06cd20 msgr2=0x7fa5fc0b4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 -- 172.21.15.99:0/1869065042 shutdown_connections 2024-09-10T07:39:58.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.499+0000 7fa603000640 1 -- 172.21.15.99:0/1869065042 wait complete. 2024-09-10T07:39:58.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:39:58.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.668+0000 7f2a42c00640 1 Processor -- start 2024-09-10T07:39:58.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.668+0000 7f2a42c00640 1 -- start start 2024-09-10T07:39:58.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.669+0000 7f2a42c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2a3c145290 0x7f2a3c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.669+0000 7f2a42c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2a3c072f40 0x7f2a3c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.669+0000 7f2a42c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a3c06e3d0 con 0x7f2a3c0ce780 2024-09-10T07:39:58.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.669+0000 7f2a42c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f2a3c06efe0 con 0x7f2a3c072f40 2024-09-10T07:39:58.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.669+0000 7f2a42c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f2a3c06e6b0 con 0x7f2a3c145290 2024-09-10T07:39:58.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.670+0000 7f2a40c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2a3c072f40 0x7f2a3c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.670+0000 7f2a40c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2a3c072f40 0x7f2a3c0b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55612/0 (socket says 172.21.15.99:55612) 2024-09-10T07:39:58.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.670+0000 7f2a40c00640 1 -- 172.21.15.99:0/2548618719 learned_addr learned my addr 172.21.15.99:0/2548618719 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:58.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.670+0000 7f2a3be00640 1 --2- 172.21.15.99:0/2548618719 >> v2:172.21.15.187:3300/0 conn(0x7f2a3c145290 0x7f2a3c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.670+0000 7f2a40c00640 1 -- 172.21.15.99:0/2548618719 >> v2:172.21.15.187:3300/0 conn(0x7f2a3c145290 msgr2=0x7f2a3c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.670+0000 7f2a40c00640 1 --2- 172.21.15.99:0/2548618719 >> v2:172.21.15.187:3300/0 conn(0x7f2a3c145290 0x7f2a3c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.670+0000 7f2a40c00640 1 -- 172.21.15.99:0/2548618719 >> v1:172.21.15.187:6789/0 conn(0x7f2a3c0ce780 legacy=0x7f2a3c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:39:58.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.670+0000 7f2a40c00640 1 -- 172.21.15.99:0/2548618719 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c06e990 con 0x7f2a3c072f40 2024-09-10T07:39:58.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.671+0000 7f2a40c00640 1 --2- 172.21.15.99:0/2548618719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 0x7f2a3c0b3930 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c075940 tx=0x7f2a3402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f5d8f41d195fef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:58.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.671+0000 7f2a3aa00640 1 -- 172.21.15.99:0/2548618719 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34036070 con 0x7f2a3c072f40 2024-09-10T07:39:58.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.671+0000 7f2a3aa00640 1 -- 172.21.15.99:0/2548618719 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a34031600 con 0x7f2a3c072f40 2024-09-10T07:39:58.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.671+0000 7f2a3aa00640 1 -- 172.21.15.99:0/2548618719 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a340319d0 con 0x7f2a3c072f40 2024-09-10T07:39:58.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.672+0000 7f2a42c00640 1 -- 172.21.15.99:0/2548618719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 msgr2=0x7f2a3c0b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.672+0000 7f2a42c00640 1 --2- 172.21.15.99:0/2548618719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 0x7f2a3c0b3930 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c075940 tx=0x7f2a3402a6f0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.672+0000 7f2a42c00640 1 -- 172.21.15.99:0/2548618719 shutdown_connections 2024-09-10T07:39:58.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.672+0000 7f2a42c00640 1 --2- 172.21.15.99:0/2548618719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 0x7f2a3c0b3930 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.672+0000 7f2a42c00640 1 --2- 172.21.15.99:0/2548618719 >> v2:172.21.15.187:3300/0 conn(0x7f2a3c145290 0x7f2a3c06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.672+0000 7f2a42c00640 1 -- 172.21.15.99:0/2548618719 >> 172.21.15.99:0/2548618719 conn(0x7f2a3c06bc10 msgr2=0x7f2a3c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:58.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.672+0000 7f2a42c00640 1 -- 172.21.15.99:0/2548618719 shutdown_connections 2024-09-10T07:39:58.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.672+0000 7f2a42c00640 1 -- 172.21.15.99:0/2548618719 wait complete. 2024-09-10T07:39:58.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.674+0000 7f2a42c00640 1 Processor -- start 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.674+0000 7f2a42c00640 1 -- start start 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a42c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 0x7f2a3c13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a42c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a3c0ce780 0x7f2a3c0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a42c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a3c145290 0x7f2a3c0b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a42c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c06df80 con 0x7f2a3c072f40 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a42c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c145670 con 0x7f2a3c145290 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a42c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2a3c06e100 con 0x7f2a3c0ce780 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a3be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 0x7f2a3c13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a3be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 0x7f2a3c13baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55620/0 (socket says 172.21.15.99:55620) 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a3be00640 1 -- 172.21.15.99:0/2170309917 learned_addr learned my addr 172.21.15.99:0/2170309917 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a40c00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a3c145290 0x7f2a3c0b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a3b400640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a3c0ce780 0x7f2a3c0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a3be00640 1 -- 172.21.15.99:0/2170309917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a3c0ce780 msgr2=0x7f2a3c0b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a3be00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a3c0ce780 0x7f2a3c0b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a3be00640 1 -- 172.21.15.99:0/2170309917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a3c145290 msgr2=0x7f2a3c0b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a3be00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a3c145290 0x7f2a3c0b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.675+0000 7f2a3be00640 1 -- 172.21.15.99:0/2170309917 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c1f4e90 con 0x7f2a3c072f40 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.676+0000 7f2a3be00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 0x7f2a3c13baa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00d5f0 tx=0x7f2a2c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.676+0000 7f2a33e00640 1 -- 172.21.15.99:0/2170309917 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0125f0 con 0x7f2a3c072f40 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.676+0000 7f2a33e00640 1 -- 172.21.15.99:0/2170309917 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a2c019070 con 0x7f2a3c072f40 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.676+0000 7f2a33e00640 1 -- 172.21.15.99:0/2170309917 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0129d0 con 0x7f2a3c072f40 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.676+0000 7f2a42c00640 1 -- 172.21.15.99:0/2170309917 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3c1f5170 con 0x7f2a3c072f40 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.676+0000 7f2a42c00640 1 -- 172.21.15.99:0/2170309917 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a3c1f5730 con 0x7f2a3c072f40 2024-09-10T07:39:58.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.677+0000 7f2a42c00640 1 -- 172.21.15.99:0/2170309917 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3c071510 con 0x7f2a3c072f40 2024-09-10T07:39:58.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.678+0000 7f2a33e00640 1 -- 172.21.15.99:0/2170309917 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a2c012b70 con 0x7f2a3c072f40 2024-09-10T07:39:58.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.679+0000 7f2a33e00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a1c06be30 0x7f2a1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:39:58.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.679+0000 7f2a33e00640 1 -- 172.21.15.99:0/2170309917 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7f2a2c08b220 con 0x7f2a3c072f40 2024-09-10T07:39:58.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.679+0000 7f2a3b400640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a1c06be30 0x7f2a1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:39:58.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.679+0000 7f2a3b400640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a1c06be30 0x7f2a1c06e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c150990 tx=0x7f2a28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:39:58.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.683+0000 7f2a33e00640 1 -- 172.21.15.99:0/2170309917 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a2c059bc0 con 0x7f2a3c072f40 2024-09-10T07:39:58.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.891+0000 7f2a42c00640 1 -- 172.21.15.99:0/2170309917 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2a3c0cff00 con 0x7f2a3c072f40 2024-09-10T07:39:58.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.891+0000 7f2a33e00640 1 -- 172.21.15.99:0/2170309917 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) ==== 53+0+73 (secure 0 0 0) 0x7f2a2c0594c0 con 0x7f2a3c072f40 2024-09-10T07:39:58.891 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.893+0000 7f2a42c00640 1 -- 172.21.15.99:0/2170309917 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a1c06be30 msgr2=0x7f2a1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.893+0000 7f2a42c00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a1c06be30 0x7f2a1c06e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c150990 tx=0x7f2a28009040 comp rx=0 tx=0).stop 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.893+0000 7f2a42c00640 1 -- 172.21.15.99:0/2170309917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 msgr2=0x7f2a3c13baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.893+0000 7f2a42c00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 0x7f2a3c13baa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00d5f0 tx=0x7f2a2c00dab0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.893+0000 7f2a42c00640 1 -- 172.21.15.99:0/2170309917 shutdown_connections 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.893+0000 7f2a42c00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a3c145290 0x7f2a3c0b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.893+0000 7f2a42c00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a3c0ce780 0x7f2a3c0b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.893+0000 7f2a42c00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a1c06be30 0x7f2a1c06e2f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.893+0000 7f2a42c00640 1 --2- 172.21.15.99:0/2170309917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a3c072f40 0x7f2a3c13baa0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.893+0000 7f2a42c00640 1 -- 172.21.15.99:0/2170309917 >> 172.21.15.99:0/2170309917 conn(0x7f2a3c06bc10 msgr2=0x7f2a3c15bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:39:58.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.894+0000 7f2a42c00640 1 -- 172.21.15.99:0/2170309917 shutdown_connections 2024-09-10T07:39:58.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:58.894+0000 7f2a42c00640 1 -- 172.21.15.99:0/2170309917 wait complete. 2024-09-10T07:39:58.908 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:39:58.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:39:58.909 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:39:58.909 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:39:58.909 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:39:58.909 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:39:58.909 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:39:58.909 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:39:58.909 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:39:58.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:58.909 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:39:58.945 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:39:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:39:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:39:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:39:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:58.945 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:39:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:39:58.945 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42429sec preferred_lft 42429sec 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:39:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:58.947 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:39:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:39:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link 2024-09-10T07:39:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:58.947 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:39:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:39:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::1c1f:52ff:fe95:9fbe/64 scope link 2024-09-10T07:39:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:39:58.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:58.947 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:39:59.039 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:39:59.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:59.042 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:39:59.078 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:39:59.078 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:39:59.078 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:39:59.078 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:39:59.078 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:39:59.079 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:39:59.079 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:39:59.079 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:39:59.079 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:39:59.079 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:39:59.079 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:39:59.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:39:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:39:59.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:59.273 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:39:59.309 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:39:59.309 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:39:59.309 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:39:59.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:59.309 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:39:59.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:39:59.405 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:39:59.440 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:39:59.441 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:39:59.441 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:39:59.516 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:39:59.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:59.516 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:39:59.646 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:39:59.646 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:39:59.673 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:39:59.673 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:39:59.673 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:39:59.673 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:39:59.673 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:39:59.675 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:39:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:39:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:39:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:39:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:39:59.678 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:39:59.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:39:59.678 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:39:59.735 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:39:59.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:39:59.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:39:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:39:59.835 INFO:teuthology.orchestra.run.smithi099.stdout:client5714 2024-09-10T07:39:59.835 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:39:59.835 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:39:59.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:40:00.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.064+0000 7f0a90600640 1 Processor -- start 2024-09-10T07:40:00.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.064+0000 7f0a90600640 1 -- start start 2024-09-10T07:40:00.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a90600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0a880cf830 0x7f0a880b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:00.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a90600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a880aec20 con 0x7f0a880cfc80 2024-09-10T07:40:00.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a90600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a880aef00 con 0x7f0a8815ede0 2024-09-10T07:40:00.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a90600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0a880af1e0 con 0x7f0a880cf830 2024-09-10T07:40:00.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a8d200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0a880cf830 0x7f0a880b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:00.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a8e600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0a880cfc80 0x7f0a88071960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55922/0 (socket says 172.21.15.99:55922) 2024-09-10T07:40:00.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a8e600640 1 -- 172.21.15.99:0/3619093884 learned_addr learned my addr 172.21.15.99:0/3619093884 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:00.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a8d200640 1 -- 172.21.15.99:0/3619093884 >> v1:172.21.15.187:6789/0 conn(0x7f0a8815ede0 legacy=0x7f0a880afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:00.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a8d200640 1 -- 172.21.15.99:0/3619093884 >> v1:172.21.15.99:6789/0 conn(0x7f0a880cfc80 legacy=0x7f0a88071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:00.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a8d200640 1 -- 172.21.15.99:0/3619093884 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a880af4c0 con 0x7f0a880cf830 2024-09-10T07:40:00.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a87e00640 1 -- 172.21.15.99:0/3619093884 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928444881 0 0) 0x7f0a880aec20 con 0x7f0a880cfc80 2024-09-10T07:40:00.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.067+0000 7f0a8d200640 1 --2- 172.21.15.99:0/3619093884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 0x7f0a880b43b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0a740097a0 tx=0x7f0a7402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b352d9d13b72597 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:00.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.068+0000 7f0a87e00640 1 -- 172.21.15.99:0/3619093884 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74037070 con 0x7f0a880cf830 2024-09-10T07:40:00.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.068+0000 7f0a87e00640 1 -- 172.21.15.99:0/3619093884 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a74032440 con 0x7f0a880cf830 2024-09-10T07:40:00.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.068+0000 7f0a87e00640 1 -- 172.21.15.99:0/3619093884 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74032810 con 0x7f0a880cf830 2024-09-10T07:40:00.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.068+0000 7f0a90600640 1 -- 172.21.15.99:0/3619093884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 msgr2=0x7f0a880b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:00.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.068+0000 7f0a90600640 1 --2- 172.21.15.99:0/3619093884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 0x7f0a880b43b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0a740097a0 tx=0x7f0a7402a230 comp rx=0 tx=0).stop 2024-09-10T07:40:00.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.068+0000 7f0a90600640 1 -- 172.21.15.99:0/3619093884 shutdown_connections 2024-09-10T07:40:00.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.068+0000 7f0a90600640 1 --2- 172.21.15.99:0/3619093884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 0x7f0a880b43b0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.068+0000 7f0a90600640 1 -- 172.21.15.99:0/3619093884 >> 172.21.15.99:0/3619093884 conn(0x7f0a8806bc10 msgr2=0x7f0a8806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:00.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.068+0000 7f0a90600640 1 -- 172.21.15.99:0/3619093884 shutdown_connections 2024-09-10T07:40:00.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.068+0000 7f0a90600640 1 -- 172.21.15.99:0/3619093884 wait complete. 2024-09-10T07:40:00.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.070+0000 7f0a90600640 1 Processor -- start 2024-09-10T07:40:00.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.070+0000 7f0a90600640 1 -- start start 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.071+0000 7f0a90600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 0x7f0a8814c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.071+0000 7f0a90600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a880cfc80 0x7f0a8806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.071+0000 7f0a90600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8815ede0 0x7f0a88072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.071+0000 7f0a90600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880ae9c0 con 0x7f0a880cf830 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.071+0000 7f0a90600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880ae840 con 0x7f0a8815ede0 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.071+0000 7f0a90600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0a880b48f0 con 0x7f0a880cfc80 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.071+0000 7f0a8dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 0x7f0a8814c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.071+0000 7f0a8dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 0x7f0a8814c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37234/0 (socket says 172.21.15.99:37234) 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.071+0000 7f0a8dc00640 1 -- 172.21.15.99:0/1684887654 learned_addr learned my addr 172.21.15.99:0/1684887654 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a8dc00640 1 -- 172.21.15.99:0/1684887654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a880cfc80 msgr2=0x7f0a8806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:00.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a8dc00640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a880cfc80 0x7f0a8806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a8dc00640 1 -- 172.21.15.99:0/1684887654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8815ede0 msgr2=0x7f0a88072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a8dc00640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8815ede0 0x7f0a88072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a8dc00640 1 -- 172.21.15.99:0/1684887654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8814c760 con 0x7f0a880cf830 2024-09-10T07:40:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a8dc00640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 0x7f0a8814c220 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c400 tx=0x7f0a7c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a85600640 1 -- 172.21.15.99:0/1684887654 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c017070 con 0x7f0a880cf830 2024-09-10T07:40:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a85600640 1 -- 172.21.15.99:0/1684887654 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7c0052d0 con 0x7f0a880cf830 2024-09-10T07:40:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a85600640 1 -- 172.21.15.99:0/1684887654 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c003830 con 0x7f0a880cf830 2024-09-10T07:40:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a90600640 1 -- 172.21.15.99:0/1684887654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8806e620 con 0x7f0a880cf830 2024-09-10T07:40:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.072+0000 7f0a90600640 1 -- 172.21.15.99:0/1684887654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8806ebe0 con 0x7f0a880cf830 2024-09-10T07:40:00.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.073+0000 7f0a90600640 1 -- 172.21.15.99:0/1684887654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a880b4cb0 con 0x7f0a880cf830 2024-09-10T07:40:00.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.074+0000 7f0a85600640 1 -- 172.21.15.99:0/1684887654 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a7c01a070 con 0x7f0a880cf830 2024-09-10T07:40:00.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.075+0000 7f0a85600640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0a6806be30 0x7f0a6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:00.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.075+0000 7f0a85600640 1 -- 172.21.15.99:0/1684887654 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7f0a7c08a2c0 con 0x7f0a880cf830 2024-09-10T07:40:00.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.075+0000 7f0a8d200640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0a6806be30 0x7f0a6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:00.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.076+0000 7f0a8d200640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0a6806be30 0x7f0a6806e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a74034000 tx=0x7f0a7402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:00.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.079+0000 7f0a85600640 1 -- 172.21.15.99:0/1684887654 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a8814c760 con 0x7f0a880cf830 2024-09-10T07:40:00.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.284+0000 7f0a90600640 1 -- 172.21.15.99:0/1684887654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0a88075620 con 0x7f0a880cf830 2024-09-10T07:40:00.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.285+0000 7f0a85600640 1 -- 172.21.15.99:0/1684887654 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) ==== 53+0+73 (secure 0 0 0) 0x7f0a7c058bd0 con 0x7f0a880cf830 2024-09-10T07:40:00.285 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:40:00.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 -- 172.21.15.99:0/1684887654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0a6806be30 msgr2=0x7f0a6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:00.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0a6806be30 0x7f0a6806e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a74034000 tx=0x7f0a7402c000 comp rx=0 tx=0).stop 2024-09-10T07:40:00.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 -- 172.21.15.99:0/1684887654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 msgr2=0x7f0a8814c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:00.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 0x7f0a8814c220 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c400 tx=0x7f0a7c00c8c0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 -- 172.21.15.99:0/1684887654 shutdown_connections 2024-09-10T07:40:00.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8815ede0 0x7f0a88072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a880cfc80 0x7f0a8806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0a6806be30 0x7f0a6806e2f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 --2- 172.21.15.99:0/1684887654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a880cf830 0x7f0a8814c220 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:00.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 -- 172.21.15.99:0/1684887654 >> 172.21.15.99:0/1684887654 conn(0x7f0a8806bc10 msgr2=0x7f0a8815d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:00.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 -- 172.21.15.99:0/1684887654 shutdown_connections 2024-09-10T07:40:00.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:00.287+0000 7f0a90600640 1 -- 172.21.15.99:0/1684887654 wait complete. 2024-09-10T07:40:00.303 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:40:00.303 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:40:00.303 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:40:00.304 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:40:00.304 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:40:00.304 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:40:00.304 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:40:00.304 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:40:00.304 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:40:00.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:00.304 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:40:00.345 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:40:00.345 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:40:00.345 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:40:00.345 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:00.345 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:40:00.345 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:00.345 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:40:00.345 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42424sec preferred_lft 42424sec 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:40:00.346 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::84a0:e5ff:fe75:1d2e/64 scope link 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:00.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:00.347 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:40:00.444 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:40:00.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:00.447 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:40:00.487 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:40:00.487 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:40:00.487 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:40:00.487 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:40:00.487 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:40:00.488 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:40:00.488 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:40:00.488 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:40:00.488 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:40:00.488 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:40:00.488 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:40:00.605 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:40:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:40:00.677 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:40:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:00.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:00.685 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:40:00.720 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:40:00.720 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:40:00.720 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:40:00.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:00.720 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:40:00.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:40:00.817 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:40:00.852 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:40:00.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:40:00.853 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:40:00.927 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:40:00.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:00.927 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:40:01.057 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:40:01.057 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:40:01.084 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:40:01.084 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:40:01.084 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:40:01.085 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:40:01.085 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:40:01.086 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:40:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:40:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:40:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:40:01.086 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:40:01.089 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:40:01.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:01.089 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:40:01.148 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:40:01.225 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:40:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:40:01.228 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:40:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:01.236 INFO:teuthology.orchestra.run.smithi187.stdout:client5717 2024-09-10T07:40:01.236 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:40:01.236 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:01.272 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:01.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.435+0000 7f8ed4a00640 1 Processor -- start 2024-09-10T07:40:01.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.435+0000 7f8ed4a00640 1 -- start start 2024-09-10T07:40:01.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.436+0000 7f8ed4a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 0x7f8ed00d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:01.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.436+0000 7f8ed4a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed015f080 con 0x7f8ed015eca0 2024-09-10T07:40:01.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.436+0000 7f8ed4a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed00b4f30 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.436+0000 7f8ed4a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed00b6d50 con 0x7f8ed00b4900 2024-09-10T07:40:01.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.436+0000 7f8ece800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8ed015eca0 0x7f8ed00ae0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55938/0 (socket says 172.21.15.99:55938) 2024-09-10T07:40:01.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.436+0000 7f8ece800640 1 -- 172.21.15.99:0/1646589841 learned_addr learned my addr 172.21.15.99:0/1646589841 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:01.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.437+0000 7f8ec7e00640 1 --2- 172.21.15.99:0/1646589841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 0x7f8ed00d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:01.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.437+0000 7f8ecde00640 1 -- 172.21.15.99:0/1646589841 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525758647 0 0) 0x7f8ed015f080 con 0x7f8ed015eca0 2024-09-10T07:40:01.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.437+0000 7f8ecde00640 1 -- 172.21.15.99:0/1646589841 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8eb4003520 con 0x7f8ed015eca0 2024-09-10T07:40:01.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.437+0000 7f8ecde00640 1 -- 172.21.15.99:0/1646589841 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441882984 0 0) 0x7f8ed00b4f30 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.437+0000 7f8ecde00640 1 -- 172.21.15.99:0/1646589841 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ed015f080 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.437+0000 7f8ec7e00640 1 -- 172.21.15.99:0/1646589841 >> v1:172.21.15.187:6789/0 conn(0x7f8ed00b1fe0 legacy=0x7f8ed00b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:01.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.437+0000 7f8ec7e00640 1 -- 172.21.15.99:0/1646589841 >> v1:172.21.15.99:6789/0 conn(0x7f8ed015eca0 legacy=0x7f8ed00ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:01.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.437+0000 7f8ec7e00640 1 -- 172.21.15.99:0/1646589841 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed006be60 con 0x7f8ed00b4900 2024-09-10T07:40:01.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.438+0000 7f8ec7e00640 1 --2- 172.21.15.99:0/1646589841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 0x7f8ed00d1aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80097d0 tx=0x7f8eb802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cccb8e9a5cd3aab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:01.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.438+0000 7f8ecde00640 1 -- 172.21.15.99:0/1646589841 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8037070 con 0x7f8ed00b4900 2024-09-10T07:40:01.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.438+0000 7f8ecde00640 1 -- 172.21.15.99:0/1646589841 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb8032440 con 0x7f8ed00b4900 2024-09-10T07:40:01.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.438+0000 7f8ecde00640 1 -- 172.21.15.99:0/1646589841 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80327f0 con 0x7f8ed00b4900 2024-09-10T07:40:01.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.439+0000 7f8ed4a00640 1 -- 172.21.15.99:0/1646589841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 msgr2=0x7f8ed00d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:01.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.439+0000 7f8ed4a00640 1 --2- 172.21.15.99:0/1646589841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 0x7f8ed00d1aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80097d0 tx=0x7f8eb802a210 comp rx=0 tx=0).stop 2024-09-10T07:40:01.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.439+0000 7f8ed4a00640 1 -- 172.21.15.99:0/1646589841 shutdown_connections 2024-09-10T07:40:01.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.439+0000 7f8ed4a00640 1 --2- 172.21.15.99:0/1646589841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 0x7f8ed00d1aa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:01.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.439+0000 7f8ed4a00640 1 -- 172.21.15.99:0/1646589841 >> 172.21.15.99:0/1646589841 conn(0x7f8ed00b6610 msgr2=0x7f8ed00b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:01.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.439+0000 7f8ed4a00640 1 -- 172.21.15.99:0/1646589841 shutdown_connections 2024-09-10T07:40:01.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.439+0000 7f8ed4a00640 1 -- 172.21.15.99:0/1646589841 wait complete. 2024-09-10T07:40:01.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.441+0000 7f8ed4a00640 1 Processor -- start 2024-09-10T07:40:01.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.441+0000 7f8ed4a00640 1 -- start start 2024-09-10T07:40:01.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.441+0000 7f8ed4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00b1fe0 0x7f8ed01586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ed4a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 0x7f8ed014c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ed4a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed015eca0 0x7f8ed01f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ed4a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed006c420 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ed4a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed006bc10 con 0x7f8ed015eca0 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ed4a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed006c940 con 0x7f8ed00b4900 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ece800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00b1fe0 0x7f8ed01586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ece800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00b1fe0 0x7f8ed01586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37250/0 (socket says 172.21.15.99:37250) 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ece800640 1 -- 172.21.15.99:0/3909843787 learned_addr learned my addr 172.21.15.99:0/3909843787 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ec7e00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 0x7f8ed014c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ecf200640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed015eca0 0x7f8ed01f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ece800640 1 -- 172.21.15.99:0/3909843787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 msgr2=0x7f8ed014c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:01.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ece800640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 0x7f8ed014c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:01.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ece800640 1 -- 172.21.15.99:0/3909843787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed015eca0 msgr2=0x7f8ed01f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:01.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ece800640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed015eca0 0x7f8ed01f49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:01.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ece800640 1 -- 172.21.15.99:0/3909843787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed0158d90 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.442+0000 7f8ec7e00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 0x7f8ed014c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:40:01.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.443+0000 7f8ece800640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00b1fe0 0x7f8ed01586b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c410 tx=0x7f8ec000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:01.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.443+0000 7f8ec6a00640 1 -- 172.21.15.99:0/3909843787 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0017070 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.443+0000 7f8ec6a00640 1 -- 172.21.15.99:0/3909843787 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec0005ce0 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.443+0000 7f8ec6a00640 1 -- 172.21.15.99:0/3909843787 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00072d0 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.443+0000 7f8ed4a00640 1 -- 172.21.15.99:0/3909843787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed015fcb0 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.443+0000 7f8ed4a00640 1 -- 172.21.15.99:0/3909843787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed0160270 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.444+0000 7f8ed4a00640 1 -- 172.21.15.99:0/3909843787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed00d1aa0 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.445+0000 7f8ec6a00640 1 -- 172.21.15.99:0/3909843787 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ec001a070 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.446+0000 7f8ec6a00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8eac06be60 0x7f8eac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:01.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.446+0000 7f8ec6a00640 1 -- 172.21.15.99:0/3909843787 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7f8ec008a220 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.446+0000 7f8ec7e00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8eac06be60 0x7f8eac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:01.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.447+0000 7f8ec7e00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8eac06be60 0x7f8eac06e320 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8034000 tx=0x7f8eb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:01.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.450+0000 7f8ec6a00640 1 -- 172.21.15.99:0/3909843787 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ec0058450 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.656+0000 7f8ed4a00640 1 -- 172.21.15.99:0/3909843787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ed00d0e70 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.657+0000 7f8ec6a00640 1 -- 172.21.15.99:0/3909843787 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7f8ec005c750 con 0x7f8ed00b1fe0 2024-09-10T07:40:01.656 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:01.656 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":57,"btime":"2024-09-10T07:39:55:461034+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/269606175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":269606175},{"type":"v1","addr":"172.21.15.187:6834","nonce":269606175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2513906672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2513906672},{"type":"v1","addr":"172.21.15.187:6835","nonce":2513906672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3548731230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3548731230},{"type":"v1","addr":"172.21.15.99:6835","nonce":3548731230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:51.850274+0000","modified":"2024-09-10T07:39:54.867555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/106508261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":106508261},{"type":"v1","addr":"172.21.15.99:6837","nonce":106508261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6465,"qdb_cluster":[6465]},"id":7}]} 2024-09-10T07:40:01.656 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 57 2024-09-10T07:40:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.659+0000 7f8ed4a00640 1 -- 172.21.15.99:0/3909843787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8eac06be60 msgr2=0x7f8eac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.659+0000 7f8ed4a00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8eac06be60 0x7f8eac06e320 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8034000 tx=0x7f8eb802e000 comp rx=0 tx=0).stop 2024-09-10T07:40:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.659+0000 7f8ed4a00640 1 -- 172.21.15.99:0/3909843787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00b1fe0 msgr2=0x7f8ed01586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.659+0000 7f8ed4a00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00b1fe0 0x7f8ed01586b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c410 tx=0x7f8ec000c8d0 comp rx=0 tx=0).stop 2024-09-10T07:40:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.659+0000 7f8ed4a00640 1 -- 172.21.15.99:0/3909843787 shutdown_connections 2024-09-10T07:40:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.659+0000 7f8ed4a00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed015eca0 0x7f8ed01f49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.659+0000 7f8ed4a00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed00b4900 0x7f8ed014c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.659+0000 7f8ed4a00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8eac06be60 0x7f8eac06e320 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.659+0000 7f8ed4a00640 1 --2- 172.21.15.99:0/3909843787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ed00b1fe0 0x7f8ed01586b0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.659+0000 7f8ed4a00640 1 -- 172.21.15.99:0/3909843787 >> 172.21.15.99:0/3909843787 conn(0x7f8ed00b6610 msgr2=0x7f8ed015deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:01.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.660+0000 7f8ed4a00640 1 -- 172.21.15.99:0/3909843787 shutdown_connections 2024-09-10T07:40:01.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:01.660+0000 7f8ed4a00640 1 -- 172.21.15.99:0/3909843787 wait complete. 2024-09-10T07:40:01.674 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:40:01.849 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":6465,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.4006086310000008,"mdsmap_epoch":57,"osdmap_epoch":125,"osdmap_epoch_barrier":125,"uptime":14.440110232} 2024-09-10T07:40:01.849 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 6465, "mdsmap_epoch": 57, "osdmap_epoch": 125, "osdmap_epoch_barrier": 125, "rank_uptime": 9.400608631, "state": "up:active", "uptime": 14.440110232, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:40:01.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-10T07:40:02.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.008+0000 7ff92ae00640 1 Processor -- start 2024-09-10T07:40:02.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.008+0000 7ff92ae00640 1 -- start start 2024-09-10T07:40:02.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.009+0000 7ff92ae00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff924072d90 0x7ff924166590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:02.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.009+0000 7ff92ae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff924160310 con 0x7ff9241445a0 2024-09-10T07:40:02.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.009+0000 7ff92ae00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff924160030 con 0x7ff9240ced50 2024-09-10T07:40:02.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.009+0000 7ff92ae00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff9240b4d20 con 0x7ff924072d90 2024-09-10T07:40:02.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.009+0000 7ff923e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff9241445a0 0x7ff9240cd380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55944/0 (socket says 172.21.15.99:55944) 2024-09-10T07:40:02.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.009+0000 7ff928e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff924072d90 0x7ff924166590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:02.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.009+0000 7ff923e00640 1 -- 172.21.15.99:0/1754510760 learned_addr learned my addr 172.21.15.99:0/1754510760 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.010+0000 7ff928e00640 1 -- 172.21.15.99:0/1754510760 >> v1:172.21.15.187:6789/0 conn(0x7ff9240ced50 legacy=0x7ff924072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.010+0000 7ff928e00640 1 -- 172.21.15.99:0/1754510760 >> v1:172.21.15.99:6789/0 conn(0x7ff9241445a0 legacy=0x7ff9240cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.010+0000 7ff928e00640 1 -- 172.21.15.99:0/1754510760 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9240b5940 con 0x7ff924072d90 2024-09-10T07:40:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.010+0000 7ff923400640 1 -- 172.21.15.99:0/1754510760 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1205901494 0 0) 0x7ff924160310 con 0x7ff9241445a0 2024-09-10T07:40:02.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.011+0000 7ff928e00640 1 --2- 172.21.15.99:0/1754510760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff924072d90 0x7ff924166590 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009d90 tx=0x7ff91c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cb582d44e93c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:02.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.011+0000 7ff923400640 1 -- 172.21.15.99:0/1754510760 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c031600 con 0x7ff924072d90 2024-09-10T07:40:02.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.011+0000 7ff923400640 1 -- 172.21.15.99:0/1754510760 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91c0317a0 con 0x7ff924072d90 2024-09-10T07:40:02.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.011+0000 7ff923400640 1 -- 172.21.15.99:0/1754510760 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c031b70 con 0x7ff924072d90 2024-09-10T07:40:02.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.011+0000 7ff92ae00640 1 -- 172.21.15.99:0/1754510760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff924072d90 msgr2=0x7ff924166590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:02.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.011+0000 7ff92ae00640 1 --2- 172.21.15.99:0/1754510760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff924072d90 0x7ff924166590 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009d90 tx=0x7ff91c02a5d0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.012+0000 7ff92ae00640 1 -- 172.21.15.99:0/1754510760 shutdown_connections 2024-09-10T07:40:02.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.012+0000 7ff92ae00640 1 --2- 172.21.15.99:0/1754510760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff924072d90 0x7ff924166590 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.012+0000 7ff92ae00640 1 -- 172.21.15.99:0/1754510760 >> 172.21.15.99:0/1754510760 conn(0x7ff9240b26a0 msgr2=0x7ff9240b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:02.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.012+0000 7ff92ae00640 1 -- 172.21.15.99:0/1754510760 shutdown_connections 2024-09-10T07:40:02.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.012+0000 7ff92ae00640 1 -- 172.21.15.99:0/1754510760 wait complete. 2024-09-10T07:40:02.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.013+0000 7ff92ae00640 1 Processor -- start 2024-09-10T07:40:02.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.013+0000 7ff92ae00640 1 -- start start 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.014+0000 7ff92ae00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff924072d90 0x7ff92415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.014+0000 7ff92ae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9240ced50 0x7ff92413c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.014+0000 7ff92ae00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9241445a0 0x7ff92413ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.014+0000 7ff92ae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff924144980 con 0x7ff9240ced50 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.014+0000 7ff92ae00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff9240b5f00 con 0x7ff924072d90 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.014+0000 7ff92ae00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff924144b00 con 0x7ff9241445a0 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff91be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9240ced50 0x7ff92413c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff91be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9240ced50 0x7ff92413c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37272/0 (socket says 172.21.15.99:37272) 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff91be00640 1 -- 172.21.15.99:0/3325162380 learned_addr learned my addr 172.21.15.99:0/3325162380 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff923e00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff924072d90 0x7ff92415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff928e00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9241445a0 0x7ff92413ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff91be00640 1 -- 172.21.15.99:0/3325162380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9241445a0 msgr2=0x7ff92413ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:02.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff91be00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9241445a0 0x7ff92413ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff91be00640 1 -- 172.21.15.99:0/3325162380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff924072d90 msgr2=0x7ff92415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:02.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff91be00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff924072d90 0x7ff92415ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff91be00640 1 -- 172.21.15.99:0/3325162380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9241f4e20 con 0x7ff9240ced50 2024-09-10T07:40:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.015+0000 7ff91be00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9240ced50 0x7ff92413c0a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00c480 tx=0x7ff90c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.016+0000 7ff920c00640 1 -- 172.21.15.99:0/3325162380 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0052d0 con 0x7ff9240ced50 2024-09-10T07:40:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.016+0000 7ff920c00640 1 -- 172.21.15.99:0/3325162380 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90c005470 con 0x7ff9240ced50 2024-09-10T07:40:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.016+0000 7ff920c00640 1 -- 172.21.15.99:0/3325162380 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c012870 con 0x7ff9240ced50 2024-09-10T07:40:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.016+0000 7ff92ae00640 1 -- 172.21.15.99:0/3325162380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9241f5100 con 0x7ff9240ced50 2024-09-10T07:40:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.016+0000 7ff92ae00640 1 -- 172.21.15.99:0/3325162380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9241f56c0 con 0x7ff9240ced50 2024-09-10T07:40:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.017+0000 7ff92ae00640 1 -- 172.21.15.99:0/3325162380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff924144f50 con 0x7ff9240ced50 2024-09-10T07:40:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.018+0000 7ff920c00640 1 -- 172.21.15.99:0/3325162380 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff90c012a10 con 0x7ff9240ced50 2024-09-10T07:40:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.019+0000 7ff920c00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff90006be30 0x7ff90006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.019+0000 7ff920c00640 1 -- 172.21.15.99:0/3325162380 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7ff90c08a9b0 con 0x7ff9240ced50 2024-09-10T07:40:02.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.019+0000 7ff923e00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff90006be30 0x7ff90006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:02.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.020+0000 7ff923e00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff90006be30 0x7ff90006e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff914000f60 tx=0x7ff914007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:02.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.023+0000 7ff920c00640 1 -- 172.21.15.99:0/3325162380 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff90c058d00 con 0x7ff9240ced50 2024-09-10T07:40:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.198+0000 7ff92ae00640 1 -- 172.21.15.99:0/3325162380 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7ff92415bc00 con 0x7ff9240ced50 2024-09-10T07:40:02.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.495+0000 7ff920c00640 1 -- 172.21.15.99:0/3325162380 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v126) ==== 181+0+0 (secure 0 0 0) 0x7ff90c05d000 con 0x7ff9240ced50 2024-09-10T07:40:02.494 INFO:teuthology.orchestra.run.smithi099.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-10T07:40:02.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 -- 172.21.15.99:0/3325162380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff90006be30 msgr2=0x7ff90006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:02.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff90006be30 0x7ff90006e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff914000f60 tx=0x7ff914007e40 comp rx=0 tx=0).stop 2024-09-10T07:40:02.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 -- 172.21.15.99:0/3325162380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9240ced50 msgr2=0x7ff92413c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:02.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9240ced50 0x7ff92413c0a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00c480 tx=0x7ff90c00c940 comp rx=0 tx=0).stop 2024-09-10T07:40:02.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 -- 172.21.15.99:0/3325162380 shutdown_connections 2024-09-10T07:40:02.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9241445a0 0x7ff92413ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff90006be30 0x7ff90006e2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9240ced50 0x7ff92413c0a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 --2- 172.21.15.99:0/3325162380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff924072d90 0x7ff92415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:02.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 -- 172.21.15.99:0/3325162380 >> 172.21.15.99:0/3325162380 conn(0x7ff9240b26a0 msgr2=0x7ff924071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:02.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 -- 172.21.15.99:0/3325162380 shutdown_connections 2024-09-10T07:40:02.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02.497+0000 7ff92ae00640 1 -- 172.21.15.99:0/3325162380 wait complete. 2024-09-10T07:40:02.514 DEBUG:teuthology.orchestra.run.smithi099:> stdin-killer -- python3 -c ' 2024-09-10T07:40:02.514 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-10T07:40:02.514 DEBUG:teuthology.orchestra.run.smithi099:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-10T07:40:02.514 DEBUG:teuthology.orchestra.run.smithi099:> os.fchmod(fd, 0O666) 2024-09-10T07:40:02.514 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(fd) 2024-09-10T07:40:02.515 DEBUG:teuthology.orchestra.run.smithi099:> os.close(fd) 2024-09-10T07:40:02.515 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-10T07:40:02.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:02.632 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:40:02.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:40:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:02.762 INFO:teuthology.orchestra.run.smithi099.stdout:client5714 2024-09-10T07:40:02.763 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client5714/osdmap') 2024-09-10T07:40:02.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:40:02.862 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 125 barrier 125 flags 0x588000 2024-09-10T07:40:02.862 INFO:teuthology.orchestra.run.smithi099.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:02.862 INFO:teuthology.orchestra.run.smithi099.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:02.862 INFO:teuthology.orchestra.run.smithi099.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:02.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd0 (2)172.21.15.99:6800 100% (exists, up) 100% -1 2024-09-10T07:40:02.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd1 (2)172.21.15.99:6810 100% (exists, up) 100% -1 2024-09-10T07:40:02.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd2 (2)172.21.15.99:6808 100% (exists, up) 100% -1 2024-09-10T07:40:02.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd3 (2)172.21.15.99:6818 100% (exists, up) 100% -1 2024-09-10T07:40:02.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd4 (2)172.21.15.187:6824 100% (exists, up) 100% -1 2024-09-10T07:40:02.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd5 (2)172.21.15.187:6800 100% (exists, up) 100% -1 2024-09-10T07:40:02.863 INFO:teuthology.orchestra.run.smithi099.stdout:osd6 (2)172.21.15.187:6808 100% (exists, up) 100% -1 2024-09-10T07:40:02.863 INFO:teuthology.orchestra.run.smithi099.stdout:osd7 (2)172.21.15.187:6811 100% (exists, up) 100% -1 2024-09-10T07:40:02.863 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records in 2024-09-10T07:40:02.863 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records out 2024-09-10T07:40:02.863 INFO:teuthology.orchestra.run.smithi099.stderr:799 bytes copied, 6.9206e-05 s, 11.5 MB/s 2024-09-10T07:40:02.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:02.873 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-10T07:40:03.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.028+0000 7fd9bd400640 1 Processor -- start 2024-09-10T07:40:03.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.028+0000 7fd9bd400640 1 -- start start 2024-09-10T07:40:03.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9bd400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd9b80ce070 0x7fd9b80b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9bd400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd9b815bfb0 0x7fd9b815d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9bd400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9b80cf890 0x7fd9b80cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9bd400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b80ce450 con 0x7fd9b80ce070 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9bd400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b815c800 con 0x7fd9b815bfb0 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9bd400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b815cae0 con 0x7fd9b80cf890 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9b6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd9b80ce070 0x7fd9b80b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9b6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd9b80ce070 0x7fd9b80b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37282/0 (socket says 172.21.15.99:37282) 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9b6800640 1 -- 172.21.15.99:0/2289213155 learned_addr learned my addr 172.21.15.99:0/2289213155 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9b7200640 1 --2- 172.21.15.99:0/2289213155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9b80cf890 0x7fd9b80cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.029+0000 7fd9b5e00640 1 --2- 172.21.15.99:0/2289213155 >> v2:172.21.15.187:3300/0 conn(0x7fd9b815bfb0 0x7fd9b815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.030+0000 7fd9b6800640 1 -- 172.21.15.99:0/2289213155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9b80cf890 msgr2=0x7fd9b80cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.030+0000 7fd9b6800640 1 --2- 172.21.15.99:0/2289213155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9b80cf890 0x7fd9b80cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.030+0000 7fd9b6800640 1 -- 172.21.15.99:0/2289213155 >> v2:172.21.15.187:3300/0 conn(0x7fd9b815bfb0 msgr2=0x7fd9b815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:03.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.030+0000 7fd9b6800640 1 --2- 172.21.15.99:0/2289213155 >> v2:172.21.15.187:3300/0 conn(0x7fd9b815bfb0 0x7fd9b815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.030+0000 7fd9b6800640 1 -- 172.21.15.99:0/2289213155 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b815cdc0 con 0x7fd9b80ce070 2024-09-10T07:40:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.031+0000 7fd9b6800640 1 --2- 172.21.15.99:0/2289213155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 0x7fd9b80b5750 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd9b815f500 tx=0x7fd9a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84ba9725d970ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.031+0000 7fd9b5400640 1 -- 172.21.15.99:0/2289213155 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8037070 con 0x7fd9b80ce070 2024-09-10T07:40:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.031+0000 7fd9b5400640 1 -- 172.21.15.99:0/2289213155 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a8032440 con 0x7fd9b80ce070 2024-09-10T07:40:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.031+0000 7fd9b5400640 1 -- 172.21.15.99:0/2289213155 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8032810 con 0x7fd9b80ce070 2024-09-10T07:40:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.031+0000 7fd9bd400640 1 -- 172.21.15.99:0/2289213155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 msgr2=0x7fd9b80b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.031+0000 7fd9bd400640 1 --2- 172.21.15.99:0/2289213155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 0x7fd9b80b5750 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd9b815f500 tx=0x7fd9a802a1e0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.032+0000 7fd9bd400640 1 -- 172.21.15.99:0/2289213155 shutdown_connections 2024-09-10T07:40:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.032+0000 7fd9bd400640 1 --2- 172.21.15.99:0/2289213155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9b80cf890 0x7fd9b80cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.032+0000 7fd9bd400640 1 --2- 172.21.15.99:0/2289213155 >> v2:172.21.15.187:3300/0 conn(0x7fd9b815bfb0 0x7fd9b815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.032+0000 7fd9bd400640 1 --2- 172.21.15.99:0/2289213155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 0x7fd9b80b5750 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.032+0000 7fd9bd400640 1 -- 172.21.15.99:0/2289213155 >> 172.21.15.99:0/2289213155 conn(0x7fd9b80b2630 msgr2=0x7fd9b80b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:03.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.032+0000 7fd9bd400640 1 -- 172.21.15.99:0/2289213155 shutdown_connections 2024-09-10T07:40:03.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.032+0000 7fd9bd400640 1 -- 172.21.15.99:0/2289213155 wait complete. 2024-09-10T07:40:03.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.033+0000 7fd9bd400640 1 Processor -- start 2024-09-10T07:40:03.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.033+0000 7fd9bd400640 1 -- start start 2024-09-10T07:40:03.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.034+0000 7fd9bd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 0x7fd9b8167e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.034+0000 7fd9bd400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80cf890 0x7fd9b815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.034+0000 7fd9bd400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9b815bfb0 0x7fd9b815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.034+0000 7fd9bd400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b815d830 con 0x7fd9b80ce070 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.034+0000 7fd9bd400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b815d6b0 con 0x7fd9b80cf890 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.034+0000 7fd9bd400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b806e080 con 0x7fd9b815bfb0 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.034+0000 7fd9b6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 0x7fd9b8167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.035+0000 7fd9b6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 0x7fd9b8167e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37288/0 (socket says 172.21.15.99:37288) 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.035+0000 7fd9b6800640 1 -- 172.21.15.99:0/2106285523 learned_addr learned my addr 172.21.15.99:0/2106285523 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.035+0000 7fd9b7200640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9b815bfb0 0x7fd9b815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.035+0000 7fd9b5e00640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80cf890 0x7fd9b815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.035+0000 7fd9b6800640 1 -- 172.21.15.99:0/2106285523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9b815bfb0 msgr2=0x7fd9b815afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.035+0000 7fd9b6800640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9b815bfb0 0x7fd9b815afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.035+0000 7fd9b6800640 1 -- 172.21.15.99:0/2106285523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80cf890 msgr2=0x7fd9b815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.035+0000 7fd9b6800640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80cf890 0x7fd9b815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.035+0000 7fd9b6800640 1 -- 172.21.15.99:0/2106285523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b8166b10 con 0x7fd9b80ce070 2024-09-10T07:40:03.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.035+0000 7fd9b6800640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 0x7fd9b8167e40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8000c00 tx=0x7fd9a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:03.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.036+0000 7fd9aea00640 1 -- 172.21.15.99:0/2106285523 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8041070 con 0x7fd9b80ce070 2024-09-10T07:40:03.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.036+0000 7fd9aea00640 1 -- 172.21.15.99:0/2106285523 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a803c870 con 0x7fd9b80ce070 2024-09-10T07:40:03.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.036+0000 7fd9bd400640 1 -- 172.21.15.99:0/2106285523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b8166df0 con 0x7fd9b80ce070 2024-09-10T07:40:03.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.036+0000 7fd9aea00640 1 -- 172.21.15.99:0/2106285523 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8037040 con 0x7fd9b80ce070 2024-09-10T07:40:03.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.036+0000 7fd9bd400640 1 -- 172.21.15.99:0/2106285523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b81673b0 con 0x7fd9b80ce070 2024-09-10T07:40:03.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.037+0000 7fd9bd400640 1 -- 172.21.15.99:0/2106285523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b8076190 con 0x7fd9b80ce070 2024-09-10T07:40:03.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.038+0000 7fd9aea00640 1 -- 172.21.15.99:0/2106285523 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9a8044070 con 0x7fd9b80ce070 2024-09-10T07:40:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.039+0000 7fd9aea00640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd99806be30 0x7fd99806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.039+0000 7fd9aea00640 1 -- 172.21.15.99:0/2106285523 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7fd9a80ab9c0 con 0x7fd9b80ce070 2024-09-10T07:40:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.039+0000 7fd9b5e00640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd99806be30 0x7fd99806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.040+0000 7fd9b5e00640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd99806be30 0x7fd99806e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd9b806ff60 tx=0x7fd9a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:03.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.044+0000 7fd9aea00640 1 -- 172.21.15.99:0/2106285523 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9b8076190 con 0x7fd9b80ce070 2024-09-10T07:40:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.226+0000 7fd9bd400640 1 -- 172.21.15.99:0/2106285523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) -- 0x7fd9b815d170 con 0x7fd9b80ce070 2024-09-10T07:40:03.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.513+0000 7fd9aea00640 1 -- 172.21.15.99:0/2106285523 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v127) ==== 93+0+0 (secure 0 0 0) 0x7fd9a80ade20 con 0x7fd9b80ce070 2024-09-10T07:40:03.512 INFO:teuthology.orchestra.run.smithi099.stderr:pauserd,pausewr is set 2024-09-10T07:40:03.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.515+0000 7fd9bd400640 1 -- 172.21.15.99:0/2106285523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd99806be30 msgr2=0x7fd99806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.515+0000 7fd9bd400640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd99806be30 0x7fd99806e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd9b806ff60 tx=0x7fd9a4008040 comp rx=0 tx=0).stop 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.515+0000 7fd9bd400640 1 -- 172.21.15.99:0/2106285523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 msgr2=0x7fd9b8167e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.515+0000 7fd9bd400640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 0x7fd9b8167e40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8000c00 tx=0x7fd9a80046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.516+0000 7fd9bd400640 1 -- 172.21.15.99:0/2106285523 shutdown_connections 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.516+0000 7fd9bd400640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9b815bfb0 0x7fd9b815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.516+0000 7fd9bd400640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80cf890 0x7fd9b815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.516+0000 7fd9bd400640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd99806be30 0x7fd99806e2f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.516+0000 7fd9bd400640 1 --2- 172.21.15.99:0/2106285523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9b80ce070 0x7fd9b8167e40 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.516+0000 7fd9bd400640 1 -- 172.21.15.99:0/2106285523 >> 172.21.15.99:0/2106285523 conn(0x7fd9b80b2630 msgr2=0x7fd9b80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.516+0000 7fd9bd400640 1 -- 172.21.15.99:0/2106285523 shutdown_connections 2024-09-10T07:40:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.516+0000 7fd9bd400640 1 -- 172.21.15.99:0/2106285523 wait complete. 2024-09-10T07:40:03.533 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-10T07:40:03.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.688+0000 7fb999c00640 1 Processor -- start 2024-09-10T07:40:03.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.688+0000 7fb999c00640 1 -- start start 2024-09-10T07:40:03.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.689+0000 7fb999c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb99415f920 0x7fb9940af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.689+0000 7fb999c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99415ff70 con 0x7fb9940b58e0 2024-09-10T07:40:03.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.689+0000 7fb999c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9940ae970 con 0x7fb9940d0080 2024-09-10T07:40:03.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.689+0000 7fb999c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb99415fd50 con 0x7fb99415f920 2024-09-10T07:40:03.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.689+0000 7fb992000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb9940b58e0 0x7fb99415f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55950/0 (socket says 172.21.15.99:55950) 2024-09-10T07:40:03.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.689+0000 7fb992000640 1 -- 172.21.15.99:0/781439328 learned_addr learned my addr 172.21.15.99:0/781439328 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:03.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.689+0000 7fb993400640 1 --2- 172.21.15.99:0/781439328 >> v2:172.21.15.99:3300/0 conn(0x7fb99415f920 0x7fb9940af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.690+0000 7fb993400640 1 -- 172.21.15.99:0/781439328 >> v1:172.21.15.187:6789/0 conn(0x7fb9940d0080 legacy=0x7fb9940b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.690+0000 7fb993400640 1 -- 172.21.15.99:0/781439328 >> v1:172.21.15.99:6789/0 conn(0x7fb9940b58e0 legacy=0x7fb99415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.690+0000 7fb993400640 1 -- 172.21.15.99:0/781439328 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9940aec50 con 0x7fb99415f920 2024-09-10T07:40:03.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.690+0000 7fb991600640 1 -- 172.21.15.99:0/781439328 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1619799989 0 0) 0x7fb99415ff70 con 0x7fb9940b58e0 2024-09-10T07:40:03.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.691+0000 7fb993400640 1 --2- 172.21.15.99:0/781439328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb99415f920 0x7fb9940af450 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009d90 tx=0x7fb98c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165b69863d6cacf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:03.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.691+0000 7fb991600640 1 -- 172.21.15.99:0/781439328 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c031600 con 0x7fb99415f920 2024-09-10T07:40:03.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.691+0000 7fb991600640 1 -- 172.21.15.99:0/781439328 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c0317a0 con 0x7fb99415f920 2024-09-10T07:40:03.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.691+0000 7fb991600640 1 -- 172.21.15.99:0/781439328 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c031b70 con 0x7fb99415f920 2024-09-10T07:40:03.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.692+0000 7fb999c00640 1 -- 172.21.15.99:0/781439328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb99415f920 msgr2=0x7fb9940af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.692+0000 7fb999c00640 1 --2- 172.21.15.99:0/781439328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb99415f920 0x7fb9940af450 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009d90 tx=0x7fb98c02a5d0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.692+0000 7fb999c00640 1 -- 172.21.15.99:0/781439328 shutdown_connections 2024-09-10T07:40:03.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.692+0000 7fb999c00640 1 --2- 172.21.15.99:0/781439328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb99415f920 0x7fb9940af450 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.692+0000 7fb999c00640 1 -- 172.21.15.99:0/781439328 >> 172.21.15.99:0/781439328 conn(0x7fb9940b2630 msgr2=0x7fb9940b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:03.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.692+0000 7fb999c00640 1 -- 172.21.15.99:0/781439328 shutdown_connections 2024-09-10T07:40:03.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.692+0000 7fb999c00640 1 -- 172.21.15.99:0/781439328 wait complete. 2024-09-10T07:40:03.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.693+0000 7fb999c00640 1 Processor -- start 2024-09-10T07:40:03.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.694+0000 7fb999c00640 1 -- start start 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.694+0000 7fb999c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9940b58e0 0x7fb9940b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.694+0000 7fb999c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9940d0080 0x7fb9940b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.694+0000 7fb999c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb99415f920 0x7fb994147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.694+0000 7fb999c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb994160250 con 0x7fb9940b58e0 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.694+0000 7fb999c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb9940af990 con 0x7fb9940d0080 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.694+0000 7fb999c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb9940d0460 con 0x7fb99415f920 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb992a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9940b58e0 0x7fb9940b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb992a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9940b58e0 0x7fb9940b0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37314/0 (socket says 172.21.15.99:37314) 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb992a00640 1 -- 172.21.15.99:0/1402858788 learned_addr learned my addr 172.21.15.99:0/1402858788 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb993400640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb99415f920 0x7fb994147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb992000640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9940d0080 0x7fb9940b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb992a00640 1 -- 172.21.15.99:0/1402858788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb99415f920 msgr2=0x7fb994147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb992a00640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb99415f920 0x7fb994147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb992a00640 1 -- 172.21.15.99:0/1402858788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9940d0080 msgr2=0x7fb9940b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb992a00640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9940d0080 0x7fb9940b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb992a00640 1 -- 172.21.15.99:0/1402858788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb994158aa0 con 0x7fb9940b58e0 2024-09-10T07:40:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb993400640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb99415f920 0x7fb994147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.695+0000 7fb992a00640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9940b58e0 0x7fb9940b0780 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb98400c450 tx=0x7fb98400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.696+0000 7fb98aa00640 1 -- 172.21.15.99:0/1402858788 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9840052d0 con 0x7fb9940b58e0 2024-09-10T07:40:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.696+0000 7fb98aa00640 1 -- 172.21.15.99:0/1402858788 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb984005470 con 0x7fb9940b58e0 2024-09-10T07:40:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.696+0000 7fb999c00640 1 -- 172.21.15.99:0/1402858788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9940b12f0 con 0x7fb9940b58e0 2024-09-10T07:40:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.696+0000 7fb98aa00640 1 -- 172.21.15.99:0/1402858788 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984012870 con 0x7fb9940b58e0 2024-09-10T07:40:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.696+0000 7fb999c00640 1 -- 172.21.15.99:0/1402858788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99415aba0 con 0x7fb9940b58e0 2024-09-10T07:40:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.697+0000 7fb999c00640 1 -- 172.21.15.99:0/1402858788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9940af450 con 0x7fb9940b58e0 2024-09-10T07:40:03.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.698+0000 7fb98aa00640 1 -- 172.21.15.99:0/1402858788 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb984012a10 con 0x7fb9940b58e0 2024-09-10T07:40:03.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.699+0000 7fb98aa00640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb97406be30 0x7fb97406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:03.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.699+0000 7fb98aa00640 1 -- 172.21.15.99:0/1402858788 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5709+0+0 (secure 0 0 0) 0x7fb98408a9c0 con 0x7fb9940b58e0 2024-09-10T07:40:03.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.699+0000 7fb98aa00640 1 -- 172.21.15.99:0/1402858788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=128+}) -- 0x7fb974073960 con 0x7fb9940b58e0 2024-09-10T07:40:03.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.699+0000 7fb992000640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb97406be30 0x7fb97406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:03.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.700+0000 7fb992000640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb97406be30 0x7fb97406e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb980007f70 tx=0x7fb980007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:03.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.703+0000 7fb98aa00640 1 -- 172.21.15.99:0/1402858788 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb98405f030 con 0x7fb9940b58e0 2024-09-10T07:40:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:03.887+0000 7fb999c00640 1 -- 172.21.15.99:0/1402858788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) -- 0x7fb9940755b0 con 0x7fb9940b58e0 2024-09-10T07:40:04.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.522+0000 7fb98aa00640 1 -- 172.21.15.99:0/1402858788 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v128) ==== 97+0+0 (secure 0 0 0) 0x7fb98408ce20 con 0x7fb9940b58e0 2024-09-10T07:40:04.522 INFO:teuthology.orchestra.run.smithi099.stderr:pauserd,pausewr is unset 2024-09-10T07:40:04.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.523+0000 7fb98aa00640 1 -- 172.21.15.99:0/1402858788 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(128..128 src has 1..128) ==== 288+0+0 (secure 0 0 0) 0x7fb984089000 con 0x7fb9940b58e0 2024-09-10T07:40:04.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.523+0000 7fb98aa00640 1 -- 172.21.15.99:0/1402858788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=129}) -- 0x7fb9740743a0 con 0x7fb9940b58e0 2024-09-10T07:40:04.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.526+0000 7fb999c00640 1 -- 172.21.15.99:0/1402858788 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb97406be30 msgr2=0x7fb97406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:04.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.526+0000 7fb999c00640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb97406be30 0x7fb97406e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb980007f70 tx=0x7fb980007f00 comp rx=0 tx=0).stop 2024-09-10T07:40:04.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.526+0000 7fb999c00640 1 -- 172.21.15.99:0/1402858788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9940b58e0 msgr2=0x7fb9940b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:04.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.526+0000 7fb999c00640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9940b58e0 0x7fb9940b0780 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb98400c450 tx=0x7fb98400c910 comp rx=0 tx=0).stop 2024-09-10T07:40:04.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.526+0000 7fb999c00640 1 -- 172.21.15.99:0/1402858788 shutdown_connections 2024-09-10T07:40:04.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.526+0000 7fb999c00640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb99415f920 0x7fb994147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.526+0000 7fb999c00640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9940d0080 0x7fb9940b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.526+0000 7fb999c00640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb97406be30 0x7fb97406e2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.526+0000 7fb999c00640 1 --2- 172.21.15.99:0/1402858788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9940b58e0 0x7fb9940b0780 secure :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb98400c450 tx=0x7fb98400c910 comp rx=0 tx=0).stop 2024-09-10T07:40:04.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.526+0000 7fb999c00640 1 -- 172.21.15.99:0/1402858788 >> 172.21.15.99:0/1402858788 conn(0x7fb9940b2630 msgr2=0x7fb9940b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:04.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.527+0000 7fb999c00640 1 -- 172.21.15.99:0/1402858788 shutdown_connections 2024-09-10T07:40:04.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.527+0000 7fb999c00640 1 -- 172.21.15.99:0/1402858788 wait complete. 2024-09-10T07:40:04.543 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:40:04.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.701+0000 7f9fa6600640 1 Processor -- start 2024-09-10T07:40:04.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.701+0000 7f9fa6600640 1 -- start start 2024-09-10T07:40:04.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9fa6600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fa0145290 0x7f9fa006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9fa6600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa0072f40 0x7f9fa00b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9fa6600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa006e3d0 con 0x7f9fa00ce780 2024-09-10T07:40:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9fa6600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa006efe0 con 0x7f9fa0145290 2024-09-10T07:40:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9fa6600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa006e6b0 con 0x7f9fa0072f40 2024-09-10T07:40:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9f9f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fa0145290 0x7f9fa006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9f9f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fa0145290 0x7f9fa006f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37324/0 (socket says 172.21.15.99:37324) 2024-09-10T07:40:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9f9f400640 1 -- 172.21.15.99:0/3355143463 learned_addr learned my addr 172.21.15.99:0/3355143463 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9f9fe00640 1 --2- 172.21.15.99:0/3355143463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa0072f40 0x7f9fa00b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9f9f400640 1 -- 172.21.15.99:0/3355143463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa0072f40 msgr2=0x7f9fa00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9f9f400640 1 --2- 172.21.15.99:0/3355143463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa0072f40 0x7f9fa00b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9f9f400640 1 -- 172.21.15.99:0/3355143463 >> v1:172.21.15.187:6789/0 conn(0x7f9fa00ce780 legacy=0x7f9fa0072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9f9f400640 1 -- 172.21.15.99:0/3355143463 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa006e990 con 0x7f9fa0145290 2024-09-10T07:40:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.703+0000 7f9f9fe00640 1 --2- 172.21.15.99:0/3355143463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa0072f40 0x7f9fa00b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.704+0000 7f9f9f400640 1 --2- 172.21.15.99:0/3355143463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0145290 0x7f9fa006f470 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009870 tx=0x7f9f9002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902dd797a29537ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9f9ea00640 1 -- 172.21.15.99:0/3355143463 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f90037070 con 0x7f9fa0145290 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9f9ea00640 1 -- 172.21.15.99:0/3355143463 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f90032440 con 0x7f9fa0145290 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9f9ea00640 1 -- 172.21.15.99:0/3355143463 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f90032810 con 0x7f9fa0145290 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9fa6600640 1 -- 172.21.15.99:0/3355143463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0145290 msgr2=0x7f9fa006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9fa6600640 1 --2- 172.21.15.99:0/3355143463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0145290 0x7f9fa006f470 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009870 tx=0x7f9f9002a250 comp rx=0 tx=0).stop 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9fa6600640 1 -- 172.21.15.99:0/3355143463 shutdown_connections 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9fa6600640 1 --2- 172.21.15.99:0/3355143463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa0072f40 0x7f9fa00b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9fa6600640 1 --2- 172.21.15.99:0/3355143463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0145290 0x7f9fa006f470 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9fa6600640 1 -- 172.21.15.99:0/3355143463 >> 172.21.15.99:0/3355143463 conn(0x7f9fa006bc10 msgr2=0x7f9fa006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9fa6600640 1 -- 172.21.15.99:0/3355143463 shutdown_connections 2024-09-10T07:40:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.705+0000 7f9fa6600640 1 -- 172.21.15.99:0/3355143463 wait complete. 2024-09-10T07:40:04.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.707+0000 7f9fa6600640 1 Processor -- start 2024-09-10T07:40:04.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.707+0000 7f9fa6600640 1 -- start start 2024-09-10T07:40:04.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9fa6600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0072f40 0x7f9fa01e8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:04.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9fa6600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa00ce780 0x7f9fa015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:04.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9fa6600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa0145290 0x7f9fa01f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:04.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9fa6600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa006df80 con 0x7f9fa0072f40 2024-09-10T07:40:04.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9fa6600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0145670 con 0x7f9fa0145290 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9fa6600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa006e100 con 0x7f9fa00ce780 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9f9f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0072f40 0x7f9fa01e8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9f9f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0072f40 0x7f9fa01e8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37334/0 (socket says 172.21.15.99:37334) 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9f9f400640 1 -- 172.21.15.99:0/126735898 learned_addr learned my addr 172.21.15.99:0/126735898 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9f9fe00640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa0145290 0x7f9fa01f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.708+0000 7f9f96a00640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa00ce780 0x7f9fa015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9f9f400640 1 -- 172.21.15.99:0/126735898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa00ce780 msgr2=0x7f9fa015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9f9f400640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa00ce780 0x7f9fa015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9f9f400640 1 -- 172.21.15.99:0/126735898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa0145290 msgr2=0x7f9fa01f2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9f9f400640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa0145290 0x7f9fa01f2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9f9f400640 1 -- 172.21.15.99:0/126735898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa01f3740 con 0x7f9fa0072f40 2024-09-10T07:40:04.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9f96a00640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa00ce780 0x7f9fa015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:04.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9f9f400640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0072f40 0x7f9fa01e8750 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009870 tx=0x7f9f900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:04.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9f97e00640 1 -- 172.21.15.99:0/126735898 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f90041020 con 0x7f9fa0072f40 2024-09-10T07:40:04.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9f97e00640 1 -- 172.21.15.99:0/126735898 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f90030970 con 0x7f9fa0072f40 2024-09-10T07:40:04.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9f97e00640 1 -- 172.21.15.99:0/126735898 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f90037040 con 0x7f9fa0072f40 2024-09-10T07:40:04.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.709+0000 7f9fa6600640 1 -- 172.21.15.99:0/126735898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa01e76b0 con 0x7f9fa0072f40 2024-09-10T07:40:04.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.710+0000 7f9fa6600640 1 -- 172.21.15.99:0/126735898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa01e7c70 con 0x7f9fa0072f40 2024-09-10T07:40:04.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.711+0000 7f9fa6600640 1 -- 172.21.15.99:0/126735898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa0071510 con 0x7f9fa0072f40 2024-09-10T07:40:04.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.712+0000 7f9f97e00640 1 -- 172.21.15.99:0/126735898 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f90044020 con 0x7f9fa0072f40 2024-09-10T07:40:04.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.712+0000 7f9f97e00640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f7c06be30 0x7f9f7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:04.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.712+0000 7f9f97e00640 1 -- 172.21.15.99:0/126735898 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f9f900ab7a0 con 0x7f9fa0072f40 2024-09-10T07:40:04.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.713+0000 7f9f96a00640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f7c06be30 0x7f9f7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:04.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.713+0000 7f9f96a00640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f7c06be30 0x7f9f7c06e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9fa01e8ed0 tx=0x7f9f88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:04.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.717+0000 7f9f97e00640 1 -- 172.21.15.99:0/126735898 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f9004b030 con 0x7f9fa0072f40 2024-09-10T07:40:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.892+0000 7f9fa6600640 1 -- 172.21.15.99:0/126735898 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fa0143300 con 0x7f9fa0072f40 2024-09-10T07:40:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.894+0000 7f9f97e00640 1 -- 172.21.15.99:0/126735898 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16663 (secure 0 0 0) 0x7f9f9007a150 con 0x7f9fa0072f40 2024-09-10T07:40:04.893 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:04.893 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":128,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:40:04.513536+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:39:49.623236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T07:39:50.847068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:40:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 -- 172.21.15.99:0/126735898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f7c06be30 msgr2=0x7f9f7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f7c06be30 0x7f9f7c06e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9fa01e8ed0 tx=0x7f9f88009040 comp rx=0 tx=0).stop 2024-09-10T07:40:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 -- 172.21.15.99:0/126735898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0072f40 msgr2=0x7f9fa01e8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0072f40 0x7f9fa01e8750 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009870 tx=0x7f9f900046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 -- 172.21.15.99:0/126735898 shutdown_connections 2024-09-10T07:40:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fa0145290 0x7f9fa01f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fa00ce780 0x7f9fa015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f7c06be30 0x7f9f7c06e2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 --2- 172.21.15.99:0/126735898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fa0072f40 0x7f9fa01e8750 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 -- 172.21.15.99:0/126735898 >> 172.21.15.99:0/126735898 conn(0x7f9fa006bc10 msgr2=0x7f9fa00b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 -- 172.21.15.99:0/126735898 shutdown_connections 2024-09-10T07:40:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:04.896+0000 7f9fa6600640 1 -- 172.21.15.99:0/126735898 wait complete. 2024-09-10T07:40:04.911 DEBUG:teuthology.orchestra.run.smithi099:> stdin-killer -- python3 -c ' 2024-09-10T07:40:04.912 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-10T07:40:04.912 DEBUG:teuthology.orchestra.run.smithi099:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-10T07:40:04.912 DEBUG:teuthology.orchestra.run.smithi099:> os.fchmod(fd, 0O666) 2024-09-10T07:40:04.912 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(fd) 2024-09-10T07:40:04.912 DEBUG:teuthology.orchestra.run.smithi099:> os.close(fd) 2024-09-10T07:40:04.912 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-10T07:40:05.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:05.025 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:40:05.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:40:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:05.153 INFO:teuthology.orchestra.run.smithi099.stdout:client5714 2024-09-10T07:40:05.153 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client5714/osdmap') 2024-09-10T07:40:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:40:05.252 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 125 barrier 125 flags 0x588000 2024-09-10T07:40:05.252 INFO:teuthology.orchestra.run.smithi099.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:05.252 INFO:teuthology.orchestra.run.smithi099.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:05.252 INFO:teuthology.orchestra.run.smithi099.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stdout:osd0 (2)172.21.15.99:6800 100% (exists, up) 100% -1 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stdout:osd1 (2)172.21.15.99:6810 100% (exists, up) 100% -1 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stdout:osd2 (2)172.21.15.99:6808 100% (exists, up) 100% -1 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stdout:osd3 (2)172.21.15.99:6818 100% (exists, up) 100% -1 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stdout:osd4 (2)172.21.15.187:6824 100% (exists, up) 100% -1 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stdout:osd5 (2)172.21.15.187:6800 100% (exists, up) 100% -1 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stdout:osd6 (2)172.21.15.187:6808 100% (exists, up) 100% -1 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stdout:osd7 (2)172.21.15.187:6811 100% (exists, up) 100% -1 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records in 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records out 2024-09-10T07:40:05.253 INFO:teuthology.orchestra.run.smithi099.stderr:799 bytes copied, 6.6536e-05 s, 12.0 MB/s 2024-09-10T07:40:05.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:05.263 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.416+0000 7f6462800640 1 Processor -- start 2024-09-10T07:40:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.416+0000 7f6462800640 1 -- start start 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.417+0000 7f6462800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c15e970 0x7f645c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.417+0000 7f6462800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f645c0d2680 0x7f645c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.417+0000 7f6462800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f645c0cfac0 0x7f645c0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.417+0000 7f6462800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f645c0d37e0 con 0x7f645c0cfac0 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.417+0000 7f6462800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f645c0d2bd0 con 0x7f645c0d2680 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.417+0000 7f6462800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f645c0d2eb0 con 0x7f645c15e970 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.417+0000 7f6461e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f645c0cfac0 0x7f645c0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.418+0000 7f6461e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f645c0cfac0 0x7f645c0d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37336/0 (socket says 172.21.15.99:37336) 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.418+0000 7f6461e00640 1 -- 172.21.15.99:0/3312630885 learned_addr learned my addr 172.21.15.99:0/3312630885 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.418+0000 7f6461400640 1 --2- 172.21.15.99:0/3312630885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c15e970 0x7f645c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.418+0000 7f6460a00640 1 --2- 172.21.15.99:0/3312630885 >> v2:172.21.15.187:3300/0 conn(0x7f645c0d2680 0x7f645c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.418+0000 7f6461e00640 1 -- 172.21.15.99:0/3312630885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c15e970 msgr2=0x7f645c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.418+0000 7f6461e00640 1 --2- 172.21.15.99:0/3312630885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c15e970 0x7f645c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.418+0000 7f6461e00640 1 -- 172.21.15.99:0/3312630885 >> v2:172.21.15.187:3300/0 conn(0x7f645c0d2680 msgr2=0x7f645c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.418+0000 7f6461e00640 1 --2- 172.21.15.99:0/3312630885 >> v2:172.21.15.187:3300/0 conn(0x7f645c0d2680 0x7f645c0cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.418+0000 7f6461e00640 1 -- 172.21.15.99:0/3312630885 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c0d3190 con 0x7f645c0cfac0 2024-09-10T07:40:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.419+0000 7f6461e00640 1 --2- 172.21.15.99:0/3312630885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c0cfac0 0x7f645c0d0ff0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f645c08dd70 tx=0x7f645402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2389ab03384e9f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.419+0000 7f645be00640 1 -- 172.21.15.99:0/3312630885 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454037070 con 0x7f645c0cfac0 2024-09-10T07:40:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.419+0000 7f645be00640 1 -- 172.21.15.99:0/3312630885 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6454032440 con 0x7f645c0cfac0 2024-09-10T07:40:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.419+0000 7f645be00640 1 -- 172.21.15.99:0/3312630885 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454032810 con 0x7f645c0cfac0 2024-09-10T07:40:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.420+0000 7f6462800640 1 -- 172.21.15.99:0/3312630885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c0cfac0 msgr2=0x7f645c0d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.420+0000 7f6462800640 1 --2- 172.21.15.99:0/3312630885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c0cfac0 0x7f645c0d0ff0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f645c08dd70 tx=0x7f645402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.420+0000 7f6462800640 1 -- 172.21.15.99:0/3312630885 shutdown_connections 2024-09-10T07:40:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.420+0000 7f6462800640 1 --2- 172.21.15.99:0/3312630885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c0cfac0 0x7f645c0d0ff0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.420+0000 7f6462800640 1 --2- 172.21.15.99:0/3312630885 >> v2:172.21.15.187:3300/0 conn(0x7f645c0d2680 0x7f645c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.420+0000 7f6462800640 1 --2- 172.21.15.99:0/3312630885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c15e970 0x7f645c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.420+0000 7f6462800640 1 -- 172.21.15.99:0/3312630885 >> 172.21.15.99:0/3312630885 conn(0x7f645c09de00 msgr2=0x7f645c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.420+0000 7f6462800640 1 -- 172.21.15.99:0/3312630885 shutdown_connections 2024-09-10T07:40:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.420+0000 7f6462800640 1 -- 172.21.15.99:0/3312630885 wait complete. 2024-09-10T07:40:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.422+0000 7f6462800640 1 Processor -- start 2024-09-10T07:40:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.422+0000 7f6462800640 1 -- start start 2024-09-10T07:40:05.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6462800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c0cfac0 0x7f645c0b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:05.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6462800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c0d2680 0x7f645c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:05.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6462800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c15e970 0x7f645c0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:05.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6462800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f645c0d0840 con 0x7f645c15e970 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6462800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f645c0cff70 con 0x7f645c0cfac0 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6462800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f645c15ed50 con 0x7f645c0d2680 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6461e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c15e970 0x7f645c0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6461e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c15e970 0x7f645c0cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37338/0 (socket says 172.21.15.99:37338) 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6461e00640 1 -- 172.21.15.99:0/180298237 learned_addr learned my addr 172.21.15.99:0/180298237 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6460a00640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c0d2680 0x7f645c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6461400640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c0cfac0 0x7f645c0b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6461e00640 1 -- 172.21.15.99:0/180298237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c0d2680 msgr2=0x7f645c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6461e00640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c0d2680 0x7f645c0cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6461e00640 1 -- 172.21.15.99:0/180298237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c0cfac0 msgr2=0x7f645c0b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6461e00640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c0cfac0 0x7f645c0b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.423+0000 7f6461e00640 1 -- 172.21.15.99:0/180298237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c15f1e0 con 0x7f645c15e970 2024-09-10T07:40:05.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.424+0000 7f6461e00640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c15e970 0x7f645c0cdce0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f645402a2b0 tx=0x7f64540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.424+0000 7f6459600640 1 -- 172.21.15.99:0/180298237 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454041020 con 0x7f645c15e970 2024-09-10T07:40:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.424+0000 7f6459600640 1 -- 172.21.15.99:0/180298237 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645403d640 con 0x7f645c15e970 2024-09-10T07:40:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.424+0000 7f6459600640 1 -- 172.21.15.99:0/180298237 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454037040 con 0x7f645c15e970 2024-09-10T07:40:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.424+0000 7f6462800640 1 -- 172.21.15.99:0/180298237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c15f480 con 0x7f645c15e970 2024-09-10T07:40:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.424+0000 7f6462800640 1 -- 172.21.15.99:0/180298237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c0b9820 con 0x7f645c15e970 2024-09-10T07:40:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.425+0000 7f6462800640 1 -- 172.21.15.99:0/180298237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f645c0cf580 con 0x7f645c15e970 2024-09-10T07:40:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.426+0000 7f6459600640 1 -- 172.21.15.99:0/180298237 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6454044020 con 0x7f645c15e970 2024-09-10T07:40:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.427+0000 7f6459600640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f643c06be30 0x7f643c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:05.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.427+0000 7f6459600640 1 -- 172.21.15.99:0/180298237 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f64540ab110 con 0x7f645c15e970 2024-09-10T07:40:05.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.427+0000 7f6461400640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f643c06be30 0x7f643c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:05.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.428+0000 7f6461400640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f643c06be30 0x7f643c06e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f64500113e0 tx=0x7f645000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.431+0000 7f6459600640 1 -- 172.21.15.99:0/180298237 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f645404b070 con 0x7f645c15e970 2024-09-10T07:40:05.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.639+0000 7f6462800640 1 -- 172.21.15.99:0/180298237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f645c06c460 con 0x7f645c15e970 2024-09-10T07:40:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.639+0000 7f6459600640 1 -- 172.21.15.99:0/180298237 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7f6454079340 con 0x7f645c15e970 2024-09-10T07:40:05.639 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:05.639 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":57,"btime":"2024-09-10T07:39:55:461034+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/269606175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":269606175},{"type":"v1","addr":"172.21.15.187:6834","nonce":269606175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2513906672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2513906672},{"type":"v1","addr":"172.21.15.187:6835","nonce":2513906672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3548731230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3548731230},{"type":"v1","addr":"172.21.15.99:6835","nonce":3548731230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:51.850274+0000","modified":"2024-09-10T07:39:54.867555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/106508261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":106508261},{"type":"v1","addr":"172.21.15.99:6837","nonce":106508261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6465,"qdb_cluster":[6465]},"id":7}]} 2024-09-10T07:40:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 57 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 -- 172.21.15.99:0/180298237 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f643c06be30 msgr2=0x7f643c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f643c06be30 0x7f643c06e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f64500113e0 tx=0x7f645000b040 comp rx=0 tx=0).stop 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 -- 172.21.15.99:0/180298237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c15e970 msgr2=0x7f645c0cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c15e970 0x7f645c0cdce0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f645402a2b0 tx=0x7f64540046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 -- 172.21.15.99:0/180298237 shutdown_connections 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f643c06be30 0x7f643c06e2f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f645c15e970 0x7f645c0cdce0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c0d2680 0x7f645c0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 --2- 172.21.15.99:0/180298237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c0cfac0 0x7f645c0b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 -- 172.21.15.99:0/180298237 >> 172.21.15.99:0/180298237 conn(0x7f645c09de00 msgr2=0x7f645c0c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 -- 172.21.15.99:0/180298237 shutdown_connections 2024-09-10T07:40:05.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05.642+0000 7f6462800640 1 -- 172.21.15.99:0/180298237 wait complete. 2024-09-10T07:40:05.657 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json osdmap barrier 128 2024-09-10T07:40:05.832 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-10T07:40:05.832 DEBUG:teuthology.orchestra.run.smithi099:> stdin-killer -- python3 -c ' 2024-09-10T07:40:05.832 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-10T07:40:05.832 DEBUG:teuthology.orchestra.run.smithi099:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-10T07:40:05.833 DEBUG:teuthology.orchestra.run.smithi099:> os.fchmod(fd, 0O666) 2024-09-10T07:40:05.833 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(fd) 2024-09-10T07:40:05.833 DEBUG:teuthology.orchestra.run.smithi099:> os.close(fd) 2024-09-10T07:40:05.833 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-10T07:40:05.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:05.948 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:40:06.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:40:06.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:06.078 INFO:teuthology.orchestra.run.smithi099.stdout:client5714 2024-09-10T07:40:06.078 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client5714/osdmap') 2024-09-10T07:40:06.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:40:06.178 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 128 barrier 128 flags 0x588000 2024-09-10T07:40:06.179 INFO:teuthology.orchestra.run.smithi099.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:06.179 INFO:teuthology.orchestra.run.smithi099.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:06.179 INFO:teuthology.orchestra.run.smithi099.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:06.179 INFO:teuthology.orchestra.run.smithi099.stdout:osd0 (2)172.21.15.99:6800 100% (exists, up) 100% -1 2024-09-10T07:40:06.179 INFO:teuthology.orchestra.run.smithi099.stdout:osd1 (2)172.21.15.99:6810 100% (exists, up) 100% -1 2024-09-10T07:40:06.179 INFO:teuthology.orchestra.run.smithi099.stdout:osd2 (2)172.21.15.99:6808 100% (exists, up) 100% -1 2024-09-10T07:40:06.180 INFO:teuthology.orchestra.run.smithi099.stdout:osd3 (2)172.21.15.99:6818 100% (exists, up) 100% -1 2024-09-10T07:40:06.180 INFO:teuthology.orchestra.run.smithi099.stdout:osd4 (2)172.21.15.187:6824 100% (exists, up) 100% -1 2024-09-10T07:40:06.180 INFO:teuthology.orchestra.run.smithi099.stdout:osd5 (2)172.21.15.187:6800 100% (exists, up) 100% -1 2024-09-10T07:40:06.180 INFO:teuthology.orchestra.run.smithi099.stdout:osd6 (2)172.21.15.187:6808 100% (exists, up) 100% -1 2024-09-10T07:40:06.180 INFO:teuthology.orchestra.run.smithi099.stdout:osd7 (2)172.21.15.187:6811 100% (exists, up) 100% -1 2024-09-10T07:40:06.181 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records in 2024-09-10T07:40:06.181 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records out 2024-09-10T07:40:06.181 INFO:teuthology.orchestra.run.smithi099.stderr:799 bytes copied, 9.4677e-05 s, 8.4 MB/s 2024-09-10T07:40:06.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:06.189 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:40:06.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:40:06.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:06.279 INFO:teuthology.orchestra.run.smithi099.stdout:client5714 2024-09-10T07:40:06.279 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d4ff4b75-2329-4b44-969c-780f31c4e94e.client5714/osdmap') 2024-09-10T07:40:06.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 128 barrier 128 flags 0x588000 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:osd0 (2)172.21.15.99:6800 100% (exists, up) 100% -1 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:osd1 (2)172.21.15.99:6810 100% (exists, up) 100% -1 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:osd2 (2)172.21.15.99:6808 100% (exists, up) 100% -1 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:osd3 (2)172.21.15.99:6818 100% (exists, up) 100% -1 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:osd4 (2)172.21.15.187:6824 100% (exists, up) 100% -1 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:osd5 (2)172.21.15.187:6800 100% (exists, up) 100% -1 2024-09-10T07:40:06.378 INFO:teuthology.orchestra.run.smithi099.stdout:osd6 (2)172.21.15.187:6808 100% (exists, up) 100% -1 2024-09-10T07:40:06.379 INFO:teuthology.orchestra.run.smithi099.stdout:osd7 (2)172.21.15.187:6811 100% (exists, up) 100% -1 2024-09-10T07:40:06.379 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records in 2024-09-10T07:40:06.379 INFO:teuthology.orchestra.run.smithi099.stderr:1+1 records out 2024-09-10T07:40:06.379 INFO:teuthology.orchestra.run.smithi099.stderr:799 bytes copied, 6.8826e-05 s, 11.6 MB/s 2024-09-10T07:40:06.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:06.388 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T07:40:06.388 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:40:06.389 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:40:06.496 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:40:06.580 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:40:06.580 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:40:06.581 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:06.581 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:06.616 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:06.617 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:06.694 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:40:06.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.889+0000 7f373fc00640 1 Processor -- start 2024-09-10T07:40:06.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.889+0000 7f373fc00640 1 -- start start 2024-09-10T07:40:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.890+0000 7f373fc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f37380b58e0 0x7f37380af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.890+0000 7f373fc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f373815f210 0x7f373815f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.890+0000 7f373fc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f373815ff70 con 0x7f37380d0080 2024-09-10T07:40:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.890+0000 7f373fc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f37380af990 con 0x7f37380b58e0 2024-09-10T07:40:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.890+0000 7f373fc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3738160250 con 0x7f373815f210 2024-09-10T07:40:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.891+0000 7f372fe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f37380b58e0 0x7f37380af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.891+0000 7f373dc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f373815f210 0x7f373815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.891+0000 7f373d200640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f37380d0080 0x7f37380b51d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:46948/0 (socket says 172.21.15.99:46948) 2024-09-10T07:40:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.891+0000 7f373d200640 1 -- 172.21.15.99:0/4176638183 learned_addr learned my addr 172.21.15.99:0/4176638183 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.892+0000 7f372fe00640 1 -- 172.21.15.99:0/4176638183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f373815f210 msgr2=0x7f373815f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:06.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.892+0000 7f372fe00640 1 --2- 172.21.15.99:0/4176638183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f373815f210 0x7f373815f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:06.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.892+0000 7f372fe00640 1 -- 172.21.15.99:0/4176638183 >> v1:172.21.15.187:6789/0 conn(0x7f37380d0080 legacy=0x7f37380b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:06.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.892+0000 7f372fe00640 1 -- 172.21.15.99:0/4176638183 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37380ae970 con 0x7f37380b58e0 2024-09-10T07:40:06.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.893+0000 7f372fe00640 1 --2- 172.21.15.99:0/4176638183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37380b58e0 0x7f37380af450 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f37200097a0 tx=0x7f372002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65c2e1b3a3d5c903 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:06.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.893+0000 7f3737e00640 1 -- 172.21.15.99:0/4176638183 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720037070 con 0x7f37380b58e0 2024-09-10T07:40:06.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.893+0000 7f3737e00640 1 -- 172.21.15.99:0/4176638183 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372002adb0 con 0x7f37380b58e0 2024-09-10T07:40:06.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.893+0000 7f3737e00640 1 -- 172.21.15.99:0/4176638183 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720032660 con 0x7f37380b58e0 2024-09-10T07:40:06.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.894+0000 7f373fc00640 1 -- 172.21.15.99:0/4176638183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37380b58e0 msgr2=0x7f37380af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:06.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.894+0000 7f373fc00640 1 --2- 172.21.15.99:0/4176638183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37380b58e0 0x7f37380af450 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f37200097a0 tx=0x7f372002a060 comp rx=0 tx=0).stop 2024-09-10T07:40:06.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.894+0000 7f373fc00640 1 -- 172.21.15.99:0/4176638183 shutdown_connections 2024-09-10T07:40:06.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.894+0000 7f373fc00640 1 --2- 172.21.15.99:0/4176638183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f373815f210 0x7f373815f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:06.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.894+0000 7f373fc00640 1 --2- 172.21.15.99:0/4176638183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37380b58e0 0x7f37380af450 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:06.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.894+0000 7f373fc00640 1 -- 172.21.15.99:0/4176638183 >> 172.21.15.99:0/4176638183 conn(0x7f37380b2630 msgr2=0x7f37380b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:06.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.894+0000 7f373fc00640 1 -- 172.21.15.99:0/4176638183 shutdown_connections 2024-09-10T07:40:06.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.894+0000 7f373fc00640 1 -- 172.21.15.99:0/4176638183 wait complete. 2024-09-10T07:40:06.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.895+0000 7f373fc00640 1 Processor -- start 2024-09-10T07:40:06.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.895+0000 7f373fc00640 1 -- start start 2024-09-10T07:40:06.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.896+0000 7f373fc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37380b58e0 0x7f3738150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:06.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.896+0000 7f373fc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37380d0080 0x7f37381f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:06.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.896+0000 7f373fc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f373815f210 0x7f37381f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:06.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.896+0000 7f373fc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f37380d0460 con 0x7f37380d0080 2024-09-10T07:40:06.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.896+0000 7f373fc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f37380aef30 con 0x7f37380b58e0 2024-09-10T07:40:06.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.896+0000 7f373fc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f373815fbc0 con 0x7f373815f210 2024-09-10T07:40:06.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f372fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37380d0080 0x7f37381f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:06.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f372fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37380d0080 0x7f37381f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37350/0 (socket says 172.21.15.99:37350) 2024-09-10T07:40:06.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f372fe00640 1 -- 172.21.15.99:0/3927297414 learned_addr learned my addr 172.21.15.99:0/3927297414 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:06.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f373dc00640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f373815f210 0x7f37381f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:06.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f373d200640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37380b58e0 0x7f3738150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:06.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f372fe00640 1 -- 172.21.15.99:0/3927297414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f373815f210 msgr2=0x7f37381f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:06.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f372fe00640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f373815f210 0x7f37381f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:06.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f372fe00640 1 -- 172.21.15.99:0/3927297414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37380b58e0 msgr2=0x7f3738150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:06.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f372fe00640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37380b58e0 0x7f3738150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:06.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f372fe00640 1 -- 172.21.15.99:0/3927297414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37381f5930 con 0x7f37380d0080 2024-09-10T07:40:06.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.897+0000 7f372fe00640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37380d0080 0x7f37381f4e00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3720035040 tx=0x7f37200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:06.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.898+0000 7f3735600640 1 -- 172.21.15.99:0/3927297414 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720041070 con 0x7f37380d0080 2024-09-10T07:40:06.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.898+0000 7f3735600640 1 -- 172.21.15.99:0/3927297414 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372003c680 con 0x7f37380d0080 2024-09-10T07:40:06.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.898+0000 7f373fc00640 1 -- 172.21.15.99:0/3927297414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37381f5c10 con 0x7f37380d0080 2024-09-10T07:40:06.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.898+0000 7f3735600640 1 -- 172.21.15.99:0/3927297414 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720037040 con 0x7f37380d0080 2024-09-10T07:40:06.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.898+0000 7f373fc00640 1 -- 172.21.15.99:0/3927297414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f373815d4f0 con 0x7f37380d0080 2024-09-10T07:40:06.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.899+0000 7f373fc00640 1 -- 172.21.15.99:0/3927297414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37380af450 con 0x7f37380d0080 2024-09-10T07:40:06.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.900+0000 7f3735600640 1 -- 172.21.15.99:0/3927297414 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f372003a070 con 0x7f37380d0080 2024-09-10T07:40:06.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.901+0000 7f3735600640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f371406be60 0x7f371406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:06.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.901+0000 7f3735600640 1 -- 172.21.15.99:0/3927297414 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f37200ab070 con 0x7f37380d0080 2024-09-10T07:40:06.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.901+0000 7f373d200640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f371406be60 0x7f371406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:06.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.901+0000 7f373d200640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f371406be60 0x7f371406e320 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3728007fd0 tx=0x7f3728007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:06.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:06.905+0000 7f3735600640 1 -- 172.21.15.99:0/3927297414 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37200794f0 con 0x7f37380d0080 2024-09-10T07:40:07.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.088+0000 7f373fc00640 1 -- 172.21.15.99:0/3927297414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f37380b5310 con 0x7f37380d0080 2024-09-10T07:40:07.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.089+0000 7f3735600640 1 -- 172.21.15.99:0/3927297414 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v128) ==== 80+0+0 (secure 0 0 0) 0x7f372007d7f0 con 0x7f37380d0080 2024-09-10T07:40:07.088 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:40:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 -- 172.21.15.99:0/3927297414 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f371406be60 msgr2=0x7f371406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f371406be60 0x7f371406e320 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3728007fd0 tx=0x7f3728007e80 comp rx=0 tx=0).stop 2024-09-10T07:40:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 -- 172.21.15.99:0/3927297414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37380d0080 msgr2=0x7f37381f4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37380d0080 0x7f37381f4e00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3720035040 tx=0x7f37200046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 -- 172.21.15.99:0/3927297414 shutdown_connections 2024-09-10T07:40:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f373815f210 0x7f37381f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f371406be60 0x7f371406e320 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37380d0080 0x7f37381f4e00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 --2- 172.21.15.99:0/3927297414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37380b58e0 0x7f3738150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 -- 172.21.15.99:0/3927297414 >> 172.21.15.99:0/3927297414 conn(0x7f37380b2630 msgr2=0x7f37380cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:07.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 -- 172.21.15.99:0/3927297414 shutdown_connections 2024-09-10T07:40:07.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.091+0000 7f373fc00640 1 -- 172.21.15.99:0/3927297414 wait complete. 2024-09-10T07:40:07.109 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:40:07.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:07.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:40:07.201 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:40:07.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:07.201 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:40:07.244 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:40:07.244 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:40:07.244 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:07.283 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:40:07.283 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:07.360 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:40:07.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.518+0000 7f6158800640 1 Processor -- start 2024-09-10T07:40:07.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.518+0000 7f6158800640 1 -- start start 2024-09-10T07:40:07.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6158800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f61500ce070 0x7f61500b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6158800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615015bfb0 0x7f615015d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6158800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f61500cf890 0x7f61500cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6158800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f61500ce450 con 0x7f61500ce070 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6158800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f615015c800 con 0x7f61500cf890 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6158800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f615015cae0 con 0x7f615015bfb0 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6155e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f61500ce070 0x7f61500b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6155e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f61500ce070 0x7f61500b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37366/0 (socket says 172.21.15.99:37366) 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6155e00640 1 -- 172.21.15.99:0/801427526 learned_addr learned my addr 172.21.15.99:0/801427526 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6156800640 1 --2- 172.21.15.99:0/801427526 >> v2:172.21.15.187:3300/0 conn(0x7f61500cf890 0x7f61500cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.519+0000 7f6155400640 1 --2- 172.21.15.99:0/801427526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615015bfb0 0x7f615015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.520+0000 7f6155e00640 1 -- 172.21.15.99:0/801427526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615015bfb0 msgr2=0x7f615015d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.520+0000 7f6155e00640 1 --2- 172.21.15.99:0/801427526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615015bfb0 0x7f615015d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.520+0000 7f6155e00640 1 -- 172.21.15.99:0/801427526 >> v2:172.21.15.187:3300/0 conn(0x7f61500cf890 msgr2=0x7f61500cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:07.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.520+0000 7f6155e00640 1 --2- 172.21.15.99:0/801427526 >> v2:172.21.15.187:3300/0 conn(0x7f61500cf890 0x7f61500cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.520+0000 7f6155e00640 1 -- 172.21.15.99:0/801427526 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615015cdc0 con 0x7f61500ce070 2024-09-10T07:40:07.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.520+0000 7f6156800640 1 --2- 172.21.15.99:0/801427526 >> v2:172.21.15.187:3300/0 conn(0x7f61500cf890 0x7f61500cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:07.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.521+0000 7f6155e00640 1 --2- 172.21.15.99:0/801427526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500ce070 0x7f61500b5750 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6150068910 tx=0x7f614402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96537243a79a3966 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:07.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.521+0000 7f6154a00640 1 -- 172.21.15.99:0/801427526 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144037070 con 0x7f61500ce070 2024-09-10T07:40:07.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.521+0000 7f6154a00640 1 -- 172.21.15.99:0/801427526 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6144032440 con 0x7f61500ce070 2024-09-10T07:40:07.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.521+0000 7f6154a00640 1 -- 172.21.15.99:0/801427526 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144032810 con 0x7f61500ce070 2024-09-10T07:40:07.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.522+0000 7f6158800640 1 -- 172.21.15.99:0/801427526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500ce070 msgr2=0x7f61500b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:07.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.522+0000 7f6158800640 1 --2- 172.21.15.99:0/801427526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500ce070 0x7f61500b5750 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6150068910 tx=0x7f614402a1e0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.522+0000 7f6158800640 1 -- 172.21.15.99:0/801427526 shutdown_connections 2024-09-10T07:40:07.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.522+0000 7f6158800640 1 --2- 172.21.15.99:0/801427526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f615015bfb0 0x7f615015d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.522+0000 7f6158800640 1 --2- 172.21.15.99:0/801427526 >> v2:172.21.15.187:3300/0 conn(0x7f61500cf890 0x7f61500cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.522+0000 7f6158800640 1 --2- 172.21.15.99:0/801427526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500ce070 0x7f61500b5750 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.522+0000 7f6158800640 1 -- 172.21.15.99:0/801427526 >> 172.21.15.99:0/801427526 conn(0x7f61500b2630 msgr2=0x7f61500b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:07.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.522+0000 7f6158800640 1 -- 172.21.15.99:0/801427526 shutdown_connections 2024-09-10T07:40:07.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.522+0000 7f6158800640 1 -- 172.21.15.99:0/801427526 wait complete. 2024-09-10T07:40:07.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.523+0000 7f6158800640 1 Processor -- start 2024-09-10T07:40:07.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.523+0000 7f6158800640 1 -- start start 2024-09-10T07:40:07.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.524+0000 7f6158800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61500ce070 0x7f61501462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:07.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.524+0000 7f6158800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500cf890 0x7f6150071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:07.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.524+0000 7f6158800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f615015bfb0 0x7f61501590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:07.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.524+0000 7f6158800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f615015d830 con 0x7f61500cf890 2024-09-10T07:40:07.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.524+0000 7f6158800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f615015d6b0 con 0x7f615015bfb0 2024-09-10T07:40:07.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.524+0000 7f6158800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f615006e080 con 0x7f61500ce070 2024-09-10T07:40:07.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6155400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500cf890 0x7f6150071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:07.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6155400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500cf890 0x7f6150071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37368/0 (socket says 172.21.15.99:37368) 2024-09-10T07:40:07.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6155400640 1 -- 172.21.15.99:0/999796317 learned_addr learned my addr 172.21.15.99:0/999796317 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:07.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6155e00640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61500ce070 0x7f61501462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:07.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6156800640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f615015bfb0 0x7f61501590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:07.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6155400640 1 -- 172.21.15.99:0/999796317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61500ce070 msgr2=0x7f61501462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:07.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6155400640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61500ce070 0x7f61501462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6155400640 1 -- 172.21.15.99:0/999796317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f615015bfb0 msgr2=0x7f61501590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:07.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6155400640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f615015bfb0 0x7f61501590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6155400640 1 -- 172.21.15.99:0/999796317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61500729e0 con 0x7f61500cf890 2024-09-10T07:40:07.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.525+0000 7f6155400640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500cf890 0x7f6150071f20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f614000d5d0 tx=0x7f614000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:07.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.528+0000 7f614a000640 1 -- 172.21.15.99:0/999796317 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140004240 con 0x7f61500cf890 2024-09-10T07:40:07.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.528+0000 7f614a000640 1 -- 172.21.15.99:0/999796317 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61400043e0 con 0x7f61500cf890 2024-09-10T07:40:07.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.528+0000 7f614a000640 1 -- 172.21.15.99:0/999796317 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140003830 con 0x7f61500cf890 2024-09-10T07:40:07.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.528+0000 7f6158800640 1 -- 172.21.15.99:0/999796317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6150072cc0 con 0x7f61500cf890 2024-09-10T07:40:07.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.528+0000 7f6158800640 1 -- 172.21.15.99:0/999796317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6150156860 con 0x7f61500cf890 2024-09-10T07:40:07.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.529+0000 7f6158800640 1 -- 172.21.15.99:0/999796317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61500d0420 con 0x7f61500cf890 2024-09-10T07:40:07.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.530+0000 7f614a000640 1 -- 172.21.15.99:0/999796317 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61400039d0 con 0x7f61500cf890 2024-09-10T07:40:07.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.531+0000 7f614a000640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f613406be30 0x7f613406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:07.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.531+0000 7f614a000640 1 -- 172.21.15.99:0/999796317 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f614008b0c0 con 0x7f61500cf890 2024-09-10T07:40:07.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.531+0000 7f6155e00640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f613406be30 0x7f613406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:07.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.532+0000 7f6155e00640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f613406be30 0x7f613406e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6144034000 tx=0x7f614402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:07.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.536+0000 7f614a000640 1 -- 172.21.15.99:0/999796317 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61400593a0 con 0x7f61500cf890 2024-09-10T07:40:07.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.718+0000 7f6158800640 1 -- 172.21.15.99:0/999796317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6150156c60 con 0x7f61500cf890 2024-09-10T07:40:07.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.719+0000 7f614a000640 1 -- 172.21.15.99:0/999796317 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v128) ==== 80+0+0 (secure 0 0 0) 0x7f614005d6a0 con 0x7f61500cf890 2024-09-10T07:40:07.719 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:40:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 -- 172.21.15.99:0/999796317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f613406be30 msgr2=0x7f613406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f613406be30 0x7f613406e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6144034000 tx=0x7f614402e000 comp rx=0 tx=0).stop 2024-09-10T07:40:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 -- 172.21.15.99:0/999796317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500cf890 msgr2=0x7f6150071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500cf890 0x7f6150071f20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f614000d5d0 tx=0x7f614000da90 comp rx=0 tx=0).stop 2024-09-10T07:40:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 -- 172.21.15.99:0/999796317 shutdown_connections 2024-09-10T07:40:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f615015bfb0 0x7f61501590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f613406be30 0x7f613406e2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61500cf890 0x7f6150071f20 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 --2- 172.21.15.99:0/999796317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61500ce070 0x7f61501462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 -- 172.21.15.99:0/999796317 >> 172.21.15.99:0/999796317 conn(0x7f61500b2630 msgr2=0x7f615006e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 -- 172.21.15.99:0/999796317 shutdown_connections 2024-09-10T07:40:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:07.721+0000 7f6158800640 1 -- 172.21.15.99:0/999796317 wait complete. 2024-09-10T07:40:07.737 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:40:07.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:07.737 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T07:40:07.803 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:40:07.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:07.803 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:40:07.839 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:40:07.840 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:07.840 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:07.875 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:40:07.875 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:40:07.875 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:40:07.875 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:07.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:40:07.916 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:08.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.069+0000 7f6e1aa00640 1 Processor -- start 2024-09-10T07:40:08.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.069+0000 7f6e1aa00640 1 -- start start 2024-09-10T07:40:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e1aa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6e1413fae0 0x7f6e1406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e1aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e14142150 0x7f6e14160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e1aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e14160a80 0x7f6e1415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e1aa00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6e140ce780 con 0x7f6e14142150 2024-09-10T07:40:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e1aa00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f6e14142650 con 0x7f6e1413fae0 2024-09-10T07:40:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e1aa00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6e14142930 con 0x7f6e14160a80 2024-09-10T07:40:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e13400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e14142150 0x7f6e14160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e13400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e14142150 0x7f6e14160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37378/0 (socket says 172.21.15.99:37378) 2024-09-10T07:40:08.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e13400640 1 -- 172.21.15.99:0/50648231 learned_addr learned my addr 172.21.15.99:0/50648231 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:08.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e13e00640 1 --2- 172.21.15.99:0/50648231 >> v2:172.21.15.187:3300/0 conn(0x7f6e1413fae0 0x7f6e1406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e18a00640 1 --2- 172.21.15.99:0/50648231 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e14160a80 0x7f6e1415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e13400640 1 -- 172.21.15.99:0/50648231 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e14160a80 msgr2=0x7f6e1415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:08.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.071+0000 7f6e13400640 1 --2- 172.21.15.99:0/50648231 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e14160a80 0x7f6e1415cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.072+0000 7f6e13400640 1 -- 172.21.15.99:0/50648231 >> v2:172.21.15.187:3300/0 conn(0x7f6e1413fae0 msgr2=0x7f6e1406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:08.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.072+0000 7f6e13400640 1 --2- 172.21.15.99:0/50648231 >> v2:172.21.15.187:3300/0 conn(0x7f6e1413fae0 0x7f6e1406f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.072+0000 7f6e13400640 1 -- 172.21.15.99:0/50648231 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e14142c10 con 0x7f6e14142150 2024-09-10T07:40:08.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.072+0000 7f6e13e00640 1 --2- 172.21.15.99:0/50648231 >> v2:172.21.15.187:3300/0 conn(0x7f6e1413fae0 0x7f6e1406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:40:08.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e13400640 1 --2- 172.21.15.99:0/50648231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14142150 0x7f6e14160540 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6e14050590 tx=0x7f6e0002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a512dc8b5e5197b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e12a00640 1 -- 172.21.15.99:0/50648231 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00037070 con 0x7f6e14142150 2024-09-10T07:40:08.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e12a00640 1 -- 172.21.15.99:0/50648231 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e00032440 con 0x7f6e14142150 2024-09-10T07:40:08.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e12a00640 1 -- 172.21.15.99:0/50648231 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00032810 con 0x7f6e14142150 2024-09-10T07:40:08.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e1aa00640 1 -- 172.21.15.99:0/50648231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14142150 msgr2=0x7f6e14160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e1aa00640 1 --2- 172.21.15.99:0/50648231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14142150 0x7f6e14160540 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6e14050590 tx=0x7f6e0002a140 comp rx=0 tx=0).stop 2024-09-10T07:40:08.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e1aa00640 1 -- 172.21.15.99:0/50648231 shutdown_connections 2024-09-10T07:40:08.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e1aa00640 1 --2- 172.21.15.99:0/50648231 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e14160a80 0x7f6e1415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e1aa00640 1 --2- 172.21.15.99:0/50648231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14142150 0x7f6e14160540 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e1aa00640 1 --2- 172.21.15.99:0/50648231 >> v2:172.21.15.187:3300/0 conn(0x7f6e1413fae0 0x7f6e1406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.073+0000 7f6e1aa00640 1 -- 172.21.15.99:0/50648231 >> 172.21.15.99:0/50648231 conn(0x7f6e1406bc10 msgr2=0x7f6e1406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:08.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.074+0000 7f6e1aa00640 1 -- 172.21.15.99:0/50648231 shutdown_connections 2024-09-10T07:40:08.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.074+0000 7f6e1aa00640 1 -- 172.21.15.99:0/50648231 wait complete. 2024-09-10T07:40:08.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.075+0000 7f6e1aa00640 1 Processor -- start 2024-09-10T07:40:08.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.075+0000 7f6e1aa00640 1 -- start start 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.076+0000 7f6e1aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1413fae0 0x7f6e14143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.076+0000 7f6e1aa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e14142150 0x7f6e14141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.076+0000 7f6e1aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14160a80 0x7f6e1413ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.076+0000 7f6e1aa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1406f870 con 0x7f6e14160a80 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.076+0000 7f6e1aa00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1406f6f0 con 0x7f6e14142150 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.076+0000 7f6e1aa00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1415d490 con 0x7f6e1413fae0 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.076+0000 7f6e18a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14160a80 0x7f6e1413ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.076+0000 7f6e18a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14160a80 0x7f6e1413ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37388/0 (socket says 172.21.15.99:37388) 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.076+0000 7f6e18a00640 1 -- 172.21.15.99:0/221009505 learned_addr learned my addr 172.21.15.99:0/221009505 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e13e00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1413fae0 0x7f6e14143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e13400640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e14142150 0x7f6e14141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e18a00640 1 -- 172.21.15.99:0/221009505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1413fae0 msgr2=0x7f6e14143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e18a00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1413fae0 0x7f6e14143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e18a00640 1 -- 172.21.15.99:0/221009505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e14142150 msgr2=0x7f6e14141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e18a00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e14142150 0x7f6e14141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e18a00640 1 -- 172.21.15.99:0/221009505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e14143a30 con 0x7f6e14160a80 2024-09-10T07:40:08.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e18a00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14160a80 0x7f6e1413ecb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00efc0 tx=0x7f6e0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e0be00640 1 -- 172.21.15.99:0/221009505 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c018020 con 0x7f6e14160a80 2024-09-10T07:40:08.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e0be00640 1 -- 172.21.15.99:0/221009505 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c014480 con 0x7f6e14160a80 2024-09-10T07:40:08.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e0be00640 1 -- 172.21.15.99:0/221009505 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c014870 con 0x7f6e14160a80 2024-09-10T07:40:08.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.077+0000 7f6e1aa00640 1 -- 172.21.15.99:0/221009505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e14143d10 con 0x7f6e14160a80 2024-09-10T07:40:08.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.078+0000 7f6e1aa00640 1 -- 172.21.15.99:0/221009505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e141442d0 con 0x7f6e14160a80 2024-09-10T07:40:08.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.079+0000 7f6e1aa00640 1 -- 172.21.15.99:0/221009505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e14160540 con 0x7f6e14160a80 2024-09-10T07:40:08.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.080+0000 7f6e0be00640 1 -- 172.21.15.99:0/221009505 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e0c005d10 con 0x7f6e14160a80 2024-09-10T07:40:08.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.080+0000 7f6e0be00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6df406be30 0x7f6df406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.080+0000 7f6e0be00640 1 -- 172.21.15.99:0/221009505 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f6e0c08b860 con 0x7f6e14160a80 2024-09-10T07:40:08.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.081+0000 7f6e13e00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6df406be30 0x7f6df406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.081+0000 7f6e13e00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6df406be30 0x7f6df406e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009560 tx=0x7f6e04009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.085+0000 7f6e0be00640 1 -- 172.21.15.99:0/221009505 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e0c022070 con 0x7f6e14160a80 2024-09-10T07:40:08.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.293+0000 7f6e1aa00640 1 -- 172.21.15.99:0/221009505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e14075620 con 0x7f6e14160a80 2024-09-10T07:40:08.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.293+0000 7f6e0be00640 1 -- 172.21.15.99:0/221009505 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7f6e0c010040 con 0x7f6e14160a80 2024-09-10T07:40:08.294 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":57,"btime":"2024-09-10T07:39:55:461034+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/269606175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":269606175},{"type":"v1","addr":"172.21.15.187:6834","nonce":269606175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2513906672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2513906672},{"type":"v1","addr":"172.21.15.187:6835","nonce":2513906672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3548731230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3548731230},{"type":"v1","addr":"172.21.15.99:6835","nonce":3548731230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:51.850274+0000","modified":"2024-09-10T07:39:54.867555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/106508261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":106508261},{"type":"v1","addr":"172.21.15.99:6837","nonce":106508261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6465,"qdb_cluster":[6465]},"id":7}]} 2024-09-10T07:40:08.294 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 57 2024-09-10T07:40:08.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.295+0000 7f6e1aa00640 1 -- 172.21.15.99:0/221009505 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6df406be30 msgr2=0x7f6df406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.295+0000 7f6e1aa00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6df406be30 0x7f6df406e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009560 tx=0x7f6e04009190 comp rx=0 tx=0).stop 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.295+0000 7f6e1aa00640 1 -- 172.21.15.99:0/221009505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14160a80 msgr2=0x7f6e1413ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.295+0000 7f6e1aa00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14160a80 0x7f6e1413ecb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00efc0 tx=0x7f6e0c00c490 comp rx=0 tx=0).stop 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.295+0000 7f6e1aa00640 1 -- 172.21.15.99:0/221009505 shutdown_connections 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.295+0000 7f6e1aa00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6df406be30 0x7f6df406e2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.295+0000 7f6e1aa00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14160a80 0x7f6e1413ecb0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.295+0000 7f6e1aa00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e14142150 0x7f6e14141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.295+0000 7f6e1aa00640 1 --2- 172.21.15.99:0/221009505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1413fae0 0x7f6e14143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.295+0000 7f6e1aa00640 1 -- 172.21.15.99:0/221009505 >> 172.21.15.99:0/221009505 conn(0x7f6e1406bc10 msgr2=0x7f6e1415f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.296+0000 7f6e1aa00640 1 -- 172.21.15.99:0/221009505 shutdown_connections 2024-09-10T07:40:08.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.296+0000 7f6e1aa00640 1 -- 172.21.15.99:0/221009505 wait complete. 2024-09-10T07:40:08.311 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:08.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.468+0000 7fe46bc00640 1 Processor -- start 2024-09-10T07:40:08.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.468+0000 7fe46bc00640 1 -- start start 2024-09-10T07:40:08.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.469+0000 7fe46bc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe464145290 0x7fe46406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.469+0000 7fe46bc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe4640ce780 0x7fe464072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.469+0000 7fe46bc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe464071510 0x7fe464072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.469+0000 7fe46bc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe46406efe0 con 0x7fe464145290 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.469+0000 7fe46bc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe46406e3d0 con 0x7fe4640ce780 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.469+0000 7fe46bc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe46406e6b0 con 0x7fe464071510 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.469+0000 7fe469200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe464145290 0x7fe46406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.469+0000 7fe469200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe464145290 0x7fe46406f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37398/0 (socket says 172.21.15.99:37398) 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.469+0000 7fe469200640 1 -- 172.21.15.99:0/3362743223 learned_addr learned my addr 172.21.15.99:0/3362743223 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.470+0000 7fe463e00640 1 --2- 172.21.15.99:0/3362743223 >> v2:172.21.15.187:3300/0 conn(0x7fe4640ce780 0x7fe464072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.470+0000 7fe469c00640 1 --2- 172.21.15.99:0/3362743223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe464071510 0x7fe464072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.470+0000 7fe469200640 1 -- 172.21.15.99:0/3362743223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe464071510 msgr2=0x7fe464072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.470+0000 7fe469200640 1 --2- 172.21.15.99:0/3362743223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe464071510 0x7fe464072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.470+0000 7fe469200640 1 -- 172.21.15.99:0/3362743223 >> v2:172.21.15.187:3300/0 conn(0x7fe4640ce780 msgr2=0x7fe464072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.470+0000 7fe469200640 1 --2- 172.21.15.99:0/3362743223 >> v2:172.21.15.187:3300/0 conn(0x7fe4640ce780 0x7fe464072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.470+0000 7fe469200640 1 -- 172.21.15.99:0/3362743223 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46406e990 con 0x7fe464145290 2024-09-10T07:40:08.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.471+0000 7fe469200640 1 --2- 172.21.15.99:0/3362743223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464145290 0x7fe46406f470 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe46406d450 tx=0x7fe45802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2f0f1c6e58720 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.471+0000 7fe463400640 1 -- 172.21.15.99:0/3362743223 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458032790 con 0x7fe464145290 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.471+0000 7fe463400640 1 -- 172.21.15.99:0/3362743223 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe458038070 con 0x7fe464145290 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.471+0000 7fe463400640 1 -- 172.21.15.99:0/3362743223 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458032b50 con 0x7fe464145290 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.472+0000 7fe46bc00640 1 -- 172.21.15.99:0/3362743223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464145290 msgr2=0x7fe46406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.472+0000 7fe46bc00640 1 --2- 172.21.15.99:0/3362743223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464145290 0x7fe46406f470 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe46406d450 tx=0x7fe45802c890 comp rx=0 tx=0).stop 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.472+0000 7fe46bc00640 1 -- 172.21.15.99:0/3362743223 shutdown_connections 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.472+0000 7fe46bc00640 1 --2- 172.21.15.99:0/3362743223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe464071510 0x7fe464072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.472+0000 7fe46bc00640 1 --2- 172.21.15.99:0/3362743223 >> v2:172.21.15.187:3300/0 conn(0x7fe4640ce780 0x7fe464072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.472+0000 7fe46bc00640 1 --2- 172.21.15.99:0/3362743223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464145290 0x7fe46406f470 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.472+0000 7fe46bc00640 1 -- 172.21.15.99:0/3362743223 >> 172.21.15.99:0/3362743223 conn(0x7fe46406bc10 msgr2=0x7fe46406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.472+0000 7fe46bc00640 1 -- 172.21.15.99:0/3362743223 shutdown_connections 2024-09-10T07:40:08.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.472+0000 7fe46bc00640 1 -- 172.21.15.99:0/3362743223 wait complete. 2024-09-10T07:40:08.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.473+0000 7fe46bc00640 1 Processor -- start 2024-09-10T07:40:08.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.473+0000 7fe46bc00640 1 -- start start 2024-09-10T07:40:08.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.474+0000 7fe46bc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464071510 0x7fe464138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.474+0000 7fe46bc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4640ce780 0x7fe464139530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.474+0000 7fe46bc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe464145290 0x7fe464158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.474+0000 7fe46bc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe46406df80 con 0x7fe464071510 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.474+0000 7fe46bc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe464145670 con 0x7fe4640ce780 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.474+0000 7fe46bc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe46406e100 con 0x7fe464145290 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.474+0000 7fe469200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464071510 0x7fe464138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe469200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464071510 0x7fe464138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37406/0 (socket says 172.21.15.99:37406) 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe469200640 1 -- 172.21.15.99:0/3105051745 learned_addr learned my addr 172.21.15.99:0/3105051745 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe463e00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4640ce780 0x7fe464139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe469c00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe464145290 0x7fe464158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe469200640 1 -- 172.21.15.99:0/3105051745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe464145290 msgr2=0x7fe464158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe469200640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe464145290 0x7fe464158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe469200640 1 -- 172.21.15.99:0/3105051745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4640ce780 msgr2=0x7fe464139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe469200640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4640ce780 0x7fe464139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe469200640 1 -- 172.21.15.99:0/3105051745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe464145cb0 con 0x7fe464071510 2024-09-10T07:40:08.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe469200640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464071510 0x7fe464138690 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe458000c00 tx=0x7fe458004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.475+0000 7fe460c00640 1 -- 172.21.15.99:0/3105051745 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458043070 con 0x7fe464071510 2024-09-10T07:40:08.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.476+0000 7fe460c00640 1 -- 172.21.15.99:0/3105051745 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45803c640 con 0x7fe464071510 2024-09-10T07:40:08.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.476+0000 7fe46bc00640 1 -- 172.21.15.99:0/3105051745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe464145f90 con 0x7fe464071510 2024-09-10T07:40:08.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.476+0000 7fe460c00640 1 -- 172.21.15.99:0/3105051745 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45803ca30 con 0x7fe464071510 2024-09-10T07:40:08.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.476+0000 7fe46bc00640 1 -- 172.21.15.99:0/3105051745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe464146550 con 0x7fe464071510 2024-09-10T07:40:08.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.477+0000 7fe46bc00640 1 -- 172.21.15.99:0/3105051745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46406f470 con 0x7fe464071510 2024-09-10T07:40:08.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.478+0000 7fe460c00640 1 -- 172.21.15.99:0/3105051745 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe458046070 con 0x7fe464071510 2024-09-10T07:40:08.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.478+0000 7fe460c00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe44406be30 0x7fe44406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.479+0000 7fe460c00640 1 -- 172.21.15.99:0/3105051745 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fe4580ab260 con 0x7fe464071510 2024-09-10T07:40:08.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.479+0000 7fe463e00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe44406be30 0x7fe44406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.479+0000 7fe463e00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe44406be30 0x7fe44406e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe4640b1a30 tx=0x7fe450008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.483+0000 7fe460c00640 1 -- 172.21.15.99:0/3105051745 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe458079650 con 0x7fe464071510 2024-09-10T07:40:08.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.691+0000 7fe46bc00640 1 -- 172.21.15.99:0/3105051745 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe46413d3d0 con 0x7fe464071510 2024-09-10T07:40:08.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.692+0000 7fe460c00640 1 -- 172.21.15.99:0/3105051745 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7fe45807d950 con 0x7fe464071510 2024-09-10T07:40:08.692 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:08.692 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":57,"btime":"2024-09-10T07:39:55:461034+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/269606175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":269606175},{"type":"v1","addr":"172.21.15.187:6834","nonce":269606175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2513906672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2513906672},{"type":"v1","addr":"172.21.15.187:6835","nonce":2513906672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3548731230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3548731230},{"type":"v1","addr":"172.21.15.99:6835","nonce":3548731230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:51.850274+0000","modified":"2024-09-10T07:39:54.867555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/106508261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":106508261},{"type":"v1","addr":"172.21.15.99:6837","nonce":106508261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6465,"qdb_cluster":[6465]},"id":7}]} 2024-09-10T07:40:08.693 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 57 2024-09-10T07:40:08.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 -- 172.21.15.99:0/3105051745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe44406be30 msgr2=0x7fe44406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe44406be30 0x7fe44406e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe4640b1a30 tx=0x7fe450008040 comp rx=0 tx=0).stop 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 -- 172.21.15.99:0/3105051745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464071510 msgr2=0x7fe464138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464071510 0x7fe464138690 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe458000c00 tx=0x7fe458004730 comp rx=0 tx=0).stop 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 -- 172.21.15.99:0/3105051745 shutdown_connections 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe464145290 0x7fe464158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4640ce780 0x7fe464139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe44406be30 0x7fe44406e2f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 --2- 172.21.15.99:0/3105051745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe464071510 0x7fe464138690 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 -- 172.21.15.99:0/3105051745 >> 172.21.15.99:0/3105051745 conn(0x7fe46406bc10 msgr2=0x7fe4640b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.694+0000 7fe46bc00640 1 -- 172.21.15.99:0/3105051745 shutdown_connections 2024-09-10T07:40:08.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.695+0000 7fe46bc00640 1 -- 172.21.15.99:0/3105051745 wait complete. 2024-09-10T07:40:08.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:40:08.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.864+0000 7f17f9c00640 1 Processor -- start 2024-09-10T07:40:08.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.864+0000 7f17f9c00640 1 -- start start 2024-09-10T07:40:08.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.865+0000 7f17f9c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f17f415e970 0x7f17f40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.865+0000 7f17f9c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f40d2680 0x7f17f40cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.865+0000 7f17f9c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17f40cfac0 0x7f17f40d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.865+0000 7f17f9c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f17f40d37e0 con 0x7f17f40cfac0 2024-09-10T07:40:08.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.865+0000 7f17f9c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f17f40d2bd0 con 0x7f17f415e970 2024-09-10T07:40:08.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.865+0000 7f17f9c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40d2eb0 con 0x7f17f40d2680 2024-09-10T07:40:08.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.865+0000 7f17f9200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17f40cfac0 0x7f17f40d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.865+0000 7f17f9200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17f40cfac0 0x7f17f40d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37414/0 (socket says 172.21.15.99:37414) 2024-09-10T07:40:08.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.865+0000 7f17f9200640 1 -- 172.21.15.99:0/2468951507 learned_addr learned my addr 172.21.15.99:0/2468951507 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:08.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.866+0000 7f17f3400640 1 --2- 172.21.15.99:0/2468951507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f40d2680 0x7f17f40cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.866+0000 7f17f3e00640 1 --2- 172.21.15.99:0/2468951507 >> v2:172.21.15.187:3300/0 conn(0x7f17f415e970 0x7f17f40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.866+0000 7f17f9200640 1 -- 172.21.15.99:0/2468951507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f40d2680 msgr2=0x7f17f40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:08.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.866+0000 7f17f9200640 1 --2- 172.21.15.99:0/2468951507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f40d2680 0x7f17f40cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.866+0000 7f17f9200640 1 -- 172.21.15.99:0/2468951507 >> v2:172.21.15.187:3300/0 conn(0x7f17f415e970 msgr2=0x7f17f40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:08.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.866+0000 7f17f9200640 1 --2- 172.21.15.99:0/2468951507 >> v2:172.21.15.187:3300/0 conn(0x7f17f415e970 0x7f17f40d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.866+0000 7f17f9200640 1 -- 172.21.15.99:0/2468951507 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f40d3190 con 0x7f17f40cfac0 2024-09-10T07:40:08.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.866+0000 7f17f3e00640 1 --2- 172.21.15.99:0/2468951507 >> v2:172.21.15.187:3300/0 conn(0x7f17f415e970 0x7f17f40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:08.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.867+0000 7f17f9200640 1 --2- 172.21.15.99:0/2468951507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f40cfac0 0x7f17f40d0ff0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f17f406c1c0 tx=0x7f17ec02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e2dbd0ca1190a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.867+0000 7f17f2a00640 1 -- 172.21.15.99:0/2468951507 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec036070 con 0x7f17f40cfac0 2024-09-10T07:40:08.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.867+0000 7f17f2a00640 1 -- 172.21.15.99:0/2468951507 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec031600 con 0x7f17f40cfac0 2024-09-10T07:40:08.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.867+0000 7f17f2a00640 1 -- 172.21.15.99:0/2468951507 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0319d0 con 0x7f17f40cfac0 2024-09-10T07:40:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.868+0000 7f17f9c00640 1 -- 172.21.15.99:0/2468951507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f40cfac0 msgr2=0x7f17f40d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.868+0000 7f17f9c00640 1 --2- 172.21.15.99:0/2468951507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f40cfac0 0x7f17f40d0ff0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f17f406c1c0 tx=0x7f17ec02a730 comp rx=0 tx=0).stop 2024-09-10T07:40:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.868+0000 7f17f9c00640 1 -- 172.21.15.99:0/2468951507 shutdown_connections 2024-09-10T07:40:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.868+0000 7f17f9c00640 1 --2- 172.21.15.99:0/2468951507 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f40d2680 0x7f17f40cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.868+0000 7f17f9c00640 1 --2- 172.21.15.99:0/2468951507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f40cfac0 0x7f17f40d0ff0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.868+0000 7f17f9c00640 1 --2- 172.21.15.99:0/2468951507 >> v2:172.21.15.187:3300/0 conn(0x7f17f415e970 0x7f17f40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.868+0000 7f17f9c00640 1 -- 172.21.15.99:0/2468951507 >> 172.21.15.99:0/2468951507 conn(0x7f17f409de00 msgr2=0x7f17f40d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.868+0000 7f17f9c00640 1 -- 172.21.15.99:0/2468951507 shutdown_connections 2024-09-10T07:40:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.868+0000 7f17f9c00640 1 -- 172.21.15.99:0/2468951507 wait complete. 2024-09-10T07:40:08.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.870+0000 7f17f9c00640 1 Processor -- start 2024-09-10T07:40:08.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.870+0000 7f17f9c00640 1 -- start start 2024-09-10T07:40:08.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.870+0000 7f17f9c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f40cfac0 0x7f17f40ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.870+0000 7f17f9c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f40d2680 0x7f17f415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f415e970 0x7f17f415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40d0840 con 0x7f17f415e970 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40cff70 con 0x7f17f40d2680 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f17f415ed50 con 0x7f17f40cfac0 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f415e970 0x7f17f415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f415e970 0x7f17f415ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37416/0 (socket says 172.21.15.99:37416) 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9200640 1 -- 172.21.15.99:0/3428603685 learned_addr learned my addr 172.21.15.99:0/3428603685 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9200640 1 -- 172.21.15.99:0/3428603685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f40cfac0 msgr2=0x7f17f40ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f3400640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f40d2680 0x7f17f415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f3e00640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f40cfac0 0x7f17f40ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9200640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f40cfac0 0x7f17f40ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9200640 1 -- 172.21.15.99:0/3428603685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f40d2680 msgr2=0x7f17f415a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:08.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9200640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f40d2680 0x7f17f415a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:08.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f9200640 1 -- 172.21.15.99:0/3428603685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f415b450 con 0x7f17f415e970 2024-09-10T07:40:08.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.871+0000 7f17f3400640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f40d2680 0x7f17f415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:08.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.872+0000 7f17f9200640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f415e970 0x7f17f415ae10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f17ec02ad20 tx=0x7f17ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.872+0000 7f17ebe00640 1 -- 172.21.15.99:0/3428603685 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec03f020 con 0x7f17f415e970 2024-09-10T07:40:08.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.872+0000 7f17ebe00640 1 -- 172.21.15.99:0/3428603685 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec037040 con 0x7f17f415e970 2024-09-10T07:40:08.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.872+0000 7f17f9c00640 1 -- 172.21.15.99:0/3428603685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f41f4630 con 0x7f17f415e970 2024-09-10T07:40:08.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.872+0000 7f17ebe00640 1 -- 172.21.15.99:0/3428603685 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec036070 con 0x7f17f415e970 2024-09-10T07:40:08.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.872+0000 7f17f9c00640 1 -- 172.21.15.99:0/3428603685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f40cebc0 con 0x7f17f415e970 2024-09-10T07:40:08.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.873+0000 7f17f9c00640 1 -- 172.21.15.99:0/3428603685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f40cf580 con 0x7f17f415e970 2024-09-10T07:40:08.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.874+0000 7f17ebe00640 1 -- 172.21.15.99:0/3428603685 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17ec042020 con 0x7f17f415e970 2024-09-10T07:40:08.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.875+0000 7f17ebe00640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f17d406be30 0x7f17d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:08.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.875+0000 7f17ebe00640 1 -- 172.21.15.99:0/3428603685 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f17ec0ab540 con 0x7f17f415e970 2024-09-10T07:40:08.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.875+0000 7f17f3e00640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f17d406be30 0x7f17d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:08.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.876+0000 7f17f3e00640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f17d406be30 0x7f17d406e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f17e4006fd0 tx=0x7f17e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:08.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:08.879+0000 7f17ebe00640 1 -- 172.21.15.99:0/3428603685 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17ec049020 con 0x7f17f415e970 2024-09-10T07:40:09.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.056+0000 7f17f9c00640 1 -- 172.21.15.99:0/3428603685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17f40caec0 con 0x7f17f415e970 2024-09-10T07:40:09.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.057+0000 7f17ebe00640 1 -- 172.21.15.99:0/3428603685 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16663 (secure 0 0 0) 0x7f17ec079ef0 con 0x7f17f415e970 2024-09-10T07:40:09.058 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:09.058 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":128,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:40:04.513536+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:39:49.623236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T07:39:50.847068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:40:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 -- 172.21.15.99:0/3428603685 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f17d406be30 msgr2=0x7f17d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f17d406be30 0x7f17d406e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f17e4006fd0 tx=0x7f17e4008040 comp rx=0 tx=0).stop 2024-09-10T07:40:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 -- 172.21.15.99:0/3428603685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f415e970 msgr2=0x7f17f415ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f415e970 0x7f17f415ae10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f17ec02ad20 tx=0x7f17ec004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 -- 172.21.15.99:0/3428603685 shutdown_connections 2024-09-10T07:40:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f17d406be30 0x7f17d406e2f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f415e970 0x7f17f415ae10 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f40d2680 0x7f17f415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 --2- 172.21.15.99:0/3428603685 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f40cfac0 0x7f17f40ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 -- 172.21.15.99:0/3428603685 >> 172.21.15.99:0/3428603685 conn(0x7f17f409de00 msgr2=0x7f17f40c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 -- 172.21.15.99:0/3428603685 shutdown_connections 2024-09-10T07:40:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.059+0000 7f17f9c00640 1 -- 172.21.15.99:0/3428603685 wait complete. 2024-09-10T07:40:09.075 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:40:09.075 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:09.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.226+0000 7f57a7000640 1 Processor -- start 2024-09-10T07:40:09.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.226+0000 7f57a7000640 1 -- start start 2024-09-10T07:40:09.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a7000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f57a0145290 0x7f57a006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a7000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f57a0072f40 0x7f57a00b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a7000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57a006e3d0 con 0x7f57a00ce780 2024-09-10T07:40:09.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a7000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f57a006efe0 con 0x7f57a0072f40 2024-09-10T07:40:09.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a7000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f57a006e6b0 con 0x7f57a0145290 2024-09-10T07:40:09.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a5000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f57a0072f40 0x7f57a00b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a5000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f57a0072f40 0x7f57a00b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37420/0 (socket says 172.21.15.99:37420) 2024-09-10T07:40:09.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a5000640 1 -- 172.21.15.99:0/673948910 learned_addr learned my addr 172.21.15.99:0/673948910 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:09.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f579f400640 1 --1- 172.21.15.99:0/673948910 >> v1:172.21.15.99:6789/0 conn(0x7f57a00ce780 0x7f57a0072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55956/0 (socket says 172.21.15.99:55956) 2024-09-10T07:40:09.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f579fe00640 1 --2- 172.21.15.99:0/673948910 >> v2:172.21.15.187:3300/0 conn(0x7f57a0145290 0x7f57a006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a5000640 1 -- 172.21.15.99:0/673948910 >> v2:172.21.15.187:3300/0 conn(0x7f57a0145290 msgr2=0x7f57a006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:09.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a5000640 1 --2- 172.21.15.99:0/673948910 >> v2:172.21.15.187:3300/0 conn(0x7f57a0145290 0x7f57a006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a5000640 1 -- 172.21.15.99:0/673948910 >> v1:172.21.15.99:6789/0 conn(0x7f57a00ce780 legacy=0x7f57a0072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.228+0000 7f57a5000640 1 -- 172.21.15.99:0/673948910 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a006e990 con 0x7f57a0072f40 2024-09-10T07:40:09.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.229+0000 7f57a5000640 1 --2- 172.21.15.99:0/673948910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a0072f40 0x7f57a00b3930 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f57a0075940 tx=0x7f579802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7804cd6926ab282 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:09.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f579ea00640 1 -- 172.21.15.99:0/673948910 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5798036070 con 0x7f57a0072f40 2024-09-10T07:40:09.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f579ea00640 1 -- 172.21.15.99:0/673948910 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5798031600 con 0x7f57a0072f40 2024-09-10T07:40:09.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f579ea00640 1 -- 172.21.15.99:0/673948910 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57980319d0 con 0x7f57a0072f40 2024-09-10T07:40:09.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f57a7000640 1 -- 172.21.15.99:0/673948910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a0072f40 msgr2=0x7f57a00b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f57a7000640 1 --2- 172.21.15.99:0/673948910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a0072f40 0x7f57a00b3930 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f57a0075940 tx=0x7f579802a730 comp rx=0 tx=0).stop 2024-09-10T07:40:09.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f57a7000640 1 -- 172.21.15.99:0/673948910 shutdown_connections 2024-09-10T07:40:09.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f57a7000640 1 --2- 172.21.15.99:0/673948910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a0072f40 0x7f57a00b3930 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f57a7000640 1 --2- 172.21.15.99:0/673948910 >> v2:172.21.15.187:3300/0 conn(0x7f57a0145290 0x7f57a006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f57a7000640 1 -- 172.21.15.99:0/673948910 >> 172.21.15.99:0/673948910 conn(0x7f57a006bc10 msgr2=0x7f57a006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:09.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f57a7000640 1 -- 172.21.15.99:0/673948910 shutdown_connections 2024-09-10T07:40:09.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.230+0000 7f57a7000640 1 -- 172.21.15.99:0/673948910 wait complete. 2024-09-10T07:40:09.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.232+0000 7f57a7000640 1 Processor -- start 2024-09-10T07:40:09.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.232+0000 7f57a7000640 1 -- start start 2024-09-10T07:40:09.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.233+0000 7f57a7000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a0072f40 0x7f57a01f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.233+0000 7f57a7000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a00ce780 0x7f57a015d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.233+0000 7f57a7000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a0145290 0x7f57a013ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.233+0000 7f57a7000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f57a006df80 con 0x7f57a00ce780 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.233+0000 7f57a7000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f57a0145670 con 0x7f57a0072f40 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.233+0000 7f57a7000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f57a006e100 con 0x7f57a0145290 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.233+0000 7f579f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a00ce780 0x7f57a015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.233+0000 7f579f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a00ce780 0x7f57a015d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37428/0 (socket says 172.21.15.99:37428) 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.233+0000 7f579f400640 1 -- 172.21.15.99:0/1872838094 learned_addr learned my addr 172.21.15.99:0/1872838094 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f579fe00640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a0072f40 0x7f57a01f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f57a5000640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a0145290 0x7f57a013ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f579f400640 1 -- 172.21.15.99:0/1872838094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a0145290 msgr2=0x7f57a013ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f579f400640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a0145290 0x7f57a013ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f579f400640 1 -- 172.21.15.99:0/1872838094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a0072f40 msgr2=0x7f57a01f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f579f400640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a0072f40 0x7f57a01f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f579f400640 1 -- 172.21.15.99:0/1872838094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a013c320 con 0x7f57a00ce780 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f57a5000640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a0145290 0x7f57a013ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f579f400640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a00ce780 0x7f57a015d260 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f578c00c440 tx=0x7f578c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f5797e00640 1 -- 172.21.15.99:0/1872838094 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c017070 con 0x7f57a00ce780 2024-09-10T07:40:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f5797e00640 1 -- 172.21.15.99:0/1872838094 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578c0064e0 con 0x7f57a00ce780 2024-09-10T07:40:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f57a7000640 1 -- 172.21.15.99:0/1872838094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a013b770 con 0x7f57a00ce780 2024-09-10T07:40:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f5797e00640 1 -- 172.21.15.99:0/1872838094 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c0049c0 con 0x7f57a00ce780 2024-09-10T07:40:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.234+0000 7f57a7000640 1 -- 172.21.15.99:0/1872838094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a013c9a0 con 0x7f57a00ce780 2024-09-10T07:40:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.235+0000 7f57a7000640 1 -- 172.21.15.99:0/1872838094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a0071510 con 0x7f57a00ce780 2024-09-10T07:40:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.236+0000 7f5797e00640 1 -- 172.21.15.99:0/1872838094 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f578c01a070 con 0x7f57a00ce780 2024-09-10T07:40:09.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.237+0000 7f5797e00640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f578006be30 0x7f578006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.237+0000 7f5797e00640 1 -- 172.21.15.99:0/1872838094 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f578c08a100 con 0x7f57a00ce780 2024-09-10T07:40:09.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.237+0000 7f579fe00640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f578006be30 0x7f578006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.238+0000 7f579fe00640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f578006be30 0x7f578006e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5790006fd0 tx=0x7f5790008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:09.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.241+0000 7f5797e00640 1 -- 172.21.15.99:0/1872838094 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f578c058450 con 0x7f57a00ce780 2024-09-10T07:40:09.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.449+0000 7f57a7000640 1 -- 172.21.15.99:0/1872838094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57a00b1650 con 0x7f57a00ce780 2024-09-10T07:40:09.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.449+0000 7f5797e00640 1 -- 172.21.15.99:0/1872838094 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7f578c05c750 con 0x7f57a00ce780 2024-09-10T07:40:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:09.449 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":57,"btime":"2024-09-10T07:39:55:461034+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/269606175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":269606175},{"type":"v1","addr":"172.21.15.187:6834","nonce":269606175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2513906672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2513906672},{"type":"v1","addr":"172.21.15.187:6835","nonce":2513906672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3548731230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3548731230},{"type":"v1","addr":"172.21.15.99:6835","nonce":3548731230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:51.850274+0000","modified":"2024-09-10T07:39:54.867555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/106508261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":106508261},{"type":"v1","addr":"172.21.15.99:6837","nonce":106508261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6465,"qdb_cluster":[6465]},"id":7}]} 2024-09-10T07:40:09.450 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 57 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.451+0000 7f57a7000640 1 -- 172.21.15.99:0/1872838094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f578006be30 msgr2=0x7f578006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.451+0000 7f57a7000640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f578006be30 0x7f578006e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5790006fd0 tx=0x7f5790008040 comp rx=0 tx=0).stop 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.451+0000 7f57a7000640 1 -- 172.21.15.99:0/1872838094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a00ce780 msgr2=0x7f57a015d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.451+0000 7f57a7000640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a00ce780 0x7f57a015d260 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f578c00c440 tx=0x7f578c001e70 comp rx=0 tx=0).stop 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.452+0000 7f57a7000640 1 -- 172.21.15.99:0/1872838094 shutdown_connections 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.452+0000 7f57a7000640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a0145290 0x7f57a013ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.452+0000 7f57a7000640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f578006be30 0x7f578006e2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.452+0000 7f57a7000640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a00ce780 0x7f57a015d260 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.452+0000 7f57a7000640 1 --2- 172.21.15.99:0/1872838094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a0072f40 0x7f57a01f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.452+0000 7f57a7000640 1 -- 172.21.15.99:0/1872838094 >> 172.21.15.99:0/1872838094 conn(0x7f57a006bc10 msgr2=0x7f57a015e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.452+0000 7f57a7000640 1 -- 172.21.15.99:0/1872838094 shutdown_connections 2024-09-10T07:40:09.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.452+0000 7f57a7000640 1 -- 172.21.15.99:0/1872838094 wait complete. 2024-09-10T07:40:09.468 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:09.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.624+0000 7f2a53800640 1 Processor -- start 2024-09-10T07:40:09.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.625+0000 7f2a53800640 1 -- start start 2024-09-10T07:40:09.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.626+0000 7f2a53800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 0x7f2a4c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.626+0000 7f2a53800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2a4c160c50 0x7f2a4c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.626+0000 7f2a53800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a4c142650 con 0x7f2a4c142150 2024-09-10T07:40:09.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.626+0000 7f2a53800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f2a4c0ce780 con 0x7f2a4c160c50 2024-09-10T07:40:09.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.626+0000 7f2a53800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4c142930 con 0x7f2a4c13fae0 2024-09-10T07:40:09.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.626+0000 7f2a51800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2a4c160c50 0x7f2a4c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.626+0000 7f2a50e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 0x7f2a4c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.626+0000 7f2a50e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 0x7f2a4c06f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:50450/0 (socket says 172.21.15.99:50450) 2024-09-10T07:40:09.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.626+0000 7f2a50e00640 1 -- 172.21.15.99:0/3491640696 learned_addr learned my addr 172.21.15.99:0/3491640696 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:09.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.626+0000 7f2a51800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2a4c160c50 0x7f2a4c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:53164/0 (socket says 172.21.15.99:53164) 2024-09-10T07:40:09.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.627+0000 7f2a50e00640 1 -- 172.21.15.99:0/3491640696 >> v2:172.21.15.187:3300/0 conn(0x7f2a4c160c50 msgr2=0x7f2a4c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:09.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.627+0000 7f2a50e00640 1 --2- 172.21.15.99:0/3491640696 >> v2:172.21.15.187:3300/0 conn(0x7f2a4c160c50 0x7f2a4c0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.627+0000 7f2a50e00640 1 -- 172.21.15.99:0/3491640696 >> v1:172.21.15.187:6789/0 conn(0x7f2a4c142150 legacy=0x7f2a4c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.627+0000 7f2a50e00640 1 -- 172.21.15.99:0/3491640696 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c142c10 con 0x7f2a4c13fae0 2024-09-10T07:40:09.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.628+0000 7f2a50e00640 1 --2- 172.21.15.99:0/3491640696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 0x7f2a4c06f1b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009870 tx=0x7f2a3c02a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a177a7a167608a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:09.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.628+0000 7f2a4be00640 1 -- 172.21.15.99:0/3491640696 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c037070 con 0x7f2a4c13fae0 2024-09-10T07:40:09.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.628+0000 7f2a4be00640 1 -- 172.21.15.99:0/3491640696 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a3c032440 con 0x7f2a4c13fae0 2024-09-10T07:40:09.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.628+0000 7f2a4be00640 1 -- 172.21.15.99:0/3491640696 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c032810 con 0x7f2a4c13fae0 2024-09-10T07:40:09.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.629+0000 7f2a53800640 1 -- 172.21.15.99:0/3491640696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 msgr2=0x7f2a4c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.629+0000 7f2a53800640 1 --2- 172.21.15.99:0/3491640696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 0x7f2a4c06f1b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009870 tx=0x7f2a3c02a1d0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.629+0000 7f2a53800640 1 -- 172.21.15.99:0/3491640696 shutdown_connections 2024-09-10T07:40:09.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.629+0000 7f2a53800640 1 --2- 172.21.15.99:0/3491640696 >> v2:172.21.15.187:3300/0 conn(0x7f2a4c160c50 0x7f2a4c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.629+0000 7f2a53800640 1 --2- 172.21.15.99:0/3491640696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 0x7f2a4c06f1b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.629+0000 7f2a53800640 1 -- 172.21.15.99:0/3491640696 >> 172.21.15.99:0/3491640696 conn(0x7f2a4c06bc10 msgr2=0x7f2a4c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:09.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.629+0000 7f2a53800640 1 -- 172.21.15.99:0/3491640696 shutdown_connections 2024-09-10T07:40:09.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.629+0000 7f2a53800640 1 -- 172.21.15.99:0/3491640696 wait complete. 2024-09-10T07:40:09.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.631+0000 7f2a53800640 1 Processor -- start 2024-09-10T07:40:09.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.631+0000 7f2a53800640 1 -- start start 2024-09-10T07:40:09.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a53800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 0x7f2a4c1f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a53800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c142150 0x7f2a4c0b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a53800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c160c50 0x7f2a4c13e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a53800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c06f870 con 0x7f2a4c160c50 2024-09-10T07:40:09.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a53800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c06f6f0 con 0x7f2a4c142150 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a53800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4c0cf150 con 0x7f2a4c13fae0 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a51800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c160c50 0x7f2a4c13e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a51800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c160c50 0x7f2a4c13e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37434/0 (socket says 172.21.15.99:37434) 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a51800640 1 -- 172.21.15.99:0/2293402536 learned_addr learned my addr 172.21.15.99:0/2293402536 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a50e00640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 0x7f2a4c1f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a43e00640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c142150 0x7f2a4c0b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a51800640 1 -- 172.21.15.99:0/2293402536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 msgr2=0x7f2a4c1f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a51800640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 0x7f2a4c1f8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a51800640 1 -- 172.21.15.99:0/2293402536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c142150 msgr2=0x7f2a4c0b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a51800640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c142150 0x7f2a4c0b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.632+0000 7f2a51800640 1 -- 172.21.15.99:0/2293402536 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c1f8c30 con 0x7f2a4c160c50 2024-09-10T07:40:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.633+0000 7f2a51800640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c160c50 0x7f2a4c13e1e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400ef90 tx=0x7f2a4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:09.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.633+0000 7f2a49600640 1 -- 172.21.15.99:0/2293402536 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44018020 con 0x7f2a4c160c50 2024-09-10T07:40:09.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.633+0000 7f2a49600640 1 -- 172.21.15.99:0/2293402536 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a44014480 con 0x7f2a4c160c50 2024-09-10T07:40:09.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.633+0000 7f2a53800640 1 -- 172.21.15.99:0/2293402536 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4c1f8f10 con 0x7f2a4c160c50 2024-09-10T07:40:09.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.633+0000 7f2a49600640 1 -- 172.21.15.99:0/2293402536 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44009e60 con 0x7f2a4c160c50 2024-09-10T07:40:09.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.633+0000 7f2a53800640 1 -- 172.21.15.99:0/2293402536 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4c13e720 con 0x7f2a4c160c50 2024-09-10T07:40:09.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.634+0000 7f2a53800640 1 -- 172.21.15.99:0/2293402536 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4c13dae0 con 0x7f2a4c160c50 2024-09-10T07:40:09.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.635+0000 7f2a49600640 1 -- 172.21.15.99:0/2293402536 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a44005d10 con 0x7f2a4c160c50 2024-09-10T07:40:09.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.636+0000 7f2a49600640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a2806be30 0x7f2a2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:09.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.636+0000 7f2a49600640 1 -- 172.21.15.99:0/2293402536 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f2a4408bc60 con 0x7f2a4c160c50 2024-09-10T07:40:09.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.636+0000 7f2a50e00640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a2806be30 0x7f2a2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:09.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.637+0000 7f2a50e00640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a2806be30 0x7f2a2806e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c034000 tx=0x7f2a3c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:09.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.640+0000 7f2a49600640 1 -- 172.21.15.99:0/2293402536 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a4c13dae0 con 0x7f2a4c160c50 2024-09-10T07:40:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.849+0000 7f2a53800640 1 -- 172.21.15.99:0/2293402536 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a4c06f1b0 con 0x7f2a4c160c50 2024-09-10T07:40:09.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.849+0000 7f2a49600640 1 -- 172.21.15.99:0/2293402536 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5225 (secure 0 0 0) 0x7f2a44022030 con 0x7f2a4c160c50 2024-09-10T07:40:09.849 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:09.849 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":57,"btime":"2024-09-10T07:39:55:461034+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/269606175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":269606175},{"type":"v1","addr":"172.21.15.187:6834","nonce":269606175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2513906672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2513906672},{"type":"v1","addr":"172.21.15.187:6835","nonce":2513906672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3548731230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3548731230},{"type":"v1","addr":"172.21.15.99:6835","nonce":3548731230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:39:51.850274+0000","modified":"2024-09-10T07:39:54.867555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6465},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6465":{"gid":6465,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/106508261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":106508261},{"type":"v1","addr":"172.21.15.99:6837","nonce":106508261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6465,"qdb_cluster":[6465]},"id":7}]} 2024-09-10T07:40:09.849 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 57 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.851+0000 7f2a53800640 1 -- 172.21.15.99:0/2293402536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a2806be30 msgr2=0x7f2a2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.851+0000 7f2a53800640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a2806be30 0x7f2a2806e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c034000 tx=0x7f2a3c02e000 comp rx=0 tx=0).stop 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.851+0000 7f2a53800640 1 -- 172.21.15.99:0/2293402536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c160c50 msgr2=0x7f2a4c13e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.852+0000 7f2a53800640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c160c50 0x7f2a4c13e1e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400ef90 tx=0x7f2a4400c490 comp rx=0 tx=0).stop 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.852+0000 7f2a53800640 1 -- 172.21.15.99:0/2293402536 shutdown_connections 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.852+0000 7f2a53800640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2a2806be30 0x7f2a2806e2f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.852+0000 7f2a53800640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c160c50 0x7f2a4c13e1e0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.852+0000 7f2a53800640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c142150 0x7f2a4c0b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.852+0000 7f2a53800640 1 --2- 172.21.15.99:0/2293402536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c13fae0 0x7f2a4c1f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.852+0000 7f2a53800640 1 -- 172.21.15.99:0/2293402536 >> 172.21.15.99:0/2293402536 conn(0x7f2a4c06bc10 msgr2=0x7f2a4c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.852+0000 7f2a53800640 1 -- 172.21.15.99:0/2293402536 shutdown_connections 2024-09-10T07:40:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:09.852+0000 7f2a53800640 1 -- 172.21.15.99:0/2293402536 wait complete. 2024-09-10T07:40:09.867 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:40:10.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.019+0000 7f29cca00640 1 Processor -- start 2024-09-10T07:40:10.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.020+0000 7f29cca00640 1 -- start start 2024-09-10T07:40:10.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.021+0000 7f29cca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29c813fae0 0x7f29c806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.021+0000 7f29cca00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f29c8142150 0x7f29c8160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.021+0000 7f29cca00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c8142650 con 0x7f29c8160a80 2024-09-10T07:40:10.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.021+0000 7f29cca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f29c80ce780 con 0x7f29c813fae0 2024-09-10T07:40:10.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.021+0000 7f29cca00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f29c8142930 con 0x7f29c8142150 2024-09-10T07:40:10.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.021+0000 7f29c5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29c813fae0 0x7f29c806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.021+0000 7f29c5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f29c813fae0 0x7f29c806f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56172/0 (socket says 172.21.15.99:56172) 2024-09-10T07:40:10.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.021+0000 7f29c5e00640 1 -- 172.21.15.99:0/1916339961 learned_addr learned my addr 172.21.15.99:0/1916339961 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:10.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.021+0000 7f29c5400640 1 --2- 172.21.15.99:0/1916339961 >> v2:172.21.15.187:3300/0 conn(0x7f29c8142150 0x7f29c8160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.022+0000 7f29c5e00640 1 -- 172.21.15.99:0/1916339961 >> v2:172.21.15.187:3300/0 conn(0x7f29c8142150 msgr2=0x7f29c8160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:10.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.022+0000 7f29c5e00640 1 --2- 172.21.15.99:0/1916339961 >> v2:172.21.15.187:3300/0 conn(0x7f29c8142150 0x7f29c8160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.022+0000 7f29c5e00640 1 -- 172.21.15.99:0/1916339961 >> v1:172.21.15.187:6789/0 conn(0x7f29c8160a80 legacy=0x7f29c815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.022+0000 7f29c5e00640 1 -- 172.21.15.99:0/1916339961 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c8142c10 con 0x7f29c813fae0 2024-09-10T07:40:10.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.023+0000 7f29c5e00640 1 --2- 172.21.15.99:0/1916339961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 0x7f29c806f1b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f29c8075560 tx=0x7f29b802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888bfa5e1996d0c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.023+0000 7f29c4a00640 1 -- 172.21.15.99:0/1916339961 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8037070 con 0x7f29c813fae0 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.023+0000 7f29c4a00640 1 -- 172.21.15.99:0/1916339961 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b8032440 con 0x7f29c813fae0 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.023+0000 7f29c4a00640 1 -- 172.21.15.99:0/1916339961 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8032810 con 0x7f29c813fae0 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.023+0000 7f29cca00640 1 -- 172.21.15.99:0/1916339961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 msgr2=0x7f29c806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.023+0000 7f29cca00640 1 --2- 172.21.15.99:0/1916339961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 0x7f29c806f1b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f29c8075560 tx=0x7f29b802a200 comp rx=0 tx=0).stop 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.023+0000 7f29cca00640 1 -- 172.21.15.99:0/1916339961 shutdown_connections 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.023+0000 7f29cca00640 1 --2- 172.21.15.99:0/1916339961 >> v2:172.21.15.187:3300/0 conn(0x7f29c8142150 0x7f29c8160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.023+0000 7f29cca00640 1 --2- 172.21.15.99:0/1916339961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 0x7f29c806f1b0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.023+0000 7f29cca00640 1 -- 172.21.15.99:0/1916339961 >> 172.21.15.99:0/1916339961 conn(0x7f29c806bc10 msgr2=0x7f29c806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.024+0000 7f29cca00640 1 -- 172.21.15.99:0/1916339961 shutdown_connections 2024-09-10T07:40:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.024+0000 7f29cca00640 1 -- 172.21.15.99:0/1916339961 wait complete. 2024-09-10T07:40:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.025+0000 7f29cca00640 1 Processor -- start 2024-09-10T07:40:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.025+0000 7f29cca00640 1 -- start start 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.026+0000 7f29cca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 0x7f29c81f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.026+0000 7f29cca00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29c8142150 0x7f29c81f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.026+0000 7f29cca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c8160a80 0x7f29c8141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.026+0000 7f29cca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f29c806f870 con 0x7f29c813fae0 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.026+0000 7f29cca00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f29c806f6f0 con 0x7f29c8160a80 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.026+0000 7f29cca00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f29c80cfc20 con 0x7f29c8142150 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.026+0000 7f29c5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 0x7f29c81f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29c5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 0x7f29c81f4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56178/0 (socket says 172.21.15.99:56178) 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29c5e00640 1 -- 172.21.15.99:0/810428457 learned_addr learned my addr 172.21.15.99:0/810428457 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29c5400640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29c8142150 0x7f29c81f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29c6800640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c8160a80 0x7f29c8141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29c5e00640 1 -- 172.21.15.99:0/810428457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29c8142150 msgr2=0x7f29c81f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29c5e00640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29c8142150 0x7f29c81f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29c5e00640 1 -- 172.21.15.99:0/810428457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c8160a80 msgr2=0x7f29c8141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29c5e00640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c8160a80 0x7f29c8141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29c5e00640 1 -- 172.21.15.99:0/810428457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c81f57a0 con 0x7f29c813fae0 2024-09-10T07:40:10.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29c5e00640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 0x7f29c81f4170 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000c00 tx=0x7f29b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:10.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29be000640 1 -- 172.21.15.99:0/810428457 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8041020 con 0x7f29c813fae0 2024-09-10T07:40:10.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29be000640 1 -- 172.21.15.99:0/810428457 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b80306c0 con 0x7f29c813fae0 2024-09-10T07:40:10.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.027+0000 7f29be000640 1 -- 172.21.15.99:0/810428457 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8037040 con 0x7f29c813fae0 2024-09-10T07:40:10.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.028+0000 7f29cca00640 1 -- 172.21.15.99:0/810428457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c81f59a0 con 0x7f29c813fae0 2024-09-10T07:40:10.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.028+0000 7f29cca00640 1 -- 172.21.15.99:0/810428457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c81f5f20 con 0x7f29c813fae0 2024-09-10T07:40:10.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.029+0000 7f29cca00640 1 -- 172.21.15.99:0/810428457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c806f1b0 con 0x7f29c813fae0 2024-09-10T07:40:10.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.030+0000 7f29be000640 1 -- 172.21.15.99:0/810428457 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29b8044020 con 0x7f29c813fae0 2024-09-10T07:40:10.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.030+0000 7f29be000640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29a806be60 0x7f29a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.031+0000 7f29be000640 1 -- 172.21.15.99:0/810428457 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f29b80ab660 con 0x7f29c813fae0 2024-09-10T07:40:10.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.031+0000 7f29c5400640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29a806be60 0x7f29a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.031+0000 7f29c5400640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29a806be60 0x7f29a806e320 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f29b4006fd0 tx=0x7f29b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:10.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.035+0000 7f29be000640 1 -- 172.21.15.99:0/810428457 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29b804b030 con 0x7f29c813fae0 2024-09-10T07:40:10.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.209+0000 7f29cca00640 1 -- 172.21.15.99:0/810428457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29c80b23f0 con 0x7f29c813fae0 2024-09-10T07:40:10.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.211+0000 7f29be000640 1 -- 172.21.15.99:0/810428457 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16663 (secure 0 0 0) 0x7f29c81f57a0 con 0x7f29c813fae0 2024-09-10T07:40:10.211 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:10.211 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":128,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:40:04.513536+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:39:49.623236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T07:39:50.847068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:40:10.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 -- 172.21.15.99:0/810428457 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29a806be60 msgr2=0x7f29a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29a806be60 0x7f29a806e320 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f29b4006fd0 tx=0x7f29b4008040 comp rx=0 tx=0).stop 2024-09-10T07:40:10.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 -- 172.21.15.99:0/810428457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 msgr2=0x7f29c81f4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 0x7f29c81f4170 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000c00 tx=0x7f29b80046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 -- 172.21.15.99:0/810428457 shutdown_connections 2024-09-10T07:40:10.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c8160a80 0x7f29c8141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29c8142150 0x7f29c81f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f29a806be60 0x7f29a806e320 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 --2- 172.21.15.99:0/810428457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29c813fae0 0x7f29c81f4170 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 -- 172.21.15.99:0/810428457 >> 172.21.15.99:0/810428457 conn(0x7f29c806bc10 msgr2=0x7f29c80cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:10.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 -- 172.21.15.99:0/810428457 shutdown_connections 2024-09-10T07:40:10.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.213+0000 7f29cca00640 1 -- 172.21.15.99:0/810428457 wait complete. 2024-09-10T07:40:10.229 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:40:10.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.381+0000 7fda36c00640 1 Processor -- start 2024-09-10T07:40:10.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.381+0000 7fda36c00640 1 -- start start 2024-09-10T07:40:10.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.382+0000 7fda36c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fda300d3070 0x7fda300d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.382+0000 7fda36c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda300cf740 con 0x7fda3015ed10 2024-09-10T07:40:10.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.382+0000 7fda36c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda300d3990 con 0x7fda300d51a0 2024-09-10T07:40:10.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.382+0000 7fda36c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fda300d2d70 con 0x7fda300d3070 2024-09-10T07:40:10.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.382+0000 7fda34e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fda3015ed10 0x7fda300d2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51604/0 (socket says 172.21.15.99:51604) 2024-09-10T07:40:10.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.382+0000 7fda34e00640 1 -- 172.21.15.99:0/2618435762 learned_addr learned my addr 172.21.15.99:0/2618435762 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:10.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.382+0000 7fda35800640 1 --2- 172.21.15.99:0/2618435762 >> v2:172.21.15.187:3300/0 conn(0x7fda300d3070 0x7fda300d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.383+0000 7fda2fe00640 1 -- 172.21.15.99:0/2618435762 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412287444 0 0) 0x7fda300cf740 con 0x7fda3015ed10 2024-09-10T07:40:10.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.383+0000 7fda2fe00640 1 -- 172.21.15.99:0/2618435762 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda18003520 con 0x7fda3015ed10 2024-09-10T07:40:10.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.383+0000 7fda35800640 1 -- 172.21.15.99:0/2618435762 >> v1:172.21.15.187:6789/0 conn(0x7fda300d51a0 legacy=0x7fda300d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.383+0000 7fda2fe00640 1 -- 172.21.15.99:0/2618435762 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195032053 0 0) 0x7fda300d3990 con 0x7fda300d51a0 2024-09-10T07:40:10.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.383+0000 7fda35800640 1 -- 172.21.15.99:0/2618435762 >> v1:172.21.15.99:6789/0 conn(0x7fda3015ed10 legacy=0x7fda300d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.383+0000 7fda35800640 1 -- 172.21.15.99:0/2618435762 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda300d08f0 con 0x7fda300d3070 2024-09-10T07:40:10.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.384+0000 7fda35800640 1 --2- 172.21.15.99:0/2618435762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda300d3070 0x7fda300d3450 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fda240097a0 tx=0x7fda2402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bfa0fb6ec54846e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:10.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.384+0000 7fda2fe00640 1 -- 172.21.15.99:0/2618435762 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24037070 con 0x7fda300d3070 2024-09-10T07:40:10.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.384+0000 7fda2fe00640 1 -- 172.21.15.99:0/2618435762 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda24032640 con 0x7fda300d3070 2024-09-10T07:40:10.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.384+0000 7fda2fe00640 1 -- 172.21.15.99:0/2618435762 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240329f0 con 0x7fda300d3070 2024-09-10T07:40:10.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.385+0000 7fda36c00640 1 -- 172.21.15.99:0/2618435762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda300d3070 msgr2=0x7fda300d3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.385+0000 7fda36c00640 1 --2- 172.21.15.99:0/2618435762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda300d3070 0x7fda300d3450 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fda240097a0 tx=0x7fda2402a2c0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.385+0000 7fda36c00640 1 -- 172.21.15.99:0/2618435762 shutdown_connections 2024-09-10T07:40:10.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.385+0000 7fda36c00640 1 --2- 172.21.15.99:0/2618435762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda300d3070 0x7fda300d3450 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.385+0000 7fda36c00640 1 -- 172.21.15.99:0/2618435762 >> 172.21.15.99:0/2618435762 conn(0x7fda3009dd60 msgr2=0x7fda300d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:10.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.385+0000 7fda36c00640 1 -- 172.21.15.99:0/2618435762 shutdown_connections 2024-09-10T07:40:10.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.385+0000 7fda36c00640 1 -- 172.21.15.99:0/2618435762 wait complete. 2024-09-10T07:40:10.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.387+0000 7fda36c00640 1 Processor -- start 2024-09-10T07:40:10.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.387+0000 7fda36c00640 1 -- start start 2024-09-10T07:40:10.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300d3070 0x7fda300cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3015ed10 0x7fda300cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda301f8ed0 0x7fda300ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fda300cf9e0 con 0x7fda301f8ed0 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fda300d5630 con 0x7fda3015ed10 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fda300cfcc0 con 0x7fda300d3070 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda301f8ed0 0x7fda300ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda35800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300d3070 0x7fda300cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda301f8ed0 0x7fda300ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56190/0 (socket says 172.21.15.99:56190) 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36200640 1 -- 172.21.15.99:0/1129025515 learned_addr learned my addr 172.21.15.99:0/1129025515 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda34e00640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3015ed10 0x7fda300cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36200640 1 -- 172.21.15.99:0/1129025515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300d3070 msgr2=0x7fda300cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36200640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300d3070 0x7fda300cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36200640 1 -- 172.21.15.99:0/1129025515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3015ed10 msgr2=0x7fda300cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.388+0000 7fda36200640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3015ed10 0x7fda300cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.389+0000 7fda36200640 1 -- 172.21.15.99:0/1129025515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda300cbc00 con 0x7fda301f8ed0 2024-09-10T07:40:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.389+0000 7fda36200640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda301f8ed0 0x7fda300ce010 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fda2800c730 tx=0x7fda2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.389+0000 7fda2d600640 1 -- 172.21.15.99:0/1129025515 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28003da0 con 0x7fda301f8ed0 2024-09-10T07:40:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.389+0000 7fda2d600640 1 -- 172.21.15.99:0/1129025515 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2800ce40 con 0x7fda301f8ed0 2024-09-10T07:40:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.389+0000 7fda2d600640 1 -- 172.21.15.99:0/1129025515 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda280052b0 con 0x7fda301f8ed0 2024-09-10T07:40:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.389+0000 7fda36c00640 1 -- 172.21.15.99:0/1129025515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda300cbee0 con 0x7fda301f8ed0 2024-09-10T07:40:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.389+0000 7fda36c00640 1 -- 172.21.15.99:0/1129025515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda300cc4a0 con 0x7fda301f8ed0 2024-09-10T07:40:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.390+0000 7fda36c00640 1 -- 172.21.15.99:0/1129025515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda300ccba0 con 0x7fda301f8ed0 2024-09-10T07:40:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.391+0000 7fda2d600640 1 -- 172.21.15.99:0/1129025515 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda28005450 con 0x7fda301f8ed0 2024-09-10T07:40:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.392+0000 7fda2d600640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda1006be30 0x7fda1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.392+0000 7fda2d600640 1 -- 172.21.15.99:0/1129025515 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fda2808ad10 con 0x7fda301f8ed0 2024-09-10T07:40:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.392+0000 7fda35800640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda1006be30 0x7fda1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.393+0000 7fda35800640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda1006be30 0x7fda1006e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fda24034000 tx=0x7fda2402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:10.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.396+0000 7fda2d600640 1 -- 172.21.15.99:0/1129025515 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda28090020 con 0x7fda301f8ed0 2024-09-10T07:40:10.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.605+0000 7fda36c00640 1 -- 172.21.15.99:0/1129025515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fda300d4870 con 0x7fda301f8ed0 2024-09-10T07:40:10.605 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:40:10.605+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:40:10.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.609+0000 7fda2d600640 1 -- 172.21.15.99:0/1129025515 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) ==== 161+0+0 (secure 0 0 0) 0x7fda28058fd0 con 0x7fda301f8ed0 2024-09-10T07:40:10.608 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:40:10.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.612+0000 7fda36c00640 1 -- 172.21.15.99:0/1129025515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda1006be30 msgr2=0x7fda1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.612+0000 7fda36c00640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda1006be30 0x7fda1006e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fda24034000 tx=0x7fda2402e000 comp rx=0 tx=0).stop 2024-09-10T07:40:10.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.613+0000 7fda36c00640 1 -- 172.21.15.99:0/1129025515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda301f8ed0 msgr2=0x7fda300ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.613+0000 7fda36c00640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda301f8ed0 0x7fda300ce010 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fda2800c730 tx=0x7fda2800cbf0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.613+0000 7fda36c00640 1 -- 172.21.15.99:0/1129025515 shutdown_connections 2024-09-10T07:40:10.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.613+0000 7fda36c00640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda1006be30 0x7fda1006e2f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.613+0000 7fda36c00640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda301f8ed0 0x7fda300ce010 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.613+0000 7fda36c00640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3015ed10 0x7fda300cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.613+0000 7fda36c00640 1 --2- 172.21.15.99:0/1129025515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda300d3070 0x7fda300cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.614+0000 7fda36c00640 1 -- 172.21.15.99:0/1129025515 >> 172.21.15.99:0/1129025515 conn(0x7fda3009dd60 msgr2=0x7fda300b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:10.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.614+0000 7fda36c00640 1 -- 172.21.15.99:0/1129025515 shutdown_connections 2024-09-10T07:40:10.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.614+0000 7fda36c00640 1 -- 172.21.15.99:0/1129025515 wait complete. 2024-09-10T07:40:10.621 INFO:tasks.ceph.mds.a.smithi099.stderr: -4943> 2024-09-10T07:39:58.026+0000 7fed1f000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:40:10.630 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:40:10.670 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:40:10.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.786+0000 7f62b3e00640 1 Processor -- start 2024-09-10T07:40:10.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.787+0000 7f62b3e00640 1 -- start start 2024-09-10T07:40:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.788+0000 7f62b3e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f62ac15b760 0x7f62ac0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.788+0000 7f62b3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 0x7f62ac0d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.788+0000 7f62b3e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62ac0b4300 con 0x7f62ac0b4a90 2024-09-10T07:40:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.788+0000 7f62b3e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f62ac0d0fa0 con 0x7f62ac15b760 2024-09-10T07:40:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.788+0000 7f62b3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac06d700 con 0x7f62ac0d0630 2024-09-10T07:40:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.788+0000 7f62b0a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f62ac0b4a90 0x7f62ac06f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51612/0 (socket says 172.21.15.99:51612) 2024-09-10T07:40:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.788+0000 7f62b0a00640 1 -- 172.21.15.99:0/2764176156 learned_addr learned my addr 172.21.15.99:0/2764176156 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.788+0000 7f62b1e00640 1 --2- 172.21.15.99:0/2764176156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 0x7f62ac0d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.788+0000 7f62b1400640 1 --2- 172.21.15.99:0/2764176156 >> v2:172.21.15.187:3300/0 conn(0x7f62ac15b760 0x7f62ac0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.789+0000 7f62abe00640 1 -- 172.21.15.99:0/2764176156 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 936516259 0 0) 0x7f62ac0b4300 con 0x7f62ac0b4a90 2024-09-10T07:40:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.789+0000 7f62abe00640 1 -- 172.21.15.99:0/2764176156 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6294003520 con 0x7f62ac0b4a90 2024-09-10T07:40:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.789+0000 7f62abe00640 1 -- 172.21.15.99:0/2764176156 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 546926363 0 0) 0x7f6294003520 con 0x7f62ac0b4a90 2024-09-10T07:40:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.789+0000 7f62b1e00640 1 -- 172.21.15.99:0/2764176156 >> v2:172.21.15.187:3300/0 conn(0x7f62ac15b760 msgr2=0x7f62ac0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.789+0000 7f62b1e00640 1 --2- 172.21.15.99:0/2764176156 >> v2:172.21.15.187:3300/0 conn(0x7f62ac15b760 0x7f62ac0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.789+0000 7f62b1e00640 1 -- 172.21.15.99:0/2764176156 >> v1:172.21.15.99:6789/0 conn(0x7f62ac0b4a90 legacy=0x7f62ac06f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.789+0000 7f62b1e00640 1 -- 172.21.15.99:0/2764176156 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac06d9e0 con 0x7f62ac0d0630 2024-09-10T07:40:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.789+0000 7f62b1400640 1 --2- 172.21.15.99:0/2764176156 >> v2:172.21.15.187:3300/0 conn(0x7f62ac15b760 0x7f62ac0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:40:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.790+0000 7f62b1e00640 1 --2- 172.21.15.99:0/2764176156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 0x7f62ac0d0a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009d90 tx=0x7f62a402a4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=578b80a9b12b8f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.790+0000 7f62abe00640 1 -- 172.21.15.99:0/2764176156 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298001670 con 0x7f62ac0d0630 2024-09-10T07:40:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.790+0000 7f62abe00640 1 -- 172.21.15.99:0/2764176156 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a4007540 con 0x7f62ac0d0630 2024-09-10T07:40:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.790+0000 7f62abe00640 1 -- 172.21.15.99:0/2764176156 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4007910 con 0x7f62ac0d0630 2024-09-10T07:40:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.791+0000 7f62b3e00640 1 -- 172.21.15.99:0/2764176156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 msgr2=0x7f62ac0d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.791+0000 7f62b3e00640 1 --2- 172.21.15.99:0/2764176156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 0x7f62ac0d0a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009d90 tx=0x7f62a402a4c0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.791+0000 7f62b3e00640 1 -- 172.21.15.99:0/2764176156 shutdown_connections 2024-09-10T07:40:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.791+0000 7f62b3e00640 1 --2- 172.21.15.99:0/2764176156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 0x7f62ac0d0a60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.791+0000 7f62b3e00640 1 --2- 172.21.15.99:0/2764176156 >> v2:172.21.15.187:3300/0 conn(0x7f62ac15b760 0x7f62ac0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.791+0000 7f62b3e00640 1 -- 172.21.15.99:0/2764176156 >> 172.21.15.99:0/2764176156 conn(0x7f62ac06bc10 msgr2=0x7f62ac06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.791+0000 7f62b3e00640 1 -- 172.21.15.99:0/2764176156 shutdown_connections 2024-09-10T07:40:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.791+0000 7f62b3e00640 1 -- 172.21.15.99:0/2764176156 wait complete. 2024-09-10T07:40:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.792+0000 7f62b3e00640 1 Processor -- start 2024-09-10T07:40:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.793+0000 7f62b3e00640 1 -- start start 2024-09-10T07:40:10.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.793+0000 7f62b3e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62ac0b4a90 0x7f62ac155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.793+0000 7f62b3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 0x7f62ac148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62ac15b760 0x7f62ac153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b3e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac0b4f20 con 0x7f62ac15b760 2024-09-10T07:40:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b3e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac15bb40 con 0x7f62ac0b4a90 2024-09-10T07:40:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac155fd0 con 0x7f62ac0d0630 2024-09-10T07:40:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62ac15b760 0x7f62ac153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62ac15b760 0x7f62ac153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56204/0 (socket says 172.21.15.99:56204) 2024-09-10T07:40:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b1e00640 1 -- 172.21.15.99:0/2962956027 learned_addr learned my addr 172.21.15.99:0/2962956027 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b0a00640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 0x7f62ac148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b1400640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62ac0b4a90 0x7f62ac155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b1e00640 1 -- 172.21.15.99:0/2962956027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 msgr2=0x7f62ac148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b1e00640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 0x7f62ac148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b1e00640 1 -- 172.21.15.99:0/2962956027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62ac0b4a90 msgr2=0x7f62ac155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b1e00640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62ac0b4a90 0x7f62ac155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.794+0000 7f62b1e00640 1 -- 172.21.15.99:0/2962956027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac15db30 con 0x7f62ac15b760 2024-09-10T07:40:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.795+0000 7f62b1e00640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62ac15b760 0x7f62ac153610 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009d90 tx=0x7f62a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.795+0000 7f62a9600640 1 -- 172.21.15.99:0/2962956027 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4040070 con 0x7f62ac15b760 2024-09-10T07:40:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.795+0000 7f62a9600640 1 -- 172.21.15.99:0/2962956027 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a4031b40 con 0x7f62ac15b760 2024-09-10T07:40:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.795+0000 7f62a9600640 1 -- 172.21.15.99:0/2962956027 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4007e90 con 0x7f62ac15b760 2024-09-10T07:40:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.795+0000 7f62b3e00640 1 -- 172.21.15.99:0/2962956027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ac15ddd0 con 0x7f62ac15b760 2024-09-10T07:40:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.795+0000 7f62b3e00640 1 -- 172.21.15.99:0/2962956027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ac155cc0 con 0x7f62ac15b760 2024-09-10T07:40:10.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.796+0000 7f62b3e00640 1 -- 172.21.15.99:0/2962956027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62ac06dcc0 con 0x7f62ac15b760 2024-09-10T07:40:10.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.797+0000 7f62a9600640 1 -- 172.21.15.99:0/2962956027 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62a4039040 con 0x7f62ac15b760 2024-09-10T07:40:10.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.798+0000 7f62a9600640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f628c06be30 0x7f628c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:10.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.798+0000 7f62a9600640 1 -- 172.21.15.99:0/2962956027 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5795+0+0 (secure 0 0 0) 0x7f62a40ac280 con 0x7f62ac15b760 2024-09-10T07:40:10.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.798+0000 7f62b1400640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f628c06be30 0x7f628c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:10.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.799+0000 7f62b1400640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f628c06be30 0x7f628c06e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009560 tx=0x7f62a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:10.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:10.802+0000 7f62a9600640 1 -- 172.21.15.99:0/2962956027 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62a404b340 con 0x7f62ac15b760 2024-09-10T07:40:11.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.010+0000 7f62b3e00640 1 -- 172.21.15.99:0/2962956027 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f62ac075060 con 0x7f62ac15b760 2024-09-10T07:40:11.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.612+0000 7f62a9600640 1 -- 172.21.15.99:0/2962956027 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) ==== 104+0+0 (secure 0 0 0) 0x7f62a407abc0 con 0x7f62ac15b760 2024-09-10T07:40:11.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 -- 172.21.15.99:0/2962956027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f628c06be30 msgr2=0x7f628c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:11.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f628c06be30 0x7f628c06e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009560 tx=0x7f62a0008040 comp rx=0 tx=0).stop 2024-09-10T07:40:11.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 -- 172.21.15.99:0/2962956027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62ac15b760 msgr2=0x7f62ac153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:11.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62ac15b760 0x7f62ac153610 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009d90 tx=0x7f62a4004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:11.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 -- 172.21.15.99:0/2962956027 shutdown_connections 2024-09-10T07:40:11.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f628c06be30 0x7f628c06e2f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62ac15b760 0x7f62ac153610 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62ac0d0630 0x7f62ac148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 --2- 172.21.15.99:0/2962956027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62ac0b4a90 0x7f62ac155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 -- 172.21.15.99:0/2962956027 >> 172.21.15.99:0/2962956027 conn(0x7f62ac06bc10 msgr2=0x7f62ac159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:11.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 -- 172.21.15.99:0/2962956027 shutdown_connections 2024-09-10T07:40:11.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.615+0000 7f62b3e00640 1 -- 172.21.15.99:0/2962956027 wait complete. 2024-09-10T07:40:11.633 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:40:11.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.833+0000 7fdb76c00640 1 Processor -- start 2024-09-10T07:40:11.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.833+0000 7fdb76c00640 1 -- start start 2024-09-10T07:40:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.834+0000 7fdb76c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdb701445a0 0x7fdb700cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.834+0000 7fdb76c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdb700ced50 0x7fdb70072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.834+0000 7fdb76c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb700cd8c0 con 0x7fdb70144980 2024-09-10T07:40:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.834+0000 7fdb76c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fdb700b4d20 con 0x7fdb700ced50 2024-09-10T07:40:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.834+0000 7fdb76c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fdb7015fdd0 con 0x7fdb701445a0 2024-09-10T07:40:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.834+0000 7fdb6f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdb700ced50 0x7fdb70072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.834+0000 7fdb6f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdb700ced50 0x7fdb70072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56206/0 (socket says 172.21.15.99:56206) 2024-09-10T07:40:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.834+0000 7fdb6f400640 1 -- 172.21.15.99:0/3796876680 learned_addr learned my addr 172.21.15.99:0/3796876680 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.835+0000 7fdb6fe00640 1 --2- 172.21.15.99:0/3796876680 >> v2:172.21.15.187:3300/0 conn(0x7fdb701445a0 0x7fdb700cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.835+0000 7fdb6f400640 1 -- 172.21.15.99:0/3796876680 >> v2:172.21.15.187:3300/0 conn(0x7fdb701445a0 msgr2=0x7fdb700cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.835+0000 7fdb6f400640 1 --2- 172.21.15.99:0/3796876680 >> v2:172.21.15.187:3300/0 conn(0x7fdb701445a0 0x7fdb700cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.835+0000 7fdb6f400640 1 -- 172.21.15.99:0/3796876680 >> v1:172.21.15.187:6789/0 conn(0x7fdb70144980 legacy=0x7fdb7006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:11.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.835+0000 7fdb6f400640 1 -- 172.21.15.99:0/3796876680 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb70160310 con 0x7fdb700ced50 2024-09-10T07:40:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.836+0000 7fdb6f400640 1 --2- 172.21.15.99:0/3796876680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb700ced50 0x7fdb70072680 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00bb40 tx=0x7fdb5c02c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c49edd1423c878 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.836+0000 7fdb6ea00640 1 -- 172.21.15.99:0/3796876680 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c03a070 con 0x7fdb700ced50 2024-09-10T07:40:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.836+0000 7fdb6ea00640 1 -- 172.21.15.99:0/3796876680 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c0326f0 con 0x7fdb700ced50 2024-09-10T07:40:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.836+0000 7fdb6ea00640 1 -- 172.21.15.99:0/3796876680 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c032ac0 con 0x7fdb700ced50 2024-09-10T07:40:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.836+0000 7fdb76c00640 1 -- 172.21.15.99:0/3796876680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb700ced50 msgr2=0x7fdb70072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.836+0000 7fdb76c00640 1 --2- 172.21.15.99:0/3796876680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb700ced50 0x7fdb70072680 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00bb40 tx=0x7fdb5c02c830 comp rx=0 tx=0).stop 2024-09-10T07:40:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.837+0000 7fdb76c00640 1 -- 172.21.15.99:0/3796876680 shutdown_connections 2024-09-10T07:40:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.837+0000 7fdb76c00640 1 --2- 172.21.15.99:0/3796876680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb700ced50 0x7fdb70072680 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.837+0000 7fdb76c00640 1 --2- 172.21.15.99:0/3796876680 >> v2:172.21.15.187:3300/0 conn(0x7fdb701445a0 0x7fdb700cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.837+0000 7fdb76c00640 1 -- 172.21.15.99:0/3796876680 >> 172.21.15.99:0/3796876680 conn(0x7fdb700b26a0 msgr2=0x7fdb700b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.837+0000 7fdb76c00640 1 -- 172.21.15.99:0/3796876680 shutdown_connections 2024-09-10T07:40:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.837+0000 7fdb76c00640 1 -- 172.21.15.99:0/3796876680 wait complete. 2024-09-10T07:40:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.838+0000 7fdb76c00640 1 Processor -- start 2024-09-10T07:40:11.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.838+0000 7fdb76c00640 1 -- start start 2024-09-10T07:40:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.839+0000 7fdb76c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb700ced50 0x7fdb7015daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.839+0000 7fdb76c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb701445a0 0x7fdb7006d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.839+0000 7fdb76c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb70144980 0x7fdb7006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.839+0000 7fdb76c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700b5c20 con 0x7fdb70144980 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.839+0000 7fdb76c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700b5940 con 0x7fdb701445a0 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.839+0000 7fdb76c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdb70144ec0 con 0x7fdb700ced50 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb74c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb70144980 0x7fdb7006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb74c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb70144980 0x7fdb7006dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56214/0 (socket says 172.21.15.99:56214) 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb74c00640 1 -- 172.21.15.99:0/2587893927 learned_addr learned my addr 172.21.15.99:0/2587893927 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb6fe00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb700ced50 0x7fdb7015daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb6f400640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb701445a0 0x7fdb7006d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb74c00640 1 -- 172.21.15.99:0/2587893927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb700ced50 msgr2=0x7fdb7015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb74c00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb700ced50 0x7fdb7015daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb74c00640 1 -- 172.21.15.99:0/2587893927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb701445a0 msgr2=0x7fdb7006d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb74c00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb701445a0 0x7fdb7006d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb74c00640 1 -- 172.21.15.99:0/2587893927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7015e0f0 con 0x7fdb70144980 2024-09-10T07:40:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb74c00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb70144980 0x7fdb7006dee0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800ba10 tx=0x7fdb6800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.840+0000 7fdb67e00640 1 -- 172.21.15.99:0/2587893927 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68019070 con 0x7fdb70144980 2024-09-10T07:40:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.841+0000 7fdb67e00640 1 -- 172.21.15.99:0/2587893927 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6800cae0 con 0x7fdb70144980 2024-09-10T07:40:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.841+0000 7fdb67e00640 1 -- 172.21.15.99:0/2587893927 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68014440 con 0x7fdb70144980 2024-09-10T07:40:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.841+0000 7fdb76c00640 1 -- 172.21.15.99:0/2587893927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7015e3d0 con 0x7fdb70144980 2024-09-10T07:40:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.841+0000 7fdb76c00640 1 -- 172.21.15.99:0/2587893927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7015e990 con 0x7fdb70144980 2024-09-10T07:40:11.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.842+0000 7fdb76c00640 1 -- 172.21.15.99:0/2587893927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7015bc00 con 0x7fdb70144980 2024-09-10T07:40:11.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.843+0000 7fdb67e00640 1 -- 172.21.15.99:0/2587893927 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb6801c070 con 0x7fdb70144980 2024-09-10T07:40:11.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.843+0000 7fdb67e00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdb5006be30 0x7fdb5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:11.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.843+0000 7fdb67e00640 1 -- 172.21.15.99:0/2587893927 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5795+0+0 (secure 0 0 0) 0x7fdb6808aa00 con 0x7fdb70144980 2024-09-10T07:40:11.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.844+0000 7fdb6fe00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdb5006be30 0x7fdb5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:11.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.844+0000 7fdb6fe00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdb5006be30 0x7fdb5006e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdb60006fd0 tx=0x7fdb60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:11.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:11.848+0000 7fdb67e00640 1 -- 172.21.15.99:0/2587893927 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb68058d00 con 0x7fdb70144980 2024-09-10T07:40:12.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.022+0000 7fdb76c00640 1 -- 172.21.15.99:0/2587893927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdb700b0760 con 0x7fdb70144980 2024-09-10T07:40:12.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.619+0000 7fdb67e00640 1 -- 172.21.15.99:0/2587893927 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v130) ==== 181+0+0 (secure 0 0 0) 0x7fdb6805d000 con 0x7fdb70144980 2024-09-10T07:40:12.620 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:40:12.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 -- 172.21.15.99:0/2587893927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdb5006be30 msgr2=0x7fdb5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:12.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdb5006be30 0x7fdb5006e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdb60006fd0 tx=0x7fdb60008040 comp rx=0 tx=0).stop 2024-09-10T07:40:12.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 -- 172.21.15.99:0/2587893927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb70144980 msgr2=0x7fdb7006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:12.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb70144980 0x7fdb7006dee0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800ba10 tx=0x7fdb6800bed0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 -- 172.21.15.99:0/2587893927 shutdown_connections 2024-09-10T07:40:12.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdb5006be30 0x7fdb5006e2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb70144980 0x7fdb7006dee0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb701445a0 0x7fdb7006d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 --2- 172.21.15.99:0/2587893927 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb700ced50 0x7fdb7015daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 -- 172.21.15.99:0/2587893927 >> 172.21.15.99:0/2587893927 conn(0x7fdb700b26a0 msgr2=0x7fdb700728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:12.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 -- 172.21.15.99:0/2587893927 shutdown_connections 2024-09-10T07:40:12.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.623+0000 7fdb76c00640 1 -- 172.21.15.99:0/2587893927 wait complete. 2024-09-10T07:40:12.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:40:12.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.799+0000 7fcd97200640 1 Processor -- start 2024-09-10T07:40:12.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.799+0000 7fcd97200640 1 -- start start 2024-09-10T07:40:12.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.800+0000 7fcd97200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcd980d3760 0x7fcd980cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:12.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.800+0000 7fcd97200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcd980cfd30 0x7fcd980b8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.800+0000 7fcd97200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd980d0520 con 0x7fcd9815eb60 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.800+0000 7fcd97200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcd980d0800 con 0x7fcd980cfd30 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.800+0000 7fcd97200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fcd980b7a60 con 0x7fcd980d3760 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.800+0000 7fcd96800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcd980cfd30 0x7fcd980b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.800+0000 7fcd96800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcd980cfd30 0x7fcd980b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56226/0 (socket says 172.21.15.99:56226) 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.800+0000 7fcd96800640 1 -- 172.21.15.99:0/3878401770 learned_addr learned my addr 172.21.15.99:0/3878401770 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.801+0000 7fcd8d400640 1 --2- 172.21.15.99:0/3878401770 >> v2:172.21.15.187:3300/0 conn(0x7fcd980d3760 0x7fcd980cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.801+0000 7fcd96800640 1 -- 172.21.15.99:0/3878401770 >> v2:172.21.15.187:3300/0 conn(0x7fcd980d3760 msgr2=0x7fcd980cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.801+0000 7fcd96800640 1 --2- 172.21.15.99:0/3878401770 >> v2:172.21.15.187:3300/0 conn(0x7fcd980d3760 0x7fcd980cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.801+0000 7fcd96800640 1 -- 172.21.15.99:0/3878401770 >> v1:172.21.15.187:6789/0 conn(0x7fcd9815eb60 legacy=0x7fcd980d3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.801+0000 7fcd96800640 1 -- 172.21.15.99:0/3878401770 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd980b7d40 con 0x7fcd980cfd30 2024-09-10T07:40:12.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.802+0000 7fcd96800640 1 --2- 172.21.15.99:0/3878401770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd980cfd30 0x7fcd980b8260 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcd980cbad0 tx=0x7fcd9002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae81260e87d12be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:12.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.802+0000 7fcd95400640 1 -- 172.21.15.99:0/3878401770 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd90037070 con 0x7fcd980cfd30 2024-09-10T07:40:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.802+0000 7fcd95400640 1 -- 172.21.15.99:0/3878401770 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd90032440 con 0x7fcd980cfd30 2024-09-10T07:40:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.802+0000 7fcd95400640 1 -- 172.21.15.99:0/3878401770 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd90032810 con 0x7fcd980cfd30 2024-09-10T07:40:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.803+0000 7fcd97200640 1 -- 172.21.15.99:0/3878401770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd980cfd30 msgr2=0x7fcd980b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.803+0000 7fcd97200640 1 --2- 172.21.15.99:0/3878401770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd980cfd30 0x7fcd980b8260 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcd980cbad0 tx=0x7fcd9002a2c0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.803+0000 7fcd97200640 1 -- 172.21.15.99:0/3878401770 shutdown_connections 2024-09-10T07:40:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.803+0000 7fcd97200640 1 --2- 172.21.15.99:0/3878401770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd980cfd30 0x7fcd980b8260 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.803+0000 7fcd97200640 1 --2- 172.21.15.99:0/3878401770 >> v2:172.21.15.187:3300/0 conn(0x7fcd980d3760 0x7fcd980cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.803+0000 7fcd97200640 1 -- 172.21.15.99:0/3878401770 >> 172.21.15.99:0/3878401770 conn(0x7fcd980d4a70 msgr2=0x7fcd980d4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.803+0000 7fcd97200640 1 -- 172.21.15.99:0/3878401770 shutdown_connections 2024-09-10T07:40:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.803+0000 7fcd97200640 1 -- 172.21.15.99:0/3878401770 wait complete. 2024-09-10T07:40:12.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.804+0000 7fcd97200640 1 Processor -- start 2024-09-10T07:40:12.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.804+0000 7fcd97200640 1 -- start start 2024-09-10T07:40:12.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.805+0000 7fcd97200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd980cfd30 0x7fcd980b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:12.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.805+0000 7fcd97200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd980d3760 0x7fcd9809f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:12.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.805+0000 7fcd97200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd9815eb60 0x7fcd980b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.805+0000 7fcd97200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9815f0c0 con 0x7fcd9815eb60 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.805+0000 7fcd97200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9815ef40 con 0x7fcd980d3760 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.805+0000 7fcd97200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcd980b87a0 con 0x7fcd980cfd30 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd96800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd9815eb60 0x7fcd980b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd96800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd9815eb60 0x7fcd980b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56238/0 (socket says 172.21.15.99:56238) 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd96800640 1 -- 172.21.15.99:0/3626149239 learned_addr learned my addr 172.21.15.99:0/3626149239 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd8d400640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd980d3760 0x7fcd9809f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd95e00640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd980cfd30 0x7fcd980b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd96800640 1 -- 172.21.15.99:0/3626149239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd980cfd30 msgr2=0x7fcd980b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd96800640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd980cfd30 0x7fcd980b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd96800640 1 -- 172.21.15.99:0/3626149239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd980d3760 msgr2=0x7fcd9809f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd96800640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd980d3760 0x7fcd9809f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd96800640 1 -- 172.21.15.99:0/3626149239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9809e8d0 con 0x7fcd9815eb60 2024-09-10T07:40:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.806+0000 7fcd96800640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd9815eb60 0x7fcd980b4d30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fcd900090b0 tx=0x7fcd900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.807+0000 7fcd8ea00640 1 -- 172.21.15.99:0/3626149239 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd90041020 con 0x7fcd9815eb60 2024-09-10T07:40:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.807+0000 7fcd8ea00640 1 -- 172.21.15.99:0/3626149239 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd900306c0 con 0x7fcd9815eb60 2024-09-10T07:40:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.807+0000 7fcd8ea00640 1 -- 172.21.15.99:0/3626149239 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd90037040 con 0x7fcd9815eb60 2024-09-10T07:40:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.807+0000 7fcd97200640 1 -- 172.21.15.99:0/3626149239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9809ebb0 con 0x7fcd9815eb60 2024-09-10T07:40:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.807+0000 7fcd97200640 1 -- 172.21.15.99:0/3626149239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9809f170 con 0x7fcd9815eb60 2024-09-10T07:40:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.808+0000 7fcd97200640 1 -- 172.21.15.99:0/3626149239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd980d0a40 con 0x7fcd9815eb60 2024-09-10T07:40:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.809+0000 7fcd8ea00640 1 -- 172.21.15.99:0/3626149239 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd90044020 con 0x7fcd9815eb60 2024-09-10T07:40:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.809+0000 7fcd8ea00640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd7406be60 0x7fcd7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.810+0000 7fcd8ea00640 1 -- 172.21.15.99:0/3626149239 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5357+0+0 (secure 0 0 0) 0x7fcd900ab460 con 0x7fcd9815eb60 2024-09-10T07:40:12.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.810+0000 7fcd95e00640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd7406be60 0x7fcd7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:12.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.810+0000 7fcd95e00640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd7406be60 0x7fcd7406e320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcd980a0b40 tx=0x7fcd880094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:12.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.814+0000 7fcd8ea00640 1 -- 172.21.15.99:0/3626149239 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd980d0a40 con 0x7fcd9815eb60 2024-09-10T07:40:12.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:12.985+0000 7fcd97200640 1 -- 172.21.15.99:0/3626149239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd980b8260 con 0x7fcd9815eb60 2024-09-10T07:40:13.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.625+0000 7fcd8ea00640 1 -- 172.21.15.99:0/3626149239 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v131) ==== 169+0+0 (secure 0 0 0) 0x7fcd9004b030 con 0x7fcd9815eb60 2024-09-10T07:40:13.625 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:40:13.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.629+0000 7fcd97200640 1 -- 172.21.15.99:0/3626149239 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd7406be60 msgr2=0x7fcd7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:13.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.629+0000 7fcd97200640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd7406be60 0x7fcd7406e320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcd980a0b40 tx=0x7fcd880094d0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.629+0000 7fcd97200640 1 -- 172.21.15.99:0/3626149239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd9815eb60 msgr2=0x7fcd980b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:13.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.629+0000 7fcd97200640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd9815eb60 0x7fcd980b4d30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fcd900090b0 tx=0x7fcd900046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.629+0000 7fcd97200640 1 -- 172.21.15.99:0/3626149239 shutdown_connections 2024-09-10T07:40:13.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.629+0000 7fcd97200640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcd7406be60 0x7fcd7406e320 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.629+0000 7fcd97200640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd9815eb60 0x7fcd980b4d30 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.629+0000 7fcd97200640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd980d3760 0x7fcd9809f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.629+0000 7fcd97200640 1 --2- 172.21.15.99:0/3626149239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd980cfd30 0x7fcd980b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.629+0000 7fcd97200640 1 -- 172.21.15.99:0/3626149239 >> 172.21.15.99:0/3626149239 conn(0x7fcd980d4a70 msgr2=0x7fcd9806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:13.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.630+0000 7fcd97200640 1 -- 172.21.15.99:0/3626149239 shutdown_connections 2024-09-10T07:40:13.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.630+0000 7fcd97200640 1 -- 172.21.15.99:0/3626149239 wait complete. 2024-09-10T07:40:13.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T07:40:13.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.809+0000 7f0462e00640 1 Processor -- start 2024-09-10T07:40:13.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.809+0000 7f0462e00640 1 -- start start 2024-09-10T07:40:13.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.810+0000 7f0462e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f045c0b4e70 0x7f045c071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:13.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.810+0000 7f0462e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f045c15ece0 0x7f045c0b5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:13.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.810+0000 7f0462e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f045c0af250 0x7f045c06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:13.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.810+0000 7f0462e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f045c0d1780 con 0x7f045c15ece0 2024-09-10T07:40:13.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.810+0000 7f0462e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f045c06d5d0 con 0x7f045c0af250 2024-09-10T07:40:13.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.810+0000 7f0462e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f045c0b5790 con 0x7f045c0b4e70 2024-09-10T07:40:13.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.811+0000 7f045b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f045c15ece0 0x7f045c0b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:13.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.811+0000 7f045b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f045c15ece0 0x7f045c0b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56250/0 (socket says 172.21.15.99:56250) 2024-09-10T07:40:13.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.811+0000 7f045b400640 1 -- 172.21.15.99:0/1298212680 learned_addr learned my addr 172.21.15.99:0/1298212680 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:13.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.811+0000 7f045be00640 1 --2- 172.21.15.99:0/1298212680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f045c0b4e70 0x7f045c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:13.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.811+0000 7f0460e00640 1 --2- 172.21.15.99:0/1298212680 >> v2:172.21.15.187:3300/0 conn(0x7f045c0af250 0x7f045c06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:13.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.811+0000 7f045b400640 1 -- 172.21.15.99:0/1298212680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f045c0b4e70 msgr2=0x7f045c071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:13.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.811+0000 7f045b400640 1 --2- 172.21.15.99:0/1298212680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f045c0b4e70 0x7f045c071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.811+0000 7f045b400640 1 -- 172.21.15.99:0/1298212680 >> v2:172.21.15.187:3300/0 conn(0x7f045c0af250 msgr2=0x7f045c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:13.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.811+0000 7f045b400640 1 --2- 172.21.15.99:0/1298212680 >> v2:172.21.15.187:3300/0 conn(0x7f045c0af250 0x7f045c06dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.811+0000 7f045b400640 1 -- 172.21.15.99:0/1298212680 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045c06f1a0 con 0x7f045c15ece0 2024-09-10T07:40:13.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.812+0000 7f045b400640 1 --2- 172.21.15.99:0/1298212680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c15ece0 0x7f045c0b5250 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f045c071500 tx=0x7f044802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c66d8bf56bff1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:13.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.812+0000 7f045aa00640 1 -- 172.21.15.99:0/1298212680 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448037070 con 0x7f045c15ece0 2024-09-10T07:40:13.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.812+0000 7f045aa00640 1 -- 172.21.15.99:0/1298212680 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0448032440 con 0x7f045c15ece0 2024-09-10T07:40:13.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.812+0000 7f045aa00640 1 -- 172.21.15.99:0/1298212680 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448032810 con 0x7f045c15ece0 2024-09-10T07:40:13.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.813+0000 7f0462e00640 1 -- 172.21.15.99:0/1298212680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c15ece0 msgr2=0x7f045c0b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:13.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.813+0000 7f0462e00640 1 --2- 172.21.15.99:0/1298212680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c15ece0 0x7f045c0b5250 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f045c071500 tx=0x7f044802a1e0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.813+0000 7f0462e00640 1 -- 172.21.15.99:0/1298212680 shutdown_connections 2024-09-10T07:40:13.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.813+0000 7f0462e00640 1 --2- 172.21.15.99:0/1298212680 >> v2:172.21.15.187:3300/0 conn(0x7f045c0af250 0x7f045c06dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.813+0000 7f0462e00640 1 --2- 172.21.15.99:0/1298212680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c15ece0 0x7f045c0b5250 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.813+0000 7f0462e00640 1 --2- 172.21.15.99:0/1298212680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f045c0b4e70 0x7f045c071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.813+0000 7f0462e00640 1 -- 172.21.15.99:0/1298212680 >> 172.21.15.99:0/1298212680 conn(0x7f045c06bc10 msgr2=0x7f045c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:13.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.813+0000 7f0462e00640 1 -- 172.21.15.99:0/1298212680 shutdown_connections 2024-09-10T07:40:13.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.813+0000 7f0462e00640 1 -- 172.21.15.99:0/1298212680 wait complete. 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.815+0000 7f0462e00640 1 Processor -- start 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.815+0000 7f0462e00640 1 -- start start 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0462e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f045c0af250 0x7f045c143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0462e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f045c0b4e70 0x7f045c159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0462e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c140bb0 0x7f045c15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0462e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f045c06d820 con 0x7f045c140bb0 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0462e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f045c06f760 con 0x7f045c0af250 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0462e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f045c06ede0 con 0x7f045c0b4e70 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0460e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c140bb0 0x7f045c15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0460e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c140bb0 0x7f045c15a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56264/0 (socket says 172.21.15.99:56264) 2024-09-10T07:40:13.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0460e00640 1 -- 172.21.15.99:0/3850490466 learned_addr learned my addr 172.21.15.99:0/3850490466 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f045b400640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f045c0b4e70 0x7f045c159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f045be00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f045c0af250 0x7f045c143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0460e00640 1 -- 172.21.15.99:0/3850490466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f045c0b4e70 msgr2=0x7f045c159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0460e00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f045c0b4e70 0x7f045c159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0460e00640 1 -- 172.21.15.99:0/3850490466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f045c0af250 msgr2=0x7f045c143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0460e00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f045c0af250 0x7f045c143bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.816+0000 7f0460e00640 1 -- 172.21.15.99:0/3850490466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045c144100 con 0x7f045c140bb0 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.817+0000 7f0460e00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c140bb0 0x7f045c15a410 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0454007e60 tx=0x7f045400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.817+0000 7f0453e00640 1 -- 172.21.15.99:0/3850490466 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454014420 con 0x7f045c140bb0 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.817+0000 7f0453e00640 1 -- 172.21.15.99:0/3850490466 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0454019070 con 0x7f045c140bb0 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.817+0000 7f0462e00640 1 -- 172.21.15.99:0/3850490466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045c161ec0 con 0x7f045c140bb0 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.817+0000 7f0453e00640 1 -- 172.21.15.99:0/3850490466 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0454014820 con 0x7f045c140bb0 2024-09-10T07:40:13.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.817+0000 7f0462e00640 1 -- 172.21.15.99:0/3850490466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045c141430 con 0x7f045c140bb0 2024-09-10T07:40:13.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.818+0000 7f0462e00640 1 -- 172.21.15.99:0/3850490466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f045c0af6a0 con 0x7f045c140bb0 2024-09-10T07:40:13.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.819+0000 7f0453e00640 1 -- 172.21.15.99:0/3850490466 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04540149c0 con 0x7f045c140bb0 2024-09-10T07:40:13.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.820+0000 7f0453e00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f043c06be30 0x7f043c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:13.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.820+0000 7f0453e00640 1 -- 172.21.15.99:0/3850490466 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f045408b290 con 0x7f045c140bb0 2024-09-10T07:40:13.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.820+0000 7f045be00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f043c06be30 0x7f043c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:13.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.821+0000 7f045be00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f043c06be30 0x7f043c06e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f044c006fd0 tx=0x7f044c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:13.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.824+0000 7f0453e00640 1 -- 172.21.15.99:0/3850490466 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0454059850 con 0x7f045c140bb0 2024-09-10T07:40:13.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:13.998+0000 7f0462e00640 1 -- 172.21.15.99:0/3850490466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f045c1626a0 con 0x7f045c140bb0 2024-09-10T07:40:14.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.003+0000 7f0453e00640 1 -- 172.21.15.99:0/3850490466 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f045405db50 con 0x7f045c140bb0 2024-09-10T07:40:14.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 -- 172.21.15.99:0/3850490466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f043c06be30 msgr2=0x7f043c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f043c06be30 0x7f043c06e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f044c006fd0 tx=0x7f044c008040 comp rx=0 tx=0).stop 2024-09-10T07:40:14.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 -- 172.21.15.99:0/3850490466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c140bb0 msgr2=0x7f045c15a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c140bb0 0x7f045c15a410 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0454007e60 tx=0x7f045400e4b0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 -- 172.21.15.99:0/3850490466 shutdown_connections 2024-09-10T07:40:14.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f043c06be30 0x7f043c06e2f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f045c140bb0 0x7f045c15a410 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f045c0b4e70 0x7f045c159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 --2- 172.21.15.99:0/3850490466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f045c0af250 0x7f045c143bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 -- 172.21.15.99:0/3850490466 >> 172.21.15.99:0/3850490466 conn(0x7f045c06bc10 msgr2=0x7f045c0b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:14.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 -- 172.21.15.99:0/3850490466 shutdown_connections 2024-09-10T07:40:14.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.005+0000 7f0462e00640 1 -- 172.21.15.99:0/3850490466 wait complete. 2024-09-10T07:40:14.020 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-10T07:40:14.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.173+0000 7fc397800640 1 Processor -- start 2024-09-10T07:40:14.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.174+0000 7fc397800640 1 -- start start 2024-09-10T07:40:14.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc397800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc390152210 0x7fc390071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc397800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3900723d0 0x7fc3900cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc397800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc3900cf550 0x7fc39006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc397800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc39015c4f0 con 0x7fc3900cf550 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc397800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fc39015b730 con 0x7fc390152210 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc397800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc39015ba10 con 0x7fc3900723d0 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc395800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc3900cf550 0x7fc39006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc395800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc3900cf550 0x7fc39006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56276/0 (socket says 172.21.15.99:56276) 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc395800640 1 -- 172.21.15.99:0/3254475242 learned_addr learned my addr 172.21.15.99:0/3254475242 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc394e00640 1 --2- 172.21.15.99:0/3254475242 >> v2:172.21.15.187:3300/0 conn(0x7fc390152210 0x7fc390071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.175+0000 7fc387e00640 1 --2- 172.21.15.99:0/3254475242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3900723d0 0x7fc3900cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.176+0000 7fc395800640 1 -- 172.21.15.99:0/3254475242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3900723d0 msgr2=0x7fc3900cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.176+0000 7fc395800640 1 --2- 172.21.15.99:0/3254475242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3900723d0 0x7fc3900cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.176+0000 7fc395800640 1 -- 172.21.15.99:0/3254475242 >> v2:172.21.15.187:3300/0 conn(0x7fc390152210 msgr2=0x7fc390071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:14.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.176+0000 7fc395800640 1 --2- 172.21.15.99:0/3254475242 >> v2:172.21.15.187:3300/0 conn(0x7fc390152210 0x7fc390071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.176+0000 7fc395800640 1 -- 172.21.15.99:0/3254475242 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39015bcf0 con 0x7fc3900cf550 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.177+0000 7fc395800640 1 --2- 172.21.15.99:0/3254475242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3900cf550 0x7fc39006d6b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc390075940 tx=0x7fc38802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc0ed955f58dde5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.177+0000 7fc38fe00640 1 -- 172.21.15.99:0/3254475242 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388036070 con 0x7fc3900cf550 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.177+0000 7fc38fe00640 1 -- 172.21.15.99:0/3254475242 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc388031600 con 0x7fc3900cf550 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.177+0000 7fc38fe00640 1 -- 172.21.15.99:0/3254475242 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3880319d0 con 0x7fc3900cf550 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.177+0000 7fc397800640 1 -- 172.21.15.99:0/3254475242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3900cf550 msgr2=0x7fc39006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.177+0000 7fc397800640 1 --2- 172.21.15.99:0/3254475242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3900cf550 0x7fc39006d6b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc390075940 tx=0x7fc38802a6a0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.178+0000 7fc397800640 1 -- 172.21.15.99:0/3254475242 shutdown_connections 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.178+0000 7fc397800640 1 --2- 172.21.15.99:0/3254475242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3900723d0 0x7fc3900cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.178+0000 7fc397800640 1 --2- 172.21.15.99:0/3254475242 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3900cf550 0x7fc39006d6b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.178+0000 7fc397800640 1 --2- 172.21.15.99:0/3254475242 >> v2:172.21.15.187:3300/0 conn(0x7fc390152210 0x7fc390071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.178+0000 7fc397800640 1 -- 172.21.15.99:0/3254475242 >> 172.21.15.99:0/3254475242 conn(0x7fc39006bc10 msgr2=0x7fc39006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:14.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.178+0000 7fc397800640 1 -- 172.21.15.99:0/3254475242 shutdown_connections 2024-09-10T07:40:14.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.178+0000 7fc397800640 1 -- 172.21.15.99:0/3254475242 wait complete. 2024-09-10T07:40:14.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.179+0000 7fc397800640 1 Processor -- start 2024-09-10T07:40:14.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.179+0000 7fc397800640 1 -- start start 2024-09-10T07:40:14.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.180+0000 7fc397800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3900723d0 0x7fc39006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.180+0000 7fc397800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3900cf550 0x7fc390146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.180+0000 7fc397800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc390152210 0x7fc3901454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.180+0000 7fc397800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc3900ce780 con 0x7fc390152210 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.180+0000 7fc397800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc39006f380 con 0x7fc3900cf550 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.180+0000 7fc397800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc3900ce900 con 0x7fc3900723d0 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.180+0000 7fc395800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc390152210 0x7fc3901454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.180+0000 7fc395800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc390152210 0x7fc3901454f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56288/0 (socket says 172.21.15.99:56288) 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.180+0000 7fc395800640 1 -- 172.21.15.99:0/2968606408 learned_addr learned my addr 172.21.15.99:0/2968606408 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc394e00640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3900723d0 0x7fc39006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc387e00640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3900cf550 0x7fc390146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc395800640 1 -- 172.21.15.99:0/2968606408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3900723d0 msgr2=0x7fc39006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc395800640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3900723d0 0x7fc39006ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc395800640 1 -- 172.21.15.99:0/2968606408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3900cf550 msgr2=0x7fc390146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc395800640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3900cf550 0x7fc390146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc395800640 1 -- 172.21.15.99:0/2968606408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc390143780 con 0x7fc390152210 2024-09-10T07:40:14.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc387e00640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3900cf550 0x7fc390146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:14.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc395800640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc390152210 0x7fc3901454f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc388009f40 tx=0x7fc388004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:14.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc38d600640 1 -- 172.21.15.99:0/2968606408 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388041020 con 0x7fc390152210 2024-09-10T07:40:14.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.181+0000 7fc38d600640 1 -- 172.21.15.99:0/2968606408 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3880077a0 con 0x7fc390152210 2024-09-10T07:40:14.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.182+0000 7fc38d600640 1 -- 172.21.15.99:0/2968606408 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388036040 con 0x7fc390152210 2024-09-10T07:40:14.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.182+0000 7fc397800640 1 -- 172.21.15.99:0/2968606408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc390143a60 con 0x7fc390152210 2024-09-10T07:40:14.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.182+0000 7fc397800640 1 -- 172.21.15.99:0/2968606408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc390144020 con 0x7fc390152210 2024-09-10T07:40:14.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.183+0000 7fc397800640 1 -- 172.21.15.99:0/2968606408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc390071e90 con 0x7fc390152210 2024-09-10T07:40:14.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.183+0000 7fc38d600640 1 -- 172.21.15.99:0/2968606408 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc388044020 con 0x7fc390152210 2024-09-10T07:40:14.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.184+0000 7fc38d600640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc36c06be30 0x7fc36c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.184+0000 7fc38d600640 1 -- 172.21.15.99:0/2968606408 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7fc3880ab700 con 0x7fc390152210 2024-09-10T07:40:14.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.185+0000 7fc394e00640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc36c06be30 0x7fc36c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.185+0000 7fc394e00640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc36c06be30 0x7fc36c06e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc380009a20 tx=0x7fc380009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:14.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.189+0000 7fc38d600640 1 -- 172.21.15.99:0/2968606408 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc38804b030 con 0x7fc390152210 2024-09-10T07:40:14.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.424+0000 7fc397800640 1 -- 172.21.15.99:0/2968606408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) -- 0x7fc390147b90 con 0x7fc390152210 2024-09-10T07:40:14.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.627+0000 7fc38d600640 1 -- 172.21.15.99:0/2968606408 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v311) ==== 128+0+0 (secure 0 0 0) 0x7fc38807a460 con 0x7fc390152210 2024-09-10T07:40:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.630+0000 7fc397800640 1 -- 172.21.15.99:0/2968606408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc36c06be30 msgr2=0x7fc36c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.630+0000 7fc397800640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc36c06be30 0x7fc36c06e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc380009a20 tx=0x7fc380009190 comp rx=0 tx=0).stop 2024-09-10T07:40:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.630+0000 7fc397800640 1 -- 172.21.15.99:0/2968606408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc390152210 msgr2=0x7fc3901454f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.630+0000 7fc397800640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc390152210 0x7fc3901454f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc388009f40 tx=0x7fc388004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.630+0000 7fc397800640 1 -- 172.21.15.99:0/2968606408 shutdown_connections 2024-09-10T07:40:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.630+0000 7fc397800640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc36c06be30 0x7fc36c06e2f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.630+0000 7fc397800640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc390152210 0x7fc3901454f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.630+0000 7fc397800640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3900cf550 0x7fc390146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.630+0000 7fc397800640 1 --2- 172.21.15.99:0/2968606408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3900723d0 0x7fc39006ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.630+0000 7fc397800640 1 -- 172.21.15.99:0/2968606408 >> 172.21.15.99:0/2968606408 conn(0x7fc39006bc10 msgr2=0x7fc390072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.631+0000 7fc397800640 1 -- 172.21.15.99:0/2968606408 shutdown_connections 2024-09-10T07:40:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.631+0000 7fc397800640 1 -- 172.21.15.99:0/2968606408 wait complete. 2024-09-10T07:40:14.646 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-10T07:40:14.646 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-10T07:40:14.647 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:40:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.801+0000 7fe5a3e00640 1 Processor -- start 2024-09-10T07:40:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.801+0000 7fe5a3e00640 1 -- start start 2024-09-10T07:40:14.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.802+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13fae0 0x7fe59c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.802+0000 7fe5a3e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe59c160c50 0x7fe59c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.802+0000 7fe5a3e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe59c142650 con 0x7fe59c142150 2024-09-10T07:40:14.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.802+0000 7fe5a3e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe59c0ce780 con 0x7fe59c160c50 2024-09-10T07:40:14.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.802+0000 7fe5a3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe59c142930 con 0x7fe59c13fae0 2024-09-10T07:40:14.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.802+0000 7fe5a0a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe59c142150 0x7fe59c160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51620/0 (socket says 172.21.15.99:51620) 2024-09-10T07:40:14.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe5a0a00640 1 -- 172.21.15.99:0/622834063 learned_addr learned my addr 172.21.15.99:0/622834063 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:14.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe5a1400640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13fae0 0x7fe59c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe5a1e00640 1 --2- 172.21.15.99:0/622834063 >> v2:172.21.15.187:3300/0 conn(0x7fe59c160c50 0x7fe59c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2252264132 0 0) 0x7fe59c142650 con 0x7fe59c142150 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe584003520 con 0x7fe59c142150 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2475458196 0 0) 0x7fe584003520 con 0x7fe59c142150 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13fae0 msgr2=0x7fe59c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13fae0 0x7fe59c06f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 >> v2:172.21.15.187:3300/0 conn(0x7fe59c160c50 msgr2=0x7fe59c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 --2- 172.21.15.99:0/622834063 >> v2:172.21.15.187:3300/0 conn(0x7fe59c160c50 0x7fe59c0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59c142c10 con 0x7fe59c142150 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fe588001670 con 0x7fe59c142150 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 >> v1:172.21.15.99:6789/0 conn(0x7fe59c142150 legacy=0x7fe59c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13fae0 0x7fe5840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.803+0000 7fe59be00640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe584003f30 0x7fe584004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe59be00640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 0x7fe5840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c142930 con 0x7fe584004d40 2024-09-10T07:40:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe58400b9c0 con 0x7fe584003f30 2024-09-10T07:40:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe58400bb90 con 0x7fe59c13fae0 2024-09-10T07:40:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe5a1e00640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 0x7fe5840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe5a0a00640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe584003f30 0x7fe584004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe5a1400640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13fae0 0x7fe5840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe5a1e00640 1 -- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13fae0 msgr2=0x7fe5840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe5a1e00640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13fae0 0x7fe5840039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe5a1e00640 1 -- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe584003f30 msgr2=0x7fe584004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe5a1e00640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe584003f30 0x7fe584004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.804+0000 7fe5a1e00640 1 -- 172.21.15.99:0/622834063 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe584003520 con 0x7fe584004d40 2024-09-10T07:40:14.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.805+0000 7fe5a1e00640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 0x7fe5840051c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe594009f90 tx=0x7fe584005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cad1c535f8949b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.805+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594009c10 con 0x7fe584004d40 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.805+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe594036070 con 0x7fe584004d40 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.805+0000 7fe59be00640 1 -- 172.21.15.99:0/622834063 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594031840 con 0x7fe584004d40 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.806+0000 7fe5a3e00640 1 -- 172.21.15.99:0/622834063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 msgr2=0x7fe5840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.806+0000 7fe5a3e00640 1 --2- 172.21.15.99:0/622834063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 0x7fe5840051c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe594009f90 tx=0x7fe584005830 comp rx=0 tx=0).stop 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.806+0000 7fe5a1e00640 1 -- 172.21.15.99:0/622834063 reap_dead start 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.806+0000 7fe5a3e00640 1 -- 172.21.15.99:0/622834063 shutdown_connections 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.806+0000 7fe5a3e00640 1 -- 172.21.15.99:0/622834063 >> 172.21.15.99:0/622834063 conn(0x7fe59c06bc10 msgr2=0x7fe59c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.806+0000 7fe5a3e00640 1 -- 172.21.15.99:0/622834063 shutdown_connections 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.806+0000 7fe5a3e00640 1 -- 172.21.15.99:0/622834063 wait complete. 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.808+0000 7fe5a3e00640 1 Processor -- start 2024-09-10T07:40:14.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.808+0000 7fe5a3e00640 1 -- start start 2024-09-10T07:40:14.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 0x7fe59c145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c157580 0x7fe59c146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a3e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13c6e0 0x7fe59c15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a3e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c06f330 con 0x7fe584004d40 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a3e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c06f1b0 con 0x7fe59c157580 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a3e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe59c06f4b0 con 0x7fe59c13c6e0 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 0x7fe59c145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 0x7fe59c145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56300/0 (socket says 172.21.15.99:56300) 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a1400640 1 -- 172.21.15.99:0/2199640523 learned_addr learned my addr 172.21.15.99:0/2199640523 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a1e00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13c6e0 0x7fe59c15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a0a00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c157580 0x7fe59c146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a1400640 1 -- 172.21.15.99:0/2199640523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13c6e0 msgr2=0x7fe59c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a1400640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13c6e0 0x7fe59c15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a1400640 1 -- 172.21.15.99:0/2199640523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c157580 msgr2=0x7fe59c146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a1400640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c157580 0x7fe59c146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.809+0000 7fe5a1400640 1 -- 172.21.15.99:0/2199640523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59c157b40 con 0x7fe584004d40 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.810+0000 7fe5a0a00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c157580 0x7fe59c146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.810+0000 7fe5a1400640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 0x7fe59c145110 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe5900119d0 tx=0x7fe590011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.810+0000 7fe599600640 1 -- 172.21.15.99:0/2199640523 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59000fb50 con 0x7fe584004d40 2024-09-10T07:40:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.810+0000 7fe599600640 1 -- 172.21.15.99:0/2199640523 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59000fcf0 con 0x7fe584004d40 2024-09-10T07:40:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.810+0000 7fe5a3e00640 1 -- 172.21.15.99:0/2199640523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59c144350 con 0x7fe584004d40 2024-09-10T07:40:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.810+0000 7fe599600640 1 -- 172.21.15.99:0/2199640523 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59000fea0 con 0x7fe584004d40 2024-09-10T07:40:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.810+0000 7fe5a3e00640 1 -- 172.21.15.99:0/2199640523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59c144910 con 0x7fe584004d40 2024-09-10T07:40:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.811+0000 7fe5a3e00640 1 -- 172.21.15.99:0/2199640523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe59c160540 con 0x7fe584004d40 2024-09-10T07:40:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.812+0000 7fe599600640 1 -- 172.21.15.99:0/2199640523 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe590012040 con 0x7fe584004d40 2024-09-10T07:40:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.813+0000 7fe599600640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe57c06be60 0x7fe57c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.814+0000 7fe599600640 1 -- 172.21.15.99:0/2199640523 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7fe59008b300 con 0x7fe584004d40 2024-09-10T07:40:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.814+0000 7fe5a0a00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe57c06be60 0x7fe57c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:14.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.814+0000 7fe5a0a00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe57c06be60 0x7fe57c06e320 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe59c1458a0 tx=0x7fe588009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:14.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:14.818+0000 7fe599600640 1 -- 172.21.15.99:0/2199640523 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe590019030 con 0x7fe584004d40 2024-09-10T07:40:15.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.002+0000 7fe5a3e00640 1 -- 172.21.15.99:0/2199640523 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe59c0cef50 con 0x7fe584004d40 2024-09-10T07:40:15.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.002+0000 7fe599600640 1 -- 172.21.15.99:0/2199640523 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+13017 (secure 0 0 0) 0x7fe590059f10 con 0x7fe584004d40 2024-09-10T07:40:15.002 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:15.002 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":131,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:40:13.621317+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6837/106508261":"2024-09-11T07:40:10.606688+0000","172.21.15.99:6836/106508261":"2024-09-11T07:40:10.606688+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:40:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 -- 172.21.15.99:0/2199640523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe57c06be60 msgr2=0x7fe57c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe57c06be60 0x7fe57c06e320 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe59c1458a0 tx=0x7fe588009040 comp rx=0 tx=0).stop 2024-09-10T07:40:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 -- 172.21.15.99:0/2199640523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 msgr2=0x7fe59c145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 0x7fe59c145110 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe5900119d0 tx=0x7fe590011e90 comp rx=0 tx=0).stop 2024-09-10T07:40:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 -- 172.21.15.99:0/2199640523 shutdown_connections 2024-09-10T07:40:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe59c13c6e0 0x7fe59c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c157580 0x7fe59c146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe57c06be60 0x7fe57c06e320 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 --2- 172.21.15.99:0/2199640523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe584004d40 0x7fe59c145110 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 -- 172.21.15.99:0/2199640523 >> 172.21.15.99:0/2199640523 conn(0x7fe59c06bc10 msgr2=0x7fe59c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:15.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 -- 172.21.15.99:0/2199640523 shutdown_connections 2024-09-10T07:40:15.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.005+0000 7fe5a3e00640 1 -- 172.21.15.99:0/2199640523 wait complete. 2024-09-10T07:40:15.020 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:34:08.744575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:40:15.021 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:40:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.179+0000 7f6cd9600640 1 Processor -- start 2024-09-10T07:40:15.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.179+0000 7f6cd9600640 1 -- start start 2024-09-10T07:40:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd9600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6cd406e280 0x7f6cd4073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd9600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6cd4071df0 0x7f6cd406e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd9600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cd406eba0 con 0x7f6cd40d1010 2024-09-10T07:40:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd9600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd40738b0 con 0x7f6cd406e280 2024-09-10T07:40:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd9600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd40722d0 con 0x7f6cd4071df0 2024-09-10T07:40:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd2a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6cd406e280 0x7f6cd4073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd2a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6cd406e280 0x7f6cd4073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56304/0 (socket says 172.21.15.99:56304) 2024-09-10T07:40:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd2a00640 1 -- 172.21.15.99:0/3292033698 learned_addr learned my addr 172.21.15.99:0/3292033698 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd2a00640 1 -- 172.21.15.99:0/3292033698 >> v2:172.21.15.187:3300/0 conn(0x7f6cd4071df0 msgr2=0x7f6cd406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd2a00640 1 --2- 172.21.15.99:0/3292033698 >> v2:172.21.15.187:3300/0 conn(0x7f6cd4071df0 0x7f6cd406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd2a00640 1 -- 172.21.15.99:0/3292033698 >> v1:172.21.15.99:6789/0 conn(0x7f6cd40d1010 legacy=0x7f6cd40ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.181+0000 7f6cd2a00640 1 -- 172.21.15.99:0/3292033698 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd40725b0 con 0x7f6cd406e280 2024-09-10T07:40:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.182+0000 7f6cd2a00640 1 --2- 172.21.15.99:0/3292033698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd406e280 0x7f6cd4073370 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4050020 tx=0x7f6cc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d2c6824a85a574 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd2000640 1 -- 172.21.15.99:0/3292033698 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4037070 con 0x7f6cd406e280 2024-09-10T07:40:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd2000640 1 -- 172.21.15.99:0/3292033698 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc4032440 con 0x7f6cd406e280 2024-09-10T07:40:15.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd2000640 1 -- 172.21.15.99:0/3292033698 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4032810 con 0x7f6cd406e280 2024-09-10T07:40:15.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd9600640 1 -- 172.21.15.99:0/3292033698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd406e280 msgr2=0x7f6cd4073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd9600640 1 --2- 172.21.15.99:0/3292033698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd406e280 0x7f6cd4073370 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4050020 tx=0x7f6cc402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:15.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd9600640 1 -- 172.21.15.99:0/3292033698 shutdown_connections 2024-09-10T07:40:15.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd9600640 1 --2- 172.21.15.99:0/3292033698 >> v2:172.21.15.187:3300/0 conn(0x7f6cd4071df0 0x7f6cd406e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd9600640 1 --2- 172.21.15.99:0/3292033698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd406e280 0x7f6cd4073370 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd9600640 1 -- 172.21.15.99:0/3292033698 >> 172.21.15.99:0/3292033698 conn(0x7f6cd406bc10 msgr2=0x7f6cd406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:15.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd9600640 1 -- 172.21.15.99:0/3292033698 shutdown_connections 2024-09-10T07:40:15.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.183+0000 7f6cd9600640 1 -- 172.21.15.99:0/3292033698 wait complete. 2024-09-10T07:40:15.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.185+0000 7f6cd9600640 1 Processor -- start 2024-09-10T07:40:15.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.185+0000 7f6cd9600640 1 -- start start 2024-09-10T07:40:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd9600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd406e280 0x7f6cd40c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd9600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cd4071df0 0x7f6cd414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd40d1010 0x7f6cd414dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd9600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd4072e50 con 0x7f6cd40d1010 2024-09-10T07:40:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd9600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd4072b70 con 0x7f6cd406e280 2024-09-10T07:40:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd9600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd415db60 con 0x7f6cd4071df0 2024-09-10T07:40:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd40d1010 0x7f6cd414dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd40d1010 0x7f6cd414dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56306/0 (socket says 172.21.15.99:56306) 2024-09-10T07:40:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd3400640 1 -- 172.21.15.99:0/20087860 learned_addr learned my addr 172.21.15.99:0/20087860 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd3400640 1 -- 172.21.15.99:0/20087860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cd4071df0 msgr2=0x7f6cd414d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cd2a00640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd406e280 0x7f6cd40c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.186+0000 7f6cca000640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cd4071df0 0x7f6cd414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6cd3400640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cd4071df0 0x7f6cd414d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6cd3400640 1 -- 172.21.15.99:0/20087860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd406e280 msgr2=0x7f6cd40c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6cd3400640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd406e280 0x7f6cd40c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6cd3400640 1 -- 172.21.15.99:0/20087860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd414d830 con 0x7f6cd40d1010 2024-09-10T07:40:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6cd2a00640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd406e280 0x7f6cd40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6cca000640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cd4071df0 0x7f6cd414d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6cd3400640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd40d1010 0x7f6cd414dc20 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c6b0 tx=0x7f6ccc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6ccb400640 1 -- 172.21.15.99:0/20087860 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc003b70 con 0x7f6cd40d1010 2024-09-10T07:40:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6ccb400640 1 -- 172.21.15.99:0/20087860 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ccc003d30 con 0x7f6cd40d1010 2024-09-10T07:40:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6ccb400640 1 -- 172.21.15.99:0/20087860 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc005310 con 0x7f6cd40d1010 2024-09-10T07:40:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6cd9600640 1 -- 172.21.15.99:0/20087860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd415a800 con 0x7f6cd40d1010 2024-09-10T07:40:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.187+0000 7f6cd9600640 1 -- 172.21.15.99:0/20087860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd415adc0 con 0x7f6cd40d1010 2024-09-10T07:40:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.188+0000 7f6cd9600640 1 -- 172.21.15.99:0/20087860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd40d14c0 con 0x7f6cd40d1010 2024-09-10T07:40:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.190+0000 7f6ccb400640 1 -- 172.21.15.99:0/20087860 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ccc0054b0 con 0x7f6cd40d1010 2024-09-10T07:40:15.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.190+0000 7f6ccb400640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6cb006be30 0x7f6cb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.191+0000 7f6ccb400640 1 -- 172.21.15.99:0/20087860 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f6ccc08aa20 con 0x7f6cd40d1010 2024-09-10T07:40:15.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.191+0000 7f6cd2a00640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6cb006be30 0x7f6cb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.191+0000 7f6cd2a00640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6cb006be30 0x7f6cb006e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4034000 tx=0x7f6cc402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:15.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.195+0000 7f6ccb400640 1 -- 172.21.15.99:0/20087860 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cd414d830 con 0x7f6cd40d1010 2024-09-10T07:40:15.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.368+0000 7f6cd9600640 1 -- 172.21.15.99:0/20087860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6cd40d08e0 con 0x7f6cd40d1010 2024-09-10T07:40:15.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.369+0000 7f6ccb400640 1 -- 172.21.15.99:0/20087860 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v131) ==== 93+0+10 (secure 0 0 0) 0x7f6ccc0596c0 con 0x7f6cd40d1010 2024-09-10T07:40:15.369 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-10T07:40:15.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 -- 172.21.15.99:0/20087860 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6cb006be30 msgr2=0x7f6cb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6cb006be30 0x7f6cb006e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4034000 tx=0x7f6cc402e000 comp rx=0 tx=0).stop 2024-09-10T07:40:15.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 -- 172.21.15.99:0/20087860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd40d1010 msgr2=0x7f6cd414dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd40d1010 0x7f6cd414dc20 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c6b0 tx=0x7f6ccc00cb70 comp rx=0 tx=0).stop 2024-09-10T07:40:15.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 -- 172.21.15.99:0/20087860 shutdown_connections 2024-09-10T07:40:15.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6cb006be30 0x7f6cb006e2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd40d1010 0x7f6cd414dc20 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cd4071df0 0x7f6cd414d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 --2- 172.21.15.99:0/20087860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd406e280 0x7f6cd40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 -- 172.21.15.99:0/20087860 >> 172.21.15.99:0/20087860 conn(0x7f6cd406bc10 msgr2=0x7f6cd415f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:15.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 -- 172.21.15.99:0/20087860 shutdown_connections 2024-09-10T07:40:15.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.371+0000 7f6cd9600640 1 -- 172.21.15.99:0/20087860 wait complete. 2024-09-10T07:40:15.387 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-10T07:40:15.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.542+0000 7f600d600640 1 Processor -- start 2024-09-10T07:40:15.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.543+0000 7f600d600640 1 -- start start 2024-09-10T07:40:15.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.544+0000 7f600d600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6008160c50 0x7f6008167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.544+0000 7f600d600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6008142650 con 0x7f6008142150 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.544+0000 7f600d600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6008142930 con 0x7f600813fae0 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.544+0000 7f600d600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f60080ce780 con 0x7f6008160c50 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.544+0000 7f6006000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6008142150 0x7f6008160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51628/0 (socket says 172.21.15.99:51628) 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.544+0000 7f6006000640 1 -- 172.21.15.99:0/2556894636 learned_addr learned my addr 172.21.15.99:0/2556894636 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.544+0000 7f6007400640 1 --2- 172.21.15.99:0/2556894636 >> v2:172.21.15.187:3300/0 conn(0x7f6008160c50 0x7f6008167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.544+0000 7f6005600640 1 -- 172.21.15.99:0/2556894636 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3874906166 0 0) 0x7f6008142650 con 0x7f6008142150 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.544+0000 7f6005600640 1 -- 172.21.15.99:0/2556894636 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fec003520 con 0x7f6008142150 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.545+0000 7f6005600640 1 -- 172.21.15.99:0/2556894636 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334046775 0 0) 0x7f6008142930 con 0x7f600813fae0 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.545+0000 7f6005600640 1 -- 172.21.15.99:0/2556894636 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6008142650 con 0x7f600813fae0 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.545+0000 7f6007400640 1 -- 172.21.15.99:0/2556894636 >> v1:172.21.15.187:6789/0 conn(0x7f600813fae0 legacy=0x7f600806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.545+0000 7f6007400640 1 -- 172.21.15.99:0/2556894636 >> v1:172.21.15.99:6789/0 conn(0x7f6008142150 legacy=0x7f6008160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.545+0000 7f6005600640 1 -- 172.21.15.99:0/2556894636 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 230933899 0 0) 0x7f5fec003520 con 0x7f6008142150 2024-09-10T07:40:15.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.545+0000 7f6007400640 1 -- 172.21.15.99:0/2556894636 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6008142c10 con 0x7f6008160c50 2024-09-10T07:40:15.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.546+0000 7f6007400640 1 --2- 172.21.15.99:0/2556894636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6008160c50 0x7f6008167680 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6000009d90 tx=0x7f600002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bffa03166de012e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:15.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.546+0000 7f6005600640 1 -- 172.21.15.99:0/2556894636 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4001670 con 0x7f6008160c50 2024-09-10T07:40:15.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.546+0000 7f6005600640 1 -- 172.21.15.99:0/2556894636 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6000007540 con 0x7f6008160c50 2024-09-10T07:40:15.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.546+0000 7f6005600640 1 -- 172.21.15.99:0/2556894636 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60000078f0 con 0x7f6008160c50 2024-09-10T07:40:15.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.547+0000 7f600d600640 1 -- 172.21.15.99:0/2556894636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6008160c50 msgr2=0x7f6008167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.547+0000 7f600d600640 1 --2- 172.21.15.99:0/2556894636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6008160c50 0x7f6008167680 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6000009d90 tx=0x7f600002a5f0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.547+0000 7f600d600640 1 -- 172.21.15.99:0/2556894636 shutdown_connections 2024-09-10T07:40:15.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.547+0000 7f600d600640 1 --2- 172.21.15.99:0/2556894636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6008160c50 0x7f6008167680 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.547+0000 7f600d600640 1 -- 172.21.15.99:0/2556894636 >> 172.21.15.99:0/2556894636 conn(0x7f600806bc10 msgr2=0x7f600806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:15.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.547+0000 7f600d600640 1 -- 172.21.15.99:0/2556894636 shutdown_connections 2024-09-10T07:40:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.547+0000 7f600d600640 1 -- 172.21.15.99:0/2556894636 wait complete. 2024-09-10T07:40:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.548+0000 7f600d600640 1 Processor -- start 2024-09-10T07:40:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.549+0000 7f600d600640 1 -- start start 2024-09-10T07:40:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.549+0000 7f600d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600813fae0 0x7f6008141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.549+0000 7f600d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6008142150 0x7f60081419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.549+0000 7f600d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008160c50 0x7f6008143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.549+0000 7f600d600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f60080cfda0 con 0x7f6008160c50 2024-09-10T07:40:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.549+0000 7f600d600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f60080cfc20 con 0x7f600813fae0 2024-09-10T07:40:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.549+0000 7f600d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f60080cff20 con 0x7f6008142150 2024-09-10T07:40:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6007400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008160c50 0x7f6008143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6007400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008160c50 0x7f6008143d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56308/0 (socket says 172.21.15.99:56308) 2024-09-10T07:40:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6007400640 1 -- 172.21.15.99:0/3693457715 learned_addr learned my addr 172.21.15.99:0/3693457715 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:15.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6006000640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6008142150 0x7f60081419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6006a00640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600813fae0 0x7f6008141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6007400640 1 -- 172.21.15.99:0/3693457715 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6008142150 msgr2=0x7f60081419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6007400640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6008142150 0x7f60081419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6007400640 1 -- 172.21.15.99:0/3693457715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600813fae0 msgr2=0x7f6008141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:15.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6007400640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600813fae0 0x7f6008141470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:15.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6007400640 1 -- 172.21.15.99:0/3693457715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60081434d0 con 0x7f6008160c50 2024-09-10T07:40:15.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6006a00640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600813fae0 0x7f6008141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:15.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.550+0000 7f6007400640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008160c50 0x7f6008143d80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6000009eb0 tx=0x7f6000004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:15.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.551+0000 7f5ffea00640 1 -- 172.21.15.99:0/3693457715 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000009450 con 0x7f6008160c50 2024-09-10T07:40:15.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.551+0000 7f5ffea00640 1 -- 172.21.15.99:0/3693457715 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6000004240 con 0x7f6008160c50 2024-09-10T07:40:15.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.551+0000 7f5ffea00640 1 -- 172.21.15.99:0/3693457715 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60000045f0 con 0x7f6008160c50 2024-09-10T07:40:15.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.551+0000 7f600d600640 1 -- 172.21.15.99:0/3693457715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60081f2b10 con 0x7f6008160c50 2024-09-10T07:40:15.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.551+0000 7f600d600640 1 -- 172.21.15.99:0/3693457715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60081f30d0 con 0x7f6008160c50 2024-09-10T07:40:15.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.552+0000 7f600d600640 1 -- 172.21.15.99:0/3693457715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6008160540 con 0x7f6008160c50 2024-09-10T07:40:15.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.553+0000 7f5ffea00640 1 -- 172.21.15.99:0/3693457715 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f600003b410 con 0x7f6008160c50 2024-09-10T07:40:15.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.554+0000 7f5ffea00640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fe806be30 0x7f5fe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:15.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.554+0000 7f5ffea00640 1 -- 172.21.15.99:0/3693457715 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f60000abd80 con 0x7f6008160c50 2024-09-10T07:40:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.554+0000 7f6006a00640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fe806be30 0x7f5fe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.555+0000 7f6006a00640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fe806be30 0x7f5fe806e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80011e0 tx=0x7f5ff8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:15.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.558+0000 7f5ffea00640 1 -- 172.21.15.99:0/3693457715 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f600003f030 con 0x7f6008160c50 2024-09-10T07:40:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:15.795+0000 7f600d600640 1 -- 172.21.15.99:0/3693457715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) -- 0x7f60080b0ab0 con 0x7f6008160c50 2024-09-10T07:40:16.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.637+0000 7f5ffea00640 1 -- 172.21.15.99:0/3693457715 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v313) ==== 143+0+0 (secure 0 0 0) 0x7f600007a3e0 con 0x7f6008160c50 2024-09-10T07:40:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 -- 172.21.15.99:0/3693457715 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fe806be30 msgr2=0x7f5fe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fe806be30 0x7f5fe806e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80011e0 tx=0x7f5ff8009040 comp rx=0 tx=0).stop 2024-09-10T07:40:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 -- 172.21.15.99:0/3693457715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008160c50 msgr2=0x7f6008143d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008160c50 0x7f6008143d80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6000009eb0 tx=0x7f6000004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 -- 172.21.15.99:0/3693457715 shutdown_connections 2024-09-10T07:40:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fe806be30 0x7f5fe806e2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6008160c50 0x7f6008143d80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6008142150 0x7f60081419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 --2- 172.21.15.99:0/3693457715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600813fae0 0x7f6008141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 -- 172.21.15.99:0/3693457715 >> 172.21.15.99:0/3693457715 conn(0x7f600806bc10 msgr2=0x7f60080ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 -- 172.21.15.99:0/3693457715 shutdown_connections 2024-09-10T07:40:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.640+0000 7f600d600640 1 -- 172.21.15.99:0/3693457715 wait complete. 2024-09-10T07:40:16.659 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T07:40:16.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.819+0000 7f688f600640 1 Processor -- start 2024-09-10T07:40:16.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.820+0000 7f688f600640 1 -- start start 2024-09-10T07:40:16.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.821+0000 7f688f600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6888071df0 0x7f6888073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:16.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.821+0000 7f688f600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f68880d1010 0x7f68880ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.821+0000 7f688f600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68880722d0 con 0x7f688806e280 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.821+0000 7f688f600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f68880738b0 con 0x7f6888071df0 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.821+0000 7f688f600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f68880725b0 con 0x7f68880d1010 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.821+0000 7f6887e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6888071df0 0x7f6888073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.821+0000 7f6887e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6888071df0 0x7f6888073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56322/0 (socket says 172.21.15.99:56322) 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.821+0000 7f688cc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f688806e280 0x7f688806e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51638/0 (socket says 172.21.15.99:51638) 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.821+0000 7f6887e00640 1 -- 172.21.15.99:0/1690075480 learned_addr learned my addr 172.21.15.99:0/1690075480 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.822+0000 7f688d600640 1 --2- 172.21.15.99:0/1690075480 >> v2:172.21.15.187:3300/0 conn(0x7f68880d1010 0x7f68880ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.822+0000 7f6887e00640 1 -- 172.21.15.99:0/1690075480 >> v2:172.21.15.187:3300/0 conn(0x7f68880d1010 msgr2=0x7f68880ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.822+0000 7f6887e00640 1 --2- 172.21.15.99:0/1690075480 >> v2:172.21.15.187:3300/0 conn(0x7f68880d1010 0x7f68880ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.822+0000 7f6887e00640 1 -- 172.21.15.99:0/1690075480 >> v1:172.21.15.99:6789/0 conn(0x7f688806e280 legacy=0x7f688806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.822+0000 7f6887400640 1 -- 172.21.15.99:0/1690075480 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187319169 0 0) 0x7f68880722d0 con 0x7f688806e280 2024-09-10T07:40:16.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.822+0000 7f6887e00640 1 -- 172.21.15.99:0/1690075480 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888072890 con 0x7f6888071df0 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.823+0000 7f6887e00640 1 --2- 172.21.15.99:0/1690075480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6888071df0 0x7f6888073370 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f68880b5ca0 tx=0x7f687402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc0efb97474fe22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.823+0000 7f6887400640 1 -- 172.21.15.99:0/1690075480 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6874037070 con 0x7f6888071df0 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.823+0000 7f6887400640 1 -- 172.21.15.99:0/1690075480 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6874032440 con 0x7f6888071df0 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.823+0000 7f6887400640 1 -- 172.21.15.99:0/1690075480 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6874032810 con 0x7f6888071df0 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.823+0000 7f688f600640 1 -- 172.21.15.99:0/1690075480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6888071df0 msgr2=0x7f6888073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.823+0000 7f688f600640 1 --2- 172.21.15.99:0/1690075480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6888071df0 0x7f6888073370 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f68880b5ca0 tx=0x7f687402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.824+0000 7f688f600640 1 -- 172.21.15.99:0/1690075480 shutdown_connections 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.824+0000 7f688f600640 1 --2- 172.21.15.99:0/1690075480 >> v2:172.21.15.187:3300/0 conn(0x7f68880d1010 0x7f68880ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.824+0000 7f688f600640 1 --2- 172.21.15.99:0/1690075480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6888071df0 0x7f6888073370 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.824+0000 7f688f600640 1 -- 172.21.15.99:0/1690075480 >> 172.21.15.99:0/1690075480 conn(0x7f688806bc10 msgr2=0x7f688806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.824+0000 7f688f600640 1 -- 172.21.15.99:0/1690075480 shutdown_connections 2024-09-10T07:40:16.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.824+0000 7f688f600640 1 -- 172.21.15.99:0/1690075480 wait complete. 2024-09-10T07:40:16.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.825+0000 7f688f600640 1 Processor -- start 2024-09-10T07:40:16.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.825+0000 7f688f600640 1 -- start start 2024-09-10T07:40:16.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.826+0000 7f688f600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688806e280 0x7f68880b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:16.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.826+0000 7f688f600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6888071df0 0x7f688814a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:16.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.826+0000 7f688f600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68880d1010 0x7f68881f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.826+0000 7f688f600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f688815db60 con 0x7f68880d1010 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.826+0000 7f688f600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6888072e50 con 0x7f6888071df0 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.826+0000 7f688f600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f68880d14c0 con 0x7f688806e280 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f688d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68880d1010 0x7f68881f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f688d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68880d1010 0x7f68881f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56336/0 (socket says 172.21.15.99:56336) 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f688d600640 1 -- 172.21.15.99:0/2861542300 learned_addr learned my addr 172.21.15.99:0/2861542300 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f6887e00640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6888071df0 0x7f688814a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f688cc00640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688806e280 0x7f68880b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f688d600640 1 -- 172.21.15.99:0/2861542300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688806e280 msgr2=0x7f68880b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f688d600640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688806e280 0x7f68880b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f688d600640 1 -- 172.21.15.99:0/2861542300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6888071df0 msgr2=0x7f688814a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:16.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f688d600640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6888071df0 0x7f688814a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f688d600640 1 -- 172.21.15.99:0/2861542300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888155420 con 0x7f68880d1010 2024-09-10T07:40:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f6887e00640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6888071df0 0x7f688814a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.827+0000 7f688d600640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68880d1010 0x7f68881f4500 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6880007e90 tx=0x7f688000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.828+0000 7f6884c00640 1 -- 172.21.15.99:0/2861542300 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880014420 con 0x7f68880d1010 2024-09-10T07:40:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.828+0000 7f6884c00640 1 -- 172.21.15.99:0/2861542300 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6880019070 con 0x7f68880d1010 2024-09-10T07:40:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.828+0000 7f6884c00640 1 -- 172.21.15.99:0/2861542300 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880014800 con 0x7f68880d1010 2024-09-10T07:40:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.828+0000 7f688f600640 1 -- 172.21.15.99:0/2861542300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6888155700 con 0x7f68880d1010 2024-09-10T07:40:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.828+0000 7f688f600640 1 -- 172.21.15.99:0/2861542300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68880b2270 con 0x7f68880d1010 2024-09-10T07:40:16.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.829+0000 7f688f600640 1 -- 172.21.15.99:0/2861542300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6888073370 con 0x7f68880d1010 2024-09-10T07:40:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.830+0000 7f6884c00640 1 -- 172.21.15.99:0/2861542300 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68800149a0 con 0x7f68880d1010 2024-09-10T07:40:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.830+0000 7f6884c00640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f686806be30 0x7f686806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.831+0000 7f6884c00640 1 -- 172.21.15.99:0/2861542300 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f688008b2e0 con 0x7f68880d1010 2024-09-10T07:40:16.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.831+0000 7f688cc00640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f686806be30 0x7f686806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:16.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.831+0000 7f688cc00640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f686806be30 0x7f686806e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6878000f60 tx=0x7f6878007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:16.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:16.835+0000 7f6884c00640 1 -- 172.21.15.99:0/2861542300 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f688005a020 con 0x7f68880d1010 2024-09-10T07:40:17.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.008+0000 7f688f600640 1 -- 172.21.15.99:0/2861542300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f688806eb70 con 0x7f68880d1010 2024-09-10T07:40:17.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.011+0000 7f6884c00640 1 -- 172.21.15.99:0/2861542300 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f6880059920 con 0x7f68880d1010 2024-09-10T07:40:17.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.013+0000 7f688f600640 1 -- 172.21.15.99:0/2861542300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f686806be30 msgr2=0x7f686806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.013+0000 7f688f600640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f686806be30 0x7f686806e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6878000f60 tx=0x7f6878007b50 comp rx=0 tx=0).stop 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.013+0000 7f688f600640 1 -- 172.21.15.99:0/2861542300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68880d1010 msgr2=0x7f68881f4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.013+0000 7f688f600640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68880d1010 0x7f68881f4500 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6880007e90 tx=0x7f688000e4b0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.014+0000 7f688f600640 1 -- 172.21.15.99:0/2861542300 shutdown_connections 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.014+0000 7f688f600640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f686806be30 0x7f686806e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.014+0000 7f688f600640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68880d1010 0x7f68881f4500 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.014+0000 7f688f600640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6888071df0 0x7f688814a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.014+0000 7f688f600640 1 --2- 172.21.15.99:0/2861542300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688806e280 0x7f68880b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.014+0000 7f688f600640 1 -- 172.21.15.99:0/2861542300 >> 172.21.15.99:0/2861542300 conn(0x7f688806bc10 msgr2=0x7f68880cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.014+0000 7f688f600640 1 -- 172.21.15.99:0/2861542300 shutdown_connections 2024-09-10T07:40:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.014+0000 7f688f600640 1 -- 172.21.15.99:0/2861542300 wait complete. 2024-09-10T07:40:17.030 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:40:17.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:40:17.108 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:40:17.198 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:40:17.198 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:17.198 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:17.234 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:40:17.234 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:40:17.234 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:17.264 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:40:17.271 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:40:17.271 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:17.271 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:17.279 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:40:17.313 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:40:17.313 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:40:17.313 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:17.351 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:40:17.351 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T07:40:17.352 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:17.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.506+0000 7f8da4c00640 1 Processor -- start 2024-09-10T07:40:17.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.506+0000 7f8da4c00640 1 -- start start 2024-09-10T07:40:17.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.507+0000 7f8da4c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8da0142150 0x7f8da0160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.507+0000 7f8da4c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da0160a80 0x7f8da00cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8da4c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da0142650 con 0x7f8da013fae0 2024-09-10T07:40:17.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8da4c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8da00ce780 con 0x7f8da0142150 2024-09-10T07:40:17.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8da4c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8da0142930 con 0x7f8da0160a80 2024-09-10T07:40:17.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8d9e800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da0160a80 0x7f8da00cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8d9d400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8da0142150 0x7f8da0160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8d9d400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8da0142150 0x7f8da0160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:50172/0 (socket says 172.21.15.99:50172) 2024-09-10T07:40:17.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8d9e800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da0160a80 0x7f8da00cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:55616/0 (socket says 172.21.15.99:55616) 2024-09-10T07:40:17.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8d9d400640 1 -- 172.21.15.99:0/1136894841 learned_addr learned my addr 172.21.15.99:0/1136894841 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:17.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8d9d400640 1 -- 172.21.15.99:0/1136894841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da0160a80 msgr2=0x7f8da00cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:17.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8d9d400640 1 --2- 172.21.15.99:0/1136894841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da0160a80 0x7f8da00cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8d9d400640 1 -- 172.21.15.99:0/1136894841 >> v1:172.21.15.187:6789/0 conn(0x7f8da013fae0 legacy=0x7f8da006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.508+0000 7f8d9d400640 1 -- 172.21.15.99:0/1136894841 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da0142c10 con 0x7f8da0142150 2024-09-10T07:40:17.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.509+0000 7f8d9d400640 1 --2- 172.21.15.99:0/1136894841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8da0142150 0x7f8da0160540 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009870 tx=0x7f8d8c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa1a20bbaa517d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8d9ca00640 1 -- 172.21.15.99:0/1136894841 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c037070 con 0x7f8da0142150 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8d9ca00640 1 -- 172.21.15.99:0/1136894841 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8c032440 con 0x7f8da0142150 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8d9ca00640 1 -- 172.21.15.99:0/1136894841 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c032810 con 0x7f8da0142150 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8da4c00640 1 -- 172.21.15.99:0/1136894841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8da0142150 msgr2=0x7f8da0160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8da4c00640 1 --2- 172.21.15.99:0/1136894841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8da0142150 0x7f8da0160540 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009870 tx=0x7f8d8c02a1e0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8da4c00640 1 -- 172.21.15.99:0/1136894841 shutdown_connections 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8da4c00640 1 --2- 172.21.15.99:0/1136894841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da0160a80 0x7f8da00cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8da4c00640 1 --2- 172.21.15.99:0/1136894841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8da0142150 0x7f8da0160540 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8da4c00640 1 -- 172.21.15.99:0/1136894841 >> 172.21.15.99:0/1136894841 conn(0x7f8da006bc10 msgr2=0x7f8da006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8da4c00640 1 -- 172.21.15.99:0/1136894841 shutdown_connections 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.510+0000 7f8da4c00640 1 -- 172.21.15.99:0/1136894841 wait complete. 2024-09-10T07:40:17.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.512+0000 7f8da4c00640 1 Processor -- start 2024-09-10T07:40:17.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.512+0000 7f8da4c00640 1 -- start start 2024-09-10T07:40:17.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8da4c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da013fae0 0x7f8da013e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8da4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0142150 0x7f8da00b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8da4c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8da0160a80 0x7f8da015b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8da4c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8da00cf2d0 con 0x7f8da0142150 2024-09-10T07:40:17.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8da4c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8da00cf150 con 0x7f8da0160a80 2024-09-10T07:40:17.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8da4c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8da00cf450 con 0x7f8da013fae0 2024-09-10T07:40:17.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8d9d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0142150 0x7f8da00b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8d9d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0142150 0x7f8da00b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56348/0 (socket says 172.21.15.99:56348) 2024-09-10T07:40:17.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8d9d400640 1 -- 172.21.15.99:0/122839423 learned_addr learned my addr 172.21.15.99:0/122839423 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:17.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8d9de00640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da013fae0 0x7f8da013e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8d9e800640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8da0160a80 0x7f8da015b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8d9d400640 1 -- 172.21.15.99:0/122839423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da013fae0 msgr2=0x7f8da013e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.513+0000 7f8d9d400640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da013fae0 0x7f8da013e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.514+0000 7f8d9d400640 1 -- 172.21.15.99:0/122839423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8da0160a80 msgr2=0x7f8da015b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.514+0000 7f8d9d400640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8da0160a80 0x7f8da015b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.514+0000 7f8d9d400640 1 -- 172.21.15.99:0/122839423 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da00b44e0 con 0x7f8da0142150 2024-09-10T07:40:17.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.514+0000 7f8d9d400640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0142150 0x7f8da00b4fd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c000c00 tx=0x7f8d8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:17.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.514+0000 7f8d96000640 1 -- 172.21.15.99:0/122839423 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c037040 con 0x7f8da0142150 2024-09-10T07:40:17.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.514+0000 7f8d96000640 1 -- 172.21.15.99:0/122839423 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8c042070 con 0x7f8da0142150 2024-09-10T07:40:17.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.514+0000 7f8da4c00640 1 -- 172.21.15.99:0/122839423 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da00b47c0 con 0x7f8da0142150 2024-09-10T07:40:17.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.514+0000 7f8d96000640 1 -- 172.21.15.99:0/122839423 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c030880 con 0x7f8da0142150 2024-09-10T07:40:17.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.514+0000 7f8da4c00640 1 -- 172.21.15.99:0/122839423 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da01433c0 con 0x7f8da0142150 2024-09-10T07:40:17.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.515+0000 7f8da4c00640 1 -- 172.21.15.99:0/122839423 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da0160540 con 0x7f8da0142150 2024-09-10T07:40:17.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.516+0000 7f8d96000640 1 -- 172.21.15.99:0/122839423 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d8c030a20 con 0x7f8da0142150 2024-09-10T07:40:17.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.518+0000 7f8d96000640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8d8006be30 0x7f8d8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.518+0000 7f8d96000640 1 -- 172.21.15.99:0/122839423 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f8d8c0ab3b0 con 0x7f8da0142150 2024-09-10T07:40:17.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.518+0000 7f8d9de00640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8d8006be30 0x7f8d8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.519+0000 7f8d9de00640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8d8006be30 0x7f8d8006e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8da0156c70 tx=0x7f8d90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.522+0000 7f8d96000640 1 -- 172.21.15.99:0/122839423 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d8c07a050 con 0x7f8da0142150 2024-09-10T07:40:17.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.732+0000 7f8da4c00640 1 -- 172.21.15.99:0/122839423 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8da00b5510 con 0x7f8da0142150 2024-09-10T07:40:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.732+0000 7f8d96000640 1 -- 172.21.15.99:0/122839423 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+3911 (secure 0 0 0) 0x7f8d8c079950 con 0x7f8da0142150 2024-09-10T07:40:17.732 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:17.732 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":59,"btime":"2024-09-10T07:40:11:610181+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5630,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/269606175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":269606175},{"type":"v1","addr":"172.21.15.187:6834","nonce":269606175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6127,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2513906672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2513906672},{"type":"v1","addr":"172.21.15.187:6835","nonce":2513906672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6462,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3548731230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":3548731230},{"type":"v1","addr":"172.21.15.99:6835","nonce":3548731230}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6702,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/416874124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":416874124},{"type":"v1","addr":"172.21.15.99:6837","nonce":416874124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[]} 2024-09-10T07:40:17.733 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 59 2024-09-10T07:40:17.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.734+0000 7f8da4c00640 1 -- 172.21.15.99:0/122839423 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8d8006be30 msgr2=0x7f8d8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.734+0000 7f8da4c00640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8d8006be30 0x7f8d8006e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8da0156c70 tx=0x7f8d90009040 comp rx=0 tx=0).stop 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.734+0000 7f8da4c00640 1 -- 172.21.15.99:0/122839423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0142150 msgr2=0x7f8da00b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.734+0000 7f8da4c00640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0142150 0x7f8da00b4fd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c000c00 tx=0x7f8d8c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.734+0000 7f8da4c00640 1 -- 172.21.15.99:0/122839423 shutdown_connections 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.734+0000 7f8da4c00640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8da0160a80 0x7f8da015b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.734+0000 7f8da4c00640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8d8006be30 0x7f8d8006e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.734+0000 7f8da4c00640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8da0142150 0x7f8da00b4fd0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.734+0000 7f8da4c00640 1 --2- 172.21.15.99:0/122839423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8da013fae0 0x7f8da013e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.734+0000 7f8da4c00640 1 -- 172.21.15.99:0/122839423 >> 172.21.15.99:0/122839423 conn(0x7f8da006bc10 msgr2=0x7f8da015f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.735+0000 7f8da4c00640 1 -- 172.21.15.99:0/122839423 shutdown_connections 2024-09-10T07:40:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.735+0000 7f8da4c00640 1 -- 172.21.15.99:0/122839423 wait complete. 2024-09-10T07:40:17.751 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:40:17.751 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T07:40:17.751 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:40:17.752 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:40:17.752 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:40:17.752 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T07:40:17.752 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:40:17.752 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:40:17.752 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:40:17.752 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T07:40:17.753 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:40:17.753 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:40:17.753 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:40:17.753 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T07:40:17.753 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:40:17.753 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:40:17.766 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:40:17.767 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:40:17.767 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:40:17.768 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:40:17.769 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:40:17.769 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:40:17.769 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:40:17.770 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:40:17.811 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:40:17.811 DEBUG:teuthology.parallel:result is None 2024-09-10T07:40:17.812 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:40:17.813 DEBUG:teuthology.parallel:result is None 2024-09-10T07:40:17.813 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:40:17.813 DEBUG:teuthology.parallel:result is None 2024-09-10T07:40:17.814 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:40:17.815 DEBUG:teuthology.parallel:result is None 2024-09-10T07:40:17.815 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T07:40:17.941 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:40:17.941 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:40:17.942 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:40:17.942 INFO:tasks.ceph.mds.b.smithi187.stderr:2024-09-10T07:40:17.943+0000 7fb1dc200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-10T07:40:17.943 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:40:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.979+0000 7f6e68000640 1 Processor -- start 2024-09-10T07:40:17.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.980+0000 7f6e68000640 1 -- start start 2024-09-10T07:40:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e68000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e6015ee60 0x7f6e6006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e68000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6e600b5180 0x7f6e6006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e68000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e600d19b0 con 0x7f6e6006dc40 2024-09-10T07:40:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e68000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f6e6015f240 con 0x7f6e6015ee60 2024-09-10T07:40:17.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e68000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f6e6006e090 con 0x7f6e600b5180 2024-09-10T07:40:17.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e65600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e6015ee60 0x7f6e6006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e65600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e6015ee60 0x7f6e6006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56390/0 (socket says 172.21.15.99:56390) 2024-09-10T07:40:17.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e65600640 1 -- 172.21.15.99:0/3694108784 learned_addr learned my addr 172.21.15.99:0/3694108784 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:17.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e64c00640 1 --2- 172.21.15.99:0/3694108784 >> v2:172.21.15.187:3300/0 conn(0x7f6e600b5180 0x7f6e6006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e65600640 1 -- 172.21.15.99:0/3694108784 >> v2:172.21.15.187:3300/0 conn(0x7f6e600b5180 msgr2=0x7f6e6006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:17.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e65600640 1 --2- 172.21.15.99:0/3694108784 >> v2:172.21.15.187:3300/0 conn(0x7f6e600b5180 0x7f6e6006d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e65600640 1 -- 172.21.15.99:0/3694108784 >> v1:172.21.15.187:6789/0 conn(0x7f6e6006dc40 legacy=0x7f6e601628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.981+0000 7f6e65600640 1 -- 172.21.15.99:0/3694108784 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e600d1c90 con 0x7f6e6015ee60 2024-09-10T07:40:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.982+0000 7f6e65600640 1 --2- 172.21.15.99:0/3694108784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e6015ee60 0x7f6e6006cd20 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009870 tx=0x7f6e5402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2969bb9316647 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e5fe00640 1 -- 172.21.15.99:0/3694108784 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54037070 con 0x7f6e6015ee60 2024-09-10T07:40:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e5fe00640 1 -- 172.21.15.99:0/3694108784 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e54032440 con 0x7f6e6015ee60 2024-09-10T07:40:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e5fe00640 1 -- 172.21.15.99:0/3694108784 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54032810 con 0x7f6e6015ee60 2024-09-10T07:40:17.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e68000640 1 -- 172.21.15.99:0/3694108784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e6015ee60 msgr2=0x7f6e6006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e68000640 1 --2- 172.21.15.99:0/3694108784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e6015ee60 0x7f6e6006cd20 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009870 tx=0x7f6e5402a2a0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e68000640 1 -- 172.21.15.99:0/3694108784 shutdown_connections 2024-09-10T07:40:17.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e68000640 1 --2- 172.21.15.99:0/3694108784 >> v2:172.21.15.187:3300/0 conn(0x7f6e600b5180 0x7f6e6006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e68000640 1 --2- 172.21.15.99:0/3694108784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e6015ee60 0x7f6e6006cd20 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e68000640 1 -- 172.21.15.99:0/3694108784 >> 172.21.15.99:0/3694108784 conn(0x7f6e600b45f0 msgr2=0x7f6e600b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:17.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e68000640 1 -- 172.21.15.99:0/3694108784 shutdown_connections 2024-09-10T07:40:17.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.983+0000 7f6e68000640 1 -- 172.21.15.99:0/3694108784 wait complete. 2024-09-10T07:40:17.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.985+0000 7f6e68000640 1 Processor -- start 2024-09-10T07:40:17.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.985+0000 7f6e68000640 1 -- start start 2024-09-10T07:40:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e68000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e6006dc40 0x7f6e60151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e68000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e600b5180 0x7f6e600cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e68000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e6015ee60 0x7f6e60152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e68000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6e600b37c0 con 0x7f6e600b5180 2024-09-10T07:40:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e68000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6006d260 con 0x7f6e6006dc40 2024-09-10T07:40:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e68000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6e600b3940 con 0x7f6e6015ee60 2024-09-10T07:40:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e64c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e600b5180 0x7f6e600cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e65600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e6006dc40 0x7f6e60151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e64c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e600b5180 0x7f6e600cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56392/0 (socket says 172.21.15.99:56392) 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e64c00640 1 -- 172.21.15.99:0/1435775682 learned_addr learned my addr 172.21.15.99:0/1435775682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.986+0000 7f6e66000640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e6015ee60 0x7f6e60152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e64c00640 1 -- 172.21.15.99:0/1435775682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e6015ee60 msgr2=0x7f6e60152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e64c00640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e6015ee60 0x7f6e60152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e64c00640 1 -- 172.21.15.99:0/1435775682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e6006dc40 msgr2=0x7f6e60151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e64c00640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e6006dc40 0x7f6e60151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e64c00640 1 -- 172.21.15.99:0/1435775682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e60152490 con 0x7f6e600b5180 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e66000640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e6015ee60 0x7f6e60152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e65600640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e6006dc40 0x7f6e60151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e64c00640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e600b5180 0x7f6e600cc580 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00e870 tx=0x7f6e4c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e5d600640 1 -- 172.21.15.99:0/1435775682 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c017070 con 0x7f6e600b5180 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e5d600640 1 -- 172.21.15.99:0/1435775682 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4c00c940 con 0x7f6e600b5180 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e68000640 1 -- 172.21.15.99:0/1435775682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e600cb7c0 con 0x7f6e600b5180 2024-09-10T07:40:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e5d600640 1 -- 172.21.15.99:0/1435775682 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00cd30 con 0x7f6e600b5180 2024-09-10T07:40:17.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.987+0000 7f6e68000640 1 -- 172.21.15.99:0/1435775682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e600cbd80 con 0x7f6e600b5180 2024-09-10T07:40:17.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.989+0000 7f6e68000640 1 -- 172.21.15.99:0/1435775682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6006d700 con 0x7f6e600b5180 2024-09-10T07:40:17.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.990+0000 7f6e5d600640 1 -- 172.21.15.99:0/1435775682 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e4c01a070 con 0x7f6e600b5180 2024-09-10T07:40:17.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.990+0000 7f6e5d600640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e4006be60 0x7f6e4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:17.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.991+0000 7f6e5d600640 1 -- 172.21.15.99:0/1435775682 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f6e4c08a8a0 con 0x7f6e600b5180 2024-09-10T07:40:17.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.991+0000 7f6e65600640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e4006be60 0x7f6e4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:17.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.991+0000 7f6e65600640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e4006be60 0x7f6e4006e320 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6e54034000 tx=0x7f6e5402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:17.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:17.995+0000 7f6e5d600640 1 -- 172.21.15.99:0/1435775682 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e60152490 con 0x7f6e600b5180 2024-09-10T07:40:18.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.178+0000 7f6e68000640 1 -- 172.21.15.99:0/1435775682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6e600b8a40 con 0x7f6e600b5180 2024-09-10T07:40:18.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.651+0000 7f6e5d600640 1 -- 172.21.15.99:0/1435775682 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v133) ==== 97+0+0 (secure 0 0 0) 0x7f6e4c058f90 con 0x7f6e600b5180 2024-09-10T07:40:18.651 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-09-10T07:40:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.653+0000 7f6e68000640 1 -- 172.21.15.99:0/1435775682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e4006be60 msgr2=0x7f6e4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.653+0000 7f6e68000640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e4006be60 0x7f6e4006e320 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6e54034000 tx=0x7f6e5402e000 comp rx=0 tx=0).stop 2024-09-10T07:40:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.653+0000 7f6e68000640 1 -- 172.21.15.99:0/1435775682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e600b5180 msgr2=0x7f6e600cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.653+0000 7f6e68000640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e600b5180 0x7f6e600cc580 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00e870 tx=0x7f6e4c00ed30 comp rx=0 tx=0).stop 2024-09-10T07:40:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.654+0000 7f6e68000640 1 -- 172.21.15.99:0/1435775682 shutdown_connections 2024-09-10T07:40:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.654+0000 7f6e68000640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e6015ee60 0x7f6e60152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.654+0000 7f6e68000640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6e4006be60 0x7f6e4006e320 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.654+0000 7f6e68000640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e600b5180 0x7f6e600cc580 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.654+0000 7f6e68000640 1 --2- 172.21.15.99:0/1435775682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e6006dc40 0x7f6e60151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.654+0000 7f6e68000640 1 -- 172.21.15.99:0/1435775682 >> 172.21.15.99:0/1435775682 conn(0x7f6e600b45f0 msgr2=0x7f6e6006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:18.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.654+0000 7f6e68000640 1 -- 172.21.15.99:0/1435775682 shutdown_connections 2024-09-10T07:40:18.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.654+0000 7f6e68000640 1 -- 172.21.15.99:0/1435775682 wait complete. 2024-09-10T07:40:18.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T07:40:18.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.827+0000 7fd368400640 1 Processor -- start 2024-09-10T07:40:18.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.827+0000 7fd368400640 1 -- start start 2024-09-10T07:40:18.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd368400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360145290 0x7fd36006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:18.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd368400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd3600ce780 0x7fd360072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:18.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd368400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd360071510 0x7fd360072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd368400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd36006efe0 con 0x7fd360071510 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd368400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd36006e3d0 con 0x7fd3600ce780 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd368400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd36006e6b0 con 0x7fd360145290 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd366400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd360071510 0x7fd360072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd366400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd360071510 0x7fd360072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56406/0 (socket says 172.21.15.99:56406) 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd366400640 1 -- 172.21.15.99:0/3892002436 learned_addr learned my addr 172.21.15.99:0/3892002436 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd365000640 1 --2- 172.21.15.99:0/3892002436 >> v2:172.21.15.187:3300/0 conn(0x7fd3600ce780 0x7fd360072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd365a00640 1 --2- 172.21.15.99:0/3892002436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360145290 0x7fd36006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd366400640 1 -- 172.21.15.99:0/3892002436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360145290 msgr2=0x7fd36006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd366400640 1 --2- 172.21.15.99:0/3892002436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360145290 0x7fd36006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd366400640 1 -- 172.21.15.99:0/3892002436 >> v2:172.21.15.187:3300/0 conn(0x7fd3600ce780 msgr2=0x7fd360072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:18.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd366400640 1 --2- 172.21.15.99:0/3892002436 >> v2:172.21.15.187:3300/0 conn(0x7fd3600ce780 0x7fd360072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd366400640 1 -- 172.21.15.99:0/3892002436 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36006e990 con 0x7fd360071510 2024-09-10T07:40:18.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.829+0000 7fd365a00640 1 --2- 172.21.15.99:0/3892002436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360145290 0x7fd36006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.830+0000 7fd366400640 1 --2- 172.21.15.99:0/3892002436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360071510 0x7fd360072d70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd3600759a0 tx=0x7fd35802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc735204bc7ccc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd35fe00640 1 -- 172.21.15.99:0/3892002436 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358036070 con 0x7fd360071510 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd35fe00640 1 -- 172.21.15.99:0/3892002436 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd358031600 con 0x7fd360071510 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd35fe00640 1 -- 172.21.15.99:0/3892002436 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580319d0 con 0x7fd360071510 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd368400640 1 -- 172.21.15.99:0/3892002436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360071510 msgr2=0x7fd360072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd368400640 1 --2- 172.21.15.99:0/3892002436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360071510 0x7fd360072d70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd3600759a0 tx=0x7fd35802a6a0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd368400640 1 -- 172.21.15.99:0/3892002436 shutdown_connections 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd368400640 1 --2- 172.21.15.99:0/3892002436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360071510 0x7fd360072d70 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd368400640 1 --2- 172.21.15.99:0/3892002436 >> v2:172.21.15.187:3300/0 conn(0x7fd3600ce780 0x7fd360072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd368400640 1 --2- 172.21.15.99:0/3892002436 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360145290 0x7fd36006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd368400640 1 -- 172.21.15.99:0/3892002436 >> 172.21.15.99:0/3892002436 conn(0x7fd36006bc10 msgr2=0x7fd36006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:18.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd368400640 1 -- 172.21.15.99:0/3892002436 shutdown_connections 2024-09-10T07:40:18.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.831+0000 7fd368400640 1 -- 172.21.15.99:0/3892002436 wait complete. 2024-09-10T07:40:18.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.833+0000 7fd368400640 1 Processor -- start 2024-09-10T07:40:18.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.833+0000 7fd368400640 1 -- start start 2024-09-10T07:40:18.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd368400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360071510 0x7fd3600aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:18.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd368400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3600ce780 0x7fd3601f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:18.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd368400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360145290 0x7fd360143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:18.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd368400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd36006df80 con 0x7fd360145290 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd368400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd360145670 con 0x7fd3600ce780 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd368400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd36006e100 con 0x7fd360071510 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd366400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360145290 0x7fd360143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd366400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360145290 0x7fd360143140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56410/0 (socket says 172.21.15.99:56410) 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd366400640 1 -- 172.21.15.99:0/1657834876 learned_addr learned my addr 172.21.15.99:0/1657834876 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd365000640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3600ce780 0x7fd3601f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.834+0000 7fd365a00640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360071510 0x7fd3600aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd366400640 1 -- 172.21.15.99:0/1657834876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360071510 msgr2=0x7fd3600aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd366400640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360071510 0x7fd3600aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd366400640 1 -- 172.21.15.99:0/1657834876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3600ce780 msgr2=0x7fd3601f8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd366400640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3600ce780 0x7fd3601f8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd366400640 1 -- 172.21.15.99:0/1657834876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd360144ae0 con 0x7fd360145290 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd366400640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360145290 0x7fd360143140 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd35802ac90 tx=0x7fd358004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd35d600640 1 -- 172.21.15.99:0/1657834876 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35803f020 con 0x7fd360145290 2024-09-10T07:40:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd35d600640 1 -- 172.21.15.99:0/1657834876 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd358037040 con 0x7fd360145290 2024-09-10T07:40:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd35d600640 1 -- 172.21.15.99:0/1657834876 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358036070 con 0x7fd360145290 2024-09-10T07:40:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd368400640 1 -- 172.21.15.99:0/1657834876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd360143a40 con 0x7fd360145290 2024-09-10T07:40:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.835+0000 7fd368400640 1 -- 172.21.15.99:0/1657834876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd360144000 con 0x7fd360145290 2024-09-10T07:40:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.836+0000 7fd368400640 1 -- 172.21.15.99:0/1657834876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd36006f470 con 0x7fd360145290 2024-09-10T07:40:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.837+0000 7fd35d600640 1 -- 172.21.15.99:0/1657834876 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd358042020 con 0x7fd360145290 2024-09-10T07:40:18.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.838+0000 7fd35d600640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd34006be30 0x7fd34006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:18.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.838+0000 7fd35d600640 1 -- 172.21.15.99:0/1657834876 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4857+0+0 (secure 0 0 0) 0x7fd3580aaf30 con 0x7fd360145290 2024-09-10T07:40:18.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.839+0000 7fd365a00640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd34006be30 0x7fd34006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.839+0000 7fd365a00640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd34006be30 0x7fd34006e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd354006e80 tx=0x7fd354008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:18.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:18.843+0000 7fd35d600640 1 -- 172.21.15.99:0/1657834876 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd358049030 con 0x7fd360145290 2024-09-10T07:40:19.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.080+0000 7fd368400640 1 -- 172.21.15.99:0/1657834876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd36013f000 con 0x7fd360145290 2024-09-10T07:40:19.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.080+0000 7fd35d600640 1 -- 172.21.15.99:0/1657834876 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7fd3580794b0 con 0x7fd360145290 2024-09-10T07:40:19.080 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:19.080 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:40:19.080 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw==", 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.081 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ==", 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw==", 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.082 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw==", 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.083 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA==", 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A==", 2024-09-10T07:40:19.084 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w==", 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.085 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA==", 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w==", 2024-09-10T07:40:19.086 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw==", 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw==", 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg==", 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.088 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg==", 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow r", 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ==", 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A==", 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.090 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw==", 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBc9t9m2Fs5JBAAQfJNCUhmbHevYDJWsG/oAg==", 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q==", 2024-09-10T07:40:19.092 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw==", 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.094 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:19.094 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 -- 172.21.15.99:0/1657834876 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd34006be30 msgr2=0x7fd34006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd34006be30 0x7fd34006e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd354006e80 tx=0x7fd354008040 comp rx=0 tx=0).stop 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 -- 172.21.15.99:0/1657834876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360145290 msgr2=0x7fd360143140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360145290 0x7fd360143140 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd35802ac90 tx=0x7fd358004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 -- 172.21.15.99:0/1657834876 shutdown_connections 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd34006be30 0x7fd34006e2f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd360145290 0x7fd360143140 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3600ce780 0x7fd3601f8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 --2- 172.21.15.99:0/1657834876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd360071510 0x7fd3600aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 -- 172.21.15.99:0/1657834876 >> 172.21.15.99:0/1657834876 conn(0x7fd36006bc10 msgr2=0x7fd36015f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 -- 172.21.15.99:0/1657834876 shutdown_connections 2024-09-10T07:40:19.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.083+0000 7fd368400640 1 -- 172.21.15.99:0/1657834876 wait complete. 2024-09-10T07:40:19.098 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:40:19.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.251+0000 7f133e200640 1 Processor -- start 2024-09-10T07:40:19.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.252+0000 7f133e200640 1 -- start start 2024-09-10T07:40:19.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f133e200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f133813fae0 0x7f133806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f133e200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1338142150 0x7f1338160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f133e200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1338160a80 0x7f133815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f133e200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f13380ce780 con 0x7f1338160a80 2024-09-10T07:40:19.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f133e200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f1338142650 con 0x7f1338142150 2024-09-10T07:40:19.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f133e200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1338142930 con 0x7f133813fae0 2024-09-10T07:40:19.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f1337e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1338160a80 0x7f133815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f1337e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1338160a80 0x7f133815cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56418/0 (socket says 172.21.15.99:56418) 2024-09-10T07:40:19.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f1337e00640 1 -- 172.21.15.99:0/2261314591 learned_addr learned my addr 172.21.15.99:0/2261314591 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:19.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f1337400640 1 --2- 172.21.15.99:0/2261314591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f133813fae0 0x7f133806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f132ea00640 1 --2- 172.21.15.99:0/2261314591 >> v2:172.21.15.187:3300/0 conn(0x7f1338142150 0x7f1338160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f1337e00640 1 -- 172.21.15.99:0/2261314591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f133813fae0 msgr2=0x7f133806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:19.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f1337e00640 1 --2- 172.21.15.99:0/2261314591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f133813fae0 0x7f133806f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f1337e00640 1 -- 172.21.15.99:0/2261314591 >> v2:172.21.15.187:3300/0 conn(0x7f1338142150 msgr2=0x7f1338160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:19.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f1337e00640 1 --2- 172.21.15.99:0/2261314591 >> v2:172.21.15.187:3300/0 conn(0x7f1338142150 0x7f1338160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.253+0000 7f1337e00640 1 -- 172.21.15.99:0/2261314591 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1338142c10 con 0x7f1338160a80 2024-09-10T07:40:19.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.254+0000 7f1337e00640 1 --2- 172.21.15.99:0/2261314591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1338160a80 0x7f133815cf50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f13380d06f0 tx=0x7f133002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209e51ec71b016f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:19.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f1336a00640 1 -- 172.21.15.99:0/2261314591 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330036070 con 0x7f1338160a80 2024-09-10T07:40:19.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f1336a00640 1 -- 172.21.15.99:0/2261314591 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1330031600 con 0x7f1338160a80 2024-09-10T07:40:19.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f1336a00640 1 -- 172.21.15.99:0/2261314591 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13300319d0 con 0x7f1338160a80 2024-09-10T07:40:19.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f133e200640 1 -- 172.21.15.99:0/2261314591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1338160a80 msgr2=0x7f133815cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f133e200640 1 --2- 172.21.15.99:0/2261314591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1338160a80 0x7f133815cf50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f13380d06f0 tx=0x7f133002a610 comp rx=0 tx=0).stop 2024-09-10T07:40:19.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f133e200640 1 -- 172.21.15.99:0/2261314591 shutdown_connections 2024-09-10T07:40:19.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f133e200640 1 --2- 172.21.15.99:0/2261314591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1338160a80 0x7f133815cf50 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f133e200640 1 --2- 172.21.15.99:0/2261314591 >> v2:172.21.15.187:3300/0 conn(0x7f1338142150 0x7f1338160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f133e200640 1 --2- 172.21.15.99:0/2261314591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f133813fae0 0x7f133806f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f133e200640 1 -- 172.21.15.99:0/2261314591 >> 172.21.15.99:0/2261314591 conn(0x7f133806bc10 msgr2=0x7f133806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:19.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f133e200640 1 -- 172.21.15.99:0/2261314591 shutdown_connections 2024-09-10T07:40:19.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.255+0000 7f133e200640 1 -- 172.21.15.99:0/2261314591 wait complete. 2024-09-10T07:40:19.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.257+0000 7f133e200640 1 Processor -- start 2024-09-10T07:40:19.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.257+0000 7f133e200640 1 -- start start 2024-09-10T07:40:19.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f133e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133813fae0 0x7f133813c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f133e200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1338142150 0x7f13380b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f133e200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1338160a80 0x7f13381385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f133e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f133806f870 con 0x7f133813fae0 2024-09-10T07:40:19.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f133e200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f133806f6f0 con 0x7f1338142150 2024-09-10T07:40:19.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f133e200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f133815d490 con 0x7f1338160a80 2024-09-10T07:40:19.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f1337400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133813fae0 0x7f133813c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f1337400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133813fae0 0x7f133813c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56432/0 (socket says 172.21.15.99:56432) 2024-09-10T07:40:19.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f1337400640 1 -- 172.21.15.99:0/3924843192 learned_addr learned my addr 172.21.15.99:0/3924843192 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f132ea00640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1338142150 0x7f13380b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.258+0000 7f1337e00640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1338160a80 0x7f13381385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f1337400640 1 -- 172.21.15.99:0/3924843192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1338160a80 msgr2=0x7f13381385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f1337400640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1338160a80 0x7f13381385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f1337400640 1 -- 172.21.15.99:0/3924843192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1338142150 msgr2=0x7f13380b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f1337400640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1338142150 0x7f13380b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f1337400640 1 -- 172.21.15.99:0/3924843192 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13380b4820 con 0x7f133813fae0 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f1337400640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133813fae0 0x7f133813c640 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f132800d800 tx=0x7f132800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f132fe00640 1 -- 172.21.15.99:0/3924843192 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328018020 con 0x7f133813fae0 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f132fe00640 1 -- 172.21.15.99:0/3924843192 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13280096a0 con 0x7f133813fae0 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f132fe00640 1 -- 172.21.15.99:0/3924843192 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328009a70 con 0x7f133813fae0 2024-09-10T07:40:19.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f133e200640 1 -- 172.21.15.99:0/3924843192 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f133813ac90 con 0x7f133813fae0 2024-09-10T07:40:19.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.259+0000 7f133e200640 1 -- 172.21.15.99:0/3924843192 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1338139530 con 0x7f133813fae0 2024-09-10T07:40:19.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.260+0000 7f133e200640 1 -- 172.21.15.99:0/3924843192 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1338160540 con 0x7f133813fae0 2024-09-10T07:40:19.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.261+0000 7f132fe00640 1 -- 172.21.15.99:0/3924843192 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f132801b020 con 0x7f133813fae0 2024-09-10T07:40:19.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.262+0000 7f132fe00640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131406be60 0x7f131406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.262+0000 7f132fe00640 1 -- 172.21.15.99:0/3924843192 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4857+0+0 (secure 0 0 0) 0x7f132808ac60 con 0x7f133813fae0 2024-09-10T07:40:19.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.262+0000 7f132ea00640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131406be60 0x7f131406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.263+0000 7f132ea00640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131406be60 0x7f131406e320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1338146690 tx=0x7f1320008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:19.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.267+0000 7f132fe00640 1 -- 172.21.15.99:0/3924843192 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1328022030 con 0x7f133813fae0 2024-09-10T07:40:19.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.442+0000 7f133e200640 1 -- 172.21.15.99:0/3924843192 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1338069220 con 0x7f133813fae0 2024-09-10T07:40:19.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.443+0000 7f132fe00640 1 -- 172.21.15.99:0/3924843192 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v135) ==== 84+0+65 (secure 0 0 0) 0x7f1328059270 con 0x7f133813fae0 2024-09-10T07:40:19.443 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:19.443 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:40:19.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:19.443 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:40:19.443 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:40:19.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:19.444 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:40:19.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 -- 172.21.15.99:0/3924843192 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131406be60 msgr2=0x7f131406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131406be60 0x7f131406e320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1338146690 tx=0x7f1320008040 comp rx=0 tx=0).stop 2024-09-10T07:40:19.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 -- 172.21.15.99:0/3924843192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133813fae0 msgr2=0x7f133813c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133813fae0 0x7f133813c640 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f132800d800 tx=0x7f132800dcc0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 -- 172.21.15.99:0/3924843192 shutdown_connections 2024-09-10T07:40:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1338160a80 0x7f13381385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1338142150 0x7f13380b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f131406be60 0x7f131406e320 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 --2- 172.21.15.99:0/3924843192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133813fae0 0x7f133813c640 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 -- 172.21.15.99:0/3924843192 >> 172.21.15.99:0/3924843192 conn(0x7f133806bc10 msgr2=0x7f13380b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 -- 172.21.15.99:0/3924843192 shutdown_connections 2024-09-10T07:40:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.445+0000 7f133e200640 1 -- 172.21.15.99:0/3924843192 wait complete. 2024-09-10T07:40:19.460 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:40:19.460 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:40:19.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.616+0000 7fc933e00640 1 Processor -- start 2024-09-10T07:40:19.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.616+0000 7fc933e00640 1 -- start start 2024-09-10T07:40:19.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.617+0000 7fc933e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc93406ffb0 0x7fc934070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.617+0000 7fc933e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9340708d0 con 0x7fc9340b7590 2024-09-10T07:40:19.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.617+0000 7fc933e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc934160260 con 0x7fc9340b7130 2024-09-10T07:40:19.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.617+0000 7fc933e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc93406cec0 con 0x7fc93406ffb0 2024-09-10T07:40:19.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.618+0000 7fc932a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc93406ffb0 0x7fc934070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.618+0000 7fc933400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc9340b7590 0x7fc93406e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51672/0 (socket says 172.21.15.99:51672) 2024-09-10T07:40:19.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.618+0000 7fc932a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc93406ffb0 0x7fc934070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56436/0 (socket says 172.21.15.99:56436) 2024-09-10T07:40:19.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.618+0000 7fc933400640 1 -- 172.21.15.99:0/4194393049 learned_addr learned my addr 172.21.15.99:0/4194393049 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:19.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.618+0000 7fc932a00640 1 -- 172.21.15.99:0/4194393049 >> v1:172.21.15.187:6789/0 conn(0x7fc9340b7130 legacy=0x7fc93406dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:19.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.618+0000 7fc932a00640 1 -- 172.21.15.99:0/4194393049 >> v1:172.21.15.99:6789/0 conn(0x7fc9340b7590 legacy=0x7fc93406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.618+0000 7fc932a00640 1 -- 172.21.15.99:0/4194393049 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93406d1a0 con 0x7fc93406ffb0 2024-09-10T07:40:19.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.618+0000 7fc931600640 1 -- 172.21.15.99:0/4194393049 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2486914515 0 0) 0x7fc9340708d0 con 0x7fc9340b7590 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.619+0000 7fc932a00640 1 --2- 172.21.15.99:0/4194393049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 0x7fc934070390 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc9240097a0 tx=0x7fc92402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1f07476db31435 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.619+0000 7fc931600640 1 -- 172.21.15.99:0/4194393049 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924037070 con 0x7fc93406ffb0 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.619+0000 7fc931600640 1 -- 172.21.15.99:0/4194393049 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924032440 con 0x7fc93406ffb0 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.619+0000 7fc931600640 1 -- 172.21.15.99:0/4194393049 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924032810 con 0x7fc93406ffb0 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.620+0000 7fc933e00640 1 -- 172.21.15.99:0/4194393049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 msgr2=0x7fc934070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.620+0000 7fc933e00640 1 --2- 172.21.15.99:0/4194393049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 0x7fc934070390 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc9240097a0 tx=0x7fc92402a230 comp rx=0 tx=0).stop 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.620+0000 7fc933e00640 1 -- 172.21.15.99:0/4194393049 shutdown_connections 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.620+0000 7fc933e00640 1 --2- 172.21.15.99:0/4194393049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 0x7fc934070390 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.620+0000 7fc933e00640 1 -- 172.21.15.99:0/4194393049 >> 172.21.15.99:0/4194393049 conn(0x7fc9340b7cc0 msgr2=0x7fc9340b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.620+0000 7fc933e00640 1 -- 172.21.15.99:0/4194393049 shutdown_connections 2024-09-10T07:40:19.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.620+0000 7fc933e00640 1 -- 172.21.15.99:0/4194393049 wait complete. 2024-09-10T07:40:19.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.622+0000 7fc933e00640 1 Processor -- start 2024-09-10T07:40:19.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.622+0000 7fc933e00640 1 -- start start 2024-09-10T07:40:19.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc933e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 0x7fc93409d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc933e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9340b7130 0x7fc9341f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc933e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9340b7590 0x7fc93414e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc933e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340b6360 con 0x7fc93406ffb0 2024-09-10T07:40:19.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc933e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc93406d760 con 0x7fc9340b7130 2024-09-10T07:40:19.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc933e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc9340b64e0 con 0x7fc9340b7590 2024-09-10T07:40:19.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc932a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 0x7fc93409d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc932a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 0x7fc93409d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56452/0 (socket says 172.21.15.99:56452) 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc932a00640 1 -- 172.21.15.99:0/2437370160 learned_addr learned my addr 172.21.15.99:0/2437370160 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc932000640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9340b7130 0x7fc9341f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc933400640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9340b7590 0x7fc93414e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc932a00640 1 -- 172.21.15.99:0/2437370160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9340b7590 msgr2=0x7fc93414e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc932a00640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9340b7590 0x7fc93414e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc932a00640 1 -- 172.21.15.99:0/2437370160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9340b7130 msgr2=0x7fc9341f89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc932a00640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9340b7130 0x7fc9341f89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.623+0000 7fc932a00640 1 -- 172.21.15.99:0/2437370160 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93409d910 con 0x7fc93406ffb0 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.624+0000 7fc932a00640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 0x7fc93409d280 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc924035040 tx=0x7fc9240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.624+0000 7fc92b400640 1 -- 172.21.15.99:0/2437370160 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924037050 con 0x7fc93406ffb0 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.624+0000 7fc92b400640 1 -- 172.21.15.99:0/2437370160 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924038040 con 0x7fc93406ffb0 2024-09-10T07:40:19.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.624+0000 7fc92b400640 1 -- 172.21.15.99:0/2437370160 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924004470 con 0x7fc93406ffb0 2024-09-10T07:40:19.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.624+0000 7fc933e00640 1 -- 172.21.15.99:0/2437370160 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93409f2f0 con 0x7fc93406ffb0 2024-09-10T07:40:19.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.624+0000 7fc933e00640 1 -- 172.21.15.99:0/2437370160 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93409f8b0 con 0x7fc93406ffb0 2024-09-10T07:40:19.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.625+0000 7fc933e00640 1 -- 172.21.15.99:0/2437370160 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc934070390 con 0x7fc93406ffb0 2024-09-10T07:40:19.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.626+0000 7fc92b400640 1 -- 172.21.15.99:0/2437370160 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc924030880 con 0x7fc93406ffb0 2024-09-10T07:40:19.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.627+0000 7fc92b400640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc91406be30 0x7fc91406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:19.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.627+0000 7fc92b400640 1 -- 172.21.15.99:0/2437370160 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4857+0+0 (secure 0 0 0) 0x7fc9240ab850 con 0x7fc93406ffb0 2024-09-10T07:40:19.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.628+0000 7fc932000640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc91406be30 0x7fc91406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:19.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.628+0000 7fc932000640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc91406be30 0x7fc91406e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc93409cab0 tx=0x7fc920009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:19.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.632+0000 7fc92b400640 1 -- 172.21.15.99:0/2437370160 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc924079f80 con 0x7fc93406ffb0 2024-09-10T07:40:19.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:19.808+0000 7fc933e00640 1 -- 172.21.15.99:0/2437370160 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc934069040 con 0x7fc93406ffb0 2024-09-10T07:40:20.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.663+0000 7fc92b400640 1 -- 172.21.15.99:0/2437370160 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v136) ==== 138+0+0 (secure 0 0 0) 0x7fc92407e280 con 0x7fc93406ffb0 2024-09-10T07:40:20.663 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:40:20.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 -- 172.21.15.99:0/2437370160 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc91406be30 msgr2=0x7fc91406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:20.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc91406be30 0x7fc91406e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc93409cab0 tx=0x7fc920009040 comp rx=0 tx=0).stop 2024-09-10T07:40:20.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 -- 172.21.15.99:0/2437370160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 msgr2=0x7fc93409d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:20.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 0x7fc93409d280 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc924035040 tx=0x7fc9240046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 -- 172.21.15.99:0/2437370160 shutdown_connections 2024-09-10T07:40:20.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9340b7590 0x7fc93414e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9340b7130 0x7fc9341f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc91406be30 0x7fc91406e2f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 --2- 172.21.15.99:0/2437370160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc93406ffb0 0x7fc93409d280 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 -- 172.21.15.99:0/2437370160 >> 172.21.15.99:0/2437370160 conn(0x7fc9340b7cc0 msgr2=0x7fc9340d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:20.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.666+0000 7fc933e00640 1 -- 172.21.15.99:0/2437370160 shutdown_connections 2024-09-10T07:40:20.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.667+0000 7fc933e00640 1 -- 172.21.15.99:0/2437370160 wait complete. 2024-09-10T07:40:20.686 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:40:20.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.849+0000 7f1061a00640 1 Processor -- start 2024-09-10T07:40:20.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.850+0000 7f1061a00640 1 -- start start 2024-09-10T07:40:20.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f1061a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f105c155c80 0x7f105c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:20.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f1061a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 0x7f105c15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:20.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f1061a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f105c06e450 0x7f105c06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:20.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f1061a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f105c06ee00 con 0x7f105c155c80 2024-09-10T07:40:20.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f1061a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f105c0723d0 con 0x7f105c06e450 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f1061a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f105c156060 con 0x7f105c15bb80 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f105be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f105c155c80 0x7f105c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f105be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f105c155c80 0x7f105c15cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42660/0 (socket says 172.21.15.99:42660) 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f105be00640 1 -- 172.21.15.99:0/4189719812 learned_addr learned my addr 172.21.15.99:0/4189719812 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f1061000640 1 --2- 172.21.15.99:0/4189719812 >> v2:172.21.15.187:3300/0 conn(0x7f105c06e450 0x7f105c06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.851+0000 7f105b400640 1 --2- 172.21.15.99:0/4189719812 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 0x7f105c15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.852+0000 7f105be00640 1 -- 172.21.15.99:0/4189719812 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 msgr2=0x7f105c15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.852+0000 7f105be00640 1 --2- 172.21.15.99:0/4189719812 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 0x7f105c15bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.852+0000 7f105be00640 1 -- 172.21.15.99:0/4189719812 >> v2:172.21.15.187:3300/0 conn(0x7f105c06e450 msgr2=0x7f105c06e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.852+0000 7f105be00640 1 --2- 172.21.15.99:0/4189719812 >> v2:172.21.15.187:3300/0 conn(0x7f105c06e450 0x7f105c06e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.852+0000 7f105be00640 1 -- 172.21.15.99:0/4189719812 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105c15c6f0 con 0x7f105c155c80 2024-09-10T07:40:20.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.852+0000 7f105be00640 1 --2- 172.21.15.99:0/4189719812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c155c80 0x7f105c15cd40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f105c0cd710 tx=0x7f104c02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4661545e264fcbf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f105aa00640 1 -- 172.21.15.99:0/4189719812 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c00b2e0 con 0x7f105c155c80 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f105aa00640 1 -- 172.21.15.99:0/4189719812 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104c009600 con 0x7f105c155c80 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f105aa00640 1 -- 172.21.15.99:0/4189719812 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c00b480 con 0x7f105c155c80 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f1061a00640 1 -- 172.21.15.99:0/4189719812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c155c80 msgr2=0x7f105c15cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f1061a00640 1 --2- 172.21.15.99:0/4189719812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c155c80 0x7f105c15cd40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f105c0cd710 tx=0x7f104c02c8a0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f1061a00640 1 -- 172.21.15.99:0/4189719812 shutdown_connections 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f1061a00640 1 --2- 172.21.15.99:0/4189719812 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 0x7f105c15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f1061a00640 1 --2- 172.21.15.99:0/4189719812 >> v2:172.21.15.187:3300/0 conn(0x7f105c06e450 0x7f105c06e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f1061a00640 1 --2- 172.21.15.99:0/4189719812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c155c80 0x7f105c15cd40 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f1061a00640 1 -- 172.21.15.99:0/4189719812 >> 172.21.15.99:0/4189719812 conn(0x7f105c0b2810 msgr2=0x7f105c0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:20.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.853+0000 7f1061a00640 1 -- 172.21.15.99:0/4189719812 shutdown_connections 2024-09-10T07:40:20.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.854+0000 7f1061a00640 1 -- 172.21.15.99:0/4189719812 wait complete. 2024-09-10T07:40:20.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.855+0000 7f1061a00640 1 Processor -- start 2024-09-10T07:40:20.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.855+0000 7f1061a00640 1 -- start start 2024-09-10T07:40:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.856+0000 7f1061a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c06e450 0x7f105c1518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.856+0000 7f1061a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f105c155c80 0x7f105c15e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.856+0000 7f1061a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 0x7f105c151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.856+0000 7f1061a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f105c072900 con 0x7f105c06e450 2024-09-10T07:40:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.856+0000 7f1061a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f105c072620 con 0x7f105c155c80 2024-09-10T07:40:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.856+0000 7f1061a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f105c071ce0 con 0x7f105c15bb80 2024-09-10T07:40:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.856+0000 7f105be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c06e450 0x7f105c1518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.856+0000 7f105be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c06e450 0x7f105c1518b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42668/0 (socket says 172.21.15.99:42668) 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.856+0000 7f105be00640 1 -- 172.21.15.99:0/303902215 learned_addr learned my addr 172.21.15.99:0/303902215 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f105b400640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f105c155c80 0x7f105c15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f105be00640 1 -- 172.21.15.99:0/303902215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 msgr2=0x7f105c151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f1061000640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 0x7f105c151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f105be00640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 0x7f105c151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f105be00640 1 -- 172.21.15.99:0/303902215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f105c155c80 msgr2=0x7f105c15e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f105be00640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f105c155c80 0x7f105c15e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f105be00640 1 -- 172.21.15.99:0/303902215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105c15e750 con 0x7f105c06e450 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f105b400640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f105c155c80 0x7f105c15e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f1061000640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 0x7f105c151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f105be00640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c06e450 0x7f105c1518b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f104c02c8e0 tx=0x7f104c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f1053e00640 1 -- 172.21.15.99:0/303902215 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c040030 con 0x7f105c06e450 2024-09-10T07:40:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f1053e00640 1 -- 172.21.15.99:0/303902215 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f104c03c640 con 0x7f105c06e450 2024-09-10T07:40:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f1053e00640 1 -- 172.21.15.99:0/303902215 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c03ca10 con 0x7f105c06e450 2024-09-10T07:40:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f1061a00640 1 -- 172.21.15.99:0/303902215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105c155100 con 0x7f105c06e450 2024-09-10T07:40:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.857+0000 7f1061a00640 1 -- 172.21.15.99:0/303902215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f105c15da10 con 0x7f105c06e450 2024-09-10T07:40:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.859+0000 7f1061a00640 1 -- 172.21.15.99:0/303902215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f105c06e8c0 con 0x7f105c06e450 2024-09-10T07:40:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.860+0000 7f1053e00640 1 -- 172.21.15.99:0/303902215 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f104c043030 con 0x7f105c06e450 2024-09-10T07:40:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.861+0000 7f1053e00640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f103c06be60 0x7f103c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.861+0000 7f1053e00640 1 -- 172.21.15.99:0/303902215 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5227+0+0 (secure 0 0 0) 0x7f104c030020 con 0x7f105c06e450 2024-09-10T07:40:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.861+0000 7f105b400640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f103c06be60 0x7f103c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:20.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.862+0000 7f105b400640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f103c06be60 0x7f103c06e320 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1048006fd0 tx=0x7f1048008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:20.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:20.866+0000 7f1053e00640 1 -- 172.21.15.99:0/303902215 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f104c04a030 con 0x7f105c06e450 2024-09-10T07:40:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.040+0000 7f1061a00640 1 -- 172.21.15.99:0/303902215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f105c0b45c0 con 0x7f105c06e450 2024-09-10T07:40:21.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.670+0000 7f1053e00640 1 -- 172.21.15.99:0/303902215 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v137) ==== 170+0+0 (secure 0 0 0) 0x7f104c07a590 con 0x7f105c06e450 2024-09-10T07:40:21.670 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:40:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 -- 172.21.15.99:0/303902215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f103c06be60 msgr2=0x7f103c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f103c06be60 0x7f103c06e320 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1048006fd0 tx=0x7f1048008040 comp rx=0 tx=0).stop 2024-09-10T07:40:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 -- 172.21.15.99:0/303902215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c06e450 msgr2=0x7f105c1518b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c06e450 0x7f105c1518b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f104c02c8e0 tx=0x7f104c004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 -- 172.21.15.99:0/303902215 shutdown_connections 2024-09-10T07:40:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f105c15bb80 0x7f105c151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f105c155c80 0x7f105c15e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f103c06be60 0x7f103c06e320 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 --2- 172.21.15.99:0/303902215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f105c06e450 0x7f105c1518b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 -- 172.21.15.99:0/303902215 >> 172.21.15.99:0/303902215 conn(0x7f105c0b2810 msgr2=0x7f105c0af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:21.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 -- 172.21.15.99:0/303902215 shutdown_connections 2024-09-10T07:40:21.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.673+0000 7f1061a00640 1 -- 172.21.15.99:0/303902215 wait complete. 2024-09-10T07:40:21.701 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:40:21.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.858+0000 7f338e200640 1 Processor -- start 2024-09-10T07:40:21.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.859+0000 7f338e200640 1 -- start start 2024-09-10T07:40:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f338e200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f338806e280 0x7f3388073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f338e200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3388071df0 0x7f338806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f338e200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33880d1010 0x7f33880ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f338e200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f33880738b0 con 0x7f338806e280 2024-09-10T07:40:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f338e200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f338806eba0 con 0x7f3388071df0 2024-09-10T07:40:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f338e200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f33880722d0 con 0x7f33880d1010 2024-09-10T07:40:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f3387400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f338806e280 0x7f3388073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f3387400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f338806e280 0x7f3388073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42682/0 (socket says 172.21.15.99:42682) 2024-09-10T07:40:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f3387400640 1 -- 172.21.15.99:0/1028220690 learned_addr learned my addr 172.21.15.99:0/1028220690 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f3387e00640 1 --2- 172.21.15.99:0/1028220690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33880d1010 0x7f33880ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.860+0000 7f337ea00640 1 --2- 172.21.15.99:0/1028220690 >> v2:172.21.15.187:3300/0 conn(0x7f3388071df0 0x7f338806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.861+0000 7f3387400640 1 -- 172.21.15.99:0/1028220690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33880d1010 msgr2=0x7f33880ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.861+0000 7f3387400640 1 --2- 172.21.15.99:0/1028220690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33880d1010 0x7f33880ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.861+0000 7f3387400640 1 -- 172.21.15.99:0/1028220690 >> v2:172.21.15.187:3300/0 conn(0x7f3388071df0 msgr2=0x7f338806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.861+0000 7f3387400640 1 --2- 172.21.15.99:0/1028220690 >> v2:172.21.15.187:3300/0 conn(0x7f3388071df0 0x7f338806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.861+0000 7f3387400640 1 -- 172.21.15.99:0/1028220690 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33880725b0 con 0x7f338806e280 2024-09-10T07:40:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.861+0000 7f3387400640 1 --2- 172.21.15.99:0/1028220690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f338806e280 0x7f3388073370 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f3388050020 tx=0x7f337802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e801809dd5471d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f3386a00640 1 -- 172.21.15.99:0/1028220690 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3378037070 con 0x7f338806e280 2024-09-10T07:40:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f3386a00640 1 -- 172.21.15.99:0/1028220690 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3378032440 con 0x7f338806e280 2024-09-10T07:40:21.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f3386a00640 1 -- 172.21.15.99:0/1028220690 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3378032810 con 0x7f338806e280 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f338e200640 1 -- 172.21.15.99:0/1028220690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f338806e280 msgr2=0x7f3388073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f338e200640 1 --2- 172.21.15.99:0/1028220690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f338806e280 0x7f3388073370 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f3388050020 tx=0x7f337802a1e0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f338e200640 1 -- 172.21.15.99:0/1028220690 shutdown_connections 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f338e200640 1 --2- 172.21.15.99:0/1028220690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33880d1010 0x7f33880ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f338e200640 1 --2- 172.21.15.99:0/1028220690 >> v2:172.21.15.187:3300/0 conn(0x7f3388071df0 0x7f338806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f338e200640 1 --2- 172.21.15.99:0/1028220690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f338806e280 0x7f3388073370 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f338e200640 1 -- 172.21.15.99:0/1028220690 >> 172.21.15.99:0/1028220690 conn(0x7f338806bc10 msgr2=0x7f338806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.862+0000 7f338e200640 1 -- 172.21.15.99:0/1028220690 shutdown_connections 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.863+0000 7f338e200640 1 -- 172.21.15.99:0/1028220690 wait complete. 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.864+0000 7f338e200640 1 Processor -- start 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.864+0000 7f338e200640 1 -- start start 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f338e200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f338806e280 0x7f3388158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:21.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f338e200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3388071df0 0x7f33880aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f338e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33880d1010 0x7f33880ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f338e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3388072e50 con 0x7f33880d1010 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f338e200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3388072b70 con 0x7f338806e280 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f338e200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f33880d14c0 con 0x7f3388071df0 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f3387e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33880d1010 0x7f33880ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f3387e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33880d1010 0x7f33880ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42686/0 (socket says 172.21.15.99:42686) 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f3387e00640 1 -- 172.21.15.99:0/475490354 learned_addr learned my addr 172.21.15.99:0/475490354 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f3387400640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f338806e280 0x7f3388158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.865+0000 7f337ea00640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3388071df0 0x7f33880aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f3387e00640 1 -- 172.21.15.99:0/475490354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3388071df0 msgr2=0x7f33880aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f3387e00640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3388071df0 0x7f33880aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f3387e00640 1 -- 172.21.15.99:0/475490354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f338806e280 msgr2=0x7f3388158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f3387e00640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f338806e280 0x7f3388158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f3387e00640 1 -- 172.21.15.99:0/475490354 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3388158150 con 0x7f33880d1010 2024-09-10T07:40:21.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f3387e00640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33880d1010 0x7f33880ace80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3380007e90 tx=0x7f338000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:21.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f337fe00640 1 -- 172.21.15.99:0/475490354 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380014420 con 0x7f33880d1010 2024-09-10T07:40:21.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f337fe00640 1 -- 172.21.15.99:0/475490354 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3380019070 con 0x7f33880d1010 2024-09-10T07:40:21.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f337fe00640 1 -- 172.21.15.99:0/475490354 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380014800 con 0x7f33880d1010 2024-09-10T07:40:21.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f338e200640 1 -- 172.21.15.99:0/475490354 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33880af390 con 0x7f33880d1010 2024-09-10T07:40:21.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.866+0000 7f338e200640 1 -- 172.21.15.99:0/475490354 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338815dd40 con 0x7f33880d1010 2024-09-10T07:40:21.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.867+0000 7f338e200640 1 -- 172.21.15.99:0/475490354 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3388073370 con 0x7f33880d1010 2024-09-10T07:40:21.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.869+0000 7f337fe00640 1 -- 172.21.15.99:0/475490354 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33800149a0 con 0x7f33880d1010 2024-09-10T07:40:21.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.869+0000 7f337fe00640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f336406be30 0x7f336406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:21.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.870+0000 7f337fe00640 1 -- 172.21.15.99:0/475490354 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5609+0+0 (secure 0 0 0) 0x7f338008b4b0 con 0x7f33880d1010 2024-09-10T07:40:21.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.870+0000 7f3387400640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f336406be30 0x7f336406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:21.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.870+0000 7f3387400640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f336406be30 0x7f336406e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3378034000 tx=0x7f337802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:21.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:21.875+0000 7f337fe00640 1 -- 172.21.15.99:0/475490354 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3380059860 con 0x7f33880d1010 2024-09-10T07:40:22.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.085+0000 7f338e200640 1 -- 172.21.15.99:0/475490354 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f338806e790 con 0x7f33880d1010 2024-09-10T07:40:22.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.672+0000 7f337fe00640 1 -- 172.21.15.99:0/475490354 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v62) ==== 174+0+0 (secure 0 0 0) 0x7f338005db60 con 0x7f33880d1010 2024-09-10T07:40:22.672 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 16 and data pool 17 2024-09-10T07:40:22.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.675+0000 7f338e200640 1 -- 172.21.15.99:0/475490354 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f336406be30 msgr2=0x7f336406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:22.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.675+0000 7f338e200640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f336406be30 0x7f336406e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3378034000 tx=0x7f337802e000 comp rx=0 tx=0).stop 2024-09-10T07:40:22.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.675+0000 7f338e200640 1 -- 172.21.15.99:0/475490354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33880d1010 msgr2=0x7f33880ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:22.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.675+0000 7f338e200640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33880d1010 0x7f33880ace80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3380007e90 tx=0x7f338000e4b0 comp rx=0 tx=0).stop 2024-09-10T07:40:22.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.676+0000 7f338e200640 1 -- 172.21.15.99:0/475490354 shutdown_connections 2024-09-10T07:40:22.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.676+0000 7f338e200640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f336406be30 0x7f336406e2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:22.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.676+0000 7f338e200640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33880d1010 0x7f33880ace80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:22.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.676+0000 7f338e200640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3388071df0 0x7f33880aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:22.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.676+0000 7f338e200640 1 --2- 172.21.15.99:0/475490354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f338806e280 0x7f3388158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:22.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.676+0000 7f338e200640 1 -- 172.21.15.99:0/475490354 >> 172.21.15.99:0/475490354 conn(0x7f338806bc10 msgr2=0x7f338815be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:22.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.677+0000 7f338e200640 1 -- 172.21.15.99:0/475490354 shutdown_connections 2024-09-10T07:40:22.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.677+0000 7f338e200640 1 -- 172.21.15.99:0/475490354 wait complete. 2024-09-10T07:40:22.711 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:40:22.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.864+0000 7f1472800640 1 Processor -- start 2024-09-10T07:40:22.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.864+0000 7f1472800640 1 -- start start 2024-09-10T07:40:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.866+0000 7f1472800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c0ce780 0x7f146c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.866+0000 7f1472800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146c06e3d0 con 0x7f146c072f40 2024-09-10T07:40:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.866+0000 7f1472800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146c06e6b0 con 0x7f146c145290 2024-09-10T07:40:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.866+0000 7f1472800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f146c06efe0 con 0x7f146c0ce780 2024-09-10T07:40:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.866+0000 7f1462a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f146c072f40 0x7f146c0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36898/0 (socket says 172.21.15.99:36898) 2024-09-10T07:40:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.866+0000 7f1462a00640 1 -- 172.21.15.99:0/2494310131 learned_addr learned my addr 172.21.15.99:0/2494310131 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.866+0000 7f146be00640 1 --2- 172.21.15.99:0/2494310131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c0ce780 0x7f146c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.866+0000 7f146aa00640 1 -- 172.21.15.99:0/2494310131 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1383046200 0 0) 0x7f146c06e3d0 con 0x7f146c072f40 2024-09-10T07:40:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.866+0000 7f146aa00640 1 -- 172.21.15.99:0/2494310131 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1450003520 con 0x7f146c072f40 2024-09-10T07:40:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.866+0000 7f146aa00640 1 -- 172.21.15.99:0/2494310131 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229682995 0 0) 0x7f146c06e6b0 con 0x7f146c145290 2024-09-10T07:40:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.867+0000 7f146aa00640 1 -- 172.21.15.99:0/2494310131 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f146c06e3d0 con 0x7f146c145290 2024-09-10T07:40:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.867+0000 7f146be00640 1 -- 172.21.15.99:0/2494310131 >> v1:172.21.15.187:6789/0 conn(0x7f146c145290 legacy=0x7f146c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.867+0000 7f146be00640 1 -- 172.21.15.99:0/2494310131 >> v1:172.21.15.99:6789/0 conn(0x7f146c072f40 legacy=0x7f146c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.867+0000 7f146be00640 1 -- 172.21.15.99:0/2494310131 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c06e990 con 0x7f146c0ce780 2024-09-10T07:40:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.868+0000 7f146be00640 1 --2- 172.21.15.99:0/2494310131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c0ce780 0x7f146c06f470 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1464009dc0 tx=0x7f146402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6136a1e20ea31d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.868+0000 7f146aa00640 1 -- 172.21.15.99:0/2494310131 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464007740 con 0x7f146c0ce780 2024-09-10T07:40:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.868+0000 7f146aa00640 1 -- 172.21.15.99:0/2494310131 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14640078e0 con 0x7f146c0ce780 2024-09-10T07:40:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.868+0000 7f146aa00640 1 -- 172.21.15.99:0/2494310131 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464007c90 con 0x7f146c0ce780 2024-09-10T07:40:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.868+0000 7f1472800640 1 -- 172.21.15.99:0/2494310131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c0ce780 msgr2=0x7f146c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.868+0000 7f1472800640 1 --2- 172.21.15.99:0/2494310131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c0ce780 0x7f146c06f470 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1464009dc0 tx=0x7f146402a6d0 comp rx=0 tx=0).stop 2024-09-10T07:40:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.869+0000 7f1472800640 1 -- 172.21.15.99:0/2494310131 shutdown_connections 2024-09-10T07:40:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.869+0000 7f1472800640 1 --2- 172.21.15.99:0/2494310131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c0ce780 0x7f146c06f470 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.869+0000 7f1472800640 1 -- 172.21.15.99:0/2494310131 >> 172.21.15.99:0/2494310131 conn(0x7f146c06bc10 msgr2=0x7f146c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.869+0000 7f1472800640 1 -- 172.21.15.99:0/2494310131 shutdown_connections 2024-09-10T07:40:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.869+0000 7f1472800640 1 -- 172.21.15.99:0/2494310131 wait complete. 2024-09-10T07:40:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.870+0000 7f1472800640 1 Processor -- start 2024-09-10T07:40:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.870+0000 7f1472800640 1 -- start start 2024-09-10T07:40:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.871+0000 7f1472800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f146c072f40 0x7f146c143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.871+0000 7f1472800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f146c0ce780 0x7f146c13d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.871+0000 7f1472800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c145290 0x7f146c15e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.871+0000 7f1472800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f146c06df80 con 0x7f146c072f40 2024-09-10T07:40:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.871+0000 7f1472800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f146c145670 con 0x7f146c0ce780 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.871+0000 7f1472800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f146c06e100 con 0x7f146c145290 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.871+0000 7f146b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f146c072f40 0x7f146c143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.871+0000 7f146b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f146c072f40 0x7f146c143f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42696/0 (socket says 172.21.15.99:42696) 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.871+0000 7f146b400640 1 -- 172.21.15.99:0/4078830122 learned_addr learned my addr 172.21.15.99:0/4078830122 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.871+0000 7f1462a00640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f146c0ce780 0x7f146c13d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f146be00640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c145290 0x7f146c15e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f146b400640 1 -- 172.21.15.99:0/4078830122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c145290 msgr2=0x7f146c15e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f146b400640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c145290 0x7f146c15e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f146b400640 1 -- 172.21.15.99:0/4078830122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f146c0ce780 msgr2=0x7f146c13d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f146b400640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f146c0ce780 0x7f146c13d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f146b400640 1 -- 172.21.15.99:0/4078830122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c13c780 con 0x7f146c072f40 2024-09-10T07:40:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f146b400640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f146c072f40 0x7f146c143f10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c500 tx=0x7f145c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f1463e00640 1 -- 172.21.15.99:0/4078830122 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c0052d0 con 0x7f146c072f40 2024-09-10T07:40:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f1463e00640 1 -- 172.21.15.99:0/4078830122 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145c005490 con 0x7f146c072f40 2024-09-10T07:40:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f1472800640 1 -- 172.21.15.99:0/4078830122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f146c1f8910 con 0x7f146c072f40 2024-09-10T07:40:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.872+0000 7f1463e00640 1 -- 172.21.15.99:0/4078830122 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c012870 con 0x7f146c072f40 2024-09-10T07:40:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.873+0000 7f1472800640 1 -- 172.21.15.99:0/4078830122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146c13cd00 con 0x7f146c072f40 2024-09-10T07:40:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.874+0000 7f1472800640 1 -- 172.21.15.99:0/4078830122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f146c0715a0 con 0x7f146c072f40 2024-09-10T07:40:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.874+0000 7f1463e00640 1 -- 172.21.15.99:0/4078830122 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f145c012a10 con 0x7f146c072f40 2024-09-10T07:40:22.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.875+0000 7f1463e00640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f144806be30 0x7f144806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:22.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.875+0000 7f1463e00640 1 -- 172.21.15.99:0/4078830122 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f145c08aa90 con 0x7f146c072f40 2024-09-10T07:40:22.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.876+0000 7f1462a00640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f144806be30 0x7f144806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:22.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.876+0000 7f1462a00640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f144806be30 0x7f144806e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f146c15e3c0 tx=0x7f1454007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:22.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:22.880+0000 7f1463e00640 1 -- 172.21.15.99:0/4078830122 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f145c058d60 con 0x7f146c072f40 2024-09-10T07:40:23.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.057+0000 7f1472800640 1 -- 172.21.15.99:0/4078830122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f146c075620 con 0x7f146c072f40 2024-09-10T07:40:23.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.058+0000 7f1463e00640 1 -- 172.21.15.99:0/4078830122 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) ==== 74+0+16677 (secure 0 0 0) 0x7f145c05d060 con 0x7f146c072f40 2024-09-10T07:40:23.058 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:23.058 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":138,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:40:22.086773+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:40:19.848847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T07:40:21.080608+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.060+0000 7f1472800640 1 -- 172.21.15.99:0/4078830122 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f144806be30 msgr2=0x7f144806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.060+0000 7f1472800640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f144806be30 0x7f144806e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f146c15e3c0 tx=0x7f1454007d30 comp rx=0 tx=0).stop 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.060+0000 7f1472800640 1 -- 172.21.15.99:0/4078830122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f146c072f40 msgr2=0x7f146c143f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.060+0000 7f1472800640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f146c072f40 0x7f146c143f10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c500 tx=0x7f145c00c9c0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.060+0000 7f1472800640 1 -- 172.21.15.99:0/4078830122 shutdown_connections 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.060+0000 7f1472800640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f146c145290 0x7f146c15e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.060+0000 7f1472800640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f146c0ce780 0x7f146c13d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.060+0000 7f1472800640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f144806be30 0x7f144806e2f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.060+0000 7f1472800640 1 --2- 172.21.15.99:0/4078830122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f146c072f40 0x7f146c143f10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.060+0000 7f1472800640 1 -- 172.21.15.99:0/4078830122 >> 172.21.15.99:0/4078830122 conn(0x7f146c06bc10 msgr2=0x7f146c0b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:23.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.061+0000 7f1472800640 1 -- 172.21.15.99:0/4078830122 shutdown_connections 2024-09-10T07:40:23.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.061+0000 7f1472800640 1 -- 172.21.15.99:0/4078830122 wait complete. 2024-09-10T07:40:23.077 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:40:23.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.230+0000 7f407b200640 1 Processor -- start 2024-09-10T07:40:23.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.230+0000 7f407b200640 1 -- start start 2024-09-10T07:40:23.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f407b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f40740cf010 0x7f40740cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f407b200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f407415c4f0 con 0x7f4074152210 2024-09-10T07:40:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f407b200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f407415b730 con 0x7f4074162ba0 2024-09-10T07:40:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f407b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f407415ba10 con 0x7f40740cf010 2024-09-10T07:40:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f4073400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f40740cf010 0x7f40740cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f4073e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4074152210 0x7f4074071e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36914/0 (socket says 172.21.15.99:36914) 2024-09-10T07:40:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f4073e00640 1 -- 172.21.15.99:0/2399954862 learned_addr learned my addr 172.21.15.99:0/2399954862 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:23.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f4073400640 1 -- 172.21.15.99:0/2399954862 >> v1:172.21.15.187:6789/0 conn(0x7f4074162ba0 legacy=0x7f4074164f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:23.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f4073400640 1 -- 172.21.15.99:0/2399954862 >> v1:172.21.15.99:6789/0 conn(0x7f4074152210 legacy=0x7f4074071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f4073400640 1 -- 172.21.15.99:0/2399954862 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407415bcf0 con 0x7f40740cf010 2024-09-10T07:40:23.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.232+0000 7f4072a00640 1 -- 172.21.15.99:0/2399954862 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3836462013 0 0) 0x7f407415c4f0 con 0x7f4074152210 2024-09-10T07:40:23.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.233+0000 7f4073400640 1 --2- 172.21.15.99:0/2399954862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 0x7f40740cf4a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f40600097a0 tx=0x7f406002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d6c33041f8b11f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:23.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.234+0000 7f4072a00640 1 -- 172.21.15.99:0/2399954862 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4060037070 con 0x7f40740cf010 2024-09-10T07:40:23.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.234+0000 7f4072a00640 1 -- 172.21.15.99:0/2399954862 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4060032440 con 0x7f40740cf010 2024-09-10T07:40:23.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.234+0000 7f4072a00640 1 -- 172.21.15.99:0/2399954862 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4060032810 con 0x7f40740cf010 2024-09-10T07:40:23.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.234+0000 7f407b200640 1 -- 172.21.15.99:0/2399954862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 msgr2=0x7f40740cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.234+0000 7f407b200640 1 --2- 172.21.15.99:0/2399954862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 0x7f40740cf4a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f40600097a0 tx=0x7f406002a1e0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.234+0000 7f407b200640 1 -- 172.21.15.99:0/2399954862 shutdown_connections 2024-09-10T07:40:23.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.234+0000 7f407b200640 1 --2- 172.21.15.99:0/2399954862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 0x7f40740cf4a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.234+0000 7f407b200640 1 -- 172.21.15.99:0/2399954862 >> 172.21.15.99:0/2399954862 conn(0x7f407406bc10 msgr2=0x7f407406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:23.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.234+0000 7f407b200640 1 -- 172.21.15.99:0/2399954862 shutdown_connections 2024-09-10T07:40:23.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.234+0000 7f407b200640 1 -- 172.21.15.99:0/2399954862 wait complete. 2024-09-10T07:40:23.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.236+0000 7f407b200640 1 Processor -- start 2024-09-10T07:40:23.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.236+0000 7f407b200640 1 -- start start 2024-09-10T07:40:23.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.237+0000 7f407b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 0x7f40741458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.237+0000 7f407b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4074152210 0x7f407415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.237+0000 7f407b200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4074162ba0 0x7f407415d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.237+0000 7f407b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f40740725a0 con 0x7f40740cf010 2024-09-10T07:40:23.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.237+0000 7f407b200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f407406f380 con 0x7f4074162ba0 2024-09-10T07:40:23.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.237+0000 7f407b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f407406e6c0 con 0x7f4074152210 2024-09-10T07:40:23.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.237+0000 7f4073e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 0x7f40741458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.237+0000 7f4073e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 0x7f40741458d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42714/0 (socket says 172.21.15.99:42714) 2024-09-10T07:40:23.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.237+0000 7f4073e00640 1 -- 172.21.15.99:0/1610903209 learned_addr learned my addr 172.21.15.99:0/1610903209 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:23.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.238+0000 7f4079200640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4074162ba0 0x7f407415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.238+0000 7f4073400640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4074152210 0x7f407415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.238+0000 7f4073e00640 1 -- 172.21.15.99:0/1610903209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4074152210 msgr2=0x7f407415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.238+0000 7f4073e00640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4074152210 0x7f407415cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.238+0000 7f4073e00640 1 -- 172.21.15.99:0/1610903209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4074162ba0 msgr2=0x7f407415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.238+0000 7f4073e00640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4074162ba0 0x7f407415d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.238+0000 7f4073e00640 1 -- 172.21.15.99:0/1610903209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4074146540 con 0x7f40740cf010 2024-09-10T07:40:23.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.238+0000 7f4073e00640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 0x7f40741458d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f406400c8c0 tx=0x7f406400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:23.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.239+0000 7f406be00640 1 -- 172.21.15.99:0/1610903209 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4064018070 con 0x7f40740cf010 2024-09-10T07:40:23.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.239+0000 7f406be00640 1 -- 172.21.15.99:0/1610903209 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f406400a640 con 0x7f40740cf010 2024-09-10T07:40:23.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.239+0000 7f406be00640 1 -- 172.21.15.99:0/1610903209 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406400aa30 con 0x7f40740cf010 2024-09-10T07:40:23.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.239+0000 7f407b200640 1 -- 172.21.15.99:0/1610903209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407415da70 con 0x7f40740cf010 2024-09-10T07:40:23.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.239+0000 7f407b200640 1 -- 172.21.15.99:0/1610903209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f407415f790 con 0x7f40740cf010 2024-09-10T07:40:23.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.240+0000 7f407b200640 1 -- 172.21.15.99:0/1610903209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40740cf4a0 con 0x7f40740cf010 2024-09-10T07:40:23.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.241+0000 7f406be00640 1 -- 172.21.15.99:0/1610903209 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f406401b070 con 0x7f40740cf010 2024-09-10T07:40:23.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.241+0000 7f406be00640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f405406be30 0x7f405406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.242+0000 7f406be00640 1 -- 172.21.15.99:0/1610903209 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f406408a430 con 0x7f40740cf010 2024-09-10T07:40:23.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.242+0000 7f4073400640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f405406be30 0x7f405406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.242+0000 7f4073400640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f405406be30 0x7f405406e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4060034000 tx=0x7f406002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:23.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.246+0000 7f406be00640 1 -- 172.21.15.99:0/1610903209 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4064058820 con 0x7f40740cf010 2024-09-10T07:40:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.421+0000 7f407b200640 1 -- 172.21.15.99:0/1610903209 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40740b5880 con 0x7f40740cf010 2024-09-10T07:40:23.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.422+0000 7f406be00640 1 -- 172.21.15.99:0/1610903209 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) ==== 74+0+16677 (secure 0 0 0) 0x7f406405cb20 con 0x7f40740cf010 2024-09-10T07:40:23.422 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:23.422 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":138,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:40:22.086773+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:40:19.848847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T07:40:21.080608+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:40:23.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.424+0000 7f407b200640 1 -- 172.21.15.99:0/1610903209 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f405406be30 msgr2=0x7f405406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.424+0000 7f407b200640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f405406be30 0x7f405406e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4060034000 tx=0x7f406002e000 comp rx=0 tx=0).stop 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.424+0000 7f407b200640 1 -- 172.21.15.99:0/1610903209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 msgr2=0x7f40741458d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.424+0000 7f407b200640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 0x7f40741458d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f406400c8c0 tx=0x7f406400cd80 comp rx=0 tx=0).stop 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.424+0000 7f407b200640 1 -- 172.21.15.99:0/1610903209 shutdown_connections 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.424+0000 7f407b200640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4074162ba0 0x7f407415d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.424+0000 7f407b200640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4074152210 0x7f407415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.424+0000 7f407b200640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f405406be30 0x7f405406e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.424+0000 7f407b200640 1 --2- 172.21.15.99:0/1610903209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40740cf010 0x7f40741458d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.424+0000 7f407b200640 1 -- 172.21.15.99:0/1610903209 >> 172.21.15.99:0/1610903209 conn(0x7f407406bc10 msgr2=0x7f40740719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.425+0000 7f407b200640 1 -- 172.21.15.99:0/1610903209 shutdown_connections 2024-09-10T07:40:23.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.425+0000 7f407b200640 1 -- 172.21.15.99:0/1610903209 wait complete. 2024-09-10T07:40:23.441 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:40:23.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.598+0000 7f5e56a00640 1 Processor -- start 2024-09-10T07:40:23.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.598+0000 7f5e56a00640 1 -- start start 2024-09-10T07:40:23.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.599+0000 7f5e56a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500d2680 0x7f5e500cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.599+0000 7f5e56a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e500d2bd0 con 0x7f5e5015e970 2024-09-10T07:40:23.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.599+0000 7f5e56a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e500d2eb0 con 0x7f5e500cfac0 2024-09-10T07:40:23.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.599+0000 7f5e56a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5e500d37e0 con 0x7f5e500d2680 2024-09-10T07:40:23.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.599+0000 7f5e55600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5e5015e970 0x7f5e500d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36928/0 (socket says 172.21.15.99:36928) 2024-09-10T07:40:23.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.599+0000 7f5e55600640 1 -- 172.21.15.99:0/370021856 learned_addr learned my addr 172.21.15.99:0/370021856 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:23.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.600+0000 7f5e54c00640 1 --2- 172.21.15.99:0/370021856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500d2680 0x7f5e500cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.600+0000 7f5e4fe00640 1 -- 172.21.15.99:0/370021856 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90614262 0 0) 0x7f5e500d2bd0 con 0x7f5e5015e970 2024-09-10T07:40:23.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.600+0000 7f5e4fe00640 1 -- 172.21.15.99:0/370021856 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e38003520 con 0x7f5e5015e970 2024-09-10T07:40:23.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.600+0000 7f5e4fe00640 1 -- 172.21.15.99:0/370021856 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590855284 0 0) 0x7f5e500d2eb0 con 0x7f5e500cfac0 2024-09-10T07:40:23.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.600+0000 7f5e4fe00640 1 -- 172.21.15.99:0/370021856 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e500d2bd0 con 0x7f5e500cfac0 2024-09-10T07:40:23.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.600+0000 7f5e4fe00640 1 -- 172.21.15.99:0/370021856 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2458729252 0 0) 0x7f5e38003520 con 0x7f5e5015e970 2024-09-10T07:40:23.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.600+0000 7f5e54c00640 1 -- 172.21.15.99:0/370021856 >> v1:172.21.15.187:6789/0 conn(0x7f5e500cfac0 legacy=0x7f5e500c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.600+0000 7f5e54c00640 1 -- 172.21.15.99:0/370021856 >> v1:172.21.15.99:6789/0 conn(0x7f5e5015e970 legacy=0x7f5e500d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.600+0000 7f5e54c00640 1 -- 172.21.15.99:0/370021856 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e500d3190 con 0x7f5e500d2680 2024-09-10T07:40:23.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.601+0000 7f5e54c00640 1 --2- 172.21.15.99:0/370021856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500d2680 0x7f5e500cf580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0097d0 tx=0x7f5e3c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fbf7fc76bbfd173 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:23.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.602+0000 7f5e4fe00640 1 -- 172.21.15.99:0/370021856 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c037070 con 0x7f5e500d2680 2024-09-10T07:40:23.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.602+0000 7f5e4fe00640 1 -- 172.21.15.99:0/370021856 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c02acc0 con 0x7f5e500d2680 2024-09-10T07:40:23.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.602+0000 7f5e4fe00640 1 -- 172.21.15.99:0/370021856 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44001670 con 0x7f5e500d2680 2024-09-10T07:40:23.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.602+0000 7f5e56a00640 1 -- 172.21.15.99:0/370021856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500d2680 msgr2=0x7f5e500cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.602+0000 7f5e56a00640 1 --2- 172.21.15.99:0/370021856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500d2680 0x7f5e500cf580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0097d0 tx=0x7f5e3c02a230 comp rx=0 tx=0).stop 2024-09-10T07:40:23.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.602+0000 7f5e56a00640 1 -- 172.21.15.99:0/370021856 shutdown_connections 2024-09-10T07:40:23.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.602+0000 7f5e56a00640 1 --2- 172.21.15.99:0/370021856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500d2680 0x7f5e500cf580 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.602+0000 7f5e56a00640 1 -- 172.21.15.99:0/370021856 >> 172.21.15.99:0/370021856 conn(0x7f5e5009de00 msgr2=0x7f5e500d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:23.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.602+0000 7f5e56a00640 1 -- 172.21.15.99:0/370021856 shutdown_connections 2024-09-10T07:40:23.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.602+0000 7f5e56a00640 1 -- 172.21.15.99:0/370021856 wait complete. 2024-09-10T07:40:23.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.604+0000 7f5e56a00640 1 Processor -- start 2024-09-10T07:40:23.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.604+0000 7f5e56a00640 1 -- start start 2024-09-10T07:40:23.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.605+0000 7f5e56a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500cfac0 0x7f5e50157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.605+0000 7f5e56a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e500d2680 0x7f5e500cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.605+0000 7f5e56a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e5015e970 0x7f5e501610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.605+0000 7f5e56a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5015ed50 con 0x7f5e500d2680 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.605+0000 7f5e56a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5e500cff70 con 0x7f5e5015e970 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.605+0000 7f5e56a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5015eed0 con 0x7f5e500cfac0 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.605+0000 7f5e54c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e500d2680 0x7f5e500cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.605+0000 7f5e54c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e500d2680 0x7f5e500cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42728/0 (socket says 172.21.15.99:42728) 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.605+0000 7f5e54c00640 1 -- 172.21.15.99:0/404698150 learned_addr learned my addr 172.21.15.99:0/404698150 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e55600640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500cfac0 0x7f5e50157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e56000640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e5015e970 0x7f5e501610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e54c00640 1 -- 172.21.15.99:0/404698150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500cfac0 msgr2=0x7f5e50157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e54c00640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500cfac0 0x7f5e50157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e54c00640 1 -- 172.21.15.99:0/404698150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e5015e970 msgr2=0x7f5e501610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e54c00640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e5015e970 0x7f5e501610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:23.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e54c00640 1 -- 172.21.15.99:0/404698150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e500b9900 con 0x7f5e500d2680 2024-09-10T07:40:23.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e54c00640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e500d2680 0x7f5e500cdc40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c035040 tx=0x7f5e3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:23.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e4d600640 1 -- 172.21.15.99:0/404698150 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c041020 con 0x7f5e500d2680 2024-09-10T07:40:23.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e4d600640 1 -- 172.21.15.99:0/404698150 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c03d640 con 0x7f5e500d2680 2024-09-10T07:40:23.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.606+0000 7f5e4d600640 1 -- 172.21.15.99:0/404698150 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c037040 con 0x7f5e500d2680 2024-09-10T07:40:23.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.607+0000 7f5e56a00640 1 -- 172.21.15.99:0/404698150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e500b9620 con 0x7f5e500d2680 2024-09-10T07:40:23.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.607+0000 7f5e56a00640 1 -- 172.21.15.99:0/404698150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e500cd440 con 0x7f5e500d2680 2024-09-10T07:40:23.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.608+0000 7f5e56a00640 1 -- 172.21.15.99:0/404698150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e500cf580 con 0x7f5e500d2680 2024-09-10T07:40:23.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.609+0000 7f5e4d600640 1 -- 172.21.15.99:0/404698150 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e3c044020 con 0x7f5e500d2680 2024-09-10T07:40:23.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.609+0000 7f5e4d600640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5e3006be30 0x7f5e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:23.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.609+0000 7f5e4d600640 1 -- 172.21.15.99:0/404698150 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f5e3c0ab320 con 0x7f5e500d2680 2024-09-10T07:40:23.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.610+0000 7f5e55600640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5e3006be30 0x7f5e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:23.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.610+0000 7f5e55600640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5e3006be30 0x7f5e3006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5e440011e0 tx=0x7f5e44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:23.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.614+0000 7f5e4d600640 1 -- 172.21.15.99:0/404698150 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e3c04b030 con 0x7f5e500d2680 2024-09-10T07:40:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:23.825+0000 7f5e56a00640 1 -- 172.21.15.99:0/404698150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5e500ca660 con 0x7f5e500d2680 2024-09-10T07:40:24.657 INFO:tasks.ceph.mds.a.smithi099.stderr:2024-09-10T07:40:24.657+0000 7fd078e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:40:24.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.707+0000 7f5e4d600640 1 -- 172.21.15.99:0/404698150 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) ==== 118+0+0 (secure 0 0 0) 0x7f5e3c079d60 con 0x7f5e500d2680 2024-09-10T07:40:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 -- 172.21.15.99:0/404698150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5e3006be30 msgr2=0x7f5e3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5e3006be30 0x7f5e3006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5e440011e0 tx=0x7f5e44009040 comp rx=0 tx=0).stop 2024-09-10T07:40:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 -- 172.21.15.99:0/404698150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e500d2680 msgr2=0x7f5e500cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e500d2680 0x7f5e500cdc40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c035040 tx=0x7f5e3c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 -- 172.21.15.99:0/404698150 shutdown_connections 2024-09-10T07:40:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e5015e970 0x7f5e501610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5e3006be30 0x7f5e3006e2f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e500d2680 0x7f5e500cdc40 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 --2- 172.21.15.99:0/404698150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e500cfac0 0x7f5e50157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 -- 172.21.15.99:0/404698150 >> 172.21.15.99:0/404698150 conn(0x7f5e5009de00 msgr2=0x7f5e500c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 -- 172.21.15.99:0/404698150 shutdown_connections 2024-09-10T07:40:24.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.710+0000 7f5e56a00640 1 -- 172.21.15.99:0/404698150 wait complete. 2024-09-10T07:40:24.728 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T07:40:24.729 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:40:24.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.895+0000 7face6000640 1 Processor -- start 2024-09-10T07:40:24.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.895+0000 7face6000640 1 -- start start 2024-09-10T07:40:24.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.896+0000 7face6000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7face015b760 0x7face00afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:24.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.896+0000 7face6000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7face00b4a90 0x7face006f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.896+0000 7face6000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7face00b4300 con 0x7face00d0630 2024-09-10T07:40:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.896+0000 7face6000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7face006d700 con 0x7face00b4a90 2024-09-10T07:40:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.896+0000 7face6000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7face006d9e0 con 0x7face015b760 2024-09-10T07:40:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.897+0000 7facdea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7face00b4a90 0x7face006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.897+0000 7facdea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7face00b4a90 0x7face006f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42740/0 (socket says 172.21.15.99:42740) 2024-09-10T07:40:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.897+0000 7facdea00640 1 -- 172.21.15.99:0/1702352978 learned_addr learned my addr 172.21.15.99:0/1702352978 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.897+0000 7facdf400640 1 --2- 172.21.15.99:0/1702352978 >> v2:172.21.15.187:3300/0 conn(0x7face015b760 0x7face00afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.897+0000 7facdea00640 1 -- 172.21.15.99:0/1702352978 >> v2:172.21.15.187:3300/0 conn(0x7face015b760 msgr2=0x7face00afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.897+0000 7facdea00640 1 --2- 172.21.15.99:0/1702352978 >> v2:172.21.15.187:3300/0 conn(0x7face015b760 0x7face00afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.897+0000 7facdea00640 1 -- 172.21.15.99:0/1702352978 >> v1:172.21.15.187:6789/0 conn(0x7face00d0630 legacy=0x7face00d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.897+0000 7facdea00640 1 -- 172.21.15.99:0/1702352978 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face00b4570 con 0x7face00b4a90 2024-09-10T07:40:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.898+0000 7facdea00640 1 --2- 172.21.15.99:0/1702352978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face00b4a90 0x7face006f290 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7face00ce2b0 tx=0x7facc802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e303c22a8f2861 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:24.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.898+0000 7facde000640 1 -- 172.21.15.99:0/1702352978 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8037070 con 0x7face00b4a90 2024-09-10T07:40:24.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.899+0000 7facde000640 1 -- 172.21.15.99:0/1702352978 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc802ae20 con 0x7face00b4a90 2024-09-10T07:40:24.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.899+0000 7facde000640 1 -- 172.21.15.99:0/1702352978 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8032660 con 0x7face00b4a90 2024-09-10T07:40:24.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.899+0000 7face6000640 1 -- 172.21.15.99:0/1702352978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face00b4a90 msgr2=0x7face006f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:24.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.899+0000 7face6000640 1 --2- 172.21.15.99:0/1702352978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face00b4a90 0x7face006f290 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7face00ce2b0 tx=0x7facc802a110 comp rx=0 tx=0).stop 2024-09-10T07:40:24.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.899+0000 7face6000640 1 -- 172.21.15.99:0/1702352978 shutdown_connections 2024-09-10T07:40:24.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.899+0000 7face6000640 1 --2- 172.21.15.99:0/1702352978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face00b4a90 0x7face006f290 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.899+0000 7face6000640 1 --2- 172.21.15.99:0/1702352978 >> v2:172.21.15.187:3300/0 conn(0x7face015b760 0x7face00afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.899+0000 7face6000640 1 -- 172.21.15.99:0/1702352978 >> 172.21.15.99:0/1702352978 conn(0x7face006bc10 msgr2=0x7face006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:24.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.899+0000 7face6000640 1 -- 172.21.15.99:0/1702352978 shutdown_connections 2024-09-10T07:40:24.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.899+0000 7face6000640 1 -- 172.21.15.99:0/1702352978 wait complete. 2024-09-10T07:40:24.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.901+0000 7face6000640 1 Processor -- start 2024-09-10T07:40:24.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.901+0000 7face6000640 1 -- start start 2024-09-10T07:40:24.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7face6000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7face00b4a90 0x7face0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:24.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7face6000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7face00d0630 0x7face015db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:24.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7face6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face015b760 0x7face0153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:24.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7face6000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7face00b4f20 con 0x7face015b760 2024-09-10T07:40:24.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7face6000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7face015bb40 con 0x7face00b4a90 2024-09-10T07:40:24.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7face6000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7face015c840 con 0x7face00d0630 2024-09-10T07:40:24.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7facdfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face015b760 0x7face0153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:24.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7facdfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face015b760 0x7face0153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42742/0 (socket says 172.21.15.99:42742) 2024-09-10T07:40:24.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7facdfe00640 1 -- 172.21.15.99:0/3135473501 learned_addr learned my addr 172.21.15.99:0/3135473501 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:24.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7facdea00640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7face00d0630 0x7face015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:24.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.902+0000 7facdf400640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7face00b4a90 0x7face0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:24.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7facdfe00640 1 -- 172.21.15.99:0/3135473501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7face00d0630 msgr2=0x7face015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:24.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7facdfe00640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7face00d0630 0x7face015db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7facdfe00640 1 -- 172.21.15.99:0/3135473501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7face00b4a90 msgr2=0x7face0155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:24.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7facdfe00640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7face00b4a90 0x7face0155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:24.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7facdfe00640 1 -- 172.21.15.99:0/3135473501 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face015bf10 con 0x7face015b760 2024-09-10T07:40:24.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7facdfe00640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face015b760 0x7face0153970 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7facd800c410 tx=0x7facd800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:24.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7facd7400640 1 -- 172.21.15.99:0/3135473501 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8011790 con 0x7face015b760 2024-09-10T07:40:24.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7facd7400640 1 -- 172.21.15.99:0/3135473501 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd8017070 con 0x7face015b760 2024-09-10T07:40:24.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7facd7400640 1 -- 172.21.15.99:0/3135473501 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8011bb0 con 0x7face015b760 2024-09-10T07:40:24.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7face6000640 1 -- 172.21.15.99:0/3135473501 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face015c1f0 con 0x7face015b760 2024-09-10T07:40:24.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.903+0000 7face6000640 1 -- 172.21.15.99:0/3135473501 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face0145920 con 0x7face015b760 2024-09-10T07:40:24.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.904+0000 7face6000640 1 -- 172.21.15.99:0/3135473501 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face006dcc0 con 0x7face015b760 2024-09-10T07:40:24.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.905+0000 7facd7400640 1 -- 172.21.15.99:0/3135473501 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7facd801c460 con 0x7face015b760 2024-09-10T07:40:24.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.906+0000 7facd7400640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7facbc06be30 0x7facbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:24.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.906+0000 7facd7400640 1 -- 172.21.15.99:0/3135473501 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7facd808a990 con 0x7face015b760 2024-09-10T07:40:24.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.906+0000 7facdf400640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7facbc06be30 0x7facbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:24.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.907+0000 7facdf400640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7facbc06be30 0x7facbc06e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7facd0003aa0 tx=0x7facd0009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:24.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:24.910+0000 7facd7400640 1 -- 172.21.15.99:0/3135473501 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facd8021020 con 0x7face015b760 2024-09-10T07:40:25.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.117+0000 7face6000640 1 -- 172.21.15.99:0/3135473501 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7face015c9c0 con 0x7face015b760 2024-09-10T07:40:25.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.713+0000 7facd7400640 1 -- 172.21.15.99:0/3135473501 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7facd8058c50 con 0x7face015b760 2024-09-10T07:40:25.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 -- 172.21.15.99:0/3135473501 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7facbc06be30 msgr2=0x7facbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:25.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7facbc06be30 0x7facbc06e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7facd0003aa0 tx=0x7facd0009830 comp rx=0 tx=0).stop 2024-09-10T07:40:25.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 -- 172.21.15.99:0/3135473501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face015b760 msgr2=0x7face0153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:25.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face015b760 0x7face0153970 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7facd800c410 tx=0x7facd800c8d0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 -- 172.21.15.99:0/3135473501 shutdown_connections 2024-09-10T07:40:25.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7facbc06be30 0x7facbc06e2f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7face015b760 0x7face0153970 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7face00d0630 0x7face015db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 --2- 172.21.15.99:0/3135473501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7face00b4a90 0x7face0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 -- 172.21.15.99:0/3135473501 >> 172.21.15.99:0/3135473501 conn(0x7face006bc10 msgr2=0x7face00ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:25.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.716+0000 7face6000640 1 -- 172.21.15.99:0/3135473501 shutdown_connections 2024-09-10T07:40:25.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.717+0000 7face6000640 1 -- 172.21.15.99:0/3135473501 wait complete. 2024-09-10T07:40:25.733 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:40:25.733 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.888+0000 7f4200e00640 1 Processor -- start 2024-09-10T07:40:25.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.888+0000 7f4200e00640 1 -- start start 2024-09-10T07:40:25.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.889+0000 7f4200e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0d2680 0x7f41fc0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:25.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.889+0000 7f4200e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f41fc0cfac0 0x7f41fc0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:25.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.889+0000 7f4200e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41fc0d2bd0 con 0x7f41fc15e970 2024-09-10T07:40:25.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.889+0000 7f4200e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f41fc0d37e0 con 0x7f41fc0cfac0 2024-09-10T07:40:25.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.889+0000 7f4200e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f41fc0d2eb0 con 0x7f41fc0d2680 2024-09-10T07:40:25.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.889+0000 7f41fb400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f41fc15e970 0x7f41fc0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36940/0 (socket says 172.21.15.99:36940) 2024-09-10T07:40:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.889+0000 7f41fb400640 1 -- 172.21.15.99:0/801482510 learned_addr learned my addr 172.21.15.99:0/801482510 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.890+0000 7f41f2a00640 1 --2- 172.21.15.99:0/801482510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0d2680 0x7f41fc0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.890+0000 7f41fbe00640 1 --2- 172.21.15.99:0/801482510 >> v2:172.21.15.187:3300/0 conn(0x7f41fc0cfac0 0x7f41fc0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.890+0000 7f41faa00640 1 -- 172.21.15.99:0/801482510 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261546787 0 0) 0x7f41fc0d2bd0 con 0x7f41fc15e970 2024-09-10T07:40:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.890+0000 7f41faa00640 1 -- 172.21.15.99:0/801482510 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e0003520 con 0x7f41fc15e970 2024-09-10T07:40:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.890+0000 7f41fbe00640 1 -- 172.21.15.99:0/801482510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0d2680 msgr2=0x7f41fc0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.890+0000 7f41fbe00640 1 --2- 172.21.15.99:0/801482510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0d2680 0x7f41fc0cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.890+0000 7f41fbe00640 1 -- 172.21.15.99:0/801482510 >> v1:172.21.15.99:6789/0 conn(0x7f41fc15e970 legacy=0x7f41fc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.890+0000 7f41fbe00640 1 -- 172.21.15.99:0/801482510 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc0d3190 con 0x7f41fc0cfac0 2024-09-10T07:40:25.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.890+0000 7f41f2a00640 1 --2- 172.21.15.99:0/801482510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0d2680 0x7f41fc0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.891+0000 7f41fbe00640 1 --2- 172.21.15.99:0/801482510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc0cfac0 0x7f41fc0c8700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009d90 tx=0x7f41f402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14af839ecb16bfd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f41faa00640 1 -- 172.21.15.99:0/801482510 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f4007740 con 0x7f41fc0cfac0 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f41faa00640 1 -- 172.21.15.99:0/801482510 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f40078e0 con 0x7f41fc0cfac0 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f41faa00640 1 -- 172.21.15.99:0/801482510 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f4007cb0 con 0x7f41fc0cfac0 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f4200e00640 1 -- 172.21.15.99:0/801482510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc0cfac0 msgr2=0x7f41fc0c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f4200e00640 1 --2- 172.21.15.99:0/801482510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc0cfac0 0x7f41fc0c8700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009d90 tx=0x7f41f402a6f0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f4200e00640 1 -- 172.21.15.99:0/801482510 shutdown_connections 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f4200e00640 1 --2- 172.21.15.99:0/801482510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc0cfac0 0x7f41fc0c8700 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f4200e00640 1 --2- 172.21.15.99:0/801482510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0d2680 0x7f41fc0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f4200e00640 1 -- 172.21.15.99:0/801482510 >> 172.21.15.99:0/801482510 conn(0x7f41fc09de00 msgr2=0x7f41fc0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f4200e00640 1 -- 172.21.15.99:0/801482510 shutdown_connections 2024-09-10T07:40:25.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.892+0000 7f4200e00640 1 -- 172.21.15.99:0/801482510 wait complete. 2024-09-10T07:40:25.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.894+0000 7f4200e00640 1 Processor -- start 2024-09-10T07:40:25.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.894+0000 7f4200e00640 1 -- start start 2024-09-10T07:40:25.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.895+0000 7f4200e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0cfac0 0x7f41fc153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:25.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.895+0000 7f4200e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41fc0d2680 0x7f41fc0ba260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.895+0000 7f4200e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc15e970 0x7f41fc155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.895+0000 7f4200e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc15ed50 con 0x7f41fc0d2680 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.895+0000 7f4200e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc0cff70 con 0x7f41fc15e970 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.895+0000 7f4200e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f41fc15eed0 con 0x7f41fc0cfac0 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.895+0000 7f41f2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41fc0d2680 0x7f41fc0ba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.895+0000 7f41f2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41fc0d2680 0x7f41fc0ba260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42752/0 (socket says 172.21.15.99:42752) 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.895+0000 7f41f2a00640 1 -- 172.21.15.99:0/3106611307 learned_addr learned my addr 172.21.15.99:0/3106611307 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41f2a00640 1 -- 172.21.15.99:0/3106611307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0cfac0 msgr2=0x7f41fc153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41fb400640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0cfac0 0x7f41fc153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41fbe00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc15e970 0x7f41fc155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41f2a00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0cfac0 0x7f41fc153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41f2a00640 1 -- 172.21.15.99:0/3106611307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc15e970 msgr2=0x7f41fc155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41f2a00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc15e970 0x7f41fc155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41f2a00640 1 -- 172.21.15.99:0/3106611307 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc0b9360 con 0x7f41fc0d2680 2024-09-10T07:40:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41fbe00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc15e970 0x7f41fc155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41fb400640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0cfac0 0x7f41fc153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41f2a00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41fc0d2680 0x7f41fc0ba260 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f41e400ebe0 tx=0x7f41e400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41f3e00640 1 -- 172.21.15.99:0/3106611307 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4017070 con 0x7f41fc0d2680 2024-09-10T07:40:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41f3e00640 1 -- 172.21.15.99:0/3106611307 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e400cc30 con 0x7f41fc0d2680 2024-09-10T07:40:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f41f3e00640 1 -- 172.21.15.99:0/3106611307 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4013470 con 0x7f41fc0d2680 2024-09-10T07:40:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.896+0000 7f4200e00640 1 -- 172.21.15.99:0/3106611307 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc0b9640 con 0x7f41fc0d2680 2024-09-10T07:40:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.897+0000 7f4200e00640 1 -- 172.21.15.99:0/3106611307 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc15fb50 con 0x7f41fc0d2680 2024-09-10T07:40:25.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.898+0000 7f4200e00640 1 -- 172.21.15.99:0/3106611307 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41fc0ceee0 con 0x7f41fc0d2680 2024-09-10T07:40:25.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.899+0000 7f41f3e00640 1 -- 172.21.15.99:0/3106611307 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41e401a070 con 0x7f41fc0d2680 2024-09-10T07:40:25.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.899+0000 7f41f3e00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41d806be60 0x7f41d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.900+0000 7f41f3e00640 1 -- 172.21.15.99:0/3106611307 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f41e408b180 con 0x7f41fc0d2680 2024-09-10T07:40:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.900+0000 7f41fb400640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41d806be60 0x7f41d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.900+0000 7f41fb400640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41d806be60 0x7f41d806e320 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f41ec005880 tx=0x7f41ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:25.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:25.904+0000 7f41f3e00640 1 -- 172.21.15.99:0/3106611307 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41e4059a90 con 0x7f41fc0d2680 2024-09-10T07:40:26.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.114+0000 7f4200e00640 1 -- 172.21.15.99:0/3106611307 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41fc0cf580 con 0x7f41fc0d2680 2024-09-10T07:40:26.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.114+0000 7f41f3e00640 1 -- 172.21.15.99:0/3106611307 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7f41e4059390 con 0x7f41fc0d2680 2024-09-10T07:40:26.115 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:26.115 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":66,"btime":"2024-09-10T07:40:25:708900+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/4097316027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4097316027},{"type":"v1","addr":"172.21.15.187:6834","nonce":4097316027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2128941619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2128941619},{"type":"v1","addr":"172.21.15.187:6835","nonce":2128941619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/722129971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":722129971},{"type":"v1","addr":"172.21.15.99:6835","nonce":722129971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:40:22.087139+0000","modified":"2024-09-10T07:40:25.118483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1531136464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1531136464},{"type":"v1","addr":"172.21.15.99:6837","nonce":1531136464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6795,"qdb_cluster":[6795]},"id":8}]} 2024-09-10T07:40:26.115 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 66 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.116+0000 7f4200e00640 1 -- 172.21.15.99:0/3106611307 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41d806be60 msgr2=0x7f41d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41d806be60 0x7f41d806e320 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f41ec005880 tx=0x7f41ec009040 comp rx=0 tx=0).stop 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 -- 172.21.15.99:0/3106611307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41fc0d2680 msgr2=0x7f41fc0ba260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41fc0d2680 0x7f41fc0ba260 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f41e400ebe0 tx=0x7f41e400c520 comp rx=0 tx=0).stop 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 -- 172.21.15.99:0/3106611307 shutdown_connections 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41fc15e970 0x7f41fc155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41d806be60 0x7f41d806e320 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41fc0d2680 0x7f41fc0ba260 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 --2- 172.21.15.99:0/3106611307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41fc0cfac0 0x7f41fc153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 -- 172.21.15.99:0/3106611307 >> 172.21.15.99:0/3106611307 conn(0x7f41fc09de00 msgr2=0x7f41fc0c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 -- 172.21.15.99:0/3106611307 shutdown_connections 2024-09-10T07:40:26.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.117+0000 7f4200e00640 1 -- 172.21.15.99:0/3106611307 wait complete. 2024-09-10T07:40:26.133 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:40:26.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.286+0000 7f3d47c00640 1 Processor -- start 2024-09-10T07:40:26.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.286+0000 7f3d47c00640 1 -- start start 2024-09-10T07:40:26.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.287+0000 7f3d47c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3d400ce780 0x7f3d4006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.287+0000 7f3d47c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4006e3d0 con 0x7f3d40145290 2024-09-10T07:40:26.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.287+0000 7f3d47c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4006e6b0 con 0x7f3d40072f40 2024-09-10T07:40:26.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.287+0000 7f3d47c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f3d4006efe0 con 0x7f3d400ce780 2024-09-10T07:40:26.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.288+0000 7f3d45200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3d40145290 0x7f3d40072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36942/0 (socket says 172.21.15.99:36942) 2024-09-10T07:40:26.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.288+0000 7f3d45200640 1 -- 172.21.15.99:0/1263393821 learned_addr learned my addr 172.21.15.99:0/1263393821 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:26.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.288+0000 7f3d45c00640 1 --2- 172.21.15.99:0/1263393821 >> v2:172.21.15.187:3300/0 conn(0x7f3d400ce780 0x7f3d4006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.288+0000 7f3d3f400640 1 -- 172.21.15.99:0/1263393821 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705378203 0 0) 0x7f3d4006e3d0 con 0x7f3d40145290 2024-09-10T07:40:26.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.288+0000 7f3d3f400640 1 -- 172.21.15.99:0/1263393821 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d28003520 con 0x7f3d40145290 2024-09-10T07:40:26.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.288+0000 7f3d45c00640 1 -- 172.21.15.99:0/1263393821 >> v1:172.21.15.187:6789/0 conn(0x7f3d40072f40 legacy=0x7f3d400b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.288+0000 7f3d45c00640 1 -- 172.21.15.99:0/1263393821 >> v1:172.21.15.99:6789/0 conn(0x7f3d40145290 legacy=0x7f3d40072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.288+0000 7f3d45c00640 1 -- 172.21.15.99:0/1263393821 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4006e990 con 0x7f3d400ce780 2024-09-10T07:40:26.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.289+0000 7f3d45c00640 1 --2- 172.21.15.99:0/1263393821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d400ce780 0x7f3d4006f470 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009d90 tx=0x7f3d3802c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab2b5edc2c16bc5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:26.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.290+0000 7f3d3f400640 1 -- 172.21.15.99:0/1263393821 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38036020 con 0x7f3d400ce780 2024-09-10T07:40:26.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.290+0000 7f3d3f400640 1 -- 172.21.15.99:0/1263393821 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d38032800 con 0x7f3d400ce780 2024-09-10T07:40:26.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.290+0000 7f3d3f400640 1 -- 172.21.15.99:0/1263393821 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38032bd0 con 0x7f3d400ce780 2024-09-10T07:40:26.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.290+0000 7f3d47c00640 1 -- 172.21.15.99:0/1263393821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d400ce780 msgr2=0x7f3d4006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.290+0000 7f3d47c00640 1 --2- 172.21.15.99:0/1263393821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d400ce780 0x7f3d4006f470 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009d90 tx=0x7f3d3802c900 comp rx=0 tx=0).stop 2024-09-10T07:40:26.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.290+0000 7f3d47c00640 1 -- 172.21.15.99:0/1263393821 shutdown_connections 2024-09-10T07:40:26.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.290+0000 7f3d47c00640 1 --2- 172.21.15.99:0/1263393821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d400ce780 0x7f3d4006f470 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.290+0000 7f3d47c00640 1 -- 172.21.15.99:0/1263393821 >> 172.21.15.99:0/1263393821 conn(0x7f3d4006bc10 msgr2=0x7f3d4006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:26.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.290+0000 7f3d47c00640 1 -- 172.21.15.99:0/1263393821 shutdown_connections 2024-09-10T07:40:26.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.290+0000 7f3d47c00640 1 -- 172.21.15.99:0/1263393821 wait complete. 2024-09-10T07:40:26.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.292+0000 7f3d47c00640 1 Processor -- start 2024-09-10T07:40:26.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.292+0000 7f3d47c00640 1 -- start start 2024-09-10T07:40:26.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d47c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d40072f40 0x7f3d4015b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d47c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d400ce780 0x7f3d4014c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d47c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d40145290 0x7f3d400ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d47c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4006df80 con 0x7f3d40145290 2024-09-10T07:40:26.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d47c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3d40145670 con 0x7f3d400ce780 2024-09-10T07:40:26.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d47c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4006e100 con 0x7f3d40072f40 2024-09-10T07:40:26.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d45c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d40145290 0x7f3d400ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d45c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d40145290 0x7f3d400ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42762/0 (socket says 172.21.15.99:42762) 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d45c00640 1 -- 172.21.15.99:0/103946717 learned_addr learned my addr 172.21.15.99:0/103946717 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d3fe00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d400ce780 0x7f3d4014c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.293+0000 7f3d45200640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d40072f40 0x7f3d4015b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d45c00640 1 -- 172.21.15.99:0/103946717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d40072f40 msgr2=0x7f3d4015b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d45c00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d40072f40 0x7f3d4015b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d45c00640 1 -- 172.21.15.99:0/103946717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d400ce780 msgr2=0x7f3d4014c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d45c00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d400ce780 0x7f3d4014c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d45c00640 1 -- 172.21.15.99:0/103946717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4014cef0 con 0x7f3d40145290 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d3fe00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d400ce780 0x7f3d4014c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d45c00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d40145290 0x7f3d400ccad0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009eb0 tx=0x7f3d38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d3cc00640 1 -- 172.21.15.99:0/103946717 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38036040 con 0x7f3d40145290 2024-09-10T07:40:26.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d3cc00640 1 -- 172.21.15.99:0/103946717 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3803dd00 con 0x7f3d40145290 2024-09-10T07:40:26.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d47c00640 1 -- 172.21.15.99:0/103946717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d400cd010 con 0x7f3d40145290 2024-09-10T07:40:26.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d3cc00640 1 -- 172.21.15.99:0/103946717 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38009450 con 0x7f3d40145290 2024-09-10T07:40:26.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.294+0000 7f3d47c00640 1 -- 172.21.15.99:0/103946717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4014bbf0 con 0x7f3d40145290 2024-09-10T07:40:26.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.295+0000 7f3d47c00640 1 -- 172.21.15.99:0/103946717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d400715a0 con 0x7f3d40145290 2024-09-10T07:40:26.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.296+0000 7f3d3cc00640 1 -- 172.21.15.99:0/103946717 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d38039020 con 0x7f3d40145290 2024-09-10T07:40:26.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.297+0000 7f3d3cc00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3d2006be30 0x7f3d2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.298+0000 7f3d3cc00640 1 -- 172.21.15.99:0/103946717 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f3d380ae460 con 0x7f3d40145290 2024-09-10T07:40:26.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.298+0000 7f3d45200640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3d2006be30 0x7f3d2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.298+0000 7f3d45200640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3d2006be30 0x7f3d2006e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3d340011e0 tx=0x7f3d34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:26.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.302+0000 7f3d3cc00640 1 -- 172.21.15.99:0/103946717 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d38042070 con 0x7f3d40145290 2024-09-10T07:40:26.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.477+0000 7f3d47c00640 1 -- 172.21.15.99:0/103946717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d4015db90 con 0x7f3d40145290 2024-09-10T07:40:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.478+0000 7f3d3cc00640 1 -- 172.21.15.99:0/103946717 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+16664 (secure 0 0 0) 0x7f3d3807ce00 con 0x7f3d40145290 2024-09-10T07:40:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:26.478 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":139,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:40:23.673167+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:40:19.848847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T07:40:21.080608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:40:26.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 -- 172.21.15.99:0/103946717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3d2006be30 msgr2=0x7f3d2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3d2006be30 0x7f3d2006e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3d340011e0 tx=0x7f3d34009040 comp rx=0 tx=0).stop 2024-09-10T07:40:26.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 -- 172.21.15.99:0/103946717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d40145290 msgr2=0x7f3d400ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d40145290 0x7f3d400ccad0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009eb0 tx=0x7f3d38004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 -- 172.21.15.99:0/103946717 shutdown_connections 2024-09-10T07:40:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3d2006be30 0x7f3d2006e2f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d40145290 0x7f3d400ccad0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d400ce780 0x7f3d4014c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 --2- 172.21.15.99:0/103946717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d40072f40 0x7f3d4015b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 -- 172.21.15.99:0/103946717 >> 172.21.15.99:0/103946717 conn(0x7f3d4006bc10 msgr2=0x7f3d4015c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 -- 172.21.15.99:0/103946717 shutdown_connections 2024-09-10T07:40:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.480+0000 7f3d47c00640 1 -- 172.21.15.99:0/103946717 wait complete. 2024-09-10T07:40:26.496 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:40:26.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:40:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.649+0000 7f14ed200640 1 Processor -- start 2024-09-10T07:40:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.649+0000 7f14ed200640 1 -- start start 2024-09-10T07:40:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.650+0000 7f14ed200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f14e815eb00 0x7f14e81630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.650+0000 7f14ed200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e806e730 con 0x7f14e806d810 2024-09-10T07:40:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.650+0000 7f14ed200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e806ea10 con 0x7f14e815fef0 2024-09-10T07:40:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.650+0000 7f14ed200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f14e81628d0 con 0x7f14e815eb00 2024-09-10T07:40:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.650+0000 7f14e5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f14e815eb00 0x7f14e81630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.650+0000 7f14e5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f14e815eb00 0x7f14e81630d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42774/0 (socket says 172.21.15.99:42774) 2024-09-10T07:40:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.650+0000 7f14e5e00640 1 -- 172.21.15.99:0/2854948709 learned_addr learned my addr 172.21.15.99:0/2854948709 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.650+0000 7f14e5400640 1 --1- 172.21.15.99:0/2854948709 >> v1:172.21.15.99:6789/0 conn(0x7f14e806d810 0x7f14e80b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36946/0 (socket says 172.21.15.99:36946) 2024-09-10T07:40:26.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.651+0000 7f14e5e00640 1 -- 172.21.15.99:0/2854948709 >> v1:172.21.15.187:6789/0 conn(0x7f14e815fef0 legacy=0x7f14e80cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.651+0000 7f14e5e00640 1 -- 172.21.15.99:0/2854948709 >> v1:172.21.15.99:6789/0 conn(0x7f14e806d810 legacy=0x7f14e80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.651+0000 7f14e5e00640 1 -- 172.21.15.99:0/2854948709 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e8162bb0 con 0x7f14e815eb00 2024-09-10T07:40:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.652+0000 7f14e5e00640 1 --2- 172.21.15.99:0/2854948709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 0x7f14e81630d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009870 tx=0x7f14d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180416af08ca75df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.652+0000 7f14e4a00640 1 -- 172.21.15.99:0/2854948709 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8037070 con 0x7f14e815eb00 2024-09-10T07:40:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.652+0000 7f14e4a00640 1 -- 172.21.15.99:0/2854948709 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8032440 con 0x7f14e815eb00 2024-09-10T07:40:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.652+0000 7f14e4a00640 1 -- 172.21.15.99:0/2854948709 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8032810 con 0x7f14e815eb00 2024-09-10T07:40:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.652+0000 7f14ed200640 1 -- 172.21.15.99:0/2854948709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 msgr2=0x7f14e81630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.652+0000 7f14ed200640 1 --2- 172.21.15.99:0/2854948709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 0x7f14e81630d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009870 tx=0x7f14d802a270 comp rx=0 tx=0).stop 2024-09-10T07:40:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.652+0000 7f14ed200640 1 -- 172.21.15.99:0/2854948709 shutdown_connections 2024-09-10T07:40:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.652+0000 7f14ed200640 1 --2- 172.21.15.99:0/2854948709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 0x7f14e81630d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.652+0000 7f14ed200640 1 -- 172.21.15.99:0/2854948709 >> 172.21.15.99:0/2854948709 conn(0x7f14e806cd20 msgr2=0x7f14e806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.653+0000 7f14ed200640 1 -- 172.21.15.99:0/2854948709 shutdown_connections 2024-09-10T07:40:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.653+0000 7f14ed200640 1 -- 172.21.15.99:0/2854948709 wait complete. 2024-09-10T07:40:26.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.654+0000 7f14ed200640 1 Processor -- start 2024-09-10T07:40:26.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.654+0000 7f14ed200640 1 -- start start 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.655+0000 7f14ed200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14e806d810 0x7f14e80c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.655+0000 7f14ed200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 0x7f14e814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.655+0000 7f14ed200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14e80ce3c0 0x7f14e80ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.655+0000 7f14ed200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f14e80b1300 con 0x7f14e815eb00 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.655+0000 7f14ed200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f14e80b1180 con 0x7f14e80ce3c0 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.655+0000 7f14ed200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f14e806ffd0 con 0x7f14e806d810 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.655+0000 7f14e5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 0x7f14e814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.655+0000 7f14e5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 0x7f14e814f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42790/0 (socket says 172.21.15.99:42790) 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.655+0000 7f14e5400640 1 -- 172.21.15.99:0/1675379408 learned_addr learned my addr 172.21.15.99:0/1675379408 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14e5e00640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14e806d810 0x7f14e80c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14e6800640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14e80ce3c0 0x7f14e80ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14e5400640 1 -- 172.21.15.99:0/1675379408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14e806d810 msgr2=0x7f14e80c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14e5400640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14e806d810 0x7f14e80c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14e5400640 1 -- 172.21.15.99:0/1675379408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14e80ce3c0 msgr2=0x7f14e80ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14e5400640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14e80ce3c0 0x7f14e80ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14e5400640 1 -- 172.21.15.99:0/1675379408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e815c740 con 0x7f14e815eb00 2024-09-10T07:40:26.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14e5400640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 0x7f14e814f430 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c500 tx=0x7f14d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14de000640 1 -- 172.21.15.99:0/1675379408 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4018070 con 0x7f14e815eb00 2024-09-10T07:40:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14de000640 1 -- 172.21.15.99:0/1675379408 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d4007500 con 0x7f14e815eb00 2024-09-10T07:40:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14de000640 1 -- 172.21.15.99:0/1675379408 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d40049e0 con 0x7f14e815eb00 2024-09-10T07:40:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.656+0000 7f14ed200640 1 -- 172.21.15.99:0/1675379408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e815ca20 con 0x7f14e815eb00 2024-09-10T07:40:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.657+0000 7f14ed200640 1 -- 172.21.15.99:0/1675379408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e815cfe0 con 0x7f14e815eb00 2024-09-10T07:40:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.658+0000 7f14ed200640 1 -- 172.21.15.99:0/1675379408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e80d1460 con 0x7f14e815eb00 2024-09-10T07:40:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.658+0000 7f14de000640 1 -- 172.21.15.99:0/1675379408 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14d401b070 con 0x7f14e815eb00 2024-09-10T07:40:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.659+0000 7f14de000640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f14c806be30 0x7f14c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.659+0000 7f14de000640 1 -- 172.21.15.99:0/1675379408 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f14d408a1c0 con 0x7f14e815eb00 2024-09-10T07:40:26.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.660+0000 7f14e5e00640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f14c806be30 0x7f14c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:26.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.660+0000 7f14e5e00640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f14c806be30 0x7f14c806e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f14d8034000 tx=0x7f14d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:26.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.664+0000 7f14de000640 1 -- 172.21.15.99:0/1675379408 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f14d4058510 con 0x7f14e815eb00 2024-09-10T07:40:26.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.836+0000 7f14ed200640 1 -- 172.21.15.99:0/1675379408 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14e806c610 con 0x7f14c806be30 2024-09-10T07:40:26.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.841+0000 7f14de000640 1 -- 172.21.15.99:0/1675379408 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247947 (secure 0 0 0) 0x7f14e806c610 con 0x7f14c806be30 2024-09-10T07:40:26.844 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:26.846 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:40:26.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.845+0000 7f14ed200640 1 -- 172.21.15.99:0/1675379408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f14c806be30 msgr2=0x7f14c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.845+0000 7f14ed200640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f14c806be30 0x7f14c806e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f14d8034000 tx=0x7f14d802e000 comp rx=0 tx=0).stop 2024-09-10T07:40:26.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.845+0000 7f14ed200640 1 -- 172.21.15.99:0/1675379408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 msgr2=0x7f14e814f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:26.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.845+0000 7f14ed200640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 0x7f14e814f430 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c500 tx=0x7f14d400c9c0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.845+0000 7f14ed200640 1 -- 172.21.15.99:0/1675379408 shutdown_connections 2024-09-10T07:40:26.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.845+0000 7f14ed200640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14e80ce3c0 0x7f14e80ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.845+0000 7f14ed200640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f14c806be30 0x7f14c806e2f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.845+0000 7f14ed200640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14e815eb00 0x7f14e814f430 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.845+0000 7f14ed200640 1 --2- 172.21.15.99:0/1675379408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14e806d810 0x7f14e80c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:26.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.845+0000 7f14ed200640 1 -- 172.21.15.99:0/1675379408 >> 172.21.15.99:0/1675379408 conn(0x7f14e806cd20 msgr2=0x7f14e80b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:26.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.846+0000 7f14ed200640 1 -- 172.21.15.99:0/1675379408 shutdown_connections 2024-09-10T07:40:26.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:26.846+0000 7f14ed200640 1 -- 172.21.15.99:0/1675379408 wait complete. 2024-09-10T07:40:26.861 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-10T07:40:26.771441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555352,"statfs":{"total":1600000000,"available":1592681100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001065"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.689299+0000","last_change":"2024-09-10T07:40:22.688967+0000","last_active":"2024-09-10T07:40:22.689299+0000","last_peered":"2024-09-10T07:40:22.689299+0000","last_clean":"2024-09-10T07:40:22.689299+0000","last_became_active":"2024-09-10T07:40:22.687698+0000","last_became_peered":"2024-09-10T07:40:22.687698+0000","last_unstale":"2024-09-10T07:40:22.689299+0000","last_undegraded":"2024-09-10T07:40:22.689299+0000","last_fullsized":"2024-09-10T07:40:22.689299+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:12.195526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677269+0000","last_change":"2024-09-10T07:40:22.692174+0000","last_active":"2024-09-10T07:40:23.677269+0000","last_peered":"2024-09-10T07:40:23.677269+0000","last_clean":"2024-09-10T07:40:23.677269+0000","last_became_active":"2024-09-10T07:40:22.690500+0000","last_became_peered":"2024-09-10T07:40:22.690500+0000","last_unstale":"2024-09-10T07:40:23.677269+0000","last_undegraded":"2024-09-10T07:40:23.677269+0000","last_fullsized":"2024-09-10T07:40:23.677269+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:34.771730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.693799+0000","last_change":"2024-09-10T07:40:22.693472+0000","last_active":"2024-09-10T07:40:22.693799+0000","last_peered":"2024-09-10T07:40:22.693799+0000","last_clean":"2024-09-10T07:40:22.693799+0000","last_became_active":"2024-09-10T07:40:22.693105+0000","last_became_peered":"2024-09-10T07:40:22.693105+0000","last_unstale":"2024-09-10T07:40:22.693799+0000","last_undegraded":"2024-09-10T07:40:22.693799+0000","last_fullsized":"2024-09-10T07:40:22.693799+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:46.604644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.687425+0000","last_change":"2024-09-10T07:40:22.687315+0000","last_active":"2024-09-10T07:40:22.687425+0000","last_peered":"2024-09-10T07:40:22.687425+0000","last_clean":"2024-09-10T07:40:22.687425+0000","last_became_active":"2024-09-10T07:40:22.687097+0000","last_became_peered":"2024-09-10T07:40:22.687097+0000","last_unstale":"2024-09-10T07:40:22.687425+0000","last_undegraded":"2024-09-10T07:40:22.687425+0000","last_fullsized":"2024-09-10T07:40:22.687425+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:16.588955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.691759+0000","last_change":"2024-09-10T07:40:22.691340+0000","last_active":"2024-09-10T07:40:22.691759+0000","last_peered":"2024-09-10T07:40:22.691759+0000","last_clean":"2024-09-10T07:40:22.691759+0000","last_became_active":"2024-09-10T07:40:22.691067+0000","last_became_peered":"2024-09-10T07:40:22.691067+0000","last_unstale":"2024-09-10T07:40:22.691759+0000","last_undegraded":"2024-09-10T07:40:22.691759+0000","last_fullsized":"2024-09-10T07:40:22.691759+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:46.595412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.695516+0000","last_change":"2024-09-10T07:40:22.692508+0000","last_active":"2024-09-10T07:40:22.695516+0000","last_peered":"2024-09-10T07:40:22.695516+0000","last_clean":"2024-09-10T07:40:22.695516+0000","last_became_active":"2024-09-10T07:40:22.692072+0000","last_became_peered":"2024-09-10T07:40:22.692072+0000","last_unstale":"2024-09-10T07:40:22.695516+0000","last_undegraded":"2024-09-10T07:40:22.695516+0000","last_fullsized":"2024-09-10T07:40:22.695516+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:15.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677704+0000","last_change":"2024-09-10T07:40:22.682754+0000","last_active":"2024-09-10T07:40:23.677704+0000","last_peered":"2024-09-10T07:40:23.677704+0000","last_clean":"2024-09-10T07:40:23.677704+0000","last_became_active":"2024-09-10T07:40:22.682491+0000","last_became_peered":"2024-09-10T07:40:22.682491+0000","last_unstale":"2024-09-10T07:40:23.677704+0000","last_undegraded":"2024-09-10T07:40:23.677704+0000","last_fullsized":"2024-09-10T07:40:23.677704+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:58.344076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.698906+0000","last_change":"2024-09-10T07:40:22.698619+0000","last_active":"2024-09-10T07:40:22.698906+0000","last_peered":"2024-09-10T07:40:22.698906+0000","last_clean":"2024-09-10T07:40:22.698906+0000","last_became_active":"2024-09-10T07:40:22.698345+0000","last_became_peered":"2024-09-10T07:40:22.698345+0000","last_unstale":"2024-09-10T07:40:22.698906+0000","last_undegraded":"2024-09-10T07:40:22.698906+0000","last_fullsized":"2024-09-10T07:40:22.698906+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:07.972665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.699290+0000","last_change":"2024-09-10T07:40:22.699181+0000","last_active":"2024-09-10T07:40:22.699290+0000","last_peered":"2024-09-10T07:40:22.699290+0000","last_clean":"2024-09-10T07:40:22.699290+0000","last_became_active":"2024-09-10T07:40:22.698926+0000","last_became_peered":"2024-09-10T07:40:22.698926+0000","last_unstale":"2024-09-10T07:40:22.699290+0000","last_undegraded":"2024-09-10T07:40:22.699290+0000","last_fullsized":"2024-09-10T07:40:22.699290+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:15.512120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.689277+0000","last_change":"2024-09-10T07:40:22.688002+0000","last_active":"2024-09-10T07:40:22.689277+0000","last_peered":"2024-09-10T07:40:22.689277+0000","last_clean":"2024-09-10T07:40:22.689277+0000","last_became_active":"2024-09-10T07:40:22.687716+0000","last_became_peered":"2024-09-10T07:40:22.687716+0000","last_unstale":"2024-09-10T07:40:22.689277+0000","last_undegraded":"2024-09-10T07:40:22.689277+0000","last_fullsized":"2024-09-10T07:40:22.689277+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:35.360440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678140+0000","last_change":"2024-09-10T07:40:22.689983+0000","last_active":"2024-09-10T07:40:23.678140+0000","last_peered":"2024-09-10T07:40:23.678140+0000","last_clean":"2024-09-10T07:40:23.678140+0000","last_became_active":"2024-09-10T07:40:22.689742+0000","last_became_peered":"2024-09-10T07:40:22.689742+0000","last_unstale":"2024-09-10T07:40:23.678140+0000","last_undegraded":"2024-09-10T07:40:23.678140+0000","last_fullsized":"2024-09-10T07:40:23.678140+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:53.021508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.685786+0000","last_change":"2024-09-10T07:40:22.685674+0000","last_active":"2024-09-10T07:40:22.685786+0000","last_peered":"2024-09-10T07:40:22.685786+0000","last_clean":"2024-09-10T07:40:22.685786+0000","last_became_active":"2024-09-10T07:40:22.685441+0000","last_became_peered":"2024-09-10T07:40:22.685441+0000","last_unstale":"2024-09-10T07:40:22.685786+0000","last_undegraded":"2024-09-10T07:40:22.685786+0000","last_fullsized":"2024-09-10T07:40:22.685786+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:03.727090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692611+0000","last_change":"2024-09-10T07:40:22.691173+0000","last_active":"2024-09-10T07:40:22.692611+0000","last_peered":"2024-09-10T07:40:22.692611+0000","last_clean":"2024-09-10T07:40:22.692611+0000","last_became_active":"2024-09-10T07:40:22.690915+0000","last_became_peered":"2024-09-10T07:40:22.690915+0000","last_unstale":"2024-09-10T07:40:22.692611+0000","last_undegraded":"2024-09-10T07:40:22.692611+0000","last_fullsized":"2024-09-10T07:40:22.692611+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:04.294017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.689976+0000","last_change":"2024-09-10T07:40:22.689188+0000","last_active":"2024-09-10T07:40:22.689976+0000","last_peered":"2024-09-10T07:40:22.689976+0000","last_clean":"2024-09-10T07:40:22.689976+0000","last_became_active":"2024-09-10T07:40:22.688933+0000","last_became_peered":"2024-09-10T07:40:22.688933+0000","last_unstale":"2024-09-10T07:40:22.689976+0000","last_undegraded":"2024-09-10T07:40:22.689976+0000","last_fullsized":"2024-09-10T07:40:22.689976+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:56.381762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.697870+0000","last_change":"2024-09-10T07:40:22.696123+0000","last_active":"2024-09-10T07:40:22.697870+0000","last_peered":"2024-09-10T07:40:22.697870+0000","last_clean":"2024-09-10T07:40:22.697870+0000","last_became_active":"2024-09-10T07:40:22.695811+0000","last_became_peered":"2024-09-10T07:40:22.695811+0000","last_unstale":"2024-09-10T07:40:22.697870+0000","last_undegraded":"2024-09-10T07:40:22.697870+0000","last_fullsized":"2024-09-10T07:40:22.697870+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:52.011721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.696763+0000","last_change":"2024-09-10T07:40:22.695354+0000","last_active":"2024-09-10T07:40:22.696763+0000","last_peered":"2024-09-10T07:40:22.696763+0000","last_clean":"2024-09-10T07:40:22.696763+0000","last_became_active":"2024-09-10T07:40:22.695085+0000","last_became_peered":"2024-09-10T07:40:22.695085+0000","last_unstale":"2024-09-10T07:40:22.696763+0000","last_undegraded":"2024-09-10T07:40:22.696763+0000","last_fullsized":"2024-09-10T07:40:22.696763+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:55.695979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677405+0000","last_change":"2024-09-10T07:40:22.692822+0000","last_active":"2024-09-10T07:40:23.677405+0000","last_peered":"2024-09-10T07:40:23.677405+0000","last_clean":"2024-09-10T07:40:23.677405+0000","last_became_active":"2024-09-10T07:40:22.692587+0000","last_became_peered":"2024-09-10T07:40:22.692587+0000","last_unstale":"2024-09-10T07:40:23.677405+0000","last_undegraded":"2024-09-10T07:40:23.677405+0000","last_fullsized":"2024-09-10T07:40:23.677405+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:25.967724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.685119+0000","last_change":"2024-09-10T07:40:22.684976+0000","last_active":"2024-09-10T07:40:22.685119+0000","last_peered":"2024-09-10T07:40:22.685119+0000","last_clean":"2024-09-10T07:40:22.685119+0000","last_became_active":"2024-09-10T07:40:22.684722+0000","last_became_peered":"2024-09-10T07:40:22.684722+0000","last_unstale":"2024-09-10T07:40:22.685119+0000","last_undegraded":"2024-09-10T07:40:22.685119+0000","last_fullsized":"2024-09-10T07:40:22.685119+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:05.111073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692591+0000","last_change":"2024-09-10T07:40:22.690800+0000","last_active":"2024-09-10T07:40:22.692591+0000","last_peered":"2024-09-10T07:40:22.692591+0000","last_clean":"2024-09-10T07:40:22.692591+0000","last_became_active":"2024-09-10T07:40:22.690487+0000","last_became_peered":"2024-09-10T07:40:22.690487+0000","last_unstale":"2024-09-10T07:40:22.692591+0000","last_undegraded":"2024-09-10T07:40:22.692591+0000","last_fullsized":"2024-09-10T07:40:22.692591+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:27.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677988+0000","last_change":"2024-09-10T07:40:22.693591+0000","last_active":"2024-09-10T07:40:23.677988+0000","last_peered":"2024-09-10T07:40:23.677988+0000","last_clean":"2024-09-10T07:40:23.677988+0000","last_became_active":"2024-09-10T07:40:22.693363+0000","last_became_peered":"2024-09-10T07:40:22.693363+0000","last_unstale":"2024-09-10T07:40:23.677988+0000","last_undegraded":"2024-09-10T07:40:23.677988+0000","last_fullsized":"2024-09-10T07:40:23.677988+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:26.788275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678394+0000","last_change":"2024-09-10T07:40:22.695332+0000","last_active":"2024-09-10T07:40:23.678394+0000","last_peered":"2024-09-10T07:40:23.678394+0000","last_clean":"2024-09-10T07:40:23.678394+0000","last_became_active":"2024-09-10T07:40:22.695068+0000","last_became_peered":"2024-09-10T07:40:22.695068+0000","last_unstale":"2024-09-10T07:40:23.678394+0000","last_undegraded":"2024-09-10T07:40:23.678394+0000","last_fullsized":"2024-09-10T07:40:23.678394+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:42.745099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679225+0000","last_change":"2024-09-10T07:40:22.691193+0000","last_active":"2024-09-10T07:40:23.679225+0000","last_peered":"2024-09-10T07:40:23.679225+0000","last_clean":"2024-09-10T07:40:23.679225+0000","last_became_active":"2024-09-10T07:40:22.690634+0000","last_became_peered":"2024-09-10T07:40:22.690634+0000","last_unstale":"2024-09-10T07:40:23.679225+0000","last_undegraded":"2024-09-10T07:40:23.679225+0000","last_fullsized":"2024-09-10T07:40:23.679225+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:50.934443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678455+0000","last_change":"2024-09-10T07:40:22.692009+0000","last_active":"2024-09-10T07:40:23.678455+0000","last_peered":"2024-09-10T07:40:23.678455+0000","last_clean":"2024-09-10T07:40:23.678455+0000","last_became_active":"2024-09-10T07:40:22.691757+0000","last_became_peered":"2024-09-10T07:40:22.691757+0000","last_unstale":"2024-09-10T07:40:23.678455+0000","last_undegraded":"2024-09-10T07:40:23.678455+0000","last_fullsized":"2024-09-10T07:40:23.678455+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:25.106988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678752+0000","last_change":"2024-09-10T07:40:22.699482+0000","last_active":"2024-09-10T07:40:23.678752+0000","last_peered":"2024-09-10T07:40:23.678752+0000","last_clean":"2024-09-10T07:40:23.678752+0000","last_became_active":"2024-09-10T07:40:22.691627+0000","last_became_peered":"2024-09-10T07:40:22.691627+0000","last_unstale":"2024-09-10T07:40:23.678752+0000","last_undegraded":"2024-09-10T07:40:23.678752+0000","last_fullsized":"2024-09-10T07:40:23.678752+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:14.242832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678134+0000","last_change":"2024-09-10T07:40:22.689316+0000","last_active":"2024-09-10T07:40:23.678134+0000","last_peered":"2024-09-10T07:40:23.678134+0000","last_clean":"2024-09-10T07:40:23.678134+0000","last_became_active":"2024-09-10T07:40:22.689044+0000","last_became_peered":"2024-09-10T07:40:22.689044+0000","last_unstale":"2024-09-10T07:40:23.678134+0000","last_undegraded":"2024-09-10T07:40:23.678134+0000","last_fullsized":"2024-09-10T07:40:23.678134+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:41.470689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.701433+0000","last_change":"2024-09-10T07:40:22.701268+0000","last_active":"2024-09-10T07:40:22.701433+0000","last_peered":"2024-09-10T07:40:22.701433+0000","last_clean":"2024-09-10T07:40:22.701433+0000","last_became_active":"2024-09-10T07:40:22.700739+0000","last_became_peered":"2024-09-10T07:40:22.700739+0000","last_unstale":"2024-09-10T07:40:22.701433+0000","last_undegraded":"2024-09-10T07:40:22.701433+0000","last_fullsized":"2024-09-10T07:40:22.701433+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:25.677922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.688612+0000","last_change":"2024-09-10T07:40:22.686858+0000","last_active":"2024-09-10T07:40:22.688612+0000","last_peered":"2024-09-10T07:40:22.688612+0000","last_clean":"2024-09-10T07:40:22.688612+0000","last_became_active":"2024-09-10T07:40:22.686125+0000","last_became_peered":"2024-09-10T07:40:22.686125+0000","last_unstale":"2024-09-10T07:40:22.688612+0000","last_undegraded":"2024-09-10T07:40:22.688612+0000","last_fullsized":"2024-09-10T07:40:22.688612+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:56.240118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679125+0000","last_change":"2024-09-10T07:40:22.692637+0000","last_active":"2024-09-10T07:40:23.679125+0000","last_peered":"2024-09-10T07:40:23.679125+0000","last_clean":"2024-09-10T07:40:23.679125+0000","last_became_active":"2024-09-10T07:40:22.692056+0000","last_became_peered":"2024-09-10T07:40:22.692056+0000","last_unstale":"2024-09-10T07:40:23.679125+0000","last_undegraded":"2024-09-10T07:40:23.679125+0000","last_fullsized":"2024-09-10T07:40:23.679125+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:20.457259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677221+0000","last_change":"2024-09-10T07:40:22.689184+0000","last_active":"2024-09-10T07:40:23.677221+0000","last_peered":"2024-09-10T07:40:23.677221+0000","last_clean":"2024-09-10T07:40:23.677221+0000","last_became_active":"2024-09-10T07:40:22.688925+0000","last_became_peered":"2024-09-10T07:40:22.688925+0000","last_unstale":"2024-09-10T07:40:23.677221+0000","last_undegraded":"2024-09-10T07:40:23.677221+0000","last_fullsized":"2024-09-10T07:40:23.677221+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:32.256965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678550+0000","last_change":"2024-09-10T07:40:22.694912+0000","last_active":"2024-09-10T07:40:23.678550+0000","last_peered":"2024-09-10T07:40:23.678550+0000","last_clean":"2024-09-10T07:40:23.678550+0000","last_became_active":"2024-09-10T07:40:22.694652+0000","last_became_peered":"2024-09-10T07:40:22.694652+0000","last_unstale":"2024-09-10T07:40:23.678550+0000","last_undegraded":"2024-09-10T07:40:23.678550+0000","last_fullsized":"2024-09-10T07:40:23.678550+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:54.179375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.701603+0000","last_change":"2024-09-10T07:40:22.701474+0000","last_active":"2024-09-10T07:40:22.701603+0000","last_peered":"2024-09-10T07:40:22.701603+0000","last_clean":"2024-09-10T07:40:22.701603+0000","last_became_active":"2024-09-10T07:40:22.701035+0000","last_became_peered":"2024-09-10T07:40:22.701035+0000","last_unstale":"2024-09-10T07:40:22.701603+0000","last_undegraded":"2024-09-10T07:40:22.701603+0000","last_fullsized":"2024-09-10T07:40:22.701603+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:46.422961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.695471+0000","last_change":"2024-09-10T07:40:22.691021+0000","last_active":"2024-09-10T07:40:22.695471+0000","last_peered":"2024-09-10T07:40:22.695471+0000","last_clean":"2024-09-10T07:40:22.695471+0000","last_became_active":"2024-09-10T07:40:22.690245+0000","last_became_peered":"2024-09-10T07:40:22.690245+0000","last_unstale":"2024-09-10T07:40:22.695471+0000","last_undegraded":"2024-09-10T07:40:22.695471+0000","last_fullsized":"2024-09-10T07:40:22.695471+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:33.045313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.681025+0000","last_change":"2024-09-10T07:40:22.680709+0000","last_active":"2024-09-10T07:40:22.681025+0000","last_peered":"2024-09-10T07:40:22.681025+0000","last_clean":"2024-09-10T07:40:22.681025+0000","last_became_active":"2024-09-10T07:40:22.680203+0000","last_became_peered":"2024-09-10T07:40:22.680203+0000","last_unstale":"2024-09-10T07:40:22.681025+0000","last_undegraded":"2024-09-10T07:40:22.681025+0000","last_fullsized":"2024-09-10T07:40:22.681025+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:44.930254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"138'4","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677227+0000","last_change":"2024-09-10T07:40:21.684170+0000","last_active":"2024-09-10T07:40:23.677227+0000","last_peered":"2024-09-10T07:40:23.677227+0000","last_clean":"2024-09-10T07:40:23.677227+0000","last_became_active":"2024-09-10T07:40:21.683825+0000","last_became_peered":"2024-09-10T07:40:21.683825+0000","last_unstale":"2024-09-10T07:40:23.677227+0000","last_undegraded":"2024-09-10T07:40:23.677227+0000","last_fullsized":"2024-09-10T07:40:23.677227+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:11.481724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.691945+0000","last_change":"2024-09-10T07:40:22.691817+0000","last_active":"2024-09-10T07:40:22.691945+0000","last_peered":"2024-09-10T07:40:22.691945+0000","last_clean":"2024-09-10T07:40:22.691945+0000","last_became_active":"2024-09-10T07:40:22.690552+0000","last_became_peered":"2024-09-10T07:40:22.690552+0000","last_unstale":"2024-09-10T07:40:22.691945+0000","last_undegraded":"2024-09-10T07:40:22.691945+0000","last_fullsized":"2024-09-10T07:40:22.691945+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:09.501873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.704281+0000","last_change":"2024-09-10T07:40:21.685080+0000","last_active":"2024-09-10T07:40:22.704281+0000","last_peered":"2024-09-10T07:40:22.704281+0000","last_clean":"2024-09-10T07:40:22.704281+0000","last_became_active":"2024-09-10T07:40:21.684844+0000","last_became_peered":"2024-09-10T07:40:21.684844+0000","last_unstale":"2024-09-10T07:40:22.704281+0000","last_undegraded":"2024-09-10T07:40:22.704281+0000","last_fullsized":"2024-09-10T07:40:22.704281+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:14.692345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.695498+0000","last_change":"2024-09-10T07:40:22.692312+0000","last_active":"2024-09-10T07:40:22.695498+0000","last_peered":"2024-09-10T07:40:22.695498+0000","last_clean":"2024-09-10T07:40:22.695498+0000","last_became_active":"2024-09-10T07:40:22.691779+0000","last_became_peered":"2024-09-10T07:40:22.691779+0000","last_unstale":"2024-09-10T07:40:22.695498+0000","last_undegraded":"2024-09-10T07:40:22.695498+0000","last_fullsized":"2024-09-10T07:40:22.695498+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:16.656244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.702751+0000","last_change":"2024-09-10T07:40:21.688010+0000","last_active":"2024-09-10T07:40:22.702751+0000","last_peered":"2024-09-10T07:40:22.702751+0000","last_clean":"2024-09-10T07:40:22.702751+0000","last_became_active":"2024-09-10T07:40:21.687281+0000","last_became_peered":"2024-09-10T07:40:21.687281+0000","last_unstale":"2024-09-10T07:40:22.702751+0000","last_undegraded":"2024-09-10T07:40:22.702751+0000","last_fullsized":"2024-09-10T07:40:22.702751+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.922933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692700+0000","last_change":"2024-09-10T07:40:22.692576+0000","last_active":"2024-09-10T07:40:22.692700+0000","last_peered":"2024-09-10T07:40:22.692700+0000","last_clean":"2024-09-10T07:40:22.692700+0000","last_became_active":"2024-09-10T07:40:22.690783+0000","last_became_peered":"2024-09-10T07:40:22.690783+0000","last_unstale":"2024-09-10T07:40:22.692700+0000","last_undegraded":"2024-09-10T07:40:22.692700+0000","last_fullsized":"2024-09-10T07:40:22.692700+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:25.699013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.703483+0000","last_change":"2024-09-10T07:40:21.683810+0000","last_active":"2024-09-10T07:40:22.703483+0000","last_peered":"2024-09-10T07:40:22.703483+0000","last_clean":"2024-09-10T07:40:22.703483+0000","last_became_active":"2024-09-10T07:40:21.683261+0000","last_became_peered":"2024-09-10T07:40:21.683261+0000","last_unstale":"2024-09-10T07:40:22.703483+0000","last_undegraded":"2024-09-10T07:40:22.703483+0000","last_fullsized":"2024-09-10T07:40:22.703483+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:23.528728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.698689+0000","last_change":"2024-09-10T07:40:22.698372+0000","last_active":"2024-09-10T07:40:22.698689+0000","last_peered":"2024-09-10T07:40:22.698689+0000","last_clean":"2024-09-10T07:40:22.698689+0000","last_became_active":"2024-09-10T07:40:22.697505+0000","last_became_peered":"2024-09-10T07:40:22.697505+0000","last_unstale":"2024-09-10T07:40:22.698689+0000","last_undegraded":"2024-09-10T07:40:22.698689+0000","last_fullsized":"2024-09-10T07:40:22.698689+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:48.636942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677565+0000","last_change":"2024-09-10T07:40:21.686417+0000","last_active":"2024-09-10T07:40:23.677565+0000","last_peered":"2024-09-10T07:40:23.677565+0000","last_clean":"2024-09-10T07:40:23.677565+0000","last_became_active":"2024-09-10T07:40:21.685451+0000","last_became_peered":"2024-09-10T07:40:21.685451+0000","last_unstale":"2024-09-10T07:40:23.677565+0000","last_undegraded":"2024-09-10T07:40:23.677565+0000","last_fullsized":"2024-09-10T07:40:23.677565+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:21.677917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677538+0000","last_change":"2024-09-10T07:40:22.690733+0000","last_active":"2024-09-10T07:40:23.677538+0000","last_peered":"2024-09-10T07:40:23.677538+0000","last_clean":"2024-09-10T07:40:23.677538+0000","last_became_active":"2024-09-10T07:40:22.690126+0000","last_became_peered":"2024-09-10T07:40:22.690126+0000","last_unstale":"2024-09-10T07:40:23.677538+0000","last_undegraded":"2024-09-10T07:40:23.677538+0000","last_fullsized":"2024-09-10T07:40:23.677538+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:09.380473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679338+0000","last_change":"2024-09-10T07:40:21.681642+0000","last_active":"2024-09-10T07:40:23.679338+0000","last_peered":"2024-09-10T07:40:23.679338+0000","last_clean":"2024-09-10T07:40:23.679338+0000","last_became_active":"2024-09-10T07:40:21.681133+0000","last_became_peered":"2024-09-10T07:40:21.681133+0000","last_unstale":"2024-09-10T07:40:23.679338+0000","last_undegraded":"2024-09-10T07:40:23.679338+0000","last_fullsized":"2024-09-10T07:40:23.679338+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:18.799722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.696727+0000","last_change":"2024-09-10T07:40:22.695033+0000","last_active":"2024-09-10T07:40:22.696727+0000","last_peered":"2024-09-10T07:40:22.696727+0000","last_clean":"2024-09-10T07:40:22.696727+0000","last_became_active":"2024-09-10T07:40:22.694223+0000","last_became_peered":"2024-09-10T07:40:22.694223+0000","last_unstale":"2024-09-10T07:40:22.696727+0000","last_undegraded":"2024-09-10T07:40:22.696727+0000","last_fullsized":"2024-09-10T07:40:22.696727+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:35.149833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677293+0000","last_change":"2024-09-10T07:40:21.679871+0000","last_active":"2024-09-10T07:40:23.677293+0000","last_peered":"2024-09-10T07:40:23.677293+0000","last_clean":"2024-09-10T07:40:23.677293+0000","last_became_active":"2024-09-10T07:40:21.679576+0000","last_became_peered":"2024-09-10T07:40:21.679576+0000","last_unstale":"2024-09-10T07:40:23.677293+0000","last_undegraded":"2024-09-10T07:40:23.677293+0000","last_fullsized":"2024-09-10T07:40:23.677293+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:02.858408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677098+0000","last_change":"2024-09-10T07:40:22.683478+0000","last_active":"2024-09-10T07:40:23.677098+0000","last_peered":"2024-09-10T07:40:23.677098+0000","last_clean":"2024-09-10T07:40:23.677098+0000","last_became_active":"2024-09-10T07:40:22.683239+0000","last_became_peered":"2024-09-10T07:40:22.683239+0000","last_unstale":"2024-09-10T07:40:23.677098+0000","last_undegraded":"2024-09-10T07:40:23.677098+0000","last_fullsized":"2024-09-10T07:40:23.677098+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:51.764464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.685152+0000","last_change":"2024-09-10T07:40:21.689727+0000","last_active":"2024-09-10T07:40:22.685152+0000","last_peered":"2024-09-10T07:40:22.685152+0000","last_clean":"2024-09-10T07:40:22.685152+0000","last_became_active":"2024-09-10T07:40:21.689372+0000","last_became_peered":"2024-09-10T07:40:21.689372+0000","last_unstale":"2024-09-10T07:40:22.685152+0000","last_undegraded":"2024-09-10T07:40:22.685152+0000","last_fullsized":"2024-09-10T07:40:22.685152+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:43.859392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677466+0000","last_change":"2024-09-10T07:40:22.679362+0000","last_active":"2024-09-10T07:40:23.677466+0000","last_peered":"2024-09-10T07:40:23.677466+0000","last_clean":"2024-09-10T07:40:23.677466+0000","last_became_active":"2024-09-10T07:40:22.679076+0000","last_became_peered":"2024-09-10T07:40:22.679076+0000","last_unstale":"2024-09-10T07:40:23.677466+0000","last_undegraded":"2024-09-10T07:40:23.677466+0000","last_fullsized":"2024-09-10T07:40:23.677466+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:31.632164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.676889+0000","last_change":"2024-09-10T07:40:21.689823+0000","last_active":"2024-09-10T07:40:22.676889+0000","last_peered":"2024-09-10T07:40:22.676889+0000","last_clean":"2024-09-10T07:40:22.676889+0000","last_became_active":"2024-09-10T07:40:21.683549+0000","last_became_peered":"2024-09-10T07:40:21.683549+0000","last_unstale":"2024-09-10T07:40:22.676889+0000","last_undegraded":"2024-09-10T07:40:22.676889+0000","last_fullsized":"2024-09-10T07:40:22.676889+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:46.540012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692458+0000","last_change":"2024-09-10T07:40:22.692027+0000","last_active":"2024-09-10T07:40:22.692458+0000","last_peered":"2024-09-10T07:40:22.692458+0000","last_clean":"2024-09-10T07:40:22.692458+0000","last_became_active":"2024-09-10T07:40:22.689896+0000","last_became_peered":"2024-09-10T07:40:22.689896+0000","last_unstale":"2024-09-10T07:40:22.692458+0000","last_undegraded":"2024-09-10T07:40:22.692458+0000","last_fullsized":"2024-09-10T07:40:22.692458+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:54.780841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679454+0000","last_change":"2024-09-10T07:40:21.682398+0000","last_active":"2024-09-10T07:40:23.679454+0000","last_peered":"2024-09-10T07:40:23.679454+0000","last_clean":"2024-09-10T07:40:23.679454+0000","last_became_active":"2024-09-10T07:40:21.681910+0000","last_became_peered":"2024-09-10T07:40:21.681910+0000","last_unstale":"2024-09-10T07:40:23.679454+0000","last_undegraded":"2024-09-10T07:40:23.679454+0000","last_fullsized":"2024-09-10T07:40:23.679454+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:24.068362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678884+0000","last_change":"2024-09-10T07:40:22.691827+0000","last_active":"2024-09-10T07:40:23.678884+0000","last_peered":"2024-09-10T07:40:23.678884+0000","last_clean":"2024-09-10T07:40:23.678884+0000","last_became_active":"2024-09-10T07:40:22.691350+0000","last_became_peered":"2024-09-10T07:40:22.691350+0000","last_unstale":"2024-09-10T07:40:23.678884+0000","last_undegraded":"2024-09-10T07:40:23.678884+0000","last_fullsized":"2024-09-10T07:40:23.678884+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:42.950939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"138'3","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.705764+0000","last_change":"2024-09-10T07:40:21.685804+0000","last_active":"2024-09-10T07:40:22.705764+0000","last_peered":"2024-09-10T07:40:22.705764+0000","last_clean":"2024-09-10T07:40:22.705764+0000","last_became_active":"2024-09-10T07:40:21.685581+0000","last_became_peered":"2024-09-10T07:40:21.685581+0000","last_unstale":"2024-09-10T07:40:22.705764+0000","last_undegraded":"2024-09-10T07:40:22.705764+0000","last_fullsized":"2024-09-10T07:40:22.705764+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:24.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677101+0000","last_change":"2024-09-10T07:40:22.689691+0000","last_active":"2024-09-10T07:40:23.677101+0000","last_peered":"2024-09-10T07:40:23.677101+0000","last_clean":"2024-09-10T07:40:23.677101+0000","last_became_active":"2024-09-10T07:40:22.689454+0000","last_became_peered":"2024-09-10T07:40:22.689454+0000","last_unstale":"2024-09-10T07:40:23.677101+0000","last_undegraded":"2024-09-10T07:40:23.677101+0000","last_fullsized":"2024-09-10T07:40:23.677101+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:11.912321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"138'6","reported_seq":18,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.708467+0000","last_change":"2024-09-10T07:40:21.690361+0000","last_active":"2024-09-10T07:40:22.708467+0000","last_peered":"2024-09-10T07:40:22.708467+0000","last_clean":"2024-09-10T07:40:22.708467+0000","last_became_active":"2024-09-10T07:40:21.689893+0000","last_became_peered":"2024-09-10T07:40:21.689893+0000","last_unstale":"2024-09-10T07:40:22.708467+0000","last_undegraded":"2024-09-10T07:40:22.708467+0000","last_fullsized":"2024-09-10T07:40:22.708467+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:34.021027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679016+0000","last_change":"2024-09-10T07:40:22.690984+0000","last_active":"2024-09-10T07:40:23.679016+0000","last_peered":"2024-09-10T07:40:23.679016+0000","last_clean":"2024-09-10T07:40:23.679016+0000","last_became_active":"2024-09-10T07:40:22.690737+0000","last_became_peered":"2024-09-10T07:40:22.690737+0000","last_unstale":"2024-09-10T07:40:23.679016+0000","last_undegraded":"2024-09-10T07:40:23.679016+0000","last_fullsized":"2024-09-10T07:40:23.679016+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:45.569078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.703022+0000","last_change":"2024-09-10T07:40:21.688279+0000","last_active":"2024-09-10T07:40:22.703022+0000","last_peered":"2024-09-10T07:40:22.703022+0000","last_clean":"2024-09-10T07:40:22.703022+0000","last_became_active":"2024-09-10T07:40:21.686170+0000","last_became_peered":"2024-09-10T07:40:21.686170+0000","last_unstale":"2024-09-10T07:40:22.703022+0000","last_undegraded":"2024-09-10T07:40:22.703022+0000","last_fullsized":"2024-09-10T07:40:22.703022+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:18.386745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678922+0000","last_change":"2024-09-10T07:40:22.698638+0000","last_active":"2024-09-10T07:40:23.678922+0000","last_peered":"2024-09-10T07:40:23.678922+0000","last_clean":"2024-09-10T07:40:23.678922+0000","last_became_active":"2024-09-10T07:40:22.698249+0000","last_became_peered":"2024-09-10T07:40:22.698249+0000","last_unstale":"2024-09-10T07:40:23.678922+0000","last_undegraded":"2024-09-10T07:40:23.678922+0000","last_fullsized":"2024-09-10T07:40:23.678922+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:40.987845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.681854+0000","last_change":"2024-09-10T07:40:21.691917+0000","last_active":"2024-09-10T07:40:22.681854+0000","last_peered":"2024-09-10T07:40:22.681854+0000","last_clean":"2024-09-10T07:40:22.681854+0000","last_became_active":"2024-09-10T07:40:21.691593+0000","last_became_peered":"2024-09-10T07:40:21.691593+0000","last_unstale":"2024-09-10T07:40:22.681854+0000","last_undegraded":"2024-09-10T07:40:22.681854+0000","last_fullsized":"2024-09-10T07:40:22.681854+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:26.830358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679369+0000","last_change":"2024-09-10T07:40:22.696419+0000","last_active":"2024-09-10T07:40:23.679369+0000","last_peered":"2024-09-10T07:40:23.679369+0000","last_clean":"2024-09-10T07:40:23.679369+0000","last_became_active":"2024-09-10T07:40:22.690943+0000","last_became_peered":"2024-09-10T07:40:22.690943+0000","last_unstale":"2024-09-10T07:40:23.679369+0000","last_undegraded":"2024-09-10T07:40:23.679369+0000","last_fullsized":"2024-09-10T07:40:23.679369+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:44.779188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"138'8","reported_seq":20,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.700767+0000","last_change":"2024-09-10T07:40:21.689256+0000","last_active":"2024-09-10T07:40:22.700767+0000","last_peered":"2024-09-10T07:40:22.700767+0000","last_clean":"2024-09-10T07:40:22.700767+0000","last_became_active":"2024-09-10T07:40:21.689020+0000","last_became_peered":"2024-09-10T07:40:21.689020+0000","last_unstale":"2024-09-10T07:40:22.700767+0000","last_undegraded":"2024-09-10T07:40:22.700767+0000","last_fullsized":"2024-09-10T07:40:22.700767+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:05.296959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.691741+0000","last_change":"2024-09-10T07:40:22.690764+0000","last_active":"2024-09-10T07:40:22.691741+0000","last_peered":"2024-09-10T07:40:22.691741+0000","last_clean":"2024-09-10T07:40:22.691741+0000","last_became_active":"2024-09-10T07:40:22.689863+0000","last_became_peered":"2024-09-10T07:40:22.689863+0000","last_unstale":"2024-09-10T07:40:22.691741+0000","last_undegraded":"2024-09-10T07:40:22.691741+0000","last_fullsized":"2024-09-10T07:40:22.691741+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:15.186750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.706632+0000","last_change":"2024-09-10T07:40:21.689271+0000","last_active":"2024-09-10T07:40:22.706632+0000","last_peered":"2024-09-10T07:40:22.706632+0000","last_clean":"2024-09-10T07:40:22.706632+0000","last_became_active":"2024-09-10T07:40:21.684211+0000","last_became_peered":"2024-09-10T07:40:21.684211+0000","last_unstale":"2024-09-10T07:40:22.706632+0000","last_undegraded":"2024-09-10T07:40:22.706632+0000","last_fullsized":"2024-09-10T07:40:22.706632+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:44.048152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.690624+0000","last_change":"2024-09-10T07:40:22.688958+0000","last_active":"2024-09-10T07:40:22.690624+0000","last_peered":"2024-09-10T07:40:22.690624+0000","last_clean":"2024-09-10T07:40:22.690624+0000","last_became_active":"2024-09-10T07:40:22.688716+0000","last_became_peered":"2024-09-10T07:40:22.688716+0000","last_unstale":"2024-09-10T07:40:22.690624+0000","last_undegraded":"2024-09-10T07:40:22.690624+0000","last_fullsized":"2024-09-10T07:40:22.690624+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:58.667648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.699300+0000","last_change":"2024-09-10T07:40:21.688201+0000","last_active":"2024-09-10T07:40:22.699300+0000","last_peered":"2024-09-10T07:40:22.699300+0000","last_clean":"2024-09-10T07:40:22.699300+0000","last_became_active":"2024-09-10T07:40:21.687632+0000","last_became_peered":"2024-09-10T07:40:21.687632+0000","last_unstale":"2024-09-10T07:40:22.699300+0000","last_undegraded":"2024-09-10T07:40:22.699300+0000","last_fullsized":"2024-09-10T07:40:22.699300+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:19.149835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.693368+0000","last_change":"2024-09-10T07:40:22.693232+0000","last_active":"2024-09-10T07:40:22.693368+0000","last_peered":"2024-09-10T07:40:22.693368+0000","last_clean":"2024-09-10T07:40:22.693368+0000","last_became_active":"2024-09-10T07:40:22.692930+0000","last_became_peered":"2024-09-10T07:40:22.692930+0000","last_unstale":"2024-09-10T07:40:22.693368+0000","last_undegraded":"2024-09-10T07:40:22.693368+0000","last_fullsized":"2024-09-10T07:40:22.693368+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:11.567051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.698858+0000","last_change":"2024-09-10T07:40:21.685017+0000","last_active":"2024-09-10T07:40:22.698858+0000","last_peered":"2024-09-10T07:40:22.698858+0000","last_clean":"2024-09-10T07:40:22.698858+0000","last_became_active":"2024-09-10T07:40:21.684767+0000","last_became_peered":"2024-09-10T07:40:21.684767+0000","last_unstale":"2024-09-10T07:40:22.698858+0000","last_undegraded":"2024-09-10T07:40:22.698858+0000","last_fullsized":"2024-09-10T07:40:22.698858+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:45.858173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.698264+0000","last_change":"2024-09-10T07:40:22.698112+0000","last_active":"2024-09-10T07:40:22.698264+0000","last_peered":"2024-09-10T07:40:22.698264+0000","last_clean":"2024-09-10T07:40:22.698264+0000","last_became_active":"2024-09-10T07:40:22.697749+0000","last_became_peered":"2024-09-10T07:40:22.697749+0000","last_unstale":"2024-09-10T07:40:22.698264+0000","last_undegraded":"2024-09-10T07:40:22.698264+0000","last_fullsized":"2024-09-10T07:40:22.698264+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.785082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677883+0000","last_change":"2024-09-10T07:40:21.686625+0000","last_active":"2024-09-10T07:40:23.677883+0000","last_peered":"2024-09-10T07:40:23.677883+0000","last_clean":"2024-09-10T07:40:23.677883+0000","last_became_active":"2024-09-10T07:40:21.685802+0000","last_became_peered":"2024-09-10T07:40:21.685802+0000","last_unstale":"2024-09-10T07:40:23.677883+0000","last_undegraded":"2024-09-10T07:40:23.677883+0000","last_fullsized":"2024-09-10T07:40:23.677883+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:35.933199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692652+0000","last_change":"2024-09-10T07:40:22.692443+0000","last_active":"2024-09-10T07:40:22.692652+0000","last_peered":"2024-09-10T07:40:22.692652+0000","last_clean":"2024-09-10T07:40:22.692652+0000","last_became_active":"2024-09-10T07:40:22.692060+0000","last_became_peered":"2024-09-10T07:40:22.692060+0000","last_unstale":"2024-09-10T07:40:22.692652+0000","last_undegraded":"2024-09-10T07:40:22.692652+0000","last_fullsized":"2024-09-10T07:40:22.692652+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:03.864286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.703417+0000","last_change":"2024-09-10T07:40:21.683479+0000","last_active":"2024-09-10T07:40:22.703417+0000","last_peered":"2024-09-10T07:40:22.703417+0000","last_clean":"2024-09-10T07:40:22.703417+0000","last_became_active":"2024-09-10T07:40:21.683271+0000","last_became_peered":"2024-09-10T07:40:21.683271+0000","last_unstale":"2024-09-10T07:40:22.703417+0000","last_undegraded":"2024-09-10T07:40:22.703417+0000","last_fullsized":"2024-09-10T07:40:22.703417+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:33.487004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692424+0000","last_change":"2024-09-10T07:40:22.691677+0000","last_active":"2024-09-10T07:40:22.692424+0000","last_peered":"2024-09-10T07:40:22.692424+0000","last_clean":"2024-09-10T07:40:22.692424+0000","last_became_active":"2024-09-10T07:40:22.691436+0000","last_became_peered":"2024-09-10T07:40:22.691436+0000","last_unstale":"2024-09-10T07:40:22.692424+0000","last_undegraded":"2024-09-10T07:40:22.692424+0000","last_fullsized":"2024-09-10T07:40:22.692424+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:39.329964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.676737+0000","last_change":"2024-09-10T07:40:21.682940+0000","last_active":"2024-09-10T07:40:22.676737+0000","last_peered":"2024-09-10T07:40:22.676737+0000","last_clean":"2024-09-10T07:40:22.676737+0000","last_became_active":"2024-09-10T07:40:21.682667+0000","last_became_peered":"2024-09-10T07:40:21.682667+0000","last_unstale":"2024-09-10T07:40:22.676737+0000","last_undegraded":"2024-09-10T07:40:22.676737+0000","last_fullsized":"2024-09-10T07:40:22.676737+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:28.502663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692631+0000","last_change":"2024-09-10T07:40:22.691799+0000","last_active":"2024-09-10T07:40:22.692631+0000","last_peered":"2024-09-10T07:40:22.692631+0000","last_clean":"2024-09-10T07:40:22.692631+0000","last_became_active":"2024-09-10T07:40:22.691560+0000","last_became_peered":"2024-09-10T07:40:22.691560+0000","last_unstale":"2024-09-10T07:40:22.692631+0000","last_undegraded":"2024-09-10T07:40:22.692631+0000","last_fullsized":"2024-09-10T07:40:22.692631+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:56.471197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.679684+0000","last_change":"2024-09-10T07:40:21.684161+0000","last_active":"2024-09-10T07:40:22.679684+0000","last_peered":"2024-09-10T07:40:22.679684+0000","last_clean":"2024-09-10T07:40:22.679684+0000","last_became_active":"2024-09-10T07:40:21.683009+0000","last_became_peered":"2024-09-10T07:40:21.683009+0000","last_unstale":"2024-09-10T07:40:22.679684+0000","last_undegraded":"2024-09-10T07:40:22.679684+0000","last_fullsized":"2024-09-10T07:40:22.679684+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:21.649103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679128+0000","last_change":"2024-09-10T07:40:22.693961+0000","last_active":"2024-09-10T07:40:23.679128+0000","last_peered":"2024-09-10T07:40:23.679128+0000","last_clean":"2024-09-10T07:40:23.679128+0000","last_became_active":"2024-09-10T07:40:22.693751+0000","last_became_peered":"2024-09-10T07:40:22.693751+0000","last_unstale":"2024-09-10T07:40:23.679128+0000","last_undegraded":"2024-09-10T07:40:23.679128+0000","last_fullsized":"2024-09-10T07:40:23.679128+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:11.870901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.686872+0000","last_change":"2024-09-10T07:40:21.692029+0000","last_active":"2024-09-10T07:40:22.686872+0000","last_peered":"2024-09-10T07:40:22.686872+0000","last_clean":"2024-09-10T07:40:22.686872+0000","last_became_active":"2024-09-10T07:40:21.691446+0000","last_became_peered":"2024-09-10T07:40:21.691446+0000","last_unstale":"2024-09-10T07:40:22.686872+0000","last_undegraded":"2024-09-10T07:40:22.686872+0000","last_fullsized":"2024-09-10T07:40:22.686872+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:41.884810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.690725+0000","last_change":"2024-09-10T07:40:22.688859+0000","last_active":"2024-09-10T07:40:22.690725+0000","last_peered":"2024-09-10T07:40:22.690725+0000","last_clean":"2024-09-10T07:40:22.690725+0000","last_became_active":"2024-09-10T07:40:22.688632+0000","last_became_peered":"2024-09-10T07:40:22.688632+0000","last_unstale":"2024-09-10T07:40:22.690725+0000","last_undegraded":"2024-09-10T07:40:22.690725+0000","last_fullsized":"2024-09-10T07:40:22.690725+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:48.734337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679613+0000","last_change":"2024-09-10T07:40:21.690432+0000","last_active":"2024-09-10T07:40:23.679613+0000","last_peered":"2024-09-10T07:40:23.679613+0000","last_clean":"2024-09-10T07:40:23.679613+0000","last_became_active":"2024-09-10T07:40:21.690217+0000","last_became_peered":"2024-09-10T07:40:21.690217+0000","last_unstale":"2024-09-10T07:40:23.679613+0000","last_undegraded":"2024-09-10T07:40:23.679613+0000","last_fullsized":"2024-09-10T07:40:23.679613+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:37.969905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.689621+0000","last_change":"2024-09-10T07:40:22.689392+0000","last_active":"2024-09-10T07:40:22.689621+0000","last_peered":"2024-09-10T07:40:22.689621+0000","last_clean":"2024-09-10T07:40:22.689621+0000","last_became_active":"2024-09-10T07:40:22.687324+0000","last_became_peered":"2024-09-10T07:40:22.687324+0000","last_unstale":"2024-09-10T07:40:22.689621+0000","last_undegraded":"2024-09-10T07:40:22.689621+0000","last_fullsized":"2024-09-10T07:40:22.689621+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:28.503675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.682183+0000","last_change":"2024-09-10T07:40:21.682243+0000","last_active":"2024-09-10T07:40:22.682183+0000","last_peered":"2024-09-10T07:40:22.682183+0000","last_clean":"2024-09-10T07:40:22.682183+0000","last_became_active":"2024-09-10T07:40:21.681983+0000","last_became_peered":"2024-09-10T07:40:21.681983+0000","last_unstale":"2024-09-10T07:40:22.682183+0000","last_undegraded":"2024-09-10T07:40:22.682183+0000","last_fullsized":"2024-09-10T07:40:22.682183+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:22.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.696747+0000","last_change":"2024-09-10T07:40:22.695219+0000","last_active":"2024-09-10T07:40:22.696747+0000","last_peered":"2024-09-10T07:40:22.696747+0000","last_clean":"2024-09-10T07:40:22.696747+0000","last_became_active":"2024-09-10T07:40:22.694826+0000","last_became_peered":"2024-09-10T07:40:22.694826+0000","last_unstale":"2024-09-10T07:40:22.696747+0000","last_undegraded":"2024-09-10T07:40:22.696747+0000","last_fullsized":"2024-09-10T07:40:22.696747+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:03.704959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.682926+0000","last_change":"2024-09-10T07:40:21.689478+0000","last_active":"2024-09-10T07:40:22.682926+0000","last_peered":"2024-09-10T07:40:22.682926+0000","last_clean":"2024-09-10T07:40:22.682926+0000","last_became_active":"2024-09-10T07:40:21.684540+0000","last_became_peered":"2024-09-10T07:40:21.684540+0000","last_unstale":"2024-09-10T07:40:22.682926+0000","last_undegraded":"2024-09-10T07:40:22.682926+0000","last_fullsized":"2024-09-10T07:40:22.682926+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:38.993186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.691926+0000","last_change":"2024-09-10T07:40:22.690185+0000","last_active":"2024-09-10T07:40:22.691926+0000","last_peered":"2024-09-10T07:40:22.691926+0000","last_clean":"2024-09-10T07:40:22.691926+0000","last_became_active":"2024-09-10T07:40:22.689931+0000","last_became_peered":"2024-09-10T07:40:22.689931+0000","last_unstale":"2024-09-10T07:40:22.691926+0000","last_undegraded":"2024-09-10T07:40:22.691926+0000","last_fullsized":"2024-09-10T07:40:22.691926+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:24.669676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679277+0000","last_change":"2024-09-10T07:40:21.685083+0000","last_active":"2024-09-10T07:40:23.679277+0000","last_peered":"2024-09-10T07:40:23.679277+0000","last_clean":"2024-09-10T07:40:23.679277+0000","last_became_active":"2024-09-10T07:40:21.684180+0000","last_became_peered":"2024-09-10T07:40:21.684180+0000","last_unstale":"2024-09-10T07:40:23.679277+0000","last_undegraded":"2024-09-10T07:40:23.679277+0000","last_fullsized":"2024-09-10T07:40:23.679277+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:07.725239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677674+0000","last_change":"2024-09-10T07:40:22.685937+0000","last_active":"2024-09-10T07:40:23.677674+0000","last_peered":"2024-09-10T07:40:23.677674+0000","last_clean":"2024-09-10T07:40:23.677674+0000","last_became_active":"2024-09-10T07:40:22.685485+0000","last_became_peered":"2024-09-10T07:40:22.685485+0000","last_unstale":"2024-09-10T07:40:23.677674+0000","last_undegraded":"2024-09-10T07:40:23.677674+0000","last_fullsized":"2024-09-10T07:40:23.677674+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:43.070161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678348+0000","last_change":"2024-09-10T07:40:21.682246+0000","last_active":"2024-09-10T07:40:23.678348+0000","last_peered":"2024-09-10T07:40:23.678348+0000","last_clean":"2024-09-10T07:40:23.678348+0000","last_became_active":"2024-09-10T07:40:21.681994+0000","last_became_peered":"2024-09-10T07:40:21.681994+0000","last_unstale":"2024-09-10T07:40:23.678348+0000","last_undegraded":"2024-09-10T07:40:23.678348+0000","last_fullsized":"2024-09-10T07:40:23.678348+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:23.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678544+0000","last_change":"2024-09-10T07:40:22.684827+0000","last_active":"2024-09-10T07:40:23.678544+0000","last_peered":"2024-09-10T07:40:23.678544+0000","last_clean":"2024-09-10T07:40:23.678544+0000","last_became_active":"2024-09-10T07:40:22.684583+0000","last_became_peered":"2024-09-10T07:40:22.684583+0000","last_unstale":"2024-09-10T07:40:23.678544+0000","last_undegraded":"2024-09-10T07:40:23.678544+0000","last_fullsized":"2024-09-10T07:40:23.678544+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.955428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677764+0000","last_change":"2024-09-10T07:40:21.684417+0000","last_active":"2024-09-10T07:40:23.677764+0000","last_peered":"2024-09-10T07:40:23.677764+0000","last_clean":"2024-09-10T07:40:23.677764+0000","last_became_active":"2024-09-10T07:40:21.683888+0000","last_became_peered":"2024-09-10T07:40:21.683888+0000","last_unstale":"2024-09-10T07:40:23.677764+0000","last_undegraded":"2024-09-10T07:40:23.677764+0000","last_fullsized":"2024-09-10T07:40:23.677764+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:56.361780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.697121+0000","last_change":"2024-09-10T07:40:22.694583+0000","last_active":"2024-09-10T07:40:22.697121+0000","last_peered":"2024-09-10T07:40:22.697121+0000","last_clean":"2024-09-10T07:40:22.697121+0000","last_became_active":"2024-09-10T07:40:22.693935+0000","last_became_peered":"2024-09-10T07:40:22.693935+0000","last_unstale":"2024-09-10T07:40:22.697121+0000","last_undegraded":"2024-09-10T07:40:22.697121+0000","last_fullsized":"2024-09-10T07:40:22.697121+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:37.290520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.676962+0000","last_change":"2024-09-10T07:40:21.685250+0000","last_active":"2024-09-10T07:40:22.676962+0000","last_peered":"2024-09-10T07:40:22.676962+0000","last_clean":"2024-09-10T07:40:22.676962+0000","last_became_active":"2024-09-10T07:40:21.684957+0000","last_became_peered":"2024-09-10T07:40:21.684957+0000","last_unstale":"2024-09-10T07:40:22.676962+0000","last_undegraded":"2024-09-10T07:40:22.676962+0000","last_fullsized":"2024-09-10T07:40:22.676962+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:05.668597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.686411+0000","last_change":"2024-09-10T07:40:22.686161+0000","last_active":"2024-09-10T07:40:22.686411+0000","last_peered":"2024-09-10T07:40:22.686411+0000","last_clean":"2024-09-10T07:40:22.686411+0000","last_became_active":"2024-09-10T07:40:22.685856+0000","last_became_peered":"2024-09-10T07:40:22.685856+0000","last_unstale":"2024-09-10T07:40:22.686411+0000","last_undegraded":"2024-09-10T07:40:22.686411+0000","last_fullsized":"2024-09-10T07:40:22.686411+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:23.642904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.683057+0000","last_change":"2024-09-10T07:40:21.690149+0000","last_active":"2024-09-10T07:40:22.683057+0000","last_peered":"2024-09-10T07:40:22.683057+0000","last_clean":"2024-09-10T07:40:22.683057+0000","last_became_active":"2024-09-10T07:40:21.689032+0000","last_became_peered":"2024-09-10T07:40:21.689032+0000","last_unstale":"2024-09-10T07:40:22.683057+0000","last_undegraded":"2024-09-10T07:40:22.683057+0000","last_fullsized":"2024-09-10T07:40:22.683057+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:12.066830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679264+0000","last_change":"2024-09-10T07:40:22.697366+0000","last_active":"2024-09-10T07:40:23.679264+0000","last_peered":"2024-09-10T07:40:23.679264+0000","last_clean":"2024-09-10T07:40:23.679264+0000","last_became_active":"2024-09-10T07:40:22.692359+0000","last_became_peered":"2024-09-10T07:40:22.692359+0000","last_unstale":"2024-09-10T07:40:23.679264+0000","last_undegraded":"2024-09-10T07:40:23.679264+0000","last_fullsized":"2024-09-10T07:40:23.679264+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:27.025489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677793+0000","last_change":"2024-09-10T07:40:21.686818+0000","last_active":"2024-09-10T07:40:23.677793+0000","last_peered":"2024-09-10T07:40:23.677793+0000","last_clean":"2024-09-10T07:40:23.677793+0000","last_became_active":"2024-09-10T07:40:21.686156+0000","last_became_peered":"2024-09-10T07:40:21.686156+0000","last_unstale":"2024-09-10T07:40:23.677793+0000","last_undegraded":"2024-09-10T07:40:23.677793+0000","last_fullsized":"2024-09-10T07:40:23.677793+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:51.062913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":403,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.684955+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:40:22.684955+0000","last_peered":"2024-09-10T07:40:22.684955+0000","last_clean":"2024-09-10T07:40:22.684955+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:40:22.684955+0000","last_undegraded":"2024-09-10T07:40:22.684955+0000","last_fullsized":"2024-09-10T07:40:22.684955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193986,"statfs":{"total":200000000,"available":198642348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":748,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199233262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":749,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199232728,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":748,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199233332,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":750,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194562,"statfs":{"total":200000000,"available":199231650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":748,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199233332,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":748,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199233208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1326,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193985,"statfs":{"total":200000000,"available":198641240,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:40:26.865 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:40:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.056+0000 7f8e5c200640 1 Processor -- start 2024-09-10T07:40:27.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.056+0000 7f8e5c200640 1 -- start start 2024-09-10T07:40:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.057+0000 7f8e5c200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8e5415ede0 0x7f8e540afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.058+0000 7f8e5c200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e540b0200 con 0x7f8e540cf830 2024-09-10T07:40:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.058+0000 7f8e5c200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e540aec20 con 0x7f8e540b4ac0 2024-09-10T07:40:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.058+0000 7f8e5c200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8e540aef00 con 0x7f8e5415ede0 2024-09-10T07:40:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.058+0000 7f8e58e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8e540cf830 0x7f8e540b43b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36958/0 (socket says 172.21.15.99:36958) 2024-09-10T07:40:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.058+0000 7f8e58e00640 1 -- 172.21.15.99:0/2102525945 learned_addr learned my addr 172.21.15.99:0/2102525945 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:27.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.058+0000 7f8e59800640 1 --2- 172.21.15.99:0/2102525945 >> v2:172.21.15.187:3300/0 conn(0x7f8e5415ede0 0x7f8e540afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.058+0000 7f8e53e00640 1 -- 172.21.15.99:0/2102525945 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891665327 0 0) 0x7f8e540b0200 con 0x7f8e540cf830 2024-09-10T07:40:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.058+0000 7f8e53e00640 1 -- 172.21.15.99:0/2102525945 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e3c003520 con 0x7f8e540cf830 2024-09-10T07:40:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.059+0000 7f8e59800640 1 -- 172.21.15.99:0/2102525945 >> v1:172.21.15.187:6789/0 conn(0x7f8e540b4ac0 legacy=0x7f8e54071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.059+0000 7f8e59800640 1 -- 172.21.15.99:0/2102525945 >> v1:172.21.15.99:6789/0 conn(0x7f8e540cf830 legacy=0x7f8e540b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.059+0000 7f8e59800640 1 -- 172.21.15.99:0/2102525945 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e540af1e0 con 0x7f8e5415ede0 2024-09-10T07:40:27.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.060+0000 7f8e59800640 1 --2- 172.21.15.99:0/2102525945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e5415ede0 0x7f8e540afcc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009d90 tx=0x7f8e4802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3e1594aafd7a453 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:27.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.060+0000 7f8e53e00640 1 -- 172.21.15.99:0/2102525945 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48007740 con 0x7f8e5415ede0 2024-09-10T07:40:27.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.060+0000 7f8e53e00640 1 -- 172.21.15.99:0/2102525945 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e480078e0 con 0x7f8e5415ede0 2024-09-10T07:40:27.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.060+0000 7f8e53e00640 1 -- 172.21.15.99:0/2102525945 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48007cb0 con 0x7f8e5415ede0 2024-09-10T07:40:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.060+0000 7f8e5c200640 1 -- 172.21.15.99:0/2102525945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e5415ede0 msgr2=0x7f8e540afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.060+0000 7f8e5c200640 1 --2- 172.21.15.99:0/2102525945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e5415ede0 0x7f8e540afcc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009d90 tx=0x7f8e4802a6f0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.060+0000 7f8e5c200640 1 -- 172.21.15.99:0/2102525945 shutdown_connections 2024-09-10T07:40:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.060+0000 7f8e5c200640 1 --2- 172.21.15.99:0/2102525945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e5415ede0 0x7f8e540afcc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.060+0000 7f8e5c200640 1 -- 172.21.15.99:0/2102525945 >> 172.21.15.99:0/2102525945 conn(0x7f8e5406bc10 msgr2=0x7f8e5406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.061+0000 7f8e5c200640 1 -- 172.21.15.99:0/2102525945 shutdown_connections 2024-09-10T07:40:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.061+0000 7f8e5c200640 1 -- 172.21.15.99:0/2102525945 wait complete. 2024-09-10T07:40:27.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.062+0000 7f8e5c200640 1 Processor -- start 2024-09-10T07:40:27.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.062+0000 7f8e5c200640 1 -- start start 2024-09-10T07:40:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.063+0000 7f8e5c200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e540b4ac0 0x7f8e541f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.063+0000 7f8e5c200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e540cf830 0x7f8e541558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.063+0000 7f8e5c200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5415ede0 0x7f8e54153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.063+0000 7f8e5c200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8e540ae840 con 0x7f8e540cf830 2024-09-10T07:40:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.063+0000 7f8e5c200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8e540af7a0 con 0x7f8e540b4ac0 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.063+0000 7f8e5c200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8e540ae9c0 con 0x7f8e5415ede0 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.063+0000 7f8e58e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e540cf830 0x7f8e541558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.063+0000 7f8e58e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e540cf830 0x7f8e541558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42792/0 (socket says 172.21.15.99:42792) 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.063+0000 7f8e58e00640 1 -- 172.21.15.99:0/1730666645 learned_addr learned my addr 172.21.15.99:0/1730666645 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e59800640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e540b4ac0 0x7f8e541f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e5a200640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5415ede0 0x7f8e54153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e58e00640 1 -- 172.21.15.99:0/1730666645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5415ede0 msgr2=0x7f8e54153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e58e00640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5415ede0 0x7f8e54153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e58e00640 1 -- 172.21.15.99:0/1730666645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e540b4ac0 msgr2=0x7f8e541f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e58e00640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e540b4ac0 0x7f8e541f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e58e00640 1 -- 172.21.15.99:0/1730666645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5415cc10 con 0x7f8e540cf830 2024-09-10T07:40:27.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e58e00640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e540cf830 0x7f8e541558b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000c500 tx=0x7f8e4000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:27.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e51600640 1 -- 172.21.15.99:0/1730666645 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40017070 con 0x7f8e540cf830 2024-09-10T07:40:27.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e51600640 1 -- 172.21.15.99:0/1730666645 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e40005ce0 con 0x7f8e540cf830 2024-09-10T07:40:27.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e5c200640 1 -- 172.21.15.99:0/1730666645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5415cef0 con 0x7f8e540cf830 2024-09-10T07:40:27.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.064+0000 7f8e51600640 1 -- 172.21.15.99:0/1730666645 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40007330 con 0x7f8e540cf830 2024-09-10T07:40:27.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.065+0000 7f8e5c200640 1 -- 172.21.15.99:0/1730666645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e54155df0 con 0x7f8e540cf830 2024-09-10T07:40:27.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.065+0000 7f8e5c200640 1 -- 172.21.15.99:0/1730666645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e540cfca0 con 0x7f8e540cf830 2024-09-10T07:40:27.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.066+0000 7f8e51600640 1 -- 172.21.15.99:0/1730666645 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e4001a070 con 0x7f8e540cf830 2024-09-10T07:40:27.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.067+0000 7f8e51600640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 0x7f8e3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.067+0000 7f8e51600640 1 -- 172.21.15.99:0/1730666645 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f8e4008a2d0 con 0x7f8e540cf830 2024-09-10T07:40:27.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.068+0000 7f8e59800640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 0x7f8e3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.068+0000 7f8e59800640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 0x7f8e3406e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8e48034000 tx=0x7f8e4802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:27.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.072+0000 7f8e51600640 1 -- 172.21.15.99:0/1730666645 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e400586e0 con 0x7f8e540cf830 2024-09-10T07:40:27.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.242+0000 7f8e5c200640 1 -- 172.21.15.99:0/1730666645 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e5415c9c0 con 0x7f8e3406be30 2024-09-10T07:40:27.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.248+0000 7f8e51600640 1 -- 172.21.15.99:0/1730666645 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247947 (secure 0 0 0) 0x7f8e5415c9c0 con 0x7f8e3406be30 2024-09-10T07:40:27.251 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:27.252 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:40:27.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 -- 172.21.15.99:0/1730666645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 msgr2=0x7f8e3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 0x7f8e3406e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8e48034000 tx=0x7f8e4802f000 comp rx=0 tx=0).stop 2024-09-10T07:40:27.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 -- 172.21.15.99:0/1730666645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e540cf830 msgr2=0x7f8e541558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e540cf830 0x7f8e541558b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000c500 tx=0x7f8e4000c9c0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 -- 172.21.15.99:0/1730666645 shutdown_connections 2024-09-10T07:40:27.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5415ede0 0x7f8e54153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 0x7f8e3406e2f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e540cf830 0x7f8e541558b0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 --2- 172.21.15.99:0/1730666645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e540b4ac0 0x7f8e541f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 -- 172.21.15.99:0/1730666645 >> 172.21.15.99:0/1730666645 conn(0x7f8e5406bc10 msgr2=0x7f8e540cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:27.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 -- 172.21.15.99:0/1730666645 shutdown_connections 2024-09-10T07:40:27.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.252+0000 7f8e5c200640 1 -- 172.21.15.99:0/1730666645 wait complete. 2024-09-10T07:40:27.267 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-10T07:40:26.771441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555352,"statfs":{"total":1600000000,"available":1592681100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001065"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.689299+0000","last_change":"2024-09-10T07:40:22.688967+0000","last_active":"2024-09-10T07:40:22.689299+0000","last_peered":"2024-09-10T07:40:22.689299+0000","last_clean":"2024-09-10T07:40:22.689299+0000","last_became_active":"2024-09-10T07:40:22.687698+0000","last_became_peered":"2024-09-10T07:40:22.687698+0000","last_unstale":"2024-09-10T07:40:22.689299+0000","last_undegraded":"2024-09-10T07:40:22.689299+0000","last_fullsized":"2024-09-10T07:40:22.689299+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:12.195526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677269+0000","last_change":"2024-09-10T07:40:22.692174+0000","last_active":"2024-09-10T07:40:23.677269+0000","last_peered":"2024-09-10T07:40:23.677269+0000","last_clean":"2024-09-10T07:40:23.677269+0000","last_became_active":"2024-09-10T07:40:22.690500+0000","last_became_peered":"2024-09-10T07:40:22.690500+0000","last_unstale":"2024-09-10T07:40:23.677269+0000","last_undegraded":"2024-09-10T07:40:23.677269+0000","last_fullsized":"2024-09-10T07:40:23.677269+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:34.771730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.693799+0000","last_change":"2024-09-10T07:40:22.693472+0000","last_active":"2024-09-10T07:40:22.693799+0000","last_peered":"2024-09-10T07:40:22.693799+0000","last_clean":"2024-09-10T07:40:22.693799+0000","last_became_active":"2024-09-10T07:40:22.693105+0000","last_became_peered":"2024-09-10T07:40:22.693105+0000","last_unstale":"2024-09-10T07:40:22.693799+0000","last_undegraded":"2024-09-10T07:40:22.693799+0000","last_fullsized":"2024-09-10T07:40:22.693799+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:46.604644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.687425+0000","last_change":"2024-09-10T07:40:22.687315+0000","last_active":"2024-09-10T07:40:22.687425+0000","last_peered":"2024-09-10T07:40:22.687425+0000","last_clean":"2024-09-10T07:40:22.687425+0000","last_became_active":"2024-09-10T07:40:22.687097+0000","last_became_peered":"2024-09-10T07:40:22.687097+0000","last_unstale":"2024-09-10T07:40:22.687425+0000","last_undegraded":"2024-09-10T07:40:22.687425+0000","last_fullsized":"2024-09-10T07:40:22.687425+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:16.588955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.691759+0000","last_change":"2024-09-10T07:40:22.691340+0000","last_active":"2024-09-10T07:40:22.691759+0000","last_peered":"2024-09-10T07:40:22.691759+0000","last_clean":"2024-09-10T07:40:22.691759+0000","last_became_active":"2024-09-10T07:40:22.691067+0000","last_became_peered":"2024-09-10T07:40:22.691067+0000","last_unstale":"2024-09-10T07:40:22.691759+0000","last_undegraded":"2024-09-10T07:40:22.691759+0000","last_fullsized":"2024-09-10T07:40:22.691759+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:46.595412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.695516+0000","last_change":"2024-09-10T07:40:22.692508+0000","last_active":"2024-09-10T07:40:22.695516+0000","last_peered":"2024-09-10T07:40:22.695516+0000","last_clean":"2024-09-10T07:40:22.695516+0000","last_became_active":"2024-09-10T07:40:22.692072+0000","last_became_peered":"2024-09-10T07:40:22.692072+0000","last_unstale":"2024-09-10T07:40:22.695516+0000","last_undegraded":"2024-09-10T07:40:22.695516+0000","last_fullsized":"2024-09-10T07:40:22.695516+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:15.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677704+0000","last_change":"2024-09-10T07:40:22.682754+0000","last_active":"2024-09-10T07:40:23.677704+0000","last_peered":"2024-09-10T07:40:23.677704+0000","last_clean":"2024-09-10T07:40:23.677704+0000","last_became_active":"2024-09-10T07:40:22.682491+0000","last_became_peered":"2024-09-10T07:40:22.682491+0000","last_unstale":"2024-09-10T07:40:23.677704+0000","last_undegraded":"2024-09-10T07:40:23.677704+0000","last_fullsized":"2024-09-10T07:40:23.677704+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:58.344076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.698906+0000","last_change":"2024-09-10T07:40:22.698619+0000","last_active":"2024-09-10T07:40:22.698906+0000","last_peered":"2024-09-10T07:40:22.698906+0000","last_clean":"2024-09-10T07:40:22.698906+0000","last_became_active":"2024-09-10T07:40:22.698345+0000","last_became_peered":"2024-09-10T07:40:22.698345+0000","last_unstale":"2024-09-10T07:40:22.698906+0000","last_undegraded":"2024-09-10T07:40:22.698906+0000","last_fullsized":"2024-09-10T07:40:22.698906+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:20:07.972665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.699290+0000","last_change":"2024-09-10T07:40:22.699181+0000","last_active":"2024-09-10T07:40:22.699290+0000","last_peered":"2024-09-10T07:40:22.699290+0000","last_clean":"2024-09-10T07:40:22.699290+0000","last_became_active":"2024-09-10T07:40:22.698926+0000","last_became_peered":"2024-09-10T07:40:22.698926+0000","last_unstale":"2024-09-10T07:40:22.699290+0000","last_undegraded":"2024-09-10T07:40:22.699290+0000","last_fullsized":"2024-09-10T07:40:22.699290+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:15.512120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.689277+0000","last_change":"2024-09-10T07:40:22.688002+0000","last_active":"2024-09-10T07:40:22.689277+0000","last_peered":"2024-09-10T07:40:22.689277+0000","last_clean":"2024-09-10T07:40:22.689277+0000","last_became_active":"2024-09-10T07:40:22.687716+0000","last_became_peered":"2024-09-10T07:40:22.687716+0000","last_unstale":"2024-09-10T07:40:22.689277+0000","last_undegraded":"2024-09-10T07:40:22.689277+0000","last_fullsized":"2024-09-10T07:40:22.689277+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:35.360440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678140+0000","last_change":"2024-09-10T07:40:22.689983+0000","last_active":"2024-09-10T07:40:23.678140+0000","last_peered":"2024-09-10T07:40:23.678140+0000","last_clean":"2024-09-10T07:40:23.678140+0000","last_became_active":"2024-09-10T07:40:22.689742+0000","last_became_peered":"2024-09-10T07:40:22.689742+0000","last_unstale":"2024-09-10T07:40:23.678140+0000","last_undegraded":"2024-09-10T07:40:23.678140+0000","last_fullsized":"2024-09-10T07:40:23.678140+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:53.021508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.685786+0000","last_change":"2024-09-10T07:40:22.685674+0000","last_active":"2024-09-10T07:40:22.685786+0000","last_peered":"2024-09-10T07:40:22.685786+0000","last_clean":"2024-09-10T07:40:22.685786+0000","last_became_active":"2024-09-10T07:40:22.685441+0000","last_became_peered":"2024-09-10T07:40:22.685441+0000","last_unstale":"2024-09-10T07:40:22.685786+0000","last_undegraded":"2024-09-10T07:40:22.685786+0000","last_fullsized":"2024-09-10T07:40:22.685786+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:03.727090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692611+0000","last_change":"2024-09-10T07:40:22.691173+0000","last_active":"2024-09-10T07:40:22.692611+0000","last_peered":"2024-09-10T07:40:22.692611+0000","last_clean":"2024-09-10T07:40:22.692611+0000","last_became_active":"2024-09-10T07:40:22.690915+0000","last_became_peered":"2024-09-10T07:40:22.690915+0000","last_unstale":"2024-09-10T07:40:22.692611+0000","last_undegraded":"2024-09-10T07:40:22.692611+0000","last_fullsized":"2024-09-10T07:40:22.692611+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:04.294017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.689976+0000","last_change":"2024-09-10T07:40:22.689188+0000","last_active":"2024-09-10T07:40:22.689976+0000","last_peered":"2024-09-10T07:40:22.689976+0000","last_clean":"2024-09-10T07:40:22.689976+0000","last_became_active":"2024-09-10T07:40:22.688933+0000","last_became_peered":"2024-09-10T07:40:22.688933+0000","last_unstale":"2024-09-10T07:40:22.689976+0000","last_undegraded":"2024-09-10T07:40:22.689976+0000","last_fullsized":"2024-09-10T07:40:22.689976+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:56.381762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.697870+0000","last_change":"2024-09-10T07:40:22.696123+0000","last_active":"2024-09-10T07:40:22.697870+0000","last_peered":"2024-09-10T07:40:22.697870+0000","last_clean":"2024-09-10T07:40:22.697870+0000","last_became_active":"2024-09-10T07:40:22.695811+0000","last_became_peered":"2024-09-10T07:40:22.695811+0000","last_unstale":"2024-09-10T07:40:22.697870+0000","last_undegraded":"2024-09-10T07:40:22.697870+0000","last_fullsized":"2024-09-10T07:40:22.697870+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:52.011721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.696763+0000","last_change":"2024-09-10T07:40:22.695354+0000","last_active":"2024-09-10T07:40:22.696763+0000","last_peered":"2024-09-10T07:40:22.696763+0000","last_clean":"2024-09-10T07:40:22.696763+0000","last_became_active":"2024-09-10T07:40:22.695085+0000","last_became_peered":"2024-09-10T07:40:22.695085+0000","last_unstale":"2024-09-10T07:40:22.696763+0000","last_undegraded":"2024-09-10T07:40:22.696763+0000","last_fullsized":"2024-09-10T07:40:22.696763+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:55.695979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677405+0000","last_change":"2024-09-10T07:40:22.692822+0000","last_active":"2024-09-10T07:40:23.677405+0000","last_peered":"2024-09-10T07:40:23.677405+0000","last_clean":"2024-09-10T07:40:23.677405+0000","last_became_active":"2024-09-10T07:40:22.692587+0000","last_became_peered":"2024-09-10T07:40:22.692587+0000","last_unstale":"2024-09-10T07:40:23.677405+0000","last_undegraded":"2024-09-10T07:40:23.677405+0000","last_fullsized":"2024-09-10T07:40:23.677405+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:25.967724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.685119+0000","last_change":"2024-09-10T07:40:22.684976+0000","last_active":"2024-09-10T07:40:22.685119+0000","last_peered":"2024-09-10T07:40:22.685119+0000","last_clean":"2024-09-10T07:40:22.685119+0000","last_became_active":"2024-09-10T07:40:22.684722+0000","last_became_peered":"2024-09-10T07:40:22.684722+0000","last_unstale":"2024-09-10T07:40:22.685119+0000","last_undegraded":"2024-09-10T07:40:22.685119+0000","last_fullsized":"2024-09-10T07:40:22.685119+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:05.111073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692591+0000","last_change":"2024-09-10T07:40:22.690800+0000","last_active":"2024-09-10T07:40:22.692591+0000","last_peered":"2024-09-10T07:40:22.692591+0000","last_clean":"2024-09-10T07:40:22.692591+0000","last_became_active":"2024-09-10T07:40:22.690487+0000","last_became_peered":"2024-09-10T07:40:22.690487+0000","last_unstale":"2024-09-10T07:40:22.692591+0000","last_undegraded":"2024-09-10T07:40:22.692591+0000","last_fullsized":"2024-09-10T07:40:22.692591+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:27.749189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677988+0000","last_change":"2024-09-10T07:40:22.693591+0000","last_active":"2024-09-10T07:40:23.677988+0000","last_peered":"2024-09-10T07:40:23.677988+0000","last_clean":"2024-09-10T07:40:23.677988+0000","last_became_active":"2024-09-10T07:40:22.693363+0000","last_became_peered":"2024-09-10T07:40:22.693363+0000","last_unstale":"2024-09-10T07:40:23.677988+0000","last_undegraded":"2024-09-10T07:40:23.677988+0000","last_fullsized":"2024-09-10T07:40:23.677988+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:26.788275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678394+0000","last_change":"2024-09-10T07:40:22.695332+0000","last_active":"2024-09-10T07:40:23.678394+0000","last_peered":"2024-09-10T07:40:23.678394+0000","last_clean":"2024-09-10T07:40:23.678394+0000","last_became_active":"2024-09-10T07:40:22.695068+0000","last_became_peered":"2024-09-10T07:40:22.695068+0000","last_unstale":"2024-09-10T07:40:23.678394+0000","last_undegraded":"2024-09-10T07:40:23.678394+0000","last_fullsized":"2024-09-10T07:40:23.678394+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:42.745099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679225+0000","last_change":"2024-09-10T07:40:22.691193+0000","last_active":"2024-09-10T07:40:23.679225+0000","last_peered":"2024-09-10T07:40:23.679225+0000","last_clean":"2024-09-10T07:40:23.679225+0000","last_became_active":"2024-09-10T07:40:22.690634+0000","last_became_peered":"2024-09-10T07:40:22.690634+0000","last_unstale":"2024-09-10T07:40:23.679225+0000","last_undegraded":"2024-09-10T07:40:23.679225+0000","last_fullsized":"2024-09-10T07:40:23.679225+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:50.934443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678455+0000","last_change":"2024-09-10T07:40:22.692009+0000","last_active":"2024-09-10T07:40:23.678455+0000","last_peered":"2024-09-10T07:40:23.678455+0000","last_clean":"2024-09-10T07:40:23.678455+0000","last_became_active":"2024-09-10T07:40:22.691757+0000","last_became_peered":"2024-09-10T07:40:22.691757+0000","last_unstale":"2024-09-10T07:40:23.678455+0000","last_undegraded":"2024-09-10T07:40:23.678455+0000","last_fullsized":"2024-09-10T07:40:23.678455+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:25.106988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678752+0000","last_change":"2024-09-10T07:40:22.699482+0000","last_active":"2024-09-10T07:40:23.678752+0000","last_peered":"2024-09-10T07:40:23.678752+0000","last_clean":"2024-09-10T07:40:23.678752+0000","last_became_active":"2024-09-10T07:40:22.691627+0000","last_became_peered":"2024-09-10T07:40:22.691627+0000","last_unstale":"2024-09-10T07:40:23.678752+0000","last_undegraded":"2024-09-10T07:40:23.678752+0000","last_fullsized":"2024-09-10T07:40:23.678752+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:14.242832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678134+0000","last_change":"2024-09-10T07:40:22.689316+0000","last_active":"2024-09-10T07:40:23.678134+0000","last_peered":"2024-09-10T07:40:23.678134+0000","last_clean":"2024-09-10T07:40:23.678134+0000","last_became_active":"2024-09-10T07:40:22.689044+0000","last_became_peered":"2024-09-10T07:40:22.689044+0000","last_unstale":"2024-09-10T07:40:23.678134+0000","last_undegraded":"2024-09-10T07:40:23.678134+0000","last_fullsized":"2024-09-10T07:40:23.678134+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:41.470689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.701433+0000","last_change":"2024-09-10T07:40:22.701268+0000","last_active":"2024-09-10T07:40:22.701433+0000","last_peered":"2024-09-10T07:40:22.701433+0000","last_clean":"2024-09-10T07:40:22.701433+0000","last_became_active":"2024-09-10T07:40:22.700739+0000","last_became_peered":"2024-09-10T07:40:22.700739+0000","last_unstale":"2024-09-10T07:40:22.701433+0000","last_undegraded":"2024-09-10T07:40:22.701433+0000","last_fullsized":"2024-09-10T07:40:22.701433+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:25.677922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.688612+0000","last_change":"2024-09-10T07:40:22.686858+0000","last_active":"2024-09-10T07:40:22.688612+0000","last_peered":"2024-09-10T07:40:22.688612+0000","last_clean":"2024-09-10T07:40:22.688612+0000","last_became_active":"2024-09-10T07:40:22.686125+0000","last_became_peered":"2024-09-10T07:40:22.686125+0000","last_unstale":"2024-09-10T07:40:22.688612+0000","last_undegraded":"2024-09-10T07:40:22.688612+0000","last_fullsized":"2024-09-10T07:40:22.688612+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:56.240118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679125+0000","last_change":"2024-09-10T07:40:22.692637+0000","last_active":"2024-09-10T07:40:23.679125+0000","last_peered":"2024-09-10T07:40:23.679125+0000","last_clean":"2024-09-10T07:40:23.679125+0000","last_became_active":"2024-09-10T07:40:22.692056+0000","last_became_peered":"2024-09-10T07:40:22.692056+0000","last_unstale":"2024-09-10T07:40:23.679125+0000","last_undegraded":"2024-09-10T07:40:23.679125+0000","last_fullsized":"2024-09-10T07:40:23.679125+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:20.457259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677221+0000","last_change":"2024-09-10T07:40:22.689184+0000","last_active":"2024-09-10T07:40:23.677221+0000","last_peered":"2024-09-10T07:40:23.677221+0000","last_clean":"2024-09-10T07:40:23.677221+0000","last_became_active":"2024-09-10T07:40:22.688925+0000","last_became_peered":"2024-09-10T07:40:22.688925+0000","last_unstale":"2024-09-10T07:40:23.677221+0000","last_undegraded":"2024-09-10T07:40:23.677221+0000","last_fullsized":"2024-09-10T07:40:23.677221+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:32.256965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678550+0000","last_change":"2024-09-10T07:40:22.694912+0000","last_active":"2024-09-10T07:40:23.678550+0000","last_peered":"2024-09-10T07:40:23.678550+0000","last_clean":"2024-09-10T07:40:23.678550+0000","last_became_active":"2024-09-10T07:40:22.694652+0000","last_became_peered":"2024-09-10T07:40:22.694652+0000","last_unstale":"2024-09-10T07:40:23.678550+0000","last_undegraded":"2024-09-10T07:40:23.678550+0000","last_fullsized":"2024-09-10T07:40:23.678550+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:54.179375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.701603+0000","last_change":"2024-09-10T07:40:22.701474+0000","last_active":"2024-09-10T07:40:22.701603+0000","last_peered":"2024-09-10T07:40:22.701603+0000","last_clean":"2024-09-10T07:40:22.701603+0000","last_became_active":"2024-09-10T07:40:22.701035+0000","last_became_peered":"2024-09-10T07:40:22.701035+0000","last_unstale":"2024-09-10T07:40:22.701603+0000","last_undegraded":"2024-09-10T07:40:22.701603+0000","last_fullsized":"2024-09-10T07:40:22.701603+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:46.422961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.695471+0000","last_change":"2024-09-10T07:40:22.691021+0000","last_active":"2024-09-10T07:40:22.695471+0000","last_peered":"2024-09-10T07:40:22.695471+0000","last_clean":"2024-09-10T07:40:22.695471+0000","last_became_active":"2024-09-10T07:40:22.690245+0000","last_became_peered":"2024-09-10T07:40:22.690245+0000","last_unstale":"2024-09-10T07:40:22.695471+0000","last_undegraded":"2024-09-10T07:40:22.695471+0000","last_fullsized":"2024-09-10T07:40:22.695471+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:33.045313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.681025+0000","last_change":"2024-09-10T07:40:22.680709+0000","last_active":"2024-09-10T07:40:22.681025+0000","last_peered":"2024-09-10T07:40:22.681025+0000","last_clean":"2024-09-10T07:40:22.681025+0000","last_became_active":"2024-09-10T07:40:22.680203+0000","last_became_peered":"2024-09-10T07:40:22.680203+0000","last_unstale":"2024-09-10T07:40:22.681025+0000","last_undegraded":"2024-09-10T07:40:22.681025+0000","last_fullsized":"2024-09-10T07:40:22.681025+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:44.930254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"138'4","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677227+0000","last_change":"2024-09-10T07:40:21.684170+0000","last_active":"2024-09-10T07:40:23.677227+0000","last_peered":"2024-09-10T07:40:23.677227+0000","last_clean":"2024-09-10T07:40:23.677227+0000","last_became_active":"2024-09-10T07:40:21.683825+0000","last_became_peered":"2024-09-10T07:40:21.683825+0000","last_unstale":"2024-09-10T07:40:23.677227+0000","last_undegraded":"2024-09-10T07:40:23.677227+0000","last_fullsized":"2024-09-10T07:40:23.677227+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:11.481724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.691945+0000","last_change":"2024-09-10T07:40:22.691817+0000","last_active":"2024-09-10T07:40:22.691945+0000","last_peered":"2024-09-10T07:40:22.691945+0000","last_clean":"2024-09-10T07:40:22.691945+0000","last_became_active":"2024-09-10T07:40:22.690552+0000","last_became_peered":"2024-09-10T07:40:22.690552+0000","last_unstale":"2024-09-10T07:40:22.691945+0000","last_undegraded":"2024-09-10T07:40:22.691945+0000","last_fullsized":"2024-09-10T07:40:22.691945+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:09.501873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.704281+0000","last_change":"2024-09-10T07:40:21.685080+0000","last_active":"2024-09-10T07:40:22.704281+0000","last_peered":"2024-09-10T07:40:22.704281+0000","last_clean":"2024-09-10T07:40:22.704281+0000","last_became_active":"2024-09-10T07:40:21.684844+0000","last_became_peered":"2024-09-10T07:40:21.684844+0000","last_unstale":"2024-09-10T07:40:22.704281+0000","last_undegraded":"2024-09-10T07:40:22.704281+0000","last_fullsized":"2024-09-10T07:40:22.704281+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:14.692345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.695498+0000","last_change":"2024-09-10T07:40:22.692312+0000","last_active":"2024-09-10T07:40:22.695498+0000","last_peered":"2024-09-10T07:40:22.695498+0000","last_clean":"2024-09-10T07:40:22.695498+0000","last_became_active":"2024-09-10T07:40:22.691779+0000","last_became_peered":"2024-09-10T07:40:22.691779+0000","last_unstale":"2024-09-10T07:40:22.695498+0000","last_undegraded":"2024-09-10T07:40:22.695498+0000","last_fullsized":"2024-09-10T07:40:22.695498+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:16.656244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.702751+0000","last_change":"2024-09-10T07:40:21.688010+0000","last_active":"2024-09-10T07:40:22.702751+0000","last_peered":"2024-09-10T07:40:22.702751+0000","last_clean":"2024-09-10T07:40:22.702751+0000","last_became_active":"2024-09-10T07:40:21.687281+0000","last_became_peered":"2024-09-10T07:40:21.687281+0000","last_unstale":"2024-09-10T07:40:22.702751+0000","last_undegraded":"2024-09-10T07:40:22.702751+0000","last_fullsized":"2024-09-10T07:40:22.702751+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.922933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692700+0000","last_change":"2024-09-10T07:40:22.692576+0000","last_active":"2024-09-10T07:40:22.692700+0000","last_peered":"2024-09-10T07:40:22.692700+0000","last_clean":"2024-09-10T07:40:22.692700+0000","last_became_active":"2024-09-10T07:40:22.690783+0000","last_became_peered":"2024-09-10T07:40:22.690783+0000","last_unstale":"2024-09-10T07:40:22.692700+0000","last_undegraded":"2024-09-10T07:40:22.692700+0000","last_fullsized":"2024-09-10T07:40:22.692700+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:25.699013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.703483+0000","last_change":"2024-09-10T07:40:21.683810+0000","last_active":"2024-09-10T07:40:22.703483+0000","last_peered":"2024-09-10T07:40:22.703483+0000","last_clean":"2024-09-10T07:40:22.703483+0000","last_became_active":"2024-09-10T07:40:21.683261+0000","last_became_peered":"2024-09-10T07:40:21.683261+0000","last_unstale":"2024-09-10T07:40:22.703483+0000","last_undegraded":"2024-09-10T07:40:22.703483+0000","last_fullsized":"2024-09-10T07:40:22.703483+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:23.528728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.698689+0000","last_change":"2024-09-10T07:40:22.698372+0000","last_active":"2024-09-10T07:40:22.698689+0000","last_peered":"2024-09-10T07:40:22.698689+0000","last_clean":"2024-09-10T07:40:22.698689+0000","last_became_active":"2024-09-10T07:40:22.697505+0000","last_became_peered":"2024-09-10T07:40:22.697505+0000","last_unstale":"2024-09-10T07:40:22.698689+0000","last_undegraded":"2024-09-10T07:40:22.698689+0000","last_fullsized":"2024-09-10T07:40:22.698689+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:48.636942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677565+0000","last_change":"2024-09-10T07:40:21.686417+0000","last_active":"2024-09-10T07:40:23.677565+0000","last_peered":"2024-09-10T07:40:23.677565+0000","last_clean":"2024-09-10T07:40:23.677565+0000","last_became_active":"2024-09-10T07:40:21.685451+0000","last_became_peered":"2024-09-10T07:40:21.685451+0000","last_unstale":"2024-09-10T07:40:23.677565+0000","last_undegraded":"2024-09-10T07:40:23.677565+0000","last_fullsized":"2024-09-10T07:40:23.677565+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:21.677917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677538+0000","last_change":"2024-09-10T07:40:22.690733+0000","last_active":"2024-09-10T07:40:23.677538+0000","last_peered":"2024-09-10T07:40:23.677538+0000","last_clean":"2024-09-10T07:40:23.677538+0000","last_became_active":"2024-09-10T07:40:22.690126+0000","last_became_peered":"2024-09-10T07:40:22.690126+0000","last_unstale":"2024-09-10T07:40:23.677538+0000","last_undegraded":"2024-09-10T07:40:23.677538+0000","last_fullsized":"2024-09-10T07:40:23.677538+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:09.380473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679338+0000","last_change":"2024-09-10T07:40:21.681642+0000","last_active":"2024-09-10T07:40:23.679338+0000","last_peered":"2024-09-10T07:40:23.679338+0000","last_clean":"2024-09-10T07:40:23.679338+0000","last_became_active":"2024-09-10T07:40:21.681133+0000","last_became_peered":"2024-09-10T07:40:21.681133+0000","last_unstale":"2024-09-10T07:40:23.679338+0000","last_undegraded":"2024-09-10T07:40:23.679338+0000","last_fullsized":"2024-09-10T07:40:23.679338+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:18.799722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.696727+0000","last_change":"2024-09-10T07:40:22.695033+0000","last_active":"2024-09-10T07:40:22.696727+0000","last_peered":"2024-09-10T07:40:22.696727+0000","last_clean":"2024-09-10T07:40:22.696727+0000","last_became_active":"2024-09-10T07:40:22.694223+0000","last_became_peered":"2024-09-10T07:40:22.694223+0000","last_unstale":"2024-09-10T07:40:22.696727+0000","last_undegraded":"2024-09-10T07:40:22.696727+0000","last_fullsized":"2024-09-10T07:40:22.696727+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:35.149833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677293+0000","last_change":"2024-09-10T07:40:21.679871+0000","last_active":"2024-09-10T07:40:23.677293+0000","last_peered":"2024-09-10T07:40:23.677293+0000","last_clean":"2024-09-10T07:40:23.677293+0000","last_became_active":"2024-09-10T07:40:21.679576+0000","last_became_peered":"2024-09-10T07:40:21.679576+0000","last_unstale":"2024-09-10T07:40:23.677293+0000","last_undegraded":"2024-09-10T07:40:23.677293+0000","last_fullsized":"2024-09-10T07:40:23.677293+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:02.858408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677098+0000","last_change":"2024-09-10T07:40:22.683478+0000","last_active":"2024-09-10T07:40:23.677098+0000","last_peered":"2024-09-10T07:40:23.677098+0000","last_clean":"2024-09-10T07:40:23.677098+0000","last_became_active":"2024-09-10T07:40:22.683239+0000","last_became_peered":"2024-09-10T07:40:22.683239+0000","last_unstale":"2024-09-10T07:40:23.677098+0000","last_undegraded":"2024-09-10T07:40:23.677098+0000","last_fullsized":"2024-09-10T07:40:23.677098+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:51.764464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.685152+0000","last_change":"2024-09-10T07:40:21.689727+0000","last_active":"2024-09-10T07:40:22.685152+0000","last_peered":"2024-09-10T07:40:22.685152+0000","last_clean":"2024-09-10T07:40:22.685152+0000","last_became_active":"2024-09-10T07:40:21.689372+0000","last_became_peered":"2024-09-10T07:40:21.689372+0000","last_unstale":"2024-09-10T07:40:22.685152+0000","last_undegraded":"2024-09-10T07:40:22.685152+0000","last_fullsized":"2024-09-10T07:40:22.685152+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:43.859392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677466+0000","last_change":"2024-09-10T07:40:22.679362+0000","last_active":"2024-09-10T07:40:23.677466+0000","last_peered":"2024-09-10T07:40:23.677466+0000","last_clean":"2024-09-10T07:40:23.677466+0000","last_became_active":"2024-09-10T07:40:22.679076+0000","last_became_peered":"2024-09-10T07:40:22.679076+0000","last_unstale":"2024-09-10T07:40:23.677466+0000","last_undegraded":"2024-09-10T07:40:23.677466+0000","last_fullsized":"2024-09-10T07:40:23.677466+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:31.632164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.676889+0000","last_change":"2024-09-10T07:40:21.689823+0000","last_active":"2024-09-10T07:40:22.676889+0000","last_peered":"2024-09-10T07:40:22.676889+0000","last_clean":"2024-09-10T07:40:22.676889+0000","last_became_active":"2024-09-10T07:40:21.683549+0000","last_became_peered":"2024-09-10T07:40:21.683549+0000","last_unstale":"2024-09-10T07:40:22.676889+0000","last_undegraded":"2024-09-10T07:40:22.676889+0000","last_fullsized":"2024-09-10T07:40:22.676889+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:46.540012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692458+0000","last_change":"2024-09-10T07:40:22.692027+0000","last_active":"2024-09-10T07:40:22.692458+0000","last_peered":"2024-09-10T07:40:22.692458+0000","last_clean":"2024-09-10T07:40:22.692458+0000","last_became_active":"2024-09-10T07:40:22.689896+0000","last_became_peered":"2024-09-10T07:40:22.689896+0000","last_unstale":"2024-09-10T07:40:22.692458+0000","last_undegraded":"2024-09-10T07:40:22.692458+0000","last_fullsized":"2024-09-10T07:40:22.692458+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:54.780841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679454+0000","last_change":"2024-09-10T07:40:21.682398+0000","last_active":"2024-09-10T07:40:23.679454+0000","last_peered":"2024-09-10T07:40:23.679454+0000","last_clean":"2024-09-10T07:40:23.679454+0000","last_became_active":"2024-09-10T07:40:21.681910+0000","last_became_peered":"2024-09-10T07:40:21.681910+0000","last_unstale":"2024-09-10T07:40:23.679454+0000","last_undegraded":"2024-09-10T07:40:23.679454+0000","last_fullsized":"2024-09-10T07:40:23.679454+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:24.068362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678884+0000","last_change":"2024-09-10T07:40:22.691827+0000","last_active":"2024-09-10T07:40:23.678884+0000","last_peered":"2024-09-10T07:40:23.678884+0000","last_clean":"2024-09-10T07:40:23.678884+0000","last_became_active":"2024-09-10T07:40:22.691350+0000","last_became_peered":"2024-09-10T07:40:22.691350+0000","last_unstale":"2024-09-10T07:40:23.678884+0000","last_undegraded":"2024-09-10T07:40:23.678884+0000","last_fullsized":"2024-09-10T07:40:23.678884+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:42.950939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"138'3","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.705764+0000","last_change":"2024-09-10T07:40:21.685804+0000","last_active":"2024-09-10T07:40:22.705764+0000","last_peered":"2024-09-10T07:40:22.705764+0000","last_clean":"2024-09-10T07:40:22.705764+0000","last_became_active":"2024-09-10T07:40:21.685581+0000","last_became_peered":"2024-09-10T07:40:21.685581+0000","last_unstale":"2024-09-10T07:40:22.705764+0000","last_undegraded":"2024-09-10T07:40:22.705764+0000","last_fullsized":"2024-09-10T07:40:22.705764+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:24.281591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677101+0000","last_change":"2024-09-10T07:40:22.689691+0000","last_active":"2024-09-10T07:40:23.677101+0000","last_peered":"2024-09-10T07:40:23.677101+0000","last_clean":"2024-09-10T07:40:23.677101+0000","last_became_active":"2024-09-10T07:40:22.689454+0000","last_became_peered":"2024-09-10T07:40:22.689454+0000","last_unstale":"2024-09-10T07:40:23.677101+0000","last_undegraded":"2024-09-10T07:40:23.677101+0000","last_fullsized":"2024-09-10T07:40:23.677101+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:11.912321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"138'6","reported_seq":18,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.708467+0000","last_change":"2024-09-10T07:40:21.690361+0000","last_active":"2024-09-10T07:40:22.708467+0000","last_peered":"2024-09-10T07:40:22.708467+0000","last_clean":"2024-09-10T07:40:22.708467+0000","last_became_active":"2024-09-10T07:40:21.689893+0000","last_became_peered":"2024-09-10T07:40:21.689893+0000","last_unstale":"2024-09-10T07:40:22.708467+0000","last_undegraded":"2024-09-10T07:40:22.708467+0000","last_fullsized":"2024-09-10T07:40:22.708467+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:34.021027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679016+0000","last_change":"2024-09-10T07:40:22.690984+0000","last_active":"2024-09-10T07:40:23.679016+0000","last_peered":"2024-09-10T07:40:23.679016+0000","last_clean":"2024-09-10T07:40:23.679016+0000","last_became_active":"2024-09-10T07:40:22.690737+0000","last_became_peered":"2024-09-10T07:40:22.690737+0000","last_unstale":"2024-09-10T07:40:23.679016+0000","last_undegraded":"2024-09-10T07:40:23.679016+0000","last_fullsized":"2024-09-10T07:40:23.679016+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:45.569078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.703022+0000","last_change":"2024-09-10T07:40:21.688279+0000","last_active":"2024-09-10T07:40:22.703022+0000","last_peered":"2024-09-10T07:40:22.703022+0000","last_clean":"2024-09-10T07:40:22.703022+0000","last_became_active":"2024-09-10T07:40:21.686170+0000","last_became_peered":"2024-09-10T07:40:21.686170+0000","last_unstale":"2024-09-10T07:40:22.703022+0000","last_undegraded":"2024-09-10T07:40:22.703022+0000","last_fullsized":"2024-09-10T07:40:22.703022+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:18.386745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678922+0000","last_change":"2024-09-10T07:40:22.698638+0000","last_active":"2024-09-10T07:40:23.678922+0000","last_peered":"2024-09-10T07:40:23.678922+0000","last_clean":"2024-09-10T07:40:23.678922+0000","last_became_active":"2024-09-10T07:40:22.698249+0000","last_became_peered":"2024-09-10T07:40:22.698249+0000","last_unstale":"2024-09-10T07:40:23.678922+0000","last_undegraded":"2024-09-10T07:40:23.678922+0000","last_fullsized":"2024-09-10T07:40:23.678922+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:40.987845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.681854+0000","last_change":"2024-09-10T07:40:21.691917+0000","last_active":"2024-09-10T07:40:22.681854+0000","last_peered":"2024-09-10T07:40:22.681854+0000","last_clean":"2024-09-10T07:40:22.681854+0000","last_became_active":"2024-09-10T07:40:21.691593+0000","last_became_peered":"2024-09-10T07:40:21.691593+0000","last_unstale":"2024-09-10T07:40:22.681854+0000","last_undegraded":"2024-09-10T07:40:22.681854+0000","last_fullsized":"2024-09-10T07:40:22.681854+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:26.830358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679369+0000","last_change":"2024-09-10T07:40:22.696419+0000","last_active":"2024-09-10T07:40:23.679369+0000","last_peered":"2024-09-10T07:40:23.679369+0000","last_clean":"2024-09-10T07:40:23.679369+0000","last_became_active":"2024-09-10T07:40:22.690943+0000","last_became_peered":"2024-09-10T07:40:22.690943+0000","last_unstale":"2024-09-10T07:40:23.679369+0000","last_undegraded":"2024-09-10T07:40:23.679369+0000","last_fullsized":"2024-09-10T07:40:23.679369+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:44.779188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"138'8","reported_seq":20,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.700767+0000","last_change":"2024-09-10T07:40:21.689256+0000","last_active":"2024-09-10T07:40:22.700767+0000","last_peered":"2024-09-10T07:40:22.700767+0000","last_clean":"2024-09-10T07:40:22.700767+0000","last_became_active":"2024-09-10T07:40:21.689020+0000","last_became_peered":"2024-09-10T07:40:21.689020+0000","last_unstale":"2024-09-10T07:40:22.700767+0000","last_undegraded":"2024-09-10T07:40:22.700767+0000","last_fullsized":"2024-09-10T07:40:22.700767+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:05.296959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.691741+0000","last_change":"2024-09-10T07:40:22.690764+0000","last_active":"2024-09-10T07:40:22.691741+0000","last_peered":"2024-09-10T07:40:22.691741+0000","last_clean":"2024-09-10T07:40:22.691741+0000","last_became_active":"2024-09-10T07:40:22.689863+0000","last_became_peered":"2024-09-10T07:40:22.689863+0000","last_unstale":"2024-09-10T07:40:22.691741+0000","last_undegraded":"2024-09-10T07:40:22.691741+0000","last_fullsized":"2024-09-10T07:40:22.691741+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:15.186750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.706632+0000","last_change":"2024-09-10T07:40:21.689271+0000","last_active":"2024-09-10T07:40:22.706632+0000","last_peered":"2024-09-10T07:40:22.706632+0000","last_clean":"2024-09-10T07:40:22.706632+0000","last_became_active":"2024-09-10T07:40:21.684211+0000","last_became_peered":"2024-09-10T07:40:21.684211+0000","last_unstale":"2024-09-10T07:40:22.706632+0000","last_undegraded":"2024-09-10T07:40:22.706632+0000","last_fullsized":"2024-09-10T07:40:22.706632+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:44.048152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.690624+0000","last_change":"2024-09-10T07:40:22.688958+0000","last_active":"2024-09-10T07:40:22.690624+0000","last_peered":"2024-09-10T07:40:22.690624+0000","last_clean":"2024-09-10T07:40:22.690624+0000","last_became_active":"2024-09-10T07:40:22.688716+0000","last_became_peered":"2024-09-10T07:40:22.688716+0000","last_unstale":"2024-09-10T07:40:22.690624+0000","last_undegraded":"2024-09-10T07:40:22.690624+0000","last_fullsized":"2024-09-10T07:40:22.690624+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:58.667648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.699300+0000","last_change":"2024-09-10T07:40:21.688201+0000","last_active":"2024-09-10T07:40:22.699300+0000","last_peered":"2024-09-10T07:40:22.699300+0000","last_clean":"2024-09-10T07:40:22.699300+0000","last_became_active":"2024-09-10T07:40:21.687632+0000","last_became_peered":"2024-09-10T07:40:21.687632+0000","last_unstale":"2024-09-10T07:40:22.699300+0000","last_undegraded":"2024-09-10T07:40:22.699300+0000","last_fullsized":"2024-09-10T07:40:22.699300+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:19.149835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.693368+0000","last_change":"2024-09-10T07:40:22.693232+0000","last_active":"2024-09-10T07:40:22.693368+0000","last_peered":"2024-09-10T07:40:22.693368+0000","last_clean":"2024-09-10T07:40:22.693368+0000","last_became_active":"2024-09-10T07:40:22.692930+0000","last_became_peered":"2024-09-10T07:40:22.692930+0000","last_unstale":"2024-09-10T07:40:22.693368+0000","last_undegraded":"2024-09-10T07:40:22.693368+0000","last_fullsized":"2024-09-10T07:40:22.693368+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:11.567051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.698858+0000","last_change":"2024-09-10T07:40:21.685017+0000","last_active":"2024-09-10T07:40:22.698858+0000","last_peered":"2024-09-10T07:40:22.698858+0000","last_clean":"2024-09-10T07:40:22.698858+0000","last_became_active":"2024-09-10T07:40:21.684767+0000","last_became_peered":"2024-09-10T07:40:21.684767+0000","last_unstale":"2024-09-10T07:40:22.698858+0000","last_undegraded":"2024-09-10T07:40:22.698858+0000","last_fullsized":"2024-09-10T07:40:22.698858+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:45.858173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.698264+0000","last_change":"2024-09-10T07:40:22.698112+0000","last_active":"2024-09-10T07:40:22.698264+0000","last_peered":"2024-09-10T07:40:22.698264+0000","last_clean":"2024-09-10T07:40:22.698264+0000","last_became_active":"2024-09-10T07:40:22.697749+0000","last_became_peered":"2024-09-10T07:40:22.697749+0000","last_unstale":"2024-09-10T07:40:22.698264+0000","last_undegraded":"2024-09-10T07:40:22.698264+0000","last_fullsized":"2024-09-10T07:40:22.698264+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.785082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677883+0000","last_change":"2024-09-10T07:40:21.686625+0000","last_active":"2024-09-10T07:40:23.677883+0000","last_peered":"2024-09-10T07:40:23.677883+0000","last_clean":"2024-09-10T07:40:23.677883+0000","last_became_active":"2024-09-10T07:40:21.685802+0000","last_became_peered":"2024-09-10T07:40:21.685802+0000","last_unstale":"2024-09-10T07:40:23.677883+0000","last_undegraded":"2024-09-10T07:40:23.677883+0000","last_fullsized":"2024-09-10T07:40:23.677883+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:35.933199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692652+0000","last_change":"2024-09-10T07:40:22.692443+0000","last_active":"2024-09-10T07:40:22.692652+0000","last_peered":"2024-09-10T07:40:22.692652+0000","last_clean":"2024-09-10T07:40:22.692652+0000","last_became_active":"2024-09-10T07:40:22.692060+0000","last_became_peered":"2024-09-10T07:40:22.692060+0000","last_unstale":"2024-09-10T07:40:22.692652+0000","last_undegraded":"2024-09-10T07:40:22.692652+0000","last_fullsized":"2024-09-10T07:40:22.692652+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:03.864286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.703417+0000","last_change":"2024-09-10T07:40:21.683479+0000","last_active":"2024-09-10T07:40:22.703417+0000","last_peered":"2024-09-10T07:40:22.703417+0000","last_clean":"2024-09-10T07:40:22.703417+0000","last_became_active":"2024-09-10T07:40:21.683271+0000","last_became_peered":"2024-09-10T07:40:21.683271+0000","last_unstale":"2024-09-10T07:40:22.703417+0000","last_undegraded":"2024-09-10T07:40:22.703417+0000","last_fullsized":"2024-09-10T07:40:22.703417+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:33.487004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692424+0000","last_change":"2024-09-10T07:40:22.691677+0000","last_active":"2024-09-10T07:40:22.692424+0000","last_peered":"2024-09-10T07:40:22.692424+0000","last_clean":"2024-09-10T07:40:22.692424+0000","last_became_active":"2024-09-10T07:40:22.691436+0000","last_became_peered":"2024-09-10T07:40:22.691436+0000","last_unstale":"2024-09-10T07:40:22.692424+0000","last_undegraded":"2024-09-10T07:40:22.692424+0000","last_fullsized":"2024-09-10T07:40:22.692424+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:39.329964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.676737+0000","last_change":"2024-09-10T07:40:21.682940+0000","last_active":"2024-09-10T07:40:22.676737+0000","last_peered":"2024-09-10T07:40:22.676737+0000","last_clean":"2024-09-10T07:40:22.676737+0000","last_became_active":"2024-09-10T07:40:21.682667+0000","last_became_peered":"2024-09-10T07:40:21.682667+0000","last_unstale":"2024-09-10T07:40:22.676737+0000","last_undegraded":"2024-09-10T07:40:22.676737+0000","last_fullsized":"2024-09-10T07:40:22.676737+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:28.502663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.692631+0000","last_change":"2024-09-10T07:40:22.691799+0000","last_active":"2024-09-10T07:40:22.692631+0000","last_peered":"2024-09-10T07:40:22.692631+0000","last_clean":"2024-09-10T07:40:22.692631+0000","last_became_active":"2024-09-10T07:40:22.691560+0000","last_became_peered":"2024-09-10T07:40:22.691560+0000","last_unstale":"2024-09-10T07:40:22.692631+0000","last_undegraded":"2024-09-10T07:40:22.692631+0000","last_fullsized":"2024-09-10T07:40:22.692631+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:56.471197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.679684+0000","last_change":"2024-09-10T07:40:21.684161+0000","last_active":"2024-09-10T07:40:22.679684+0000","last_peered":"2024-09-10T07:40:22.679684+0000","last_clean":"2024-09-10T07:40:22.679684+0000","last_became_active":"2024-09-10T07:40:21.683009+0000","last_became_peered":"2024-09-10T07:40:21.683009+0000","last_unstale":"2024-09-10T07:40:22.679684+0000","last_undegraded":"2024-09-10T07:40:22.679684+0000","last_fullsized":"2024-09-10T07:40:22.679684+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:21.649103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679128+0000","last_change":"2024-09-10T07:40:22.693961+0000","last_active":"2024-09-10T07:40:23.679128+0000","last_peered":"2024-09-10T07:40:23.679128+0000","last_clean":"2024-09-10T07:40:23.679128+0000","last_became_active":"2024-09-10T07:40:22.693751+0000","last_became_peered":"2024-09-10T07:40:22.693751+0000","last_unstale":"2024-09-10T07:40:23.679128+0000","last_undegraded":"2024-09-10T07:40:23.679128+0000","last_fullsized":"2024-09-10T07:40:23.679128+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:11.870901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.686872+0000","last_change":"2024-09-10T07:40:21.692029+0000","last_active":"2024-09-10T07:40:22.686872+0000","last_peered":"2024-09-10T07:40:22.686872+0000","last_clean":"2024-09-10T07:40:22.686872+0000","last_became_active":"2024-09-10T07:40:21.691446+0000","last_became_peered":"2024-09-10T07:40:21.691446+0000","last_unstale":"2024-09-10T07:40:22.686872+0000","last_undegraded":"2024-09-10T07:40:22.686872+0000","last_fullsized":"2024-09-10T07:40:22.686872+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:41.884810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.690725+0000","last_change":"2024-09-10T07:40:22.688859+0000","last_active":"2024-09-10T07:40:22.690725+0000","last_peered":"2024-09-10T07:40:22.690725+0000","last_clean":"2024-09-10T07:40:22.690725+0000","last_became_active":"2024-09-10T07:40:22.688632+0000","last_became_peered":"2024-09-10T07:40:22.688632+0000","last_unstale":"2024-09-10T07:40:22.690725+0000","last_undegraded":"2024-09-10T07:40:22.690725+0000","last_fullsized":"2024-09-10T07:40:22.690725+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:48.734337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679613+0000","last_change":"2024-09-10T07:40:21.690432+0000","last_active":"2024-09-10T07:40:23.679613+0000","last_peered":"2024-09-10T07:40:23.679613+0000","last_clean":"2024-09-10T07:40:23.679613+0000","last_became_active":"2024-09-10T07:40:21.690217+0000","last_became_peered":"2024-09-10T07:40:21.690217+0000","last_unstale":"2024-09-10T07:40:23.679613+0000","last_undegraded":"2024-09-10T07:40:23.679613+0000","last_fullsized":"2024-09-10T07:40:23.679613+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:37.969905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.689621+0000","last_change":"2024-09-10T07:40:22.689392+0000","last_active":"2024-09-10T07:40:22.689621+0000","last_peered":"2024-09-10T07:40:22.689621+0000","last_clean":"2024-09-10T07:40:22.689621+0000","last_became_active":"2024-09-10T07:40:22.687324+0000","last_became_peered":"2024-09-10T07:40:22.687324+0000","last_unstale":"2024-09-10T07:40:22.689621+0000","last_undegraded":"2024-09-10T07:40:22.689621+0000","last_fullsized":"2024-09-10T07:40:22.689621+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:28.503675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.682183+0000","last_change":"2024-09-10T07:40:21.682243+0000","last_active":"2024-09-10T07:40:22.682183+0000","last_peered":"2024-09-10T07:40:22.682183+0000","last_clean":"2024-09-10T07:40:22.682183+0000","last_became_active":"2024-09-10T07:40:21.681983+0000","last_became_peered":"2024-09-10T07:40:21.681983+0000","last_unstale":"2024-09-10T07:40:22.682183+0000","last_undegraded":"2024-09-10T07:40:22.682183+0000","last_fullsized":"2024-09-10T07:40:22.682183+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:22.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.696747+0000","last_change":"2024-09-10T07:40:22.695219+0000","last_active":"2024-09-10T07:40:22.696747+0000","last_peered":"2024-09-10T07:40:22.696747+0000","last_clean":"2024-09-10T07:40:22.696747+0000","last_became_active":"2024-09-10T07:40:22.694826+0000","last_became_peered":"2024-09-10T07:40:22.694826+0000","last_unstale":"2024-09-10T07:40:22.696747+0000","last_undegraded":"2024-09-10T07:40:22.696747+0000","last_fullsized":"2024-09-10T07:40:22.696747+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:03.704959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.682926+0000","last_change":"2024-09-10T07:40:21.689478+0000","last_active":"2024-09-10T07:40:22.682926+0000","last_peered":"2024-09-10T07:40:22.682926+0000","last_clean":"2024-09-10T07:40:22.682926+0000","last_became_active":"2024-09-10T07:40:21.684540+0000","last_became_peered":"2024-09-10T07:40:21.684540+0000","last_unstale":"2024-09-10T07:40:22.682926+0000","last_undegraded":"2024-09-10T07:40:22.682926+0000","last_fullsized":"2024-09-10T07:40:22.682926+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:38.993186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.691926+0000","last_change":"2024-09-10T07:40:22.690185+0000","last_active":"2024-09-10T07:40:22.691926+0000","last_peered":"2024-09-10T07:40:22.691926+0000","last_clean":"2024-09-10T07:40:22.691926+0000","last_became_active":"2024-09-10T07:40:22.689931+0000","last_became_peered":"2024-09-10T07:40:22.689931+0000","last_unstale":"2024-09-10T07:40:22.691926+0000","last_undegraded":"2024-09-10T07:40:22.691926+0000","last_fullsized":"2024-09-10T07:40:22.691926+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:24.669676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679277+0000","last_change":"2024-09-10T07:40:21.685083+0000","last_active":"2024-09-10T07:40:23.679277+0000","last_peered":"2024-09-10T07:40:23.679277+0000","last_clean":"2024-09-10T07:40:23.679277+0000","last_became_active":"2024-09-10T07:40:21.684180+0000","last_became_peered":"2024-09-10T07:40:21.684180+0000","last_unstale":"2024-09-10T07:40:23.679277+0000","last_undegraded":"2024-09-10T07:40:23.679277+0000","last_fullsized":"2024-09-10T07:40:23.679277+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:07.725239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677674+0000","last_change":"2024-09-10T07:40:22.685937+0000","last_active":"2024-09-10T07:40:23.677674+0000","last_peered":"2024-09-10T07:40:23.677674+0000","last_clean":"2024-09-10T07:40:23.677674+0000","last_became_active":"2024-09-10T07:40:22.685485+0000","last_became_peered":"2024-09-10T07:40:22.685485+0000","last_unstale":"2024-09-10T07:40:23.677674+0000","last_undegraded":"2024-09-10T07:40:23.677674+0000","last_fullsized":"2024-09-10T07:40:23.677674+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:43.070161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678348+0000","last_change":"2024-09-10T07:40:21.682246+0000","last_active":"2024-09-10T07:40:23.678348+0000","last_peered":"2024-09-10T07:40:23.678348+0000","last_clean":"2024-09-10T07:40:23.678348+0000","last_became_active":"2024-09-10T07:40:21.681994+0000","last_became_peered":"2024-09-10T07:40:21.681994+0000","last_unstale":"2024-09-10T07:40:23.678348+0000","last_undegraded":"2024-09-10T07:40:23.678348+0000","last_fullsized":"2024-09-10T07:40:23.678348+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:23.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.678544+0000","last_change":"2024-09-10T07:40:22.684827+0000","last_active":"2024-09-10T07:40:23.678544+0000","last_peered":"2024-09-10T07:40:23.678544+0000","last_clean":"2024-09-10T07:40:23.678544+0000","last_became_active":"2024-09-10T07:40:22.684583+0000","last_became_peered":"2024-09-10T07:40:22.684583+0000","last_unstale":"2024-09-10T07:40:23.678544+0000","last_undegraded":"2024-09-10T07:40:23.678544+0000","last_fullsized":"2024-09-10T07:40:23.678544+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.955428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677764+0000","last_change":"2024-09-10T07:40:21.684417+0000","last_active":"2024-09-10T07:40:23.677764+0000","last_peered":"2024-09-10T07:40:23.677764+0000","last_clean":"2024-09-10T07:40:23.677764+0000","last_became_active":"2024-09-10T07:40:21.683888+0000","last_became_peered":"2024-09-10T07:40:21.683888+0000","last_unstale":"2024-09-10T07:40:23.677764+0000","last_undegraded":"2024-09-10T07:40:23.677764+0000","last_fullsized":"2024-09-10T07:40:23.677764+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:56.361780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.697121+0000","last_change":"2024-09-10T07:40:22.694583+0000","last_active":"2024-09-10T07:40:22.697121+0000","last_peered":"2024-09-10T07:40:22.697121+0000","last_clean":"2024-09-10T07:40:22.697121+0000","last_became_active":"2024-09-10T07:40:22.693935+0000","last_became_peered":"2024-09-10T07:40:22.693935+0000","last_unstale":"2024-09-10T07:40:22.697121+0000","last_undegraded":"2024-09-10T07:40:22.697121+0000","last_fullsized":"2024-09-10T07:40:22.697121+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:37.290520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.676962+0000","last_change":"2024-09-10T07:40:21.685250+0000","last_active":"2024-09-10T07:40:22.676962+0000","last_peered":"2024-09-10T07:40:22.676962+0000","last_clean":"2024-09-10T07:40:22.676962+0000","last_became_active":"2024-09-10T07:40:21.684957+0000","last_became_peered":"2024-09-10T07:40:21.684957+0000","last_unstale":"2024-09-10T07:40:22.676962+0000","last_undegraded":"2024-09-10T07:40:22.676962+0000","last_fullsized":"2024-09-10T07:40:22.676962+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:05.668597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.686411+0000","last_change":"2024-09-10T07:40:22.686161+0000","last_active":"2024-09-10T07:40:22.686411+0000","last_peered":"2024-09-10T07:40:22.686411+0000","last_clean":"2024-09-10T07:40:22.686411+0000","last_became_active":"2024-09-10T07:40:22.685856+0000","last_became_peered":"2024-09-10T07:40:22.685856+0000","last_unstale":"2024-09-10T07:40:22.686411+0000","last_undegraded":"2024-09-10T07:40:22.686411+0000","last_fullsized":"2024-09-10T07:40:22.686411+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:23.642904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.683057+0000","last_change":"2024-09-10T07:40:21.690149+0000","last_active":"2024-09-10T07:40:22.683057+0000","last_peered":"2024-09-10T07:40:22.683057+0000","last_clean":"2024-09-10T07:40:22.683057+0000","last_became_active":"2024-09-10T07:40:21.689032+0000","last_became_peered":"2024-09-10T07:40:21.689032+0000","last_unstale":"2024-09-10T07:40:22.683057+0000","last_undegraded":"2024-09-10T07:40:22.683057+0000","last_fullsized":"2024-09-10T07:40:22.683057+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:12.066830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.679264+0000","last_change":"2024-09-10T07:40:22.697366+0000","last_active":"2024-09-10T07:40:23.679264+0000","last_peered":"2024-09-10T07:40:23.679264+0000","last_clean":"2024-09-10T07:40:23.679264+0000","last_became_active":"2024-09-10T07:40:22.692359+0000","last_became_peered":"2024-09-10T07:40:22.692359+0000","last_unstale":"2024-09-10T07:40:23.679264+0000","last_undegraded":"2024-09-10T07:40:23.679264+0000","last_fullsized":"2024-09-10T07:40:23.679264+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:21.664909+0000","last_clean_scrub_stamp":"2024-09-10T07:40:21.664909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:27.025489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-10T07:40:23.677793+0000","last_change":"2024-09-10T07:40:21.686818+0000","last_active":"2024-09-10T07:40:23.677793+0000","last_peered":"2024-09-10T07:40:23.677793+0000","last_clean":"2024-09-10T07:40:23.677793+0000","last_became_active":"2024-09-10T07:40:21.686156+0000","last_became_peered":"2024-09-10T07:40:21.686156+0000","last_unstale":"2024-09-10T07:40:23.677793+0000","last_undegraded":"2024-09-10T07:40:23.677793+0000","last_fullsized":"2024-09-10T07:40:23.677793+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:40:20.662037+0000","last_clean_scrub_stamp":"2024-09-10T07:40:20.662037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:51.062913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":403,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-10T07:40:22.684955+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:40:22.684955+0000","last_peered":"2024-09-10T07:40:22.684955+0000","last_clean":"2024-09-10T07:40:22.684955+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:40:22.684955+0000","last_undegraded":"2024-09-10T07:40:22.684955+0000","last_fullsized":"2024-09-10T07:40:22.684955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193986,"statfs":{"total":200000000,"available":198642348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":748,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199233262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":749,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199232728,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":748,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199233332,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":750,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194562,"statfs":{"total":200000000,"available":199231650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574925,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":748,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199233332,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":748,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194563,"statfs":{"total":200000000,"available":199233208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1326,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193985,"statfs":{"total":200000000,"available":198641240,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:40:27.271 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:40:27.271 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T07:40:27.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.467+0000 7f73c6e00640 1 Processor -- start 2024-09-10T07:40:27.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.467+0000 7f73c6e00640 1 -- start start 2024-09-10T07:40:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.468+0000 7f73c6e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c015c580 0x7f73c006d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.468+0000 7f73c6e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f73c015c960 0x7f73c00b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.468+0000 7f73c6e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f73c00cea40 0x7f73c006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.468+0000 7f73c6e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f73c00b3930 con 0x7f73c00cea40 2024-09-10T07:40:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.468+0000 7f73c6e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f73c006d920 con 0x7f73c015c960 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.468+0000 7f73c6e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f73c006dc00 con 0x7f73c015c580 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.469+0000 7f73c6400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f73c00cea40 0x7f73c006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.469+0000 7f73c6400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f73c00cea40 0x7f73c006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42808/0 (socket says 172.21.15.99:42808) 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.469+0000 7f73c6400640 1 -- 172.21.15.99:0/613536974 learned_addr learned my addr 172.21.15.99:0/613536974 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.469+0000 7f73c5a00640 1 --2- 172.21.15.99:0/613536974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c015c580 0x7f73c006d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.469+0000 7f73c5000640 1 --2- 172.21.15.99:0/613536974 >> v2:172.21.15.187:3300/0 conn(0x7f73c015c960 0x7f73c00b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.469+0000 7f73c6400640 1 -- 172.21.15.99:0/613536974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c015c580 msgr2=0x7f73c006d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.469+0000 7f73c6400640 1 --2- 172.21.15.99:0/613536974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c015c580 0x7f73c006d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.469+0000 7f73c6400640 1 -- 172.21.15.99:0/613536974 >> v2:172.21.15.187:3300/0 conn(0x7f73c015c960 msgr2=0x7f73c00b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.469+0000 7f73c6400640 1 --2- 172.21.15.99:0/613536974 >> v2:172.21.15.187:3300/0 conn(0x7f73c015c960 0x7f73c00b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.469+0000 7f73c6400640 1 -- 172.21.15.99:0/613536974 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c006dee0 con 0x7f73c00cea40 2024-09-10T07:40:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.470+0000 7f73c6400640 1 --2- 172.21.15.99:0/613536974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c00cea40 0x7f73c006bc10 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f73c006de10 tx=0x7f73b802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d6222bc5662ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.470+0000 7f73bfe00640 1 -- 172.21.15.99:0/613536974 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8036070 con 0x7f73c00cea40 2024-09-10T07:40:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73bfe00640 1 -- 172.21.15.99:0/613536974 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b8031600 con 0x7f73c00cea40 2024-09-10T07:40:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73bfe00640 1 -- 172.21.15.99:0/613536974 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80319d0 con 0x7f73c00cea40 2024-09-10T07:40:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73c6e00640 1 -- 172.21.15.99:0/613536974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c00cea40 msgr2=0x7f73c006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73c6e00640 1 --2- 172.21.15.99:0/613536974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c00cea40 0x7f73c006bc10 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f73c006de10 tx=0x7f73b802a680 comp rx=0 tx=0).stop 2024-09-10T07:40:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73c6e00640 1 -- 172.21.15.99:0/613536974 shutdown_connections 2024-09-10T07:40:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73c6e00640 1 --2- 172.21.15.99:0/613536974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c00cea40 0x7f73c006bc10 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73c6e00640 1 --2- 172.21.15.99:0/613536974 >> v2:172.21.15.187:3300/0 conn(0x7f73c015c960 0x7f73c00b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73c6e00640 1 --2- 172.21.15.99:0/613536974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c015c580 0x7f73c006d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73c6e00640 1 -- 172.21.15.99:0/613536974 >> 172.21.15.99:0/613536974 conn(0x7f73c00b2810 msgr2=0x7f73c00b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:27.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73c6e00640 1 -- 172.21.15.99:0/613536974 shutdown_connections 2024-09-10T07:40:27.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.471+0000 7f73c6e00640 1 -- 172.21.15.99:0/613536974 wait complete. 2024-09-10T07:40:27.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.473+0000 7f73c6e00640 1 Processor -- start 2024-09-10T07:40:27.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.473+0000 7f73c6e00640 1 -- start start 2024-09-10T07:40:27.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c6e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c00cea40 0x7f73c0155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c6e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c015c580 0x7f73c01f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c6e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c0155b90 0x7f73c01f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c6e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f73c00cefc0 con 0x7f73c0155b90 2024-09-10T07:40:27.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c6e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f73c00cee40 con 0x7f73c015c580 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c6e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f73c00cf140 con 0x7f73c00cea40 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c6400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c0155b90 0x7f73c01f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c6400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c0155b90 0x7f73c01f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42810/0 (socket says 172.21.15.99:42810) 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c6400640 1 -- 172.21.15.99:0/252088442 learned_addr learned my addr 172.21.15.99:0/252088442 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c5a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c00cea40 0x7f73c0155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.474+0000 7f73c5000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c015c580 0x7f73c01f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73c6400640 1 -- 172.21.15.99:0/252088442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c00cea40 msgr2=0x7f73c0155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73c6400640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c00cea40 0x7f73c0155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73c6400640 1 -- 172.21.15.99:0/252088442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c015c580 msgr2=0x7f73c01f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73c6400640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c015c580 0x7f73c01f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73c6400640 1 -- 172.21.15.99:0/252088442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c01560a0 con 0x7f73c0155b90 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73c6400640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c0155b90 0x7f73c01f46b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009f10 tx=0x7f73b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:27.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73bd600640 1 -- 172.21.15.99:0/252088442 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8036050 con 0x7f73c0155b90 2024-09-10T07:40:27.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73bd600640 1 -- 172.21.15.99:0/252088442 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b8042070 con 0x7f73c0155b90 2024-09-10T07:40:27.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73bd600640 1 -- 172.21.15.99:0/252088442 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8009510 con 0x7f73c0155b90 2024-09-10T07:40:27.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73c6e00640 1 -- 172.21.15.99:0/252088442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c0156380 con 0x7f73c0155b90 2024-09-10T07:40:27.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.475+0000 7f73c6e00640 1 -- 172.21.15.99:0/252088442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c0158260 con 0x7f73c0155b90 2024-09-10T07:40:27.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.476+0000 7f73c6e00640 1 -- 172.21.15.99:0/252088442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c006d340 con 0x7f73c0155b90 2024-09-10T07:40:27.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.477+0000 7f73bd600640 1 -- 172.21.15.99:0/252088442 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73b8007bf0 con 0x7f73c0155b90 2024-09-10T07:40:27.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.478+0000 7f73bd600640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f73a006be30 0x7f73a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.478+0000 7f73bd600640 1 -- 172.21.15.99:0/252088442 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f73b80abb90 con 0x7f73c0155b90 2024-09-10T07:40:27.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.478+0000 7f73c5a00640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f73a006be30 0x7f73a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.479+0000 7f73c5a00640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f73a006be30 0x7f73a006e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009b40 tx=0x7f73b4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:27.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.482+0000 7f73bd600640 1 -- 172.21.15.99:0/252088442 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73b8079dc0 con 0x7f73c0155b90 2024-09-10T07:40:27.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.717+0000 7f73c6e00640 1 -- 172.21.15.99:0/252088442 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f73c00b4390 con 0x7f73c0155b90 2024-09-10T07:40:27.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.726+0000 7f73bd600640 1 -- 172.21.15.99:0/252088442 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7f73b807e0c0 con 0x7f73c0155b90 2024-09-10T07:40:27.726 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:40:27.726 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:40:27.726 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-09-10T07:40:27.726 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-09-10T07:40:27.726 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T07:40:27.726 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-09-10T07:40:27.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 -- 172.21.15.99:0/252088442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f73a006be30 msgr2=0x7f73a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f73a006be30 0x7f73a006e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009b40 tx=0x7f73b4009190 comp rx=0 tx=0).stop 2024-09-10T07:40:27.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 -- 172.21.15.99:0/252088442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c0155b90 msgr2=0x7f73c01f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c0155b90 0x7f73c01f46b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009f10 tx=0x7f73b8004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:27.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 -- 172.21.15.99:0/252088442 shutdown_connections 2024-09-10T07:40:27.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f73a006be30 0x7f73a006e2f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c0155b90 0x7f73c01f46b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c015c580 0x7f73c01f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 --2- 172.21.15.99:0/252088442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c00cea40 0x7f73c0155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 -- 172.21.15.99:0/252088442 >> 172.21.15.99:0/252088442 conn(0x7f73c00b2810 msgr2=0x7f73c006c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:27.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 -- 172.21.15.99:0/252088442 shutdown_connections 2024-09-10T07:40:27.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.729+0000 7f73c6e00640 1 -- 172.21.15.99:0/252088442 wait complete. 2024-09-10T07:40:27.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:27.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.898+0000 7fe97a800640 1 Processor -- start 2024-09-10T07:40:27.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.898+0000 7fe97a800640 1 -- start start 2024-09-10T07:40:27.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.899+0000 7fe97a800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe97415ed50 0x7fe9740d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.899+0000 7fe97a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe9740d1aa0 0x7fe9740b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.899+0000 7fe97a800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9740d31b0 con 0x7fe9740b5030 2024-09-10T07:40:27.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.899+0000 7fe97a800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe9740d1ee0 con 0x7fe9740d1aa0 2024-09-10T07:40:27.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.899+0000 7fe97a800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe9740d3490 con 0x7fe97415ed50 2024-09-10T07:40:27.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.899+0000 7fe972a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe9740d1aa0 0x7fe9740b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.900+0000 7fe972a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe9740d1aa0 0x7fe9740b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42822/0 (socket says 172.21.15.99:42822) 2024-09-10T07:40:27.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.900+0000 7fe972a00640 1 -- 172.21.15.99:0/3459548708 learned_addr learned my addr 172.21.15.99:0/3459548708 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:27.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.900+0000 7fe973400640 1 --2- 172.21.15.99:0/3459548708 >> v2:172.21.15.187:3300/0 conn(0x7fe97415ed50 0x7fe9740d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.900+0000 7fe972a00640 1 -- 172.21.15.99:0/3459548708 >> v2:172.21.15.187:3300/0 conn(0x7fe97415ed50 msgr2=0x7fe9740d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:27.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.900+0000 7fe972a00640 1 --2- 172.21.15.99:0/3459548708 >> v2:172.21.15.187:3300/0 conn(0x7fe97415ed50 0x7fe9740d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.900+0000 7fe972a00640 1 -- 172.21.15.99:0/3459548708 >> v1:172.21.15.99:6789/0 conn(0x7fe9740b5030 legacy=0x7fe9740b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.900+0000 7fe972a00640 1 -- 172.21.15.99:0/3459548708 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9740d3770 con 0x7fe9740d1aa0 2024-09-10T07:40:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.900+0000 7fe973400640 1 --2- 172.21.15.99:0/3459548708 >> v2:172.21.15.187:3300/0 conn(0x7fe97415ed50 0x7fe9740d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.900+0000 7fe972000640 1 -- 172.21.15.99:0/3459548708 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150542444 0 0) 0x7fe9740d31b0 con 0x7fe9740b5030 2024-09-10T07:40:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.901+0000 7fe972a00640 1 --2- 172.21.15.99:0/3459548708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 0x7fe9740b4af0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe9740d5cd0 tx=0x7fe96002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd048a78362f2388 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.901+0000 7fe972000640 1 -- 172.21.15.99:0/3459548708 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960037070 con 0x7fe9740d1aa0 2024-09-10T07:40:27.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.901+0000 7fe972000640 1 -- 172.21.15.99:0/3459548708 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96002ae50 con 0x7fe9740d1aa0 2024-09-10T07:40:27.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.901+0000 7fe972000640 1 -- 172.21.15.99:0/3459548708 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960032860 con 0x7fe9740d1aa0 2024-09-10T07:40:27.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.902+0000 7fe97a800640 1 -- 172.21.15.99:0/3459548708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 msgr2=0x7fe9740b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.902+0000 7fe97a800640 1 --2- 172.21.15.99:0/3459548708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 0x7fe9740b4af0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe9740d5cd0 tx=0x7fe96002a300 comp rx=0 tx=0).stop 2024-09-10T07:40:27.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.902+0000 7fe97a800640 1 -- 172.21.15.99:0/3459548708 shutdown_connections 2024-09-10T07:40:27.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.902+0000 7fe97a800640 1 --2- 172.21.15.99:0/3459548708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 0x7fe9740b4af0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.902+0000 7fe97a800640 1 --2- 172.21.15.99:0/3459548708 >> v2:172.21.15.187:3300/0 conn(0x7fe97415ed50 0x7fe9740d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.902+0000 7fe97a800640 1 -- 172.21.15.99:0/3459548708 >> 172.21.15.99:0/3459548708 conn(0x7fe9740d4bd0 msgr2=0x7fe9740d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:27.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.902+0000 7fe97a800640 1 -- 172.21.15.99:0/3459548708 shutdown_connections 2024-09-10T07:40:27.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.902+0000 7fe97a800640 1 -- 172.21.15.99:0/3459548708 wait complete. 2024-09-10T07:40:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.903+0000 7fe97a800640 1 Processor -- start 2024-09-10T07:40:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.904+0000 7fe97a800640 1 -- start start 2024-09-10T07:40:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.904+0000 7fe97a800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9740b5030 0x7fe9741564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.904+0000 7fe97a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 0x7fe9740b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.904+0000 7fe97a800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe97415ed50 0x7fe97415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.904+0000 7fe97a800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe9740d3d30 con 0x7fe9740d1aa0 2024-09-10T07:40:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.904+0000 7fe97a800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe9740b45d0 con 0x7fe97415ed50 2024-09-10T07:40:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.904+0000 7fe97a800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe97415f130 con 0x7fe9740b5030 2024-09-10T07:40:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe972a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 0x7fe9740b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe972a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 0x7fe9740b93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42824/0 (socket says 172.21.15.99:42824) 2024-09-10T07:40:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe972a00640 1 -- 172.21.15.99:0/1865118913 learned_addr learned my addr 172.21.15.99:0/1865118913 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe973400640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9740b5030 0x7fe9741564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe973e00640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe97415ed50 0x7fe97415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe972a00640 1 -- 172.21.15.99:0/1865118913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9740b5030 msgr2=0x7fe9741564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe972a00640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9740b5030 0x7fe9741564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe972a00640 1 -- 172.21.15.99:0/1865118913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe97415ed50 msgr2=0x7fe97415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe972a00640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe97415ed50 0x7fe97415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe972a00640 1 -- 172.21.15.99:0/1865118913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9740c9180 con 0x7fe9740d1aa0 2024-09-10T07:40:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe973e00640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe97415ed50 0x7fe97415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.905+0000 7fe972a00640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 0x7fe9740b93b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe9600090b0 tx=0x7fe9600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.906+0000 7fe96b400640 1 -- 172.21.15.99:0/1865118913 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960037040 con 0x7fe9740d1aa0 2024-09-10T07:40:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.906+0000 7fe96b400640 1 -- 172.21.15.99:0/1865118913 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe960004030 con 0x7fe9740d1aa0 2024-09-10T07:40:27.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.906+0000 7fe96b400640 1 -- 172.21.15.99:0/1865118913 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960004400 con 0x7fe9740d1aa0 2024-09-10T07:40:27.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.906+0000 7fe97a800640 1 -- 172.21.15.99:0/1865118913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9740c9420 con 0x7fe9740d1aa0 2024-09-10T07:40:27.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.906+0000 7fe97a800640 1 -- 172.21.15.99:0/1865118913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9740c99e0 con 0x7fe9740d1aa0 2024-09-10T07:40:27.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.907+0000 7fe97a800640 1 -- 172.21.15.99:0/1865118913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe974162690 con 0x7fe9740d1aa0 2024-09-10T07:40:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.908+0000 7fe96b400640 1 -- 172.21.15.99:0/1865118913 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe96003a070 con 0x7fe9740d1aa0 2024-09-10T07:40:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.909+0000 7fe96b400640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe95406be30 0x7fe95406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.909+0000 7fe96b400640 1 -- 172.21.15.99:0/1865118913 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fe9600ab300 con 0x7fe9740d1aa0 2024-09-10T07:40:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.909+0000 7fe973400640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe95406be30 0x7fe95406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:27.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.910+0000 7fe973400640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe95406be30 0x7fe95406e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe9740b1c60 tx=0x7fe964008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:27.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:27.913+0000 7fe96b400640 1 -- 172.21.15.99:0/1865118913 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe974162690 con 0x7fe9740d1aa0 2024-09-10T07:40:28.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.122+0000 7fe97a800640 1 -- 172.21.15.99:0/1865118913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9740d21e0 con 0x7fe9740d1aa0 2024-09-10T07:40:28.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.122+0000 7fe96b400640 1 -- 172.21.15.99:0/1865118913 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7fe960041020 con 0x7fe9740d1aa0 2024-09-10T07:40:28.122 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:28.122 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":66,"btime":"2024-09-10T07:40:25:708900+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/4097316027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4097316027},{"type":"v1","addr":"172.21.15.187:6834","nonce":4097316027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2128941619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2128941619},{"type":"v1","addr":"172.21.15.187:6835","nonce":2128941619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/722129971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":722129971},{"type":"v1","addr":"172.21.15.99:6835","nonce":722129971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:40:22.087139+0000","modified":"2024-09-10T07:40:25.118483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1531136464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1531136464},{"type":"v1","addr":"172.21.15.99:6837","nonce":1531136464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6795,"qdb_cluster":[6795]},"id":8}]} 2024-09-10T07:40:28.122 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 66 2024-09-10T07:40:28.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 -- 172.21.15.99:0/1865118913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe95406be30 msgr2=0x7fe95406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe95406be30 0x7fe95406e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe9740b1c60 tx=0x7fe964008040 comp rx=0 tx=0).stop 2024-09-10T07:40:28.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 -- 172.21.15.99:0/1865118913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 msgr2=0x7fe9740b93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 0x7fe9740b93b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe9600090b0 tx=0x7fe9600046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 -- 172.21.15.99:0/1865118913 shutdown_connections 2024-09-10T07:40:28.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe97415ed50 0x7fe97415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe95406be30 0x7fe95406e2f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740d1aa0 0x7fe9740b93b0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 --2- 172.21.15.99:0/1865118913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9740b5030 0x7fe9741564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 -- 172.21.15.99:0/1865118913 >> 172.21.15.99:0/1865118913 conn(0x7fe9740d4bd0 msgr2=0x7fe9740b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:28.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.124+0000 7fe97a800640 1 -- 172.21.15.99:0/1865118913 shutdown_connections 2024-09-10T07:40:28.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.125+0000 7fe97a800640 1 -- 172.21.15.99:0/1865118913 wait complete. 2024-09-10T07:40:28.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:40:22.087139+0000', 'modified': '2024-09-10T07:40:25.118483+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6795}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6795': {'gid': 6795, 'name': 'a', 'rank': 0, 'incarnation': 62, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/1531136464', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 1531136464}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 1531136464}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6795, 'qdb_cluster': [6795]} 2024-09-10T07:40:28.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:40:28.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T07:40:28.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.701+0000 7f6141e00640 1 Processor -- start 2024-09-10T07:40:28.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.701+0000 7f6141e00640 1 -- start start 2024-09-10T07:40:28.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.702+0000 7f6141e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f613c0b5750 0x7f613c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.703+0000 7f6141e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c15c800 con 0x7f613c0ce070 2024-09-10T07:40:28.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.703+0000 7f6141e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c15cae0 con 0x7f613c0cf890 2024-09-10T07:40:28.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.703+0000 7f6141e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f613c0b5bb0 con 0x7f613c0b5750 2024-09-10T07:40:28.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.703+0000 7f613aa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f613c0ce070 0x7f613c15bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36978/0 (socket says 172.21.15.99:36978) 2024-09-10T07:40:28.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.703+0000 7f613aa00640 1 -- 172.21.15.99:0/3622010574 learned_addr learned my addr 172.21.15.99:0/3622010574 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:28.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.703+0000 7f6132000640 1 --2- 172.21.15.99:0/3622010574 >> v2:172.21.15.99:3300/0 conn(0x7f613c0b5750 0x7f613c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.703+0000 7f6132000640 1 -- 172.21.15.99:0/3622010574 >> v1:172.21.15.187:6789/0 conn(0x7f613c0cf890 legacy=0x7f613c06e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.703+0000 7f613a000640 1 -- 172.21.15.99:0/3622010574 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4271314093 0 0) 0x7f613c15c800 con 0x7f613c0ce070 2024-09-10T07:40:28.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.703+0000 7f6132000640 1 -- 172.21.15.99:0/3622010574 >> v1:172.21.15.99:6789/0 conn(0x7f613c0ce070 legacy=0x7f613c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.703+0000 7f6132000640 1 -- 172.21.15.99:0/3622010574 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c15cdc0 con 0x7f613c0b5750 2024-09-10T07:40:28.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.704+0000 7f6132000640 1 --2- 172.21.15.99:0/3622010574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0b5750 0x7f613c15d170 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f61240097a0 tx=0x7f612402c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a9e62f21e9ecb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.704+0000 7f613a000640 1 -- 172.21.15.99:0/3622010574 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124038070 con 0x7f613c0b5750 2024-09-10T07:40:28.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.704+0000 7f613a000640 1 -- 172.21.15.99:0/3622010574 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6124031710 con 0x7f613c0b5750 2024-09-10T07:40:28.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.705+0000 7f613a000640 1 -- 172.21.15.99:0/3622010574 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124031ae0 con 0x7f613c0b5750 2024-09-10T07:40:28.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.705+0000 7f6141e00640 1 -- 172.21.15.99:0/3622010574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0b5750 msgr2=0x7f613c15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.705+0000 7f6141e00640 1 --2- 172.21.15.99:0/3622010574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0b5750 0x7f613c15d170 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f61240097a0 tx=0x7f612402c440 comp rx=0 tx=0).stop 2024-09-10T07:40:28.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.705+0000 7f6141e00640 1 -- 172.21.15.99:0/3622010574 shutdown_connections 2024-09-10T07:40:28.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.705+0000 7f6141e00640 1 --2- 172.21.15.99:0/3622010574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0b5750 0x7f613c15d170 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.705+0000 7f6141e00640 1 -- 172.21.15.99:0/3622010574 >> 172.21.15.99:0/3622010574 conn(0x7f613c0b2630 msgr2=0x7f613c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:28.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.705+0000 7f6141e00640 1 -- 172.21.15.99:0/3622010574 shutdown_connections 2024-09-10T07:40:28.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.705+0000 7f6141e00640 1 -- 172.21.15.99:0/3622010574 wait complete. 2024-09-10T07:40:28.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.707+0000 7f6141e00640 1 Processor -- start 2024-09-10T07:40:28.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.707+0000 7f6141e00640 1 -- start start 2024-09-10T07:40:28.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6141e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f613c0b5750 0x7f613c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6141e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0ce070 0x7f613c13fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6141e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f613c0cf890 0x7f613c1f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6141e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f613c06e790 con 0x7f613c0ce070 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6141e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f613c0ce450 con 0x7f613c0cf890 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6141e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f613c06e910 con 0x7f613c0b5750 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6132000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0ce070 0x7f613c13fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6132000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0ce070 0x7f613c13fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42838/0 (socket says 172.21.15.99:42838) 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6132000640 1 -- 172.21.15.99:0/1013290127 learned_addr learned my addr 172.21.15.99:0/1013290127 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f613aa00640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f613c0b5750 0x7f613c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f613b400640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f613c0cf890 0x7f613c1f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6132000640 1 -- 172.21.15.99:0/1013290127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f613c0b5750 msgr2=0x7f613c15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6132000640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f613c0b5750 0x7f613c15adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6132000640 1 -- 172.21.15.99:0/1013290127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f613c0cf890 msgr2=0x7f613c1f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6132000640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f613c0cf890 0x7f613c1f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f6132000640 1 -- 172.21.15.99:0/1013290127 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c140120 con 0x7f613c0ce070 2024-09-10T07:40:28.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.708+0000 7f613b400640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f613c0cf890 0x7f613c1f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:28.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.709+0000 7f6132000640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0ce070 0x7f613c13fbe0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6124000c00 tx=0x7f61240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.709+0000 7f6133e00640 1 -- 172.21.15.99:0/1013290127 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124042020 con 0x7f613c0ce070 2024-09-10T07:40:28.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.709+0000 7f6133e00640 1 -- 172.21.15.99:0/1013290127 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6124033a40 con 0x7f613c0ce070 2024-09-10T07:40:28.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.709+0000 7f6133e00640 1 -- 172.21.15.99:0/1013290127 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124038040 con 0x7f613c0ce070 2024-09-10T07:40:28.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.709+0000 7f6141e00640 1 -- 172.21.15.99:0/1013290127 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613c154a90 con 0x7f613c0ce070 2024-09-10T07:40:28.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.709+0000 7f6141e00640 1 -- 172.21.15.99:0/1013290127 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613c155050 con 0x7f613c0ce070 2024-09-10T07:40:28.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.712+0000 7f6133e00640 1 -- 172.21.15.99:0/1013290127 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6124045020 con 0x7f613c0ce070 2024-09-10T07:40:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.713+0000 7f6133e00640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f611806be30 0x7f611806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.713+0000 7f6133e00640 1 -- 172.21.15.99:0/1013290127 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f61240adad0 con 0x7f613c0ce070 2024-09-10T07:40:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.713+0000 7f613aa00640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f611806be30 0x7f611806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.713+0000 7f6144bc7740 1 Processor -- start 2024-09-10T07:40:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.713+0000 7f6144bc7740 1 -- start start 2024-09-10T07:40:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.714+0000 7f613aa00640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f611806be30 0x7f611806e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f612c000f60 tx=0x7f612c007d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.714+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b380cf0 0x564f6b3c6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.714+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b37e4b0 0x564f6b3810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.714+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b382480 0x564f6b37b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.714+0000 7f6144bc7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564f6b2df3b0 con 0x564f6b37e4b0 2024-09-10T07:40:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.714+0000 7f6144bc7740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x564f6b2e4410 con 0x564f6b382480 2024-09-10T07:40:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.714+0000 7f6144bc7740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x564f6b28c620 con 0x564f6b380cf0 2024-09-10T07:40:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f613aa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b380cf0 0x564f6b3c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f6132000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b37e4b0 0x564f6b3810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f6132000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b37e4b0 0x564f6b3810d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42846/0 (socket says 172.21.15.99:42846) 2024-09-10T07:40:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f6132000640 1 -- 172.21.15.99:0/583493018 learned_addr learned my addr 172.21.15.99:0/583493018 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f613b400640 1 --2- 172.21.15.99:0/583493018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b382480 0x564f6b37b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f6132000640 1 -- 172.21.15.99:0/583493018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b380cf0 msgr2=0x564f6b3c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:28.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f6132000640 1 --2- 172.21.15.99:0/583493018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b380cf0 0x564f6b3c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f6132000640 1 -- 172.21.15.99:0/583493018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b382480 msgr2=0x564f6b37b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:28.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f6132000640 1 --2- 172.21.15.99:0/583493018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b382480 0x564f6b37b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f6132000640 1 -- 172.21.15.99:0/583493018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f6aff72d0 con 0x564f6b37e4b0 2024-09-10T07:40:28.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.715+0000 7f6132000640 1 --2- 172.21.15.99:0/583493018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b37e4b0 0x564f6b3810d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f61240abf70 tx=0x7f612407b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf6fbf57853d3cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f612b400640 1 -- 172.21.15.99:0/583493018 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612407c480 con 0x564f6b37e4b0 2024-09-10T07:40:28.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f612b400640 1 -- 172.21.15.99:0/583493018 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61240aa070 con 0x564f6b37e4b0 2024-09-10T07:40:28.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f612b400640 1 -- 172.21.15.99:0/583493018 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612407bd80 con 0x564f6b37e4b0 2024-09-10T07:40:28.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f6144bc7740 1 -- 172.21.15.99:0/583493018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b37e4b0 msgr2=0x564f6b3810d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f6144bc7740 1 --2- 172.21.15.99:0/583493018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b37e4b0 0x564f6b3810d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f61240abf70 tx=0x7f612407b6e0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f6144bc7740 1 -- 172.21.15.99:0/583493018 shutdown_connections 2024-09-10T07:40:28.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f6144bc7740 1 --2- 172.21.15.99:0/583493018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b382480 0x564f6b37b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f6144bc7740 1 --2- 172.21.15.99:0/583493018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b37e4b0 0x564f6b3810d0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f6144bc7740 1 --2- 172.21.15.99:0/583493018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b380cf0 0x564f6b3c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f6144bc7740 1 -- 172.21.15.99:0/583493018 >> 172.21.15.99:0/583493018 conn(0x564f6b37d740 msgr2=0x564f6b3c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:28.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f6144bc7740 1 -- 172.21.15.99:0/583493018 shutdown_connections 2024-09-10T07:40:28.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.716+0000 7f6144bc7740 1 -- 172.21.15.99:0/583493018 wait complete. 2024-09-10T07:40:28.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.717+0000 7f6144bc7740 1 -- start start 2024-09-10T07:40:28.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.717+0000 7f6144bc7740 1 Processor -- start 2024-09-10T07:40:28.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.718+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b380cf0 0x564f6b37bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.718+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b37c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.718+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b3c3220 0x564f6b3aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.718+0000 7f6144bc7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564f6b29f780 con 0x564f6b382480 2024-09-10T07:40:28.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.718+0000 7f6144bc7740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x564f6b2e03d0 con 0x564f6b380cf0 2024-09-10T07:40:28.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.718+0000 7f6144bc7740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x564f6b2df3b0 con 0x564f6b3c3220 2024-09-10T07:40:28.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.718+0000 7f6144bc7740 10 client.0 _ll_register_callbacks cb 0x564f6b2dd5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:40:28.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.718+0000 7f6132000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b37c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f6132000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b37c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42848/0 (socket says 172.21.15.99:42848) 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f6132000640 1 -- 172.21.15.99:0/2236761287 learned_addr learned my addr 172.21.15.99:0/2236761287 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f613aa00640 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b380cf0 0x564f6b37bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f613b400640 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b3c3220 0x564f6b3aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f6132000640 1 -- 172.21.15.99:0/2236761287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b3c3220 msgr2=0x564f6b3aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f6132000640 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b3c3220 0x564f6b3aa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f6132000640 1 -- 172.21.15.99:0/2236761287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b380cf0 msgr2=0x564f6b37bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f6132000640 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b380cf0 0x564f6b37bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f6132000640 1 -- 172.21.15.99:0/2236761287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f6b0c16b0 con 0x564f6b382480 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f613b400640 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b3c3220 0x564f6b3aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f6132000640 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b37c040 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6124033fd0 tx=0x7f6124006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8167daa98cec41c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f611fe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f611fe00640 1 -- 172.21.15.99:0/2236761287 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124080130 con 0x564f6b382480 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f611fe00640 1 -- 172.21.15.99:0/2236761287 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f61240844d0 con 0x564f6b382480 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.719+0000 7f6144bc7740 1 -- 172.21.15.99:0/2236761287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61240aa070 con 0x564f6b382480 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f611fe00640 1 -- 172.21.15.99:0/2236761287 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f6124084960 con 0x564f6b382480 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f6144bc7740 10 client.6918 fetch_fsmap learned FSMap version 66 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f6144bc7740 1 -- 172.21.15.99:0/2236761287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x564f6b390db0 con 0x564f6b382480 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f611fe00640 1 -- 172.21.15.99:0/2236761287 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61240aa070 con 0x564f6b382480 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f611fe00640 1 -- 172.21.15.99:0/2236761287 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 66) ==== 3502+0+0 (secure 0 0 0) 0x7f612407b1d0 con 0x564f6b382480 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f6144bc7740 10 client.6918 fetch_fsmap finished waiting for FSMap version 66 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f6144bc7740 10 client.6918 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T07:40:28.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f6144bc7740 20 client.6918 populate_metadata read hostname 'smithi099' 2024-09-10T07:40:28.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f6144bc7740 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.99:6836/1531136464,v1:172.21.15.99:6837/1531136464] conn(0x564f6b391830 0x564f6b391c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f6144bc7740 4 client.6918 mds_command: new command op to 6795 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:40:28.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f6144bc7740 1 -- 172.21.15.99:0/2236761287 --> [v2:172.21.15.99:6836/1531136464,v1:172.21.15.99:6837/1531136464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f6b2f1b40 con 0x564f6b391830 2024-09-10T07:40:28.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.720+0000 7f613aa00640 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.99:6836/1531136464,v1:172.21.15.99:6837/1531136464] conn(0x564f6b391830 0x564f6b391c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.721+0000 7f613aa00640 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.99:6836/1531136464,v1:172.21.15.99:6837/1531136464] conn(0x564f6b391830 0x564f6b391c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e230d4d65f0ac202 server_cookie=d2ae6328a329cbcd in_seq=0 out_seq=0 2024-09-10T07:40:28.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.721+0000 7f611fe00640 10 client.6918 ms_handle_connect on v2:172.21.15.99:6836/1531136464 2024-09-10T07:40:28.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f611fe00640 1 -- 172.21.15.99:0/2236761287 <== mds.0 v2:172.21.15.99:6836/1531136464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f6b2f1b40 con 0x564f6b391830 2024-09-10T07:40:28.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f611fe00640 10 client.6918 handle_command_reply: tid=0 2024-09-10T07:40:28.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f6144bc7740 1 client.6918 shutdown 2024-09-10T07:40:28.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f6144bc7740 1 -- 172.21.15.99:0/2236761287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 msgr2=0x564f6b37c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f6144bc7740 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b37c040 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f6124033fd0 tx=0x7f6124006ef0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f6144bc7740 1 -- 172.21.15.99:0/2236761287 shutdown_connections 2024-09-10T07:40:28.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f6144bc7740 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.99:6836/1531136464,v1:172.21.15.99:6837/1531136464] conn(0x564f6b391830 0x564f6b391c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f6144bc7740 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b3c3220 0x564f6b3aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f6144bc7740 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b37c040 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f611fe00640 0 client.6918 ms_handle_reset on v2:172.21.15.99:6836/1531136464 2024-09-10T07:40:28.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f6144bc7740 1 --2- 172.21.15.99:0/2236761287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b380cf0 0x564f6b37bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.722+0000 7f6144bc7740 1 -- 172.21.15.99:0/2236761287 >> 172.21.15.99:0/2236761287 conn(0x564f6b37e4b0 msgr2=0x564f6b3c39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:28.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.723+0000 7f6144bc7740 1 -- 172.21.15.99:0/2236761287 shutdown_connections 2024-09-10T07:40:28.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.723+0000 7f6144bc7740 1 -- 172.21.15.99:0/2236761287 wait complete. 2024-09-10T07:40:28.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.723+0000 7f6144bc7740 20 client.6918 trim_cache size 0 max 16384 2024-09-10T07:40:28.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.741+0000 7f6144bc7740 1 Processor -- start 2024-09-10T07:40:28.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.742+0000 7f6144bc7740 1 -- start start 2024-09-10T07:40:28.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.742+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b380cf0 0x564f6b393220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.742+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b3c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.742+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b3c3220 0x564f6b3c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.742+0000 7f6144bc7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f613c1fbc10 con 0x564f6b382480 2024-09-10T07:40:28.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.742+0000 7f6144bc7740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f613c141400 con 0x564f6b3c3220 2024-09-10T07:40:28.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.742+0000 7f6144bc7740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f613c1fb5c0 con 0x564f6b380cf0 2024-09-10T07:40:28.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f6132000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b3c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f6132000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b3c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42860/0 (socket says 172.21.15.99:42860) 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f6132000640 1 -- 172.21.15.99:0/3566671016 learned_addr learned my addr 172.21.15.99:0/3566671016 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f6132000640 1 -- 172.21.15.99:0/3566671016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b380cf0 msgr2=0x564f6b393220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f6132000640 1 --2- 172.21.15.99:0/3566671016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b380cf0 0x564f6b393220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f6132000640 1 -- 172.21.15.99:0/3566671016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b3c3220 msgr2=0x564f6b3c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f6132000640 1 --2- 172.21.15.99:0/3566671016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b3c3220 0x564f6b3c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f6132000640 1 -- 172.21.15.99:0/3566671016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f6b3dfaf0 con 0x564f6b382480 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f6132000640 1 --2- 172.21.15.99:0/3566671016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b3c74c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f61240781e0 tx=0x7f6124095040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bdcf0a01d0ad36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f612aa00640 1 -- 172.21.15.99:0/3566671016 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124080130 con 0x564f6b382480 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f612aa00640 1 -- 172.21.15.99:0/3566671016 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61240aa070 con 0x564f6b382480 2024-09-10T07:40:28.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.743+0000 7f612aa00640 1 -- 172.21.15.99:0/3566671016 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612407bd80 con 0x564f6b382480 2024-09-10T07:40:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.744+0000 7f6144bc7740 1 -- 172.21.15.99:0/3566671016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 msgr2=0x564f6b3c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.744+0000 7f6144bc7740 1 --2- 172.21.15.99:0/3566671016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b3c74c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f61240781e0 tx=0x7f6124095040 comp rx=0 tx=0).stop 2024-09-10T07:40:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.744+0000 7f6144bc7740 1 -- 172.21.15.99:0/3566671016 shutdown_connections 2024-09-10T07:40:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.744+0000 7f6144bc7740 1 --2- 172.21.15.99:0/3566671016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b3c3220 0x564f6b3c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.744+0000 7f6144bc7740 1 --2- 172.21.15.99:0/3566671016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b382480 0x564f6b3c74c0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.744+0000 7f6144bc7740 1 --2- 172.21.15.99:0/3566671016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b380cf0 0x564f6b393220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.744+0000 7f6144bc7740 1 -- 172.21.15.99:0/3566671016 >> 172.21.15.99:0/3566671016 conn(0x564f6b37e4b0 msgr2=0x564f6b3a7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.744+0000 7f6144bc7740 1 -- 172.21.15.99:0/3566671016 shutdown_connections 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.744+0000 7f6144bc7740 1 -- 172.21.15.99:0/3566671016 wait complete. 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.745+0000 7f6144bc7740 1 -- start start 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.745+0000 7f6144bc7740 1 Processor -- start 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.746+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b380cf0 0x564f6b38fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.746+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b382480 0x564f6b42d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.746+0000 7f6144bc7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b3c3220 0x564f6b3c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.746+0000 7f6144bc7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564f6b29f780 con 0x564f6b3c3220 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.746+0000 7f6144bc7740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x564f6b2df3b0 con 0x564f6b380cf0 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.746+0000 7f6144bc7740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x564f6b2e03d0 con 0x564f6b382480 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.746+0000 7f6144bc7740 10 client.0 _ll_register_callbacks cb 0x7f6134001720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.746+0000 7f613b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b3c3220 0x564f6b3c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.746+0000 7f613b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b3c3220 0x564f6b3c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42872/0 (socket says 172.21.15.99:42872) 2024-09-10T07:40:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.746+0000 7f613b400640 1 -- 172.21.15.99:0/478897752 learned_addr learned my addr 172.21.15.99:0/478897752 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f613aa00640 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b380cf0 0x564f6b38fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f6132000640 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b382480 0x564f6b42d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f613b400640 1 -- 172.21.15.99:0/478897752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b382480 msgr2=0x564f6b42d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f613b400640 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b382480 0x564f6b42d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f613b400640 1 -- 172.21.15.99:0/478897752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b380cf0 msgr2=0x564f6b38fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f613b400640 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b380cf0 0x564f6b38fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f613b400640 1 -- 172.21.15.99:0/478897752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f6b42de30 con 0x564f6b3c3220 2024-09-10T07:40:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f6132000640 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b382480 0x564f6b42d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f613b400640 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b3c3220 0x564f6b3c39e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f6134001d30 tx=0x7f61340021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135662144b292cea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f611fe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:40:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f611fe00640 1 -- 172.21.15.99:0/478897752 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134016480 con 0x564f6b3c3220 2024-09-10T07:40:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f611fe00640 1 -- 172.21.15.99:0/478897752 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f6134010070 con 0x564f6b3c3220 2024-09-10T07:40:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.747+0000 7f6144bc7740 1 -- 172.21.15.99:0/478897752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61240aa070 con 0x564f6b3c3220 2024-09-10T07:40:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f611fe00640 1 -- 172.21.15.99:0/478897752 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f6134022050 con 0x564f6b3c3220 2024-09-10T07:40:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f6144bc7740 10 client.6924 fetch_fsmap learned FSMap version 66 2024-09-10T07:40:28.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f6144bc7740 1 -- 172.21.15.99:0/478897752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x564f6b3c9860 con 0x564f6b3c3220 2024-09-10T07:40:28.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f611fe00640 1 -- 172.21.15.99:0/478897752 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61240aa070 con 0x564f6b3c3220 2024-09-10T07:40:28.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f611fe00640 1 -- 172.21.15.99:0/478897752 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 66) ==== 3502+0+0 (secure 0 0 0) 0x7f6134025020 con 0x564f6b3c3220 2024-09-10T07:40:28.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f6144bc7740 10 client.6924 fetch_fsmap finished waiting for FSMap version 66 2024-09-10T07:40:28.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f6144bc7740 10 client.6924 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T07:40:28.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f6144bc7740 20 client.6924 populate_metadata read hostname 'smithi099' 2024-09-10T07:40:28.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f6144bc7740 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.99:6836/1531136464,v1:172.21.15.99:6837/1531136464] conn(0x564f6b3c2890 0x564f6b3c8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f6144bc7740 4 client.6924 mds_command: new command op to 6795 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:40:28.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f6144bc7740 1 -- 172.21.15.99:0/478897752 --> [v2:172.21.15.99:6836/1531136464,v1:172.21.15.99:6837/1531136464] -- command(tid 0: {"prefix": "status"}) -- 0x564f6b2ebe90 con 0x564f6b3c2890 2024-09-10T07:40:28.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.748+0000 7f613aa00640 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.99:6836/1531136464,v1:172.21.15.99:6837/1531136464] conn(0x564f6b3c2890 0x564f6b3c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f613aa00640 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.99:6836/1531136464,v1:172.21.15.99:6837/1531136464] conn(0x564f6b3c2890 0x564f6b3c8780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c1501f11e11e53d server_cookie=2767dd180a29dca8 in_seq=0 out_seq=0 2024-09-10T07:40:28.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f611fe00640 10 client.6924 ms_handle_connect on v2:172.21.15.99:6836/1531136464 2024-09-10T07:40:28.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f611fe00640 1 -- 172.21.15.99:0/478897752 <== mds.0 v2:172.21.15.99:6836/1531136464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x564f6b2ebe90 con 0x564f6b3c2890 2024-09-10T07:40:28.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f611fe00640 10 client.6924 handle_command_reply: tid=0 2024-09-10T07:40:28.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 client.6924 shutdown 2024-09-10T07:40:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 -- 172.21.15.99:0/478897752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b3c3220 msgr2=0x564f6b3c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b3c3220 0x564f6b3c39e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f6134001d30 tx=0x7f61340021f0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 -- 172.21.15.99:0/478897752 shutdown_connections 2024-09-10T07:40:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.99:6836/1531136464,v1:172.21.15.99:6837/1531136464] conn(0x564f6b3c2890 0x564f6b3c8780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564f6b3c3220 0x564f6b3c39e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x564f6b382480 0x564f6b42d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f611fe00640 0 client.6924 ms_handle_reset on v2:172.21.15.99:6836/1531136464 2024-09-10T07:40:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 --2- 172.21.15.99:0/478897752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f6b380cf0 0x564f6b38fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 -- 172.21.15.99:0/478897752 >> 172.21.15.99:0/478897752 conn(0x564f6b37e4b0 msgr2=0x564f6b3c74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 -- 172.21.15.99:0/478897752 shutdown_connections 2024-09-10T07:40:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.749+0000 7f6144bc7740 1 -- 172.21.15.99:0/478897752 wait complete. 2024-09-10T07:40:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6144bc7740 20 client.6924 trim_cache size 0 max 16384 2024-09-10T07:40:28.758 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:40:28.758 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:40:28.758 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:40:28.758 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 6795, 2024-09-10T07:40:28.758 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:40:28.758 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:40:28.758 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:40:28.759 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 6.0763916130000002, 2024-09-10T07:40:28.759 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 66, 2024-09-10T07:40:28.759 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 139, 2024-09-10T07:40:28.759 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 139, 2024-09-10T07:40:28.759 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 10.799618859000001 2024-09-10T07:40:28.759 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 -- 172.21.15.99:0/1013290127 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f611806be30 msgr2=0x7f611806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f611806be30 0x7f611806e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f612c000f60 tx=0x7f612c007d00 comp rx=0 tx=0).stop 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 -- 172.21.15.99:0/1013290127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0ce070 msgr2=0x7f613c13fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0ce070 0x7f613c13fbe0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6124000c00 tx=0x7f61240046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 -- 172.21.15.99:0/1013290127 shutdown_connections 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f613c0cf890 0x7f613c1f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f611806be30 0x7f611806e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f613c0ce070 0x7f613c13fbe0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 --2- 172.21.15.99:0/1013290127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f613c0b5750 0x7f613c15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 -- 172.21.15.99:0/1013290127 >> 172.21.15.99:0/1013290127 conn(0x7f613c0b2630 msgr2=0x7f613c071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 -- 172.21.15.99:0/1013290127 shutdown_connections 2024-09-10T07:40:28.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.750+0000 7f6141e00640 1 -- 172.21.15.99:0/1013290127 wait complete. 2024-09-10T07:40:28.765 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:40:28.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.918+0000 7fad5a400640 1 Processor -- start 2024-09-10T07:40:28.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.918+0000 7fad5a400640 1 -- start start 2024-09-10T07:40:28.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.920+0000 7fad5a400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 0x7fad54167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.920+0000 7fad5a400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad54142650 con 0x7fad5413fae0 2024-09-10T07:40:28.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.920+0000 7fad5a400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad54142930 con 0x7fad54142150 2024-09-10T07:40:28.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.920+0000 7fad5a400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fad540ce780 con 0x7fad54160c50 2024-09-10T07:40:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.920+0000 7fad53400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fad5413fae0 0x7fad5406f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36980/0 (socket says 172.21.15.99:36980) 2024-09-10T07:40:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.920+0000 7fad53400640 1 -- 172.21.15.99:0/84188968 learned_addr learned my addr 172.21.15.99:0/84188968 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.920+0000 7fad53e00640 1 --2- 172.21.15.99:0/84188968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 0x7fad54167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.920+0000 7fad52a00640 1 -- 172.21.15.99:0/84188968 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764220478 0 0) 0x7fad54142650 con 0x7fad5413fae0 2024-09-10T07:40:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.920+0000 7fad52a00640 1 -- 172.21.15.99:0/84188968 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad38003520 con 0x7fad5413fae0 2024-09-10T07:40:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.921+0000 7fad53e00640 1 -- 172.21.15.99:0/84188968 >> v1:172.21.15.187:6789/0 conn(0x7fad54142150 legacy=0x7fad54160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.921+0000 7fad53e00640 1 -- 172.21.15.99:0/84188968 >> v1:172.21.15.99:6789/0 conn(0x7fad5413fae0 legacy=0x7fad5406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.921+0000 7fad53e00640 1 -- 172.21.15.99:0/84188968 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad54142c10 con 0x7fad54160c50 2024-09-10T07:40:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.922+0000 7fad53e00640 1 --2- 172.21.15.99:0/84188968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 0x7fad54167680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009dc0 tx=0x7fad4c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9064132cf2f0ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.922+0000 7fad52a00640 1 -- 172.21.15.99:0/84188968 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c02ae60 con 0x7fad54160c50 2024-09-10T07:40:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.922+0000 7fad52a00640 1 -- 172.21.15.99:0/84188968 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4c007740 con 0x7fad54160c50 2024-09-10T07:40:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.922+0000 7fad52a00640 1 -- 172.21.15.99:0/84188968 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c007b10 con 0x7fad54160c50 2024-09-10T07:40:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.922+0000 7fad5a400640 1 -- 172.21.15.99:0/84188968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 msgr2=0x7fad54167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.922+0000 7fad5a400640 1 --2- 172.21.15.99:0/84188968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 0x7fad54167680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009dc0 tx=0x7fad4c02a640 comp rx=0 tx=0).stop 2024-09-10T07:40:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.923+0000 7fad5a400640 1 -- 172.21.15.99:0/84188968 shutdown_connections 2024-09-10T07:40:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.923+0000 7fad5a400640 1 --2- 172.21.15.99:0/84188968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 0x7fad54167680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.923+0000 7fad5a400640 1 -- 172.21.15.99:0/84188968 >> 172.21.15.99:0/84188968 conn(0x7fad5406bc10 msgr2=0x7fad5406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.923+0000 7fad5a400640 1 -- 172.21.15.99:0/84188968 shutdown_connections 2024-09-10T07:40:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.923+0000 7fad5a400640 1 -- 172.21.15.99:0/84188968 wait complete. 2024-09-10T07:40:28.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.924+0000 7fad5a400640 1 Processor -- start 2024-09-10T07:40:28.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.924+0000 7fad5a400640 1 -- start start 2024-09-10T07:40:28.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.925+0000 7fad5a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad5413fae0 0x7fad540b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.925+0000 7fad5a400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad54142150 0x7fad5413b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.925+0000 7fad5a400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 0x7fad5415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.925+0000 7fad5a400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fad540cfda0 con 0x7fad5413fae0 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.925+0000 7fad5a400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fad540cfc20 con 0x7fad54142150 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.925+0000 7fad5a400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fad540cff20 con 0x7fad54160c50 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.925+0000 7fad53400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad5413fae0 0x7fad540b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.925+0000 7fad53400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad5413fae0 0x7fad540b5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42888/0 (socket says 172.21.15.99:42888) 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.925+0000 7fad53400640 1 -- 172.21.15.99:0/3248886637 learned_addr learned my addr 172.21.15.99:0/3248886637 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad53e00640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 0x7fad5415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad4aa00640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad54142150 0x7fad5413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad53400640 1 -- 172.21.15.99:0/3248886637 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 msgr2=0x7fad5415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad53400640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 0x7fad5415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad53400640 1 -- 172.21.15.99:0/3248886637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad54142150 msgr2=0x7fad5413b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad53400640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad54142150 0x7fad5413b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad53400640 1 -- 172.21.15.99:0/3248886637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5415eb50 con 0x7fad5413fae0 2024-09-10T07:40:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad53400640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad5413fae0 0x7fad540b5620 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c530 tx=0x7fad4400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad4be00640 1 -- 172.21.15.99:0/3248886637 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44017070 con 0x7fad5413fae0 2024-09-10T07:40:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad4be00640 1 -- 172.21.15.99:0/3248886637 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad44005ce0 con 0x7fad5413fae0 2024-09-10T07:40:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad4be00640 1 -- 172.21.15.99:0/3248886637 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad440072b0 con 0x7fad5413fae0 2024-09-10T07:40:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.926+0000 7fad5a400640 1 -- 172.21.15.99:0/3248886637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad540b3f80 con 0x7fad5413fae0 2024-09-10T07:40:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.927+0000 7fad5a400640 1 -- 172.21.15.99:0/3248886637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad540b4540 con 0x7fad5413fae0 2024-09-10T07:40:28.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.927+0000 7fad5a400640 1 -- 172.21.15.99:0/3248886637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad54160540 con 0x7fad5413fae0 2024-09-10T07:40:28.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.928+0000 7fad4be00640 1 -- 172.21.15.99:0/3248886637 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad4401a070 con 0x7fad5413fae0 2024-09-10T07:40:28.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.930+0000 7fad4be00640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad3006be30 0x7fad3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:28.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.930+0000 7fad4be00640 1 -- 172.21.15.99:0/3248886637 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fad4408a290 con 0x7fad5413fae0 2024-09-10T07:40:28.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.930+0000 7fad4aa00640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad3006be30 0x7fad3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:28.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.931+0000 7fad4aa00640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad3006be30 0x7fad3006e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fad5415e0c0 tx=0x7fad3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:28.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:28.934+0000 7fad4be00640 1 -- 172.21.15.99:0/3248886637 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad44058cf0 con 0x7fad5413fae0 2024-09-10T07:40:29.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.142+0000 7fad5a400640 1 -- 172.21.15.99:0/3248886637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fad540b0860 con 0x7fad5413fae0 2024-09-10T07:40:29.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.142+0000 7fad4be00640 1 -- 172.21.15.99:0/3248886637 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) ==== 53+0+73 (secure 0 0 0) 0x7fad440585f0 con 0x7fad5413fae0 2024-09-10T07:40:29.143 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:40:29.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.144+0000 7fad5a400640 1 -- 172.21.15.99:0/3248886637 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad3006be30 msgr2=0x7fad3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:29.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.144+0000 7fad5a400640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad3006be30 0x7fad3006e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fad5415e0c0 tx=0x7fad3c009040 comp rx=0 tx=0).stop 2024-09-10T07:40:29.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.144+0000 7fad5a400640 1 -- 172.21.15.99:0/3248886637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad5413fae0 msgr2=0x7fad540b5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:29.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.144+0000 7fad5a400640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad5413fae0 0x7fad540b5620 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c530 tx=0x7fad4400c9f0 comp rx=0 tx=0).stop 2024-09-10T07:40:29.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.145+0000 7fad5a400640 1 -- 172.21.15.99:0/3248886637 shutdown_connections 2024-09-10T07:40:29.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.145+0000 7fad5a400640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad54160c50 0x7fad5415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:29.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.145+0000 7fad5a400640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad54142150 0x7fad5413b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:29.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.145+0000 7fad5a400640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad3006be30 0x7fad3006e2f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:29.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.145+0000 7fad5a400640 1 --2- 172.21.15.99:0/3248886637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad5413fae0 0x7fad540b5620 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:29.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.145+0000 7fad5a400640 1 -- 172.21.15.99:0/3248886637 >> 172.21.15.99:0/3248886637 conn(0x7fad5406bc10 msgr2=0x7fad5406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:29.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.145+0000 7fad5a400640 1 -- 172.21.15.99:0/3248886637 shutdown_connections 2024-09-10T07:40:29.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29.145+0000 7fad5a400640 1 -- 172.21.15.99:0/3248886637 wait complete. 2024-09-10T07:40:29.160 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:40:29.160 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:40:29.161 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:40:29.161 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:40:29.161 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:40:29.161 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:40:29.161 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:40:29.161 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:40:29.161 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:40:29.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:29.161 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:40:29.197 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:40:29.197 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:40:29.197 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:40:29.198 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42399sec preferred_lft 42399sec 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link 2024-09-10T07:40:29.199 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:29.200 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:40:29.200 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:40:29.200 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::1c1f:52ff:fe95:9fbe/64 scope link 2024-09-10T07:40:29.200 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:29.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:29.200 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:40:29.292 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:40:29.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:29.295 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:40:29.332 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:40:29.332 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:40:29.332 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:40:29.332 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:40:29.332 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:40:29.333 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:40:29.333 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:40:29.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:40:29.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:40:29.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:40:29.333 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:40:29.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:40:29.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:29.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:29.530 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:40:29.565 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:40:29.565 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:40:29.565 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:40:29.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:29.565 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:40:29.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:40:29.662 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:40:29.698 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:40:29.699 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:40:29.699 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:40:29.774 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:40:29.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:29.774 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:40:29.901 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:40:29.902 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:40:29.927 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:40:29.928 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:40:29.928 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:40:29.928 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:40:29.928 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:40:29.929 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:40:29.929 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:40:29.930 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:40:29.930 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:40:29.930 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:40:29.932 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:40:29.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:29.933 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:40:29.990 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:40:30.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:40:30.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:30.084 INFO:teuthology.orchestra.run.smithi099.stdout:client5933 2024-09-10T07:40:30.085 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:30.085 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:30.120 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:40:30.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.315+0000 7f830a600640 1 Processor -- start 2024-09-10T07:40:30.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.315+0000 7f830a600640 1 -- start start 2024-09-10T07:40:30.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.316+0000 7f830a600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f830415e970 0x7f83040d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:30.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.316+0000 7f830a600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f83040d2680 0x7f83040cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:30.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.316+0000 7f830a600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83040d2bd0 con 0x7f83040cfac0 2024-09-10T07:40:30.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.316+0000 7f830a600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f83040d37e0 con 0x7f830415e970 2024-09-10T07:40:30.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.316+0000 7f830a600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f83040d2eb0 con 0x7f83040d2680 2024-09-10T07:40:30.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.317+0000 7f8309200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f830415e970 0x7f83040d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:30.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.317+0000 7f8309200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f830415e970 0x7f83040d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40434/0 (socket says 172.21.15.99:40434) 2024-09-10T07:40:30.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.317+0000 7f8309200640 1 -- 172.21.15.99:0/2400424438 learned_addr learned my addr 172.21.15.99:0/2400424438 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:30.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.317+0000 7f8303e00640 1 --2- 172.21.15.99:0/2400424438 >> v2:172.21.15.187:3300/0 conn(0x7f83040d2680 0x7f83040cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:30.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.317+0000 7f8309200640 1 -- 172.21.15.99:0/2400424438 >> v2:172.21.15.187:3300/0 conn(0x7f83040d2680 msgr2=0x7f83040cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:30.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.317+0000 7f8309200640 1 --2- 172.21.15.99:0/2400424438 >> v2:172.21.15.187:3300/0 conn(0x7f83040d2680 0x7f83040cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.317+0000 7f8309200640 1 -- 172.21.15.99:0/2400424438 >> v1:172.21.15.187:6789/0 conn(0x7f83040cfac0 legacy=0x7f83040d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:30.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.317+0000 7f8309200640 1 -- 172.21.15.99:0/2400424438 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83040d3190 con 0x7f830415e970 2024-09-10T07:40:30.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.317+0000 7f8303e00640 1 --2- 172.21.15.99:0/2400424438 >> v2:172.21.15.187:3300/0 conn(0x7f83040d2680 0x7f83040cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:30.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.318+0000 7f8309200640 1 --2- 172.21.15.99:0/2400424438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f830415e970 0x7f83040d0300 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f830409e530 tx=0x7f82f402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40efe3210692d3bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:30.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.318+0000 7f8303400640 1 -- 172.21.15.99:0/2400424438 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4037070 con 0x7f830415e970 2024-09-10T07:40:30.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.318+0000 7f8303400640 1 -- 172.21.15.99:0/2400424438 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f4032440 con 0x7f830415e970 2024-09-10T07:40:30.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.318+0000 7f8303400640 1 -- 172.21.15.99:0/2400424438 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4032810 con 0x7f830415e970 2024-09-10T07:40:30.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.319+0000 7f830a600640 1 -- 172.21.15.99:0/2400424438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f830415e970 msgr2=0x7f83040d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:30.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.319+0000 7f830a600640 1 --2- 172.21.15.99:0/2400424438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f830415e970 0x7f83040d0300 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f830409e530 tx=0x7f82f402a2c0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.319+0000 7f830a600640 1 -- 172.21.15.99:0/2400424438 shutdown_connections 2024-09-10T07:40:30.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.319+0000 7f830a600640 1 --2- 172.21.15.99:0/2400424438 >> v2:172.21.15.187:3300/0 conn(0x7f83040d2680 0x7f83040cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.319+0000 7f830a600640 1 --2- 172.21.15.99:0/2400424438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f830415e970 0x7f83040d0300 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.319+0000 7f830a600640 1 -- 172.21.15.99:0/2400424438 >> 172.21.15.99:0/2400424438 conn(0x7f830409de00 msgr2=0x7f83040d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:30.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.319+0000 7f830a600640 1 -- 172.21.15.99:0/2400424438 shutdown_connections 2024-09-10T07:40:30.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.319+0000 7f830a600640 1 -- 172.21.15.99:0/2400424438 wait complete. 2024-09-10T07:40:30.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.321+0000 7f830a600640 1 Processor -- start 2024-09-10T07:40:30.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.321+0000 7f830a600640 1 -- start start 2024-09-10T07:40:30.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f830a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83040cfac0 0x7f83040b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:30.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f830a600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83040d2680 0x7f83040b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:30.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f830a600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f830415e970 0x7f83041e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:30.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f830a600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f83040d0840 con 0x7f83040cfac0 2024-09-10T07:40:30.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f830a600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f83040cff10 con 0x7f83040d2680 2024-09-10T07:40:30.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f830a600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f830415ed50 con 0x7f830415e970 2024-09-10T07:40:30.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f8309200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83040cfac0 0x7f83040b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:30.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f8309200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83040cfac0 0x7f83040b7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40436/0 (socket says 172.21.15.99:40436) 2024-09-10T07:40:30.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f8309200640 1 -- 172.21.15.99:0/2890920226 learned_addr learned my addr 172.21.15.99:0/2890920226 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:30.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f8303e00640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83040d2680 0x7f83040b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:30.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f8309200640 1 -- 172.21.15.99:0/2890920226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f830415e970 msgr2=0x7f83041e8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:30.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f8309200640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f830415e970 0x7f83041e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f8309200640 1 -- 172.21.15.99:0/2890920226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83040d2680 msgr2=0x7f83040b9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:30.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f8309200640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83040d2680 0x7f83040b9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f8309200640 1 -- 172.21.15.99:0/2890920226 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830415a220 con 0x7f83040cfac0 2024-09-10T07:40:30.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.322+0000 7f8303e00640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83040d2680 0x7f83040b9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:30.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.323+0000 7f8309200640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83040cfac0 0x7f83040b7e80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f82f4000c00 tx=0x7f82f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:30.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.323+0000 7f8300c00640 1 -- 172.21.15.99:0/2890920226 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4041020 con 0x7f83040cfac0 2024-09-10T07:40:30.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.323+0000 7f8300c00640 1 -- 172.21.15.99:0/2890920226 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f4030970 con 0x7f83040cfac0 2024-09-10T07:40:30.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.323+0000 7f8300c00640 1 -- 172.21.15.99:0/2890920226 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4037040 con 0x7f83040cfac0 2024-09-10T07:40:30.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.323+0000 7f830a600640 1 -- 172.21.15.99:0/2890920226 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830415a4c0 con 0x7f83040cfac0 2024-09-10T07:40:30.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.323+0000 7f830a600640 1 -- 172.21.15.99:0/2890920226 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830415aa80 con 0x7f83040cfac0 2024-09-10T07:40:30.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.324+0000 7f830a600640 1 -- 172.21.15.99:0/2890920226 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8304155010 con 0x7f83040cfac0 2024-09-10T07:40:30.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.325+0000 7f8300c00640 1 -- 172.21.15.99:0/2890920226 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82f4044020 con 0x7f83040cfac0 2024-09-10T07:40:30.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.326+0000 7f8300c00640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f82e406be30 0x7f82e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:30.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.326+0000 7f8300c00640 1 -- 172.21.15.99:0/2890920226 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f82f40ab840 con 0x7f83040cfac0 2024-09-10T07:40:30.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.326+0000 7f8303e00640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f82e406be30 0x7f82e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:30.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.326+0000 7f8303e00640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f82e406be30 0x7f82e406e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f82f0006fd0 tx=0x7f82f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:30.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.330+0000 7f8300c00640 1 -- 172.21.15.99:0/2890920226 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82f404b030 con 0x7f83040cfac0 2024-09-10T07:40:30.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.555+0000 7f830a600640 1 -- 172.21.15.99:0/2890920226 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f83040cf580 con 0x7f83040cfac0 2024-09-10T07:40:30.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.555+0000 7f8300c00640 1 -- 172.21.15.99:0/2890920226 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) ==== 53+0+73 (secure 0 0 0) 0x7f82f407a1f0 con 0x7f83040cfac0 2024-09-10T07:40:30.555 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:40:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 -- 172.21.15.99:0/2890920226 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f82e406be30 msgr2=0x7f82e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f82e406be30 0x7f82e406e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f82f0006fd0 tx=0x7f82f0008040 comp rx=0 tx=0).stop 2024-09-10T07:40:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 -- 172.21.15.99:0/2890920226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83040cfac0 msgr2=0x7f83040b7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:30.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83040cfac0 0x7f83040b7e80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f82f4000c00 tx=0x7f82f40046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 -- 172.21.15.99:0/2890920226 shutdown_connections 2024-09-10T07:40:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f830415e970 0x7f83041e8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83040d2680 0x7f83040b9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f82e406be30 0x7f82e406e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 --2- 172.21.15.99:0/2890920226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83040cfac0 0x7f83040b7e80 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 -- 172.21.15.99:0/2890920226 >> 172.21.15.99:0/2890920226 conn(0x7f830409de00 msgr2=0x7f83040c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 -- 172.21.15.99:0/2890920226 shutdown_connections 2024-09-10T07:40:30.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:30.557+0000 7f830a600640 1 -- 172.21.15.99:0/2890920226 wait complete. 2024-09-10T07:40:30.573 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:40:30.573 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:40:30.574 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:40:30.574 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:40:30.574 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:40:30.574 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:40:30.574 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:40:30.574 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:40:30.574 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:40:30.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:30.574 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:40:30.615 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:40:30.615 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:40:30.615 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:40:30.615 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:30.615 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:40:30.616 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42393sec preferred_lft 42393sec 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:30.617 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:40:30.618 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:40:30.618 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::84a0:e5ff:fe75:1d2e/64 scope link 2024-09-10T07:40:30.618 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:40:30.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:30.618 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:40:30.715 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:40:30.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:30.718 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:40:30.756 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:40:30.756 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:40:30.757 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:40:30.757 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:40:30.757 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:40:30.757 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:40:30.757 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:40:30.757 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:40:30.757 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:40:30.757 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:40:30.757 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:40:30.874 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:40:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:40:30.945 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:40:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:30.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:30.954 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:40:30.989 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:40:30.989 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:40:30.989 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:40:30.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:30.989 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:40:31.085 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:40:31.085 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:40:31.120 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:40:31.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:40:31.121 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:40:31.195 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:40:31.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:31.195 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:40:31.323 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:40:31.323 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:40:31.351 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:40:31.351 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:40:31.351 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:40:31.351 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:40:31.351 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:40:31.353 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:40:31.353 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:40:31.353 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:40:31.353 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:40:31.353 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:40:31.356 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:40:31.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:31.356 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:40:31.412 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:40:31.490 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:40:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:40:31.494 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:40:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:40:31.502 INFO:teuthology.orchestra.run.smithi187.stdout:client6939 2024-09-10T07:40:31.502 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:40:31.502 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:31.538 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.696+0000 7f7e3be00640 1 Processor -- start 2024-09-10T07:40:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.696+0000 7f7e3be00640 1 -- start start 2024-09-10T07:40:31.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.698+0000 7f7e3be00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e3415ede0 0x7f7e340afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:31.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.698+0000 7f7e3be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e340cf830 0x7f7e340b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:31.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.698+0000 7f7e3be00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e340b0200 con 0x7f7e340cfc70 2024-09-10T07:40:31.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.698+0000 7f7e3be00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7e340aec20 con 0x7f7e3415ede0 2024-09-10T07:40:31.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.698+0000 7f7e3be00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340aef00 con 0x7f7e340cf830 2024-09-10T07:40:31.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.698+0000 7f7e38a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e340cf830 0x7f7e340b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.698+0000 7f7e39400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e3415ede0 0x7f7e340afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.698+0000 7f7e39400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e3415ede0 0x7f7e340afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:58872/0 (socket says 172.21.15.99:58872) 2024-09-10T07:40:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.698+0000 7f7e38a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e340cf830 0x7f7e340b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:40204/0 (socket says 172.21.15.99:40204) 2024-09-10T07:40:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.698+0000 7f7e39400640 1 -- 172.21.15.99:0/3772471951 learned_addr learned my addr 172.21.15.99:0/3772471951 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.699+0000 7f7e38a00640 1 -- 172.21.15.99:0/3772471951 >> v2:172.21.15.187:3300/0 conn(0x7f7e3415ede0 msgr2=0x7f7e340afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.699+0000 7f7e38a00640 1 --2- 172.21.15.99:0/3772471951 >> v2:172.21.15.187:3300/0 conn(0x7f7e3415ede0 0x7f7e340afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.699+0000 7f7e38a00640 1 -- 172.21.15.99:0/3772471951 >> v1:172.21.15.187:6789/0 conn(0x7f7e340cfc70 legacy=0x7f7e34071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.699+0000 7f7e38a00640 1 -- 172.21.15.99:0/3772471951 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e340af1e0 con 0x7f7e340cf830 2024-09-10T07:40:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.699+0000 7f7e39400640 1 --2- 172.21.15.99:0/3772471951 >> v2:172.21.15.187:3300/0 conn(0x7f7e3415ede0 0x7f7e340afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:40:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.699+0000 7f7e33e00640 1 -- 172.21.15.99:0/3772471951 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081075684 0 0) 0x7f7e340b0200 con 0x7f7e340cfc70 2024-09-10T07:40:31.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.700+0000 7f7e38a00640 1 --2- 172.21.15.99:0/3772471951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e340cf830 0x7f7e340b43b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097a0 tx=0x7f7e2002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd8b0ff6b3617623 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.700+0000 7f7e33e00640 1 -- 172.21.15.99:0/3772471951 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20037070 con 0x7f7e340cf830 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.700+0000 7f7e33e00640 1 -- 172.21.15.99:0/3772471951 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e20032440 con 0x7f7e340cf830 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.700+0000 7f7e33e00640 1 -- 172.21.15.99:0/3772471951 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20032810 con 0x7f7e340cf830 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.700+0000 7f7e3be00640 1 -- 172.21.15.99:0/3772471951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e340cf830 msgr2=0x7f7e340b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.700+0000 7f7e3be00640 1 --2- 172.21.15.99:0/3772471951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e340cf830 0x7f7e340b43b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097a0 tx=0x7f7e2002a180 comp rx=0 tx=0).stop 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.701+0000 7f7e3be00640 1 -- 172.21.15.99:0/3772471951 shutdown_connections 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.701+0000 7f7e3be00640 1 --2- 172.21.15.99:0/3772471951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e340cf830 0x7f7e340b43b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.701+0000 7f7e3be00640 1 --2- 172.21.15.99:0/3772471951 >> v2:172.21.15.187:3300/0 conn(0x7f7e3415ede0 0x7f7e340afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.701+0000 7f7e3be00640 1 -- 172.21.15.99:0/3772471951 >> 172.21.15.99:0/3772471951 conn(0x7f7e3406bc10 msgr2=0x7f7e3406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.701+0000 7f7e3be00640 1 -- 172.21.15.99:0/3772471951 shutdown_connections 2024-09-10T07:40:31.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.701+0000 7f7e3be00640 1 -- 172.21.15.99:0/3772471951 wait complete. 2024-09-10T07:40:31.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.702+0000 7f7e3be00640 1 Processor -- start 2024-09-10T07:40:31.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.702+0000 7f7e3be00640 1 -- start start 2024-09-10T07:40:31.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.703+0000 7f7e3be00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e340cf830 0x7f7e34155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:31.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.703+0000 7f7e3be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e340cfc70 0x7f7e341490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:31.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.703+0000 7f7e3be00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3415ede0 0x7f7e3406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.703+0000 7f7e3be00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340ae840 con 0x7f7e340cfc70 2024-09-10T07:40:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.703+0000 7f7e3be00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340af7a0 con 0x7f7e340cf830 2024-09-10T07:40:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.703+0000 7f7e3be00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340ae9c0 con 0x7f7e3415ede0 2024-09-10T07:40:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e38a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e340cfc70 0x7f7e341490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e38a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e340cfc70 0x7f7e341490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40438/0 (socket says 172.21.15.99:40438) 2024-09-10T07:40:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e38a00640 1 -- 172.21.15.99:0/2114539782 learned_addr learned my addr 172.21.15.99:0/2114539782 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e39400640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e340cf830 0x7f7e34155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e39e00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3415ede0 0x7f7e3406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e38a00640 1 -- 172.21.15.99:0/2114539782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3415ede0 msgr2=0x7f7e3406ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e38a00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3415ede0 0x7f7e3406ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e38a00640 1 -- 172.21.15.99:0/2114539782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e340cf830 msgr2=0x7f7e34155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e38a00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e340cf830 0x7f7e34155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e38a00640 1 -- 172.21.15.99:0/2114539782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e341531a0 con 0x7f7e340cfc70 2024-09-10T07:40:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e39400640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e340cf830 0x7f7e34155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e39e00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3415ede0 0x7f7e3406ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.704+0000 7f7e38a00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e340cfc70 0x7f7e341490c0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7e200098c0 tx=0x7f7e200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.705+0000 7f7e31600640 1 -- 172.21.15.99:0/2114539782 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20041070 con 0x7f7e340cfc70 2024-09-10T07:40:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.705+0000 7f7e31600640 1 -- 172.21.15.99:0/2114539782 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2003c870 con 0x7f7e340cfc70 2024-09-10T07:40:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.705+0000 7f7e31600640 1 -- 172.21.15.99:0/2114539782 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20037040 con 0x7f7e340cfc70 2024-09-10T07:40:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.705+0000 7f7e3be00640 1 -- 172.21.15.99:0/2114539782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e34153480 con 0x7f7e340cfc70 2024-09-10T07:40:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.705+0000 7f7e3be00640 1 -- 172.21.15.99:0/2114539782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e34153a40 con 0x7f7e340cfc70 2024-09-10T07:40:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.706+0000 7f7e3be00640 1 -- 172.21.15.99:0/2114539782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e340afcc0 con 0x7f7e340cfc70 2024-09-10T07:40:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.707+0000 7f7e31600640 1 -- 172.21.15.99:0/2114539782 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e20044070 con 0x7f7e340cfc70 2024-09-10T07:40:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.708+0000 7f7e31600640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e1406be30 0x7f7e1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.708+0000 7f7e31600640 1 -- 172.21.15.99:0/2114539782 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f7e200ab850 con 0x7f7e340cfc70 2024-09-10T07:40:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.708+0000 7f7e39400640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e1406be30 0x7f7e1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:31.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.709+0000 7f7e39400640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e1406be30 0x7f7e1406e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009b80 tx=0x7f7e28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:31.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.712+0000 7f7e31600640 1 -- 172.21.15.99:0/2114539782 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e2007a1f0 con 0x7f7e340cfc70 2024-09-10T07:40:31.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.920+0000 7f7e3be00640 1 -- 172.21.15.99:0/2114539782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e34071ca0 con 0x7f7e340cfc70 2024-09-10T07:40:31.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.921+0000 7f7e31600640 1 -- 172.21.15.99:0/2114539782 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7f7e20079af0 con 0x7f7e340cfc70 2024-09-10T07:40:31.921 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:31.921 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":66,"btime":"2024-09-10T07:40:25:708900+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/4097316027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4097316027},{"type":"v1","addr":"172.21.15.187:6834","nonce":4097316027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2128941619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2128941619},{"type":"v1","addr":"172.21.15.187:6835","nonce":2128941619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/722129971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":722129971},{"type":"v1","addr":"172.21.15.99:6835","nonce":722129971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:40:22.087139+0000","modified":"2024-09-10T07:40:25.118483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1531136464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1531136464},{"type":"v1","addr":"172.21.15.99:6837","nonce":1531136464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6795,"qdb_cluster":[6795]},"id":8}]} 2024-09-10T07:40:31.921 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 66 2024-09-10T07:40:31.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 -- 172.21.15.99:0/2114539782 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e1406be30 msgr2=0x7f7e1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:31.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e1406be30 0x7f7e1406e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009b80 tx=0x7f7e28008040 comp rx=0 tx=0).stop 2024-09-10T07:40:31.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 -- 172.21.15.99:0/2114539782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e340cfc70 msgr2=0x7f7e341490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e340cfc70 0x7f7e341490c0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7e200098c0 tx=0x7f7e200046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 -- 172.21.15.99:0/2114539782 shutdown_connections 2024-09-10T07:40:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3415ede0 0x7f7e3406ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e1406be30 0x7f7e1406e2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e340cfc70 0x7f7e341490c0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 --2- 172.21.15.99:0/2114539782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e340cf830 0x7f7e34155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 -- 172.21.15.99:0/2114539782 >> 172.21.15.99:0/2114539782 conn(0x7f7e3406bc10 msgr2=0x7f7e34160200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 -- 172.21.15.99:0/2114539782 shutdown_connections 2024-09-10T07:40:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:31.923+0000 7f7e3be00640 1 -- 172.21.15.99:0/2114539782 wait complete. 2024-09-10T07:40:31.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:40:32.114 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":6795,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.4284820539999998,"mdsmap_epoch":66,"osdmap_epoch":139,"osdmap_epoch_barrier":139,"uptime":14.151711727} 2024-09-10T07:40:32.114 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 6795, "mdsmap_epoch": 66, "osdmap_epoch": 139, "osdmap_epoch_barrier": 139, "rank_uptime": 9.428482054, "state": "up:active", "uptime": 14.151711727, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:40:32.115 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-10T07:40:32.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.270+0000 7f16b7000640 1 Processor -- start 2024-09-10T07:40:32.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.270+0000 7f16b7000640 1 -- start start 2024-09-10T07:40:32.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.272+0000 7f16b7000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b015af10 0x7f16b00cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.272+0000 7f16b7000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16b00716a0 con 0x7f16b00cf440 2024-09-10T07:40:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.272+0000 7f16b7000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16b0071980 con 0x7f16b006f580 2024-09-10T07:40:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.272+0000 7f16b7000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f16b00731f0 con 0x7f16b015af10 2024-09-10T07:40:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.272+0000 7f16af400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f16b00cf440 0x7f16b006ee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60714/0 (socket says 172.21.15.99:60714) 2024-09-10T07:40:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.272+0000 7f16af400640 1 -- 172.21.15.99:0/1141436633 learned_addr learned my addr 172.21.15.99:0/1141436633 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.272+0000 7f16afe00640 1 --2- 172.21.15.99:0/1141436633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b015af10 0x7f16b00cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.272+0000 7f16aea00640 1 -- 172.21.15.99:0/1141436633 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010566860 0 0) 0x7f16b00716a0 con 0x7f16b00cf440 2024-09-10T07:40:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.273+0000 7f16aea00640 1 -- 172.21.15.99:0/1141436633 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1694003440 con 0x7f16b00cf440 2024-09-10T07:40:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.273+0000 7f16aea00640 1 -- 172.21.15.99:0/1141436633 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708886084 0 0) 0x7f16b0071980 con 0x7f16b006f580 2024-09-10T07:40:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.273+0000 7f16aea00640 1 -- 172.21.15.99:0/1141436633 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16b00716a0 con 0x7f16b006f580 2024-09-10T07:40:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.273+0000 7f16aea00640 1 -- 172.21.15.99:0/1141436633 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4061259094 0 0) 0x7f1694003440 con 0x7f16b00cf440 2024-09-10T07:40:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.273+0000 7f16afe00640 1 -- 172.21.15.99:0/1141436633 >> v1:172.21.15.187:6789/0 conn(0x7f16b006f580 legacy=0x7f16b00b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.273+0000 7f16afe00640 1 -- 172.21.15.99:0/1141436633 >> v1:172.21.15.99:6789/0 conn(0x7f16b00cf440 legacy=0x7f16b006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.273+0000 7f16afe00640 1 -- 172.21.15.99:0/1141436633 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b0071c60 con 0x7f16b015af10 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.274+0000 7f16afe00640 1 --2- 172.21.15.99:0/1141436633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b015af10 0x7f16b00cef00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f16a0009dc0 tx=0x7f16a002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776e5fc400eabd68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.274+0000 7f16aea00640 1 -- 172.21.15.99:0/1141436633 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c001670 con 0x7f16b015af10 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.274+0000 7f16aea00640 1 -- 172.21.15.99:0/1141436633 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16a0007540 con 0x7f16b015af10 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.274+0000 7f16aea00640 1 -- 172.21.15.99:0/1141436633 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0007910 con 0x7f16b015af10 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.275+0000 7f16b7000640 1 -- 172.21.15.99:0/1141436633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b015af10 msgr2=0x7f16b00cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.275+0000 7f16b7000640 1 --2- 172.21.15.99:0/1141436633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b015af10 0x7f16b00cef00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f16a0009dc0 tx=0x7f16a002a5d0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.275+0000 7f16b7000640 1 -- 172.21.15.99:0/1141436633 shutdown_connections 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.275+0000 7f16b7000640 1 --2- 172.21.15.99:0/1141436633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b015af10 0x7f16b00cef00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.275+0000 7f16b7000640 1 -- 172.21.15.99:0/1141436633 >> 172.21.15.99:0/1141436633 conn(0x7f16b00b26a0 msgr2=0x7f16b00b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.275+0000 7f16b7000640 1 -- 172.21.15.99:0/1141436633 shutdown_connections 2024-09-10T07:40:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.275+0000 7f16b7000640 1 -- 172.21.15.99:0/1141436633 wait complete. 2024-09-10T07:40:32.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.276+0000 7f16b7000640 1 Processor -- start 2024-09-10T07:40:32.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.276+0000 7f16b7000640 1 -- start start 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.277+0000 7f16b7000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16b006f580 0x7f16b013d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.277+0000 7f16b7000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b00cf440 0x7f16b0153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.277+0000 7f16b7000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16b015af10 0x7f16b0151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.277+0000 7f16b7000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f16b015b2f0 con 0x7f16b006f580 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.277+0000 7f16b7000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0072220 con 0x7f16b015af10 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.277+0000 7f16b7000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f16b0072740 con 0x7f16b00cf440 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16afe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16b006f580 0x7f16b013d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16afe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16b006f580 0x7f16b013d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40440/0 (socket says 172.21.15.99:40440) 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16afe00640 1 -- 172.21.15.99:0/2287397121 learned_addr learned my addr 172.21.15.99:0/2287397121 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16b5000640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16b015af10 0x7f16b0151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16af400640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b00cf440 0x7f16b0153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:32.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16afe00640 1 -- 172.21.15.99:0/2287397121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b00cf440 msgr2=0x7f16b0153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16afe00640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b00cf440 0x7f16b0153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16afe00640 1 -- 172.21.15.99:0/2287397121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16b015af10 msgr2=0x7f16b0151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16afe00640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16b015af10 0x7f16b0151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16afe00640 1 -- 172.21.15.99:0/2287397121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b013d960 con 0x7f16b006f580 2024-09-10T07:40:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16b5000640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16b015af10 0x7f16b0151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:32.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.278+0000 7f16afe00640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16b006f580 0x7f16b013d110 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f16a0000f80 tx=0x7f16a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:32.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.279+0000 7f16a7e00640 1 -- 172.21.15.99:0/2287397121 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0040070 con 0x7f16b006f580 2024-09-10T07:40:32.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.279+0000 7f16a7e00640 1 -- 172.21.15.99:0/2287397121 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16a0031c40 con 0x7f16b006f580 2024-09-10T07:40:32.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.279+0000 7f16a7e00640 1 -- 172.21.15.99:0/2287397121 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a0009450 con 0x7f16b006f580 2024-09-10T07:40:32.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.279+0000 7f16b7000640 1 -- 172.21.15.99:0/2287397121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b013dc40 con 0x7f16b006f580 2024-09-10T07:40:32.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.279+0000 7f16b7000640 1 -- 172.21.15.99:0/2287397121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b013e200 con 0x7f16b006f580 2024-09-10T07:40:32.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.280+0000 7f16b7000640 1 -- 172.21.15.99:0/2287397121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b00cef00 con 0x7f16b006f580 2024-09-10T07:40:32.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.281+0000 7f16a7e00640 1 -- 172.21.15.99:0/2287397121 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16a0039040 con 0x7f16b006f580 2024-09-10T07:40:32.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.281+0000 7f16a7e00640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f169006be30 0x7f169006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:32.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.282+0000 7f16a7e00640 1 -- 172.21.15.99:0/2287397121 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f16a00ac6b0 con 0x7f16b006f580 2024-09-10T07:40:32.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.282+0000 7f16af400640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f169006be30 0x7f169006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:32.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.282+0000 7f16af400640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f169006be30 0x7f169006e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f16b0159bf0 tx=0x7f169c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:32.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.286+0000 7f16a7e00640 1 -- 172.21.15.99:0/2287397121 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16a007afc0 con 0x7f16b006f580 2024-09-10T07:40:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.457+0000 7f16b7000640 1 -- 172.21.15.99:0/2287397121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f16b015a410 con 0x7f16b006f580 2024-09-10T07:40:32.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.738+0000 7f16a7e00640 1 -- 172.21.15.99:0/2287397121 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v140) ==== 181+0+0 (secure 0 0 0) 0x7f16a007a8c0 con 0x7f16b006f580 2024-09-10T07:40:32.739 INFO:teuthology.orchestra.run.smithi099.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 -- 172.21.15.99:0/2287397121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f169006be30 msgr2=0x7f169006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f169006be30 0x7f169006e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f16b0159bf0 tx=0x7f169c009040 comp rx=0 tx=0).stop 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 -- 172.21.15.99:0/2287397121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16b006f580 msgr2=0x7f16b013d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16b006f580 0x7f16b013d110 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f16a0000f80 tx=0x7f16a0004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 -- 172.21.15.99:0/2287397121 shutdown_connections 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16b015af10 0x7f16b0151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16b00cf440 0x7f16b0153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f169006be30 0x7f169006e2f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 --2- 172.21.15.99:0/2287397121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16b006f580 0x7f16b013d110 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 -- 172.21.15.99:0/2287397121 >> 172.21.15.99:0/2287397121 conn(0x7f16b00b26a0 msgr2=0x7f16b014f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 -- 172.21.15.99:0/2287397121 shutdown_connections 2024-09-10T07:40:32.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:32.741+0000 7f16b7000640 1 -- 172.21.15.99:0/2287397121 wait complete. 2024-09-10T07:40:32.759 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-10T07:40:32.926 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_mon_report_interval":"5"} 2024-09-10T07:40:32.926 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-10T07:40:32.927 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-10T07:40:32.927 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:32.927 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:32.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:32.963 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-10T07:40:33.180 INFO:teuthology.orchestra.run.smithi099.stderr:16+0 records in 2024-09-10T07:40:33.180 INFO:teuthology.orchestra.run.smithi099.stderr:16+0 records out 2024-09-10T07:40:33.180 INFO:teuthology.orchestra.run.smithi099.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.136326 s, 123 MB/s 2024-09-10T07:40:33.181 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:33.181 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:33.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:33.217 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-10T07:40:33.422 INFO:teuthology.orchestra.run.smithi099.stderr:17+0 records in 2024-09-10T07:40:33.422 INFO:teuthology.orchestra.run.smithi099.stderr:17+0 records out 2024-09-10T07:40:33.423 INFO:teuthology.orchestra.run.smithi099.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.126665 s, 141 MB/s 2024-09-10T07:40:33.423 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-10T07:40:33.424 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:40:33.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.578+0000 7f1714a00640 1 Processor -- start 2024-09-10T07:40:33.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.578+0000 7f1714a00640 1 -- start start 2024-09-10T07:40:33.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f1714a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1710142150 0x7f1710160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:33.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f1714a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1710160a80 0x7f17100cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:33.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f1714a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1710142650 con 0x7f171013fae0 2024-09-10T07:40:33.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f1714a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f17100ce780 con 0x7f1710142150 2024-09-10T07:40:33.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f1714a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f1710142930 con 0x7f1710160a80 2024-09-10T07:40:33.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f170d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1710142150 0x7f1710160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:33.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f170d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1710142150 0x7f1710160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40456/0 (socket says 172.21.15.99:40456) 2024-09-10T07:40:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f170d400640 1 -- 172.21.15.99:0/4135664693 learned_addr learned my addr 172.21.15.99:0/4135664693 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f170e800640 1 --2- 172.21.15.99:0/4135664693 >> v2:172.21.15.187:3300/0 conn(0x7f1710160a80 0x7f17100cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f170d400640 1 -- 172.21.15.99:0/4135664693 >> v2:172.21.15.187:3300/0 conn(0x7f1710160a80 msgr2=0x7f17100cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f170d400640 1 --2- 172.21.15.99:0/4135664693 >> v2:172.21.15.187:3300/0 conn(0x7f1710160a80 0x7f17100cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f170d400640 1 -- 172.21.15.99:0/4135664693 >> v1:172.21.15.187:6789/0 conn(0x7f171013fae0 legacy=0x7f171006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.580+0000 7f170d400640 1 -- 172.21.15.99:0/4135664693 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1710142c10 con 0x7f1710142150 2024-09-10T07:40:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.581+0000 7f170d400640 1 --2- 172.21.15.99:0/4135664693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 0x7f1710160540 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f17100b39c0 tx=0x7f16fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393f4482ec5994e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f170ca00640 1 -- 172.21.15.99:0/4135664693 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc037070 con 0x7f1710142150 2024-09-10T07:40:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f170ca00640 1 -- 172.21.15.99:0/4135664693 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16fc032440 con 0x7f1710142150 2024-09-10T07:40:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f170ca00640 1 -- 172.21.15.99:0/4135664693 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc032810 con 0x7f1710142150 2024-09-10T07:40:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f1714a00640 1 -- 172.21.15.99:0/4135664693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 msgr2=0x7f1710160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f1714a00640 1 --2- 172.21.15.99:0/4135664693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 0x7f1710160540 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f17100b39c0 tx=0x7f16fc02a1a0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f1714a00640 1 -- 172.21.15.99:0/4135664693 shutdown_connections 2024-09-10T07:40:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f1714a00640 1 --2- 172.21.15.99:0/4135664693 >> v2:172.21.15.187:3300/0 conn(0x7f1710160a80 0x7f17100cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f1714a00640 1 --2- 172.21.15.99:0/4135664693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 0x7f1710160540 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f1714a00640 1 -- 172.21.15.99:0/4135664693 >> 172.21.15.99:0/4135664693 conn(0x7f171006bc10 msgr2=0x7f171006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f1714a00640 1 -- 172.21.15.99:0/4135664693 shutdown_connections 2024-09-10T07:40:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.582+0000 7f1714a00640 1 -- 172.21.15.99:0/4135664693 wait complete. 2024-09-10T07:40:33.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.584+0000 7f1714a00640 1 Processor -- start 2024-09-10T07:40:33.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.584+0000 7f1714a00640 1 -- start start 2024-09-10T07:40:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.585+0000 7f1714a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f171013fae0 0x7f17101f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.585+0000 7f1714a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 0x7f17101f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.585+0000 7f1714a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1710160a80 0x7f17100b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.585+0000 7f1714a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f17100cf2d0 con 0x7f1710142150 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.585+0000 7f1714a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f17100cf150 con 0x7f1710160a80 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.585+0000 7f1714a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f17100cf450 con 0x7f171013fae0 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.585+0000 7f170d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 0x7f17101f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.585+0000 7f170d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 0x7f17101f5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40458/0 (socket says 172.21.15.99:40458) 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.585+0000 7f170d400640 1 -- 172.21.15.99:0/1096952569 learned_addr learned my addr 172.21.15.99:0/1096952569 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.586+0000 7f170de00640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f171013fae0 0x7f17101f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.586+0000 7f170e800640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1710160a80 0x7f17100b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.586+0000 7f170d400640 1 -- 172.21.15.99:0/1096952569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f171013fae0 msgr2=0x7f17101f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.586+0000 7f170d400640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f171013fae0 0x7f17101f1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.586+0000 7f170d400640 1 -- 172.21.15.99:0/1096952569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1710160a80 msgr2=0x7f17100b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.586+0000 7f170d400640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1710160a80 0x7f17100b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.586+0000 7f170d400640 1 -- 172.21.15.99:0/1096952569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17101443d0 con 0x7f1710142150 2024-09-10T07:40:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.586+0000 7f170e800640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1710160a80 0x7f17100b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.586+0000 7f170d400640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 0x7f17101f5840 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f16fc02a1e0 tx=0x7f16fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.586+0000 7f1706000640 1 -- 172.21.15.99:0/1096952569 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc041020 con 0x7f1710142150 2024-09-10T07:40:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.587+0000 7f1706000640 1 -- 172.21.15.99:0/1096952569 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16fc0306c0 con 0x7f1710142150 2024-09-10T07:40:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.587+0000 7f1714a00640 1 -- 172.21.15.99:0/1096952569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17101446b0 con 0x7f1710142150 2024-09-10T07:40:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.587+0000 7f1706000640 1 -- 172.21.15.99:0/1096952569 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc037040 con 0x7f1710142150 2024-09-10T07:40:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.587+0000 7f1714a00640 1 -- 172.21.15.99:0/1096952569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1710144c70 con 0x7f1710142150 2024-09-10T07:40:33.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.588+0000 7f1714a00640 1 -- 172.21.15.99:0/1096952569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1710160540 con 0x7f1710142150 2024-09-10T07:40:33.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.589+0000 7f1706000640 1 -- 172.21.15.99:0/1096952569 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16fc044020 con 0x7f1710142150 2024-09-10T07:40:33.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.590+0000 7f1706000640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f16f006be30 0x7f16f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:33.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.590+0000 7f1706000640 1 -- 172.21.15.99:0/1096952569 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f16fc0ab6b0 con 0x7f1710142150 2024-09-10T07:40:33.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.590+0000 7f170de00640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f16f006be30 0x7f16f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:33.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.590+0000 7f170de00640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f16f006be30 0x7f16f006e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1700004f60 tx=0x7f1700007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.594+0000 7f1706000640 1 -- 172.21.15.99:0/1096952569 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16fc04b030 con 0x7f1710142150 2024-09-10T07:40:33.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.770+0000 7f1714a00640 1 -- 172.21.15.99:0/1096952569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f17100cd0c0 con 0x7f1710142150 2024-09-10T07:40:33.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.772+0000 7f1706000640 1 -- 172.21.15.99:0/1096952569 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) ==== 81+0+34202 (secure 0 0 0) 0x7f16fc079fc0 con 0x7f1710142150 2024-09-10T07:40:33.772 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:33.773 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:40:33.773 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 140, 2024-09-10T07:40:33.773 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:40:33.773 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:40:33.773 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:40:32.738179+0000", 2024-09-10T07:40:33.773 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:40:33.773 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:40:33.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:40:33.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:40:33.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 17, 2024-09-10T07:40:33.774 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:33.775 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:33.776 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:33.776 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:33.776 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:33.776 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:33.776 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:33.776 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:33.776 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:33.776 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:33.776 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:40:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:40:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:40:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:40:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:40:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:33.778 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:33.779 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:33.780 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:40:33.781 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 16, 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:19.848847+0000", 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:33.782 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:33.783 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "138", 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:33.784 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:33.786 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:33.786 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:33.786 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:33.786 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:33.786 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:33.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.786 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:33.786 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:33.786 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:40:33.787 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:33.788 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 17, 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:21.080608+0000", 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:33.789 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:40:33.790 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "140", 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:33.791 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:33.792 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:33.793 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.794 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:33.795 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:33.796 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:33.797 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:33.797 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:33.797 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:33.797 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:33.797 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:33.797 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:33.797 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:33.797 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:33.797 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:33.798 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.799 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.800 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:33.800 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.800 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:40:33.802 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:33.803 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:33.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:40:33.806 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:33.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.807 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.807 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:40:33.807 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:33.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.807 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.807 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:33.807 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.809 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:40:33.809 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:40:33.809 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:40:33.809 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:40:33.809 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:33.809 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:33.809 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:33.809 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.810 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:33.810 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:33.810 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:33.810 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:33.810 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:33.810 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:33.810 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.813 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:40:33.815 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:33.816 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:33.817 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:33.817 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:33.817 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:33.817 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:33.817 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:33.817 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:33.817 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:33.817 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:33.817 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.818 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:33.820 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:40:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.824 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.826 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:40:33.827 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:33.828 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.829 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.830 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.831 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:40:33.833 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:33.834 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.835 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.836 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:33.837 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.837 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.837 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:40:33.837 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:33.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.837 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.838 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:40:33.838 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:33.838 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.838 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.838 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:33.838 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.838 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.838 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:40:33.839 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:33.840 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:33.841 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:33.842 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:33.843 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:33.844 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.845 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.845 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:33.845 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:33.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.845 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:33.845 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:40:33.845 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:33.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:33.846 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:40:33.847 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:33.848 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:33.849 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.850 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:33.851 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.852 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:40:33.853 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:40:33.854 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:40:33.855 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:33.855 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 -- 172.21.15.99:0/1096952569 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f16f006be30 msgr2=0x7f16f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f16f006be30 0x7f16f006e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1700004f60 tx=0x7f1700007e30 comp rx=0 tx=0).stop 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 -- 172.21.15.99:0/1096952569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 msgr2=0x7f17101f5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 0x7f17101f5840 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f16fc02a1e0 tx=0x7f16fc0046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 -- 172.21.15.99:0/1096952569 shutdown_connections 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1710160a80 0x7f17100b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f16f006be30 0x7f16f006e2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1710142150 0x7f17101f5840 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 --2- 172.21.15.99:0/1096952569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f171013fae0 0x7f17101f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 -- 172.21.15.99:0/1096952569 >> 172.21.15.99:0/1096952569 conn(0x7f171006bc10 msgr2=0x7f17100cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 -- 172.21.15.99:0/1096952569 shutdown_connections 2024-09-10T07:40:33.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:33.775+0000 7f1714a00640 1 -- 172.21.15.99:0/1096952569 wait complete. 2024-09-10T07:40:33.858 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:40:38.859 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:40:39.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.025+0000 7f31ebe00640 1 Processor -- start 2024-09-10T07:40:39.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.025+0000 7f31ebe00640 1 -- start start 2024-09-10T07:40:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.026+0000 7f31ebe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f31ec15c580 0x7f31ec06d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.026+0000 7f31ebe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31ec0b5960 0x7f31ec06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.026+0000 7f31ebe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ec06d920 con 0x7f31ec15c960 2024-09-10T07:40:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.026+0000 7f31ebe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f31ec0b3930 con 0x7f31ec15c580 2024-09-10T07:40:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.026+0000 7f31ebe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec06dc00 con 0x7f31ec0b5960 2024-09-10T07:40:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.026+0000 7f31eaa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f31ec15c580 0x7f31ec06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.026+0000 7f31e2000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f31ec15c960 0x7f31ec0cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:60728/0 (socket says 172.21.15.99:60728) 2024-09-10T07:40:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.026+0000 7f31e2000640 1 -- 172.21.15.99:0/988944996 learned_addr learned my addr 172.21.15.99:0/988944996 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.027+0000 7f31eaa00640 1 -- 172.21.15.99:0/988944996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31ec0b5960 msgr2=0x7f31ec06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.027+0000 7f31eaa00640 1 --2- 172.21.15.99:0/988944996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31ec0b5960 0x7f31ec06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.027+0000 7f31eaa00640 1 -- 172.21.15.99:0/988944996 >> v1:172.21.15.99:6789/0 conn(0x7f31ec15c960 legacy=0x7f31ec0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.027+0000 7f31eaa00640 1 -- 172.21.15.99:0/988944996 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec06dee0 con 0x7f31ec15c580 2024-09-10T07:40:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.028+0000 7f31eaa00640 1 --2- 172.21.15.99:0/988944996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 0x7f31ec06d340 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0097a0 tx=0x7f31dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac66fb62887bfe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:39.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.028+0000 7f31ea000640 1 -- 172.21.15.99:0/988944996 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc037070 con 0x7f31ec15c580 2024-09-10T07:40:39.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.028+0000 7f31ea000640 1 -- 172.21.15.99:0/988944996 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc032440 con 0x7f31ec15c580 2024-09-10T07:40:39.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.028+0000 7f31ea000640 1 -- 172.21.15.99:0/988944996 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc032810 con 0x7f31ec15c580 2024-09-10T07:40:39.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.028+0000 7f31ebe00640 1 -- 172.21.15.99:0/988944996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 msgr2=0x7f31ec06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:39.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.028+0000 7f31ebe00640 1 --2- 172.21.15.99:0/988944996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 0x7f31ec06d340 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0097a0 tx=0x7f31dc02a180 comp rx=0 tx=0).stop 2024-09-10T07:40:39.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.028+0000 7f31ebe00640 1 -- 172.21.15.99:0/988944996 shutdown_connections 2024-09-10T07:40:39.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.028+0000 7f31ebe00640 1 --2- 172.21.15.99:0/988944996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31ec0b5960 0x7f31ec06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.028+0000 7f31ebe00640 1 --2- 172.21.15.99:0/988944996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 0x7f31ec06d340 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.028+0000 7f31ebe00640 1 -- 172.21.15.99:0/988944996 >> 172.21.15.99:0/988944996 conn(0x7f31ec0b2810 msgr2=0x7f31ec0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:39.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.029+0000 7f31ebe00640 1 -- 172.21.15.99:0/988944996 shutdown_connections 2024-09-10T07:40:39.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.029+0000 7f31ebe00640 1 -- 172.21.15.99:0/988944996 wait complete. 2024-09-10T07:40:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.030+0000 7f31ebe00640 1 Processor -- start 2024-09-10T07:40:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.030+0000 7f31ebe00640 1 -- start start 2024-09-10T07:40:39.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.031+0000 7f31ebe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31ec0b5960 0x7f31ec0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.031+0000 7f31ebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 0x7f31ec13ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.031+0000 7f31ebe00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31ec15e040 0x7f31ec0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.031+0000 7f31ebe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec06c150 con 0x7f31ec15c580 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.031+0000 7f31ebe00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec0b5da0 con 0x7f31ec15e040 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.031+0000 7f31ebe00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec06c2d0 con 0x7f31ec0b5960 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.031+0000 7f31e2000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 0x7f31ec13ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.031+0000 7f31e2000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 0x7f31ec13ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40486/0 (socket says 172.21.15.99:40486) 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.031+0000 7f31e2000640 1 -- 172.21.15.99:0/1770675872 learned_addr learned my addr 172.21.15.99:0/1770675872 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31eb400640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31ec15e040 0x7f31ec0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31eaa00640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31ec0b5960 0x7f31ec0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31e2000640 1 -- 172.21.15.99:0/1770675872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31ec0b5960 msgr2=0x7f31ec0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31e2000640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31ec0b5960 0x7f31ec0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31e2000640 1 -- 172.21.15.99:0/1770675872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31ec15e040 msgr2=0x7f31ec0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31e2000640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31ec15e040 0x7f31ec0c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31e2000640 1 -- 172.21.15.99:0/1770675872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec140440 con 0x7f31ec15c580 2024-09-10T07:40:39.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31eb400640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31ec15e040 0x7f31ec0c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:39.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31e2000640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 0x7f31ec13ff00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f31d400c440 tx=0x7f31d400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:39.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31e3e00640 1 -- 172.21.15.99:0/1770675872 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4017070 con 0x7f31ec15c580 2024-09-10T07:40:39.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31e3e00640 1 -- 172.21.15.99:0/1770675872 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d4005ce0 con 0x7f31ec15c580 2024-09-10T07:40:39.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31e3e00640 1 -- 172.21.15.99:0/1770675872 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d40072f0 con 0x7f31ec15c580 2024-09-10T07:40:39.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.032+0000 7f31ebe00640 1 -- 172.21.15.99:0/1770675872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec15e870 con 0x7f31ec15c580 2024-09-10T07:40:39.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.033+0000 7f31ebe00640 1 -- 172.21.15.99:0/1770675872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec15ee30 con 0x7f31ec15c580 2024-09-10T07:40:39.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.034+0000 7f31ebe00640 1 -- 172.21.15.99:0/1770675872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ec06d670 con 0x7f31ec15c580 2024-09-10T07:40:39.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.035+0000 7f31e3e00640 1 -- 172.21.15.99:0/1770675872 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31d401a070 con 0x7f31ec15c580 2024-09-10T07:40:39.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.035+0000 7f31e3e00640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31c806be30 0x7f31c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.036+0000 7f31e3e00640 1 -- 172.21.15.99:0/1770675872 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f31d408a1a0 con 0x7f31ec15c580 2024-09-10T07:40:39.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.036+0000 7f31e3e00640 1 -- 172.21.15.99:0/1770675872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=142}) -- 0x7f31c8073960 con 0x7f31ec15c580 2024-09-10T07:40:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.036+0000 7f31eaa00640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31c806be30 0x7f31c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.036+0000 7f31eaa00640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31c806be30 0x7f31c806e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f31dc034000 tx=0x7f31dc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:39.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.040+0000 7f31e3e00640 1 -- 172.21.15.99:0/1770675872 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31ec06d670 con 0x7f31ec15c580 2024-09-10T07:40:39.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.214+0000 7f31ebe00640 1 -- 172.21.15.99:0/1770675872 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f31ec0b55d0 con 0x7f31ec15c580 2024-09-10T07:40:39.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.215+0000 7f31e3e00640 1 -- 172.21.15.99:0/1770675872 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) ==== 81+0+34221 (secure 0 0 0) 0x7f31d4058460 con 0x7f31ec15c580 2024-09-10T07:40:39.215 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:39.215 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 141, 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:40:36.753263+0000", 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:40:39.216 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 17, 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:40:39.217 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:39.218 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:39.219 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:39.222 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:39.223 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 16, 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:19.848847+0000", 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:39.224 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:40:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "138", 2024-09-10T07:40:39.226 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:39.227 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:39.228 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:40:39.229 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:39.230 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 17, 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:21.080608+0000", 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1027, 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:39.231 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "141", 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:39.233 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:39.234 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:39.235 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:40:39.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.237 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:39.238 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.240 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.241 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.242 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:39.243 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:39.244 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.245 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.246 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:39.247 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:40:39.248 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:39.250 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:39.252 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.253 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:39.255 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:39.257 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.258 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:39.261 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:40:39.262 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:40:39.263 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:40:39.264 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:40:39.265 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:40:39.266 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:39.267 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:40:39.269 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.271 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:40:39.272 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:39.273 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:40:39.277 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:40:39.278 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:39.280 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:39.280 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:39.280 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:39.280 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:39.280 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.280 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.280 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:40:39.280 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:39.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:40:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.284 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.284 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:40:39.284 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:39.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:39.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:39.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:39.289 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:39.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:39.292 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:39.293 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:40:39.294 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:40:39.295 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:40:39.296 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:40:39.296 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:40:39.296 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:40:39.296 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:40:39.296 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:40:39.296 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:39.296 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:40:39.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.217+0000 7f31ebe00640 1 -- 172.21.15.99:0/1770675872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31c806be30 msgr2=0x7f31c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:39.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.217+0000 7f31ebe00640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31c806be30 0x7f31c806e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f31dc034000 tx=0x7f31dc02e000 comp rx=0 tx=0).stop 2024-09-10T07:40:39.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.217+0000 7f31ebe00640 1 -- 172.21.15.99:0/1770675872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 msgr2=0x7f31ec13ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:39.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.217+0000 7f31ebe00640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 0x7f31ec13ff00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f31d400c440 tx=0x7f31d400c900 comp rx=0 tx=0).stop 2024-09-10T07:40:39.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.218+0000 7f31ebe00640 1 -- 172.21.15.99:0/1770675872 shutdown_connections 2024-09-10T07:40:39.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.218+0000 7f31ebe00640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31ec15e040 0x7f31ec0c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.218+0000 7f31ebe00640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f31c806be30 0x7f31c806e2f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.218+0000 7f31ebe00640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31ec15c580 0x7f31ec13ff00 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.218+0000 7f31ebe00640 1 --2- 172.21.15.99:0/1770675872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31ec0b5960 0x7f31ec0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.218+0000 7f31ebe00640 1 -- 172.21.15.99:0/1770675872 >> 172.21.15.99:0/1770675872 conn(0x7f31ec0b2810 msgr2=0x7f31ec072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:39.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.218+0000 7f31ebe00640 1 -- 172.21.15.99:0/1770675872 shutdown_connections 2024-09-10T07:40:39.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.218+0000 7f31ebe00640 1 -- 172.21.15.99:0/1770675872 wait complete. 2024-09-10T07:40:39.299 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-10T07:40:39.300 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:39.300 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:39.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:39.335 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-10T07:40:39.716 INFO:teuthology.orchestra.run.smithi099.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-10T07:40:39.716 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records in 2024-09-10T07:40:39.716 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records out 2024-09-10T07:40:39.716 INFO:teuthology.orchestra.run.smithi099.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.301964 s, 174 MB/s 2024-09-10T07:40:39.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:40:39.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:40:39.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.873+0000 7fad7f200640 1 Processor -- start 2024-09-10T07:40:39.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.873+0000 7fad7f200640 1 -- start start 2024-09-10T07:40:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.874+0000 7fad7f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fad800d2680 0x7fad800cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.874+0000 7fad7f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad800cfac0 0x7fad800c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.874+0000 7fad7f200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad800d2bd0 con 0x7fad8015e970 2024-09-10T07:40:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.874+0000 7fad7f200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fad800d37e0 con 0x7fad800d2680 2024-09-10T07:40:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.874+0000 7fad7f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fad800d2eb0 con 0x7fad800cfac0 2024-09-10T07:40:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.874+0000 7fad7d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fad800d2680 0x7fad800cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.874+0000 7fad7d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fad800d2680 0x7fad800cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53558/0 (socket says 172.21.15.99:53558) 2024-09-10T07:40:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.874+0000 7fad7d400640 1 -- 172.21.15.99:0/1714714802 learned_addr learned my addr 172.21.15.99:0/1714714802 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.875+0000 7fad7e800640 1 --2- 172.21.15.99:0/1714714802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad800cfac0 0x7fad800c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.875+0000 7fad7d400640 1 -- 172.21.15.99:0/1714714802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad800cfac0 msgr2=0x7fad800c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.875+0000 7fad7d400640 1 --2- 172.21.15.99:0/1714714802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad800cfac0 0x7fad800c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.875+0000 7fad7d400640 1 -- 172.21.15.99:0/1714714802 >> v1:172.21.15.187:6789/0 conn(0x7fad8015e970 legacy=0x7fad800d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:39.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.875+0000 7fad7d400640 1 -- 172.21.15.99:0/1714714802 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad800d3190 con 0x7fad800d2680 2024-09-10T07:40:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.876+0000 7fad7d400640 1 --2- 172.21.15.99:0/1714714802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800d2680 0x7fad800cf580 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009870 tx=0x7fad6c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9148911e213ead3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.876+0000 7fad7ca00640 1 -- 172.21.15.99:0/1714714802 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c037070 con 0x7fad800d2680 2024-09-10T07:40:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.876+0000 7fad7ca00640 1 -- 172.21.15.99:0/1714714802 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6c02ae50 con 0x7fad800d2680 2024-09-10T07:40:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.876+0000 7fad7ca00640 1 -- 172.21.15.99:0/1714714802 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c032860 con 0x7fad800d2680 2024-09-10T07:40:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.877+0000 7fad7f200640 1 -- 172.21.15.99:0/1714714802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800d2680 msgr2=0x7fad800cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.877+0000 7fad7f200640 1 --2- 172.21.15.99:0/1714714802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800d2680 0x7fad800cf580 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009870 tx=0x7fad6c02a300 comp rx=0 tx=0).stop 2024-09-10T07:40:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.877+0000 7fad7f200640 1 -- 172.21.15.99:0/1714714802 shutdown_connections 2024-09-10T07:40:39.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.877+0000 7fad7f200640 1 --2- 172.21.15.99:0/1714714802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad800cfac0 0x7fad800c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.877+0000 7fad7f200640 1 --2- 172.21.15.99:0/1714714802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800d2680 0x7fad800cf580 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.877+0000 7fad7f200640 1 -- 172.21.15.99:0/1714714802 >> 172.21.15.99:0/1714714802 conn(0x7fad8009de00 msgr2=0x7fad800d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:39.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.877+0000 7fad7f200640 1 -- 172.21.15.99:0/1714714802 shutdown_connections 2024-09-10T07:40:39.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.877+0000 7fad7f200640 1 -- 172.21.15.99:0/1714714802 wait complete. 2024-09-10T07:40:39.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.879+0000 7fad7f200640 1 Processor -- start 2024-09-10T07:40:39.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.879+0000 7fad7f200640 1 -- start start 2024-09-10T07:40:39.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.879+0000 7fad7f200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad800cfac0 0x7fad80153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad800d2680 0x7fad800cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8015e970 0x7fad80160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fad8015ed50 con 0x7fad8015e970 2024-09-10T07:40:39.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7f200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fad800cff50 con 0x7fad800cfac0 2024-09-10T07:40:39.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fad8015eed0 con 0x7fad800d2680 2024-09-10T07:40:39.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8015e970 0x7fad80160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8015e970 0x7fad80160220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53570/0 (socket says 172.21.15.99:53570) 2024-09-10T07:40:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7e800640 1 -- 172.21.15.99:0/3992876692 learned_addr learned my addr 172.21.15.99:0/3992876692 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7d400640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad800d2680 0x7fad800cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7de00640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad800cfac0 0x7fad80153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7e800640 1 -- 172.21.15.99:0/3992876692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad800d2680 msgr2=0x7fad800cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7e800640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad800d2680 0x7fad800cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7e800640 1 -- 172.21.15.99:0/3992876692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad800cfac0 msgr2=0x7fad80153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7e800640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad800cfac0 0x7fad80153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7e800640 1 -- 172.21.15.99:0/3992876692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad80154350 con 0x7fad8015e970 2024-09-10T07:40:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.880+0000 7fad7de00640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad800cfac0 0x7fad80153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:39.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.881+0000 7fad7e800640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8015e970 0x7fad80160220 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fad78007e40 tx=0x7fad7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:39.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.881+0000 7fad76000640 1 -- 172.21.15.99:0/3992876692 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78014620 con 0x7fad8015e970 2024-09-10T07:40:39.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.881+0000 7fad76000640 1 -- 172.21.15.99:0/3992876692 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad78019070 con 0x7fad8015e970 2024-09-10T07:40:39.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.881+0000 7fad7f200640 1 -- 172.21.15.99:0/3992876692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad800c9040 con 0x7fad8015e970 2024-09-10T07:40:39.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.881+0000 7fad76000640 1 -- 172.21.15.99:0/3992876692 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78014a20 con 0x7fad8015e970 2024-09-10T07:40:39.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.881+0000 7fad7f200640 1 -- 172.21.15.99:0/3992876692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad800c9600 con 0x7fad8015e970 2024-09-10T07:40:39.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.882+0000 7fad7f200640 1 -- 172.21.15.99:0/3992876692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad800cf580 con 0x7fad8015e970 2024-09-10T07:40:39.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.883+0000 7fad76000640 1 -- 172.21.15.99:0/3992876692 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad78014bc0 con 0x7fad8015e970 2024-09-10T07:40:39.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.884+0000 7fad76000640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad6006be30 0x7fad6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:39.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.884+0000 7fad76000640 1 -- 172.21.15.99:0/3992876692 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7fad7808b670 con 0x7fad8015e970 2024-09-10T07:40:39.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.884+0000 7fad7de00640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad6006be30 0x7fad6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:39.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.884+0000 7fad76000640 1 -- 172.21.15.99:0/3992876692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=142}) -- 0x7fad600739c0 con 0x7fad8015e970 2024-09-10T07:40:39.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.885+0000 7fad7de00640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad6006be30 0x7fad6006e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fad800c9ce0 tx=0x7fad70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:39.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:39.888+0000 7fad76000640 1 -- 172.21.15.99:0/3992876692 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad7805a010 con 0x7fad8015e970 2024-09-10T07:40:40.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.062+0000 7fad7f200640 1 -- 172.21.15.99:0/3992876692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fad80161cc0 con 0x7fad8015e970 2024-09-10T07:40:40.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.063+0000 7fad76000640 1 -- 172.21.15.99:0/3992876692 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) ==== 81+0+34221 (secure 0 0 0) 0x7fad78059910 con 0x7fad8015e970 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 141, 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:40:36.753263+0000", 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:40:40.064 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 17, 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:40:40.065 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:40.066 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:40:40.067 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:40.068 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:40.069 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:40.070 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:40.071 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.072 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 16, 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:19.848847+0000", 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:40.073 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:40.074 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "138", 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:40.075 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:40.076 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:40.077 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:40:40.078 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:40.079 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 17, 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:21.080608+0000", 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1027, 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:40.080 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:40:40.081 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.082 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "141", 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:40.083 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:40.084 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:40.085 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:40.086 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:40.087 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:40.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:40.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:40.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:40.093 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:40.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:40.095 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:40.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:40:40.097 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:40.099 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.100 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.102 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.103 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.104 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:40.105 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.106 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.106 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:40:40.106 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:40.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.106 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.106 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:40.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.109 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.110 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:40:40.111 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:40.112 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:40:40.113 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:40:40.114 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:40:40.115 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:40:40.116 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:40:40.119 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:40:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:40:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:40.123 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.124 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:40:40.125 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:40.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.127 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:40.128 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.129 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:40.131 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:40:40.133 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:40.134 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:40.135 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:40:40.136 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:40.137 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:40.138 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:40:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:40:40.141 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:40:40.142 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:40:40.142 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:40:40.142 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:40:40.142 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:40:40.142 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:40:40.142 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:40:40.142 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:40:40.142 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:40:40.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:40.142 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.065+0000 7fad7f200640 1 -- 172.21.15.99:0/3992876692 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad6006be30 msgr2=0x7fad6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.065+0000 7fad7f200640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad6006be30 0x7fad6006e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fad800c9ce0 tx=0x7fad70009040 comp rx=0 tx=0).stop 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.065+0000 7fad7f200640 1 -- 172.21.15.99:0/3992876692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8015e970 msgr2=0x7fad80160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.065+0000 7fad7f200640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8015e970 0x7fad80160220 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fad78007e40 tx=0x7fad7800e4b0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.066+0000 7fad7f200640 1 -- 172.21.15.99:0/3992876692 shutdown_connections 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.066+0000 7fad7f200640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad6006be30 0x7fad6006e2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.066+0000 7fad7f200640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad8015e970 0x7fad80160220 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.066+0000 7fad7f200640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad800d2680 0x7fad800cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.066+0000 7fad7f200640 1 --2- 172.21.15.99:0/3992876692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad800cfac0 0x7fad80153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.066+0000 7fad7f200640 1 -- 172.21.15.99:0/3992876692 >> 172.21.15.99:0/3992876692 conn(0x7fad8009de00 msgr2=0x7fad800ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:40.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.066+0000 7fad7f200640 1 -- 172.21.15.99:0/3992876692 shutdown_connections 2024-09-10T07:40:40.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.066+0000 7fad7f200640 1 -- 172.21.15.99:0/3992876692 wait complete. 2024-09-10T07:40:40.145 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:40.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.298+0000 7efdc4800640 1 Processor -- start 2024-09-10T07:40:40.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.298+0000 7efdc4800640 1 -- start start 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.299+0000 7efdc4800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efdbc13fae0 0x7efdbc06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.299+0000 7efdc4800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 0x7efdbc160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.299+0000 7efdc4800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc142650 con 0x7efdbc160a80 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.299+0000 7efdc4800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7efdbc0ce780 con 0x7efdbc13fae0 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.299+0000 7efdc4800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7efdbc142930 con 0x7efdbc142150 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.300+0000 7efdc2800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7efdbc160a80 0x7efdbc15cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47570/0 (socket says 172.21.15.99:47570) 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.300+0000 7efdc2800640 1 -- 172.21.15.99:0/2420221262 learned_addr learned my addr 172.21.15.99:0/2420221262 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.300+0000 7efdc1400640 1 --2- 172.21.15.99:0/2420221262 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 0x7efdbc160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.300+0000 7efdc1e00640 1 --2- 172.21.15.99:0/2420221262 >> v2:172.21.15.187:3300/0 conn(0x7efdbc13fae0 0x7efdbc06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.300+0000 7efdc0a00640 1 -- 172.21.15.99:0/2420221262 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1690486029 0 0) 0x7efdbc142650 con 0x7efdbc160a80 2024-09-10T07:40:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.300+0000 7efdc0a00640 1 -- 172.21.15.99:0/2420221262 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda4003520 con 0x7efdbc160a80 2024-09-10T07:40:40.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.300+0000 7efdc1400640 1 -- 172.21.15.99:0/2420221262 >> v2:172.21.15.187:3300/0 conn(0x7efdbc13fae0 msgr2=0x7efdbc06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:40.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.300+0000 7efdc1400640 1 --2- 172.21.15.99:0/2420221262 >> v2:172.21.15.187:3300/0 conn(0x7efdbc13fae0 0x7efdbc06f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.301+0000 7efdc1400640 1 -- 172.21.15.99:0/2420221262 >> v1:172.21.15.99:6789/0 conn(0x7efdbc160a80 legacy=0x7efdbc15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.301+0000 7efdc0a00640 1 -- 172.21.15.99:0/2420221262 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2779361934 0 0) 0x7efda4003520 con 0x7efdbc160a80 2024-09-10T07:40:40.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.301+0000 7efdc1400640 1 -- 172.21.15.99:0/2420221262 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc142c10 con 0x7efdbc142150 2024-09-10T07:40:40.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.302+0000 7efdc1400640 1 --2- 172.21.15.99:0/2420221262 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 0x7efdbc160540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efdac0097a0 tx=0x7efdac02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9572b42265581e50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:40.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.302+0000 7efdc0a00640 1 -- 172.21.15.99:0/2420221262 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac037070 con 0x7efdbc142150 2024-09-10T07:40:40.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.302+0000 7efdc0a00640 1 -- 172.21.15.99:0/2420221262 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac02ab10 con 0x7efdbc142150 2024-09-10T07:40:40.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.302+0000 7efdc0a00640 1 -- 172.21.15.99:0/2420221262 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb80019f0 con 0x7efdbc142150 2024-09-10T07:40:40.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.302+0000 7efdc4800640 1 -- 172.21.15.99:0/2420221262 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 msgr2=0x7efdbc160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.302+0000 7efdc4800640 1 --2- 172.21.15.99:0/2420221262 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 0x7efdbc160540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efdac0097a0 tx=0x7efdac02a080 comp rx=0 tx=0).stop 2024-09-10T07:40:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.303+0000 7efdc4800640 1 -- 172.21.15.99:0/2420221262 shutdown_connections 2024-09-10T07:40:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.303+0000 7efdc4800640 1 --2- 172.21.15.99:0/2420221262 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 0x7efdbc160540 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.303+0000 7efdc4800640 1 --2- 172.21.15.99:0/2420221262 >> v2:172.21.15.187:3300/0 conn(0x7efdbc13fae0 0x7efdbc06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.303+0000 7efdc4800640 1 -- 172.21.15.99:0/2420221262 >> 172.21.15.99:0/2420221262 conn(0x7efdbc06bc10 msgr2=0x7efdbc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.303+0000 7efdc4800640 1 -- 172.21.15.99:0/2420221262 shutdown_connections 2024-09-10T07:40:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.303+0000 7efdc4800640 1 -- 172.21.15.99:0/2420221262 wait complete. 2024-09-10T07:40:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.304+0000 7efdc4800640 1 Processor -- start 2024-09-10T07:40:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.304+0000 7efdc4800640 1 -- start start 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.305+0000 7efdc4800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efdbc13fae0 0x7efdbc13f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.305+0000 7efdc4800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 0x7efdbc144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.305+0000 7efdc4800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc160a80 0x7efdbc15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.305+0000 7efdc4800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc06f870 con 0x7efdbc160a80 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.305+0000 7efdc4800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc06f6f0 con 0x7efdbc13fae0 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.305+0000 7efdc4800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7efdbc0cfc20 con 0x7efdbc142150 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc160a80 0x7efdbc15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc160a80 0x7efdbc15cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53586/0 (socket says 172.21.15.99:53586) 2024-09-10T07:40:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc2800640 1 -- 172.21.15.99:0/2555428161 learned_addr learned my addr 172.21.15.99:0/2555428161 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc1400640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 0x7efdbc144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc1e00640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efdbc13fae0 0x7efdbc13f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc2800640 1 -- 172.21.15.99:0/2555428161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 msgr2=0x7efdbc144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc2800640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 0x7efdbc144020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc2800640 1 -- 172.21.15.99:0/2555428161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efdbc13fae0 msgr2=0x7efdbc13f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc2800640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efdbc13fae0 0x7efdbc13f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc2800640 1 -- 172.21.15.99:0/2555428161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc13f620 con 0x7efdbc160a80 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.306+0000 7efdc2800640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc160a80 0x7efdbc15cf50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7efdb800cc30 tx=0x7efdb800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.307+0000 7efdb6000640 1 -- 172.21.15.99:0/2555428161 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8017070 con 0x7efdbc160a80 2024-09-10T07:40:40.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.307+0000 7efdb6000640 1 -- 172.21.15.99:0/2555428161 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb800ce40 con 0x7efdbc160a80 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.307+0000 7efdb6000640 1 -- 172.21.15.99:0/2555428161 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8012600 con 0x7efdbc160a80 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.307+0000 7efdc4800640 1 -- 172.21.15.99:0/2555428161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdbc144f10 con 0x7efdbc160a80 2024-09-10T07:40:40.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.307+0000 7efdc4800640 1 -- 172.21.15.99:0/2555428161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdbc1454d0 con 0x7efdbc160a80 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.308+0000 7efdc4800640 1 -- 172.21.15.99:0/2555428161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdbc06f1b0 con 0x7efdbc160a80 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.309+0000 7efdb6000640 1 -- 172.21.15.99:0/2555428161 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdb801a070 con 0x7efdbc160a80 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.310+0000 7efdb6000640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efda006be30 0x7efda006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.310+0000 7efdb6000640 1 -- 172.21.15.99:0/2555428161 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7efdb808ac30 con 0x7efdbc160a80 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.310+0000 7efdb6000640 1 -- 172.21.15.99:0/2555428161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=142}) -- 0x7efda0073960 con 0x7efdbc160a80 2024-09-10T07:40:40.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.310+0000 7efdc1e00640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efda006be30 0x7efda006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:40.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.311+0000 7efdc1e00640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efda006be30 0x7efda006e2f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009a10 tx=0x7efdb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:40.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.314+0000 7efdb6000640 1 -- 172.21.15.99:0/2555428161 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdb8058f80 con 0x7efdbc160a80 2024-09-10T07:40:40.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.522+0000 7efdc4800640 1 -- 172.21.15.99:0/2555428161 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdbc15fa20 con 0x7efdbc160a80 2024-09-10T07:40:40.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.523+0000 7efdb6000640 1 -- 172.21.15.99:0/2555428161 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7efdb805d280 con 0x7efdbc160a80 2024-09-10T07:40:40.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:40.523 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":66,"btime":"2024-09-10T07:40:25:708900+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/4097316027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4097316027},{"type":"v1","addr":"172.21.15.187:6834","nonce":4097316027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2128941619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2128941619},{"type":"v1","addr":"172.21.15.187:6835","nonce":2128941619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/722129971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":722129971},{"type":"v1","addr":"172.21.15.99:6835","nonce":722129971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:40:22.087139+0000","modified":"2024-09-10T07:40:25.118483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1531136464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1531136464},{"type":"v1","addr":"172.21.15.99:6837","nonce":1531136464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6795,"qdb_cluster":[6795]},"id":8}]} 2024-09-10T07:40:40.523 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 66 2024-09-10T07:40:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 -- 172.21.15.99:0/2555428161 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efda006be30 msgr2=0x7efda006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efda006be30 0x7efda006e2f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009a10 tx=0x7efdb0008040 comp rx=0 tx=0).stop 2024-09-10T07:40:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 -- 172.21.15.99:0/2555428161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc160a80 msgr2=0x7efdbc15cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc160a80 0x7efdbc15cf50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7efdb800cc30 tx=0x7efdb800a430 comp rx=0 tx=0).stop 2024-09-10T07:40:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 -- 172.21.15.99:0/2555428161 shutdown_connections 2024-09-10T07:40:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7efda006be30 0x7efda006e2f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc160a80 0x7efdbc15cf50 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efdbc142150 0x7efdbc144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 --2- 172.21.15.99:0/2555428161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efdbc13fae0 0x7efdbc13f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 -- 172.21.15.99:0/2555428161 >> 172.21.15.99:0/2555428161 conn(0x7efdbc06bc10 msgr2=0x7efdbc0cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 -- 172.21.15.99:0/2555428161 shutdown_connections 2024-09-10T07:40:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:40.525+0000 7efdc4800640 1 -- 172.21.15.99:0/2555428161 wait complete. 2024-09-10T07:40:40.541 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:40:40.716 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":6795,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.031865323000002,"mdsmap_epoch":66,"osdmap_epoch":141,"osdmap_epoch_barrier":141,"uptime":22.755093562999999} 2024-09-10T07:40:40.717 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 6795, "mdsmap_epoch": 66, "osdmap_epoch": 141, "osdmap_epoch_barrier": 141, "rank_uptime": 18.031865323, "state": "up:active", "uptime": 22.755093563, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:40:40.717 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T07:40:40.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:40.717 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-10T07:40:40.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:40.756 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-10T07:40:40.837 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:40:41.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.032+0000 7f2867e00640 1 Processor -- start 2024-09-10T07:40:41.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.033+0000 7f2867e00640 1 -- start start 2024-09-10T07:40:41.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.034+0000 7f2867e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2860142150 0x7f2860160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:41.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.034+0000 7f2867e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2860160a80 0x7f28600cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:41.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.034+0000 7f2867e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2860142650 con 0x7f286013fae0 2024-09-10T07:40:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.034+0000 7f2867e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f28600ce780 con 0x7f2860160a80 2024-09-10T07:40:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.034+0000 7f2867e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f2860142930 con 0x7f2860142150 2024-09-10T07:40:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.034+0000 7f2865e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2860160a80 0x7f28600cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.034+0000 7f2865e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2860160a80 0x7f28600cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53592/0 (socket says 172.21.15.99:53592) 2024-09-10T07:40:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.034+0000 7f2865e00640 1 -- 172.21.15.99:0/3585822968 learned_addr learned my addr 172.21.15.99:0/3585822968 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.034+0000 7f2864a00640 1 --2- 172.21.15.99:0/3585822968 >> v2:172.21.15.187:3300/0 conn(0x7f2860142150 0x7f2860160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.035+0000 7f2865e00640 1 -- 172.21.15.99:0/3585822968 >> v2:172.21.15.187:3300/0 conn(0x7f2860142150 msgr2=0x7f2860160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.035+0000 7f2865e00640 1 --2- 172.21.15.99:0/3585822968 >> v2:172.21.15.187:3300/0 conn(0x7f2860142150 0x7f2860160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.035+0000 7f2865e00640 1 -- 172.21.15.99:0/3585822968 >> v1:172.21.15.187:6789/0 conn(0x7f286013fae0 legacy=0x7f286006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.035+0000 7f2865e00640 1 -- 172.21.15.99:0/3585822968 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2860142c10 con 0x7f2860160a80 2024-09-10T07:40:41.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.035+0000 7f2865e00640 1 --2- 172.21.15.99:0/3585822968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2860160a80 0x7f28600cec10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2860075560 tx=0x7f285802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234dd0cf0658f059 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.036+0000 7f285fe00640 1 -- 172.21.15.99:0/3585822968 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858037070 con 0x7f2860160a80 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.036+0000 7f285fe00640 1 -- 172.21.15.99:0/3585822968 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2858032440 con 0x7f2860160a80 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.036+0000 7f285fe00640 1 -- 172.21.15.99:0/3585822968 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858032810 con 0x7f2860160a80 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.036+0000 7f2867e00640 1 -- 172.21.15.99:0/3585822968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2860160a80 msgr2=0x7f28600cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.036+0000 7f2867e00640 1 --2- 172.21.15.99:0/3585822968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2860160a80 0x7f28600cec10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2860075560 tx=0x7f285802a1a0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.036+0000 7f2867e00640 1 -- 172.21.15.99:0/3585822968 shutdown_connections 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.036+0000 7f2867e00640 1 --2- 172.21.15.99:0/3585822968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2860160a80 0x7f28600cec10 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.036+0000 7f2867e00640 1 --2- 172.21.15.99:0/3585822968 >> v2:172.21.15.187:3300/0 conn(0x7f2860142150 0x7f2860160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.036+0000 7f2867e00640 1 -- 172.21.15.99:0/3585822968 >> 172.21.15.99:0/3585822968 conn(0x7f286006bc10 msgr2=0x7f286006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.037+0000 7f2867e00640 1 -- 172.21.15.99:0/3585822968 shutdown_connections 2024-09-10T07:40:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.037+0000 7f2867e00640 1 -- 172.21.15.99:0/3585822968 wait complete. 2024-09-10T07:40:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.038+0000 7f2867e00640 1 Processor -- start 2024-09-10T07:40:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.038+0000 7f2867e00640 1 -- start start 2024-09-10T07:40:41.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.039+0000 7f2867e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f286013fae0 0x7f28601f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:41.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.039+0000 7f2867e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2860142150 0x7f28601596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:41.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.039+0000 7f2867e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2860160a80 0x7f286015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:41.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.039+0000 7f2867e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f28600cf2d0 con 0x7f286013fae0 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.039+0000 7f2867e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f28600cf150 con 0x7f2860160a80 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.039+0000 7f2867e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f28600cf450 con 0x7f2860142150 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.039+0000 7f2865400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f286013fae0 0x7f28601f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.039+0000 7f2865400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f286013fae0 0x7f28601f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53594/0 (socket says 172.21.15.99:53594) 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.040+0000 7f2865400640 1 -- 172.21.15.99:0/1199970229 learned_addr learned my addr 172.21.15.99:0/1199970229 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.040+0000 7f2865e00640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2860160a80 0x7f286015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.040+0000 7f2864a00640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2860142150 0x7f28601596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.040+0000 7f2865400640 1 -- 172.21.15.99:0/1199970229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2860142150 msgr2=0x7f28601596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.040+0000 7f2865400640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2860142150 0x7f28601596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.040+0000 7f2865400640 1 -- 172.21.15.99:0/1199970229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2860160a80 msgr2=0x7f286015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.040+0000 7f2865400640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2860160a80 0x7f286015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.040+0000 7f2865400640 1 -- 172.21.15.99:0/1199970229 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28601f3360 con 0x7f286013fae0 2024-09-10T07:40:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.040+0000 7f2865400640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f286013fae0 0x7f28601f2a00 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f285400c7f0 tx=0x7f285400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.040+0000 7f285d600640 1 -- 172.21.15.99:0/1199970229 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854016020 con 0x7f286013fae0 2024-09-10T07:40:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.041+0000 7f285d600640 1 -- 172.21.15.99:0/1199970229 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285400aa50 con 0x7f286013fae0 2024-09-10T07:40:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.041+0000 7f2867e00640 1 -- 172.21.15.99:0/1199970229 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28601f3640 con 0x7f286013fae0 2024-09-10T07:40:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.041+0000 7f285d600640 1 -- 172.21.15.99:0/1199970229 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285400ae40 con 0x7f286013fae0 2024-09-10T07:40:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.041+0000 7f2867e00640 1 -- 172.21.15.99:0/1199970229 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2860157620 con 0x7f286013fae0 2024-09-10T07:40:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.042+0000 7f2867e00640 1 -- 172.21.15.99:0/1199970229 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2860160540 con 0x7f286013fae0 2024-09-10T07:40:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.043+0000 7f285d600640 1 -- 172.21.15.99:0/1199970229 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2854019020 con 0x7f286013fae0 2024-09-10T07:40:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.043+0000 7f285d600640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f284006be30 0x7f284006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.043+0000 7f285d600640 1 -- 172.21.15.99:0/1199970229 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f285408ab30 con 0x7f286013fae0 2024-09-10T07:40:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.044+0000 7f2864a00640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f284006be30 0x7f284006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.044+0000 7f285d600640 1 -- 172.21.15.99:0/1199970229 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=142}) -- 0x7f2840073960 con 0x7f286013fae0 2024-09-10T07:40:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.044+0000 7f2864a00640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f284006be30 0x7f284006e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f28600ccc80 tx=0x7f284c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.047+0000 7f285d600640 1 -- 172.21.15.99:0/1199970229 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2854020070 con 0x7f286013fae0 2024-09-10T07:40:41.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.222+0000 7f2867e00640 1 -- 172.21.15.99:0/1199970229 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f28600b05a0 con 0x7f286013fae0 2024-09-10T07:40:41.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.224+0000 7f285d600640 1 -- 172.21.15.99:0/1199970229 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) ==== 81+0+34221 (secure 0 0 0) 0x7f2854058df0 con 0x7f286013fae0 2024-09-10T07:40:41.224 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:41.224 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:40:41.224 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 141, 2024-09-10T07:40:41.224 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:40:41.224 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:40:41.224 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:40:36.753263+0000", 2024-09-10T07:40:41.224 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:40:41.224 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:40:41.224 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:40:41.225 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 17, 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:41.226 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:41.227 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:41.228 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:41.229 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:41.230 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:41.231 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:40:41.232 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 16, 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:19.848847+0000", 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:41.233 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:40:41.234 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "138", 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:41.235 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:41.236 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:41.237 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.238 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:41.239 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 17, 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:21.080608+0000", 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1027, 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:41.240 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:41.241 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "141", 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:41.242 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:41.243 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:41.244 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:40:41.245 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.246 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:41.247 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.248 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:41.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:41.252 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:40:41.253 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:40:41.254 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.256 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:40:41.257 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:41.258 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.261 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.262 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:41.264 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:40:41.268 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:41.269 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:41.270 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.271 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.272 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.273 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.274 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.278 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:40:41.279 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:41.280 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.281 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.282 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.283 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.284 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:41.285 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:41.286 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:41.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.288 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.289 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:41.290 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:41.293 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:41.295 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:40:41.296 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:40:41.297 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:41.299 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 -- 172.21.15.99:0/1199970229 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f284006be30 msgr2=0x7f284006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f284006be30 0x7f284006e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f28600ccc80 tx=0x7f284c008040 comp rx=0 tx=0).stop 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 -- 172.21.15.99:0/1199970229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f286013fae0 msgr2=0x7f28601f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f286013fae0 0x7f28601f2a00 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f285400c7f0 tx=0x7f285400ccb0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 -- 172.21.15.99:0/1199970229 shutdown_connections 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2860160a80 0x7f286015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2860142150 0x7f28601596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f284006be30 0x7f284006e2f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 --2- 172.21.15.99:0/1199970229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f286013fae0 0x7f28601f2a00 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 -- 172.21.15.99:0/1199970229 >> 172.21.15.99:0/1199970229 conn(0x7f286006bc10 msgr2=0x7f28600b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 -- 172.21.15.99:0/1199970229 shutdown_connections 2024-09-10T07:40:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:41.226+0000 7f2867e00640 1 -- 172.21.15.99:0/1199970229 wait complete. 2024-09-10T07:40:41.302 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:40:46.303 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:40:46.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.467+0000 7fe773200640 1 Processor -- start 2024-09-10T07:40:46.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.468+0000 7fe773200640 1 -- start start 2024-09-10T07:40:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.469+0000 7fe773200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 0x7fe76c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.469+0000 7fe773200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe76c142650 con 0x7fe76c160a80 2024-09-10T07:40:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.469+0000 7fe773200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe76c142930 con 0x7fe76c13fae0 2024-09-10T07:40:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.469+0000 7fe773200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe76c0ce780 con 0x7fe76c142150 2024-09-10T07:40:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.469+0000 7fe771200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe76c160a80 0x7fe76c0cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47572/0 (socket says 172.21.15.99:47572) 2024-09-10T07:40:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.469+0000 7fe771200640 1 -- 172.21.15.99:0/2044237314 learned_addr learned my addr 172.21.15.99:0/2044237314 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.469+0000 7fe763400640 1 --2- 172.21.15.99:0/2044237314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 0x7fe76c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.470+0000 7fe76b400640 1 -- 172.21.15.99:0/2044237314 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1630627338 0 0) 0x7fe76c142650 con 0x7fe76c160a80 2024-09-10T07:40:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.470+0000 7fe76b400640 1 -- 172.21.15.99:0/2044237314 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe750003520 con 0x7fe76c160a80 2024-09-10T07:40:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.470+0000 7fe76b400640 1 -- 172.21.15.99:0/2044237314 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107604657 0 0) 0x7fe76c142930 con 0x7fe76c13fae0 2024-09-10T07:40:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.470+0000 7fe76b400640 1 -- 172.21.15.99:0/2044237314 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe76c142650 con 0x7fe76c13fae0 2024-09-10T07:40:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.470+0000 7fe763400640 1 -- 172.21.15.99:0/2044237314 >> v1:172.21.15.187:6789/0 conn(0x7fe76c13fae0 legacy=0x7fe76c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.470+0000 7fe763400640 1 -- 172.21.15.99:0/2044237314 >> v1:172.21.15.99:6789/0 conn(0x7fe76c160a80 legacy=0x7fe76c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:46.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.470+0000 7fe76b400640 1 -- 172.21.15.99:0/2044237314 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 66762738 0 0) 0x7fe750003520 con 0x7fe76c160a80 2024-09-10T07:40:46.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.470+0000 7fe763400640 1 -- 172.21.15.99:0/2044237314 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76c142c10 con 0x7fe76c142150 2024-09-10T07:40:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.471+0000 7fe763400640 1 --2- 172.21.15.99:0/2044237314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 0x7fe76c160540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe7540097d0 tx=0x7fe75402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c72c3b873545baa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.471+0000 7fe76b400640 1 -- 172.21.15.99:0/2044237314 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754037070 con 0x7fe76c142150 2024-09-10T07:40:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.471+0000 7fe76b400640 1 -- 172.21.15.99:0/2044237314 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75402ab90 con 0x7fe76c142150 2024-09-10T07:40:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.471+0000 7fe76b400640 1 -- 172.21.15.99:0/2044237314 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7640019f0 con 0x7fe76c142150 2024-09-10T07:40:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.472+0000 7fe773200640 1 -- 172.21.15.99:0/2044237314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 msgr2=0x7fe76c160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.472+0000 7fe773200640 1 --2- 172.21.15.99:0/2044237314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 0x7fe76c160540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe7540097d0 tx=0x7fe75402a100 comp rx=0 tx=0).stop 2024-09-10T07:40:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.472+0000 7fe773200640 1 -- 172.21.15.99:0/2044237314 shutdown_connections 2024-09-10T07:40:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.472+0000 7fe773200640 1 --2- 172.21.15.99:0/2044237314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 0x7fe76c160540 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.472+0000 7fe773200640 1 -- 172.21.15.99:0/2044237314 >> 172.21.15.99:0/2044237314 conn(0x7fe76c06bc10 msgr2=0x7fe76c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.472+0000 7fe773200640 1 -- 172.21.15.99:0/2044237314 shutdown_connections 2024-09-10T07:40:46.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.472+0000 7fe773200640 1 -- 172.21.15.99:0/2044237314 wait complete. 2024-09-10T07:40:46.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.474+0000 7fe773200640 1 Processor -- start 2024-09-10T07:40:46.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.474+0000 7fe773200640 1 -- start start 2024-09-10T07:40:46.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.474+0000 7fe773200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe76c13fae0 0x7fe76c13ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:46.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe773200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 0x7fe76c0b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:46.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe773200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c160a80 0x7fe76c13d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:46.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe773200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c0cf4a0 con 0x7fe76c13fae0 2024-09-10T07:40:46.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe773200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c0cf320 con 0x7fe76c160a80 2024-09-10T07:40:46.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe773200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe76c0cf620 con 0x7fe76c142150 2024-09-10T07:40:46.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe76be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe76c13fae0 0x7fe76c13ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe76be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe76c13fae0 0x7fe76c13ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53610/0 (socket says 172.21.15.99:53610) 2024-09-10T07:40:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe76be00640 1 -- 172.21.15.99:0/865746345 learned_addr learned my addr 172.21.15.99:0/865746345 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe763400640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 0x7fe76c0b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe771200640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c160a80 0x7fe76c13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe76be00640 1 -- 172.21.15.99:0/865746345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 msgr2=0x7fe76c0b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe76be00640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 0x7fe76c0b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe76be00640 1 -- 172.21.15.99:0/865746345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c160a80 msgr2=0x7fe76c13d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe76be00640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c160a80 0x7fe76c13d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.475+0000 7fe76be00640 1 -- 172.21.15.99:0/865746345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76c0b50b0 con 0x7fe76c13fae0 2024-09-10T07:40:46.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.476+0000 7fe76be00640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe76c13fae0 0x7fe76c13ec00 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c490 tx=0x7fe75c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:46.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.476+0000 7fe768c00640 1 -- 172.21.15.99:0/865746345 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0052d0 con 0x7fe76c13fae0 2024-09-10T07:40:46.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.476+0000 7fe773200640 1 -- 172.21.15.99:0/865746345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76c0b3ad0 con 0x7fe76c13fae0 2024-09-10T07:40:46.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.476+0000 7fe768c00640 1 -- 172.21.15.99:0/865746345 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75c005470 con 0x7fe76c13fae0 2024-09-10T07:40:46.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.476+0000 7fe768c00640 1 -- 172.21.15.99:0/865746345 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c012850 con 0x7fe76c13fae0 2024-09-10T07:40:46.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.476+0000 7fe773200640 1 -- 172.21.15.99:0/865746345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe76c0b4090 con 0x7fe76c13fae0 2024-09-10T07:40:46.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.477+0000 7fe773200640 1 -- 172.21.15.99:0/865746345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76c160540 con 0x7fe76c13fae0 2024-09-10T07:40:46.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.478+0000 7fe768c00640 1 -- 172.21.15.99:0/865746345 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe75c0129f0 con 0x7fe76c13fae0 2024-09-10T07:40:46.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.479+0000 7fe768c00640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe74806be30 0x7fe74806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:46.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.479+0000 7fe768c00640 1 -- 172.21.15.99:0/865746345 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7fe75c08abe0 con 0x7fe76c13fae0 2024-09-10T07:40:46.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.479+0000 7fe763400640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe74806be30 0x7fe74806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:46.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.479+0000 7fe768c00640 1 -- 172.21.15.99:0/865746345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=142}) -- 0x7fe748073960 con 0x7fe76c13fae0 2024-09-10T07:40:46.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.480+0000 7fe763400640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe74806be30 0x7fe74806e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe754034000 tx=0x7fe75402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:46.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.483+0000 7fe768c00640 1 -- 172.21.15.99:0/865746345 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe76c0b50b0 con 0x7fe76c13fae0 2024-09-10T07:40:46.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.656+0000 7fe773200640 1 -- 172.21.15.99:0/865746345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fe76c0b17c0 con 0x7fe76c13fae0 2024-09-10T07:40:46.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.657+0000 7fe768c00640 1 -- 172.21.15.99:0/865746345 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) ==== 81+0+34221 (secure 0 0 0) 0x7fe75c059500 con 0x7fe76c13fae0 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 141, 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:40:36.753263+0000", 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:40:46.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 17, 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:40:46.658 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:46.659 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:40:46.660 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:46.661 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:46.662 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:46.663 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:40:46.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 16, 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:19.848847+0000", 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:46.667 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "138", 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:46.668 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:46.669 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:46.670 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:46.671 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 17, 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:40:46.672 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:21.080608+0000", 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1027, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:46.673 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:46.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "141", 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:46.675 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:46.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:46.677 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:46.678 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:46.679 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:40:46.680 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.682 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:40:46.684 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:46.685 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.686 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.687 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:46.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:46.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:46.690 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:46.691 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.692 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:46.693 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.694 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:40:46.695 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:46.696 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:40:46.697 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:46.701 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:46.702 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.703 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.704 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.705 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:40:46.706 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:46.707 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.711 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:46.712 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:46.713 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.715 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.717 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:46.718 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:46.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:46.723 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.724 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:46.725 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:46.727 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:46.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:46.729 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:46.731 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:40:46.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.659+0000 7fe773200640 1 -- 172.21.15.99:0/865746345 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe74806be30 msgr2=0x7fe74806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:46.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.659+0000 7fe773200640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe74806be30 0x7fe74806e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe754034000 tx=0x7fe75402e000 comp rx=0 tx=0).stop 2024-09-10T07:40:46.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.659+0000 7fe773200640 1 -- 172.21.15.99:0/865746345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe76c13fae0 msgr2=0x7fe76c13ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:46.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.659+0000 7fe773200640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe76c13fae0 0x7fe76c13ec00 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c490 tx=0x7fe75c00c950 comp rx=0 tx=0).stop 2024-09-10T07:40:46.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.659+0000 7fe773200640 1 -- 172.21.15.99:0/865746345 shutdown_connections 2024-09-10T07:40:46.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.659+0000 7fe773200640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c160a80 0x7fe76c13d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.659+0000 7fe773200640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe76c142150 0x7fe76c0b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.659+0000 7fe773200640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe74806be30 0x7fe74806e2f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.659+0000 7fe773200640 1 --2- 172.21.15.99:0/865746345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe76c13fae0 0x7fe76c13ec00 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:46.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.659+0000 7fe773200640 1 -- 172.21.15.99:0/865746345 >> 172.21.15.99:0/865746345 conn(0x7fe76c06bc10 msgr2=0x7fe76c06f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:46.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.660+0000 7fe773200640 1 -- 172.21.15.99:0/865746345 shutdown_connections 2024-09-10T07:40:46.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:46.660+0000 7fe773200640 1 -- 172.21.15.99:0/865746345 wait complete. 2024-09-10T07:40:46.735 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:40:47.390 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:40:47.395 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:40:51.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:40:51.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.904+0000 7f30e3000640 1 Processor -- start 2024-09-10T07:40:51.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.904+0000 7f30e3000640 1 -- start start 2024-09-10T07:40:51.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30e3000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f30dc0ce780 0x7f30dc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:51.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30e3000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30dc06e3d0 con 0x7f30dc145290 2024-09-10T07:40:51.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30e3000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30dc06e6b0 con 0x7f30dc072f40 2024-09-10T07:40:51.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30e3000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f30dc06efe0 con 0x7f30dc0ce780 2024-09-10T07:40:51.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30dbe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f30dc145290 0x7f30dc072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52652/0 (socket says 172.21.15.99:52652) 2024-09-10T07:40:51.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30dbe00640 1 -- 172.21.15.99:0/2355771295 learned_addr learned my addr 172.21.15.99:0/2355771295 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:51.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30e1000640 1 --2- 172.21.15.99:0/2355771295 >> v2:172.21.15.99:3300/0 conn(0x7f30dc0ce780 0x7f30dc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:51.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30db400640 1 -- 172.21.15.99:0/2355771295 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2364991062 0 0) 0x7f30dc06e3d0 con 0x7f30dc145290 2024-09-10T07:40:51.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30db400640 1 -- 172.21.15.99:0/2355771295 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30c0005730 con 0x7f30dc145290 2024-09-10T07:40:51.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30e1000640 1 -- 172.21.15.99:0/2355771295 >> v1:172.21.15.187:6789/0 conn(0x7f30dc072f40 legacy=0x7f30dc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:51.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.906+0000 7f30db400640 1 -- 172.21.15.99:0/2355771295 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3232372499 0 0) 0x7f30dc06e6b0 con 0x7f30dc072f40 2024-09-10T07:40:51.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.907+0000 7f30e1000640 1 -- 172.21.15.99:0/2355771295 >> v1:172.21.15.99:6789/0 conn(0x7f30dc145290 legacy=0x7f30dc072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:51.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.907+0000 7f30e1000640 1 -- 172.21.15.99:0/2355771295 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc06e990 con 0x7f30dc0ce780 2024-09-10T07:40:51.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.908+0000 7f30e1000640 1 --2- 172.21.15.99:0/2355771295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc0ce780 0x7f30dc06f470 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009d90 tx=0x7f30d402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a096db599de9771 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:51.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.908+0000 7f30db400640 1 -- 172.21.15.99:0/2355771295 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d4007740 con 0x7f30dc0ce780 2024-09-10T07:40:51.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.908+0000 7f30db400640 1 -- 172.21.15.99:0/2355771295 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d40078e0 con 0x7f30dc0ce780 2024-09-10T07:40:51.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.908+0000 7f30db400640 1 -- 172.21.15.99:0/2355771295 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d4007cb0 con 0x7f30dc0ce780 2024-09-10T07:40:51.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.908+0000 7f30e3000640 1 -- 172.21.15.99:0/2355771295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc0ce780 msgr2=0x7f30dc06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:51.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.908+0000 7f30e3000640 1 --2- 172.21.15.99:0/2355771295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc0ce780 0x7f30dc06f470 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009d90 tx=0x7f30d402a6f0 comp rx=0 tx=0).stop 2024-09-10T07:40:51.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.909+0000 7f30e3000640 1 -- 172.21.15.99:0/2355771295 shutdown_connections 2024-09-10T07:40:51.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.909+0000 7f30e3000640 1 --2- 172.21.15.99:0/2355771295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc0ce780 0x7f30dc06f470 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:51.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.909+0000 7f30e3000640 1 -- 172.21.15.99:0/2355771295 >> 172.21.15.99:0/2355771295 conn(0x7f30dc06bc10 msgr2=0x7f30dc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:51.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.909+0000 7f30e3000640 1 -- 172.21.15.99:0/2355771295 shutdown_connections 2024-09-10T07:40:51.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.909+0000 7f30e3000640 1 -- 172.21.15.99:0/2355771295 wait complete. 2024-09-10T07:40:51.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.910+0000 7f30e3000640 1 Processor -- start 2024-09-10T07:40:51.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.910+0000 7f30e3000640 1 -- start start 2024-09-10T07:40:51.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.911+0000 7f30e3000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc072f40 0x7f30dc142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:51.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.911+0000 7f30e3000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30dc0ce780 0x7f30dc0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:51.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.911+0000 7f30e3000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30dc145290 0x7f30dc0c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:51.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.911+0000 7f30e3000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc06df80 con 0x7f30dc072f40 2024-09-10T07:40:51.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.911+0000 7f30e3000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc145670 con 0x7f30dc0ce780 2024-09-10T07:40:51.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.911+0000 7f30e3000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f30dc06e100 con 0x7f30dc145290 2024-09-10T07:40:51.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.911+0000 7f30dbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc072f40 0x7f30dc142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:51.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.911+0000 7f30dbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc072f40 0x7f30dc142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55108/0 (socket says 172.21.15.99:55108) 2024-09-10T07:40:51.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30dbe00640 1 -- 172.21.15.99:0/138785698 learned_addr learned my addr 172.21.15.99:0/138785698 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:51.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30d3400640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30dc0ce780 0x7f30dc0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:51.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30e1000640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30dc145290 0x7f30dc0c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:51.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30dbe00640 1 -- 172.21.15.99:0/138785698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30dc145290 msgr2=0x7f30dc0c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:51.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30dbe00640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30dc145290 0x7f30dc0c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:51.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30dbe00640 1 -- 172.21.15.99:0/138785698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30dc0ce780 msgr2=0x7f30dc0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:51.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30dbe00640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30dc0ce780 0x7f30dc0c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:51.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30dbe00640 1 -- 172.21.15.99:0/138785698 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc142ac0 con 0x7f30dc072f40 2024-09-10T07:40:51.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30dbe00640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc072f40 0x7f30dc142490 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00c430 tx=0x7f30cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:51.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30d8c00640 1 -- 172.21.15.99:0/138785698 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc017070 con 0x7f30dc072f40 2024-09-10T07:40:51.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30d8c00640 1 -- 172.21.15.99:0/138785698 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30cc005ce0 con 0x7f30dc072f40 2024-09-10T07:40:51.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.912+0000 7f30d8c00640 1 -- 172.21.15.99:0/138785698 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0072f0 con 0x7f30dc072f40 2024-09-10T07:40:51.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.913+0000 7f30e3000640 1 -- 172.21.15.99:0/138785698 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc142da0 con 0x7f30dc072f40 2024-09-10T07:40:51.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.913+0000 7f30e3000640 1 -- 172.21.15.99:0/138785698 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc143360 con 0x7f30dc072f40 2024-09-10T07:40:51.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.914+0000 7f30e3000640 1 -- 172.21.15.99:0/138785698 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30dc0715a0 con 0x7f30dc072f40 2024-09-10T07:40:51.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.914+0000 7f30d8c00640 1 -- 172.21.15.99:0/138785698 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30cc01a070 con 0x7f30dc072f40 2024-09-10T07:40:51.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.915+0000 7f30d8c00640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f30b806be30 0x7f30b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:51.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.915+0000 7f30d8c00640 1 -- 172.21.15.99:0/138785698 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f30cc08a400 con 0x7f30dc072f40 2024-09-10T07:40:51.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.916+0000 7f30d3400640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f30b806be30 0x7f30b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:51.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.916+0000 7f30d3400640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f30b806be30 0x7f30b806e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f30c4007fd0 tx=0x7f30c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:51.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:51.920+0000 7f30d8c00640 1 -- 172.21.15.99:0/138785698 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30cc058d10 con 0x7f30dc072f40 2024-09-10T07:40:52.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.094+0000 7f30e3000640 1 -- 172.21.15.99:0/138785698 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f30dc15c8e0 con 0x7f30dc072f40 2024-09-10T07:40:52.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.096+0000 7f30d8c00640 1 -- 172.21.15.99:0/138785698 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v142) ==== 81+0+34202 (secure 0 0 0) 0x7f30cc058610 con 0x7f30dc072f40 2024-09-10T07:40:52.096 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:52.096 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:40:52.096 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 142, 2024-09-10T07:40:52.096 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:40:52.096 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:40:51.756409+0000", 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:40:52.097 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 17, 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:40:52.098 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:40:52.099 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:52.100 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:52.101 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:52.102 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:52.103 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 16, 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:19.848847+0000", 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:52.105 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:52.106 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "138", 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:52.107 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:52.108 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:52.109 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:52.110 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 17, 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:21.080608+0000", 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:52.111 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:40:52.112 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "142", 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:52.113 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:52.114 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:52.115 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:40:52.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.122 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.123 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:40:52.124 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:40:52.125 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:40:52.126 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:40:52.127 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.128 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.129 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.130 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.131 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.132 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.133 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.134 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.135 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.137 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.138 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:40:52.139 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.140 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:40:52.141 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:40:52.142 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:40:52.143 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:40:52.144 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.145 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.146 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.148 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:40:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.151 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.156 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.157 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.158 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.159 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.160 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:40:52.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.163 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.165 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.166 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.167 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.168 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:40:52.169 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:40:52.170 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:40:52.171 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.171 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:40:52.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 -- 172.21.15.99:0/138785698 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f30b806be30 msgr2=0x7f30b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f30b806be30 0x7f30b806e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f30c4007fd0 tx=0x7f30c4009040 comp rx=0 tx=0).stop 2024-09-10T07:40:52.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 -- 172.21.15.99:0/138785698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc072f40 msgr2=0x7f30dc142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc072f40 0x7f30dc142490 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00c430 tx=0x7f30cc00c8f0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 -- 172.21.15.99:0/138785698 shutdown_connections 2024-09-10T07:40:52.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30dc145290 0x7f30dc0c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30dc0ce780 0x7f30dc0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f30b806be30 0x7f30b806e2f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 --2- 172.21.15.99:0/138785698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc072f40 0x7f30dc142490 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 -- 172.21.15.99:0/138785698 >> 172.21.15.99:0/138785698 conn(0x7f30dc06bc10 msgr2=0x7f30dc0cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:52.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 -- 172.21.15.99:0/138785698 shutdown_connections 2024-09-10T07:40:52.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.098+0000 7f30e3000640 1 -- 172.21.15.99:0/138785698 wait complete. 2024-09-10T07:40:52.174 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-10T07:40:52.174 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:40:52.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.327+0000 7f72b0a00640 1 Processor -- start 2024-09-10T07:40:52.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.327+0000 7f72b0a00640 1 -- start start 2024-09-10T07:40:52.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.328+0000 7f72b0a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f72ac160300 0x7f72ac0cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.328+0000 7f72b0a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f72ac0708f0 0x7f72ac0cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.328+0000 7f72b0a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72ac0d0050 con 0x7f72ac0d1ed0 2024-09-10T07:40:52.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.328+0000 7f72b0a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f72ac0d0330 con 0x7f72ac0708f0 2024-09-10T07:40:52.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.328+0000 7f72b0a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f72ac0d1420 con 0x7f72ac160300 2024-09-10T07:40:52.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.329+0000 7f72a9400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f72ac0d1ed0 0x7f72ac0cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52668/0 (socket says 172.21.15.99:52668) 2024-09-10T07:40:52.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.329+0000 7f72a9400640 1 -- 172.21.15.99:0/913903839 learned_addr learned my addr 172.21.15.99:0/913903839 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:52.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.329+0000 7f72aa800640 1 --2- 172.21.15.99:0/913903839 >> v2:172.21.15.99:3300/0 conn(0x7f72ac0708f0 0x7f72ac0cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.329+0000 7f72a9e00640 1 --2- 172.21.15.99:0/913903839 >> v2:172.21.15.187:3300/0 conn(0x7f72ac160300 0x7f72ac0cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.329+0000 7f72aa800640 1 -- 172.21.15.99:0/913903839 >> v2:172.21.15.187:3300/0 conn(0x7f72ac160300 msgr2=0x7f72ac0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:52.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.329+0000 7f72aa800640 1 --2- 172.21.15.99:0/913903839 >> v2:172.21.15.187:3300/0 conn(0x7f72ac160300 0x7f72ac0cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.329+0000 7f72aa800640 1 -- 172.21.15.99:0/913903839 >> v1:172.21.15.99:6789/0 conn(0x7f72ac0d1ed0 legacy=0x7f72ac0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.329+0000 7f72aa800640 1 -- 172.21.15.99:0/913903839 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ac0d1700 con 0x7f72ac0708f0 2024-09-10T07:40:52.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.329+0000 7f72a8a00640 1 -- 172.21.15.99:0/913903839 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 368433179 0 0) 0x7f72ac0d0050 con 0x7f72ac0d1ed0 2024-09-10T07:40:52.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.330+0000 7f72aa800640 1 --2- 172.21.15.99:0/913903839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 0x7f72ac0cd730 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f72ac072570 tx=0x7f72a402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179c184b338e0232 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:52.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.330+0000 7f72a8a00640 1 -- 172.21.15.99:0/913903839 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4007740 con 0x7f72ac0708f0 2024-09-10T07:40:52.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.330+0000 7f72a8a00640 1 -- 172.21.15.99:0/913903839 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a40078e0 con 0x7f72ac0708f0 2024-09-10T07:40:52.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.330+0000 7f72a8a00640 1 -- 172.21.15.99:0/913903839 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4007cb0 con 0x7f72ac0708f0 2024-09-10T07:40:52.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.331+0000 7f72b0a00640 1 -- 172.21.15.99:0/913903839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 msgr2=0x7f72ac0cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.331+0000 7f72b0a00640 1 --2- 172.21.15.99:0/913903839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 0x7f72ac0cd730 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f72ac072570 tx=0x7f72a402a5f0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.331+0000 7f72b0a00640 1 -- 172.21.15.99:0/913903839 shutdown_connections 2024-09-10T07:40:52.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.331+0000 7f72b0a00640 1 --2- 172.21.15.99:0/913903839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 0x7f72ac0cd730 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.331+0000 7f72b0a00640 1 --2- 172.21.15.99:0/913903839 >> v2:172.21.15.187:3300/0 conn(0x7f72ac160300 0x7f72ac0cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.331+0000 7f72b0a00640 1 -- 172.21.15.99:0/913903839 >> 172.21.15.99:0/913903839 conn(0x7f72ac0b4600 msgr2=0x7f72ac0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:52.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.331+0000 7f72b0a00640 1 -- 172.21.15.99:0/913903839 shutdown_connections 2024-09-10T07:40:52.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.331+0000 7f72b0a00640 1 -- 172.21.15.99:0/913903839 wait complete. 2024-09-10T07:40:52.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.333+0000 7f72b0a00640 1 Processor -- start 2024-09-10T07:40:52.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.333+0000 7f72b0a00640 1 -- start start 2024-09-10T07:40:52.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72b0a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 0x7f72ac0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72b0a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72ac0d1ed0 0x7f72ac0c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72b0a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72ac160300 0x7f72ac14dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72b0a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac1606e0 con 0x7f72ac0708f0 2024-09-10T07:40:52.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72b0a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac0b54a0 con 0x7f72ac160300 2024-09-10T07:40:52.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72b0a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f72ac160860 con 0x7f72ac0d1ed0 2024-09-10T07:40:52.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72a9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 0x7f72ac0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72a9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 0x7f72ac0b6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55130/0 (socket says 172.21.15.99:55130) 2024-09-10T07:40:52.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72a9e00640 1 -- 172.21.15.99:0/2029041689 learned_addr learned my addr 172.21.15.99:0/2029041689 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:52.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72a9400640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72ac0d1ed0 0x7f72ac0c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72a9e00640 1 -- 172.21.15.99:0/2029041689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72ac0d1ed0 msgr2=0x7f72ac0c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72aa800640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72ac160300 0x7f72ac14dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72a9e00640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72ac0d1ed0 0x7f72ac0c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72a9e00640 1 -- 172.21.15.99:0/2029041689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72ac160300 msgr2=0x7f72ac14dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.334+0000 7f72a9e00640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72ac160300 0x7f72ac14dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.335+0000 7f72a9e00640 1 -- 172.21.15.99:0/2029041689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ac0b7c20 con 0x7f72ac0708f0 2024-09-10T07:40:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.335+0000 7f72a9400640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72ac0d1ed0 0x7f72ac0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.335+0000 7f72aa800640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72ac160300 0x7f72ac14dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.335+0000 7f72a9e00640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 0x7f72ac0b6280 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e8a0 tx=0x7f729c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.335+0000 7f72a2000640 1 -- 172.21.15.99:0/2029041689 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c017070 con 0x7f72ac0708f0 2024-09-10T07:40:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.335+0000 7f72a2000640 1 -- 172.21.15.99:0/2029041689 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f729c00c940 con 0x7f72ac0708f0 2024-09-10T07:40:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.335+0000 7f72b0a00640 1 -- 172.21.15.99:0/2029041689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ac14e7c0 con 0x7f72ac0708f0 2024-09-10T07:40:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.335+0000 7f72a2000640 1 -- 172.21.15.99:0/2029041689 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c00cd30 con 0x7f72ac0708f0 2024-09-10T07:40:52.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.335+0000 7f72b0a00640 1 -- 172.21.15.99:0/2029041689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ac0b5a80 con 0x7f72ac0708f0 2024-09-10T07:40:52.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.336+0000 7f72b0a00640 1 -- 172.21.15.99:0/2029041689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ac0cf2d0 con 0x7f72ac0708f0 2024-09-10T07:40:52.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.337+0000 7f72a2000640 1 -- 172.21.15.99:0/2029041689 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f729c01a070 con 0x7f72ac0708f0 2024-09-10T07:40:52.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.338+0000 7f72a2000640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f728c06be30 0x7f728c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.338+0000 7f72a2000640 1 -- 172.21.15.99:0/2029041689 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f729c08adc0 con 0x7f72ac0708f0 2024-09-10T07:40:52.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.338+0000 7f72a9400640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f728c06be30 0x7f728c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.339+0000 7f72a9400640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f728c06be30 0x7f728c06e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f72ac1523f0 tx=0x7f7298009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:52.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.342+0000 7f72a2000640 1 -- 172.21.15.99:0/2029041689 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f729c0596d0 con 0x7f72ac0708f0 2024-09-10T07:40:52.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.515+0000 7f72b0a00640 1 -- 172.21.15.99:0/2029041689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f72ac068740 con 0x7f72ac0708f0 2024-09-10T07:40:52.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.517+0000 7f72a2000640 1 -- 172.21.15.99:0/2029041689 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v142) ==== 81+0+34202 (secure 0 0 0) 0x7f729c058fd0 con 0x7f72ac0708f0 2024-09-10T07:40:52.517 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:52.517 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:40:52.517 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 142, 2024-09-10T07:40:52.517 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:40:51.756409+0000", 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:40:52.518 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:52.519 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:40:52.519 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:40:52.519 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:40:52.519 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:40:52.519 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:40:52.519 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 17, 2024-09-10T07:40:52.519 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:40:52.519 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:40:52.519 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:40:52.519 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:52.520 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:40:52.521 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:52.522 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:52.523 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:52.523 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:52.523 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:52.523 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:52.523 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:52.523 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:52.523 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:52.524 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:52.524 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:52.524 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:52.524 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:52.524 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:52.524 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:52.524 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:52.524 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:52.524 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:52.525 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:52.526 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:52.526 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:52.526 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:52.526 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:52.526 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:52.526 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:52.526 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:40:52.526 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:52.527 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 16, 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:19.848847+0000", 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:52.528 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:52.529 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "138", 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:52.530 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:52.531 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:52.532 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:40:52.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 17, 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:40:21.080608+0000", 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:40:52.535 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:40:52.536 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "142", 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:40:52.537 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:40:52.538 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:40:52.539 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.542 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.543 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.544 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.548 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.549 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.550 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.551 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.552 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:40:52.553 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:40:52.553 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:40:52.553 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:40:52.553 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.553 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.553 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.553 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.553 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.555 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.556 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.557 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.558 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.558 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.558 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:40:52.558 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.559 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.560 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.561 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:40:52.562 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.562 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.562 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.562 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.562 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.562 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:40:52.562 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.563 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:40:52.565 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.566 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.567 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.567 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.567 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.567 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.567 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.567 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.567 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.567 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.568 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.569 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.570 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.570 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:40:52.570 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.570 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.571 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.572 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:40:52.577 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.578 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.583 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:40:52.584 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 137, 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:40:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:40:52.588 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:40:52.589 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.590 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.592 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.593 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.593 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.593 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:40:52.593 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.593 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:40:52.593 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.594 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:40:52.596 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:40:52.597 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:40:52.598 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.519+0000 7f72b0a00640 1 -- 172.21.15.99:0/2029041689 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f728c06be30 msgr2=0x7f728c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.519+0000 7f72b0a00640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f728c06be30 0x7f728c06e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f72ac1523f0 tx=0x7f7298009040 comp rx=0 tx=0).stop 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.519+0000 7f72b0a00640 1 -- 172.21.15.99:0/2029041689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 msgr2=0x7f72ac0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.519+0000 7f72b0a00640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 0x7f72ac0b6280 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e8a0 tx=0x7f729c00ed60 comp rx=0 tx=0).stop 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.519+0000 7f72b0a00640 1 -- 172.21.15.99:0/2029041689 shutdown_connections 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.519+0000 7f72b0a00640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72ac160300 0x7f72ac14dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.519+0000 7f72b0a00640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72ac0d1ed0 0x7f72ac0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.519+0000 7f72b0a00640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f728c06be30 0x7f728c06e2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.519+0000 7f72b0a00640 1 --2- 172.21.15.99:0/2029041689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0708f0 0x7f72ac0b6280 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.519+0000 7f72b0a00640 1 -- 172.21.15.99:0/2029041689 >> 172.21.15.99:0/2029041689 conn(0x7f72ac0b4600 msgr2=0x7f72ac15e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:52.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.520+0000 7f72b0a00640 1 -- 172.21.15.99:0/2029041689 shutdown_connections 2024-09-10T07:40:52.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.520+0000 7f72b0a00640 1 -- 172.21.15.99:0/2029041689 wait complete. 2024-09-10T07:40:52.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:52.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.754+0000 7f5507200640 1 Processor -- start 2024-09-10T07:40:52.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.754+0000 7f5507200640 1 -- start start 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.755+0000 7f5507200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f550815e970 0x7f55080d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.755+0000 7f5507200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f55080d2680 0x7f55080cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.755+0000 7f5507200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55080cfac0 0x7f55080d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.755+0000 7f5507200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f55080d37e0 con 0x7f55080d2680 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.755+0000 7f5507200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f55080d2bd0 con 0x7f550815e970 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.755+0000 7f5507200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f55080d2eb0 con 0x7f55080cfac0 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.755+0000 7f5505400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f55080d2680 0x7f55080cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.755+0000 7f5505400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f55080d2680 0x7f55080cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55132/0 (socket says 172.21.15.99:55132) 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.755+0000 7f5505400640 1 -- 172.21.15.99:0/3705350578 learned_addr learned my addr 172.21.15.99:0/3705350578 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.756+0000 7f5505e00640 1 --2- 172.21.15.99:0/3705350578 >> v2:172.21.15.187:3300/0 conn(0x7f550815e970 0x7f55080d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.756+0000 7f5506800640 1 --2- 172.21.15.99:0/3705350578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55080cfac0 0x7f55080d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.756+0000 7f5505400640 1 -- 172.21.15.99:0/3705350578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55080cfac0 msgr2=0x7f55080d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.756+0000 7f5505400640 1 --2- 172.21.15.99:0/3705350578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55080cfac0 0x7f55080d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.756+0000 7f5505400640 1 -- 172.21.15.99:0/3705350578 >> v2:172.21.15.187:3300/0 conn(0x7f550815e970 msgr2=0x7f55080d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.756+0000 7f5505400640 1 --2- 172.21.15.99:0/3705350578 >> v2:172.21.15.187:3300/0 conn(0x7f550815e970 0x7f55080d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.756+0000 7f5505400640 1 -- 172.21.15.99:0/3705350578 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55080d3190 con 0x7f55080d2680 2024-09-10T07:40:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.757+0000 7f5505400640 1 --2- 172.21.15.99:0/3705350578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55080d2680 0x7f55080cf580 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f550806c1c0 tx=0x7f54f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5785e430d30c70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.757+0000 7f5504a00640 1 -- 172.21.15.99:0/3705350578 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4037070 con 0x7f55080d2680 2024-09-10T07:40:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.757+0000 7f5504a00640 1 -- 172.21.15.99:0/3705350578 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4032440 con 0x7f55080d2680 2024-09-10T07:40:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.757+0000 7f5504a00640 1 -- 172.21.15.99:0/3705350578 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4032810 con 0x7f55080d2680 2024-09-10T07:40:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.758+0000 7f5507200640 1 -- 172.21.15.99:0/3705350578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55080d2680 msgr2=0x7f55080cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.758+0000 7f5507200640 1 --2- 172.21.15.99:0/3705350578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55080d2680 0x7f55080cf580 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f550806c1c0 tx=0x7f54f402a270 comp rx=0 tx=0).stop 2024-09-10T07:40:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.758+0000 7f5507200640 1 -- 172.21.15.99:0/3705350578 shutdown_connections 2024-09-10T07:40:52.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.758+0000 7f5507200640 1 --2- 172.21.15.99:0/3705350578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55080cfac0 0x7f55080d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.758+0000 7f5507200640 1 --2- 172.21.15.99:0/3705350578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55080d2680 0x7f55080cf580 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.758+0000 7f5507200640 1 --2- 172.21.15.99:0/3705350578 >> v2:172.21.15.187:3300/0 conn(0x7f550815e970 0x7f55080d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.758+0000 7f5507200640 1 -- 172.21.15.99:0/3705350578 >> 172.21.15.99:0/3705350578 conn(0x7f550809de00 msgr2=0x7f55080d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:52.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.758+0000 7f5507200640 1 -- 172.21.15.99:0/3705350578 shutdown_connections 2024-09-10T07:40:52.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.758+0000 7f5507200640 1 -- 172.21.15.99:0/3705350578 wait complete. 2024-09-10T07:40:52.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.759+0000 7f5507200640 1 Processor -- start 2024-09-10T07:40:52.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.759+0000 7f5507200640 1 -- start start 2024-09-10T07:40:52.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.760+0000 7f5507200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55080cfac0 0x7f55081558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.760+0000 7f5507200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55080d2680 0x7f55080b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.760+0000 7f5507200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f550815e970 0x7f55080cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.760+0000 7f5507200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f55080d0840 con 0x7f550815e970 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.760+0000 7f5507200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f55080cff50 con 0x7f55080cfac0 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.760+0000 7f5507200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f550815ed50 con 0x7f55080d2680 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f5506800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f550815e970 0x7f55080cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f5506800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f550815e970 0x7f55080cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55138/0 (socket says 172.21.15.99:55138) 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f5506800640 1 -- 172.21.15.99:0/1766319364 learned_addr learned my addr 172.21.15.99:0/1766319364 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f5506800640 1 -- 172.21.15.99:0/1766319364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55080d2680 msgr2=0x7f55080b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f5506800640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55080d2680 0x7f55080b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f5506800640 1 -- 172.21.15.99:0/1766319364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55080cfac0 msgr2=0x7f55081558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f5506800640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55080cfac0 0x7f55081558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f5506800640 1 -- 172.21.15.99:0/1766319364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55080b7e20 con 0x7f550815e970 2024-09-10T07:40:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f5506800640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f550815e970 0x7f55080cc060 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f5500007e60 tx=0x7f550000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:52.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f54fe000640 1 -- 172.21.15.99:0/1766319364 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500014420 con 0x7f550815e970 2024-09-10T07:40:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.761+0000 7f54fe000640 1 -- 172.21.15.99:0/1766319364 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5500019070 con 0x7f550815e970 2024-09-10T07:40:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.762+0000 7f54fe000640 1 -- 172.21.15.99:0/1766319364 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500014820 con 0x7f550815e970 2024-09-10T07:40:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.762+0000 7f5507200640 1 -- 172.21.15.99:0/1766319364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55080b80f0 con 0x7f550815e970 2024-09-10T07:40:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.762+0000 7f5507200640 1 -- 172.21.15.99:0/1766319364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55080b86b0 con 0x7f550815e970 2024-09-10T07:40:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.763+0000 7f5507200640 1 -- 172.21.15.99:0/1766319364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55080cf580 con 0x7f550815e970 2024-09-10T07:40:52.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.764+0000 7f54fe000640 1 -- 172.21.15.99:0/1766319364 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55000149c0 con 0x7f550815e970 2024-09-10T07:40:52.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.764+0000 7f54fe000640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e806be30 0x7f54e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:52.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.764+0000 7f54fe000640 1 -- 172.21.15.99:0/1766319364 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f550008b740 con 0x7f550815e970 2024-09-10T07:40:52.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.765+0000 7f5505e00640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e806be30 0x7f54e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:52.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.765+0000 7f5505e00640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e806be30 0x7f54e806e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009870 tx=0x7f54f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:52.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.769+0000 7f54fe000640 1 -- 172.21.15.99:0/1766319364 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f550005a050 con 0x7f550815e970 2024-09-10T07:40:52.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.980+0000 7f5507200640 1 -- 172.21.15.99:0/1766319364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f550806cfe0 con 0x7f550815e970 2024-09-10T07:40:52.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.980+0000 7f54fe000640 1 -- 172.21.15.99:0/1766319364 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7f5500059950 con 0x7f550815e970 2024-09-10T07:40:52.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:52.981 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":66,"btime":"2024-09-10T07:40:25:708900+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/4097316027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4097316027},{"type":"v1","addr":"172.21.15.187:6834","nonce":4097316027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2128941619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2128941619},{"type":"v1","addr":"172.21.15.187:6835","nonce":2128941619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/722129971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":722129971},{"type":"v1","addr":"172.21.15.99:6835","nonce":722129971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:40:22.087139+0000","modified":"2024-09-10T07:40:25.118483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1531136464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1531136464},{"type":"v1","addr":"172.21.15.99:6837","nonce":1531136464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6795,"qdb_cluster":[6795]},"id":8}]} 2024-09-10T07:40:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 66 2024-09-10T07:40:52.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 -- 172.21.15.99:0/1766319364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e806be30 msgr2=0x7f54e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e806be30 0x7f54e806e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009870 tx=0x7f54f8008040 comp rx=0 tx=0).stop 2024-09-10T07:40:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 -- 172.21.15.99:0/1766319364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f550815e970 msgr2=0x7f55080cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f550815e970 0x7f55080cc060 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f5500007e60 tx=0x7f550000e4b0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 -- 172.21.15.99:0/1766319364 shutdown_connections 2024-09-10T07:40:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e806be30 0x7f54e806e2f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f550815e970 0x7f55080cc060 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55080d2680 0x7f55080b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 --2- 172.21.15.99:0/1766319364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55080cfac0 0x7f55081558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 -- 172.21.15.99:0/1766319364 >> 172.21.15.99:0/1766319364 conn(0x7f550809de00 msgr2=0x7f55080b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 -- 172.21.15.99:0/1766319364 shutdown_connections 2024-09-10T07:40:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:52.983+0000 7f5507200640 1 -- 172.21.15.99:0/1766319364 wait complete. 2024-09-10T07:40:52.999 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-10T07:40:53.172 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":6795,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":30.487198167999999,"mdsmap_epoch":66,"osdmap_epoch":142,"osdmap_epoch_barrier":141,"uptime":35.210427326000001} 2024-09-10T07:40:53.172 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 6795, "mdsmap_epoch": 66, "osdmap_epoch": 142, "osdmap_epoch_barrier": 141, "rank_uptime": 30.487198168, "state": "up:active", "uptime": 35.210427326, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:40:53.173 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T07:40:53.173 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:53.173 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:53.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:53.209 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-10T07:40:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records in 2024-09-10T07:40:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records out 2024-09-10T07:40:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.368594 s, 142 MB/s 2024-09-10T07:40:53.655 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:40:53.655 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:40:53.733 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:40:53.820 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:40:53.820 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:40:53.820 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:53.820 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:53.859 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:53.860 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:53.936 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:40:54.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.129+0000 7f9b98200640 1 Processor -- start 2024-09-10T07:40:54.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.129+0000 7f9b98200640 1 -- start start 2024-09-10T07:40:54.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b98200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9b9006e040 0x7f9b9006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b98200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b900ce8d0 0x7f9b900ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b98200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b90153e50 con 0x7f9b9015db60 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b98200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f9b9015df40 con 0x7f9b9006e040 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b98200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9b9006e9d0 con 0x7f9b900ce8d0 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b95800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9b9015db60 0x7f9b90071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52676/0 (socket says 172.21.15.99:52676) 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b95800640 1 -- 172.21.15.99:0/3725274143 learned_addr learned my addr 172.21.15.99:0/3725274143 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b96200640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b900ce8d0 0x7f9b900ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b94e00640 1 --2- 172.21.15.99:0/3725274143 >> v2:172.21.15.187:3300/0 conn(0x7f9b9006e040 0x7f9b9006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584042224 0 0) 0x7f9b90153e50 con 0x7f9b9015db60 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.131+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b78003520 con 0x7f9b9015db60 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3372845423 0 0) 0x7f9b78003520 con 0x7f9b9015db60 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b900ce8d0 msgr2=0x7f9b900ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:54.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b900ce8d0 0x7f9b900ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 >> v2:172.21.15.187:3300/0 conn(0x7f9b9006e040 msgr2=0x7f9b9006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:54.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 --2- 172.21.15.99:0/3725274143 >> v2:172.21.15.187:3300/0 conn(0x7f9b9006e040 0x7f9b9006e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b90072ac0 con 0x7f9b9015db60 2024-09-10T07:40:54.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f9b84001670 con 0x7f9b9015db60 2024-09-10T07:40:54.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 >> v1:172.21.15.99:6789/0 conn(0x7f9b9015db60 legacy=0x7f9b90071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b780039b0 0x7f9b78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b78004800 0x7f9b78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b900ce8d0 0x7f9b780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9015df40 con 0x7f9b780039b0 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9006e9d0 con 0x7f9b78004800 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7800b9c0 con 0x7f9b900ce8d0 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b95800640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b780039b0 0x7f9b78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b94e00640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b78004800 0x7f9b78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.132+0000 7f9b96200640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b900ce8d0 0x7f9b780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.133+0000 7f9b94e00640 1 -- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b900ce8d0 msgr2=0x7f9b780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.133+0000 7f9b94e00640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b900ce8d0 0x7f9b780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.133+0000 7f9b94e00640 1 -- 172.21.15.99:0/3725274143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b780039b0 msgr2=0x7f9b78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.133+0000 7f9b94e00640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b780039b0 0x7f9b78003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.133+0000 7f9b94e00640 1 -- 172.21.15.99:0/3725274143 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b78003520 con 0x7f9b78004800 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.133+0000 7f9b96200640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b900ce8d0 0x7f9b780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:40:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.133+0000 7f9b95800640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b780039b0 0x7f9b78003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:40:54.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.134+0000 7f9b94e00640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b78004800 0x7f9b78004c80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009ac0 tx=0x7f9b78005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b501dfd2498736 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:54.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.134+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c036070 con 0x7f9b78004800 2024-09-10T07:40:54.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.134+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7c031400 con 0x7f9b78004800 2024-09-10T07:40:54.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.134+0000 7f9b8fe00640 1 -- 172.21.15.99:0/3725274143 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c009690 con 0x7f9b78004800 2024-09-10T07:40:54.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.134+0000 7f9b98200640 1 -- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b78004800 msgr2=0x7f9b78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.134+0000 7f9b98200640 1 --2- 172.21.15.99:0/3725274143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b78004800 0x7f9b78004c80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009ac0 tx=0x7f9b78005830 comp rx=0 tx=0).stop 2024-09-10T07:40:54.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.134+0000 7f9b96200640 1 -- 172.21.15.99:0/3725274143 reap_dead start 2024-09-10T07:40:54.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.135+0000 7f9b98200640 1 -- 172.21.15.99:0/3725274143 shutdown_connections 2024-09-10T07:40:54.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.135+0000 7f9b98200640 1 -- 172.21.15.99:0/3725274143 >> 172.21.15.99:0/3725274143 conn(0x7f9b900b2630 msgr2=0x7f9b900b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:54.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.135+0000 7f9b98200640 1 -- 172.21.15.99:0/3725274143 shutdown_connections 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.135+0000 7f9b98200640 1 -- 172.21.15.99:0/3725274143 wait complete. 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.136+0000 7f9b98200640 1 Processor -- start 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.136+0000 7f9b98200640 1 -- start start 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.137+0000 7f9b98200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b78004800 0x7f9b901f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.137+0000 7f9b98200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b90158e30 0x7f9b90158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.137+0000 7f9b98200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b9015a920 0x7f9b9015adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.137+0000 7f9b98200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90073360 con 0x7f9b90158e30 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.137+0000 7f9b98200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90072e00 con 0x7f9b78004800 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.137+0000 7f9b98200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9b90073640 con 0x7f9b9015a920 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.137+0000 7f9b94e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b90158e30 0x7f9b90158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.138+0000 7f9b94e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b90158e30 0x7f9b90158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55154/0 (socket says 172.21.15.99:55154) 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.138+0000 7f9b94e00640 1 -- 172.21.15.99:0/1090635593 learned_addr learned my addr 172.21.15.99:0/1090635593 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.138+0000 7f9b96200640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b9015a920 0x7f9b9015adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.138+0000 7f9b95800640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b78004800 0x7f9b901f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.138+0000 7f9b94e00640 1 -- 172.21.15.99:0/1090635593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b9015a920 msgr2=0x7f9b9015adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.138+0000 7f9b94e00640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b9015a920 0x7f9b9015adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.138+0000 7f9b94e00640 1 -- 172.21.15.99:0/1090635593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b78004800 msgr2=0x7f9b901f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.138+0000 7f9b94e00640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b78004800 0x7f9b901f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.138+0000 7f9b94e00640 1 -- 172.21.15.99:0/1090635593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b901f3960 con 0x7f9b90158e30 2024-09-10T07:40:54.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.138+0000 7f9b94e00640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b90158e30 0x7f9b90158430 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009be0 tx=0x7f9b7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:54.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.139+0000 7f9b8d600640 1 -- 172.21.15.99:0/1090635593 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c040020 con 0x7f9b90158e30 2024-09-10T07:40:54.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.139+0000 7f9b8d600640 1 -- 172.21.15.99:0/1090635593 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7c0038d0 con 0x7f9b90158e30 2024-09-10T07:40:54.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.139+0000 7f9b8d600640 1 -- 172.21.15.99:0/1090635593 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c036040 con 0x7f9b90158e30 2024-09-10T07:40:54.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.139+0000 7f9b98200640 1 -- 172.21.15.99:0/1090635593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b900adf90 con 0x7f9b90158e30 2024-09-10T07:40:54.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.139+0000 7f9b98200640 1 -- 172.21.15.99:0/1090635593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b900ae550 con 0x7f9b90158e30 2024-09-10T07:40:54.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.140+0000 7f9b98200640 1 -- 172.21.15.99:0/1090635593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b9006e490 con 0x7f9b90158e30 2024-09-10T07:40:54.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.141+0000 7f9b8d600640 1 -- 172.21.15.99:0/1090635593 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b7c043020 con 0x7f9b90158e30 2024-09-10T07:40:54.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.142+0000 7f9b8d600640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b7006be30 0x7f9b7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.142+0000 7f9b8d600640 1 -- 172.21.15.99:0/1090635593 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f9b7c0aaf40 con 0x7f9b90158e30 2024-09-10T07:40:54.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.142+0000 7f9b95800640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b7006be30 0x7f9b7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.143+0000 7f9b95800640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b7006be30 0x7f9b7006e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b84007c50 tx=0x7f9b84001e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:54.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.146+0000 7f9b8d600640 1 -- 172.21.15.99:0/1090635593 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b7c04a070 con 0x7f9b90158e30 2024-09-10T07:40:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.333+0000 7f9b98200640 1 -- 172.21.15.99:0/1090635593 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9b900727a0 con 0x7f9b90158e30 2024-09-10T07:40:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.334+0000 7f9b8d600640 1 -- 172.21.15.99:0/1090635593 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v142) ==== 80+0+0 (secure 0 0 0) 0x7f9b7c079290 con 0x7f9b90158e30 2024-09-10T07:40:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:40:54.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 -- 172.21.15.99:0/1090635593 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b7006be30 msgr2=0x7f9b7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b7006be30 0x7f9b7006e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9b84007c50 tx=0x7f9b84001e30 comp rx=0 tx=0).stop 2024-09-10T07:40:54.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 -- 172.21.15.99:0/1090635593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b90158e30 msgr2=0x7f9b90158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b90158e30 0x7f9b90158430 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009be0 tx=0x7f9b7c004730 comp rx=0 tx=0).stop 2024-09-10T07:40:54.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 -- 172.21.15.99:0/1090635593 shutdown_connections 2024-09-10T07:40:54.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b9015a920 0x7f9b9015adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9b7006be30 0x7f9b7006e2f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b90158e30 0x7f9b90158430 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 --2- 172.21.15.99:0/1090635593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b78004800 0x7f9b901f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 -- 172.21.15.99:0/1090635593 >> 172.21.15.99:0/1090635593 conn(0x7f9b900b2630 msgr2=0x7f9b9015ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:54.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 -- 172.21.15.99:0/1090635593 shutdown_connections 2024-09-10T07:40:54.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.336+0000 7f9b98200640 1 -- 172.21.15.99:0/1090635593 wait complete. 2024-09-10T07:40:54.352 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:40:54.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:54.353 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:40:54.450 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:40:54.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:54.451 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:40:54.493 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:40:54.494 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:40:54.494 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:54.532 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:40:54.532 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:54.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:40:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.767+0000 7fd951a00640 1 Processor -- start 2024-09-10T07:40:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.767+0000 7fd951a00640 1 -- start start 2024-09-10T07:40:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.768+0000 7fd951a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 0x7fd94c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.768+0000 7fd951a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd94c0cf890 0x7fd94c0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.768+0000 7fd951a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94c15c800 con 0x7fd94c0ce070 2024-09-10T07:40:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.768+0000 7fd951a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd94c0b5bb0 con 0x7fd94c0cf890 2024-09-10T07:40:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.768+0000 7fd951a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c0ce450 con 0x7fd94c0b5750 2024-09-10T07:40:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.768+0000 7fd94aa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd94c0ce070 0x7fd94c15bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52678/0 (socket says 172.21.15.99:52678) 2024-09-10T07:40:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.768+0000 7fd94aa00640 1 -- 172.21.15.99:0/2650439000 learned_addr learned my addr 172.21.15.99:0/2650439000 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.768+0000 7fd94b400640 1 --2- 172.21.15.99:0/2650439000 >> v2:172.21.15.99:3300/0 conn(0x7fd94c0cf890 0x7fd94c0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.769+0000 7fd94a000640 1 --2- 172.21.15.99:0/2650439000 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 0x7fd94c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.769+0000 7fd949600640 1 -- 172.21.15.99:0/2650439000 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478249329 0 0) 0x7fd94c15c800 con 0x7fd94c0ce070 2024-09-10T07:40:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.769+0000 7fd949600640 1 -- 172.21.15.99:0/2650439000 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd930005730 con 0x7fd94c0ce070 2024-09-10T07:40:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.769+0000 7fd94b400640 1 -- 172.21.15.99:0/2650439000 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 msgr2=0x7fd94c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.769+0000 7fd94b400640 1 --2- 172.21.15.99:0/2650439000 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 0x7fd94c15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.769+0000 7fd94b400640 1 -- 172.21.15.99:0/2650439000 >> v1:172.21.15.99:6789/0 conn(0x7fd94c0ce070 legacy=0x7fd94c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.769+0000 7fd94b400640 1 -- 172.21.15.99:0/2650439000 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c15cae0 con 0x7fd94c0cf890 2024-09-10T07:40:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.769+0000 7fd94a000640 1 --2- 172.21.15.99:0/2650439000 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 0x7fd94c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.770+0000 7fd94b400640 1 --2- 172.21.15.99:0/2650439000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0cf890 0x7fd94c0cfd40 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd944009d90 tx=0x7fd94402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f990843c9775011d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.770+0000 7fd949600640 1 -- 172.21.15.99:0/2650439000 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944007740 con 0x7fd94c0cf890 2024-09-10T07:40:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.770+0000 7fd949600640 1 -- 172.21.15.99:0/2650439000 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9440078e0 con 0x7fd94c0cf890 2024-09-10T07:40:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.770+0000 7fd949600640 1 -- 172.21.15.99:0/2650439000 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944007cb0 con 0x7fd94c0cf890 2024-09-10T07:40:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.771+0000 7fd951a00640 1 -- 172.21.15.99:0/2650439000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0cf890 msgr2=0x7fd94c0cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.771+0000 7fd951a00640 1 --2- 172.21.15.99:0/2650439000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0cf890 0x7fd94c0cfd40 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd944009d90 tx=0x7fd94402a660 comp rx=0 tx=0).stop 2024-09-10T07:40:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.771+0000 7fd951a00640 1 -- 172.21.15.99:0/2650439000 shutdown_connections 2024-09-10T07:40:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.771+0000 7fd951a00640 1 --2- 172.21.15.99:0/2650439000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0cf890 0x7fd94c0cfd40 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.771+0000 7fd951a00640 1 --2- 172.21.15.99:0/2650439000 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 0x7fd94c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.771+0000 7fd951a00640 1 -- 172.21.15.99:0/2650439000 >> 172.21.15.99:0/2650439000 conn(0x7fd94c0b2630 msgr2=0x7fd94c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.771+0000 7fd951a00640 1 -- 172.21.15.99:0/2650439000 shutdown_connections 2024-09-10T07:40:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.771+0000 7fd951a00640 1 -- 172.21.15.99:0/2650439000 wait complete. 2024-09-10T07:40:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.772+0000 7fd951a00640 1 Processor -- start 2024-09-10T07:40:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.773+0000 7fd951a00640 1 -- start start 2024-09-10T07:40:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd951a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 0x7fd94c14c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd951a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0ce070 0x7fd94c0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd951a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd94c0cf890 0x7fd94c0adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd951a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c15d830 con 0x7fd94c0ce070 2024-09-10T07:40:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd951a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c15d6b0 con 0x7fd94c0cf890 2024-09-10T07:40:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd951a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c06e080 con 0x7fd94c0b5750 2024-09-10T07:40:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd94a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0ce070 0x7fd94c0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd94a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0ce070 0x7fd94c0ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55182/0 (socket says 172.21.15.99:55182) 2024-09-10T07:40:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd94a000640 1 -- 172.21.15.99:0/4240866096 learned_addr learned my addr 172.21.15.99:0/4240866096 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd94aa00640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 0x7fd94c14c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd94b400640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd94c0cf890 0x7fd94c0adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd94a000640 1 -- 172.21.15.99:0/4240866096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 msgr2=0x7fd94c14c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd94a000640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 0x7fd94c14c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd94a000640 1 -- 172.21.15.99:0/4240866096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd94c0cf890 msgr2=0x7fd94c0adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd94a000640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd94c0cf890 0x7fd94c0adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.774+0000 7fd94a000640 1 -- 172.21.15.99:0/4240866096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c0ae180 con 0x7fd94c0ce070 2024-09-10T07:40:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.775+0000 7fd94a000640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0ce070 0x7fd94c0ad630 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd93800e7e0 tx=0x7fd93800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.775+0000 7fd942a00640 1 -- 172.21.15.99:0/4240866096 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938017070 con 0x7fd94c0ce070 2024-09-10T07:40:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.775+0000 7fd942a00640 1 -- 172.21.15.99:0/4240866096 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93800c6d0 con 0x7fd94c0ce070 2024-09-10T07:40:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.775+0000 7fd942a00640 1 -- 172.21.15.99:0/4240866096 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93800f040 con 0x7fd94c0ce070 2024-09-10T07:40:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.775+0000 7fd951a00640 1 -- 172.21.15.99:0/4240866096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94c0aa610 con 0x7fd94c0ce070 2024-09-10T07:40:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.775+0000 7fd951a00640 1 -- 172.21.15.99:0/4240866096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94c0aabd0 con 0x7fd94c0ce070 2024-09-10T07:40:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.776+0000 7fd951a00640 1 -- 172.21.15.99:0/4240866096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd94c0aa430 con 0x7fd94c0ce070 2024-09-10T07:40:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.777+0000 7fd942a00640 1 -- 172.21.15.99:0/4240866096 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd93801a070 con 0x7fd94c0ce070 2024-09-10T07:40:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.778+0000 7fd942a00640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd92c06be30 0x7fd92c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.778+0000 7fd942a00640 1 -- 172.21.15.99:0/4240866096 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fd93808ad30 con 0x7fd94c0ce070 2024-09-10T07:40:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.778+0000 7fd94aa00640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd92c06be30 0x7fd92c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.779+0000 7fd94aa00640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd92c06be30 0x7fd92c06e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd93c005880 tx=0x7fd93c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:54.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.782+0000 7fd942a00640 1 -- 172.21.15.99:0/4240866096 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd94c0aa430 con 0x7fd94c0ce070 2024-09-10T07:40:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.967+0000 7fd951a00640 1 -- 172.21.15.99:0/4240866096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd94c154d10 con 0x7fd94c0ce070 2024-09-10T07:40:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.967+0000 7fd942a00640 1 -- 172.21.15.99:0/4240866096 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v142) ==== 80+0+0 (secure 0 0 0) 0x7fd94c154d10 con 0x7fd94c0ce070 2024-09-10T07:40:54.968 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:40:54.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.969+0000 7fd951a00640 1 -- 172.21.15.99:0/4240866096 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd92c06be30 msgr2=0x7fd92c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.969+0000 7fd951a00640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd92c06be30 0x7fd92c06e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd93c005880 tx=0x7fd93c009040 comp rx=0 tx=0).stop 2024-09-10T07:40:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.969+0000 7fd951a00640 1 -- 172.21.15.99:0/4240866096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0ce070 msgr2=0x7fd94c0ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.969+0000 7fd951a00640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0ce070 0x7fd94c0ad630 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd93800e7e0 tx=0x7fd93800eca0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.969+0000 7fd951a00640 1 -- 172.21.15.99:0/4240866096 shutdown_connections 2024-09-10T07:40:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.969+0000 7fd951a00640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd94c0cf890 0x7fd94c0adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.969+0000 7fd951a00640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd92c06be30 0x7fd92c06e2f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.969+0000 7fd951a00640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd94c0ce070 0x7fd94c0ad630 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.969+0000 7fd951a00640 1 --2- 172.21.15.99:0/4240866096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd94c0b5750 0x7fd94c14c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.969+0000 7fd951a00640 1 -- 172.21.15.99:0/4240866096 >> 172.21.15.99:0/4240866096 conn(0x7fd94c0b2630 msgr2=0x7fd94c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.970+0000 7fd951a00640 1 -- 172.21.15.99:0/4240866096 shutdown_connections 2024-09-10T07:40:54.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:54.970+0000 7fd951a00640 1 -- 172.21.15.99:0/4240866096 wait complete. 2024-09-10T07:40:54.985 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:40:54.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:54.985 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T07:40:55.053 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:40:55.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:40:55.053 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:40:55.089 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:40:55.089 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:40:55.089 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:55.125 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:40:55.126 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:40:55.126 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:40:55.126 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:40:55.165 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:40:55.165 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:55.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.318+0000 7fec05a00640 1 Processor -- start 2024-09-10T07:40:55.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.318+0000 7fec05a00640 1 -- start start 2024-09-10T07:40:55.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.319+0000 7fec05a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fec0015e970 0x7fec000d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.319+0000 7fec05a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec000cfc90 0x7fec000c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.319+0000 7fec05a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec000d2bd0 con 0x7fec000d2680 2024-09-10T07:40:55.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.319+0000 7fec05a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fec000d37e0 con 0x7fec000cfc90 2024-09-10T07:40:55.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.319+0000 7fec05a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fec000d2eb0 con 0x7fec0015e970 2024-09-10T07:40:55.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.319+0000 7fec05000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec000cfc90 0x7fec000c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.320+0000 7fec05000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec000cfc90 0x7fec000c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55194/0 (socket says 172.21.15.99:55194) 2024-09-10T07:40:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.320+0000 7fec05000640 1 -- 172.21.15.99:0/651931003 learned_addr learned my addr 172.21.15.99:0/651931003 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.320+0000 7febffe00640 1 --2- 172.21.15.99:0/651931003 >> v2:172.21.15.187:3300/0 conn(0x7fec0015e970 0x7fec000d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.320+0000 7fec05000640 1 -- 172.21.15.99:0/651931003 >> v2:172.21.15.187:3300/0 conn(0x7fec0015e970 msgr2=0x7fec000d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.320+0000 7fec05000640 1 --2- 172.21.15.99:0/651931003 >> v2:172.21.15.187:3300/0 conn(0x7fec0015e970 0x7fec000d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.320+0000 7fec05000640 1 -- 172.21.15.99:0/651931003 >> v1:172.21.15.187:6789/0 conn(0x7fec000d2680 legacy=0x7fec000cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.320+0000 7fec05000640 1 -- 172.21.15.99:0/651931003 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec000d3190 con 0x7fec000cfc90 2024-09-10T07:40:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.321+0000 7fec05000640 1 --2- 172.21.15.99:0/651931003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000cfc90 0x7fec000c8700 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fec0006c1c0 tx=0x7febf802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08ecb4d7b51dd23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.321+0000 7febff400640 1 -- 172.21.15.99:0/651931003 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8037070 con 0x7fec000cfc90 2024-09-10T07:40:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.321+0000 7febff400640 1 -- 172.21.15.99:0/651931003 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf8032440 con 0x7fec000cfc90 2024-09-10T07:40:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.321+0000 7febff400640 1 -- 172.21.15.99:0/651931003 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8032810 con 0x7fec000cfc90 2024-09-10T07:40:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.322+0000 7fec05a00640 1 -- 172.21.15.99:0/651931003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000cfc90 msgr2=0x7fec000c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.322+0000 7fec05a00640 1 --2- 172.21.15.99:0/651931003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000cfc90 0x7fec000c8700 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fec0006c1c0 tx=0x7febf802a2c0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.322+0000 7fec05a00640 1 -- 172.21.15.99:0/651931003 shutdown_connections 2024-09-10T07:40:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.322+0000 7fec05a00640 1 --2- 172.21.15.99:0/651931003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000cfc90 0x7fec000c8700 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.322+0000 7fec05a00640 1 --2- 172.21.15.99:0/651931003 >> v2:172.21.15.187:3300/0 conn(0x7fec0015e970 0x7fec000d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.322+0000 7fec05a00640 1 -- 172.21.15.99:0/651931003 >> 172.21.15.99:0/651931003 conn(0x7fec0009de00 msgr2=0x7fec000d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.322+0000 7fec05a00640 1 -- 172.21.15.99:0/651931003 shutdown_connections 2024-09-10T07:40:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.322+0000 7fec05a00640 1 -- 172.21.15.99:0/651931003 wait complete. 2024-09-10T07:40:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.323+0000 7fec05a00640 1 Processor -- start 2024-09-10T07:40:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.324+0000 7fec05a00640 1 -- start start 2024-09-10T07:40:55.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.324+0000 7fec05a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec000cfc90 0x7fec000b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.324+0000 7fec05a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000d2680 0x7fec00154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.324+0000 7fec05a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec0015e970 0x7fec00160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.324+0000 7fec05a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fec0015ed50 con 0x7fec000d2680 2024-09-10T07:40:55.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.324+0000 7fec05a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fec000d0840 con 0x7fec0015e970 2024-09-10T07:40:55.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.324+0000 7fec05a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fec0015eed0 con 0x7fec000cfc90 2024-09-10T07:40:55.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febf7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000d2680 0x7fec00154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febf7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000d2680 0x7fec00154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55200/0 (socket says 172.21.15.99:55200) 2024-09-10T07:40:55.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febf7400640 1 -- 172.21.15.99:0/2655720758 learned_addr learned my addr 172.21.15.99:0/2655720758 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:55.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7fec05000640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec0015e970 0x7fec00160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febffe00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec000cfc90 0x7fec000b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febf7400640 1 -- 172.21.15.99:0/2655720758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec000cfc90 msgr2=0x7fec000b9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febf7400640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec000cfc90 0x7fec000b9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febf7400640 1 -- 172.21.15.99:0/2655720758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec0015e970 msgr2=0x7fec00160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febf7400640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec0015e970 0x7fec00160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febf7400640 1 -- 172.21.15.99:0/2655720758 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec000cbf40 con 0x7fec000d2680 2024-09-10T07:40:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7fec05000640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec0015e970 0x7fec00160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febffe00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec000cfc90 0x7fec000b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.325+0000 7febf7400640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000d2680 0x7fec00154d20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7febe800c460 tx=0x7febe800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.326+0000 7febfcc00640 1 -- 172.21.15.99:0/2655720758 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8016020 con 0x7fec000d2680 2024-09-10T07:40:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.326+0000 7febfcc00640 1 -- 172.21.15.99:0/2655720758 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febe8012870 con 0x7fec000d2680 2024-09-10T07:40:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.326+0000 7febfcc00640 1 -- 172.21.15.99:0/2655720758 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8012c60 con 0x7fec000d2680 2024-09-10T07:40:55.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.326+0000 7fec05a00640 1 -- 172.21.15.99:0/2655720758 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec000cc220 con 0x7fec000d2680 2024-09-10T07:40:55.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.326+0000 7fec05a00640 1 -- 172.21.15.99:0/2655720758 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec000cc7e0 con 0x7fec000d2680 2024-09-10T07:40:55.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.327+0000 7fec05a00640 1 -- 172.21.15.99:0/2655720758 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec000d0300 con 0x7fec000d2680 2024-09-10T07:40:55.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.328+0000 7febfcc00640 1 -- 172.21.15.99:0/2655720758 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febe8019020 con 0x7fec000d2680 2024-09-10T07:40:55.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.329+0000 7febfcc00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febdc06be30 0x7febdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.329+0000 7febfcc00640 1 -- 172.21.15.99:0/2655720758 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7febe808af00 con 0x7fec000d2680 2024-09-10T07:40:55.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.329+0000 7febffe00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febdc06be30 0x7febdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.330+0000 7febffe00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febdc06be30 0x7febdc06e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fec000ba700 tx=0x7febf000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:55.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.333+0000 7febfcc00640 1 -- 172.21.15.99:0/2655720758 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7febe8020020 con 0x7fec000d2680 2024-09-10T07:40:55.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.542+0000 7fec05a00640 1 -- 172.21.15.99:0/2655720758 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec0006c560 con 0x7fec000d2680 2024-09-10T07:40:55.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.542+0000 7febfcc00640 1 -- 172.21.15.99:0/2655720758 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7febe80182c0 con 0x7fec000d2680 2024-09-10T07:40:55.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:55.542 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":66,"btime":"2024-09-10T07:40:25:708900+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/4097316027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4097316027},{"type":"v1","addr":"172.21.15.187:6834","nonce":4097316027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2128941619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2128941619},{"type":"v1","addr":"172.21.15.187:6835","nonce":2128941619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/722129971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":722129971},{"type":"v1","addr":"172.21.15.99:6835","nonce":722129971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:40:22.087139+0000","modified":"2024-09-10T07:40:25.118483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1531136464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1531136464},{"type":"v1","addr":"172.21.15.99:6837","nonce":1531136464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6795,"qdb_cluster":[6795]},"id":8}]} 2024-09-10T07:40:55.542 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 66 2024-09-10T07:40:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.544+0000 7fec05a00640 1 -- 172.21.15.99:0/2655720758 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febdc06be30 msgr2=0x7febdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.544+0000 7fec05a00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febdc06be30 0x7febdc06e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fec000ba700 tx=0x7febf000b040 comp rx=0 tx=0).stop 2024-09-10T07:40:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.544+0000 7fec05a00640 1 -- 172.21.15.99:0/2655720758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000d2680 msgr2=0x7fec00154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.544+0000 7fec05a00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000d2680 0x7fec00154d20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7febe800c460 tx=0x7febe800c920 comp rx=0 tx=0).stop 2024-09-10T07:40:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.544+0000 7fec05a00640 1 -- 172.21.15.99:0/2655720758 shutdown_connections 2024-09-10T07:40:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.544+0000 7fec05a00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec0015e970 0x7fec00160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.544+0000 7fec05a00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7febdc06be30 0x7febdc06e2f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.544+0000 7fec05a00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000d2680 0x7fec00154d20 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.544+0000 7fec05a00640 1 --2- 172.21.15.99:0/2655720758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec000cfc90 0x7fec000b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.544+0000 7fec05a00640 1 -- 172.21.15.99:0/2655720758 >> 172.21.15.99:0/2655720758 conn(0x7fec0009de00 msgr2=0x7fec000c9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.545+0000 7fec05a00640 1 -- 172.21.15.99:0/2655720758 shutdown_connections 2024-09-10T07:40:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.545+0000 7fec05a00640 1 -- 172.21.15.99:0/2655720758 wait complete. 2024-09-10T07:40:55.560 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.714+0000 7f7aeb200640 1 Processor -- start 2024-09-10T07:40:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.714+0000 7f7aeb200640 1 -- start start 2024-09-10T07:40:55.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.715+0000 7f7aeb200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7ae415eab0 0x7f7ae40b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.715+0000 7f7aeb200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae40d3710 con 0x7f7ae40d3230 2024-09-10T07:40:55.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.715+0000 7f7aeb200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae40b6390 con 0x7f7ae4070b40 2024-09-10T07:40:55.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.715+0000 7f7aeb200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae40b6670 con 0x7f7ae415eab0 2024-09-10T07:40:55.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.716+0000 7f7ae9e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7ae415eab0 0x7f7ae40b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.716+0000 7f7aea800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7ae40d3230 0x7f7ae40b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52694/0 (socket says 172.21.15.99:52694) 2024-09-10T07:40:55.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.716+0000 7f7ae9e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7ae415eab0 0x7f7ae40b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55216/0 (socket says 172.21.15.99:55216) 2024-09-10T07:40:55.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.716+0000 7f7aea800640 1 -- 172.21.15.99:0/1793295894 learned_addr learned my addr 172.21.15.99:0/1793295894 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:55.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.716+0000 7f7ae9e00640 1 -- 172.21.15.99:0/1793295894 >> v1:172.21.15.187:6789/0 conn(0x7f7ae4070b40 legacy=0x7f7ae406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.716+0000 7f7ae9e00640 1 -- 172.21.15.99:0/1793295894 >> v1:172.21.15.99:6789/0 conn(0x7f7ae40d3230 legacy=0x7f7ae40b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.716+0000 7f7ae9e00640 1 -- 172.21.15.99:0/1793295894 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae40b6950 con 0x7f7ae415eab0 2024-09-10T07:40:55.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.717+0000 7f7ae9e00640 1 --2- 172.21.15.99:0/1793295894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae415eab0 0x7f7ae40b1c40 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80097a0 tx=0x7f7ad802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478a3f3fec55587b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:55.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.717+0000 7f7ae8a00640 1 -- 172.21.15.99:0/1793295894 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8037070 con 0x7f7ae415eab0 2024-09-10T07:40:55.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.717+0000 7f7ae8a00640 1 -- 172.21.15.99:0/1793295894 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad8032440 con 0x7f7ae415eab0 2024-09-10T07:40:55.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.717+0000 7f7ae8a00640 1 -- 172.21.15.99:0/1793295894 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad802ae60 con 0x7f7ae415eab0 2024-09-10T07:40:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.718+0000 7f7aeb200640 1 -- 172.21.15.99:0/1793295894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae415eab0 msgr2=0x7f7ae40b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.718+0000 7f7aeb200640 1 --2- 172.21.15.99:0/1793295894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae415eab0 0x7f7ae40b1c40 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80097a0 tx=0x7f7ad802a110 comp rx=0 tx=0).stop 2024-09-10T07:40:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.718+0000 7f7aeb200640 1 -- 172.21.15.99:0/1793295894 shutdown_connections 2024-09-10T07:40:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.718+0000 7f7aeb200640 1 --2- 172.21.15.99:0/1793295894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae415eab0 0x7f7ae40b1c40 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.718+0000 7f7aeb200640 1 -- 172.21.15.99:0/1793295894 >> 172.21.15.99:0/1793295894 conn(0x7f7ae40b7cc0 msgr2=0x7f7ae40b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.718+0000 7f7aeb200640 1 -- 172.21.15.99:0/1793295894 shutdown_connections 2024-09-10T07:40:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.718+0000 7f7aeb200640 1 -- 172.21.15.99:0/1793295894 wait complete. 2024-09-10T07:40:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.720+0000 7f7aeb200640 1 Processor -- start 2024-09-10T07:40:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.720+0000 7f7aeb200640 1 -- start start 2024-09-10T07:40:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7aeb200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae4070b40 0x7f7ae40ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7aeb200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae40d3230 0x7f7ae40ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7aeb200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae415eab0 0x7f7ae4151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7aeb200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae415ee90 con 0x7f7ae40d3230 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7aeb200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae406d430 con 0x7f7ae415eab0 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7aeb200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae40d17d0 con 0x7f7ae4070b40 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae40d3230 0x7f7ae40ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae40d3230 0x7f7ae40ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55224/0 (socket says 172.21.15.99:55224) 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9400640 1 -- 172.21.15.99:0/2669898176 learned_addr learned my addr 172.21.15.99:0/2669898176 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7aea800640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae415eab0 0x7f7ae4151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9e00640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae4070b40 0x7f7ae40ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9400640 1 -- 172.21.15.99:0/2669898176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae4070b40 msgr2=0x7f7ae40ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9400640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae4070b40 0x7f7ae40ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9400640 1 -- 172.21.15.99:0/2669898176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae415eab0 msgr2=0x7f7ae4151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9400640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae415eab0 0x7f7ae4151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9400640 1 -- 172.21.15.99:0/2669898176 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae40d0bc0 con 0x7f7ae40d3230 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7aea800640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae415eab0 0x7f7ae4151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9e00640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae4070b40 0x7f7ae40ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.721+0000 7f7ae9400640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae40d3230 0x7f7ae40ceb70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400c400 tx=0x7f7ad400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.722+0000 7f7ade000640 1 -- 172.21.15.99:0/2669898176 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40052d0 con 0x7f7ae40d3230 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.722+0000 7f7ade000640 1 -- 172.21.15.99:0/2669898176 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad4005490 con 0x7f7ae40d3230 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.722+0000 7f7ade000640 1 -- 172.21.15.99:0/2669898176 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4007260 con 0x7f7ae40d3230 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.722+0000 7f7aeb200640 1 -- 172.21.15.99:0/2669898176 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae40d0ea0 con 0x7f7ae40d3230 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.722+0000 7f7aeb200640 1 -- 172.21.15.99:0/2669898176 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae40d1460 con 0x7f7ae40d3230 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.723+0000 7f7aeb200640 1 -- 172.21.15.99:0/2669898176 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae40b1c40 con 0x7f7ae40d3230 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.724+0000 7f7ade000640 1 -- 172.21.15.99:0/2669898176 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ad4007400 con 0x7f7ae40d3230 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.725+0000 7f7ade000640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 0x7f7ac806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.725+0000 7f7ade000640 1 -- 172.21.15.99:0/2669898176 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f7ad408a3a0 con 0x7f7ae40d3230 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.725+0000 7f7ae9e00640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 0x7f7ac806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.726+0000 7f7ae9e00640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 0x7f7ac806e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8034000 tx=0x7f7ad802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.729+0000 7f7ade000640 1 -- 172.21.15.99:0/2669898176 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ad4058d50 con 0x7f7ae40d3230 2024-09-10T07:40:55.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.938+0000 7f7aeb200640 1 -- 172.21.15.99:0/2669898176 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ae40b3520 con 0x7f7ae40d3230 2024-09-10T07:40:55.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.938+0000 7f7ade000640 1 -- 172.21.15.99:0/2669898176 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7f7ad4058650 con 0x7f7ae40d3230 2024-09-10T07:40:55.939 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:55.939 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":66,"btime":"2024-09-10T07:40:25:708900+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/4097316027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4097316027},{"type":"v1","addr":"172.21.15.187:6834","nonce":4097316027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2128941619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2128941619},{"type":"v1","addr":"172.21.15.187:6835","nonce":2128941619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/722129971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":722129971},{"type":"v1","addr":"172.21.15.99:6835","nonce":722129971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:40:22.087139+0000","modified":"2024-09-10T07:40:25.118483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1531136464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1531136464},{"type":"v1","addr":"172.21.15.99:6837","nonce":1531136464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6795,"qdb_cluster":[6795]},"id":8}]} 2024-09-10T07:40:55.939 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 66 2024-09-10T07:40:55.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.940+0000 7f7aeb200640 1 -- 172.21.15.99:0/2669898176 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 msgr2=0x7f7ac806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.940+0000 7f7aeb200640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 0x7f7ac806e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8034000 tx=0x7f7ad802e000 comp rx=0 tx=0).stop 2024-09-10T07:40:55.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.940+0000 7f7aeb200640 1 -- 172.21.15.99:0/2669898176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae40d3230 msgr2=0x7f7ae40ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:55.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.940+0000 7f7aeb200640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae40d3230 0x7f7ae40ceb70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400c400 tx=0x7f7ad400c8c0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.941+0000 7f7aeb200640 1 -- 172.21.15.99:0/2669898176 shutdown_connections 2024-09-10T07:40:55.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.941+0000 7f7aeb200640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae415eab0 0x7f7ae4151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.941+0000 7f7aeb200640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 0x7f7ac806e2f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.941+0000 7f7aeb200640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ae40d3230 0x7f7ae40ceb70 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.941+0000 7f7aeb200640 1 --2- 172.21.15.99:0/2669898176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae4070b40 0x7f7ae40ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:55.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.941+0000 7f7aeb200640 1 -- 172.21.15.99:0/2669898176 >> 172.21.15.99:0/2669898176 conn(0x7f7ae40b7cc0 msgr2=0x7f7ae40b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:55.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.941+0000 7f7aeb200640 1 -- 172.21.15.99:0/2669898176 shutdown_connections 2024-09-10T07:40:55.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:55.941+0000 7f7aeb200640 1 -- 172.21.15.99:0/2669898176 wait complete. 2024-09-10T07:40:55.956 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:40:56.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.110+0000 7fbe41c00640 1 Processor -- start 2024-09-10T07:40:56.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.110+0000 7fbe41c00640 1 -- start start 2024-09-10T07:40:56.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe41c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbe3c145290 0x7fbe3c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe41c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbe3c0ce780 0x7fbe3c072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe41c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe3c071510 0x7fbe3c072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe41c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbe3c06efe0 con 0x7fbe3c145290 2024-09-10T07:40:56.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe41c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbe3c06e3d0 con 0x7fbe3c0ce780 2024-09-10T07:40:56.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe41c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbe3c06e6b0 con 0x7fbe3c071510 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe3aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbe3c145290 0x7fbe3c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe3aa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbe3c145290 0x7fbe3c06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55240/0 (socket says 172.21.15.99:55240) 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe3aa00640 1 -- 172.21.15.99:0/3889435243 learned_addr learned my addr 172.21.15.99:0/3889435243 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe3b400640 1 --2- 172.21.15.99:0/3889435243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe3c071510 0x7fbe3c072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe32000640 1 --2- 172.21.15.99:0/3889435243 >> v2:172.21.15.187:3300/0 conn(0x7fbe3c0ce780 0x7fbe3c072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe3aa00640 1 -- 172.21.15.99:0/3889435243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe3c071510 msgr2=0x7fbe3c072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe3aa00640 1 --2- 172.21.15.99:0/3889435243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe3c071510 0x7fbe3c072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe3aa00640 1 -- 172.21.15.99:0/3889435243 >> v2:172.21.15.187:3300/0 conn(0x7fbe3c0ce780 msgr2=0x7fbe3c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe3aa00640 1 --2- 172.21.15.99:0/3889435243 >> v2:172.21.15.187:3300/0 conn(0x7fbe3c0ce780 0x7fbe3c072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe3aa00640 1 -- 172.21.15.99:0/3889435243 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c06e990 con 0x7fbe3c145290 2024-09-10T07:40:56.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.112+0000 7fbe3b400640 1 --2- 172.21.15.99:0/3889435243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe3c071510 0x7fbe3c072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:56.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.113+0000 7fbe3aa00640 1 --2- 172.21.15.99:0/3889435243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c145290 0x7fbe3c06f470 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c06d450 tx=0x7fbe2c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29fbaa67eb27fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe3a000640 1 -- 172.21.15.99:0/3889435243 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c037070 con 0x7fbe3c145290 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe3a000640 1 -- 172.21.15.99:0/3889435243 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe2c032440 con 0x7fbe3c145290 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe3a000640 1 -- 172.21.15.99:0/3889435243 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c032810 con 0x7fbe3c145290 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe41c00640 1 -- 172.21.15.99:0/3889435243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c145290 msgr2=0x7fbe3c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe41c00640 1 --2- 172.21.15.99:0/3889435243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c145290 0x7fbe3c06f470 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c06d450 tx=0x7fbe2c02a1e0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe41c00640 1 -- 172.21.15.99:0/3889435243 shutdown_connections 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe41c00640 1 --2- 172.21.15.99:0/3889435243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe3c071510 0x7fbe3c072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe41c00640 1 --2- 172.21.15.99:0/3889435243 >> v2:172.21.15.187:3300/0 conn(0x7fbe3c0ce780 0x7fbe3c072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe41c00640 1 --2- 172.21.15.99:0/3889435243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c145290 0x7fbe3c06f470 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe41c00640 1 -- 172.21.15.99:0/3889435243 >> 172.21.15.99:0/3889435243 conn(0x7fbe3c06bc10 msgr2=0x7fbe3c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe41c00640 1 -- 172.21.15.99:0/3889435243 shutdown_connections 2024-09-10T07:40:56.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.114+0000 7fbe41c00640 1 -- 172.21.15.99:0/3889435243 wait complete. 2024-09-10T07:40:56.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.116+0000 7fbe41c00640 1 Processor -- start 2024-09-10T07:40:56.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.116+0000 7fbe41c00640 1 -- start start 2024-09-10T07:40:56.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.117+0000 7fbe41c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c071510 0x7fbe3c15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.117+0000 7fbe41c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe3c0ce780 0x7fbe3c13b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.117+0000 7fbe41c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe3c145290 0x7fbe3c13bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.117+0000 7fbe41c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c06df80 con 0x7fbe3c071510 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.117+0000 7fbe41c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c145670 con 0x7fbe3c0ce780 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.117+0000 7fbe41c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbe3c06e100 con 0x7fbe3c145290 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.117+0000 7fbe3aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c071510 0x7fbe3c15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.117+0000 7fbe3aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c071510 0x7fbe3c15b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55254/0 (socket says 172.21.15.99:55254) 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.117+0000 7fbe3aa00640 1 -- 172.21.15.99:0/3601150522 learned_addr learned my addr 172.21.15.99:0/3601150522 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe3aa00640 1 -- 172.21.15.99:0/3601150522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe3c145290 msgr2=0x7fbe3c13bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe3aa00640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe3c145290 0x7fbe3c13bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe3aa00640 1 -- 172.21.15.99:0/3601150522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe3c0ce780 msgr2=0x7fbe3c13b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe3aa00640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe3c0ce780 0x7fbe3c13b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe3aa00640 1 -- 172.21.15.99:0/3601150522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c15b6c0 con 0x7fbe3c071510 2024-09-10T07:40:56.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe3aa00640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c071510 0x7fbe3c15b180 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c02a220 tx=0x7fbe2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:56.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe33400640 1 -- 172.21.15.99:0/3601150522 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c041020 con 0x7fbe3c071510 2024-09-10T07:40:56.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe33400640 1 -- 172.21.15.99:0/3601150522 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe2c0306c0 con 0x7fbe3c071510 2024-09-10T07:40:56.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe41c00640 1 -- 172.21.15.99:0/3601150522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3c1e1dd0 con 0x7fbe3c071510 2024-09-10T07:40:56.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe33400640 1 -- 172.21.15.99:0/3601150522 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c037040 con 0x7fbe3c071510 2024-09-10T07:40:56.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.118+0000 7fbe41c00640 1 -- 172.21.15.99:0/3601150522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe3c1e2390 con 0x7fbe3c071510 2024-09-10T07:40:56.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.119+0000 7fbe41c00640 1 -- 172.21.15.99:0/3601150522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe3c1e2560 con 0x7fbe3c071510 2024-09-10T07:40:56.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.120+0000 7fbe33400640 1 -- 172.21.15.99:0/3601150522 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe2c044020 con 0x7fbe3c071510 2024-09-10T07:40:56.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.121+0000 7fbe33400640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbe1806be30 0x7fbe1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.121+0000 7fbe33400640 1 -- 172.21.15.99:0/3601150522 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fbe2c0ab700 con 0x7fbe3c071510 2024-09-10T07:40:56.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.121+0000 7fbe32000640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbe1806be30 0x7fbe1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.122+0000 7fbe32000640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbe1806be30 0x7fbe1806e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbe24006fd0 tx=0x7fbe24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:56.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.125+0000 7fbe33400640 1 -- 172.21.15.99:0/3601150522 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe2c04b030 con 0x7fbe3c071510 2024-09-10T07:40:56.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.300+0000 7fbe41c00640 1 -- 172.21.15.99:0/3601150522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe3c06f470 con 0x7fbe3c071510 2024-09-10T07:40:56.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.301+0000 7fbe33400640 1 -- 172.21.15.99:0/3601150522 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16671 (secure 0 0 0) 0x7fbe3c15b6c0 con 0x7fbe3c071510 2024-09-10T07:40:56.302 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:56.302 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":142,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:40:51.756409+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:40:19.848847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T07:40:21.080608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:40:56.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 -- 172.21.15.99:0/3601150522 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbe1806be30 msgr2=0x7fbe1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbe1806be30 0x7fbe1806e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbe24006fd0 tx=0x7fbe24008040 comp rx=0 tx=0).stop 2024-09-10T07:40:56.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 -- 172.21.15.99:0/3601150522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c071510 msgr2=0x7fbe3c15b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c071510 0x7fbe3c15b180 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c02a220 tx=0x7fbe2c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 -- 172.21.15.99:0/3601150522 shutdown_connections 2024-09-10T07:40:56.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe3c145290 0x7fbe3c13bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe3c0ce780 0x7fbe3c13b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbe1806be30 0x7fbe1806e2f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 --2- 172.21.15.99:0/3601150522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe3c071510 0x7fbe3c15b180 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 -- 172.21.15.99:0/3601150522 >> 172.21.15.99:0/3601150522 conn(0x7fbe3c06bc10 msgr2=0x7fbe3c1409e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:56.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 -- 172.21.15.99:0/3601150522 shutdown_connections 2024-09-10T07:40:56.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.303+0000 7fbe41c00640 1 -- 172.21.15.99:0/3601150522 wait complete. 2024-09-10T07:40:56.319 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:40:56.319 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:56.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.472+0000 7fb3d5800640 1 Processor -- start 2024-09-10T07:40:56.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.472+0000 7fb3d5800640 1 -- start start 2024-09-10T07:40:56.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.473+0000 7fb3d5800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb3d015e970 0x7fb3d00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.473+0000 7fb3d5800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00cfc90 0x7fb3d00c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.473+0000 7fb3d5800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d00d2bd0 con 0x7fb3d00d2680 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.473+0000 7fb3d5800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d00d37e0 con 0x7fb3d015e970 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.473+0000 7fb3d5800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d00d2eb0 con 0x7fb3d00cfc90 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.473+0000 7fb3cfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb3d015e970 0x7fb3d00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.473+0000 7fb3cfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb3d015e970 0x7fb3d00d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55270/0 (socket says 172.21.15.99:55270) 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.473+0000 7fb3cfe00640 1 -- 172.21.15.99:0/1958761800 learned_addr learned my addr 172.21.15.99:0/1958761800 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.474+0000 7fb3d4e00640 1 --2- 172.21.15.99:0/1958761800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00cfc90 0x7fb3d00c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.474+0000 7fb3cfe00640 1 -- 172.21.15.99:0/1958761800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00cfc90 msgr2=0x7fb3d00c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.474+0000 7fb3cfe00640 1 --2- 172.21.15.99:0/1958761800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00cfc90 0x7fb3d00c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.474+0000 7fb3cfe00640 1 -- 172.21.15.99:0/1958761800 >> v1:172.21.15.187:6789/0 conn(0x7fb3d00d2680 legacy=0x7fb3d00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.474+0000 7fb3cfe00640 1 -- 172.21.15.99:0/1958761800 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d00d3190 con 0x7fb3d015e970 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.475+0000 7fb3cfe00640 1 --2- 172.21.15.99:0/1958761800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d015e970 0x7fb3d00d0300 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009870 tx=0x7fb3c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de29fe84b56515d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.475+0000 7fb3cea00640 1 -- 172.21.15.99:0/1958761800 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0037070 con 0x7fb3d015e970 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.475+0000 7fb3cea00640 1 -- 172.21.15.99:0/1958761800 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c0032440 con 0x7fb3d015e970 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.475+0000 7fb3cea00640 1 -- 172.21.15.99:0/1958761800 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0032810 con 0x7fb3d015e970 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.476+0000 7fb3d5800640 1 -- 172.21.15.99:0/1958761800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d015e970 msgr2=0x7fb3d00d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.476+0000 7fb3d5800640 1 --2- 172.21.15.99:0/1958761800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d015e970 0x7fb3d00d0300 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009870 tx=0x7fb3c002a270 comp rx=0 tx=0).stop 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.476+0000 7fb3d5800640 1 -- 172.21.15.99:0/1958761800 shutdown_connections 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.476+0000 7fb3d5800640 1 --2- 172.21.15.99:0/1958761800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00cfc90 0x7fb3d00c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.476+0000 7fb3d5800640 1 --2- 172.21.15.99:0/1958761800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d015e970 0x7fb3d00d0300 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.476+0000 7fb3d5800640 1 -- 172.21.15.99:0/1958761800 >> 172.21.15.99:0/1958761800 conn(0x7fb3d009de00 msgr2=0x7fb3d00d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.476+0000 7fb3d5800640 1 -- 172.21.15.99:0/1958761800 shutdown_connections 2024-09-10T07:40:56.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.476+0000 7fb3d5800640 1 -- 172.21.15.99:0/1958761800 wait complete. 2024-09-10T07:40:56.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.477+0000 7fb3d5800640 1 Processor -- start 2024-09-10T07:40:56.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.478+0000 7fb3d5800640 1 -- start start 2024-09-10T07:40:56.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.478+0000 7fb3d5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d00cfc90 0x7fb3d00cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.478+0000 7fb3d5800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00d2680 0x7fb3d0156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3d5800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3d015e970 0x7fb3d015f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3d5800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d015ed50 con 0x7fb3d00cfc90 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3d5800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d00d0840 con 0x7fb3d015e970 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3d5800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d015eed0 con 0x7fb3d00d2680 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d00cfc90 0x7fb3d00cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d00cfc90 0x7fb3d00cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55286/0 (socket says 172.21.15.99:55286) 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cfe00640 1 -- 172.21.15.99:0/936882729 learned_addr learned my addr 172.21.15.99:0/936882729 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cf400640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00d2680 0x7fb3d0156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3d4e00640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3d015e970 0x7fb3d015f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cfe00640 1 -- 172.21.15.99:0/936882729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00d2680 msgr2=0x7fb3d0156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cfe00640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00d2680 0x7fb3d0156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cfe00640 1 -- 172.21.15.99:0/936882729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3d015e970 msgr2=0x7fb3d015f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cfe00640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3d015e970 0x7fb3d015f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cfe00640 1 -- 172.21.15.99:0/936882729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d01e8240 con 0x7fb3d00cfc90 2024-09-10T07:40:56.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3d4e00640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3d015e970 0x7fb3d015f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:56.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cf400640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00d2680 0x7fb3d0156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:56.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.479+0000 7fb3cfe00640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d00cfc90 0x7fb3d00cbb80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0000c00 tx=0x7fb3c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:56.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.480+0000 7fb3c7e00640 1 -- 172.21.15.99:0/936882729 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0037040 con 0x7fb3d00cfc90 2024-09-10T07:40:56.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.480+0000 7fb3c7e00640 1 -- 172.21.15.99:0/936882729 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c0042070 con 0x7fb3d00cfc90 2024-09-10T07:40:56.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.480+0000 7fb3c7e00640 1 -- 172.21.15.99:0/936882729 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0030880 con 0x7fb3d00cfc90 2024-09-10T07:40:56.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.480+0000 7fb3d5800640 1 -- 172.21.15.99:0/936882729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d01e8520 con 0x7fb3d00cfc90 2024-09-10T07:40:56.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.480+0000 7fb3d5800640 1 -- 172.21.15.99:0/936882729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d01e8ae0 con 0x7fb3d00cfc90 2024-09-10T07:40:56.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.481+0000 7fb3d5800640 1 -- 172.21.15.99:0/936882729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d00d0300 con 0x7fb3d00cfc90 2024-09-10T07:40:56.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.482+0000 7fb3c7e00640 1 -- 172.21.15.99:0/936882729 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3c0030a20 con 0x7fb3d00cfc90 2024-09-10T07:40:56.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.483+0000 7fb3c7e00640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3b006be30 0x7fb3b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.483+0000 7fb3c7e00640 1 -- 172.21.15.99:0/936882729 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fb3c00ab740 con 0x7fb3d00cfc90 2024-09-10T07:40:56.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.483+0000 7fb3cf400640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3b006be30 0x7fb3b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.483+0000 7fb3cf400640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3b006be30 0x7fb3b006e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb3d01e7c70 tx=0x7fb3bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:56.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.487+0000 7fb3c7e00640 1 -- 172.21.15.99:0/936882729 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3c007a050 con 0x7fb3d00cfc90 2024-09-10T07:40:56.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.694+0000 7fb3d5800640 1 -- 172.21.15.99:0/936882729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3d006c8f0 con 0x7fb3d00cfc90 2024-09-10T07:40:56.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.695+0000 7fb3c7e00640 1 -- 172.21.15.99:0/936882729 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7fb3c0079950 con 0x7fb3d00cfc90 2024-09-10T07:40:56.697 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:56.697 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":66,"btime":"2024-09-10T07:40:25:708900+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/4097316027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4097316027},{"type":"v1","addr":"172.21.15.187:6834","nonce":4097316027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2128941619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2128941619},{"type":"v1","addr":"172.21.15.187:6835","nonce":2128941619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/722129971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":722129971},{"type":"v1","addr":"172.21.15.99:6835","nonce":722129971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:40:22.087139+0000","modified":"2024-09-10T07:40:25.118483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1531136464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1531136464},{"type":"v1","addr":"172.21.15.99:6837","nonce":1531136464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6795,"qdb_cluster":[6795]},"id":8}]} 2024-09-10T07:40:56.698 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 66 2024-09-10T07:40:56.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 -- 172.21.15.99:0/936882729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3b006be30 msgr2=0x7fb3b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3b006be30 0x7fb3b006e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb3d01e7c70 tx=0x7fb3bc009040 comp rx=0 tx=0).stop 2024-09-10T07:40:56.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 -- 172.21.15.99:0/936882729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d00cfc90 msgr2=0x7fb3d00cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d00cfc90 0x7fb3d00cbb80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0000c00 tx=0x7fb3c00046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 -- 172.21.15.99:0/936882729 shutdown_connections 2024-09-10T07:40:56.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3d015e970 0x7fb3d015f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3d00d2680 0x7fb3d0156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb3b006be30 0x7fb3b006e2f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 --2- 172.21.15.99:0/936882729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d00cfc90 0x7fb3d00cbb80 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 -- 172.21.15.99:0/936882729 >> 172.21.15.99:0/936882729 conn(0x7fb3d009de00 msgr2=0x7fb3d0157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:56.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 -- 172.21.15.99:0/936882729 shutdown_connections 2024-09-10T07:40:56.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.697+0000 7fb3d5800640 1 -- 172.21.15.99:0/936882729 wait complete. 2024-09-10T07:40:56.713 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:40:56.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.868+0000 7f3c16000640 1 Processor -- start 2024-09-10T07:40:56.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.869+0000 7f3c16000640 1 -- start start 2024-09-10T07:40:56.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.870+0000 7f3c16000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3c100d57a0 0x7f3c100d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.870+0000 7f3c16000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c100d3880 con 0x7f3c1015ecc0 2024-09-10T07:40:56.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.870+0000 7f3c16000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c100d3b20 con 0x7f3c100d1990 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.870+0000 7f3c16000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f3c100b42f0 con 0x7f3c100d57a0 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.870+0000 7f3c0f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3c1015ecc0 0x7f3c100d3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52710/0 (socket says 172.21.15.99:52710) 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.870+0000 7f3c0f400640 1 -- 172.21.15.99:0/2384250103 learned_addr learned my addr 172.21.15.99:0/2384250103 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.870+0000 7f3c06a00640 1 --2- 172.21.15.99:0/2384250103 >> v2:172.21.15.187:3300/0 conn(0x7f3c100d57a0 0x7f3c100d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.870+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270050802 0 0) 0x7f3c100d3880 con 0x7f3c1015ecc0 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.870+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf4003520 con 0x7f3c1015ecc0 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2685696745 0 0) 0x7f3bf4003520 con 0x7f3c1015ecc0 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 >> v2:172.21.15.187:3300/0 conn(0x7f3c100d57a0 msgr2=0x7f3c100d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 --2- 172.21.15.99:0/2384250103 >> v2:172.21.15.187:3300/0 conn(0x7f3c100d57a0 0x7f3c100d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 >> v1:172.21.15.187:6789/0 conn(0x7f3c100d1990 legacy=0x7f3c100b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c100b45d0 con 0x7f3c1015ecc0 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f3c00001670 con 0x7f3c1015ecc0 2024-09-10T07:40:56.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 >> v1:172.21.15.99:6789/0 conn(0x7f3c1015ecc0 legacy=0x7f3c100d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3bf4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf4004800 0x7f3bf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bf40051c0 0x7f3bf400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3c100b42f0 con 0x7f3bf4003a00 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf400c0c0 con 0x7f3bf4004800 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf400c2c0 con 0x7f3bf40051c0 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0f400640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3bf4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c06a00640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf4004800 0x7f3bf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0fe00640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bf40051c0 0x7f3bf400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0f400640 1 -- 172.21.15.99:0/2384250103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bf40051c0 msgr2=0x7f3bf400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0f400640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bf40051c0 0x7f3bf400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0f400640 1 -- 172.21.15.99:0/2384250103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf4004800 msgr2=0x7f3bf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:56.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0f400640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf4004800 0x7f3bf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0f400640 1 -- 172.21.15.99:0/2384250103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf4003520 con 0x7f3bf4003a00 2024-09-10T07:40:56.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c06a00640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bf4004800 0x7f3bf4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:56.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.871+0000 7f3c0fe00640 1 -- 172.21.15.99:0/2384250103 reap_dead start 2024-09-10T07:40:56.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.872+0000 7f3c0f400640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3bf4003e20 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000c190 tx=0x7f3bf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8501df64e7dd5486 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:56.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.873+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00007c60 con 0x7f3bf4003a00 2024-09-10T07:40:56.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.873+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c00005ad0 con 0x7f3bf4003a00 2024-09-10T07:40:56.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.873+0000 7f3c0ea00640 1 -- 172.21.15.99:0/2384250103 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00007070 con 0x7f3bf4003a00 2024-09-10T07:40:56.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.873+0000 7f3c16000640 1 -- 172.21.15.99:0/2384250103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 msgr2=0x7f3bf4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.873+0000 7f3c16000640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3bf4003e20 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000c190 tx=0x7f3bf4005830 comp rx=0 tx=0).stop 2024-09-10T07:40:56.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.873+0000 7f3c16000640 1 -- 172.21.15.99:0/2384250103 shutdown_connections 2024-09-10T07:40:56.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.873+0000 7f3c16000640 1 --2- 172.21.15.99:0/2384250103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3bf4003e20 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.873+0000 7f3c16000640 1 -- 172.21.15.99:0/2384250103 >> 172.21.15.99:0/2384250103 conn(0x7f3c100d4bd0 msgr2=0x7f3c100d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:56.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.873+0000 7f3c16000640 1 -- 172.21.15.99:0/2384250103 shutdown_connections 2024-09-10T07:40:56.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.873+0000 7f3c16000640 1 -- 172.21.15.99:0/2384250103 wait complete. 2024-09-10T07:40:56.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.875+0000 7f3c16000640 1 Processor -- start 2024-09-10T07:40:56.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.875+0000 7f3c16000640 1 -- start start 2024-09-10T07:40:56.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c16000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3c10155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c16000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c100c99b0 0x7f3c100b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c16000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c100b9140 0x7f3c100ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c16000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1015f0a0 con 0x7f3bf4003a00 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c16000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3c100b4b90 con 0x7f3c100b9140 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c16000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1015f220 con 0x7f3c100c99b0 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c0f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3c10155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c0f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3c10155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55308/0 (socket says 172.21.15.99:55308) 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c0f400640 1 -- 172.21.15.99:0/2059861196 learned_addr learned my addr 172.21.15.99:0/2059861196 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c06a00640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c100c99b0 0x7f3c100b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.876+0000 7f3c0fe00640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c100b9140 0x7f3c100ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.877+0000 7f3c0f400640 1 -- 172.21.15.99:0/2059861196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c100c99b0 msgr2=0x7f3c100b9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.877+0000 7f3c0f400640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c100c99b0 0x7f3c100b9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.877+0000 7f3c0f400640 1 -- 172.21.15.99:0/2059861196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c100b9140 msgr2=0x7f3c100ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:56.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.877+0000 7f3c0f400640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c100b9140 0x7f3c100ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:56.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.877+0000 7f3c0f400640 1 -- 172.21.15.99:0/2059861196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c100c9eb0 con 0x7f3bf4003a00 2024-09-10T07:40:56.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.877+0000 7f3c0fe00640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c100b9140 0x7f3c100ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:40:56.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.877+0000 7f3c0f400640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3c10155a00 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000c190 tx=0x7f3c00001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:56.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.879+0000 7f3c07e00640 1 -- 172.21.15.99:0/2059861196 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0003f070 con 0x7f3bf4003a00 2024-09-10T07:40:56.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.879+0000 7f3c07e00640 1 -- 172.21.15.99:0/2059861196 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c00001430 con 0x7f3bf4003a00 2024-09-10T07:40:56.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.879+0000 7f3c07e00640 1 -- 172.21.15.99:0/2059861196 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00007070 con 0x7f3bf4003a00 2024-09-10T07:40:56.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.879+0000 7f3c16000640 1 -- 172.21.15.99:0/2059861196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c100b8660 con 0x7f3bf4003a00 2024-09-10T07:40:56.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.879+0000 7f3c16000640 1 -- 172.21.15.99:0/2059861196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c100b8c20 con 0x7f3bf4003a00 2024-09-10T07:40:56.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.881+0000 7f3c16000640 1 -- 172.21.15.99:0/2059861196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c100d14e0 con 0x7f3bf4003a00 2024-09-10T07:40:56.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.881+0000 7f3c07e00640 1 -- 172.21.15.99:0/2059861196 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c00042070 con 0x7f3bf4003a00 2024-09-10T07:40:56.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.882+0000 7f3c07e00640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3bec06be30 0x7f3bec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:56.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.882+0000 7f3c07e00640 1 -- 172.21.15.99:0/2059861196 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f3c000aab10 con 0x7f3bf4003a00 2024-09-10T07:40:56.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.882+0000 7f3c07e00640 1 -- 172.21.15.99:0/2059861196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=144}) -- 0x7f3bec073960 con 0x7f3bf4003a00 2024-09-10T07:40:56.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.882+0000 7f3c06a00640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3bec06be30 0x7f3bec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:56.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.883+0000 7f3c06a00640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3bec06be30 0x7f3bec06e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3c100b5200 tx=0x7f3bf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:56.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:56.887+0000 7f3c07e00640 1 -- 172.21.15.99:0/2059861196 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c00049030 con 0x7f3bf4003a00 2024-09-10T07:40:57.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.093+0000 7f3c16000640 1 -- 172.21.15.99:0/2059861196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c100d0550 con 0x7f3bf4003a00 2024-09-10T07:40:57.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.094+0000 7f3c07e00640 1 -- 172.21.15.99:0/2059861196 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7f3c0008e090 con 0x7f3bf4003a00 2024-09-10T07:40:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:57.094 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":66,"btime":"2024-09-10T07:40:25:708900+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/4097316027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4097316027},{"type":"v1","addr":"172.21.15.187:6834","nonce":4097316027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2128941619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2128941619},{"type":"v1","addr":"172.21.15.187:6835","nonce":2128941619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/722129971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":722129971},{"type":"v1","addr":"172.21.15.99:6835","nonce":722129971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:40:22.087139+0000","modified":"2024-09-10T07:40:25.118483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/1531136464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1531136464},{"type":"v1","addr":"172.21.15.99:6837","nonce":1531136464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6795,"qdb_cluster":[6795]},"id":8}]} 2024-09-10T07:40:57.095 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 66 2024-09-10T07:40:57.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.096+0000 7f3c16000640 1 -- 172.21.15.99:0/2059861196 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3bec06be30 msgr2=0x7f3bec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.096+0000 7f3c16000640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3bec06be30 0x7f3bec06e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3c100b5200 tx=0x7f3bf8008040 comp rx=0 tx=0).stop 2024-09-10T07:40:57.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.096+0000 7f3c16000640 1 -- 172.21.15.99:0/2059861196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 msgr2=0x7f3c10155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.096+0000 7f3c16000640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3c10155a00 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000c190 tx=0x7f3c00001970 comp rx=0 tx=0).stop 2024-09-10T07:40:57.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.096+0000 7f3c16000640 1 -- 172.21.15.99:0/2059861196 shutdown_connections 2024-09-10T07:40:57.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.096+0000 7f3c16000640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c100b9140 0x7f3c100ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.096+0000 7f3c16000640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c100c99b0 0x7f3c100b9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.096+0000 7f3c16000640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3bec06be30 0x7f3bec06e2f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.096+0000 7f3c16000640 1 --2- 172.21.15.99:0/2059861196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bf4003a00 0x7f3c10155a00 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.096+0000 7f3c16000640 1 -- 172.21.15.99:0/2059861196 >> 172.21.15.99:0/2059861196 conn(0x7f3c100d4bd0 msgr2=0x7f3c100b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:57.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.097+0000 7f3c16000640 1 -- 172.21.15.99:0/2059861196 shutdown_connections 2024-09-10T07:40:57.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.097+0000 7f3c16000640 1 -- 172.21.15.99:0/2059861196 wait complete. 2024-09-10T07:40:57.113 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:40:57.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.266+0000 7f9812200640 1 Processor -- start 2024-09-10T07:40:57.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.267+0000 7f9812200640 1 -- start start 2024-09-10T07:40:57.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f9812200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f980c13fae0 0x7f980c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f9812200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f980c142150 0x7f980c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f9812200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980c160a80 0x7f980c15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f9812200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f980c0ce780 con 0x7f980c13fae0 2024-09-10T07:40:57.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f9812200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f980c142650 con 0x7f980c142150 2024-09-10T07:40:57.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f9812200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f980c142930 con 0x7f980c160a80 2024-09-10T07:40:57.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f980b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f980c13fae0 0x7f980c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:57.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f980b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f980c13fae0 0x7f980c06f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55318/0 (socket says 172.21.15.99:55318) 2024-09-10T07:40:57.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f980b400640 1 -- 172.21.15.99:0/2737960894 learned_addr learned my addr 172.21.15.99:0/2737960894 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f980b400640 1 -- 172.21.15.99:0/2737960894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980c160a80 msgr2=0x7f980c15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f980b400640 1 --2- 172.21.15.99:0/2737960894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980c160a80 0x7f980c15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f980b400640 1 -- 172.21.15.99:0/2737960894 >> v2:172.21.15.187:3300/0 conn(0x7f980c142150 msgr2=0x7f980c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f980b400640 1 --2- 172.21.15.99:0/2737960894 >> v2:172.21.15.187:3300/0 conn(0x7f980c142150 0x7f980c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.268+0000 7f980b400640 1 -- 172.21.15.99:0/2737960894 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980c142c10 con 0x7f980c13fae0 2024-09-10T07:40:57.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.269+0000 7f980b400640 1 --2- 172.21.15.99:0/2737960894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 0x7f980c06f1b0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f980c075560 tx=0x7f97fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e516cd30e5e07a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:57.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f980aa00640 1 -- 172.21.15.99:0/2737960894 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc037070 con 0x7f980c13fae0 2024-09-10T07:40:57.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f980aa00640 1 -- 172.21.15.99:0/2737960894 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97fc032440 con 0x7f980c13fae0 2024-09-10T07:40:57.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f980aa00640 1 -- 172.21.15.99:0/2737960894 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc032810 con 0x7f980c13fae0 2024-09-10T07:40:57.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f9812200640 1 -- 172.21.15.99:0/2737960894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 msgr2=0x7f980c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f9812200640 1 --2- 172.21.15.99:0/2737960894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 0x7f980c06f1b0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f980c075560 tx=0x7f97fc02a140 comp rx=0 tx=0).stop 2024-09-10T07:40:57.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f9812200640 1 -- 172.21.15.99:0/2737960894 shutdown_connections 2024-09-10T07:40:57.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f9812200640 1 --2- 172.21.15.99:0/2737960894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980c160a80 0x7f980c15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f9812200640 1 --2- 172.21.15.99:0/2737960894 >> v2:172.21.15.187:3300/0 conn(0x7f980c142150 0x7f980c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f9812200640 1 --2- 172.21.15.99:0/2737960894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 0x7f980c06f1b0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f9812200640 1 -- 172.21.15.99:0/2737960894 >> 172.21.15.99:0/2737960894 conn(0x7f980c06bc10 msgr2=0x7f980c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:57.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f9812200640 1 -- 172.21.15.99:0/2737960894 shutdown_connections 2024-09-10T07:40:57.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.270+0000 7f9812200640 1 -- 172.21.15.99:0/2737960894 wait complete. 2024-09-10T07:40:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.272+0000 7f9812200640 1 Processor -- start 2024-09-10T07:40:57.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.272+0000 7f9812200640 1 -- start start 2024-09-10T07:40:57.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.273+0000 7f9812200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 0x7f980c143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.273+0000 7f9812200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980c142150 0x7f980c156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.273+0000 7f9812200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f980c160a80 0x7f980c144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.273+0000 7f9812200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f980c06f870 con 0x7f980c13fae0 2024-09-10T07:40:57.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.273+0000 7f9812200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f980c06f6f0 con 0x7f980c160a80 2024-09-10T07:40:57.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.273+0000 7f9812200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f980c15d490 con 0x7f980c142150 2024-09-10T07:40:57.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.273+0000 7f980b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 0x7f980c143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:57.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.273+0000 7f980b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 0x7f980c143d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55326/0 (socket says 172.21.15.99:55326) 2024-09-10T07:40:57.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.273+0000 7f980b400640 1 -- 172.21.15.99:0/4106456878 learned_addr learned my addr 172.21.15.99:0/4106456878 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f980b400640 1 -- 172.21.15.99:0/4106456878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980c142150 msgr2=0x7f980c156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f980b400640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980c142150 0x7f980c156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f980b400640 1 -- 172.21.15.99:0/4106456878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f980c160a80 msgr2=0x7f980c144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f980b400640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f980c160a80 0x7f980c144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f980b400640 1 -- 172.21.15.99:0/4106456878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980c156880 con 0x7f980c13fae0 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f980b400640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 0x7f980c143d00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f97fc000c00 tx=0x7f97fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f9803e00640 1 -- 172.21.15.99:0/4106456878 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc041070 con 0x7f980c13fae0 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f9803e00640 1 -- 172.21.15.99:0/4106456878 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97fc03c890 con 0x7f980c13fae0 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f9812200640 1 -- 172.21.15.99:0/4106456878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980c143260 con 0x7f980c13fae0 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f9803e00640 1 -- 172.21.15.99:0/4106456878 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc037040 con 0x7f980c13fae0 2024-09-10T07:40:57.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.274+0000 7f9812200640 1 -- 172.21.15.99:0/4106456878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f980c143500 con 0x7f980c13fae0 2024-09-10T07:40:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.276+0000 7f9812200640 1 -- 172.21.15.99:0/4106456878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f980c160540 con 0x7f980c13fae0 2024-09-10T07:40:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.276+0000 7f9803e00640 1 -- 172.21.15.99:0/4106456878 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97fc044070 con 0x7f980c13fae0 2024-09-10T07:40:57.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.277+0000 7f9803e00640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f97e806be30 0x7f97e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.277+0000 7f9803e00640 1 -- 172.21.15.99:0/4106456878 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f97fc0abdd0 con 0x7f980c13fae0 2024-09-10T07:40:57.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.277+0000 7f9802a00640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f97e806be30 0x7f97e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:57.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.277+0000 7f9803e00640 1 -- 172.21.15.99:0/4106456878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=144}) -- 0x7f97e8073960 con 0x7f980c13fae0 2024-09-10T07:40:57.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.278+0000 7f9802a00640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f97e806be30 0x7f97e806e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f980c13f3c0 tx=0x7f97f4006c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:57.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.281+0000 7f9803e00640 1 -- 172.21.15.99:0/4106456878 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97fc0ad060 con 0x7f980c13fae0 2024-09-10T07:40:57.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.456+0000 7f9812200640 1 -- 172.21.15.99:0/4106456878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f980c0ccf00 con 0x7f980c13fae0 2024-09-10T07:40:57.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.457+0000 7f9803e00640 1 -- 172.21.15.99:0/4106456878 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16690 (secure 0 0 0) 0x7f97fc07a930 con 0x7f980c13fae0 2024-09-10T07:40:57.457 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:40:57.458 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":143,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:40:56.757861+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:40:19.848847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T07:40:21.080608+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:40:57.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.459+0000 7f9812200640 1 -- 172.21.15.99:0/4106456878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f97e806be30 msgr2=0x7f97e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.459+0000 7f9812200640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f97e806be30 0x7f97e806e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f980c13f3c0 tx=0x7f97f4006c90 comp rx=0 tx=0).stop 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.459+0000 7f9812200640 1 -- 172.21.15.99:0/4106456878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 msgr2=0x7f980c143d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.459+0000 7f9812200640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 0x7f980c143d00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f97fc000c00 tx=0x7f97fc0046c0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.460+0000 7f9812200640 1 -- 172.21.15.99:0/4106456878 shutdown_connections 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.460+0000 7f9812200640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f980c160a80 0x7f980c144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.460+0000 7f9812200640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980c142150 0x7f980c156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.460+0000 7f9812200640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f97e806be30 0x7f97e806e2f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.460+0000 7f9812200640 1 --2- 172.21.15.99:0/4106456878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f980c13fae0 0x7f980c143d00 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.460+0000 7f9812200640 1 -- 172.21.15.99:0/4106456878 >> 172.21.15.99:0/4106456878 conn(0x7f980c06bc10 msgr2=0x7f980c15f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.460+0000 7f9812200640 1 -- 172.21.15.99:0/4106456878 shutdown_connections 2024-09-10T07:40:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.460+0000 7f9812200640 1 -- 172.21.15.99:0/4106456878 wait complete. 2024-09-10T07:40:57.475 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:40:57.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.633+0000 7f7090a00640 1 Processor -- start 2024-09-10T07:40:57.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.633+0000 7f7090a00640 1 -- start start 2024-09-10T07:40:57.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.634+0000 7f7090a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f708c0cf890 0x7f708c0cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.634+0000 7f7090a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f708c15d880 con 0x7f708c0b5750 2024-09-10T07:40:57.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.634+0000 7f7090a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f708c15c800 con 0x7f708c0ce070 2024-09-10T07:40:57.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.634+0000 7f7090a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f708c0b5bb0 con 0x7f708c0cf890 2024-09-10T07:40:57.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.634+0000 7f708a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f708c0cf890 0x7f708c0cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:57.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.634+0000 7f708a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f708c0cf890 0x7f708c0cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55334/0 (socket says 172.21.15.99:55334) 2024-09-10T07:40:57.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.634+0000 7f708a800640 1 -- 172.21.15.99:0/3187898145 learned_addr learned my addr 172.21.15.99:0/3187898145 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.634+0000 7f7081400640 1 --1- 172.21.15.99:0/3187898145 >> v1:172.21.15.99:6789/0 conn(0x7f708c0b5750 0x7f708c15d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52726/0 (socket says 172.21.15.99:52726) 2024-09-10T07:40:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.635+0000 7f708a800640 1 -- 172.21.15.99:0/3187898145 >> v1:172.21.15.187:6789/0 conn(0x7f708c0ce070 legacy=0x7f708c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.635+0000 7f708a800640 1 -- 172.21.15.99:0/3187898145 >> v1:172.21.15.99:6789/0 conn(0x7f708c0b5750 legacy=0x7f708c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.635+0000 7f708a800640 1 -- 172.21.15.99:0/3187898145 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c15cae0 con 0x7f708c0cf890 2024-09-10T07:40:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.636+0000 7f708a800640 1 --2- 172.21.15.99:0/3187898145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 0x7f708c0cfd00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f7084009e50 tx=0x7f708402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506ef4ff8772e975 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:57.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.636+0000 7f7089400640 1 -- 172.21.15.99:0/3187898145 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084036070 con 0x7f708c0cf890 2024-09-10T07:40:57.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.636+0000 7f7089400640 1 -- 172.21.15.99:0/3187898145 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7084031600 con 0x7f708c0cf890 2024-09-10T07:40:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.636+0000 7f7089400640 1 -- 172.21.15.99:0/3187898145 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70840319f0 con 0x7f708c0cf890 2024-09-10T07:40:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.637+0000 7f7090a00640 1 -- 172.21.15.99:0/3187898145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 msgr2=0x7f708c0cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.637+0000 7f7090a00640 1 --2- 172.21.15.99:0/3187898145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 0x7f708c0cfd00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f7084009e50 tx=0x7f708402a7c0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.637+0000 7f7090a00640 1 -- 172.21.15.99:0/3187898145 shutdown_connections 2024-09-10T07:40:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.637+0000 7f7090a00640 1 --2- 172.21.15.99:0/3187898145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 0x7f708c0cfd00 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.637+0000 7f7090a00640 1 -- 172.21.15.99:0/3187898145 >> 172.21.15.99:0/3187898145 conn(0x7f708c0b2630 msgr2=0x7f708c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.637+0000 7f7090a00640 1 -- 172.21.15.99:0/3187898145 shutdown_connections 2024-09-10T07:40:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.637+0000 7f7090a00640 1 -- 172.21.15.99:0/3187898145 wait complete. 2024-09-10T07:40:57.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.638+0000 7f7090a00640 1 Processor -- start 2024-09-10T07:40:57.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.639+0000 7f7090a00640 1 -- start start 2024-09-10T07:40:57.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.639+0000 7f7090a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0b5750 0x7f708c15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.639+0000 7f7090a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c0ce070 0x7f708c071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.639+0000 7f7090a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 0x7f708c0af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.639+0000 7f7090a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f708c0ce450 con 0x7f708c0cf890 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.639+0000 7f7090a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f708c0d0240 con 0x7f708c0ce070 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.639+0000 7f7090a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f708c06e080 con 0x7f708c0b5750 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f708a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 0x7f708c0af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f708a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 0x7f708c0af480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55346/0 (socket says 172.21.15.99:55346) 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f708a800640 1 -- 172.21.15.99:0/2051389056 learned_addr learned my addr 172.21.15.99:0/2051389056 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f7089e00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0b5750 0x7f708c15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f708a800640 1 -- 172.21.15.99:0/2051389056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0b5750 msgr2=0x7f708c15b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f7081400640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c0ce070 0x7f708c071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f708a800640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0b5750 0x7f708c15b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f708a800640 1 -- 172.21.15.99:0/2051389056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c0ce070 msgr2=0x7f708c071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f708a800640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c0ce070 0x7f708c071510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f708a800640 1 -- 172.21.15.99:0/2051389056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c071ed0 con 0x7f708c0cf890 2024-09-10T07:40:57.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f7089e00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0b5750 0x7f708c15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:57.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f7081400640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c0ce070 0x7f708c071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:57.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.640+0000 7f708a800640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 0x7f708c0af480 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f7084034040 tx=0x7f7084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:57.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.641+0000 7f7082a00640 1 -- 172.21.15.99:0/2051389056 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084036050 con 0x7f708c0cf890 2024-09-10T07:40:57.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.641+0000 7f7082a00640 1 -- 172.21.15.99:0/2051389056 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7084042070 con 0x7f708c0cf890 2024-09-10T07:40:57.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.641+0000 7f7082a00640 1 -- 172.21.15.99:0/2051389056 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084009510 con 0x7f708c0cf890 2024-09-10T07:40:57.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.641+0000 7f7090a00640 1 -- 172.21.15.99:0/2051389056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708c0721b0 con 0x7f708c0cf890 2024-09-10T07:40:57.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.641+0000 7f7090a00640 1 -- 172.21.15.99:0/2051389056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708c072770 con 0x7f708c0cf890 2024-09-10T07:40:57.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.642+0000 7f7090a00640 1 -- 172.21.15.99:0/2051389056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708c06ed20 con 0x7f708c0cf890 2024-09-10T07:40:57.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.643+0000 7f7082a00640 1 -- 172.21.15.99:0/2051389056 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7084004450 con 0x7f708c0cf890 2024-09-10T07:40:57.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.644+0000 7f7082a00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 0x7f706806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:57.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.644+0000 7f7082a00640 1 -- 172.21.15.99:0/2051389056 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f70840abe50 con 0x7f708c0cf890 2024-09-10T07:40:57.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.644+0000 7f7082a00640 1 -- 172.21.15.99:0/2051389056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=144}) -- 0x7f70680739c0 con 0x7f708c0cf890 2024-09-10T07:40:57.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.644+0000 7f7089e00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 0x7f706806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:57.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.645+0000 7f7089e00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 0x7f706806e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f707c000f60 tx=0x7f707c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:57.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.648+0000 7f7082a00640 1 -- 172.21.15.99:0/2051389056 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f708c06ed20 con 0x7f708c0cf890 2024-09-10T07:40:57.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.855+0000 7f7090a00640 1 -- 172.21.15.99:0/2051389056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f708c0d0420 con 0x7f708c0cf890 2024-09-10T07:40:57.856 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:40:57.856+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:40:57.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.858+0000 7f7082a00640 1 -- 172.21.15.99:0/2051389056 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) ==== 161+0+0 (secure 0 0 0) 0x7f708407a770 con 0x7f708c0cf890 2024-09-10T07:40:57.858 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:40:57.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.859+0000 7f7082a00640 1 -- 172.21.15.99:0/2051389056 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(144..144 src has 1..144) ==== 374+0+0 (secure 0 0 0) 0x7f70840aa490 con 0x7f708c0cf890 2024-09-10T07:40:57.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.859+0000 7f7082a00640 1 -- 172.21.15.99:0/2051389056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=145}) -- 0x7f7068074330 con 0x7f708c0cf890 2024-09-10T07:40:57.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.862+0000 7f7090a00640 1 -- 172.21.15.99:0/2051389056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 msgr2=0x7f706806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.862+0000 7f7090a00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 0x7f706806e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f707c000f60 tx=0x7f707c009040 comp rx=0 tx=0).stop 2024-09-10T07:40:57.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.862+0000 7f7090a00640 1 -- 172.21.15.99:0/2051389056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 msgr2=0x7f708c0af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:57.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.862+0000 7f7090a00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 0x7f708c0af480 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f7084034040 tx=0x7f7084004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:57.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.862+0000 7f7090a00640 1 -- 172.21.15.99:0/2051389056 shutdown_connections 2024-09-10T07:40:57.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.862+0000 7f7090a00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 0x7f706806e2f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.862+0000 7f7090a00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0cf890 0x7f708c0af480 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.862+0000 7f7090a00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c0ce070 0x7f708c071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.862+0000 7f7090a00640 1 --2- 172.21.15.99:0/2051389056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0b5750 0x7f708c15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:57.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.862+0000 7f7090a00640 1 -- 172.21.15.99:0/2051389056 >> 172.21.15.99:0/2051389056 conn(0x7f708c0b2630 msgr2=0x7f708c153f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:57.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.863+0000 7f7090a00640 1 -- 172.21.15.99:0/2051389056 shutdown_connections 2024-09-10T07:40:57.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:57.863+0000 7f7090a00640 1 -- 172.21.15.99:0/2051389056 wait complete. 2024-09-10T07:40:57.872 INFO:tasks.ceph.mds.a.smithi099.stderr: -9479> 2024-09-10T07:40:24.657+0000 7fd078e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:40:57.879 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:40:57.926 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:40:58.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.036+0000 7ff03ec00640 1 Processor -- start 2024-09-10T07:40:58.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.036+0000 7ff03ec00640 1 -- start start 2024-09-10T07:40:58.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff03806e280 0x7ff038073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:58.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff03ec00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0380722d0 con 0x7ff038071df0 2024-09-10T07:40:58.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff03ec00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0380725b0 con 0x7ff0380d1010 2024-09-10T07:40:58.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff03ec00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff0380738b0 con 0x7ff03806e280 2024-09-10T07:40:58.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff037400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff038071df0 0x7ff03806e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52742/0 (socket says 172.21.15.99:52742) 2024-09-10T07:40:58.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff037400640 1 -- 172.21.15.99:0/3774868797 learned_addr learned my addr 172.21.15.99:0/3774868797 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:58.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff037e00640 1 --2- 172.21.15.99:0/3774868797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff03806e280 0x7ff038073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:58.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff036a00640 1 -- 172.21.15.99:0/3774868797 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157996002 0 0) 0x7ff0380722d0 con 0x7ff038071df0 2024-09-10T07:40:58.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff037e00640 1 -- 172.21.15.99:0/3774868797 >> v1:172.21.15.187:6789/0 conn(0x7ff0380d1010 legacy=0x7ff0380ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:58.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff037e00640 1 -- 172.21.15.99:0/3774868797 >> v1:172.21.15.99:6789/0 conn(0x7ff038071df0 legacy=0x7ff03806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:58.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.038+0000 7ff037e00640 1 -- 172.21.15.99:0/3774868797 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff038072890 con 0x7ff03806e280 2024-09-10T07:40:58.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.039+0000 7ff037e00640 1 --2- 172.21.15.99:0/3774868797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff03806e280 0x7ff038073370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff028009dc0 tx=0x7ff02802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23aad3d939c9ef9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:58.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.040+0000 7ff036a00640 1 -- 172.21.15.99:0/3774868797 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028007740 con 0x7ff03806e280 2024-09-10T07:40:58.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.040+0000 7ff036a00640 1 -- 172.21.15.99:0/3774868797 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0280078e0 con 0x7ff03806e280 2024-09-10T07:40:58.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.040+0000 7ff036a00640 1 -- 172.21.15.99:0/3774868797 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028007cb0 con 0x7ff03806e280 2024-09-10T07:40:58.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.040+0000 7ff03ec00640 1 -- 172.21.15.99:0/3774868797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff03806e280 msgr2=0x7ff038073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:58.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.040+0000 7ff03ec00640 1 --2- 172.21.15.99:0/3774868797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff03806e280 0x7ff038073370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff028009dc0 tx=0x7ff02802a6f0 comp rx=0 tx=0).stop 2024-09-10T07:40:58.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.040+0000 7ff03ec00640 1 -- 172.21.15.99:0/3774868797 shutdown_connections 2024-09-10T07:40:58.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.040+0000 7ff03ec00640 1 --2- 172.21.15.99:0/3774868797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff03806e280 0x7ff038073370 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:58.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.040+0000 7ff03ec00640 1 -- 172.21.15.99:0/3774868797 >> 172.21.15.99:0/3774868797 conn(0x7ff03806bc10 msgr2=0x7ff03806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:58.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.041+0000 7ff03ec00640 1 -- 172.21.15.99:0/3774868797 shutdown_connections 2024-09-10T07:40:58.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.041+0000 7ff03ec00640 1 -- 172.21.15.99:0/3774868797 wait complete. 2024-09-10T07:40:58.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.042+0000 7ff03ec00640 1 Processor -- start 2024-09-10T07:40:58.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.042+0000 7ff03ec00640 1 -- start start 2024-09-10T07:40:58.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.043+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff03806e280 0x7ff038153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:58.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.043+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff038071df0 0x7ff038150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:58.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.043+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0380d1010 0x7ff0381f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:58.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.043+0000 7ff03ec00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff03815db60 con 0x7ff0380d1010 2024-09-10T07:40:58.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.043+0000 7ff03ec00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff038072e50 con 0x7ff03806e280 2024-09-10T07:40:58.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.043+0000 7ff03ec00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff0380d14c0 con 0x7ff038071df0 2024-09-10T07:40:58.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.043+0000 7ff03cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0380d1010 0x7ff0381f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:58.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.043+0000 7ff03cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0380d1010 0x7ff0381f7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55386/0 (socket says 172.21.15.99:55386) 2024-09-10T07:40:58.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.043+0000 7ff03cc00640 1 -- 172.21.15.99:0/669854328 learned_addr learned my addr 172.21.15.99:0/669854328 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:58.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff037400640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff038071df0 0x7ff038150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff037e00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff03806e280 0x7ff038153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff03cc00640 1 -- 172.21.15.99:0/669854328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff038071df0 msgr2=0x7ff038150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff03cc00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff038071df0 0x7ff038150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff03cc00640 1 -- 172.21.15.99:0/669854328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff03806e280 msgr2=0x7ff038153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff03cc00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff03806e280 0x7ff038153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff03cc00640 1 -- 172.21.15.99:0/669854328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0381508d0 con 0x7ff0380d1010 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff037e00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff03806e280 0x7ff038153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff03cc00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0380d1010 0x7ff0381f7db0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ff03000c390 tx=0x7ff03000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff02fe00640 1 -- 172.21.15.99:0/669854328 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030017070 con 0x7ff0380d1010 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff02fe00640 1 -- 172.21.15.99:0/669854328 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0300052d0 con 0x7ff0380d1010 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff02fe00640 1 -- 172.21.15.99:0/669854328 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030003810 con 0x7ff0380d1010 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.044+0000 7ff03ec00640 1 -- 172.21.15.99:0/669854328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0381f82f0 con 0x7ff0380d1010 2024-09-10T07:40:58.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.045+0000 7ff03ec00640 1 -- 172.21.15.99:0/669854328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0381f8870 con 0x7ff0380d1010 2024-09-10T07:40:58.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.046+0000 7ff03ec00640 1 -- 172.21.15.99:0/669854328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff038073370 con 0x7ff0380d1010 2024-09-10T07:40:58.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.046+0000 7ff02fe00640 1 -- 172.21.15.99:0/669854328 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff03001a070 con 0x7ff0380d1010 2024-09-10T07:40:58.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.047+0000 7ff02fe00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:58.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.047+0000 7ff02fe00640 1 -- 172.21.15.99:0/669854328 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5795+0+0 (secure 0 0 0) 0x7ff03008a260 con 0x7ff0380d1010 2024-09-10T07:40:58.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.048+0000 7ff037e00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:58.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.048+0000 7ff02fe00640 1 -- 172.21.15.99:0/669854328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=145}) -- 0x7ff018073a70 con 0x7ff0380d1010 2024-09-10T07:40:58.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.048+0000 7ff037e00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff01806be30 0x7ff01806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff028034000 tx=0x7ff02802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:58.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.052+0000 7ff02fe00640 1 -- 172.21.15.99:0/669854328 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0381508d0 con 0x7ff0380d1010 2024-09-10T07:40:58.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.260+0000 7ff03ec00640 1 -- 172.21.15.99:0/669854328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff0380cfd50 con 0x7ff0380d1010 2024-09-10T07:40:58.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.884+0000 7ff02fe00640 1 -- 172.21.15.99:0/669854328 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) ==== 104+0+0 (secure 0 0 0) 0x7ff030058b10 con 0x7ff0380d1010 2024-09-10T07:40:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 -- 172.21.15.99:0/669854328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff01806be30 msgr2=0x7ff01806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff01806be30 0x7ff01806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff028034000 tx=0x7ff02802f000 comp rx=0 tx=0).stop 2024-09-10T07:40:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 -- 172.21.15.99:0/669854328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0380d1010 msgr2=0x7ff0381f7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0380d1010 0x7ff0381f7db0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ff03000c390 tx=0x7ff03000c850 comp rx=0 tx=0).stop 2024-09-10T07:40:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 -- 172.21.15.99:0/669854328 shutdown_connections 2024-09-10T07:40:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0380d1010 0x7ff0381f7db0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff038071df0 0x7ff038150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 --2- 172.21.15.99:0/669854328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff03806e280 0x7ff038153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 -- 172.21.15.99:0/669854328 >> 172.21.15.99:0/669854328 conn(0x7ff03806bc10 msgr2=0x7ff0380b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 -- 172.21.15.99:0/669854328 shutdown_connections 2024-09-10T07:40:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:58.887+0000 7ff03ec00640 1 -- 172.21.15.99:0/669854328 wait complete. 2024-09-10T07:40:58.905 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:40:59.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.064+0000 7f4221600640 1 Processor -- start 2024-09-10T07:40:59.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.065+0000 7f4221600640 1 -- start start 2024-09-10T07:40:59.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.066+0000 7f4221600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f421c06e2d0 0x7f421c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:59.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.066+0000 7f4221600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f421c072af0 0x7f421c072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:59.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.066+0000 7f4221600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f421c0734c0 con 0x7f421c06e6b0 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.066+0000 7f4221600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f421c071840 con 0x7f421c072af0 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.066+0000 7f4221600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f421c071b20 con 0x7f421c06e2d0 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.066+0000 7f4220c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f421c072af0 0x7f421c072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.066+0000 7f421b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f421c06e6b0 0x7f421c0b4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52750/0 (socket says 172.21.15.99:52750) 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.066+0000 7f421b400640 1 -- 172.21.15.99:0/3665108466 learned_addr learned my addr 172.21.15.99:0/3665108466 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.066+0000 7f421be00640 1 --2- 172.21.15.99:0/3665108466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f421c06e2d0 0x7f421c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.067+0000 7f4220c00640 1 -- 172.21.15.99:0/3665108466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f421c06e2d0 msgr2=0x7f421c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.067+0000 7f4220c00640 1 --2- 172.21.15.99:0/3665108466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f421c06e2d0 0x7f421c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.067+0000 7f4220c00640 1 -- 172.21.15.99:0/3665108466 >> v1:172.21.15.99:6789/0 conn(0x7f421c06e6b0 legacy=0x7f421c0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.067+0000 7f421aa00640 1 -- 172.21.15.99:0/3665108466 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168283614 0 0) 0x7f421c0734c0 con 0x7f421c06e6b0 2024-09-10T07:40:59.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.067+0000 7f4220c00640 1 -- 172.21.15.99:0/3665108466 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c072310 con 0x7f421c072af0 2024-09-10T07:40:59.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.068+0000 7f4220c00640 1 --2- 172.21.15.99:0/3665108466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 0x7f421c072f80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f4214009d90 tx=0x7f421402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a988d2758541b18e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:59.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.068+0000 7f421aa00640 1 -- 172.21.15.99:0/3665108466 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214031600 con 0x7f421c072af0 2024-09-10T07:40:59.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.068+0000 7f421aa00640 1 -- 172.21.15.99:0/3665108466 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42140317a0 con 0x7f421c072af0 2024-09-10T07:40:59.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.068+0000 7f421aa00640 1 -- 172.21.15.99:0/3665108466 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214031b70 con 0x7f421c072af0 2024-09-10T07:40:59.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.068+0000 7f4221600640 1 -- 172.21.15.99:0/3665108466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 msgr2=0x7f421c072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:59.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.068+0000 7f4221600640 1 --2- 172.21.15.99:0/3665108466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 0x7f421c072f80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f4214009d90 tx=0x7f421402a5d0 comp rx=0 tx=0).stop 2024-09-10T07:40:59.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.068+0000 7f4221600640 1 -- 172.21.15.99:0/3665108466 shutdown_connections 2024-09-10T07:40:59.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.068+0000 7f4221600640 1 --2- 172.21.15.99:0/3665108466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 0x7f421c072f80 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:59.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.068+0000 7f4221600640 1 --2- 172.21.15.99:0/3665108466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f421c06e2d0 0x7f421c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:59.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.068+0000 7f4221600640 1 -- 172.21.15.99:0/3665108466 >> 172.21.15.99:0/3665108466 conn(0x7f421c06bc10 msgr2=0x7f421c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:59.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.069+0000 7f4221600640 1 -- 172.21.15.99:0/3665108466 shutdown_connections 2024-09-10T07:40:59.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.069+0000 7f4221600640 1 -- 172.21.15.99:0/3665108466 wait complete. 2024-09-10T07:40:59.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.070+0000 7f4221600640 1 Processor -- start 2024-09-10T07:40:59.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.070+0000 7f4221600640 1 -- start start 2024-09-10T07:40:59.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.071+0000 7f4221600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f421c06e2d0 0x7f421c143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:59.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.071+0000 7f4221600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f421c06e6b0 0x7f421c14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:59.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.071+0000 7f4221600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 0x7f421c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:59.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.071+0000 7f4221600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f421c06d0d0 con 0x7f421c072af0 2024-09-10T07:40:59.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.071+0000 7f4221600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f421c06cf50 con 0x7f421c06e6b0 2024-09-10T07:40:59.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.071+0000 7f4221600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f421c06d250 con 0x7f421c06e2d0 2024-09-10T07:40:59.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f4220c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 0x7f421c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:59.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f4220c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 0x7f421c0ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55394/0 (socket says 172.21.15.99:55394) 2024-09-10T07:40:59.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f4220c00640 1 -- 172.21.15.99:0/615965764 learned_addr learned my addr 172.21.15.99:0/615965764 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:40:59.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f421be00640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f421c06e2d0 0x7f421c143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:59.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f421b400640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f421c06e6b0 0x7f421c14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:59.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f4220c00640 1 -- 172.21.15.99:0/615965764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f421c06e2d0 msgr2=0x7f421c143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:59.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f4220c00640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f421c06e2d0 0x7f421c143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:59.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f4220c00640 1 -- 172.21.15.99:0/615965764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f421c06e6b0 msgr2=0x7f421c14b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:59.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f4220c00640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f421c06e6b0 0x7f421c14b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:59.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f4220c00640 1 -- 172.21.15.99:0/615965764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c1441f0 con 0x7f421c072af0 2024-09-10T07:40:59.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.072+0000 7f4220c00640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 0x7f421c0ae870 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f4214009d90 tx=0x7f4214004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:59.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.073+0000 7f4213e00640 1 -- 172.21.15.99:0/615965764 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421403f070 con 0x7f421c072af0 2024-09-10T07:40:59.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.073+0000 7f4213e00640 1 -- 172.21.15.99:0/615965764 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4214030b60 con 0x7f421c072af0 2024-09-10T07:40:59.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.073+0000 7f4221600640 1 -- 172.21.15.99:0/615965764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421c149550 con 0x7f421c072af0 2024-09-10T07:40:59.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.073+0000 7f4213e00640 1 -- 172.21.15.99:0/615965764 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214009450 con 0x7f421c072af0 2024-09-10T07:40:59.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.073+0000 7f4221600640 1 -- 172.21.15.99:0/615965764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f421c149b10 con 0x7f421c072af0 2024-09-10T07:40:59.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.074+0000 7f4221600640 1 -- 172.21.15.99:0/615965764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421c0afd80 con 0x7f421c072af0 2024-09-10T07:40:59.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.075+0000 7f4213e00640 1 -- 172.21.15.99:0/615965764 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f421403b410 con 0x7f421c072af0 2024-09-10T07:40:59.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.076+0000 7f4213e00640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41fc06be60 0x7f41fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:40:59.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.076+0000 7f4213e00640 1 -- 172.21.15.99:0/615965764 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5795+0+0 (secure 0 0 0) 0x7f42140ac090 con 0x7f421c072af0 2024-09-10T07:40:59.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.076+0000 7f421be00640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41fc06be60 0x7f41fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:40:59.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.076+0000 7f4213e00640 1 -- 172.21.15.99:0/615965764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=145}) -- 0x7f41fc073aa0 con 0x7f421c072af0 2024-09-10T07:40:59.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.076+0000 7f421be00640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41fc06be60 0x7f41fc06e320 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f420c006fd0 tx=0x7f420c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:40:59.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.080+0000 7f4213e00640 1 -- 172.21.15.99:0/615965764 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f421407a2f0 con 0x7f421c072af0 2024-09-10T07:40:59.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.252+0000 7f4221600640 1 -- 172.21.15.99:0/615965764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f421c071f10 con 0x7f421c072af0 2024-09-10T07:40:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.887+0000 7f4213e00640 1 -- 172.21.15.99:0/615965764 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v145) ==== 181+0+0 (secure 0 0 0) 0x7f421407e5f0 con 0x7f421c072af0 2024-09-10T07:40:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:40:59.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.890+0000 7f4221600640 1 -- 172.21.15.99:0/615965764 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41fc06be60 msgr2=0x7f41fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:59.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.890+0000 7f4221600640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41fc06be60 0x7f41fc06e320 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f420c006fd0 tx=0x7f420c008040 comp rx=0 tx=0).stop 2024-09-10T07:40:59.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.890+0000 7f4221600640 1 -- 172.21.15.99:0/615965764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 msgr2=0x7f421c0ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:40:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.890+0000 7f4221600640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 0x7f421c0ae870 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f4214009d90 tx=0x7f4214004a40 comp rx=0 tx=0).stop 2024-09-10T07:40:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.890+0000 7f4221600640 1 -- 172.21.15.99:0/615965764 shutdown_connections 2024-09-10T07:40:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.890+0000 7f4221600640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41fc06be60 0x7f41fc06e320 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.890+0000 7f4221600640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f421c072af0 0x7f421c0ae870 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.890+0000 7f4221600640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f421c06e6b0 0x7f421c14b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.890+0000 7f4221600640 1 --2- 172.21.15.99:0/615965764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f421c06e2d0 0x7f421c143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:40:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.890+0000 7f4221600640 1 -- 172.21.15.99:0/615965764 >> 172.21.15.99:0/615965764 conn(0x7f421c06bc10 msgr2=0x7f421c0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:40:59.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.892+0000 7f4221600640 1 -- 172.21.15.99:0/615965764 shutdown_connections 2024-09-10T07:40:59.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:40:59.893+0000 7f4221600640 1 -- 172.21.15.99:0/615965764 wait complete. 2024-09-10T07:40:59.915 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:41:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.073+0000 7fb69ae00640 1 Processor -- start 2024-09-10T07:41:00.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.073+0000 7fb69ae00640 1 -- start start 2024-09-10T07:41:00.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.074+0000 7fb69ae00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb69415ed00 0x7fb6940d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:00.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.074+0000 7fb69ae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6940d3880 con 0x7fb6940d2000 2024-09-10T07:41:00.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.074+0000 7fb69ae00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6940b7b90 con 0x7fb6940d1a90 2024-09-10T07:41:00.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.074+0000 7fb69ae00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb6940b7e70 con 0x7fb69415ed00 2024-09-10T07:41:00.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.074+0000 7fb693400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb6940d2000 0x7fb6940d1380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50268/0 (socket says 172.21.15.99:50268) 2024-09-10T07:41:00.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.074+0000 7fb693400640 1 -- 172.21.15.99:0/2198334130 learned_addr learned my addr 172.21.15.99:0/2198334130 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:00.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.075+0000 7fb693e00640 1 --2- 172.21.15.99:0/2198334130 >> v2:172.21.15.187:3300/0 conn(0x7fb69415ed00 0x7fb6940d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:00.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.075+0000 7fb692a00640 1 -- 172.21.15.99:0/2198334130 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105057502 0 0) 0x7fb6940d3880 con 0x7fb6940d2000 2024-09-10T07:41:00.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.075+0000 7fb692a00640 1 -- 172.21.15.99:0/2198334130 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb678003520 con 0x7fb6940d2000 2024-09-10T07:41:00.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.075+0000 7fb692a00640 1 -- 172.21.15.99:0/2198334130 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499982223 0 0) 0x7fb6940b7b90 con 0x7fb6940d1a90 2024-09-10T07:41:00.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.075+0000 7fb692a00640 1 -- 172.21.15.99:0/2198334130 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6940d3880 con 0x7fb6940d1a90 2024-09-10T07:41:00.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.075+0000 7fb692a00640 1 -- 172.21.15.99:0/2198334130 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2033845756 0 0) 0x7fb678003520 con 0x7fb6940d2000 2024-09-10T07:41:00.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.075+0000 7fb693e00640 1 -- 172.21.15.99:0/2198334130 >> v1:172.21.15.187:6789/0 conn(0x7fb6940d1a90 legacy=0x7fb6940b8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:00.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.075+0000 7fb693e00640 1 -- 172.21.15.99:0/2198334130 >> v1:172.21.15.99:6789/0 conn(0x7fb6940d2000 legacy=0x7fb6940d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:00.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.075+0000 7fb693e00640 1 -- 172.21.15.99:0/2198334130 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6940b8150 con 0x7fb69415ed00 2024-09-10T07:41:00.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.076+0000 7fb693e00640 1 --2- 172.21.15.99:0/2198334130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb69415ed00 0x7fb6940d31f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb684009d90 tx=0x7fb68402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb8cf0a755e71b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:00.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.076+0000 7fb692a00640 1 -- 172.21.15.99:0/2198334130 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0015f0 con 0x7fb69415ed00 2024-09-10T07:41:00.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.076+0000 7fb692a00640 1 -- 172.21.15.99:0/2198334130 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb684007540 con 0x7fb69415ed00 2024-09-10T07:41:00.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.076+0000 7fb692a00640 1 -- 172.21.15.99:0/2198334130 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb684007910 con 0x7fb69415ed00 2024-09-10T07:41:00.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.077+0000 7fb69ae00640 1 -- 172.21.15.99:0/2198334130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb69415ed00 msgr2=0x7fb6940d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:00.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.077+0000 7fb69ae00640 1 --2- 172.21.15.99:0/2198334130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb69415ed00 0x7fb6940d31f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb684009d90 tx=0x7fb68402a5f0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.077+0000 7fb69ae00640 1 -- 172.21.15.99:0/2198334130 shutdown_connections 2024-09-10T07:41:00.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.077+0000 7fb69ae00640 1 --2- 172.21.15.99:0/2198334130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb69415ed00 0x7fb6940d31f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.077+0000 7fb69ae00640 1 -- 172.21.15.99:0/2198334130 >> 172.21.15.99:0/2198334130 conn(0x7fb6940d4c10 msgr2=0x7fb6940d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:00.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.077+0000 7fb69ae00640 1 -- 172.21.15.99:0/2198334130 shutdown_connections 2024-09-10T07:41:00.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.077+0000 7fb69ae00640 1 -- 172.21.15.99:0/2198334130 wait complete. 2024-09-10T07:41:00.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.079+0000 7fb69ae00640 1 Processor -- start 2024-09-10T07:41:00.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.079+0000 7fb69ae00640 1 -- start start 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb69ae00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6940d1a90 0x7fb6941f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb69ae00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6940d2000 0x7fb6941f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb69ae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb69415ed00 0x7fb6940b9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb69ae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb69415f0e0 con 0x7fb69415ed00 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb69ae00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb6940d2490 con 0x7fb6940d2000 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb69ae00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb69415f260 con 0x7fb6940d1a90 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb698e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb69415ed00 0x7fb6940b9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb698e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb69415ed00 0x7fb6940b9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46456/0 (socket says 172.21.15.99:46456) 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb698e00640 1 -- 172.21.15.99:0/551706225 learned_addr learned my addr 172.21.15.99:0/551706225 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb693400640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6940d2000 0x7fb6941f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb693e00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6940d1a90 0x7fb6941f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:00.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb698e00640 1 -- 172.21.15.99:0/551706225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6940d1a90 msgr2=0x7fb6941f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb698e00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6940d1a90 0x7fb6941f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb698e00640 1 -- 172.21.15.99:0/551706225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6940d2000 msgr2=0x7fb6941f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb698e00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6940d2000 0x7fb6941f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb698e00640 1 -- 172.21.15.99:0/551706225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6941f4b20 con 0x7fb69415ed00 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.080+0000 7fb693e00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6940d1a90 0x7fb6941f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.081+0000 7fb698e00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb69415ed00 0x7fb6940b9d70 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c4c0 tx=0x7fb68c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.081+0000 7fb68be00640 1 -- 172.21.15.99:0/551706225 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0052d0 con 0x7fb69415ed00 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.081+0000 7fb68be00640 1 -- 172.21.15.99:0/551706225 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c005470 con 0x7fb69415ed00 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.081+0000 7fb68be00640 1 -- 172.21.15.99:0/551706225 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c012870 con 0x7fb69415ed00 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.081+0000 7fb69ae00640 1 -- 172.21.15.99:0/551706225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6941f5ce0 con 0x7fb69415ed00 2024-09-10T07:41:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.081+0000 7fb69ae00640 1 -- 172.21.15.99:0/551706225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6941f4dc0 con 0x7fb69415ed00 2024-09-10T07:41:00.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.082+0000 7fb69ae00640 1 -- 172.21.15.99:0/551706225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6940c8aa0 con 0x7fb69415ed00 2024-09-10T07:41:00.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.083+0000 7fb68be00640 1 -- 172.21.15.99:0/551706225 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb68c012a10 con 0x7fb69415ed00 2024-09-10T07:41:00.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.084+0000 7fb68be00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb67006be30 0x7fb67006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:00.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.084+0000 7fb68be00640 1 -- 172.21.15.99:0/551706225 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5357+0+0 (secure 0 0 0) 0x7fb68c08aa50 con 0x7fb69415ed00 2024-09-10T07:41:00.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.084+0000 7fb68be00640 1 -- 172.21.15.99:0/551706225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=146}) -- 0x7fb670072c00 con 0x7fb69415ed00 2024-09-10T07:41:00.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.084+0000 7fb693e00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb67006be30 0x7fb67006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.085+0000 7fb693e00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb67006be30 0x7fb67006e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb684034000 tx=0x7fb684033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:00.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.089+0000 7fb68be00640 1 -- 172.21.15.99:0/551706225 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6940c8aa0 con 0x7fb69415ed00 2024-09-10T07:41:00.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.263+0000 7fb69ae00640 1 -- 172.21.15.99:0/551706225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb6940d1680 con 0x7fb69415ed00 2024-09-10T07:41:00.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.908+0000 7fb68be00640 1 -- 172.21.15.99:0/551706225 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v146) ==== 169+0+0 (secure 0 0 0) 0x7fb68c0594e0 con 0x7fb69415ed00 2024-09-10T07:41:00.908 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:41:00.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.908+0000 7fb68be00640 1 -- 172.21.15.99:0/551706225 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(146..146 src has 1..146) ==== 296+0+0 (secure 0 0 0) 0x7fb68c0891f0 con 0x7fb69415ed00 2024-09-10T07:41:00.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.908+0000 7fb68be00640 1 -- 172.21.15.99:0/551706225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=147}) -- 0x7fb6700719f0 con 0x7fb69415ed00 2024-09-10T07:41:00.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.914+0000 7fb69ae00640 1 -- 172.21.15.99:0/551706225 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb67006be30 msgr2=0x7fb67006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:00.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.914+0000 7fb69ae00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb67006be30 0x7fb67006e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb684034000 tx=0x7fb684033040 comp rx=0 tx=0).stop 2024-09-10T07:41:00.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.914+0000 7fb69ae00640 1 -- 172.21.15.99:0/551706225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb69415ed00 msgr2=0x7fb6940b9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:00.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.914+0000 7fb69ae00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb69415ed00 0x7fb6940b9d70 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c4c0 tx=0x7fb68c00c980 comp rx=0 tx=0).stop 2024-09-10T07:41:00.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.917+0000 7fb69ae00640 1 -- 172.21.15.99:0/551706225 shutdown_connections 2024-09-10T07:41:00.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.917+0000 7fb69ae00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb67006be30 0x7fb67006e2f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.917+0000 7fb69ae00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb69415ed00 0x7fb6940b9d70 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.917+0000 7fb69ae00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6940d2000 0x7fb6941f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.917+0000 7fb69ae00640 1 --2- 172.21.15.99:0/551706225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6940d1a90 0x7fb6941f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:00.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.917+0000 7fb69ae00640 1 -- 172.21.15.99:0/551706225 >> 172.21.15.99:0/551706225 conn(0x7fb6940d4c10 msgr2=0x7fb6940d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:00.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.917+0000 7fb69ae00640 1 -- 172.21.15.99:0/551706225 shutdown_connections 2024-09-10T07:41:00.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:00.920+0000 7fb69ae00640 1 -- 172.21.15.99:0/551706225 wait complete. 2024-09-10T07:41:00.938 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T07:41:01.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.094+0000 7fdc87a00640 1 Processor -- start 2024-09-10T07:41:01.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.094+0000 7fdc87a00640 1 -- start start 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.095+0000 7fdc87a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc8015ede0 0x7fdc800d5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.095+0000 7fdc87a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d1bf0 0x7fdc800b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.095+0000 7fdc87a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc800d3270 con 0x7fdc800d5840 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.095+0000 7fdc87a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fdc800d34e0 con 0x7fdc8015ede0 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.095+0000 7fdc87a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdc800d37c0 con 0x7fdc800d1bf0 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.096+0000 7fdc85000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc8015ede0 0x7fdc800d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.096+0000 7fdc7fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdc800d5840 0x7fdc800d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50280/0 (socket says 172.21.15.99:50280) 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.096+0000 7fdc7fe00640 1 -- 172.21.15.99:0/774191726 learned_addr learned my addr 172.21.15.99:0/774191726 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.096+0000 7fdc85000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc8015ede0 0x7fdc800d5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46468/0 (socket says 172.21.15.99:46468) 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.096+0000 7fdc85a00640 1 --2- 172.21.15.99:0/774191726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d1bf0 0x7fdc800b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.096+0000 7fdc85000640 1 -- 172.21.15.99:0/774191726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d1bf0 msgr2=0x7fdc800b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:01.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.096+0000 7fdc85000640 1 --2- 172.21.15.99:0/774191726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d1bf0 0x7fdc800b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.096+0000 7fdc85000640 1 -- 172.21.15.99:0/774191726 >> v1:172.21.15.99:6789/0 conn(0x7fdc800d5840 legacy=0x7fdc800d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.096+0000 7fdc85000640 1 -- 172.21.15.99:0/774191726 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc800d3aa0 con 0x7fdc8015ede0 2024-09-10T07:41:01.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.096+0000 7fdc85a00640 1 --2- 172.21.15.99:0/774191726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d1bf0 0x7fdc800b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:01.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.097+0000 7fdc85000640 1 --2- 172.21.15.99:0/774191726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8015ede0 0x7fdc800d5300 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fdc700097a0 tx=0x7fdc7002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec47e05f14bee22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:01.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.097+0000 7fdc7f400640 1 -- 172.21.15.99:0/774191726 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70037070 con 0x7fdc8015ede0 2024-09-10T07:41:01.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.097+0000 7fdc7f400640 1 -- 172.21.15.99:0/774191726 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc70032440 con 0x7fdc8015ede0 2024-09-10T07:41:01.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.097+0000 7fdc7f400640 1 -- 172.21.15.99:0/774191726 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70032810 con 0x7fdc8015ede0 2024-09-10T07:41:01.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.098+0000 7fdc87a00640 1 -- 172.21.15.99:0/774191726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8015ede0 msgr2=0x7fdc800d5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.098+0000 7fdc87a00640 1 --2- 172.21.15.99:0/774191726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8015ede0 0x7fdc800d5300 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fdc700097a0 tx=0x7fdc7002a210 comp rx=0 tx=0).stop 2024-09-10T07:41:01.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.098+0000 7fdc87a00640 1 -- 172.21.15.99:0/774191726 shutdown_connections 2024-09-10T07:41:01.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.098+0000 7fdc87a00640 1 --2- 172.21.15.99:0/774191726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d1bf0 0x7fdc800b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.098+0000 7fdc87a00640 1 --2- 172.21.15.99:0/774191726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8015ede0 0x7fdc800d5300 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.098+0000 7fdc87a00640 1 -- 172.21.15.99:0/774191726 >> 172.21.15.99:0/774191726 conn(0x7fdc8009df30 msgr2=0x7fdc800d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:01.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.098+0000 7fdc87a00640 1 -- 172.21.15.99:0/774191726 shutdown_connections 2024-09-10T07:41:01.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.098+0000 7fdc87a00640 1 -- 172.21.15.99:0/774191726 wait complete. 2024-09-10T07:41:01.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.100+0000 7fdc87a00640 1 Processor -- start 2024-09-10T07:41:01.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.100+0000 7fdc87a00640 1 -- start start 2024-09-10T07:41:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc87a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc800d1bf0 0x7fdc80154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc87a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d5840 0x7fdc80159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc87a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc8015ede0 0x7fdc801f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc87a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdc800b41a0 con 0x7fdc800d1bf0 2024-09-10T07:41:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc87a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdc800b4020 con 0x7fdc8015ede0 2024-09-10T07:41:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc87a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdc800b4d20 con 0x7fdc800d5840 2024-09-10T07:41:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc85000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc800d1bf0 0x7fdc80154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc85000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc800d1bf0 0x7fdc80154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46476/0 (socket says 172.21.15.99:46476) 2024-09-10T07:41:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc85000640 1 -- 172.21.15.99:0/3741109141 learned_addr learned my addr 172.21.15.99:0/3741109141 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:01.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc7fe00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d5840 0x7fdc80159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc85a00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc8015ede0 0x7fdc801f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc85000640 1 -- 172.21.15.99:0/3741109141 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d5840 msgr2=0x7fdc80159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc85000640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d5840 0x7fdc80159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc85000640 1 -- 172.21.15.99:0/3741109141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc8015ede0 msgr2=0x7fdc801f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc85000640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc8015ede0 0x7fdc801f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc85000640 1 -- 172.21.15.99:0/3741109141 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8015abb0 con 0x7fdc800d1bf0 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.101+0000 7fdc85a00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc8015ede0 0x7fdc801f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.102+0000 7fdc85000640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc800d1bf0 0x7fdc80154c30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fdc70035040 tx=0x7fdc700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.102+0000 7fdc7cc00640 1 -- 172.21.15.99:0/3741109141 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70037040 con 0x7fdc800d1bf0 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.102+0000 7fdc7cc00640 1 -- 172.21.15.99:0/3741109141 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc70030770 con 0x7fdc800d1bf0 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.102+0000 7fdc7cc00640 1 -- 172.21.15.99:0/3741109141 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70030b40 con 0x7fdc800d1bf0 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.102+0000 7fdc87a00640 1 -- 172.21.15.99:0/3741109141 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc80162280 con 0x7fdc800d1bf0 2024-09-10T07:41:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.102+0000 7fdc87a00640 1 -- 172.21.15.99:0/3741109141 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8015b110 con 0x7fdc800d1bf0 2024-09-10T07:41:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.103+0000 7fdc87a00640 1 -- 172.21.15.99:0/3741109141 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc800b47e0 con 0x7fdc800d1bf0 2024-09-10T07:41:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.104+0000 7fdc7cc00640 1 -- 172.21.15.99:0/3741109141 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc70044020 con 0x7fdc800d1bf0 2024-09-10T07:41:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.105+0000 7fdc7cc00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdc6006be30 0x7fdc6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.105+0000 7fdc7cc00640 1 -- 172.21.15.99:0/3741109141 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7fdc700aaff0 con 0x7fdc800d1bf0 2024-09-10T07:41:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.105+0000 7fdc7fe00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdc6006be30 0x7fdc6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.106+0000 7fdc7fe00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdc6006be30 0x7fdc6006e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c000f60 tx=0x7fdc6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:01.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.109+0000 7fdc7cc00640 1 -- 172.21.15.99:0/3741109141 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc8015abb0 con 0x7fdc800d1bf0 2024-09-10T07:41:01.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.285+0000 7fdc87a00640 1 -- 172.21.15.99:0/3741109141 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fdc800c8070 con 0x7fdc800d1bf0 2024-09-10T07:41:01.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.290+0000 7fdc7cc00640 1 -- 172.21.15.99:0/3741109141 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fdc70032e20 con 0x7fdc800d1bf0 2024-09-10T07:41:01.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.292+0000 7fdc87a00640 1 -- 172.21.15.99:0/3741109141 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdc6006be30 msgr2=0x7fdc6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdc6006be30 0x7fdc6006e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c000f60 tx=0x7fdc6c009040 comp rx=0 tx=0).stop 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 -- 172.21.15.99:0/3741109141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc800d1bf0 msgr2=0x7fdc80154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc800d1bf0 0x7fdc80154c30 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fdc70035040 tx=0x7fdc700046c0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 -- 172.21.15.99:0/3741109141 shutdown_connections 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc8015ede0 0x7fdc801f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc800d5840 0x7fdc80159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdc6006be30 0x7fdc6006e2f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 --2- 172.21.15.99:0/3741109141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc800d1bf0 0x7fdc80154c30 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 -- 172.21.15.99:0/3741109141 >> 172.21.15.99:0/3741109141 conn(0x7fdc8009df30 msgr2=0x7fdc800b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 -- 172.21.15.99:0/3741109141 shutdown_connections 2024-09-10T07:41:01.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.293+0000 7fdc87a00640 1 -- 172.21.15.99:0/3741109141 wait complete. 2024-09-10T07:41:01.308 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-10T07:41:01.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.460+0000 7fef3ca00640 1 Processor -- start 2024-09-10T07:41:01.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.461+0000 7fef3ca00640 1 -- start start 2024-09-10T07:41:01.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.462+0000 7fef3ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fef38145290 0x7fef3806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.462+0000 7fef3ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3806e3d0 con 0x7fef380ce780 2024-09-10T07:41:01.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.462+0000 7fef3ca00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3806e6b0 con 0x7fef38072f40 2024-09-10T07:41:01.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.462+0000 7fef3ca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fef3806efe0 con 0x7fef38145290 2024-09-10T07:41:01.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.462+0000 7fef35e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fef38145290 0x7fef3806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.462+0000 7fef2d400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fef380ce780 0x7fef38072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50290/0 (socket says 172.21.15.99:50290) 2024-09-10T07:41:01.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.462+0000 7fef2d400640 1 -- 172.21.15.99:0/4231344419 learned_addr learned my addr 172.21.15.99:0/4231344419 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:01.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.462+0000 7fef35e00640 1 -- 172.21.15.99:0/4231344419 >> v1:172.21.15.187:6789/0 conn(0x7fef38072f40 legacy=0x7fef380b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:01.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.463+0000 7fef35e00640 1 -- 172.21.15.99:0/4231344419 >> v1:172.21.15.99:6789/0 conn(0x7fef380ce780 legacy=0x7fef38072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.463+0000 7fef35e00640 1 -- 172.21.15.99:0/4231344419 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3806e990 con 0x7fef38145290 2024-09-10T07:41:01.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.464+0000 7fef35e00640 1 --2- 172.21.15.99:0/4231344419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38145290 0x7fef3806f470 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fef280097a0 tx=0x7fef2802a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6043a7bf7266e532 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:01.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.464+0000 7fef35400640 1 -- 172.21.15.99:0/4231344419 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28037070 con 0x7fef38145290 2024-09-10T07:41:01.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.464+0000 7fef35400640 1 -- 172.21.15.99:0/4231344419 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2802ad60 con 0x7fef38145290 2024-09-10T07:41:01.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.464+0000 7fef35400640 1 -- 172.21.15.99:0/4231344419 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28032660 con 0x7fef38145290 2024-09-10T07:41:01.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.464+0000 7fef3ca00640 1 -- 172.21.15.99:0/4231344419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38145290 msgr2=0x7fef3806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.464+0000 7fef3ca00640 1 --2- 172.21.15.99:0/4231344419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38145290 0x7fef3806f470 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fef280097a0 tx=0x7fef2802a0d0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.464+0000 7fef3ca00640 1 -- 172.21.15.99:0/4231344419 shutdown_connections 2024-09-10T07:41:01.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.464+0000 7fef3ca00640 1 --2- 172.21.15.99:0/4231344419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38145290 0x7fef3806f470 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.464+0000 7fef3ca00640 1 -- 172.21.15.99:0/4231344419 >> 172.21.15.99:0/4231344419 conn(0x7fef3806bc10 msgr2=0x7fef3806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:01.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.464+0000 7fef3ca00640 1 -- 172.21.15.99:0/4231344419 shutdown_connections 2024-09-10T07:41:01.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.465+0000 7fef3ca00640 1 -- 172.21.15.99:0/4231344419 wait complete. 2024-09-10T07:41:01.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.466+0000 7fef3ca00640 1 Processor -- start 2024-09-10T07:41:01.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.466+0000 7fef3ca00640 1 -- start start 2024-09-10T07:41:01.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.467+0000 7fef3ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38072f40 0x7fef38138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.467+0000 7fef3ca00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef380ce780 0x7fef38158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.467+0000 7fef3ca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38145290 0x7fef380b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.467+0000 7fef3ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fef3806df80 con 0x7fef38072f40 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.467+0000 7fef3ca00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fef38145670 con 0x7fef38145290 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.467+0000 7fef3ca00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fef3806e100 con 0x7fef380ce780 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.467+0000 7fef35e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38072f40 0x7fef38138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.467+0000 7fef35e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38072f40 0x7fef38138e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46488/0 (socket says 172.21.15.99:46488) 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.467+0000 7fef35e00640 1 -- 172.21.15.99:0/2033592980 learned_addr learned my addr 172.21.15.99:0/2033592980 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef2d400640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef380ce780 0x7fef38158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef35e00640 1 -- 172.21.15.99:0/2033592980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef380ce780 msgr2=0x7fef38158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef35e00640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef380ce780 0x7fef38158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef36800640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38145290 0x7fef380b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef35e00640 1 -- 172.21.15.99:0/2033592980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38145290 msgr2=0x7fef380b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef35e00640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38145290 0x7fef380b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef35e00640 1 -- 172.21.15.99:0/2033592980 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3815cd80 con 0x7fef38072f40 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef2d400640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef380ce780 0x7fef38158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef36800640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38145290 0x7fef380b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef35e00640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38072f40 0x7fef38138e50 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fef280098c0 tx=0x7fef280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef2ea00640 1 -- 172.21.15.99:0/2033592980 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28037040 con 0x7fef38072f40 2024-09-10T07:41:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef2ea00640 1 -- 172.21.15.99:0/2033592980 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef28004030 con 0x7fef38072f40 2024-09-10T07:41:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef2ea00640 1 -- 172.21.15.99:0/2033592980 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28004420 con 0x7fef38072f40 2024-09-10T07:41:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef3ca00640 1 -- 172.21.15.99:0/2033592980 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3815d060 con 0x7fef38072f40 2024-09-10T07:41:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.468+0000 7fef3ca00640 1 -- 172.21.15.99:0/2033592980 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3815db60 con 0x7fef38072f40 2024-09-10T07:41:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.469+0000 7fef3ca00640 1 -- 172.21.15.99:0/2033592980 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef380715a0 con 0x7fef38072f40 2024-09-10T07:41:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.470+0000 7fef2ea00640 1 -- 172.21.15.99:0/2033592980 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef2803a070 con 0x7fef38072f40 2024-09-10T07:41:01.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.471+0000 7fef2ea00640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fef1406be30 0x7fef1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:01.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.472+0000 7fef2ea00640 1 -- 172.21.15.99:0/2033592980 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7fef280ab150 con 0x7fef38072f40 2024-09-10T07:41:01.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.472+0000 7fef2d400640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fef1406be30 0x7fef1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:01.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.472+0000 7fef2d400640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fef1406be30 0x7fef1406e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fef20000f60 tx=0x7fef20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:01.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.476+0000 7fef2ea00640 1 -- 172.21.15.99:0/2033592980 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef28041020 con 0x7fef38072f40 2024-09-10T07:41:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.712+0000 7fef3ca00640 1 -- 172.21.15.99:0/2033592980 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) -- 0x7fef38160370 con 0x7fef38072f40 2024-09-10T07:41:01.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.902+0000 7fef2ea00640 1 -- 172.21.15.99:0/2033592980 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v353) ==== 140+0+0 (secure 0 0 0) 0x7fef28079df0 con 0x7fef38072f40 2024-09-10T07:41:01.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.904+0000 7fef3ca00640 1 -- 172.21.15.99:0/2033592980 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fef1406be30 msgr2=0x7fef1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.904+0000 7fef3ca00640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fef1406be30 0x7fef1406e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fef20000f60 tx=0x7fef20009040 comp rx=0 tx=0).stop 2024-09-10T07:41:01.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.904+0000 7fef3ca00640 1 -- 172.21.15.99:0/2033592980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38072f40 msgr2=0x7fef38138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:01.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.904+0000 7fef3ca00640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38072f40 0x7fef38138e50 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fef280098c0 tx=0x7fef280046c0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.905+0000 7fef3ca00640 1 -- 172.21.15.99:0/2033592980 shutdown_connections 2024-09-10T07:41:01.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.905+0000 7fef3ca00640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38145290 0x7fef380b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.905+0000 7fef3ca00640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef380ce780 0x7fef38158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.905+0000 7fef3ca00640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fef1406be30 0x7fef1406e2f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.905+0000 7fef3ca00640 1 --2- 172.21.15.99:0/2033592980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef38072f40 0x7fef38138e50 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:01.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.905+0000 7fef3ca00640 1 -- 172.21.15.99:0/2033592980 >> 172.21.15.99:0/2033592980 conn(0x7fef3806bc10 msgr2=0x7fef380b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:01.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.905+0000 7fef3ca00640 1 -- 172.21.15.99:0/2033592980 shutdown_connections 2024-09-10T07:41:01.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:01.905+0000 7fef3ca00640 1 -- 172.21.15.99:0/2033592980 wait complete. 2024-09-10T07:41:01.921 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-10T07:41:01.922 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2024-09-10T07:41:01.922 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:41:02.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.076+0000 7fad7d400640 1 Processor -- start 2024-09-10T07:41:02.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.076+0000 7fad7d400640 1 -- start start 2024-09-10T07:41:02.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.078+0000 7fad7d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fad78072f40 0x7fad7806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.078+0000 7fad7d400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad7806e3d0 con 0x7fad780ce780 2024-09-10T07:41:02.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.078+0000 7fad7d400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad7806e6b0 con 0x7fad78145290 2024-09-10T07:41:02.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.078+0000 7fad7d400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fad7806efe0 con 0x7fad78072f40 2024-09-10T07:41:02.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.078+0000 7fad6de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fad78072f40 0x7fad7806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.078+0000 7fad6de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fad78072f40 0x7fad7806f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46500/0 (socket says 172.21.15.99:46500) 2024-09-10T07:41:02.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.078+0000 7fad6de00640 1 -- 172.21.15.99:0/559088438 learned_addr learned my addr 172.21.15.99:0/559088438 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:02.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.078+0000 7fad6de00640 1 -- 172.21.15.99:0/559088438 >> v1:172.21.15.187:6789/0 conn(0x7fad78145290 legacy=0x7fad78072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:02.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.078+0000 7fad6de00640 1 -- 172.21.15.99:0/559088438 >> v1:172.21.15.99:6789/0 conn(0x7fad780ce780 legacy=0x7fad780b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.078+0000 7fad6de00640 1 -- 172.21.15.99:0/559088438 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7806e990 con 0x7fad78072f40 2024-09-10T07:41:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.079+0000 7fad6de00640 1 --2- 172.21.15.99:0/559088438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78072f40 0x7fad7806f470 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fad60009e50 tx=0x7fad6002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e58f7750c596bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.079+0000 7fad75e00640 1 -- 172.21.15.99:0/559088438 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60036070 con 0x7fad78072f40 2024-09-10T07:41:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.080+0000 7fad75e00640 1 -- 172.21.15.99:0/559088438 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad60031600 con 0x7fad78072f40 2024-09-10T07:41:02.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.080+0000 7fad75e00640 1 -- 172.21.15.99:0/559088438 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad600319d0 con 0x7fad78072f40 2024-09-10T07:41:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.080+0000 7fad7d400640 1 -- 172.21.15.99:0/559088438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78072f40 msgr2=0x7fad7806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.080+0000 7fad7d400640 1 --2- 172.21.15.99:0/559088438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78072f40 0x7fad7806f470 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fad60009e50 tx=0x7fad6002a760 comp rx=0 tx=0).stop 2024-09-10T07:41:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.080+0000 7fad7d400640 1 -- 172.21.15.99:0/559088438 shutdown_connections 2024-09-10T07:41:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.080+0000 7fad7d400640 1 --2- 172.21.15.99:0/559088438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78072f40 0x7fad7806f470 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.080+0000 7fad7d400640 1 -- 172.21.15.99:0/559088438 >> 172.21.15.99:0/559088438 conn(0x7fad7806bc10 msgr2=0x7fad7806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.080+0000 7fad7d400640 1 -- 172.21.15.99:0/559088438 shutdown_connections 2024-09-10T07:41:02.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.080+0000 7fad7d400640 1 -- 172.21.15.99:0/559088438 wait complete. 2024-09-10T07:41:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.082+0000 7fad7d400640 1 Processor -- start 2024-09-10T07:41:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.082+0000 7fad7d400640 1 -- start start 2024-09-10T07:41:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad7d400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78072f40 0x7fad78144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad7d400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad780ce780 0x7fad7815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad7d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78145290 0x7fad780c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad7d400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fad7806df80 con 0x7fad78145290 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad7d400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fad78145670 con 0x7fad78072f40 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad7d400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fad7806e100 con 0x7fad780ce780 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad77200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78145290 0x7fad780c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad77200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78145290 0x7fad780c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46514/0 (socket says 172.21.15.99:46514) 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad77200640 1 -- 172.21.15.99:0/3333928102 learned_addr learned my addr 172.21.15.99:0/3333928102 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad76800640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78072f40 0x7fad78144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.083+0000 7fad6de00640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad780ce780 0x7fad7815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad77200640 1 -- 172.21.15.99:0/3333928102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad780ce780 msgr2=0x7fad7815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad77200640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad780ce780 0x7fad7815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad77200640 1 -- 172.21.15.99:0/3333928102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78072f40 msgr2=0x7fad78144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad77200640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78072f40 0x7fad78144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad77200640 1 -- 172.21.15.99:0/3333928102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad78143560 con 0x7fad78145290 2024-09-10T07:41:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad77200640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78145290 0x7fad780c6290 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fad70001eb0 tx=0x7fad7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:02.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad6f400640 1 -- 172.21.15.99:0/3333928102 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70017070 con 0x7fad78145290 2024-09-10T07:41:02.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad6f400640 1 -- 172.21.15.99:0/3333928102 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad700052d0 con 0x7fad78145290 2024-09-10T07:41:02.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad7d400640 1 -- 172.21.15.99:0/3333928102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad78143840 con 0x7fad78145290 2024-09-10T07:41:02.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad6f400640 1 -- 172.21.15.99:0/3333928102 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70003810 con 0x7fad78145290 2024-09-10T07:41:02.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.084+0000 7fad7d400640 1 -- 172.21.15.99:0/3333928102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad781440e0 con 0x7fad78145290 2024-09-10T07:41:02.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.085+0000 7fad7d400640 1 -- 172.21.15.99:0/3333928102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad780715a0 con 0x7fad78145290 2024-09-10T07:41:02.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.086+0000 7fad6f400640 1 -- 172.21.15.99:0/3333928102 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad7001a070 con 0x7fad78145290 2024-09-10T07:41:02.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.087+0000 7fad6f400640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad5406be30 0x7fad5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.087+0000 7fad6f400640 1 -- 172.21.15.99:0/3333928102 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7fad70089f10 con 0x7fad78145290 2024-09-10T07:41:02.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.087+0000 7fad76800640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad5406be30 0x7fad5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.088+0000 7fad76800640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad5406be30 0x7fad5406e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fad68004f60 tx=0x7fad68007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:02.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.091+0000 7fad6f400640 1 -- 172.21.15.99:0/3333928102 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad700584d0 con 0x7fad78145290 2024-09-10T07:41:02.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.267+0000 7fad7d400640 1 -- 172.21.15.99:0/3333928102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad78143a10 con 0x7fad78145290 2024-09-10T07:41:02.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.268+0000 7fad6f400640 1 -- 172.21.15.99:0/3333928102 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+13019 (secure 0 0 0) 0x7fad7005c7d0 con 0x7fad78145290 2024-09-10T07:41:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:02.268 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":146,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:41:00.900195+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6837/1531136464":"2024-09-11T07:40:57.857431+0000","172.21.15.99:6836/1531136464":"2024-09-11T07:40:57.857431+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:41:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 -- 172.21.15.99:0/3333928102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad5406be30 msgr2=0x7fad5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad5406be30 0x7fad5406e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fad68004f60 tx=0x7fad68007e30 comp rx=0 tx=0).stop 2024-09-10T07:41:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 -- 172.21.15.99:0/3333928102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78145290 msgr2=0x7fad780c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78145290 0x7fad780c6290 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fad70001eb0 tx=0x7fad7000c890 comp rx=0 tx=0).stop 2024-09-10T07:41:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 -- 172.21.15.99:0/3333928102 shutdown_connections 2024-09-10T07:41:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fad5406be30 0x7fad5406e2f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad78145290 0x7fad780c6290 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad780ce780 0x7fad7815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 --2- 172.21.15.99:0/3333928102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78072f40 0x7fad78144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 -- 172.21.15.99:0/3333928102 >> 172.21.15.99:0/3333928102 conn(0x7fad7806bc10 msgr2=0x7fad780b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 -- 172.21.15.99:0/3333928102 shutdown_connections 2024-09-10T07:41:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.270+0000 7fad7d400640 1 -- 172.21.15.99:0/3333928102 wait complete. 2024-09-10T07:41:02.286 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:34:08.744575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:41:02.286 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:41:02.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.441+0000 7fcca0a00640 1 Processor -- start 2024-09-10T07:41:02.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.441+0000 7fcca0a00640 1 -- start start 2024-09-10T07:41:02.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcca0a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9c15eab0 0x7fcc9c0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcca0a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcc9c070b40 0x7fcc9c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcca0a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcc9c06d260 0x7fcc9c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcca0a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcc9c0d3710 con 0x7fcc9c070b40 2024-09-10T07:41:02.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcca0a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fcc9c0b6390 con 0x7fcc9c06d260 2024-09-10T07:41:02.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcca0a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9c0b6670 con 0x7fcc9c15eab0 2024-09-10T07:41:02.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcc91e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcc9c070b40 0x7fcc9c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcc91e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcc9c070b40 0x7fcc9c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46530/0 (socket says 172.21.15.99:46530) 2024-09-10T07:41:02.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcc91e00640 1 -- 172.21.15.99:0/435789702 learned_addr learned my addr 172.21.15.99:0/435789702 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:02.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcc9a800640 1 --2- 172.21.15.99:0/435789702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9c15eab0 0x7fcc9c0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcc9b200640 1 --2- 172.21.15.99:0/435789702 >> v2:172.21.15.187:3300/0 conn(0x7fcc9c06d260 0x7fcc9c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcc91e00640 1 -- 172.21.15.99:0/435789702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9c15eab0 msgr2=0x7fcc9c0b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:02.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcc91e00640 1 --2- 172.21.15.99:0/435789702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9c15eab0 0x7fcc9c0b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcc91e00640 1 -- 172.21.15.99:0/435789702 >> v2:172.21.15.187:3300/0 conn(0x7fcc9c06d260 msgr2=0x7fcc9c0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:02.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcc91e00640 1 --2- 172.21.15.99:0/435789702 >> v2:172.21.15.187:3300/0 conn(0x7fcc9c06d260 0x7fcc9c0b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.443+0000 7fcc91e00640 1 -- 172.21.15.99:0/435789702 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c0b6950 con 0x7fcc9c070b40 2024-09-10T07:41:02.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.444+0000 7fcc91e00640 1 --2- 172.21.15.99:0/435789702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c070b40 0x7fcc9c06cd20 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009870 tx=0x7fcc8402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1823d2e34f45baad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:02.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcc99e00640 1 -- 172.21.15.99:0/435789702 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc84037070 con 0x7fcc9c070b40 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcc99e00640 1 -- 172.21.15.99:0/435789702 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc8402ae10 con 0x7fcc9c070b40 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcc99e00640 1 -- 172.21.15.99:0/435789702 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc84032660 con 0x7fcc9c070b40 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcca0a00640 1 -- 172.21.15.99:0/435789702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c070b40 msgr2=0x7fcc9c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcca0a00640 1 --2- 172.21.15.99:0/435789702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c070b40 0x7fcc9c06cd20 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009870 tx=0x7fcc8402a100 comp rx=0 tx=0).stop 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcca0a00640 1 -- 172.21.15.99:0/435789702 shutdown_connections 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcca0a00640 1 --2- 172.21.15.99:0/435789702 >> v2:172.21.15.187:3300/0 conn(0x7fcc9c06d260 0x7fcc9c0b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcca0a00640 1 --2- 172.21.15.99:0/435789702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c070b40 0x7fcc9c06cd20 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcca0a00640 1 --2- 172.21.15.99:0/435789702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9c15eab0 0x7fcc9c0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcca0a00640 1 -- 172.21.15.99:0/435789702 >> 172.21.15.99:0/435789702 conn(0x7fcc9c0b7cc0 msgr2=0x7fcc9c0b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcca0a00640 1 -- 172.21.15.99:0/435789702 shutdown_connections 2024-09-10T07:41:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.445+0000 7fcca0a00640 1 -- 172.21.15.99:0/435789702 wait complete. 2024-09-10T07:41:02.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.447+0000 7fcca0a00640 1 Processor -- start 2024-09-10T07:41:02.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.447+0000 7fcca0a00640 1 -- start start 2024-09-10T07:41:02.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcca0a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c06d260 0x7fcc9c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcca0a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9c070b40 0x7fcc9c09fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcca0a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc9c15eab0 0x7fcc9c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcca0a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c15ee90 con 0x7fcc9c06d260 2024-09-10T07:41:02.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcca0a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c0d3230 con 0x7fcc9c15eab0 2024-09-10T07:41:02.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcca0a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9c09e3d0 con 0x7fcc9c070b40 2024-09-10T07:41:02.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcc9a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c06d260 0x7fcc9c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcc9a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c06d260 0x7fcc9c1537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46538/0 (socket says 172.21.15.99:46538) 2024-09-10T07:41:02.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcc9a800640 1 -- 172.21.15.99:0/3078164829 learned_addr learned my addr 172.21.15.99:0/3078164829 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:02.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcc91e00640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9c070b40 0x7fcc9c09fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.448+0000 7fcc9b200640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc9c15eab0 0x7fcc9c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.449+0000 7fcc9a800640 1 -- 172.21.15.99:0/3078164829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9c070b40 msgr2=0x7fcc9c09fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.449+0000 7fcc9a800640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9c070b40 0x7fcc9c09fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.449+0000 7fcc9a800640 1 -- 172.21.15.99:0/3078164829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc9c15eab0 msgr2=0x7fcc9c156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.449+0000 7fcc9a800640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc9c15eab0 0x7fcc9c156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.449+0000 7fcc9a800640 1 -- 172.21.15.99:0/3078164829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c09f100 con 0x7fcc9c06d260 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.449+0000 7fcc9a800640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c06d260 0x7fcc9c1537d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00e9b0 tx=0x7fcc8c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.449+0000 7fcc93400640 1 -- 172.21.15.99:0/3078164829 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c017070 con 0x7fcc9c06d260 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.449+0000 7fcc93400640 1 -- 172.21.15.99:0/3078164829 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc8c00c9a0 con 0x7fcc9c06d260 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.449+0000 7fcc93400640 1 -- 172.21.15.99:0/3078164829 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00cd90 con 0x7fcc9c06d260 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.449+0000 7fcca0a00640 1 -- 172.21.15.99:0/3078164829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9c0a0630 con 0x7fcc9c06d260 2024-09-10T07:41:02.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.450+0000 7fcca0a00640 1 -- 172.21.15.99:0/3078164829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9c09e900 con 0x7fcc9c06d260 2024-09-10T07:41:02.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.451+0000 7fcca0a00640 1 -- 172.21.15.99:0/3078164829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9c06cd20 con 0x7fcc9c06d260 2024-09-10T07:41:02.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.452+0000 7fcc93400640 1 -- 172.21.15.99:0/3078164829 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc8c01a070 con 0x7fcc9c06d260 2024-09-10T07:41:02.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.452+0000 7fcc93400640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc7806be30 0x7fcc7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.453+0000 7fcc93400640 1 -- 172.21.15.99:0/3078164829 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7fcc8c08aaf0 con 0x7fcc9c06d260 2024-09-10T07:41:02.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.453+0000 7fcc91e00640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc7806be30 0x7fcc7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.453+0000 7fcc91e00640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc7806be30 0x7fcc7806e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcc84034000 tx=0x7fcc8402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:02.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.457+0000 7fcc93400640 1 -- 172.21.15.99:0/3078164829 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc8c059140 con 0x7fcc9c06d260 2024-09-10T07:41:02.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.629+0000 7fcca0a00640 1 -- 172.21.15.99:0/3078164829 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcc9c06fc40 con 0x7fcc9c06d260 2024-09-10T07:41:02.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.630+0000 7fcc93400640 1 -- 172.21.15.99:0/3078164829 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) ==== 93+0+10 (secure 0 0 0) 0x7fcc8c05d440 con 0x7fcc9c06d260 2024-09-10T07:41:02.630 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-10T07:41:02.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 -- 172.21.15.99:0/3078164829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc7806be30 msgr2=0x7fcc7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc7806be30 0x7fcc7806e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcc84034000 tx=0x7fcc8402e000 comp rx=0 tx=0).stop 2024-09-10T07:41:02.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 -- 172.21.15.99:0/3078164829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c06d260 msgr2=0x7fcc9c1537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c06d260 0x7fcc9c1537d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00e9b0 tx=0x7fcc8c00ee70 comp rx=0 tx=0).stop 2024-09-10T07:41:02.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 -- 172.21.15.99:0/3078164829 shutdown_connections 2024-09-10T07:41:02.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc9c15eab0 0x7fcc9c156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc9c070b40 0x7fcc9c09fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc7806be30 0x7fcc7806e2f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 --2- 172.21.15.99:0/3078164829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc9c06d260 0x7fcc9c1537d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 -- 172.21.15.99:0/3078164829 >> 172.21.15.99:0/3078164829 conn(0x7fcc9c0b7cc0 msgr2=0x7fcc9c070020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:02.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 -- 172.21.15.99:0/3078164829 shutdown_connections 2024-09-10T07:41:02.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.632+0000 7fcca0a00640 1 -- 172.21.15.99:0/3078164829 wait complete. 2024-09-10T07:41:02.648 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-10T07:41:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.802+0000 7f576da00640 1 Processor -- start 2024-09-10T07:41:02.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.802+0000 7f576da00640 1 -- start start 2024-09-10T07:41:02.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f576da00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576813fae0 0x7f576806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f576da00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5768142150 0x7f5768160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f576da00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5768142650 con 0x7f5768160a80 2024-09-10T07:41:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f576da00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f57680ce780 con 0x7f5768142150 2024-09-10T07:41:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f576da00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5768142930 con 0x7f576813fae0 2024-09-10T07:41:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f5766000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5768142150 0x7f5768160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f5766000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5768142150 0x7f5768160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46542/0 (socket says 172.21.15.99:46542) 2024-09-10T07:41:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f5766000640 1 -- 172.21.15.99:0/1072331439 learned_addr learned my addr 172.21.15.99:0/1072331439 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f5766a00640 1 --2- 172.21.15.99:0/1072331439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576813fae0 0x7f576806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f5766000640 1 -- 172.21.15.99:0/1072331439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576813fae0 msgr2=0x7f576806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f5766000640 1 --2- 172.21.15.99:0/1072331439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576813fae0 0x7f576806f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f5766000640 1 -- 172.21.15.99:0/1072331439 >> v1:172.21.15.99:6789/0 conn(0x7f5768160a80 legacy=0x7f576815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f5766000640 1 -- 172.21.15.99:0/1072331439 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5768142c10 con 0x7f5768142150 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.804+0000 7f5765600640 1 -- 172.21.15.99:0/1072331439 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096099090 0 0) 0x7f5768142650 con 0x7f5768160a80 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.805+0000 7f5766000640 1 --2- 172.21.15.99:0/1072331439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 0x7f5768160540 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f5754009870 tx=0x7f575402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e86f1eae0ce967d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f5765600640 1 -- 172.21.15.99:0/1072331439 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754037070 con 0x7f5768142150 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f5765600640 1 -- 172.21.15.99:0/1072331439 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5754032440 con 0x7f5768142150 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f5765600640 1 -- 172.21.15.99:0/1072331439 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754032810 con 0x7f5768142150 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f576da00640 1 -- 172.21.15.99:0/1072331439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 msgr2=0x7f5768160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f576da00640 1 --2- 172.21.15.99:0/1072331439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 0x7f5768160540 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f5754009870 tx=0x7f575402a1c0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f576da00640 1 -- 172.21.15.99:0/1072331439 shutdown_connections 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f576da00640 1 --2- 172.21.15.99:0/1072331439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 0x7f5768160540 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f576da00640 1 --2- 172.21.15.99:0/1072331439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576813fae0 0x7f576806f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f576da00640 1 -- 172.21.15.99:0/1072331439 >> 172.21.15.99:0/1072331439 conn(0x7f576806bc10 msgr2=0x7f576806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:02.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f576da00640 1 -- 172.21.15.99:0/1072331439 shutdown_connections 2024-09-10T07:41:02.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.806+0000 7f576da00640 1 -- 172.21.15.99:0/1072331439 wait complete. 2024-09-10T07:41:02.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.808+0000 7f576da00640 1 Processor -- start 2024-09-10T07:41:02.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.808+0000 7f576da00640 1 -- start start 2024-09-10T07:41:02.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f576da00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576813fae0 0x7f5768143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f576da00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 0x7f57681f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f576da00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5768160a80 0x7f57680b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f576da00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f576806f870 con 0x7f5768142150 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f576da00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f576806f6f0 con 0x7f5768160a80 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f576da00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f57680cfc20 con 0x7f576813fae0 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f5766000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 0x7f57681f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f5766000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 0x7f57681f5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46544/0 (socket says 172.21.15.99:46544) 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f5766000640 1 -- 172.21.15.99:0/2477766795 learned_addr learned my addr 172.21.15.99:0/2477766795 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f5766000640 1 -- 172.21.15.99:0/2477766795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576813fae0 msgr2=0x7f5768143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f5766000640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576813fae0 0x7f5768143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f5766000640 1 -- 172.21.15.99:0/2477766795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5768160a80 msgr2=0x7f57680b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f5766000640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5768160a80 0x7f57680b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.809+0000 7f5766000640 1 -- 172.21.15.99:0/2477766795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5768144690 con 0x7f5768142150 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.810+0000 7f5766000640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 0x7f57681f5af0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5754035040 tx=0x7f57540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.810+0000 7f575ea00640 1 -- 172.21.15.99:0/2477766795 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754037040 con 0x7f5768142150 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.810+0000 7f575ea00640 1 -- 172.21.15.99:0/2477766795 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5754004230 con 0x7f5768142150 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.810+0000 7f575ea00640 1 -- 172.21.15.99:0/2477766795 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754003610 con 0x7f5768142150 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.810+0000 7f576da00640 1 -- 172.21.15.99:0/2477766795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576813fff0 con 0x7f5768142150 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.810+0000 7f576da00640 1 -- 172.21.15.99:0/2477766795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57681440d0 con 0x7f5768142150 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.811+0000 7f576da00640 1 -- 172.21.15.99:0/2477766795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57681401c0 con 0x7f5768142150 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.812+0000 7f575ea00640 1 -- 172.21.15.99:0/2477766795 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f575402ad10 con 0x7f5768142150 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.813+0000 7f575ea00640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f574806be30 0x7f574806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.813+0000 7f575ea00640 1 -- 172.21.15.99:0/2477766795 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7f57540ab560 con 0x7f5768142150 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.813+0000 7f5766a00640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f574806be30 0x7f574806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:02.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.814+0000 7f5766a00640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f574806be30 0x7f574806e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5758006a90 tx=0x7f5758006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:02.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:02.817+0000 7f575ea00640 1 -- 172.21.15.99:0/2477766795 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f575407a320 con 0x7f5768142150 2024-09-10T07:41:03.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.058+0000 7f576da00640 1 -- 172.21.15.99:0/2477766795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) -- 0x7f5768160020 con 0x7f5768142150 2024-09-10T07:41:03.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.913+0000 7f575ea00640 1 -- 172.21.15.99:0/2477766795 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v355) ==== 135+0+0 (secure 0 0 0) 0x7f5754045e40 con 0x7f5768142150 2024-09-10T07:41:03.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 -- 172.21.15.99:0/2477766795 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f574806be30 msgr2=0x7f574806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:03.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f574806be30 0x7f574806e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5758006a90 tx=0x7f5758006a20 comp rx=0 tx=0).stop 2024-09-10T07:41:03.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 -- 172.21.15.99:0/2477766795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 msgr2=0x7f57681f5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:03.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 0x7f57681f5af0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5754035040 tx=0x7f57540046c0 comp rx=0 tx=0).stop 2024-09-10T07:41:03.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 -- 172.21.15.99:0/2477766795 shutdown_connections 2024-09-10T07:41:03.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5768160a80 0x7f57680b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:03.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f574806be30 0x7f574806e2f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:03.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5768142150 0x7f57681f5af0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:03.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 --2- 172.21.15.99:0/2477766795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f576813fae0 0x7f5768143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:03.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 -- 172.21.15.99:0/2477766795 >> 172.21.15.99:0/2477766795 conn(0x7f576806bc10 msgr2=0x7f57680b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:03.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 -- 172.21.15.99:0/2477766795 shutdown_connections 2024-09-10T07:41:03.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:03.917+0000 7f576da00640 1 -- 172.21.15.99:0/2477766795 wait complete. 2024-09-10T07:41:03.937 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T07:41:04.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.097+0000 7faf93400640 1 Processor -- start 2024-09-10T07:41:04.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.097+0000 7faf93400640 1 -- start start 2024-09-10T07:41:04.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf93400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faf8c162ff0 0x7faf8c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf93400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf8c0d11d0 0x7faf8c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf93400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faf8c0d0b70 0x7faf8c0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf93400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7faf8c06f610 con 0x7faf8c162ff0 2024-09-10T07:41:04.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf93400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7faf8c0b3980 con 0x7faf8c0d0b70 2024-09-10T07:41:04.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf93400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faf8c0b3c60 con 0x7faf8c0d11d0 2024-09-10T07:41:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf90a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faf8c162ff0 0x7faf8c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf90a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faf8c162ff0 0x7faf8c06ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46558/0 (socket says 172.21.15.99:46558) 2024-09-10T07:41:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf90a00640 1 -- 172.21.15.99:0/3403166427 learned_addr learned my addr 172.21.15.99:0/3403166427 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf8be00640 1 --2- 172.21.15.99:0/3403166427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf8c0d11d0 0x7faf8c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf91400640 1 --2- 172.21.15.99:0/3403166427 >> v2:172.21.15.187:3300/0 conn(0x7faf8c0d0b70 0x7faf8c0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf90a00640 1 -- 172.21.15.99:0/3403166427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf8c0d11d0 msgr2=0x7faf8c0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf90a00640 1 --2- 172.21.15.99:0/3403166427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf8c0d11d0 0x7faf8c0d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf90a00640 1 -- 172.21.15.99:0/3403166427 >> v2:172.21.15.187:3300/0 conn(0x7faf8c0d0b70 msgr2=0x7faf8c0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf90a00640 1 --2- 172.21.15.99:0/3403166427 >> v2:172.21.15.187:3300/0 conn(0x7faf8c0d0b70 0x7faf8c0ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.099+0000 7faf90a00640 1 -- 172.21.15.99:0/3403166427 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c0b3f40 con 0x7faf8c162ff0 2024-09-10T07:41:04.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.100+0000 7faf90a00640 1 --2- 172.21.15.99:0/3403166427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c162ff0 0x7faf8c06ed10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0b5d20 tx=0x7faf7c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25944293bb1b4a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf8b400640 1 -- 172.21.15.99:0/3403166427 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c036070 con 0x7faf8c162ff0 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf8b400640 1 -- 172.21.15.99:0/3403166427 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c031600 con 0x7faf8c162ff0 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf8b400640 1 -- 172.21.15.99:0/3403166427 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0319d0 con 0x7faf8c162ff0 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf93400640 1 -- 172.21.15.99:0/3403166427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c162ff0 msgr2=0x7faf8c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf93400640 1 --2- 172.21.15.99:0/3403166427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c162ff0 0x7faf8c06ed10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0b5d20 tx=0x7faf7c02a610 comp rx=0 tx=0).stop 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf93400640 1 -- 172.21.15.99:0/3403166427 shutdown_connections 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf93400640 1 --2- 172.21.15.99:0/3403166427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf8c0d11d0 0x7faf8c0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf93400640 1 --2- 172.21.15.99:0/3403166427 >> v2:172.21.15.187:3300/0 conn(0x7faf8c0d0b70 0x7faf8c0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf93400640 1 --2- 172.21.15.99:0/3403166427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c162ff0 0x7faf8c06ed10 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf93400640 1 -- 172.21.15.99:0/3403166427 >> 172.21.15.99:0/3403166427 conn(0x7faf8c06bc10 msgr2=0x7faf8c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf93400640 1 -- 172.21.15.99:0/3403166427 shutdown_connections 2024-09-10T07:41:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.101+0000 7faf93400640 1 -- 172.21.15.99:0/3403166427 wait complete. 2024-09-10T07:41:04.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.103+0000 7faf93400640 1 Processor -- start 2024-09-10T07:41:04.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.103+0000 7faf93400640 1 -- start start 2024-09-10T07:41:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf93400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c0d0b70 0x7faf8c153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf93400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf8c0d11d0 0x7faf8c14e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf93400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf8c162ff0 0x7faf8c14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf93400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c06f3d0 con 0x7faf8c0d0b70 2024-09-10T07:41:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf93400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c06f250 con 0x7faf8c0d11d0 2024-09-10T07:41:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf93400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faf8c071570 con 0x7faf8c162ff0 2024-09-10T07:41:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf90a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c0d0b70 0x7faf8c153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf90a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c0d0b70 0x7faf8c153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46568/0 (socket says 172.21.15.99:46568) 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf90a00640 1 -- 172.21.15.99:0/2227503166 learned_addr learned my addr 172.21.15.99:0/2227503166 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf91400640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf8c162ff0 0x7faf8c14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf8be00640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf8c0d11d0 0x7faf8c14e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf90a00640 1 -- 172.21.15.99:0/2227503166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf8c162ff0 msgr2=0x7faf8c14ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf90a00640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf8c162ff0 0x7faf8c14ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf90a00640 1 -- 172.21.15.99:0/2227503166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf8c0d11d0 msgr2=0x7faf8c14e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.104+0000 7faf90a00640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf8c0d11d0 0x7faf8c14e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.105+0000 7faf90a00640 1 -- 172.21.15.99:0/2227503166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c1589e0 con 0x7faf8c0d0b70 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.105+0000 7faf90a00640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c0d0b70 0x7faf8c153fe0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7faf7c034040 tx=0x7faf7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.105+0000 7faf88c00640 1 -- 172.21.15.99:0/2227503166 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c036050 con 0x7faf8c0d0b70 2024-09-10T07:41:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.105+0000 7faf88c00640 1 -- 172.21.15.99:0/2227503166 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c042070 con 0x7faf8c0d0b70 2024-09-10T07:41:04.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.105+0000 7faf88c00640 1 -- 172.21.15.99:0/2227503166 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c009510 con 0x7faf8c0d0b70 2024-09-10T07:41:04.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.105+0000 7faf93400640 1 -- 172.21.15.99:0/2227503166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c1584b0 con 0x7faf8c0d0b70 2024-09-10T07:41:04.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.105+0000 7faf93400640 1 -- 172.21.15.99:0/2227503166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c158c80 con 0x7faf8c0d0b70 2024-09-10T07:41:04.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.106+0000 7faf93400640 1 -- 172.21.15.99:0/2227503166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8c0d0630 con 0x7faf8c0d0b70 2024-09-10T07:41:04.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.107+0000 7faf88c00640 1 -- 172.21.15.99:0/2227503166 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf7c007c30 con 0x7faf8c0d0b70 2024-09-10T07:41:04.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.108+0000 7faf88c00640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf6c06be30 0x7faf6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.108+0000 7faf88c00640 1 -- 172.21.15.99:0/2227503166 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7faf7c0aba80 con 0x7faf8c0d0b70 2024-09-10T07:41:04.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.108+0000 7faf8be00640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf6c06be30 0x7faf6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.109+0000 7faf8be00640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf6c06be30 0x7faf6c06e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7faf78006fd0 tx=0x7faf78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:04.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.112+0000 7faf88c00640 1 -- 172.21.15.99:0/2227503166 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf7c0ade20 con 0x7faf8c0d0b70 2024-09-10T07:41:04.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.284+0000 7faf93400640 1 -- 172.21.15.99:0/2227503166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7faf8c0726a0 con 0x7faf8c0d0b70 2024-09-10T07:41:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.288+0000 7faf88c00640 1 -- 172.21.15.99:0/2227503166 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7faf7c045360 con 0x7faf8c0d0b70 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 -- 172.21.15.99:0/2227503166 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf6c06be30 msgr2=0x7faf6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf6c06be30 0x7faf6c06e2f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7faf78006fd0 tx=0x7faf78008040 comp rx=0 tx=0).stop 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 -- 172.21.15.99:0/2227503166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c0d0b70 msgr2=0x7faf8c153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c0d0b70 0x7faf8c153fe0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7faf7c034040 tx=0x7faf7c004a40 comp rx=0 tx=0).stop 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 -- 172.21.15.99:0/2227503166 shutdown_connections 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf8c162ff0 0x7faf8c14ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf8c0d11d0 0x7faf8c14e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faf6c06be30 0x7faf6c06e2f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 --2- 172.21.15.99:0/2227503166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c0d0b70 0x7faf8c153fe0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 -- 172.21.15.99:0/2227503166 >> 172.21.15.99:0/2227503166 conn(0x7faf8c06bc10 msgr2=0x7faf8c161730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 -- 172.21.15.99:0/2227503166 shutdown_connections 2024-09-10T07:41:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.290+0000 7faf93400640 1 -- 172.21.15.99:0/2227503166 wait complete. 2024-09-10T07:41:04.307 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:41:04.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:41:04.405 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:41:04.513 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:41:04.513 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:41:04.513 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:41:04.549 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:41:04.549 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:41:04.549 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:41:04.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:41:04.586 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:41:04.586 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:41:04.625 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:41:04.625 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:41:04.625 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:41:04.663 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:41:04.663 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T07:41:04.663 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:41:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.817+0000 7f08bbc00640 1 Processor -- start 2024-09-10T07:41:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.817+0000 7f08bbc00640 1 -- start start 2024-09-10T07:41:04.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08bbc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f08b4142150 0x7f08b4160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08bbc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f08b4160a80 0x7f08b40cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08bbc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b4142650 con 0x7f08b413fae0 2024-09-10T07:41:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08bbc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f08b40ce780 con 0x7f08b4142150 2024-09-10T07:41:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08bbc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f08b4142930 con 0x7f08b4160a80 2024-09-10T07:41:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08abe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f08b4142150 0x7f08b4160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08abe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f08b4142150 0x7f08b4160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46570/0 (socket says 172.21.15.99:46570) 2024-09-10T07:41:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08abe00640 1 -- 172.21.15.99:0/3176729950 learned_addr learned my addr 172.21.15.99:0/3176729950 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08b9c00640 1 --2- 172.21.15.99:0/3176729950 >> v2:172.21.15.187:3300/0 conn(0x7f08b4160a80 0x7f08b40cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08abe00640 1 -- 172.21.15.99:0/3176729950 >> v2:172.21.15.187:3300/0 conn(0x7f08b4160a80 msgr2=0x7f08b40cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08abe00640 1 --2- 172.21.15.99:0/3176729950 >> v2:172.21.15.187:3300/0 conn(0x7f08b4160a80 0x7f08b40cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08abe00640 1 -- 172.21.15.99:0/3176729950 >> v1:172.21.15.187:6789/0 conn(0x7f08b413fae0 legacy=0x7f08b406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.819+0000 7f08abe00640 1 -- 172.21.15.99:0/3176729950 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b4142c10 con 0x7f08b4142150 2024-09-10T07:41:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.820+0000 7f08abe00640 1 --2- 172.21.15.99:0/3176729950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 0x7f08b4160540 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f08b40b39c0 tx=0x7f089c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de791fd24a4f5f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.820+0000 7f08b3e00640 1 -- 172.21.15.99:0/3176729950 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c037070 con 0x7f08b4142150 2024-09-10T07:41:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.821+0000 7f08b3e00640 1 -- 172.21.15.99:0/3176729950 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c032440 con 0x7f08b4142150 2024-09-10T07:41:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.821+0000 7f08b3e00640 1 -- 172.21.15.99:0/3176729950 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c032810 con 0x7f08b4142150 2024-09-10T07:41:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.821+0000 7f08bbc00640 1 -- 172.21.15.99:0/3176729950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 msgr2=0x7f08b4160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.821+0000 7f08bbc00640 1 --2- 172.21.15.99:0/3176729950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 0x7f08b4160540 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f08b40b39c0 tx=0x7f089c02a200 comp rx=0 tx=0).stop 2024-09-10T07:41:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.821+0000 7f08bbc00640 1 -- 172.21.15.99:0/3176729950 shutdown_connections 2024-09-10T07:41:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.821+0000 7f08bbc00640 1 --2- 172.21.15.99:0/3176729950 >> v2:172.21.15.187:3300/0 conn(0x7f08b4160a80 0x7f08b40cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.821+0000 7f08bbc00640 1 --2- 172.21.15.99:0/3176729950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 0x7f08b4160540 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.821+0000 7f08bbc00640 1 -- 172.21.15.99:0/3176729950 >> 172.21.15.99:0/3176729950 conn(0x7f08b406bc10 msgr2=0x7f08b406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.821+0000 7f08bbc00640 1 -- 172.21.15.99:0/3176729950 shutdown_connections 2024-09-10T07:41:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.821+0000 7f08bbc00640 1 -- 172.21.15.99:0/3176729950 wait complete. 2024-09-10T07:41:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.823+0000 7f08bbc00640 1 Processor -- start 2024-09-10T07:41:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.823+0000 7f08bbc00640 1 -- start start 2024-09-10T07:41:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08bbc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b413fae0 0x7f08b40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08bbc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 0x7f08b41455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08bbc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b4160a80 0x7f08b413ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08bbc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f08b40cf2d0 con 0x7f08b4142150 2024-09-10T07:41:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08bbc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f08b40cf150 con 0x7f08b413fae0 2024-09-10T07:41:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08bbc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f08b40cf450 con 0x7f08b4160a80 2024-09-10T07:41:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08abe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 0x7f08b41455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08abe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 0x7f08b41455a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46576/0 (socket says 172.21.15.99:46576) 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08abe00640 1 -- 172.21.15.99:0/181898846 learned_addr learned my addr 172.21.15.99:0/181898846 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08b9c00640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b4160a80 0x7f08b413ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08b9200640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b413fae0 0x7f08b40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.824+0000 7f08abe00640 1 -- 172.21.15.99:0/181898846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b4160a80 msgr2=0x7f08b413ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08abe00640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b4160a80 0x7f08b413ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08abe00640 1 -- 172.21.15.99:0/181898846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b413fae0 msgr2=0x7f08b40b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08abe00640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b413fae0 0x7f08b40b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08abe00640 1 -- 172.21.15.99:0/181898846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b4146290 con 0x7f08b4142150 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08b9200640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b413fae0 0x7f08b40b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08abe00640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 0x7f08b41455a0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f089c02a240 tx=0x7f089c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08b1600640 1 -- 172.21.15.99:0/181898846 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c037040 con 0x7f08b4142150 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08b1600640 1 -- 172.21.15.99:0/181898846 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c042070 con 0x7f08b4142150 2024-09-10T07:41:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08bbc00640 1 -- 172.21.15.99:0/181898846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b4145fb0 con 0x7f08b4142150 2024-09-10T07:41:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08b1600640 1 -- 172.21.15.99:0/181898846 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c030880 con 0x7f08b4142150 2024-09-10T07:41:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.825+0000 7f08bbc00640 1 -- 172.21.15.99:0/181898846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b41f8890 con 0x7f08b4142150 2024-09-10T07:41:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.826+0000 7f08bbc00640 1 -- 172.21.15.99:0/181898846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b4160540 con 0x7f08b4142150 2024-09-10T07:41:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.827+0000 7f08b1600640 1 -- 172.21.15.99:0/181898846 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f089c030a20 con 0x7f08b4142150 2024-09-10T07:41:04.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.828+0000 7f08b1600640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f089006be30 0x7f089006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:04.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.828+0000 7f08b1600640 1 -- 172.21.15.99:0/181898846 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7f089c0ab3d0 con 0x7f08b4142150 2024-09-10T07:41:04.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.828+0000 7f08b9200640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f089006be30 0x7f089006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:04.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.829+0000 7f08b9200640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f089006be30 0x7f089006e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f08a4001680 tx=0x7f08a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:04.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:04.833+0000 7f08b1600640 1 -- 172.21.15.99:0/181898846 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f089c07a080 con 0x7f08b4142150 2024-09-10T07:41:05.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.042+0000 7f08bbc00640 1 -- 172.21.15.99:0/181898846 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08b40d0080 con 0x7f08b4142150 2024-09-10T07:41:05.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.043+0000 7f08b1600640 1 -- 172.21.15.99:0/181898846 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+3914 (secure 0 0 0) 0x7f089c079980 con 0x7f08b4142150 2024-09-10T07:41:05.043 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:05.043 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":68,"btime":"2024-09-10T07:40:58:880820+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/4097316027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":4097316027},{"type":"v1","addr":"172.21.15.187:6834","nonce":4097316027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2128941619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2128941619},{"type":"v1","addr":"172.21.15.187:6835","nonce":2128941619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/722129971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":722129971},{"type":"v1","addr":"172.21.15.99:6835","nonce":722129971}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7083,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1650255891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1650255891},{"type":"v1","addr":"172.21.15.99:6837","nonce":1650255891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[]} 2024-09-10T07:41:05.043 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 68 2024-09-10T07:41:05.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 -- 172.21.15.99:0/181898846 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f089006be30 msgr2=0x7f089006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:05.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f089006be30 0x7f089006e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f08a4001680 tx=0x7f08a4009040 comp rx=0 tx=0).stop 2024-09-10T07:41:05.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 -- 172.21.15.99:0/181898846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 msgr2=0x7f08b41455a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:05.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 0x7f08b41455a0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f089c02a240 tx=0x7f089c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:41:05.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 -- 172.21.15.99:0/181898846 shutdown_connections 2024-09-10T07:41:05.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b4160a80 0x7f08b413ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f089006be30 0x7f089006e2f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08b4142150 0x7f08b41455a0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 --2- 172.21.15.99:0/181898846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b413fae0 0x7f08b40b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 -- 172.21.15.99:0/181898846 >> 172.21.15.99:0/181898846 conn(0x7f08b406bc10 msgr2=0x7f08b415e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 -- 172.21.15.99:0/181898846 shutdown_connections 2024-09-10T07:41:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.045+0000 7f08bbc00640 1 -- 172.21.15.99:0/181898846 wait complete. 2024-09-10T07:41:05.061 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:41:05.061 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T07:41:05.061 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:41:05.061 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:41:05.062 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:41:05.062 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T07:41:05.062 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:41:05.062 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:41:05.062 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:41:05.062 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T07:41:05.063 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:41:05.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:41:05.063 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:41:05.063 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T07:41:05.063 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:41:05.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:41:05.077 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:41:05.078 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:41:05.078 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:41:05.079 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:41:05.080 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:41:05.080 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:41:05.085 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:41:05.085 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:41:05.122 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:41:05.122 DEBUG:teuthology.parallel:result is None 2024-09-10T07:41:05.124 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:41:05.125 DEBUG:teuthology.parallel:result is None 2024-09-10T07:41:05.125 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:41:05.125 DEBUG:teuthology.parallel:result is None 2024-09-10T07:41:05.127 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:41:05.127 DEBUG:teuthology.parallel:result is None 2024-09-10T07:41:05.127 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T07:41:05.253 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:41:05.255 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:41:05.255 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:41:05.256 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:41:05.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.289+0000 7fc699800640 1 Processor -- start 2024-09-10T07:41:05.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.289+0000 7fc699800640 1 -- start start 2024-09-10T07:41:05.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc699800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc69415eda0 0x7fc6940d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:05.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc699800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6940d0480 0x7fc6940d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:05.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc699800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6940d0bf0 con 0x7fc6940d3af0 2024-09-10T07:41:05.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc699800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc6940d2880 con 0x7fc69415eda0 2024-09-10T07:41:05.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc699800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc6940d3120 con 0x7fc6940d0480 2024-09-10T07:41:05.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc692a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc69415eda0 0x7fc6940d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:05.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc692a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc69415eda0 0x7fc6940d5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46624/0 (socket says 172.21.15.99:46624) 2024-09-10T07:41:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc692a00640 1 -- 172.21.15.99:0/2114239663 learned_addr learned my addr 172.21.15.99:0/2114239663 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc692000640 1 --2- 172.21.15.99:0/2114239663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6940d0480 0x7fc6940d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc692a00640 1 -- 172.21.15.99:0/2114239663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6940d0480 msgr2=0x7fc6940d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.291+0000 7fc692a00640 1 --2- 172.21.15.99:0/2114239663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6940d0480 0x7fc6940d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.292+0000 7fc692a00640 1 -- 172.21.15.99:0/2114239663 >> v1:172.21.15.187:6789/0 conn(0x7fc6940d3af0 legacy=0x7fc6940d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.292+0000 7fc692a00640 1 -- 172.21.15.99:0/2114239663 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6940d2ad0 con 0x7fc69415eda0 2024-09-10T07:41:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.293+0000 7fc692a00640 1 --2- 172.21.15.99:0/2114239663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415eda0 0x7fc6940d5790 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fc684009870 tx=0x7fc68402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f6aad492b8771b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.293+0000 7fc691600640 1 -- 172.21.15.99:0/2114239663 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684037070 con 0x7fc69415eda0 2024-09-10T07:41:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.293+0000 7fc691600640 1 -- 172.21.15.99:0/2114239663 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc684032440 con 0x7fc69415eda0 2024-09-10T07:41:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.293+0000 7fc691600640 1 -- 172.21.15.99:0/2114239663 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684032810 con 0x7fc69415eda0 2024-09-10T07:41:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.294+0000 7fc699800640 1 -- 172.21.15.99:0/2114239663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415eda0 msgr2=0x7fc6940d5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.294+0000 7fc699800640 1 --2- 172.21.15.99:0/2114239663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415eda0 0x7fc6940d5790 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fc684009870 tx=0x7fc68402a270 comp rx=0 tx=0).stop 2024-09-10T07:41:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.294+0000 7fc699800640 1 -- 172.21.15.99:0/2114239663 shutdown_connections 2024-09-10T07:41:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.294+0000 7fc699800640 1 --2- 172.21.15.99:0/2114239663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6940d0480 0x7fc6940d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.294+0000 7fc699800640 1 --2- 172.21.15.99:0/2114239663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc69415eda0 0x7fc6940d5790 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.294+0000 7fc699800640 1 -- 172.21.15.99:0/2114239663 >> 172.21.15.99:0/2114239663 conn(0x7fc69409df40 msgr2=0x7fc6940d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.294+0000 7fc699800640 1 -- 172.21.15.99:0/2114239663 shutdown_connections 2024-09-10T07:41:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.294+0000 7fc699800640 1 -- 172.21.15.99:0/2114239663 wait complete. 2024-09-10T07:41:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.295+0000 7fc699800640 1 Processor -- start 2024-09-10T07:41:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.296+0000 7fc699800640 1 -- start start 2024-09-10T07:41:05.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.296+0000 7fc699800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940d0480 0x7fc6940c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:05.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.296+0000 7fc699800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69415eda0 0x7fc694157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:05.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc699800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6940cb3a0 0x7fc694157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:05.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc699800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc69415f180 con 0x7fc6940d0480 2024-09-10T07:41:05.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc699800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc6940d08c0 con 0x7fc6940cb3a0 2024-09-10T07:41:05.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc699800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc69415f300 con 0x7fc69415eda0 2024-09-10T07:41:05.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc692a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940d0480 0x7fc6940c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:05.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc692a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940d0480 0x7fc6940c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46634/0 (socket says 172.21.15.99:46634) 2024-09-10T07:41:05.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc692a00640 1 -- 172.21.15.99:0/3107354998 learned_addr learned my addr 172.21.15.99:0/3107354998 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:05.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc692000640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69415eda0 0x7fc694157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:05.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc693400640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6940cb3a0 0x7fc694157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:05.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc692a00640 1 -- 172.21.15.99:0/3107354998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69415eda0 msgr2=0x7fc694157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:05.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc692a00640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69415eda0 0x7fc694157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:05.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc692a00640 1 -- 172.21.15.99:0/3107354998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6940cb3a0 msgr2=0x7fc694157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:05.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc692a00640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6940cb3a0 0x7fc694157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:05.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc692a00640 1 -- 172.21.15.99:0/3107354998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6940ca050 con 0x7fc6940d0480 2024-09-10T07:41:05.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.297+0000 7fc692000640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69415eda0 0x7fc694157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:05.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.298+0000 7fc692a00640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940d0480 0x7fc6940c9b10 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc684009870 tx=0x7fc6840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:05.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.299+0000 7fc68aa00640 1 -- 172.21.15.99:0/3107354998 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684041070 con 0x7fc6940d0480 2024-09-10T07:41:05.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.299+0000 7fc68aa00640 1 -- 172.21.15.99:0/3107354998 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68403c870 con 0x7fc6940d0480 2024-09-10T07:41:05.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.299+0000 7fc699800640 1 -- 172.21.15.99:0/3107354998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6940ca300 con 0x7fc6940d0480 2024-09-10T07:41:05.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.299+0000 7fc68aa00640 1 -- 172.21.15.99:0/3107354998 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684037040 con 0x7fc6940d0480 2024-09-10T07:41:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.299+0000 7fc699800640 1 -- 172.21.15.99:0/3107354998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6940ca8c0 con 0x7fc6940d0480 2024-09-10T07:41:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.300+0000 7fc699800640 1 -- 172.21.15.99:0/3107354998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6940d35b0 con 0x7fc6940d0480 2024-09-10T07:41:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.301+0000 7fc68aa00640 1 -- 172.21.15.99:0/3107354998 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc684044070 con 0x7fc6940d0480 2024-09-10T07:41:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.302+0000 7fc68aa00640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc67406be30 0x7fc67406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.302+0000 7fc68aa00640 1 -- 172.21.15.99:0/3107354998 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 4943+0+0 (secure 0 0 0) 0x7fc6840ab580 con 0x7fc6940d0480 2024-09-10T07:41:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.302+0000 7fc692000640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc67406be30 0x7fc67406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:05.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.303+0000 7fc692000640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc67406be30 0x7fc67406e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc6941f8180 tx=0x7fc680008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.306+0000 7fc68aa00640 1 -- 172.21.15.99:0/3107354998 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc68407a340 con 0x7fc6940d0480 2024-09-10T07:41:05.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:05.491+0000 7fc699800640 1 -- 172.21.15.99:0/3107354998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc69406cab0 con 0x7fc6940d0480 2024-09-10T07:41:06.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.312+0000 7fc68aa00640 1 -- 172.21.15.99:0/3107354998 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v151) ==== 97+0+0 (secure 0 0 0) 0x7fc684079c40 con 0x7fc6940d0480 2024-09-10T07:41:06.312 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-09-10T07:41:06.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.316+0000 7fc699800640 1 -- 172.21.15.99:0/3107354998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc67406be30 msgr2=0x7fc67406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.316+0000 7fc699800640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc67406be30 0x7fc67406e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc6941f8180 tx=0x7fc680008040 comp rx=0 tx=0).stop 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.316+0000 7fc699800640 1 -- 172.21.15.99:0/3107354998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940d0480 msgr2=0x7fc6940c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.316+0000 7fc699800640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940d0480 0x7fc6940c9b10 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc684009870 tx=0x7fc6840046c0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.317+0000 7fc699800640 1 -- 172.21.15.99:0/3107354998 shutdown_connections 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.317+0000 7fc699800640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6940cb3a0 0x7fc694157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.317+0000 7fc699800640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc69415eda0 0x7fc694157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.317+0000 7fc699800640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc67406be30 0x7fc67406e2f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.317+0000 7fc699800640 1 --2- 172.21.15.99:0/3107354998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6940d0480 0x7fc6940c9b10 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.317+0000 7fc699800640 1 -- 172.21.15.99:0/3107354998 >> 172.21.15.99:0/3107354998 conn(0x7fc69409df40 msgr2=0x7fc6940b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.317+0000 7fc699800640 1 -- 172.21.15.99:0/3107354998 shutdown_connections 2024-09-10T07:41:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.317+0000 7fc699800640 1 -- 172.21.15.99:0/3107354998 wait complete. 2024-09-10T07:41:06.336 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T07:41:06.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.493+0000 7f460e800640 1 Processor -- start 2024-09-10T07:41:06.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.493+0000 7f460e800640 1 -- start start 2024-09-10T07:41:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.494+0000 7f460e800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f46080cf010 0x7f46080cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.494+0000 7f460e800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608162ba0 0x7f4608164f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.494+0000 7f460e800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f460815c4f0 con 0x7f4608152210 2024-09-10T07:41:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.494+0000 7f460e800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f460815b730 con 0x7f46080cf010 2024-09-10T07:41:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.494+0000 7f460e800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f460815ba10 con 0x7f4608162ba0 2024-09-10T07:41:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.495+0000 7f45fea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f46080cf010 0x7f46080cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.495+0000 7f45fea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f46080cf010 0x7f46080cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46644/0 (socket says 172.21.15.99:46644) 2024-09-10T07:41:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.495+0000 7f45fea00640 1 -- 172.21.15.99:0/3240174189 learned_addr learned my addr 172.21.15.99:0/3240174189 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.495+0000 7f4607e00640 1 --2- 172.21.15.99:0/3240174189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608162ba0 0x7f4608164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.495+0000 7f45fea00640 1 -- 172.21.15.99:0/3240174189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608162ba0 msgr2=0x7f4608164f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.495+0000 7f45fea00640 1 --2- 172.21.15.99:0/3240174189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608162ba0 0x7f4608164f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.495+0000 7f45fea00640 1 -- 172.21.15.99:0/3240174189 >> v1:172.21.15.187:6789/0 conn(0x7f4608152210 legacy=0x7f4608071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.495+0000 7f45fea00640 1 -- 172.21.15.99:0/3240174189 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460815bcf0 con 0x7f46080cf010 2024-09-10T07:41:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.495+0000 7f4607e00640 1 --2- 172.21.15.99:0/3240174189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608162ba0 0x7f4608164f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.496+0000 7f45fea00640 1 --2- 172.21.15.99:0/3240174189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 0x7f46080cf4a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009870 tx=0x7f45f002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2022fc35312caa95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.496+0000 7f4606a00640 1 -- 172.21.15.99:0/3240174189 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0037070 con 0x7f46080cf010 2024-09-10T07:41:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.496+0000 7f4606a00640 1 -- 172.21.15.99:0/3240174189 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f0032440 con 0x7f46080cf010 2024-09-10T07:41:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.496+0000 7f4606a00640 1 -- 172.21.15.99:0/3240174189 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0032810 con 0x7f46080cf010 2024-09-10T07:41:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.497+0000 7f460e800640 1 -- 172.21.15.99:0/3240174189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 msgr2=0x7f46080cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.497+0000 7f460e800640 1 --2- 172.21.15.99:0/3240174189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 0x7f46080cf4a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009870 tx=0x7f45f002a250 comp rx=0 tx=0).stop 2024-09-10T07:41:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.497+0000 7f460e800640 1 -- 172.21.15.99:0/3240174189 shutdown_connections 2024-09-10T07:41:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.497+0000 7f460e800640 1 --2- 172.21.15.99:0/3240174189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608162ba0 0x7f4608164f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.497+0000 7f460e800640 1 --2- 172.21.15.99:0/3240174189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 0x7f46080cf4a0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.497+0000 7f460e800640 1 -- 172.21.15.99:0/3240174189 >> 172.21.15.99:0/3240174189 conn(0x7f460806bc10 msgr2=0x7f460806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.497+0000 7f460e800640 1 -- 172.21.15.99:0/3240174189 shutdown_connections 2024-09-10T07:41:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.497+0000 7f460e800640 1 -- 172.21.15.99:0/3240174189 wait complete. 2024-09-10T07:41:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.499+0000 7f460e800640 1 Processor -- start 2024-09-10T07:41:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.499+0000 7f460e800640 1 -- start start 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.499+0000 7f460e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 0x7f460814d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.499+0000 7f460e800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608152210 0x7f460815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f460e800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4608162ba0 0x7f460815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f460e800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f46080725a0 con 0x7f46080cf010 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f460e800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f460806f380 con 0x7f4608162ba0 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f460e800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f460806e6c0 con 0x7f4608152210 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f4607400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 0x7f460814d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f4607400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 0x7f460814d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46652/0 (socket says 172.21.15.99:46652) 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f4607400640 1 -- 172.21.15.99:0/2056624337 learned_addr learned my addr 172.21.15.99:0/2056624337 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f45fea00640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608152210 0x7f460815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f4607e00640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4608162ba0 0x7f460815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f4607400640 1 -- 172.21.15.99:0/2056624337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608152210 msgr2=0x7f460815a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f4607400640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608152210 0x7f460815a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f4607400640 1 -- 172.21.15.99:0/2056624337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4608162ba0 msgr2=0x7f460815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f4607400640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4608162ba0 0x7f460815a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f4607400640 1 -- 172.21.15.99:0/2056624337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4608152b80 con 0x7f46080cf010 2024-09-10T07:41:06.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.500+0000 7f4607e00640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4608162ba0 0x7f460815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.501+0000 7f4607400640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 0x7f460814d100 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f45f800c480 tx=0x7f45f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.501+0000 7f45ffe00640 1 -- 172.21.15.99:0/2056624337 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f80052d0 con 0x7f46080cf010 2024-09-10T07:41:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.501+0000 7f45ffe00640 1 -- 172.21.15.99:0/2056624337 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f8005470 con 0x7f46080cf010 2024-09-10T07:41:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.501+0000 7f460e800640 1 -- 172.21.15.99:0/2056624337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4608152e60 con 0x7f46080cf010 2024-09-10T07:41:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.501+0000 7f45ffe00640 1 -- 172.21.15.99:0/2056624337 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8012870 con 0x7f46080cf010 2024-09-10T07:41:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.501+0000 7f460e800640 1 -- 172.21.15.99:0/2056624337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4608153420 con 0x7f46080cf010 2024-09-10T07:41:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.502+0000 7f460e800640 1 -- 172.21.15.99:0/2056624337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46080cf4a0 con 0x7f46080cf010 2024-09-10T07:41:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.503+0000 7f45ffe00640 1 -- 172.21.15.99:0/2056624337 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45f8012a10 con 0x7f46080cf010 2024-09-10T07:41:06.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.504+0000 7f45ffe00640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45e406be30 0x7f45e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.504+0000 7f45ffe00640 1 -- 172.21.15.99:0/2056624337 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 4857+0+0 (secure 0 0 0) 0x7f45f808a710 con 0x7f46080cf010 2024-09-10T07:41:06.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.504+0000 7f45fea00640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45e406be30 0x7f45e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.505+0000 7f45fea00640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45e406be30 0x7f45e406e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f45f0034000 tx=0x7f45f002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:06.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.509+0000 7f45ffe00640 1 -- 172.21.15.99:0/2056624337 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45f8059400 con 0x7f46080cf010 2024-09-10T07:41:06.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.745+0000 7f460e800640 1 -- 172.21.15.99:0/2056624337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4608155860 con 0x7f46080cf010 2024-09-10T07:41:06.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.745+0000 7f45ffe00640 1 -- 172.21.15.99:0/2056624337 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7f45f8058d00 con 0x7f46080cf010 2024-09-10T07:41:06.745 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:06.745 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:41:06.745 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-09-10T07:41:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-09-10T07:41:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw==", 2024-09-10T07:41:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:41:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:41:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:41:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ==", 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.747 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-09-10T07:41:06.748 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw==", 2024-09-10T07:41:06.748 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw==", 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:41:06.749 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA==", 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A==", 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w==", 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.751 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA==", 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w==", 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw==", 2024-09-10T07:41:06.753 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw==", 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg==", 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg==", 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:41:06.755 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow r", 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ==", 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A==", 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw==", 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.757 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBc9t9m2Fs5JBAAQfJNCUhmbHevYDJWsG/oAg==", 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.758 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q==", 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw==", 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:41:06.759 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:41:06.760 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:41:06.760 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:41:06.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:06.760 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:41:06.760 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:41:06.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.747+0000 7f460e800640 1 -- 172.21.15.99:0/2056624337 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45e406be30 msgr2=0x7f45e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.747+0000 7f460e800640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45e406be30 0x7f45e406e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f45f0034000 tx=0x7f45f002e000 comp rx=0 tx=0).stop 2024-09-10T07:41:06.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.747+0000 7f460e800640 1 -- 172.21.15.99:0/2056624337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 msgr2=0x7f460814d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.747+0000 7f460e800640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 0x7f460814d100 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f45f800c480 tx=0x7f45f800c940 comp rx=0 tx=0).stop 2024-09-10T07:41:06.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.748+0000 7f460e800640 1 -- 172.21.15.99:0/2056624337 shutdown_connections 2024-09-10T07:41:06.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.748+0000 7f460e800640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4608162ba0 0x7f460815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.748+0000 7f460e800640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4608152210 0x7f460815a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.748+0000 7f460e800640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f45e406be30 0x7f45e406e2f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.748+0000 7f460e800640 1 --2- 172.21.15.99:0/2056624337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46080cf010 0x7f460814d100 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.748+0000 7f460e800640 1 -- 172.21.15.99:0/2056624337 >> 172.21.15.99:0/2056624337 conn(0x7f460806bc10 msgr2=0x7f4608151320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:06.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.748+0000 7f460e800640 1 -- 172.21.15.99:0/2056624337 shutdown_connections 2024-09-10T07:41:06.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.748+0000 7f460e800640 1 -- 172.21.15.99:0/2056624337 wait complete. 2024-09-10T07:41:06.763 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:41:06.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.916+0000 7fce82c00640 1 Processor -- start 2024-09-10T07:41:06.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.917+0000 7fce82c00640 1 -- start start 2024-09-10T07:41:06.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce82c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fce7c072f40 0x7fce7c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce82c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce7c0ce780 0x7fce7c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce82c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce7c06e3d0 con 0x7fce7c145290 2024-09-10T07:41:06.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce82c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fce7c06efe0 con 0x7fce7c0ce780 2024-09-10T07:41:06.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce82c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fce7c06e6b0 con 0x7fce7c072f40 2024-09-10T07:41:06.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce7be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fce7c145290 0x7fce7c072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50328/0 (socket says 172.21.15.99:50328) 2024-09-10T07:41:06.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce7be00640 1 -- 172.21.15.99:0/2785357016 learned_addr learned my addr 172.21.15.99:0/2785357016 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:06.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce80c00640 1 --2- 172.21.15.99:0/2785357016 >> v2:172.21.15.99:3300/0 conn(0x7fce7c0ce780 0x7fce7c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce7b400640 1 --2- 172.21.15.99:0/2785357016 >> v2:172.21.15.187:3300/0 conn(0x7fce7c072f40 0x7fce7c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce80c00640 1 -- 172.21.15.99:0/2785357016 >> v2:172.21.15.187:3300/0 conn(0x7fce7c072f40 msgr2=0x7fce7c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:06.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce80c00640 1 --2- 172.21.15.99:0/2785357016 >> v2:172.21.15.187:3300/0 conn(0x7fce7c072f40 0x7fce7c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.918+0000 7fce80c00640 1 -- 172.21.15.99:0/2785357016 >> v1:172.21.15.99:6789/0 conn(0x7fce7c145290 legacy=0x7fce7c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.919+0000 7fce80c00640 1 -- 172.21.15.99:0/2785357016 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c06e990 con 0x7fce7c0ce780 2024-09-10T07:41:06.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.919+0000 7fce7aa00640 1 -- 172.21.15.99:0/2785357016 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776161383 0 0) 0x7fce7c06e3d0 con 0x7fce7c145290 2024-09-10T07:41:06.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.919+0000 7fce7b400640 1 --2- 172.21.15.99:0/2785357016 >> v2:172.21.15.187:3300/0 conn(0x7fce7c072f40 0x7fce7c06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:06.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.920+0000 7fce80c00640 1 --2- 172.21.15.99:0/2785357016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 0x7fce7c0b3930 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fce7c06d450 tx=0x7fce7402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa056d910cd8b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:06.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.920+0000 7fce7aa00640 1 -- 172.21.15.99:0/2785357016 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74007740 con 0x7fce7c0ce780 2024-09-10T07:41:06.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.920+0000 7fce7aa00640 1 -- 172.21.15.99:0/2785357016 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce740078e0 con 0x7fce7c0ce780 2024-09-10T07:41:06.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.920+0000 7fce7aa00640 1 -- 172.21.15.99:0/2785357016 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74007cb0 con 0x7fce7c0ce780 2024-09-10T07:41:06.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.920+0000 7fce82c00640 1 -- 172.21.15.99:0/2785357016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 msgr2=0x7fce7c0b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.920+0000 7fce82c00640 1 --2- 172.21.15.99:0/2785357016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 0x7fce7c0b3930 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fce7c06d450 tx=0x7fce7402a680 comp rx=0 tx=0).stop 2024-09-10T07:41:06.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.920+0000 7fce82c00640 1 -- 172.21.15.99:0/2785357016 shutdown_connections 2024-09-10T07:41:06.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.920+0000 7fce82c00640 1 --2- 172.21.15.99:0/2785357016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 0x7fce7c0b3930 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.920+0000 7fce82c00640 1 --2- 172.21.15.99:0/2785357016 >> v2:172.21.15.187:3300/0 conn(0x7fce7c072f40 0x7fce7c06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.920+0000 7fce82c00640 1 -- 172.21.15.99:0/2785357016 >> 172.21.15.99:0/2785357016 conn(0x7fce7c06bc10 msgr2=0x7fce7c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:06.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.921+0000 7fce82c00640 1 -- 172.21.15.99:0/2785357016 shutdown_connections 2024-09-10T07:41:06.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.921+0000 7fce82c00640 1 -- 172.21.15.99:0/2785357016 wait complete. 2024-09-10T07:41:06.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.922+0000 7fce82c00640 1 Processor -- start 2024-09-10T07:41:06.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.922+0000 7fce82c00640 1 -- start start 2024-09-10T07:41:06.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.923+0000 7fce82c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7c072f40 0x7fce7c13c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.923+0000 7fce82c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 0x7fce7c13c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.923+0000 7fce82c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7c145290 0x7fce7c1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.923+0000 7fce82c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c06df80 con 0x7fce7c0ce780 2024-09-10T07:41:06.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.923+0000 7fce82c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c145670 con 0x7fce7c072f40 2024-09-10T07:41:06.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.923+0000 7fce82c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fce7c06e100 con 0x7fce7c145290 2024-09-10T07:41:06.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce7b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 0x7fce7c13c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce7b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 0x7fce7c13c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46660/0 (socket says 172.21.15.99:46660) 2024-09-10T07:41:06.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce7b400640 1 -- 172.21.15.99:0/362487705 learned_addr learned my addr 172.21.15.99:0/362487705 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:06.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce80c00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7c145290 0x7fce7c1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce7be00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7c072f40 0x7fce7c13c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce7b400640 1 -- 172.21.15.99:0/362487705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7c145290 msgr2=0x7fce7c1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce7b400640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7c145290 0x7fce7c1428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce7b400640 1 -- 172.21.15.99:0/362487705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7c072f40 msgr2=0x7fce7c13c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:06.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce7b400640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7c072f40 0x7fce7c13c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:06.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce7b400640 1 -- 172.21.15.99:0/362487705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c0cc300 con 0x7fce7c0ce780 2024-09-10T07:41:06.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.924+0000 7fce7b400640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 0x7fce7c13c680 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fce6800c820 tx=0x7fce6800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:06.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.925+0000 7fce73e00640 1 -- 172.21.15.99:0/362487705 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68015070 con 0x7fce7c0ce780 2024-09-10T07:41:06.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.925+0000 7fce73e00640 1 -- 172.21.15.99:0/362487705 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce68007a30 con 0x7fce7c0ce780 2024-09-10T07:41:06.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.925+0000 7fce73e00640 1 -- 172.21.15.99:0/362487705 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68007de0 con 0x7fce7c0ce780 2024-09-10T07:41:06.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.925+0000 7fce82c00640 1 -- 172.21.15.99:0/362487705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7c144670 con 0x7fce7c0ce780 2024-09-10T07:41:06.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.926+0000 7fce82c00640 1 -- 172.21.15.99:0/362487705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7c0cc570 con 0x7fce7c0ce780 2024-09-10T07:41:06.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.927+0000 7fce82c00640 1 -- 172.21.15.99:0/362487705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce7c071510 con 0x7fce7c0ce780 2024-09-10T07:41:06.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.928+0000 7fce73e00640 1 -- 172.21.15.99:0/362487705 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce68018070 con 0x7fce7c0ce780 2024-09-10T07:41:06.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.928+0000 7fce73e00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fce5c06be30 0x7fce5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:06.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.929+0000 7fce73e00640 1 -- 172.21.15.99:0/362487705 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 4857+0+0 (secure 0 0 0) 0x7fce6808a8d0 con 0x7fce7c0ce780 2024-09-10T07:41:06.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.929+0000 7fce7be00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fce5c06be30 0x7fce5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:06.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.929+0000 7fce7be00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fce5c06be30 0x7fce5c06e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fce6c000f60 tx=0x7fce6c007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:06.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:06.933+0000 7fce73e00640 1 -- 172.21.15.99:0/362487705 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce68058f70 con 0x7fce7c0ce780 2024-09-10T07:41:07.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.107+0000 7fce82c00640 1 -- 172.21.15.99:0/362487705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fce7c15f4e0 con 0x7fce7c0ce780 2024-09-10T07:41:07.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.107+0000 7fce73e00640 1 -- 172.21.15.99:0/362487705 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v151) ==== 84+0+65 (secure 0 0 0) 0x7fce6805d270 con 0x7fce7c0ce780 2024-09-10T07:41:07.107 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:07.107 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:41:07.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:41:07.107 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:41:07.107 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:41:07.108 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:41:07.108 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:41:07.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 -- 172.21.15.99:0/362487705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fce5c06be30 msgr2=0x7fce5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fce5c06be30 0x7fce5c06e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fce6c000f60 tx=0x7fce6c007d50 comp rx=0 tx=0).stop 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 -- 172.21.15.99:0/362487705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 msgr2=0x7fce7c13c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 0x7fce7c13c680 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fce6800c820 tx=0x7fce6800cce0 comp rx=0 tx=0).stop 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 -- 172.21.15.99:0/362487705 shutdown_connections 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7c145290 0x7fce7c1428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fce5c06be30 0x7fce5c06e2f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce7c0ce780 0x7fce7c13c680 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 --2- 172.21.15.99:0/362487705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce7c072f40 0x7fce7c13c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 -- 172.21.15.99:0/362487705 >> 172.21.15.99:0/362487705 conn(0x7fce7c06bc10 msgr2=0x7fce7c15df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.109+0000 7fce82c00640 1 -- 172.21.15.99:0/362487705 shutdown_connections 2024-09-10T07:41:07.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.110+0000 7fce82c00640 1 -- 172.21.15.99:0/362487705 wait complete. 2024-09-10T07:41:07.125 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:41:07.125 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:41:07.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.282+0000 7fa48b200640 1 Processor -- start 2024-09-10T07:41:07.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.282+0000 7fa48b200640 1 -- start start 2024-09-10T07:41:07.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.283+0000 7fa48b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 0x7fa4840cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:07.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.283+0000 7fa48b200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa48406d8d0 0x7fa48406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:07.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.283+0000 7fa48b200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa48415d370 con 0x7fa4840afde0 2024-09-10T07:41:07.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.283+0000 7fa48b200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa48406e260 con 0x7fa48406d8d0 2024-09-10T07:41:07.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.283+0000 7fa48b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa48415d140 con 0x7fa48415cce0 2024-09-10T07:41:07.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.284+0000 7fa489400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 0x7fa4840cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:07.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.284+0000 7fa489e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fa4840afde0 0x7fa4840712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:38166/0 (socket says 172.21.15.99:38166) 2024-09-10T07:41:07.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.284+0000 7fa489e00640 1 -- 172.21.15.99:0/2135157722 learned_addr learned my addr 172.21.15.99:0/2135157722 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:07.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.284+0000 7fa48a800640 1 --2- 172.21.15.99:0/2135157722 >> v2:172.21.15.187:3300/0 conn(0x7fa48406d8d0 0x7fa48406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:07.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.284+0000 7fa489400640 1 --2- 172.21.15.99:0/2135157722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 0x7fa4840cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:37522/0 (socket says 172.21.15.99:37522) 2024-09-10T07:41:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.284+0000 7fa489400640 1 -- 172.21.15.99:0/2135157722 >> v2:172.21.15.187:3300/0 conn(0x7fa48406d8d0 msgr2=0x7fa48406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.284+0000 7fa489400640 1 --2- 172.21.15.99:0/2135157722 >> v2:172.21.15.187:3300/0 conn(0x7fa48406d8d0 0x7fa48406dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.284+0000 7fa489400640 1 -- 172.21.15.99:0/2135157722 >> v1:172.21.15.187:6789/0 conn(0x7fa4840afde0 legacy=0x7fa4840712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.284+0000 7fa489400640 1 -- 172.21.15.99:0/2135157722 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48415d650 con 0x7fa48415cce0 2024-09-10T07:41:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.284+0000 7fa48a800640 1 --2- 172.21.15.99:0/2135157722 >> v2:172.21.15.187:3300/0 conn(0x7fa48406d8d0 0x7fa48406dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:41:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.285+0000 7fa489400640 1 --2- 172.21.15.99:0/2135157722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 0x7fa4840cccf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa4740097a0 tx=0x7fa47402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b29a651d2261d5c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:07.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.286+0000 7fa488a00640 1 -- 172.21.15.99:0/2135157722 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474037070 con 0x7fa48415cce0 2024-09-10T07:41:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.286+0000 7fa488a00640 1 -- 172.21.15.99:0/2135157722 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47402adb0 con 0x7fa48415cce0 2024-09-10T07:41:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.286+0000 7fa488a00640 1 -- 172.21.15.99:0/2135157722 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474032660 con 0x7fa48415cce0 2024-09-10T07:41:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.286+0000 7fa48b200640 1 -- 172.21.15.99:0/2135157722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 msgr2=0x7fa4840cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.286+0000 7fa48b200640 1 --2- 172.21.15.99:0/2135157722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 0x7fa4840cccf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa4740097a0 tx=0x7fa47402a060 comp rx=0 tx=0).stop 2024-09-10T07:41:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.286+0000 7fa48b200640 1 -- 172.21.15.99:0/2135157722 shutdown_connections 2024-09-10T07:41:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.286+0000 7fa48b200640 1 --2- 172.21.15.99:0/2135157722 >> v2:172.21.15.187:3300/0 conn(0x7fa48406d8d0 0x7fa48406dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.286+0000 7fa48b200640 1 --2- 172.21.15.99:0/2135157722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 0x7fa4840cccf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.286+0000 7fa48b200640 1 -- 172.21.15.99:0/2135157722 >> 172.21.15.99:0/2135157722 conn(0x7fa48406bc10 msgr2=0x7fa48406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.287+0000 7fa48b200640 1 -- 172.21.15.99:0/2135157722 shutdown_connections 2024-09-10T07:41:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.287+0000 7fa48b200640 1 -- 172.21.15.99:0/2135157722 wait complete. 2024-09-10T07:41:07.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.288+0000 7fa48b200640 1 Processor -- start 2024-09-10T07:41:07.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.288+0000 7fa48b200640 1 -- start start 2024-09-10T07:41:07.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.289+0000 7fa48b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48406d8d0 0x7fa4840b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:07.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.289+0000 7fa48b200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4840afde0 0x7fa484159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.289+0000 7fa48b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 0x7fa484147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.289+0000 7fa48b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa48415dc10 con 0x7fa48406d8d0 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.289+0000 7fa48b200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa4840cd230 con 0x7fa4840afde0 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.289+0000 7fa48b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa48406d3b0 con 0x7fa48415cce0 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.289+0000 7fa489e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48406d8d0 0x7fa4840b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa489e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48406d8d0 0x7fa4840b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46672/0 (socket says 172.21.15.99:46672) 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa489e00640 1 -- 172.21.15.99:0/2533570993 learned_addr learned my addr 172.21.15.99:0/2533570993 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa48a800640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 0x7fa484147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa489400640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4840afde0 0x7fa484159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa489e00640 1 -- 172.21.15.99:0/2533570993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 msgr2=0x7fa484147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa489e00640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 0x7fa484147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa489e00640 1 -- 172.21.15.99:0/2533570993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4840afde0 msgr2=0x7fa484159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:07.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa489e00640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4840afde0 0x7fa484159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:07.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa489e00640 1 -- 172.21.15.99:0/2533570993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa484158d50 con 0x7fa48406d8d0 2024-09-10T07:41:07.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa489e00640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48406d8d0 0x7fa4840b45d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c400 tx=0x7fa47800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:07.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa47e000640 1 -- 172.21.15.99:0/2533570993 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478017070 con 0x7fa48406d8d0 2024-09-10T07:41:07.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.290+0000 7fa47e000640 1 -- 172.21.15.99:0/2533570993 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478005ce0 con 0x7fa48406d8d0 2024-09-10T07:41:07.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.291+0000 7fa48b200640 1 -- 172.21.15.99:0/2533570993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa484159030 con 0x7fa48406d8d0 2024-09-10T07:41:07.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.291+0000 7fa47e000640 1 -- 172.21.15.99:0/2533570993 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4780072f0 con 0x7fa48406d8d0 2024-09-10T07:41:07.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.291+0000 7fa48b200640 1 -- 172.21.15.99:0/2533570993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4841595f0 con 0x7fa48406d8d0 2024-09-10T07:41:07.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.292+0000 7fa48b200640 1 -- 172.21.15.99:0/2533570993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4841597f0 con 0x7fa48406d8d0 2024-09-10T07:41:07.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.293+0000 7fa47e000640 1 -- 172.21.15.99:0/2533570993 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa47801a070 con 0x7fa48406d8d0 2024-09-10T07:41:07.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.293+0000 7fa47e000640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 0x7fa46806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:07.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.294+0000 7fa47e000640 1 -- 172.21.15.99:0/2533570993 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 4857+0+0 (secure 0 0 0) 0x7fa478089f50 con 0x7fa48406d8d0 2024-09-10T07:41:07.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.294+0000 7fa489400640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 0x7fa46806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:07.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.294+0000 7fa489400640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 0x7fa46806e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa474034000 tx=0x7fa47402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:07.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.298+0000 7fa47e000640 1 -- 172.21.15.99:0/2533570993 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa478058c40 con 0x7fa48406d8d0 2024-09-10T07:41:07.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:07.472+0000 7fa48b200640 1 -- 172.21.15.99:0/2533570993 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa484071ac0 con 0x7fa48406d8d0 2024-09-10T07:41:08.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.316+0000 7fa47e000640 1 -- 172.21.15.99:0/2533570993 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v152) ==== 138+0+0 (secure 0 0 0) 0x7fa478058540 con 0x7fa48406d8d0 2024-09-10T07:41:08.316 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:41:08.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.320+0000 7fa48b200640 1 -- 172.21.15.99:0/2533570993 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 msgr2=0x7fa46806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:08.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.320+0000 7fa48b200640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 0x7fa46806e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa474034000 tx=0x7fa47402e000 comp rx=0 tx=0).stop 2024-09-10T07:41:08.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.320+0000 7fa48b200640 1 -- 172.21.15.99:0/2533570993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48406d8d0 msgr2=0x7fa4840b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:08.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.320+0000 7fa48b200640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48406d8d0 0x7fa4840b45d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c400 tx=0x7fa47800c8c0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.320+0000 7fa48b200640 1 -- 172.21.15.99:0/2533570993 shutdown_connections 2024-09-10T07:41:08.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.320+0000 7fa48b200640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa48415cce0 0x7fa484147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.320+0000 7fa48b200640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4840afde0 0x7fa484159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.320+0000 7fa48b200640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa46806be30 0x7fa46806e2f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.320+0000 7fa48b200640 1 --2- 172.21.15.99:0/2533570993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa48406d8d0 0x7fa4840b45d0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.320+0000 7fa48b200640 1 -- 172.21.15.99:0/2533570993 >> 172.21.15.99:0/2533570993 conn(0x7fa48406bc10 msgr2=0x7fa4840b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:08.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.322+0000 7fa48b200640 1 -- 172.21.15.99:0/2533570993 shutdown_connections 2024-09-10T07:41:08.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.322+0000 7fa48b200640 1 -- 172.21.15.99:0/2533570993 wait complete. 2024-09-10T07:41:08.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:41:08.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.502+0000 7fb523e00640 1 Processor -- start 2024-09-10T07:41:08.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.502+0000 7fb523e00640 1 -- start start 2024-09-10T07:41:08.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.503+0000 7fb523e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb52415e970 0x7fb5240d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:08.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.503+0000 7fb523e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5240cfc90 0x7fb5240c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:08.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.503+0000 7fb523e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5240d2bd0 con 0x7fb5240d2680 2024-09-10T07:41:08.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.503+0000 7fb523e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb5240d37e0 con 0x7fb5240cfc90 2024-09-10T07:41:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.503+0000 7fb523e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb5240d2eb0 con 0x7fb52415e970 2024-09-10T07:41:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.504+0000 7fb523400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5240cfc90 0x7fb5240c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.504+0000 7fb523400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5240cfc90 0x7fb5240c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46680/0 (socket says 172.21.15.99:46680) 2024-09-10T07:41:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.504+0000 7fb523400640 1 -- 172.21.15.99:0/957807009 learned_addr learned my addr 172.21.15.99:0/957807009 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.504+0000 7fb522a00640 1 --2- 172.21.15.99:0/957807009 >> v2:172.21.15.187:3300/0 conn(0x7fb52415e970 0x7fb5240d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.504+0000 7fb523400640 1 -- 172.21.15.99:0/957807009 >> v2:172.21.15.187:3300/0 conn(0x7fb52415e970 msgr2=0x7fb5240d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.504+0000 7fb523400640 1 --2- 172.21.15.99:0/957807009 >> v2:172.21.15.187:3300/0 conn(0x7fb52415e970 0x7fb5240d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.504+0000 7fb523400640 1 -- 172.21.15.99:0/957807009 >> v1:172.21.15.187:6789/0 conn(0x7fb5240d2680 legacy=0x7fb5240cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.504+0000 7fb523400640 1 -- 172.21.15.99:0/957807009 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5240d3190 con 0x7fb5240cfc90 2024-09-10T07:41:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.505+0000 7fb523400640 1 --2- 172.21.15.99:0/957807009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 0x7fb5240c8700 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb52406c1c0 tx=0x7fb51c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66c59994d2e8d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.505+0000 7fb521600640 1 -- 172.21.15.99:0/957807009 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c036070 con 0x7fb5240cfc90 2024-09-10T07:41:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.505+0000 7fb521600640 1 -- 172.21.15.99:0/957807009 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c031600 con 0x7fb5240cfc90 2024-09-10T07:41:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.505+0000 7fb521600640 1 -- 172.21.15.99:0/957807009 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0319f0 con 0x7fb5240cfc90 2024-09-10T07:41:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.506+0000 7fb523e00640 1 -- 172.21.15.99:0/957807009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 msgr2=0x7fb5240c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.506+0000 7fb523e00640 1 --2- 172.21.15.99:0/957807009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 0x7fb5240c8700 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb52406c1c0 tx=0x7fb51c02a7c0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.506+0000 7fb523e00640 1 -- 172.21.15.99:0/957807009 shutdown_connections 2024-09-10T07:41:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.506+0000 7fb523e00640 1 --2- 172.21.15.99:0/957807009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 0x7fb5240c8700 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.506+0000 7fb523e00640 1 --2- 172.21.15.99:0/957807009 >> v2:172.21.15.187:3300/0 conn(0x7fb52415e970 0x7fb5240d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.506+0000 7fb523e00640 1 -- 172.21.15.99:0/957807009 >> 172.21.15.99:0/957807009 conn(0x7fb52409de00 msgr2=0x7fb5240d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.506+0000 7fb523e00640 1 -- 172.21.15.99:0/957807009 shutdown_connections 2024-09-10T07:41:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.506+0000 7fb523e00640 1 -- 172.21.15.99:0/957807009 wait complete. 2024-09-10T07:41:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.508+0000 7fb523e00640 1 Processor -- start 2024-09-10T07:41:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.508+0000 7fb523e00640 1 -- start start 2024-09-10T07:41:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb523e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 0x7fb5241f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb523e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5240d2680 0x7fb5240b9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb523e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb52415e970 0x7fb5241600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb523e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb52415ed50 con 0x7fb5240cfc90 2024-09-10T07:41:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb523e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb5240d0840 con 0x7fb52415e970 2024-09-10T07:41:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb523e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb52415eed0 con 0x7fb5240d2680 2024-09-10T07:41:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb522a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 0x7fb5241f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb522a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 0x7fb5241f8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46682/0 (socket says 172.21.15.99:46682) 2024-09-10T07:41:08.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb522a00640 1 -- 172.21.15.99:0/200592645 learned_addr learned my addr 172.21.15.99:0/200592645 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb523400640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb52415e970 0x7fb5241600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb522000640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5240d2680 0x7fb5240b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb522a00640 1 -- 172.21.15.99:0/200592645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5240d2680 msgr2=0x7fb5240b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb522a00640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5240d2680 0x7fb5240b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb522a00640 1 -- 172.21.15.99:0/200592645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb52415e970 msgr2=0x7fb5241600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb522a00640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb52415e970 0x7fb5241600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.509+0000 7fb522a00640 1 -- 172.21.15.99:0/200592645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5240cd960 con 0x7fb5240cfc90 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.510+0000 7fb522a00640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 0x7fb5241f8680 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb51400d620 tx=0x7fb51400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.510+0000 7fb51aa00640 1 -- 172.21.15.99:0/200592645 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51400b620 con 0x7fb5240cfc90 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.510+0000 7fb51aa00640 1 -- 172.21.15.99:0/200592645 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb514019070 con 0x7fb5240cfc90 2024-09-10T07:41:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.510+0000 7fb523e00640 1 -- 172.21.15.99:0/200592645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5240cdc40 con 0x7fb5240cfc90 2024-09-10T07:41:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.510+0000 7fb51aa00640 1 -- 172.21.15.99:0/200592645 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51400ba00 con 0x7fb5240cfc90 2024-09-10T07:41:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.510+0000 7fb523e00640 1 -- 172.21.15.99:0/200592645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5240ce200 con 0x7fb5240cfc90 2024-09-10T07:41:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.511+0000 7fb523e00640 1 -- 172.21.15.99:0/200592645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb524073780 con 0x7fb5240cfc90 2024-09-10T07:41:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.512+0000 7fb51aa00640 1 -- 172.21.15.99:0/200592645 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb51400bba0 con 0x7fb5240cfc90 2024-09-10T07:41:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.513+0000 7fb51aa00640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50406be30 0x7fb50406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.513+0000 7fb51aa00640 1 -- 172.21.15.99:0/200592645 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5227+0+0 (secure 0 0 0) 0x7fb51408afa0 con 0x7fb5240cfc90 2024-09-10T07:41:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.513+0000 7fb522000640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50406be30 0x7fb50406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.514+0000 7fb522000640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50406be30 0x7fb50406e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb524160c40 tx=0x7fb510009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:08.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.518+0000 7fb51aa00640 1 -- 172.21.15.99:0/200592645 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb524073780 con 0x7fb5240cfc90 2024-09-10T07:41:08.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:08.691+0000 7fb523e00640 1 -- 172.21.15.99:0/200592645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb5240d0300 con 0x7fb5240cfc90 2024-09-10T07:41:09.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.324+0000 7fb51aa00640 1 -- 172.21.15.99:0/200592645 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v153) ==== 170+0+0 (secure 0 0 0) 0x7fb514059440 con 0x7fb5240cfc90 2024-09-10T07:41:09.324 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:41:09.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 -- 172.21.15.99:0/200592645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50406be30 msgr2=0x7fb50406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:09.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50406be30 0x7fb50406e2f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb524160c40 tx=0x7fb510009040 comp rx=0 tx=0).stop 2024-09-10T07:41:09.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 -- 172.21.15.99:0/200592645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 msgr2=0x7fb5241f8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:09.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 0x7fb5241f8680 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb51400d620 tx=0x7fb51400dae0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 -- 172.21.15.99:0/200592645 shutdown_connections 2024-09-10T07:41:09.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb52415e970 0x7fb5241600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5240d2680 0x7fb5240b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50406be30 0x7fb50406e2f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 --2- 172.21.15.99:0/200592645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5240cfc90 0x7fb5241f8680 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 -- 172.21.15.99:0/200592645 >> 172.21.15.99:0/200592645 conn(0x7fb52409de00 msgr2=0x7fb5240d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:09.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 -- 172.21.15.99:0/200592645 shutdown_connections 2024-09-10T07:41:09.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.327+0000 7fb523e00640 1 -- 172.21.15.99:0/200592645 wait complete. 2024-09-10T07:41:09.352 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:41:09.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.509+0000 7f8a64c00640 1 Processor -- start 2024-09-10T07:41:09.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.509+0000 7f8a64c00640 1 -- start start 2024-09-10T07:41:09.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a64c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8a6015b760 0x7f8a600afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a64c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600d0630 0x7f8a600d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a64c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a600b4300 con 0x7f8a600b4a90 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a64c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8a600d0fa0 con 0x7f8a6015b760 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a64c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6006d700 con 0x7f8a600d0630 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a5de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8a6015b760 0x7f8a600afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a5de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8a6015b760 0x7f8a600afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46696/0 (socket says 172.21.15.99:46696) 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a5de00640 1 -- 172.21.15.99:0/3725074647 learned_addr learned my addr 172.21.15.99:0/3725074647 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a5e800640 1 --2- 172.21.15.99:0/3725074647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600d0630 0x7f8a600d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a5de00640 1 -- 172.21.15.99:0/3725074647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600d0630 msgr2=0x7f8a600d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a5de00640 1 --2- 172.21.15.99:0/3725074647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600d0630 0x7f8a600d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a5de00640 1 -- 172.21.15.99:0/3725074647 >> v1:172.21.15.99:6789/0 conn(0x7f8a600b4a90 legacy=0x7f8a6006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:09.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.512+0000 7f8a5de00640 1 -- 172.21.15.99:0/3725074647 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6006d9e0 con 0x7f8a6015b760 2024-09-10T07:41:09.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.512+0000 7f8a5e800640 1 --2- 172.21.15.99:0/3725074647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600d0630 0x7f8a600d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:09.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.511+0000 7f8a5ca00640 1 -- 172.21.15.99:0/3725074647 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780628233 0 0) 0x7f8a600b4300 con 0x7f8a600b4a90 2024-09-10T07:41:09.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a5de00640 1 --2- 172.21.15.99:0/3725074647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a6015b760 0x7f8a600afa90 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000bb10 tx=0x7f8a5002c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7db477f3afc67ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:09.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a5ca00640 1 -- 172.21.15.99:0/3725074647 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50032700 con 0x7f8a6015b760 2024-09-10T07:41:09.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a5ca00640 1 -- 172.21.15.99:0/3725074647 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a500328a0 con 0x7f8a6015b760 2024-09-10T07:41:09.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a5ca00640 1 -- 172.21.15.99:0/3725074647 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50032c70 con 0x7f8a6015b760 2024-09-10T07:41:09.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a64c00640 1 -- 172.21.15.99:0/3725074647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a6015b760 msgr2=0x7f8a600afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:09.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a64c00640 1 --2- 172.21.15.99:0/3725074647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a6015b760 0x7f8a600afa90 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000bb10 tx=0x7f8a5002c800 comp rx=0 tx=0).stop 2024-09-10T07:41:09.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a64c00640 1 -- 172.21.15.99:0/3725074647 shutdown_connections 2024-09-10T07:41:09.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a64c00640 1 --2- 172.21.15.99:0/3725074647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600d0630 0x7f8a600d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a64c00640 1 --2- 172.21.15.99:0/3725074647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a6015b760 0x7f8a600afa90 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a64c00640 1 -- 172.21.15.99:0/3725074647 >> 172.21.15.99:0/3725074647 conn(0x7f8a6006bc10 msgr2=0x7f8a6006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:09.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a64c00640 1 -- 172.21.15.99:0/3725074647 shutdown_connections 2024-09-10T07:41:09.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.513+0000 7f8a64c00640 1 -- 172.21.15.99:0/3725074647 wait complete. 2024-09-10T07:41:09.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.515+0000 7f8a64c00640 1 Processor -- start 2024-09-10T07:41:09.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.515+0000 7f8a64c00640 1 -- start start 2024-09-10T07:41:09.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.516+0000 7f8a64c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600b4a90 0x7f8a600c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:09.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.516+0000 7f8a64c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a600d0630 0x7f8a6015e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:09.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.516+0000 7f8a64c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015b760 0x7f8a60158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:09.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.516+0000 7f8a64c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600b4f20 con 0x7f8a600d0630 2024-09-10T07:41:09.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.516+0000 7f8a64c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6015bb40 con 0x7f8a6015b760 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.516+0000 7f8a64c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6015c150 con 0x7f8a600b4a90 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.516+0000 7f8a5d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a600d0630 0x7f8a6015e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.516+0000 7f8a5d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a600d0630 0x7f8a6015e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46712/0 (socket says 172.21.15.99:46712) 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.516+0000 7f8a5d400640 1 -- 172.21.15.99:0/1626288325 learned_addr learned my addr 172.21.15.99:0/1626288325 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a5de00640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600b4a90 0x7f8a600c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a5e800640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015b760 0x7f8a60158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a5d400640 1 -- 172.21.15.99:0/1626288325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600b4a90 msgr2=0x7f8a600c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a5d400640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600b4a90 0x7f8a600c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a5d400640 1 -- 172.21.15.99:0/1626288325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015b760 msgr2=0x7f8a60158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a5d400640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015b760 0x7f8a60158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a5d400640 1 -- 172.21.15.99:0/1626288325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6015c3f0 con 0x7f8a600d0630 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a5e800640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015b760 0x7f8a60158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:09.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a5d400640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a600d0630 0x7f8a6015e940 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00c410 tx=0x7f8a4c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:09.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a56000640 1 -- 172.21.15.99:0/1626288325 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c017070 con 0x7f8a600d0630 2024-09-10T07:41:09.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a56000640 1 -- 172.21.15.99:0/1626288325 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c0035f0 con 0x7f8a600d0630 2024-09-10T07:41:09.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a56000640 1 -- 172.21.15.99:0/1626288325 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0039e0 con 0x7f8a600d0630 2024-09-10T07:41:09.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a64c00640 1 -- 172.21.15.99:0/1626288325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6015c6d0 con 0x7f8a600d0630 2024-09-10T07:41:09.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.517+0000 7f8a64c00640 1 -- 172.21.15.99:0/1626288325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6014fc20 con 0x7f8a600d0630 2024-09-10T07:41:09.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.518+0000 7f8a64c00640 1 -- 172.21.15.99:0/1626288325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a6006dcc0 con 0x7f8a600d0630 2024-09-10T07:41:09.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.520+0000 7f8a56000640 1 -- 172.21.15.99:0/1626288325 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a4c01a070 con 0x7f8a600d0630 2024-09-10T07:41:09.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.521+0000 7f8a56000640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8a4006be30 0x7f8a4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:09.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.521+0000 7f8a56000640 1 -- 172.21.15.99:0/1626288325 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5609+0+0 (secure 0 0 0) 0x7f8a4c08a270 con 0x7f8a600d0630 2024-09-10T07:41:09.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.521+0000 7f8a5de00640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8a4006be30 0x7f8a4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:09.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.521+0000 7f8a5de00640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8a4006be30 0x7f8a4006e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8a50037000 tx=0x7f8a50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:09.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.525+0000 7f8a56000640 1 -- 172.21.15.99:0/1626288325 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a4c058c70 con 0x7f8a600d0630 2024-09-10T07:41:09.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:09.736+0000 7f8a64c00640 1 -- 172.21.15.99:0/1626288325 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8a600aeb20 con 0x7f8a600d0630 2024-09-10T07:41:10.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.326+0000 7f8a56000640 1 -- 172.21.15.99:0/1626288325 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v70) ==== 174+0+0 (secure 0 0 0) 0x7f8a4c058570 con 0x7f8a600d0630 2024-09-10T07:41:10.326 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 18 and data pool 19 2024-09-10T07:41:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.332+0000 7f8a64c00640 1 -- 172.21.15.99:0/1626288325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8a4006be30 msgr2=0x7f8a4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.332+0000 7f8a64c00640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8a4006be30 0x7f8a4006e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8a50037000 tx=0x7f8a50008040 comp rx=0 tx=0).stop 2024-09-10T07:41:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.332+0000 7f8a64c00640 1 -- 172.21.15.99:0/1626288325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a600d0630 msgr2=0x7f8a6015e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.332+0000 7f8a64c00640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a600d0630 0x7f8a6015e940 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00c410 tx=0x7f8a4c00c8d0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.335+0000 7f8a64c00640 1 -- 172.21.15.99:0/1626288325 shutdown_connections 2024-09-10T07:41:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.335+0000 7f8a64c00640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a6015b760 0x7f8a60158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.335+0000 7f8a64c00640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8a4006be30 0x7f8a4006e2f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.335+0000 7f8a64c00640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a600d0630 0x7f8a6015e940 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.335+0000 7f8a64c00640 1 --2- 172.21.15.99:0/1626288325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a600b4a90 0x7f8a600c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.335+0000 7f8a64c00640 1 -- 172.21.15.99:0/1626288325 >> 172.21.15.99:0/1626288325 conn(0x7f8a6006bc10 msgr2=0x7f8a600af320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:10.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.337+0000 7f8a64c00640 1 -- 172.21.15.99:0/1626288325 shutdown_connections 2024-09-10T07:41:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.340+0000 7f8a64c00640 1 -- 172.21.15.99:0/1626288325 wait complete. 2024-09-10T07:41:10.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:41:10.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.524+0000 7fd6ee600640 1 Processor -- start 2024-09-10T07:41:10.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.524+0000 7fd6ee600640 1 -- start start 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.525+0000 7fd6ee600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e815ecc0 0x7fd6e80d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.525+0000 7fd6ee600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd6e80d1b60 0x7fd6e80b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.525+0000 7fd6ee600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e80d3b20 con 0x7fd6e80d57a0 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.525+0000 7fd6ee600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e80b42f0 con 0x7fd6e80d1b60 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.525+0000 7fd6ee600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e80b45d0 con 0x7fd6e815ecc0 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.526+0000 7fd6dea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd6e80d57a0 0x7fd6e80d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45724/0 (socket says 172.21.15.99:45724) 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.526+0000 7fd6dea00640 1 -- 172.21.15.99:0/806893446 learned_addr learned my addr 172.21.15.99:0/806893446 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.526+0000 7fd6e7400640 1 --2- 172.21.15.99:0/806893446 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e815ecc0 0x7fd6e80d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.526+0000 7fd6e7e00640 1 --2- 172.21.15.99:0/806893446 >> v2:172.21.15.187:3300/0 conn(0x7fd6e80d1b60 0x7fd6e80b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.526+0000 7fd6e6a00640 1 -- 172.21.15.99:0/806893446 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1513657098 0 0) 0x7fd6e80d3b20 con 0x7fd6e80d57a0 2024-09-10T07:41:10.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.526+0000 7fd6e6a00640 1 -- 172.21.15.99:0/806893446 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6cc003520 con 0x7fd6e80d57a0 2024-09-10T07:41:10.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.526+0000 7fd6e7400640 1 -- 172.21.15.99:0/806893446 >> v2:172.21.15.187:3300/0 conn(0x7fd6e80d1b60 msgr2=0x7fd6e80b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:10.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.526+0000 7fd6e7400640 1 --2- 172.21.15.99:0/806893446 >> v2:172.21.15.187:3300/0 conn(0x7fd6e80d1b60 0x7fd6e80b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.526+0000 7fd6e7400640 1 -- 172.21.15.99:0/806893446 >> v1:172.21.15.99:6789/0 conn(0x7fd6e80d57a0 legacy=0x7fd6e80d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.526+0000 7fd6e7400640 1 -- 172.21.15.99:0/806893446 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e80b48b0 con 0x7fd6e815ecc0 2024-09-10T07:41:10.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.527+0000 7fd6e7400640 1 --2- 172.21.15.99:0/806893446 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e815ecc0 0x7fd6e80d3170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80097a0 tx=0x7fd6d802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbfe198bde89db16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:10.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6e6a00640 1 -- 172.21.15.99:0/806893446 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8037070 con 0x7fd6e815ecc0 2024-09-10T07:41:10.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6e6a00640 1 -- 172.21.15.99:0/806893446 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d8032440 con 0x7fd6e815ecc0 2024-09-10T07:41:10.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6e6a00640 1 -- 172.21.15.99:0/806893446 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8032810 con 0x7fd6e815ecc0 2024-09-10T07:41:10.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6ee600640 1 -- 172.21.15.99:0/806893446 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e815ecc0 msgr2=0x7fd6e80d3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6ee600640 1 --2- 172.21.15.99:0/806893446 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e815ecc0 0x7fd6e80d3170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80097a0 tx=0x7fd6d802a180 comp rx=0 tx=0).stop 2024-09-10T07:41:10.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6ee600640 1 -- 172.21.15.99:0/806893446 shutdown_connections 2024-09-10T07:41:10.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6ee600640 1 --2- 172.21.15.99:0/806893446 >> v2:172.21.15.187:3300/0 conn(0x7fd6e80d1b60 0x7fd6e80b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6ee600640 1 --2- 172.21.15.99:0/806893446 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e815ecc0 0x7fd6e80d3170 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6ee600640 1 -- 172.21.15.99:0/806893446 >> 172.21.15.99:0/806893446 conn(0x7fd6e80d4bd0 msgr2=0x7fd6e80d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:10.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6ee600640 1 -- 172.21.15.99:0/806893446 shutdown_connections 2024-09-10T07:41:10.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.528+0000 7fd6ee600640 1 -- 172.21.15.99:0/806893446 wait complete. 2024-09-10T07:41:10.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.530+0000 7fd6ee600640 1 Processor -- start 2024-09-10T07:41:10.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.530+0000 7fd6ee600640 1 -- start start 2024-09-10T07:41:10.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6ee600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80d1b60 0x7fd6e8156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6ee600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e80d57a0 0x7fd6e80c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6ee600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6e815ecc0 0x7fd6e81611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6ee600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e815f220 con 0x7fd6e815ecc0 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6ee600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e815f0a0 con 0x7fd6e80d57a0 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6ee600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e80d36b0 con 0x7fd6e80d1b60 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6e7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6e815ecc0 0x7fd6e81611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6e7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6e815ecc0 0x7fd6e81611e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42144/0 (socket says 172.21.15.99:42144) 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6e7e00640 1 -- 172.21.15.99:0/2827162671 learned_addr learned my addr 172.21.15.99:0/2827162671 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6dea00640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e80d57a0 0x7fd6e80c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.531+0000 7fd6e7400640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80d1b60 0x7fd6e8156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6e7e00640 1 -- 172.21.15.99:0/2827162671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80d1b60 msgr2=0x7fd6e8156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6e7e00640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80d1b60 0x7fd6e8156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6e7e00640 1 -- 172.21.15.99:0/2827162671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e80d57a0 msgr2=0x7fd6e80c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6e7e00640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e80d57a0 0x7fd6e80c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6e7e00640 1 -- 172.21.15.99:0/2827162671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e8156950 con 0x7fd6e815ecc0 2024-09-10T07:41:10.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6e7e00640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6e815ecc0 0x7fd6e81611e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000efc0 tx=0x7fd6e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:10.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6dfe00640 1 -- 172.21.15.99:0/2827162671 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0018020 con 0x7fd6e815ecc0 2024-09-10T07:41:10.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6dfe00640 1 -- 172.21.15.99:0/2827162671 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e0014480 con 0x7fd6e815ecc0 2024-09-10T07:41:10.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6ee600640 1 -- 172.21.15.99:0/2827162671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e80c9120 con 0x7fd6e815ecc0 2024-09-10T07:41:10.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6dfe00640 1 -- 172.21.15.99:0/2827162671 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0014870 con 0x7fd6e815ecc0 2024-09-10T07:41:10.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.532+0000 7fd6ee600640 1 -- 172.21.15.99:0/2827162671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e815f890 con 0x7fd6e815ecc0 2024-09-10T07:41:10.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.533+0000 7fd6ee600640 1 -- 172.21.15.99:0/2827162671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e80d3170 con 0x7fd6e815ecc0 2024-09-10T07:41:10.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.534+0000 7fd6dfe00640 1 -- 172.21.15.99:0/2827162671 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6e0005d10 con 0x7fd6e815ecc0 2024-09-10T07:41:10.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.535+0000 7fd6dfe00640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd6c406be30 0x7fd6c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.535+0000 7fd6dfe00640 1 -- 172.21.15.99:0/2827162671 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fd6e008bbf0 con 0x7fd6e815ecc0 2024-09-10T07:41:10.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.535+0000 7fd6e7400640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd6c406be30 0x7fd6c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:10.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.536+0000 7fd6e7400640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd6c406be30 0x7fd6c406e2f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8034000 tx=0x7fd6d802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:10.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.539+0000 7fd6dfe00640 1 -- 172.21.15.99:0/2827162671 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6e0022030 con 0x7fd6e815ecc0 2024-09-10T07:41:10.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.713+0000 7fd6ee600640 1 -- 172.21.15.99:0/2827162671 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6e806c5d0 con 0x7fd6e815ecc0 2024-09-10T07:41:10.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.714+0000 7fd6dfe00640 1 -- 172.21.15.99:0/2827162671 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16729 (secure 0 0 0) 0x7fd6e0010040 con 0x7fd6e815ecc0 2024-09-10T07:41:10.715 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:10.715 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":154,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:41:09.738179+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:41:07.512869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-10T07:41:08.732386+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 -- 172.21.15.99:0/2827162671 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd6c406be30 msgr2=0x7fd6c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd6c406be30 0x7fd6c406e2f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8034000 tx=0x7fd6d802e000 comp rx=0 tx=0).stop 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 -- 172.21.15.99:0/2827162671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6e815ecc0 msgr2=0x7fd6e81611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6e815ecc0 0x7fd6e81611e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000efc0 tx=0x7fd6e000c490 comp rx=0 tx=0).stop 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 -- 172.21.15.99:0/2827162671 shutdown_connections 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd6c406be30 0x7fd6c406e2f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6e815ecc0 0x7fd6e81611e0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e80d57a0 0x7fd6e80c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 --2- 172.21.15.99:0/2827162671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80d1b60 0x7fd6e8156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 -- 172.21.15.99:0/2827162671 >> 172.21.15.99:0/2827162671 conn(0x7fd6e80d4bd0 msgr2=0x7fd6e80b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:10.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 -- 172.21.15.99:0/2827162671 shutdown_connections 2024-09-10T07:41:10.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.717+0000 7fd6ee600640 1 -- 172.21.15.99:0/2827162671 wait complete. 2024-09-10T07:41:10.733 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:41:10.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.886+0000 7f238ae00640 1 Processor -- start 2024-09-10T07:41:10.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.886+0000 7f238ae00640 1 -- start start 2024-09-10T07:41:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.887+0000 7f238ae00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f238413fae0 0x7f238406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.887+0000 7f238ae00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2384142150 0x7f2384160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.887+0000 7f238ae00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2384142650 con 0x7f2384160a80 2024-09-10T07:41:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.887+0000 7f238ae00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f23840ce780 con 0x7f238413fae0 2024-09-10T07:41:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.887+0000 7f238ae00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f2384142930 con 0x7f2384142150 2024-09-10T07:41:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.888+0000 7f2383e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f238413fae0 0x7f238406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:10.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.888+0000 7f2383e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f238413fae0 0x7f238406f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42150/0 (socket says 172.21.15.99:42150) 2024-09-10T07:41:10.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.888+0000 7f2383e00640 1 -- 172.21.15.99:0/1074270875 learned_addr learned my addr 172.21.15.99:0/1074270875 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:10.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.888+0000 7f237b400640 1 --2- 172.21.15.99:0/1074270875 >> v2:172.21.15.187:3300/0 conn(0x7f2384142150 0x7f2384160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:10.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.888+0000 7f2383e00640 1 -- 172.21.15.99:0/1074270875 >> v2:172.21.15.187:3300/0 conn(0x7f2384142150 msgr2=0x7f2384160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:10.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.888+0000 7f2383e00640 1 --2- 172.21.15.99:0/1074270875 >> v2:172.21.15.187:3300/0 conn(0x7f2384142150 0x7f2384160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.888+0000 7f2383e00640 1 -- 172.21.15.99:0/1074270875 >> v1:172.21.15.187:6789/0 conn(0x7f2384160a80 legacy=0x7f238415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:10.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.888+0000 7f2383e00640 1 -- 172.21.15.99:0/1074270875 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2384142c10 con 0x7f238413fae0 2024-09-10T07:41:10.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.888+0000 7f237b400640 1 --2- 172.21.15.99:0/1074270875 >> v2:172.21.15.187:3300/0 conn(0x7f2384142150 0x7f2384160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:10.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.889+0000 7f2383e00640 1 --2- 172.21.15.99:0/1074270875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 0x7f238406f1b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f2384075560 tx=0x7f237402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991a2f3fa7c1d117 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.889+0000 7f2383400640 1 -- 172.21.15.99:0/1074270875 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374037070 con 0x7f238413fae0 2024-09-10T07:41:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.889+0000 7f2383400640 1 -- 172.21.15.99:0/1074270875 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374032440 con 0x7f238413fae0 2024-09-10T07:41:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.889+0000 7f2383400640 1 -- 172.21.15.99:0/1074270875 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374032810 con 0x7f238413fae0 2024-09-10T07:41:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.890+0000 7f238ae00640 1 -- 172.21.15.99:0/1074270875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 msgr2=0x7f238406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.890+0000 7f238ae00640 1 --2- 172.21.15.99:0/1074270875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 0x7f238406f1b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f2384075560 tx=0x7f237402a1a0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.890+0000 7f238ae00640 1 -- 172.21.15.99:0/1074270875 shutdown_connections 2024-09-10T07:41:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.890+0000 7f238ae00640 1 --2- 172.21.15.99:0/1074270875 >> v2:172.21.15.187:3300/0 conn(0x7f2384142150 0x7f2384160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.890+0000 7f238ae00640 1 --2- 172.21.15.99:0/1074270875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 0x7f238406f1b0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.890+0000 7f238ae00640 1 -- 172.21.15.99:0/1074270875 >> 172.21.15.99:0/1074270875 conn(0x7f238406bc10 msgr2=0x7f238406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.890+0000 7f238ae00640 1 -- 172.21.15.99:0/1074270875 shutdown_connections 2024-09-10T07:41:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.890+0000 7f238ae00640 1 -- 172.21.15.99:0/1074270875 wait complete. 2024-09-10T07:41:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.892+0000 7f238ae00640 1 Processor -- start 2024-09-10T07:41:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.892+0000 7f238ae00640 1 -- start start 2024-09-10T07:41:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f238ae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 0x7f238413ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f238ae00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2384142150 0x7f23841e6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f238ae00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2384160a80 0x7f23841414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f238ae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f238406f870 con 0x7f238413fae0 2024-09-10T07:41:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f238ae00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f238406f6f0 con 0x7f2384160a80 2024-09-10T07:41:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f238ae00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f23840cfc20 con 0x7f2384142150 2024-09-10T07:41:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f2383e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 0x7f238413ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f2383e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 0x7f238413ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42164/0 (socket says 172.21.15.99:42164) 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f2383e00640 1 -- 172.21.15.99:0/3526742774 learned_addr learned my addr 172.21.15.99:0/3526742774 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f2383e00640 1 -- 172.21.15.99:0/3526742774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2384142150 msgr2=0x7f23841e6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f2383e00640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2384142150 0x7f23841e6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f2383e00640 1 -- 172.21.15.99:0/3526742774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2384160a80 msgr2=0x7f23841414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f2383e00640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2384160a80 0x7f23841414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.893+0000 7f2383e00640 1 -- 172.21.15.99:0/3526742774 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23841e7580 con 0x7f238413fae0 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.894+0000 7f2383e00640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 0x7f238413ec50 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f2374000c00 tx=0x7f23740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.894+0000 7f2380c00640 1 -- 172.21.15.99:0/3526742774 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374041020 con 0x7f238413fae0 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.894+0000 7f2380c00640 1 -- 172.21.15.99:0/3526742774 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374030970 con 0x7f238413fae0 2024-09-10T07:41:10.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.894+0000 7f2380c00640 1 -- 172.21.15.99:0/3526742774 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374037040 con 0x7f238413fae0 2024-09-10T07:41:10.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.894+0000 7f238ae00640 1 -- 172.21.15.99:0/3526742774 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23841e7860 con 0x7f238413fae0 2024-09-10T07:41:10.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.894+0000 7f238ae00640 1 -- 172.21.15.99:0/3526742774 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23841e7e20 con 0x7f238413fae0 2024-09-10T07:41:10.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.895+0000 7f238ae00640 1 -- 172.21.15.99:0/3526742774 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238406f1b0 con 0x7f238413fae0 2024-09-10T07:41:10.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.896+0000 7f2380c00640 1 -- 172.21.15.99:0/3526742774 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2374044020 con 0x7f238413fae0 2024-09-10T07:41:10.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.898+0000 7f2380c00640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236006be60 0x7f236006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:10.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.898+0000 7f2380c00640 1 -- 172.21.15.99:0/3526742774 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f23740ab8e0 con 0x7f238413fae0 2024-09-10T07:41:10.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.898+0000 7f237b400640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236006be60 0x7f236006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:10.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.898+0000 7f237b400640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236006be60 0x7f236006e320 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f236c006fd0 tx=0x7f236c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:10.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:10.902+0000 7f2380c00640 1 -- 172.21.15.99:0/3526742774 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f237404b030 con 0x7f238413fae0 2024-09-10T07:41:11.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.080+0000 7f238ae00640 1 -- 172.21.15.99:0/3526742774 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23840b5a20 con 0x7f238413fae0 2024-09-10T07:41:11.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.081+0000 7f2380c00640 1 -- 172.21.15.99:0/3526742774 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16729 (secure 0 0 0) 0x7f237407a1f0 con 0x7f238413fae0 2024-09-10T07:41:11.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:11.081 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":154,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:41:09.738179+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:41:07.512869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-10T07:41:08.732386+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:41:11.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.083+0000 7f238ae00640 1 -- 172.21.15.99:0/3526742774 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236006be60 msgr2=0x7f236006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:11.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.083+0000 7f238ae00640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236006be60 0x7f236006e320 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f236c006fd0 tx=0x7f236c008040 comp rx=0 tx=0).stop 2024-09-10T07:41:11.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.083+0000 7f238ae00640 1 -- 172.21.15.99:0/3526742774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 msgr2=0x7f238413ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:11.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.083+0000 7f238ae00640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 0x7f238413ec50 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f2374000c00 tx=0x7f23740046c0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.084+0000 7f238ae00640 1 -- 172.21.15.99:0/3526742774 shutdown_connections 2024-09-10T07:41:11.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.084+0000 7f238ae00640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2384160a80 0x7f23841414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.084+0000 7f238ae00640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2384142150 0x7f23841e6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.084+0000 7f238ae00640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f236006be60 0x7f236006e320 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.084+0000 7f238ae00640 1 --2- 172.21.15.99:0/3526742774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f238413fae0 0x7f238413ec50 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.084+0000 7f238ae00640 1 -- 172.21.15.99:0/3526742774 >> 172.21.15.99:0/3526742774 conn(0x7f238406bc10 msgr2=0x7f238415cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:11.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.084+0000 7f238ae00640 1 -- 172.21.15.99:0/3526742774 shutdown_connections 2024-09-10T07:41:11.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.084+0000 7f238ae00640 1 -- 172.21.15.99:0/3526742774 wait complete. 2024-09-10T07:41:11.100 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:41:11.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.255+0000 7f0b05600640 1 Processor -- start 2024-09-10T07:41:11.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.255+0000 7f0b05600640 1 -- start start 2024-09-10T07:41:11.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.256+0000 7f0b05600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b0015e970 0x7f0b000d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.256+0000 7f0b05600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b000cfc90 0x7f0b000c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.256+0000 7f0b05600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b000d2bd0 con 0x7f0b000d2680 2024-09-10T07:41:11.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.256+0000 7f0b05600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0b000d37e0 con 0x7f0b000cfc90 2024-09-10T07:41:11.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.256+0000 7f0b05600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000d2eb0 con 0x7f0b0015e970 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0af7400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0b000d2680 0x7f0b000cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45726/0 (socket says 172.21.15.99:45726) 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0af7400640 1 -- 172.21.15.99:0/2012969029 learned_addr learned my addr 172.21.15.99:0/2012969029 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0b04c00640 1 --2- 172.21.15.99:0/2012969029 >> v2:172.21.15.187:3300/0 conn(0x7f0b000cfc90 0x7f0b000c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0affe00640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b0015e970 0x7f0b000d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520794930 0 0) 0x7f0b000d2bd0 con 0x7f0b000d2680 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae4003520 con 0x7f0b000d2680 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1981282150 0 0) 0x7f0ae4003520 con 0x7f0b000d2680 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b0015e970 msgr2=0x7f0b000d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0aff400640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b0015e970 0x7f0b000d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 >> v2:172.21.15.187:3300/0 conn(0x7f0b000cfc90 msgr2=0x7f0b000c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0aff400640 1 --2- 172.21.15.99:0/2012969029 >> v2:172.21.15.187:3300/0 conn(0x7f0b000cfc90 0x7f0b000c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b000d3190 con 0x7f0b000d2680 2024-09-10T07:41:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f0ae8001670 con 0x7f0b000d2680 2024-09-10T07:41:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.257+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 >> v1:172.21.15.99:6789/0 conn(0x7f0b000d2680 legacy=0x7f0b000cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0aff400640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae40039b0 0x7f0ae4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0aff400640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ae40043a0 0x7f0ae4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0aff400640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ae4004ef0 0x7f0ae400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000d37e0 con 0x7f0ae4004ef0 2024-09-10T07:41:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000d2eb0 con 0x7f0ae40043a0 2024-09-10T07:41:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae400bf00 con 0x7f0ae40039b0 2024-09-10T07:41:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0af7400640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ae40043a0 0x7f0ae4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0affe00640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae40039b0 0x7f0ae4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0b04c00640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ae4004ef0 0x7f0ae400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0b04c00640 1 -- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae40039b0 msgr2=0x7f0ae4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0b04c00640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae40039b0 0x7f0ae4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0b04c00640 1 -- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ae40043a0 msgr2=0x7f0ae4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0b04c00640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ae40043a0 0x7f0ae4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0b04c00640 1 -- 172.21.15.99:0/2012969029 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae4003520 con 0x7f0ae4004ef0 2024-09-10T07:41:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.258+0000 7f0affe00640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae40039b0 0x7f0ae4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:41:11.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.259+0000 7f0b04c00640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ae4004ef0 0x7f0ae400b9c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f0af800e170 tx=0x7f0ae4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef262173a432529 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:11.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.260+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8034020 con 0x7f0ae4004ef0 2024-09-10T07:41:11.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.260+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af8030430 con 0x7f0ae4004ef0 2024-09-10T07:41:11.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.260+0000 7f0aff400640 1 -- 172.21.15.99:0/2012969029 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8009c10 con 0x7f0ae4004ef0 2024-09-10T07:41:11.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.260+0000 7f0b05600640 1 -- 172.21.15.99:0/2012969029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ae4004ef0 msgr2=0x7f0ae400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:11.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.260+0000 7f0b05600640 1 --2- 172.21.15.99:0/2012969029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ae4004ef0 0x7f0ae400b9c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f0af800e170 tx=0x7f0ae4005830 comp rx=0 tx=0).stop 2024-09-10T07:41:11.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.260+0000 7f0b04c00640 1 -- 172.21.15.99:0/2012969029 reap_dead start 2024-09-10T07:41:11.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.260+0000 7f0b05600640 1 -- 172.21.15.99:0/2012969029 shutdown_connections 2024-09-10T07:41:11.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.260+0000 7f0b05600640 1 -- 172.21.15.99:0/2012969029 >> 172.21.15.99:0/2012969029 conn(0x7f0b0009de00 msgr2=0x7f0b000d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.260+0000 7f0b05600640 1 -- 172.21.15.99:0/2012969029 shutdown_connections 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.260+0000 7f0b05600640 1 -- 172.21.15.99:0/2012969029 wait complete. 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.262+0000 7f0b05600640 1 Processor -- start 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.262+0000 7f0b05600640 1 -- start start 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.263+0000 7f0b05600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae4004ef0 0x7f0b001f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.263+0000 7f0b05600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b0014f2e0 0x7f0b0014e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.263+0000 7f0b05600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001600a0 0x7f0b00160550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.263+0000 7f0b05600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0015eed0 con 0x7f0b001600a0 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.263+0000 7f0b05600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0015ed50 con 0x7f0b0014f2e0 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.263+0000 7f0b05600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000d0300 con 0x7f0ae4004ef0 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.263+0000 7f0b04c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001600a0 0x7f0b00160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.263+0000 7f0b04c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001600a0 0x7f0b00160550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42178/0 (socket says 172.21.15.99:42178) 2024-09-10T07:41:11.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.263+0000 7f0b04c00640 1 -- 172.21.15.99:0/3037636328 learned_addr learned my addr 172.21.15.99:0/3037636328 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:11.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0affe00640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae4004ef0 0x7f0b001f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0b04c00640 1 -- 172.21.15.99:0/3037636328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae4004ef0 msgr2=0x7f0b001f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:11.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0b04c00640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae4004ef0 0x7f0b001f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0af7400640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b0014f2e0 0x7f0b0014e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0b04c00640 1 -- 172.21.15.99:0/3037636328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b0014f2e0 msgr2=0x7f0b0014e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:11.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0b04c00640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b0014f2e0 0x7f0b0014e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:11.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0b04c00640 1 -- 172.21.15.99:0/3037636328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b001f8e40 con 0x7f0b001600a0 2024-09-10T07:41:11.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0affe00640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae4004ef0 0x7f0b001f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:11.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0af7400640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b0014f2e0 0x7f0b0014e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:11.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0b04c00640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001600a0 0x7f0b00160550 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0af800e170 tx=0x7f0af8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:11.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0afcc00640 1 -- 172.21.15.99:0/3037636328 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8034040 con 0x7f0b001600a0 2024-09-10T07:41:11.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0afcc00640 1 -- 172.21.15.99:0/3037636328 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af8003b90 con 0x7f0b001600a0 2024-09-10T07:41:11.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0b05600640 1 -- 172.21.15.99:0/3037636328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b000b9280 con 0x7f0b001600a0 2024-09-10T07:41:11.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0afcc00640 1 -- 172.21.15.99:0/3037636328 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0009650 con 0x7f0b001600a0 2024-09-10T07:41:11.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.264+0000 7f0b05600640 1 -- 172.21.15.99:0/3037636328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b000b9840 con 0x7f0b001600a0 2024-09-10T07:41:11.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.265+0000 7f0b05600640 1 -- 172.21.15.99:0/3037636328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b000ba220 con 0x7f0b001600a0 2024-09-10T07:41:11.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.266+0000 7f0afcc00640 1 -- 172.21.15.99:0/3037636328 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0af8037020 con 0x7f0b001600a0 2024-09-10T07:41:11.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.267+0000 7f0afcc00640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0adc06be30 0x7f0adc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:11.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.267+0000 7f0afcc00640 1 -- 172.21.15.99:0/3037636328 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f0af80abc10 con 0x7f0b001600a0 2024-09-10T07:41:11.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.267+0000 7f0affe00640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0adc06be30 0x7f0adc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:11.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.268+0000 7f0affe00640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0adc06be30 0x7f0adc06e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0b0006c1c0 tx=0x7f0af0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:11.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.271+0000 7f0afcc00640 1 -- 172.21.15.99:0/3037636328 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b000ba220 con 0x7f0b001600a0 2024-09-10T07:41:11.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:11.481+0000 7f0b05600640 1 -- 172.21.15.99:0/3037636328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0b000d06c0 con 0x7f0b001600a0 2024-09-10T07:41:12.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.352+0000 7f0afcc00640 1 -- 172.21.15.99:0/3037636328 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) ==== 118+0+0 (secure 0 0 0) 0x7f0af8049060 con 0x7f0b001600a0 2024-09-10T07:41:12.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 -- 172.21.15.99:0/3037636328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0adc06be30 msgr2=0x7f0adc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:12.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0adc06be30 0x7f0adc06e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0b0006c1c0 tx=0x7f0af0008040 comp rx=0 tx=0).stop 2024-09-10T07:41:12.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 -- 172.21.15.99:0/3037636328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001600a0 msgr2=0x7f0b00160550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:12.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001600a0 0x7f0b00160550 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0af800e170 tx=0x7f0af8009750 comp rx=0 tx=0).stop 2024-09-10T07:41:12.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 -- 172.21.15.99:0/3037636328 shutdown_connections 2024-09-10T07:41:12.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0adc06be30 0x7f0adc06e2f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001600a0 0x7f0b00160550 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b0014f2e0 0x7f0b0014e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 --2- 172.21.15.99:0/3037636328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ae4004ef0 0x7f0b001f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 -- 172.21.15.99:0/3037636328 >> 172.21.15.99:0/3037636328 conn(0x7f0b0009de00 msgr2=0x7f0b000c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:12.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 -- 172.21.15.99:0/3037636328 shutdown_connections 2024-09-10T07:41:12.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.355+0000 7f0b05600640 1 -- 172.21.15.99:0/3037636328 wait complete. 2024-09-10T07:41:12.374 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T07:41:12.374 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:41:12.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.534+0000 7f0092400640 1 Processor -- start 2024-09-10T07:41:12.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.534+0000 7f0092400640 1 -- start start 2024-09-10T07:41:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.536+0000 7f0092400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f008c071570 0x7f008c06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.536+0000 7f0092400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c0719c0 con 0x7f008c15ece0 2024-09-10T07:41:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.536+0000 7f0092400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c06f1a0 con 0x7f008c0b4e70 2024-09-10T07:41:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.536+0000 7f0092400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f008c0d1780 con 0x7f008c071570 2024-09-10T07:41:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.536+0000 7f008be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f008c071570 0x7f008c06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.536+0000 7f0082a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f008c15ece0 0x7f008c0af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45734/0 (socket says 172.21.15.99:45734) 2024-09-10T07:41:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.536+0000 7f0082a00640 1 -- 172.21.15.99:0/951981038 learned_addr learned my addr 172.21.15.99:0/951981038 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:12.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.536+0000 7f008be00640 1 -- 172.21.15.99:0/951981038 >> v1:172.21.15.187:6789/0 conn(0x7f008c0b4e70 legacy=0x7f008c0b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:12.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.537+0000 7f008be00640 1 -- 172.21.15.99:0/951981038 >> v1:172.21.15.99:6789/0 conn(0x7f008c15ece0 legacy=0x7f008c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:12.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.537+0000 7f008be00640 1 -- 172.21.15.99:0/951981038 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c06f480 con 0x7f008c071570 2024-09-10T07:41:12.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.537+0000 7f008aa00640 1 -- 172.21.15.99:0/951981038 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2057040504 0 0) 0x7f008c0719c0 con 0x7f008c15ece0 2024-09-10T07:41:12.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.538+0000 7f008be00640 1 --2- 172.21.15.99:0/951981038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c071570 0x7f008c06dd40 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f0084009d90 tx=0x7f008402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad947e37299960c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:12.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.538+0000 7f008aa00640 1 -- 172.21.15.99:0/951981038 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084007740 con 0x7f008c071570 2024-09-10T07:41:12.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.538+0000 7f008aa00640 1 -- 172.21.15.99:0/951981038 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00840078e0 con 0x7f008c071570 2024-09-10T07:41:12.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.538+0000 7f008aa00640 1 -- 172.21.15.99:0/951981038 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084007cb0 con 0x7f008c071570 2024-09-10T07:41:12.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.538+0000 7f0092400640 1 -- 172.21.15.99:0/951981038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c071570 msgr2=0x7f008c06dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:12.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.538+0000 7f0092400640 1 --2- 172.21.15.99:0/951981038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c071570 0x7f008c06dd40 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f0084009d90 tx=0x7f008402a6f0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.538+0000 7f0092400640 1 -- 172.21.15.99:0/951981038 shutdown_connections 2024-09-10T07:41:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.538+0000 7f0092400640 1 --2- 172.21.15.99:0/951981038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c071570 0x7f008c06dd40 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.538+0000 7f0092400640 1 -- 172.21.15.99:0/951981038 >> 172.21.15.99:0/951981038 conn(0x7f008c06bc10 msgr2=0x7f008c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.538+0000 7f0092400640 1 -- 172.21.15.99:0/951981038 shutdown_connections 2024-09-10T07:41:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.539+0000 7f0092400640 1 -- 172.21.15.99:0/951981038 wait complete. 2024-09-10T07:41:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.540+0000 7f0092400640 1 Processor -- start 2024-09-10T07:41:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.540+0000 7f0092400640 1 -- start start 2024-09-10T07:41:12.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.541+0000 7f0092400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f008c071570 0x7f008c1583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.541+0000 7f0092400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f008c0b4e70 0x7f008c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.541+0000 7f0092400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c15d520 0x7f008c160d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.541+0000 7f0092400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f008c06d820 con 0x7f008c15d520 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.541+0000 7f0092400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f008c06d5d0 con 0x7f008c071570 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.541+0000 7f0092400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f008c06ede0 con 0x7f008c0b4e70 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.541+0000 7f008be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c15d520 0x7f008c160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.541+0000 7f008be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c15d520 0x7f008c160d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42200/0 (socket says 172.21.15.99:42200) 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.541+0000 7f008be00640 1 -- 172.21.15.99:0/2498652126 learned_addr learned my addr 172.21.15.99:0/2498652126 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f008b400640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f008c071570 0x7f008c1583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f0082a00640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f008c0b4e70 0x7f008c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f008be00640 1 -- 172.21.15.99:0/2498652126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f008c0b4e70 msgr2=0x7f008c15cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f008be00640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f008c0b4e70 0x7f008c15cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f008be00640 1 -- 172.21.15.99:0/2498652126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f008c071570 msgr2=0x7f008c1583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:12.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f008be00640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f008c071570 0x7f008c1583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:12.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f008be00640 1 -- 172.21.15.99:0/2498652126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c15f200 con 0x7f008c15d520 2024-09-10T07:41:12.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f0082a00640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f008c0b4e70 0x7f008c15cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:12.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f008b400640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f008c071570 0x7f008c1583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:12.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f008be00640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c15d520 0x7f008c160d00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f0084009d90 tx=0x7f0084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:12.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f0083e00640 1 -- 172.21.15.99:0/2498652126 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084040070 con 0x7f008c15d520 2024-09-10T07:41:12.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f0083e00640 1 -- 172.21.15.99:0/2498652126 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0084031c40 con 0x7f008c15d520 2024-09-10T07:41:12.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f0092400640 1 -- 172.21.15.99:0/2498652126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008c15f4e0 con 0x7f008c15d520 2024-09-10T07:41:12.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f0083e00640 1 -- 172.21.15.99:0/2498652126 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084003990 con 0x7f008c15d520 2024-09-10T07:41:12.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.542+0000 7f0092400640 1 -- 172.21.15.99:0/2498652126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008c15faa0 con 0x7f008c15d520 2024-09-10T07:41:12.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.543+0000 7f0092400640 1 -- 172.21.15.99:0/2498652126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f008c072c50 con 0x7f008c15d520 2024-09-10T07:41:12.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.545+0000 7f0083e00640 1 -- 172.21.15.99:0/2498652126 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0084039040 con 0x7f008c15d520 2024-09-10T07:41:12.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.545+0000 7f0083e00640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f006806be30 0x7f006806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:12.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.546+0000 7f0083e00640 1 -- 172.21.15.99:0/2498652126 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7f00840ac2c0 con 0x7f008c15d520 2024-09-10T07:41:12.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.546+0000 7f008b400640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f006806be30 0x7f006806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:12.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.546+0000 7f008b400640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f006806be30 0x7f006806e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f008c15b040 tx=0x7f007c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:12.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.550+0000 7f0083e00640 1 -- 172.21.15.99:0/2498652126 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f008c072c50 con 0x7f008c15d520 2024-09-10T07:41:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:12.756+0000 7f0092400640 1 -- 172.21.15.99:0/2498652126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f008c0b5250 con 0x7f008c15d520 2024-09-10T07:41:13.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.358+0000 7f0083e00640 1 -- 172.21.15.99:0/2498652126 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) ==== 122+0+0 (secure 0 0 0) 0x7f008407abd0 con 0x7f008c15d520 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 -- 172.21.15.99:0/2498652126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f006806be30 msgr2=0x7f006806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f006806be30 0x7f006806e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f008c15b040 tx=0x7f007c009040 comp rx=0 tx=0).stop 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 -- 172.21.15.99:0/2498652126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c15d520 msgr2=0x7f008c160d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c15d520 0x7f008c160d00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f0084009d90 tx=0x7f0084004a40 comp rx=0 tx=0).stop 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 -- 172.21.15.99:0/2498652126 shutdown_connections 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f006806be30 0x7f006806e2f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f008c15d520 0x7f008c160d00 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f008c0b4e70 0x7f008c15cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 --2- 172.21.15.99:0/2498652126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f008c071570 0x7f008c1583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 -- 172.21.15.99:0/2498652126 >> 172.21.15.99:0/2498652126 conn(0x7f008c06bc10 msgr2=0x7f008c0b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 -- 172.21.15.99:0/2498652126 shutdown_connections 2024-09-10T07:41:13.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.361+0000 7f0092400640 1 -- 172.21.15.99:0/2498652126 wait complete. 2024-09-10T07:41:13.378 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:41:13.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:41:13.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.532+0000 7f387f200640 1 Processor -- start 2024-09-10T07:41:13.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.532+0000 7f387f200640 1 -- start start 2024-09-10T07:41:13.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.533+0000 7f387f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800d2680 0x7f38800cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.533+0000 7f387f200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38800d2bd0 con 0x7f388015e970 2024-09-10T07:41:13.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.533+0000 7f387f200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38800d2eb0 con 0x7f38800cfac0 2024-09-10T07:41:13.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.533+0000 7f387f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f38800d37e0 con 0x7f38800d2680 2024-09-10T07:41:13.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.533+0000 7f387de00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f388015e970 0x7f38800d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45738/0 (socket says 172.21.15.99:45738) 2024-09-10T07:41:13.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.533+0000 7f387de00640 1 -- 172.21.15.99:0/2503906701 learned_addr learned my addr 172.21.15.99:0/2503906701 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:13.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f3877e00640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800d2680 0x7f38800cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584458759 0 0) 0x7f38800d2bd0 con 0x7f388015e970 2024-09-10T07:41:13.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3864003520 con 0x7f388015e970 2024-09-10T07:41:13.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3231078513 0 0) 0x7f3864003520 con 0x7f388015e970 2024-09-10T07:41:13.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800d2680 msgr2=0x7f38800cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:13.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800d2680 0x7f38800cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 >> v1:172.21.15.187:6789/0 conn(0x7f38800cfac0 legacy=0x7f38800c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38800d3190 con 0x7f388015e970 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f3870001670 con 0x7f388015e970 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 >> v1:172.21.15.99:6789/0 conn(0x7f388015e970 legacy=0x7f38800d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800d2680 0x7f38640039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3864003f60 0x7f3864004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3864004d40 0x7f38640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f38800d37e0 con 0x7f3864003f60 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f386400bb30 con 0x7f3864004d40 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.534+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f386400bd30 con 0x7f38800d2680 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.535+0000 7f3877e00640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3864003f60 0x7f3864004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.535+0000 7f387e800640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3864004d40 0x7f38640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.535+0000 7f387de00640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800d2680 0x7f38640039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.535+0000 7f3877e00640 1 -- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800d2680 msgr2=0x7f38640039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:13.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.535+0000 7f3877e00640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800d2680 0x7f38640039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.535+0000 7f3877e00640 1 -- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3864004d40 msgr2=0x7f38640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.535+0000 7f3877e00640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3864004d40 0x7f38640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.535+0000 7f3877e00640 1 -- 172.21.15.99:0/2503906701 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3864003520 con 0x7f3864003f60 2024-09-10T07:41:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.535+0000 7f387e800640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3864004d40 0x7f38640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.536+0000 7f3877e00640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3864003f60 0x7f3864004800 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f3868009a90 tx=0x7f3864005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed49759a2e6d920c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.536+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868036070 con 0x7f3864003f60 2024-09-10T07:41:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.536+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3868031400 con 0x7f3864003f60 2024-09-10T07:41:13.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.536+0000 7f387d400640 1 -- 172.21.15.99:0/2503906701 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868009690 con 0x7f3864003f60 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.537+0000 7f387f200640 1 -- 172.21.15.99:0/2503906701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3864003f60 msgr2=0x7f3864004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.537+0000 7f387f200640 1 --2- 172.21.15.99:0/2503906701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3864003f60 0x7f3864004800 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f3868009a90 tx=0x7f3864005830 comp rx=0 tx=0).stop 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.537+0000 7f387e800640 1 -- 172.21.15.99:0/2503906701 reap_dead start 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.537+0000 7f387f200640 1 -- 172.21.15.99:0/2503906701 shutdown_connections 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.537+0000 7f387f200640 1 -- 172.21.15.99:0/2503906701 >> 172.21.15.99:0/2503906701 conn(0x7f388009de00 msgr2=0x7f38800d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.537+0000 7f387f200640 1 -- 172.21.15.99:0/2503906701 shutdown_connections 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.537+0000 7f387f200640 1 -- 172.21.15.99:0/2503906701 wait complete. 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.539+0000 7f387f200640 1 Processor -- start 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.539+0000 7f387f200640 1 -- start start 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387f200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3864003f60 0x7f38800ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800ccbd0 0x7f388014d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f388014dba0 0x7f3880161640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f388015ed50 con 0x7f388014dba0 2024-09-10T07:41:13.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387f200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f38800cff70 con 0x7f3864003f60 2024-09-10T07:41:13.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f388015eed0 con 0x7f38800ccbd0 2024-09-10T07:41:13.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f388014dba0 0x7f3880161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f388014dba0 0x7f3880161640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42220/0 (socket says 172.21.15.99:42220) 2024-09-10T07:41:13.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387e800640 1 -- 172.21.15.99:0/3506808565 learned_addr learned my addr 172.21.15.99:0/3506808565 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:13.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f3877e00640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800ccbd0 0x7f388014d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387de00640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3864003f60 0x7f38800ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387e800640 1 -- 172.21.15.99:0/3506808565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800ccbd0 msgr2=0x7f388014d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387e800640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800ccbd0 0x7f388014d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387e800640 1 -- 172.21.15.99:0/3506808565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3864003f60 msgr2=0x7f38800ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387e800640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3864003f60 0x7f38800ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.540+0000 7f387e800640 1 -- 172.21.15.99:0/3506808565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38800cd060 con 0x7f388014dba0 2024-09-10T07:41:13.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.541+0000 7f387e800640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f388014dba0 0x7f3880161640 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3878000f80 tx=0x7f387800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:13.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.541+0000 7f3876000640 1 -- 172.21.15.99:0/3506808565 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878006b50 con 0x7f388014dba0 2024-09-10T07:41:13.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.541+0000 7f3876000640 1 -- 172.21.15.99:0/3506808565 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3878006d10 con 0x7f388014dba0 2024-09-10T07:41:13.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.541+0000 7f3876000640 1 -- 172.21.15.99:0/3506808565 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878003970 con 0x7f388014dba0 2024-09-10T07:41:13.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.541+0000 7f387f200640 1 -- 172.21.15.99:0/3506808565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38800cd340 con 0x7f388014dba0 2024-09-10T07:41:13.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.541+0000 7f387f200640 1 -- 172.21.15.99:0/3506808565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38800cd900 con 0x7f388014dba0 2024-09-10T07:41:13.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.542+0000 7f387f200640 1 -- 172.21.15.99:0/3506808565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38800cf580 con 0x7f388014dba0 2024-09-10T07:41:13.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.543+0000 7f3876000640 1 -- 172.21.15.99:0/3506808565 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f387801a020 con 0x7f388014dba0 2024-09-10T07:41:13.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.544+0000 7f3876000640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f385c06be30 0x7f385c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.544+0000 7f3876000640 1 -- 172.21.15.99:0/3506808565 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7f387808a610 con 0x7f388014dba0 2024-09-10T07:41:13.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.544+0000 7f387de00640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f385c06be30 0x7f385c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.545+0000 7f387de00640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f385c06be30 0x7f385c06e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3870001eb0 tx=0x7f3870009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:13.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.548+0000 7f3876000640 1 -- 172.21.15.99:0/3506808565 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3878058f20 con 0x7f388014dba0 2024-09-10T07:41:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.756+0000 7f387f200640 1 -- 172.21.15.99:0/3506808565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f388006c560 con 0x7f388014dba0 2024-09-10T07:41:13.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.757+0000 7f3876000640 1 -- 172.21.15.99:0/3506808565 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5225 (secure 0 0 0) 0x7f3878058820 con 0x7f388014dba0 2024-09-10T07:41:13.757 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:13.757 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":74,"btime":"2024-09-10T07:41:13:353969+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3366680210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3366680210},{"type":"v1","addr":"172.21.15.187:6835","nonce":3366680210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6712,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/919138741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":919138741},{"type":"v1","addr":"172.21.15.99:6836","nonce":919138741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/794540040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":794540040},{"type":"v1","addr":"172.21.15.187:6834","nonce":794540040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:41:09.738509+0000","modified":"2024-09-10T07:41:12.757588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/2751383266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":2751383266},{"type":"v1","addr":"172.21.15.99:6837","nonce":2751383266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7179,"qdb_cluster":[7179]},"id":9}]} 2024-09-10T07:41:13.757 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 74 2024-09-10T07:41:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 -- 172.21.15.99:0/3506808565 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f385c06be30 msgr2=0x7f385c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f385c06be30 0x7f385c06e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3870001eb0 tx=0x7f3870009040 comp rx=0 tx=0).stop 2024-09-10T07:41:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 -- 172.21.15.99:0/3506808565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f388014dba0 msgr2=0x7f3880161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f388014dba0 0x7f3880161640 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3878000f80 tx=0x7f387800eb90 comp rx=0 tx=0).stop 2024-09-10T07:41:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 -- 172.21.15.99:0/3506808565 shutdown_connections 2024-09-10T07:41:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f385c06be30 0x7f385c06e2f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f388014dba0 0x7f3880161640 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800ccbd0 0x7f388014d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 --2- 172.21.15.99:0/3506808565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3864003f60 0x7f38800ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 -- 172.21.15.99:0/3506808565 >> 172.21.15.99:0/3506808565 conn(0x7f388009de00 msgr2=0x7f38800c90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:13.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 -- 172.21.15.99:0/3506808565 shutdown_connections 2024-09-10T07:41:13.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.759+0000 7f387f200640 1 -- 172.21.15.99:0/3506808565 wait complete. 2024-09-10T07:41:13.774 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:41:13.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.927+0000 7fc3b9000640 1 Processor -- start 2024-09-10T07:41:13.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.927+0000 7fc3b9000640 1 -- start start 2024-09-10T07:41:13.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.928+0000 7fc3b9000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b40d1ab0 0x7fc3b40b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.928+0000 7fc3b9000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc3b40d3240 0x7fc3b40b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.928+0000 7fc3b9000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b40b7a90 con 0x7fc3b415ef50 2024-09-10T07:41:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.928+0000 7fc3b9000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b40d3740 con 0x7fc3b40d3240 2024-09-10T07:41:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.928+0000 7fc3b9000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b40d3a20 con 0x7fc3b40d1ab0 2024-09-10T07:41:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.928+0000 7fc3b1e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc3b415ef50 0x7fc3b40d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45752/0 (socket says 172.21.15.99:45752) 2024-09-10T07:41:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.928+0000 7fc3b1e00640 1 -- 172.21.15.99:0/1536834544 learned_addr learned my addr 172.21.15.99:0/1536834544 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b2800640 1 --2- 172.21.15.99:0/1536834544 >> v2:172.21.15.187:3300/0 conn(0x7fc3b40d3240 0x7fc3b40b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b1400640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b40d1ab0 0x7fc3b40b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862575296 0 0) 0x7fc3b40b7a90 con 0x7fc3b415ef50 2024-09-10T07:41:13.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc398003520 con 0x7fc3b415ef50 2024-09-10T07:41:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 188087935 0 0) 0x7fc398003520 con 0x7fc3b415ef50 2024-09-10T07:41:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b40d1ab0 msgr2=0x7fc3b40b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b40d1ab0 0x7fc3b40b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 >> v2:172.21.15.187:3300/0 conn(0x7fc3b40d3240 msgr2=0x7fc3b40b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 --2- 172.21.15.99:0/1536834544 >> v2:172.21.15.187:3300/0 conn(0x7fc3b40d3240 0x7fc3b40b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b40b7d00 con 0x7fc3b415ef50 2024-09-10T07:41:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fc3a4001670 con 0x7fc3b415ef50 2024-09-10T07:41:13.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b2800640 1 --2- 172.21.15.99:0/1536834544 >> v2:172.21.15.187:3300/0 conn(0x7fc3b40d3240 0x7fc3b40b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 >> v1:172.21.15.99:6789/0 conn(0x7fc3b415ef50 legacy=0x7fc3b40d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3980039b0 0x7fc398003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc398004800 0x7fc398004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3980051c0 0x7fc39800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b40d3740 con 0x7fc3980039b0 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b40d3a20 con 0x7fc3980051c0 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc39800bf80 con 0x7fc398004800 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.929+0000 7fc3b1400640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b40d1ab0 0x7fc3b40b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.930+0000 7fc3b1e00640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3980039b0 0x7fc398003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.930+0000 7fc3b2800640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3980051c0 0x7fc39800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.930+0000 7fc3b1400640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc398004800 0x7fc398004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.930+0000 7fc3b1e00640 1 -- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc398004800 msgr2=0x7fc398004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:13.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.930+0000 7fc3b1e00640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc398004800 0x7fc398004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.930+0000 7fc3b1e00640 1 -- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3980051c0 msgr2=0x7fc39800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.930+0000 7fc3b1e00640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3980051c0 0x7fc39800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.930+0000 7fc3b1e00640 1 -- 172.21.15.99:0/1536834544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc398003520 con 0x7fc3980039b0 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.930+0000 7fc3b1400640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc398004800 0x7fc398004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.931+0000 7fc3b1e00640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3980039b0 0x7fc398003dd0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c190 tx=0x7fc398005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4b082266dd139 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.931+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4007c80 con 0x7fc3980039b0 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.931+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a4005ad0 con 0x7fc3980039b0 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.931+0000 7fc3b0a00640 1 -- 172.21.15.99:0/1536834544 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4007070 con 0x7fc3980039b0 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.932+0000 7fc3b9000640 1 -- 172.21.15.99:0/1536834544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3980039b0 msgr2=0x7fc398003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.932+0000 7fc3b9000640 1 --2- 172.21.15.99:0/1536834544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3980039b0 0x7fc398003dd0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c190 tx=0x7fc398005830 comp rx=0 tx=0).stop 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.932+0000 7fc3b2800640 1 -- 172.21.15.99:0/1536834544 reap_dead start 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.932+0000 7fc3b9000640 1 -- 172.21.15.99:0/1536834544 shutdown_connections 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.932+0000 7fc3b9000640 1 -- 172.21.15.99:0/1536834544 >> 172.21.15.99:0/1536834544 conn(0x7fc3b40d4c60 msgr2=0x7fc3b40d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:13.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.932+0000 7fc3b9000640 1 -- 172.21.15.99:0/1536834544 shutdown_connections 2024-09-10T07:41:13.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.932+0000 7fc3b9000640 1 -- 172.21.15.99:0/1536834544 wait complete. 2024-09-10T07:41:13.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.934+0000 7fc3b9000640 1 Processor -- start 2024-09-10T07:41:13.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.934+0000 7fc3b9000640 1 -- start start 2024-09-10T07:41:13.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b9000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3980039b0 0x7fc3b40c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b9000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b40cceb0 0x7fc3b40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b40cade0 0x7fc3b40cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b9000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b40d21a0 con 0x7fc3b40cade0 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b9000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b40d2020 con 0x7fc3980039b0 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b9000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b40d5780 con 0x7fc3b40cceb0 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b40cade0 0x7fc3b40cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b40cade0 0x7fc3b40cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42236/0 (socket says 172.21.15.99:42236) 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b2800640 1 -- 172.21.15.99:0/576312295 learned_addr learned my addr 172.21.15.99:0/576312295 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b1e00640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3980039b0 0x7fc3b40c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b1400640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b40cceb0 0x7fc3b40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b2800640 1 -- 172.21.15.99:0/576312295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b40cceb0 msgr2=0x7fc3b40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b2800640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b40cceb0 0x7fc3b40cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b2800640 1 -- 172.21.15.99:0/576312295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3980039b0 msgr2=0x7fc3b40c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b2800640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3980039b0 0x7fc3b40c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b2800640 1 -- 172.21.15.99:0/576312295 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b41f5a40 con 0x7fc3b40cade0 2024-09-10T07:41:13.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.935+0000 7fc3b2800640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b40cade0 0x7fc3b40cb260 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009f50 tx=0x7fc3ac00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:13.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.936+0000 7fc3aa000640 1 -- 172.21.15.99:0/576312295 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac00fe60 con 0x7fc3b40cade0 2024-09-10T07:41:13.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.936+0000 7fc3aa000640 1 -- 172.21.15.99:0/576312295 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ac003990 con 0x7fc3b40cade0 2024-09-10T07:41:13.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.936+0000 7fc3b9000640 1 -- 172.21.15.99:0/576312295 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b41f5760 con 0x7fc3b40cade0 2024-09-10T07:41:13.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.936+0000 7fc3aa000640 1 -- 172.21.15.99:0/576312295 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac003d80 con 0x7fc3b40cade0 2024-09-10T07:41:13.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.936+0000 7fc3b9000640 1 -- 172.21.15.99:0/576312295 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b40ca5e0 con 0x7fc3b40cade0 2024-09-10T07:41:13.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.937+0000 7fc3b9000640 1 -- 172.21.15.99:0/576312295 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b40d13a0 con 0x7fc3b40cade0 2024-09-10T07:41:13.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.938+0000 7fc3aa000640 1 -- 172.21.15.99:0/576312295 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3ac01f020 con 0x7fc3b40cade0 2024-09-10T07:41:13.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.938+0000 7fc3aa000640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39406be30 0x7fc39406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:13.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.939+0000 7fc3aa000640 1 -- 172.21.15.99:0/576312295 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7fc3ac08b320 con 0x7fc3b40cade0 2024-09-10T07:41:13.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.939+0000 7fc3b1e00640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39406be30 0x7fc39406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:13.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.939+0000 7fc3b1e00640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39406be30 0x7fc39406e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c190 tx=0x7fc3a4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:13.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:13.943+0000 7fc3aa000640 1 -- 172.21.15.99:0/576312295 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3ac010040 con 0x7fc3b40cade0 2024-09-10T07:41:14.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.117+0000 7fc3b9000640 1 -- 172.21.15.99:0/576312295 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3b406d090 con 0x7fc3b40cade0 2024-09-10T07:41:14.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.119+0000 7fc3aa000640 1 -- 172.21.15.99:0/576312295 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16716 (secure 0 0 0) 0x7fc3ac059c30 con 0x7fc3b40cade0 2024-09-10T07:41:14.119 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:14.119 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":155,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:41:11.337988+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:41:07.512869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-10T07:41:08.732386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:41:14.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 -- 172.21.15.99:0/576312295 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39406be30 msgr2=0x7fc39406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39406be30 0x7fc39406e2f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c190 tx=0x7fc3a4009030 comp rx=0 tx=0).stop 2024-09-10T07:41:14.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 -- 172.21.15.99:0/576312295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b40cade0 msgr2=0x7fc3b40cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b40cade0 0x7fc3b40cb260 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009f50 tx=0x7fc3ac00f580 comp rx=0 tx=0).stop 2024-09-10T07:41:14.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 -- 172.21.15.99:0/576312295 shutdown_connections 2024-09-10T07:41:14.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc39406be30 0x7fc39406e2f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3b40cade0 0x7fc3b40cb260 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b40cceb0 0x7fc3b40cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 --2- 172.21.15.99:0/576312295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3980039b0 0x7fc3b40c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 -- 172.21.15.99:0/576312295 >> 172.21.15.99:0/576312295 conn(0x7fc3b40d4c60 msgr2=0x7fc3b40d2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:14.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 -- 172.21.15.99:0/576312295 shutdown_connections 2024-09-10T07:41:14.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.121+0000 7fc3b9000640 1 -- 172.21.15.99:0/576312295 wait complete. 2024-09-10T07:41:14.137 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:41:14.137 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:41:14.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.291+0000 7f4d03e00640 1 Processor -- start 2024-09-10T07:41:14.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.291+0000 7f4d03e00640 1 -- start start 2024-09-10T07:41:14.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.292+0000 7f4d03e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4d0415eab0 0x7f4d040b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.292+0000 7f4d03e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4d04070b40 0x7f4d0406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.292+0000 7f4d03e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d040d3710 con 0x7f4d0406d260 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.292+0000 7f4d03e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4d040b6390 con 0x7f4d0415eab0 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.292+0000 7f4d03e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f4d040b6670 con 0x7f4d04070b40 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.292+0000 7f4d02a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4d0415eab0 0x7f4d040b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.292+0000 7f4d03400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4d0406d260 0x7f4d040b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45756/0 (socket says 172.21.15.99:45756) 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.292+0000 7f4d03400640 1 -- 172.21.15.99:0/1954133057 learned_addr learned my addr 172.21.15.99:0/1954133057 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.293+0000 7f4cfa000640 1 --2- 172.21.15.99:0/1954133057 >> v2:172.21.15.187:3300/0 conn(0x7f4d04070b40 0x7f4d0406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.293+0000 7f4d02a00640 1 -- 172.21.15.99:0/1954133057 >> v2:172.21.15.187:3300/0 conn(0x7f4d04070b40 msgr2=0x7f4d0406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.293+0000 7f4d02a00640 1 --2- 172.21.15.99:0/1954133057 >> v2:172.21.15.187:3300/0 conn(0x7f4d04070b40 0x7f4d0406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.293+0000 7f4d02a00640 1 -- 172.21.15.99:0/1954133057 >> v1:172.21.15.99:6789/0 conn(0x7f4d0406d260 legacy=0x7f4d040b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.293+0000 7f4d02a00640 1 -- 172.21.15.99:0/1954133057 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d040b6950 con 0x7f4d0415eab0 2024-09-10T07:41:14.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.293+0000 7f4cfa000640 1 --2- 172.21.15.99:0/1954133057 >> v2:172.21.15.187:3300/0 conn(0x7f4d04070b40 0x7f4d0406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.294+0000 7f4d02a00640 1 --2- 172.21.15.99:0/1954133057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d0415eab0 0x7f4d040b1c40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4d040a0a60 tx=0x7f4cf402a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153b81d016a14d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.294+0000 7f4d02000640 1 -- 172.21.15.99:0/1954133057 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4037070 con 0x7f4d0415eab0 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.294+0000 7f4d02000640 1 -- 172.21.15.99:0/1954133057 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf402ade0 con 0x7f4d0415eab0 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.294+0000 7f4d02000640 1 -- 172.21.15.99:0/1954133057 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4032660 con 0x7f4d0415eab0 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.294+0000 7f4d03e00640 1 -- 172.21.15.99:0/1954133057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d0415eab0 msgr2=0x7f4d040b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.295+0000 7f4d03e00640 1 --2- 172.21.15.99:0/1954133057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d0415eab0 0x7f4d040b1c40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f4d040a0a60 tx=0x7f4cf402a090 comp rx=0 tx=0).stop 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.295+0000 7f4d03e00640 1 -- 172.21.15.99:0/1954133057 shutdown_connections 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.295+0000 7f4d03e00640 1 --2- 172.21.15.99:0/1954133057 >> v2:172.21.15.187:3300/0 conn(0x7f4d04070b40 0x7f4d0406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.295+0000 7f4d03e00640 1 --2- 172.21.15.99:0/1954133057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d0415eab0 0x7f4d040b1c40 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.295+0000 7f4d03e00640 1 -- 172.21.15.99:0/1954133057 >> 172.21.15.99:0/1954133057 conn(0x7f4d040b7cc0 msgr2=0x7f4d040b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:14.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.295+0000 7f4d03e00640 1 -- 172.21.15.99:0/1954133057 shutdown_connections 2024-09-10T07:41:14.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.295+0000 7f4d03e00640 1 -- 172.21.15.99:0/1954133057 wait complete. 2024-09-10T07:41:14.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.296+0000 7f4d03e00640 1 Processor -- start 2024-09-10T07:41:14.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.297+0000 7f4d03e00640 1 -- start start 2024-09-10T07:41:14.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.297+0000 7f4d03e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d0406d260 0x7f4d041f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.297+0000 7f4d03e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d04070b40 0x7f4d041523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.297+0000 7f4d03e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d0415eab0 0x7f4d0415c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.297+0000 7f4d03e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0415ee90 con 0x7f4d04070b40 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.297+0000 7f4d03e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4d040b7860 con 0x7f4d0406d260 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.297+0000 7f4d03e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0415acd0 con 0x7f4d0415eab0 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4cfa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d04070b40 0x7f4d041523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4cfa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d04070b40 0x7f4d041523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42250/0 (socket says 172.21.15.99:42250) 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4cfa000640 1 -- 172.21.15.99:0/3940185149 learned_addr learned my addr 172.21.15.99:0/3940185149 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4d02a00640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d0406d260 0x7f4d041f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4d03400640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d0415eab0 0x7f4d0415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4cfa000640 1 -- 172.21.15.99:0/3940185149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d0415eab0 msgr2=0x7f4d0415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4cfa000640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d0415eab0 0x7f4d0415c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4cfa000640 1 -- 172.21.15.99:0/3940185149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d0406d260 msgr2=0x7f4d041f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4cfa000640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d0406d260 0x7f4d041f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4cfa000640 1 -- 172.21.15.99:0/3940185149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d041528e0 con 0x7f4d04070b40 2024-09-10T07:41:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4d03400640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d0415eab0 0x7f4d0415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.298+0000 7f4cfa000640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d04070b40 0x7f4d041523a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00e7e0 tx=0x7f4cec00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.299+0000 7f4cfb400640 1 -- 172.21.15.99:0/3940185149 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00f040 con 0x7f4d04070b40 2024-09-10T07:41:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.299+0000 7f4cfb400640 1 -- 172.21.15.99:0/3940185149 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cec004030 con 0x7f4d04070b40 2024-09-10T07:41:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.299+0000 7f4d03e00640 1 -- 172.21.15.99:0/3940185149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0415af20 con 0x7f4d04070b40 2024-09-10T07:41:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.299+0000 7f4cfb400640 1 -- 172.21.15.99:0/3940185149 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec004400 con 0x7f4d04070b40 2024-09-10T07:41:14.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.299+0000 7f4d03e00640 1 -- 172.21.15.99:0/3940185149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0415b4e0 con 0x7f4d04070b40 2024-09-10T07:41:14.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.300+0000 7f4d03e00640 1 -- 172.21.15.99:0/3940185149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d040d3230 con 0x7f4d04070b40 2024-09-10T07:41:14.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.301+0000 7f4cfb400640 1 -- 172.21.15.99:0/3940185149 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cec00c6d0 con 0x7f4d04070b40 2024-09-10T07:41:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.302+0000 7f4cfb400640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ce006be30 0x7f4ce006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.302+0000 7f4cfb400640 1 -- 172.21.15.99:0/3940185149 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7f4cec08abe0 con 0x7f4d04070b40 2024-09-10T07:41:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.302+0000 7f4d02a00640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ce006be30 0x7f4ce006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.303+0000 7f4d02a00640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ce006be30 0x7f4ce006e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4034000 tx=0x7f4cf402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:14.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.306+0000 7f4cfb400640 1 -- 172.21.15.99:0/3940185149 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cec017020 con 0x7f4d04070b40 2024-09-10T07:41:14.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.481+0000 7f4d03e00640 1 -- 172.21.15.99:0/3940185149 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d040b2c20 con 0x7f4ce006be30 2024-09-10T07:41:14.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.487+0000 7f4cfb400640 1 -- 172.21.15.99:0/3940185149 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237607 (secure 0 0 0) 0x7f4d040b2c20 con 0x7f4ce006be30 2024-09-10T07:41:14.490 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:14.491 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:41:14.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.491+0000 7f4d03e00640 1 -- 172.21.15.99:0/3940185149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ce006be30 msgr2=0x7f4ce006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.491+0000 7f4d03e00640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ce006be30 0x7f4ce006e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4034000 tx=0x7f4cf402e000 comp rx=0 tx=0).stop 2024-09-10T07:41:14.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.491+0000 7f4d03e00640 1 -- 172.21.15.99:0/3940185149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d04070b40 msgr2=0x7f4d041523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.491+0000 7f4d03e00640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d04070b40 0x7f4d041523a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00e7e0 tx=0x7f4cec00eca0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.491+0000 7f4d03e00640 1 -- 172.21.15.99:0/3940185149 shutdown_connections 2024-09-10T07:41:14.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.491+0000 7f4d03e00640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d0415eab0 0x7f4d0415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.491+0000 7f4d03e00640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ce006be30 0x7f4ce006e2f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.491+0000 7f4d03e00640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d04070b40 0x7f4d041523a0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.491+0000 7f4d03e00640 1 --2- 172.21.15.99:0/3940185149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d0406d260 0x7f4d041f88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.492+0000 7f4d03e00640 1 -- 172.21.15.99:0/3940185149 >> 172.21.15.99:0/3940185149 conn(0x7f4d040b7cc0 msgr2=0x7f4d0406fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:14.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.492+0000 7f4d03e00640 1 -- 172.21.15.99:0/3940185149 shutdown_connections 2024-09-10T07:41:14.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.492+0000 7f4d03e00640 1 -- 172.21.15.99:0/3940185149 wait complete. 2024-09-10T07:41:14.507 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-09-10T07:41:12.780758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7738,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554761,"statfs":{"total":1600000000,"available":1592075502,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.462055"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.321510+0000","last_change":"2024-09-10T07:41:08.321510+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.321510+0000","last_undegraded":"2024-09-10T07:41:08.321510+0000","last_fullsized":"2024-09-10T07:41:08.321510+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.320753+0000","last_change":"2024-09-10T07:41:08.320753+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.320753+0000","last_undegraded":"2024-09-10T07:41:08.320753+0000","last_fullsized":"2024-09-10T07:41:08.320753+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.323007+0000","last_change":"2024-09-10T07:41:08.323007+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.323007+0000","last_undegraded":"2024-09-10T07:41:08.323007+0000","last_fullsized":"2024-09-10T07:41:08.323007+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.320027+0000","last_change":"2024-09-10T07:41:08.320027+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.320027+0000","last_undegraded":"2024-09-10T07:41:08.320027+0000","last_fullsized":"2024-09-10T07:41:08.320027+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.319931+0000","last_change":"2024-09-10T07:41:08.319931+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.319931+0000","last_undegraded":"2024-09-10T07:41:08.319931+0000","last_fullsized":"2024-09-10T07:41:08.319931+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.323957+0000","last_change":"2024-09-10T07:41:08.323957+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.323957+0000","last_undegraded":"2024-09-10T07:41:08.323957+0000","last_fullsized":"2024-09-10T07:41:08.323957+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.323261+0000","last_change":"2024-09-10T07:41:08.323261+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.323261+0000","last_undegraded":"2024-09-10T07:41:08.323261+0000","last_fullsized":"2024-09-10T07:41:08.323261+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.319597+0000","last_change":"2024-09-10T07:41:08.319597+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.319597+0000","last_undegraded":"2024-09-10T07:41:08.319597+0000","last_fullsized":"2024-09-10T07:41:08.319597+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.320768+0000","last_change":"2024-09-10T07:41:08.320768+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.320768+0000","last_undegraded":"2024-09-10T07:41:08.320768+0000","last_fullsized":"2024-09-10T07:41:08.320768+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.322830+0000","last_change":"2024-09-10T07:41:08.322830+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.322830+0000","last_undegraded":"2024-09-10T07:41:08.322830+0000","last_fullsized":"2024-09-10T07:41:08.322830+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.320487+0000","last_change":"2024-09-10T07:41:08.320487+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.320487+0000","last_undegraded":"2024-09-10T07:41:08.320487+0000","last_fullsized":"2024-09-10T07:41:08.320487+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.321610+0000","last_change":"2024-09-10T07:41:08.321610+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.321610+0000","last_undegraded":"2024-09-10T07:41:08.321610+0000","last_fullsized":"2024-09-10T07:41:08.321610+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.322381+0000","last_change":"2024-09-10T07:41:08.322381+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.322381+0000","last_undegraded":"2024-09-10T07:41:08.322381+0000","last_fullsized":"2024-09-10T07:41:08.322381+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.319663+0000","last_change":"2024-09-10T07:41:08.319663+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.319663+0000","last_undegraded":"2024-09-10T07:41:08.319663+0000","last_fullsized":"2024-09-10T07:41:08.319663+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.321998+0000","last_change":"2024-09-10T07:41:08.321998+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.321998+0000","last_undegraded":"2024-09-10T07:41:08.321998+0000","last_fullsized":"2024-09-10T07:41:08.321998+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.320103+0000","last_change":"2024-09-10T07:41:08.320103+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.320103+0000","last_undegraded":"2024-09-10T07:41:08.320103+0000","last_fullsized":"2024-09-10T07:41:08.320103+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.322705+0000","last_change":"2024-09-10T07:41:08.322705+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.322705+0000","last_undegraded":"2024-09-10T07:41:08.322705+0000","last_fullsized":"2024-09-10T07:41:08.322705+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.323114+0000","last_change":"2024-09-10T07:41:08.323114+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.323114+0000","last_undegraded":"2024-09-10T07:41:08.323114+0000","last_fullsized":"2024-09-10T07:41:08.323114+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.320123+0000","last_change":"2024-09-10T07:41:08.320123+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.320123+0000","last_undegraded":"2024-09-10T07:41:08.320123+0000","last_fullsized":"2024-09-10T07:41:08.320123+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.320061+0000","last_change":"2024-09-10T07:41:08.320061+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.320061+0000","last_undegraded":"2024-09-10T07:41:08.320061+0000","last_fullsized":"2024-09-10T07:41:08.320061+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.322831+0000","last_change":"2024-09-10T07:41:08.322831+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.322831+0000","last_undegraded":"2024-09-10T07:41:08.322831+0000","last_fullsized":"2024-09-10T07:41:08.322831+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.323596+0000","last_change":"2024-09-10T07:41:08.323596+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.323596+0000","last_undegraded":"2024-09-10T07:41:08.323596+0000","last_fullsized":"2024-09-10T07:41:08.323596+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.322380+0000","last_change":"2024-09-10T07:41:08.322380+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.322380+0000","last_undegraded":"2024-09-10T07:41:08.322380+0000","last_fullsized":"2024-09-10T07:41:08.322380+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.323149+0000","last_change":"2024-09-10T07:41:08.323149+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.323149+0000","last_undegraded":"2024-09-10T07:41:08.323149+0000","last_fullsized":"2024-09-10T07:41:08.323149+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.321076+0000","last_change":"2024-09-10T07:41:08.321076+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.321076+0000","last_undegraded":"2024-09-10T07:41:08.321076+0000","last_fullsized":"2024-09-10T07:41:08.321076+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.319637+0000","last_change":"2024-09-10T07:41:08.319637+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.319637+0000","last_undegraded":"2024-09-10T07:41:08.319637+0000","last_fullsized":"2024-09-10T07:41:08.319637+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.322353+0000","last_change":"2024-09-10T07:41:08.322353+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.322353+0000","last_undegraded":"2024-09-10T07:41:08.322353+0000","last_fullsized":"2024-09-10T07:41:08.322353+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.319644+0000","last_change":"2024-09-10T07:41:08.319644+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.319644+0000","last_undegraded":"2024-09-10T07:41:08.319644+0000","last_fullsized":"2024-09-10T07:41:08.319644+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.321250+0000","last_change":"2024-09-10T07:41:08.321250+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.321250+0000","last_undegraded":"2024-09-10T07:41:08.321250+0000","last_fullsized":"2024-09-10T07:41:08.321250+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.322572+0000","last_change":"2024-09-10T07:41:08.322572+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.322572+0000","last_undegraded":"2024-09-10T07:41:08.322572+0000","last_fullsized":"2024-09-10T07:41:08.322572+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.322278+0000","last_change":"2024-09-10T07:41:08.322278+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.322278+0000","last_undegraded":"2024-09-10T07:41:08.322278+0000","last_fullsized":"2024-09-10T07:41:08.322278+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T07:41:09.318639+0000","last_change":"2024-09-10T07:41:09.318639+0000","last_active":"2024-09-10T07:41:09.318639+0000","last_peered":"2024-09-10T07:41:09.318639+0000","last_clean":"2024-09-10T07:41:09.318639+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:09.318639+0000","last_undegraded":"2024-09-10T07:41:09.318639+0000","last_fullsized":"2024-09-10T07:41:09.318639+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T07:41:08.320861+0000","last_change":"2024-09-10T07:41:08.320861+0000","last_active":"2024-09-10T07:41:08.315503+0000","last_peered":"2024-09-10T07:41:08.315503+0000","last_clean":"2024-09-10T07:41:08.315503+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:41:08.320861+0000","last_undegraded":"2024-09-10T07:41:08.320861+0000","last_fullsized":"2024-09-10T07:41:08.320861+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":429,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-10T07:41:08.321925+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:41:08.321925+0000","last_peered":"2024-09-10T07:41:08.321925+0000","last_clean":"2024-09-10T07:41:08.321925+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:41:08.321925+0000","last_undegraded":"2024-09-10T07:41:08.321925+0000","last_fullsized":"2024-09-10T07:41:08.321925+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193914,"statfs":{"total":200000000,"available":198568116,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194490,"statfs":{"total":200000000,"available":199158484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194490,"statfs":{"total":200000000,"available":199158484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":827,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194485,"statfs":{"total":200000000,"available":199152667,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":827,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194485,"statfs":{"total":200000000,"available":199152667,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194490,"statfs":{"total":200000000,"available":199158484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194490,"statfs":{"total":200000000,"available":199158484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193914,"statfs":{"total":200000000,"available":198568116,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:41:14.512 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:41:14.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.700+0000 7f0576400640 1 Processor -- start 2024-09-10T07:41:14.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.700+0000 7f0576400640 1 -- start start 2024-09-10T07:41:14.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.701+0000 7f0576400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f05700ce780 0x7f057006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.702+0000 7f0576400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057006e3d0 con 0x7f0570072f40 2024-09-10T07:41:14.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.702+0000 7f0576400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057006e6b0 con 0x7f0570145290 2024-09-10T07:41:14.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.702+0000 7f0576400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f057006efe0 con 0x7f05700ce780 2024-09-10T07:41:14.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.702+0000 7f0566a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0570072f40 0x7f05700b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45766/0 (socket says 172.21.15.99:45766) 2024-09-10T07:41:14.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.702+0000 7f0566a00640 1 -- 172.21.15.99:0/2641767787 learned_addr learned my addr 172.21.15.99:0/2641767787 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:14.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.702+0000 7f056fe00640 1 --2- 172.21.15.99:0/2641767787 >> v2:172.21.15.187:3300/0 conn(0x7f05700ce780 0x7f057006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.702+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562987186 0 0) 0x7f057006e3d0 con 0x7f0570072f40 2024-09-10T07:41:14.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.702+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0554003520 con 0x7f0570072f40 2024-09-10T07:41:14.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3369382567 0 0) 0x7f0554003520 con 0x7f0570072f40 2024-09-10T07:41:14.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 >> v2:172.21.15.187:3300/0 conn(0x7f05700ce780 msgr2=0x7f057006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:14.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 --2- 172.21.15.99:0/2641767787 >> v2:172.21.15.187:3300/0 conn(0x7f05700ce780 0x7f057006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 >> v1:172.21.15.187:6789/0 conn(0x7f0570145290 legacy=0x7f0570072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057006e990 con 0x7f0570072f40 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f0558001670 con 0x7f0570072f40 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 >> v1:172.21.15.99:6789/0 conn(0x7f0570072f40 legacy=0x7f05700b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05540039b0 0x7f0554003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05540043b0 0x7f0554004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0554005080 0x7f055400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f057006efe0 con 0x7f05540043b0 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f055400e1f0 con 0x7f0554005080 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f055400e3f0 con 0x7f05540039b0 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f0566a00640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05540043b0 0x7f0554004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056f400640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05540039b0 0x7f0554003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056fe00640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0554005080 0x7f055400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f0566a00640 1 -- 172.21.15.99:0/2641767787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05540039b0 msgr2=0x7f0554003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f0566a00640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05540039b0 0x7f0554003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f0566a00640 1 -- 172.21.15.99:0/2641767787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0554005080 msgr2=0x7f055400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f0566a00640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0554005080 0x7f055400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f056fe00640 1 -- 172.21.15.99:0/2641767787 reap_dead start 2024-09-10T07:41:14.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.703+0000 7f0566a00640 1 -- 172.21.15.99:0/2641767787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0554003520 con 0x7f05540043b0 2024-09-10T07:41:14.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.704+0000 7f0566a00640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05540043b0 0x7f0554004880 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f055800c210 tx=0x7f0554005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890b00963e7d4579 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:14.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.705+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558007ce0 con 0x7f05540043b0 2024-09-10T07:41:14.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.705+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0558005af0 con 0x7f05540043b0 2024-09-10T07:41:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.705+0000 7f056ea00640 1 -- 172.21.15.99:0/2641767787 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558007070 con 0x7f05540043b0 2024-09-10T07:41:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.705+0000 7f0576400640 1 -- 172.21.15.99:0/2641767787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05540043b0 msgr2=0x7f0554004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.705+0000 7f0576400640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05540043b0 0x7f0554004880 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f055800c210 tx=0x7f0554005830 comp rx=0 tx=0).stop 2024-09-10T07:41:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.705+0000 7f0576400640 1 -- 172.21.15.99:0/2641767787 shutdown_connections 2024-09-10T07:41:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.705+0000 7f0576400640 1 --2- 172.21.15.99:0/2641767787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05540043b0 0x7f0554004880 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.705+0000 7f0576400640 1 -- 172.21.15.99:0/2641767787 >> 172.21.15.99:0/2641767787 conn(0x7f057006bc10 msgr2=0x7f057006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.705+0000 7f0576400640 1 -- 172.21.15.99:0/2641767787 shutdown_connections 2024-09-10T07:41:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.705+0000 7f0576400640 1 -- 172.21.15.99:0/2641767787 wait complete. 2024-09-10T07:41:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.707+0000 7f0576400640 1 Processor -- start 2024-09-10T07:41:14.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.707+0000 7f0576400640 1 -- start start 2024-09-10T07:41:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.708+0000 7f0576400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05540043b0 0x7f05700afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.708+0000 7f0576400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05700ccd20 0x7f057015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.708+0000 7f0576400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570135f40 0x7f05701383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.708+0000 7f0576400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f057006df80 con 0x7f0570135f40 2024-09-10T07:41:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.708+0000 7f0576400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0570145670 con 0x7f05540043b0 2024-09-10T07:41:14.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.708+0000 7f0576400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f057006e100 con 0x7f05700ccd20 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.708+0000 7f056fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570135f40 0x7f05701383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.708+0000 7f056fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570135f40 0x7f05701383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42270/0 (socket says 172.21.15.99:42270) 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.708+0000 7f056fe00640 1 -- 172.21.15.99:0/3374464873 learned_addr learned my addr 172.21.15.99:0/3374464873 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f056fe00640 1 -- 172.21.15.99:0/3374464873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05700ccd20 msgr2=0x7f057015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f056fe00640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05700ccd20 0x7f057015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f056fe00640 1 -- 172.21.15.99:0/3374464873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05540043b0 msgr2=0x7f05700afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f056fe00640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05540043b0 0x7f05700afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f056fe00640 1 -- 172.21.15.99:0/3374464873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05700aecb0 con 0x7f0570135f40 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f056fe00640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570135f40 0x7f05701383c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f057006ef50 tx=0x7f056800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f0567e00640 1 -- 172.21.15.99:0/3374464873 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056800fd60 con 0x7f0570135f40 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f0567e00640 1 -- 172.21.15.99:0/3374464873 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f056801d070 con 0x7f0570135f40 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f0576400640 1 -- 172.21.15.99:0/3374464873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05700aef90 con 0x7f0570135f40 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f0567e00640 1 -- 172.21.15.99:0/3374464873 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568015670 con 0x7f0570135f40 2024-09-10T07:41:14.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.709+0000 7f0576400640 1 -- 172.21.15.99:0/3374464873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05700af550 con 0x7f0570135f40 2024-09-10T07:41:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.711+0000 7f0576400640 1 -- 172.21.15.99:0/3374464873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05700715a0 con 0x7f0570135f40 2024-09-10T07:41:14.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.711+0000 7f0567e00640 1 -- 172.21.15.99:0/3374464873 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0568015810 con 0x7f0570135f40 2024-09-10T07:41:14.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.712+0000 7f0567e00640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f054c06be30 0x7f054c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:14.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.712+0000 7f0567e00640 1 -- 172.21.15.99:0/3374464873 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7f056808b980 con 0x7f0570135f40 2024-09-10T07:41:14.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.713+0000 7f056f400640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f054c06be30 0x7f054c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:14.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.713+0000 7f056f400640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f054c06be30 0x7f054c06e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0570077320 tx=0x7f0560009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:14.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.716+0000 7f0567e00640 1 -- 172.21.15.99:0/3374464873 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0568010040 con 0x7f0570135f40 2024-09-10T07:41:14.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.887+0000 7f0576400640 1 -- 172.21.15.99:0/3374464873 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05700cfdb0 con 0x7f054c06be30 2024-09-10T07:41:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.893+0000 7f0567e00640 1 -- 172.21.15.99:0/3374464873 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247992 (secure 0 0 0) 0x7f05700cfdb0 con 0x7f054c06be30 2024-09-10T07:41:14.896 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:14.897 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:41:14.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 -- 172.21.15.99:0/3374464873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f054c06be30 msgr2=0x7f054c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f054c06be30 0x7f054c06e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0570077320 tx=0x7f0560009040 comp rx=0 tx=0).stop 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 -- 172.21.15.99:0/3374464873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570135f40 msgr2=0x7f05701383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570135f40 0x7f05701383c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f057006ef50 tx=0x7f056800f580 comp rx=0 tx=0).stop 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 -- 172.21.15.99:0/3374464873 shutdown_connections 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f054c06be30 0x7f054c06e2f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570135f40 0x7f05701383c0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05700ccd20 0x7f057015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 --2- 172.21.15.99:0/3374464873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05540043b0 0x7f05700afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 -- 172.21.15.99:0/3374464873 >> 172.21.15.99:0/3374464873 conn(0x7f057006bc10 msgr2=0x7f05700717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 -- 172.21.15.99:0/3374464873 shutdown_connections 2024-09-10T07:41:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:14.898+0000 7f0576400640 1 -- 172.21.15.99:0/3374464873 wait complete. 2024-09-10T07:41:14.914 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-09-10T07:41:14.781090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7928,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554571,"statfs":{"total":1600000000,"available":1591880980,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001014"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347717+0000","last_change":"2024-09-10T07:41:10.341118+0000","last_active":"2024-09-10T07:41:11.347717+0000","last_peered":"2024-09-10T07:41:11.347717+0000","last_clean":"2024-09-10T07:41:11.347717+0000","last_became_active":"2024-09-10T07:41:10.340816+0000","last_became_peered":"2024-09-10T07:41:10.340816+0000","last_unstale":"2024-09-10T07:41:11.347717+0000","last_undegraded":"2024-09-10T07:41:11.347717+0000","last_fullsized":"2024-09-10T07:41:11.347717+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:04.416435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.534123+0000","last_change":"2024-09-10T07:41:10.344725+0000","last_active":"2024-09-10T07:41:11.534123+0000","last_peered":"2024-09-10T07:41:11.534123+0000","last_clean":"2024-09-10T07:41:11.534123+0000","last_became_active":"2024-09-10T07:41:10.344499+0000","last_became_peered":"2024-09-10T07:41:10.344499+0000","last_unstale":"2024-09-10T07:41:11.534123+0000","last_undegraded":"2024-09-10T07:41:11.534123+0000","last_fullsized":"2024-09-10T07:41:11.534123+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:14.334962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.532828+0000","last_change":"2024-09-10T07:41:10.347248+0000","last_active":"2024-09-10T07:41:11.532828+0000","last_peered":"2024-09-10T07:41:11.532828+0000","last_clean":"2024-09-10T07:41:11.532828+0000","last_became_active":"2024-09-10T07:41:10.346999+0000","last_became_peered":"2024-09-10T07:41:10.346999+0000","last_unstale":"2024-09-10T07:41:11.532828+0000","last_undegraded":"2024-09-10T07:41:11.532828+0000","last_fullsized":"2024-09-10T07:41:11.532828+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:29.812533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347191+0000","last_change":"2024-09-10T07:41:10.347870+0000","last_active":"2024-09-10T07:41:11.347191+0000","last_peered":"2024-09-10T07:41:11.347191+0000","last_clean":"2024-09-10T07:41:11.347191+0000","last_became_active":"2024-09-10T07:41:10.347232+0000","last_became_peered":"2024-09-10T07:41:10.347232+0000","last_unstale":"2024-09-10T07:41:11.347191+0000","last_undegraded":"2024-09-10T07:41:11.347191+0000","last_fullsized":"2024-09-10T07:41:11.347191+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:32.148631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348820+0000","last_change":"2024-09-10T07:41:10.351266+0000","last_active":"2024-09-10T07:41:11.348820+0000","last_peered":"2024-09-10T07:41:11.348820+0000","last_clean":"2024-09-10T07:41:11.348820+0000","last_became_active":"2024-09-10T07:41:10.350854+0000","last_became_peered":"2024-09-10T07:41:10.350854+0000","last_unstale":"2024-09-10T07:41:11.348820+0000","last_undegraded":"2024-09-10T07:41:11.348820+0000","last_fullsized":"2024-09-10T07:41:11.348820+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:07.926621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533597+0000","last_change":"2024-09-10T07:41:10.349756+0000","last_active":"2024-09-10T07:41:11.533597+0000","last_peered":"2024-09-10T07:41:11.533597+0000","last_clean":"2024-09-10T07:41:11.533597+0000","last_became_active":"2024-09-10T07:41:10.349439+0000","last_became_peered":"2024-09-10T07:41:10.349439+0000","last_unstale":"2024-09-10T07:41:11.533597+0000","last_undegraded":"2024-09-10T07:41:11.533597+0000","last_fullsized":"2024-09-10T07:41:11.533597+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:09.831193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533216+0000","last_change":"2024-09-10T07:41:10.343277+0000","last_active":"2024-09-10T07:41:11.533216+0000","last_peered":"2024-09-10T07:41:11.533216+0000","last_clean":"2024-09-10T07:41:11.533216+0000","last_became_active":"2024-09-10T07:41:10.342526+0000","last_became_peered":"2024-09-10T07:41:10.342526+0000","last_unstale":"2024-09-10T07:41:11.533216+0000","last_undegraded":"2024-09-10T07:41:11.533216+0000","last_fullsized":"2024-09-10T07:41:11.533216+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:17.014501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533001+0000","last_change":"2024-09-10T07:41:10.344221+0000","last_active":"2024-09-10T07:41:11.533001+0000","last_peered":"2024-09-10T07:41:11.533001+0000","last_clean":"2024-09-10T07:41:11.533001+0000","last_became_active":"2024-09-10T07:41:10.343725+0000","last_became_peered":"2024-09-10T07:41:10.343725+0000","last_unstale":"2024-09-10T07:41:11.533001+0000","last_undegraded":"2024-09-10T07:41:11.533001+0000","last_fullsized":"2024-09-10T07:41:11.533001+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:05.111950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.532816+0000","last_change":"2024-09-10T07:41:10.347296+0000","last_active":"2024-09-10T07:41:11.532816+0000","last_peered":"2024-09-10T07:41:11.532816+0000","last_clean":"2024-09-10T07:41:11.532816+0000","last_became_active":"2024-09-10T07:41:10.347025+0000","last_became_peered":"2024-09-10T07:41:10.347025+0000","last_unstale":"2024-09-10T07:41:11.532816+0000","last_undegraded":"2024-09-10T07:41:11.532816+0000","last_fullsized":"2024-09-10T07:41:11.532816+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:04.640934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533663+0000","last_change":"2024-09-10T07:41:10.351280+0000","last_active":"2024-09-10T07:41:11.533663+0000","last_peered":"2024-09-10T07:41:11.533663+0000","last_clean":"2024-09-10T07:41:11.533663+0000","last_became_active":"2024-09-10T07:41:10.350995+0000","last_became_peered":"2024-09-10T07:41:10.350995+0000","last_unstale":"2024-09-10T07:41:11.533663+0000","last_undegraded":"2024-09-10T07:41:11.533663+0000","last_fullsized":"2024-09-10T07:41:11.533663+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:17.692422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533534+0000","last_change":"2024-09-10T07:41:10.346514+0000","last_active":"2024-09-10T07:41:11.533534+0000","last_peered":"2024-09-10T07:41:11.533534+0000","last_clean":"2024-09-10T07:41:11.533534+0000","last_became_active":"2024-09-10T07:41:10.346232+0000","last_became_peered":"2024-09-10T07:41:10.346232+0000","last_unstale":"2024-09-10T07:41:11.533534+0000","last_undegraded":"2024-09-10T07:41:11.533534+0000","last_fullsized":"2024-09-10T07:41:11.533534+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:14.032934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533139+0000","last_change":"2024-09-10T07:41:10.350895+0000","last_active":"2024-09-10T07:41:11.533139+0000","last_peered":"2024-09-10T07:41:11.533139+0000","last_clean":"2024-09-10T07:41:11.533139+0000","last_became_active":"2024-09-10T07:41:10.350534+0000","last_became_peered":"2024-09-10T07:41:10.350534+0000","last_unstale":"2024-09-10T07:41:11.533139+0000","last_undegraded":"2024-09-10T07:41:11.533139+0000","last_fullsized":"2024-09-10T07:41:11.533139+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:02.199785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347190+0000","last_change":"2024-09-10T07:41:10.344509+0000","last_active":"2024-09-10T07:41:11.347190+0000","last_peered":"2024-09-10T07:41:11.347190+0000","last_clean":"2024-09-10T07:41:11.347190+0000","last_became_active":"2024-09-10T07:41:10.344122+0000","last_became_peered":"2024-09-10T07:41:10.344122+0000","last_unstale":"2024-09-10T07:41:11.347190+0000","last_undegraded":"2024-09-10T07:41:11.347190+0000","last_fullsized":"2024-09-10T07:41:11.347190+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:02.551082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533244+0000","last_change":"2024-09-10T07:41:10.349619+0000","last_active":"2024-09-10T07:41:11.533244+0000","last_peered":"2024-09-10T07:41:11.533244+0000","last_clean":"2024-09-10T07:41:11.533244+0000","last_became_active":"2024-09-10T07:41:10.349378+0000","last_became_peered":"2024-09-10T07:41:10.349378+0000","last_unstale":"2024-09-10T07:41:11.533244+0000","last_undegraded":"2024-09-10T07:41:11.533244+0000","last_fullsized":"2024-09-10T07:41:11.533244+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:08.003417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347450+0000","last_change":"2024-09-10T07:41:10.347943+0000","last_active":"2024-09-10T07:41:11.347450+0000","last_peered":"2024-09-10T07:41:11.347450+0000","last_clean":"2024-09-10T07:41:11.347450+0000","last_became_active":"2024-09-10T07:41:10.344486+0000","last_became_peered":"2024-09-10T07:41:10.344486+0000","last_unstale":"2024-09-10T07:41:11.347450+0000","last_undegraded":"2024-09-10T07:41:11.347450+0000","last_fullsized":"2024-09-10T07:41:11.347450+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:48.450500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533764+0000","last_change":"2024-09-10T07:41:10.343805+0000","last_active":"2024-09-10T07:41:11.533764+0000","last_peered":"2024-09-10T07:41:11.533764+0000","last_clean":"2024-09-10T07:41:11.533764+0000","last_became_active":"2024-09-10T07:41:10.343528+0000","last_became_peered":"2024-09-10T07:41:10.343528+0000","last_unstale":"2024-09-10T07:41:11.533764+0000","last_undegraded":"2024-09-10T07:41:11.533764+0000","last_fullsized":"2024-09-10T07:41:11.533764+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:47.850555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533569+0000","last_change":"2024-09-10T07:41:10.346214+0000","last_active":"2024-09-10T07:41:11.533569+0000","last_peered":"2024-09-10T07:41:11.533569+0000","last_clean":"2024-09-10T07:41:11.533569+0000","last_became_active":"2024-09-10T07:41:10.345775+0000","last_became_peered":"2024-09-10T07:41:10.345775+0000","last_unstale":"2024-09-10T07:41:11.533569+0000","last_undegraded":"2024-09-10T07:41:11.533569+0000","last_fullsized":"2024-09-10T07:41:11.533569+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:12.297855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533546+0000","last_change":"2024-09-10T07:41:10.339263+0000","last_active":"2024-09-10T07:41:11.533546+0000","last_peered":"2024-09-10T07:41:11.533546+0000","last_clean":"2024-09-10T07:41:11.533546+0000","last_became_active":"2024-09-10T07:41:10.338615+0000","last_became_peered":"2024-09-10T07:41:10.338615+0000","last_unstale":"2024-09-10T07:41:11.533546+0000","last_undegraded":"2024-09-10T07:41:11.533546+0000","last_fullsized":"2024-09-10T07:41:11.533546+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:07.914848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.532898+0000","last_change":"2024-09-10T07:41:10.340879+0000","last_active":"2024-09-10T07:41:11.532898+0000","last_peered":"2024-09-10T07:41:11.532898+0000","last_clean":"2024-09-10T07:41:11.532898+0000","last_became_active":"2024-09-10T07:41:10.340469+0000","last_became_peered":"2024-09-10T07:41:10.340469+0000","last_unstale":"2024-09-10T07:41:11.532898+0000","last_undegraded":"2024-09-10T07:41:11.532898+0000","last_fullsized":"2024-09-10T07:41:11.532898+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:35.275838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.534072+0000","last_change":"2024-09-10T07:41:10.347135+0000","last_active":"2024-09-10T07:41:11.534072+0000","last_peered":"2024-09-10T07:41:11.534072+0000","last_clean":"2024-09-10T07:41:11.534072+0000","last_became_active":"2024-09-10T07:41:10.346891+0000","last_became_peered":"2024-09-10T07:41:10.346891+0000","last_unstale":"2024-09-10T07:41:11.534072+0000","last_undegraded":"2024-09-10T07:41:11.534072+0000","last_fullsized":"2024-09-10T07:41:11.534072+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:07.796855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348546+0000","last_change":"2024-09-10T07:41:10.347763+0000","last_active":"2024-09-10T07:41:11.348546+0000","last_peered":"2024-09-10T07:41:11.348546+0000","last_clean":"2024-09-10T07:41:11.348546+0000","last_became_active":"2024-09-10T07:41:10.347521+0000","last_became_peered":"2024-09-10T07:41:10.347521+0000","last_unstale":"2024-09-10T07:41:11.348546+0000","last_undegraded":"2024-09-10T07:41:11.348546+0000","last_fullsized":"2024-09-10T07:41:11.348546+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:25.348763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533274+0000","last_change":"2024-09-10T07:41:10.345419+0000","last_active":"2024-09-10T07:41:11.533274+0000","last_peered":"2024-09-10T07:41:11.533274+0000","last_clean":"2024-09-10T07:41:11.533274+0000","last_became_active":"2024-09-10T07:41:10.343716+0000","last_became_peered":"2024-09-10T07:41:10.343716+0000","last_unstale":"2024-09-10T07:41:11.533274+0000","last_undegraded":"2024-09-10T07:41:11.533274+0000","last_fullsized":"2024-09-10T07:41:11.533274+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:46.848000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533477+0000","last_change":"2024-09-10T07:41:10.344000+0000","last_active":"2024-09-10T07:41:11.533477+0000","last_peered":"2024-09-10T07:41:11.533477+0000","last_clean":"2024-09-10T07:41:11.533477+0000","last_became_active":"2024-09-10T07:41:10.343329+0000","last_became_peered":"2024-09-10T07:41:10.343329+0000","last_unstale":"2024-09-10T07:41:11.533477+0000","last_undegraded":"2024-09-10T07:41:11.533477+0000","last_fullsized":"2024-09-10T07:41:11.533477+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:53.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533025+0000","last_change":"2024-09-10T07:41:10.340697+0000","last_active":"2024-09-10T07:41:11.533025+0000","last_peered":"2024-09-10T07:41:11.533025+0000","last_clean":"2024-09-10T07:41:11.533025+0000","last_became_active":"2024-09-10T07:41:10.340148+0000","last_became_peered":"2024-09-10T07:41:10.340148+0000","last_unstale":"2024-09-10T07:41:11.533025+0000","last_undegraded":"2024-09-10T07:41:11.533025+0000","last_fullsized":"2024-09-10T07:41:11.533025+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:11.212874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533796+0000","last_change":"2024-09-10T07:41:10.354675+0000","last_active":"2024-09-10T07:41:11.533796+0000","last_peered":"2024-09-10T07:41:11.533796+0000","last_clean":"2024-09-10T07:41:11.533796+0000","last_became_active":"2024-09-10T07:41:10.352955+0000","last_became_peered":"2024-09-10T07:41:10.352955+0000","last_unstale":"2024-09-10T07:41:11.533796+0000","last_undegraded":"2024-09-10T07:41:11.533796+0000","last_fullsized":"2024-09-10T07:41:11.533796+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:07.192854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533903+0000","last_change":"2024-09-10T07:41:10.348969+0000","last_active":"2024-09-10T07:41:11.533903+0000","last_peered":"2024-09-10T07:41:11.533903+0000","last_clean":"2024-09-10T07:41:11.533903+0000","last_became_active":"2024-09-10T07:41:10.348691+0000","last_became_peered":"2024-09-10T07:41:10.348691+0000","last_unstale":"2024-09-10T07:41:11.533903+0000","last_undegraded":"2024-09-10T07:41:11.533903+0000","last_fullsized":"2024-09-10T07:41:11.533903+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:15.766166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347191+0000","last_change":"2024-09-10T07:41:10.346038+0000","last_active":"2024-09-10T07:41:11.347191+0000","last_peered":"2024-09-10T07:41:11.347191+0000","last_clean":"2024-09-10T07:41:11.347191+0000","last_became_active":"2024-09-10T07:41:10.345467+0000","last_became_peered":"2024-09-10T07:41:10.345467+0000","last_unstale":"2024-09-10T07:41:11.347191+0000","last_undegraded":"2024-09-10T07:41:11.347191+0000","last_fullsized":"2024-09-10T07:41:11.347191+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:32.576004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348542+0000","last_change":"2024-09-10T07:41:10.342828+0000","last_active":"2024-09-10T07:41:11.348542+0000","last_peered":"2024-09-10T07:41:11.348542+0000","last_clean":"2024-09-10T07:41:11.348542+0000","last_became_active":"2024-09-10T07:41:10.342595+0000","last_became_peered":"2024-09-10T07:41:10.342595+0000","last_unstale":"2024-09-10T07:41:11.348542+0000","last_undegraded":"2024-09-10T07:41:11.348542+0000","last_fullsized":"2024-09-10T07:41:11.348542+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:33.965019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347402+0000","last_change":"2024-09-10T07:41:10.347463+0000","last_active":"2024-09-10T07:41:11.347402+0000","last_peered":"2024-09-10T07:41:11.347402+0000","last_clean":"2024-09-10T07:41:11.347402+0000","last_became_active":"2024-09-10T07:41:10.346598+0000","last_became_peered":"2024-09-10T07:41:10.346598+0000","last_unstale":"2024-09-10T07:41:11.347402+0000","last_undegraded":"2024-09-10T07:41:11.347402+0000","last_fullsized":"2024-09-10T07:41:11.347402+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:40.928815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347594+0000","last_change":"2024-09-10T07:41:10.347801+0000","last_active":"2024-09-10T07:41:11.347594+0000","last_peered":"2024-09-10T07:41:11.347594+0000","last_clean":"2024-09-10T07:41:11.347594+0000","last_became_active":"2024-09-10T07:41:10.344084+0000","last_became_peered":"2024-09-10T07:41:10.344084+0000","last_unstale":"2024-09-10T07:41:11.347594+0000","last_undegraded":"2024-09-10T07:41:11.347594+0000","last_fullsized":"2024-09-10T07:41:11.347594+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:11.657019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348708+0000","last_change":"2024-09-10T07:41:10.352526+0000","last_active":"2024-09-10T07:41:11.348708+0000","last_peered":"2024-09-10T07:41:11.348708+0000","last_clean":"2024-09-10T07:41:11.348708+0000","last_became_active":"2024-09-10T07:41:10.351225+0000","last_became_peered":"2024-09-10T07:41:10.351225+0000","last_unstale":"2024-09-10T07:41:11.348708+0000","last_undegraded":"2024-09-10T07:41:11.348708+0000","last_fullsized":"2024-09-10T07:41:11.348708+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:43.479411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533430+0000","last_change":"2024-09-10T07:41:10.339206+0000","last_active":"2024-09-10T07:41:11.533430+0000","last_peered":"2024-09-10T07:41:11.533430+0000","last_clean":"2024-09-10T07:41:11.533430+0000","last_became_active":"2024-09-10T07:41:10.338962+0000","last_became_peered":"2024-09-10T07:41:10.338962+0000","last_unstale":"2024-09-10T07:41:11.533430+0000","last_undegraded":"2024-09-10T07:41:11.533430+0000","last_fullsized":"2024-09-10T07:41:11.533430+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:51.507970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533123+0000","last_change":"2024-09-10T07:41:10.337363+0000","last_active":"2024-09-10T07:41:11.533123+0000","last_peered":"2024-09-10T07:41:11.533123+0000","last_clean":"2024-09-10T07:41:11.533123+0000","last_became_active":"2024-09-10T07:41:10.337132+0000","last_became_peered":"2024-09-10T07:41:10.337132+0000","last_unstale":"2024-09-10T07:41:11.533123+0000","last_undegraded":"2024-09-10T07:41:11.533123+0000","last_fullsized":"2024-09-10T07:41:11.533123+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:26.270785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"154'4","reported_seq":18,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348281+0000","last_change":"2024-09-10T07:41:09.334108+0000","last_active":"2024-09-10T07:41:11.348281+0000","last_peered":"2024-09-10T07:41:11.348281+0000","last_clean":"2024-09-10T07:41:11.348281+0000","last_became_active":"2024-09-10T07:41:09.333862+0000","last_became_peered":"2024-09-10T07:41:09.333862+0000","last_unstale":"2024-09-10T07:41:11.348281+0000","last_undegraded":"2024-09-10T07:41:11.348281+0000","last_fullsized":"2024-09-10T07:41:11.348281+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:44.167215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533192+0000","last_change":"2024-09-10T07:41:10.349810+0000","last_active":"2024-09-10T07:41:11.533192+0000","last_peered":"2024-09-10T07:41:11.533192+0000","last_clean":"2024-09-10T07:41:11.533192+0000","last_became_active":"2024-09-10T07:41:10.349541+0000","last_became_peered":"2024-09-10T07:41:10.349541+0000","last_unstale":"2024-09-10T07:41:11.533192+0000","last_undegraded":"2024-09-10T07:41:11.533192+0000","last_fullsized":"2024-09-10T07:41:11.533192+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:45.579672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"154'1","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348485+0000","last_change":"2024-09-10T07:41:09.340217+0000","last_active":"2024-09-10T07:41:11.348485+0000","last_peered":"2024-09-10T07:41:11.348485+0000","last_clean":"2024-09-10T07:41:11.348485+0000","last_became_active":"2024-09-10T07:41:09.339909+0000","last_became_peered":"2024-09-10T07:41:09.339909+0000","last_unstale":"2024-09-10T07:41:11.348485+0000","last_undegraded":"2024-09-10T07:41:11.348485+0000","last_fullsized":"2024-09-10T07:41:11.348485+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:35.813100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348860+0000","last_change":"2024-09-10T07:41:10.346480+0000","last_active":"2024-09-10T07:41:11.348860+0000","last_peered":"2024-09-10T07:41:11.348860+0000","last_clean":"2024-09-10T07:41:11.348860+0000","last_became_active":"2024-09-10T07:41:10.346238+0000","last_became_peered":"2024-09-10T07:41:10.346238+0000","last_unstale":"2024-09-10T07:41:11.348860+0000","last_undegraded":"2024-09-10T07:41:11.348860+0000","last_fullsized":"2024-09-10T07:41:11.348860+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:05.180383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"154'2","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.532953+0000","last_change":"2024-09-10T07:41:09.336888+0000","last_active":"2024-09-10T07:41:11.532953+0000","last_peered":"2024-09-10T07:41:11.532953+0000","last_clean":"2024-09-10T07:41:11.532953+0000","last_became_active":"2024-09-10T07:41:09.335530+0000","last_became_peered":"2024-09-10T07:41:09.335530+0000","last_unstale":"2024-09-10T07:41:11.532953+0000","last_undegraded":"2024-09-10T07:41:11.532953+0000","last_fullsized":"2024-09-10T07:41:11.532953+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:16.211725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348982+0000","last_change":"2024-09-10T07:41:10.353340+0000","last_active":"2024-09-10T07:41:11.348982+0000","last_peered":"2024-09-10T07:41:11.348982+0000","last_clean":"2024-09-10T07:41:11.348982+0000","last_became_active":"2024-09-10T07:41:10.353087+0000","last_became_peered":"2024-09-10T07:41:10.353087+0000","last_unstale":"2024-09-10T07:41:11.348982+0000","last_undegraded":"2024-09-10T07:41:11.348982+0000","last_fullsized":"2024-09-10T07:41:11.348982+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:25.384512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"154'2","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533929+0000","last_change":"2024-09-10T07:41:09.340226+0000","last_active":"2024-09-10T07:41:11.533929+0000","last_peered":"2024-09-10T07:41:11.533929+0000","last_clean":"2024-09-10T07:41:11.533929+0000","last_became_active":"2024-09-10T07:41:09.339994+0000","last_became_peered":"2024-09-10T07:41:09.339994+0000","last_unstale":"2024-09-10T07:41:11.533929+0000","last_undegraded":"2024-09-10T07:41:11.533929+0000","last_fullsized":"2024-09-10T07:41:11.533929+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:03.047884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533686+0000","last_change":"2024-09-10T07:41:10.339985+0000","last_active":"2024-09-10T07:41:11.533686+0000","last_peered":"2024-09-10T07:41:11.533686+0000","last_clean":"2024-09-10T07:41:11.533686+0000","last_became_active":"2024-09-10T07:41:10.339004+0000","last_became_peered":"2024-09-10T07:41:10.339004+0000","last_unstale":"2024-09-10T07:41:11.533686+0000","last_undegraded":"2024-09-10T07:41:11.533686+0000","last_fullsized":"2024-09-10T07:41:11.533686+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:49.183582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"154'1","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.534177+0000","last_change":"2024-09-10T07:41:09.345583+0000","last_active":"2024-09-10T07:41:11.534177+0000","last_peered":"2024-09-10T07:41:11.534177+0000","last_clean":"2024-09-10T07:41:11.534177+0000","last_became_active":"2024-09-10T07:41:09.344849+0000","last_became_peered":"2024-09-10T07:41:09.344849+0000","last_unstale":"2024-09-10T07:41:11.534177+0000","last_undegraded":"2024-09-10T07:41:11.534177+0000","last_fullsized":"2024-09-10T07:41:11.534177+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:59.389238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533668+0000","last_change":"2024-09-10T07:41:10.337053+0000","last_active":"2024-09-10T07:41:11.533668+0000","last_peered":"2024-09-10T07:41:11.533668+0000","last_clean":"2024-09-10T07:41:11.533668+0000","last_became_active":"2024-09-10T07:41:10.336750+0000","last_became_peered":"2024-09-10T07:41:10.336750+0000","last_unstale":"2024-09-10T07:41:11.533668+0000","last_undegraded":"2024-09-10T07:41:11.533668+0000","last_fullsized":"2024-09-10T07:41:11.533668+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:02.671663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"154'1","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533811+0000","last_change":"2024-09-10T07:41:09.341933+0000","last_active":"2024-09-10T07:41:11.533811+0000","last_peered":"2024-09-10T07:41:11.533811+0000","last_clean":"2024-09-10T07:41:11.533811+0000","last_became_active":"2024-09-10T07:41:09.340866+0000","last_became_peered":"2024-09-10T07:41:09.340866+0000","last_unstale":"2024-09-10T07:41:11.533811+0000","last_undegraded":"2024-09-10T07:41:11.533811+0000","last_fullsized":"2024-09-10T07:41:11.533811+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:21.557244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533222+0000","last_change":"2024-09-10T07:41:10.344783+0000","last_active":"2024-09-10T07:41:11.533222+0000","last_peered":"2024-09-10T07:41:11.533222+0000","last_clean":"2024-09-10T07:41:11.533222+0000","last_became_active":"2024-09-10T07:41:10.344548+0000","last_became_peered":"2024-09-10T07:41:10.344548+0000","last_unstale":"2024-09-10T07:41:11.533222+0000","last_undegraded":"2024-09-10T07:41:11.533222+0000","last_fullsized":"2024-09-10T07:41:11.533222+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:52.322758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533326+0000","last_change":"2024-09-10T07:41:09.337647+0000","last_active":"2024-09-10T07:41:11.533326+0000","last_peered":"2024-09-10T07:41:11.533326+0000","last_clean":"2024-09-10T07:41:11.533326+0000","last_became_active":"2024-09-10T07:41:09.337404+0000","last_became_peered":"2024-09-10T07:41:09.337404+0000","last_unstale":"2024-09-10T07:41:11.533326+0000","last_undegraded":"2024-09-10T07:41:11.533326+0000","last_fullsized":"2024-09-10T07:41:11.533326+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:16.518916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533372+0000","last_change":"2024-09-10T07:41:10.345454+0000","last_active":"2024-09-10T07:41:11.533372+0000","last_peered":"2024-09-10T07:41:11.533372+0000","last_clean":"2024-09-10T07:41:11.533372+0000","last_became_active":"2024-09-10T07:41:10.342518+0000","last_became_peered":"2024-09-10T07:41:10.342518+0000","last_unstale":"2024-09-10T07:41:11.533372+0000","last_undegraded":"2024-09-10T07:41:11.533372+0000","last_fullsized":"2024-09-10T07:41:11.533372+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:06.921275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.534023+0000","last_change":"2024-09-10T07:41:09.343208+0000","last_active":"2024-09-10T07:41:11.534023+0000","last_peered":"2024-09-10T07:41:11.534023+0000","last_clean":"2024-09-10T07:41:11.534023+0000","last_became_active":"2024-09-10T07:41:09.342971+0000","last_became_peered":"2024-09-10T07:41:09.342971+0000","last_unstale":"2024-09-10T07:41:11.534023+0000","last_undegraded":"2024-09-10T07:41:11.534023+0000","last_fullsized":"2024-09-10T07:41:11.534023+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:13.309994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347778+0000","last_change":"2024-09-10T07:41:10.347687+0000","last_active":"2024-09-10T07:41:11.347778+0000","last_peered":"2024-09-10T07:41:11.347778+0000","last_clean":"2024-09-10T07:41:11.347778+0000","last_became_active":"2024-09-10T07:41:10.347440+0000","last_became_peered":"2024-09-10T07:41:10.347440+0000","last_unstale":"2024-09-10T07:41:11.347778+0000","last_undegraded":"2024-09-10T07:41:11.347778+0000","last_fullsized":"2024-09-10T07:41:11.347778+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:54.641175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348408+0000","last_change":"2024-09-10T07:41:09.336116+0000","last_active":"2024-09-10T07:41:11.348408+0000","last_peered":"2024-09-10T07:41:11.348408+0000","last_clean":"2024-09-10T07:41:11.348408+0000","last_became_active":"2024-09-10T07:41:09.335925+0000","last_became_peered":"2024-09-10T07:41:09.335925+0000","last_unstale":"2024-09-10T07:41:11.348408+0000","last_undegraded":"2024-09-10T07:41:11.348408+0000","last_fullsized":"2024-09-10T07:41:11.348408+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:48.342250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348197+0000","last_change":"2024-09-10T07:41:10.341349+0000","last_active":"2024-09-10T07:41:11.348197+0000","last_peered":"2024-09-10T07:41:11.348197+0000","last_clean":"2024-09-10T07:41:11.348197+0000","last_became_active":"2024-09-10T07:41:10.339207+0000","last_became_peered":"2024-09-10T07:41:10.339207+0000","last_unstale":"2024-09-10T07:41:11.348197+0000","last_undegraded":"2024-09-10T07:41:11.348197+0000","last_fullsized":"2024-09-10T07:41:11.348197+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:31:32.586288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533816+0000","last_change":"2024-09-10T07:41:09.342176+0000","last_active":"2024-09-10T07:41:11.533816+0000","last_peered":"2024-09-10T07:41:11.533816+0000","last_clean":"2024-09-10T07:41:11.533816+0000","last_became_active":"2024-09-10T07:41:09.341642+0000","last_became_peered":"2024-09-10T07:41:09.341642+0000","last_unstale":"2024-09-10T07:41:11.533816+0000","last_undegraded":"2024-09-10T07:41:11.533816+0000","last_fullsized":"2024-09-10T07:41:11.533816+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:06.609077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.349016+0000","last_change":"2024-09-10T07:41:10.354558+0000","last_active":"2024-09-10T07:41:11.349016+0000","last_peered":"2024-09-10T07:41:11.349016+0000","last_clean":"2024-09-10T07:41:11.349016+0000","last_became_active":"2024-09-10T07:41:10.352429+0000","last_became_peered":"2024-09-10T07:41:10.352429+0000","last_unstale":"2024-09-10T07:41:11.349016+0000","last_undegraded":"2024-09-10T07:41:11.349016+0000","last_fullsized":"2024-09-10T07:41:11.349016+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:56.027848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"154'3","reported_seq":17,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348608+0000","last_change":"2024-09-10T07:41:09.340694+0000","last_active":"2024-09-10T07:41:11.348608+0000","last_peered":"2024-09-10T07:41:11.348608+0000","last_clean":"2024-09-10T07:41:11.348608+0000","last_became_active":"2024-09-10T07:41:09.338472+0000","last_became_peered":"2024-09-10T07:41:09.338472+0000","last_unstale":"2024-09-10T07:41:11.348608+0000","last_undegraded":"2024-09-10T07:41:11.348608+0000","last_fullsized":"2024-09-10T07:41:11.348608+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:23.794525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348216+0000","last_change":"2024-09-10T07:41:10.353865+0000","last_active":"2024-09-10T07:41:11.348216+0000","last_peered":"2024-09-10T07:41:11.348216+0000","last_clean":"2024-09-10T07:41:11.348216+0000","last_became_active":"2024-09-10T07:41:10.353542+0000","last_became_peered":"2024-09-10T07:41:10.353542+0000","last_unstale":"2024-09-10T07:41:11.348216+0000","last_undegraded":"2024-09-10T07:41:11.348216+0000","last_fullsized":"2024-09-10T07:41:11.348216+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:04.030341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"154'6","reported_seq":20,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.532971+0000","last_change":"2024-09-10T07:41:09.338813+0000","last_active":"2024-09-10T07:41:11.532971+0000","last_peered":"2024-09-10T07:41:11.532971+0000","last_clean":"2024-09-10T07:41:11.532971+0000","last_became_active":"2024-09-10T07:41:09.338053+0000","last_became_peered":"2024-09-10T07:41:09.338053+0000","last_unstale":"2024-09-10T07:41:11.532971+0000","last_undegraded":"2024-09-10T07:41:11.532971+0000","last_fullsized":"2024-09-10T07:41:11.532971+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:40.450429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347820+0000","last_change":"2024-09-10T07:41:10.348569+0000","last_active":"2024-09-10T07:41:11.347820+0000","last_peered":"2024-09-10T07:41:11.347820+0000","last_clean":"2024-09-10T07:41:11.347820+0000","last_became_active":"2024-09-10T07:41:10.348228+0000","last_became_peered":"2024-09-10T07:41:10.348228+0000","last_unstale":"2024-09-10T07:41:11.347820+0000","last_undegraded":"2024-09-10T07:41:11.347820+0000","last_fullsized":"2024-09-10T07:41:11.347820+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:38.676359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347819+0000","last_change":"2024-09-10T07:41:09.343499+0000","last_active":"2024-09-10T07:41:11.347819+0000","last_peered":"2024-09-10T07:41:11.347819+0000","last_clean":"2024-09-10T07:41:11.347819+0000","last_became_active":"2024-09-10T07:41:09.343229+0000","last_became_peered":"2024-09-10T07:41:09.343229+0000","last_unstale":"2024-09-10T07:41:11.347819+0000","last_undegraded":"2024-09-10T07:41:11.347819+0000","last_fullsized":"2024-09-10T07:41:11.347819+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:07.541202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.532889+0000","last_change":"2024-09-10T07:41:10.349645+0000","last_active":"2024-09-10T07:41:11.532889+0000","last_peered":"2024-09-10T07:41:11.532889+0000","last_clean":"2024-09-10T07:41:11.532889+0000","last_became_active":"2024-09-10T07:41:10.349404+0000","last_became_peered":"2024-09-10T07:41:10.349404+0000","last_unstale":"2024-09-10T07:41:11.532889+0000","last_undegraded":"2024-09-10T07:41:11.532889+0000","last_fullsized":"2024-09-10T07:41:11.532889+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:25.987991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.534268+0000","last_change":"2024-09-10T07:41:09.345809+0000","last_active":"2024-09-10T07:41:11.534268+0000","last_peered":"2024-09-10T07:41:11.534268+0000","last_clean":"2024-09-10T07:41:11.534268+0000","last_became_active":"2024-09-10T07:41:09.345302+0000","last_became_peered":"2024-09-10T07:41:09.345302+0000","last_unstale":"2024-09-10T07:41:11.534268+0000","last_undegraded":"2024-09-10T07:41:11.534268+0000","last_fullsized":"2024-09-10T07:41:11.534268+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:43.244996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533349+0000","last_change":"2024-09-10T07:41:10.342225+0000","last_active":"2024-09-10T07:41:11.533349+0000","last_peered":"2024-09-10T07:41:11.533349+0000","last_clean":"2024-09-10T07:41:11.533349+0000","last_became_active":"2024-09-10T07:41:10.341778+0000","last_became_peered":"2024-09-10T07:41:10.341778+0000","last_unstale":"2024-09-10T07:41:11.533349+0000","last_undegraded":"2024-09-10T07:41:11.533349+0000","last_fullsized":"2024-09-10T07:41:11.533349+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:34.462763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"154'8","reported_seq":22,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533604+0000","last_change":"2024-09-10T07:41:09.341218+0000","last_active":"2024-09-10T07:41:11.533604+0000","last_peered":"2024-09-10T07:41:11.533604+0000","last_clean":"2024-09-10T07:41:11.533604+0000","last_became_active":"2024-09-10T07:41:09.340545+0000","last_became_peered":"2024-09-10T07:41:09.340545+0000","last_unstale":"2024-09-10T07:41:11.533604+0000","last_undegraded":"2024-09-10T07:41:11.533604+0000","last_fullsized":"2024-09-10T07:41:11.533604+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:31.915998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533336+0000","last_change":"2024-09-10T07:41:10.351487+0000","last_active":"2024-09-10T07:41:11.533336+0000","last_peered":"2024-09-10T07:41:11.533336+0000","last_clean":"2024-09-10T07:41:11.533336+0000","last_became_active":"2024-09-10T07:41:10.350610+0000","last_became_peered":"2024-09-10T07:41:10.350610+0000","last_unstale":"2024-09-10T07:41:11.533336+0000","last_undegraded":"2024-09-10T07:41:11.533336+0000","last_fullsized":"2024-09-10T07:41:11.533336+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:47.595601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"154'1","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348594+0000","last_change":"2024-09-10T07:41:09.335644+0000","last_active":"2024-09-10T07:41:11.348594+0000","last_peered":"2024-09-10T07:41:11.348594+0000","last_clean":"2024-09-10T07:41:11.348594+0000","last_became_active":"2024-09-10T07:41:09.335341+0000","last_became_peered":"2024-09-10T07:41:09.335341+0000","last_unstale":"2024-09-10T07:41:11.348594+0000","last_undegraded":"2024-09-10T07:41:11.348594+0000","last_fullsized":"2024-09-10T07:41:11.348594+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:30.820491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348427+0000","last_change":"2024-09-10T07:41:10.347191+0000","last_active":"2024-09-10T07:41:11.348427+0000","last_peered":"2024-09-10T07:41:11.348427+0000","last_clean":"2024-09-10T07:41:11.348427+0000","last_became_active":"2024-09-10T07:41:10.346860+0000","last_became_peered":"2024-09-10T07:41:10.346860+0000","last_unstale":"2024-09-10T07:41:11.348427+0000","last_undegraded":"2024-09-10T07:41:11.348427+0000","last_fullsized":"2024-09-10T07:41:11.348427+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:34.244542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"154'2","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533048+0000","last_change":"2024-09-10T07:41:09.342975+0000","last_active":"2024-09-10T07:41:11.533048+0000","last_peered":"2024-09-10T07:41:11.533048+0000","last_clean":"2024-09-10T07:41:11.533048+0000","last_became_active":"2024-09-10T07:41:09.341702+0000","last_became_peered":"2024-09-10T07:41:09.341702+0000","last_unstale":"2024-09-10T07:41:11.533048+0000","last_undegraded":"2024-09-10T07:41:11.533048+0000","last_fullsized":"2024-09-10T07:41:11.533048+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:13.074879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533771+0000","last_change":"2024-09-10T07:41:10.349214+0000","last_active":"2024-09-10T07:41:11.533771+0000","last_peered":"2024-09-10T07:41:11.533771+0000","last_clean":"2024-09-10T07:41:11.533771+0000","last_became_active":"2024-09-10T07:41:10.348940+0000","last_became_peered":"2024-09-10T07:41:10.348940+0000","last_unstale":"2024-09-10T07:41:11.533771+0000","last_undegraded":"2024-09-10T07:41:11.533771+0000","last_fullsized":"2024-09-10T07:41:11.533771+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:54.989460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"154'1","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533683+0000","last_change":"2024-09-10T07:41:09.341486+0000","last_active":"2024-09-10T07:41:11.533683+0000","last_peered":"2024-09-10T07:41:11.533683+0000","last_clean":"2024-09-10T07:41:11.533683+0000","last_became_active":"2024-09-10T07:41:09.341162+0000","last_became_peered":"2024-09-10T07:41:09.341162+0000","last_unstale":"2024-09-10T07:41:11.533683+0000","last_undegraded":"2024-09-10T07:41:11.533683+0000","last_fullsized":"2024-09-10T07:41:11.533683+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:20.615415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.534086+0000","last_change":"2024-09-10T07:41:10.345424+0000","last_active":"2024-09-10T07:41:11.534086+0000","last_peered":"2024-09-10T07:41:11.534086+0000","last_clean":"2024-09-10T07:41:11.534086+0000","last_became_active":"2024-09-10T07:41:10.345005+0000","last_became_peered":"2024-09-10T07:41:10.345005+0000","last_unstale":"2024-09-10T07:41:11.534086+0000","last_undegraded":"2024-09-10T07:41:11.534086+0000","last_fullsized":"2024-09-10T07:41:11.534086+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:50.939072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348141+0000","last_change":"2024-09-10T07:41:09.339214+0000","last_active":"2024-09-10T07:41:11.348141+0000","last_peered":"2024-09-10T07:41:11.348141+0000","last_clean":"2024-09-10T07:41:11.348141+0000","last_became_active":"2024-09-10T07:41:09.338909+0000","last_became_peered":"2024-09-10T07:41:09.338909+0000","last_unstale":"2024-09-10T07:41:11.348141+0000","last_undegraded":"2024-09-10T07:41:11.348141+0000","last_fullsized":"2024-09-10T07:41:11.348141+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:15.766675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347550+0000","last_change":"2024-09-10T07:41:10.347675+0000","last_active":"2024-09-10T07:41:11.347550+0000","last_peered":"2024-09-10T07:41:11.347550+0000","last_clean":"2024-09-10T07:41:11.347550+0000","last_became_active":"2024-09-10T07:41:10.346897+0000","last_became_peered":"2024-09-10T07:41:10.346897+0000","last_unstale":"2024-09-10T07:41:11.347550+0000","last_undegraded":"2024-09-10T07:41:11.347550+0000","last_fullsized":"2024-09-10T07:41:11.347550+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:30.736594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"154'2","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348729+0000","last_change":"2024-09-10T07:41:09.333378+0000","last_active":"2024-09-10T07:41:11.348729+0000","last_peered":"2024-09-10T07:41:11.348729+0000","last_clean":"2024-09-10T07:41:11.348729+0000","last_became_active":"2024-09-10T07:41:09.332884+0000","last_became_peered":"2024-09-10T07:41:09.332884+0000","last_unstale":"2024-09-10T07:41:11.348729+0000","last_undegraded":"2024-09-10T07:41:11.348729+0000","last_fullsized":"2024-09-10T07:41:11.348729+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:36.349376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.532956+0000","last_change":"2024-09-10T07:41:10.349471+0000","last_active":"2024-09-10T07:41:11.532956+0000","last_peered":"2024-09-10T07:41:11.532956+0000","last_clean":"2024-09-10T07:41:11.532956+0000","last_became_active":"2024-09-10T07:41:10.347614+0000","last_became_peered":"2024-09-10T07:41:10.347614+0000","last_unstale":"2024-09-10T07:41:11.532956+0000","last_undegraded":"2024-09-10T07:41:11.532956+0000","last_fullsized":"2024-09-10T07:41:11.532956+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:05.612746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533311+0000","last_change":"2024-09-10T07:41:09.338631+0000","last_active":"2024-09-10T07:41:11.533311+0000","last_peered":"2024-09-10T07:41:11.533311+0000","last_clean":"2024-09-10T07:41:11.533311+0000","last_became_active":"2024-09-10T07:41:09.338353+0000","last_became_peered":"2024-09-10T07:41:09.338353+0000","last_unstale":"2024-09-10T07:41:11.533311+0000","last_undegraded":"2024-09-10T07:41:11.533311+0000","last_fullsized":"2024-09-10T07:41:11.533311+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:50.336955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533879+0000","last_change":"2024-09-10T07:41:10.348617+0000","last_active":"2024-09-10T07:41:11.533879+0000","last_peered":"2024-09-10T07:41:11.533879+0000","last_clean":"2024-09-10T07:41:11.533879+0000","last_became_active":"2024-09-10T07:41:10.348328+0000","last_became_peered":"2024-09-10T07:41:10.348328+0000","last_unstale":"2024-09-10T07:41:11.533879+0000","last_undegraded":"2024-09-10T07:41:11.533879+0000","last_fullsized":"2024-09-10T07:41:11.533879+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:48.268538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.534186+0000","last_change":"2024-09-10T07:41:09.335043+0000","last_active":"2024-09-10T07:41:11.534186+0000","last_peered":"2024-09-10T07:41:11.534186+0000","last_clean":"2024-09-10T07:41:11.534186+0000","last_became_active":"2024-09-10T07:41:09.332724+0000","last_became_peered":"2024-09-10T07:41:09.332724+0000","last_unstale":"2024-09-10T07:41:11.534186+0000","last_undegraded":"2024-09-10T07:41:11.534186+0000","last_fullsized":"2024-09-10T07:41:11.534186+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:57.477258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348669+0000","last_change":"2024-09-10T07:41:10.351847+0000","last_active":"2024-09-10T07:41:11.348669+0000","last_peered":"2024-09-10T07:41:11.348669+0000","last_clean":"2024-09-10T07:41:11.348669+0000","last_became_active":"2024-09-10T07:41:10.351572+0000","last_became_peered":"2024-09-10T07:41:10.351572+0000","last_unstale":"2024-09-10T07:41:11.348669+0000","last_undegraded":"2024-09-10T07:41:11.348669+0000","last_fullsized":"2024-09-10T07:41:11.348669+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:26.195468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533580+0000","last_change":"2024-09-10T07:41:09.340330+0000","last_active":"2024-09-10T07:41:11.533580+0000","last_peered":"2024-09-10T07:41:11.533580+0000","last_clean":"2024-09-10T07:41:11.533580+0000","last_became_active":"2024-09-10T07:41:09.340122+0000","last_became_peered":"2024-09-10T07:41:09.340122+0000","last_unstale":"2024-09-10T07:41:11.533580+0000","last_undegraded":"2024-09-10T07:41:11.533580+0000","last_fullsized":"2024-09-10T07:41:11.533580+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:05.583093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533125+0000","last_change":"2024-09-10T07:41:10.338320+0000","last_active":"2024-09-10T07:41:11.533125+0000","last_peered":"2024-09-10T07:41:11.533125+0000","last_clean":"2024-09-10T07:41:11.533125+0000","last_became_active":"2024-09-10T07:41:10.337443+0000","last_became_peered":"2024-09-10T07:41:10.337443+0000","last_unstale":"2024-09-10T07:41:11.533125+0000","last_undegraded":"2024-09-10T07:41:11.533125+0000","last_fullsized":"2024-09-10T07:41:11.533125+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:55.681502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"154'2","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347927+0000","last_change":"2024-09-10T07:41:09.334802+0000","last_active":"2024-09-10T07:41:11.347927+0000","last_peered":"2024-09-10T07:41:11.347927+0000","last_clean":"2024-09-10T07:41:11.347927+0000","last_became_active":"2024-09-10T07:41:09.334570+0000","last_became_peered":"2024-09-10T07:41:09.334570+0000","last_unstale":"2024-09-10T07:41:11.347927+0000","last_undegraded":"2024-09-10T07:41:11.347927+0000","last_fullsized":"2024-09-10T07:41:11.347927+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:28.982014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.347897+0000","last_change":"2024-09-10T07:41:10.346897+0000","last_active":"2024-09-10T07:41:11.347897+0000","last_peered":"2024-09-10T07:41:11.347897+0000","last_clean":"2024-09-10T07:41:11.347897+0000","last_became_active":"2024-09-10T07:41:10.345799+0000","last_became_peered":"2024-09-10T07:41:10.345799+0000","last_unstale":"2024-09-10T07:41:11.347897+0000","last_undegraded":"2024-09-10T07:41:11.347897+0000","last_fullsized":"2024-09-10T07:41:11.347897+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:43.687894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"155'1","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348462+0000","last_change":"2024-09-10T07:41:09.342638+0000","last_active":"2024-09-10T07:41:11.348462+0000","last_peered":"2024-09-10T07:41:11.348462+0000","last_clean":"2024-09-10T07:41:11.348462+0000","last_became_active":"2024-09-10T07:41:09.342377+0000","last_became_peered":"2024-09-10T07:41:09.342377+0000","last_unstale":"2024-09-10T07:41:11.348462+0000","last_undegraded":"2024-09-10T07:41:11.348462+0000","last_fullsized":"2024-09-10T07:41:11.348462+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:23.090701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533981+0000","last_change":"2024-09-10T07:41:10.353178+0000","last_active":"2024-09-10T07:41:11.533981+0000","last_peered":"2024-09-10T07:41:11.533981+0000","last_clean":"2024-09-10T07:41:11.533981+0000","last_became_active":"2024-09-10T07:41:10.352680+0000","last_became_peered":"2024-09-10T07:41:10.352680+0000","last_unstale":"2024-09-10T07:41:11.533981+0000","last_undegraded":"2024-09-10T07:41:11.533981+0000","last_fullsized":"2024-09-10T07:41:11.533981+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:09.948459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533416+0000","last_change":"2024-09-10T07:41:09.344611+0000","last_active":"2024-09-10T07:41:11.533416+0000","last_peered":"2024-09-10T07:41:11.533416+0000","last_clean":"2024-09-10T07:41:11.533416+0000","last_became_active":"2024-09-10T07:41:09.344372+0000","last_became_peered":"2024-09-10T07:41:09.344372+0000","last_unstale":"2024-09-10T07:41:11.533416+0000","last_undegraded":"2024-09-10T07:41:11.533416+0000","last_fullsized":"2024-09-10T07:41:11.533416+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:42.797100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.532755+0000","last_change":"2024-09-10T07:41:10.354069+0000","last_active":"2024-09-10T07:41:11.532755+0000","last_peered":"2024-09-10T07:41:11.532755+0000","last_clean":"2024-09-10T07:41:11.532755+0000","last_became_active":"2024-09-10T07:41:10.351908+0000","last_became_peered":"2024-09-10T07:41:10.351908+0000","last_unstale":"2024-09-10T07:41:11.532755+0000","last_undegraded":"2024-09-10T07:41:11.532755+0000","last_fullsized":"2024-09-10T07:41:11.532755+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:57.894800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533154+0000","last_change":"2024-09-10T07:41:09.341927+0000","last_active":"2024-09-10T07:41:11.533154+0000","last_peered":"2024-09-10T07:41:11.533154+0000","last_clean":"2024-09-10T07:41:11.533154+0000","last_became_active":"2024-09-10T07:41:09.341325+0000","last_became_peered":"2024-09-10T07:41:09.341325+0000","last_unstale":"2024-09-10T07:41:11.533154+0000","last_undegraded":"2024-09-10T07:41:11.533154+0000","last_fullsized":"2024-09-10T07:41:11.533154+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:54.015829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348111+0000","last_change":"2024-09-10T07:41:10.350469+0000","last_active":"2024-09-10T07:41:11.348111+0000","last_peered":"2024-09-10T07:41:11.348111+0000","last_clean":"2024-09-10T07:41:11.348111+0000","last_became_active":"2024-09-10T07:41:10.350188+0000","last_became_peered":"2024-09-10T07:41:10.350188+0000","last_unstale":"2024-09-10T07:41:11.348111+0000","last_undegraded":"2024-09-10T07:41:11.348111+0000","last_fullsized":"2024-09-10T07:41:11.348111+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:03.163084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.534124+0000","last_change":"2024-09-10T07:41:09.344336+0000","last_active":"2024-09-10T07:41:11.534124+0000","last_peered":"2024-09-10T07:41:11.534124+0000","last_clean":"2024-09-10T07:41:11.534124+0000","last_became_active":"2024-09-10T07:41:09.344093+0000","last_became_peered":"2024-09-10T07:41:09.344093+0000","last_unstale":"2024-09-10T07:41:11.534124+0000","last_undegraded":"2024-09-10T07:41:11.534124+0000","last_fullsized":"2024-09-10T07:41:11.534124+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:25.975838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348347+0000","last_change":"2024-09-10T07:41:10.348957+0000","last_active":"2024-09-10T07:41:11.348347+0000","last_peered":"2024-09-10T07:41:11.348347+0000","last_clean":"2024-09-10T07:41:11.348347+0000","last_became_active":"2024-09-10T07:41:10.348710+0000","last_became_peered":"2024-09-10T07:41:10.348710+0000","last_unstale":"2024-09-10T07:41:11.348347+0000","last_undegraded":"2024-09-10T07:41:11.348347+0000","last_fullsized":"2024-09-10T07:41:11.348347+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:21.904071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348256+0000","last_change":"2024-09-10T07:41:09.338477+0000","last_active":"2024-09-10T07:41:11.348256+0000","last_peered":"2024-09-10T07:41:11.348256+0000","last_clean":"2024-09-10T07:41:11.348256+0000","last_became_active":"2024-09-10T07:41:09.338245+0000","last_became_peered":"2024-09-10T07:41:09.338245+0000","last_unstale":"2024-09-10T07:41:11.348256+0000","last_undegraded":"2024-09-10T07:41:11.348256+0000","last_fullsized":"2024-09-10T07:41:11.348256+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:07.251588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533260+0000","last_change":"2024-09-10T07:41:10.347260+0000","last_active":"2024-09-10T07:41:11.533260+0000","last_peered":"2024-09-10T07:41:11.533260+0000","last_clean":"2024-09-10T07:41:11.533260+0000","last_became_active":"2024-09-10T07:41:10.346469+0000","last_became_peered":"2024-09-10T07:41:10.346469+0000","last_unstale":"2024-09-10T07:41:11.533260+0000","last_undegraded":"2024-09-10T07:41:11.533260+0000","last_fullsized":"2024-09-10T07:41:11.533260+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:39.219974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533907+0000","last_change":"2024-09-10T07:41:09.338244+0000","last_active":"2024-09-10T07:41:11.533907+0000","last_peered":"2024-09-10T07:41:11.533907+0000","last_clean":"2024-09-10T07:41:11.533907+0000","last_became_active":"2024-09-10T07:41:09.337954+0000","last_became_peered":"2024-09-10T07:41:09.337954+0000","last_unstale":"2024-09-10T07:41:11.533907+0000","last_undegraded":"2024-09-10T07:41:11.533907+0000","last_fullsized":"2024-09-10T07:41:11.533907+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:25.336144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533021+0000","last_change":"2024-09-10T07:41:10.352431+0000","last_active":"2024-09-10T07:41:11.533021+0000","last_peered":"2024-09-10T07:41:11.533021+0000","last_clean":"2024-09-10T07:41:11.533021+0000","last_became_active":"2024-09-10T07:41:10.352194+0000","last_became_peered":"2024-09-10T07:41:10.352194+0000","last_unstale":"2024-09-10T07:41:11.533021+0000","last_undegraded":"2024-09-10T07:41:11.533021+0000","last_fullsized":"2024-09-10T07:41:11.533021+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:37.553860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.533069+0000","last_change":"2024-09-10T07:41:09.340088+0000","last_active":"2024-09-10T07:41:11.533069+0000","last_peered":"2024-09-10T07:41:11.533069+0000","last_clean":"2024-09-10T07:41:11.533069+0000","last_became_active":"2024-09-10T07:41:09.339610+0000","last_became_peered":"2024-09-10T07:41:09.339610+0000","last_unstale":"2024-09-10T07:41:11.533069+0000","last_undegraded":"2024-09-10T07:41:11.533069+0000","last_fullsized":"2024-09-10T07:41:11.533069+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:01.296813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.348952+0000","last_change":"2024-09-10T07:41:10.352759+0000","last_active":"2024-09-10T07:41:11.348952+0000","last_peered":"2024-09-10T07:41:11.348952+0000","last_clean":"2024-09-10T07:41:11.348952+0000","last_became_active":"2024-09-10T07:41:10.352194+0000","last_became_peered":"2024-09-10T07:41:10.352194+0000","last_unstale":"2024-09-10T07:41:11.348952+0000","last_undegraded":"2024-09-10T07:41:11.348952+0000","last_fullsized":"2024-09-10T07:41:11.348952+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:09.318639+0000","last_clean_scrub_stamp":"2024-09-10T07:41:09.318639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:11.891441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"154'2","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.349106+0000","last_change":"2024-09-10T07:41:09.335721+0000","last_active":"2024-09-10T07:41:11.349106+0000","last_peered":"2024-09-10T07:41:11.349106+0000","last_clean":"2024-09-10T07:41:11.349106+0000","last_became_active":"2024-09-10T07:41:09.335298+0000","last_became_peered":"2024-09-10T07:41:09.335298+0000","last_unstale":"2024-09-10T07:41:11.349106+0000","last_undegraded":"2024-09-10T07:41:11.349106+0000","last_fullsized":"2024-09-10T07:41:11.349106+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:41:08.315503+0000","last_clean_scrub_stamp":"2024-09-10T07:41:08.315503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:31.940390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":435,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T07:41:11.349057+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:41:11.349057+0000","last_peered":"2024-09-10T07:41:11.349057+0000","last_clean":"2024-09-10T07:41:11.349057+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:41:11.349057+0000","last_undegraded":"2024-09-10T07:41:11.349057+0000","last_fullsized":"2024-09-10T07:41:11.349057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1425,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193887,"statfs":{"total":200000000,"available":198540699,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":847,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194464,"statfs":{"total":200000000,"available":199131705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194466,"statfs":{"total":200000000,"available":199133205,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194466,"statfs":{"total":200000000,"available":199133247,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574935,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133157,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199132701,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194466,"statfs":{"total":200000000,"available":199133317,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1422,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193889,"statfs":{"total":200000000,"available":198542949,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:41:14.919 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:41:14.919 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T07:41:15.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.116+0000 7fc412c00640 1 Processor -- start 2024-09-10T07:41:15.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.116+0000 7fc412c00640 1 -- start start 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.117+0000 7fc412c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc40c071df0 0x7fc40c073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.117+0000 7fc412c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc40c0d1010 0x7fc40c0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.117+0000 7fc412c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40c0722d0 con 0x7fc40c06e280 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.117+0000 7fc412c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c0738b0 con 0x7fc40c071df0 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.117+0000 7fc412c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c0725b0 con 0x7fc40c0d1010 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.118+0000 7fc40b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc40c071df0 0x7fc40c073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.118+0000 7fc40b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc40c071df0 0x7fc40c073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42278/0 (socket says 172.21.15.99:42278) 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.118+0000 7fc40b400640 1 -- 172.21.15.99:0/1999777135 learned_addr learned my addr 172.21.15.99:0/1999777135 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.118+0000 7fc410c00640 1 --2- 172.21.15.99:0/1999777135 >> v2:172.21.15.187:3300/0 conn(0x7fc40c0d1010 0x7fc40c0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.118+0000 7fc40b400640 1 -- 172.21.15.99:0/1999777135 >> v2:172.21.15.187:3300/0 conn(0x7fc40c0d1010 msgr2=0x7fc40c0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:15.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.118+0000 7fc40b400640 1 --2- 172.21.15.99:0/1999777135 >> v2:172.21.15.187:3300/0 conn(0x7fc40c0d1010 0x7fc40c0ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.118+0000 7fc40b400640 1 -- 172.21.15.99:0/1999777135 >> v1:172.21.15.99:6789/0 conn(0x7fc40c06e280 legacy=0x7fc40c06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.118+0000 7fc40b400640 1 -- 172.21.15.99:0/1999777135 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c072890 con 0x7fc40c071df0 2024-09-10T07:41:15.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.118+0000 7fc410c00640 1 --2- 172.21.15.99:0/1999777135 >> v2:172.21.15.187:3300/0 conn(0x7fc40c0d1010 0x7fc40c0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:15.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.119+0000 7fc40b400640 1 --2- 172.21.15.99:0/1999777135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c071df0 0x7fc40c073370 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0b5ca0 tx=0x7fc3f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad59dcbd97f18648 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:15.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.119+0000 7fc40aa00640 1 -- 172.21.15.99:0/1999777135 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8037070 con 0x7fc40c071df0 2024-09-10T07:41:15.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.119+0000 7fc40aa00640 1 -- 172.21.15.99:0/1999777135 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f8032440 con 0x7fc40c071df0 2024-09-10T07:41:15.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.119+0000 7fc40aa00640 1 -- 172.21.15.99:0/1999777135 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8032810 con 0x7fc40c071df0 2024-09-10T07:41:15.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.120+0000 7fc412c00640 1 -- 172.21.15.99:0/1999777135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c071df0 msgr2=0x7fc40c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.120+0000 7fc412c00640 1 --2- 172.21.15.99:0/1999777135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c071df0 0x7fc40c073370 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0b5ca0 tx=0x7fc3f802a270 comp rx=0 tx=0).stop 2024-09-10T07:41:15.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.120+0000 7fc412c00640 1 -- 172.21.15.99:0/1999777135 shutdown_connections 2024-09-10T07:41:15.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.120+0000 7fc412c00640 1 --2- 172.21.15.99:0/1999777135 >> v2:172.21.15.187:3300/0 conn(0x7fc40c0d1010 0x7fc40c0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.120+0000 7fc412c00640 1 --2- 172.21.15.99:0/1999777135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c071df0 0x7fc40c073370 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.120+0000 7fc412c00640 1 -- 172.21.15.99:0/1999777135 >> 172.21.15.99:0/1999777135 conn(0x7fc40c06bc10 msgr2=0x7fc40c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:15.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.120+0000 7fc412c00640 1 -- 172.21.15.99:0/1999777135 shutdown_connections 2024-09-10T07:41:15.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.120+0000 7fc412c00640 1 -- 172.21.15.99:0/1999777135 wait complete. 2024-09-10T07:41:15.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.122+0000 7fc412c00640 1 Processor -- start 2024-09-10T07:41:15.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.122+0000 7fc412c00640 1 -- start start 2024-09-10T07:41:15.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc412c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc40c06e280 0x7fc40c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc412c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc40c071df0 0x7fc40c15b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc412c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c0d1010 0x7fc40c150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc412c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c15db60 con 0x7fc40c0d1010 2024-09-10T07:41:15.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc412c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c072e50 con 0x7fc40c06e280 2024-09-10T07:41:15.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc412c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc40c0d14c0 con 0x7fc40c071df0 2024-09-10T07:41:15.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc410c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c0d1010 0x7fc40c150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc410c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c0d1010 0x7fc40c150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42294/0 (socket says 172.21.15.99:42294) 2024-09-10T07:41:15.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc410c00640 1 -- 172.21.15.99:0/162898729 learned_addr learned my addr 172.21.15.99:0/162898729 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:15.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc40b400640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc40c071df0 0x7fc40c15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc40be00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc40c06e280 0x7fc40c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc410c00640 1 -- 172.21.15.99:0/162898729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc40c071df0 msgr2=0x7fc40c15b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc410c00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc40c071df0 0x7fc40c15b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc410c00640 1 -- 172.21.15.99:0/162898729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc40c06e280 msgr2=0x7fc40c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc410c00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc40c06e280 0x7fc40c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc410c00640 1 -- 172.21.15.99:0/162898729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c0c5860 con 0x7fc40c0d1010 2024-09-10T07:41:15.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.123+0000 7fc40be00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc40c06e280 0x7fc40c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:15.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.124+0000 7fc410c00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c0d1010 0x7fc40c150e20 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc404007e70 tx=0x7fc40400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:15.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.124+0000 7fc403e00640 1 -- 172.21.15.99:0/162898729 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40401a070 con 0x7fc40c0d1010 2024-09-10T07:41:15.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.124+0000 7fc403e00640 1 -- 172.21.15.99:0/162898729 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc404003bb0 con 0x7fc40c0d1010 2024-09-10T07:41:15.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.124+0000 7fc412c00640 1 -- 172.21.15.99:0/162898729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c0c5b40 con 0x7fc40c0d1010 2024-09-10T07:41:15.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.124+0000 7fc403e00640 1 -- 172.21.15.99:0/162898729 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404004030 con 0x7fc40c0d1010 2024-09-10T07:41:15.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.124+0000 7fc412c00640 1 -- 172.21.15.99:0/162898729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c15bb70 con 0x7fc40c0d1010 2024-09-10T07:41:15.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.125+0000 7fc412c00640 1 -- 172.21.15.99:0/162898729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40c073370 con 0x7fc40c0d1010 2024-09-10T07:41:15.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.126+0000 7fc403e00640 1 -- 172.21.15.99:0/162898729 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc40401d070 con 0x7fc40c0d1010 2024-09-10T07:41:15.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.127+0000 7fc403e00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3ec06be30 0x7fc3ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.127+0000 7fc403e00640 1 -- 172.21.15.99:0/162898729 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7fc40408b170 con 0x7fc40c0d1010 2024-09-10T07:41:15.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.127+0000 7fc40be00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3ec06be30 0x7fc3ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.128+0000 7fc40be00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3ec06be30 0x7fc3ec06e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc001700 tx=0x7fc3fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:15.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.131+0000 7fc403e00640 1 -- 172.21.15.99:0/162898729 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc404010070 con 0x7fc40c0d1010 2024-09-10T07:41:15.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.369+0000 7fc412c00640 1 -- 172.21.15.99:0/162898729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc40c06e8b0 con 0x7fc40c0d1010 2024-09-10T07:41:15.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.371+0000 7fc403e00640 1 -- 172.21.15.99:0/162898729 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7fc404059b10 con 0x7fc40c0d1010 2024-09-10T07:41:15.371 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:41:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:41:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-09-10T07:41:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-09-10T07:41:15.371 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T07:41:15.371 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-09-10T07:41:15.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 -- 172.21.15.99:0/162898729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3ec06be30 msgr2=0x7fc3ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3ec06be30 0x7fc3ec06e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc001700 tx=0x7fc3fc009040 comp rx=0 tx=0).stop 2024-09-10T07:41:15.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 -- 172.21.15.99:0/162898729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c0d1010 msgr2=0x7fc40c150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c0d1010 0x7fc40c150e20 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc404007e70 tx=0x7fc40400d4a0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 -- 172.21.15.99:0/162898729 shutdown_connections 2024-09-10T07:41:15.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc3ec06be30 0x7fc3ec06e2f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc40c0d1010 0x7fc40c150e20 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc40c071df0 0x7fc40c15b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 --2- 172.21.15.99:0/162898729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc40c06e280 0x7fc40c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 -- 172.21.15.99:0/162898729 >> 172.21.15.99:0/162898729 conn(0x7fc40c06bc10 msgr2=0x7fc40c0b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:15.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 -- 172.21.15.99:0/162898729 shutdown_connections 2024-09-10T07:41:15.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.373+0000 7fc412c00640 1 -- 172.21.15.99:0/162898729 wait complete. 2024-09-10T07:41:15.388 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:41:15.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.540+0000 7fae18600640 1 Processor -- start 2024-09-10T07:41:15.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.540+0000 7fae18600640 1 -- start start 2024-09-10T07:41:15.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.542+0000 7fae18600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae10145290 0x7fae1006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.542+0000 7fae18600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1006e3d0 con 0x7fae100ce780 2024-09-10T07:41:15.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.542+0000 7fae18600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1006e6b0 con 0x7fae10072f40 2024-09-10T07:41:15.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.542+0000 7fae18600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fae1006efe0 con 0x7fae10145290 2024-09-10T07:41:15.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.542+0000 7fae15200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fae100ce780 0x7fae10072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45790/0 (socket says 172.21.15.99:45790) 2024-09-10T07:41:15.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.542+0000 7fae15200640 1 -- 172.21.15.99:0/3145229165 learned_addr learned my addr 172.21.15.99:0/3145229165 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:15.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.542+0000 7fae15c00640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae10145290 0x7fae1006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2930207637 0 0) 0x7fae1006e3d0 con 0x7fae100ce780 2024-09-10T07:41:15.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadf8005730 con 0x7fae100ce780 2024-09-10T07:41:15.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063801864 0 0) 0x7fae1006e6b0 con 0x7fae10072f40 2024-09-10T07:41:15.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae1006e3d0 con 0x7fae10072f40 2024-09-10T07:41:15.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3094314578 0 0) 0x7fadf8005730 con 0x7fae100ce780 2024-09-10T07:41:15.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae10145290 msgr2=0x7fae1006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:15.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae10145290 0x7fae1006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 >> v1:172.21.15.187:6789/0 conn(0x7fae10072f40 legacy=0x7fae100b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1006e990 con 0x7fae100ce780 2024-09-10T07:41:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fadfc001670 con 0x7fae100ce780 2024-09-10T07:41:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 >> v1:172.21.15.99:6789/0 conn(0x7fae100ce780 legacy=0x7fae10072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadf8005d80 0x7fadf8006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae10145290 0x7fadf8006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 0x7fadf80073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fae1006efe0 con 0x7fadf8006f50 2024-09-10T07:41:15.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fadf800dc80 con 0x7fadf8005d80 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fadf800de30 con 0x7fae10145290 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae16600640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 0x7fadf80073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae15c00640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadf8005d80 0x7fadf8006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.543+0000 7fae15200640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae10145290 0x7fadf8006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.544+0000 7fae16600640 1 -- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae10145290 msgr2=0x7fadf8006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.544+0000 7fae16600640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae10145290 0x7fadf8006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.544+0000 7fae16600640 1 -- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadf8005d80 msgr2=0x7fadf8006180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.544+0000 7fae16600640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadf8005d80 0x7fadf8006180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.544+0000 7fae16600640 1 -- 172.21.15.99:0/3145229165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf8005730 con 0x7fadf8006f50 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.545+0000 7fae16600640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 0x7fadf80073d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fae10160580 tx=0x7fadf8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650c37b2760a20fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.545+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08001bf0 con 0x7fadf8006f50 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.545+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae08003b70 con 0x7fadf8006f50 2024-09-10T07:41:15.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.545+0000 7fae0fe00640 1 -- 172.21.15.99:0/3145229165 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae080050d0 con 0x7fadf8006f50 2024-09-10T07:41:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.545+0000 7fae18600640 1 -- 172.21.15.99:0/3145229165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 msgr2=0x7fadf80073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.545+0000 7fae18600640 1 --2- 172.21.15.99:0/3145229165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 0x7fadf80073d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fae10160580 tx=0x7fadf8007a40 comp rx=0 tx=0).stop 2024-09-10T07:41:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.545+0000 7fae16600640 1 -- 172.21.15.99:0/3145229165 reap_dead start 2024-09-10T07:41:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.545+0000 7fae18600640 1 -- 172.21.15.99:0/3145229165 shutdown_connections 2024-09-10T07:41:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.545+0000 7fae18600640 1 -- 172.21.15.99:0/3145229165 >> 172.21.15.99:0/3145229165 conn(0x7fae1006bc10 msgr2=0x7fae1006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.545+0000 7fae18600640 1 -- 172.21.15.99:0/3145229165 shutdown_connections 2024-09-10T07:41:15.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.546+0000 7fae18600640 1 -- 172.21.15.99:0/3145229165 wait complete. 2024-09-10T07:41:15.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.547+0000 7fae18600640 1 Processor -- start 2024-09-10T07:41:15.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.547+0000 7fae18600640 1 -- start start 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.548+0000 7fae18600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 0x7fae100b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.548+0000 7fae18600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae1015a260 0x7fae1015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.548+0000 7fae18600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae1012bad0 0x7fae1012bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.548+0000 7fae18600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fae1006df80 con 0x7fadf8006f50 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.548+0000 7fae18600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fae10145670 con 0x7fae1015a260 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.548+0000 7fae18600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fae1006e100 con 0x7fae1012bad0 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.548+0000 7fae15c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 0x7fae100b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.548+0000 7fae15c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 0x7fae100b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42316/0 (socket says 172.21.15.99:42316) 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.548+0000 7fae15c00640 1 -- 172.21.15.99:0/612852712 learned_addr learned my addr 172.21.15.99:0/612852712 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae15c00640 1 -- 172.21.15.99:0/612852712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae1012bad0 msgr2=0x7fae1012bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae15200640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae1015a260 0x7fae1015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae16600640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae1012bad0 0x7fae1012bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae15c00640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae1012bad0 0x7fae1012bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae15c00640 1 -- 172.21.15.99:0/612852712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae1015a260 msgr2=0x7fae1015a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae15c00640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae1015a260 0x7fae1015a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae15c00640 1 -- 172.21.15.99:0/612852712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1015ac00 con 0x7fadf8006f50 2024-09-10T07:41:15.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae16600640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae1012bad0 0x7fae1012bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:15.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae15200640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae1015a260 0x7fae1015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:15.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae15c00640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 0x7fae100b46f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fae040119a0 tx=0x7fae04011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:15.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae0d600640 1 -- 172.21.15.99:0/612852712 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0400faf0 con 0x7fadf8006f50 2024-09-10T07:41:15.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae0d600640 1 -- 172.21.15.99:0/612852712 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0400fc90 con 0x7fadf8006f50 2024-09-10T07:41:15.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae0d600640 1 -- 172.21.15.99:0/612852712 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04014440 con 0x7fadf8006f50 2024-09-10T07:41:15.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae18600640 1 -- 172.21.15.99:0/612852712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1012c840 con 0x7fadf8006f50 2024-09-10T07:41:15.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.549+0000 7fae18600640 1 -- 172.21.15.99:0/612852712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1012ce00 con 0x7fadf8006f50 2024-09-10T07:41:15.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.550+0000 7fae18600640 1 -- 172.21.15.99:0/612852712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae100715a0 con 0x7fadf8006f50 2024-09-10T07:41:15.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.551+0000 7fae0d600640 1 -- 172.21.15.99:0/612852712 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae04012040 con 0x7fadf8006f50 2024-09-10T07:41:15.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.552+0000 7fae0d600640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fadf006be30 0x7fadf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:15.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.552+0000 7fae0d600640 1 -- 172.21.15.99:0/612852712 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7fae0408b600 con 0x7fadf8006f50 2024-09-10T07:41:15.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.552+0000 7fae15200640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fadf006be30 0x7fadf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:15.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.553+0000 7fae15200640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fadf006be30 0x7fadf006e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fadfc001050 tx=0x7fadfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:15.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.556+0000 7fae0d600640 1 -- 172.21.15.99:0/612852712 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae04019030 con 0x7fadf8006f50 2024-09-10T07:41:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.761+0000 7fae18600640 1 -- 172.21.15.99:0/612852712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae100cb1e0 con 0x7fadf8006f50 2024-09-10T07:41:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.762+0000 7fae0d600640 1 -- 172.21.15.99:0/612852712 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5225 (secure 0 0 0) 0x7fae04059f10 con 0x7fadf8006f50 2024-09-10T07:41:15.762 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:15.762 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":74,"btime":"2024-09-10T07:41:13:353969+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3366680210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3366680210},{"type":"v1","addr":"172.21.15.187:6835","nonce":3366680210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6712,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/919138741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":919138741},{"type":"v1","addr":"172.21.15.99:6836","nonce":919138741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/794540040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":794540040},{"type":"v1","addr":"172.21.15.187:6834","nonce":794540040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:41:09.738509+0000","modified":"2024-09-10T07:41:12.757588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/2751383266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":2751383266},{"type":"v1","addr":"172.21.15.99:6837","nonce":2751383266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7179,"qdb_cluster":[7179]},"id":9}]} 2024-09-10T07:41:15.762 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 74 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 -- 172.21.15.99:0/612852712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fadf006be30 msgr2=0x7fadf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fadf006be30 0x7fadf006e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fadfc001050 tx=0x7fadfc009040 comp rx=0 tx=0).stop 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 -- 172.21.15.99:0/612852712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 msgr2=0x7fae100b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 0x7fae100b46f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fae040119a0 tx=0x7fae04011e60 comp rx=0 tx=0).stop 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 -- 172.21.15.99:0/612852712 shutdown_connections 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae1012bad0 0x7fae1012bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae1015a260 0x7fae1015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fadf006be30 0x7fadf006e2f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 --2- 172.21.15.99:0/612852712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf8006f50 0x7fae100b46f0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 -- 172.21.15.99:0/612852712 >> 172.21.15.99:0/612852712 conn(0x7fae1006bc10 msgr2=0x7fae100ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 -- 172.21.15.99:0/612852712 shutdown_connections 2024-09-10T07:41:15.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:15.764+0000 7fae18600640 1 -- 172.21.15.99:0/612852712 wait complete. 2024-09-10T07:41:15.926 INFO:tasks.ceph.mds.c.smithi099.stderr:2024-09-10T07:41:15.926+0000 7f43ea400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:41:16.182 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:41:09.738509+0000', 'modified': '2024-09-10T07:41:12.757588+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7179}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7179': {'gid': 7179, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/2751383266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6835', 'nonce': 2751383266}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 2751383266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7179, 'qdb_cluster': [7179]} 2024-09-10T07:41:16.182 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:41:16.182 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T07:41:16.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.337+0000 7f88f7200640 1 Processor -- start 2024-09-10T07:41:16.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.337+0000 7f88f7200640 1 -- start start 2024-09-10T07:41:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.338+0000 7f88f7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f815ed10 0x7f88f80d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.338+0000 7f88f7200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88f80d51a0 0x7f88f80d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.338+0000 7f88f7200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88f80cf740 con 0x7f88f80d3070 2024-09-10T07:41:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.338+0000 7f88f7200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f88f80d5910 con 0x7f88f80d51a0 2024-09-10T07:41:16.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.338+0000 7f88f7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f88f80d5630 con 0x7f88f815ed10 2024-09-10T07:41:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.339+0000 7f88f5400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f815ed10 0x7f88f80d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.339+0000 7f88f5400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f815ed10 0x7f88f80d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:46772/0 (socket says 172.21.15.99:46772) 2024-09-10T07:41:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.339+0000 7f88f6800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88f80d51a0 0x7f88f80d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.339+0000 7f88f5e00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f88f80d3070 0x7f88f80d3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:49070/0 (socket says 172.21.15.99:49070) 2024-09-10T07:41:16.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.339+0000 7f88f5400640 1 -- 172.21.15.99:0/2122032873 learned_addr learned my addr 172.21.15.99:0/2122032873 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:16.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.339+0000 7f88f6800640 1 -- 172.21.15.99:0/2122032873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f815ed10 msgr2=0x7f88f80d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.339+0000 7f88f6800640 1 --2- 172.21.15.99:0/2122032873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f815ed10 0x7f88f80d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.339+0000 7f88f6800640 1 -- 172.21.15.99:0/2122032873 >> v1:172.21.15.187:6789/0 conn(0x7f88f80d3070 legacy=0x7f88f80d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.339+0000 7f88f6800640 1 -- 172.21.15.99:0/2122032873 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f80cf9e0 con 0x7f88f80d51a0 2024-09-10T07:41:16.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.340+0000 7f88f6800640 1 --2- 172.21.15.99:0/2122032873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f80d51a0 0x7f88f80d01e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f88f00097a0 tx=0x7f88f002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bf2ccc592fa4a9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.340+0000 7f88f4a00640 1 -- 172.21.15.99:0/2122032873 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0037070 con 0x7f88f80d51a0 2024-09-10T07:41:16.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.341+0000 7f88f4a00640 1 -- 172.21.15.99:0/2122032873 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f0032440 con 0x7f88f80d51a0 2024-09-10T07:41:16.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.341+0000 7f88f4a00640 1 -- 172.21.15.99:0/2122032873 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0032810 con 0x7f88f80d51a0 2024-09-10T07:41:16.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.341+0000 7f88f7200640 1 -- 172.21.15.99:0/2122032873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f80d51a0 msgr2=0x7f88f80d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.341+0000 7f88f7200640 1 --2- 172.21.15.99:0/2122032873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f80d51a0 0x7f88f80d01e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f88f00097a0 tx=0x7f88f002a210 comp rx=0 tx=0).stop 2024-09-10T07:41:16.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.341+0000 7f88f7200640 1 -- 172.21.15.99:0/2122032873 shutdown_connections 2024-09-10T07:41:16.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.341+0000 7f88f7200640 1 --2- 172.21.15.99:0/2122032873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f80d51a0 0x7f88f80d01e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.341+0000 7f88f7200640 1 --2- 172.21.15.99:0/2122032873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f815ed10 0x7f88f80d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.341+0000 7f88f7200640 1 -- 172.21.15.99:0/2122032873 >> 172.21.15.99:0/2122032873 conn(0x7f88f809dd60 msgr2=0x7f88f80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:16.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.341+0000 7f88f7200640 1 -- 172.21.15.99:0/2122032873 shutdown_connections 2024-09-10T07:41:16.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.341+0000 7f88f7200640 1 -- 172.21.15.99:0/2122032873 wait complete. 2024-09-10T07:41:16.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.343+0000 7f88f7200640 1 Processor -- start 2024-09-10T07:41:16.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.343+0000 7f88f7200640 1 -- start start 2024-09-10T07:41:16.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f80d3070 0x7f88f80c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88f815ed10 0x7f88f80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f7200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f80b9040 0x7f88f80b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f88f80d2d20 con 0x7f88f815ed10 2024-09-10T07:41:16.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f7200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f88f80d2ba0 con 0x7f88f80b9040 2024-09-10T07:41:16.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f88f80d0720 con 0x7f88f80d3070 2024-09-10T07:41:16.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88f815ed10 0x7f88f80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88f815ed10 0x7f88f80b8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42326/0 (socket says 172.21.15.99:42326) 2024-09-10T07:41:16.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f5400640 1 -- 172.21.15.99:0/810754952 learned_addr learned my addr 172.21.15.99:0/810754952 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f5e00640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f80d3070 0x7f88f80c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f6800640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f80b9040 0x7f88f80b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f5400640 1 -- 172.21.15.99:0/810754952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f80d3070 msgr2=0x7f88f80c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f5400640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f80d3070 0x7f88f80c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f5400640 1 -- 172.21.15.99:0/810754952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f80b9040 msgr2=0x7f88f80b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f5400640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f80b9040 0x7f88f80b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f5400640 1 -- 172.21.15.99:0/810754952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f80cb120 con 0x7f88f815ed10 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f6800640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f80b9040 0x7f88f80b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.344+0000 7f88f5e00640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f80d3070 0x7f88f80c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.345+0000 7f88f5400640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88f815ed10 0x7f88f80b8b00 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f88e000e870 tx=0x7f88e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.345+0000 7f88ee000640 1 -- 172.21.15.99:0/810754952 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0017070 con 0x7f88f815ed10 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.345+0000 7f88ee000640 1 -- 172.21.15.99:0/810754952 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e000c8e0 con 0x7f88f815ed10 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.345+0000 7f88f7200640 1 -- 172.21.15.99:0/810754952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f80b7a60 con 0x7f88f815ed10 2024-09-10T07:41:16.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.345+0000 7f88ee000640 1 -- 172.21.15.99:0/810754952 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e000ccd0 con 0x7f88f815ed10 2024-09-10T07:41:16.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.345+0000 7f88f7200640 1 -- 172.21.15.99:0/810754952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f80b8020 con 0x7f88f815ed10 2024-09-10T07:41:16.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.348+0000 7f88ee000640 1 -- 172.21.15.99:0/810754952 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88e001a070 con 0x7f88f815ed10 2024-09-10T07:41:16.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.349+0000 7f88ee000640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f88d406be30 0x7f88d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.349+0000 7f88ee000640 1 -- 172.21.15.99:0/810754952 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7f88e008ad70 con 0x7f88f815ed10 2024-09-10T07:41:16.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.349+0000 7f88f5e00640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f88d406be30 0x7f88d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.349+0000 7f88ffcab740 1 Processor -- start 2024-09-10T07:41:16.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.349+0000 7f88ffcab740 1 -- start start 2024-09-10T07:41:16.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.350+0000 7f88f5e00640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f88d406be30 0x7f88d406e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f88f80a29a0 tx=0x7f88e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.350+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160ab43640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.350+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafb660 0x56160aafe280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.350+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaff630 0x56160aaf8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.350+0000 7f88ffcab740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56160aa5c3b0 con 0x56160aafdea0 2024-09-10T07:41:16.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.350+0000 7f88ffcab740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56160aa61410 con 0x56160aafb660 2024-09-10T07:41:16.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.350+0000 7f88ffcab740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x56160aa09620 con 0x56160aaff630 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.350+0000 7f88f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160ab43640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160ab43640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42330/0 (socket says 172.21.15.99:42330) 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f5e00640 1 -- 172.21.15.99:0/1277483100 learned_addr learned my addr 172.21.15.99:0/1277483100 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f6800640 1 --2- 172.21.15.99:0/1277483100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaff630 0x56160aaf8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f5400640 1 --2- 172.21.15.99:0/1277483100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafb660 0x56160aafe280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f5e00640 1 -- 172.21.15.99:0/1277483100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaff630 msgr2=0x56160aaf8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f5e00640 1 --2- 172.21.15.99:0/1277483100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaff630 0x56160aaf8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f5e00640 1 -- 172.21.15.99:0/1277483100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafb660 msgr2=0x56160aafe280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f5e00640 1 --2- 172.21.15.99:0/1277483100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafb660 0x56160aafe280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f5e00640 1 -- 172.21.15.99:0/1277483100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56160a7742d0 con 0x56160aafdea0 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f5400640 1 --2- 172.21.15.99:0/1277483100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafb660 0x56160aafe280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88f5e00640 1 --2- 172.21.15.99:0/1277483100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160ab43640 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f88e8005fb0 tx=0x7f88e8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffd99d7250c8dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88e6a00640 1 -- 172.21.15.99:0/1277483100 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8004d60 con 0x56160aafdea0 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88e6a00640 1 -- 172.21.15.99:0/1277483100 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e8007650 con 0x56160aafdea0 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.351+0000 7f88e6a00640 1 -- 172.21.15.99:0/1277483100 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8007a00 con 0x56160aafdea0 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.352+0000 7f88ffcab740 1 -- 172.21.15.99:0/1277483100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 msgr2=0x56160ab43640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.352+0000 7f88ffcab740 1 --2- 172.21.15.99:0/1277483100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160ab43640 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f88e8005fb0 tx=0x7f88e8010000 comp rx=0 tx=0).stop 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.352+0000 7f88ffcab740 1 -- 172.21.15.99:0/1277483100 shutdown_connections 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.352+0000 7f88ffcab740 1 --2- 172.21.15.99:0/1277483100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaff630 0x56160aaf8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.352+0000 7f88ffcab740 1 --2- 172.21.15.99:0/1277483100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafb660 0x56160aafe280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.352+0000 7f88ffcab740 1 --2- 172.21.15.99:0/1277483100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160ab43640 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.352+0000 7f88ffcab740 1 -- 172.21.15.99:0/1277483100 >> 172.21.15.99:0/1277483100 conn(0x56160aafa8f0 msgr2=0x56160ab42b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.352+0000 7f88ffcab740 1 -- 172.21.15.99:0/1277483100 shutdown_connections 2024-09-10T07:41:16.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.352+0000 7f88ffcab740 1 -- 172.21.15.99:0/1277483100 wait complete. 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.353+0000 7f88ffcab740 1 -- start start 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.353+0000 7f88ffcab740 1 Processor -- start 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.354+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aafdea0 0x56160ab537f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.354+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 0x56160aaf8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.354+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaf9270 0x56160aafc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.354+0000 7f88ffcab740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56160aa1c780 con 0x56160aaf9270 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.354+0000 7f88ffcab740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56160aa5d3d0 con 0x56160aaff630 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.354+0000 7f88ffcab740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x56160aaf9d90 con 0x56160aafdea0 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.354+0000 7f88ffcab740 10 client.0 _ll_register_callbacks cb 0x56160aa5a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.354+0000 7f88f6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaf9270 0x56160aafc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.354+0000 7f88f6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaf9270 0x56160aafc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42336/0 (socket says 172.21.15.99:42336) 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.354+0000 7f88f6800640 1 -- 172.21.15.99:0/3856312291 learned_addr learned my addr 172.21.15.99:0/3856312291 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:16.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88f5400640 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 0x56160aaf8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88f5e00640 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aafdea0 0x56160ab537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88f6800640 1 -- 172.21.15.99:0/3856312291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aafdea0 msgr2=0x56160ab537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88f6800640 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aafdea0 0x56160ab537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88f6800640 1 -- 172.21.15.99:0/3856312291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 msgr2=0x56160aaf8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88f6800640 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 0x56160aaf8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88f6800640 1 -- 172.21.15.99:0/3856312291 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56160a83e6b0 con 0x56160aaf9270 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88f5400640 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 0x56160aaf8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88f5e00640 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aafdea0 0x56160ab537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88f6800640 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaf9270 0x56160aafc630 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f88f002a800 tx=0x7f88f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec03c89428bf7b02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88db400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88db400640 1 -- 172.21.15.99:0/3856312291 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0037040 con 0x56160aaf9270 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.355+0000 7f88ffcab740 1 -- 172.21.15.99:0/3856312291 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88e8007650 con 0x56160aaf9270 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88db400640 1 -- 172.21.15.99:0/3856312291 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7f88f0032a40 con 0x56160aaf9270 2024-09-10T07:41:16.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88db400640 1 -- 172.21.15.99:0/3856312291 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f88f004d050 con 0x56160aaf9270 2024-09-10T07:41:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88ffcab740 10 client.7302 fetch_fsmap learned FSMap version 74 2024-09-10T07:41:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88ffcab740 1 -- 172.21.15.99:0/3856312291 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x56160ab52f30 con 0x56160aaf9270 2024-09-10T07:41:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88db400640 1 -- 172.21.15.99:0/3856312291 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e8007650 con 0x56160aaf9270 2024-09-10T07:41:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88db400640 1 -- 172.21.15.99:0/3856312291 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7f88f0050020 con 0x56160aaf9270 2024-09-10T07:41:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88ffcab740 10 client.7302 fetch_fsmap finished waiting for FSMap version 74 2024-09-10T07:41:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88ffcab740 10 client.7302 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T07:41:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88ffcab740 20 client.7302 populate_metadata read hostname 'smithi099' 2024-09-10T07:41:16.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.99:6835/2751383266,v1:172.21.15.99:6837/2751383266] conn(0x56160aaf7a80 0x56160ab56b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88ffcab740 4 client.7302 mds_command: new command op to 7179 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.356+0000 7f88ffcab740 1 -- 172.21.15.99:0/3856312291 --> [v2:172.21.15.99:6835/2751383266,v1:172.21.15.99:6837/2751383266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56160aa6eb40 con 0x56160aaf7a80 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.357+0000 7f88f5e00640 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.99:6835/2751383266,v1:172.21.15.99:6837/2751383266] conn(0x56160aaf7a80 0x56160ab56b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.357+0000 7f88f5e00640 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.99:6835/2751383266,v1:172.21.15.99:6837/2751383266] conn(0x56160aaf7a80 0x56160ab56b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a518d5df6ebac79 server_cookie=baf4d93bd5f34c4e in_seq=0 out_seq=0 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.357+0000 7f88db400640 10 client.7302 ms_handle_connect on v2:172.21.15.99:6835/2751383266 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88db400640 1 -- 172.21.15.99:0/3856312291 <== mds.0 v2:172.21.15.99:6835/2751383266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56160aa6eb40 con 0x56160aaf7a80 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88db400640 10 client.7302 handle_command_reply: tid=0 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 client.7302 shutdown 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 -- 172.21.15.99:0/3856312291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaf9270 msgr2=0x56160aafc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaf9270 0x56160aafc630 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f88f002a800 tx=0x7f88f0004730 comp rx=0 tx=0).stop 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 -- 172.21.15.99:0/3856312291 shutdown_connections 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaf9270 0x56160aafc630 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 0x56160aaf8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.99:6835/2751383266,v1:172.21.15.99:6837/2751383266] conn(0x56160aaf7a80 0x56160ab56b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3856312291 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aafdea0 0x56160ab537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88db400640 0 client.7302 ms_handle_reset on v2:172.21.15.99:6835/2751383266 2024-09-10T07:41:16.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 -- 172.21.15.99:0/3856312291 >> 172.21.15.99:0/3856312291 conn(0x56160aafb660 msgr2=0x56160ab42050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:16.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 -- 172.21.15.99:0/3856312291 shutdown_connections 2024-09-10T07:41:16.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.358+0000 7f88ffcab740 1 -- 172.21.15.99:0/3856312291 wait complete. 2024-09-10T07:41:16.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.359+0000 7f88ffcab740 20 client.7302 trim_cache size 0 max 16384 2024-09-10T07:41:16.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.377+0000 7f88ffcab740 1 Processor -- start 2024-09-10T07:41:16.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.378+0000 7f88ffcab740 1 -- start start 2024-09-10T07:41:16.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.378+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaf9270 0x56160aafbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.378+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafdea0 0x56160aaf3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.378+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaff630 0x56160ab66f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.378+0000 7f88ffcab740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f88f82001e0 con 0x56160aaff630 2024-09-10T07:41:16.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.378+0000 7f88ffcab740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f88f80caa00 con 0x56160aafdea0 2024-09-10T07:41:16.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.378+0000 7f88ffcab740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f88f81ffb90 con 0x56160aaf9270 2024-09-10T07:41:16.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaff630 0x56160ab66f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaff630 0x56160ab66f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42352/0 (socket says 172.21.15.99:42352) 2024-09-10T07:41:16.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f6800640 1 -- 172.21.15.99:0/125537318 learned_addr learned my addr 172.21.15.99:0/125537318 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:16.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f5e00640 1 --2- 172.21.15.99:0/125537318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaf9270 0x56160aafbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f5400640 1 --2- 172.21.15.99:0/125537318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafdea0 0x56160aaf3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f6800640 1 -- 172.21.15.99:0/125537318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaf9270 msgr2=0x56160aafbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f6800640 1 --2- 172.21.15.99:0/125537318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaf9270 0x56160aafbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f6800640 1 -- 172.21.15.99:0/125537318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafdea0 msgr2=0x56160aaf3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f6800640 1 --2- 172.21.15.99:0/125537318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafdea0 0x56160aaf3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f6800640 1 -- 172.21.15.99:0/125537318 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56160ab53360 con 0x56160aaff630 2024-09-10T07:41:16.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.379+0000 7f88f6800640 1 --2- 172.21.15.99:0/125537318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaff630 0x56160ab66f20 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f88f0032d10 tx=0x7f88f003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3056c9c562571879 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88e6000640 1 -- 172.21.15.99:0/125537318 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0037070 con 0x56160aaff630 2024-09-10T07:41:16.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88e6000640 1 -- 172.21.15.99:0/125537318 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f0032a40 con 0x56160aaff630 2024-09-10T07:41:16.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88e6000640 1 -- 172.21.15.99:0/125537318 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0004250 con 0x56160aaff630 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88ffcab740 1 -- 172.21.15.99:0/125537318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaff630 msgr2=0x56160ab66f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88ffcab740 1 --2- 172.21.15.99:0/125537318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaff630 0x56160ab66f20 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f88f0032d10 tx=0x7f88f003e000 comp rx=0 tx=0).stop 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88ffcab740 1 -- 172.21.15.99:0/125537318 shutdown_connections 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88ffcab740 1 --2- 172.21.15.99:0/125537318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aaff630 0x56160ab66f20 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88ffcab740 1 --2- 172.21.15.99:0/125537318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aafdea0 0x56160aaf3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88ffcab740 1 --2- 172.21.15.99:0/125537318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaf9270 0x56160aafbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88ffcab740 1 -- 172.21.15.99:0/125537318 >> 172.21.15.99:0/125537318 conn(0x56160aafb660 msgr2=0x56160ab41020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88ffcab740 1 -- 172.21.15.99:0/125537318 shutdown_connections 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.380+0000 7f88ffcab740 1 -- 172.21.15.99:0/125537318 wait complete. 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.381+0000 7f88ffcab740 1 -- start start 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.381+0000 7f88ffcab740 1 Processor -- start 2024-09-10T07:41:16.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaf9270 0x56160abc1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160aba95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88ffcab740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 0x56160ab3bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88ffcab740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56160aaf7900 con 0x56160aafdea0 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88ffcab740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56160ab1dd00 con 0x56160aaff630 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88ffcab740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x56160aaf7f50 con 0x56160aaf9270 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88ffcab740 10 client.0 _ll_register_callbacks cb 0x7f88e00090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160aba95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160aba95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42368/0 (socket says 172.21.15.99:42368) 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88f5400640 1 -- 172.21.15.99:0/3944634832 learned_addr learned my addr 172.21.15.99:0/3944634832 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.382+0000 7f88f5e00640 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaf9270 0x56160abc1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88f6800640 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 0x56160ab3bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88f5400640 1 -- 172.21.15.99:0/3944634832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaf9270 msgr2=0x56160abc1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88f5400640 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaf9270 0x56160abc1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88f5400640 1 -- 172.21.15.99:0/3944634832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 msgr2=0x56160ab3bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88f5400640 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 0x56160ab3bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88f5400640 1 -- 172.21.15.99:0/3944634832 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56160aafc910 con 0x56160aafdea0 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88f5400640 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160aba95c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f88e0000c00 tx=0x7f88e00591e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4f31596128e343 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88db400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88db400640 1 -- 172.21.15.99:0/3944634832 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0021040 con 0x56160aafdea0 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88db400640 1 -- 172.21.15.99:0/3944634832 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7f88e0058720 con 0x56160aafdea0 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88ffcab740 1 -- 172.21.15.99:0/3944634832 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88f0032a40 con 0x56160aafdea0 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.383+0000 7f88db400640 1 -- 172.21.15.99:0/3944634832 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f88e0057490 con 0x56160aafdea0 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88ffcab740 10 client.7308 fetch_fsmap learned FSMap version 74 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88ffcab740 1 -- 172.21.15.99:0/3944634832 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x56160aba9b00 con 0x56160aafdea0 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88db400640 1 -- 172.21.15.99:0/3944634832 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f0032a40 con 0x56160aafdea0 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88db400640 1 -- 172.21.15.99:0/3944634832 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7f88e0024060 con 0x56160aafdea0 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88ffcab740 10 client.7308 fetch_fsmap finished waiting for FSMap version 74 2024-09-10T07:41:16.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88ffcab740 10 client.7308 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88ffcab740 20 client.7308 populate_metadata read hostname 'smithi099' 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.99:6835/2751383266,v1:172.21.15.99:6837/2751383266] conn(0x56160ab211e0 0x56160ab215c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88ffcab740 4 client.7308 mds_command: new command op to 7179 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88ffcab740 1 -- 172.21.15.99:0/3944634832 --> [v2:172.21.15.99:6835/2751383266,v1:172.21.15.99:6837/2751383266] -- command(tid 0: {"prefix": "status"}) -- 0x56160ab26d70 con 0x56160ab211e0 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.384+0000 7f88f5e00640 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.99:6835/2751383266,v1:172.21.15.99:6837/2751383266] conn(0x56160ab211e0 0x56160ab215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88f5e00640 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.99:6835/2751383266,v1:172.21.15.99:6837/2751383266] conn(0x56160ab211e0 0x56160ab215c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24d45cc050d9b893 server_cookie=d58710aed697cb1a in_seq=0 out_seq=0 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88db400640 10 client.7308 ms_handle_connect on v2:172.21.15.99:6835/2751383266 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88db400640 1 -- 172.21.15.99:0/3944634832 <== mds.0 v2:172.21.15.99:6835/2751383266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56160ab26d70 con 0x56160ab211e0 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88db400640 10 client.7308 handle_command_reply: tid=0 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 client.7308 shutdown 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 -- 172.21.15.99:0/3944634832 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 msgr2=0x56160aba95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160aba95c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f88e0000c00 tx=0x7f88e00591e0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 -- 172.21.15.99:0/3944634832 shutdown_connections 2024-09-10T07:41:16.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56160aaff630 0x56160ab3bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56160aafdea0 0x56160aba95c0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.99:6835/2751383266,v1:172.21.15.99:6837/2751383266] conn(0x56160ab211e0 0x56160ab215c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 --2- 172.21.15.99:0/3944634832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56160aaf9270 0x56160abc1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 -- 172.21.15.99:0/3944634832 >> 172.21.15.99:0/3944634832 conn(0x56160aafb660 msgr2=0x56160aaf3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:16.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88db400640 0 client.7308 ms_handle_reset on v2:172.21.15.99:6835/2751383266 2024-09-10T07:41:16.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 -- 172.21.15.99:0/3944634832 shutdown_connections 2024-09-10T07:41:16.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 1 -- 172.21.15.99:0/3944634832 wait complete. 2024-09-10T07:41:16.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.385+0000 7f88ffcab740 20 client.7308 trim_cache size 0 max 16384 2024-09-10T07:41:16.390 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 7179, 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 6.0574419600000002, 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 74, 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 155, 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 155, 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 11.125748266 2024-09-10T07:41:16.391 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:41:16.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 -- 172.21.15.99:0/810754952 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f88d406be30 msgr2=0x7f88d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f88d406be30 0x7f88d406e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f88f80a29a0 tx=0x7f88e8009040 comp rx=0 tx=0).stop 2024-09-10T07:41:16.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 -- 172.21.15.99:0/810754952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88f815ed10 msgr2=0x7f88f80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88f815ed10 0x7f88f80b8b00 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f88e000e870 tx=0x7f88e000ed30 comp rx=0 tx=0).stop 2024-09-10T07:41:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 -- 172.21.15.99:0/810754952 shutdown_connections 2024-09-10T07:41:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88f80b9040 0x7f88f80b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f88d406be30 0x7f88d406e2f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88f815ed10 0x7f88f80b8b00 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 --2- 172.21.15.99:0/810754952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88f80d3070 0x7f88f80c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 -- 172.21.15.99:0/810754952 >> 172.21.15.99:0/810754952 conn(0x7f88f809dd60 msgr2=0x7f88f80b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 -- 172.21.15.99:0/810754952 shutdown_connections 2024-09-10T07:41:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.386+0000 7f88f7200640 1 -- 172.21.15.99:0/810754952 wait complete. 2024-09-10T07:41:16.401 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:41:16.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.554+0000 7fdbe2400640 1 Processor -- start 2024-09-10T07:41:16.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.554+0000 7fdbe2400640 1 -- start start 2024-09-10T07:41:16.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbe2400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc145290 0x7fdbdc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbe2400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdbdc0ce780 0x7fdbdc072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbe2400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdbdc071510 0x7fdbdc072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbe2400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fdbdc06efe0 con 0x7fdbdc0ce780 2024-09-10T07:41:16.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbe2400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fdbdc06e3d0 con 0x7fdbdc071510 2024-09-10T07:41:16.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbe2400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdbdc06e6b0 con 0x7fdbdc145290 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbd2a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdbdc0ce780 0x7fdbdc072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbd2a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdbdc0ce780 0x7fdbdc072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42370/0 (socket says 172.21.15.99:42370) 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbd2a00640 1 -- 172.21.15.99:0/3611284452 learned_addr learned my addr 172.21.15.99:0/3611284452 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbdb400640 1 --2- 172.21.15.99:0/3611284452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc145290 0x7fdbdc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbdbe00640 1 --2- 172.21.15.99:0/3611284452 >> v2:172.21.15.187:3300/0 conn(0x7fdbdc071510 0x7fdbdc072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbd2a00640 1 -- 172.21.15.99:0/3611284452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc145290 msgr2=0x7fdbdc06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbd2a00640 1 --2- 172.21.15.99:0/3611284452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc145290 0x7fdbdc06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbd2a00640 1 -- 172.21.15.99:0/3611284452 >> v2:172.21.15.187:3300/0 conn(0x7fdbdc071510 msgr2=0x7fdbdc072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbd2a00640 1 --2- 172.21.15.99:0/3611284452 >> v2:172.21.15.187:3300/0 conn(0x7fdbdc071510 0x7fdbdc072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbd2a00640 1 -- 172.21.15.99:0/3611284452 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc06e990 con 0x7fdbdc0ce780 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbdb400640 1 --2- 172.21.15.99:0/3611284452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc145290 0x7fdbdc06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.556+0000 7fdbdbe00640 1 --2- 172.21.15.99:0/3611284452 >> v2:172.21.15.187:3300/0 conn(0x7fdbdc071510 0x7fdbdc072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.557+0000 7fdbd2a00640 1 --2- 172.21.15.99:0/3611284452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc0ce780 0x7fdbdc072830 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0714a0 tx=0x7fdbc402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921408ad7a3dac09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbdaa00640 1 -- 172.21.15.99:0/3611284452 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4037070 con 0x7fdbdc0ce780 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbdaa00640 1 -- 172.21.15.99:0/3611284452 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc4032440 con 0x7fdbdc0ce780 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbdaa00640 1 -- 172.21.15.99:0/3611284452 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4032810 con 0x7fdbdc0ce780 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbe2400640 1 -- 172.21.15.99:0/3611284452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc0ce780 msgr2=0x7fdbdc072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbe2400640 1 --2- 172.21.15.99:0/3611284452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc0ce780 0x7fdbdc072830 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0714a0 tx=0x7fdbc402a1e0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbe2400640 1 -- 172.21.15.99:0/3611284452 shutdown_connections 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbe2400640 1 --2- 172.21.15.99:0/3611284452 >> v2:172.21.15.187:3300/0 conn(0x7fdbdc071510 0x7fdbdc072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbe2400640 1 --2- 172.21.15.99:0/3611284452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc0ce780 0x7fdbdc072830 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbe2400640 1 --2- 172.21.15.99:0/3611284452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc145290 0x7fdbdc06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbe2400640 1 -- 172.21.15.99:0/3611284452 >> 172.21.15.99:0/3611284452 conn(0x7fdbdc06bc10 msgr2=0x7fdbdc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbe2400640 1 -- 172.21.15.99:0/3611284452 shutdown_connections 2024-09-10T07:41:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.558+0000 7fdbe2400640 1 -- 172.21.15.99:0/3611284452 wait complete. 2024-09-10T07:41:16.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.560+0000 7fdbe2400640 1 Processor -- start 2024-09-10T07:41:16.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.560+0000 7fdbe2400640 1 -- start start 2024-09-10T07:41:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbe2400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc071510 0x7fdbdc138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbe2400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc0ce780 0x7fdbdc158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbe2400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbdc145290 0x7fdbdc168100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbe2400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc06df80 con 0x7fdbdc071510 2024-09-10T07:41:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbe2400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc145670 con 0x7fdbdc145290 2024-09-10T07:41:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbe2400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdbdc06e100 con 0x7fdbdc0ce780 2024-09-10T07:41:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbdb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc071510 0x7fdbdc138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbdb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc071510 0x7fdbdc138100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42380/0 (socket says 172.21.15.99:42380) 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbdb400640 1 -- 172.21.15.99:0/1866061762 learned_addr learned my addr 172.21.15.99:0/1866061762 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbd2a00640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc0ce780 0x7fdbdc158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbdbe00640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbdc145290 0x7fdbdc168100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbdb400640 1 -- 172.21.15.99:0/1866061762 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc0ce780 msgr2=0x7fdbdc158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbdb400640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc0ce780 0x7fdbdc158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbdb400640 1 -- 172.21.15.99:0/1866061762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbdc145290 msgr2=0x7fdbdc168100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbdb400640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbdc145290 0x7fdbdc168100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbdb400640 1 -- 172.21.15.99:0/1866061762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc15bb00 con 0x7fdbdc071510 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.561+0000 7fdbdbe00640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbdc145290 0x7fdbdc168100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.562+0000 7fdbdb400640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc071510 0x7fdbdc138100 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00e730 tx=0x7fdbcc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.562+0000 7fdbd3e00640 1 -- 172.21.15.99:0/1866061762 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc00f040 con 0x7fdbdc071510 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.562+0000 7fdbd3e00640 1 -- 172.21.15.99:0/1866061762 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbcc004230 con 0x7fdbdc071510 2024-09-10T07:41:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.562+0000 7fdbd3e00640 1 -- 172.21.15.99:0/1866061762 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc00ee40 con 0x7fdbdc071510 2024-09-10T07:41:16.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.562+0000 7fdbe2400640 1 -- 172.21.15.99:0/1866061762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbdc168640 con 0x7fdbdc071510 2024-09-10T07:41:16.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.562+0000 7fdbe2400640 1 -- 172.21.15.99:0/1866061762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbdc137620 con 0x7fdbdc071510 2024-09-10T07:41:16.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.563+0000 7fdbe2400640 1 -- 172.21.15.99:0/1866061762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbdc06f470 con 0x7fdbdc071510 2024-09-10T07:41:16.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.564+0000 7fdbd3e00640 1 -- 172.21.15.99:0/1866061762 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdbcc00c6d0 con 0x7fdbdc071510 2024-09-10T07:41:16.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.565+0000 7fdbd3e00640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbb806be30 0x7fdbb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:16.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.565+0000 7fdbd3e00640 1 -- 172.21.15.99:0/1866061762 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7fdbcc08aa40 con 0x7fdbdc071510 2024-09-10T07:41:16.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.565+0000 7fdbd2a00640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbb806be30 0x7fdbb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:16.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.566+0000 7fdbd2a00640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbb806be30 0x7fdbb806e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4034000 tx=0x7fdbc402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:16.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.569+0000 7fdbd3e00640 1 -- 172.21.15.99:0/1866061762 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbcc017020 con 0x7fdbdc071510 2024-09-10T07:41:16.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.775+0000 7fdbe2400640 1 -- 172.21.15.99:0/1866061762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdbdc15ee20 con 0x7fdbdc071510 2024-09-10T07:41:16.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.776+0000 7fdbd3e00640 1 -- 172.21.15.99:0/1866061762 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) ==== 53+0+73 (secure 0 0 0) 0x7fdbcc058e30 con 0x7fdbdc071510 2024-09-10T07:41:16.776 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:41:16.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 -- 172.21.15.99:0/1866061762 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbb806be30 msgr2=0x7fdbb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbb806be30 0x7fdbb806e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4034000 tx=0x7fdbc402e000 comp rx=0 tx=0).stop 2024-09-10T07:41:16.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 -- 172.21.15.99:0/1866061762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc071510 msgr2=0x7fdbdc138100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:16.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc071510 0x7fdbdc138100 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00e730 tx=0x7fdbcc00ebf0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 -- 172.21.15.99:0/1866061762 shutdown_connections 2024-09-10T07:41:16.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbdc145290 0x7fdbdc168100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbdc0ce780 0x7fdbdc158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbb806be30 0x7fdbb806e2f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 --2- 172.21.15.99:0/1866061762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbdc071510 0x7fdbdc138100 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:16.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 -- 172.21.15.99:0/1866061762 >> 172.21.15.99:0/1866061762 conn(0x7fdbdc06bc10 msgr2=0x7fdbdc0cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:16.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 -- 172.21.15.99:0/1866061762 shutdown_connections 2024-09-10T07:41:16.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:16.778+0000 7fdbe2400640 1 -- 172.21.15.99:0/1866061762 wait complete. 2024-09-10T07:41:16.794 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:41:16.794 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:41:16.794 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:41:16.794 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:41:16.795 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:41:16.795 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:41:16.795 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:41:16.795 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:41:16.795 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:41:16.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:16.795 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:41:16.831 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:41:16.831 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:41:16.832 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42351sec preferred_lft 42351sec 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:41:16.833 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:16.834 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:41:16.834 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:41:16.834 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link 2024-09-10T07:41:16.834 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:16.834 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:41:16.834 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:41:16.834 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::1c1f:52ff:fe95:9fbe/64 scope link 2024-09-10T07:41:16.834 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:16.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:16.834 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:41:16.925 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:41:16.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:16.928 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:41:16.964 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:41:16.965 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:41:16.965 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:41:16.965 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:41:16.965 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:41:16.965 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:41:16.965 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:41:16.965 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:41:16.966 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:41:16.966 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:41:16.966 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:41:17.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:41:17.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:41:17.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:17.161 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:41:17.197 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:41:17.197 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:41:17.197 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:41:17.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:17.197 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:41:17.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:41:17.295 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:41:17.330 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:41:17.331 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:41:17.331 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:41:17.406 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:41:17.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:17.406 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:41:17.512 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:41:17.516 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:41:17.534 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:41:17.534 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:41:17.562 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:41:17.563 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:41:17.563 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:41:17.563 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:41:17.563 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:41:17.564 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:41:17.564 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:41:17.564 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:41:17.564 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:41:17.564 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:41:17.569 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:41:17.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:17.569 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:41:17.698 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:41:17.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:41:17.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:41:17.793 INFO:teuthology.orchestra.run.smithi099.stdout:client6826 2024-09-10T07:41:17.793 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:41:17.793 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:41:17.829 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:41:18.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.023+0000 7f594fa00640 1 Processor -- start 2024-09-10T07:41:18.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.024+0000 7f594fa00640 1 -- start start 2024-09-10T07:41:18.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.025+0000 7f594fa00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5948145290 0x7f594806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:18.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.025+0000 7f594fa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5948072f40 0x7f59480b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:18.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.025+0000 7f594fa00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594806e3d0 con 0x7f59480ce780 2024-09-10T07:41:18.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.025+0000 7f594fa00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f594806efe0 con 0x7f5948072f40 2024-09-10T07:41:18.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.025+0000 7f594fa00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f594806e6b0 con 0x7f5948145290 2024-09-10T07:41:18.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.025+0000 7f5947e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f59480ce780 0x7f5948072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45804/0 (socket says 172.21.15.99:45804) 2024-09-10T07:41:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.025+0000 7f5947e00640 1 -- 172.21.15.99:0/340950836 learned_addr learned my addr 172.21.15.99:0/340950836 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.025+0000 7f594da00640 1 --2- 172.21.15.99:0/340950836 >> v2:172.21.15.99:3300/0 conn(0x7f5948072f40 0x7f59480b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.025+0000 7f594d000640 1 --2- 172.21.15.99:0/340950836 >> v2:172.21.15.187:3300/0 conn(0x7f5948145290 0x7f594806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.026+0000 7f594da00640 1 -- 172.21.15.99:0/340950836 >> v2:172.21.15.187:3300/0 conn(0x7f5948145290 msgr2=0x7f594806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:41:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.026+0000 7f594da00640 1 --2- 172.21.15.99:0/340950836 >> v2:172.21.15.187:3300/0 conn(0x7f5948145290 0x7f594806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.026+0000 7f594da00640 1 -- 172.21.15.99:0/340950836 >> v1:172.21.15.99:6789/0 conn(0x7f59480ce780 legacy=0x7f5948072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.026+0000 7f594da00640 1 -- 172.21.15.99:0/340950836 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594806e990 con 0x7f5948072f40 2024-09-10T07:41:18.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.026+0000 7f5947400640 1 -- 172.21.15.99:0/340950836 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766143649 0 0) 0x7f594806e3d0 con 0x7f59480ce780 2024-09-10T07:41:18.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f594da00640 1 --2- 172.21.15.99:0/340950836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5948072f40 0x7f59480b3930 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5948075940 tx=0x7f594002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0b42f97c89d9c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:18.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f5947400640 1 -- 172.21.15.99:0/340950836 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5940007740 con 0x7f5948072f40 2024-09-10T07:41:18.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f5947400640 1 -- 172.21.15.99:0/340950836 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59400078e0 con 0x7f5948072f40 2024-09-10T07:41:18.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f5947400640 1 -- 172.21.15.99:0/340950836 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5940007cb0 con 0x7f5948072f40 2024-09-10T07:41:18.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f594fa00640 1 -- 172.21.15.99:0/340950836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5948072f40 msgr2=0x7f59480b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f594fa00640 1 --2- 172.21.15.99:0/340950836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5948072f40 0x7f59480b3930 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5948075940 tx=0x7f594002a680 comp rx=0 tx=0).stop 2024-09-10T07:41:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f594fa00640 1 -- 172.21.15.99:0/340950836 shutdown_connections 2024-09-10T07:41:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f594fa00640 1 --2- 172.21.15.99:0/340950836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5948072f40 0x7f59480b3930 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f594fa00640 1 --2- 172.21.15.99:0/340950836 >> v2:172.21.15.187:3300/0 conn(0x7f5948145290 0x7f594806f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f594fa00640 1 -- 172.21.15.99:0/340950836 >> 172.21.15.99:0/340950836 conn(0x7f594806bc10 msgr2=0x7f594806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f594fa00640 1 -- 172.21.15.99:0/340950836 shutdown_connections 2024-09-10T07:41:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.027+0000 7f594fa00640 1 -- 172.21.15.99:0/340950836 wait complete. 2024-09-10T07:41:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.029+0000 7f594fa00640 1 Processor -- start 2024-09-10T07:41:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.029+0000 7f594fa00640 1 -- start start 2024-09-10T07:41:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.030+0000 7f594fa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5948072f40 0x7f59481446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.030+0000 7f594fa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59480ce780 0x7f594815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.030+0000 7f594fa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5948145290 0x7f59481e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.030+0000 7f594fa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f594806df80 con 0x7f59480ce780 2024-09-10T07:41:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.030+0000 7f594fa00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5948145670 con 0x7f5948072f40 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.030+0000 7f594fa00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f594806e100 con 0x7f5948145290 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.030+0000 7f5947e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59480ce780 0x7f594815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5947e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59480ce780 0x7f594815da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42404/0 (socket says 172.21.15.99:42404) 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5947e00640 1 -- 172.21.15.99:0/417007913 learned_addr learned my addr 172.21.15.99:0/417007913 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f594d000640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5948072f40 0x7f59481446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f594da00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5948145290 0x7f59481e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5947e00640 1 -- 172.21.15.99:0/417007913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5948145290 msgr2=0x7f59481e3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5947e00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5948145290 0x7f59481e3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5947e00640 1 -- 172.21.15.99:0/417007913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5948072f40 msgr2=0x7f59481446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5947e00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5948072f40 0x7f59481446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5947e00640 1 -- 172.21.15.99:0/417007913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594815e430 con 0x7f59480ce780 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5947e00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59480ce780 0x7f594815da00 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f593400c4b0 tx=0x7f593400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5944c00640 1 -- 172.21.15.99:0/417007913 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934018070 con 0x7f59480ce780 2024-09-10T07:41:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5944c00640 1 -- 172.21.15.99:0/417007913 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5934007500 con 0x7f59480ce780 2024-09-10T07:41:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.031+0000 7f5944c00640 1 -- 172.21.15.99:0/417007913 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934004a20 con 0x7f59480ce780 2024-09-10T07:41:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.032+0000 7f594fa00640 1 -- 172.21.15.99:0/417007913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594815e710 con 0x7f59480ce780 2024-09-10T07:41:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.032+0000 7f594fa00640 1 -- 172.21.15.99:0/417007913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594812f0e0 con 0x7f59480ce780 2024-09-10T07:41:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.033+0000 7f594fa00640 1 -- 172.21.15.99:0/417007913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5948071510 con 0x7f59480ce780 2024-09-10T07:41:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.033+0000 7f5944c00640 1 -- 172.21.15.99:0/417007913 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5934004bc0 con 0x7f59480ce780 2024-09-10T07:41:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.034+0000 7f5944c00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f592806be30 0x7f592806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.034+0000 7f5944c00640 1 -- 172.21.15.99:0/417007913 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7f593408a0f0 con 0x7f59480ce780 2024-09-10T07:41:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.035+0000 7f594d000640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f592806be30 0x7f592806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.035+0000 7f594d000640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f592806be30 0x7f592806e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f593c0079a0 tx=0x7f593c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:18.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.039+0000 7f5944c00640 1 -- 172.21.15.99:0/417007913 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5934058470 con 0x7f59480ce780 2024-09-10T07:41:18.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.246+0000 7f594fa00640 1 -- 172.21.15.99:0/417007913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f594815e8e0 con 0x7f59480ce780 2024-09-10T07:41:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.246+0000 7f5944c00640 1 -- 172.21.15.99:0/417007913 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) ==== 53+0+73 (secure 0 0 0) 0x7f593405c770 con 0x7f59480ce780 2024-09-10T07:41:18.246 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:41:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 -- 172.21.15.99:0/417007913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f592806be30 msgr2=0x7f592806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f592806be30 0x7f592806e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f593c0079a0 tx=0x7f593c008040 comp rx=0 tx=0).stop 2024-09-10T07:41:18.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 -- 172.21.15.99:0/417007913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59480ce780 msgr2=0x7f594815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59480ce780 0x7f594815da00 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f593400c4b0 tx=0x7f593400c970 comp rx=0 tx=0).stop 2024-09-10T07:41:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 -- 172.21.15.99:0/417007913 shutdown_connections 2024-09-10T07:41:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5948145290 0x7f59481e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f592806be30 0x7f592806e2f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59480ce780 0x7f594815da00 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 --2- 172.21.15.99:0/417007913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5948072f40 0x7f59481446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 -- 172.21.15.99:0/417007913 >> 172.21.15.99:0/417007913 conn(0x7f594806bc10 msgr2=0x7f59480b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 -- 172.21.15.99:0/417007913 shutdown_connections 2024-09-10T07:41:18.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:18.248+0000 7f594fa00640 1 -- 172.21.15.99:0/417007913 wait complete. 2024-09-10T07:41:18.265 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:41:18.265 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:41:18.265 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:41:18.265 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:41:18.265 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:41:18.265 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:41:18.265 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:41:18.265 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:41:18.265 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:41:18.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:18.266 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:41:18.306 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:41:18.306 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:41:18.306 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:41:18.306 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:41:18.307 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42346sec preferred_lft 42346sec 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:41:18.308 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:18.309 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:41:18.309 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:41:18.309 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::84a0:e5ff:fe75:1d2e/64 scope link 2024-09-10T07:41:18.309 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:41:18.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:18.309 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:41:18.404 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:41:18.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:18.407 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:41:18.445 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:41:18.445 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:41:18.445 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:41:18.445 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:41:18.445 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:41:18.445 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:41:18.445 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:41:18.445 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:41:18.445 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:41:18.446 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:41:18.446 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:41:18.563 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:41:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:41:18.633 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:41:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:41:18.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:18.641 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:41:18.676 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:41:18.677 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:41:18.677 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:41:18.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:18.677 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:41:18.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:41:18.773 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:41:18.808 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:41:18.808 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:41:18.808 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:41:18.883 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:41:18.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:18.884 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:41:19.013 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:41:19.013 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:41:19.041 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:41:19.041 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:41:19.041 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:41:19.041 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:41:19.041 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:41:19.043 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:41:19.043 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:41:19.043 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:41:19.043 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:41:19.044 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:41:19.046 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:41:19.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:41:19.046 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:41:19.102 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:41:19.180 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:41:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:41:19.183 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:41:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:41:19.191 INFO:teuthology.orchestra.run.smithi187.stdout:client7326 2024-09-10T07:41:19.191 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:41:19.191 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:41:19.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:41:19.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.385+0000 7effbce00640 1 Processor -- start 2024-09-10T07:41:19.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.386+0000 7effbce00640 1 -- start start 2024-09-10T07:41:19.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.387+0000 7effbce00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80c9710 0x7effb81695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:19.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.387+0000 7effbce00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb80d2bd0 con 0x7effb815e970 2024-09-10T07:41:19.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.387+0000 7effbce00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb80d2eb0 con 0x7effb80d2680 2024-09-10T07:41:19.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.387+0000 7effbce00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7effb80d37e0 con 0x7effb80c9710 2024-09-10T07:41:19.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.387+0000 7effb7400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7effb815e970 0x7effb80d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:45812/0 (socket says 172.21.15.99:45812) 2024-09-10T07:41:19.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.387+0000 7effb7400640 1 -- 172.21.15.99:0/2254221238 learned_addr learned my addr 172.21.15.99:0/2254221238 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:19.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.387+0000 7effb7e00640 1 --2- 172.21.15.99:0/2254221238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80c9710 0x7effb81695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:19.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.387+0000 7effb6a00640 1 -- 172.21.15.99:0/2254221238 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111441136 0 0) 0x7effb80d2bd0 con 0x7effb815e970 2024-09-10T07:41:19.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.388+0000 7effb6a00640 1 -- 172.21.15.99:0/2254221238 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff9c003520 con 0x7effb815e970 2024-09-10T07:41:19.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.388+0000 7effb6a00640 1 -- 172.21.15.99:0/2254221238 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183432417 0 0) 0x7effb80d2eb0 con 0x7effb80d2680 2024-09-10T07:41:19.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.388+0000 7effb7e00640 1 -- 172.21.15.99:0/2254221238 >> v1:172.21.15.187:6789/0 conn(0x7effb80d2680 legacy=0x7effb80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.388+0000 7effb7e00640 1 -- 172.21.15.99:0/2254221238 >> v1:172.21.15.99:6789/0 conn(0x7effb815e970 legacy=0x7effb80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.388+0000 7effb7e00640 1 -- 172.21.15.99:0/2254221238 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb80d3190 con 0x7effb80c9710 2024-09-10T07:41:19.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.389+0000 7effb7e00640 1 --2- 172.21.15.99:0/2254221238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80c9710 0x7effb81695e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7effb0009dc0 tx=0x7effb002a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=980761cfb9346c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:19.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.389+0000 7effb6a00640 1 -- 172.21.15.99:0/2254221238 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0007740 con 0x7effb80c9710 2024-09-10T07:41:19.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.389+0000 7effb6a00640 1 -- 172.21.15.99:0/2254221238 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb00078e0 con 0x7effb80c9710 2024-09-10T07:41:19.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.389+0000 7effb6a00640 1 -- 172.21.15.99:0/2254221238 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0007cb0 con 0x7effb80c9710 2024-09-10T07:41:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.389+0000 7effbce00640 1 -- 172.21.15.99:0/2254221238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80c9710 msgr2=0x7effb81695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.389+0000 7effbce00640 1 --2- 172.21.15.99:0/2254221238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80c9710 0x7effb81695e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7effb0009dc0 tx=0x7effb002a760 comp rx=0 tx=0).stop 2024-09-10T07:41:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.389+0000 7effbce00640 1 -- 172.21.15.99:0/2254221238 shutdown_connections 2024-09-10T07:41:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.389+0000 7effbce00640 1 --2- 172.21.15.99:0/2254221238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80c9710 0x7effb81695e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.389+0000 7effbce00640 1 -- 172.21.15.99:0/2254221238 >> 172.21.15.99:0/2254221238 conn(0x7effb809de00 msgr2=0x7effb80d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.390+0000 7effbce00640 1 -- 172.21.15.99:0/2254221238 shutdown_connections 2024-09-10T07:41:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.390+0000 7effbce00640 1 -- 172.21.15.99:0/2254221238 wait complete. 2024-09-10T07:41:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.391+0000 7effbce00640 1 Processor -- start 2024-09-10T07:41:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.391+0000 7effbce00640 1 -- start start 2024-09-10T07:41:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.392+0000 7effbce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb80c9710 0x7effb8161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.392+0000 7effbce00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80d2680 0x7effb80cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.392+0000 7effbce00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effb815e970 0x7effb809e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.392+0000 7effbce00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7effb815eed0 con 0x7effb80c9710 2024-09-10T07:41:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.392+0000 7effbce00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7effb815ed50 con 0x7effb815e970 2024-09-10T07:41:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.392+0000 7effbce00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7effb80cfc90 con 0x7effb80d2680 2024-09-10T07:41:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.392+0000 7effb7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb80c9710 0x7effb8161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.393+0000 7effb7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb80c9710 0x7effb8161bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42420/0 (socket says 172.21.15.99:42420) 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.393+0000 7effb7400640 1 -- 172.21.15.99:0/3277528493 learned_addr learned my addr 172.21.15.99:0/3277528493 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.393+0000 7effaea00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80d2680 0x7effb80cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.393+0000 7effb7e00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effb815e970 0x7effb809e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.393+0000 7effb7400640 1 -- 172.21.15.99:0/3277528493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80d2680 msgr2=0x7effb80cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.393+0000 7effb7400640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80d2680 0x7effb80cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.393+0000 7effb7400640 1 -- 172.21.15.99:0/3277528493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effb815e970 msgr2=0x7effb809e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.393+0000 7effb7400640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effb815e970 0x7effb809e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.393+0000 7effb7400640 1 -- 172.21.15.99:0/3277528493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb80ccde0 con 0x7effb80c9710 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.393+0000 7effb7400640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb80c9710 0x7effb8161bd0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7effa800c400 tx=0x7effa800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.394+0000 7effafe00640 1 -- 172.21.15.99:0/3277528493 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8017070 con 0x7effb80c9710 2024-09-10T07:41:19.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.394+0000 7effafe00640 1 -- 172.21.15.99:0/3277528493 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa8005ce0 con 0x7effb80c9710 2024-09-10T07:41:19.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.394+0000 7effbce00640 1 -- 172.21.15.99:0/3277528493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb80cd0c0 con 0x7effb80c9710 2024-09-10T07:41:19.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.394+0000 7effafe00640 1 -- 172.21.15.99:0/3277528493 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80072d0 con 0x7effb80c9710 2024-09-10T07:41:19.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.394+0000 7effbce00640 1 -- 172.21.15.99:0/3277528493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb80cd680 con 0x7effb80c9710 2024-09-10T07:41:19.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.395+0000 7effbce00640 1 -- 172.21.15.99:0/3277528493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb80cf580 con 0x7effb80c9710 2024-09-10T07:41:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.396+0000 7effafe00640 1 -- 172.21.15.99:0/3277528493 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effa801a070 con 0x7effb80c9710 2024-09-10T07:41:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.397+0000 7effafe00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7eff9406be30 0x7eff9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.397+0000 7effafe00640 1 -- 172.21.15.99:0/3277528493 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7effa808a120 con 0x7effb80c9710 2024-09-10T07:41:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.397+0000 7effaea00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7eff9406be30 0x7eff9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.397+0000 7effaea00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7eff9406be30 0x7eff9406e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7effb815daf0 tx=0x7effa0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:19.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.401+0000 7effafe00640 1 -- 172.21.15.99:0/3277528493 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effa80583e0 con 0x7effb80c9710 2024-09-10T07:41:19.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.605+0000 7effbce00640 1 -- 172.21.15.99:0/3277528493 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effb80c9d40 con 0x7effb80c9710 2024-09-10T07:41:19.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.606+0000 7effafe00640 1 -- 172.21.15.99:0/3277528493 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5225 (secure 0 0 0) 0x7effa805c6e0 con 0x7effb80c9710 2024-09-10T07:41:19.606 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:41:19.606 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":74,"btime":"2024-09-10T07:41:13:353969+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3366680210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3366680210},{"type":"v1","addr":"172.21.15.187:6835","nonce":3366680210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6712,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/919138741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":919138741},{"type":"v1","addr":"172.21.15.99:6836","nonce":919138741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/794540040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":794540040},{"type":"v1","addr":"172.21.15.187:6834","nonce":794540040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:41:09.738509+0000","modified":"2024-09-10T07:41:12.757588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/2751383266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":2751383266},{"type":"v1","addr":"172.21.15.99:6837","nonce":2751383266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7179,"qdb_cluster":[7179]},"id":9}]} 2024-09-10T07:41:19.606 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 74 2024-09-10T07:41:19.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 -- 172.21.15.99:0/3277528493 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7eff9406be30 msgr2=0x7eff9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7eff9406be30 0x7eff9406e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7effb815daf0 tx=0x7effa0009040 comp rx=0 tx=0).stop 2024-09-10T07:41:19.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 -- 172.21.15.99:0/3277528493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb80c9710 msgr2=0x7effb8161bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb80c9710 0x7effb8161bd0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7effa800c400 tx=0x7effa800c8c0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 -- 172.21.15.99:0/3277528493 shutdown_connections 2024-09-10T07:41:19.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effb815e970 0x7effb809e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7effb80d2680 0x7effb80cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7eff9406be30 0x7eff9406e2f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 --2- 172.21.15.99:0/3277528493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb80c9710 0x7effb8161bd0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 -- 172.21.15.99:0/3277528493 >> 172.21.15.99:0/3277528493 conn(0x7effb809de00 msgr2=0x7effb80b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:19.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 -- 172.21.15.99:0/3277528493 shutdown_connections 2024-09-10T07:41:19.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.608+0000 7effbce00640 1 -- 172.21.15.99:0/3277528493 wait complete. 2024-09-10T07:41:19.625 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-10T07:41:19.801 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":7179,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.4606771730000006,"mdsmap_epoch":74,"osdmap_epoch":155,"osdmap_epoch_barrier":155,"uptime":14.528985305999999} 2024-09-10T07:41:19.801 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 7179, "mdsmap_epoch": 74, "osdmap_epoch": 155, "osdmap_epoch_barrier": 155, "rank_uptime": 9.460677173, "state": "up:active", "uptime": 14.528985306, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:41:19.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-10T07:41:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.960+0000 7f5fdde00640 1 Processor -- start 2024-09-10T07:41:19.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.960+0000 7f5fdde00640 1 -- start start 2024-09-10T07:41:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.961+0000 7f5fdde00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5fd80d3760 0x7f5fd80cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.961+0000 7f5fdde00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd80d0520 con 0x7f5fd80cfd30 2024-09-10T07:41:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.961+0000 7f5fdde00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd80d0800 con 0x7f5fd815eb60 2024-09-10T07:41:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.961+0000 7f5fdde00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd80b7a60 con 0x7f5fd80d3760 2024-09-10T07:41:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.961+0000 7f5fdd400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5fd80cfd30 0x7f5fd80b8260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54004/0 (socket says 172.21.15.99:54004) 2024-09-10T07:41:19.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.961+0000 7f5fdd400640 1 -- 172.21.15.99:0/2179888528 learned_addr learned my addr 172.21.15.99:0/2179888528 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:41:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.961+0000 7f5fd7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5fd80d3760 0x7f5fd80cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.962+0000 7f5fd7e00640 1 -- 172.21.15.99:0/2179888528 >> v1:172.21.15.187:6789/0 conn(0x7f5fd815eb60 legacy=0x7f5fd80d3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.962+0000 7f5fd7400640 1 -- 172.21.15.99:0/2179888528 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965504392 0 0) 0x7f5fd80d0520 con 0x7f5fd80cfd30 2024-09-10T07:41:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.962+0000 7f5fd7e00640 1 -- 172.21.15.99:0/2179888528 >> v1:172.21.15.99:6789/0 conn(0x7f5fd80cfd30 legacy=0x7f5fd80b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.962+0000 7f5fd7e00640 1 -- 172.21.15.99:0/2179888528 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd80b7d40 con 0x7f5fd80d3760 2024-09-10T07:41:19.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.963+0000 7f5fd7e00640 1 --2- 172.21.15.99:0/2179888528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 0x7f5fd80cf7f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009720 tx=0x7f5fc402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a8254675b04309 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.963+0000 7f5fd7400640 1 -- 172.21.15.99:0/2179888528 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4037070 con 0x7f5fd80d3760 2024-09-10T07:41:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.963+0000 7f5fd7400640 1 -- 172.21.15.99:0/2179888528 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc4032440 con 0x7f5fd80d3760 2024-09-10T07:41:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.963+0000 7f5fd7400640 1 -- 172.21.15.99:0/2179888528 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc402ae60 con 0x7f5fd80d3760 2024-09-10T07:41:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.964+0000 7f5fdde00640 1 -- 172.21.15.99:0/2179888528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 msgr2=0x7f5fd80cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.964+0000 7f5fdde00640 1 --2- 172.21.15.99:0/2179888528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 0x7f5fd80cf7f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009720 tx=0x7f5fc402a150 comp rx=0 tx=0).stop 2024-09-10T07:41:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.964+0000 7f5fdde00640 1 -- 172.21.15.99:0/2179888528 shutdown_connections 2024-09-10T07:41:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.964+0000 7f5fdde00640 1 --2- 172.21.15.99:0/2179888528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 0x7f5fd80cf7f0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.964+0000 7f5fdde00640 1 -- 172.21.15.99:0/2179888528 >> 172.21.15.99:0/2179888528 conn(0x7f5fd80d4a70 msgr2=0x7f5fd80d4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.964+0000 7f5fdde00640 1 -- 172.21.15.99:0/2179888528 shutdown_connections 2024-09-10T07:41:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.964+0000 7f5fdde00640 1 -- 172.21.15.99:0/2179888528 wait complete. 2024-09-10T07:41:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.965+0000 7f5fdde00640 1 Processor -- start 2024-09-10T07:41:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.966+0000 7f5fdde00640 1 -- start start 2024-09-10T07:41:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.966+0000 7f5fdde00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fd80cfd30 0x7f5fd80a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.966+0000 7f5fdde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 0x7f5fd80d1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.966+0000 7f5fdde00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fd815eb60 0x7f5fd8153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.966+0000 7f5fdde00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd815f0c0 con 0x7f5fd80d3760 2024-09-10T07:41:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.966+0000 7f5fdde00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd815ef40 con 0x7f5fd815eb60 2024-09-10T07:41:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.966+0000 7f5fdde00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd80b8970 con 0x7f5fd80cfd30 2024-09-10T07:41:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.967+0000 7f5fd7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 0x7f5fd80d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.967+0000 7f5fd7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 0x7f5fd80d1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59906/0 (socket says 172.21.15.99:59906) 2024-09-10T07:41:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.967+0000 7f5fd7e00640 1 -- 172.21.15.99:0/2704668594 learned_addr learned my addr 172.21.15.99:0/2704668594 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:41:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.967+0000 7f5fdd400640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fd815eb60 0x7f5fd8153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.967+0000 7f5fdca00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fd80cfd30 0x7f5fd80a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.967+0000 7f5fd7e00640 1 -- 172.21.15.99:0/2704668594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fd80cfd30 msgr2=0x7f5fd80a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.967+0000 7f5fd7e00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fd80cfd30 0x7f5fd80a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.967+0000 7f5fd7e00640 1 -- 172.21.15.99:0/2704668594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fd815eb60 msgr2=0x7f5fd8153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.967+0000 7f5fd7e00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fd815eb60 0x7f5fd8153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.967+0000 7f5fd7e00640 1 -- 172.21.15.99:0/2704668594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd809f750 con 0x7f5fd80d3760 2024-09-10T07:41:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.968+0000 7f5fd7e00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 0x7f5fd80d1310 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4000c00 tx=0x7f5fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.968+0000 7f5fd4c00640 1 -- 172.21.15.99:0/2704668594 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4037040 con 0x7f5fd80d3760 2024-09-10T07:41:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.968+0000 7f5fd4c00640 1 -- 172.21.15.99:0/2704668594 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc4004230 con 0x7f5fd80d3760 2024-09-10T07:41:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.968+0000 7f5fd4c00640 1 -- 172.21.15.99:0/2704668594 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc403c670 con 0x7f5fd80d3760 2024-09-10T07:41:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.968+0000 7f5fdde00640 1 -- 172.21.15.99:0/2704668594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd809fa30 con 0x7f5fd80d3760 2024-09-10T07:41:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.968+0000 7f5fdde00640 1 -- 172.21.15.99:0/2704668594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd809fff0 con 0x7f5fd80d3760 2024-09-10T07:41:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.969+0000 7f5fdde00640 1 -- 172.21.15.99:0/2704668594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd80cf7f0 con 0x7f5fd80d3760 2024-09-10T07:41:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.970+0000 7f5fd4c00640 1 -- 172.21.15.99:0/2704668594 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fc403a070 con 0x7f5fd80d3760 2024-09-10T07:41:19.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.971+0000 7f5fd4c00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fb806be30 0x7f5fb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:41:19.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.971+0000 7f5fd4c00640 1 -- 172.21.15.99:0/2704668594 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5709+0+0 (secure 0 0 0) 0x7f5fc40ab890 con 0x7f5fd80d3760 2024-09-10T07:41:19.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.971+0000 7f5fdca00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fb806be30 0x7f5fb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:41:19.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.972+0000 7f5fdca00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fb806be30 0x7f5fb806e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc007fd0 tx=0x7f5fcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:41:19.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:19.975+0000 7f5fd4c00640 1 -- 172.21.15.99:0/2704668594 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5fc4041020 con 0x7f5fd80d3760 2024-09-10T07:41:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.149+0000 7f5fdde00640 1 -- 172.21.15.99:0/2704668594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f5fd806dd30 con 0x7f5fd80d3760 2024-09-10T07:41:20.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.380+0000 7f5fd4c00640 1 -- 172.21.15.99:0/2704668594 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v156) ==== 181+0+0 (secure 0 0 0) 0x7f5fc407a1a0 con 0x7f5fd80d3760 2024-09-10T07:41:20.380 INFO:teuthology.orchestra.run.smithi099.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-10T07:41:20.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 -- 172.21.15.99:0/2704668594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fb806be30 msgr2=0x7f5fb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:20.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fb806be30 0x7f5fb806e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc007fd0 tx=0x7f5fcc009040 comp rx=0 tx=0).stop 2024-09-10T07:41:20.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 -- 172.21.15.99:0/2704668594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 msgr2=0x7f5fd80d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:41:20.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 0x7f5fd80d1310 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4000c00 tx=0x7f5fc40046c0 comp rx=0 tx=0).stop 2024-09-10T07:41:20.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 -- 172.21.15.99:0/2704668594 shutdown_connections 2024-09-10T07:41:20.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fd815eb60 0x7f5fd8153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:20.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5fb806be30 0x7f5fb806e2f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:20.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fd80d3760 0x7f5fd80d1310 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:20.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 --2- 172.21.15.99:0/2704668594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fd80cfd30 0x7f5fd80a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:41:20.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 -- 172.21.15.99:0/2704668594 >> 172.21.15.99:0/2704668594 conn(0x7f5fd80d4a70 msgr2=0x7f5fd80b9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:41:20.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 -- 172.21.15.99:0/2704668594 shutdown_connections 2024-09-10T07:41:20.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:41:20.383+0000 7f5fdde00640 1 -- 172.21.15.99:0/2704668594 wait complete. 2024-09-10T07:41:20.400 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-10T07:41:20.566 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_mon_report_interval":"5"} 2024-09-10T07:41:20.567 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-10T07:41:20.567 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-10T07:41:20.728 INFO:teuthology.orchestra.run.smithi099.stdout:{"mon_tick_interval":"5"} 2024-09-10T07:41:20.729 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-10T07:41:20.729 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-10T07:41:20.729 DEBUG:teuthology.orchestra.run.smithi099:> stdin-killer -- python3 -c ' 2024-09-10T07:41:20.729 DEBUG:teuthology.orchestra.run.smithi099:> import time 2024-09-10T07:41:20.729 DEBUG:teuthology.orchestra.run.smithi099:> import datetime 2024-09-10T07:41:20.729 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-09-10T07:41:20.729 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-10T07:41:20.729 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> # Write some buffered data through before going full, all should be well 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> print("writing some data through which we expect to succeed") 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> bytes = 0 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(f) 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> # buffered IO, the error should always only appear from fsync and not 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> # from write 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> full = False 2024-09-10T07:41:20.730 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> for n in range(0, int(32 * 0.9)): 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> print("done writing {0} bytes".format(bytes)) 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> # OK, now we should sneak in under the full condition 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> # due to the time it takes the OSDs to report to the 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> # mons, and get a successful fsync on our full-making data 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(f) 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> # buffered write, add more dirty data to the buffer 2024-09-10T07:41:20.731 DEBUG:teuthology.orchestra.run.smithi099:> print("starting buffered write") 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> try: 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> for n in range(0, int(32 * 0.2)): 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> time.sleep(15.0) 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> except OSError: 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> pass; 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> # Wait long enough for a background flush that should fail 2024-09-10T07:41:20.732 DEBUG:teuthology.orchestra.run.smithi099:> time.sleep(30) 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> if False: 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> # ...and check that the failed background flush is reflected in fclose 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> try: 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> os.close(f) 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> except OSError: 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> print("close() returned an error as expected") 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> else: 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("close() failed to raise error") 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> else: 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> # The kernel cephfs client does not raise errors on fclose 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> os.close(f) 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:41:20.733 DEBUG:teuthology.orchestra.run.smithi099:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-10T07:41:20.734 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-10T07:41:47.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:41:47.617 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:42:17.724 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:42:17.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:42:47.838 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:42:47.844 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:43:17.956 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:43:17.962 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:43:25.507 INFO:teuthology.orchestra.run.smithi099.stdout:writing some data through which we expect to succeed 2024-09-10T07:43:25.507 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-10T07:43:25.507 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-10T07:43:25.507 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-10T07:43:25.507 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-10T07:43:25.507 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-10T07:43:25.507 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-10T07:43:25.508 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-10T07:43:25.509 INFO:teuthology.orchestra.run.smithi099.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-10T07:43:25.510 INFO:teuthology.orchestra.run.smithi099.stdout:done writing 29884416 bytes 2024-09-10T07:43:25.510 INFO:teuthology.orchestra.run.smithi099.stdout:successfully fsync'ed prior to getting full state reported 2024-09-10T07:43:25.510 INFO:teuthology.orchestra.run.smithi099.stdout:starting buffered write 2024-09-10T07:43:25.510 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:43:25.510 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:43:25.510 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:43:25.510 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:43:25.510 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:43:25.510 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:43:25.510 INFO:teuthology.orchestra.run.smithi099.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-10T07:43:25.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:43:25.523 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:43:25.523 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:43:25.625 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:43:25.739 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:43:25.739 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:43:25.739 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:43:25.739 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:25.777 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:43:25.777 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:25.854 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:43:26.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.052+0000 7fc85da00640 1 Processor -- start 2024-09-10T07:43:26.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.052+0000 7fc85da00640 1 -- start start 2024-09-10T07:43:26.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.053+0000 7fc85da00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580d3070 0x7fc8580d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.053+0000 7fc85da00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc85815ed10 0x7fc8580d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.053+0000 7fc85da00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8580cf740 con 0x7fc8580d51a0 2024-09-10T07:43:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.053+0000 7fc85da00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc8580d3990 con 0x7fc85815ed10 2024-09-10T07:43:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.053+0000 7fc85da00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc8580d08f0 con 0x7fc8580d3070 2024-09-10T07:43:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.054+0000 7fc84f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc85815ed10 0x7fc8580d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.054+0000 7fc84f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc85815ed10 0x7fc8580d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50544/0 (socket says 172.21.15.99:50544) 2024-09-10T07:43:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.054+0000 7fc84f400640 1 -- 172.21.15.99:0/392603759 learned_addr learned my addr 172.21.15.99:0/392603759 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.054+0000 7fc85d000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc8580d51a0 0x7fc8580d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42330/0 (socket says 172.21.15.99:42330) 2024-09-10T07:43:26.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.054+0000 7fc857e00640 1 --2- 172.21.15.99:0/392603759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580d3070 0x7fc8580d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.054+0000 7fc84f400640 1 -- 172.21.15.99:0/392603759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580d3070 msgr2=0x7fc8580d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.054+0000 7fc84f400640 1 --2- 172.21.15.99:0/392603759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580d3070 0x7fc8580d3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.054+0000 7fc84f400640 1 -- 172.21.15.99:0/392603759 >> v1:172.21.15.99:6789/0 conn(0x7fc8580d51a0 legacy=0x7fc8580d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.054+0000 7fc84f400640 1 -- 172.21.15.99:0/392603759 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8580d5910 con 0x7fc85815ed10 2024-09-10T07:43:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.055+0000 7fc84f400640 1 --2- 172.21.15.99:0/392603759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 0x7fc8580d2660 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc840009870 tx=0x7fc84002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8203c72f84073323 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.055+0000 7fc857400640 1 -- 172.21.15.99:0/392603759 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840037070 con 0x7fc85815ed10 2024-09-10T07:43:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.055+0000 7fc857400640 1 -- 172.21.15.99:0/392603759 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84002ae50 con 0x7fc85815ed10 2024-09-10T07:43:26.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.055+0000 7fc857400640 1 -- 172.21.15.99:0/392603759 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840032860 con 0x7fc85815ed10 2024-09-10T07:43:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.056+0000 7fc85da00640 1 -- 172.21.15.99:0/392603759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 msgr2=0x7fc8580d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.056+0000 7fc85da00640 1 --2- 172.21.15.99:0/392603759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 0x7fc8580d2660 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc840009870 tx=0x7fc84002a300 comp rx=0 tx=0).stop 2024-09-10T07:43:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.056+0000 7fc85da00640 1 -- 172.21.15.99:0/392603759 shutdown_connections 2024-09-10T07:43:26.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.056+0000 7fc85da00640 1 --2- 172.21.15.99:0/392603759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 0x7fc8580d2660 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.056+0000 7fc85da00640 1 --2- 172.21.15.99:0/392603759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580d3070 0x7fc8580d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.056+0000 7fc85da00640 1 -- 172.21.15.99:0/392603759 >> 172.21.15.99:0/392603759 conn(0x7fc85809dd60 msgr2=0x7fc8580d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.056+0000 7fc85da00640 1 -- 172.21.15.99:0/392603759 shutdown_connections 2024-09-10T07:43:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.056+0000 7fc85da00640 1 -- 172.21.15.99:0/392603759 wait complete. 2024-09-10T07:43:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.058+0000 7fc85da00640 1 Processor -- start 2024-09-10T07:43:26.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.058+0000 7fc85da00640 1 -- start start 2024-09-10T07:43:26.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc85da00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8580d3070 0x7fc858150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc85da00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 0x7fc8580b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc85da00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580ba360 0x7fc8580ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc85da00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580cfcc0 con 0x7fc85815ed10 2024-09-10T07:43:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc85da00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580cf9e0 con 0x7fc8580d3070 2024-09-10T07:43:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc85da00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc8580d2ba0 con 0x7fc8580ba360 2024-09-10T07:43:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc84f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 0x7fc8580b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc84f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 0x7fc8580b9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50550/0 (socket says 172.21.15.99:50550) 2024-09-10T07:43:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc84f400640 1 -- 172.21.15.99:0/3481761949 learned_addr learned my addr 172.21.15.99:0/3481761949 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc857e00640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8580d3070 0x7fc858150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc85d000640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580ba360 0x7fc8580ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc84f400640 1 -- 172.21.15.99:0/3481761949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580ba360 msgr2=0x7fc8580ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc84f400640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580ba360 0x7fc8580ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc84f400640 1 -- 172.21.15.99:0/3481761949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8580d3070 msgr2=0x7fc858150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc84f400640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8580d3070 0x7fc858150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc84f400640 1 -- 172.21.15.99:0/3481761949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8580cdd00 con 0x7fc85815ed10 2024-09-10T07:43:26.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.059+0000 7fc85d000640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580ba360 0x7fc8580ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:26.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.060+0000 7fc84f400640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 0x7fc8580b9e20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc84002a340 tx=0x7fc8400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:26.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.060+0000 7fc854c00640 1 -- 172.21.15.99:0/3481761949 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840041020 con 0x7fc85815ed10 2024-09-10T07:43:26.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.060+0000 7fc854c00640 1 -- 172.21.15.99:0/3481761949 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84003c890 con 0x7fc85815ed10 2024-09-10T07:43:26.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.060+0000 7fc854c00640 1 -- 172.21.15.99:0/3481761949 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840037040 con 0x7fc85815ed10 2024-09-10T07:43:26.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.060+0000 7fc85da00640 1 -- 172.21.15.99:0/3481761949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8581f4cf0 con 0x7fc85815ed10 2024-09-10T07:43:26.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.060+0000 7fc85da00640 1 -- 172.21.15.99:0/3481761949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8581f52b0 con 0x7fc85815ed10 2024-09-10T07:43:26.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.061+0000 7fc85da00640 1 -- 172.21.15.99:0/3481761949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8580ba770 con 0x7fc85815ed10 2024-09-10T07:43:26.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.062+0000 7fc854c00640 1 -- 172.21.15.99:0/3481761949 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc840044020 con 0x7fc85815ed10 2024-09-10T07:43:26.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.063+0000 7fc854c00640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc83406be30 0x7fc83406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.063+0000 7fc854c00640 1 -- 172.21.15.99:0/3481761949 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5767+0+0 (secure 0 0 0) 0x7fc8400ab600 con 0x7fc85815ed10 2024-09-10T07:43:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.063+0000 7fc854c00640 1 -- 172.21.15.99:0/3481761949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7fc834073a20 con 0x7fc85815ed10 2024-09-10T07:43:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.063+0000 7fc857e00640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc83406be30 0x7fc83406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.064+0000 7fc857e00640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc83406be30 0x7fc83406e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc848011340 tx=0x7fc84800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:26.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.068+0000 7fc854c00640 1 -- 172.21.15.99:0/3481761949 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8580ba770 con 0x7fc85815ed10 2024-09-10T07:43:26.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.249+0000 7fc85da00640 1 -- 172.21.15.99:0/3481761949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc8580d3450 con 0x7fc85815ed10 2024-09-10T07:43:26.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.250+0000 7fc854c00640 1 -- 172.21.15.99:0/3481761949 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v159) ==== 80+0+0 (secure 0 0 0) 0x7fc84004b070 con 0x7fc85815ed10 2024-09-10T07:43:26.250 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:43:26.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 -- 172.21.15.99:0/3481761949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc83406be30 msgr2=0x7fc83406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc83406be30 0x7fc83406e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc848011340 tx=0x7fc84800b040 comp rx=0 tx=0).stop 2024-09-10T07:43:26.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 -- 172.21.15.99:0/3481761949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 msgr2=0x7fc8580b9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 0x7fc8580b9e20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc84002a340 tx=0x7fc8400046c0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 -- 172.21.15.99:0/3481761949 shutdown_connections 2024-09-10T07:43:26.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8580ba360 0x7fc8580ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc83406be30 0x7fc83406e2f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc85815ed10 0x7fc8580b9e20 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 --2- 172.21.15.99:0/3481761949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8580d3070 0x7fc858150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 -- 172.21.15.99:0/3481761949 >> 172.21.15.99:0/3481761949 conn(0x7fc85809dd60 msgr2=0x7fc85806c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:26.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 -- 172.21.15.99:0/3481761949 shutdown_connections 2024-09-10T07:43:26.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.252+0000 7fc85da00640 1 -- 172.21.15.99:0/3481761949 wait complete. 2024-09-10T07:43:26.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:43:26.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:26.268 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:43:26.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:43:26.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:26.332 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:43:26.371 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:43:26.371 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:43:26.371 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:26.411 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:43:26.411 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:26.489 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:43:26.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.643+0000 7fa909800640 1 Processor -- start 2024-09-10T07:43:26.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.644+0000 7fa909800640 1 -- start start 2024-09-10T07:43:26.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa909800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa90415db60 0x7fa904071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa909800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 0x7fa90406e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa909800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa90406e580 0x7fa904160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa909800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa90415df40 con 0x7fa90406e580 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa909800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa90406e9b0 con 0x7fa90415db60 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa909800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa904153e50 con 0x7fa9040724d0 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa903400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa90406e580 0x7fa904160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa903400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa90406e580 0x7fa904160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50566/0 (socket says 172.21.15.99:50566) 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa903400640 1 -- 172.21.15.99:0/3104037683 learned_addr learned my addr 172.21.15.99:0/3104037683 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa902a00640 1 --2- 172.21.15.99:0/3104037683 >> v2:172.21.15.187:3300/0 conn(0x7fa90415db60 0x7fa904071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa8fa000640 1 --2- 172.21.15.99:0/3104037683 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 0x7fa90406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.645+0000 7fa903400640 1 -- 172.21.15.99:0/3104037683 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 msgr2=0x7fa90406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.646+0000 7fa903400640 1 --2- 172.21.15.99:0/3104037683 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 0x7fa90406e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.646+0000 7fa903400640 1 -- 172.21.15.99:0/3104037683 >> v2:172.21.15.187:3300/0 conn(0x7fa90415db60 msgr2=0x7fa904071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.646+0000 7fa903400640 1 --2- 172.21.15.99:0/3104037683 >> v2:172.21.15.187:3300/0 conn(0x7fa90415db60 0x7fa904071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.646+0000 7fa903400640 1 -- 172.21.15.99:0/3104037683 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa904072ac0 con 0x7fa90406e580 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.646+0000 7fa902a00640 1 --2- 172.21.15.99:0/3104037683 >> v2:172.21.15.187:3300/0 conn(0x7fa90415db60 0x7fa904071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:26.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.646+0000 7fa8fa000640 1 --2- 172.21.15.99:0/3104037683 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 0x7fa90406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.646+0000 7fa903400640 1 --2- 172.21.15.99:0/3104037683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 0x7fa904160580 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa904073f30 tx=0x7fa8fc02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f3cf3c47869594 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa902000640 1 -- 172.21.15.99:0/3104037683 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc036070 con 0x7fa90406e580 2024-09-10T07:43:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa902000640 1 -- 172.21.15.99:0/3104037683 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8fc031600 con 0x7fa90406e580 2024-09-10T07:43:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa902000640 1 -- 172.21.15.99:0/3104037683 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0319d0 con 0x7fa90406e580 2024-09-10T07:43:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa909800640 1 -- 172.21.15.99:0/3104037683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 msgr2=0x7fa904160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa909800640 1 --2- 172.21.15.99:0/3104037683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 0x7fa904160580 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fa904073f30 tx=0x7fa8fc02a6c0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa909800640 1 -- 172.21.15.99:0/3104037683 shutdown_connections 2024-09-10T07:43:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa909800640 1 --2- 172.21.15.99:0/3104037683 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 0x7fa90406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa909800640 1 --2- 172.21.15.99:0/3104037683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 0x7fa904160580 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa909800640 1 --2- 172.21.15.99:0/3104037683 >> v2:172.21.15.187:3300/0 conn(0x7fa90415db60 0x7fa904071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa909800640 1 -- 172.21.15.99:0/3104037683 >> 172.21.15.99:0/3104037683 conn(0x7fa9040b2630 msgr2=0x7fa9040b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.647+0000 7fa909800640 1 -- 172.21.15.99:0/3104037683 shutdown_connections 2024-09-10T07:43:26.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.648+0000 7fa909800640 1 -- 172.21.15.99:0/3104037683 wait complete. 2024-09-10T07:43:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.649+0000 7fa909800640 1 Processor -- start 2024-09-10T07:43:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.649+0000 7fa909800640 1 -- start start 2024-09-10T07:43:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.650+0000 7fa909800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 0x7fa9040c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.650+0000 7fa909800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 0x7fa9041f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.650+0000 7fa909800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa90415db60 0x7fa904151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.650+0000 7fa909800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa904073360 con 0x7fa90406e580 2024-09-10T07:43:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.650+0000 7fa909800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa904073080 con 0x7fa90415db60 2024-09-10T07:43:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.650+0000 7fa909800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa904073640 con 0x7fa9040724d0 2024-09-10T07:43:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.650+0000 7fa902a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 0x7fa9040c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.650+0000 7fa902a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 0x7fa9040c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50572/0 (socket says 172.21.15.99:50572) 2024-09-10T07:43:26.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.650+0000 7fa902a00640 1 -- 172.21.15.99:0/1173209250 learned_addr learned my addr 172.21.15.99:0/1173209250 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:26.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa8fa000640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 0x7fa9041f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa903400640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa90415db60 0x7fa904151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa902a00640 1 -- 172.21.15.99:0/1173209250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 msgr2=0x7fa9041f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa902a00640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 0x7fa9041f8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa902a00640 1 -- 172.21.15.99:0/1173209250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa90415db60 msgr2=0x7fa904151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa902a00640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa90415db60 0x7fa904151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa902a00640 1 -- 172.21.15.99:0/1173209250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa904152240 con 0x7fa90406e580 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa8fa000640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 0x7fa9041f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa903400640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa90415db60 0x7fa904151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa902a00640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 0x7fa9040c6c10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400d7d0 tx=0x7fa8f400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa8fb400640 1 -- 172.21.15.99:0/1173209250 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4004030 con 0x7fa90406e580 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa8fb400640 1 -- 172.21.15.99:0/1173209250 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f40041d0 con 0x7fa90406e580 2024-09-10T07:43:26.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa8fb400640 1 -- 172.21.15.99:0/1173209250 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40096a0 con 0x7fa90406e580 2024-09-10T07:43:26.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa909800640 1 -- 172.21.15.99:0/1173209250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9040c7310 con 0x7fa90406e580 2024-09-10T07:43:26.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.651+0000 7fa909800640 1 -- 172.21.15.99:0/1173209250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9041f4f50 con 0x7fa90406e580 2024-09-10T07:43:26.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.653+0000 7fa909800640 1 -- 172.21.15.99:0/1173209250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa90415d2a0 con 0x7fa90406e580 2024-09-10T07:43:26.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.653+0000 7fa8fb400640 1 -- 172.21.15.99:0/1173209250 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8f4009840 con 0x7fa90406e580 2024-09-10T07:43:26.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.654+0000 7fa8fb400640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa8e006be30 0x7fa8e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:26.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.654+0000 7fa8fb400640 1 -- 172.21.15.99:0/1173209250 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5767+0+0 (secure 0 0 0) 0x7fa8f408b200 con 0x7fa90406e580 2024-09-10T07:43:26.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.655+0000 7fa8fa000640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa8e006be30 0x7fa8e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:26.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.655+0000 7fa8fb400640 1 -- 172.21.15.99:0/1173209250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7fa8e0073a20 con 0x7fa90406e580 2024-09-10T07:43:26.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.655+0000 7fa8fa000640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa8e006be30 0x7fa8e006e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec006fd0 tx=0x7fa8ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:26.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.659+0000 7fa8fb400640 1 -- 172.21.15.99:0/1173209250 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8f4059ad0 con 0x7fa90406e580 2024-09-10T07:43:26.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.842+0000 7fa909800640 1 -- 172.21.15.99:0/1173209250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa9040afc30 con 0x7fa90406e580 2024-09-10T07:43:26.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.843+0000 7fa8fb400640 1 -- 172.21.15.99:0/1173209250 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v159) ==== 80+0+0 (secure 0 0 0) 0x7fa8f40593d0 con 0x7fa90406e580 2024-09-10T07:43:26.842 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:43:26.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 -- 172.21.15.99:0/1173209250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa8e006be30 msgr2=0x7fa8e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa8e006be30 0x7fa8e006e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec006fd0 tx=0x7fa8ec008040 comp rx=0 tx=0).stop 2024-09-10T07:43:26.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 -- 172.21.15.99:0/1173209250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 msgr2=0x7fa9040c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:26.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 0x7fa9040c6c10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400d7d0 tx=0x7fa8f400dc90 comp rx=0 tx=0).stop 2024-09-10T07:43:26.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 -- 172.21.15.99:0/1173209250 shutdown_connections 2024-09-10T07:43:26.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa90415db60 0x7fa904151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9040724d0 0x7fa9041f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa8e006be30 0x7fa8e006e2f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 --2- 172.21.15.99:0/1173209250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa90406e580 0x7fa9040c6c10 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:26.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 -- 172.21.15.99:0/1173209250 >> 172.21.15.99:0/1173209250 conn(0x7fa9040b2630 msgr2=0x7fa9040af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:26.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 -- 172.21.15.99:0/1173209250 shutdown_connections 2024-09-10T07:43:26.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:26.845+0000 7fa909800640 1 -- 172.21.15.99:0/1173209250 wait complete. 2024-09-10T07:43:26.861 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:43:26.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:26.862 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T07:43:26.929 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:43:26.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:26.929 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:43:26.966 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:43:26.966 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:43:26.966 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:27.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:43:27.003 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:43:27.003 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:43:27.003 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:27.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:43:27.043 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:43:27.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.197+0000 7f7b5b000640 1 Processor -- start 2024-09-10T07:43:27.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.197+0000 7f7b5b000640 1 -- start start 2024-09-10T07:43:27.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.198+0000 7f7b5b000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7b5415e970 0x7f7b540d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.198+0000 7f7b5b000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b540d2680 0x7f7b540cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.198+0000 7f7b5b000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b540d2bd0 con 0x7f7b540cfac0 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.198+0000 7f7b5b000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7b540d37e0 con 0x7f7b5415e970 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.198+0000 7f7b5b000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7b540d2eb0 con 0x7f7b540d2680 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.198+0000 7f7b59c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7b5415e970 0x7f7b540d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.198+0000 7f7b59c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7b5415e970 0x7f7b540d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50576/0 (socket says 172.21.15.99:50576) 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.198+0000 7f7b59c00640 1 -- 172.21.15.99:0/1846866572 learned_addr learned my addr 172.21.15.99:0/1846866572 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.199+0000 7f7b59200640 1 --2- 172.21.15.99:0/1846866572 >> v2:172.21.15.187:3300/0 conn(0x7f7b540d2680 0x7f7b540cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.199+0000 7f7b59c00640 1 -- 172.21.15.99:0/1846866572 >> v2:172.21.15.187:3300/0 conn(0x7f7b540d2680 msgr2=0x7f7b540cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.199+0000 7f7b59c00640 1 --2- 172.21.15.99:0/1846866572 >> v2:172.21.15.187:3300/0 conn(0x7f7b540d2680 0x7f7b540cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.199+0000 7f7b59c00640 1 -- 172.21.15.99:0/1846866572 >> v1:172.21.15.187:6789/0 conn(0x7f7b540cfac0 legacy=0x7f7b540d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.199+0000 7f7b59c00640 1 -- 172.21.15.99:0/1846866572 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b540d3190 con 0x7f7b5415e970 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.200+0000 7f7b59c00640 1 --2- 172.21.15.99:0/1846866572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 0x7f7b540d0300 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f7b5409e530 tx=0x7f7b4802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733e9efd5b776c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.200+0000 7f7b53e00640 1 -- 172.21.15.99:0/1846866572 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48036070 con 0x7f7b5415e970 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.200+0000 7f7b53e00640 1 -- 172.21.15.99:0/1846866572 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b48031600 con 0x7f7b5415e970 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.200+0000 7f7b53e00640 1 -- 172.21.15.99:0/1846866572 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b480319f0 con 0x7f7b5415e970 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.201+0000 7f7b5b000640 1 -- 172.21.15.99:0/1846866572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 msgr2=0x7f7b540d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.201+0000 7f7b5b000640 1 --2- 172.21.15.99:0/1846866572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 0x7f7b540d0300 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f7b5409e530 tx=0x7f7b4802a7c0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.201+0000 7f7b5b000640 1 -- 172.21.15.99:0/1846866572 shutdown_connections 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.201+0000 7f7b5b000640 1 --2- 172.21.15.99:0/1846866572 >> v2:172.21.15.187:3300/0 conn(0x7f7b540d2680 0x7f7b540cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.201+0000 7f7b5b000640 1 --2- 172.21.15.99:0/1846866572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 0x7f7b540d0300 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.201+0000 7f7b5b000640 1 -- 172.21.15.99:0/1846866572 >> 172.21.15.99:0/1846866572 conn(0x7f7b5409de00 msgr2=0x7f7b540d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.201+0000 7f7b5b000640 1 -- 172.21.15.99:0/1846866572 shutdown_connections 2024-09-10T07:43:27.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.201+0000 7f7b5b000640 1 -- 172.21.15.99:0/1846866572 wait complete. 2024-09-10T07:43:27.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.202+0000 7f7b5b000640 1 Processor -- start 2024-09-10T07:43:27.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.202+0000 7f7b5b000640 1 -- start start 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.203+0000 7f7b5b000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b540cfac0 0x7f7b54154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.203+0000 7f7b5b000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b540d2680 0x7f7b5415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.203+0000 7f7b5b000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 0x7f7b5415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.203+0000 7f7b5b000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7b540d0840 con 0x7f7b5415e970 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.203+0000 7f7b5b000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7b540cff10 con 0x7f7b540cfac0 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.203+0000 7f7b5b000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5415ed50 con 0x7f7b540d2680 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b5a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 0x7f7b5415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b5a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 0x7f7b5415cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50582/0 (socket says 172.21.15.99:50582) 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b5a600640 1 -- 172.21.15.99:0/3551217693 learned_addr learned my addr 172.21.15.99:0/3551217693 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b59c00640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b540cfac0 0x7f7b54154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b59200640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b540d2680 0x7f7b5415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b5a600640 1 -- 172.21.15.99:0/3551217693 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b540d2680 msgr2=0x7f7b5415ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b5a600640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b540d2680 0x7f7b5415ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b5a600640 1 -- 172.21.15.99:0/3551217693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b540cfac0 msgr2=0x7f7b54154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b5a600640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b540cfac0 0x7f7b54154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b5a600640 1 -- 172.21.15.99:0/3551217693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b540cd560 con 0x7f7b5415e970 2024-09-10T07:43:27.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b5a600640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 0x7f7b5415cf50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00c390 tx=0x7f7b4c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:27.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.204+0000 7f7b51600640 1 -- 172.21.15.99:0/3551217693 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c017070 con 0x7f7b5415e970 2024-09-10T07:43:27.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.205+0000 7f7b51600640 1 -- 172.21.15.99:0/3551217693 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b4c0052d0 con 0x7f7b5415e970 2024-09-10T07:43:27.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.205+0000 7f7b5b000640 1 -- 172.21.15.99:0/3551217693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b540b9a90 con 0x7f7b5415e970 2024-09-10T07:43:27.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.205+0000 7f7b51600640 1 -- 172.21.15.99:0/3551217693 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c003810 con 0x7f7b5415e970 2024-09-10T07:43:27.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.205+0000 7f7b5b000640 1 -- 172.21.15.99:0/3551217693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b540ba050 con 0x7f7b5415e970 2024-09-10T07:43:27.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.206+0000 7f7b5b000640 1 -- 172.21.15.99:0/3551217693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b540cf580 con 0x7f7b5415e970 2024-09-10T07:43:27.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.207+0000 7f7b51600640 1 -- 172.21.15.99:0/3551217693 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b4c01a070 con 0x7f7b5415e970 2024-09-10T07:43:27.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.207+0000 7f7b51600640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b3406be30 0x7f7b3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.208+0000 7f7b51600640 1 -- 172.21.15.99:0/3551217693 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5767+0+0 (secure 0 0 0) 0x7f7b4c08a160 con 0x7f7b5415e970 2024-09-10T07:43:27.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.208+0000 7f7b59c00640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b3406be30 0x7f7b3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.208+0000 7f7b51600640 1 -- 172.21.15.99:0/3551217693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7f7b34073a20 con 0x7f7b5415e970 2024-09-10T07:43:27.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.208+0000 7f7b59c00640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b3406be30 0x7f7b3406e2f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7b48033000 tx=0x7f7b48009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:27.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.212+0000 7f7b51600640 1 -- 172.21.15.99:0/3551217693 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b4c0583e0 con 0x7f7b5415e970 2024-09-10T07:43:27.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.422+0000 7f7b5b000640 1 -- 172.21.15.99:0/3551217693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b54155150 con 0x7f7b5415e970 2024-09-10T07:43:27.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.423+0000 7f7b51600640 1 -- 172.21.15.99:0/3551217693 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5225 (secure 0 0 0) 0x7f7b4c05c6e0 con 0x7f7b5415e970 2024-09-10T07:43:27.423 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:27.423 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":74,"btime":"2024-09-10T07:41:13:353969+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3366680210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3366680210},{"type":"v1","addr":"172.21.15.187:6835","nonce":3366680210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6712,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/919138741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":919138741},{"type":"v1","addr":"172.21.15.99:6836","nonce":919138741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/794540040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":794540040},{"type":"v1","addr":"172.21.15.187:6834","nonce":794540040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:41:09.738509+0000","modified":"2024-09-10T07:41:12.757588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/2751383266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":2751383266},{"type":"v1","addr":"172.21.15.99:6837","nonce":2751383266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7179,"qdb_cluster":[7179]},"id":9}]} 2024-09-10T07:43:27.423 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 74 2024-09-10T07:43:27.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.425+0000 7f7b5b000640 1 -- 172.21.15.99:0/3551217693 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b3406be30 msgr2=0x7f7b3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.425+0000 7f7b5b000640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b3406be30 0x7f7b3406e2f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7b48033000 tx=0x7f7b48009000 comp rx=0 tx=0).stop 2024-09-10T07:43:27.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.425+0000 7f7b5b000640 1 -- 172.21.15.99:0/3551217693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 msgr2=0x7f7b5415cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.425+0000 7f7b5b000640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 0x7f7b5415cf50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00c390 tx=0x7f7b4c00c850 comp rx=0 tx=0).stop 2024-09-10T07:43:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.426+0000 7f7b5b000640 1 -- 172.21.15.99:0/3551217693 shutdown_connections 2024-09-10T07:43:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.426+0000 7f7b5b000640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7b3406be30 0x7f7b3406e2f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.426+0000 7f7b5b000640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b5415e970 0x7f7b5415cf50 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.426+0000 7f7b5b000640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b540d2680 0x7f7b5415ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.426+0000 7f7b5b000640 1 --2- 172.21.15.99:0/3551217693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b540cfac0 0x7f7b54154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.426+0000 7f7b5b000640 1 -- 172.21.15.99:0/3551217693 >> 172.21.15.99:0/3551217693 conn(0x7f7b5409de00 msgr2=0x7f7b540d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.426+0000 7f7b5b000640 1 -- 172.21.15.99:0/3551217693 shutdown_connections 2024-09-10T07:43:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.426+0000 7f7b5b000640 1 -- 172.21.15.99:0/3551217693 wait complete. 2024-09-10T07:43:27.442 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:43:27.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.595+0000 7f21a8e00640 1 Processor -- start 2024-09-10T07:43:27.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.596+0000 7f21a8e00640 1 -- start start 2024-09-10T07:43:27.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.597+0000 7f21a8e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21a4160c50 0x7f21a4167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.597+0000 7f21a8e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a4142650 con 0x7f21a4142150 2024-09-10T07:43:27.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.597+0000 7f21a8e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a4142930 con 0x7f21a413fae0 2024-09-10T07:43:27.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.597+0000 7f21a8e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f21a40ce780 con 0x7f21a4160c50 2024-09-10T07:43:27.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.597+0000 7f21a2800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21a4160c50 0x7f21a4167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.597+0000 7f21a2800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21a4160c50 0x7f21a4167680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50594/0 (socket says 172.21.15.99:50594) 2024-09-10T07:43:27.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.597+0000 7f21a1400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f21a4142150 0x7f21a4160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42332/0 (socket says 172.21.15.99:42332) 2024-09-10T07:43:27.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.597+0000 7f21a2800640 1 -- 172.21.15.99:0/1900788222 learned_addr learned my addr 172.21.15.99:0/1900788222 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:27.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.598+0000 7f21a2800640 1 -- 172.21.15.99:0/1900788222 >> v1:172.21.15.187:6789/0 conn(0x7f21a413fae0 legacy=0x7f21a406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.598+0000 7f21a2800640 1 -- 172.21.15.99:0/1900788222 >> v1:172.21.15.99:6789/0 conn(0x7f21a4142150 legacy=0x7f21a4160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.598+0000 7f21a2800640 1 -- 172.21.15.99:0/1900788222 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a4142c10 con 0x7f21a4160c50 2024-09-10T07:43:27.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.599+0000 7f21a2800640 1 --2- 172.21.15.99:0/1900788222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a4160c50 0x7f21a4167680 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f219c009870 tx=0x7f219c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf85ab10237525 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:27.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.599+0000 7f21a0a00640 1 -- 172.21.15.99:0/1900788222 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c037070 con 0x7f21a4160c50 2024-09-10T07:43:27.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.599+0000 7f21a0a00640 1 -- 172.21.15.99:0/1900788222 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c032440 con 0x7f21a4160c50 2024-09-10T07:43:27.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.599+0000 7f21a0a00640 1 -- 172.21.15.99:0/1900788222 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c032810 con 0x7f21a4160c50 2024-09-10T07:43:27.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.599+0000 7f21a8e00640 1 -- 172.21.15.99:0/1900788222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a4160c50 msgr2=0x7f21a4167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.599+0000 7f21a8e00640 1 --2- 172.21.15.99:0/1900788222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a4160c50 0x7f21a4167680 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f219c009870 tx=0x7f219c02a270 comp rx=0 tx=0).stop 2024-09-10T07:43:27.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.599+0000 7f21a8e00640 1 -- 172.21.15.99:0/1900788222 shutdown_connections 2024-09-10T07:43:27.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.599+0000 7f21a8e00640 1 --2- 172.21.15.99:0/1900788222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a4160c50 0x7f21a4167680 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.599+0000 7f21a8e00640 1 -- 172.21.15.99:0/1900788222 >> 172.21.15.99:0/1900788222 conn(0x7f21a406bc10 msgr2=0x7f21a406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:27.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.599+0000 7f21a8e00640 1 -- 172.21.15.99:0/1900788222 shutdown_connections 2024-09-10T07:43:27.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.600+0000 7f21a8e00640 1 -- 172.21.15.99:0/1900788222 wait complete. 2024-09-10T07:43:27.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.601+0000 7f21a8e00640 1 Processor -- start 2024-09-10T07:43:27.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.601+0000 7f21a8e00640 1 -- start start 2024-09-10T07:43:27.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.602+0000 7f21a8e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a413fae0 0x7f21a41f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.602+0000 7f21a8e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4142150 0x7f21a41f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.602+0000 7f21a8e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a4160c50 0x7f21a415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.602+0000 7f21a8e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f21a40cfda0 con 0x7f21a413fae0 2024-09-10T07:43:27.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.602+0000 7f21a8e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f21a40cfc20 con 0x7f21a4160c50 2024-09-10T07:43:27.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.602+0000 7f21a8e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f21a40cff20 con 0x7f21a4142150 2024-09-10T07:43:27.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.602+0000 7f21a1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a413fae0 0x7f21a41f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.602+0000 7f21a1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a413fae0 0x7f21a41f7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50598/0 (socket says 172.21.15.99:50598) 2024-09-10T07:43:27.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.602+0000 7f21a1e00640 1 -- 172.21.15.99:0/453459118 learned_addr learned my addr 172.21.15.99:0/453459118 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:27.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a2800640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a4160c50 0x7f21a415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a1400640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4142150 0x7f21a41f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a1e00640 1 -- 172.21.15.99:0/453459118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4142150 msgr2=0x7f21a41f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a1e00640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4142150 0x7f21a41f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a1e00640 1 -- 172.21.15.99:0/453459118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a4160c50 msgr2=0x7f21a415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a1e00640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a4160c50 0x7f21a415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a1e00640 1 -- 172.21.15.99:0/453459118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a41f6890 con 0x7f21a413fae0 2024-09-10T07:43:27.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a1400640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4142150 0x7f21a41f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:27.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a1e00640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a413fae0 0x7f21a41f7930 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f219400c8a0 tx=0x7f219400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:27.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f219a000640 1 -- 172.21.15.99:0/453459118 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194003b70 con 0x7f21a413fae0 2024-09-10T07:43:27.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f219a000640 1 -- 172.21.15.99:0/453459118 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2194003d30 con 0x7f21a413fae0 2024-09-10T07:43:27.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f219a000640 1 -- 172.21.15.99:0/453459118 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219400aa90 con 0x7f21a413fae0 2024-09-10T07:43:27.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a8e00640 1 -- 172.21.15.99:0/453459118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a41f6b70 con 0x7f21a413fae0 2024-09-10T07:43:27.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.603+0000 7f21a8e00640 1 -- 172.21.15.99:0/453459118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a41f7130 con 0x7f21a413fae0 2024-09-10T07:43:27.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.605+0000 7f21a8e00640 1 -- 172.21.15.99:0/453459118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a4160540 con 0x7f21a413fae0 2024-09-10T07:43:27.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.605+0000 7f219a000640 1 -- 172.21.15.99:0/453459118 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f219400ac30 con 0x7f21a413fae0 2024-09-10T07:43:27.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.607+0000 7f219a000640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f218406be30 0x7f218406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.607+0000 7f219a000640 1 -- 172.21.15.99:0/453459118 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5767+0+0 (secure 0 0 0) 0x7f219408ad80 con 0x7f21a413fae0 2024-09-10T07:43:27.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.607+0000 7f21a1400640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f218406be30 0x7f218406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.607+0000 7f219a000640 1 -- 172.21.15.99:0/453459118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7f2184073a20 con 0x7f21a413fae0 2024-09-10T07:43:27.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.608+0000 7f21a1400640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f218406be30 0x7f218406e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2190007fd0 tx=0x7f2190007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:27.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.611+0000 7f219a000640 1 -- 172.21.15.99:0/453459118 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21940596e0 con 0x7f21a413fae0 2024-09-10T07:43:27.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.817+0000 7f21a8e00640 1 -- 172.21.15.99:0/453459118 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21a40b0c70 con 0x7f21a413fae0 2024-09-10T07:43:27.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.817+0000 7f219a000640 1 -- 172.21.15.99:0/453459118 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5225 (secure 0 0 0) 0x7f2194058fe0 con 0x7f21a413fae0 2024-09-10T07:43:27.817 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:27.817 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":74,"btime":"2024-09-10T07:41:13:353969+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3366680210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3366680210},{"type":"v1","addr":"172.21.15.187:6835","nonce":3366680210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6712,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/919138741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":919138741},{"type":"v1","addr":"172.21.15.99:6836","nonce":919138741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/794540040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":794540040},{"type":"v1","addr":"172.21.15.187:6834","nonce":794540040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:41:09.738509+0000","modified":"2024-09-10T07:41:12.757588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/2751383266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":2751383266},{"type":"v1","addr":"172.21.15.99:6837","nonce":2751383266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7179,"qdb_cluster":[7179]},"id":9}]} 2024-09-10T07:43:27.817 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 74 2024-09-10T07:43:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 -- 172.21.15.99:0/453459118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f218406be30 msgr2=0x7f218406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f218406be30 0x7f218406e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2190007fd0 tx=0x7f2190007d60 comp rx=0 tx=0).stop 2024-09-10T07:43:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 -- 172.21.15.99:0/453459118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a413fae0 msgr2=0x7f21a41f7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a413fae0 0x7f21a41f7930 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f219400c8a0 tx=0x7f219400cd60 comp rx=0 tx=0).stop 2024-09-10T07:43:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 -- 172.21.15.99:0/453459118 shutdown_connections 2024-09-10T07:43:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21a4160c50 0x7f21a415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4142150 0x7f21a41f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f218406be30 0x7f218406e2f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 --2- 172.21.15.99:0/453459118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21a413fae0 0x7f21a41f7930 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 -- 172.21.15.99:0/453459118 >> 172.21.15.99:0/453459118 conn(0x7f21a406bc10 msgr2=0x7f21a40ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 -- 172.21.15.99:0/453459118 shutdown_connections 2024-09-10T07:43:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.819+0000 7f21a8e00640 1 -- 172.21.15.99:0/453459118 wait complete. 2024-09-10T07:43:27.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:43:27.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.987+0000 7f1e12200640 1 Processor -- start 2024-09-10T07:43:27.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.987+0000 7f1e12200640 1 -- start start 2024-09-10T07:43:27.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e12200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e0c15c580 0x7f1e0c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e12200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c960 0x7f1e0c0b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:27.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e12200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e0c06d920 con 0x7f1e0c0cea40 2024-09-10T07:43:27.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e12200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f1e0c0b3930 con 0x7f1e0c15c580 2024-09-10T07:43:27.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e12200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0c06dc00 con 0x7f1e0c15c960 2024-09-10T07:43:27.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e10e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e0c15c580 0x7f1e0c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e10e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e0c15c580 0x7f1e0c06d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50610/0 (socket says 172.21.15.99:50610) 2024-09-10T07:43:27.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e10e00640 1 -- 172.21.15.99:0/780999584 learned_addr learned my addr 172.21.15.99:0/780999584 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:27.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e11800640 1 --1- 172.21.15.99:0/780999584 >> v1:172.21.15.99:6789/0 conn(0x7f1e0c0cea40 0x7f1e0c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42346/0 (socket says 172.21.15.99:42346) 2024-09-10T07:43:27.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e0be00640 1 --2- 172.21.15.99:0/780999584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c960 0x7f1e0c0b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:27.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e10e00640 1 -- 172.21.15.99:0/780999584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c960 msgr2=0x7f1e0c0b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:27.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e10e00640 1 --2- 172.21.15.99:0/780999584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c960 0x7f1e0c0b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e10e00640 1 -- 172.21.15.99:0/780999584 >> v1:172.21.15.99:6789/0 conn(0x7f1e0c0cea40 legacy=0x7f1e0c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e10e00640 1 -- 172.21.15.99:0/780999584 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0c06dee0 con 0x7f1e0c15c580 2024-09-10T07:43:27.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e0be00640 1 --2- 172.21.15.99:0/780999584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c960 0x7f1e0c0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:27.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.989+0000 7f1e0b400640 1 -- 172.21.15.99:0/780999584 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3377506120 0 0) 0x7f1e0c06d920 con 0x7f1e0c0cea40 2024-09-10T07:43:27.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.990+0000 7f1e10e00640 1 --2- 172.21.15.99:0/780999584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c15c580 0x7f1e0c06d340 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009870 tx=0x7f1e0002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d92b6b34010229 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:27.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e0b400640 1 -- 172.21.15.99:0/780999584 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e00037070 con 0x7f1e0c15c580 2024-09-10T07:43:27.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e0b400640 1 -- 172.21.15.99:0/780999584 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e00032440 con 0x7f1e0c15c580 2024-09-10T07:43:27.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e0b400640 1 -- 172.21.15.99:0/780999584 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e00032810 con 0x7f1e0c15c580 2024-09-10T07:43:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e12200640 1 -- 172.21.15.99:0/780999584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c15c580 msgr2=0x7f1e0c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e12200640 1 --2- 172.21.15.99:0/780999584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c15c580 0x7f1e0c06d340 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009870 tx=0x7f1e0002a250 comp rx=0 tx=0).stop 2024-09-10T07:43:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e12200640 1 -- 172.21.15.99:0/780999584 shutdown_connections 2024-09-10T07:43:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e12200640 1 --2- 172.21.15.99:0/780999584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c960 0x7f1e0c0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e12200640 1 --2- 172.21.15.99:0/780999584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c15c580 0x7f1e0c06d340 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e12200640 1 -- 172.21.15.99:0/780999584 >> 172.21.15.99:0/780999584 conn(0x7f1e0c0b2810 msgr2=0x7f1e0c0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e12200640 1 -- 172.21.15.99:0/780999584 shutdown_connections 2024-09-10T07:43:27.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.991+0000 7f1e12200640 1 -- 172.21.15.99:0/780999584 wait complete. 2024-09-10T07:43:28.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.993+0000 7f1e12200640 1 Processor -- start 2024-09-10T07:43:28.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.993+0000 7f1e12200640 1 -- start start 2024-09-10T07:43:28.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.994+0000 7f1e12200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c0cea40 0x7f1e0c0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.994+0000 7f1e12200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c580 0x7f1e0c158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.994+0000 7f1e12200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e0c147f10 0x7f1e0c1483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.994+0000 7f1e12200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c06c4a0 con 0x7f1e0c0cea40 2024-09-10T07:43:28.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.994+0000 7f1e12200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c06c320 con 0x7f1e0c147f10 2024-09-10T07:43:28.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.994+0000 7f1e12200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0c0cee40 con 0x7f1e0c15c580 2024-09-10T07:43:28.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.994+0000 7f1e10e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c0cea40 0x7f1e0c0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.994+0000 7f1e10e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c0cea40 0x7f1e0c0cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50614/0 (socket says 172.21.15.99:50614) 2024-09-10T07:43:28.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.994+0000 7f1e10e00640 1 -- 172.21.15.99:0/3798630112 learned_addr learned my addr 172.21.15.99:0/3798630112 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:28.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e0be00640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c580 0x7f1e0c158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e11800640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e0c147f10 0x7f1e0c1483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e10e00640 1 -- 172.21.15.99:0/3798630112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c580 msgr2=0x7f1e0c158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e10e00640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c580 0x7f1e0c158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e10e00640 1 -- 172.21.15.99:0/3798630112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e0c147f10 msgr2=0x7f1e0c1483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e10e00640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e0c147f10 0x7f1e0c1483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e10e00640 1 -- 172.21.15.99:0/3798630112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0c1f4540 con 0x7f1e0c0cea40 2024-09-10T07:43:28.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e11800640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e0c147f10 0x7f1e0c1483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:28.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e10e00640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c0cea40 0x7f1e0c0cc0f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009870 tx=0x7f1e000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:28.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e08c00640 1 -- 172.21.15.99:0/3798630112 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e00041020 con 0x7f1e0c0cea40 2024-09-10T07:43:28.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e08c00640 1 -- 172.21.15.99:0/3798630112 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e00030970 con 0x7f1e0c0cea40 2024-09-10T07:43:28.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e08c00640 1 -- 172.21.15.99:0/3798630112 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e00037040 con 0x7f1e0c0cea40 2024-09-10T07:43:28.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e12200640 1 -- 172.21.15.99:0/3798630112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0c1f4820 con 0x7f1e0c0cea40 2024-09-10T07:43:28.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.995+0000 7f1e12200640 1 -- 172.21.15.99:0/3798630112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0c1f4de0 con 0x7f1e0c0cea40 2024-09-10T07:43:28.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.996+0000 7f1e12200640 1 -- 172.21.15.99:0/3798630112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0c0b5480 con 0x7f1e0c0cea40 2024-09-10T07:43:28.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.997+0000 7f1e08c00640 1 -- 172.21.15.99:0/3798630112 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e00044020 con 0x7f1e0c0cea40 2024-09-10T07:43:28.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.998+0000 7f1e08c00640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1dec06be30 0x7f1dec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.998+0000 7f1e08c00640 1 -- 172.21.15.99:0/3798630112 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5767+0+0 (secure 0 0 0) 0x7f1e000ab910 con 0x7f1e0c0cea40 2024-09-10T07:43:28.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.998+0000 7f1e0be00640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1dec06be30 0x7f1dec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.999+0000 7f1e08c00640 1 -- 172.21.15.99:0/3798630112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7f1dec073a20 con 0x7f1e0c0cea40 2024-09-10T07:43:28.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:27.999+0000 7f1e0be00640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1dec06be30 0x7f1dec06e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c157ad0 tx=0x7f1df8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:28.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.007+0000 7f1e08c00640 1 -- 172.21.15.99:0/3798630112 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e0c0b5480 con 0x7f1e0c0cea40 2024-09-10T07:43:28.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.182+0000 7f1e12200640 1 -- 172.21.15.99:0/3798630112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e0c15d320 con 0x7f1e0c0cea40 2024-09-10T07:43:28.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.183+0000 7f1e08c00640 1 -- 172.21.15.99:0/3798630112 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) ==== 74+0+16784 (secure 0 0 0) 0x7f1e0004b030 con 0x7f1e0c0cea40 2024-09-10T07:43:28.183 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:28.183 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":159,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:42:46.784275+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:41:07.512869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-10T07:41:08.732386+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.23","mappings":[{"from":2,"to":0}]},{"pgid":"19.3a","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:43:28.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 -- 172.21.15.99:0/3798630112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1dec06be30 msgr2=0x7f1dec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1dec06be30 0x7f1dec06e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c157ad0 tx=0x7f1df8008040 comp rx=0 tx=0).stop 2024-09-10T07:43:28.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 -- 172.21.15.99:0/3798630112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c0cea40 msgr2=0x7f1e0c0cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c0cea40 0x7f1e0c0cc0f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009870 tx=0x7f1e000046c0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 -- 172.21.15.99:0/3798630112 shutdown_connections 2024-09-10T07:43:28.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e0c147f10 0x7f1e0c1483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e0c15c580 0x7f1e0c158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f1dec06be30 0x7f1dec06e2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 --2- 172.21.15.99:0/3798630112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e0c0cea40 0x7f1e0c0cc0f0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 -- 172.21.15.99:0/3798630112 >> 172.21.15.99:0/3798630112 conn(0x7f1e0c0b2810 msgr2=0x7f1e0c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:28.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 -- 172.21.15.99:0/3798630112 shutdown_connections 2024-09-10T07:43:28.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.185+0000 7f1e12200640 1 -- 172.21.15.99:0/3798630112 wait complete. 2024-09-10T07:43:28.201 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:43:28.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:43:28.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.354+0000 7f5c1ec00640 1 Processor -- start 2024-09-10T07:43:28.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.354+0000 7f5c1ec00640 1 -- start start 2024-09-10T07:43:28.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.355+0000 7f5c1ec00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c18145290 0x7f5c1806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.355+0000 7f5c1ec00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5c18072f40 0x7f5c180b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.355+0000 7f5c1ec00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c1806e3d0 con 0x7f5c180ce780 2024-09-10T07:43:28.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.355+0000 7f5c1ec00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f5c1806efe0 con 0x7f5c18072f40 2024-09-10T07:43:28.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.355+0000 7f5c1ec00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1806e6b0 con 0x7f5c18145290 2024-09-10T07:43:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.356+0000 7f5c17e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c18145290 0x7f5c1806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.356+0000 7f5c17e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c18145290 0x7f5c1806f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:59916/0 (socket says 172.21.15.99:59916) 2024-09-10T07:43:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.356+0000 7f5c1cc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5c18072f40 0x7f5c180b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.356+0000 7f5c17e00640 1 -- 172.21.15.99:0/3155249316 learned_addr learned my addr 172.21.15.99:0/3155249316 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:28.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.356+0000 7f5c17400640 1 --1- 172.21.15.99:0/3155249316 >> v1:172.21.15.187:6789/0 conn(0x7f5c180ce780 0x7f5c18072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:44372/0 (socket says 172.21.15.99:44372) 2024-09-10T07:43:28.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.356+0000 7f5c17e00640 1 -- 172.21.15.99:0/3155249316 >> v2:172.21.15.187:3300/0 conn(0x7f5c18072f40 msgr2=0x7f5c180b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:28.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.356+0000 7f5c17e00640 1 --2- 172.21.15.99:0/3155249316 >> v2:172.21.15.187:3300/0 conn(0x7f5c18072f40 0x7f5c180b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.356+0000 7f5c17e00640 1 -- 172.21.15.99:0/3155249316 >> v1:172.21.15.187:6789/0 conn(0x7f5c180ce780 legacy=0x7f5c18072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.356+0000 7f5c17e00640 1 -- 172.21.15.99:0/3155249316 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1806e990 con 0x7f5c18145290 2024-09-10T07:43:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.357+0000 7f5c17e00640 1 --2- 172.21.15.99:0/3155249316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c18145290 0x7f5c1806f470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009870 tx=0x7f5c0802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51db4c05e14c664c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.357+0000 7f5c16a00640 1 -- 172.21.15.99:0/3155249316 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08037070 con 0x7f5c18145290 2024-09-10T07:43:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.358+0000 7f5c16a00640 1 -- 172.21.15.99:0/3155249316 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c08032440 con 0x7f5c18145290 2024-09-10T07:43:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.358+0000 7f5c16a00640 1 -- 172.21.15.99:0/3155249316 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08032810 con 0x7f5c18145290 2024-09-10T07:43:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.358+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3155249316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c18145290 msgr2=0x7f5c1806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.358+0000 7f5c1ec00640 1 --2- 172.21.15.99:0/3155249316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c18145290 0x7f5c1806f470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009870 tx=0x7f5c0802a250 comp rx=0 tx=0).stop 2024-09-10T07:43:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.358+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3155249316 shutdown_connections 2024-09-10T07:43:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.358+0000 7f5c1ec00640 1 --2- 172.21.15.99:0/3155249316 >> v2:172.21.15.187:3300/0 conn(0x7f5c18072f40 0x7f5c180b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.358+0000 7f5c1ec00640 1 --2- 172.21.15.99:0/3155249316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c18145290 0x7f5c1806f470 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.358+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3155249316 >> 172.21.15.99:0/3155249316 conn(0x7f5c1806bc10 msgr2=0x7f5c1806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:28.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.358+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3155249316 shutdown_connections 2024-09-10T07:43:28.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.358+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3155249316 wait complete. 2024-09-10T07:43:28.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.360+0000 7f5c1ec00640 1 Processor -- start 2024-09-10T07:43:28.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.360+0000 7f5c1ec00640 1 -- start start 2024-09-10T07:43:28.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1ec00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c18072f40 0x7f5c18152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1ec00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c180ce780 0x7f5c1815e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1ec00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c18145290 0x7f5c1813dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1ec00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1806df80 con 0x7f5c18145290 2024-09-10T07:43:28.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1ec00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18145670 con 0x7f5c18072f40 2024-09-10T07:43:28.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1ec00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1806e100 con 0x7f5c180ce780 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c18145290 0x7f5c1813dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c18145290 0x7f5c1813dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50618/0 (socket says 172.21.15.99:50618) 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1cc00640 1 -- 172.21.15.99:0/3672582875 learned_addr learned my addr 172.21.15.99:0/3672582875 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c17e00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c18072f40 0x7f5c18152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c17400640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c180ce780 0x7f5c1815e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1cc00640 1 -- 172.21.15.99:0/3672582875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c180ce780 msgr2=0x7f5c1815e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1cc00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c180ce780 0x7f5c1815e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1cc00640 1 -- 172.21.15.99:0/3672582875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c18072f40 msgr2=0x7f5c18152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.361+0000 7f5c1cc00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c18072f40 0x7f5c18152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.362+0000 7f5c1cc00640 1 -- 172.21.15.99:0/3672582875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1815ea90 con 0x7f5c18145290 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.362+0000 7f5c1cc00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c18145290 0x7f5c1813dae0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000efc0 tx=0x7f5c1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.362+0000 7f5c0fe00640 1 -- 172.21.15.99:0/3672582875 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10018020 con 0x7f5c18145290 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.362+0000 7f5c0fe00640 1 -- 172.21.15.99:0/3672582875 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c10014480 con 0x7f5c18145290 2024-09-10T07:43:28.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.362+0000 7f5c0fe00640 1 -- 172.21.15.99:0/3672582875 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10009e60 con 0x7f5c18145290 2024-09-10T07:43:28.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.362+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3672582875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1815ed70 con 0x7f5c18145290 2024-09-10T07:43:28.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.362+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3672582875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1815f330 con 0x7f5c18145290 2024-09-10T07:43:28.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.363+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3672582875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c18071510 con 0x7f5c18145290 2024-09-10T07:43:28.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.364+0000 7f5c0fe00640 1 -- 172.21.15.99:0/3672582875 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c10005d10 con 0x7f5c18145290 2024-09-10T07:43:28.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.365+0000 7f5c0fe00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.365+0000 7f5c0fe00640 1 -- 172.21.15.99:0/3672582875 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5767+0+0 (secure 0 0 0) 0x7f5c1008bb50 con 0x7f5c18145290 2024-09-10T07:43:28.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.365+0000 7f5c17e00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.366+0000 7f5c0fe00640 1 -- 172.21.15.99:0/3672582875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7f5bf8073a20 con 0x7f5c18145290 2024-09-10T07:43:28.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.366+0000 7f5c17e00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5bf806be30 0x7f5bf806e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5c08034000 tx=0x7f5c0802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:28.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.369+0000 7f5c0fe00640 1 -- 172.21.15.99:0/3672582875 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c10022030 con 0x7f5c18145290 2024-09-10T07:43:28.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.577+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3672582875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c180b1330 con 0x7f5c18145290 2024-09-10T07:43:28.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.577+0000 7f5c0fe00640 1 -- 172.21.15.99:0/3672582875 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5225 (secure 0 0 0) 0x7f5c1006f090 con 0x7f5c18145290 2024-09-10T07:43:28.578 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:28.578 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":74,"btime":"2024-09-10T07:41:13:353969+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3366680210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3366680210},{"type":"v1","addr":"172.21.15.187:6835","nonce":3366680210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6712,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/919138741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":919138741},{"type":"v1","addr":"172.21.15.99:6836","nonce":919138741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/794540040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":794540040},{"type":"v1","addr":"172.21.15.187:6834","nonce":794540040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:41:09.738509+0000","modified":"2024-09-10T07:41:12.757588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/2751383266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":2751383266},{"type":"v1","addr":"172.21.15.99:6837","nonce":2751383266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7179,"qdb_cluster":[7179]},"id":9}]} 2024-09-10T07:43:28.579 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 74 2024-09-10T07:43:28.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3672582875 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5bf806be30 msgr2=0x7f5bf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5bf806be30 0x7f5bf806e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5c08034000 tx=0x7f5c0802e000 comp rx=0 tx=0).stop 2024-09-10T07:43:28.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3672582875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c18145290 msgr2=0x7f5c1813dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c18145290 0x7f5c1813dae0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000efc0 tx=0x7f5c1000c490 comp rx=0 tx=0).stop 2024-09-10T07:43:28.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3672582875 shutdown_connections 2024-09-10T07:43:28.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f5bf806be30 0x7f5bf806e2f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c18145290 0x7f5c1813dae0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c180ce780 0x7f5c1815e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 --2- 172.21.15.99:0/3672582875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c18072f40 0x7f5c18152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3672582875 >> 172.21.15.99:0/3672582875 conn(0x7f5c1806bc10 msgr2=0x7f5c181416c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:28.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3672582875 shutdown_connections 2024-09-10T07:43:28.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.580+0000 7f5c1ec00640 1 -- 172.21.15.99:0/3672582875 wait complete. 2024-09-10T07:43:28.596 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:43:28.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.749+0000 7fe188e00640 1 Processor -- start 2024-09-10T07:43:28.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.750+0000 7fe188e00640 1 -- start start 2024-09-10T07:43:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe188e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe18413fae0 0x7fe18406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe188e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe184160c50 0x7fe1840cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe188e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe184142650 con 0x7fe184142150 2024-09-10T07:43:28.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe188e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe1840ce780 con 0x7fe18413fae0 2024-09-10T07:43:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe188e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe184142930 con 0x7fe184160c50 2024-09-10T07:43:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe181e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe18413fae0 0x7fe18406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe181e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe18413fae0 0x7fe18406f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50634/0 (socket says 172.21.15.99:50634) 2024-09-10T07:43:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe181e00640 1 -- 172.21.15.99:0/931728455 learned_addr learned my addr 172.21.15.99:0/931728455 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe182800640 1 --2- 172.21.15.99:0/931728455 >> v2:172.21.15.187:3300/0 conn(0x7fe184160c50 0x7fe1840cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe181e00640 1 -- 172.21.15.99:0/931728455 >> v2:172.21.15.187:3300/0 conn(0x7fe184160c50 msgr2=0x7fe1840cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe181e00640 1 --2- 172.21.15.99:0/931728455 >> v2:172.21.15.187:3300/0 conn(0x7fe184160c50 0x7fe1840cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe181e00640 1 -- 172.21.15.99:0/931728455 >> v1:172.21.15.187:6789/0 conn(0x7fe184142150 legacy=0x7fe184160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:28.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.751+0000 7fe181e00640 1 -- 172.21.15.99:0/931728455 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe184142c10 con 0x7fe18413fae0 2024-09-10T07:43:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.752+0000 7fe181e00640 1 --2- 172.21.15.99:0/931728455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 0x7fe18406f1b0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe1840b39c0 tx=0x7fe17402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce6431b8ee8d485 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.753+0000 7fe180a00640 1 -- 172.21.15.99:0/931728455 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174037070 con 0x7fe18413fae0 2024-09-10T07:43:28.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.753+0000 7fe180a00640 1 -- 172.21.15.99:0/931728455 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe174032440 con 0x7fe18413fae0 2024-09-10T07:43:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.753+0000 7fe180a00640 1 -- 172.21.15.99:0/931728455 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174032810 con 0x7fe18413fae0 2024-09-10T07:43:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.753+0000 7fe188e00640 1 -- 172.21.15.99:0/931728455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 msgr2=0x7fe18406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.753+0000 7fe188e00640 1 --2- 172.21.15.99:0/931728455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 0x7fe18406f1b0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe1840b39c0 tx=0x7fe17402a1a0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.753+0000 7fe188e00640 1 -- 172.21.15.99:0/931728455 shutdown_connections 2024-09-10T07:43:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.753+0000 7fe188e00640 1 --2- 172.21.15.99:0/931728455 >> v2:172.21.15.187:3300/0 conn(0x7fe184160c50 0x7fe1840cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.753+0000 7fe188e00640 1 --2- 172.21.15.99:0/931728455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 0x7fe18406f1b0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.753+0000 7fe188e00640 1 -- 172.21.15.99:0/931728455 >> 172.21.15.99:0/931728455 conn(0x7fe18406bc10 msgr2=0x7fe18406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.753+0000 7fe188e00640 1 -- 172.21.15.99:0/931728455 shutdown_connections 2024-09-10T07:43:28.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.754+0000 7fe188e00640 1 -- 172.21.15.99:0/931728455 wait complete. 2024-09-10T07:43:28.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.755+0000 7fe188e00640 1 Processor -- start 2024-09-10T07:43:28.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.755+0000 7fe188e00640 1 -- start start 2024-09-10T07:43:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.756+0000 7fe188e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 0x7fe184144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.756+0000 7fe188e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe184142150 0x7fe1841453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.756+0000 7fe188e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe184160c50 0x7fe1841458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.756+0000 7fe188e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe18406f870 con 0x7fe18413fae0 2024-09-10T07:43:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.756+0000 7fe188e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe18406f6f0 con 0x7fe184142150 2024-09-10T07:43:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.756+0000 7fe188e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe1840cf150 con 0x7fe184160c50 2024-09-10T07:43:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.756+0000 7fe181e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 0x7fe184144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.756+0000 7fe181e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 0x7fe184144e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50636/0 (socket says 172.21.15.99:50636) 2024-09-10T07:43:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.756+0000 7fe181e00640 1 -- 172.21.15.99:0/4090792250 learned_addr learned my addr 172.21.15.99:0/4090792250 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe181400640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe184142150 0x7fe1841453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe182800640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe184160c50 0x7fe1841458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe181e00640 1 -- 172.21.15.99:0/4090792250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe184160c50 msgr2=0x7fe1841458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe181e00640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe184160c50 0x7fe1841458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe181e00640 1 -- 172.21.15.99:0/4090792250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe184142150 msgr2=0x7fe1841453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe181e00640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe184142150 0x7fe1841453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe181e00640 1 -- 172.21.15.99:0/4090792250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe184143dd0 con 0x7fe18413fae0 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe181400640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe184142150 0x7fe1841453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe182800640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe184160c50 0x7fe1841458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe181e00640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 0x7fe184144e70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe17402a1e0 tx=0x7fe1740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe17a000640 1 -- 172.21.15.99:0/4090792250 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174041070 con 0x7fe18413fae0 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe17a000640 1 -- 172.21.15.99:0/4090792250 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17403c870 con 0x7fe18413fae0 2024-09-10T07:43:28.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe17a000640 1 -- 172.21.15.99:0/4090792250 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174037040 con 0x7fe18413fae0 2024-09-10T07:43:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe188e00640 1 -- 172.21.15.99:0/4090792250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1841440b0 con 0x7fe18413fae0 2024-09-10T07:43:28.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.757+0000 7fe188e00640 1 -- 172.21.15.99:0/4090792250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe184144670 con 0x7fe18413fae0 2024-09-10T07:43:28.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.758+0000 7fe188e00640 1 -- 172.21.15.99:0/4090792250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18406f1b0 con 0x7fe18413fae0 2024-09-10T07:43:28.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.759+0000 7fe17a000640 1 -- 172.21.15.99:0/4090792250 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe174044070 con 0x7fe18413fae0 2024-09-10T07:43:28.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.760+0000 7fe17a000640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe16406be60 0x7fe16406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:28.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.760+0000 7fe17a000640 1 -- 172.21.15.99:0/4090792250 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5767+0+0 (secure 0 0 0) 0x7fe1740abce0 con 0x7fe18413fae0 2024-09-10T07:43:28.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.760+0000 7fe181400640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe16406be60 0x7fe16406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:28.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.760+0000 7fe17a000640 1 -- 172.21.15.99:0/4090792250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7fe164073ab0 con 0x7fe18413fae0 2024-09-10T07:43:28.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.761+0000 7fe181400640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe16406be60 0x7fe16406e320 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe1840b0d40 tx=0x7fe170009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:28.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.765+0000 7fe17a000640 1 -- 172.21.15.99:0/4090792250 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe17407a6d0 con 0x7fe18413fae0 2024-09-10T07:43:28.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.975+0000 7fe188e00640 1 -- 172.21.15.99:0/4090792250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1840b0d70 con 0x7fe18413fae0 2024-09-10T07:43:28.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.976+0000 7fe17a000640 1 -- 172.21.15.99:0/4090792250 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5225 (secure 0 0 0) 0x7fe174079fd0 con 0x7fe18413fae0 2024-09-10T07:43:28.975 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:28.975 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":74,"btime":"2024-09-10T07:41:13:353969+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3366680210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3366680210},{"type":"v1","addr":"172.21.15.187:6835","nonce":3366680210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6712,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/919138741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":919138741},{"type":"v1","addr":"172.21.15.99:6836","nonce":919138741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/794540040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":794540040},{"type":"v1","addr":"172.21.15.187:6834","nonce":794540040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:41:09.738509+0000","modified":"2024-09-10T07:41:12.757588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7179},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7179":{"gid":7179,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/2751383266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":2751383266},{"type":"v1","addr":"172.21.15.99:6837","nonce":2751383266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7179,"qdb_cluster":[7179]},"id":9}]} 2024-09-10T07:43:28.976 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 74 2024-09-10T07:43:28.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 -- 172.21.15.99:0/4090792250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe16406be60 msgr2=0x7fe16406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe16406be60 0x7fe16406e320 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe1840b0d40 tx=0x7fe170009040 comp rx=0 tx=0).stop 2024-09-10T07:43:28.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 -- 172.21.15.99:0/4090792250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 msgr2=0x7fe184144e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:28.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 0x7fe184144e70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe17402a1e0 tx=0x7fe1740046c0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 -- 172.21.15.99:0/4090792250 shutdown_connections 2024-09-10T07:43:28.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe184160c50 0x7fe1841458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe184142150 0x7fe1841453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe16406be60 0x7fe16406e320 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 --2- 172.21.15.99:0/4090792250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe18413fae0 0x7fe184144e70 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:28.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 -- 172.21.15.99:0/4090792250 >> 172.21.15.99:0/4090792250 conn(0x7fe18406bc10 msgr2=0x7fe18406e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:28.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 -- 172.21.15.99:0/4090792250 shutdown_connections 2024-09-10T07:43:28.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:28.978+0000 7fe188e00640 1 -- 172.21.15.99:0/4090792250 wait complete. 2024-09-10T07:43:28.993 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:43:29.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.147+0000 7fab02000640 1 Processor -- start 2024-09-10T07:43:29.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.147+0000 7fab02000640 1 -- start start 2024-09-10T07:43:29.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.148+0000 7fab02000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faafc072f40 0x7faafc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.148+0000 7fab02000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faafc0ce780 0x7faafc0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.148+0000 7fab02000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc06e3d0 con 0x7faafc145290 2024-09-10T07:43:29.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.148+0000 7fab02000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7faafc06efe0 con 0x7faafc072f40 2024-09-10T07:43:29.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.148+0000 7fab02000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faafc06e6b0 con 0x7faafc0ce780 2024-09-10T07:43:29.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.149+0000 7faafb400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faafc145290 0x7faafc072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42348/0 (socket says 172.21.15.99:42348) 2024-09-10T07:43:29.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.149+0000 7faafb400640 1 -- 172.21.15.99:0/2221370666 learned_addr learned my addr 172.21.15.99:0/2221370666 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:29.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.149+0000 7faaf3e00640 1 --2- 172.21.15.99:0/2221370666 >> v2:172.21.15.99:3300/0 conn(0x7faafc072f40 0x7faafc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.149+0000 7faafbe00640 1 --2- 172.21.15.99:0/2221370666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faafc0ce780 0x7faafc0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.149+0000 7faafaa00640 1 -- 172.21.15.99:0/2221370666 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952998367 0 0) 0x7faafc06e3d0 con 0x7faafc145290 2024-09-10T07:43:29.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.149+0000 7faafaa00640 1 -- 172.21.15.99:0/2221370666 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae0005730 con 0x7faafc145290 2024-09-10T07:43:29.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.149+0000 7faaf3e00640 1 -- 172.21.15.99:0/2221370666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faafc0ce780 msgr2=0x7faafc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:29.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.149+0000 7faaf3e00640 1 --2- 172.21.15.99:0/2221370666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faafc0ce780 0x7faafc0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.149+0000 7faaf3e00640 1 -- 172.21.15.99:0/2221370666 >> v1:172.21.15.99:6789/0 conn(0x7faafc145290 legacy=0x7faafc072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.149+0000 7faaf3e00640 1 -- 172.21.15.99:0/2221370666 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc06e990 con 0x7faafc072f40 2024-09-10T07:43:29.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.150+0000 7faaf3e00640 1 --2- 172.21.15.99:0/2221370666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 0x7faafc06f470 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7faafc06f160 tx=0x7faae402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1415149a97cdec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:29.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.150+0000 7faafaa00640 1 -- 172.21.15.99:0/2221370666 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae4037070 con 0x7faafc072f40 2024-09-10T07:43:29.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.151+0000 7faafaa00640 1 -- 172.21.15.99:0/2221370666 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae4032440 con 0x7faafc072f40 2024-09-10T07:43:29.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.151+0000 7faafaa00640 1 -- 172.21.15.99:0/2221370666 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae40327f0 con 0x7faafc072f40 2024-09-10T07:43:29.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.151+0000 7fab02000640 1 -- 172.21.15.99:0/2221370666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 msgr2=0x7faafc06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.151+0000 7fab02000640 1 --2- 172.21.15.99:0/2221370666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 0x7faafc06f470 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7faafc06f160 tx=0x7faae402a180 comp rx=0 tx=0).stop 2024-09-10T07:43:29.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.151+0000 7fab02000640 1 -- 172.21.15.99:0/2221370666 shutdown_connections 2024-09-10T07:43:29.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.151+0000 7fab02000640 1 --2- 172.21.15.99:0/2221370666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faafc0ce780 0x7faafc0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.151+0000 7fab02000640 1 --2- 172.21.15.99:0/2221370666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 0x7faafc06f470 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.151+0000 7fab02000640 1 -- 172.21.15.99:0/2221370666 >> 172.21.15.99:0/2221370666 conn(0x7faafc06bc10 msgr2=0x7faafc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:29.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.151+0000 7fab02000640 1 -- 172.21.15.99:0/2221370666 shutdown_connections 2024-09-10T07:43:29.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.151+0000 7fab02000640 1 -- 172.21.15.99:0/2221370666 wait complete. 2024-09-10T07:43:29.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.153+0000 7fab02000640 1 Processor -- start 2024-09-10T07:43:29.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.153+0000 7fab02000640 1 -- start start 2024-09-10T07:43:29.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7fab02000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 0x7faafc15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7fab02000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faafc0ce780 0x7faafc0b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7fab02000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faafc145290 0x7faafc0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7fab02000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faafc06df80 con 0x7faafc072f40 2024-09-10T07:43:29.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7fab02000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faafc145670 con 0x7faafc145290 2024-09-10T07:43:29.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7fab02000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faafc06e100 con 0x7faafc0ce780 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7faafb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 0x7faafc15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7faafb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 0x7faafc15b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50654/0 (socket says 172.21.15.99:50654) 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7faafb400640 1 -- 172.21.15.99:0/1091540785 learned_addr learned my addr 172.21.15.99:0/1091540785 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7faaf3e00640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faafc0ce780 0x7faafc0b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.154+0000 7faafbe00640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faafc145290 0x7faafc0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7faafb400640 1 -- 172.21.15.99:0/1091540785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faafc0ce780 msgr2=0x7faafc0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7faafb400640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faafc0ce780 0x7faafc0b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7faafb400640 1 -- 172.21.15.99:0/1091540785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faafc145290 msgr2=0x7faafc0b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7faafb400640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faafc145290 0x7faafc0b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7faafb400640 1 -- 172.21.15.99:0/1091540785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc142130 con 0x7faafc072f40 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7faafbe00640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faafc145290 0x7faafc0b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:29.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7faafb400640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 0x7faafc15b450 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7faaec00c430 tx=0x7faaec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:29.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7faaf3400640 1 -- 172.21.15.99:0/1091540785 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec017070 con 0x7faafc072f40 2024-09-10T07:43:29.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7faaf3400640 1 -- 172.21.15.99:0/1091540785 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaec005ce0 con 0x7faafc072f40 2024-09-10T07:43:29.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7fab02000640 1 -- 172.21.15.99:0/1091540785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faafc1423d0 con 0x7faafc072f40 2024-09-10T07:43:29.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7faaf3400640 1 -- 172.21.15.99:0/1091540785 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec0072f0 con 0x7faafc072f40 2024-09-10T07:43:29.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.155+0000 7fab02000640 1 -- 172.21.15.99:0/1091540785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faafc142990 con 0x7faafc072f40 2024-09-10T07:43:29.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.156+0000 7fab02000640 1 -- 172.21.15.99:0/1091540785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faafc0715a0 con 0x7faafc072f40 2024-09-10T07:43:29.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.157+0000 7faaf3400640 1 -- 172.21.15.99:0/1091540785 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faaec01a070 con 0x7faafc072f40 2024-09-10T07:43:29.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.158+0000 7faaf3400640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faad806be30 0x7faad806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.158+0000 7faaf3400640 1 -- 172.21.15.99:0/1091540785 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5767+0+0 (secure 0 0 0) 0x7faaec08a260 con 0x7faafc072f40 2024-09-10T07:43:29.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.158+0000 7faaf3e00640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faad806be30 0x7faad806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.158+0000 7faaf3400640 1 -- 172.21.15.99:0/1091540785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7faad8073a20 con 0x7faafc072f40 2024-09-10T07:43:29.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.159+0000 7faaf3e00640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faad806be30 0x7faad806e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faae4034000 tx=0x7faae402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:29.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.162+0000 7faaf3400640 1 -- 172.21.15.99:0/1091540785 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faaec058610 con 0x7faafc072f40 2024-09-10T07:43:29.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.334+0000 7fab02000640 1 -- 172.21.15.99:0/1091540785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faafc13f130 con 0x7faafc072f40 2024-09-10T07:43:29.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.336+0000 7faaf3400640 1 -- 172.21.15.99:0/1091540785 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) ==== 74+0+16784 (secure 0 0 0) 0x7faaec05c910 con 0x7faafc072f40 2024-09-10T07:43:29.336 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:29.336 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":159,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:42:46.784275+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:41:07.512869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-10T07:41:08.732386+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.23","mappings":[{"from":2,"to":0}]},{"pgid":"19.3a","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 -- 172.21.15.99:0/1091540785 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faad806be30 msgr2=0x7faad806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faad806be30 0x7faad806e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7faae4034000 tx=0x7faae402e000 comp rx=0 tx=0).stop 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 -- 172.21.15.99:0/1091540785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 msgr2=0x7faafc15b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 0x7faafc15b450 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7faaec00c430 tx=0x7faaec00c8f0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 -- 172.21.15.99:0/1091540785 shutdown_connections 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faafc145290 0x7faafc0b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faafc0ce780 0x7faafc0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faad806be30 0x7faad806e2f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 --2- 172.21.15.99:0/1091540785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc072f40 0x7faafc15b450 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 -- 172.21.15.99:0/1091540785 >> 172.21.15.99:0/1091540785 conn(0x7faafc06bc10 msgr2=0x7faafc0ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 -- 172.21.15.99:0/1091540785 shutdown_connections 2024-09-10T07:43:29.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.338+0000 7fab02000640 1 -- 172.21.15.99:0/1091540785 wait complete. 2024-09-10T07:43:29.353 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:43:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.508+0000 7f86cf000640 1 Processor -- start 2024-09-10T07:43:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.508+0000 7f86cf000640 1 -- start start 2024-09-10T07:43:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.509+0000 7f86cf000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c806ebc0 0x7f86c80b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.509+0000 7f86cf000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f86c8158920 0x7f86c8158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.509+0000 7f86cf000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c80b0120 con 0x7f86c815f150 2024-09-10T07:43:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.509+0000 7f86cf000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f86c8071710 con 0x7f86c8158920 2024-09-10T07:43:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.509+0000 7f86cf000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f86c80713c0 con 0x7f86c806ebc0 2024-09-10T07:43:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.510+0000 7f86cdc00640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f86c815f150 0x7f86c815f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:44390/0 (socket says 172.21.15.99:44390) 2024-09-10T07:43:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.510+0000 7f86cd200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c806ebc0 0x7f86c80b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.510+0000 7f86cdc00640 1 -- 172.21.15.99:0/1297940811 learned_addr learned my addr 172.21.15.99:0/1297940811 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.510+0000 7f86ce600640 1 --2- 172.21.15.99:0/1297940811 >> v2:172.21.15.187:3300/0 conn(0x7f86c8158920 0x7f86c8158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.510+0000 7f86cd200640 1 -- 172.21.15.99:0/1297940811 >> v2:172.21.15.187:3300/0 conn(0x7f86c8158920 msgr2=0x7f86c8158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.511+0000 7f86cd200640 1 --2- 172.21.15.99:0/1297940811 >> v2:172.21.15.187:3300/0 conn(0x7f86c8158920 0x7f86c8158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.511+0000 7f86cd200640 1 -- 172.21.15.99:0/1297940811 >> v1:172.21.15.187:6789/0 conn(0x7f86c815f150 legacy=0x7f86c815f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.510+0000 7f86c7e00640 1 -- 172.21.15.99:0/1297940811 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620883481 0 0) 0x7f86c80b0120 con 0x7f86c815f150 2024-09-10T07:43:29.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.511+0000 7f86cd200640 1 -- 172.21.15.99:0/1297940811 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c80b41a0 con 0x7f86c806ebc0 2024-09-10T07:43:29.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.512+0000 7f86cd200640 1 --2- 172.21.15.99:0/1297940811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c806ebc0 0x7f86c80b3850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86b40097a0 tx=0x7f86b402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa41af0cd398a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:29.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.512+0000 7f86c7e00640 1 -- 172.21.15.99:0/1297940811 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b4037070 con 0x7f86c806ebc0 2024-09-10T07:43:29.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.512+0000 7f86c7e00640 1 -- 172.21.15.99:0/1297940811 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b4032440 con 0x7f86c806ebc0 2024-09-10T07:43:29.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.512+0000 7f86c7e00640 1 -- 172.21.15.99:0/1297940811 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b4032810 con 0x7f86c806ebc0 2024-09-10T07:43:29.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.512+0000 7f86cf000640 1 -- 172.21.15.99:0/1297940811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c806ebc0 msgr2=0x7f86c80b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.512+0000 7f86cf000640 1 --2- 172.21.15.99:0/1297940811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c806ebc0 0x7f86c80b3850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86b40097a0 tx=0x7f86b402a180 comp rx=0 tx=0).stop 2024-09-10T07:43:29.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.512+0000 7f86cf000640 1 -- 172.21.15.99:0/1297940811 shutdown_connections 2024-09-10T07:43:29.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.512+0000 7f86cf000640 1 --2- 172.21.15.99:0/1297940811 >> v2:172.21.15.187:3300/0 conn(0x7f86c8158920 0x7f86c8158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.512+0000 7f86cf000640 1 --2- 172.21.15.99:0/1297940811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c806ebc0 0x7f86c80b3850 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.512+0000 7f86cf000640 1 -- 172.21.15.99:0/1297940811 >> 172.21.15.99:0/1297940811 conn(0x7f86c806bdf0 msgr2=0x7f86c806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:29.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.513+0000 7f86cf000640 1 -- 172.21.15.99:0/1297940811 shutdown_connections 2024-09-10T07:43:29.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.513+0000 7f86cf000640 1 -- 172.21.15.99:0/1297940811 wait complete. 2024-09-10T07:43:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.514+0000 7f86cf000640 1 Processor -- start 2024-09-10T07:43:29.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.514+0000 7f86cf000640 1 -- start start 2024-09-10T07:43:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.515+0000 7f86cf000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86c806ebc0 0x7f86c814aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.515+0000 7f86cf000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c8158920 0x7f86c80aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.515+0000 7f86cf000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c815f150 0x7f86c80ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.515+0000 7f86cf000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f86c80ce940 con 0x7f86c815f150 2024-09-10T07:43:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.515+0000 7f86cf000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f86c80b4760 con 0x7f86c806ebc0 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.515+0000 7f86cf000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f86c80b3d90 con 0x7f86c8158920 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.515+0000 7f86ce600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c815f150 0x7f86c80ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.516+0000 7f86ce600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c815f150 0x7f86c80ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50666/0 (socket says 172.21.15.99:50666) 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.516+0000 7f86ce600640 1 -- 172.21.15.99:0/2522277705 learned_addr learned my addr 172.21.15.99:0/2522277705 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.516+0000 7f86cdc00640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86c806ebc0 0x7f86c814aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.516+0000 7f86cd200640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c8158920 0x7f86c80aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.516+0000 7f86ce600640 1 -- 172.21.15.99:0/2522277705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c8158920 msgr2=0x7f86c80aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.516+0000 7f86ce600640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c8158920 0x7f86c80aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.516+0000 7f86ce600640 1 -- 172.21.15.99:0/2522277705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86c806ebc0 msgr2=0x7f86c814aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.516+0000 7f86ce600640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86c806ebc0 0x7f86c814aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.516+0000 7f86ce600640 1 -- 172.21.15.99:0/2522277705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c80aaba0 con 0x7f86c815f150 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.516+0000 7f86ce600640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c815f150 0x7f86c80ac3a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f86c000efc0 tx=0x7f86c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.517+0000 7f86c5600640 1 -- 172.21.15.99:0/2522277705 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0018020 con 0x7f86c815f150 2024-09-10T07:43:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.517+0000 7f86c5600640 1 -- 172.21.15.99:0/2522277705 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c0014480 con 0x7f86c815f150 2024-09-10T07:43:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.517+0000 7f86c5600640 1 -- 172.21.15.99:0/2522277705 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0014870 con 0x7f86c815f150 2024-09-10T07:43:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.517+0000 7f86cf000640 1 -- 172.21.15.99:0/2522277705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c80aae80 con 0x7f86c815f150 2024-09-10T07:43:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.517+0000 7f86cf000640 1 -- 172.21.15.99:0/2522277705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c80ab440 con 0x7f86c815f150 2024-09-10T07:43:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.518+0000 7f86cf000640 1 -- 172.21.15.99:0/2522277705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c80b3850 con 0x7f86c815f150 2024-09-10T07:43:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.519+0000 7f86c5600640 1 -- 172.21.15.99:0/2522277705 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86c0005d10 con 0x7f86c815f150 2024-09-10T07:43:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.520+0000 7f86c5600640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f86a806be30 0x7f86a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.520+0000 7f86c5600640 1 -- 172.21.15.99:0/2522277705 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5767+0+0 (secure 0 0 0) 0x7f86c008b8a0 con 0x7f86c815f150 2024-09-10T07:43:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.520+0000 7f86cdc00640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f86a806be30 0x7f86a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.520+0000 7f86c5600640 1 -- 172.21.15.99:0/2522277705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7f86a8073a80 con 0x7f86c815f150 2024-09-10T07:43:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.521+0000 7f86cdc00640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f86a806be30 0x7f86a806e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f86bc000f60 tx=0x7f86bc007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:29.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.524+0000 7f86c5600640 1 -- 172.21.15.99:0/2522277705 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86c0022070 con 0x7f86c815f150 2024-09-10T07:43:29.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.730+0000 7f86cf000640 1 -- 172.21.15.99:0/2522277705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f86c815fa60 con 0x7f86c815f150 2024-09-10T07:43:29.730 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:43:29.731+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:43:29.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.733+0000 7f86c5600640 1 -- 172.21.15.99:0/2522277705 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) ==== 161+0+0 (secure 0 0 0) 0x7f86c0010040 con 0x7f86c815f150 2024-09-10T07:43:29.733 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:43:29.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.734+0000 7f86c5600640 1 -- 172.21.15.99:0/2522277705 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(160..160 src has 1..160) ==== 374+0+0 (secure 0 0 0) 0x7f86c0057bc0 con 0x7f86c815f150 2024-09-10T07:43:29.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.734+0000 7f86c5600640 1 -- 172.21.15.99:0/2522277705 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=161}) -- 0x7f86a8074380 con 0x7f86c815f150 2024-09-10T07:43:29.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.736+0000 7f86cf000640 1 -- 172.21.15.99:0/2522277705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f86a806be30 msgr2=0x7f86a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.736+0000 7f86cf000640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f86a806be30 0x7f86a806e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f86bc000f60 tx=0x7f86bc007d50 comp rx=0 tx=0).stop 2024-09-10T07:43:29.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.736+0000 7f86cf000640 1 -- 172.21.15.99:0/2522277705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c815f150 msgr2=0x7f86c80ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.736+0000 7f86cf000640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c815f150 0x7f86c80ac3a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f86c000efc0 tx=0x7f86c000c490 comp rx=0 tx=0).stop 2024-09-10T07:43:29.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.737+0000 7f86cf000640 1 -- 172.21.15.99:0/2522277705 shutdown_connections 2024-09-10T07:43:29.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.737+0000 7f86cf000640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f86a806be30 0x7f86a806e2f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.737+0000 7f86cf000640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86c815f150 0x7f86c80ac3a0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.737+0000 7f86cf000640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86c8158920 0x7f86c80aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.737+0000 7f86cf000640 1 --2- 172.21.15.99:0/2522277705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86c806ebc0 0x7f86c814aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.737+0000 7f86cf000640 1 -- 172.21.15.99:0/2522277705 >> 172.21.15.99:0/2522277705 conn(0x7f86c806bdf0 msgr2=0x7f86c81570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:29.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.737+0000 7f86cf000640 1 -- 172.21.15.99:0/2522277705 shutdown_connections 2024-09-10T07:43:29.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.738+0000 7f86cf000640 1 -- 172.21.15.99:0/2522277705 wait complete. 2024-09-10T07:43:29.754 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:43:29.799 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:43:29.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.912+0000 7f0943200640 1 Processor -- start 2024-09-10T07:43:29.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.912+0000 7f0943200640 1 -- start start 2024-09-10T07:43:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.913+0000 7f0943200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f094415bb80 0x7f094415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.913+0000 7f0943200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f094406e450 0x7f094406e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.913+0000 7f0943200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f094415d450 con 0x7f0944155c80 2024-09-10T07:43:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.913+0000 7f0943200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f094406ede0 con 0x7f094406e450 2024-09-10T07:43:29.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.913+0000 7f0943200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f09440723d0 con 0x7f094415bb80 2024-09-10T07:43:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.914+0000 7f0942800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f094406e450 0x7f094406e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.914+0000 7f0942800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f094406e450 0x7f094406e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58786/0 (socket says 172.21.15.99:58786) 2024-09-10T07:43:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.914+0000 7f0942800640 1 -- 172.21.15.99:0/4052661911 learned_addr learned my addr 172.21.15.99:0/4052661911 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:29.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.914+0000 7f0941400640 1 --2- 172.21.15.99:0/4052661911 >> v2:172.21.15.187:3300/0 conn(0x7f094415bb80 0x7f094415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.914+0000 7f0942800640 1 -- 172.21.15.99:0/4052661911 >> v2:172.21.15.187:3300/0 conn(0x7f094415bb80 msgr2=0x7f094415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:29.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.914+0000 7f0942800640 1 --2- 172.21.15.99:0/4052661911 >> v2:172.21.15.187:3300/0 conn(0x7f094415bb80 0x7f094415c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.914+0000 7f0942800640 1 -- 172.21.15.99:0/4052661911 >> v1:172.21.15.187:6789/0 conn(0x7f0944155c80 legacy=0x7f094415cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.914+0000 7f0942800640 1 -- 172.21.15.99:0/4052661911 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0944156060 con 0x7f094406e450 2024-09-10T07:43:29.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.914+0000 7f0941400640 1 --2- 172.21.15.99:0/4052661911 >> v2:172.21.15.187:3300/0 conn(0x7f094415bb80 0x7f094415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:29.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.915+0000 7f0942800640 1 --2- 172.21.15.99:0/4052661911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f094406e450 0x7f094406e8a0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f094406f640 tx=0x7f093c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b65bdd37b94edd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:29.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.915+0000 7f0940a00640 1 -- 172.21.15.99:0/4052661911 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c036070 con 0x7f094406e450 2024-09-10T07:43:29.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.916+0000 7f0940a00640 1 -- 172.21.15.99:0/4052661911 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c031600 con 0x7f094406e450 2024-09-10T07:43:29.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.916+0000 7f0940a00640 1 -- 172.21.15.99:0/4052661911 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c0319d0 con 0x7f094406e450 2024-09-10T07:43:29.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.916+0000 7f0943200640 1 -- 172.21.15.99:0/4052661911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f094406e450 msgr2=0x7f094406e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.916+0000 7f0943200640 1 --2- 172.21.15.99:0/4052661911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f094406e450 0x7f094406e8a0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f094406f640 tx=0x7f093c02a730 comp rx=0 tx=0).stop 2024-09-10T07:43:29.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.916+0000 7f0943200640 1 -- 172.21.15.99:0/4052661911 shutdown_connections 2024-09-10T07:43:29.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.916+0000 7f0943200640 1 --2- 172.21.15.99:0/4052661911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f094406e450 0x7f094406e8a0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.916+0000 7f0943200640 1 --2- 172.21.15.99:0/4052661911 >> v2:172.21.15.187:3300/0 conn(0x7f094415bb80 0x7f094415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.916+0000 7f0943200640 1 -- 172.21.15.99:0/4052661911 >> 172.21.15.99:0/4052661911 conn(0x7f09440b2810 msgr2=0x7f09440b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:29.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.916+0000 7f0943200640 1 -- 172.21.15.99:0/4052661911 shutdown_connections 2024-09-10T07:43:29.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.916+0000 7f0943200640 1 -- 172.21.15.99:0/4052661911 wait complete. 2024-09-10T07:43:29.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.918+0000 7f0943200640 1 Processor -- start 2024-09-10T07:43:29.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.918+0000 7f0943200640 1 -- start start 2024-09-10T07:43:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0943200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f094406e450 0x7f0944150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0943200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0944155c80 0x7f0944156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0943200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f094415bb80 0x7f09441573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0943200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0944072620 con 0x7f0944155c80 2024-09-10T07:43:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0943200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f094415c9d0 con 0x7f094415bb80 2024-09-10T07:43:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0943200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0944072900 con 0x7f094406e450 2024-09-10T07:43:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0941400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0944155c80 0x7f0944156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0941400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0944155c80 0x7f0944156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58796/0 (socket says 172.21.15.99:58796) 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0941400640 1 -- 172.21.15.99:0/3644356054 learned_addr learned my addr 172.21.15.99:0/3644356054 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0941e00640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f094406e450 0x7f0944150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0942800640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f094415bb80 0x7f09441573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0941400640 1 -- 172.21.15.99:0/3644356054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f094406e450 msgr2=0x7f0944150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0941400640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f094406e450 0x7f0944150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0941400640 1 -- 172.21.15.99:0/3644356054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f094415bb80 msgr2=0x7f09441573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0941400640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f094415bb80 0x7f09441573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0941400640 1 -- 172.21.15.99:0/3644356054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09440cf0f0 con 0x7f0944155c80 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0942800640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f094415bb80 0x7f09441573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.919+0000 7f0941e00640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f094406e450 0x7f0944150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.920+0000 7f0941400640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0944155c80 0x7f0944156eb0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f093000d7d0 tx=0x7f093000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.920+0000 7f093a000640 1 -- 172.21.15.99:0/3644356054 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930004030 con 0x7f0944155c80 2024-09-10T07:43:29.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.920+0000 7f093a000640 1 -- 172.21.15.99:0/3644356054 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09300041d0 con 0x7f0944155c80 2024-09-10T07:43:29.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.920+0000 7f093a000640 1 -- 172.21.15.99:0/3644356054 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09300096a0 con 0x7f0944155c80 2024-09-10T07:43:29.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.920+0000 7f0943200640 1 -- 172.21.15.99:0/3644356054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0944153b50 con 0x7f0944155c80 2024-09-10T07:43:29.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.920+0000 7f0943200640 1 -- 172.21.15.99:0/3644356054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0944154110 con 0x7f0944155c80 2024-09-10T07:43:29.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.921+0000 7f0943200640 1 -- 172.21.15.99:0/3644356054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0944071ce0 con 0x7f0944155c80 2024-09-10T07:43:29.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.922+0000 7f093a000640 1 -- 172.21.15.99:0/3644356054 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0930009840 con 0x7f0944155c80 2024-09-10T07:43:29.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.923+0000 7f093a000640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f092406be30 0x7f092406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:29.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.923+0000 7f093a000640 1 -- 172.21.15.99:0/3644356054 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5853+0+0 (secure 0 0 0) 0x7f093008b210 con 0x7f0944155c80 2024-09-10T07:43:29.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.923+0000 7f0941e00640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f092406be30 0x7f092406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:29.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.923+0000 7f093a000640 1 -- 172.21.15.99:0/3644356054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=161}) -- 0x7f0924073b20 con 0x7f0944155c80 2024-09-10T07:43:29.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.924+0000 7f0941e00640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f092406be30 0x7f092406e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0934001680 tx=0x7f0934009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:29.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:29.927+0000 7f093a000640 1 -- 172.21.15.99:0/3644356054 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0930059b20 con 0x7f0944155c80 2024-09-10T07:43:30.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.139+0000 7f0943200640 1 -- 172.21.15.99:0/3644356054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f094415de20 con 0x7f0944155c80 2024-09-10T07:43:30.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.735+0000 7f093a000640 1 -- 172.21.15.99:0/3644356054 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) ==== 104+0+0 (secure 0 0 0) 0x7f0930059420 con 0x7f0944155c80 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 -- 172.21.15.99:0/3644356054 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f092406be30 msgr2=0x7f092406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f092406be30 0x7f092406e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0934001680 tx=0x7f0934009040 comp rx=0 tx=0).stop 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 -- 172.21.15.99:0/3644356054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0944155c80 msgr2=0x7f0944156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0944155c80 0x7f0944156eb0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f093000d7d0 tx=0x7f093000dc90 comp rx=0 tx=0).stop 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 -- 172.21.15.99:0/3644356054 shutdown_connections 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f094415bb80 0x7f09441573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f092406be30 0x7f092406e2f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0944155c80 0x7f0944156eb0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 --2- 172.21.15.99:0/3644356054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f094406e450 0x7f0944150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 -- 172.21.15.99:0/3644356054 >> 172.21.15.99:0/3644356054 conn(0x7f09440b2810 msgr2=0x7f094415d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 -- 172.21.15.99:0/3644356054 shutdown_connections 2024-09-10T07:43:30.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.738+0000 7f0943200640 1 -- 172.21.15.99:0/3644356054 wait complete. 2024-09-10T07:43:30.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:43:30.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.955+0000 7fd8b5600640 1 Processor -- start 2024-09-10T07:43:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.956+0000 7fd8b5600640 1 -- start start 2024-09-10T07:43:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b5600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8b00cecc0 0x7fd8b00d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b5600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd8b00b4b40 0x7fd8b00cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b5600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b00b2370 con 0x7fd8b00b3970 2024-09-10T07:43:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b5600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd8b006ddf0 con 0x7fd8b00b4b40 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b5600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b00b2670 con 0x7fd8b00cecc0 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b4c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd8b00b4b40 0x7fd8b00cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b4c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd8b00b4b40 0x7fd8b00cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58810/0 (socket says 172.21.15.99:58810) 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b4c00640 1 -- 172.21.15.99:0/1664229704 learned_addr learned my addr 172.21.15.99:0/1664229704 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8afe00640 1 --2- 172.21.15.99:0/1664229704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8b00cecc0 0x7fd8b00d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b4c00640 1 -- 172.21.15.99:0/1664229704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8b00cecc0 msgr2=0x7fd8b00d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b4c00640 1 --2- 172.21.15.99:0/1664229704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8b00cecc0 0x7fd8b00d3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b4c00640 1 -- 172.21.15.99:0/1664229704 >> v1:172.21.15.187:6789/0 conn(0x7fd8b00b3970 legacy=0x7fd8b00b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.957+0000 7fd8b4c00640 1 -- 172.21.15.99:0/1664229704 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b00cf0a0 con 0x7fd8b00b4b40 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.958+0000 7fd8b4c00640 1 --2- 172.21.15.99:0/1664229704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b4b40 0x7fd8b00cce10 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00b2260 tx=0x7fd8a802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd85611e89448480 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:31.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8aea00640 1 -- 172.21.15.99:0/1664229704 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8036070 con 0x7fd8b00b4b40 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8aea00640 1 -- 172.21.15.99:0/1664229704 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a8031600 con 0x7fd8b00b4b40 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8aea00640 1 -- 172.21.15.99:0/1664229704 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80319d0 con 0x7fd8b00b4b40 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8b5600640 1 -- 172.21.15.99:0/1664229704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b4b40 msgr2=0x7fd8b00cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8b5600640 1 --2- 172.21.15.99:0/1664229704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b4b40 0x7fd8b00cce10 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00b2260 tx=0x7fd8a802a6a0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8b5600640 1 -- 172.21.15.99:0/1664229704 shutdown_connections 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8b5600640 1 --2- 172.21.15.99:0/1664229704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b4b40 0x7fd8b00cce10 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8b5600640 1 --2- 172.21.15.99:0/1664229704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8b00cecc0 0x7fd8b00d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8b5600640 1 -- 172.21.15.99:0/1664229704 >> 172.21.15.99:0/1664229704 conn(0x7fd8b00d2850 msgr2=0x7fd8b00d2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8b5600640 1 -- 172.21.15.99:0/1664229704 shutdown_connections 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.959+0000 7fd8b5600640 1 -- 172.21.15.99:0/1664229704 wait complete. 2024-09-10T07:43:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.961+0000 7fd8b5600640 1 Processor -- start 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.961+0000 7fd8b5600640 1 -- start start 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8b5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b3970 0x7fd8b01540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8b5600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8b00b4b40 0x7fd8b0158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8b5600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8b00cecc0 0x7fd8b0156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8b5600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b006e600 con 0x7fd8b00b3970 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8b5600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b006e320 con 0x7fd8b00cecc0 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8b5600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b00b2b00 con 0x7fd8b00b4b40 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8afe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b3970 0x7fd8b01540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8afe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b3970 0x7fd8b01540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58814/0 (socket says 172.21.15.99:58814) 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8afe00640 1 -- 172.21.15.99:0/3024145587 learned_addr learned my addr 172.21.15.99:0/3024145587 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8b4c00640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8b00cecc0 0x7fd8b0156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.962+0000 7fd8af400640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8b00b4b40 0x7fd8b0158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.963+0000 7fd8afe00640 1 -- 172.21.15.99:0/3024145587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8b00b4b40 msgr2=0x7fd8b0158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.963+0000 7fd8afe00640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8b00b4b40 0x7fd8b0158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.963+0000 7fd8afe00640 1 -- 172.21.15.99:0/3024145587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8b00cecc0 msgr2=0x7fd8b0156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.963+0000 7fd8afe00640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8b00cecc0 0x7fd8b0156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.963+0000 7fd8afe00640 1 -- 172.21.15.99:0/3024145587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b0154610 con 0x7fd8b00b3970 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.963+0000 7fd8afe00640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b3970 0x7fd8b01540d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000d5f0 tx=0x7fd8a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.963+0000 7fd8a7e00640 1 -- 172.21.15.99:0/3024145587 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00125f0 con 0x7fd8b00b3970 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.963+0000 7fd8a7e00640 1 -- 172.21.15.99:0/3024145587 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a0019070 con 0x7fd8b00b3970 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.963+0000 7fd8a7e00640 1 -- 172.21.15.99:0/3024145587 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00129d0 con 0x7fd8b00b3970 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.963+0000 7fd8b5600640 1 -- 172.21.15.99:0/3024145587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b0154a90 con 0x7fd8b00b3970 2024-09-10T07:43:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.964+0000 7fd8b5600640 1 -- 172.21.15.99:0/3024145587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b00b7470 con 0x7fd8b00b3970 2024-09-10T07:43:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.964+0000 7fd8b5600640 1 -- 172.21.15.99:0/3024145587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b00b57a0 con 0x7fd8b00b3970 2024-09-10T07:43:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.965+0000 7fd8a7e00640 1 -- 172.21.15.99:0/3024145587 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8a0012b70 con 0x7fd8b00b3970 2024-09-10T07:43:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.966+0000 7fd8a7e00640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.966+0000 7fd8a7e00640 1 -- 172.21.15.99:0/3024145587 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5853+0+0 (secure 0 0 0) 0x7fd8a008b1e0 con 0x7fd8b00b3970 2024-09-10T07:43:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.966+0000 7fd8a7e00640 1 -- 172.21.15.99:0/3024145587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=161}) -- 0x7fd890073b30 con 0x7fd8b00b3970 2024-09-10T07:43:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.966+0000 7fd8af400640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.967+0000 7fd8af400640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd89006be30 0x7fd89006e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0161b50 tx=0x7fd89c007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:30.970+0000 7fd8a7e00640 1 -- 172.21.15.99:0/3024145587 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8a0059410 con 0x7fd8b00b3970 2024-09-10T07:43:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.147+0000 7fd8b5600640 1 -- 172.21.15.99:0/3024145587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd8b00a0a80 con 0x7fd8b00b3970 2024-09-10T07:43:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.793+0000 7fd8a7e00640 1 -- 172.21.15.99:0/3024145587 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v161) ==== 181+0+0 (secure 0 0 0) 0x7fd8a005d710 con 0x7fd8b00b3970 2024-09-10T07:43:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:43:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.794+0000 7fd8a7e00640 1 -- 172.21.15.99:0/3024145587 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(161..161 src has 1..161) ==== 687+0+0 (secure 0 0 0) 0x7fd8a00bfd50 con 0x7fd8b00b3970 2024-09-10T07:43:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.794+0000 7fd8a7e00640 1 -- 172.21.15.99:0/3024145587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=162}) -- 0x7fd890071f60 con 0x7fd8b00b3970 2024-09-10T07:43:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.799+0000 7fd8b5600640 1 -- 172.21.15.99:0/3024145587 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd89006be30 msgr2=0x7fd89006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.799+0000 7fd8b5600640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd89006be30 0x7fd89006e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0161b50 tx=0x7fd89c007e30 comp rx=0 tx=0).stop 2024-09-10T07:43:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.799+0000 7fd8b5600640 1 -- 172.21.15.99:0/3024145587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b3970 msgr2=0x7fd8b01540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.799+0000 7fd8b5600640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b3970 0x7fd8b01540d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000d5f0 tx=0x7fd8a000dab0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.799+0000 7fd8b5600640 1 -- 172.21.15.99:0/3024145587 shutdown_connections 2024-09-10T07:43:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.799+0000 7fd8b5600640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8b00cecc0 0x7fd8b0156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.799+0000 7fd8b5600640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8b00b4b40 0x7fd8b0158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.799+0000 7fd8b5600640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.799+0000 7fd8b5600640 1 --2- 172.21.15.99:0/3024145587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b00b3970 0x7fd8b01540d0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.799+0000 7fd8b5600640 1 -- 172.21.15.99:0/3024145587 >> 172.21.15.99:0/3024145587 conn(0x7fd8b00d2850 msgr2=0x7fd8b0070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.800+0000 7fd8b5600640 1 -- 172.21.15.99:0/3024145587 shutdown_connections 2024-09-10T07:43:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.800+0000 7fd8b5600640 1 -- 172.21.15.99:0/3024145587 wait complete. 2024-09-10T07:43:31.821 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:43:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.980+0000 7fded9a00640 1 Processor -- start 2024-09-10T07:43:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.980+0000 7fded9a00640 1 -- start start 2024-09-10T07:43:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.982+0000 7fded9a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded415cce0 0x7fded40cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.982+0000 7fded9a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fded406d8d0 0x7fded406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.982+0000 7fded9a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded415d370 con 0x7fded40afde0 2024-09-10T07:43:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.982+0000 7fded9a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fded406e260 con 0x7fded406d8d0 2024-09-10T07:43:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.982+0000 7fded9a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fded415d140 con 0x7fded415cce0 2024-09-10T07:43:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.982+0000 7fdecbe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded415cce0 0x7fded40cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.982+0000 7fdecbe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded415cce0 0x7fded40cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:50858/0 (socket says 172.21.15.99:50858) 2024-09-10T07:43:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.982+0000 7fdecbe00640 1 -- 172.21.15.99:0/1869152205 learned_addr learned my addr 172.21.15.99:0/1869152205 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.982+0000 7fded9000640 1 --2- 172.21.15.99:0/1869152205 >> v2:172.21.15.187:3300/0 conn(0x7fded406d8d0 0x7fded406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.983+0000 7fdecbe00640 1 -- 172.21.15.99:0/1869152205 >> v2:172.21.15.187:3300/0 conn(0x7fded406d8d0 msgr2=0x7fded406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.983+0000 7fdecbe00640 1 --2- 172.21.15.99:0/1869152205 >> v2:172.21.15.187:3300/0 conn(0x7fded406d8d0 0x7fded406dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.983+0000 7fdecbe00640 1 -- 172.21.15.99:0/1869152205 >> v1:172.21.15.187:6789/0 conn(0x7fded40afde0 legacy=0x7fded40712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.983+0000 7fdecbe00640 1 -- 172.21.15.99:0/1869152205 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded415d650 con 0x7fded415cce0 2024-09-10T07:43:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.984+0000 7fdecbe00640 1 --2- 172.21.15.99:0/1869152205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded415cce0 0x7fded40cccf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009870 tx=0x7fdebc02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=665fa3658843dd18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.984+0000 7fded3400640 1 -- 172.21.15.99:0/1869152205 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc037070 con 0x7fded415cce0 2024-09-10T07:43:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.984+0000 7fded3400640 1 -- 172.21.15.99:0/1869152205 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdebc032440 con 0x7fded415cce0 2024-09-10T07:43:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.984+0000 7fded3400640 1 -- 172.21.15.99:0/1869152205 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc032810 con 0x7fded415cce0 2024-09-10T07:43:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.985+0000 7fded9a00640 1 -- 172.21.15.99:0/1869152205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded415cce0 msgr2=0x7fded40cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.985+0000 7fded9a00640 1 --2- 172.21.15.99:0/1869152205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded415cce0 0x7fded40cccf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009870 tx=0x7fdebc02a130 comp rx=0 tx=0).stop 2024-09-10T07:43:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.985+0000 7fded9a00640 1 -- 172.21.15.99:0/1869152205 shutdown_connections 2024-09-10T07:43:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.985+0000 7fded9a00640 1 --2- 172.21.15.99:0/1869152205 >> v2:172.21.15.187:3300/0 conn(0x7fded406d8d0 0x7fded406dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.985+0000 7fded9a00640 1 --2- 172.21.15.99:0/1869152205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded415cce0 0x7fded40cccf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.985+0000 7fded9a00640 1 -- 172.21.15.99:0/1869152205 >> 172.21.15.99:0/1869152205 conn(0x7fded406bc10 msgr2=0x7fded406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.985+0000 7fded9a00640 1 -- 172.21.15.99:0/1869152205 shutdown_connections 2024-09-10T07:43:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.985+0000 7fded9a00640 1 -- 172.21.15.99:0/1869152205 wait complete. 2024-09-10T07:43:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.987+0000 7fded9a00640 1 Processor -- start 2024-09-10T07:43:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.987+0000 7fded9a00640 1 -- start start 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fded9a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded406d8d0 0x7fded4156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fded9a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded40afde0 0x7fded41e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fded9a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fded415cce0 0x7fded4158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fded9a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fded415dc10 con 0x7fded40afde0 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fded9a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fded40cd230 con 0x7fded415cce0 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fded9a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fded406d3b0 con 0x7fded406d8d0 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fdecbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded40afde0 0x7fded41e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fdecbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded40afde0 0x7fded41e7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58830/0 (socket says 172.21.15.99:58830) 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fdecbe00640 1 -- 172.21.15.99:0/2066765924 learned_addr learned my addr 172.21.15.99:0/2066765924 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fded9000640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fded415cce0 0x7fded4158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fded3e00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded406d8d0 0x7fded4156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fdecbe00640 1 -- 172.21.15.99:0/2066765924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded406d8d0 msgr2=0x7fded4156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fdecbe00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded406d8d0 0x7fded4156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fdecbe00640 1 -- 172.21.15.99:0/2066765924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fded415cce0 msgr2=0x7fded4158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fdecbe00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fded415cce0 0x7fded4158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.988+0000 7fdecbe00640 1 -- 172.21.15.99:0/2066765924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded41e7570 con 0x7fded40afde0 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.989+0000 7fdecbe00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded40afde0 0x7fded41e7030 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0090b0 tx=0x7fdebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.989+0000 7fded0c00640 1 -- 172.21.15.99:0/2066765924 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc037040 con 0x7fded40afde0 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.989+0000 7fded0c00640 1 -- 172.21.15.99:0/2066765924 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdebc042070 con 0x7fded40afde0 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.989+0000 7fded9a00640 1 -- 172.21.15.99:0/2066765924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded4158770 con 0x7fded40afde0 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.989+0000 7fded0c00640 1 -- 172.21.15.99:0/2066765924 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc030900 con 0x7fded40afde0 2024-09-10T07:43:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.989+0000 7fded9a00640 1 -- 172.21.15.99:0/2066765924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded4158cf0 con 0x7fded40afde0 2024-09-10T07:43:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.990+0000 7fded9a00640 1 -- 172.21.15.99:0/2066765924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded4071ac0 con 0x7fded40afde0 2024-09-10T07:43:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.991+0000 7fded0c00640 1 -- 172.21.15.99:0/2066765924 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdebc030aa0 con 0x7fded40afde0 2024-09-10T07:43:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.992+0000 7fded0c00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdeb006be30 0x7fdeb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:31.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.992+0000 7fded0c00640 1 -- 172.21.15.99:0/2066765924 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5415+0+0 (secure 0 0 0) 0x7fdebc0ab4e0 con 0x7fded40afde0 2024-09-10T07:43:31.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.992+0000 7fded3e00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdeb006be30 0x7fdeb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:31.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.993+0000 7fded3e00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdeb006be30 0x7fdeb006e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdec4001780 tx=0x7fdec4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:31.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:31.996+0000 7fded0c00640 1 -- 172.21.15.99:0/2066765924 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdebc0799f0 con 0x7fded40afde0 2024-09-10T07:43:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:32.169+0000 7fded9a00640 1 -- 172.21.15.99:0/2066765924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fded4072650 con 0x7fded40afde0 2024-09-10T07:43:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.020+0000 7fded0c00640 1 -- 172.21.15.99:0/2066765924 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v162) ==== 169+0+0 (secure 0 0 0) 0x7fdebc07dcf0 con 0x7fded40afde0 2024-09-10T07:43:33.020 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:43:33.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.029+0000 7fded9a00640 1 -- 172.21.15.99:0/2066765924 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdeb006be30 msgr2=0x7fdeb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.029+0000 7fded9a00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdeb006be30 0x7fdeb006e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdec4001780 tx=0x7fdec4009040 comp rx=0 tx=0).stop 2024-09-10T07:43:33.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.029+0000 7fded9a00640 1 -- 172.21.15.99:0/2066765924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded40afde0 msgr2=0x7fded41e7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.029+0000 7fded9a00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded40afde0 0x7fded41e7030 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0090b0 tx=0x7fdebc0046c0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.031+0000 7fded9a00640 1 -- 172.21.15.99:0/2066765924 shutdown_connections 2024-09-10T07:43:33.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.031+0000 7fded9a00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fded415cce0 0x7fded4158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.031+0000 7fded9a00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdeb006be30 0x7fdeb006e2f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.031+0000 7fded9a00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded40afde0 0x7fded41e7030 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.031+0000 7fded9a00640 1 --2- 172.21.15.99:0/2066765924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fded406d8d0 0x7fded4156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.031+0000 7fded9a00640 1 -- 172.21.15.99:0/2066765924 >> 172.21.15.99:0/2066765924 conn(0x7fded406bc10 msgr2=0x7fded40d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:33.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.032+0000 7fded9a00640 1 -- 172.21.15.99:0/2066765924 shutdown_connections 2024-09-10T07:43:33.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.032+0000 7fded9a00640 1 -- 172.21.15.99:0/2066765924 wait complete. 2024-09-10T07:43:33.049 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T07:43:33.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.207+0000 7fdf67400640 1 Processor -- start 2024-09-10T07:43:33.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.208+0000 7fdf67400640 1 -- start start 2024-09-10T07:43:33.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.209+0000 7fdf67400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf60071df0 0x7fdf60073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.209+0000 7fdf67400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdf600d1010 0x7fdf600ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.209+0000 7fdf67400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf600722d0 con 0x7fdf6006e280 2024-09-10T07:43:33.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.209+0000 7fdf67400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fdf600738b0 con 0x7fdf600d1010 2024-09-10T07:43:33.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.209+0000 7fdf67400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdf600725b0 con 0x7fdf60071df0 2024-09-10T07:43:33.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.209+0000 7fdf57e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf60071df0 0x7fdf60073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.209+0000 7fdf57e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf60071df0 0x7fdf60073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:50870/0 (socket says 172.21.15.99:50870) 2024-09-10T07:43:33.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.209+0000 7fdf57e00640 1 -- 172.21.15.99:0/1673620724 learned_addr learned my addr 172.21.15.99:0/1673620724 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:33.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.209+0000 7fdf65400640 1 --2- 172.21.15.99:0/1673620724 >> v2:172.21.15.187:3300/0 conn(0x7fdf600d1010 0x7fdf600ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.210+0000 7fdf57e00640 1 -- 172.21.15.99:0/1673620724 >> v2:172.21.15.187:3300/0 conn(0x7fdf600d1010 msgr2=0x7fdf600ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:33.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.210+0000 7fdf57e00640 1 --2- 172.21.15.99:0/1673620724 >> v2:172.21.15.187:3300/0 conn(0x7fdf600d1010 0x7fdf600ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.210+0000 7fdf5fe00640 1 -- 172.21.15.99:0/1673620724 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256828408 0 0) 0x7fdf600722d0 con 0x7fdf6006e280 2024-09-10T07:43:33.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.210+0000 7fdf57e00640 1 -- 172.21.15.99:0/1673620724 >> v1:172.21.15.187:6789/0 conn(0x7fdf6006e280 legacy=0x7fdf6006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.210+0000 7fdf57e00640 1 -- 172.21.15.99:0/1673620724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf60072890 con 0x7fdf60071df0 2024-09-10T07:43:33.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.211+0000 7fdf57e00640 1 --2- 172.21.15.99:0/1673620724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf60071df0 0x7fdf60073370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009870 tx=0x7fdf4802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a53efb7a7ee7179a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:33.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.211+0000 7fdf5fe00640 1 -- 172.21.15.99:0/1673620724 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48037070 con 0x7fdf60071df0 2024-09-10T07:43:33.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.211+0000 7fdf5fe00640 1 -- 172.21.15.99:0/1673620724 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf48032440 con 0x7fdf60071df0 2024-09-10T07:43:33.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.211+0000 7fdf5fe00640 1 -- 172.21.15.99:0/1673620724 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48032810 con 0x7fdf60071df0 2024-09-10T07:43:33.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.212+0000 7fdf67400640 1 -- 172.21.15.99:0/1673620724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf60071df0 msgr2=0x7fdf60073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.212+0000 7fdf67400640 1 --2- 172.21.15.99:0/1673620724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf60071df0 0x7fdf60073370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009870 tx=0x7fdf4802a250 comp rx=0 tx=0).stop 2024-09-10T07:43:33.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.212+0000 7fdf67400640 1 -- 172.21.15.99:0/1673620724 shutdown_connections 2024-09-10T07:43:33.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.212+0000 7fdf67400640 1 --2- 172.21.15.99:0/1673620724 >> v2:172.21.15.187:3300/0 conn(0x7fdf600d1010 0x7fdf600ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.212+0000 7fdf67400640 1 --2- 172.21.15.99:0/1673620724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf60071df0 0x7fdf60073370 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.212+0000 7fdf67400640 1 -- 172.21.15.99:0/1673620724 >> 172.21.15.99:0/1673620724 conn(0x7fdf6006bc10 msgr2=0x7fdf6006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:33.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.212+0000 7fdf67400640 1 -- 172.21.15.99:0/1673620724 shutdown_connections 2024-09-10T07:43:33.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.212+0000 7fdf67400640 1 -- 172.21.15.99:0/1673620724 wait complete. 2024-09-10T07:43:33.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.214+0000 7fdf67400640 1 Processor -- start 2024-09-10T07:43:33.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.214+0000 7fdf67400640 1 -- start start 2024-09-10T07:43:33.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf67400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6006e280 0x7fdf600b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf67400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf60071df0 0x7fdf600b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf67400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf600d1010 0x7fdf601594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf67400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6015db60 con 0x7fdf60071df0 2024-09-10T07:43:33.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf67400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60072e50 con 0x7fdf6006e280 2024-09-10T07:43:33.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf67400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdf600d1490 con 0x7fdf600d1010 2024-09-10T07:43:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf57e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf60071df0 0x7fdf600b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf57e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf60071df0 0x7fdf600b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58832/0 (socket says 172.21.15.99:58832) 2024-09-10T07:43:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf57e00640 1 -- 172.21.15.99:0/1314857355 learned_addr learned my addr 172.21.15.99:0/1314857355 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf65400640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf600d1010 0x7fdf601594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf64a00640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6006e280 0x7fdf600b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf57e00640 1 -- 172.21.15.99:0/1314857355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf600d1010 msgr2=0x7fdf601594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf57e00640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf600d1010 0x7fdf601594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf57e00640 1 -- 172.21.15.99:0/1314857355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6006e280 msgr2=0x7fdf600b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf57e00640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6006e280 0x7fdf600b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.215+0000 7fdf57e00640 1 -- 172.21.15.99:0/1314857355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf60158d50 con 0x7fdf60071df0 2024-09-10T07:43:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.216+0000 7fdf57e00640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf60071df0 0x7fdf600b3e90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fdf48035040 tx=0x7fdf480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.216+0000 7fdf5d600640 1 -- 172.21.15.99:0/1314857355 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48037040 con 0x7fdf60071df0 2024-09-10T07:43:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.216+0000 7fdf5d600640 1 -- 172.21.15.99:0/1314857355 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf48004230 con 0x7fdf60071df0 2024-09-10T07:43:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.216+0000 7fdf5d600640 1 -- 172.21.15.99:0/1314857355 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48003610 con 0x7fdf60071df0 2024-09-10T07:43:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.216+0000 7fdf67400640 1 -- 172.21.15.99:0/1314857355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf600b5940 con 0x7fdf60071df0 2024-09-10T07:43:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.216+0000 7fdf67400640 1 -- 172.21.15.99:0/1314857355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf600b5660 con 0x7fdf60071df0 2024-09-10T07:43:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.217+0000 7fdf67400640 1 -- 172.21.15.99:0/1314857355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf60073370 con 0x7fdf60071df0 2024-09-10T07:43:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.218+0000 7fdf5d600640 1 -- 172.21.15.99:0/1314857355 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf480037b0 con 0x7fdf60071df0 2024-09-10T07:43:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.219+0000 7fdf5d600640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.219+0000 7fdf5d600640 1 -- 172.21.15.99:0/1314857355 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4943+0+0 (secure 0 0 0) 0x7fdf480ab720 con 0x7fdf60071df0 2024-09-10T07:43:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.220+0000 7fdf64a00640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.220+0000 7fdf64a00640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdf50000f60 tx=0x7fdf50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.224+0000 7fdf5d600640 1 -- 172.21.15.99:0/1314857355 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf48079d70 con 0x7fdf60071df0 2024-09-10T07:43:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.396+0000 7fdf67400640 1 -- 172.21.15.99:0/1314857355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fdf60156110 con 0x7fdf60071df0 2024-09-10T07:43:33.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.400+0000 7fdf5d600640 1 -- 172.21.15.99:0/1314857355 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7fdf4807e070 con 0x7fdf60071df0 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 -- 172.21.15.99:0/1314857355 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdf3c06be30 msgr2=0x7fdf3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdf50000f60 tx=0x7fdf50009040 comp rx=0 tx=0).stop 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 -- 172.21.15.99:0/1314857355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf60071df0 msgr2=0x7fdf600b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf60071df0 0x7fdf600b3e90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fdf48035040 tx=0x7fdf480046c0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 -- 172.21.15.99:0/1314857355 shutdown_connections 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf600d1010 0x7fdf601594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdf3c06be30 0x7fdf3c06e2f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf60071df0 0x7fdf600b3e90 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 --2- 172.21.15.99:0/1314857355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6006e280 0x7fdf600b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 -- 172.21.15.99:0/1314857355 >> 172.21.15.99:0/1314857355 conn(0x7fdf6006bc10 msgr2=0x7fdf6015ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 -- 172.21.15.99:0/1314857355 shutdown_connections 2024-09-10T07:43:33.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.403+0000 7fdf67400640 1 -- 172.21.15.99:0/1314857355 wait complete. 2024-09-10T07:43:33.419 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-10T07:43:33.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.573+0000 7fe64d600640 1 Processor -- start 2024-09-10T07:43:33.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.573+0000 7fe64d600640 1 -- start start 2024-09-10T07:43:33.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe64d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 0x7fe6480afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe64d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe6480cf830 0x7fe6480b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe64d600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe6480cfc70 0x7fe6480b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe64d600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe6480b0200 con 0x7fe6480cf830 2024-09-10T07:43:33.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe64d600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fe6480aec20 con 0x7fe6480cfc70 2024-09-10T07:43:33.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe64d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe6480aef00 con 0x7fe64815ede0 2024-09-10T07:43:33.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe63e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe6480cf830 0x7fe6480b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe63e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe6480cf830 0x7fe6480b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58838/0 (socket says 172.21.15.99:58838) 2024-09-10T07:43:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe63e000640 1 -- 172.21.15.99:0/3490400288 learned_addr learned my addr 172.21.15.99:0/3490400288 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe646a00640 1 --2- 172.21.15.99:0/3490400288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 0x7fe6480afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe647400640 1 --2- 172.21.15.99:0/3490400288 >> v2:172.21.15.187:3300/0 conn(0x7fe6480cfc70 0x7fe6480b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe63e000640 1 -- 172.21.15.99:0/3490400288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 msgr2=0x7fe6480afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe63e000640 1 --2- 172.21.15.99:0/3490400288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 0x7fe6480afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe63e000640 1 -- 172.21.15.99:0/3490400288 >> v2:172.21.15.187:3300/0 conn(0x7fe6480cfc70 msgr2=0x7fe6480b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.575+0000 7fe63e000640 1 --2- 172.21.15.99:0/3490400288 >> v2:172.21.15.187:3300/0 conn(0x7fe6480cfc70 0x7fe6480b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.576+0000 7fe63e000640 1 -- 172.21.15.99:0/3490400288 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6480af1e0 con 0x7fe6480cf830 2024-09-10T07:43:33.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.576+0000 7fe63e000640 1 --2- 172.21.15.99:0/3490400288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cf830 0x7fe6480b43b0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe6480714a0 tx=0x7fe63002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a940480f51773c22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:33.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe646000640 1 -- 172.21.15.99:0/3490400288 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630037070 con 0x7fe6480cf830 2024-09-10T07:43:33.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe646000640 1 -- 172.21.15.99:0/3490400288 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe630032440 con 0x7fe6480cf830 2024-09-10T07:43:33.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe646000640 1 -- 172.21.15.99:0/3490400288 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630032810 con 0x7fe6480cf830 2024-09-10T07:43:33.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe64d600640 1 -- 172.21.15.99:0/3490400288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cf830 msgr2=0x7fe6480b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe64d600640 1 --2- 172.21.15.99:0/3490400288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cf830 0x7fe6480b43b0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe6480714a0 tx=0x7fe63002a1e0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe64d600640 1 -- 172.21.15.99:0/3490400288 shutdown_connections 2024-09-10T07:43:33.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe64d600640 1 --2- 172.21.15.99:0/3490400288 >> v2:172.21.15.187:3300/0 conn(0x7fe6480cfc70 0x7fe6480b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe64d600640 1 --2- 172.21.15.99:0/3490400288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cf830 0x7fe6480b43b0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe64d600640 1 --2- 172.21.15.99:0/3490400288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 0x7fe6480afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe64d600640 1 -- 172.21.15.99:0/3490400288 >> 172.21.15.99:0/3490400288 conn(0x7fe64806bc10 msgr2=0x7fe64806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:33.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe64d600640 1 -- 172.21.15.99:0/3490400288 shutdown_connections 2024-09-10T07:43:33.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.577+0000 7fe64d600640 1 -- 172.21.15.99:0/3490400288 wait complete. 2024-09-10T07:43:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.579+0000 7fe64d600640 1 Processor -- start 2024-09-10T07:43:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.579+0000 7fe64d600640 1 -- start start 2024-09-10T07:43:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.580+0000 7fe64d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6480cf830 0x7fe6481518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.580+0000 7fe64d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cfc70 0x7fe648155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.580+0000 7fe64d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 0x7fe648157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.580+0000 7fe64d600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe6480ae840 con 0x7fe6480cfc70 2024-09-10T07:43:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.580+0000 7fe64d600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe6480af7a0 con 0x7fe6480cf830 2024-09-10T07:43:33.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.580+0000 7fe64d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe6480ae9c0 con 0x7fe64815ede0 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.580+0000 7fe63e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cfc70 0x7fe648155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.580+0000 7fe63e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cfc70 0x7fe648155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58844/0 (socket says 172.21.15.99:58844) 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.580+0000 7fe63e000640 1 -- 172.21.15.99:0/2012322763 learned_addr learned my addr 172.21.15.99:0/2012322763 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe647400640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 0x7fe648157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe63e000640 1 -- 172.21.15.99:0/2012322763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 msgr2=0x7fe648157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe63e000640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 0x7fe648157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe63e000640 1 -- 172.21.15.99:0/2012322763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6480cf830 msgr2=0x7fe6481518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe646a00640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6480cf830 0x7fe6481518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe63e000640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6480cf830 0x7fe6481518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe63e000640 1 -- 172.21.15.99:0/2012322763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6481618d0 con 0x7fe6480cfc70 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe647400640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 0x7fe648157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe63e000640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cfc70 0x7fe648155a30 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe630000c00 tx=0x7fe6300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe63f400640 1 -- 172.21.15.99:0/2012322763 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630041020 con 0x7fe6480cfc70 2024-09-10T07:43:33.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe63f400640 1 -- 172.21.15.99:0/2012322763 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6300306c0 con 0x7fe6480cfc70 2024-09-10T07:43:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe63f400640 1 -- 172.21.15.99:0/2012322763 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630037040 con 0x7fe6480cfc70 2024-09-10T07:43:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.581+0000 7fe64d600640 1 -- 172.21.15.99:0/2012322763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe648161bb0 con 0x7fe6480cfc70 2024-09-10T07:43:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.582+0000 7fe64d600640 1 -- 172.21.15.99:0/2012322763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6481614f0 con 0x7fe6480cfc70 2024-09-10T07:43:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.583+0000 7fe64d600640 1 -- 172.21.15.99:0/2012322763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6480afcc0 con 0x7fe6480cfc70 2024-09-10T07:43:33.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.583+0000 7fe63f400640 1 -- 172.21.15.99:0/2012322763 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe630044020 con 0x7fe6480cfc70 2024-09-10T07:43:33.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.584+0000 7fe63f400640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe62406be30 0x7fe62406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:33.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.584+0000 7fe63f400640 1 -- 172.21.15.99:0/2012322763 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4943+0+0 (secure 0 0 0) 0x7fe6300ab470 con 0x7fe6480cfc70 2024-09-10T07:43:33.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.584+0000 7fe646a00640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe62406be30 0x7fe62406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:33.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.585+0000 7fe646a00640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe62406be30 0x7fe62406e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe638006fd0 tx=0x7fe638008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.588+0000 7fe63f400640 1 -- 172.21.15.99:0/2012322763 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe63004b030 con 0x7fe6480cfc70 2024-09-10T07:43:33.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:33.829+0000 7fe64d600640 1 -- 172.21.15.99:0/2012322763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) -- 0x7fe648071e10 con 0x7fe6480cfc70 2024-09-10T07:43:34.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.022+0000 7fe63f400640 1 -- 172.21.15.99:0/2012322763 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v445) ==== 132+0+0 (secure 0 0 0) 0x7fe63007a080 con 0x7fe6480cfc70 2024-09-10T07:43:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 -- 172.21.15.99:0/2012322763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe62406be30 msgr2=0x7fe62406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe62406be30 0x7fe62406e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe638006fd0 tx=0x7fe638008040 comp rx=0 tx=0).stop 2024-09-10T07:43:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 -- 172.21.15.99:0/2012322763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cfc70 msgr2=0x7fe648155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cfc70 0x7fe648155a30 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe630000c00 tx=0x7fe6300046c0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 -- 172.21.15.99:0/2012322763 shutdown_connections 2024-09-10T07:43:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe64815ede0 0x7fe648157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe62406be30 0x7fe62406e2f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6480cfc70 0x7fe648155a30 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 --2- 172.21.15.99:0/2012322763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6480cf830 0x7fe6481518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 -- 172.21.15.99:0/2012322763 >> 172.21.15.99:0/2012322763 conn(0x7fe64806bc10 msgr2=0x7fe64815c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:34.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 -- 172.21.15.99:0/2012322763 shutdown_connections 2024-09-10T07:43:34.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.025+0000 7fe64d600640 1 -- 172.21.15.99:0/2012322763 wait complete. 2024-09-10T07:43:34.041 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-10T07:43:34.041 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2024-09-10T07:43:34.041 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2024-09-10T07:43:34.042 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:43:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.195+0000 7f8558c00640 1 Processor -- start 2024-09-10T07:43:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.195+0000 7f8558c00640 1 -- start start 2024-09-10T07:43:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.196+0000 7f8558c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 0x7f85540d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.196+0000 7f8558c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85540d2680 0x7f85540cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.196+0000 7f8558c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85540d2bd0 con 0x7f85540cfac0 2024-09-10T07:43:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.196+0000 7f8558c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f85540d37e0 con 0x7f85540d2680 2024-09-10T07:43:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.196+0000 7f8558c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f85540d2eb0 con 0x7f855415e970 2024-09-10T07:43:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.197+0000 7f8552a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f85540d2680 0x7f85540cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.197+0000 7f8553e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f85540cfac0 0x7f85540d0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32898/0 (socket says 172.21.15.99:32898) 2024-09-10T07:43:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.197+0000 7f8553e00640 1 -- 172.21.15.99:0/2617779363 learned_addr learned my addr 172.21.15.99:0/2617779363 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:34.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.197+0000 7f8553400640 1 --2- 172.21.15.99:0/2617779363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 0x7f85540d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.197+0000 7f8552a00640 1 -- 172.21.15.99:0/2617779363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 msgr2=0x7f85540d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:34.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.197+0000 7f8552a00640 1 --2- 172.21.15.99:0/2617779363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 0x7f85540d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.197+0000 7f8552a00640 1 -- 172.21.15.99:0/2617779363 >> v1:172.21.15.99:6789/0 conn(0x7f85540cfac0 legacy=0x7f85540d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.197+0000 7f8552a00640 1 -- 172.21.15.99:0/2617779363 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85540d3190 con 0x7f85540d2680 2024-09-10T07:43:34.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.197+0000 7f8552000640 1 -- 172.21.15.99:0/2617779363 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355100002 0 0) 0x7f85540d2bd0 con 0x7f85540cfac0 2024-09-10T07:43:34.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.197+0000 7f8553400640 1 --2- 172.21.15.99:0/2617779363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 0x7f85540d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:34.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.198+0000 7f8552a00640 1 --2- 172.21.15.99:0/2617779363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540d2680 0x7f85540cf580 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f85400097a0 tx=0x7f854002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b89f6d56f32f4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.198+0000 7f8552000640 1 -- 172.21.15.99:0/2617779363 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540037070 con 0x7f85540d2680 2024-09-10T07:43:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.198+0000 7f8552000640 1 -- 172.21.15.99:0/2617779363 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8540032440 con 0x7f85540d2680 2024-09-10T07:43:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.198+0000 7f8552000640 1 -- 172.21.15.99:0/2617779363 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540032810 con 0x7f85540d2680 2024-09-10T07:43:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.199+0000 7f8558c00640 1 -- 172.21.15.99:0/2617779363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540d2680 msgr2=0x7f85540cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.199+0000 7f8558c00640 1 --2- 172.21.15.99:0/2617779363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540d2680 0x7f85540cf580 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f85400097a0 tx=0x7f854002a210 comp rx=0 tx=0).stop 2024-09-10T07:43:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.199+0000 7f8558c00640 1 -- 172.21.15.99:0/2617779363 shutdown_connections 2024-09-10T07:43:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.199+0000 7f8558c00640 1 --2- 172.21.15.99:0/2617779363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540d2680 0x7f85540cf580 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.199+0000 7f8558c00640 1 --2- 172.21.15.99:0/2617779363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 0x7f85540d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.199+0000 7f8558c00640 1 -- 172.21.15.99:0/2617779363 >> 172.21.15.99:0/2617779363 conn(0x7f855409de00 msgr2=0x7f85540d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.199+0000 7f8558c00640 1 -- 172.21.15.99:0/2617779363 shutdown_connections 2024-09-10T07:43:34.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.199+0000 7f8558c00640 1 -- 172.21.15.99:0/2617779363 wait complete. 2024-09-10T07:43:34.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.201+0000 7f8558c00640 1 Processor -- start 2024-09-10T07:43:34.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.201+0000 7f8558c00640 1 -- start start 2024-09-10T07:43:34.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8558c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540cfac0 0x7f85540ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8558c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85540d2680 0x7f85540ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8558c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 0x7f85540caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8558c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f85540d0840 con 0x7f85540cfac0 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8558c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f85540cff70 con 0x7f85540d2680 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8558c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f855415ed50 con 0x7f855415e970 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8553400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540cfac0 0x7f85540ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8553400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540cfac0 0x7f85540ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58852/0 (socket says 172.21.15.99:58852) 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8553400640 1 -- 172.21.15.99:0/3754462582 learned_addr learned my addr 172.21.15.99:0/3754462582 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8553e00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 0x7f85540caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8552a00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85540d2680 0x7f85540ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8553400640 1 -- 172.21.15.99:0/3754462582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 msgr2=0x7f85540caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8553400640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 0x7f85540caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8553400640 1 -- 172.21.15.99:0/3754462582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85540d2680 msgr2=0x7f85540ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8553400640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85540d2680 0x7f85540ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8553400640 1 -- 172.21.15.99:0/3754462582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85540b9de0 con 0x7f85540cfac0 2024-09-10T07:43:34.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.202+0000 7f8552a00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85540d2680 0x7f85540ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:34.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.203+0000 7f8553400640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540cfac0 0x7f85540ce750 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f854400d7d0 tx=0x7f854400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:34.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.203+0000 7f854b400640 1 -- 172.21.15.99:0/3754462582 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544004030 con 0x7f85540cfac0 2024-09-10T07:43:34.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.203+0000 7f854b400640 1 -- 172.21.15.99:0/3754462582 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85440041d0 con 0x7f85540cfac0 2024-09-10T07:43:34.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.203+0000 7f8558c00640 1 -- 172.21.15.99:0/3754462582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85540ba0c0 con 0x7f85540cfac0 2024-09-10T07:43:34.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.203+0000 7f854b400640 1 -- 172.21.15.99:0/3754462582 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854400b6c0 con 0x7f85540cfac0 2024-09-10T07:43:34.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.203+0000 7f8558c00640 1 -- 172.21.15.99:0/3754462582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85540ba680 con 0x7f85540cfac0 2024-09-10T07:43:34.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.204+0000 7f8558c00640 1 -- 172.21.15.99:0/3754462582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85540cf580 con 0x7f85540cfac0 2024-09-10T07:43:34.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.205+0000 7f854b400640 1 -- 172.21.15.99:0/3754462582 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f854400b860 con 0x7f85540cfac0 2024-09-10T07:43:34.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.206+0000 7f854b400640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f853406be30 0x7f853406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.206+0000 7f854b400640 1 -- 172.21.15.99:0/3754462582 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4943+0+0 (secure 0 0 0) 0x7f854408ae80 con 0x7f85540cfac0 2024-09-10T07:43:34.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.206+0000 7f8552a00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f853406be30 0x7f853406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.207+0000 7f8552a00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f853406be30 0x7f853406e2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8540034000 tx=0x7f854002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.210+0000 7f854b400640 1 -- 172.21.15.99:0/3754462582 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8544059b20 con 0x7f85540cfac0 2024-09-10T07:43:34.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.386+0000 7f8558c00640 1 -- 172.21.15.99:0/3754462582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85540b5c00 con 0x7f85540cfac0 2024-09-10T07:43:34.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.387+0000 7f854b400640 1 -- 172.21.15.99:0/3754462582 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) ==== 74+0+13019 (secure 0 0 0) 0x7f8544059420 con 0x7f85540cfac0 2024-09-10T07:43:34.387 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:34.387 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":162,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:43:33.012242+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6837/2751383266":"2024-09-11T07:43:29.732339+0000","172.21.15.99:6835/2751383266":"2024-09-11T07:43:29.732339+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:43:34.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.389+0000 7f8558c00640 1 -- 172.21.15.99:0/3754462582 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f853406be30 msgr2=0x7f853406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.389+0000 7f8558c00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f853406be30 0x7f853406e2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8540034000 tx=0x7f854002e000 comp rx=0 tx=0).stop 2024-09-10T07:43:34.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.389+0000 7f8558c00640 1 -- 172.21.15.99:0/3754462582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540cfac0 msgr2=0x7f85540ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.389+0000 7f8558c00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540cfac0 0x7f85540ce750 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f854400d7d0 tx=0x7f854400dc90 comp rx=0 tx=0).stop 2024-09-10T07:43:34.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.389+0000 7f8558c00640 1 -- 172.21.15.99:0/3754462582 shutdown_connections 2024-09-10T07:43:34.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.389+0000 7f8558c00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f855415e970 0x7f85540caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.389+0000 7f8558c00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85540d2680 0x7f85540ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.389+0000 7f8558c00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f853406be30 0x7f853406e2f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.389+0000 7f8558c00640 1 --2- 172.21.15.99:0/3754462582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85540cfac0 0x7f85540ce750 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.389+0000 7f8558c00640 1 -- 172.21.15.99:0/3754462582 >> 172.21.15.99:0/3754462582 conn(0x7f855409de00 msgr2=0x7f85540d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:34.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.390+0000 7f8558c00640 1 -- 172.21.15.99:0/3754462582 shutdown_connections 2024-09-10T07:43:34.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.390+0000 7f8558c00640 1 -- 172.21.15.99:0/3754462582 wait complete. 2024-09-10T07:43:34.406 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:34:08.744575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:43:34.406 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:43:34.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.562+0000 7f09f8e00640 1 Processor -- start 2024-09-10T07:43:34.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.562+0000 7f09f8e00640 1 -- start start 2024-09-10T07:43:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09f8e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f415eab0 0x7f09f40b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09f8e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f09f40d3230 0x7f09f40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09f8e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f40d3710 con 0x7f09f4070b40 2024-09-10T07:43:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09f8e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f09f40b6390 con 0x7f09f40d3230 2024-09-10T07:43:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09f8e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f09f40b6670 con 0x7f09f415eab0 2024-09-10T07:43:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09eaa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f09f4070b40 0x7f09f406cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32910/0 (socket says 172.21.15.99:32910) 2024-09-10T07:43:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09eaa00640 1 -- 172.21.15.99:0/1431574878 learned_addr learned my addr 172.21.15.99:0/1431574878 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09f3400640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f415eab0 0x7f09f40b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09f3e00640 1 --2- 172.21.15.99:0/1431574878 >> v2:172.21.15.187:3300/0 conn(0x7f09f40d3230 0x7f09f40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125403710 0 0) 0x7f09f40d3710 con 0x7f09f4070b40 2024-09-10T07:43:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.564+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09d8003520 con 0x7f09f4070b40 2024-09-10T07:43:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3395935099 0 0) 0x7f09d8003520 con 0x7f09f4070b40 2024-09-10T07:43:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f415eab0 msgr2=0x7f09f40b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f415eab0 0x7f09f40b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 >> v2:172.21.15.187:3300/0 conn(0x7f09f40d3230 msgr2=0x7f09f40b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 --2- 172.21.15.99:0/1431574878 >> v2:172.21.15.187:3300/0 conn(0x7f09f40d3230 0x7f09f40b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f40b6950 con 0x7f09f4070b40 2024-09-10T07:43:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f09dc001670 con 0x7f09f4070b40 2024-09-10T07:43:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 >> v1:172.21.15.99:6789/0 conn(0x7f09f4070b40 legacy=0x7f09f406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09d80039b0 0x7f09d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 0x7f09d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f415eab0 0x7f09d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40b6390 con 0x7f09d8004800 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40b6670 con 0x7f09d80039b0 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f09d800baa0 con 0x7f09f415eab0 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09eaa00640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 0x7f09d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f3400640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09d80039b0 0x7f09d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09f3e00640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f415eab0 0x7f09d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09eaa00640 1 -- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f415eab0 msgr2=0x7f09d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09eaa00640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f415eab0 0x7f09d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09eaa00640 1 -- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09d80039b0 msgr2=0x7f09d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.565+0000 7f09eaa00640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09d80039b0 0x7f09d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.566+0000 7f09eaa00640 1 -- 172.21.15.99:0/1431574878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d8003520 con 0x7f09d8004800 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.566+0000 7f09eaa00640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 0x7f09d8004c80 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f09dc001eb0 tx=0x7f09d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbc452405cebdb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.567+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc007c80 con 0x7f09d8004800 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.567+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09dc005ad0 con 0x7f09d8004800 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.567+0000 7f09f2a00640 1 -- 172.21.15.99:0/1431574878 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc007070 con 0x7f09d8004800 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.567+0000 7f09f8e00640 1 -- 172.21.15.99:0/1431574878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 msgr2=0x7f09d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.567+0000 7f09f8e00640 1 --2- 172.21.15.99:0/1431574878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 0x7f09d8004c80 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f09dc001eb0 tx=0x7f09d8005830 comp rx=0 tx=0).stop 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.567+0000 7f09f3e00640 1 -- 172.21.15.99:0/1431574878 reap_dead start 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.567+0000 7f09f8e00640 1 -- 172.21.15.99:0/1431574878 shutdown_connections 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.567+0000 7f09f8e00640 1 -- 172.21.15.99:0/1431574878 >> 172.21.15.99:0/1431574878 conn(0x7f09f40b7cc0 msgr2=0x7f09f40b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.567+0000 7f09f8e00640 1 -- 172.21.15.99:0/1431574878 shutdown_connections 2024-09-10T07:43:34.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.567+0000 7f09f8e00640 1 -- 172.21.15.99:0/1431574878 wait complete. 2024-09-10T07:43:34.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.569+0000 7f09f8e00640 1 Processor -- start 2024-09-10T07:43:34.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.569+0000 7f09f8e00640 1 -- start start 2024-09-10T07:43:34.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.570+0000 7f09f8e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 0x7f09f414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.570+0000 7f09f8e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f4158530 0x7f09f409f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.570+0000 7f09f8e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09f40b21f0 0x7f09f40b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.570+0000 7f09f8e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f09f415ee90 con 0x7f09d8004800 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.570+0000 7f09f8e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f09f406d430 con 0x7f09f40b21f0 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.570+0000 7f09f8e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f09f409fa40 con 0x7f09f4158530 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.570+0000 7f09f3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 0x7f09f414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.570+0000 7f09f3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 0x7f09f414f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58870/0 (socket says 172.21.15.99:58870) 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.570+0000 7f09f3400640 1 -- 172.21.15.99:0/227242536 learned_addr learned my addr 172.21.15.99:0/227242536 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09eaa00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f4158530 0x7f09f409f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09f3e00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09f40b21f0 0x7f09f40b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09f3400640 1 -- 172.21.15.99:0/227242536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f4158530 msgr2=0x7f09f409f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09f3400640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f4158530 0x7f09f409f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09f3400640 1 -- 172.21.15.99:0/227242536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09f40b21f0 msgr2=0x7f09f40b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09f3400640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09f40b21f0 0x7f09f40b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09f3400640 1 -- 172.21.15.99:0/227242536 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f409fd20 con 0x7f09d8004800 2024-09-10T07:43:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09f3400640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 0x7f09f414f500 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f09e40118e0 tx=0x7f09e4011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09ebe00640 1 -- 172.21.15.99:0/227242536 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e400fa90 con 0x7f09d8004800 2024-09-10T07:43:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09ebe00640 1 -- 172.21.15.99:0/227242536 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e400fc30 con 0x7f09d8004800 2024-09-10T07:43:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09ebe00640 1 -- 172.21.15.99:0/227242536 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4014440 con 0x7f09d8004800 2024-09-10T07:43:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.571+0000 7f09f8e00640 1 -- 172.21.15.99:0/227242536 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f40a0000 con 0x7f09d8004800 2024-09-10T07:43:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.572+0000 7f09f8e00640 1 -- 172.21.15.99:0/227242536 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f40a05c0 con 0x7f09d8004800 2024-09-10T07:43:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.573+0000 7f09f8e00640 1 -- 172.21.15.99:0/227242536 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f40b1c40 con 0x7f09d8004800 2024-09-10T07:43:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.573+0000 7f09ebe00640 1 -- 172.21.15.99:0/227242536 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09e4012040 con 0x7f09d8004800 2024-09-10T07:43:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.574+0000 7f09ebe00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f09d006be30 0x7f09d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.574+0000 7f09ebe00640 1 -- 172.21.15.99:0/227242536 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4943+0+0 (secure 0 0 0) 0x7f09e408b240 con 0x7f09d8004800 2024-09-10T07:43:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.575+0000 7f09eaa00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f09d006be30 0x7f09d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.575+0000 7f09eaa00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f09d006be30 0x7f09d006e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f09dc032000 tx=0x7f09dc009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:34.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.578+0000 7f09ebe00640 1 -- 172.21.15.99:0/227242536 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09e4019030 con 0x7f09d8004800 2024-09-10T07:43:34.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.749+0000 7f09f8e00640 1 -- 172.21.15.99:0/227242536 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f09f40b06a0 con 0x7f09d8004800 2024-09-10T07:43:34.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.750+0000 7f09ebe00640 1 -- 172.21.15.99:0/227242536 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) ==== 93+0+10 (secure 0 0 0) 0x7f09e4059e50 con 0x7f09d8004800 2024-09-10T07:43:34.749 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-10T07:43:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 -- 172.21.15.99:0/227242536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f09d006be30 msgr2=0x7f09d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f09d006be30 0x7f09d006e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f09dc032000 tx=0x7f09dc009030 comp rx=0 tx=0).stop 2024-09-10T07:43:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 -- 172.21.15.99:0/227242536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 msgr2=0x7f09f414f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 0x7f09f414f500 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f09e40118e0 tx=0x7f09e4011da0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 -- 172.21.15.99:0/227242536 shutdown_connections 2024-09-10T07:43:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09f40b21f0 0x7f09f40b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09f4158530 0x7f09f409f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f09d006be30 0x7f09d006e2f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 --2- 172.21.15.99:0/227242536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09d8004800 0x7f09f414f500 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 -- 172.21.15.99:0/227242536 >> 172.21.15.99:0/227242536 conn(0x7f09f40b7cc0 msgr2=0x7f09f40b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:34.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 -- 172.21.15.99:0/227242536 shutdown_connections 2024-09-10T07:43:34.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.752+0000 7f09f8e00640 1 -- 172.21.15.99:0/227242536 wait complete. 2024-09-10T07:43:34.768 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-10T07:43:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.921+0000 7f3079400640 1 Processor -- start 2024-09-10T07:43:34.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.921+0000 7f3079400640 1 -- start start 2024-09-10T07:43:34.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.922+0000 7f3079400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3074072f40 0x7f307406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.922+0000 7f3079400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307406e3d0 con 0x7f3074145290 2024-09-10T07:43:34.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.922+0000 7f3079400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307406e6b0 con 0x7f30740ce780 2024-09-10T07:43:34.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.922+0000 7f3079400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f307406efe0 con 0x7f3074072f40 2024-09-10T07:43:34.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.922+0000 7f3072800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3074145290 0x7f3074072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32922/0 (socket says 172.21.15.99:32922) 2024-09-10T07:43:34.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.922+0000 7f3072800640 1 -- 172.21.15.99:0/419379205 learned_addr learned my addr 172.21.15.99:0/419379205 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:34.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3069e00640 1 --2- 172.21.15.99:0/419379205 >> v2:172.21.15.187:3300/0 conn(0x7f3074072f40 0x7f307406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380066940 0 0) 0x7f307406e3d0 con 0x7f3074145290 2024-09-10T07:43:34.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3058003520 con 0x7f3074145290 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990645966 0 0) 0x7f307406e6b0 con 0x7f30740ce780 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f307406e3d0 con 0x7f30740ce780 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3819137169 0 0) 0x7f3058003520 con 0x7f3074145290 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 >> v2:172.21.15.187:3300/0 conn(0x7f3074072f40 msgr2=0x7f307406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 --2- 172.21.15.99:0/419379205 >> v2:172.21.15.187:3300/0 conn(0x7f3074072f40 0x7f307406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 >> v1:172.21.15.187:6789/0 conn(0x7f30740ce780 legacy=0x7f30740b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307406e990 con 0x7f3074145290 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3069e00640 1 --2- 172.21.15.99:0/419379205 >> v2:172.21.15.187:3300/0 conn(0x7f3074072f40 0x7f307406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f3064001670 con 0x7f3074145290 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 >> v1:172.21.15.99:6789/0 conn(0x7f3074145290 legacy=0x7f3074072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3058003b40 0x7f3058003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580051c0 0x7f305800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f307406efe0 con 0x7f3058004800 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f305800e250 con 0x7f3058003b40 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f305800e450 con 0x7f30580051c0 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.923+0000 7f3069e00640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.924+0000 7f3072800640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3058003b40 0x7f3058003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.924+0000 7f3073200640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580051c0 0x7f305800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.924+0000 7f3069e00640 1 -- 172.21.15.99:0/419379205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580051c0 msgr2=0x7f305800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.924+0000 7f3069e00640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580051c0 0x7f305800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.924+0000 7f3069e00640 1 -- 172.21.15.99:0/419379205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3058003b40 msgr2=0x7f3058003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.924+0000 7f3069e00640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3058003b40 0x7f3058003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.924+0000 7f3069e00640 1 -- 172.21.15.99:0/419379205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3058003520 con 0x7f3058004800 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.924+0000 7f3072800640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3058003b40 0x7f3058003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:43:34.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.924+0000 7f3073200640 1 -- 172.21.15.99:0/419379205 reap_dead start 2024-09-10T07:43:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.925+0000 7f3069e00640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3058004800 0x7f3058004c80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f305c009c90 tx=0x7f3058005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccad9dc2020b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.925+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c036070 con 0x7f3058004800 2024-09-10T07:43:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.925+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305c031400 con 0x7f3058004800 2024-09-10T07:43:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.925+0000 7f3071e00640 1 -- 172.21.15.99:0/419379205 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c009860 con 0x7f3058004800 2024-09-10T07:43:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.926+0000 7f3079400640 1 -- 172.21.15.99:0/419379205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3058004800 msgr2=0x7f3058004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.926+0000 7f3079400640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3058004800 0x7f3058004c80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f305c009c90 tx=0x7f3058005830 comp rx=0 tx=0).stop 2024-09-10T07:43:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.926+0000 7f3079400640 1 -- 172.21.15.99:0/419379205 shutdown_connections 2024-09-10T07:43:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.926+0000 7f3079400640 1 --2- 172.21.15.99:0/419379205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.926+0000 7f3079400640 1 -- 172.21.15.99:0/419379205 >> 172.21.15.99:0/419379205 conn(0x7f307406bc10 msgr2=0x7f307406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.926+0000 7f3079400640 1 -- 172.21.15.99:0/419379205 shutdown_connections 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.926+0000 7f3079400640 1 -- 172.21.15.99:0/419379205 wait complete. 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.928+0000 7f3079400640 1 Processor -- start 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.928+0000 7f3079400640 1 -- start start 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3079400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3058004800 0x7f307413c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3079400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307413c000 0x7f3074143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3079400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307413aa90 0x7f3074141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3079400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f307406df80 con 0x7f307413aa90 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3079400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3074145670 con 0x7f3058004800 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3079400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f307406e100 con 0x7f307413c000 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3073200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307413aa90 0x7f3074141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3073200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307413aa90 0x7f3074141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58902/0 (socket says 172.21.15.99:58902) 2024-09-10T07:43:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3073200640 1 -- 172.21.15.99:0/1744026451 learned_addr learned my addr 172.21.15.99:0/1744026451 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3069e00640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307413c000 0x7f3074143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3072800640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3058004800 0x7f307413c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3073200640 1 -- 172.21.15.99:0/1744026451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307413c000 msgr2=0x7f3074143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3073200640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307413c000 0x7f3074143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3073200640 1 -- 172.21.15.99:0/1744026451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3058004800 msgr2=0x7f307413c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3073200640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3058004800 0x7f307413c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.929+0000 7f3073200640 1 -- 172.21.15.99:0/1744026451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307415d190 con 0x7f307413aa90 2024-09-10T07:43:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.930+0000 7f3073200640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307413aa90 0x7f3074141590 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f30740685b0 tx=0x7f306c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:34.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.930+0000 7f306b400640 1 -- 172.21.15.99:0/1744026451 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c019070 con 0x7f307413aa90 2024-09-10T07:43:34.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.930+0000 7f306b400640 1 -- 172.21.15.99:0/1744026451 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c006e20 con 0x7f307413aa90 2024-09-10T07:43:34.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.930+0000 7f3079400640 1 -- 172.21.15.99:0/1744026451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3074144870 con 0x7f307413aa90 2024-09-10T07:43:34.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.930+0000 7f306b400640 1 -- 172.21.15.99:0/1744026451 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c003b70 con 0x7f307413aa90 2024-09-10T07:43:34.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.930+0000 7f3079400640 1 -- 172.21.15.99:0/1744026451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3074144480 con 0x7f307413aa90 2024-09-10T07:43:34.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.931+0000 7f3079400640 1 -- 172.21.15.99:0/1744026451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30740d04c0 con 0x7f307413aa90 2024-09-10T07:43:34.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.932+0000 7f306b400640 1 -- 172.21.15.99:0/1744026451 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f306c01c070 con 0x7f307413aa90 2024-09-10T07:43:34.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.933+0000 7f306b400640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305006be30 0x7f305006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:34.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.933+0000 7f306b400640 1 -- 172.21.15.99:0/1744026451 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4943+0+0 (secure 0 0 0) 0x7f306c089f50 con 0x7f307413aa90 2024-09-10T07:43:34.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.933+0000 7f3072800640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305006be30 0x7f305006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:34.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.934+0000 7f3072800640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305006be30 0x7f305006e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3064001200 tx=0x7f3064001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:34.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:34.937+0000 7f306b400640 1 -- 172.21.15.99:0/1744026451 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30740d04c0 con 0x7f307413aa90 2024-09-10T07:43:35.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:35.173+0000 7f3079400640 1 -- 172.21.15.99:0/1744026451 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) -- 0x7f30740715a0 con 0x7f307413aa90 2024-09-10T07:43:36.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.029+0000 7f306b400640 1 -- 172.21.15.99:0/1744026451 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v447) ==== 134+0+0 (secure 0 0 0) 0x7f306c0585a0 con 0x7f307413aa90 2024-09-10T07:43:36.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.032+0000 7f3079400640 1 -- 172.21.15.99:0/1744026451 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305006be30 msgr2=0x7f305006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.032+0000 7f3079400640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305006be30 0x7f305006e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3064001200 tx=0x7f3064001e50 comp rx=0 tx=0).stop 2024-09-10T07:43:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.032+0000 7f3079400640 1 -- 172.21.15.99:0/1744026451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307413aa90 msgr2=0x7f3074141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.032+0000 7f3079400640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307413aa90 0x7f3074141590 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f30740685b0 tx=0x7f306c00ff70 comp rx=0 tx=0).stop 2024-09-10T07:43:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.033+0000 7f3079400640 1 -- 172.21.15.99:0/1744026451 shutdown_connections 2024-09-10T07:43:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.033+0000 7f3079400640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f305006be30 0x7f305006e2f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.033+0000 7f3079400640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307413aa90 0x7f3074141590 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.033+0000 7f3079400640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f307413c000 0x7f3074143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.033+0000 7f3079400640 1 --2- 172.21.15.99:0/1744026451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3058004800 0x7f307413c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.033+0000 7f3079400640 1 -- 172.21.15.99:0/1744026451 >> 172.21.15.99:0/1744026451 conn(0x7f307406bc10 msgr2=0x7f3074072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.033+0000 7f3079400640 1 -- 172.21.15.99:0/1744026451 shutdown_connections 2024-09-10T07:43:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.033+0000 7f3079400640 1 -- 172.21.15.99:0/1744026451 wait complete. 2024-09-10T07:43:36.051 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T07:43:36.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.211+0000 7f73be000640 1 Processor -- start 2024-09-10T07:43:36.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.211+0000 7f73be000640 1 -- start start 2024-09-10T07:43:36.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.212+0000 7f73be000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f73b8070b40 0x7f73b80b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.212+0000 7f73be000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73b80d3710 con 0x7f73b815eab0 2024-09-10T07:43:36.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.212+0000 7f73be000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73b80b6390 con 0x7f73b80d3230 2024-09-10T07:43:36.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.212+0000 7f73be000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f73b80b6670 con 0x7f73b8070b40 2024-09-10T07:43:36.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.213+0000 7f73b7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f73b8070b40 0x7f73b80b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.213+0000 7f73b7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f73b8070b40 0x7f73b80b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58908/0 (socket says 172.21.15.99:58908) 2024-09-10T07:43:36.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.213+0000 7f73bcc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f73b815eab0 0x7f73b806cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32934/0 (socket says 172.21.15.99:32934) 2024-09-10T07:43:36.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.213+0000 7f73b7e00640 1 -- 172.21.15.99:0/3530051457 learned_addr learned my addr 172.21.15.99:0/3530051457 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:36.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.213+0000 7f73b7e00640 1 -- 172.21.15.99:0/3530051457 >> v1:172.21.15.187:6789/0 conn(0x7f73b80d3230 legacy=0x7f73b80b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:36.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.213+0000 7f73b7e00640 1 -- 172.21.15.99:0/3530051457 >> v1:172.21.15.99:6789/0 conn(0x7f73b815eab0 legacy=0x7f73b806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.213+0000 7f73b7e00640 1 -- 172.21.15.99:0/3530051457 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b80b6950 con 0x7f73b8070b40 2024-09-10T07:43:36.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.214+0000 7f73b7e00640 1 --2- 172.21.15.99:0/3530051457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 0x7f73b80b1c40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f73a4009870 tx=0x7f73a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881e5c4de204efb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:36.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.214+0000 7f73b7400640 1 -- 172.21.15.99:0/3530051457 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4037070 con 0x7f73b8070b40 2024-09-10T07:43:36.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.214+0000 7f73b7400640 1 -- 172.21.15.99:0/3530051457 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a4032440 con 0x7f73b8070b40 2024-09-10T07:43:36.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.214+0000 7f73b7400640 1 -- 172.21.15.99:0/3530051457 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4032810 con 0x7f73b8070b40 2024-09-10T07:43:36.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.215+0000 7f73be000640 1 -- 172.21.15.99:0/3530051457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 msgr2=0x7f73b80b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.215+0000 7f73be000640 1 --2- 172.21.15.99:0/3530051457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 0x7f73b80b1c40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f73a4009870 tx=0x7f73a402a1e0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.215+0000 7f73be000640 1 -- 172.21.15.99:0/3530051457 shutdown_connections 2024-09-10T07:43:36.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.215+0000 7f73be000640 1 --2- 172.21.15.99:0/3530051457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 0x7f73b80b1c40 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.215+0000 7f73be000640 1 -- 172.21.15.99:0/3530051457 >> 172.21.15.99:0/3530051457 conn(0x7f73b80b7cc0 msgr2=0x7f73b80b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:36.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.215+0000 7f73be000640 1 -- 172.21.15.99:0/3530051457 shutdown_connections 2024-09-10T07:43:36.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.215+0000 7f73be000640 1 -- 172.21.15.99:0/3530051457 wait complete. 2024-09-10T07:43:36.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.217+0000 7f73be000640 1 Processor -- start 2024-09-10T07:43:36.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.217+0000 7f73be000640 1 -- start start 2024-09-10T07:43:36.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73be000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 0x7f73b81534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73be000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73b80d3230 0x7f73b806d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73be000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73b815eab0 0x7f73b806db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73be000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f73b815ee90 con 0x7f73b8070b40 2024-09-10T07:43:36.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73be000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f73b806d430 con 0x7f73b80d3230 2024-09-10T07:43:36.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73be000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f73b809f5a0 con 0x7f73b815eab0 2024-09-10T07:43:36.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73bcc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 0x7f73b81534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73bcc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 0x7f73b81534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58924/0 (socket says 172.21.15.99:58924) 2024-09-10T07:43:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73bcc00640 1 -- 172.21.15.99:0/520322895 learned_addr learned my addr 172.21.15.99:0/520322895 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73b7e00640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73b80d3230 0x7f73b806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73bd600640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73b815eab0 0x7f73b806db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73bcc00640 1 -- 172.21.15.99:0/520322895 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73b815eab0 msgr2=0x7f73b806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73bcc00640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73b815eab0 0x7f73b806db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73bcc00640 1 -- 172.21.15.99:0/520322895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73b80d3230 msgr2=0x7f73b806d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73bcc00640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73b80d3230 0x7f73b806d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73bcc00640 1 -- 172.21.15.99:0/520322895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b809ec70 con 0x7f73b8070b40 2024-09-10T07:43:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.218+0000 7f73b7e00640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73b80d3230 0x7f73b806d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.219+0000 7f73bcc00640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 0x7f73b81534b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00c410 tx=0x7f73ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:36.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.219+0000 7f73b4c00640 1 -- 172.21.15.99:0/520322895 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0074e0 con 0x7f73b8070b40 2024-09-10T07:43:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.219+0000 7f73b4c00640 1 -- 172.21.15.99:0/520322895 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac007680 con 0x7f73b8070b40 2024-09-10T07:43:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.219+0000 7f73be000640 1 -- 172.21.15.99:0/520322895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b809ef50 con 0x7f73b8070b40 2024-09-10T07:43:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.219+0000 7f73b4c00640 1 -- 172.21.15.99:0/520322895 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0049e0 con 0x7f73b8070b40 2024-09-10T07:43:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.219+0000 7f73be000640 1 -- 172.21.15.99:0/520322895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b81f55e0 con 0x7f73b8070b40 2024-09-10T07:43:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.220+0000 7f73be000640 1 -- 172.21.15.99:0/520322895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b80b1c40 con 0x7f73b8070b40 2024-09-10T07:43:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.221+0000 7f73b4c00640 1 -- 172.21.15.99:0/520322895 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73ac01a020 con 0x7f73b8070b40 2024-09-10T07:43:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.222+0000 7f73b4c00640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f739806be30 0x7f739806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.222+0000 7f73b4c00640 1 -- 172.21.15.99:0/520322895 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4943+0+0 (secure 0 0 0) 0x7f73ac08a3f0 con 0x7f73b8070b40 2024-09-10T07:43:36.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.222+0000 7f73b7e00640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f739806be30 0x7f739806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.223+0000 7f73b7e00640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f739806be30 0x7f739806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f73a4034000 tx=0x7f73a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:36.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.226+0000 7f73b4c00640 1 -- 172.21.15.99:0/520322895 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73ac010300 con 0x7f73b8070b40 2024-09-10T07:43:36.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.402+0000 7f73be000640 1 -- 172.21.15.99:0/520322895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f73b806e580 con 0x7f73b8070b40 2024-09-10T07:43:36.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.408+0000 7f73b4c00640 1 -- 172.21.15.99:0/520322895 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f73ac059000 con 0x7f73b8070b40 2024-09-10T07:43:36.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 -- 172.21.15.99:0/520322895 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f739806be30 msgr2=0x7f739806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f739806be30 0x7f739806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f73a4034000 tx=0x7f73a402e000 comp rx=0 tx=0).stop 2024-09-10T07:43:36.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 -- 172.21.15.99:0/520322895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 msgr2=0x7f73b81534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 0x7f73b81534b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00c410 tx=0x7f73ac00c8d0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 -- 172.21.15.99:0/520322895 shutdown_connections 2024-09-10T07:43:36.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73b815eab0 0x7f73b806db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73b80d3230 0x7f73b806d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f739806be30 0x7f739806e2f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 --2- 172.21.15.99:0/520322895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b8070b40 0x7f73b81534b0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 -- 172.21.15.99:0/520322895 >> 172.21.15.99:0/520322895 conn(0x7f73b80b7cc0 msgr2=0x7f73b80afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:36.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 -- 172.21.15.99:0/520322895 shutdown_connections 2024-09-10T07:43:36.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.410+0000 7f73be000640 1 -- 172.21.15.99:0/520322895 wait complete. 2024-09-10T07:43:36.425 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:43:36.425 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:43:36.518 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:43:36.607 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:43:36.608 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:43:36.608 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:36.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:43:36.643 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:43:36.643 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:36.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:43:36.680 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:43:36.680 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:36.718 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:43:36.719 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:43:36.719 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:36.755 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:43:36.756 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T07:43:36.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:43:36.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.912+0000 7fcb6ea00640 1 Processor -- start 2024-09-10T07:43:36.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.913+0000 7fcb6ea00640 1 -- start start 2024-09-10T07:43:36.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb6ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcb6813fae0 0x7fcb6806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb6ea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68142150 0x7fcb68160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb6ea00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcb68160a80 0x7fcb6815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb6ea00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcb680ce780 con 0x7fcb6813fae0 2024-09-10T07:43:36.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb6ea00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fcb68142650 con 0x7fcb68160a80 2024-09-10T07:43:36.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb6ea00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcb68142930 con 0x7fcb68142150 2024-09-10T07:43:36.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb67e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcb6813fae0 0x7fcb6806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb67e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcb6813fae0 0x7fcb6806f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58932/0 (socket says 172.21.15.99:58932) 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb67e00640 1 -- 172.21.15.99:0/822631758 learned_addr learned my addr 172.21.15.99:0/822631758 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb67e00640 1 -- 172.21.15.99:0/822631758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68142150 msgr2=0x7fcb68160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb67400640 1 --2- 172.21.15.99:0/822631758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68142150 0x7fcb68160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb6ca00640 1 --2- 172.21.15.99:0/822631758 >> v2:172.21.15.187:3300/0 conn(0x7fcb68160a80 0x7fcb6815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb67e00640 1 --2- 172.21.15.99:0/822631758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68142150 0x7fcb68160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb67e00640 1 -- 172.21.15.99:0/822631758 >> v2:172.21.15.187:3300/0 conn(0x7fcb68160a80 msgr2=0x7fcb6815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb67e00640 1 --2- 172.21.15.99:0/822631758 >> v2:172.21.15.187:3300/0 conn(0x7fcb68160a80 0x7fcb6815cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb67e00640 1 -- 172.21.15.99:0/822631758 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb68142c10 con 0x7fcb6813fae0 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb67400640 1 --2- 172.21.15.99:0/822631758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68142150 0x7fcb68160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:36.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.914+0000 7fcb6ca00640 1 --2- 172.21.15.99:0/822631758 >> v2:172.21.15.187:3300/0 conn(0x7fcb68160a80 0x7fcb6815cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:36.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.915+0000 7fcb67e00640 1 --2- 172.21.15.99:0/822631758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 0x7fcb6806f1b0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fcb680685a0 tx=0x7fcb5802a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec9bcd081f09d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:36.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb66a00640 1 -- 172.21.15.99:0/822631758 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58036070 con 0x7fcb6813fae0 2024-09-10T07:43:36.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb66a00640 1 -- 172.21.15.99:0/822631758 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb58031600 con 0x7fcb6813fae0 2024-09-10T07:43:36.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb66a00640 1 -- 172.21.15.99:0/822631758 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb580319d0 con 0x7fcb6813fae0 2024-09-10T07:43:36.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb6ea00640 1 -- 172.21.15.99:0/822631758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 msgr2=0x7fcb6806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb6ea00640 1 --2- 172.21.15.99:0/822631758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 0x7fcb6806f1b0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fcb680685a0 tx=0x7fcb5802a600 comp rx=0 tx=0).stop 2024-09-10T07:43:36.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb6ea00640 1 -- 172.21.15.99:0/822631758 shutdown_connections 2024-09-10T07:43:36.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb6ea00640 1 --2- 172.21.15.99:0/822631758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68142150 0x7fcb68160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb6ea00640 1 --2- 172.21.15.99:0/822631758 >> v2:172.21.15.187:3300/0 conn(0x7fcb68160a80 0x7fcb6815cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb6ea00640 1 --2- 172.21.15.99:0/822631758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 0x7fcb6806f1b0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb6ea00640 1 -- 172.21.15.99:0/822631758 >> 172.21.15.99:0/822631758 conn(0x7fcb6806bc10 msgr2=0x7fcb6806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:36.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb6ea00640 1 -- 172.21.15.99:0/822631758 shutdown_connections 2024-09-10T07:43:36.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.916+0000 7fcb6ea00640 1 -- 172.21.15.99:0/822631758 wait complete. 2024-09-10T07:43:36.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.918+0000 7fcb6ea00640 1 Processor -- start 2024-09-10T07:43:36.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.918+0000 7fcb6ea00640 1 -- start start 2024-09-10T07:43:36.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.919+0000 7fcb6ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 0x7fcb680b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.919+0000 7fcb6ea00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb68142150 0x7fcb6813f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.919+0000 7fcb6ea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68160a80 0x7fcb6815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.919+0000 7fcb6ea00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6806f870 con 0x7fcb6813fae0 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.919+0000 7fcb6ea00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6806f6f0 con 0x7fcb68142150 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.919+0000 7fcb6ea00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6815d490 con 0x7fcb68160a80 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.919+0000 7fcb67e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 0x7fcb680b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.919+0000 7fcb67e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 0x7fcb680b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58948/0 (socket says 172.21.15.99:58948) 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.919+0000 7fcb67e00640 1 -- 172.21.15.99:0/4236946793 learned_addr learned my addr 172.21.15.99:0/4236946793 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb67400640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb68142150 0x7fcb6813f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb6ca00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68160a80 0x7fcb6815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb67e00640 1 -- 172.21.15.99:0/4236946793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68160a80 msgr2=0x7fcb6815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb67e00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68160a80 0x7fcb6815bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb67e00640 1 -- 172.21.15.99:0/4236946793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb68142150 msgr2=0x7fcb6813f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb67e00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb68142150 0x7fcb6813f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb67e00640 1 -- 172.21.15.99:0/4236946793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6813f670 con 0x7fcb6813fae0 2024-09-10T07:43:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb67e00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 0x7fcb680b3a30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fcb580093e0 tx=0x7fcb58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb5fe00640 1 -- 172.21.15.99:0/4236946793 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58041020 con 0x7fcb6813fae0 2024-09-10T07:43:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb5fe00640 1 -- 172.21.15.99:0/4236946793 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb58007800 con 0x7fcb6813fae0 2024-09-10T07:43:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb5fe00640 1 -- 172.21.15.99:0/4236946793 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58036040 con 0x7fcb6813fae0 2024-09-10T07:43:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb6ea00640 1 -- 172.21.15.99:0/4236946793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb681f7cd0 con 0x7fcb6813fae0 2024-09-10T07:43:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.920+0000 7fcb6ea00640 1 -- 172.21.15.99:0/4236946793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb681f8290 con 0x7fcb6813fae0 2024-09-10T07:43:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.921+0000 7fcb6ea00640 1 -- 172.21.15.99:0/4236946793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb68160540 con 0x7fcb6813fae0 2024-09-10T07:43:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.922+0000 7fcb5fe00640 1 -- 172.21.15.99:0/4236946793 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb58044020 con 0x7fcb6813fae0 2024-09-10T07:43:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.923+0000 7fcb5fe00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb4806be30 0x7fcb4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.923+0000 7fcb5fe00640 1 -- 172.21.15.99:0/4236946793 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4943+0+0 (secure 0 0 0) 0x7fcb580aba80 con 0x7fcb6813fae0 2024-09-10T07:43:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.923+0000 7fcb67400640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb4806be30 0x7fcb4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.924+0000 7fcb67400640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb4806be30 0x7fcb4806e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcb68146160 tx=0x7fcb54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:36.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:36.927+0000 7fcb5fe00640 1 -- 172.21.15.99:0/4236946793 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb580ade20 con 0x7fcb6813fae0 2024-09-10T07:43:37.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.134+0000 7fcb6ea00640 1 -- 172.21.15.99:0/4236946793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb68075620 con 0x7fcb6813fae0 2024-09-10T07:43:37.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.134+0000 7fcb5fe00640 1 -- 172.21.15.99:0/4236946793 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+3911 (secure 0 0 0) 0x7fcb5804b030 con 0x7fcb6813fae0 2024-09-10T07:43:37.134 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:37.134 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":76,"btime":"2024-09-10T07:43:30:734368+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3366680210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3366680210},{"type":"v1","addr":"172.21.15.187:6835","nonce":3366680210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6712,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/919138741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":919138741},{"type":"v1","addr":"172.21.15.99:6836","nonce":919138741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6718,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/794540040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":794540040},{"type":"v1","addr":"172.21.15.187:6834","nonce":794540040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7410,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/2494321044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":2494321044},{"type":"v1","addr":"172.21.15.99:6837","nonce":2494321044}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[]} 2024-09-10T07:43:37.135 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 76 2024-09-10T07:43:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.136+0000 7fcb6ea00640 1 -- 172.21.15.99:0/4236946793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb4806be30 msgr2=0x7fcb4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.136+0000 7fcb6ea00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb4806be30 0x7fcb4806e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcb68146160 tx=0x7fcb54008040 comp rx=0 tx=0).stop 2024-09-10T07:43:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.136+0000 7fcb6ea00640 1 -- 172.21.15.99:0/4236946793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 msgr2=0x7fcb680b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.136+0000 7fcb6ea00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 0x7fcb680b3a30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fcb580093e0 tx=0x7fcb58004a40 comp rx=0 tx=0).stop 2024-09-10T07:43:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.137+0000 7fcb6ea00640 1 -- 172.21.15.99:0/4236946793 shutdown_connections 2024-09-10T07:43:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.137+0000 7fcb6ea00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb68160a80 0x7fcb6815bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.137+0000 7fcb6ea00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb68142150 0x7fcb6813f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.137+0000 7fcb6ea00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb4806be30 0x7fcb4806e2f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.137+0000 7fcb6ea00640 1 --2- 172.21.15.99:0/4236946793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6813fae0 0x7fcb680b3a30 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.137+0000 7fcb6ea00640 1 -- 172.21.15.99:0/4236946793 >> 172.21.15.99:0/4236946793 conn(0x7fcb6806bc10 msgr2=0x7fcb6806e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:37.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.137+0000 7fcb6ea00640 1 -- 172.21.15.99:0/4236946793 shutdown_connections 2024-09-10T07:43:37.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.137+0000 7fcb6ea00640 1 -- 172.21.15.99:0/4236946793 wait complete. 2024-09-10T07:43:37.152 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:43:37.152 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T07:43:37.152 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:43:37.152 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:43:37.153 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:43:37.153 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T07:43:37.153 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:43:37.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:43:37.153 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:43:37.153 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T07:43:37.153 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:43:37.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:43:37.154 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:43:37.154 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T07:43:37.154 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:43:37.154 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:43:37.166 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:43:37.167 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:43:37.167 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:43:37.168 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:43:37.171 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:43:37.171 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:43:37.172 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:43:37.172 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:43:37.211 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:43:37.211 DEBUG:teuthology.parallel:result is None 2024-09-10T07:43:37.213 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:43:37.213 DEBUG:teuthology.parallel:result is None 2024-09-10T07:43:37.215 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:43:37.215 DEBUG:teuthology.parallel:result is None 2024-09-10T07:43:37.217 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:43:37.218 DEBUG:teuthology.parallel:result is None 2024-09-10T07:43:37.218 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T07:43:37.340 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:43:37.342 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:43:37.346 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:43:37.346 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:43:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.382+0000 7f903f000640 1 Processor -- start 2024-09-10T07:43:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.382+0000 7f903f000640 1 -- start start 2024-09-10T07:43:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.383+0000 7f903f000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f90380d3400 0x7f90381618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.383+0000 7f903f000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90380d0aa0 con 0x7f90380d5870 2024-09-10T07:43:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f903f000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90380b7b60 con 0x7f90380ba7e0 2024-09-10T07:43:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f903f000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f90380babc0 con 0x7f90380d3400 2024-09-10T07:43:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f902f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f90380d5870 0x7f90380d2cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32952/0 (socket says 172.21.15.99:32952) 2024-09-10T07:43:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f902f400640 1 -- 172.21.15.99:0/324733873 learned_addr learned my addr 172.21.15.99:0/324733873 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f903d000640 1 --2- 172.21.15.99:0/324733873 >> v2:172.21.15.187:3300/0 conn(0x7f90380d3400 0x7f90381618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f9037400640 1 -- 172.21.15.99:0/324733873 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 509833234 0 0) 0x7f90380d0aa0 con 0x7f90380d5870 2024-09-10T07:43:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f9037400640 1 -- 172.21.15.99:0/324733873 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f901c003520 con 0x7f90380d5870 2024-09-10T07:43:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f9037400640 1 -- 172.21.15.99:0/324733873 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1503877732 0 0) 0x7f90380b7b60 con 0x7f90380ba7e0 2024-09-10T07:43:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f9037400640 1 -- 172.21.15.99:0/324733873 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90380d0aa0 con 0x7f90380ba7e0 2024-09-10T07:43:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f903d000640 1 -- 172.21.15.99:0/324733873 >> v1:172.21.15.187:6789/0 conn(0x7f90380ba7e0 legacy=0x7f90380d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f903d000640 1 -- 172.21.15.99:0/324733873 >> v1:172.21.15.99:6789/0 conn(0x7f90380d5870 legacy=0x7f90380d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.384+0000 7f903d000640 1 -- 172.21.15.99:0/324733873 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90380b7e40 con 0x7f90380d3400 2024-09-10T07:43:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.385+0000 7f903d000640 1 --2- 172.21.15.99:0/324733873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90380d3400 0x7f90381618f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9030009d90 tx=0x7f903002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43a5be31de3d9acb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.386+0000 7f9037400640 1 -- 172.21.15.99:0/324733873 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030007740 con 0x7f90380d3400 2024-09-10T07:43:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.386+0000 7f9037400640 1 -- 172.21.15.99:0/324733873 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90300078e0 con 0x7f90380d3400 2024-09-10T07:43:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.386+0000 7f9037400640 1 -- 172.21.15.99:0/324733873 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030007cb0 con 0x7f90380d3400 2024-09-10T07:43:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.386+0000 7f903f000640 1 -- 172.21.15.99:0/324733873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90380d3400 msgr2=0x7f90381618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.386+0000 7f903f000640 1 --2- 172.21.15.99:0/324733873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90380d3400 0x7f90381618f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9030009d90 tx=0x7f903002a6f0 comp rx=0 tx=0).stop 2024-09-10T07:43:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.386+0000 7f903f000640 1 -- 172.21.15.99:0/324733873 shutdown_connections 2024-09-10T07:43:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.386+0000 7f903f000640 1 --2- 172.21.15.99:0/324733873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90380d3400 0x7f90381618f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.386+0000 7f903f000640 1 -- 172.21.15.99:0/324733873 >> 172.21.15.99:0/324733873 conn(0x7f90380d4c70 msgr2=0x7f90380d5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.386+0000 7f903f000640 1 -- 172.21.15.99:0/324733873 shutdown_connections 2024-09-10T07:43:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.386+0000 7f903f000640 1 -- 172.21.15.99:0/324733873 wait complete. 2024-09-10T07:43:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.388+0000 7f903f000640 1 Processor -- start 2024-09-10T07:43:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.388+0000 7f903f000640 1 -- start start 2024-09-10T07:43:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.389+0000 7f903f000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90380ba7e0 0x7f90381d6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.389+0000 7f903f000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90380d3400 0x7f90380cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.389+0000 7f903f000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90380d5870 0x7f90380ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.389+0000 7f903f000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f90380b9930 con 0x7f90380d5870 2024-09-10T07:43:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.389+0000 7f903f000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f90380b8400 con 0x7f90380d3400 2024-09-10T07:43:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.389+0000 7f903f000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f90380b9ab0 con 0x7f90380ba7e0 2024-09-10T07:43:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f903d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90380d5870 0x7f90380ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f903d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90380d5870 0x7f90380ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59002/0 (socket says 172.21.15.99:59002) 2024-09-10T07:43:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f903d000640 1 -- 172.21.15.99:0/4204299232 learned_addr learned my addr 172.21.15.99:0/4204299232 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f9037e00640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90380ba7e0 0x7f90381d6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f902f400640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90380d3400 0x7f90380cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f903d000640 1 -- 172.21.15.99:0/4204299232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90380ba7e0 msgr2=0x7f90381d6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f903d000640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90380ba7e0 0x7f90381d6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f903d000640 1 -- 172.21.15.99:0/4204299232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90380d3400 msgr2=0x7f90380cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f903d000640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90380d3400 0x7f90380cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f903d000640 1 -- 172.21.15.99:0/4204299232 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90380cb5c0 con 0x7f90380d5870 2024-09-10T07:43:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f9037e00640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90380ba7e0 0x7f90381d6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.390+0000 7f903d000640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90380d5870 0x7f90380ce780 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f9030009eb0 tx=0x7f9030004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.391+0000 7f9034c00640 1 -- 172.21.15.99:0/4204299232 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030040070 con 0x7f90380d5870 2024-09-10T07:43:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.391+0000 7f9034c00640 1 -- 172.21.15.99:0/4204299232 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9030031b40 con 0x7f90380d5870 2024-09-10T07:43:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.391+0000 7f9034c00640 1 -- 172.21.15.99:0/4204299232 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030045460 con 0x7f90380d5870 2024-09-10T07:43:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.391+0000 7f903f000640 1 -- 172.21.15.99:0/4204299232 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90380cd6e0 con 0x7f90380d5870 2024-09-10T07:43:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.391+0000 7f903f000640 1 -- 172.21.15.99:0/4204299232 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90380cdca0 con 0x7f90380d5870 2024-09-10T07:43:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.392+0000 7f903f000640 1 -- 172.21.15.99:0/4204299232 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90380d2cf0 con 0x7f90380d5870 2024-09-10T07:43:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.393+0000 7f9034c00640 1 -- 172.21.15.99:0/4204299232 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9030039040 con 0x7f90380d5870 2024-09-10T07:43:37.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.394+0000 7f9034c00640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f901406be30 0x7f901406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:37.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.394+0000 7f9034c00640 1 -- 172.21.15.99:0/4204299232 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4943+0+0 (secure 0 0 0) 0x7f90300ac300 con 0x7f90380d5870 2024-09-10T07:43:37.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.394+0000 7f9037e00640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f901406be30 0x7f901406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:37.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.394+0000 7f9037e00640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f901406be30 0x7f901406e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9028001670 tx=0x7f9028009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:37.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.399+0000 7f9034c00640 1 -- 172.21.15.99:0/4204299232 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f903007b0c0 con 0x7f90380d5870 2024-09-10T07:43:37.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:37.584+0000 7f903f000640 1 -- 172.21.15.99:0/4204299232 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f903806e220 con 0x7f90380d5870 2024-09-10T07:43:38.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.424+0000 7f9034c00640 1 -- 172.21.15.99:0/4204299232 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v167) ==== 97+0+0 (secure 0 0 0) 0x7f903007a9c0 con 0x7f90380d5870 2024-09-10T07:43:38.423 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-09-10T07:43:38.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 -- 172.21.15.99:0/4204299232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f901406be30 msgr2=0x7f901406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f901406be30 0x7f901406e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9028001670 tx=0x7f9028009040 comp rx=0 tx=0).stop 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 -- 172.21.15.99:0/4204299232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90380d5870 msgr2=0x7f90380ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90380d5870 0x7f90380ce780 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f9030009eb0 tx=0x7f9030004a40 comp rx=0 tx=0).stop 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 -- 172.21.15.99:0/4204299232 shutdown_connections 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f901406be30 0x7f901406e2f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90380d5870 0x7f90380ce780 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90380d3400 0x7f90380cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 --2- 172.21.15.99:0/4204299232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90380ba7e0 0x7f90381d6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 -- 172.21.15.99:0/4204299232 >> 172.21.15.99:0/4204299232 conn(0x7f90380d4c70 msgr2=0x7f90381e6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 -- 172.21.15.99:0/4204299232 shutdown_connections 2024-09-10T07:43:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.427+0000 7f903f000640 1 -- 172.21.15.99:0/4204299232 wait complete. 2024-09-10T07:43:38.444 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T07:43:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.601+0000 7faac2200640 1 Processor -- start 2024-09-10T07:43:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.601+0000 7faac2200640 1 -- start start 2024-09-10T07:43:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.602+0000 7faac2200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faabc15e970 0x7faabc0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.602+0000 7faac2200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faabc0d2bd0 con 0x7faabc0cfc90 2024-09-10T07:43:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.602+0000 7faac2200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faabc0d2eb0 con 0x7faabc0d2680 2024-09-10T07:43:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.602+0000 7faac2200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7faabc0d37e0 con 0x7faabc15e970 2024-09-10T07:43:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.603+0000 7faac1800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faabc0cfc90 0x7faabc0c8700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32958/0 (socket says 172.21.15.99:32958) 2024-09-10T07:43:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.603+0000 7faac1800640 1 -- 172.21.15.99:0/299120957 learned_addr learned my addr 172.21.15.99:0/299120957 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.603+0000 7faac0e00640 1 --2- 172.21.15.99:0/299120957 >> v2:172.21.15.187:3300/0 conn(0x7faabc15e970 0x7faabc0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.603+0000 7faabb400640 1 -- 172.21.15.99:0/299120957 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450897464 0 0) 0x7faabc0d2bd0 con 0x7faabc0cfc90 2024-09-10T07:43:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.603+0000 7faabb400640 1 -- 172.21.15.99:0/299120957 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaa4003520 con 0x7faabc0cfc90 2024-09-10T07:43:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.603+0000 7faabb400640 1 -- 172.21.15.99:0/299120957 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2695024340 0 0) 0x7faabc0d2eb0 con 0x7faabc0d2680 2024-09-10T07:43:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.603+0000 7faabb400640 1 -- 172.21.15.99:0/299120957 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faabc0d2bd0 con 0x7faabc0d2680 2024-09-10T07:43:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.603+0000 7faac0e00640 1 -- 172.21.15.99:0/299120957 >> v1:172.21.15.187:6789/0 conn(0x7faabc0d2680 legacy=0x7faabc0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.603+0000 7faac0e00640 1 -- 172.21.15.99:0/299120957 >> v1:172.21.15.99:6789/0 conn(0x7faabc0cfc90 legacy=0x7faabc0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.603+0000 7faac0e00640 1 -- 172.21.15.99:0/299120957 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc0d3190 con 0x7faabc15e970 2024-09-10T07:43:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.604+0000 7faac0e00640 1 --2- 172.21.15.99:0/299120957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faabc15e970 0x7faabc0d0300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7faabc0d3960 tx=0x7faab002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fac65743fc00142 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.605+0000 7faabb400640 1 -- 172.21.15.99:0/299120957 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0037070 con 0x7faabc15e970 2024-09-10T07:43:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.605+0000 7faabb400640 1 -- 172.21.15.99:0/299120957 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab0032640 con 0x7faabc15e970 2024-09-10T07:43:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.605+0000 7faabb400640 1 -- 172.21.15.99:0/299120957 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab00329f0 con 0x7faabc15e970 2024-09-10T07:43:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.605+0000 7faac2200640 1 -- 172.21.15.99:0/299120957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faabc15e970 msgr2=0x7faabc0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.605+0000 7faac2200640 1 --2- 172.21.15.99:0/299120957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faabc15e970 0x7faabc0d0300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7faabc0d3960 tx=0x7faab002a2c0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.605+0000 7faac2200640 1 -- 172.21.15.99:0/299120957 shutdown_connections 2024-09-10T07:43:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.605+0000 7faac2200640 1 --2- 172.21.15.99:0/299120957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faabc15e970 0x7faabc0d0300 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.605+0000 7faac2200640 1 -- 172.21.15.99:0/299120957 >> 172.21.15.99:0/299120957 conn(0x7faabc09de00 msgr2=0x7faabc0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.605+0000 7faac2200640 1 -- 172.21.15.99:0/299120957 shutdown_connections 2024-09-10T07:43:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.605+0000 7faac2200640 1 -- 172.21.15.99:0/299120957 wait complete. 2024-09-10T07:43:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.607+0000 7faac2200640 1 Processor -- start 2024-09-10T07:43:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.607+0000 7faac2200640 1 -- start start 2024-09-10T07:43:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faac2200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faabc0cfc90 0x7faabc0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faac2200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc0d2680 0x7faabc158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faac2200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faabc15e970 0x7faabc1e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faac2200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faabc15ed50 con 0x7faabc0d2680 2024-09-10T07:43:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faac2200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faabc0d0840 con 0x7faabc0cfc90 2024-09-10T07:43:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faac2200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faabc15eed0 con 0x7faabc15e970 2024-09-10T07:43:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faabbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc0d2680 0x7faabc158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faabbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc0d2680 0x7faabc158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59018/0 (socket says 172.21.15.99:59018) 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faabbe00640 1 -- 172.21.15.99:0/1193227279 learned_addr learned my addr 172.21.15.99:0/1193227279 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faac0e00640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faabc0cfc90 0x7faabc0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.608+0000 7faac1800640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faabc15e970 0x7faabc1e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faabbe00640 1 -- 172.21.15.99:0/1193227279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faabc15e970 msgr2=0x7faabc1e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faabbe00640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faabc15e970 0x7faabc1e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faabbe00640 1 -- 172.21.15.99:0/1193227279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faabc0cfc90 msgr2=0x7faabc0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faabbe00640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faabc0cfc90 0x7faabc0b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faabbe00640 1 -- 172.21.15.99:0/1193227279 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc161600 con 0x7faabc0d2680 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faabbe00640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc0d2680 0x7faabc158560 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c490 tx=0x7faaac00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faab8c00640 1 -- 172.21.15.99:0/1193227279 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac0052d0 con 0x7faabc0d2680 2024-09-10T07:43:38.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faab8c00640 1 -- 172.21.15.99:0/1193227279 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaac005470 con 0x7faabc0d2680 2024-09-10T07:43:38.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faac2200640 1 -- 172.21.15.99:0/1193227279 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faabc1e9c40 con 0x7faabc0d2680 2024-09-10T07:43:38.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faab8c00640 1 -- 172.21.15.99:0/1193227279 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac012850 con 0x7faabc0d2680 2024-09-10T07:43:38.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.609+0000 7faac2200640 1 -- 172.21.15.99:0/1193227279 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faabc161320 con 0x7faabc0d2680 2024-09-10T07:43:38.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.610+0000 7faac2200640 1 -- 172.21.15.99:0/1193227279 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faabc0d0300 con 0x7faabc0d2680 2024-09-10T07:43:38.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.611+0000 7faab8c00640 1 -- 172.21.15.99:0/1193227279 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faaac0129f0 con 0x7faabc0d2680 2024-09-10T07:43:38.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.612+0000 7faab8c00640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faaa006be30 0x7faaa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:38.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.612+0000 7faab8c00640 1 -- 172.21.15.99:0/1193227279 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 4857+0+0 (secure 0 0 0) 0x7faaac08a740 con 0x7faabc0d2680 2024-09-10T07:43:38.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.612+0000 7faac0e00640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faaa006be30 0x7faaa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:38.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.613+0000 7faac0e00640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faaa006be30 0x7faaa006e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faab0034000 tx=0x7faab002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:38.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.616+0000 7faab8c00640 1 -- 172.21.15.99:0/1193227279 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faaac059430 con 0x7faabc0d2680 2024-09-10T07:43:38.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.851+0000 7faac2200640 1 -- 172.21.15.99:0/1193227279 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7faabc06d390 con 0x7faabc0d2680 2024-09-10T07:43:38.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.851+0000 7faab8c00640 1 -- 172.21.15.99:0/1193227279 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7faaac058d30 con 0x7faabc0d2680 2024-09-10T07:43:38.850 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw==", 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.851 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.852 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-09-10T07:43:38.852 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ==", 2024-09-10T07:43:38.852 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.852 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:43:38.852 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:43:38.852 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:43:38.852 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.853 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.853 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-09-10T07:43:38.853 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw==", 2024-09-10T07:43:38.853 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.853 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:43:38.853 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:43:38.854 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:43:38.854 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.854 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.854 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-09-10T07:43:38.854 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw==", 2024-09-10T07:43:38.854 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.854 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:43:38.854 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA==", 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A==", 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w==", 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.856 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA==", 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:43:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w==", 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-09-10T07:43:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw==", 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw==", 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg==", 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-09-10T07:43:38.860 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg==", 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow r", 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ==", 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:43:38.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A==", 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.862 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw==", 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBc9t9m2Fs5JBAAQfJNCUhmbHevYDJWsG/oAg==", 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.863 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q==", 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:43:38.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:38.865 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-09-10T07:43:38.865 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw==", 2024-09-10T07:43:38.865 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:43:38.868 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:43:38.868 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:43:38.868 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:43:38.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:38.869 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:43:38.869 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:43:38.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 -- 172.21.15.99:0/1193227279 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faaa006be30 msgr2=0x7faaa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faaa006be30 0x7faaa006e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faab0034000 tx=0x7faab002e000 comp rx=0 tx=0).stop 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 -- 172.21.15.99:0/1193227279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc0d2680 msgr2=0x7faabc158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc0d2680 0x7faabc158560 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c490 tx=0x7faaac00c950 comp rx=0 tx=0).stop 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 -- 172.21.15.99:0/1193227279 shutdown_connections 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faabc15e970 0x7faabc1e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7faaa006be30 0x7faaa006e2f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc0d2680 0x7faabc158560 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 --2- 172.21.15.99:0/1193227279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faabc0cfc90 0x7faabc0b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 -- 172.21.15.99:0/1193227279 >> 172.21.15.99:0/1193227279 conn(0x7faabc09de00 msgr2=0x7faabc06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 -- 172.21.15.99:0/1193227279 shutdown_connections 2024-09-10T07:43:38.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:38.854+0000 7faac2200640 1 -- 172.21.15.99:0/1193227279 wait complete. 2024-09-10T07:43:38.872 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:43:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.027+0000 7fcc07600640 1 Processor -- start 2024-09-10T07:43:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.027+0000 7fcc07600640 1 -- start start 2024-09-10T07:43:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.028+0000 7fcc07600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0013fae0 0x7fcc0006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.028+0000 7fcc07600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc00142650 con 0x7fcc00142150 2024-09-10T07:43:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.028+0000 7fcc07600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc00142930 con 0x7fcc00160c50 2024-09-10T07:43:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.028+0000 7fcc07600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcc000ce780 con 0x7fcc0013fae0 2024-09-10T07:43:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbffe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcc00142150 0x7fcc00160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32974/0 (socket says 172.21.15.99:32974) 2024-09-10T07:43:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbffe00640 1 -- 172.21.15.99:0/663342930 learned_addr learned my addr 172.21.15.99:0/663342930 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcc04c00640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0013fae0 0x7fcc0006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 597457344 0 0) 0x7fcc00142650 con 0x7fcc00142150 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbe8003520 con 0x7fcc00142150 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338157739 0 0) 0x7fcc00142930 con 0x7fcc00160c50 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc00142650 con 0x7fcc00160c50 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1527276668 0 0) 0x7fcbe8003520 con 0x7fcc00142150 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0013fae0 msgr2=0x7fcc0006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbff400640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0013fae0 0x7fcc0006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 >> v1:172.21.15.187:6789/0 conn(0x7fcc00160c50 legacy=0x7fcc000cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc00142c10 con 0x7fcc00142150 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.029+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fcbec001670 con 0x7fcc00142150 2024-09-10T07:43:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 >> v1:172.21.15.99:6789/0 conn(0x7fcc00142150 legacy=0x7fcc00160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcbff400640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbe8003b70 0x7fcbe8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcbff400640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0013fae0 0x7fcbe8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcbff400640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 0x7fcbe80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe800ba90 con 0x7fcbe8004d40 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe800bc40 con 0x7fcbe8003b70 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe800be40 con 0x7fcc0013fae0 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcc05600640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 0x7fcbe80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcbffe00640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0013fae0 0x7fcbe8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcc04c00640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbe8003b70 0x7fcbe8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcc05600640 1 -- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0013fae0 msgr2=0x7fcbe8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcc05600640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0013fae0 0x7fcbe8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcc05600640 1 -- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbe8003b70 msgr2=0x7fcbe8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcc05600640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbe8003b70 0x7fcbe8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.030+0000 7fcc05600640 1 -- 172.21.15.99:0/663342930 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe8003520 con 0x7fcbe8004d40 2024-09-10T07:43:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.031+0000 7fcc05600640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 0x7fcbe80051c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fcc0006c7b0 tx=0x7fcbe8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158c1f17ee6a9cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.032+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8001bf0 con 0x7fcbe8004d40 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.032+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf8003b70 con 0x7fcbe8004d40 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.032+0000 7fcbff400640 1 -- 172.21.15.99:0/663342930 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80050d0 con 0x7fcbe8004d40 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.032+0000 7fcc07600640 1 -- 172.21.15.99:0/663342930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 msgr2=0x7fcbe80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.032+0000 7fcc07600640 1 --2- 172.21.15.99:0/663342930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 0x7fcbe80051c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fcc0006c7b0 tx=0x7fcbe8005830 comp rx=0 tx=0).stop 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.032+0000 7fcc05600640 1 -- 172.21.15.99:0/663342930 reap_dead start 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.032+0000 7fcc07600640 1 -- 172.21.15.99:0/663342930 shutdown_connections 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.032+0000 7fcc07600640 1 -- 172.21.15.99:0/663342930 >> 172.21.15.99:0/663342930 conn(0x7fcc0006bc10 msgr2=0x7fcc0006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.032+0000 7fcc07600640 1 -- 172.21.15.99:0/663342930 shutdown_connections 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.032+0000 7fcc07600640 1 -- 172.21.15.99:0/663342930 wait complete. 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.034+0000 7fcc07600640 1 Processor -- start 2024-09-10T07:43:39.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.034+0000 7fcc07600640 1 -- start start 2024-09-10T07:43:39.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcc07600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 0x7fcc001f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcc07600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc001386a0 0x7fcc00138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcc07600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0015b990 0x7fcc0015be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcc07600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0006f330 con 0x7fcbe8004d40 2024-09-10T07:43:39.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcc07600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0006f1b0 con 0x7fcc001386a0 2024-09-10T07:43:39.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcc07600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0006f4b0 con 0x7fcc0015b990 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcc04c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 0x7fcc001f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcc04c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 0x7fcc001f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59044/0 (socket says 172.21.15.99:59044) 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcc04c00640 1 -- 172.21.15.99:0/1128670562 learned_addr learned my addr 172.21.15.99:0/1128670562 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcbffe00640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc001386a0 0x7fcc00138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.035+0000 7fcc05600640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0015b990 0x7fcc0015be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcc04c00640 1 -- 172.21.15.99:0/1128670562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0015b990 msgr2=0x7fcc0015be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcc04c00640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0015b990 0x7fcc0015be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcc04c00640 1 -- 172.21.15.99:0/1128670562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc001386a0 msgr2=0x7fcc00138ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcc04c00640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc001386a0 0x7fcc00138ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcc04c00640 1 -- 172.21.15.99:0/1128670562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc00138b20 con 0x7fcbe8004d40 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcc04c00640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 0x7fcc001f5ea0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4011940 tx=0x7fcbf4011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcbfcc00640 1 -- 172.21.15.99:0/1128670562 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4019070 con 0x7fcbe8004d40 2024-09-10T07:43:39.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcbfcc00640 1 -- 172.21.15.99:0/1128670562 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf4004240 con 0x7fcbe8004d40 2024-09-10T07:43:39.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcbfcc00640 1 -- 172.21.15.99:0/1128670562 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400f8e0 con 0x7fcbe8004d40 2024-09-10T07:43:39.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcc07600640 1 -- 172.21.15.99:0/1128670562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc00139760 con 0x7fcbe8004d40 2024-09-10T07:43:39.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.036+0000 7fcc07600640 1 -- 172.21.15.99:0/1128670562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc00139d20 con 0x7fcbe8004d40 2024-09-10T07:43:39.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.037+0000 7fcc07600640 1 -- 172.21.15.99:0/1128670562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc00073530 con 0x7fcbe8004d40 2024-09-10T07:43:39.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.038+0000 7fcbfcc00640 1 -- 172.21.15.99:0/1128670562 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbf401c070 con 0x7fcbe8004d40 2024-09-10T07:43:39.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.039+0000 7fcbfcc00640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcbe006be60 0x7fcbe006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.039+0000 7fcbfcc00640 1 -- 172.21.15.99:0/1128670562 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 4857+0+0 (secure 0 0 0) 0x7fcbf408afa0 con 0x7fcbe8004d40 2024-09-10T07:43:39.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.040+0000 7fcbffe00640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcbe006be60 0x7fcbe006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.040+0000 7fcbffe00640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcbe006be60 0x7fcbe006e320 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcc000cddd0 tx=0x7fcbec001e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:39.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.046+0000 7fcbfcc00640 1 -- 172.21.15.99:0/1128670562 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc00073530 con 0x7fcbe8004d40 2024-09-10T07:43:39.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.221+0000 7fcc07600640 1 -- 172.21.15.99:0/1128670562 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcc00160540 con 0x7fcbe8004d40 2024-09-10T07:43:39.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.221+0000 7fcbfcc00640 1 -- 172.21.15.99:0/1128670562 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v167) ==== 84+0+65 (secure 0 0 0) 0x7fcbf4059650 con 0x7fcbe8004d40 2024-09-10T07:43:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:39.220 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:43:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:43:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:43:39.220 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:43:39.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:43:39.221 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:43:39.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.223+0000 7fcc07600640 1 -- 172.21.15.99:0/1128670562 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcbe006be60 msgr2=0x7fcbe006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.223+0000 7fcc07600640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcbe006be60 0x7fcbe006e320 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcc000cddd0 tx=0x7fcbec001e40 comp rx=0 tx=0).stop 2024-09-10T07:43:39.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.223+0000 7fcc07600640 1 -- 172.21.15.99:0/1128670562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 msgr2=0x7fcc001f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.223+0000 7fcc07600640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 0x7fcc001f5ea0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4011940 tx=0x7fcbf4011e00 comp rx=0 tx=0).stop 2024-09-10T07:43:39.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.224+0000 7fcc07600640 1 -- 172.21.15.99:0/1128670562 shutdown_connections 2024-09-10T07:43:39.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.224+0000 7fcc07600640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc0015b990 0x7fcc0015be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.224+0000 7fcc07600640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc001386a0 0x7fcc00138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.224+0000 7fcc07600640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcbe006be60 0x7fcbe006e320 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.224+0000 7fcc07600640 1 --2- 172.21.15.99:0/1128670562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbe8004d40 0x7fcc001f5ea0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.224+0000 7fcc07600640 1 -- 172.21.15.99:0/1128670562 >> 172.21.15.99:0/1128670562 conn(0x7fcc0006bc10 msgr2=0x7fcc0015fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:39.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.224+0000 7fcc07600640 1 -- 172.21.15.99:0/1128670562 shutdown_connections 2024-09-10T07:43:39.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.224+0000 7fcc07600640 1 -- 172.21.15.99:0/1128670562 wait complete. 2024-09-10T07:43:39.238 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:43:39.238 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:43:39.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.396+0000 7ff8ac000640 1 Processor -- start 2024-09-10T07:43:39.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.397+0000 7ff8ac000640 1 -- start start 2024-09-10T07:43:39.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.398+0000 7ff8ac000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 0x7ff8a406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.398+0000 7ff8ac000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8a40716a0 con 0x7ff8a406f3b0 2024-09-10T07:43:39.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.398+0000 7ff8ac000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8a4071980 con 0x7ff8a415af10 2024-09-10T07:43:39.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.398+0000 7ff8ac000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff8a40731f0 con 0x7ff8a4072740 2024-09-10T07:43:39.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.398+0000 7ff8aa000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff8a406f3b0 0x7ff8a40b39a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32986/0 (socket says 172.21.15.99:32986) 2024-09-10T07:43:39.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.398+0000 7ff8aa000640 1 -- 172.21.15.99:0/3228958374 learned_addr learned my addr 172.21.15.99:0/3228958374 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:39.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.398+0000 7ff8a8c00640 1 --2- 172.21.15.99:0/3228958374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 0x7ff8a406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.399+0000 7ff8a3e00640 1 -- 172.21.15.99:0/3228958374 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349827378 0 0) 0x7ff8a40716a0 con 0x7ff8a406f3b0 2024-09-10T07:43:39.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.399+0000 7ff8a3e00640 1 -- 172.21.15.99:0/3228958374 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff88c003520 con 0x7ff8a406f3b0 2024-09-10T07:43:39.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.399+0000 7ff8a3e00640 1 -- 172.21.15.99:0/3228958374 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3575595361 0 0) 0x7ff8a4071980 con 0x7ff8a415af10 2024-09-10T07:43:39.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.399+0000 7ff8a8c00640 1 -- 172.21.15.99:0/3228958374 >> v1:172.21.15.187:6789/0 conn(0x7ff8a415af10 legacy=0x7ff8a40cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.399+0000 7ff8a8c00640 1 -- 172.21.15.99:0/3228958374 >> v1:172.21.15.99:6789/0 conn(0x7ff8a406f3b0 legacy=0x7ff8a40b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.399+0000 7ff8a8c00640 1 -- 172.21.15.99:0/3228958374 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a4071c60 con 0x7ff8a4072740 2024-09-10T07:43:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.400+0000 7ff8a8c00640 1 --2- 172.21.15.99:0/3228958374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 0x7ff8a406ee70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff89000a970 tx=0x7ff89002b550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bc8d1712b3bb897 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.400+0000 7ff8a3e00640 1 -- 172.21.15.99:0/3228958374 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89000b040 con 0x7ff8a4072740 2024-09-10T07:43:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.400+0000 7ff8a3e00640 1 -- 172.21.15.99:0/3228958374 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff890030710 con 0x7ff8a4072740 2024-09-10T07:43:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.400+0000 7ff8a3e00640 1 -- 172.21.15.99:0/3228958374 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890030ae0 con 0x7ff8a4072740 2024-09-10T07:43:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.401+0000 7ff8ac000640 1 -- 172.21.15.99:0/3228958374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 msgr2=0x7ff8a406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.401+0000 7ff8ac000640 1 --2- 172.21.15.99:0/3228958374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 0x7ff8a406ee70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff89000a970 tx=0x7ff89002b550 comp rx=0 tx=0).stop 2024-09-10T07:43:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.401+0000 7ff8ac000640 1 -- 172.21.15.99:0/3228958374 shutdown_connections 2024-09-10T07:43:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.401+0000 7ff8ac000640 1 --2- 172.21.15.99:0/3228958374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 0x7ff8a406ee70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.401+0000 7ff8ac000640 1 -- 172.21.15.99:0/3228958374 >> 172.21.15.99:0/3228958374 conn(0x7ff8a40b26a0 msgr2=0x7ff8a40b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:39.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.401+0000 7ff8ac000640 1 -- 172.21.15.99:0/3228958374 shutdown_connections 2024-09-10T07:43:39.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.401+0000 7ff8ac000640 1 -- 172.21.15.99:0/3228958374 wait complete. 2024-09-10T07:43:39.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.402+0000 7ff8ac000640 1 Processor -- start 2024-09-10T07:43:39.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.402+0000 7ff8ac000640 1 -- start start 2024-09-10T07:43:39.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.403+0000 7ff8ac000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8a406f3b0 0x7ff8a4146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.403+0000 7ff8ac000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 0x7ff8a4152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.403+0000 7ff8ac000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8a415af10 0x7ff8a40b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.403+0000 7ff8ac000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4072220 con 0x7ff8a415af10 2024-09-10T07:43:39.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.403+0000 7ff8ac000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a406f800 con 0x7ff8a406f3b0 2024-09-10T07:43:39.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.403+0000 7ff8ac000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff8a415b2f0 con 0x7ff8a4072740 2024-09-10T07:43:39.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8aa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8a415af10 0x7ff8a40b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8aa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8a415af10 0x7ff8a40b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59056/0 (socket says 172.21.15.99:59056) 2024-09-10T07:43:39.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8aa000640 1 -- 172.21.15.99:0/491692277 learned_addr learned my addr 172.21.15.99:0/491692277 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:39.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8a8c00640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 0x7ff8a4152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8a9600640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8a406f3b0 0x7ff8a4146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8aa000640 1 -- 172.21.15.99:0/491692277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 msgr2=0x7ff8a4152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8aa000640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 0x7ff8a4152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8aa000640 1 -- 172.21.15.99:0/491692277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8a406f3b0 msgr2=0x7ff8a4146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:39.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8aa000640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8a406f3b0 0x7ff8a4146fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:39.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8aa000640 1 -- 172.21.15.99:0/491692277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a4151d50 con 0x7ff8a415af10 2024-09-10T07:43:39.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8a9600640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8a406f3b0 0x7ff8a4146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:39.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8aa000640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8a415af10 0x7ff8a40b4b20 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00cb40 tx=0x7ff89c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:39.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.404+0000 7ff8a1600640 1 -- 172.21.15.99:0/491692277 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c017070 con 0x7ff8a415af10 2024-09-10T07:43:39.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.405+0000 7ff8a1600640 1 -- 172.21.15.99:0/491692277 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff89c00aca0 con 0x7ff8a415af10 2024-09-10T07:43:39.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.405+0000 7ff8a1600640 1 -- 172.21.15.99:0/491692277 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c012620 con 0x7ff8a415af10 2024-09-10T07:43:39.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.405+0000 7ff8ac000640 1 -- 172.21.15.99:0/491692277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a4152030 con 0x7ff8a415af10 2024-09-10T07:43:39.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.405+0000 7ff8ac000640 1 -- 172.21.15.99:0/491692277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a41525f0 con 0x7ff8a415af10 2024-09-10T07:43:39.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.406+0000 7ff8ac000640 1 -- 172.21.15.99:0/491692277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a40cef00 con 0x7ff8a415af10 2024-09-10T07:43:39.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.407+0000 7ff8a1600640 1 -- 172.21.15.99:0/491692277 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff89c01a070 con 0x7ff8a415af10 2024-09-10T07:43:39.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.408+0000 7ff8a1600640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff88406be30 0x7ff88406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:39.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.408+0000 7ff8a1600640 1 -- 172.21.15.99:0/491692277 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 4857+0+0 (secure 0 0 0) 0x7ff89c08a8e0 con 0x7ff8a415af10 2024-09-10T07:43:39.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.408+0000 7ff8a9600640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff88406be30 0x7ff88406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:39.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.409+0000 7ff8a9600640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff88406be30 0x7ff88406e2f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff898000f60 tx=0x7ff898009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:39.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.412+0000 7ff8a1600640 1 -- 172.21.15.99:0/491692277 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff89c058f80 con 0x7ff8a415af10 2024-09-10T07:43:39.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:39.585+0000 7ff8ac000640 1 -- 172.21.15.99:0/491692277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff8a406d7e0 con 0x7ff8a415af10 2024-09-10T07:43:40.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.428+0000 7ff8a1600640 1 -- 172.21.15.99:0/491692277 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v168) ==== 138+0+0 (secure 0 0 0) 0x7ff89c05d280 con 0x7ff8a415af10 2024-09-10T07:43:40.427 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:43:40.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.432+0000 7ff8ac000640 1 -- 172.21.15.99:0/491692277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff88406be30 msgr2=0x7ff88406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:40.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.432+0000 7ff8ac000640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff88406be30 0x7ff88406e2f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff898000f60 tx=0x7ff898009040 comp rx=0 tx=0).stop 2024-09-10T07:43:40.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.432+0000 7ff8ac000640 1 -- 172.21.15.99:0/491692277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8a415af10 msgr2=0x7ff8a40b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.432+0000 7ff8ac000640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8a415af10 0x7ff8a40b4b20 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00cb40 tx=0x7ff89c00a060 comp rx=0 tx=0).stop 2024-09-10T07:43:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.432+0000 7ff8ac000640 1 -- 172.21.15.99:0/491692277 shutdown_connections 2024-09-10T07:43:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.432+0000 7ff8ac000640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff88406be30 0x7ff88406e2f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.432+0000 7ff8ac000640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8a415af10 0x7ff8a40b4b20 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.432+0000 7ff8ac000640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a4072740 0x7ff8a4152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:40.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.432+0000 7ff8ac000640 1 --2- 172.21.15.99:0/491692277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8a406f3b0 0x7ff8a4146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:40.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.432+0000 7ff8ac000640 1 -- 172.21.15.99:0/491692277 >> 172.21.15.99:0/491692277 conn(0x7ff8a40b26a0 msgr2=0x7ff8a40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:40.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.434+0000 7ff8ac000640 1 -- 172.21.15.99:0/491692277 shutdown_connections 2024-09-10T07:43:40.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.435+0000 7ff8ac000640 1 -- 172.21.15.99:0/491692277 wait complete. 2024-09-10T07:43:40.451 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:43:40.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.615+0000 7fbfb6600640 1 Processor -- start 2024-09-10T07:43:40.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.615+0000 7fbfb6600640 1 -- start start 2024-09-10T07:43:40.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.616+0000 7fbfb6600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb00afa90 0x7fbfb006f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:40.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.616+0000 7fbfb6600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbfb00d0630 0x7fbfb00d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:40.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.617+0000 7fbfb6600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb00b4300 con 0x7fbfb015b760 2024-09-10T07:43:40.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.617+0000 7fbfb6600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb006d700 con 0x7fbfb00d0630 2024-09-10T07:43:40.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.617+0000 7fbfb6600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb006d9e0 con 0x7fbfb00afa90 2024-09-10T07:43:40.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.617+0000 7fbfaea00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb00afa90 0x7fbfb006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:40.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.617+0000 7fbfaf400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fbfb015b760 0x7fbfb00b4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:41096/0 (socket says 172.21.15.99:41096) 2024-09-10T07:43:40.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.617+0000 7fbfaf400640 1 -- 172.21.15.99:0/3689697313 learned_addr learned my addr 172.21.15.99:0/3689697313 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:40.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.617+0000 7fbfafe00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbfb00d0630 0x7fbfb00d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:40.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.618+0000 7fbfae000640 1 -- 172.21.15.99:0/3689697313 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927402420 0 0) 0x7fbfb00b4300 con 0x7fbfb015b760 2024-09-10T07:43:40.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.618+0000 7fbfae000640 1 -- 172.21.15.99:0/3689697313 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf94003520 con 0x7fbfb015b760 2024-09-10T07:43:40.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.618+0000 7fbfafe00640 1 -- 172.21.15.99:0/3689697313 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb00afa90 msgr2=0x7fbfb006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:40.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.618+0000 7fbfafe00640 1 --2- 172.21.15.99:0/3689697313 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb00afa90 0x7fbfb006f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:40.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.618+0000 7fbfafe00640 1 -- 172.21.15.99:0/3689697313 >> v1:172.21.15.187:6789/0 conn(0x7fbfb015b760 legacy=0x7fbfb00b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:40.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.618+0000 7fbfafe00640 1 -- 172.21.15.99:0/3689697313 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb00d0fe0 con 0x7fbfb00d0630 2024-09-10T07:43:40.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.618+0000 7fbfaea00640 1 --2- 172.21.15.99:0/3689697313 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb00afa90 0x7fbfb006f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.619+0000 7fbfafe00640 1 --2- 172.21.15.99:0/3689697313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfb00d0630 0x7fbfb00d0aa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009d90 tx=0x7fbfa802a540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd32cffa7120c14b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.619+0000 7fbfae000640 1 -- 172.21.15.99:0/3689697313 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8007740 con 0x7fbfb00d0630 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.619+0000 7fbfae000640 1 -- 172.21.15.99:0/3689697313 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa80078e0 con 0x7fbfb00d0630 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.619+0000 7fbfae000640 1 -- 172.21.15.99:0/3689697313 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8007c90 con 0x7fbfb00d0630 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.619+0000 7fbfb6600640 1 -- 172.21.15.99:0/3689697313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfb00d0630 msgr2=0x7fbfb00d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.619+0000 7fbfb6600640 1 --2- 172.21.15.99:0/3689697313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfb00d0630 0x7fbfb00d0aa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009d90 tx=0x7fbfa802a540 comp rx=0 tx=0).stop 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.620+0000 7fbfb6600640 1 -- 172.21.15.99:0/3689697313 shutdown_connections 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.620+0000 7fbfb6600640 1 --2- 172.21.15.99:0/3689697313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfb00d0630 0x7fbfb00d0aa0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.620+0000 7fbfb6600640 1 --2- 172.21.15.99:0/3689697313 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb00afa90 0x7fbfb006f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.620+0000 7fbfb6600640 1 -- 172.21.15.99:0/3689697313 >> 172.21.15.99:0/3689697313 conn(0x7fbfb006bc10 msgr2=0x7fbfb006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.620+0000 7fbfb6600640 1 -- 172.21.15.99:0/3689697313 shutdown_connections 2024-09-10T07:43:40.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.620+0000 7fbfb6600640 1 -- 172.21.15.99:0/3689697313 wait complete. 2024-09-10T07:43:40.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.621+0000 7fbfb6600640 1 Processor -- start 2024-09-10T07:43:40.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.621+0000 7fbfb6600640 1 -- start start 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.622+0000 7fbfb6600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfb00afa90 0x7fbfb01476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.622+0000 7fbfb6600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfb00d0630 0x7fbfb01442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.622+0000 7fbfb6600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb015b760 0x7fbfb0144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.622+0000 7fbfb6600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb015bb40 con 0x7fbfb00afa90 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.622+0000 7fbfb6600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb006f7d0 con 0x7fbfb00d0630 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.622+0000 7fbfb6600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb015bcc0 con 0x7fbfb015b760 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfaf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfb00afa90 0x7fbfb01476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfaf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfb00afa90 0x7fbfb01476f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52722/0 (socket says 172.21.15.99:52722) 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfaf400640 1 -- 172.21.15.99:0/2081109391 learned_addr learned my addr 172.21.15.99:0/2081109391 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfaea00640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfb00d0630 0x7fbfb01442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:40.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfafe00640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb015b760 0x7fbfb0144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:40.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfaf400640 1 -- 172.21.15.99:0/2081109391 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb015b760 msgr2=0x7fbfb0144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:40.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfaf400640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb015b760 0x7fbfb0144b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:40.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfaf400640 1 -- 172.21.15.99:0/2081109391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfb00d0630 msgr2=0x7fbfb01442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:40.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfaf400640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfb00d0630 0x7fbfb01442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:40.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfaf400640 1 -- 172.21.15.99:0/2081109391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb015c450 con 0x7fbfb00afa90 2024-09-10T07:43:40.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.623+0000 7fbfaf400640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfb00afa90 0x7fbfb01476f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000c390 tx=0x7fbfa000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:40.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.624+0000 7fbfa7400640 1 -- 172.21.15.99:0/2081109391 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0017070 con 0x7fbfb00afa90 2024-09-10T07:43:40.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.624+0000 7fbfa7400640 1 -- 172.21.15.99:0/2081109391 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa0005ce0 con 0x7fbfb00afa90 2024-09-10T07:43:40.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.624+0000 7fbfa7400640 1 -- 172.21.15.99:0/2081109391 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00072f0 con 0x7fbfb00afa90 2024-09-10T07:43:40.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.624+0000 7fbfb6600640 1 -- 172.21.15.99:0/2081109391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb015c730 con 0x7fbfb00afa90 2024-09-10T07:43:40.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.624+0000 7fbfb6600640 1 -- 172.21.15.99:0/2081109391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb01450d0 con 0x7fbfb00afa90 2024-09-10T07:43:40.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.625+0000 7fbfb6600640 1 -- 172.21.15.99:0/2081109391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb006dcc0 con 0x7fbfb00afa90 2024-09-10T07:43:40.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.626+0000 7fbfa7400640 1 -- 172.21.15.99:0/2081109391 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfa001a070 con 0x7fbfb00afa90 2024-09-10T07:43:40.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.627+0000 7fbfa7400640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbf9006be30 0x7fbf9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:40.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.627+0000 7fbfa7400640 1 -- 172.21.15.99:0/2081109391 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5227+0+0 (secure 0 0 0) 0x7fbfa008a090 con 0x7fbfb00afa90 2024-09-10T07:43:40.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.627+0000 7fbfaea00640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbf9006be30 0x7fbf9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:40.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.627+0000 7fbfaea00640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbf9006be30 0x7fbf9006e2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00b800 tx=0x7fbf9c00b3a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.632+0000 7fbfa7400640 1 -- 172.21.15.99:0/2081109391 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfa0058c10 con 0x7fbfb00afa90 2024-09-10T07:43:40.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:40.803+0000 7fbfb6600640 1 -- 172.21.15.99:0/2081109391 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbfb01589a0 con 0x7fbfb00afa90 2024-09-10T07:43:41.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.435+0000 7fbfa7400640 1 -- 172.21.15.99:0/2081109391 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v169) ==== 170+0+0 (secure 0 0 0) 0x7fbfa0058510 con 0x7fbfb00afa90 2024-09-10T07:43:41.434 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:43:41.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 -- 172.21.15.99:0/2081109391 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbf9006be30 msgr2=0x7fbf9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:41.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbf9006be30 0x7fbf9006e2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00b800 tx=0x7fbf9c00b3a0 comp rx=0 tx=0).stop 2024-09-10T07:43:41.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 -- 172.21.15.99:0/2081109391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfb00afa90 msgr2=0x7fbfb01476f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:41.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfb00afa90 0x7fbfb01476f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000c390 tx=0x7fbfa000c850 comp rx=0 tx=0).stop 2024-09-10T07:43:41.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 -- 172.21.15.99:0/2081109391 shutdown_connections 2024-09-10T07:43:41.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfb015b760 0x7fbfb0144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:41.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfb00d0630 0x7fbfb01442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:41.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbf9006be30 0x7fbf9006e2f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:41.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 --2- 172.21.15.99:0/2081109391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfb00afa90 0x7fbfb01476f0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:41.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 -- 172.21.15.99:0/2081109391 >> 172.21.15.99:0/2081109391 conn(0x7fbfb006bc10 msgr2=0x7fbfb00b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:41.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 -- 172.21.15.99:0/2081109391 shutdown_connections 2024-09-10T07:43:41.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.438+0000 7fbfb6600640 1 -- 172.21.15.99:0/2081109391 wait complete. 2024-09-10T07:43:41.462 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:43:41.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.619+0000 7f9e08800640 1 Processor -- start 2024-09-10T07:43:41.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.620+0000 7f9e08800640 1 -- start start 2024-09-10T07:43:41.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.621+0000 7f9e08800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9e0015ece0 0x7f9e00071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:41.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.621+0000 7f9e08800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e000af250 0x7f9e0006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:41.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.621+0000 7f9e08800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0006f1a0 con 0x7f9e000b4e70 2024-09-10T07:43:41.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.621+0000 7f9e08800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9e000d1780 con 0x7f9e0015ece0 2024-09-10T07:43:41.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.621+0000 7f9e08800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0006d5d0 con 0x7f9e000af250 2024-09-10T07:43:41.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.621+0000 7f9e05400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9e0015ece0 0x7f9e00071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:41.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.621+0000 7f9e05400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9e0015ece0 0x7f9e00071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52732/0 (socket says 172.21.15.99:52732) 2024-09-10T07:43:41.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.621+0000 7f9e05400640 1 -- 172.21.15.99:0/3634606128 learned_addr learned my addr 172.21.15.99:0/3634606128 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:41.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.621+0000 7f9e06800640 1 --2- 172.21.15.99:0/3634606128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e000af250 0x7f9e0006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:41.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.622+0000 7f9e05400640 1 -- 172.21.15.99:0/3634606128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e000af250 msgr2=0x7f9e0006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:41.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.622+0000 7f9e05400640 1 --2- 172.21.15.99:0/3634606128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e000af250 0x7f9e0006dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:41.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.622+0000 7f9e05400640 1 -- 172.21.15.99:0/3634606128 >> v1:172.21.15.187:6789/0 conn(0x7f9e000b4e70 legacy=0x7f9e000b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:41.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.622+0000 7f9e05400640 1 -- 172.21.15.99:0/3634606128 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0006f480 con 0x7f9e0015ece0 2024-09-10T07:43:41.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.623+0000 7f9e05400640 1 --2- 172.21.15.99:0/3634606128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e0015ece0 0x7f9e00071570 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009870 tx=0x7f9df002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa219804de833c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:41.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.623+0000 7f9e04a00640 1 -- 172.21.15.99:0/3634606128 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0037070 con 0x7f9e0015ece0 2024-09-10T07:43:41.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.623+0000 7f9e04a00640 1 -- 172.21.15.99:0/3634606128 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df0032440 con 0x7f9e0015ece0 2024-09-10T07:43:41.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.623+0000 7f9e04a00640 1 -- 172.21.15.99:0/3634606128 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0032810 con 0x7f9e0015ece0 2024-09-10T07:43:41.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.623+0000 7f9e08800640 1 -- 172.21.15.99:0/3634606128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e0015ece0 msgr2=0x7f9e00071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:41.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.623+0000 7f9e08800640 1 --2- 172.21.15.99:0/3634606128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e0015ece0 0x7f9e00071570 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009870 tx=0x7f9df002a270 comp rx=0 tx=0).stop 2024-09-10T07:43:41.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.624+0000 7f9e08800640 1 -- 172.21.15.99:0/3634606128 shutdown_connections 2024-09-10T07:43:41.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.624+0000 7f9e08800640 1 --2- 172.21.15.99:0/3634606128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e000af250 0x7f9e0006dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:41.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.624+0000 7f9e08800640 1 --2- 172.21.15.99:0/3634606128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e0015ece0 0x7f9e00071570 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:41.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.624+0000 7f9e08800640 1 -- 172.21.15.99:0/3634606128 >> 172.21.15.99:0/3634606128 conn(0x7f9e0006bc10 msgr2=0x7f9e0006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:41.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.624+0000 7f9e08800640 1 -- 172.21.15.99:0/3634606128 shutdown_connections 2024-09-10T07:43:41.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.624+0000 7f9e08800640 1 -- 172.21.15.99:0/3634606128 wait complete. 2024-09-10T07:43:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.625+0000 7f9e08800640 1 Processor -- start 2024-09-10T07:43:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.625+0000 7f9e08800640 1 -- start start 2024-09-10T07:43:41.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.626+0000 7f9e08800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e000af250 0x7f9e0014fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.626+0000 7f9e08800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e000b4e70 0x7f9e00158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.626+0000 7f9e08800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e0015b120 0x7f9e0015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.626+0000 7f9e08800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0006ede0 con 0x7f9e000b4e70 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.626+0000 7f9e08800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0006d820 con 0x7f9e0015b120 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.626+0000 7f9e08800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0006ef60 con 0x7f9e000af250 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e05400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e000b4e70 0x7f9e00158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e05400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e000b4e70 0x7f9e00158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52740/0 (socket says 172.21.15.99:52740) 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e05400640 1 -- 172.21.15.99:0/188599821 learned_addr learned my addr 172.21.15.99:0/188599821 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e05e00640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e000af250 0x7f9e0014fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e06800640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e0015b120 0x7f9e0015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e05400640 1 -- 172.21.15.99:0/188599821 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e000af250 msgr2=0x7f9e0014fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e05400640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e000af250 0x7f9e0014fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e05400640 1 -- 172.21.15.99:0/188599821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e0015b120 msgr2=0x7f9e0015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:41.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e05400640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e0015b120 0x7f9e0015b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:41.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e05400640 1 -- 172.21.15.99:0/188599821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e001f4f00 con 0x7f9e000b4e70 2024-09-10T07:43:41.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.627+0000 7f9e05400640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e000b4e70 0x7f9e00158d50 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9df002a2b0 tx=0x7f9df00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:41.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.628+0000 7f9dfa000640 1 -- 172.21.15.99:0/188599821 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0041030 con 0x7f9e000b4e70 2024-09-10T07:43:41.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.628+0000 7f9dfa000640 1 -- 172.21.15.99:0/188599821 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df0030440 con 0x7f9e000b4e70 2024-09-10T07:43:41.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.628+0000 7f9e08800640 1 -- 172.21.15.99:0/188599821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e00151040 con 0x7f9e000b4e70 2024-09-10T07:43:41.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.628+0000 7f9dfa000640 1 -- 172.21.15.99:0/188599821 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0037040 con 0x7f9e000b4e70 2024-09-10T07:43:41.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.628+0000 7f9e08800640 1 -- 172.21.15.99:0/188599821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e00160620 con 0x7f9e000b4e70 2024-09-10T07:43:41.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.629+0000 7f9e08800640 1 -- 172.21.15.99:0/188599821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e000af6e0 con 0x7f9e000b4e70 2024-09-10T07:43:41.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.630+0000 7f9dfa000640 1 -- 172.21.15.99:0/188599821 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9df0044070 con 0x7f9e000b4e70 2024-09-10T07:43:41.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.631+0000 7f9dfa000640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9de406be60 0x7f9de406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:41.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.631+0000 7f9dfa000640 1 -- 172.21.15.99:0/188599821 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5609+0+0 (secure 0 0 0) 0x7f9df00ab150 con 0x7f9e000b4e70 2024-09-10T07:43:41.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.631+0000 7f9e05e00640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9de406be60 0x7f9de406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:41.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.632+0000 7f9e05e00640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9de406be60 0x7f9de406e320 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9df4001780 tx=0x7f9df4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.636+0000 7f9dfa000640 1 -- 172.21.15.99:0/188599821 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9df004b070 con 0x7f9e000b4e70 2024-09-10T07:43:41.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:41.844+0000 7f9e08800640 1 -- 172.21.15.99:0/188599821 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9e00151500 con 0x7f9e000b4e70 2024-09-10T07:43:42.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.437+0000 7f9dfa000640 1 -- 172.21.15.99:0/188599821 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v78) ==== 174+0+0 (secure 0 0 0) 0x7f9df0079470 con 0x7f9e000b4e70 2024-09-10T07:43:42.436 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 20 and data pool 21 2024-09-10T07:43:42.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.440+0000 7f9e08800640 1 -- 172.21.15.99:0/188599821 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9de406be60 msgr2=0x7f9de406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.440+0000 7f9e08800640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9de406be60 0x7f9de406e320 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9df4001780 tx=0x7f9df4009040 comp rx=0 tx=0).stop 2024-09-10T07:43:42.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.440+0000 7f9e08800640 1 -- 172.21.15.99:0/188599821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e000b4e70 msgr2=0x7f9e00158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.440+0000 7f9e08800640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e000b4e70 0x7f9e00158d50 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9df002a2b0 tx=0x7f9df00046c0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.441+0000 7f9e08800640 1 -- 172.21.15.99:0/188599821 shutdown_connections 2024-09-10T07:43:42.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.441+0000 7f9e08800640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e0015b120 0x7f9e0015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.441+0000 7f9e08800640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9de406be60 0x7f9de406e320 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.441+0000 7f9e08800640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e000b4e70 0x7f9e00158d50 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.441+0000 7f9e08800640 1 --2- 172.21.15.99:0/188599821 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e000af250 0x7f9e0014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.441+0000 7f9e08800640 1 -- 172.21.15.99:0/188599821 >> 172.21.15.99:0/188599821 conn(0x7f9e0006bc10 msgr2=0x7f9e00074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:42.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.443+0000 7f9e08800640 1 -- 172.21.15.99:0/188599821 shutdown_connections 2024-09-10T07:43:42.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.443+0000 7f9e08800640 1 -- 172.21.15.99:0/188599821 wait complete. 2024-09-10T07:43:42.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:43:42.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.626+0000 7fccb3600640 1 Processor -- start 2024-09-10T07:43:42.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.626+0000 7fccb3600640 1 -- start start 2024-09-10T07:43:42.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fccb3600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fccac160c50 0x7fccac167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fccb3600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccac142650 con 0x7fccac142150 2024-09-10T07:43:42.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fccb3600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccac142930 con 0x7fccac13fae0 2024-09-10T07:43:42.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fccb3600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fccac0ce780 con 0x7fccac160c50 2024-09-10T07:43:42.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fccb1600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fccac160c50 0x7fccac167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:42.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fcca3e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fccac142150 0x7fccac160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39630/0 (socket says 172.21.15.99:39630) 2024-09-10T07:43:42.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fcca3e00640 1 -- 172.21.15.99:0/4211368890 learned_addr learned my addr 172.21.15.99:0/4211368890 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:42.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fccb1600640 1 -- 172.21.15.99:0/4211368890 >> v1:172.21.15.187:6789/0 conn(0x7fccac13fae0 legacy=0x7fccac06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:42.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fccb1600640 1 -- 172.21.15.99:0/4211368890 >> v1:172.21.15.99:6789/0 conn(0x7fccac142150 legacy=0x7fccac160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fccb1600640 1 -- 172.21.15.99:0/4211368890 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac142c10 con 0x7fccac160c50 2024-09-10T07:43:42.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.628+0000 7fccabe00640 1 -- 172.21.15.99:0/4211368890 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1955827857 0 0) 0x7fccac142650 con 0x7fccac142150 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.629+0000 7fccb1600640 1 --2- 172.21.15.99:0/4211368890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac160c50 0x7fccac167680 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009d90 tx=0x7fcca402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e72c26906a88fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.630+0000 7fccabe00640 1 -- 172.21.15.99:0/4211368890 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4031600 con 0x7fccac160c50 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.630+0000 7fccabe00640 1 -- 172.21.15.99:0/4211368890 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca40317a0 con 0x7fccac160c50 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.630+0000 7fccabe00640 1 -- 172.21.15.99:0/4211368890 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4031b70 con 0x7fccac160c50 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.630+0000 7fccb3600640 1 -- 172.21.15.99:0/4211368890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac160c50 msgr2=0x7fccac167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.630+0000 7fccb3600640 1 --2- 172.21.15.99:0/4211368890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac160c50 0x7fccac167680 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009d90 tx=0x7fcca402a610 comp rx=0 tx=0).stop 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.630+0000 7fccb3600640 1 -- 172.21.15.99:0/4211368890 shutdown_connections 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.630+0000 7fccb3600640 1 --2- 172.21.15.99:0/4211368890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac160c50 0x7fccac167680 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.630+0000 7fccb3600640 1 -- 172.21.15.99:0/4211368890 >> 172.21.15.99:0/4211368890 conn(0x7fccac06bc10 msgr2=0x7fccac06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.630+0000 7fccb3600640 1 -- 172.21.15.99:0/4211368890 shutdown_connections 2024-09-10T07:43:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.630+0000 7fccb3600640 1 -- 172.21.15.99:0/4211368890 wait complete. 2024-09-10T07:43:42.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.632+0000 7fccb3600640 1 Processor -- start 2024-09-10T07:43:42.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.632+0000 7fccb3600640 1 -- start start 2024-09-10T07:43:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.633+0000 7fccb3600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac13fae0 0x7fccac141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.633+0000 7fccb3600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fccac142150 0x7fccac1f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.633+0000 7fccb3600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccac160c50 0x7fccac159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.633+0000 7fccb3600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fccac0cfda0 con 0x7fccac13fae0 2024-09-10T07:43:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.633+0000 7fccb3600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fccac0cfc20 con 0x7fccac160c50 2024-09-10T07:43:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.633+0000 7fccb3600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fccac0cff20 con 0x7fccac142150 2024-09-10T07:43:42.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.633+0000 7fccb0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac13fae0 0x7fccac141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:42.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.633+0000 7fccb0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac13fae0 0x7fccac141bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52770/0 (socket says 172.21.15.99:52770) 2024-09-10T07:43:42.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.633+0000 7fccb0c00640 1 -- 172.21.15.99:0/1115581041 learned_addr learned my addr 172.21.15.99:0/1115581041 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:42.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fccb0c00640 1 -- 172.21.15.99:0/1115581041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fccac142150 msgr2=0x7fccac1f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fccb0c00640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fccac142150 0x7fccac1f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fccb0c00640 1 -- 172.21.15.99:0/1115581041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccac160c50 msgr2=0x7fccac159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fccb0c00640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccac160c50 0x7fccac159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fccb0c00640 1 -- 172.21.15.99:0/1115581041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac1f2e20 con 0x7fccac13fae0 2024-09-10T07:43:42.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fccb0c00640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac13fae0 0x7fccac141bd0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00c430 tx=0x7fcc9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:42.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fcca9600640 1 -- 172.21.15.99:0/1115581041 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c011790 con 0x7fccac13fae0 2024-09-10T07:43:42.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fcca9600640 1 -- 172.21.15.99:0/1115581041 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc9c017070 con 0x7fccac13fae0 2024-09-10T07:43:42.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fccb3600640 1 -- 172.21.15.99:0/1115581041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccac1f3100 con 0x7fccac13fae0 2024-09-10T07:43:42.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fcca9600640 1 -- 172.21.15.99:0/1115581041 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c011bb0 con 0x7fccac13fae0 2024-09-10T07:43:42.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.634+0000 7fccb3600640 1 -- 172.21.15.99:0/1115581041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccac157720 con 0x7fccac13fae0 2024-09-10T07:43:42.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.635+0000 7fccb3600640 1 -- 172.21.15.99:0/1115581041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccac1f3620 con 0x7fccac13fae0 2024-09-10T07:43:42.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.636+0000 7fcca9600640 1 -- 172.21.15.99:0/1115581041 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc9c01c460 con 0x7fccac13fae0 2024-09-10T07:43:42.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.637+0000 7fcca9600640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc8806be60 0x7fcc8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.637+0000 7fcca9600640 1 -- 172.21.15.99:0/1115581041 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5709+0+0 (secure 0 0 0) 0x7fcc9c08ad50 con 0x7fccac13fae0 2024-09-10T07:43:42.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.637+0000 7fcca3e00640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc8806be60 0x7fcc8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:42.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.638+0000 7fcca3e00640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc8806be60 0x7fcc8806e320 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcc94007fd0 tx=0x7fcc94007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:42.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.642+0000 7fcca9600640 1 -- 172.21.15.99:0/1115581041 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccac1f3620 con 0x7fccac13fae0 2024-09-10T07:43:42.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.816+0000 7fccb3600640 1 -- 172.21.15.99:0/1115581041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccac160540 con 0x7fccac13fae0 2024-09-10T07:43:42.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.817+0000 7fcca9600640 1 -- 172.21.15.99:0/1115581041 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) ==== 74+0+16729 (secure 0 0 0) 0x7fcc9c0596f0 con 0x7fccac13fae0 2024-09-10T07:43:42.816 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:42.816 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":170,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:43:41.844765+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:43:39.625121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-10T07:43:40.843617+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:43:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 -- 172.21.15.99:0/1115581041 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc8806be60 msgr2=0x7fcc8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc8806be60 0x7fcc8806e320 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcc94007fd0 tx=0x7fcc94007920 comp rx=0 tx=0).stop 2024-09-10T07:43:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 -- 172.21.15.99:0/1115581041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac13fae0 msgr2=0x7fccac141bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac13fae0 0x7fccac141bd0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00c430 tx=0x7fcc9c00c8f0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 -- 172.21.15.99:0/1115581041 shutdown_connections 2024-09-10T07:43:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccac160c50 0x7fccac159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fccac142150 0x7fccac1f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcc8806be60 0x7fcc8806e320 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 --2- 172.21.15.99:0/1115581041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccac13fae0 0x7fccac141bd0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 -- 172.21.15.99:0/1115581041 >> 172.21.15.99:0/1115581041 conn(0x7fccac06bc10 msgr2=0x7fccac06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 -- 172.21.15.99:0/1115581041 shutdown_connections 2024-09-10T07:43:42.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.819+0000 7fccb3600640 1 -- 172.21.15.99:0/1115581041 wait complete. 2024-09-10T07:43:42.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:43:42.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.986+0000 7fd3e6e00640 1 Processor -- start 2024-09-10T07:43:42.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.987+0000 7fd3e6e00640 1 -- start start 2024-09-10T07:43:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.988+0000 7fd3e6e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd3e0145290 0x7fd3e006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.988+0000 7fd3e6e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3e00ce780 0x7fd3e0072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.988+0000 7fd3e6e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e006e3d0 con 0x7fd3e0071510 2024-09-10T07:43:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.988+0000 7fd3e6e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e006efe0 con 0x7fd3e0145290 2024-09-10T07:43:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.988+0000 7fd3e6e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e006e6b0 con 0x7fd3e00ce780 2024-09-10T07:43:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.988+0000 7fd3dfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd3e0145290 0x7fd3e006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.988+0000 7fd3dfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd3e0145290 0x7fd3e006f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52784/0 (socket says 172.21.15.99:52784) 2024-09-10T07:43:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.988+0000 7fd3dfe00640 1 -- 172.21.15.99:0/255260460 learned_addr learned my addr 172.21.15.99:0/255260460 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:42.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.989+0000 7fd3df400640 1 --2- 172.21.15.99:0/255260460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3e00ce780 0x7fd3e0072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:42.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.989+0000 7fd3dfe00640 1 -- 172.21.15.99:0/255260460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3e00ce780 msgr2=0x7fd3e0072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:42.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.989+0000 7fd3dfe00640 1 --2- 172.21.15.99:0/255260460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3e00ce780 0x7fd3e0072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.989+0000 7fd3dfe00640 1 -- 172.21.15.99:0/255260460 >> v1:172.21.15.187:6789/0 conn(0x7fd3e0071510 legacy=0x7fd3e00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:42.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.989+0000 7fd3dfe00640 1 -- 172.21.15.99:0/255260460 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e006e990 con 0x7fd3e0145290 2024-09-10T07:43:42.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.990+0000 7fd3dfe00640 1 --2- 172.21.15.99:0/255260460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0145290 0x7fd3e006f470 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009870 tx=0x7fd3d002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd659b1abdc17cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:42.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.990+0000 7fd3dea00640 1 -- 172.21.15.99:0/255260460 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0037070 con 0x7fd3e0145290 2024-09-10T07:43:42.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.990+0000 7fd3dea00640 1 -- 172.21.15.99:0/255260460 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d0032440 con 0x7fd3e0145290 2024-09-10T07:43:42.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.990+0000 7fd3dea00640 1 -- 172.21.15.99:0/255260460 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0032810 con 0x7fd3e0145290 2024-09-10T07:43:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.990+0000 7fd3e6e00640 1 -- 172.21.15.99:0/255260460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0145290 msgr2=0x7fd3e006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.990+0000 7fd3e6e00640 1 --2- 172.21.15.99:0/255260460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0145290 0x7fd3e006f470 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009870 tx=0x7fd3d002a210 comp rx=0 tx=0).stop 2024-09-10T07:43:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.991+0000 7fd3e6e00640 1 -- 172.21.15.99:0/255260460 shutdown_connections 2024-09-10T07:43:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.991+0000 7fd3e6e00640 1 --2- 172.21.15.99:0/255260460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3e00ce780 0x7fd3e0072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.991+0000 7fd3e6e00640 1 --2- 172.21.15.99:0/255260460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0145290 0x7fd3e006f470 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.991+0000 7fd3e6e00640 1 -- 172.21.15.99:0/255260460 >> 172.21.15.99:0/255260460 conn(0x7fd3e006bc10 msgr2=0x7fd3e006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.991+0000 7fd3e6e00640 1 -- 172.21.15.99:0/255260460 shutdown_connections 2024-09-10T07:43:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.991+0000 7fd3e6e00640 1 -- 172.21.15.99:0/255260460 wait complete. 2024-09-10T07:43:42.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.992+0000 7fd3e6e00640 1 Processor -- start 2024-09-10T07:43:42.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.992+0000 7fd3e6e00640 1 -- start start 2024-09-10T07:43:42.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.993+0000 7fd3e6e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0071510 0x7fd3e00c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.993+0000 7fd3e6e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3e00ce780 0x7fd3e00b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.993+0000 7fd3e6e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3e0145290 0x7fd3e00cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.993+0000 7fd3e6e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e006df80 con 0x7fd3e0071510 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.993+0000 7fd3e6e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e0145670 con 0x7fd3e00ce780 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.993+0000 7fd3e6e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e006e100 con 0x7fd3e0145290 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3dfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0071510 0x7fd3e00c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3dfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0071510 0x7fd3e00c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52792/0 (socket says 172.21.15.99:52792) 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3dfe00640 1 -- 172.21.15.99:0/1167109863 learned_addr learned my addr 172.21.15.99:0/1167109863 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3df400640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3e00ce780 0x7fd3e00b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3e4e00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3e0145290 0x7fd3e00cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3dfe00640 1 -- 172.21.15.99:0/1167109863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3e0145290 msgr2=0x7fd3e00cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3dfe00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3e0145290 0x7fd3e00cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3dfe00640 1 -- 172.21.15.99:0/1167109863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3e00ce780 msgr2=0x7fd3e00b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3dfe00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3e00ce780 0x7fd3e00b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:42.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3dfe00640 1 -- 172.21.15.99:0/1167109863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e0131150 con 0x7fd3e0071510 2024-09-10T07:43:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.994+0000 7fd3dfe00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0071510 0x7fd3e00c9590 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0000c00 tx=0x7fd3d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:42.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.995+0000 7fd3d7e00640 1 -- 172.21.15.99:0/1167109863 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0041020 con 0x7fd3e0071510 2024-09-10T07:43:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.995+0000 7fd3d7e00640 1 -- 172.21.15.99:0/1167109863 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d00306c0 con 0x7fd3e0071510 2024-09-10T07:43:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.995+0000 7fd3d7e00640 1 -- 172.21.15.99:0/1167109863 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0037040 con 0x7fd3e0071510 2024-09-10T07:43:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.995+0000 7fd3e6e00640 1 -- 172.21.15.99:0/1167109863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e01313f0 con 0x7fd3e0071510 2024-09-10T07:43:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.995+0000 7fd3e6e00640 1 -- 172.21.15.99:0/1167109863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e01319b0 con 0x7fd3e0071510 2024-09-10T07:43:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.996+0000 7fd3e6e00640 1 -- 172.21.15.99:0/1167109863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e006f470 con 0x7fd3e0071510 2024-09-10T07:43:42.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.997+0000 7fd3d7e00640 1 -- 172.21.15.99:0/1167109863 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3d0044020 con 0x7fd3e0071510 2024-09-10T07:43:42.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.998+0000 7fd3d7e00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd3c006be60 0x7fd3c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:42.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.998+0000 7fd3d7e00640 1 -- 172.21.15.99:0/1167109863 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5709+0+0 (secure 0 0 0) 0x7fd3d00ab730 con 0x7fd3e0071510 2024-09-10T07:43:42.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.998+0000 7fd3df400640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd3c006be60 0x7fd3c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:42.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:42.999+0000 7fd3df400640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd3c006be60 0x7fd3c006e320 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd3e01f6300 tx=0x7fd3cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:43.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.002+0000 7fd3d7e00640 1 -- 172.21.15.99:0/1167109863 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3d004b030 con 0x7fd3e0071510 2024-09-10T07:43:43.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.178+0000 7fd3e6e00640 1 -- 172.21.15.99:0/1167109863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3e0141480 con 0x7fd3e0071510 2024-09-10T07:43:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.179+0000 7fd3d7e00640 1 -- 172.21.15.99:0/1167109863 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) ==== 74+0+16729 (secure 0 0 0) 0x7fd3d0079fb0 con 0x7fd3e0071510 2024-09-10T07:43:43.179 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:43.180 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":170,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:43:41.844765+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:43:39.625121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-10T07:43:40.843617+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 -- 172.21.15.99:0/1167109863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd3c006be60 msgr2=0x7fd3c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd3c006be60 0x7fd3c006e320 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd3e01f6300 tx=0x7fd3cc008040 comp rx=0 tx=0).stop 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 -- 172.21.15.99:0/1167109863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0071510 msgr2=0x7fd3e00c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0071510 0x7fd3e00c9590 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0000c00 tx=0x7fd3d00046c0 comp rx=0 tx=0).stop 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 -- 172.21.15.99:0/1167109863 shutdown_connections 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3e0145290 0x7fd3e00cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3e00ce780 0x7fd3e00b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd3c006be60 0x7fd3c006e320 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 --2- 172.21.15.99:0/1167109863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e0071510 0x7fd3e00c9590 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 -- 172.21.15.99:0/1167109863 >> 172.21.15.99:0/1167109863 conn(0x7fd3e006bc10 msgr2=0x7fd3e0072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 -- 172.21.15.99:0/1167109863 shutdown_connections 2024-09-10T07:43:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.182+0000 7fd3e6e00640 1 -- 172.21.15.99:0/1167109863 wait complete. 2024-09-10T07:43:43.197 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:43:43.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.353+0000 7fe78a000640 1 Processor -- start 2024-09-10T07:43:43.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.353+0000 7fe78a000640 1 -- start start 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.354+0000 7fe78a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78406e280 0x7fe784073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.354+0000 7fe78a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7840d1010 0x7fe7840ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.354+0000 7fe78a000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7840722d0 con 0x7fe784071df0 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.354+0000 7fe78a000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fe7840738b0 con 0x7fe7840d1010 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.354+0000 7fe78a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe7840725b0 con 0x7fe78406e280 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.355+0000 7fe783e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7840d1010 0x7fe7840ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.355+0000 7fe783e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7840d1010 0x7fe7840ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52796/0 (socket says 172.21.15.99:52796) 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.355+0000 7fe783e00640 1 -- 172.21.15.99:0/2998039298 learned_addr learned my addr 172.21.15.99:0/2998039298 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.355+0000 7fe783400640 1 --2- 172.21.15.99:0/2998039298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78406e280 0x7fe784073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.355+0000 7fe783e00640 1 -- 172.21.15.99:0/2998039298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78406e280 msgr2=0x7fe784073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.355+0000 7fe783e00640 1 --2- 172.21.15.99:0/2998039298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78406e280 0x7fe784073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.355+0000 7fe783e00640 1 -- 172.21.15.99:0/2998039298 >> v1:172.21.15.187:6789/0 conn(0x7fe784071df0 legacy=0x7fe78406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:43.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.355+0000 7fe783e00640 1 -- 172.21.15.99:0/2998039298 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe784072890 con 0x7fe7840d1010 2024-09-10T07:43:43.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.355+0000 7fe783400640 1 --2- 172.21.15.99:0/2998039298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78406e280 0x7fe784073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.356+0000 7fe783e00640 1 --2- 172.21.15.99:0/2998039298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 0x7fe7840ce3d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009e50 tx=0x7fe77c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1149ceebc502b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.356+0000 7fe782000640 1 -- 172.21.15.99:0/2998039298 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c036070 con 0x7fe7840d1010 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.356+0000 7fe782000640 1 -- 172.21.15.99:0/2998039298 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c031600 con 0x7fe7840d1010 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.356+0000 7fe782000640 1 -- 172.21.15.99:0/2998039298 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0319d0 con 0x7fe7840d1010 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.357+0000 7fe78a000640 1 -- 172.21.15.99:0/2998039298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 msgr2=0x7fe7840ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.357+0000 7fe78a000640 1 --2- 172.21.15.99:0/2998039298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 0x7fe7840ce3d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009e50 tx=0x7fe77c02a710 comp rx=0 tx=0).stop 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.357+0000 7fe78a000640 1 -- 172.21.15.99:0/2998039298 shutdown_connections 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.357+0000 7fe78a000640 1 --2- 172.21.15.99:0/2998039298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 0x7fe7840ce3d0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.357+0000 7fe78a000640 1 --2- 172.21.15.99:0/2998039298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78406e280 0x7fe784073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.357+0000 7fe78a000640 1 -- 172.21.15.99:0/2998039298 >> 172.21.15.99:0/2998039298 conn(0x7fe78406bc10 msgr2=0x7fe78406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:43.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.357+0000 7fe78a000640 1 -- 172.21.15.99:0/2998039298 shutdown_connections 2024-09-10T07:43:43.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.357+0000 7fe78a000640 1 -- 172.21.15.99:0/2998039298 wait complete. 2024-09-10T07:43:43.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.358+0000 7fe78a000640 1 Processor -- start 2024-09-10T07:43:43.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.359+0000 7fe78a000640 1 -- start start 2024-09-10T07:43:43.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.359+0000 7fe78a000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78406e280 0x7fe7841501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:43.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.359+0000 7fe78a000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe784071df0 0x7fe784158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:43.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.359+0000 7fe78a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 0x7fe784158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:43.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.359+0000 7fe78a000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe78415db60 con 0x7fe7840d1010 2024-09-10T07:43:43.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.359+0000 7fe78a000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe784072e50 con 0x7fe78406e280 2024-09-10T07:43:43.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe78a000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fe7840d14c0 con 0x7fe784071df0 2024-09-10T07:43:43.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe783e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 0x7fe784158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:43.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe783e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 0x7fe784158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52810/0 (socket says 172.21.15.99:52810) 2024-09-10T07:43:43.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe783e00640 1 -- 172.21.15.99:0/1495163906 learned_addr learned my addr 172.21.15.99:0/1495163906 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe783400640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78406e280 0x7fe7841501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe782a00640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe784071df0 0x7fe784158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe783e00640 1 -- 172.21.15.99:0/1495163906 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe784071df0 msgr2=0x7fe784158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe783e00640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe784071df0 0x7fe784158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe783e00640 1 -- 172.21.15.99:0/1495163906 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78406e280 msgr2=0x7fe7841501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe783e00640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78406e280 0x7fe7841501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe783e00640 1 -- 172.21.15.99:0/1495163906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe784150730 con 0x7fe7840d1010 2024-09-10T07:43:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe782a00640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe784071df0 0x7fe784158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.360+0000 7fe783e00640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 0x7fe784158d40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009e50 tx=0x7fe77c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:43.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.361+0000 7fe77b400640 1 -- 172.21.15.99:0/1495163906 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c041070 con 0x7fe7840d1010 2024-09-10T07:43:43.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.361+0000 7fe77b400640 1 -- 172.21.15.99:0/1495163906 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c03c650 con 0x7fe7840d1010 2024-09-10T07:43:43.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.361+0000 7fe77b400640 1 -- 172.21.15.99:0/1495163906 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c036040 con 0x7fe7840d1010 2024-09-10T07:43:43.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.361+0000 7fe78a000640 1 -- 172.21.15.99:0/1495163906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7840b0030 con 0x7fe7840d1010 2024-09-10T07:43:43.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.361+0000 7fe78a000640 1 -- 172.21.15.99:0/1495163906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7840b05f0 con 0x7fe7840d1010 2024-09-10T07:43:43.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.362+0000 7fe78a000640 1 -- 172.21.15.99:0/1495163906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe784073370 con 0x7fe7840d1010 2024-09-10T07:43:43.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.363+0000 7fe77b400640 1 -- 172.21.15.99:0/1495163906 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe77c044070 con 0x7fe7840d1010 2024-09-10T07:43:43.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.364+0000 7fe77b400640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe76406be30 0x7fe76406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:43.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.364+0000 7fe77b400640 1 -- 172.21.15.99:0/1495163906 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5709+0+0 (secure 0 0 0) 0x7fe77c0ab8e0 con 0x7fe7840d1010 2024-09-10T07:43:43.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.364+0000 7fe783400640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe76406be30 0x7fe76406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:43.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.364+0000 7fe783400640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe76406be30 0x7fe76406e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe78415bc90 tx=0x7fe774008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.368+0000 7fe77b400640 1 -- 172.21.15.99:0/1495163906 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe77c079c30 con 0x7fe7840d1010 2024-09-10T07:43:43.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:43.578+0000 7fe78a000640 1 -- 172.21.15.99:0/1495163906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe7841e6b10 con 0x7fe7840d1010 2024-09-10T07:43:44.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.461+0000 7fe77b400640 1 -- 172.21.15.99:0/1495163906 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v81) ==== 118+0+0 (secure 0 0 0) 0x7fe77c07df30 con 0x7fe7840d1010 2024-09-10T07:43:44.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.464+0000 7fe78a000640 1 -- 172.21.15.99:0/1495163906 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe76406be30 msgr2=0x7fe76406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.464+0000 7fe78a000640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe76406be30 0x7fe76406e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe78415bc90 tx=0x7fe774008040 comp rx=0 tx=0).stop 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.464+0000 7fe78a000640 1 -- 172.21.15.99:0/1495163906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 msgr2=0x7fe784158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.464+0000 7fe78a000640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 0x7fe784158d40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009e50 tx=0x7fe77c004a40 comp rx=0 tx=0).stop 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.464+0000 7fe78a000640 1 -- 172.21.15.99:0/1495163906 shutdown_connections 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.465+0000 7fe78a000640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fe76406be30 0x7fe76406e2f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.465+0000 7fe78a000640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7840d1010 0x7fe784158d40 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.465+0000 7fe78a000640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe784071df0 0x7fe784158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.465+0000 7fe78a000640 1 --2- 172.21.15.99:0/1495163906 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78406e280 0x7fe7841501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.465+0000 7fe78a000640 1 -- 172.21.15.99:0/1495163906 >> 172.21.15.99:0/1495163906 conn(0x7fe78406bc10 msgr2=0x7fe78415edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.465+0000 7fe78a000640 1 -- 172.21.15.99:0/1495163906 shutdown_connections 2024-09-10T07:43:44.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.465+0000 7fe78a000640 1 -- 172.21.15.99:0/1495163906 wait complete. 2024-09-10T07:43:44.483 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T07:43:44.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:43:44.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.643+0000 7f6098600640 1 Processor -- start 2024-09-10T07:43:44.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.644+0000 7f6098600640 1 -- start start 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.645+0000 7f6098600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f60900b4e70 0x7f6090071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.645+0000 7f6098600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f60900af250 0x7f609006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.645+0000 7f6098600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609006f1a0 con 0x7f609015ece0 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.645+0000 7f6098600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f60900d1780 con 0x7f60900af250 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.645+0000 7f6098600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f609006d5d0 con 0x7f60900b4e70 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.645+0000 7f6096600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f60900af250 0x7f609006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.645+0000 7f6095200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f609015ece0 0x7f60900b5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39640/0 (socket says 172.21.15.99:39640) 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.645+0000 7f6095200640 1 -- 172.21.15.99:0/1472995960 learned_addr learned my addr 172.21.15.99:0/1472995960 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.645+0000 7f6095c00640 1 --2- 172.21.15.99:0/1472995960 >> v2:172.21.15.187:3300/0 conn(0x7f60900b4e70 0x7f6090071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.646+0000 7f6096600640 1 -- 172.21.15.99:0/1472995960 >> v2:172.21.15.187:3300/0 conn(0x7f60900b4e70 msgr2=0x7f6090071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.646+0000 7f6096600640 1 --2- 172.21.15.99:0/1472995960 >> v2:172.21.15.187:3300/0 conn(0x7f60900b4e70 0x7f6090071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.646+0000 7f6096600640 1 -- 172.21.15.99:0/1472995960 >> v1:172.21.15.99:6789/0 conn(0x7f609015ece0 legacy=0x7f60900b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:44.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.646+0000 7f6096600640 1 -- 172.21.15.99:0/1472995960 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609006f480 con 0x7f60900af250 2024-09-10T07:43:44.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.646+0000 7f608fe00640 1 -- 172.21.15.99:0/1472995960 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272533938 0 0) 0x7f609006f1a0 con 0x7f609015ece0 2024-09-10T07:43:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.647+0000 7f6096600640 1 --2- 172.21.15.99:0/1472995960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60900af250 0x7f609006dd40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f60900506f0 tx=0x7f608802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34279da659207e6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.647+0000 7f608fe00640 1 -- 172.21.15.99:0/1472995960 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088007740 con 0x7f60900af250 2024-09-10T07:43:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.647+0000 7f608fe00640 1 -- 172.21.15.99:0/1472995960 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60880078e0 con 0x7f60900af250 2024-09-10T07:43:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.647+0000 7f608fe00640 1 -- 172.21.15.99:0/1472995960 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088007cb0 con 0x7f60900af250 2024-09-10T07:43:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.647+0000 7f6098600640 1 -- 172.21.15.99:0/1472995960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60900af250 msgr2=0x7f609006dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.647+0000 7f6098600640 1 --2- 172.21.15.99:0/1472995960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60900af250 0x7f609006dd40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f60900506f0 tx=0x7f608802a680 comp rx=0 tx=0).stop 2024-09-10T07:43:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.648+0000 7f6098600640 1 -- 172.21.15.99:0/1472995960 shutdown_connections 2024-09-10T07:43:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.648+0000 7f6098600640 1 --2- 172.21.15.99:0/1472995960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60900af250 0x7f609006dd40 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.648+0000 7f6098600640 1 --2- 172.21.15.99:0/1472995960 >> v2:172.21.15.187:3300/0 conn(0x7f60900b4e70 0x7f6090071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.648+0000 7f6098600640 1 -- 172.21.15.99:0/1472995960 >> 172.21.15.99:0/1472995960 conn(0x7f609006bc10 msgr2=0x7f609006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.648+0000 7f6098600640 1 -- 172.21.15.99:0/1472995960 shutdown_connections 2024-09-10T07:43:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.648+0000 7f6098600640 1 -- 172.21.15.99:0/1472995960 wait complete. 2024-09-10T07:43:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.649+0000 7f6098600640 1 Processor -- start 2024-09-10T07:43:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.650+0000 7f6098600640 1 -- start start 2024-09-10T07:43:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.650+0000 7f6098600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60900af250 0x7f609015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.650+0000 7f6098600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60900b4e70 0x7f60901f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.650+0000 7f6098600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609015f0d0 0x7f60901613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.650+0000 7f6098600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f609006ede0 con 0x7f609015f0d0 2024-09-10T07:43:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.650+0000 7f6098600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f609006d820 con 0x7f60900af250 2024-09-10T07:43:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.650+0000 7f6098600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f609006ef60 con 0x7f60900b4e70 2024-09-10T07:43:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.651+0000 7f6096600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609015f0d0 0x7f60901613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.651+0000 7f6096600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609015f0d0 0x7f60901613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52826/0 (socket says 172.21.15.99:52826) 2024-09-10T07:43:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.651+0000 7f6096600640 1 -- 172.21.15.99:0/364547515 learned_addr learned my addr 172.21.15.99:0/364547515 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.651+0000 7f6095c00640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60900af250 0x7f609015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.651+0000 7f6095200640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60900b4e70 0x7f60901f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.651+0000 7f6096600640 1 -- 172.21.15.99:0/364547515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60900b4e70 msgr2=0x7f60901f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.651+0000 7f6096600640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60900b4e70 0x7f60901f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.651+0000 7f6096600640 1 -- 172.21.15.99:0/364547515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60900af250 msgr2=0x7f609015e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.651+0000 7f6096600640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60900af250 0x7f609015e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:44.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.651+0000 7f6096600640 1 -- 172.21.15.99:0/364547515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609015dcb0 con 0x7f609015f0d0 2024-09-10T07:43:44.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.652+0000 7f6096600640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609015f0d0 0x7f60901613c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6088009e80 tx=0x7f6088004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:44.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.652+0000 7f608d600640 1 -- 172.21.15.99:0/364547515 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088040070 con 0x7f609015f0d0 2024-09-10T07:43:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.652+0000 7f608d600640 1 -- 172.21.15.99:0/364547515 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6088031c40 con 0x7f609015f0d0 2024-09-10T07:43:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.652+0000 7f608d600640 1 -- 172.21.15.99:0/364547515 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088009450 con 0x7f609015f0d0 2024-09-10T07:43:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.652+0000 7f6098600640 1 -- 172.21.15.99:0/364547515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609015f760 con 0x7f609015f0d0 2024-09-10T07:43:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.652+0000 7f6098600640 1 -- 172.21.15.99:0/364547515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609015fd20 con 0x7f609015f0d0 2024-09-10T07:43:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.653+0000 7f6098600640 1 -- 172.21.15.99:0/364547515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60900af6a0 con 0x7f609015f0d0 2024-09-10T07:43:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.654+0000 7f608d600640 1 -- 172.21.15.99:0/364547515 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6088039040 con 0x7f609015f0d0 2024-09-10T07:43:44.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.655+0000 7f608d600640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f607006be60 0x7f607006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:44.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.655+0000 7f608d600640 1 -- 172.21.15.99:0/364547515 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f60880abff0 con 0x7f609015f0d0 2024-09-10T07:43:44.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.655+0000 7f6095c00640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f607006be60 0x7f607006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:44.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.656+0000 7f6095c00640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f607006be60 0x7f607006e320 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6090163650 tx=0x7f6084009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:44.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.659+0000 7f608d600640 1 -- 172.21.15.99:0/364547515 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f608807a2d0 con 0x7f609015f0d0 2024-09-10T07:43:44.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:44.868+0000 7f6098600640 1 -- 172.21.15.99:0/364547515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6090075620 con 0x7f609015f0d0 2024-09-10T07:43:45.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.463+0000 7f608d600640 1 -- 172.21.15.99:0/364547515 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v82) ==== 122+0+0 (secure 0 0 0) 0x7f608807e5d0 con 0x7f609015f0d0 2024-09-10T07:43:45.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.465+0000 7f6098600640 1 -- 172.21.15.99:0/364547515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f607006be60 msgr2=0x7f607006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:45.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.465+0000 7f6098600640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f607006be60 0x7f607006e320 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6090163650 tx=0x7f6084009190 comp rx=0 tx=0).stop 2024-09-10T07:43:45.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.465+0000 7f6098600640 1 -- 172.21.15.99:0/364547515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609015f0d0 msgr2=0x7f60901613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.465+0000 7f6098600640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609015f0d0 0x7f60901613c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6088009e80 tx=0x7f6088004a40 comp rx=0 tx=0).stop 2024-09-10T07:43:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.466+0000 7f6098600640 1 -- 172.21.15.99:0/364547515 shutdown_connections 2024-09-10T07:43:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.466+0000 7f6098600640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f607006be60 0x7f607006e320 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.466+0000 7f6098600640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609015f0d0 0x7f60901613c0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.466+0000 7f6098600640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60900b4e70 0x7f60901f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.466+0000 7f6098600640 1 --2- 172.21.15.99:0/364547515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60900af250 0x7f609015e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.466+0000 7f6098600640 1 -- 172.21.15.99:0/364547515 >> 172.21.15.99:0/364547515 conn(0x7f609006bc10 msgr2=0x7f609006e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.466+0000 7f6098600640 1 -- 172.21.15.99:0/364547515 shutdown_connections 2024-09-10T07:43:45.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.466+0000 7f6098600640 1 -- 172.21.15.99:0/364547515 wait complete. 2024-09-10T07:43:45.484 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:43:45.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:43:45.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.640+0000 7f48af400640 1 Processor -- start 2024-09-10T07:43:45.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.641+0000 7f48af400640 1 -- start start 2024-09-10T07:43:45.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.642+0000 7f48af400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f48a8145290 0x7f48a806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:45.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.642+0000 7f48af400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48a806e3d0 con 0x7f48a8072f40 2024-09-10T07:43:45.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.642+0000 7f48af400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48a806e6b0 con 0x7f48a80ce780 2024-09-10T07:43:45.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.642+0000 7f48af400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f48a806efe0 con 0x7f48a8145290 2024-09-10T07:43:45.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.642+0000 7f48ad400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f48a8072f40 0x7f48a80b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39646/0 (socket says 172.21.15.99:39646) 2024-09-10T07:43:45.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.642+0000 7f48ad400640 1 -- 172.21.15.99:0/3467084789 learned_addr learned my addr 172.21.15.99:0/3467084789 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:45.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.642+0000 7f48aca00640 1 --2- 172.21.15.99:0/3467084789 >> v2:172.21.15.187:3300/0 conn(0x7f48a8145290 0x7f48a806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:45.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.643+0000 7f48a7e00640 1 -- 172.21.15.99:0/3467084789 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738046783 0 0) 0x7f48a806e3d0 con 0x7f48a8072f40 2024-09-10T07:43:45.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.643+0000 7f48a7e00640 1 -- 172.21.15.99:0/3467084789 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f488c005730 con 0x7f48a8072f40 2024-09-10T07:43:45.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.643+0000 7f48a7e00640 1 -- 172.21.15.99:0/3467084789 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339860367 0 0) 0x7f48a806e6b0 con 0x7f48a80ce780 2024-09-10T07:43:45.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.643+0000 7f48a7e00640 1 -- 172.21.15.99:0/3467084789 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48a806e3d0 con 0x7f48a80ce780 2024-09-10T07:43:45.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.643+0000 7f48aca00640 1 -- 172.21.15.99:0/3467084789 >> v1:172.21.15.187:6789/0 conn(0x7f48a80ce780 legacy=0x7f48a8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:45.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.643+0000 7f48aca00640 1 -- 172.21.15.99:0/3467084789 >> v1:172.21.15.99:6789/0 conn(0x7f48a8072f40 legacy=0x7f48a80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:45.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.643+0000 7f48aca00640 1 -- 172.21.15.99:0/3467084789 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a806e990 con 0x7f48a8145290 2024-09-10T07:43:45.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.644+0000 7f48aca00640 1 --2- 172.21.15.99:0/3467084789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a8145290 0x7f48a806f470 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f48980097a0 tx=0x7f489802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a17eeb97a1415323 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:45.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.644+0000 7f48a7e00640 1 -- 172.21.15.99:0/3467084789 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898037070 con 0x7f48a8145290 2024-09-10T07:43:45.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.644+0000 7f48a7e00640 1 -- 172.21.15.99:0/3467084789 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4898032440 con 0x7f48a8145290 2024-09-10T07:43:45.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.644+0000 7f48a7e00640 1 -- 172.21.15.99:0/3467084789 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898032810 con 0x7f48a8145290 2024-09-10T07:43:45.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.645+0000 7f48af400640 1 -- 172.21.15.99:0/3467084789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a8145290 msgr2=0x7f48a806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:45.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.645+0000 7f48af400640 1 --2- 172.21.15.99:0/3467084789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a8145290 0x7f48a806f470 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f48980097a0 tx=0x7f489802a230 comp rx=0 tx=0).stop 2024-09-10T07:43:45.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.645+0000 7f48af400640 1 -- 172.21.15.99:0/3467084789 shutdown_connections 2024-09-10T07:43:45.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.645+0000 7f48af400640 1 --2- 172.21.15.99:0/3467084789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a8145290 0x7f48a806f470 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.645+0000 7f48af400640 1 -- 172.21.15.99:0/3467084789 >> 172.21.15.99:0/3467084789 conn(0x7f48a806bc10 msgr2=0x7f48a806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:45.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.645+0000 7f48af400640 1 -- 172.21.15.99:0/3467084789 shutdown_connections 2024-09-10T07:43:45.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.645+0000 7f48af400640 1 -- 172.21.15.99:0/3467084789 wait complete. 2024-09-10T07:43:45.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.647+0000 7f48af400640 1 Processor -- start 2024-09-10T07:43:45.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.647+0000 7f48af400640 1 -- start start 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48af400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a8072f40 0x7f48a80af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48af400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48a80ce780 0x7f48a815e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48af400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48a8145290 0x7f48a8136170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48af400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f48a806df80 con 0x7f48a8145290 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48af400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f48a8145670 con 0x7f48a8072f40 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48af400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f48a806e100 con 0x7f48a80ce780 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48ad400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48a8145290 0x7f48a8136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48aca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a8072f40 0x7f48a80af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48ad400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48a8145290 0x7f48a8136170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52842/0 (socket says 172.21.15.99:52842) 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48ad400640 1 -- 172.21.15.99:0/1151506206 learned_addr learned my addr 172.21.15.99:0/1151506206 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f489fe00640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48a80ce780 0x7f48a815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48ad400640 1 -- 172.21.15.99:0/1151506206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48a80ce780 msgr2=0x7f48a815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:45.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48ad400640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48a80ce780 0x7f48a815e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48ad400640 1 -- 172.21.15.99:0/1151506206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a8072f40 msgr2=0x7f48a80af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:45.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48ad400640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a8072f40 0x7f48a80af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f48ad400640 1 -- 172.21.15.99:0/1151506206 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a80afb50 con 0x7f48a8145290 2024-09-10T07:43:45.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.648+0000 7f489fe00640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48a80ce780 0x7f48a815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:45.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.649+0000 7f48ad400640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48a8145290 0x7f48a8136170 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f48a000cac0 tx=0x7f48a000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:45.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.649+0000 7f48a5600640 1 -- 172.21.15.99:0/1151506206 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0017070 con 0x7f48a8145290 2024-09-10T07:43:45.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.649+0000 7f48a5600640 1 -- 172.21.15.99:0/1151506206 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a000ac30 con 0x7f48a8145290 2024-09-10T07:43:45.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.649+0000 7f48a5600640 1 -- 172.21.15.99:0/1151506206 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0012400 con 0x7f48a8145290 2024-09-10T07:43:45.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.649+0000 7f48af400640 1 -- 172.21.15.99:0/1151506206 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a80afe30 con 0x7f48a8145290 2024-09-10T07:43:45.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.649+0000 7f48af400640 1 -- 172.21.15.99:0/1151506206 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a8151d10 con 0x7f48a8145290 2024-09-10T07:43:45.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.650+0000 7f48af400640 1 -- 172.21.15.99:0/1151506206 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a80715a0 con 0x7f48a8145290 2024-09-10T07:43:45.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.651+0000 7f48a5600640 1 -- 172.21.15.99:0/1151506206 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48a001a070 con 0x7f48a8145290 2024-09-10T07:43:45.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.652+0000 7f48a5600640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f488406be30 0x7f488406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:45.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.652+0000 7f48a5600640 1 -- 172.21.15.99:0/1151506206 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f48a008ab80 con 0x7f48a8145290 2024-09-10T07:43:45.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.652+0000 7f48aca00640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f488406be30 0x7f488406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:45.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.653+0000 7f48aca00640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f488406be30 0x7f488406e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4898034000 tx=0x7f489802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:45.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.656+0000 7f48a5600640 1 -- 172.21.15.99:0/1151506206 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48a0058ed0 con 0x7f48a8145290 2024-09-10T07:43:45.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.860+0000 7f48af400640 1 -- 172.21.15.99:0/1151506206 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48a8140950 con 0x7f48a8145290 2024-09-10T07:43:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.860+0000 7f48a5600640 1 -- 172.21.15.99:0/1151506206 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5224 (secure 0 0 0) 0x7f48a005d1d0 con 0x7f48a8145290 2024-09-10T07:43:45.860 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:45.860 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"btime":"2024-09-10T07:43:45:462569+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/484957916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":484957916},{"type":"v1","addr":"172.21.15.99:6836","nonce":484957916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6967,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/837681918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":837681918},{"type":"v1","addr":"172.21.15.99:6837","nonce":837681918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3241210910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3241210910},{"type":"v1","addr":"172.21.15.187:6834","nonce":3241210910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:43:41.845115+0000","modified":"2024-09-10T07:43:44.869981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/274874285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":274874285},{"type":"v1","addr":"172.21.15.187:6835","nonce":274874285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7494,"qdb_cluster":[7494]},"id":10}]} 2024-09-10T07:43:45.861 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 82 2024-09-10T07:43:45.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.862+0000 7f48af400640 1 -- 172.21.15.99:0/1151506206 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f488406be30 msgr2=0x7f488406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:45.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.862+0000 7f48af400640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f488406be30 0x7f488406e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4898034000 tx=0x7f489802e000 comp rx=0 tx=0).stop 2024-09-10T07:43:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.862+0000 7f48af400640 1 -- 172.21.15.99:0/1151506206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48a8145290 msgr2=0x7f48a8136170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.862+0000 7f48af400640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48a8145290 0x7f48a8136170 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f48a000cac0 tx=0x7f48a000cf80 comp rx=0 tx=0).stop 2024-09-10T07:43:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.862+0000 7f48af400640 1 -- 172.21.15.99:0/1151506206 shutdown_connections 2024-09-10T07:43:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.862+0000 7f48af400640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f488406be30 0x7f488406e2f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.862+0000 7f48af400640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48a8145290 0x7f48a8136170 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.862+0000 7f48af400640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48a80ce780 0x7f48a815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.862+0000 7f48af400640 1 --2- 172.21.15.99:0/1151506206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a8072f40 0x7f48a80af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.863+0000 7f48af400640 1 -- 172.21.15.99:0/1151506206 >> 172.21.15.99:0/1151506206 conn(0x7f48a806bc10 msgr2=0x7f48a80717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.863+0000 7f48af400640 1 -- 172.21.15.99:0/1151506206 shutdown_connections 2024-09-10T07:43:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:45.863+0000 7f48af400640 1 -- 172.21.15.99:0/1151506206 wait complete. 2024-09-10T07:43:45.878 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:43:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.031+0000 7fd239400640 1 Processor -- start 2024-09-10T07:43:46.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.031+0000 7fd239400640 1 -- start start 2024-09-10T07:43:46.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.033+0000 7fd239400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd23415eab0 0x7fd2340b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.033+0000 7fd239400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd2340b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.033+0000 7fd239400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2340d3710 con 0x7fd234070b40 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.033+0000 7fd239400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd2340b6390 con 0x7fd23415eab0 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.033+0000 7fd239400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd2340b6670 con 0x7fd2340d3230 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.033+0000 7fd238a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd2340b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.033+0000 7fd233400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fd234070b40 0x7fd23406cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:41140/0 (socket says 172.21.15.99:41140) 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.033+0000 7fd238a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd2340b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:50706/0 (socket says 172.21.15.99:50706) 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.033+0000 7fd233400640 1 -- 172.21.15.99:0/4175638063 learned_addr learned my addr 172.21.15.99:0/4175638063 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.033+0000 7fd233e00640 1 --2- 172.21.15.99:0/4175638063 >> v2:172.21.15.187:3300/0 conn(0x7fd23415eab0 0x7fd2340b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.034+0000 7fd232a00640 1 -- 172.21.15.99:0/4175638063 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 456448479 0 0) 0x7fd2340d3710 con 0x7fd234070b40 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.034+0000 7fd232a00640 1 -- 172.21.15.99:0/4175638063 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd218003520 con 0x7fd234070b40 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.034+0000 7fd238a00640 1 -- 172.21.15.99:0/4175638063 >> v2:172.21.15.187:3300/0 conn(0x7fd23415eab0 msgr2=0x7fd2340b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.034+0000 7fd238a00640 1 --2- 172.21.15.99:0/4175638063 >> v2:172.21.15.187:3300/0 conn(0x7fd23415eab0 0x7fd2340b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.034+0000 7fd238a00640 1 -- 172.21.15.99:0/4175638063 >> v1:172.21.15.187:6789/0 conn(0x7fd234070b40 legacy=0x7fd23406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.034+0000 7fd238a00640 1 -- 172.21.15.99:0/4175638063 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2340b6950 con 0x7fd2340d3230 2024-09-10T07:43:46.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.034+0000 7fd233e00640 1 --2- 172.21.15.99:0/4175638063 >> v2:172.21.15.187:3300/0 conn(0x7fd23415eab0 0x7fd2340b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.035+0000 7fd238a00640 1 --2- 172.21.15.99:0/4175638063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd2340b7150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009d90 tx=0x7fd22c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1135135f22792f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.035+0000 7fd232a00640 1 -- 172.21.15.99:0/4175638063 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c031600 con 0x7fd2340d3230 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.035+0000 7fd232a00640 1 -- 172.21.15.99:0/4175638063 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c0317a0 con 0x7fd2340d3230 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.035+0000 7fd232a00640 1 -- 172.21.15.99:0/4175638063 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c031b70 con 0x7fd2340d3230 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.036+0000 7fd239400640 1 -- 172.21.15.99:0/4175638063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 msgr2=0x7fd2340b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.036+0000 7fd239400640 1 --2- 172.21.15.99:0/4175638063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd2340b7150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009d90 tx=0x7fd22c02a5d0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.036+0000 7fd239400640 1 -- 172.21.15.99:0/4175638063 shutdown_connections 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.036+0000 7fd239400640 1 --2- 172.21.15.99:0/4175638063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd2340b7150 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.036+0000 7fd239400640 1 --2- 172.21.15.99:0/4175638063 >> v2:172.21.15.187:3300/0 conn(0x7fd23415eab0 0x7fd2340b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.036+0000 7fd239400640 1 -- 172.21.15.99:0/4175638063 >> 172.21.15.99:0/4175638063 conn(0x7fd2340b7cc0 msgr2=0x7fd2340b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.036+0000 7fd239400640 1 -- 172.21.15.99:0/4175638063 shutdown_connections 2024-09-10T07:43:46.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.036+0000 7fd239400640 1 -- 172.21.15.99:0/4175638063 wait complete. 2024-09-10T07:43:46.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.038+0000 7fd239400640 1 Processor -- start 2024-09-10T07:43:46.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.038+0000 7fd239400640 1 -- start start 2024-09-10T07:43:46.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd239400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd234070b40 0x7fd23414bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd239400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd23414e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd239400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23415eab0 0x7fd2340b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd239400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd23415ee90 con 0x7fd234070b40 2024-09-10T07:43:46.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd239400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd23406d430 con 0x7fd23415eab0 2024-09-10T07:43:46.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd239400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd23414f500 con 0x7fd2340d3230 2024-09-10T07:43:46.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd233e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd234070b40 0x7fd23414bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd233e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd234070b40 0x7fd23414bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52854/0 (socket says 172.21.15.99:52854) 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd233e00640 1 -- 172.21.15.99:0/1971640990 learned_addr learned my addr 172.21.15.99:0/1971640990 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd238a00640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23415eab0 0x7fd2340b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd233400640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd23414e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd233e00640 1 -- 172.21.15.99:0/1971640990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 msgr2=0x7fd23414e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd233e00640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd23414e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd233e00640 1 -- 172.21.15.99:0/1971640990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23415eab0 msgr2=0x7fd2340b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd233e00640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23415eab0 0x7fd2340b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd233e00640 1 -- 172.21.15.99:0/1971640990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23414c200 con 0x7fd234070b40 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.039+0000 7fd233400640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd23414e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.040+0000 7fd233e00640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd234070b40 0x7fd23414bcc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd22400e960 tx=0x7fd22400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.040+0000 7fd22be00640 1 -- 172.21.15.99:0/1971640990 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224017070 con 0x7fd234070b40 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.040+0000 7fd22be00640 1 -- 172.21.15.99:0/1971640990 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22400ca00 con 0x7fd234070b40 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.040+0000 7fd239400640 1 -- 172.21.15.99:0/1971640990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23414ef40 con 0x7fd234070b40 2024-09-10T07:43:46.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.040+0000 7fd22be00640 1 -- 172.21.15.99:0/1971640990 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22400cdd0 con 0x7fd234070b40 2024-09-10T07:43:46.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.040+0000 7fd239400640 1 -- 172.21.15.99:0/1971640990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23414c620 con 0x7fd234070b40 2024-09-10T07:43:46.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.041+0000 7fd239400640 1 -- 172.21.15.99:0/1971640990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23415e040 con 0x7fd234070b40 2024-09-10T07:43:46.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.042+0000 7fd22be00640 1 -- 172.21.15.99:0/1971640990 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd22401a070 con 0x7fd234070b40 2024-09-10T07:43:46.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.043+0000 7fd22be00640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd21406be30 0x7fd21406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.043+0000 7fd22be00640 1 -- 172.21.15.99:0/1971640990 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7fd22408adf0 con 0x7fd234070b40 2024-09-10T07:43:46.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.043+0000 7fd233400640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd21406be30 0x7fd21406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.044+0000 7fd233400640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd21406be30 0x7fd21406e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd234158d60 tx=0x7fd220009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:46.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.047+0000 7fd22be00640 1 -- 172.21.15.99:0/1971640990 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd23415e040 con 0x7fd234070b40 2024-09-10T07:43:46.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.226+0000 7fd239400640 1 -- 172.21.15.99:0/1971640990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2340b1c40 con 0x7fd234070b40 2024-09-10T07:43:46.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.227+0000 7fd22be00640 1 -- 172.21.15.99:0/1971640990 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+16716 (secure 0 0 0) 0x7fd224059700 con 0x7fd234070b40 2024-09-10T07:43:46.227 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:46.227 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":171,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:43:43.437320+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:43:39.625121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-10T07:43:40.843617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:43:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 -- 172.21.15.99:0/1971640990 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd21406be30 msgr2=0x7fd21406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd21406be30 0x7fd21406e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd234158d60 tx=0x7fd220009040 comp rx=0 tx=0).stop 2024-09-10T07:43:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 -- 172.21.15.99:0/1971640990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd234070b40 msgr2=0x7fd23414bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd234070b40 0x7fd23414bcc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd22400e960 tx=0x7fd22400ee20 comp rx=0 tx=0).stop 2024-09-10T07:43:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 -- 172.21.15.99:0/1971640990 shutdown_connections 2024-09-10T07:43:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23415eab0 0x7fd2340b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2340d3230 0x7fd23414e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd21406be30 0x7fd21406e2f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 --2- 172.21.15.99:0/1971640990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd234070b40 0x7fd23414bcc0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 -- 172.21.15.99:0/1971640990 >> 172.21.15.99:0/1971640990 conn(0x7fd2340b7cc0 msgr2=0x7fd23415c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:46.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 -- 172.21.15.99:0/1971640990 shutdown_connections 2024-09-10T07:43:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.230+0000 7fd239400640 1 -- 172.21.15.99:0/1971640990 wait complete. 2024-09-10T07:43:46.246 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:43:46.246 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:43:46.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.399+0000 7f696ba00640 1 Processor -- start 2024-09-10T07:43:46.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.399+0000 7f696ba00640 1 -- start start 2024-09-10T07:43:46.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f696ba00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6964152210 0x7f6964071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f696ba00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69640723d0 0x7f69640ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f696ba00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f696415c4f0 con 0x7f69640cecc0 2024-09-10T07:43:46.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f696ba00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f696415b730 con 0x7f6964152210 2024-09-10T07:43:46.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f696ba00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f696415ba10 con 0x7f69640723d0 2024-09-10T07:43:46.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f6969a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f69640cecc0 0x7f69640cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39648/0 (socket says 172.21.15.99:39648) 2024-09-10T07:43:46.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f6969000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6964152210 0x7f6964071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f6969a00640 1 -- 172.21.15.99:0/1493374298 learned_addr learned my addr 172.21.15.99:0/1493374298 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:46.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f695be00640 1 --2- 172.21.15.99:0/1493374298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69640723d0 0x7f69640ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f6969000640 1 -- 172.21.15.99:0/1493374298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69640723d0 msgr2=0x7f69640ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:46.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f6969000640 1 --2- 172.21.15.99:0/1493374298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69640723d0 0x7f69640ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f6969000640 1 -- 172.21.15.99:0/1493374298 >> v1:172.21.15.99:6789/0 conn(0x7f69640cecc0 legacy=0x7f69640cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f6969000640 1 -- 172.21.15.99:0/1493374298 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696415bcf0 con 0x7f6964152210 2024-09-10T07:43:46.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.401+0000 7f6963e00640 1 -- 172.21.15.99:0/1493374298 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1702647183 0 0) 0x7f696415c4f0 con 0x7f69640cecc0 2024-09-10T07:43:46.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.402+0000 7f6969000640 1 --2- 172.21.15.99:0/1493374298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6964152210 0x7f6964071e90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f69540097a0 tx=0x7f695402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5ef575df10c41a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:46.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f6963e00640 1 -- 172.21.15.99:0/1493374298 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954037070 con 0x7f6964152210 2024-09-10T07:43:46.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f6963e00640 1 -- 172.21.15.99:0/1493374298 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6954032440 con 0x7f6964152210 2024-09-10T07:43:46.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f6963e00640 1 -- 172.21.15.99:0/1493374298 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954032810 con 0x7f6964152210 2024-09-10T07:43:46.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f696ba00640 1 -- 172.21.15.99:0/1493374298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6964152210 msgr2=0x7f6964071e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f696ba00640 1 --2- 172.21.15.99:0/1493374298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6964152210 0x7f6964071e90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f69540097a0 tx=0x7f695402a180 comp rx=0 tx=0).stop 2024-09-10T07:43:46.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f696ba00640 1 -- 172.21.15.99:0/1493374298 shutdown_connections 2024-09-10T07:43:46.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f696ba00640 1 --2- 172.21.15.99:0/1493374298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69640723d0 0x7f69640ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f696ba00640 1 --2- 172.21.15.99:0/1493374298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6964152210 0x7f6964071e90 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f696ba00640 1 -- 172.21.15.99:0/1493374298 >> 172.21.15.99:0/1493374298 conn(0x7f696406bc10 msgr2=0x7f696406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:46.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f696ba00640 1 -- 172.21.15.99:0/1493374298 shutdown_connections 2024-09-10T07:43:46.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.403+0000 7f696ba00640 1 -- 172.21.15.99:0/1493374298 wait complete. 2024-09-10T07:43:46.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.405+0000 7f696ba00640 1 Processor -- start 2024-09-10T07:43:46.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.405+0000 7f696ba00640 1 -- start start 2024-09-10T07:43:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f696ba00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69640723d0 0x7f6964149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f696ba00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69640cecc0 0x7f696414b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f696ba00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6964152210 0x7f696413eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f696ba00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f69640cf880 con 0x7f69640cecc0 2024-09-10T07:43:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f696ba00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f696406f380 con 0x7f6964152210 2024-09-10T07:43:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f696ba00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6964165bc0 con 0x7f69640723d0 2024-09-10T07:43:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f695be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69640cecc0 0x7f696414b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f695be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69640cecc0 0x7f696414b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52860/0 (socket says 172.21.15.99:52860) 2024-09-10T07:43:46.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f695be00640 1 -- 172.21.15.99:0/2762550928 learned_addr learned my addr 172.21.15.99:0/2762550928 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f6969000640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69640723d0 0x7f6964149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.406+0000 7f6969a00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6964152210 0x7f696413eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f695be00640 1 -- 172.21.15.99:0/2762550928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69640723d0 msgr2=0x7f6964149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f695be00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69640723d0 0x7f6964149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f695be00640 1 -- 172.21.15.99:0/2762550928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6964152210 msgr2=0x7f696413eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f695be00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6964152210 0x7f696413eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f695be00640 1 -- 172.21.15.99:0/2762550928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696414a440 con 0x7f69640cecc0 2024-09-10T07:43:46.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f6969a00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6964152210 0x7f696413eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:43:46.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f695be00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69640cecc0 0x7f696414b7c0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f694c00e9b0 tx=0x7f694c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:46.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f6961600640 1 -- 172.21.15.99:0/2762550928 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c017070 con 0x7f69640cecc0 2024-09-10T07:43:46.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f6961600640 1 -- 172.21.15.99:0/2762550928 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c00c9a0 con 0x7f69640cecc0 2024-09-10T07:43:46.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f696ba00640 1 -- 172.21.15.99:0/2762550928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696414a720 con 0x7f69640cecc0 2024-09-10T07:43:46.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f6961600640 1 -- 172.21.15.99:0/2762550928 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c00cd70 con 0x7f69640cecc0 2024-09-10T07:43:46.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.407+0000 7f696ba00640 1 -- 172.21.15.99:0/2762550928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6964166bd0 con 0x7f69640cecc0 2024-09-10T07:43:46.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.408+0000 7f696ba00640 1 -- 172.21.15.99:0/2762550928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6964146570 con 0x7f69640cecc0 2024-09-10T07:43:46.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.409+0000 7f6961600640 1 -- 172.21.15.99:0/2762550928 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f694c01a070 con 0x7f69640cecc0 2024-09-10T07:43:46.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.410+0000 7f6961600640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f694006be30 0x7f694006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.411+0000 7f6961600640 1 -- 172.21.15.99:0/2762550928 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f694c08b220 con 0x7f69640cecc0 2024-09-10T07:43:46.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.411+0000 7f6969000640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f694006be30 0x7f694006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.411+0000 7f6969000640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f694006be30 0x7f694006e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6954034000 tx=0x7f695402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:46.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.415+0000 7f6961600640 1 -- 172.21.15.99:0/2762550928 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6964146570 con 0x7f69640cecc0 2024-09-10T07:43:46.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.586+0000 7f696ba00640 1 -- 172.21.15.99:0/2762550928 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f696406f650 con 0x7f694006be30 2024-09-10T07:43:46.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.592+0000 7f6961600640 1 -- 172.21.15.99:0/2762550928 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247966 (secure 0 0 0) 0x7f696406f650 con 0x7f694006be30 2024-09-10T07:43:46.595 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:46.597 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:43:46.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 -- 172.21.15.99:0/2762550928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f694006be30 msgr2=0x7f694006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f694006be30 0x7f694006e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6954034000 tx=0x7f695402e000 comp rx=0 tx=0).stop 2024-09-10T07:43:46.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 -- 172.21.15.99:0/2762550928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69640cecc0 msgr2=0x7f696414b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69640cecc0 0x7f696414b7c0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f694c00e9b0 tx=0x7f694c00ee70 comp rx=0 tx=0).stop 2024-09-10T07:43:46.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 -- 172.21.15.99:0/2762550928 shutdown_connections 2024-09-10T07:43:46.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6964152210 0x7f696413eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f694006be30 0x7f694006e2f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69640cecc0 0x7f696414b7c0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 --2- 172.21.15.99:0/2762550928 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69640723d0 0x7f6964149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 -- 172.21.15.99:0/2762550928 >> 172.21.15.99:0/2762550928 conn(0x7f696406bc10 msgr2=0x7f69640b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:46.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 -- 172.21.15.99:0/2762550928 shutdown_connections 2024-09-10T07:43:46.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.596+0000 7f696ba00640 1 -- 172.21.15.99:0/2762550928 wait complete. 2024-09-10T07:43:46.613 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2024-09-10T07:43:44.818245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8611,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553888,"statfs":{"total":1600000000,"available":1591181604,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.388847"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.457885+0000","last_change":"2024-09-10T07:43:42.457766+0000","last_active":"2024-09-10T07:43:42.457885+0000","last_peered":"2024-09-10T07:43:42.457885+0000","last_clean":"2024-09-10T07:43:42.457885+0000","last_became_active":"2024-09-10T07:43:42.456802+0000","last_became_peered":"2024-09-10T07:43:42.456802+0000","last_unstale":"2024-09-10T07:43:42.457885+0000","last_undegraded":"2024-09-10T07:43:42.457885+0000","last_fullsized":"2024-09-10T07:43:42.457885+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:31.705856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.440810+0000","last_change":"2024-09-10T07:43:42.447327+0000","last_active":"2024-09-10T07:43:43.440810+0000","last_peered":"2024-09-10T07:43:43.440810+0000","last_clean":"2024-09-10T07:43:43.440810+0000","last_became_active":"2024-09-10T07:43:42.447077+0000","last_became_peered":"2024-09-10T07:43:42.447077+0000","last_unstale":"2024-09-10T07:43:43.440810+0000","last_undegraded":"2024-09-10T07:43:43.440810+0000","last_fullsized":"2024-09-10T07:43:43.440810+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:27.955587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.462635+0000","last_change":"2024-09-10T07:43:42.462516+0000","last_active":"2024-09-10T07:43:42.462635+0000","last_peered":"2024-09-10T07:43:42.462635+0000","last_clean":"2024-09-10T07:43:42.462635+0000","last_became_active":"2024-09-10T07:43:42.461709+0000","last_became_peered":"2024-09-10T07:43:42.461709+0000","last_unstale":"2024-09-10T07:43:42.462635+0000","last_undegraded":"2024-09-10T07:43:42.462635+0000","last_fullsized":"2024-09-10T07:43:42.462635+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:20.427826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441602+0000","last_change":"2024-09-10T07:43:42.465521+0000","last_active":"2024-09-10T07:43:43.441602+0000","last_peered":"2024-09-10T07:43:43.441602+0000","last_clean":"2024-09-10T07:43:43.441602+0000","last_became_active":"2024-09-10T07:43:42.464500+0000","last_became_peered":"2024-09-10T07:43:42.464500+0000","last_unstale":"2024-09-10T07:43:43.441602+0000","last_undegraded":"2024-09-10T07:43:43.441602+0000","last_fullsized":"2024-09-10T07:43:43.441602+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:30.682331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441844+0000","last_change":"2024-09-10T07:43:42.463240+0000","last_active":"2024-09-10T07:43:43.441844+0000","last_peered":"2024-09-10T07:43:43.441844+0000","last_clean":"2024-09-10T07:43:43.441844+0000","last_became_active":"2024-09-10T07:43:42.462876+0000","last_became_peered":"2024-09-10T07:43:42.462876+0000","last_unstale":"2024-09-10T07:43:43.441844+0000","last_undegraded":"2024-09-10T07:43:43.441844+0000","last_fullsized":"2024-09-10T07:43:43.441844+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:09.935609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.457695+0000","last_change":"2024-09-10T07:43:42.457583+0000","last_active":"2024-09-10T07:43:42.457695+0000","last_peered":"2024-09-10T07:43:42.457695+0000","last_clean":"2024-09-10T07:43:42.457695+0000","last_became_active":"2024-09-10T07:43:42.456479+0000","last_became_peered":"2024-09-10T07:43:42.456479+0000","last_unstale":"2024-09-10T07:43:42.457695+0000","last_undegraded":"2024-09-10T07:43:42.457695+0000","last_fullsized":"2024-09-10T07:43:42.457695+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:23.637280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.461031+0000","last_change":"2024-09-10T07:43:42.460928+0000","last_active":"2024-09-10T07:43:42.461031+0000","last_peered":"2024-09-10T07:43:42.461031+0000","last_clean":"2024-09-10T07:43:42.461031+0000","last_became_active":"2024-09-10T07:43:42.460727+0000","last_became_peered":"2024-09-10T07:43:42.460727+0000","last_unstale":"2024-09-10T07:43:42.461031+0000","last_undegraded":"2024-09-10T07:43:42.461031+0000","last_fullsized":"2024-09-10T07:43:42.461031+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:20.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.456599+0000","last_change":"2024-09-10T07:43:42.456484+0000","last_active":"2024-09-10T07:43:42.456599+0000","last_peered":"2024-09-10T07:43:42.456599+0000","last_clean":"2024-09-10T07:43:42.456599+0000","last_became_active":"2024-09-10T07:43:42.456028+0000","last_became_peered":"2024-09-10T07:43:42.456028+0000","last_unstale":"2024-09-10T07:43:42.456599+0000","last_undegraded":"2024-09-10T07:43:42.456599+0000","last_fullsized":"2024-09-10T07:43:42.456599+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:01.601239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.440793+0000","last_change":"2024-09-10T07:43:42.448950+0000","last_active":"2024-09-10T07:43:43.440793+0000","last_peered":"2024-09-10T07:43:43.440793+0000","last_clean":"2024-09-10T07:43:43.440793+0000","last_became_active":"2024-09-10T07:43:42.448699+0000","last_became_peered":"2024-09-10T07:43:42.448699+0000","last_unstale":"2024-09-10T07:43:43.440793+0000","last_undegraded":"2024-09-10T07:43:43.440793+0000","last_fullsized":"2024-09-10T07:43:43.440793+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:27.153890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.470272+0000","last_change":"2024-09-10T07:43:42.470159+0000","last_active":"2024-09-10T07:43:42.470272+0000","last_peered":"2024-09-10T07:43:42.470272+0000","last_clean":"2024-09-10T07:43:42.470272+0000","last_became_active":"2024-09-10T07:43:42.469890+0000","last_became_peered":"2024-09-10T07:43:42.469890+0000","last_unstale":"2024-09-10T07:43:42.470272+0000","last_undegraded":"2024-09-10T07:43:42.470272+0000","last_fullsized":"2024-09-10T07:43:42.470272+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:42.599817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.451298+0000","last_change":"2024-09-10T07:43:42.451160+0000","last_active":"2024-09-10T07:43:42.451298+0000","last_peered":"2024-09-10T07:43:42.451298+0000","last_clean":"2024-09-10T07:43:42.451298+0000","last_became_active":"2024-09-10T07:43:42.450722+0000","last_became_peered":"2024-09-10T07:43:42.450722+0000","last_unstale":"2024-09-10T07:43:42.451298+0000","last_undegraded":"2024-09-10T07:43:42.451298+0000","last_fullsized":"2024-09-10T07:43:42.451298+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:51.767768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.465302+0000","last_change":"2024-09-10T07:43:42.458940+0000","last_active":"2024-09-10T07:43:42.465302+0000","last_peered":"2024-09-10T07:43:42.465302+0000","last_clean":"2024-09-10T07:43:42.465302+0000","last_became_active":"2024-09-10T07:43:42.458698+0000","last_became_peered":"2024-09-10T07:43:42.458698+0000","last_unstale":"2024-09-10T07:43:42.465302+0000","last_undegraded":"2024-09-10T07:43:42.465302+0000","last_fullsized":"2024-09-10T07:43:42.465302+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:57.593780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441423+0000","last_change":"2024-09-10T07:43:42.459740+0000","last_active":"2024-09-10T07:43:43.441423+0000","last_peered":"2024-09-10T07:43:43.441423+0000","last_clean":"2024-09-10T07:43:43.441423+0000","last_became_active":"2024-09-10T07:43:42.458918+0000","last_became_peered":"2024-09-10T07:43:42.458918+0000","last_unstale":"2024-09-10T07:43:43.441423+0000","last_undegraded":"2024-09-10T07:43:43.441423+0000","last_fullsized":"2024-09-10T07:43:43.441423+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:31.222992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441880+0000","last_change":"2024-09-10T07:43:42.465264+0000","last_active":"2024-09-10T07:43:43.441880+0000","last_peered":"2024-09-10T07:43:43.441880+0000","last_clean":"2024-09-10T07:43:43.441880+0000","last_became_active":"2024-09-10T07:43:42.464166+0000","last_became_peered":"2024-09-10T07:43:42.464166+0000","last_unstale":"2024-09-10T07:43:43.441880+0000","last_undegraded":"2024-09-10T07:43:43.441880+0000","last_fullsized":"2024-09-10T07:43:43.441880+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:30.426739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.468033+0000","last_change":"2024-09-10T07:43:42.467230+0000","last_active":"2024-09-10T07:43:42.468033+0000","last_peered":"2024-09-10T07:43:42.468033+0000","last_clean":"2024-09-10T07:43:42.468033+0000","last_became_active":"2024-09-10T07:43:42.458843+0000","last_became_peered":"2024-09-10T07:43:42.458843+0000","last_unstale":"2024-09-10T07:43:42.468033+0000","last_undegraded":"2024-09-10T07:43:42.468033+0000","last_fullsized":"2024-09-10T07:43:42.468033+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:47.389052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.449620+0000","last_change":"2024-09-10T07:43:42.449509+0000","last_active":"2024-09-10T07:43:42.449620+0000","last_peered":"2024-09-10T07:43:42.449620+0000","last_clean":"2024-09-10T07:43:42.449620+0000","last_became_active":"2024-09-10T07:43:42.449065+0000","last_became_peered":"2024-09-10T07:43:42.449065+0000","last_unstale":"2024-09-10T07:43:42.449620+0000","last_undegraded":"2024-09-10T07:43:42.449620+0000","last_fullsized":"2024-09-10T07:43:42.449620+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:43.854733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.467103+0000","last_change":"2024-09-10T07:43:42.465947+0000","last_active":"2024-09-10T07:43:42.467103+0000","last_peered":"2024-09-10T07:43:42.467103+0000","last_clean":"2024-09-10T07:43:42.467103+0000","last_became_active":"2024-09-10T07:43:42.465709+0000","last_became_peered":"2024-09-10T07:43:42.465709+0000","last_unstale":"2024-09-10T07:43:42.467103+0000","last_undegraded":"2024-09-10T07:43:42.467103+0000","last_fullsized":"2024-09-10T07:43:42.467103+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:40.511395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.464685+0000","last_change":"2024-09-10T07:43:42.464176+0000","last_active":"2024-09-10T07:43:42.464685+0000","last_peered":"2024-09-10T07:43:42.464685+0000","last_clean":"2024-09-10T07:43:42.464685+0000","last_became_active":"2024-09-10T07:43:42.462059+0000","last_became_peered":"2024-09-10T07:43:42.462059+0000","last_unstale":"2024-09-10T07:43:42.464685+0000","last_undegraded":"2024-09-10T07:43:42.464685+0000","last_fullsized":"2024-09-10T07:43:42.464685+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:44.394956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.450599+0000","last_change":"2024-09-10T07:43:42.450398+0000","last_active":"2024-09-10T07:43:42.450599+0000","last_peered":"2024-09-10T07:43:42.450599+0000","last_clean":"2024-09-10T07:43:42.450599+0000","last_became_active":"2024-09-10T07:43:42.450152+0000","last_became_peered":"2024-09-10T07:43:42.450152+0000","last_unstale":"2024-09-10T07:43:42.450599+0000","last_undegraded":"2024-09-10T07:43:42.450599+0000","last_fullsized":"2024-09-10T07:43:42.450599+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:13.668146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.448458+0000","last_change":"2024-09-10T07:43:42.447666+0000","last_active":"2024-09-10T07:43:42.448458+0000","last_peered":"2024-09-10T07:43:42.448458+0000","last_clean":"2024-09-10T07:43:42.448458+0000","last_became_active":"2024-09-10T07:43:42.447432+0000","last_became_peered":"2024-09-10T07:43:42.447432+0000","last_unstale":"2024-09-10T07:43:42.448458+0000","last_undegraded":"2024-09-10T07:43:42.448458+0000","last_fullsized":"2024-09-10T07:43:42.448458+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:14.926791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.470812+0000","last_change":"2024-09-10T07:43:42.468678+0000","last_active":"2024-09-10T07:43:42.470812+0000","last_peered":"2024-09-10T07:43:42.470812+0000","last_clean":"2024-09-10T07:43:42.470812+0000","last_became_active":"2024-09-10T07:43:42.468449+0000","last_became_peered":"2024-09-10T07:43:42.468449+0000","last_unstale":"2024-09-10T07:43:42.470812+0000","last_undegraded":"2024-09-10T07:43:42.470812+0000","last_fullsized":"2024-09-10T07:43:42.470812+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:38.581269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442490+0000","last_change":"2024-09-10T07:43:42.456581+0000","last_active":"2024-09-10T07:43:43.442490+0000","last_peered":"2024-09-10T07:43:43.442490+0000","last_clean":"2024-09-10T07:43:43.442490+0000","last_became_active":"2024-09-10T07:43:42.456340+0000","last_became_peered":"2024-09-10T07:43:42.456340+0000","last_unstale":"2024-09-10T07:43:43.442490+0000","last_undegraded":"2024-09-10T07:43:43.442490+0000","last_fullsized":"2024-09-10T07:43:43.442490+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:46.767884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442251+0000","last_change":"2024-09-10T07:43:42.462262+0000","last_active":"2024-09-10T07:43:43.442251+0000","last_peered":"2024-09-10T07:43:43.442251+0000","last_clean":"2024-09-10T07:43:43.442251+0000","last_became_active":"2024-09-10T07:43:42.462017+0000","last_became_peered":"2024-09-10T07:43:42.462017+0000","last_unstale":"2024-09-10T07:43:43.442251+0000","last_undegraded":"2024-09-10T07:43:43.442251+0000","last_fullsized":"2024-09-10T07:43:43.442251+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:56.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.470831+0000","last_change":"2024-09-10T07:43:42.470579+0000","last_active":"2024-09-10T07:43:42.470831+0000","last_peered":"2024-09-10T07:43:42.470831+0000","last_clean":"2024-09-10T07:43:42.470831+0000","last_became_active":"2024-09-10T07:43:42.469001+0000","last_became_peered":"2024-09-10T07:43:42.469001+0000","last_unstale":"2024-09-10T07:43:42.470831+0000","last_undegraded":"2024-09-10T07:43:42.470831+0000","last_fullsized":"2024-09-10T07:43:42.470831+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:43.875147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.448513+0000","last_change":"2024-09-10T07:43:42.448227+0000","last_active":"2024-09-10T07:43:42.448513+0000","last_peered":"2024-09-10T07:43:42.448513+0000","last_clean":"2024-09-10T07:43:42.448513+0000","last_became_active":"2024-09-10T07:43:42.447963+0000","last_became_peered":"2024-09-10T07:43:42.447963+0000","last_unstale":"2024-09-10T07:43:42.448513+0000","last_undegraded":"2024-09-10T07:43:42.448513+0000","last_fullsized":"2024-09-10T07:43:42.448513+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:41.799926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.448227+0000","last_change":"2024-09-10T07:43:42.447066+0000","last_active":"2024-09-10T07:43:42.448227+0000","last_peered":"2024-09-10T07:43:42.448227+0000","last_clean":"2024-09-10T07:43:42.448227+0000","last_became_active":"2024-09-10T07:43:42.446838+0000","last_became_peered":"2024-09-10T07:43:42.446838+0000","last_unstale":"2024-09-10T07:43:42.448227+0000","last_undegraded":"2024-09-10T07:43:42.448227+0000","last_fullsized":"2024-09-10T07:43:42.448227+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:23.459750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.458029+0000","last_change":"2024-09-10T07:43:42.457794+0000","last_active":"2024-09-10T07:43:42.458029+0000","last_peered":"2024-09-10T07:43:42.458029+0000","last_clean":"2024-09-10T07:43:42.458029+0000","last_became_active":"2024-09-10T07:43:42.457569+0000","last_became_peered":"2024-09-10T07:43:42.457569+0000","last_unstale":"2024-09-10T07:43:42.458029+0000","last_undegraded":"2024-09-10T07:43:42.458029+0000","last_fullsized":"2024-09-10T07:43:42.458029+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:24.722320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.458064+0000","last_change":"2024-09-10T07:43:42.457776+0000","last_active":"2024-09-10T07:43:42.458064+0000","last_peered":"2024-09-10T07:43:42.458064+0000","last_clean":"2024-09-10T07:43:42.458064+0000","last_became_active":"2024-09-10T07:43:42.456928+0000","last_became_peered":"2024-09-10T07:43:42.456928+0000","last_unstale":"2024-09-10T07:43:42.458064+0000","last_undegraded":"2024-09-10T07:43:42.458064+0000","last_fullsized":"2024-09-10T07:43:42.458064+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:42.176524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.449625+0000","last_change":"2024-09-10T07:43:42.448648+0000","last_active":"2024-09-10T07:43:42.449625+0000","last_peered":"2024-09-10T07:43:42.449625+0000","last_clean":"2024-09-10T07:43:42.449625+0000","last_became_active":"2024-09-10T07:43:42.448430+0000","last_became_peered":"2024-09-10T07:43:42.448430+0000","last_unstale":"2024-09-10T07:43:42.449625+0000","last_undegraded":"2024-09-10T07:43:42.449625+0000","last_fullsized":"2024-09-10T07:43:42.449625+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:35.315033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442718+0000","last_change":"2024-09-10T07:43:42.465045+0000","last_active":"2024-09-10T07:43:43.442718+0000","last_peered":"2024-09-10T07:43:43.442718+0000","last_clean":"2024-09-10T07:43:43.442718+0000","last_became_active":"2024-09-10T07:43:42.463280+0000","last_became_peered":"2024-09-10T07:43:42.463280+0000","last_unstale":"2024-09-10T07:43:43.442718+0000","last_undegraded":"2024-09-10T07:43:43.442718+0000","last_fullsized":"2024-09-10T07:43:43.442718+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:32.839322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.440898+0000","last_change":"2024-09-10T07:43:42.458875+0000","last_active":"2024-09-10T07:43:43.440898+0000","last_peered":"2024-09-10T07:43:43.440898+0000","last_clean":"2024-09-10T07:43:43.440898+0000","last_became_active":"2024-09-10T07:43:42.458642+0000","last_became_peered":"2024-09-10T07:43:42.458642+0000","last_unstale":"2024-09-10T07:43:43.440898+0000","last_undegraded":"2024-09-10T07:43:43.440898+0000","last_fullsized":"2024-09-10T07:43:43.440898+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:13.702942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.448496+0000","last_change":"2024-09-10T07:43:42.448135+0000","last_active":"2024-09-10T07:43:42.448496+0000","last_peered":"2024-09-10T07:43:42.448496+0000","last_clean":"2024-09-10T07:43:42.448496+0000","last_became_active":"2024-09-10T07:43:42.447757+0000","last_became_peered":"2024-09-10T07:43:42.447757+0000","last_unstale":"2024-09-10T07:43:42.448496+0000","last_undegraded":"2024-09-10T07:43:42.448496+0000","last_fullsized":"2024-09-10T07:43:42.448496+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:21.019368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.467123+0000","last_change":"2024-09-10T07:43:42.466982+0000","last_active":"2024-09-10T07:43:42.467123+0000","last_peered":"2024-09-10T07:43:42.467123+0000","last_clean":"2024-09-10T07:43:42.467123+0000","last_became_active":"2024-09-10T07:43:42.460197+0000","last_became_peered":"2024-09-10T07:43:42.460197+0000","last_unstale":"2024-09-10T07:43:42.467123+0000","last_undegraded":"2024-09-10T07:43:42.467123+0000","last_fullsized":"2024-09-10T07:43:42.467123+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:44.617276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"170'4","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.469500+0000","last_change":"2024-09-10T07:43:41.452640+0000","last_active":"2024-09-10T07:43:42.469500+0000","last_peered":"2024-09-10T07:43:42.469500+0000","last_clean":"2024-09-10T07:43:42.469500+0000","last_became_active":"2024-09-10T07:43:41.452365+0000","last_became_peered":"2024-09-10T07:43:41.452365+0000","last_unstale":"2024-09-10T07:43:42.469500+0000","last_undegraded":"2024-09-10T07:43:42.469500+0000","last_fullsized":"2024-09-10T07:43:42.469500+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:47.510345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441001+0000","last_change":"2024-09-10T07:43:42.447164+0000","last_active":"2024-09-10T07:43:43.441001+0000","last_peered":"2024-09-10T07:43:43.441001+0000","last_clean":"2024-09-10T07:43:43.441001+0000","last_became_active":"2024-09-10T07:43:42.446861+0000","last_became_peered":"2024-09-10T07:43:42.446861+0000","last_unstale":"2024-09-10T07:43:43.441001+0000","last_undegraded":"2024-09-10T07:43:43.441001+0000","last_fullsized":"2024-09-10T07:43:43.441001+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:50.555383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.440915+0000","last_change":"2024-09-10T07:43:41.453424+0000","last_active":"2024-09-10T07:43:43.440915+0000","last_peered":"2024-09-10T07:43:43.440915+0000","last_clean":"2024-09-10T07:43:43.440915+0000","last_became_active":"2024-09-10T07:43:41.452170+0000","last_became_peered":"2024-09-10T07:43:41.452170+0000","last_unstale":"2024-09-10T07:43:43.440915+0000","last_undegraded":"2024-09-10T07:43:43.440915+0000","last_fullsized":"2024-09-10T07:43:43.440915+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:49.321277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.457244+0000","last_change":"2024-09-10T07:43:42.457068+0000","last_active":"2024-09-10T07:43:42.457244+0000","last_peered":"2024-09-10T07:43:42.457244+0000","last_clean":"2024-09-10T07:43:42.457244+0000","last_became_active":"2024-09-10T07:43:42.456122+0000","last_became_peered":"2024-09-10T07:43:42.456122+0000","last_unstale":"2024-09-10T07:43:42.457244+0000","last_undegraded":"2024-09-10T07:43:42.457244+0000","last_fullsized":"2024-09-10T07:43:42.457244+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:11.189734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442900+0000","last_change":"2024-09-10T07:43:41.443618+0000","last_active":"2024-09-10T07:43:43.442900+0000","last_peered":"2024-09-10T07:43:43.442900+0000","last_clean":"2024-09-10T07:43:43.442900+0000","last_became_active":"2024-09-10T07:43:41.443361+0000","last_became_peered":"2024-09-10T07:43:41.443361+0000","last_unstale":"2024-09-10T07:43:43.442900+0000","last_undegraded":"2024-09-10T07:43:43.442900+0000","last_fullsized":"2024-09-10T07:43:43.442900+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:08.339955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.468051+0000","last_change":"2024-09-10T07:43:42.467427+0000","last_active":"2024-09-10T07:43:42.468051+0000","last_peered":"2024-09-10T07:43:42.468051+0000","last_clean":"2024-09-10T07:43:42.468051+0000","last_became_active":"2024-09-10T07:43:42.460681+0000","last_became_peered":"2024-09-10T07:43:42.460681+0000","last_unstale":"2024-09-10T07:43:42.468051+0000","last_undegraded":"2024-09-10T07:43:42.468051+0000","last_fullsized":"2024-09-10T07:43:42.468051+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:55.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442991+0000","last_change":"2024-09-10T07:43:41.452274+0000","last_active":"2024-09-10T07:43:43.442991+0000","last_peered":"2024-09-10T07:43:43.442991+0000","last_clean":"2024-09-10T07:43:43.442991+0000","last_became_active":"2024-09-10T07:43:41.452007+0000","last_became_peered":"2024-09-10T07:43:41.452007+0000","last_unstale":"2024-09-10T07:43:43.442991+0000","last_undegraded":"2024-09-10T07:43:43.442991+0000","last_fullsized":"2024-09-10T07:43:43.442991+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:36.839286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441084+0000","last_change":"2024-09-10T07:43:42.458790+0000","last_active":"2024-09-10T07:43:43.441084+0000","last_peered":"2024-09-10T07:43:43.441084+0000","last_clean":"2024-09-10T07:43:43.441084+0000","last_became_active":"2024-09-10T07:43:42.458607+0000","last_became_peered":"2024-09-10T07:43:42.458607+0000","last_unstale":"2024-09-10T07:43:43.441084+0000","last_undegraded":"2024-09-10T07:43:43.441084+0000","last_fullsized":"2024-09-10T07:43:43.441084+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:16.274471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.469901+0000","last_change":"2024-09-10T07:43:41.450902+0000","last_active":"2024-09-10T07:43:42.469901+0000","last_peered":"2024-09-10T07:43:42.469901+0000","last_clean":"2024-09-10T07:43:42.469901+0000","last_became_active":"2024-09-10T07:43:41.450664+0000","last_became_peered":"2024-09-10T07:43:41.450664+0000","last_unstale":"2024-09-10T07:43:42.469901+0000","last_undegraded":"2024-09-10T07:43:42.469901+0000","last_fullsized":"2024-09-10T07:43:42.469901+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:11.583848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442590+0000","last_change":"2024-09-10T07:43:42.460218+0000","last_active":"2024-09-10T07:43:43.442590+0000","last_peered":"2024-09-10T07:43:43.442590+0000","last_clean":"2024-09-10T07:43:43.442590+0000","last_became_active":"2024-09-10T07:43:42.459900+0000","last_became_peered":"2024-09-10T07:43:42.459900+0000","last_unstale":"2024-09-10T07:43:43.442590+0000","last_undegraded":"2024-09-10T07:43:43.442590+0000","last_fullsized":"2024-09-10T07:43:43.442590+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:24.280705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442321+0000","last_change":"2024-09-10T07:43:41.453236+0000","last_active":"2024-09-10T07:43:43.442321+0000","last_peered":"2024-09-10T07:43:43.442321+0000","last_clean":"2024-09-10T07:43:43.442321+0000","last_became_active":"2024-09-10T07:43:41.452885+0000","last_became_peered":"2024-09-10T07:43:41.452885+0000","last_unstale":"2024-09-10T07:43:43.442321+0000","last_undegraded":"2024-09-10T07:43:43.442321+0000","last_fullsized":"2024-09-10T07:43:43.442321+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:30.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441327+0000","last_change":"2024-09-10T07:43:42.450170+0000","last_active":"2024-09-10T07:43:43.441327+0000","last_peered":"2024-09-10T07:43:43.441327+0000","last_clean":"2024-09-10T07:43:43.441327+0000","last_became_active":"2024-09-10T07:43:42.449917+0000","last_became_peered":"2024-09-10T07:43:42.449917+0000","last_unstale":"2024-09-10T07:43:43.441327+0000","last_undegraded":"2024-09-10T07:43:43.441327+0000","last_fullsized":"2024-09-10T07:43:43.441327+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:08.236445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.439540+0000","last_change":"2024-09-10T07:43:41.445841+0000","last_active":"2024-09-10T07:43:42.439540+0000","last_peered":"2024-09-10T07:43:42.439540+0000","last_clean":"2024-09-10T07:43:42.439540+0000","last_became_active":"2024-09-10T07:43:41.445609+0000","last_became_peered":"2024-09-10T07:43:41.445609+0000","last_unstale":"2024-09-10T07:43:42.439540+0000","last_undegraded":"2024-09-10T07:43:42.439540+0000","last_fullsized":"2024-09-10T07:43:42.439540+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:27.577629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441571+0000","last_change":"2024-09-10T07:43:42.448653+0000","last_active":"2024-09-10T07:43:43.441571+0000","last_peered":"2024-09-10T07:43:43.441571+0000","last_clean":"2024-09-10T07:43:43.441571+0000","last_became_active":"2024-09-10T07:43:42.448405+0000","last_became_peered":"2024-09-10T07:43:42.448405+0000","last_unstale":"2024-09-10T07:43:43.441571+0000","last_undegraded":"2024-09-10T07:43:43.441571+0000","last_fullsized":"2024-09-10T07:43:43.441571+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:44.854310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442997+0000","last_change":"2024-09-10T07:43:41.451998+0000","last_active":"2024-09-10T07:43:43.442997+0000","last_peered":"2024-09-10T07:43:43.442997+0000","last_clean":"2024-09-10T07:43:43.442997+0000","last_became_active":"2024-09-10T07:43:41.451736+0000","last_became_peered":"2024-09-10T07:43:41.451736+0000","last_unstale":"2024-09-10T07:43:43.442997+0000","last_undegraded":"2024-09-10T07:43:43.442997+0000","last_fullsized":"2024-09-10T07:43:43.442997+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:21.273872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442031+0000","last_change":"2024-09-10T07:43:42.447710+0000","last_active":"2024-09-10T07:43:43.442031+0000","last_peered":"2024-09-10T07:43:43.442031+0000","last_clean":"2024-09-10T07:43:43.442031+0000","last_became_active":"2024-09-10T07:43:42.447386+0000","last_became_peered":"2024-09-10T07:43:42.447386+0000","last_unstale":"2024-09-10T07:43:43.442031+0000","last_undegraded":"2024-09-10T07:43:43.442031+0000","last_fullsized":"2024-09-10T07:43:43.442031+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:50.051625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441003+0000","last_change":"2024-09-10T07:43:41.450329+0000","last_active":"2024-09-10T07:43:43.441003+0000","last_peered":"2024-09-10T07:43:43.441003+0000","last_clean":"2024-09-10T07:43:43.441003+0000","last_became_active":"2024-09-10T07:43:41.449913+0000","last_became_peered":"2024-09-10T07:43:41.449913+0000","last_unstale":"2024-09-10T07:43:43.441003+0000","last_undegraded":"2024-09-10T07:43:43.441003+0000","last_fullsized":"2024-09-10T07:43:43.441003+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:22.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.465275+0000","last_change":"2024-09-10T07:43:42.458277+0000","last_active":"2024-09-10T07:43:42.465275+0000","last_peered":"2024-09-10T07:43:42.465275+0000","last_clean":"2024-09-10T07:43:42.465275+0000","last_became_active":"2024-09-10T07:43:42.457854+0000","last_became_peered":"2024-09-10T07:43:42.457854+0000","last_unstale":"2024-09-10T07:43:42.465275+0000","last_undegraded":"2024-09-10T07:43:42.465275+0000","last_fullsized":"2024-09-10T07:43:42.465275+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.977166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.454306+0000","last_change":"2024-09-10T07:43:41.455031+0000","last_active":"2024-09-10T07:43:42.454306+0000","last_peered":"2024-09-10T07:43:42.454306+0000","last_clean":"2024-09-10T07:43:42.454306+0000","last_became_active":"2024-09-10T07:43:41.454758+0000","last_became_peered":"2024-09-10T07:43:41.454758+0000","last_unstale":"2024-09-10T07:43:42.454306+0000","last_undegraded":"2024-09-10T07:43:42.454306+0000","last_fullsized":"2024-09-10T07:43:42.454306+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:31.355153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.445235+0000","last_change":"2024-09-10T07:43:42.444381+0000","last_active":"2024-09-10T07:43:42.445235+0000","last_peered":"2024-09-10T07:43:42.445235+0000","last_clean":"2024-09-10T07:43:42.445235+0000","last_became_active":"2024-09-10T07:43:42.444139+0000","last_became_peered":"2024-09-10T07:43:42.444139+0000","last_unstale":"2024-09-10T07:43:42.445235+0000","last_undegraded":"2024-09-10T07:43:42.445235+0000","last_fullsized":"2024-09-10T07:43:42.445235+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:28.938492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"170'6","reported_seq":18,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.471192+0000","last_change":"2024-09-10T07:43:41.447659+0000","last_active":"2024-09-10T07:43:42.471192+0000","last_peered":"2024-09-10T07:43:42.471192+0000","last_clean":"2024-09-10T07:43:42.471192+0000","last_became_active":"2024-09-10T07:43:41.446684+0000","last_became_peered":"2024-09-10T07:43:41.446684+0000","last_unstale":"2024-09-10T07:43:42.471192+0000","last_undegraded":"2024-09-10T07:43:42.471192+0000","last_fullsized":"2024-09-10T07:43:42.471192+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:47.581968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.466407+0000","last_change":"2024-09-10T07:43:42.464713+0000","last_active":"2024-09-10T07:43:42.466407+0000","last_peered":"2024-09-10T07:43:42.466407+0000","last_clean":"2024-09-10T07:43:42.466407+0000","last_became_active":"2024-09-10T07:43:42.461084+0000","last_became_peered":"2024-09-10T07:43:42.461084+0000","last_unstale":"2024-09-10T07:43:42.466407+0000","last_undegraded":"2024-09-10T07:43:42.466407+0000","last_fullsized":"2024-09-10T07:43:42.466407+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:49.692969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.467827+0000","last_change":"2024-09-10T07:43:41.448976+0000","last_active":"2024-09-10T07:43:42.467827+0000","last_peered":"2024-09-10T07:43:42.467827+0000","last_clean":"2024-09-10T07:43:42.467827+0000","last_became_active":"2024-09-10T07:43:41.448704+0000","last_became_peered":"2024-09-10T07:43:41.448704+0000","last_unstale":"2024-09-10T07:43:42.467827+0000","last_undegraded":"2024-09-10T07:43:42.467827+0000","last_fullsized":"2024-09-10T07:43:42.467827+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:09.608528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441054+0000","last_change":"2024-09-10T07:43:42.447206+0000","last_active":"2024-09-10T07:43:43.441054+0000","last_peered":"2024-09-10T07:43:43.441054+0000","last_clean":"2024-09-10T07:43:43.441054+0000","last_became_active":"2024-09-10T07:43:42.446946+0000","last_became_peered":"2024-09-10T07:43:42.446946+0000","last_unstale":"2024-09-10T07:43:43.441054+0000","last_undegraded":"2024-09-10T07:43:43.441054+0000","last_fullsized":"2024-09-10T07:43:43.441054+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:50.048199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.453829+0000","last_change":"2024-09-10T07:43:41.449707+0000","last_active":"2024-09-10T07:43:42.453829+0000","last_peered":"2024-09-10T07:43:42.453829+0000","last_clean":"2024-09-10T07:43:42.453829+0000","last_became_active":"2024-09-10T07:43:41.449450+0000","last_became_peered":"2024-09-10T07:43:41.449450+0000","last_unstale":"2024-09-10T07:43:42.453829+0000","last_undegraded":"2024-09-10T07:43:42.453829+0000","last_fullsized":"2024-09-10T07:43:42.453829+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:25.215518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441831+0000","last_change":"2024-09-10T07:43:42.459547+0000","last_active":"2024-09-10T07:43:43.441831+0000","last_peered":"2024-09-10T07:43:43.441831+0000","last_clean":"2024-09-10T07:43:43.441831+0000","last_became_active":"2024-09-10T07:43:42.458602+0000","last_became_peered":"2024-09-10T07:43:42.458602+0000","last_unstale":"2024-09-10T07:43:43.441831+0000","last_undegraded":"2024-09-10T07:43:43.441831+0000","last_fullsized":"2024-09-10T07:43:43.441831+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:35.317335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.444987+0000","last_change":"2024-09-10T07:43:41.451620+0000","last_active":"2024-09-10T07:43:42.444987+0000","last_peered":"2024-09-10T07:43:42.444987+0000","last_clean":"2024-09-10T07:43:42.444987+0000","last_became_active":"2024-09-10T07:43:41.451404+0000","last_became_peered":"2024-09-10T07:43:41.451404+0000","last_unstale":"2024-09-10T07:43:42.444987+0000","last_undegraded":"2024-09-10T07:43:42.444987+0000","last_fullsized":"2024-09-10T07:43:42.444987+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:57.080238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.455899+0000","last_change":"2024-09-10T07:43:42.455098+0000","last_active":"2024-09-10T07:43:42.455899+0000","last_peered":"2024-09-10T07:43:42.455899+0000","last_clean":"2024-09-10T07:43:42.455899+0000","last_became_active":"2024-09-10T07:43:42.454887+0000","last_became_peered":"2024-09-10T07:43:42.454887+0000","last_unstale":"2024-09-10T07:43:42.455899+0000","last_undegraded":"2024-09-10T07:43:42.455899+0000","last_fullsized":"2024-09-10T07:43:42.455899+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:45.186617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"170'8","reported_seq":20,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.469236+0000","last_change":"2024-09-10T07:43:41.448603+0000","last_active":"2024-09-10T07:43:42.469236+0000","last_peered":"2024-09-10T07:43:42.469236+0000","last_clean":"2024-09-10T07:43:42.469236+0000","last_became_active":"2024-09-10T07:43:41.448371+0000","last_became_peered":"2024-09-10T07:43:41.448371+0000","last_unstale":"2024-09-10T07:43:42.469236+0000","last_undegraded":"2024-09-10T07:43:42.469236+0000","last_fullsized":"2024-09-10T07:43:42.469236+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:25.827236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.467141+0000","last_change":"2024-09-10T07:43:42.467008+0000","last_active":"2024-09-10T07:43:42.467141+0000","last_peered":"2024-09-10T07:43:42.467141+0000","last_clean":"2024-09-10T07:43:42.467141+0000","last_became_active":"2024-09-10T07:43:42.458517+0000","last_became_peered":"2024-09-10T07:43:42.458517+0000","last_unstale":"2024-09-10T07:43:42.467141+0000","last_undegraded":"2024-09-10T07:43:42.467141+0000","last_fullsized":"2024-09-10T07:43:42.467141+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:44.942455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442127+0000","last_change":"2024-09-10T07:43:41.451501+0000","last_active":"2024-09-10T07:43:43.442127+0000","last_peered":"2024-09-10T07:43:43.442127+0000","last_clean":"2024-09-10T07:43:43.442127+0000","last_became_active":"2024-09-10T07:43:41.450849+0000","last_became_peered":"2024-09-10T07:43:41.450849+0000","last_unstale":"2024-09-10T07:43:43.442127+0000","last_undegraded":"2024-09-10T07:43:43.442127+0000","last_fullsized":"2024-09-10T07:43:43.442127+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:29.913262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.455833+0000","last_change":"2024-09-10T07:43:42.455724+0000","last_active":"2024-09-10T07:43:42.455833+0000","last_peered":"2024-09-10T07:43:42.455833+0000","last_clean":"2024-09-10T07:43:42.455833+0000","last_became_active":"2024-09-10T07:43:42.455301+0000","last_became_peered":"2024-09-10T07:43:42.455301+0000","last_unstale":"2024-09-10T07:43:42.455833+0000","last_undegraded":"2024-09-10T07:43:42.455833+0000","last_fullsized":"2024-09-10T07:43:42.455833+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:47.225302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441417+0000","last_change":"2024-09-10T07:43:41.447707+0000","last_active":"2024-09-10T07:43:43.441417+0000","last_peered":"2024-09-10T07:43:43.441417+0000","last_clean":"2024-09-10T07:43:43.441417+0000","last_became_active":"2024-09-10T07:43:41.447192+0000","last_became_peered":"2024-09-10T07:43:41.447192+0000","last_unstale":"2024-09-10T07:43:43.441417+0000","last_undegraded":"2024-09-10T07:43:43.441417+0000","last_fullsized":"2024-09-10T07:43:43.441417+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:38:14.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.461778+0000","last_change":"2024-09-10T07:43:42.458309+0000","last_active":"2024-09-10T07:43:42.461778+0000","last_peered":"2024-09-10T07:43:42.461778+0000","last_clean":"2024-09-10T07:43:42.461778+0000","last_became_active":"2024-09-10T07:43:42.457853+0000","last_became_peered":"2024-09-10T07:43:42.457853+0000","last_unstale":"2024-09-10T07:43:42.461778+0000","last_undegraded":"2024-09-10T07:43:42.461778+0000","last_fullsized":"2024-09-10T07:43:42.461778+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:54.379580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.469774+0000","last_change":"2024-09-10T07:43:41.449333+0000","last_active":"2024-09-10T07:43:42.469774+0000","last_peered":"2024-09-10T07:43:42.469774+0000","last_clean":"2024-09-10T07:43:42.469774+0000","last_became_active":"2024-09-10T07:43:41.448665+0000","last_became_peered":"2024-09-10T07:43:41.448665+0000","last_unstale":"2024-09-10T07:43:42.469774+0000","last_undegraded":"2024-09-10T07:43:42.469774+0000","last_fullsized":"2024-09-10T07:43:42.469774+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:24.150949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.458300+0000","last_change":"2024-09-10T07:43:42.457955+0000","last_active":"2024-09-10T07:43:42.458300+0000","last_peered":"2024-09-10T07:43:42.458300+0000","last_clean":"2024-09-10T07:43:42.458300+0000","last_became_active":"2024-09-10T07:43:42.457363+0000","last_became_peered":"2024-09-10T07:43:42.457363+0000","last_unstale":"2024-09-10T07:43:42.458300+0000","last_undegraded":"2024-09-10T07:43:42.458300+0000","last_fullsized":"2024-09-10T07:43:42.458300+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:57.954238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.440971+0000","last_change":"2024-09-10T07:43:41.450222+0000","last_active":"2024-09-10T07:43:43.440971+0000","last_peered":"2024-09-10T07:43:43.440971+0000","last_clean":"2024-09-10T07:43:43.440971+0000","last_became_active":"2024-09-10T07:43:41.447182+0000","last_became_peered":"2024-09-10T07:43:41.447182+0000","last_unstale":"2024-09-10T07:43:43.440971+0000","last_undegraded":"2024-09-10T07:43:43.440971+0000","last_fullsized":"2024-09-10T07:43:43.440971+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:13.686759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442080+0000","last_change":"2024-09-10T07:43:42.463813+0000","last_active":"2024-09-10T07:43:43.442080+0000","last_peered":"2024-09-10T07:43:43.442080+0000","last_clean":"2024-09-10T07:43:43.442080+0000","last_became_active":"2024-09-10T07:43:42.459605+0000","last_became_peered":"2024-09-10T07:43:42.459605+0000","last_unstale":"2024-09-10T07:43:43.442080+0000","last_undegraded":"2024-09-10T07:43:43.442080+0000","last_fullsized":"2024-09-10T07:43:43.442080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:30.324850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.457293+0000","last_change":"2024-09-10T07:43:41.453068+0000","last_active":"2024-09-10T07:43:42.457293+0000","last_peered":"2024-09-10T07:43:42.457293+0000","last_clean":"2024-09-10T07:43:42.457293+0000","last_became_active":"2024-09-10T07:43:41.452690+0000","last_became_peered":"2024-09-10T07:43:41.452690+0000","last_unstale":"2024-09-10T07:43:42.457293+0000","last_undegraded":"2024-09-10T07:43:42.457293+0000","last_fullsized":"2024-09-10T07:43:42.457293+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:47.501883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.455740+0000","last_change":"2024-09-10T07:43:42.455469+0000","last_active":"2024-09-10T07:43:42.455740+0000","last_peered":"2024-09-10T07:43:42.455740+0000","last_clean":"2024-09-10T07:43:42.455740+0000","last_became_active":"2024-09-10T07:43:42.454703+0000","last_became_peered":"2024-09-10T07:43:42.454703+0000","last_unstale":"2024-09-10T07:43:42.455740+0000","last_undegraded":"2024-09-10T07:43:42.455740+0000","last_fullsized":"2024-09-10T07:43:42.455740+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:52.190547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.453748+0000","last_change":"2024-09-10T07:43:41.455352+0000","last_active":"2024-09-10T07:43:42.453748+0000","last_peered":"2024-09-10T07:43:42.453748+0000","last_clean":"2024-09-10T07:43:42.453748+0000","last_became_active":"2024-09-10T07:43:41.453946+0000","last_became_peered":"2024-09-10T07:43:41.453946+0000","last_unstale":"2024-09-10T07:43:42.453748+0000","last_undegraded":"2024-09-10T07:43:42.453748+0000","last_fullsized":"2024-09-10T07:43:42.453748+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:29.813184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442878+0000","last_change":"2024-09-10T07:43:42.463237+0000","last_active":"2024-09-10T07:43:43.442878+0000","last_peered":"2024-09-10T07:43:43.442878+0000","last_clean":"2024-09-10T07:43:43.442878+0000","last_became_active":"2024-09-10T07:43:42.461394+0000","last_became_peered":"2024-09-10T07:43:42.461394+0000","last_unstale":"2024-09-10T07:43:43.442878+0000","last_undegraded":"2024-09-10T07:43:43.442878+0000","last_fullsized":"2024-09-10T07:43:43.442878+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:31.577093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.458109+0000","last_change":"2024-09-10T07:43:41.453406+0000","last_active":"2024-09-10T07:43:42.458109+0000","last_peered":"2024-09-10T07:43:42.458109+0000","last_clean":"2024-09-10T07:43:42.458109+0000","last_became_active":"2024-09-10T07:43:41.452976+0000","last_became_peered":"2024-09-10T07:43:41.452976+0000","last_unstale":"2024-09-10T07:43:42.458109+0000","last_undegraded":"2024-09-10T07:43:42.458109+0000","last_fullsized":"2024-09-10T07:43:42.458109+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:45.488054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.455438+0000","last_change":"2024-09-10T07:43:42.454936+0000","last_active":"2024-09-10T07:43:42.455438+0000","last_peered":"2024-09-10T07:43:42.455438+0000","last_clean":"2024-09-10T07:43:42.455438+0000","last_became_active":"2024-09-10T07:43:42.454666+0000","last_became_peered":"2024-09-10T07:43:42.454666+0000","last_unstale":"2024-09-10T07:43:42.455438+0000","last_undegraded":"2024-09-10T07:43:42.455438+0000","last_fullsized":"2024-09-10T07:43:42.455438+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:31.824260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.454837+0000","last_change":"2024-09-10T07:43:41.454874+0000","last_active":"2024-09-10T07:43:42.454837+0000","last_peered":"2024-09-10T07:43:42.454837+0000","last_clean":"2024-09-10T07:43:42.454837+0000","last_became_active":"2024-09-10T07:43:41.454618+0000","last_became_peered":"2024-09-10T07:43:41.454618+0000","last_unstale":"2024-09-10T07:43:42.454837+0000","last_undegraded":"2024-09-10T07:43:42.454837+0000","last_fullsized":"2024-09-10T07:43:42.454837+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:49.949474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442068+0000","last_change":"2024-09-10T07:43:42.459935+0000","last_active":"2024-09-10T07:43:43.442068+0000","last_peered":"2024-09-10T07:43:43.442068+0000","last_clean":"2024-09-10T07:43:43.442068+0000","last_became_active":"2024-09-10T07:43:42.459239+0000","last_became_peered":"2024-09-10T07:43:42.459239+0000","last_unstale":"2024-09-10T07:43:43.442068+0000","last_undegraded":"2024-09-10T07:43:43.442068+0000","last_fullsized":"2024-09-10T07:43:43.442068+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:09.458072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.470081+0000","last_change":"2024-09-10T07:43:41.454195+0000","last_active":"2024-09-10T07:43:42.470081+0000","last_peered":"2024-09-10T07:43:42.470081+0000","last_clean":"2024-09-10T07:43:42.470081+0000","last_became_active":"2024-09-10T07:43:41.453929+0000","last_became_peered":"2024-09-10T07:43:41.453929+0000","last_unstale":"2024-09-10T07:43:42.470081+0000","last_undegraded":"2024-09-10T07:43:42.470081+0000","last_fullsized":"2024-09-10T07:43:42.470081+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:00.261974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.461755+0000","last_change":"2024-09-10T07:43:42.458103+0000","last_active":"2024-09-10T07:43:42.461755+0000","last_peered":"2024-09-10T07:43:42.461755+0000","last_clean":"2024-09-10T07:43:42.461755+0000","last_became_active":"2024-09-10T07:43:42.457537+0000","last_became_peered":"2024-09-10T07:43:42.457537+0000","last_unstale":"2024-09-10T07:43:42.461755+0000","last_undegraded":"2024-09-10T07:43:42.461755+0000","last_fullsized":"2024-09-10T07:43:42.461755+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:09.098369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.444497+0000","last_change":"2024-09-10T07:43:41.453373+0000","last_active":"2024-09-10T07:43:42.444497+0000","last_peered":"2024-09-10T07:43:42.444497+0000","last_clean":"2024-09-10T07:43:42.444497+0000","last_became_active":"2024-09-10T07:43:41.452998+0000","last_became_peered":"2024-09-10T07:43:41.452998+0000","last_unstale":"2024-09-10T07:43:42.444497+0000","last_undegraded":"2024-09-10T07:43:42.444497+0000","last_fullsized":"2024-09-10T07:43:42.444497+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:51.351769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441200+0000","last_change":"2024-09-10T07:43:42.457913+0000","last_active":"2024-09-10T07:43:43.441200+0000","last_peered":"2024-09-10T07:43:43.441200+0000","last_clean":"2024-09-10T07:43:43.441200+0000","last_became_active":"2024-09-10T07:43:42.457685+0000","last_became_peered":"2024-09-10T07:43:42.457685+0000","last_unstale":"2024-09-10T07:43:43.441200+0000","last_undegraded":"2024-09-10T07:43:43.441200+0000","last_fullsized":"2024-09-10T07:43:43.441200+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:23.113553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.445571+0000","last_change":"2024-09-10T07:43:41.452681+0000","last_active":"2024-09-10T07:43:42.445571+0000","last_peered":"2024-09-10T07:43:42.445571+0000","last_clean":"2024-09-10T07:43:42.445571+0000","last_became_active":"2024-09-10T07:43:41.452411+0000","last_became_peered":"2024-09-10T07:43:41.452411+0000","last_unstale":"2024-09-10T07:43:42.445571+0000","last_undegraded":"2024-09-10T07:43:42.445571+0000","last_fullsized":"2024-09-10T07:43:42.445571+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:59.370027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.464762+0000","last_change":"2024-09-10T07:43:42.464644+0000","last_active":"2024-09-10T07:43:42.464762+0000","last_peered":"2024-09-10T07:43:42.464762+0000","last_clean":"2024-09-10T07:43:42.464762+0000","last_became_active":"2024-09-10T07:43:42.464386+0000","last_became_peered":"2024-09-10T07:43:42.464386+0000","last_unstale":"2024-09-10T07:43:42.464762+0000","last_undegraded":"2024-09-10T07:43:42.464762+0000","last_fullsized":"2024-09-10T07:43:42.464762+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:16.896579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.445192+0000","last_change":"2024-09-10T07:43:41.449828+0000","last_active":"2024-09-10T07:43:42.445192+0000","last_peered":"2024-09-10T07:43:42.445192+0000","last_clean":"2024-09-10T07:43:42.445192+0000","last_became_active":"2024-09-10T07:43:41.449567+0000","last_became_peered":"2024-09-10T07:43:41.449567+0000","last_unstale":"2024-09-10T07:43:42.445192+0000","last_undegraded":"2024-09-10T07:43:42.445192+0000","last_fullsized":"2024-09-10T07:43:42.445192+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:30.223639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.456530+0000","last_change":"2024-09-10T07:43:42.456422+0000","last_active":"2024-09-10T07:43:42.456530+0000","last_peered":"2024-09-10T07:43:42.456530+0000","last_clean":"2024-09-10T07:43:42.456530+0000","last_became_active":"2024-09-10T07:43:42.456207+0000","last_became_peered":"2024-09-10T07:43:42.456207+0000","last_unstale":"2024-09-10T07:43:42.456530+0000","last_undegraded":"2024-09-10T07:43:42.456530+0000","last_fullsized":"2024-09-10T07:43:42.456530+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:49.060893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.442507+0000","last_change":"2024-09-10T07:43:41.447602+0000","last_active":"2024-09-10T07:43:42.442507+0000","last_peered":"2024-09-10T07:43:42.442507+0000","last_clean":"2024-09-10T07:43:42.442507+0000","last_became_active":"2024-09-10T07:43:41.447363+0000","last_became_peered":"2024-09-10T07:43:41.447363+0000","last_unstale":"2024-09-10T07:43:42.442507+0000","last_undegraded":"2024-09-10T07:43:42.442507+0000","last_fullsized":"2024-09-10T07:43:42.442507+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:37.018736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441671+0000","last_change":"2024-09-10T07:43:42.458476+0000","last_active":"2024-09-10T07:43:43.441671+0000","last_peered":"2024-09-10T07:43:43.441671+0000","last_clean":"2024-09-10T07:43:43.441671+0000","last_became_active":"2024-09-10T07:43:42.457104+0000","last_became_peered":"2024-09-10T07:43:42.457104+0000","last_unstale":"2024-09-10T07:43:43.441671+0000","last_undegraded":"2024-09-10T07:43:43.441671+0000","last_fullsized":"2024-09-10T07:43:43.441671+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:51.761652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.455019+0000","last_change":"2024-09-10T07:43:41.455706+0000","last_active":"2024-09-10T07:43:42.455019+0000","last_peered":"2024-09-10T07:43:42.455019+0000","last_clean":"2024-09-10T07:43:42.455019+0000","last_became_active":"2024-09-10T07:43:41.455375+0000","last_became_peered":"2024-09-10T07:43:41.455375+0000","last_unstale":"2024-09-10T07:43:42.455019+0000","last_undegraded":"2024-09-10T07:43:42.455019+0000","last_fullsized":"2024-09-10T07:43:42.455019+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:52.847927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.468014+0000","last_change":"2024-09-10T07:43:42.467194+0000","last_active":"2024-09-10T07:43:42.468014+0000","last_peered":"2024-09-10T07:43:42.468014+0000","last_clean":"2024-09-10T07:43:42.468014+0000","last_became_active":"2024-09-10T07:43:42.460613+0000","last_became_peered":"2024-09-10T07:43:42.460613+0000","last_unstale":"2024-09-10T07:43:42.468014+0000","last_undegraded":"2024-09-10T07:43:42.468014+0000","last_fullsized":"2024-09-10T07:43:42.468014+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:12.869681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.451823+0000","last_change":"2024-09-10T07:43:41.450768+0000","last_active":"2024-09-10T07:43:42.451823+0000","last_peered":"2024-09-10T07:43:42.451823+0000","last_clean":"2024-09-10T07:43:42.451823+0000","last_became_active":"2024-09-10T07:43:41.450250+0000","last_became_peered":"2024-09-10T07:43:41.450250+0000","last_unstale":"2024-09-10T07:43:42.451823+0000","last_undegraded":"2024-09-10T07:43:42.451823+0000","last_fullsized":"2024-09-10T07:43:42.451823+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:42.494118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442222+0000","last_change":"2024-09-10T07:43:42.448627+0000","last_active":"2024-09-10T07:43:43.442222+0000","last_peered":"2024-09-10T07:43:43.442222+0000","last_clean":"2024-09-10T07:43:43.442222+0000","last_became_active":"2024-09-10T07:43:42.447920+0000","last_became_peered":"2024-09-10T07:43:42.447920+0000","last_unstale":"2024-09-10T07:43:43.442222+0000","last_undegraded":"2024-09-10T07:43:43.442222+0000","last_fullsized":"2024-09-10T07:43:43.442222+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:55.388274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441014+0000","last_change":"2024-09-10T07:43:41.452485+0000","last_active":"2024-09-10T07:43:43.441014+0000","last_peered":"2024-09-10T07:43:43.441014+0000","last_clean":"2024-09-10T07:43:43.441014+0000","last_became_active":"2024-09-10T07:43:41.451513+0000","last_became_peered":"2024-09-10T07:43:41.451513+0000","last_unstale":"2024-09-10T07:43:43.441014+0000","last_undegraded":"2024-09-10T07:43:43.441014+0000","last_fullsized":"2024-09-10T07:43:43.441014+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:26.046862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.464331+0000","last_change":"2024-09-10T07:43:42.464157+0000","last_active":"2024-09-10T07:43:42.464331+0000","last_peered":"2024-09-10T07:43:42.464331+0000","last_clean":"2024-09-10T07:43:42.464331+0000","last_became_active":"2024-09-10T07:43:42.463836+0000","last_became_peered":"2024-09-10T07:43:42.463836+0000","last_unstale":"2024-09-10T07:43:42.464331+0000","last_undegraded":"2024-09-10T07:43:42.464331+0000","last_fullsized":"2024-09-10T07:43:42.464331+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:07.734980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"170'3","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.472075+0000","last_change":"2024-09-10T07:43:41.455995+0000","last_active":"2024-09-10T07:43:42.472075+0000","last_peered":"2024-09-10T07:43:42.472075+0000","last_clean":"2024-09-10T07:43:42.472075+0000","last_became_active":"2024-09-10T07:43:41.455592+0000","last_became_peered":"2024-09-10T07:43:41.455592+0000","last_unstale":"2024-09-10T07:43:42.472075+0000","last_undegraded":"2024-09-10T07:43:42.472075+0000","last_fullsized":"2024-09-10T07:43:42.472075+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:54.664184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":464,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.453808+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:43:42.453808+0000","last_peered":"2024-09-10T07:43:42.453808+0000","last_clean":"2024-09-10T07:43:42.453808+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:43:42.453808+0000","last_undegraded":"2024-09-10T07:43:42.453808+0000","last_fullsized":"2024-09-10T07:43:42.453808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193803,"statfs":{"total":200000000,"available":198454875,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045749,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045873,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045895,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045805,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":933,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194379,"statfs":{"total":200000000,"available":199044213,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":932,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045313,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1509,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193802,"statfs":{"total":200000000,"available":198453881,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:43:46.618 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:43:46.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.807+0000 7f53bae00640 1 Processor -- start 2024-09-10T07:43:46.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.807+0000 7f53bae00640 1 -- start start 2024-09-10T07:43:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.808+0000 7f53bae00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f53b413fae0 0x7f53b406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.808+0000 7f53bae00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f53b4142150 0x7f53b4160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.808+0000 7f53bae00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4160a80 0x7f53b415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.808+0000 7f53bae00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f53b40ce780 con 0x7f53b413fae0 2024-09-10T07:43:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.808+0000 7f53bae00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f53b4142650 con 0x7f53b4142150 2024-09-10T07:43:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.808+0000 7f53bae00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f53b4142930 con 0x7f53b4160a80 2024-09-10T07:43:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f53b413fae0 0x7f53b406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f53b413fae0 0x7f53b406f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52866/0 (socket says 172.21.15.99:52866) 2024-09-10T07:43:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b3e00640 1 -- 172.21.15.99:0/820819046 learned_addr learned my addr 172.21.15.99:0/820819046 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:46.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b3400640 1 --2- 172.21.15.99:0/820819046 >> v2:172.21.15.187:3300/0 conn(0x7f53b4142150 0x7f53b4160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b8e00640 1 --2- 172.21.15.99:0/820819046 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4160a80 0x7f53b415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b3e00640 1 -- 172.21.15.99:0/820819046 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4160a80 msgr2=0x7f53b415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:46.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b3e00640 1 --2- 172.21.15.99:0/820819046 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4160a80 0x7f53b415cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b3e00640 1 -- 172.21.15.99:0/820819046 >> v2:172.21.15.187:3300/0 conn(0x7f53b4142150 msgr2=0x7f53b4160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:46.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b3e00640 1 --2- 172.21.15.99:0/820819046 >> v2:172.21.15.187:3300/0 conn(0x7f53b4142150 0x7f53b4160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b3e00640 1 -- 172.21.15.99:0/820819046 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b4142c10 con 0x7f53b413fae0 2024-09-10T07:43:46.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.809+0000 7f53b8e00640 1 --2- 172.21.15.99:0/820819046 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4160a80 0x7f53b415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.810+0000 7f53b3e00640 1 --2- 172.21.15.99:0/820819046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 0x7f53b406f1b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f53b4075560 tx=0x7f53a402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2804ac9675ab935a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.810+0000 7f53b2a00640 1 -- 172.21.15.99:0/820819046 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a4037070 con 0x7f53b413fae0 2024-09-10T07:43:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.810+0000 7f53b2a00640 1 -- 172.21.15.99:0/820819046 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a4032440 con 0x7f53b413fae0 2024-09-10T07:43:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.810+0000 7f53b2a00640 1 -- 172.21.15.99:0/820819046 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a4032810 con 0x7f53b413fae0 2024-09-10T07:43:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.811+0000 7f53bae00640 1 -- 172.21.15.99:0/820819046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 msgr2=0x7f53b406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.811+0000 7f53bae00640 1 --2- 172.21.15.99:0/820819046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 0x7f53b406f1b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f53b4075560 tx=0x7f53a402a140 comp rx=0 tx=0).stop 2024-09-10T07:43:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.811+0000 7f53bae00640 1 -- 172.21.15.99:0/820819046 shutdown_connections 2024-09-10T07:43:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.811+0000 7f53bae00640 1 --2- 172.21.15.99:0/820819046 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4160a80 0x7f53b415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.811+0000 7f53bae00640 1 --2- 172.21.15.99:0/820819046 >> v2:172.21.15.187:3300/0 conn(0x7f53b4142150 0x7f53b4160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.811+0000 7f53bae00640 1 --2- 172.21.15.99:0/820819046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 0x7f53b406f1b0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.811+0000 7f53bae00640 1 -- 172.21.15.99:0/820819046 >> 172.21.15.99:0/820819046 conn(0x7f53b406bc10 msgr2=0x7f53b406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.811+0000 7f53bae00640 1 -- 172.21.15.99:0/820819046 shutdown_connections 2024-09-10T07:43:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.811+0000 7f53bae00640 1 -- 172.21.15.99:0/820819046 wait complete. 2024-09-10T07:43:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.813+0000 7f53bae00640 1 Processor -- start 2024-09-10T07:43:46.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.813+0000 7f53bae00640 1 -- start start 2024-09-10T07:43:46.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53bae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 0x7f53b40b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53bae00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4142150 0x7f53b413f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53bae00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53b4160a80 0x7f53b41442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53bae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f53b406f870 con 0x7f53b413fae0 2024-09-10T07:43:46.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53bae00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f53b406f6f0 con 0x7f53b4160a80 2024-09-10T07:43:46.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53bae00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f53b415d490 con 0x7f53b4142150 2024-09-10T07:43:46.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 0x7f53b40b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 0x7f53b40b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52876/0 (socket says 172.21.15.99:52876) 2024-09-10T07:43:46.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53b3e00640 1 -- 172.21.15.99:0/2444212835 learned_addr learned my addr 172.21.15.99:0/2444212835 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:46.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53b8e00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53b4160a80 0x7f53b41442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53b3400640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4142150 0x7f53b413f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53b3e00640 1 -- 172.21.15.99:0/2444212835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4142150 msgr2=0x7f53b413f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53b3e00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4142150 0x7f53b413f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53b3e00640 1 -- 172.21.15.99:0/2444212835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53b4160a80 msgr2=0x7f53b41442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:46.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53b3e00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53b4160a80 0x7f53b41442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:46.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.814+0000 7f53b3e00640 1 -- 172.21.15.99:0/2444212835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b4144b70 con 0x7f53b413fae0 2024-09-10T07:43:46.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.815+0000 7f53b3e00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 0x7f53b40b56d0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f53a402a180 tx=0x7f53a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:46.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.815+0000 7f53abe00640 1 -- 172.21.15.99:0/2444212835 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a4037040 con 0x7f53b413fae0 2024-09-10T07:43:46.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.815+0000 7f53abe00640 1 -- 172.21.15.99:0/2444212835 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53a4042070 con 0x7f53b413fae0 2024-09-10T07:43:46.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.815+0000 7f53bae00640 1 -- 172.21.15.99:0/2444212835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b4144e50 con 0x7f53b413fae0 2024-09-10T07:43:46.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.815+0000 7f53abe00640 1 -- 172.21.15.99:0/2444212835 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a4030880 con 0x7f53b413fae0 2024-09-10T07:43:46.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.815+0000 7f53bae00640 1 -- 172.21.15.99:0/2444212835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b4145410 con 0x7f53b413fae0 2024-09-10T07:43:46.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.816+0000 7f53bae00640 1 -- 172.21.15.99:0/2444212835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b4160540 con 0x7f53b413fae0 2024-09-10T07:43:46.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.817+0000 7f53abe00640 1 -- 172.21.15.99:0/2444212835 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53a4030a20 con 0x7f53b413fae0 2024-09-10T07:43:46.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.818+0000 7f53abe00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f539406be30 0x7f539406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:46.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.818+0000 7f53abe00640 1 -- 172.21.15.99:0/2444212835 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f53a40ab5e0 con 0x7f53b413fae0 2024-09-10T07:43:46.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.818+0000 7f53b3400640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f539406be30 0x7f539406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:46.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.819+0000 7f53b3400640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f539406be30 0x7f539406e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f53b40b5c10 tx=0x7f53a0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:46.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.822+0000 7f53abe00640 1 -- 172.21.15.99:0/2444212835 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53a40798a0 con 0x7f53b413fae0 2024-09-10T07:43:46.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.992+0000 7f53bae00640 1 -- 172.21.15.99:0/2444212835 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53b413f600 con 0x7f539406be30 2024-09-10T07:43:46.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:46.998+0000 7f53abe00640 1 -- 172.21.15.99:0/2444212835 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247966 (secure 0 0 0) 0x7f53b413f600 con 0x7f539406be30 2024-09-10T07:43:47.000 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:43:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 -- 172.21.15.99:0/2444212835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f539406be30 msgr2=0x7f539406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f539406be30 0x7f539406e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f53b40b5c10 tx=0x7f53a0009190 comp rx=0 tx=0).stop 2024-09-10T07:43:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 -- 172.21.15.99:0/2444212835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 msgr2=0x7f53b40b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 0x7f53b40b56d0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f53a402a180 tx=0x7f53a40046c0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 -- 172.21.15.99:0/2444212835 shutdown_connections 2024-09-10T07:43:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53b4160a80 0x7f53b41442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53b4142150 0x7f53b413f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f539406be30 0x7f539406e2f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 --2- 172.21.15.99:0/2444212835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b413fae0 0x7f53b40b56d0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 -- 172.21.15.99:0/2444212835 >> 172.21.15.99:0/2444212835 conn(0x7f53b406bc10 msgr2=0x7f53b4071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:47.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 -- 172.21.15.99:0/2444212835 shutdown_connections 2024-09-10T07:43:47.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.002+0000 7f53bae00640 1 -- 172.21.15.99:0/2444212835 wait complete. 2024-09-10T07:43:47.017 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2024-09-10T07:43:46.818661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8611,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553888,"statfs":{"total":1600000000,"available":1591181604,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001005"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.457885+0000","last_change":"2024-09-10T07:43:42.457766+0000","last_active":"2024-09-10T07:43:42.457885+0000","last_peered":"2024-09-10T07:43:42.457885+0000","last_clean":"2024-09-10T07:43:42.457885+0000","last_became_active":"2024-09-10T07:43:42.456802+0000","last_became_peered":"2024-09-10T07:43:42.456802+0000","last_unstale":"2024-09-10T07:43:42.457885+0000","last_undegraded":"2024-09-10T07:43:42.457885+0000","last_fullsized":"2024-09-10T07:43:42.457885+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:31.705856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.440810+0000","last_change":"2024-09-10T07:43:42.447327+0000","last_active":"2024-09-10T07:43:43.440810+0000","last_peered":"2024-09-10T07:43:43.440810+0000","last_clean":"2024-09-10T07:43:43.440810+0000","last_became_active":"2024-09-10T07:43:42.447077+0000","last_became_peered":"2024-09-10T07:43:42.447077+0000","last_unstale":"2024-09-10T07:43:43.440810+0000","last_undegraded":"2024-09-10T07:43:43.440810+0000","last_fullsized":"2024-09-10T07:43:43.440810+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:27.955587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.462635+0000","last_change":"2024-09-10T07:43:42.462516+0000","last_active":"2024-09-10T07:43:42.462635+0000","last_peered":"2024-09-10T07:43:42.462635+0000","last_clean":"2024-09-10T07:43:42.462635+0000","last_became_active":"2024-09-10T07:43:42.461709+0000","last_became_peered":"2024-09-10T07:43:42.461709+0000","last_unstale":"2024-09-10T07:43:42.462635+0000","last_undegraded":"2024-09-10T07:43:42.462635+0000","last_fullsized":"2024-09-10T07:43:42.462635+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:20.427826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441602+0000","last_change":"2024-09-10T07:43:42.465521+0000","last_active":"2024-09-10T07:43:43.441602+0000","last_peered":"2024-09-10T07:43:43.441602+0000","last_clean":"2024-09-10T07:43:43.441602+0000","last_became_active":"2024-09-10T07:43:42.464500+0000","last_became_peered":"2024-09-10T07:43:42.464500+0000","last_unstale":"2024-09-10T07:43:43.441602+0000","last_undegraded":"2024-09-10T07:43:43.441602+0000","last_fullsized":"2024-09-10T07:43:43.441602+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:30.682331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441844+0000","last_change":"2024-09-10T07:43:42.463240+0000","last_active":"2024-09-10T07:43:43.441844+0000","last_peered":"2024-09-10T07:43:43.441844+0000","last_clean":"2024-09-10T07:43:43.441844+0000","last_became_active":"2024-09-10T07:43:42.462876+0000","last_became_peered":"2024-09-10T07:43:42.462876+0000","last_unstale":"2024-09-10T07:43:43.441844+0000","last_undegraded":"2024-09-10T07:43:43.441844+0000","last_fullsized":"2024-09-10T07:43:43.441844+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:09.935609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.457695+0000","last_change":"2024-09-10T07:43:42.457583+0000","last_active":"2024-09-10T07:43:42.457695+0000","last_peered":"2024-09-10T07:43:42.457695+0000","last_clean":"2024-09-10T07:43:42.457695+0000","last_became_active":"2024-09-10T07:43:42.456479+0000","last_became_peered":"2024-09-10T07:43:42.456479+0000","last_unstale":"2024-09-10T07:43:42.457695+0000","last_undegraded":"2024-09-10T07:43:42.457695+0000","last_fullsized":"2024-09-10T07:43:42.457695+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:23.637280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.461031+0000","last_change":"2024-09-10T07:43:42.460928+0000","last_active":"2024-09-10T07:43:42.461031+0000","last_peered":"2024-09-10T07:43:42.461031+0000","last_clean":"2024-09-10T07:43:42.461031+0000","last_became_active":"2024-09-10T07:43:42.460727+0000","last_became_peered":"2024-09-10T07:43:42.460727+0000","last_unstale":"2024-09-10T07:43:42.461031+0000","last_undegraded":"2024-09-10T07:43:42.461031+0000","last_fullsized":"2024-09-10T07:43:42.461031+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:20.913754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.456599+0000","last_change":"2024-09-10T07:43:42.456484+0000","last_active":"2024-09-10T07:43:42.456599+0000","last_peered":"2024-09-10T07:43:42.456599+0000","last_clean":"2024-09-10T07:43:42.456599+0000","last_became_active":"2024-09-10T07:43:42.456028+0000","last_became_peered":"2024-09-10T07:43:42.456028+0000","last_unstale":"2024-09-10T07:43:42.456599+0000","last_undegraded":"2024-09-10T07:43:42.456599+0000","last_fullsized":"2024-09-10T07:43:42.456599+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:01.601239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.440793+0000","last_change":"2024-09-10T07:43:42.448950+0000","last_active":"2024-09-10T07:43:43.440793+0000","last_peered":"2024-09-10T07:43:43.440793+0000","last_clean":"2024-09-10T07:43:43.440793+0000","last_became_active":"2024-09-10T07:43:42.448699+0000","last_became_peered":"2024-09-10T07:43:42.448699+0000","last_unstale":"2024-09-10T07:43:43.440793+0000","last_undegraded":"2024-09-10T07:43:43.440793+0000","last_fullsized":"2024-09-10T07:43:43.440793+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:27.153890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.470272+0000","last_change":"2024-09-10T07:43:42.470159+0000","last_active":"2024-09-10T07:43:42.470272+0000","last_peered":"2024-09-10T07:43:42.470272+0000","last_clean":"2024-09-10T07:43:42.470272+0000","last_became_active":"2024-09-10T07:43:42.469890+0000","last_became_peered":"2024-09-10T07:43:42.469890+0000","last_unstale":"2024-09-10T07:43:42.470272+0000","last_undegraded":"2024-09-10T07:43:42.470272+0000","last_fullsized":"2024-09-10T07:43:42.470272+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:42.599817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.451298+0000","last_change":"2024-09-10T07:43:42.451160+0000","last_active":"2024-09-10T07:43:42.451298+0000","last_peered":"2024-09-10T07:43:42.451298+0000","last_clean":"2024-09-10T07:43:42.451298+0000","last_became_active":"2024-09-10T07:43:42.450722+0000","last_became_peered":"2024-09-10T07:43:42.450722+0000","last_unstale":"2024-09-10T07:43:42.451298+0000","last_undegraded":"2024-09-10T07:43:42.451298+0000","last_fullsized":"2024-09-10T07:43:42.451298+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:51.767768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.465302+0000","last_change":"2024-09-10T07:43:42.458940+0000","last_active":"2024-09-10T07:43:42.465302+0000","last_peered":"2024-09-10T07:43:42.465302+0000","last_clean":"2024-09-10T07:43:42.465302+0000","last_became_active":"2024-09-10T07:43:42.458698+0000","last_became_peered":"2024-09-10T07:43:42.458698+0000","last_unstale":"2024-09-10T07:43:42.465302+0000","last_undegraded":"2024-09-10T07:43:42.465302+0000","last_fullsized":"2024-09-10T07:43:42.465302+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:57.593780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441423+0000","last_change":"2024-09-10T07:43:42.459740+0000","last_active":"2024-09-10T07:43:43.441423+0000","last_peered":"2024-09-10T07:43:43.441423+0000","last_clean":"2024-09-10T07:43:43.441423+0000","last_became_active":"2024-09-10T07:43:42.458918+0000","last_became_peered":"2024-09-10T07:43:42.458918+0000","last_unstale":"2024-09-10T07:43:43.441423+0000","last_undegraded":"2024-09-10T07:43:43.441423+0000","last_fullsized":"2024-09-10T07:43:43.441423+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:31.222992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441880+0000","last_change":"2024-09-10T07:43:42.465264+0000","last_active":"2024-09-10T07:43:43.441880+0000","last_peered":"2024-09-10T07:43:43.441880+0000","last_clean":"2024-09-10T07:43:43.441880+0000","last_became_active":"2024-09-10T07:43:42.464166+0000","last_became_peered":"2024-09-10T07:43:42.464166+0000","last_unstale":"2024-09-10T07:43:43.441880+0000","last_undegraded":"2024-09-10T07:43:43.441880+0000","last_fullsized":"2024-09-10T07:43:43.441880+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:30.426739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.468033+0000","last_change":"2024-09-10T07:43:42.467230+0000","last_active":"2024-09-10T07:43:42.468033+0000","last_peered":"2024-09-10T07:43:42.468033+0000","last_clean":"2024-09-10T07:43:42.468033+0000","last_became_active":"2024-09-10T07:43:42.458843+0000","last_became_peered":"2024-09-10T07:43:42.458843+0000","last_unstale":"2024-09-10T07:43:42.468033+0000","last_undegraded":"2024-09-10T07:43:42.468033+0000","last_fullsized":"2024-09-10T07:43:42.468033+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:47.389052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.449620+0000","last_change":"2024-09-10T07:43:42.449509+0000","last_active":"2024-09-10T07:43:42.449620+0000","last_peered":"2024-09-10T07:43:42.449620+0000","last_clean":"2024-09-10T07:43:42.449620+0000","last_became_active":"2024-09-10T07:43:42.449065+0000","last_became_peered":"2024-09-10T07:43:42.449065+0000","last_unstale":"2024-09-10T07:43:42.449620+0000","last_undegraded":"2024-09-10T07:43:42.449620+0000","last_fullsized":"2024-09-10T07:43:42.449620+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:43.854733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.467103+0000","last_change":"2024-09-10T07:43:42.465947+0000","last_active":"2024-09-10T07:43:42.467103+0000","last_peered":"2024-09-10T07:43:42.467103+0000","last_clean":"2024-09-10T07:43:42.467103+0000","last_became_active":"2024-09-10T07:43:42.465709+0000","last_became_peered":"2024-09-10T07:43:42.465709+0000","last_unstale":"2024-09-10T07:43:42.467103+0000","last_undegraded":"2024-09-10T07:43:42.467103+0000","last_fullsized":"2024-09-10T07:43:42.467103+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:40.511395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.464685+0000","last_change":"2024-09-10T07:43:42.464176+0000","last_active":"2024-09-10T07:43:42.464685+0000","last_peered":"2024-09-10T07:43:42.464685+0000","last_clean":"2024-09-10T07:43:42.464685+0000","last_became_active":"2024-09-10T07:43:42.462059+0000","last_became_peered":"2024-09-10T07:43:42.462059+0000","last_unstale":"2024-09-10T07:43:42.464685+0000","last_undegraded":"2024-09-10T07:43:42.464685+0000","last_fullsized":"2024-09-10T07:43:42.464685+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:44.394956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.450599+0000","last_change":"2024-09-10T07:43:42.450398+0000","last_active":"2024-09-10T07:43:42.450599+0000","last_peered":"2024-09-10T07:43:42.450599+0000","last_clean":"2024-09-10T07:43:42.450599+0000","last_became_active":"2024-09-10T07:43:42.450152+0000","last_became_peered":"2024-09-10T07:43:42.450152+0000","last_unstale":"2024-09-10T07:43:42.450599+0000","last_undegraded":"2024-09-10T07:43:42.450599+0000","last_fullsized":"2024-09-10T07:43:42.450599+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:13.668146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.448458+0000","last_change":"2024-09-10T07:43:42.447666+0000","last_active":"2024-09-10T07:43:42.448458+0000","last_peered":"2024-09-10T07:43:42.448458+0000","last_clean":"2024-09-10T07:43:42.448458+0000","last_became_active":"2024-09-10T07:43:42.447432+0000","last_became_peered":"2024-09-10T07:43:42.447432+0000","last_unstale":"2024-09-10T07:43:42.448458+0000","last_undegraded":"2024-09-10T07:43:42.448458+0000","last_fullsized":"2024-09-10T07:43:42.448458+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:14.926791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.470812+0000","last_change":"2024-09-10T07:43:42.468678+0000","last_active":"2024-09-10T07:43:42.470812+0000","last_peered":"2024-09-10T07:43:42.470812+0000","last_clean":"2024-09-10T07:43:42.470812+0000","last_became_active":"2024-09-10T07:43:42.468449+0000","last_became_peered":"2024-09-10T07:43:42.468449+0000","last_unstale":"2024-09-10T07:43:42.470812+0000","last_undegraded":"2024-09-10T07:43:42.470812+0000","last_fullsized":"2024-09-10T07:43:42.470812+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:38.581269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442490+0000","last_change":"2024-09-10T07:43:42.456581+0000","last_active":"2024-09-10T07:43:43.442490+0000","last_peered":"2024-09-10T07:43:43.442490+0000","last_clean":"2024-09-10T07:43:43.442490+0000","last_became_active":"2024-09-10T07:43:42.456340+0000","last_became_peered":"2024-09-10T07:43:42.456340+0000","last_unstale":"2024-09-10T07:43:43.442490+0000","last_undegraded":"2024-09-10T07:43:43.442490+0000","last_fullsized":"2024-09-10T07:43:43.442490+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:46.767884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442251+0000","last_change":"2024-09-10T07:43:42.462262+0000","last_active":"2024-09-10T07:43:43.442251+0000","last_peered":"2024-09-10T07:43:43.442251+0000","last_clean":"2024-09-10T07:43:43.442251+0000","last_became_active":"2024-09-10T07:43:42.462017+0000","last_became_peered":"2024-09-10T07:43:42.462017+0000","last_unstale":"2024-09-10T07:43:43.442251+0000","last_undegraded":"2024-09-10T07:43:43.442251+0000","last_fullsized":"2024-09-10T07:43:43.442251+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:56.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.470831+0000","last_change":"2024-09-10T07:43:42.470579+0000","last_active":"2024-09-10T07:43:42.470831+0000","last_peered":"2024-09-10T07:43:42.470831+0000","last_clean":"2024-09-10T07:43:42.470831+0000","last_became_active":"2024-09-10T07:43:42.469001+0000","last_became_peered":"2024-09-10T07:43:42.469001+0000","last_unstale":"2024-09-10T07:43:42.470831+0000","last_undegraded":"2024-09-10T07:43:42.470831+0000","last_fullsized":"2024-09-10T07:43:42.470831+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:43.875147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.448513+0000","last_change":"2024-09-10T07:43:42.448227+0000","last_active":"2024-09-10T07:43:42.448513+0000","last_peered":"2024-09-10T07:43:42.448513+0000","last_clean":"2024-09-10T07:43:42.448513+0000","last_became_active":"2024-09-10T07:43:42.447963+0000","last_became_peered":"2024-09-10T07:43:42.447963+0000","last_unstale":"2024-09-10T07:43:42.448513+0000","last_undegraded":"2024-09-10T07:43:42.448513+0000","last_fullsized":"2024-09-10T07:43:42.448513+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:41.799926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.448227+0000","last_change":"2024-09-10T07:43:42.447066+0000","last_active":"2024-09-10T07:43:42.448227+0000","last_peered":"2024-09-10T07:43:42.448227+0000","last_clean":"2024-09-10T07:43:42.448227+0000","last_became_active":"2024-09-10T07:43:42.446838+0000","last_became_peered":"2024-09-10T07:43:42.446838+0000","last_unstale":"2024-09-10T07:43:42.448227+0000","last_undegraded":"2024-09-10T07:43:42.448227+0000","last_fullsized":"2024-09-10T07:43:42.448227+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:23.459750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.458029+0000","last_change":"2024-09-10T07:43:42.457794+0000","last_active":"2024-09-10T07:43:42.458029+0000","last_peered":"2024-09-10T07:43:42.458029+0000","last_clean":"2024-09-10T07:43:42.458029+0000","last_became_active":"2024-09-10T07:43:42.457569+0000","last_became_peered":"2024-09-10T07:43:42.457569+0000","last_unstale":"2024-09-10T07:43:42.458029+0000","last_undegraded":"2024-09-10T07:43:42.458029+0000","last_fullsized":"2024-09-10T07:43:42.458029+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:24.722320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.458064+0000","last_change":"2024-09-10T07:43:42.457776+0000","last_active":"2024-09-10T07:43:42.458064+0000","last_peered":"2024-09-10T07:43:42.458064+0000","last_clean":"2024-09-10T07:43:42.458064+0000","last_became_active":"2024-09-10T07:43:42.456928+0000","last_became_peered":"2024-09-10T07:43:42.456928+0000","last_unstale":"2024-09-10T07:43:42.458064+0000","last_undegraded":"2024-09-10T07:43:42.458064+0000","last_fullsized":"2024-09-10T07:43:42.458064+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:42.176524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.449625+0000","last_change":"2024-09-10T07:43:42.448648+0000","last_active":"2024-09-10T07:43:42.449625+0000","last_peered":"2024-09-10T07:43:42.449625+0000","last_clean":"2024-09-10T07:43:42.449625+0000","last_became_active":"2024-09-10T07:43:42.448430+0000","last_became_peered":"2024-09-10T07:43:42.448430+0000","last_unstale":"2024-09-10T07:43:42.449625+0000","last_undegraded":"2024-09-10T07:43:42.449625+0000","last_fullsized":"2024-09-10T07:43:42.449625+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:35.315033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442718+0000","last_change":"2024-09-10T07:43:42.465045+0000","last_active":"2024-09-10T07:43:43.442718+0000","last_peered":"2024-09-10T07:43:43.442718+0000","last_clean":"2024-09-10T07:43:43.442718+0000","last_became_active":"2024-09-10T07:43:42.463280+0000","last_became_peered":"2024-09-10T07:43:42.463280+0000","last_unstale":"2024-09-10T07:43:43.442718+0000","last_undegraded":"2024-09-10T07:43:43.442718+0000","last_fullsized":"2024-09-10T07:43:43.442718+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:32.839322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.440898+0000","last_change":"2024-09-10T07:43:42.458875+0000","last_active":"2024-09-10T07:43:43.440898+0000","last_peered":"2024-09-10T07:43:43.440898+0000","last_clean":"2024-09-10T07:43:43.440898+0000","last_became_active":"2024-09-10T07:43:42.458642+0000","last_became_peered":"2024-09-10T07:43:42.458642+0000","last_unstale":"2024-09-10T07:43:43.440898+0000","last_undegraded":"2024-09-10T07:43:43.440898+0000","last_fullsized":"2024-09-10T07:43:43.440898+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:13.702942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.448496+0000","last_change":"2024-09-10T07:43:42.448135+0000","last_active":"2024-09-10T07:43:42.448496+0000","last_peered":"2024-09-10T07:43:42.448496+0000","last_clean":"2024-09-10T07:43:42.448496+0000","last_became_active":"2024-09-10T07:43:42.447757+0000","last_became_peered":"2024-09-10T07:43:42.447757+0000","last_unstale":"2024-09-10T07:43:42.448496+0000","last_undegraded":"2024-09-10T07:43:42.448496+0000","last_fullsized":"2024-09-10T07:43:42.448496+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:21.019368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.467123+0000","last_change":"2024-09-10T07:43:42.466982+0000","last_active":"2024-09-10T07:43:42.467123+0000","last_peered":"2024-09-10T07:43:42.467123+0000","last_clean":"2024-09-10T07:43:42.467123+0000","last_became_active":"2024-09-10T07:43:42.460197+0000","last_became_peered":"2024-09-10T07:43:42.460197+0000","last_unstale":"2024-09-10T07:43:42.467123+0000","last_undegraded":"2024-09-10T07:43:42.467123+0000","last_fullsized":"2024-09-10T07:43:42.467123+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:44.617276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"170'4","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.469500+0000","last_change":"2024-09-10T07:43:41.452640+0000","last_active":"2024-09-10T07:43:42.469500+0000","last_peered":"2024-09-10T07:43:42.469500+0000","last_clean":"2024-09-10T07:43:42.469500+0000","last_became_active":"2024-09-10T07:43:41.452365+0000","last_became_peered":"2024-09-10T07:43:41.452365+0000","last_unstale":"2024-09-10T07:43:42.469500+0000","last_undegraded":"2024-09-10T07:43:42.469500+0000","last_fullsized":"2024-09-10T07:43:42.469500+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:47.510345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441001+0000","last_change":"2024-09-10T07:43:42.447164+0000","last_active":"2024-09-10T07:43:43.441001+0000","last_peered":"2024-09-10T07:43:43.441001+0000","last_clean":"2024-09-10T07:43:43.441001+0000","last_became_active":"2024-09-10T07:43:42.446861+0000","last_became_peered":"2024-09-10T07:43:42.446861+0000","last_unstale":"2024-09-10T07:43:43.441001+0000","last_undegraded":"2024-09-10T07:43:43.441001+0000","last_fullsized":"2024-09-10T07:43:43.441001+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:50.555383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.440915+0000","last_change":"2024-09-10T07:43:41.453424+0000","last_active":"2024-09-10T07:43:43.440915+0000","last_peered":"2024-09-10T07:43:43.440915+0000","last_clean":"2024-09-10T07:43:43.440915+0000","last_became_active":"2024-09-10T07:43:41.452170+0000","last_became_peered":"2024-09-10T07:43:41.452170+0000","last_unstale":"2024-09-10T07:43:43.440915+0000","last_undegraded":"2024-09-10T07:43:43.440915+0000","last_fullsized":"2024-09-10T07:43:43.440915+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:49.321277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.457244+0000","last_change":"2024-09-10T07:43:42.457068+0000","last_active":"2024-09-10T07:43:42.457244+0000","last_peered":"2024-09-10T07:43:42.457244+0000","last_clean":"2024-09-10T07:43:42.457244+0000","last_became_active":"2024-09-10T07:43:42.456122+0000","last_became_peered":"2024-09-10T07:43:42.456122+0000","last_unstale":"2024-09-10T07:43:42.457244+0000","last_undegraded":"2024-09-10T07:43:42.457244+0000","last_fullsized":"2024-09-10T07:43:42.457244+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:11.189734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442900+0000","last_change":"2024-09-10T07:43:41.443618+0000","last_active":"2024-09-10T07:43:43.442900+0000","last_peered":"2024-09-10T07:43:43.442900+0000","last_clean":"2024-09-10T07:43:43.442900+0000","last_became_active":"2024-09-10T07:43:41.443361+0000","last_became_peered":"2024-09-10T07:43:41.443361+0000","last_unstale":"2024-09-10T07:43:43.442900+0000","last_undegraded":"2024-09-10T07:43:43.442900+0000","last_fullsized":"2024-09-10T07:43:43.442900+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:08.339955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.468051+0000","last_change":"2024-09-10T07:43:42.467427+0000","last_active":"2024-09-10T07:43:42.468051+0000","last_peered":"2024-09-10T07:43:42.468051+0000","last_clean":"2024-09-10T07:43:42.468051+0000","last_became_active":"2024-09-10T07:43:42.460681+0000","last_became_peered":"2024-09-10T07:43:42.460681+0000","last_unstale":"2024-09-10T07:43:42.468051+0000","last_undegraded":"2024-09-10T07:43:42.468051+0000","last_fullsized":"2024-09-10T07:43:42.468051+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:55.903755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442991+0000","last_change":"2024-09-10T07:43:41.452274+0000","last_active":"2024-09-10T07:43:43.442991+0000","last_peered":"2024-09-10T07:43:43.442991+0000","last_clean":"2024-09-10T07:43:43.442991+0000","last_became_active":"2024-09-10T07:43:41.452007+0000","last_became_peered":"2024-09-10T07:43:41.452007+0000","last_unstale":"2024-09-10T07:43:43.442991+0000","last_undegraded":"2024-09-10T07:43:43.442991+0000","last_fullsized":"2024-09-10T07:43:43.442991+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:36.839286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441084+0000","last_change":"2024-09-10T07:43:42.458790+0000","last_active":"2024-09-10T07:43:43.441084+0000","last_peered":"2024-09-10T07:43:43.441084+0000","last_clean":"2024-09-10T07:43:43.441084+0000","last_became_active":"2024-09-10T07:43:42.458607+0000","last_became_peered":"2024-09-10T07:43:42.458607+0000","last_unstale":"2024-09-10T07:43:43.441084+0000","last_undegraded":"2024-09-10T07:43:43.441084+0000","last_fullsized":"2024-09-10T07:43:43.441084+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:16.274471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.469901+0000","last_change":"2024-09-10T07:43:41.450902+0000","last_active":"2024-09-10T07:43:42.469901+0000","last_peered":"2024-09-10T07:43:42.469901+0000","last_clean":"2024-09-10T07:43:42.469901+0000","last_became_active":"2024-09-10T07:43:41.450664+0000","last_became_peered":"2024-09-10T07:43:41.450664+0000","last_unstale":"2024-09-10T07:43:42.469901+0000","last_undegraded":"2024-09-10T07:43:42.469901+0000","last_fullsized":"2024-09-10T07:43:42.469901+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:11.583848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442590+0000","last_change":"2024-09-10T07:43:42.460218+0000","last_active":"2024-09-10T07:43:43.442590+0000","last_peered":"2024-09-10T07:43:43.442590+0000","last_clean":"2024-09-10T07:43:43.442590+0000","last_became_active":"2024-09-10T07:43:42.459900+0000","last_became_peered":"2024-09-10T07:43:42.459900+0000","last_unstale":"2024-09-10T07:43:43.442590+0000","last_undegraded":"2024-09-10T07:43:43.442590+0000","last_fullsized":"2024-09-10T07:43:43.442590+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:24.280705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442321+0000","last_change":"2024-09-10T07:43:41.453236+0000","last_active":"2024-09-10T07:43:43.442321+0000","last_peered":"2024-09-10T07:43:43.442321+0000","last_clean":"2024-09-10T07:43:43.442321+0000","last_became_active":"2024-09-10T07:43:41.452885+0000","last_became_peered":"2024-09-10T07:43:41.452885+0000","last_unstale":"2024-09-10T07:43:43.442321+0000","last_undegraded":"2024-09-10T07:43:43.442321+0000","last_fullsized":"2024-09-10T07:43:43.442321+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:30.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441327+0000","last_change":"2024-09-10T07:43:42.450170+0000","last_active":"2024-09-10T07:43:43.441327+0000","last_peered":"2024-09-10T07:43:43.441327+0000","last_clean":"2024-09-10T07:43:43.441327+0000","last_became_active":"2024-09-10T07:43:42.449917+0000","last_became_peered":"2024-09-10T07:43:42.449917+0000","last_unstale":"2024-09-10T07:43:43.441327+0000","last_undegraded":"2024-09-10T07:43:43.441327+0000","last_fullsized":"2024-09-10T07:43:43.441327+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:08.236445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.439540+0000","last_change":"2024-09-10T07:43:41.445841+0000","last_active":"2024-09-10T07:43:42.439540+0000","last_peered":"2024-09-10T07:43:42.439540+0000","last_clean":"2024-09-10T07:43:42.439540+0000","last_became_active":"2024-09-10T07:43:41.445609+0000","last_became_peered":"2024-09-10T07:43:41.445609+0000","last_unstale":"2024-09-10T07:43:42.439540+0000","last_undegraded":"2024-09-10T07:43:42.439540+0000","last_fullsized":"2024-09-10T07:43:42.439540+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:27.577629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441571+0000","last_change":"2024-09-10T07:43:42.448653+0000","last_active":"2024-09-10T07:43:43.441571+0000","last_peered":"2024-09-10T07:43:43.441571+0000","last_clean":"2024-09-10T07:43:43.441571+0000","last_became_active":"2024-09-10T07:43:42.448405+0000","last_became_peered":"2024-09-10T07:43:42.448405+0000","last_unstale":"2024-09-10T07:43:43.441571+0000","last_undegraded":"2024-09-10T07:43:43.441571+0000","last_fullsized":"2024-09-10T07:43:43.441571+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:44.854310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442997+0000","last_change":"2024-09-10T07:43:41.451998+0000","last_active":"2024-09-10T07:43:43.442997+0000","last_peered":"2024-09-10T07:43:43.442997+0000","last_clean":"2024-09-10T07:43:43.442997+0000","last_became_active":"2024-09-10T07:43:41.451736+0000","last_became_peered":"2024-09-10T07:43:41.451736+0000","last_unstale":"2024-09-10T07:43:43.442997+0000","last_undegraded":"2024-09-10T07:43:43.442997+0000","last_fullsized":"2024-09-10T07:43:43.442997+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:21.273872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442031+0000","last_change":"2024-09-10T07:43:42.447710+0000","last_active":"2024-09-10T07:43:43.442031+0000","last_peered":"2024-09-10T07:43:43.442031+0000","last_clean":"2024-09-10T07:43:43.442031+0000","last_became_active":"2024-09-10T07:43:42.447386+0000","last_became_peered":"2024-09-10T07:43:42.447386+0000","last_unstale":"2024-09-10T07:43:43.442031+0000","last_undegraded":"2024-09-10T07:43:43.442031+0000","last_fullsized":"2024-09-10T07:43:43.442031+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:50.051625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441003+0000","last_change":"2024-09-10T07:43:41.450329+0000","last_active":"2024-09-10T07:43:43.441003+0000","last_peered":"2024-09-10T07:43:43.441003+0000","last_clean":"2024-09-10T07:43:43.441003+0000","last_became_active":"2024-09-10T07:43:41.449913+0000","last_became_peered":"2024-09-10T07:43:41.449913+0000","last_unstale":"2024-09-10T07:43:43.441003+0000","last_undegraded":"2024-09-10T07:43:43.441003+0000","last_fullsized":"2024-09-10T07:43:43.441003+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:22.375798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.465275+0000","last_change":"2024-09-10T07:43:42.458277+0000","last_active":"2024-09-10T07:43:42.465275+0000","last_peered":"2024-09-10T07:43:42.465275+0000","last_clean":"2024-09-10T07:43:42.465275+0000","last_became_active":"2024-09-10T07:43:42.457854+0000","last_became_peered":"2024-09-10T07:43:42.457854+0000","last_unstale":"2024-09-10T07:43:42.465275+0000","last_undegraded":"2024-09-10T07:43:42.465275+0000","last_fullsized":"2024-09-10T07:43:42.465275+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.977166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.454306+0000","last_change":"2024-09-10T07:43:41.455031+0000","last_active":"2024-09-10T07:43:42.454306+0000","last_peered":"2024-09-10T07:43:42.454306+0000","last_clean":"2024-09-10T07:43:42.454306+0000","last_became_active":"2024-09-10T07:43:41.454758+0000","last_became_peered":"2024-09-10T07:43:41.454758+0000","last_unstale":"2024-09-10T07:43:42.454306+0000","last_undegraded":"2024-09-10T07:43:42.454306+0000","last_fullsized":"2024-09-10T07:43:42.454306+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:31.355153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.445235+0000","last_change":"2024-09-10T07:43:42.444381+0000","last_active":"2024-09-10T07:43:42.445235+0000","last_peered":"2024-09-10T07:43:42.445235+0000","last_clean":"2024-09-10T07:43:42.445235+0000","last_became_active":"2024-09-10T07:43:42.444139+0000","last_became_peered":"2024-09-10T07:43:42.444139+0000","last_unstale":"2024-09-10T07:43:42.445235+0000","last_undegraded":"2024-09-10T07:43:42.445235+0000","last_fullsized":"2024-09-10T07:43:42.445235+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:28.938492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"170'6","reported_seq":18,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.471192+0000","last_change":"2024-09-10T07:43:41.447659+0000","last_active":"2024-09-10T07:43:42.471192+0000","last_peered":"2024-09-10T07:43:42.471192+0000","last_clean":"2024-09-10T07:43:42.471192+0000","last_became_active":"2024-09-10T07:43:41.446684+0000","last_became_peered":"2024-09-10T07:43:41.446684+0000","last_unstale":"2024-09-10T07:43:42.471192+0000","last_undegraded":"2024-09-10T07:43:42.471192+0000","last_fullsized":"2024-09-10T07:43:42.471192+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:47.581968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.466407+0000","last_change":"2024-09-10T07:43:42.464713+0000","last_active":"2024-09-10T07:43:42.466407+0000","last_peered":"2024-09-10T07:43:42.466407+0000","last_clean":"2024-09-10T07:43:42.466407+0000","last_became_active":"2024-09-10T07:43:42.461084+0000","last_became_peered":"2024-09-10T07:43:42.461084+0000","last_unstale":"2024-09-10T07:43:42.466407+0000","last_undegraded":"2024-09-10T07:43:42.466407+0000","last_fullsized":"2024-09-10T07:43:42.466407+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:49.692969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.467827+0000","last_change":"2024-09-10T07:43:41.448976+0000","last_active":"2024-09-10T07:43:42.467827+0000","last_peered":"2024-09-10T07:43:42.467827+0000","last_clean":"2024-09-10T07:43:42.467827+0000","last_became_active":"2024-09-10T07:43:41.448704+0000","last_became_peered":"2024-09-10T07:43:41.448704+0000","last_unstale":"2024-09-10T07:43:42.467827+0000","last_undegraded":"2024-09-10T07:43:42.467827+0000","last_fullsized":"2024-09-10T07:43:42.467827+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:09.608528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441054+0000","last_change":"2024-09-10T07:43:42.447206+0000","last_active":"2024-09-10T07:43:43.441054+0000","last_peered":"2024-09-10T07:43:43.441054+0000","last_clean":"2024-09-10T07:43:43.441054+0000","last_became_active":"2024-09-10T07:43:42.446946+0000","last_became_peered":"2024-09-10T07:43:42.446946+0000","last_unstale":"2024-09-10T07:43:43.441054+0000","last_undegraded":"2024-09-10T07:43:43.441054+0000","last_fullsized":"2024-09-10T07:43:43.441054+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:50.048199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.453829+0000","last_change":"2024-09-10T07:43:41.449707+0000","last_active":"2024-09-10T07:43:42.453829+0000","last_peered":"2024-09-10T07:43:42.453829+0000","last_clean":"2024-09-10T07:43:42.453829+0000","last_became_active":"2024-09-10T07:43:41.449450+0000","last_became_peered":"2024-09-10T07:43:41.449450+0000","last_unstale":"2024-09-10T07:43:42.453829+0000","last_undegraded":"2024-09-10T07:43:42.453829+0000","last_fullsized":"2024-09-10T07:43:42.453829+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:25.215518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441831+0000","last_change":"2024-09-10T07:43:42.459547+0000","last_active":"2024-09-10T07:43:43.441831+0000","last_peered":"2024-09-10T07:43:43.441831+0000","last_clean":"2024-09-10T07:43:43.441831+0000","last_became_active":"2024-09-10T07:43:42.458602+0000","last_became_peered":"2024-09-10T07:43:42.458602+0000","last_unstale":"2024-09-10T07:43:43.441831+0000","last_undegraded":"2024-09-10T07:43:43.441831+0000","last_fullsized":"2024-09-10T07:43:43.441831+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:35.317335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.444987+0000","last_change":"2024-09-10T07:43:41.451620+0000","last_active":"2024-09-10T07:43:42.444987+0000","last_peered":"2024-09-10T07:43:42.444987+0000","last_clean":"2024-09-10T07:43:42.444987+0000","last_became_active":"2024-09-10T07:43:41.451404+0000","last_became_peered":"2024-09-10T07:43:41.451404+0000","last_unstale":"2024-09-10T07:43:42.444987+0000","last_undegraded":"2024-09-10T07:43:42.444987+0000","last_fullsized":"2024-09-10T07:43:42.444987+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:57.080238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.455899+0000","last_change":"2024-09-10T07:43:42.455098+0000","last_active":"2024-09-10T07:43:42.455899+0000","last_peered":"2024-09-10T07:43:42.455899+0000","last_clean":"2024-09-10T07:43:42.455899+0000","last_became_active":"2024-09-10T07:43:42.454887+0000","last_became_peered":"2024-09-10T07:43:42.454887+0000","last_unstale":"2024-09-10T07:43:42.455899+0000","last_undegraded":"2024-09-10T07:43:42.455899+0000","last_fullsized":"2024-09-10T07:43:42.455899+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:45.186617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"170'8","reported_seq":20,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.469236+0000","last_change":"2024-09-10T07:43:41.448603+0000","last_active":"2024-09-10T07:43:42.469236+0000","last_peered":"2024-09-10T07:43:42.469236+0000","last_clean":"2024-09-10T07:43:42.469236+0000","last_became_active":"2024-09-10T07:43:41.448371+0000","last_became_peered":"2024-09-10T07:43:41.448371+0000","last_unstale":"2024-09-10T07:43:42.469236+0000","last_undegraded":"2024-09-10T07:43:42.469236+0000","last_fullsized":"2024-09-10T07:43:42.469236+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:25.827236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.467141+0000","last_change":"2024-09-10T07:43:42.467008+0000","last_active":"2024-09-10T07:43:42.467141+0000","last_peered":"2024-09-10T07:43:42.467141+0000","last_clean":"2024-09-10T07:43:42.467141+0000","last_became_active":"2024-09-10T07:43:42.458517+0000","last_became_peered":"2024-09-10T07:43:42.458517+0000","last_unstale":"2024-09-10T07:43:42.467141+0000","last_undegraded":"2024-09-10T07:43:42.467141+0000","last_fullsized":"2024-09-10T07:43:42.467141+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:44.942455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442127+0000","last_change":"2024-09-10T07:43:41.451501+0000","last_active":"2024-09-10T07:43:43.442127+0000","last_peered":"2024-09-10T07:43:43.442127+0000","last_clean":"2024-09-10T07:43:43.442127+0000","last_became_active":"2024-09-10T07:43:41.450849+0000","last_became_peered":"2024-09-10T07:43:41.450849+0000","last_unstale":"2024-09-10T07:43:43.442127+0000","last_undegraded":"2024-09-10T07:43:43.442127+0000","last_fullsized":"2024-09-10T07:43:43.442127+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:29.913262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.455833+0000","last_change":"2024-09-10T07:43:42.455724+0000","last_active":"2024-09-10T07:43:42.455833+0000","last_peered":"2024-09-10T07:43:42.455833+0000","last_clean":"2024-09-10T07:43:42.455833+0000","last_became_active":"2024-09-10T07:43:42.455301+0000","last_became_peered":"2024-09-10T07:43:42.455301+0000","last_unstale":"2024-09-10T07:43:42.455833+0000","last_undegraded":"2024-09-10T07:43:42.455833+0000","last_fullsized":"2024-09-10T07:43:42.455833+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:47.225302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441417+0000","last_change":"2024-09-10T07:43:41.447707+0000","last_active":"2024-09-10T07:43:43.441417+0000","last_peered":"2024-09-10T07:43:43.441417+0000","last_clean":"2024-09-10T07:43:43.441417+0000","last_became_active":"2024-09-10T07:43:41.447192+0000","last_became_peered":"2024-09-10T07:43:41.447192+0000","last_unstale":"2024-09-10T07:43:43.441417+0000","last_undegraded":"2024-09-10T07:43:43.441417+0000","last_fullsized":"2024-09-10T07:43:43.441417+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:38:14.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.461778+0000","last_change":"2024-09-10T07:43:42.458309+0000","last_active":"2024-09-10T07:43:42.461778+0000","last_peered":"2024-09-10T07:43:42.461778+0000","last_clean":"2024-09-10T07:43:42.461778+0000","last_became_active":"2024-09-10T07:43:42.457853+0000","last_became_peered":"2024-09-10T07:43:42.457853+0000","last_unstale":"2024-09-10T07:43:42.461778+0000","last_undegraded":"2024-09-10T07:43:42.461778+0000","last_fullsized":"2024-09-10T07:43:42.461778+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:54.379580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.469774+0000","last_change":"2024-09-10T07:43:41.449333+0000","last_active":"2024-09-10T07:43:42.469774+0000","last_peered":"2024-09-10T07:43:42.469774+0000","last_clean":"2024-09-10T07:43:42.469774+0000","last_became_active":"2024-09-10T07:43:41.448665+0000","last_became_peered":"2024-09-10T07:43:41.448665+0000","last_unstale":"2024-09-10T07:43:42.469774+0000","last_undegraded":"2024-09-10T07:43:42.469774+0000","last_fullsized":"2024-09-10T07:43:42.469774+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:24.150949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.458300+0000","last_change":"2024-09-10T07:43:42.457955+0000","last_active":"2024-09-10T07:43:42.458300+0000","last_peered":"2024-09-10T07:43:42.458300+0000","last_clean":"2024-09-10T07:43:42.458300+0000","last_became_active":"2024-09-10T07:43:42.457363+0000","last_became_peered":"2024-09-10T07:43:42.457363+0000","last_unstale":"2024-09-10T07:43:42.458300+0000","last_undegraded":"2024-09-10T07:43:42.458300+0000","last_fullsized":"2024-09-10T07:43:42.458300+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:57.954238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.440971+0000","last_change":"2024-09-10T07:43:41.450222+0000","last_active":"2024-09-10T07:43:43.440971+0000","last_peered":"2024-09-10T07:43:43.440971+0000","last_clean":"2024-09-10T07:43:43.440971+0000","last_became_active":"2024-09-10T07:43:41.447182+0000","last_became_peered":"2024-09-10T07:43:41.447182+0000","last_unstale":"2024-09-10T07:43:43.440971+0000","last_undegraded":"2024-09-10T07:43:43.440971+0000","last_fullsized":"2024-09-10T07:43:43.440971+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:13.686759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442080+0000","last_change":"2024-09-10T07:43:42.463813+0000","last_active":"2024-09-10T07:43:43.442080+0000","last_peered":"2024-09-10T07:43:43.442080+0000","last_clean":"2024-09-10T07:43:43.442080+0000","last_became_active":"2024-09-10T07:43:42.459605+0000","last_became_peered":"2024-09-10T07:43:42.459605+0000","last_unstale":"2024-09-10T07:43:43.442080+0000","last_undegraded":"2024-09-10T07:43:43.442080+0000","last_fullsized":"2024-09-10T07:43:43.442080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:30.324850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.457293+0000","last_change":"2024-09-10T07:43:41.453068+0000","last_active":"2024-09-10T07:43:42.457293+0000","last_peered":"2024-09-10T07:43:42.457293+0000","last_clean":"2024-09-10T07:43:42.457293+0000","last_became_active":"2024-09-10T07:43:41.452690+0000","last_became_peered":"2024-09-10T07:43:41.452690+0000","last_unstale":"2024-09-10T07:43:42.457293+0000","last_undegraded":"2024-09-10T07:43:42.457293+0000","last_fullsized":"2024-09-10T07:43:42.457293+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:47.501883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.455740+0000","last_change":"2024-09-10T07:43:42.455469+0000","last_active":"2024-09-10T07:43:42.455740+0000","last_peered":"2024-09-10T07:43:42.455740+0000","last_clean":"2024-09-10T07:43:42.455740+0000","last_became_active":"2024-09-10T07:43:42.454703+0000","last_became_peered":"2024-09-10T07:43:42.454703+0000","last_unstale":"2024-09-10T07:43:42.455740+0000","last_undegraded":"2024-09-10T07:43:42.455740+0000","last_fullsized":"2024-09-10T07:43:42.455740+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:52.190547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.453748+0000","last_change":"2024-09-10T07:43:41.455352+0000","last_active":"2024-09-10T07:43:42.453748+0000","last_peered":"2024-09-10T07:43:42.453748+0000","last_clean":"2024-09-10T07:43:42.453748+0000","last_became_active":"2024-09-10T07:43:41.453946+0000","last_became_peered":"2024-09-10T07:43:41.453946+0000","last_unstale":"2024-09-10T07:43:42.453748+0000","last_undegraded":"2024-09-10T07:43:42.453748+0000","last_fullsized":"2024-09-10T07:43:42.453748+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:29.813184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442878+0000","last_change":"2024-09-10T07:43:42.463237+0000","last_active":"2024-09-10T07:43:43.442878+0000","last_peered":"2024-09-10T07:43:43.442878+0000","last_clean":"2024-09-10T07:43:43.442878+0000","last_became_active":"2024-09-10T07:43:42.461394+0000","last_became_peered":"2024-09-10T07:43:42.461394+0000","last_unstale":"2024-09-10T07:43:43.442878+0000","last_undegraded":"2024-09-10T07:43:43.442878+0000","last_fullsized":"2024-09-10T07:43:43.442878+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:31.577093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.458109+0000","last_change":"2024-09-10T07:43:41.453406+0000","last_active":"2024-09-10T07:43:42.458109+0000","last_peered":"2024-09-10T07:43:42.458109+0000","last_clean":"2024-09-10T07:43:42.458109+0000","last_became_active":"2024-09-10T07:43:41.452976+0000","last_became_peered":"2024-09-10T07:43:41.452976+0000","last_unstale":"2024-09-10T07:43:42.458109+0000","last_undegraded":"2024-09-10T07:43:42.458109+0000","last_fullsized":"2024-09-10T07:43:42.458109+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:45.488054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.455438+0000","last_change":"2024-09-10T07:43:42.454936+0000","last_active":"2024-09-10T07:43:42.455438+0000","last_peered":"2024-09-10T07:43:42.455438+0000","last_clean":"2024-09-10T07:43:42.455438+0000","last_became_active":"2024-09-10T07:43:42.454666+0000","last_became_peered":"2024-09-10T07:43:42.454666+0000","last_unstale":"2024-09-10T07:43:42.455438+0000","last_undegraded":"2024-09-10T07:43:42.455438+0000","last_fullsized":"2024-09-10T07:43:42.455438+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:31.824260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.454837+0000","last_change":"2024-09-10T07:43:41.454874+0000","last_active":"2024-09-10T07:43:42.454837+0000","last_peered":"2024-09-10T07:43:42.454837+0000","last_clean":"2024-09-10T07:43:42.454837+0000","last_became_active":"2024-09-10T07:43:41.454618+0000","last_became_peered":"2024-09-10T07:43:41.454618+0000","last_unstale":"2024-09-10T07:43:42.454837+0000","last_undegraded":"2024-09-10T07:43:42.454837+0000","last_fullsized":"2024-09-10T07:43:42.454837+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:49.949474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442068+0000","last_change":"2024-09-10T07:43:42.459935+0000","last_active":"2024-09-10T07:43:43.442068+0000","last_peered":"2024-09-10T07:43:43.442068+0000","last_clean":"2024-09-10T07:43:43.442068+0000","last_became_active":"2024-09-10T07:43:42.459239+0000","last_became_peered":"2024-09-10T07:43:42.459239+0000","last_unstale":"2024-09-10T07:43:43.442068+0000","last_undegraded":"2024-09-10T07:43:43.442068+0000","last_fullsized":"2024-09-10T07:43:43.442068+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:09.458072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.470081+0000","last_change":"2024-09-10T07:43:41.454195+0000","last_active":"2024-09-10T07:43:42.470081+0000","last_peered":"2024-09-10T07:43:42.470081+0000","last_clean":"2024-09-10T07:43:42.470081+0000","last_became_active":"2024-09-10T07:43:41.453929+0000","last_became_peered":"2024-09-10T07:43:41.453929+0000","last_unstale":"2024-09-10T07:43:42.470081+0000","last_undegraded":"2024-09-10T07:43:42.470081+0000","last_fullsized":"2024-09-10T07:43:42.470081+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:00.261974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.461755+0000","last_change":"2024-09-10T07:43:42.458103+0000","last_active":"2024-09-10T07:43:42.461755+0000","last_peered":"2024-09-10T07:43:42.461755+0000","last_clean":"2024-09-10T07:43:42.461755+0000","last_became_active":"2024-09-10T07:43:42.457537+0000","last_became_peered":"2024-09-10T07:43:42.457537+0000","last_unstale":"2024-09-10T07:43:42.461755+0000","last_undegraded":"2024-09-10T07:43:42.461755+0000","last_fullsized":"2024-09-10T07:43:42.461755+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:09.098369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.444497+0000","last_change":"2024-09-10T07:43:41.453373+0000","last_active":"2024-09-10T07:43:42.444497+0000","last_peered":"2024-09-10T07:43:42.444497+0000","last_clean":"2024-09-10T07:43:42.444497+0000","last_became_active":"2024-09-10T07:43:41.452998+0000","last_became_peered":"2024-09-10T07:43:41.452998+0000","last_unstale":"2024-09-10T07:43:42.444497+0000","last_undegraded":"2024-09-10T07:43:42.444497+0000","last_fullsized":"2024-09-10T07:43:42.444497+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:51.351769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441200+0000","last_change":"2024-09-10T07:43:42.457913+0000","last_active":"2024-09-10T07:43:43.441200+0000","last_peered":"2024-09-10T07:43:43.441200+0000","last_clean":"2024-09-10T07:43:43.441200+0000","last_became_active":"2024-09-10T07:43:42.457685+0000","last_became_peered":"2024-09-10T07:43:42.457685+0000","last_unstale":"2024-09-10T07:43:43.441200+0000","last_undegraded":"2024-09-10T07:43:43.441200+0000","last_fullsized":"2024-09-10T07:43:43.441200+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:23.113553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.445571+0000","last_change":"2024-09-10T07:43:41.452681+0000","last_active":"2024-09-10T07:43:42.445571+0000","last_peered":"2024-09-10T07:43:42.445571+0000","last_clean":"2024-09-10T07:43:42.445571+0000","last_became_active":"2024-09-10T07:43:41.452411+0000","last_became_peered":"2024-09-10T07:43:41.452411+0000","last_unstale":"2024-09-10T07:43:42.445571+0000","last_undegraded":"2024-09-10T07:43:42.445571+0000","last_fullsized":"2024-09-10T07:43:42.445571+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:59.370027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.464762+0000","last_change":"2024-09-10T07:43:42.464644+0000","last_active":"2024-09-10T07:43:42.464762+0000","last_peered":"2024-09-10T07:43:42.464762+0000","last_clean":"2024-09-10T07:43:42.464762+0000","last_became_active":"2024-09-10T07:43:42.464386+0000","last_became_peered":"2024-09-10T07:43:42.464386+0000","last_unstale":"2024-09-10T07:43:42.464762+0000","last_undegraded":"2024-09-10T07:43:42.464762+0000","last_fullsized":"2024-09-10T07:43:42.464762+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:16.896579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.445192+0000","last_change":"2024-09-10T07:43:41.449828+0000","last_active":"2024-09-10T07:43:42.445192+0000","last_peered":"2024-09-10T07:43:42.445192+0000","last_clean":"2024-09-10T07:43:42.445192+0000","last_became_active":"2024-09-10T07:43:41.449567+0000","last_became_peered":"2024-09-10T07:43:41.449567+0000","last_unstale":"2024-09-10T07:43:42.445192+0000","last_undegraded":"2024-09-10T07:43:42.445192+0000","last_fullsized":"2024-09-10T07:43:42.445192+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:30.223639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.456530+0000","last_change":"2024-09-10T07:43:42.456422+0000","last_active":"2024-09-10T07:43:42.456530+0000","last_peered":"2024-09-10T07:43:42.456530+0000","last_clean":"2024-09-10T07:43:42.456530+0000","last_became_active":"2024-09-10T07:43:42.456207+0000","last_became_peered":"2024-09-10T07:43:42.456207+0000","last_unstale":"2024-09-10T07:43:42.456530+0000","last_undegraded":"2024-09-10T07:43:42.456530+0000","last_fullsized":"2024-09-10T07:43:42.456530+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:49.060893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.442507+0000","last_change":"2024-09-10T07:43:41.447602+0000","last_active":"2024-09-10T07:43:42.442507+0000","last_peered":"2024-09-10T07:43:42.442507+0000","last_clean":"2024-09-10T07:43:42.442507+0000","last_became_active":"2024-09-10T07:43:41.447363+0000","last_became_peered":"2024-09-10T07:43:41.447363+0000","last_unstale":"2024-09-10T07:43:42.442507+0000","last_undegraded":"2024-09-10T07:43:42.442507+0000","last_fullsized":"2024-09-10T07:43:42.442507+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:37.018736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441671+0000","last_change":"2024-09-10T07:43:42.458476+0000","last_active":"2024-09-10T07:43:43.441671+0000","last_peered":"2024-09-10T07:43:43.441671+0000","last_clean":"2024-09-10T07:43:43.441671+0000","last_became_active":"2024-09-10T07:43:42.457104+0000","last_became_peered":"2024-09-10T07:43:42.457104+0000","last_unstale":"2024-09-10T07:43:43.441671+0000","last_undegraded":"2024-09-10T07:43:43.441671+0000","last_fullsized":"2024-09-10T07:43:43.441671+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:51.761652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.455019+0000","last_change":"2024-09-10T07:43:41.455706+0000","last_active":"2024-09-10T07:43:42.455019+0000","last_peered":"2024-09-10T07:43:42.455019+0000","last_clean":"2024-09-10T07:43:42.455019+0000","last_became_active":"2024-09-10T07:43:41.455375+0000","last_became_peered":"2024-09-10T07:43:41.455375+0000","last_unstale":"2024-09-10T07:43:42.455019+0000","last_undegraded":"2024-09-10T07:43:42.455019+0000","last_fullsized":"2024-09-10T07:43:42.455019+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:52.847927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.468014+0000","last_change":"2024-09-10T07:43:42.467194+0000","last_active":"2024-09-10T07:43:42.468014+0000","last_peered":"2024-09-10T07:43:42.468014+0000","last_clean":"2024-09-10T07:43:42.468014+0000","last_became_active":"2024-09-10T07:43:42.460613+0000","last_became_peered":"2024-09-10T07:43:42.460613+0000","last_unstale":"2024-09-10T07:43:42.468014+0000","last_undegraded":"2024-09-10T07:43:42.468014+0000","last_fullsized":"2024-09-10T07:43:42.468014+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:12.869681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.451823+0000","last_change":"2024-09-10T07:43:41.450768+0000","last_active":"2024-09-10T07:43:42.451823+0000","last_peered":"2024-09-10T07:43:42.451823+0000","last_clean":"2024-09-10T07:43:42.451823+0000","last_became_active":"2024-09-10T07:43:41.450250+0000","last_became_peered":"2024-09-10T07:43:41.450250+0000","last_unstale":"2024-09-10T07:43:42.451823+0000","last_undegraded":"2024-09-10T07:43:42.451823+0000","last_fullsized":"2024-09-10T07:43:42.451823+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:42.494118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.442222+0000","last_change":"2024-09-10T07:43:42.448627+0000","last_active":"2024-09-10T07:43:43.442222+0000","last_peered":"2024-09-10T07:43:43.442222+0000","last_clean":"2024-09-10T07:43:43.442222+0000","last_became_active":"2024-09-10T07:43:42.447920+0000","last_became_peered":"2024-09-10T07:43:42.447920+0000","last_unstale":"2024-09-10T07:43:43.442222+0000","last_undegraded":"2024-09-10T07:43:43.442222+0000","last_fullsized":"2024-09-10T07:43:43.442222+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:55.388274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T07:43:43.441014+0000","last_change":"2024-09-10T07:43:41.452485+0000","last_active":"2024-09-10T07:43:43.441014+0000","last_peered":"2024-09-10T07:43:43.441014+0000","last_clean":"2024-09-10T07:43:43.441014+0000","last_became_active":"2024-09-10T07:43:41.451513+0000","last_became_peered":"2024-09-10T07:43:41.451513+0000","last_unstale":"2024-09-10T07:43:43.441014+0000","last_undegraded":"2024-09-10T07:43:43.441014+0000","last_fullsized":"2024-09-10T07:43:43.441014+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:26.046862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.464331+0000","last_change":"2024-09-10T07:43:42.464157+0000","last_active":"2024-09-10T07:43:42.464331+0000","last_peered":"2024-09-10T07:43:42.464331+0000","last_clean":"2024-09-10T07:43:42.464331+0000","last_became_active":"2024-09-10T07:43:42.463836+0000","last_became_peered":"2024-09-10T07:43:42.463836+0000","last_unstale":"2024-09-10T07:43:42.464331+0000","last_undegraded":"2024-09-10T07:43:42.464331+0000","last_fullsized":"2024-09-10T07:43:42.464331+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:41.429213+0000","last_clean_scrub_stamp":"2024-09-10T07:43:41.429213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:07.734980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"170'3","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.472075+0000","last_change":"2024-09-10T07:43:41.455995+0000","last_active":"2024-09-10T07:43:42.472075+0000","last_peered":"2024-09-10T07:43:42.472075+0000","last_clean":"2024-09-10T07:43:42.472075+0000","last_became_active":"2024-09-10T07:43:41.455592+0000","last_became_peered":"2024-09-10T07:43:41.455592+0000","last_unstale":"2024-09-10T07:43:42.472075+0000","last_undegraded":"2024-09-10T07:43:42.472075+0000","last_fullsized":"2024-09-10T07:43:42.472075+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:43:40.426068+0000","last_clean_scrub_stamp":"2024-09-10T07:43:40.426068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:54.664184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":464,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T07:43:42.453808+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:43:42.453808+0000","last_peered":"2024-09-10T07:43:42.453808+0000","last_clean":"2024-09-10T07:43:42.453808+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:43:42.453808+0000","last_undegraded":"2024-09-10T07:43:42.453808+0000","last_fullsized":"2024-09-10T07:43:42.453808+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193803,"statfs":{"total":200000000,"available":198454875,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045749,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045873,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045895,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045805,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":933,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194379,"statfs":{"total":200000000,"available":199044213,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":932,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045313,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1509,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193802,"statfs":{"total":200000000,"available":198453881,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:43:47.021 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:43:47.021 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T07:43:47.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.217+0000 7f7af3200640 1 Processor -- start 2024-09-10T07:43:47.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.217+0000 7f7af3200640 1 -- start start 2024-09-10T07:43:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7af3200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aec15b760 0x7f7aec0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7af3200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7aec0d0630 0x7f7aec0d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7af3200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aec0b4300 con 0x7f7aec0b4a90 2024-09-10T07:43:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7af3200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7aec0d0fc0 con 0x7f7aec0d0630 2024-09-10T07:43:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7af3200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7aec06d700 con 0x7f7aec15b760 2024-09-10T07:43:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7ae3400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7aec0b4a90 0x7f7aec06f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39650/0 (socket says 172.21.15.99:39650) 2024-09-10T07:43:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7ae3400640 1 -- 172.21.15.99:0/1874537372 learned_addr learned my addr 172.21.15.99:0/1874537372 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7af1200640 1 --2- 172.21.15.99:0/1874537372 >> v2:172.21.15.187:3300/0 conn(0x7f7aec0d0630 0x7f7aec0d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7aebe00640 1 --2- 172.21.15.99:0/1874537372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aec15b760 0x7f7aec0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7aeb400640 1 -- 172.21.15.99:0/1874537372 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010406173 0 0) 0x7f7aec0b4300 con 0x7f7aec0b4a90 2024-09-10T07:43:47.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.219+0000 7f7aeb400640 1 -- 172.21.15.99:0/1874537372 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ad0003520 con 0x7f7aec0b4a90 2024-09-10T07:43:47.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.220+0000 7f7af1200640 1 -- 172.21.15.99:0/1874537372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aec15b760 msgr2=0x7f7aec0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:47.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.220+0000 7f7af1200640 1 --2- 172.21.15.99:0/1874537372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aec15b760 0x7f7aec0afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.220+0000 7f7af1200640 1 -- 172.21.15.99:0/1874537372 >> v1:172.21.15.99:6789/0 conn(0x7f7aec0b4a90 legacy=0x7f7aec06f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.220+0000 7f7af1200640 1 -- 172.21.15.99:0/1874537372 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec06d9e0 con 0x7f7aec0d0630 2024-09-10T07:43:47.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.221+0000 7f7af1200640 1 --2- 172.21.15.99:0/1874537372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aec0d0630 0x7f7aec0d0a80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009d90 tx=0x7f7ae402a540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cbdcd7f0f071b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:47.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.221+0000 7f7aeb400640 1 -- 172.21.15.99:0/1874537372 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4007740 con 0x7f7aec0d0630 2024-09-10T07:43:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.221+0000 7f7aeb400640 1 -- 172.21.15.99:0/1874537372 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae40078e0 con 0x7f7aec0d0630 2024-09-10T07:43:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.221+0000 7f7aeb400640 1 -- 172.21.15.99:0/1874537372 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4007c90 con 0x7f7aec0d0630 2024-09-10T07:43:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.222+0000 7f7af3200640 1 -- 172.21.15.99:0/1874537372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aec0d0630 msgr2=0x7f7aec0d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.222+0000 7f7af3200640 1 --2- 172.21.15.99:0/1874537372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aec0d0630 0x7f7aec0d0a80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009d90 tx=0x7f7ae402a540 comp rx=0 tx=0).stop 2024-09-10T07:43:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.222+0000 7f7af3200640 1 -- 172.21.15.99:0/1874537372 shutdown_connections 2024-09-10T07:43:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.222+0000 7f7af3200640 1 --2- 172.21.15.99:0/1874537372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aec0d0630 0x7f7aec0d0a80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.222+0000 7f7af3200640 1 --2- 172.21.15.99:0/1874537372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aec15b760 0x7f7aec0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.222+0000 7f7af3200640 1 -- 172.21.15.99:0/1874537372 >> 172.21.15.99:0/1874537372 conn(0x7f7aec06bc10 msgr2=0x7f7aec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.222+0000 7f7af3200640 1 -- 172.21.15.99:0/1874537372 shutdown_connections 2024-09-10T07:43:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.222+0000 7f7af3200640 1 -- 172.21.15.99:0/1874537372 wait complete. 2024-09-10T07:43:47.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.223+0000 7f7af3200640 1 Processor -- start 2024-09-10T07:43:47.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.224+0000 7f7af3200640 1 -- start start 2024-09-10T07:43:47.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.224+0000 7f7af3200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7aec0b4a90 0x7f7aec15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.224+0000 7f7af3200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aec0d0630 0x7f7aec0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.224+0000 7f7af3200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aec15b760 0x7f7aec0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.224+0000 7f7af3200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec0b5070 con 0x7f7aec0b4a90 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.224+0000 7f7af3200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec0b4ef0 con 0x7f7aec0d0630 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.224+0000 7f7af3200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7aec15bb40 con 0x7f7aec15b760 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7aec0b4a90 0x7f7aec15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7aec0b4a90 0x7f7aec15c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52878/0 (socket says 172.21.15.99:52878) 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7aebe00640 1 -- 172.21.15.99:0/1342246678 learned_addr learned my addr 172.21.15.99:0/1342246678 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7af1200640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aec15b760 0x7f7aec0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7ae3400640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aec0d0630 0x7f7aec0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7aebe00640 1 -- 172.21.15.99:0/1342246678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aec15b760 msgr2=0x7f7aec0cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7aebe00640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aec15b760 0x7f7aec0cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7aebe00640 1 -- 172.21.15.99:0/1342246678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aec0d0630 msgr2=0x7f7aec0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7aebe00640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aec0d0630 0x7f7aec0cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7aebe00640 1 -- 172.21.15.99:0/1342246678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec1f5e90 con 0x7f7aec0b4a90 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7aebe00640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7aec0b4a90 0x7f7aec15c470 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00e8a0 tx=0x7f7adc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:47.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7ae8c00640 1 -- 172.21.15.99:0/1342246678 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc017070 con 0x7f7aec0b4a90 2024-09-10T07:43:47.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7ae8c00640 1 -- 172.21.15.99:0/1342246678 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7adc00c940 con 0x7f7aec0b4a90 2024-09-10T07:43:47.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.225+0000 7f7af3200640 1 -- 172.21.15.99:0/1342246678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec1f6170 con 0x7f7aec0b4a90 2024-09-10T07:43:47.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.226+0000 7f7ae8c00640 1 -- 172.21.15.99:0/1342246678 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc00cd30 con 0x7f7aec0b4a90 2024-09-10T07:43:47.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.226+0000 7f7af3200640 1 -- 172.21.15.99:0/1342246678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec1f6730 con 0x7f7aec0b4a90 2024-09-10T07:43:47.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.227+0000 7f7af3200640 1 -- 172.21.15.99:0/1342246678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aec06dcc0 con 0x7f7aec0b4a90 2024-09-10T07:43:47.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.227+0000 7f7ae8c00640 1 -- 172.21.15.99:0/1342246678 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7adc01a070 con 0x7f7aec0b4a90 2024-09-10T07:43:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.228+0000 7f7ae8c00640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 0x7f7ac806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.228+0000 7f7ae8c00640 1 -- 172.21.15.99:0/1342246678 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f7adc08b150 con 0x7f7aec0b4a90 2024-09-10T07:43:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.229+0000 7f7ae3400640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 0x7f7ac806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.229+0000 7f7ae3400640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 0x7f7ac806e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0b1bf0 tx=0x7f7ad4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:47.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.233+0000 7f7ae8c00640 1 -- 172.21.15.99:0/1342246678 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7adc059a60 con 0x7f7aec0b4a90 2024-09-10T07:43:47.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.467+0000 7f7af3200640 1 -- 172.21.15.99:0/1342246678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f7aec0d0ba0 con 0x7f7aec0b4a90 2024-09-10T07:43:47.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.471+0000 7f7ae8c00640 1 -- 172.21.15.99:0/1342246678 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f7adc059360 con 0x7f7aec0b4a90 2024-09-10T07:43:47.471 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:43:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:43:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-09-10T07:43:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-09-10T07:43:47.471 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T07:43:47.471 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-09-10T07:43:47.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 -- 172.21.15.99:0/1342246678 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 msgr2=0x7f7ac806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 0x7f7ac806e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0b1bf0 tx=0x7f7ad4009040 comp rx=0 tx=0).stop 2024-09-10T07:43:47.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 -- 172.21.15.99:0/1342246678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7aec0b4a90 msgr2=0x7f7aec15c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7aec0b4a90 0x7f7aec15c470 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00e8a0 tx=0x7f7adc00ed60 comp rx=0 tx=0).stop 2024-09-10T07:43:47.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 -- 172.21.15.99:0/1342246678 shutdown_connections 2024-09-10T07:43:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aec15b760 0x7f7aec0cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aec0d0630 0x7f7aec0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7ac806be30 0x7f7ac806e2f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 --2- 172.21.15.99:0/1342246678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7aec0b4a90 0x7f7aec15c470 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 -- 172.21.15.99:0/1342246678 >> 172.21.15.99:0/1342246678 conn(0x7f7aec06bc10 msgr2=0x7f7aec159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 -- 172.21.15.99:0/1342246678 shutdown_connections 2024-09-10T07:43:47.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.474+0000 7f7af3200640 1 -- 172.21.15.99:0/1342246678 wait complete. 2024-09-10T07:43:47.492 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:43:47.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.645+0000 7f4563800640 1 Processor -- start 2024-09-10T07:43:47.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.645+0000 7f4563800640 1 -- start start 2024-09-10T07:43:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.647+0000 7f4563800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f455c142150 0x7f455c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.647+0000 7f4563800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455c142650 con 0x7f455c160a80 2024-09-10T07:43:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.647+0000 7f4563800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455c142930 con 0x7f455c13fae0 2024-09-10T07:43:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.647+0000 7f4563800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f455c0ce780 con 0x7f455c142150 2024-09-10T07:43:47.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.647+0000 7f4561800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f455c160a80 0x7f455c0cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39660/0 (socket says 172.21.15.99:39660) 2024-09-10T07:43:47.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.647+0000 7f4561800640 1 -- 172.21.15.99:0/375720493 learned_addr learned my addr 172.21.15.99:0/375720493 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:47.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.647+0000 7f4553e00640 1 --2- 172.21.15.99:0/375720493 >> v2:172.21.15.187:3300/0 conn(0x7f455c142150 0x7f455c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.647+0000 7f455be00640 1 -- 172.21.15.99:0/375720493 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387601325 0 0) 0x7f455c142650 con 0x7f455c160a80 2024-09-10T07:43:47.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.647+0000 7f455be00640 1 -- 172.21.15.99:0/375720493 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4540003520 con 0x7f455c160a80 2024-09-10T07:43:47.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.648+0000 7f4553e00640 1 -- 172.21.15.99:0/375720493 >> v1:172.21.15.187:6789/0 conn(0x7f455c13fae0 legacy=0x7f455c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.648+0000 7f4553e00640 1 -- 172.21.15.99:0/375720493 >> v1:172.21.15.99:6789/0 conn(0x7f455c160a80 legacy=0x7f455c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.648+0000 7f4553e00640 1 -- 172.21.15.99:0/375720493 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c142c10 con 0x7f455c142150 2024-09-10T07:43:47.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.649+0000 7f4553e00640 1 --2- 172.21.15.99:0/375720493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f455c142150 0x7f455c160540 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f45440097a0 tx=0x7f454402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf9313baa39f36c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:47.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.649+0000 7f455be00640 1 -- 172.21.15.99:0/375720493 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4544037070 con 0x7f455c142150 2024-09-10T07:43:47.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.649+0000 7f455be00640 1 -- 172.21.15.99:0/375720493 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4544032440 con 0x7f455c142150 2024-09-10T07:43:47.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.649+0000 7f455be00640 1 -- 172.21.15.99:0/375720493 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45440327f0 con 0x7f455c142150 2024-09-10T07:43:47.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.650+0000 7f4563800640 1 -- 172.21.15.99:0/375720493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f455c142150 msgr2=0x7f455c160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.650+0000 7f4563800640 1 --2- 172.21.15.99:0/375720493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f455c142150 0x7f455c160540 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f45440097a0 tx=0x7f454402a1a0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.650+0000 7f4563800640 1 -- 172.21.15.99:0/375720493 shutdown_connections 2024-09-10T07:43:47.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.650+0000 7f4563800640 1 --2- 172.21.15.99:0/375720493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f455c142150 0x7f455c160540 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.650+0000 7f4563800640 1 -- 172.21.15.99:0/375720493 >> 172.21.15.99:0/375720493 conn(0x7f455c06bc10 msgr2=0x7f455c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:47.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.650+0000 7f4563800640 1 -- 172.21.15.99:0/375720493 shutdown_connections 2024-09-10T07:43:47.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.650+0000 7f4563800640 1 -- 172.21.15.99:0/375720493 wait complete. 2024-09-10T07:43:47.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.651+0000 7f4563800640 1 Processor -- start 2024-09-10T07:43:47.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.651+0000 7f4563800640 1 -- start start 2024-09-10T07:43:47.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.652+0000 7f4563800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455c13fae0 0x7f455c13d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.652+0000 7f4563800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f455c142150 0x7f455c15e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.652+0000 7f4563800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f455c160a80 0x7f455c140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.652+0000 7f4563800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f455c0cf4a0 con 0x7f455c13fae0 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.652+0000 7f4563800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f455c0cf320 con 0x7f455c142150 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.652+0000 7f4563800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f455c0cf620 con 0x7f455c160a80 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4560e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455c13fae0 0x7f455c13d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4560e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455c13fae0 0x7f455c13d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52884/0 (socket says 172.21.15.99:52884) 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4560e00640 1 -- 172.21.15.99:0/1315309049 learned_addr learned my addr 172.21.15.99:0/1315309049 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4553e00640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f455c142150 0x7f455c15e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4561800640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f455c160a80 0x7f455c140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4560e00640 1 -- 172.21.15.99:0/1315309049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f455c160a80 msgr2=0x7f455c140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4560e00640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f455c160a80 0x7f455c140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4560e00640 1 -- 172.21.15.99:0/1315309049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f455c142150 msgr2=0x7f455c15e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4560e00640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f455c142150 0x7f455c15e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4560e00640 1 -- 172.21.15.99:0/1315309049 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c15f1d0 con 0x7f455c13fae0 2024-09-10T07:43:47.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4553e00640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f455c142150 0x7f455c15e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:47.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4561800640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f455c160a80 0x7f455c140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:47.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4560e00640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455c13fae0 0x7f455c13d030 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f454c00c430 tx=0x7f454c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:47.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.653+0000 7f4559600640 1 -- 172.21.15.99:0/1315309049 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c0052d0 con 0x7f455c13fae0 2024-09-10T07:43:47.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.654+0000 7f4559600640 1 -- 172.21.15.99:0/1315309049 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c005490 con 0x7f455c13fae0 2024-09-10T07:43:47.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.654+0000 7f4559600640 1 -- 172.21.15.99:0/1315309049 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c007260 con 0x7f455c13fae0 2024-09-10T07:43:47.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.654+0000 7f4563800640 1 -- 172.21.15.99:0/1315309049 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455c1f7e10 con 0x7f455c13fae0 2024-09-10T07:43:47.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.654+0000 7f4563800640 1 -- 172.21.15.99:0/1315309049 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455c1f83d0 con 0x7f455c13fae0 2024-09-10T07:43:47.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.655+0000 7f4563800640 1 -- 172.21.15.99:0/1315309049 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455c160540 con 0x7f455c13fae0 2024-09-10T07:43:47.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.655+0000 7f4559600640 1 -- 172.21.15.99:0/1315309049 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f454c007400 con 0x7f455c13fae0 2024-09-10T07:43:47.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.656+0000 7f4559600640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f453806be30 0x7f453806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:47.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.656+0000 7f4559600640 1 -- 172.21.15.99:0/1315309049 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f454c08a390 con 0x7f455c13fae0 2024-09-10T07:43:47.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.657+0000 7f4553e00640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f453806be30 0x7f453806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:47.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.657+0000 7f4553e00640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f453806be30 0x7f453806e2f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4544034000 tx=0x7f454402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:47.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.661+0000 7f4559600640 1 -- 172.21.15.99:0/1315309049 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f454c058d30 con 0x7f455c13fae0 2024-09-10T07:43:47.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.869+0000 7f4563800640 1 -- 172.21.15.99:0/1315309049 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f455c071b40 con 0x7f455c13fae0 2024-09-10T07:43:47.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.869+0000 7f4559600640 1 -- 172.21.15.99:0/1315309049 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5224 (secure 0 0 0) 0x7f454c058630 con 0x7f455c13fae0 2024-09-10T07:43:47.869 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:47.869 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"btime":"2024-09-10T07:43:45:462569+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/484957916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":484957916},{"type":"v1","addr":"172.21.15.99:6836","nonce":484957916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6967,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/837681918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":837681918},{"type":"v1","addr":"172.21.15.99:6837","nonce":837681918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3241210910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3241210910},{"type":"v1","addr":"172.21.15.187:6834","nonce":3241210910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:43:41.845115+0000","modified":"2024-09-10T07:43:44.869981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/274874285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":274874285},{"type":"v1","addr":"172.21.15.187:6835","nonce":274874285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7494,"qdb_cluster":[7494]},"id":10}]} 2024-09-10T07:43:47.870 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 82 2024-09-10T07:43:47.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 -- 172.21.15.99:0/1315309049 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f453806be30 msgr2=0x7f453806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f453806be30 0x7f453806e2f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4544034000 tx=0x7f454402e000 comp rx=0 tx=0).stop 2024-09-10T07:43:47.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 -- 172.21.15.99:0/1315309049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455c13fae0 msgr2=0x7f455c13d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:47.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455c13fae0 0x7f455c13d030 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f454c00c430 tx=0x7f454c00c8f0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 -- 172.21.15.99:0/1315309049 shutdown_connections 2024-09-10T07:43:47.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f455c160a80 0x7f455c140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f455c142150 0x7f455c15e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f453806be30 0x7f453806e2f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 --2- 172.21.15.99:0/1315309049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f455c13fae0 0x7f455c13d030 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:47.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 -- 172.21.15.99:0/1315309049 >> 172.21.15.99:0/1315309049 conn(0x7f455c06bc10 msgr2=0x7f455c0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:47.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 -- 172.21.15.99:0/1315309049 shutdown_connections 2024-09-10T07:43:47.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:47.872+0000 7f4563800640 1 -- 172.21.15.99:0/1315309049 wait complete. 2024-09-10T07:43:48.041 INFO:tasks.ceph.mds.d.smithi187.stderr:2024-09-10T07:43:48.041+0000 7f5821c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:43:48.067 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:43:48.072 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:43:48.291 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:43:41.845115+0000', 'modified': '2024-09-10T07:43:44.869981+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7494}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7494': {'gid': 7494, 'name': 'd', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6835/274874285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6833', 'nonce': 274874285}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 274874285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7494, 'qdb_cluster': [7494]} 2024-09-10T07:43:48.291 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:43:48.291 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T07:43:48.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.445+0000 7ff60ca00640 1 Processor -- start 2024-09-10T07:43:48.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.445+0000 7ff60ca00640 1 -- start start 2024-09-10T07:43:48.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.446+0000 7ff60ca00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff60815d210 0x7ff60806d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.446+0000 7ff60ca00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6080cd920 0x7ff60815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.446+0000 7ff60ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6080cfb20 0x7ff6080cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.446+0000 7ff60ca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff6080ce6c0 con 0x7ff6080cfb20 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.446+0000 7ff60ca00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff6080ce100 con 0x7ff60815d210 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.446+0000 7ff60ca00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff6080ce3e0 con 0x7ff6080cd920 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.446+0000 7ff607200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6080cfb20 0x7ff6080cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.446+0000 7ff607200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6080cfb20 0x7ff6080cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52896/0 (socket says 172.21.15.99:52896) 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.446+0000 7ff607200640 1 -- 172.21.15.99:0/3388961722 learned_addr learned my addr 172.21.15.99:0/3388961722 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.447+0000 7ff605e00640 1 --2- 172.21.15.99:0/3388961722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6080cd920 0x7ff60815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.447+0000 7ff606800640 1 --2- 172.21.15.99:0/3388961722 >> v2:172.21.15.187:3300/0 conn(0x7ff60815d210 0x7ff60806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.447+0000 7ff607200640 1 -- 172.21.15.99:0/3388961722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6080cd920 msgr2=0x7ff60815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.447+0000 7ff607200640 1 --2- 172.21.15.99:0/3388961722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6080cd920 0x7ff60815d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.447+0000 7ff607200640 1 -- 172.21.15.99:0/3388961722 >> v2:172.21.15.187:3300/0 conn(0x7ff60815d210 msgr2=0x7ff60806d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.447+0000 7ff607200640 1 --2- 172.21.15.99:0/3388961722 >> v2:172.21.15.187:3300/0 conn(0x7ff60815d210 0x7ff60806d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.447+0000 7ff607200640 1 -- 172.21.15.99:0/3388961722 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6080b4800 con 0x7ff6080cfb20 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.448+0000 7ff607200640 1 --2- 172.21.15.99:0/3388961722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 0x7ff6080cffb0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff608073720 tx=0x7ff60002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8482a8bd2a1f8f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.448+0000 7ff605400640 1 -- 172.21.15.99:0/3388961722 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600036070 con 0x7ff6080cfb20 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.448+0000 7ff605400640 1 -- 172.21.15.99:0/3388961722 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff600031600 con 0x7ff6080cfb20 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.448+0000 7ff605400640 1 -- 172.21.15.99:0/3388961722 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6000319d0 con 0x7ff6080cfb20 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.449+0000 7ff60ca00640 1 -- 172.21.15.99:0/3388961722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 msgr2=0x7ff6080cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.449+0000 7ff60ca00640 1 --2- 172.21.15.99:0/3388961722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 0x7ff6080cffb0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff608073720 tx=0x7ff60002a6a0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.449+0000 7ff60ca00640 1 -- 172.21.15.99:0/3388961722 shutdown_connections 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.449+0000 7ff60ca00640 1 --2- 172.21.15.99:0/3388961722 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6080cd920 0x7ff60815d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.449+0000 7ff60ca00640 1 --2- 172.21.15.99:0/3388961722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 0x7ff6080cffb0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.449+0000 7ff60ca00640 1 --2- 172.21.15.99:0/3388961722 >> v2:172.21.15.187:3300/0 conn(0x7ff60815d210 0x7ff60806d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.449+0000 7ff60ca00640 1 -- 172.21.15.99:0/3388961722 >> 172.21.15.99:0/3388961722 conn(0x7ff60806bdf0 msgr2=0x7ff60806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.449+0000 7ff60ca00640 1 -- 172.21.15.99:0/3388961722 shutdown_connections 2024-09-10T07:43:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.449+0000 7ff60ca00640 1 -- 172.21.15.99:0/3388961722 wait complete. 2024-09-10T07:43:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.450+0000 7ff60ca00640 1 Processor -- start 2024-09-10T07:43:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.450+0000 7ff60ca00640 1 -- start start 2024-09-10T07:43:48.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.451+0000 7ff60ca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6080cd920 0x7ff6081e9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.451+0000 7ff60ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 0x7ff6081e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.451+0000 7ff60ca00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff60815d210 0x7ff6081f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.451+0000 7ff60ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff6080d04f0 con 0x7ff6080cfb20 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.451+0000 7ff60ca00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff60815db30 con 0x7ff6080cd920 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.451+0000 7ff60ca00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff6080cdd60 con 0x7ff60815d210 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff605e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 0x7ff6081e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff605e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 0x7ff6081e95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52900/0 (socket says 172.21.15.99:52900) 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff605e00640 1 -- 172.21.15.99:0/3369847173 learned_addr learned my addr 172.21.15.99:0/3369847173 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff606800640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6080cd920 0x7ff6081e9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff607200640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff60815d210 0x7ff6081f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff605e00640 1 -- 172.21.15.99:0/3369847173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff60815d210 msgr2=0x7ff6081f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff605e00640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff60815d210 0x7ff6081f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff605e00640 1 -- 172.21.15.99:0/3369847173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6080cd920 msgr2=0x7ff6081e9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff605e00640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6080cd920 0x7ff6081e9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff605e00640 1 -- 172.21.15.99:0/3369847173 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6080b1050 con 0x7ff6080cfb20 2024-09-10T07:43:48.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.452+0000 7ff605e00640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 0x7ff6081e95b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400d800 tx=0x7ff5f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.453+0000 7ff5fea00640 1 -- 172.21.15.99:0/3369847173 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f400b6c0 con 0x7ff6080cfb20 2024-09-10T07:43:48.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.453+0000 7ff5fea00640 1 -- 172.21.15.99:0/3369847173 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f4019070 con 0x7ff6080cfb20 2024-09-10T07:43:48.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.453+0000 7ff60ca00640 1 -- 172.21.15.99:0/3369847173 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6080b1330 con 0x7ff6080cfb20 2024-09-10T07:43:48.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.453+0000 7ff5fea00640 1 -- 172.21.15.99:0/3369847173 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f400ba80 con 0x7ff6080cfb20 2024-09-10T07:43:48.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.453+0000 7ff60ca00640 1 -- 172.21.15.99:0/3369847173 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6080b1e10 con 0x7ff6080cfb20 2024-09-10T07:43:48.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.455+0000 7ff5fea00640 1 -- 172.21.15.99:0/3369847173 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5f400bc20 con 0x7ff6080cfb20 2024-09-10T07:43:48.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.456+0000 7ff5fea00640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e806be30 0x7ff5e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.456+0000 7ff5fea00640 1 -- 172.21.15.99:0/3369847173 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7ff5f408b1e0 con 0x7ff6080cfb20 2024-09-10T07:43:48.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.456+0000 7ff606800640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e806be30 0x7ff5e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.456+0000 7ff61028f740 1 Processor -- start 2024-09-10T07:43:48.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.456+0000 7ff61028f740 1 -- start start 2024-09-10T07:43:48.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.457+0000 7ff606800640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e806be30 0x7ff5e806e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8007920 tx=0x7ff5f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.457+0000 7ff61028f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 0x5563580a4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.457+0000 7ff61028f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805c660 0x55635805f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.457+0000 7ff61028f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556358060630 0x556358059720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.457+0000 7ff61028f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556357fbd3b0 con 0x55635805c660 2024-09-10T07:43:48.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.457+0000 7ff61028f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x556357fc2410 con 0x556358060630 2024-09-10T07:43:48.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.457+0000 7ff61028f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x556357f6a620 con 0x55635805eea0 2024-09-10T07:43:48.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff605e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805c660 0x55635805f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff606800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 0x5563580a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff606800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 0x5563580a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:50824/0 (socket says 172.21.15.99:50824) 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff606800640 1 -- 172.21.15.99:0/2810774176 learned_addr learned my addr 172.21.15.99:0/2810774176 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff607200640 1 --2- 172.21.15.99:0/2810774176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556358060630 0x556358059720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff606800640 1 -- 172.21.15.99:0/2810774176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556358060630 msgr2=0x556358059720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff606800640 1 --2- 172.21.15.99:0/2810774176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556358060630 0x556358059720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff606800640 1 -- 172.21.15.99:0/2810774176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805c660 msgr2=0x55635805f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff606800640 1 --2- 172.21.15.99:0/2810774176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805c660 0x55635805f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff606800640 1 -- 172.21.15.99:0/2810774176 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556357cd52d0 con 0x55635805eea0 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff607200640 1 --2- 172.21.15.99:0/2810774176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556358060630 0x556358059720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.458+0000 7ff605e00640 1 --2- 172.21.15.99:0/2810774176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805c660 0x55635805f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:43:48.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.459+0000 7ff606800640 1 --2- 172.21.15.99:0/2810774176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 0x5563580a4640 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8010aa0 tx=0x7ff5f8013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72effb72870c04bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.459+0000 7ff5f3000640 1 -- 172.21.15.99:0/2810774176 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f801c050 con 0x55635805eea0 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.459+0000 7ff5f3000640 1 -- 172.21.15.99:0/2810774176 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f8026070 con 0x55635805eea0 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.459+0000 7ff5f3000640 1 -- 172.21.15.99:0/2810774176 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8016e30 con 0x55635805eea0 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.459+0000 7ff61028f740 1 -- 172.21.15.99:0/2810774176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 msgr2=0x5563580a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.459+0000 7ff61028f740 1 --2- 172.21.15.99:0/2810774176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 0x5563580a4640 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8010aa0 tx=0x7ff5f8013000 comp rx=0 tx=0).stop 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.460+0000 7ff61028f740 1 -- 172.21.15.99:0/2810774176 shutdown_connections 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.460+0000 7ff61028f740 1 --2- 172.21.15.99:0/2810774176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556358060630 0x556358059720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.460+0000 7ff61028f740 1 --2- 172.21.15.99:0/2810774176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805c660 0x55635805f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.460+0000 7ff61028f740 1 --2- 172.21.15.99:0/2810774176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 0x5563580a4640 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.460+0000 7ff61028f740 1 -- 172.21.15.99:0/2810774176 >> 172.21.15.99:0/2810774176 conn(0x55635805b8f0 msgr2=0x5563580a3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.460+0000 7ff61028f740 1 -- 172.21.15.99:0/2810774176 shutdown_connections 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.460+0000 7ff61028f740 1 -- 172.21.15.99:0/2810774176 wait complete. 2024-09-10T07:43:48.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.460+0000 7ff61028f740 1 -- start start 2024-09-10T07:43:48.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.461+0000 7ff61028f740 1 Processor -- start 2024-09-10T07:43:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.461+0000 7ff61028f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805eea0 0x55635809f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.461+0000 7ff61028f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x556358060630 0x556358079530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.461+0000 7ff61028f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 0x5563580b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.461+0000 7ff61028f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556357f7d780 con 0x55635805eea0 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.461+0000 7ff61028f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x556357fbe3d0 con 0x55635809d760 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.461+0000 7ff61028f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55635805ad90 con 0x556358060630 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff61028f740 10 client.0 _ll_register_callbacks cb 0x556357fbb5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff606800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805eea0 0x55635809f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff606800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805eea0 0x55635809f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52922/0 (socket says 172.21.15.99:52922) 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff606800640 1 -- 172.21.15.99:0/1207531102 learned_addr learned my addr 172.21.15.99:0/1207531102 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff607200640 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 0x5563580b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff605e00640 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x556358060630 0x556358079530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff606800640 1 -- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x556358060630 msgr2=0x556358079530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff606800640 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x556358060630 0x556358079530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff606800640 1 -- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 msgr2=0x5563580b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff606800640 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 0x5563580b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff606800640 1 -- 172.21.15.99:0/1207531102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556357d9f6b0 con 0x55635805eea0 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff606800640 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805eea0 0x55635809f670 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8005c20 tx=0x7ff5f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b186bc184335abdf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.462+0000 7ff5e7400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff5e7400640 1 -- 172.21.15.99:0/1207531102 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8021650 con 0x55635805eea0 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff61028f740 1 -- 172.21.15.99:0/1207531102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5f8026070 con 0x55635805eea0 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff5e7400640 1 -- 172.21.15.99:0/1207531102 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7ff5f80217f0 con 0x55635805eea0 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff5e7400640 1 -- 172.21.15.99:0/1207531102 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7ff5f801c020 con 0x55635805eea0 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff61028f740 10 client.7605 fetch_fsmap learned FSMap version 82 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff61028f740 1 -- 172.21.15.99:0/1207531102 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) -- 0x55635809fbb0 con 0x55635805eea0 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff5e7400640 1 -- 172.21.15.99:0/1207531102 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f8026070 con 0x55635805eea0 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff5e7400640 1 -- 172.21.15.99:0/1207531102 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 82) ==== 3502+0+0 (secure 0 0 0) 0x7ff5f80219f0 con 0x55635805eea0 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff61028f740 10 client.7605 fetch_fsmap finished waiting for FSMap version 82 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff61028f740 10 client.7605 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff61028f740 20 client.7605 populate_metadata read hostname 'smithi099' 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff61028f740 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:6833/274874285,v1:172.21.15.187:6835/274874285] conn(0x5563580874c0 0x5563580878a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff61028f740 4 client.7605 mds_command: new command op to 7494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:43:48.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.463+0000 7ff61028f740 1 -- 172.21.15.99:0/1207531102 --> [v2:172.21.15.187:6833/274874285,v1:172.21.15.187:6835/274874285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556357fcfb40 con 0x5563580874c0 2024-09-10T07:43:48.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.464+0000 7ff605e00640 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:6833/274874285,v1:172.21.15.187:6835/274874285] conn(0x5563580874c0 0x5563580878a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.464+0000 7ff605e00640 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:6833/274874285,v1:172.21.15.187:6835/274874285] conn(0x5563580874c0 0x5563580878a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b0edb6ecca1959 server_cookie=3bd1cf9527e04260 in_seq=0 out_seq=0 2024-09-10T07:43:48.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.464+0000 7ff5e7400640 10 client.7605 ms_handle_connect on v2:172.21.15.187:6833/274874285 2024-09-10T07:43:48.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.465+0000 7ff5e7400640 1 -- 172.21.15.99:0/1207531102 <== mds.0 v2:172.21.15.187:6833/274874285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556357fcfb40 con 0x5563580874c0 2024-09-10T07:43:48.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.465+0000 7ff5e7400640 10 client.7605 handle_command_reply: tid=0 2024-09-10T07:43:48.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 client.7605 shutdown 2024-09-10T07:43:48.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 -- 172.21.15.99:0/1207531102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805eea0 msgr2=0x55635809f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805eea0 0x55635809f670 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8005c20 tx=0x7ff5f8004730 comp rx=0 tx=0).stop 2024-09-10T07:43:48.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 -- 172.21.15.99:0/1207531102 shutdown_connections 2024-09-10T07:43:48.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:6833/274874285,v1:172.21.15.187:6835/274874285] conn(0x5563580874c0 0x5563580878a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 0x5563580b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x556358060630 0x556358079530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 --2- 172.21.15.99:0/1207531102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635805eea0 0x55635809f670 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 -- 172.21.15.99:0/1207531102 >> 172.21.15.99:0/1207531102 conn(0x55635805c660 msgr2=0x5563580a1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:48.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff5e7400640 0 client.7605 ms_handle_reset on v2:172.21.15.187:6833/274874285 2024-09-10T07:43:48.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 -- 172.21.15.99:0/1207531102 shutdown_connections 2024-09-10T07:43:48.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 1 -- 172.21.15.99:0/1207531102 wait complete. 2024-09-10T07:43:48.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.466+0000 7ff61028f740 20 client.7605 trim_cache size 0 max 16384 2024-09-10T07:43:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.485+0000 7ff61028f740 1 Processor -- start 2024-09-10T07:43:48.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.485+0000 7ff61028f740 1 -- start start 2024-09-10T07:43:48.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.486+0000 7ff61028f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635805eea0 0x5563580c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.486+0000 7ff61028f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x556358060630 0x5563580b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.486+0000 7ff61028f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635809d760 0x5563580a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.486+0000 7ff61028f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff6081e8660 con 0x55635809d760 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.486+0000 7ff61028f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff6081e79c0 con 0x55635805eea0 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.486+0000 7ff61028f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff6081e8010 con 0x556358060630 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.486+0000 7ff607200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635809d760 0x5563580a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.486+0000 7ff607200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635809d760 0x5563580a1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52930/0 (socket says 172.21.15.99:52930) 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.486+0000 7ff607200640 1 -- 172.21.15.99:0/2406078413 learned_addr learned my addr 172.21.15.99:0/2406078413 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff605e00640 1 --2- 172.21.15.99:0/2406078413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x556358060630 0x5563580b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff606800640 1 --2- 172.21.15.99:0/2406078413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635805eea0 0x5563580c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff607200640 1 -- 172.21.15.99:0/2406078413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x556358060630 msgr2=0x5563580b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:48.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff607200640 1 --2- 172.21.15.99:0/2406078413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x556358060630 0x5563580b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff607200640 1 -- 172.21.15.99:0/2406078413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635805eea0 msgr2=0x5563580c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff607200640 1 --2- 172.21.15.99:0/2406078413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635805eea0 0x5563580c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff607200640 1 -- 172.21.15.99:0/2406078413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556358055740 con 0x55635809d760 2024-09-10T07:43:48.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff607200640 1 --2- 172.21.15.99:0/2406078413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635809d760 0x5563580a1b90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff60002ac90 tx=0x7ff60002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e32e569a61daa66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff5f2600640 1 -- 172.21.15.99:0/2406078413 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600036040 con 0x55635809d760 2024-09-10T07:43:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff5f2600640 1 -- 172.21.15.99:0/2406078413 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff600037040 con 0x55635809d760 2024-09-10T07:43:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.487+0000 7ff5f2600640 1 -- 172.21.15.99:0/2406078413 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600031920 con 0x55635809d760 2024-09-10T07:43:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.488+0000 7ff61028f740 1 -- 172.21.15.99:0/2406078413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635809d760 msgr2=0x5563580a1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.488+0000 7ff61028f740 1 --2- 172.21.15.99:0/2406078413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635809d760 0x5563580a1b90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff60002ac90 tx=0x7ff60002e000 comp rx=0 tx=0).stop 2024-09-10T07:43:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.488+0000 7ff61028f740 1 -- 172.21.15.99:0/2406078413 shutdown_connections 2024-09-10T07:43:48.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.488+0000 7ff61028f740 1 --2- 172.21.15.99:0/2406078413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55635809d760 0x5563580a1b90 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.488+0000 7ff61028f740 1 --2- 172.21.15.99:0/2406078413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x556358060630 0x5563580b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.488+0000 7ff61028f740 1 --2- 172.21.15.99:0/2406078413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635805eea0 0x5563580c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.488+0000 7ff61028f740 1 -- 172.21.15.99:0/2406078413 >> 172.21.15.99:0/2406078413 conn(0x55635805c660 msgr2=0x556358089110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.488+0000 7ff61028f740 1 -- 172.21.15.99:0/2406078413 shutdown_connections 2024-09-10T07:43:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.488+0000 7ff61028f740 1 -- 172.21.15.99:0/2406078413 wait complete. 2024-09-10T07:43:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.489+0000 7ff61028f740 1 -- start start 2024-09-10T07:43:48.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.489+0000 7ff61028f740 1 Processor -- start 2024-09-10T07:43:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff61028f740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 0x55635811f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff61028f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556358060630 0x5563580a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff61028f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 0x5563580a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff61028f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556358079bb0 con 0x556358060630 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff61028f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x5563580b4900 con 0x55635809d760 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff61028f740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x5563580a0c00 con 0x55635805eea0 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff61028f740 10 client.0 _ll_register_callbacks cb 0x7ff5f40557d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff605e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556358060630 0x5563580a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff605e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556358060630 0x5563580a1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52942/0 (socket says 172.21.15.99:52942) 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff605e00640 1 -- 172.21.15.99:0/4086456768 learned_addr learned my addr 172.21.15.99:0/4086456768 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff607200640 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 0x5563580a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.490+0000 7ff606800640 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 0x55635811f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff605e00640 1 -- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 msgr2=0x55635811f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff605e00640 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 0x55635811f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff605e00640 1 -- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 msgr2=0x5563580a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff605e00640 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 0x5563580a20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff605e00640 1 -- 172.21.15.99:0/4086456768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556358088560 con 0x556358060630 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff607200640 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 0x5563580a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:43:48.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff605e00640 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556358060630 0x5563580a1b90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40591e0 tx=0x7ff5f4058fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61227a2d387e03e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff5e7400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff5e7400640 1 -- 172.21.15.99:0/4086456768 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4055ba0 con 0x556358060630 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff5e7400640 1 -- 172.21.15.99:0/4086456768 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7ff5f4058980 con 0x556358060630 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff61028f740 1 -- 172.21.15.99:0/4086456768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff600037040 con 0x556358060630 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff5e7400640 1 -- 172.21.15.99:0/4086456768 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7ff5f4055d40 con 0x556358060630 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff61028f740 10 client.7611 fetch_fsmap learned FSMap version 82 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.491+0000 7ff61028f740 1 -- 172.21.15.99:0/4086456768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) -- 0x556358088270 con 0x556358060630 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.492+0000 7ff5e7400640 1 -- 172.21.15.99:0/4086456768 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff600037040 con 0x556358060630 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.492+0000 7ff5e7400640 1 -- 172.21.15.99:0/4086456768 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 82) ==== 3502+0+0 (secure 0 0 0) 0x7ff5f4089020 con 0x556358060630 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.492+0000 7ff61028f740 10 client.7611 fetch_fsmap finished waiting for FSMap version 82 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.492+0000 7ff61028f740 10 client.7611 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.492+0000 7ff61028f740 20 client.7611 populate_metadata read hostname 'smithi099' 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.492+0000 7ff61028f740 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:6833/274874285,v1:172.21.15.187:6835/274874285] conn(0x556358122dd0 0x5563580a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.492+0000 7ff61028f740 4 client.7611 mds_command: new command op to 7494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:43:48.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.492+0000 7ff61028f740 1 -- 172.21.15.99:0/4086456768 --> [v2:172.21.15.187:6833/274874285,v1:172.21.15.187:6835/274874285] -- command(tid 0: {"prefix": "status"}) -- 0x55635809d5b0 con 0x556358122dd0 2024-09-10T07:43:48.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.492+0000 7ff606800640 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:6833/274874285,v1:172.21.15.187:6835/274874285] conn(0x556358122dd0 0x5563580a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff606800640 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:6833/274874285,v1:172.21.15.187:6835/274874285] conn(0x556358122dd0 0x5563580a6d40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd71c4a89a88756e server_cookie=6e1ac6fe87937a40 in_seq=0 out_seq=0 2024-09-10T07:43:48.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff5e7400640 10 client.7611 ms_handle_connect on v2:172.21.15.187:6833/274874285 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff5e7400640 1 -- 172.21.15.99:0/4086456768 <== mds.0 v2:172.21.15.187:6833/274874285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55635809d5b0 con 0x556358122dd0 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff5e7400640 10 client.7611 handle_command_reply: tid=0 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff61028f740 1 client.7611 shutdown 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff61028f740 1 -- 172.21.15.99:0/4086456768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556358060630 msgr2=0x5563580a1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff61028f740 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556358060630 0x5563580a1b90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40591e0 tx=0x7ff5f4058fb0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff61028f740 1 -- 172.21.15.99:0/4086456768 shutdown_connections 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff61028f740 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:6833/274874285,v1:172.21.15.187:6835/274874285] conn(0x556358122dd0 0x5563580a6d40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff61028f740 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55635809d760 0x5563580a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff61028f740 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556358060630 0x5563580a1b90 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff5e7400640 0 client.7611 ms_handle_reset on v2:172.21.15.187:6833/274874285 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff61028f740 1 --2- 172.21.15.99:0/4086456768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55635805eea0 0x55635811f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff61028f740 1 -- 172.21.15.99:0/4086456768 >> 172.21.15.99:0/4086456768 conn(0x55635805c660 msgr2=0x556358085c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.493+0000 7ff61028f740 1 -- 172.21.15.99:0/4086456768 shutdown_connections 2024-09-10T07:43:48.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff61028f740 1 -- 172.21.15.99:0/4086456768 wait complete. 2024-09-10T07:43:48.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff61028f740 20 client.7611 trim_cache size 0 max 16384 2024-09-10T07:43:48.497 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:43:48.497 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:43:48.497 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:43:48.497 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 7494, 2024-09-10T07:43:48.497 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:43:48.497 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:43:48.497 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:43:48.498 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 6.0562446569999997, 2024-09-10T07:43:48.498 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 82, 2024-09-10T07:43:48.498 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 171, 2024-09-10T07:43:48.498 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 171, 2024-09-10T07:43:48.498 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 11.142207994 2024-09-10T07:43:48.498 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 -- 172.21.15.99:0/3369847173 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e806be30 msgr2=0x7ff5e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e806be30 0x7ff5e806e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8007920 tx=0x7ff5f8008040 comp rx=0 tx=0).stop 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 -- 172.21.15.99:0/3369847173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 msgr2=0x7ff6081e95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 0x7ff6081e95b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400d800 tx=0x7ff5f400dcc0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 -- 172.21.15.99:0/3369847173 shutdown_connections 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff60815d210 0x7ff6081f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff5e806be30 0x7ff5e806e2f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6080cfb20 0x7ff6081e95b0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 --2- 172.21.15.99:0/3369847173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6080cd920 0x7ff6081e9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 -- 172.21.15.99:0/3369847173 >> 172.21.15.99:0/3369847173 conn(0x7ff60806bdf0 msgr2=0x7ff60806c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 -- 172.21.15.99:0/3369847173 shutdown_connections 2024-09-10T07:43:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.494+0000 7ff60ca00640 1 -- 172.21.15.99:0/3369847173 wait complete. 2024-09-10T07:43:48.509 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:43:48.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.661+0000 7ff1c7a00640 1 Processor -- start 2024-09-10T07:43:48.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.661+0000 7ff1c7a00640 1 -- start start 2024-09-10T07:43:48.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.663+0000 7ff1c7a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff1c0072f40 0x7ff1c006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.663+0000 7ff1c7a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c006e3d0 con 0x7ff1c00ce780 2024-09-10T07:43:48.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.663+0000 7ff1c7a00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c006e6b0 con 0x7ff1c0145290 2024-09-10T07:43:48.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.663+0000 7ff1c7a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c006efe0 con 0x7ff1c0072f40 2024-09-10T07:43:48.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.663+0000 7ff1c5a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff1c00ce780 0x7ff1c00b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39670/0 (socket says 172.21.15.99:39670) 2024-09-10T07:43:48.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.663+0000 7ff1c5a00640 1 -- 172.21.15.99:0/1022564876 learned_addr learned my addr 172.21.15.99:0/1022564876 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:48.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.663+0000 7ff1b7e00640 1 --2- 172.21.15.99:0/1022564876 >> v2:172.21.15.187:3300/0 conn(0x7ff1c0072f40 0x7ff1c006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.664+0000 7ff1bfe00640 1 -- 172.21.15.99:0/1022564876 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651089461 0 0) 0x7ff1c006e3d0 con 0x7ff1c00ce780 2024-09-10T07:43:48.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.664+0000 7ff1bfe00640 1 -- 172.21.15.99:0/1022564876 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1a4005730 con 0x7ff1c00ce780 2024-09-10T07:43:48.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.664+0000 7ff1bfe00640 1 -- 172.21.15.99:0/1022564876 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705143340 0 0) 0x7ff1c006e6b0 con 0x7ff1c0145290 2024-09-10T07:43:48.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.664+0000 7ff1bfe00640 1 -- 172.21.15.99:0/1022564876 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c006e3d0 con 0x7ff1c0145290 2024-09-10T07:43:48.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.664+0000 7ff1b7e00640 1 -- 172.21.15.99:0/1022564876 >> v1:172.21.15.187:6789/0 conn(0x7ff1c0145290 legacy=0x7ff1c0072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.664+0000 7ff1b7e00640 1 -- 172.21.15.99:0/1022564876 >> v1:172.21.15.99:6789/0 conn(0x7ff1c00ce780 legacy=0x7ff1c00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.664+0000 7ff1b7e00640 1 -- 172.21.15.99:0/1022564876 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c006e990 con 0x7ff1c0072f40 2024-09-10T07:43:48.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.665+0000 7ff1b7e00640 1 --2- 172.21.15.99:0/1022564876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1c0072f40 0x7ff1c006f470 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80097a0 tx=0x7ff1a802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af43b496cefe399e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.665+0000 7ff1bfe00640 1 -- 172.21.15.99:0/1022564876 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8037070 con 0x7ff1c0072f40 2024-09-10T07:43:48.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.665+0000 7ff1bfe00640 1 -- 172.21.15.99:0/1022564876 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a8032440 con 0x7ff1c0072f40 2024-09-10T07:43:48.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.665+0000 7ff1bfe00640 1 -- 172.21.15.99:0/1022564876 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8032810 con 0x7ff1c0072f40 2024-09-10T07:43:48.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.666+0000 7ff1c7a00640 1 -- 172.21.15.99:0/1022564876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1c0072f40 msgr2=0x7ff1c006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.666+0000 7ff1c7a00640 1 --2- 172.21.15.99:0/1022564876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1c0072f40 0x7ff1c006f470 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80097a0 tx=0x7ff1a802a230 comp rx=0 tx=0).stop 2024-09-10T07:43:48.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.666+0000 7ff1c7a00640 1 -- 172.21.15.99:0/1022564876 shutdown_connections 2024-09-10T07:43:48.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.666+0000 7ff1c7a00640 1 --2- 172.21.15.99:0/1022564876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1c0072f40 0x7ff1c006f470 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.666+0000 7ff1c7a00640 1 -- 172.21.15.99:0/1022564876 >> 172.21.15.99:0/1022564876 conn(0x7ff1c006bc10 msgr2=0x7ff1c006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:48.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.666+0000 7ff1c7a00640 1 -- 172.21.15.99:0/1022564876 shutdown_connections 2024-09-10T07:43:48.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.666+0000 7ff1c7a00640 1 -- 172.21.15.99:0/1022564876 wait complete. 2024-09-10T07:43:48.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.667+0000 7ff1c7a00640 1 Processor -- start 2024-09-10T07:43:48.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.667+0000 7ff1c7a00640 1 -- start start 2024-09-10T07:43:48.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.668+0000 7ff1c7a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1c0072f40 0x7ff1c015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.668+0000 7ff1c7a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1c00ce780 0x7ff1c00c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.668+0000 7ff1c7a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1c0145290 0x7ff1c013d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.668+0000 7ff1c7a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c006df80 con 0x7ff1c0072f40 2024-09-10T07:43:48.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.668+0000 7ff1c7a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0145670 con 0x7ff1c00ce780 2024-09-10T07:43:48.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.668+0000 7ff1c7a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c006e100 con 0x7ff1c0145290 2024-09-10T07:43:48.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1c5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1c0072f40 0x7ff1c015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1b7e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1c00ce780 0x7ff1c00c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1c5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1c0072f40 0x7ff1c015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52948/0 (socket says 172.21.15.99:52948) 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1c5000640 1 -- 172.21.15.99:0/84290835 learned_addr learned my addr 172.21.15.99:0/84290835 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1c5a00640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1c0145290 0x7ff1c013d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1c5000640 1 -- 172.21.15.99:0/84290835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1c0145290 msgr2=0x7ff1c013d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1c5000640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1c0145290 0x7ff1c013d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1c5000640 1 -- 172.21.15.99:0/84290835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1c00ce780 msgr2=0x7ff1c00c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1c5000640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1c00ce780 0x7ff1c00c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1c5000640 1 -- 172.21.15.99:0/84290835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c00ca400 con 0x7ff1c0072f40 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1b7e00640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1c00ce780 0x7ff1c00c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.669+0000 7ff1c5000640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1c0072f40 0x7ff1c015b260 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000c500 tx=0x7ff1b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.670+0000 7ff1bd600640 1 -- 172.21.15.99:0/84290835 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b00052d0 con 0x7ff1c0072f40 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.670+0000 7ff1bd600640 1 -- 172.21.15.99:0/84290835 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b0005490 con 0x7ff1c0072f40 2024-09-10T07:43:48.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.670+0000 7ff1bd600640 1 -- 172.21.15.99:0/84290835 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0012870 con 0x7ff1c0072f40 2024-09-10T07:43:48.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.670+0000 7ff1c7a00640 1 -- 172.21.15.99:0/84290835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c00ca6e0 con 0x7ff1c0072f40 2024-09-10T07:43:48.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.670+0000 7ff1c7a00640 1 -- 172.21.15.99:0/84290835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c00caca0 con 0x7ff1c0072f40 2024-09-10T07:43:48.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.671+0000 7ff1c7a00640 1 -- 172.21.15.99:0/84290835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c00715a0 con 0x7ff1c0072f40 2024-09-10T07:43:48.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.672+0000 7ff1bd600640 1 -- 172.21.15.99:0/84290835 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1b0012a10 con 0x7ff1c0072f40 2024-09-10T07:43:48.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.673+0000 7ff1bd600640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff19c06be30 0x7ff19c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:48.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.673+0000 7ff1bd600640 1 -- 172.21.15.99:0/84290835 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7ff1b008aa60 con 0x7ff1c0072f40 2024-09-10T07:43:48.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.673+0000 7ff1b7e00640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff19c06be30 0x7ff19c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:48.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.674+0000 7ff1b7e00640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff19c06be30 0x7ff19c06e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8034000 tx=0x7ff1a802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:48.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.677+0000 7ff1bd600640 1 -- 172.21.15.99:0/84290835 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1b0058d30 con 0x7ff1c0072f40 2024-09-10T07:43:48.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.886+0000 7ff1c7a00640 1 -- 172.21.15.99:0/84290835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff1c00cf680 con 0x7ff1c0072f40 2024-09-10T07:43:48.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.886+0000 7ff1bd600640 1 -- 172.21.15.99:0/84290835 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) ==== 53+0+73 (secure 0 0 0) 0x7ff1b005d030 con 0x7ff1c0072f40 2024-09-10T07:43:48.886 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:43:48.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 -- 172.21.15.99:0/84290835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff19c06be30 msgr2=0x7ff19c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff19c06be30 0x7ff19c06e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8034000 tx=0x7ff1a802e000 comp rx=0 tx=0).stop 2024-09-10T07:43:48.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 -- 172.21.15.99:0/84290835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1c0072f40 msgr2=0x7ff1c015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:48.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1c0072f40 0x7ff1c015b260 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000c500 tx=0x7ff1b000c9c0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 -- 172.21.15.99:0/84290835 shutdown_connections 2024-09-10T07:43:48.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1c0145290 0x7ff1c013d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1c00ce780 0x7ff1c00c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff19c06be30 0x7ff19c06e2f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 --2- 172.21.15.99:0/84290835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1c0072f40 0x7ff1c015b260 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:48.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 -- 172.21.15.99:0/84290835 >> 172.21.15.99:0/84290835 conn(0x7ff1c006bc10 msgr2=0x7ff1c0072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:48.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 -- 172.21.15.99:0/84290835 shutdown_connections 2024-09-10T07:43:48.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:48.889+0000 7ff1c7a00640 1 -- 172.21.15.99:0/84290835 wait complete. 2024-09-10T07:43:48.905 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:43:48.905 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:43:48.905 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:43:48.905 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:43:48.905 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:43:48.905 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:43:48.905 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:43:48.905 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:43:48.905 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:43:48.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:48.906 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:43:48.941 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:43:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:43:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:43:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:43:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42199sec preferred_lft 42199sec 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:43:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:43:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::1c1f:52ff:fe95:9fbe/64 scope link 2024-09-10T07:43:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:48.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:48.945 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:43:49.039 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:43:49.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:49.042 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:43:49.078 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:43:49.079 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:43:49.079 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:43:49.079 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:43:49.079 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:43:49.079 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:43:49.080 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:43:49.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:43:49.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:43:49.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:43:49.080 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:43:49.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:43:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:43:49.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:49.275 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:43:49.310 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:43:49.310 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:43:49.311 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:43:49.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:49.311 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:43:49.406 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:43:49.407 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:43:49.442 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:43:49.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:43:49.442 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:43:49.517 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:43:49.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:49.518 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:43:49.646 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:43:49.646 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:43:49.673 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:43:49.673 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:43:49.673 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:43:49.673 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:43:49.674 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:43:49.675 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:43:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:43:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:43:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:43:49.675 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:43:49.678 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:43:49.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:49.678 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:43:49.735 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:43:49.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:43:49.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:43:49.835 INFO:teuthology.orchestra.run.smithi099.stdout:client7620 2024-09-10T07:43:49.835 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:43:49.836 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:49.871 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:43:50.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.064+0000 7f9f2ac00640 1 Processor -- start 2024-09-10T07:43:50.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.064+0000 7f9f2ac00640 1 -- start start 2024-09-10T07:43:50.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.066+0000 7f9f2ac00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9f24072f40 0x7f9f2406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:50.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.066+0000 7f9f2ac00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2406e3d0 con 0x7f9f24145290 2024-09-10T07:43:50.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.066+0000 7f9f2ac00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2406e6b0 con 0x7f9f240ce780 2024-09-10T07:43:50.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.066+0000 7f9f2ac00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2406efe0 con 0x7f9f24072f40 2024-09-10T07:43:50.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.066+0000 7f9f23e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9f24145290 0x7f9f24072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36458/0 (socket says 172.21.15.99:36458) 2024-09-10T07:43:50.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.066+0000 7f9f23e00640 1 -- 172.21.15.99:0/2008673873 learned_addr learned my addr 172.21.15.99:0/2008673873 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1170018294 0 0) 0x7f9f2406e3d0 con 0x7f9f24145290 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f1b400640 1 --2- 172.21.15.99:0/2008673873 >> v2:172.21.15.187:3300/0 conn(0x7f9f24072f40 0x7f9f2406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f08005730 con 0x7f9f24145290 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1462941788 0 0) 0x7f9f08005730 con 0x7f9f24145290 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 >> v2:172.21.15.187:3300/0 conn(0x7f9f24072f40 msgr2=0x7f9f2406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 --2- 172.21.15.99:0/2008673873 >> v2:172.21.15.187:3300/0 conn(0x7f9f24072f40 0x7f9f2406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 >> v1:172.21.15.187:6789/0 conn(0x7f9f240ce780 legacy=0x7f9f240b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2406e990 con 0x7f9f24145290 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f9f14001670 con 0x7f9f24145290 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 >> v1:172.21.15.99:6789/0 conn(0x7f9f24145290 legacy=0x7f9f24072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f08005bc0 0x7f9f08005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f08006a10 0x7f9f08006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f080073d0 0x7f9f0800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2406efe0 con 0x7f9f08006a10 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0800e270 con 0x7f9f080073d0 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0800e470 con 0x7f9f08005bc0 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f1b400640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f08006a10 0x7f9f08006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f23e00640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f08005bc0 0x7f9f08005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.067+0000 7f9f28c00640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f080073d0 0x7f9f0800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.068+0000 7f9f1b400640 1 -- 172.21.15.99:0/2008673873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f08005bc0 msgr2=0x7f9f08005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.068+0000 7f9f1b400640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f08005bc0 0x7f9f08005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.068+0000 7f9f1b400640 1 -- 172.21.15.99:0/2008673873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f080073d0 msgr2=0x7f9f0800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.068+0000 7f9f1b400640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f080073d0 0x7f9f0800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.068+0000 7f9f1b400640 1 -- 172.21.15.99:0/2008673873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f08005730 con 0x7f9f08006a10 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.068+0000 7f9f28c00640 1 -- 172.21.15.99:0/2008673873 reap_dead start 2024-09-10T07:43:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.068+0000 7f9f23e00640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f08005bc0 0x7f9f08005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.069+0000 7f9f1b400640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f08006a10 0x7f9f08006e90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009ac0 tx=0x7f9f08007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58a4d2edf7ec4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.069+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c036070 con 0x7f9f08006a10 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.069+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c031400 con 0x7f9f08006a10 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.069+0000 7f9f23400640 1 -- 172.21.15.99:0/2008673873 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c009690 con 0x7f9f08006a10 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.069+0000 7f9f2ac00640 1 -- 172.21.15.99:0/2008673873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f08006a10 msgr2=0x7f9f08006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.069+0000 7f9f2ac00640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f08006a10 0x7f9f08006e90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009ac0 tx=0x7f9f08007a40 comp rx=0 tx=0).stop 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.069+0000 7f9f2ac00640 1 -- 172.21.15.99:0/2008673873 shutdown_connections 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.070+0000 7f9f2ac00640 1 --2- 172.21.15.99:0/2008673873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f08006a10 0x7f9f08006e90 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.070+0000 7f9f2ac00640 1 -- 172.21.15.99:0/2008673873 >> 172.21.15.99:0/2008673873 conn(0x7f9f2406bc10 msgr2=0x7f9f2406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.070+0000 7f9f2ac00640 1 -- 172.21.15.99:0/2008673873 shutdown_connections 2024-09-10T07:43:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.070+0000 7f9f2ac00640 1 -- 172.21.15.99:0/2008673873 wait complete. 2024-09-10T07:43:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.071+0000 7f9f2ac00640 1 Processor -- start 2024-09-10T07:43:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.071+0000 7f9f2ac00640 1 -- start start 2024-09-10T07:43:50.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.072+0000 7f9f2ac00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f08006a10 0x7f9f2415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.072+0000 7f9f2ac00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f2415d1c0 0x7f9f2415d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.072+0000 7f9f2ac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f2415bfa0 0x7f9f2415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.072+0000 7f9f2ac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2406df80 con 0x7f9f2415bfa0 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.072+0000 7f9f2ac00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9f24145670 con 0x7f9f08006a10 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.072+0000 7f9f2ac00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2406e100 con 0x7f9f2415d1c0 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.072+0000 7f9f28c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f2415bfa0 0x7f9f2415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f28c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f2415bfa0 0x7f9f2415c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48748/0 (socket says 172.21.15.99:48748) 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f28c00640 1 -- 172.21.15.99:0/3085626991 learned_addr learned my addr 172.21.15.99:0/3085626991 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f23e00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f08006a10 0x7f9f2415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f1b400640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f2415d1c0 0x7f9f2415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f28c00640 1 -- 172.21.15.99:0/3085626991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f2415d1c0 msgr2=0x7f9f2415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f28c00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f2415d1c0 0x7f9f2415d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f28c00640 1 -- 172.21.15.99:0/3085626991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f08006a10 msgr2=0x7f9f2415ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f28c00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f08006a10 0x7f9f2415ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f28c00640 1 -- 172.21.15.99:0/3085626991 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2415dc80 con 0x7f9f2415bfa0 2024-09-10T07:43:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f28c00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f2415bfa0 0x7f9f2415c420 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9f2406ef50 tx=0x7f9f1c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.073+0000 7f9f20c00640 1 -- 172.21.15.99:0/3085626991 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c006e20 con 0x7f9f2415bfa0 2024-09-10T07:43:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.074+0000 7f9f20c00640 1 -- 172.21.15.99:0/3085626991 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1c003970 con 0x7f9f2415bfa0 2024-09-10T07:43:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.074+0000 7f9f20c00640 1 -- 172.21.15.99:0/3085626991 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c003d60 con 0x7f9f2415bfa0 2024-09-10T07:43:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.074+0000 7f9f2ac00640 1 -- 172.21.15.99:0/3085626991 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2415df60 con 0x7f9f2415bfa0 2024-09-10T07:43:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.074+0000 7f9f2ac00640 1 -- 172.21.15.99:0/3085626991 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f241414b0 con 0x7f9f2415bfa0 2024-09-10T07:43:50.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.075+0000 7f9f2ac00640 1 -- 172.21.15.99:0/3085626991 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f24139250 con 0x7f9f2415bfa0 2024-09-10T07:43:50.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.076+0000 7f9f20c00640 1 -- 172.21.15.99:0/3085626991 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f1c00c770 con 0x7f9f2415bfa0 2024-09-10T07:43:50.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.076+0000 7f9f20c00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f0006be60 0x7f9f0006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:50.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.077+0000 7f9f20c00640 1 -- 172.21.15.99:0/3085626991 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f9f1c08ea40 con 0x7f9f2415bfa0 2024-09-10T07:43:50.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.077+0000 7f9f23e00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f0006be60 0x7f9f0006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:50.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.077+0000 7f9f23e00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f0006be60 0x7f9f0006e320 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9f140017e0 tx=0x7f9f14007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:50.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.081+0000 7f9f20c00640 1 -- 172.21.15.99:0/3085626991 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f24139250 con 0x7f9f2415bfa0 2024-09-10T07:43:50.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.288+0000 7f9f2ac00640 1 -- 172.21.15.99:0/3085626991 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9f240715a0 con 0x7f9f2415bfa0 2024-09-10T07:43:50.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.289+0000 7f9f20c00640 1 -- 172.21.15.99:0/3085626991 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) ==== 53+0+73 (secure 0 0 0) 0x7f9f1c05cd90 con 0x7f9f2415bfa0 2024-09-10T07:43:50.289 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:43:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 -- 172.21.15.99:0/3085626991 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f0006be60 msgr2=0x7f9f0006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f0006be60 0x7f9f0006e320 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9f140017e0 tx=0x7f9f14007040 comp rx=0 tx=0).stop 2024-09-10T07:43:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 -- 172.21.15.99:0/3085626991 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f2415bfa0 msgr2=0x7f9f2415c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f2415bfa0 0x7f9f2415c420 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9f2406ef50 tx=0x7f9f1c011f90 comp rx=0 tx=0).stop 2024-09-10T07:43:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 -- 172.21.15.99:0/3085626991 shutdown_connections 2024-09-10T07:43:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9f0006be60 0x7f9f0006e320 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f2415bfa0 0x7f9f2415c420 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f2415d1c0 0x7f9f2415d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 --2- 172.21.15.99:0/3085626991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f08006a10 0x7f9f2415ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:50.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 -- 172.21.15.99:0/3085626991 >> 172.21.15.99:0/3085626991 conn(0x7f9f2406bc10 msgr2=0x7f9f24140270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:50.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 -- 172.21.15.99:0/3085626991 shutdown_connections 2024-09-10T07:43:50.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:50.291+0000 7f9f2ac00640 1 -- 172.21.15.99:0/3085626991 wait complete. 2024-09-10T07:43:50.306 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:43:50.306 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:43:50.307 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:43:50.307 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:43:50.307 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:43:50.307 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:43:50.307 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:43:50.307 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:43:50.307 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:43:50.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:50.307 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:43:50.348 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:43:50.348 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:43:50.348 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:43:50.349 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42194sec preferred_lft 42194sec 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:43:50.350 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:43:50.351 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::84a0:e5ff:fe75:1d2e/64 scope link 2024-09-10T07:43:50.351 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:43:50.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:50.351 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:43:50.445 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:43:50.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:50.448 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:43:50.487 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:43:50.487 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:43:50.487 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:43:50.488 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:43:50.488 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:43:50.488 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:43:50.488 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:43:50.488 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:43:50.488 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:43:50.488 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:43:50.488 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:43:50.604 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:43:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:43:50.675 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:43:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:43:50.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:50.683 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:43:50.718 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:43:50.718 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:43:50.718 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:43:50.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:50.719 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:43:50.813 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:43:50.814 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:43:50.849 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:43:50.849 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:43:50.849 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:43:50.924 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:43:50.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:50.924 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:43:51.052 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:43:51.052 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:43:51.078 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:43:51.078 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:43:51.078 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:43:51.078 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:43:51.078 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:43:51.080 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:43:51.080 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:43:51.080 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:43:51.080 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:43:51.080 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:43:51.083 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:43:51.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:43:51.083 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:43:51.138 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:43:51.215 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:43:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:43:51.218 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:43:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:43:51.226 INFO:teuthology.orchestra.run.smithi187.stdout:client6353 2024-09-10T07:43:51.227 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:43:51.227 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:43:51.263 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:43:51.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.421+0000 7f0f37400640 1 Processor -- start 2024-09-10T07:43:51.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.422+0000 7f0f37400640 1 -- start start 2024-09-10T07:43:51.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.423+0000 7f0f37400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f3013fae0 0x7f0f3006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:51.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.423+0000 7f0f37400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0f30142150 0x7f0f30160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:51.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.423+0000 7f0f37400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f30142650 con 0x7f0f30160a80 2024-09-10T07:43:51.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.423+0000 7f0f37400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0f300ce780 con 0x7f0f30142150 2024-09-10T07:43:51.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.423+0000 7f0f37400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0f30142930 con 0x7f0f3013fae0 2024-09-10T07:43:51.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.423+0000 7f0f35400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0f30160a80 0x7f0f3015cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36474/0 (socket says 172.21.15.99:36474) 2024-09-10T07:43:51.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.423+0000 7f0f35400640 1 -- 172.21.15.99:0/2904441032 learned_addr learned my addr 172.21.15.99:0/2904441032 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:43:51.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.423+0000 7f0f2fe00640 1 --2- 172.21.15.99:0/2904441032 >> v2:172.21.15.187:3300/0 conn(0x7f0f30142150 0x7f0f30160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:51.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.423+0000 7f0f34a00640 1 --2- 172.21.15.99:0/2904441032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f3013fae0 0x7f0f3006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.424+0000 7f0f2fe00640 1 -- 172.21.15.99:0/2904441032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f3013fae0 msgr2=0x7f0f3006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.424+0000 7f0f2fe00640 1 --2- 172.21.15.99:0/2904441032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f3013fae0 0x7f0f3006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.424+0000 7f0f2fe00640 1 -- 172.21.15.99:0/2904441032 >> v1:172.21.15.99:6789/0 conn(0x7f0f30160a80 legacy=0x7f0f3015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.424+0000 7f0f2fe00640 1 -- 172.21.15.99:0/2904441032 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f30142c10 con 0x7f0f30142150 2024-09-10T07:43:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.424+0000 7f0f2f400640 1 -- 172.21.15.99:0/2904441032 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862415413 0 0) 0x7f0f30142650 con 0x7f0f30160a80 2024-09-10T07:43:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.425+0000 7f0f2fe00640 1 --2- 172.21.15.99:0/2904441032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f30142150 0x7f0f30160540 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0097a0 tx=0x7f0f1c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2ca62a23efc6f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.425+0000 7f0f2f400640 1 -- 172.21.15.99:0/2904441032 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c037070 con 0x7f0f30142150 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.425+0000 7f0f2f400640 1 -- 172.21.15.99:0/2904441032 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1c02ae50 con 0x7f0f30142150 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.425+0000 7f0f2f400640 1 -- 172.21.15.99:0/2904441032 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c032660 con 0x7f0f30142150 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.425+0000 7f0f37400640 1 -- 172.21.15.99:0/2904441032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f30142150 msgr2=0x7f0f30160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.425+0000 7f0f37400640 1 --2- 172.21.15.99:0/2904441032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f30142150 0x7f0f30160540 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0097a0 tx=0x7f0f1c02a100 comp rx=0 tx=0).stop 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.426+0000 7f0f37400640 1 -- 172.21.15.99:0/2904441032 shutdown_connections 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.426+0000 7f0f37400640 1 --2- 172.21.15.99:0/2904441032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f30142150 0x7f0f30160540 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.426+0000 7f0f37400640 1 --2- 172.21.15.99:0/2904441032 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f3013fae0 0x7f0f3006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.426+0000 7f0f37400640 1 -- 172.21.15.99:0/2904441032 >> 172.21.15.99:0/2904441032 conn(0x7f0f3006bc10 msgr2=0x7f0f3006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.426+0000 7f0f37400640 1 -- 172.21.15.99:0/2904441032 shutdown_connections 2024-09-10T07:43:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.426+0000 7f0f37400640 1 -- 172.21.15.99:0/2904441032 wait complete. 2024-09-10T07:43:51.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.427+0000 7f0f37400640 1 Processor -- start 2024-09-10T07:43:51.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.427+0000 7f0f37400640 1 -- start start 2024-09-10T07:43:51.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.428+0000 7f0f37400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f3013fae0 0x7f0f3015a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:51.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.428+0000 7f0f37400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f30142150 0x7f0f3013ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:51.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.428+0000 7f0f37400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f30160a80 0x7f0f30143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:51.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.428+0000 7f0f37400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3006f870 con 0x7f0f30142150 2024-09-10T07:43:51.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.428+0000 7f0f37400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3006f6f0 con 0x7f0f30160a80 2024-09-10T07:43:51.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.428+0000 7f0f37400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0f300cfc20 con 0x7f0f3013fae0 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.428+0000 7f0f2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f30142150 0x7f0f3013ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.429+0000 7f0f2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f30142150 0x7f0f3013ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48764/0 (socket says 172.21.15.99:48764) 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.429+0000 7f0f2fe00640 1 -- 172.21.15.99:0/1532381946 learned_addr learned my addr 172.21.15.99:0/1532381946 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.429+0000 7f0f35400640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f30160a80 0x7f0f30143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.429+0000 7f0f34a00640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f3013fae0 0x7f0f3015a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.429+0000 7f0f2fe00640 1 -- 172.21.15.99:0/1532381946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f3013fae0 msgr2=0x7f0f3015a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.429+0000 7f0f2fe00640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f3013fae0 0x7f0f3015a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.429+0000 7f0f2fe00640 1 -- 172.21.15.99:0/1532381946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f30160a80 msgr2=0x7f0f30143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.429+0000 7f0f2fe00640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f30160a80 0x7f0f30143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.429+0000 7f0f2fe00640 1 -- 172.21.15.99:0/1532381946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3013f010 con 0x7f0f30142150 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.429+0000 7f0f2fe00640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f30142150 0x7f0f3013ead0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c035040 tx=0x7f0f1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.430+0000 7f0f2cc00640 1 -- 172.21.15.99:0/1532381946 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c041070 con 0x7f0f30142150 2024-09-10T07:43:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.430+0000 7f0f2cc00640 1 -- 172.21.15.99:0/1532381946 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1c03c460 con 0x7f0f30142150 2024-09-10T07:43:51.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.430+0000 7f0f2cc00640 1 -- 172.21.15.99:0/1532381946 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c037040 con 0x7f0f30142150 2024-09-10T07:43:51.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.430+0000 7f0f37400640 1 -- 172.21.15.99:0/1532381946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3015a6f0 con 0x7f0f30142150 2024-09-10T07:43:51.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.430+0000 7f0f37400640 1 -- 172.21.15.99:0/1532381946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3015acb0 con 0x7f0f30142150 2024-09-10T07:43:51.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.431+0000 7f0f37400640 1 -- 172.21.15.99:0/1532381946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3006f1b0 con 0x7f0f30142150 2024-09-10T07:43:51.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.432+0000 7f0f2cc00640 1 -- 172.21.15.99:0/1532381946 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f1c03a070 con 0x7f0f30142150 2024-09-10T07:43:51.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.432+0000 7f0f2cc00640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0f1006be30 0x7f0f1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:51.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.433+0000 7f0f2cc00640 1 -- 172.21.15.99:0/1532381946 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f0f1c0ab200 con 0x7f0f30142150 2024-09-10T07:43:51.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.433+0000 7f0f34a00640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0f1006be30 0x7f0f1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:51.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.433+0000 7f0f34a00640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0f1006be30 0x7f0f1006e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009b40 tx=0x7f0f20009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:51.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.437+0000 7f0f2cc00640 1 -- 172.21.15.99:0/1532381946 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f1c079560 con 0x7f0f30142150 2024-09-10T07:43:51.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.652+0000 7f0f37400640 1 -- 172.21.15.99:0/1532381946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f30144080 con 0x7f0f30142150 2024-09-10T07:43:51.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.652+0000 7f0f2cc00640 1 -- 172.21.15.99:0/1532381946 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5224 (secure 0 0 0) 0x7f0f1c07d860 con 0x7f0f30142150 2024-09-10T07:43:51.652 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:43:51.652 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"btime":"2024-09-10T07:43:45:462569+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/484957916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":484957916},{"type":"v1","addr":"172.21.15.99:6836","nonce":484957916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6967,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/837681918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":837681918},{"type":"v1","addr":"172.21.15.99:6837","nonce":837681918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3241210910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3241210910},{"type":"v1","addr":"172.21.15.187:6834","nonce":3241210910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:43:41.845115+0000","modified":"2024-09-10T07:43:44.869981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/274874285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":274874285},{"type":"v1","addr":"172.21.15.187:6835","nonce":274874285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7494,"qdb_cluster":[7494]},"id":10}]} 2024-09-10T07:43:51.653 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 82 2024-09-10T07:43:51.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 -- 172.21.15.99:0/1532381946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0f1006be30 msgr2=0x7f0f1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:51.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0f1006be30 0x7f0f1006e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009b40 tx=0x7f0f20009190 comp rx=0 tx=0).stop 2024-09-10T07:43:51.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 -- 172.21.15.99:0/1532381946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f30142150 msgr2=0x7f0f3013ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:51.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f30142150 0x7f0f3013ead0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c035040 tx=0x7f0f1c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:43:51.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 -- 172.21.15.99:0/1532381946 shutdown_connections 2024-09-10T07:43:51.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f30160a80 0x7f0f30143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:51.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0f1006be30 0x7f0f1006e2f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:51.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f30142150 0x7f0f3013ead0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:51.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 --2- 172.21.15.99:0/1532381946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f3013fae0 0x7f0f3015a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:51.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 -- 172.21.15.99:0/1532381946 >> 172.21.15.99:0/1532381946 conn(0x7f0f3006bc10 msgr2=0x7f0f3015f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:51.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 -- 172.21.15.99:0/1532381946 shutdown_connections 2024-09-10T07:43:51.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:51.655+0000 7f0f37400640 1 -- 172.21.15.99:0/1532381946 wait complete. 2024-09-10T07:43:51.671 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2024-09-10T07:43:51.846 INFO:teuthology.orchestra.run.smithi187.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":7494,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.3970064660000006,"mdsmap_epoch":82,"osdmap_epoch":171,"osdmap_epoch_barrier":171,"uptime":14.482969148} 2024-09-10T07:43:51.846 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 7494, "mdsmap_epoch": 82, "osdmap_epoch": 171, "osdmap_epoch_barrier": 171, "rank_uptime": 9.397006466, "state": "up:active", "uptime": 14.482969148, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:43:51.846 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-10T07:43:52.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.004+0000 7f5937e00640 1 Processor -- start 2024-09-10T07:43:52.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.004+0000 7f5937e00640 1 -- start start 2024-09-10T07:43:52.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.005+0000 7f5937e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59380afde0 0x7f593815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:52.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5937e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f59380cccf0 0x7f59380712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:52.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5937e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f593815d370 con 0x7f5938071810 2024-09-10T07:43:52.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5937e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f593815dc10 con 0x7f59380afde0 2024-09-10T07:43:52.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5937e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f593815d650 con 0x7f59380cccf0 2024-09-10T07:43:52.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5936a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59380afde0 0x7f593815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:52.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5936a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59380afde0 0x7f593815cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48772/0 (socket says 172.21.15.99:48772) 2024-09-10T07:43:52.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5936a00640 1 -- 172.21.15.99:0/1828666018 learned_addr learned my addr 172.21.15.99:0/1828666018 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:52.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5936000640 1 --2- 172.21.15.99:0/1828666018 >> v2:172.21.15.187:3300/0 conn(0x7f59380cccf0 0x7f59380712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:52.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5936a00640 1 -- 172.21.15.99:0/1828666018 >> v2:172.21.15.187:3300/0 conn(0x7f59380cccf0 msgr2=0x7f59380712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:52.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5936a00640 1 --2- 172.21.15.99:0/1828666018 >> v2:172.21.15.187:3300/0 conn(0x7f59380cccf0 0x7f59380712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:52.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5936a00640 1 -- 172.21.15.99:0/1828666018 >> v1:172.21.15.187:6789/0 conn(0x7f5938071810 legacy=0x7f593806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:43:52.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.006+0000 7f5936a00640 1 -- 172.21.15.99:0/1828666018 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593815d930 con 0x7f59380afde0 2024-09-10T07:43:52.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.007+0000 7f5936a00640 1 --2- 172.21.15.99:0/1828666018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380afde0 0x7f593815cce0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5938160190 tx=0x7f592802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771d787e8332e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:52.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.007+0000 7f5935600640 1 -- 172.21.15.99:0/1828666018 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5928037070 con 0x7f59380afde0 2024-09-10T07:43:52.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.008+0000 7f5935600640 1 -- 172.21.15.99:0/1828666018 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f592802ae20 con 0x7f59380afde0 2024-09-10T07:43:52.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.008+0000 7f5935600640 1 -- 172.21.15.99:0/1828666018 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5928032660 con 0x7f59380afde0 2024-09-10T07:43:52.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.008+0000 7f5937e00640 1 -- 172.21.15.99:0/1828666018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380afde0 msgr2=0x7f593815cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:52.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.008+0000 7f5937e00640 1 --2- 172.21.15.99:0/1828666018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380afde0 0x7f593815cce0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5938160190 tx=0x7f592802a110 comp rx=0 tx=0).stop 2024-09-10T07:43:52.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.008+0000 7f5937e00640 1 -- 172.21.15.99:0/1828666018 shutdown_connections 2024-09-10T07:43:52.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.008+0000 7f5937e00640 1 --2- 172.21.15.99:0/1828666018 >> v2:172.21.15.187:3300/0 conn(0x7f59380cccf0 0x7f59380712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:52.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.008+0000 7f5937e00640 1 --2- 172.21.15.99:0/1828666018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380afde0 0x7f593815cce0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:52.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.008+0000 7f5937e00640 1 -- 172.21.15.99:0/1828666018 >> 172.21.15.99:0/1828666018 conn(0x7f593806bc10 msgr2=0x7f593806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:52.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.008+0000 7f5937e00640 1 -- 172.21.15.99:0/1828666018 shutdown_connections 2024-09-10T07:43:52.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.008+0000 7f5937e00640 1 -- 172.21.15.99:0/1828666018 wait complete. 2024-09-10T07:43:52.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.010+0000 7f5937e00640 1 Processor -- start 2024-09-10T07:43:52.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.010+0000 7f5937e00640 1 -- start start 2024-09-10T07:43:52.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5938071810 0x7f5938145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:52.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59380afde0 0x7f5938146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:52.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380cccf0 0x7f5938148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:52.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f593806dfe0 con 0x7f59380cccf0 2024-09-10T07:43:52.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f59380cd180 con 0x7f59380afde0 2024-09-10T07:43:52.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f593806e160 con 0x7f5938071810 2024-09-10T07:43:52.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380cccf0 0x7f5938148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:52.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5936000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59380afde0 0x7f5938146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:52.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380cccf0 0x7f5938148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48776/0 (socket says 172.21.15.99:48776) 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937400640 1 -- 172.21.15.99:0/3020091923 learned_addr learned my addr 172.21.15.99:0/3020091923 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5936a00640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5938071810 0x7f5938145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937400640 1 -- 172.21.15.99:0/3020091923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5938071810 msgr2=0x7f5938145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937400640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5938071810 0x7f5938145770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937400640 1 -- 172.21.15.99:0/3020091923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59380afde0 msgr2=0x7f5938146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937400640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59380afde0 0x7f5938146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.011+0000 7f5937400640 1 -- 172.21.15.99:0/3020091923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5938146bb0 con 0x7f59380cccf0 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.012+0000 7f5937400640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380cccf0 0x7f5938148150 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f593000b970 tx=0x7f593000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.012+0000 7f592ea00640 1 -- 172.21.15.99:0/3020091923 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5930019070 con 0x7f59380cccf0 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.012+0000 7f592ea00640 1 -- 172.21.15.99:0/3020091923 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593000cae0 con 0x7f59380cccf0 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.012+0000 7f5937e00640 1 -- 172.21.15.99:0/3020091923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5938146e90 con 0x7f59380cccf0 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.012+0000 7f592ea00640 1 -- 172.21.15.99:0/3020091923 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5930014440 con 0x7f59380cccf0 2024-09-10T07:43:52.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.012+0000 7f5937e00640 1 -- 172.21.15.99:0/3020091923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5938147450 con 0x7f59380cccf0 2024-09-10T07:43:52.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.013+0000 7f5937e00640 1 -- 172.21.15.99:0/3020091923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593815cce0 con 0x7f59380cccf0 2024-09-10T07:43:52.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.014+0000 7f592ea00640 1 -- 172.21.15.99:0/3020091923 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f593001c070 con 0x7f59380cccf0 2024-09-10T07:43:52.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.015+0000 7f592ea00640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f591806be30 0x7f591806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:43:52.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.015+0000 7f592ea00640 1 -- 172.21.15.99:0/3020091923 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f593008ab00 con 0x7f59380cccf0 2024-09-10T07:43:52.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.015+0000 7f5936a00640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f591806be30 0x7f591806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:43:52.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.016+0000 7f5936a00640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f591806be30 0x7f591806e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5928034000 tx=0x7f592802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:43:52.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.019+0000 7f592ea00640 1 -- 172.21.15.99:0/3020091923 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5930058d30 con 0x7f59380cccf0 2024-09-10T07:43:52.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.196+0000 7f5937e00640 1 -- 172.21.15.99:0/3020091923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f59380aec30 con 0x7f59380cccf0 2024-09-10T07:43:52.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.494+0000 7f592ea00640 1 -- 172.21.15.99:0/3020091923 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v172) ==== 181+0+0 (secure 0 0 0) 0x7f593005d030 con 0x7f59380cccf0 2024-09-10T07:43:52.494 INFO:teuthology.orchestra.run.smithi099.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-10T07:43:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 -- 172.21.15.99:0/3020091923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f591806be30 msgr2=0x7f591806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f591806be30 0x7f591806e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5928034000 tx=0x7f592802e000 comp rx=0 tx=0).stop 2024-09-10T07:43:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 -- 172.21.15.99:0/3020091923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380cccf0 msgr2=0x7f5938148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:43:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380cccf0 0x7f5938148150 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f593000b970 tx=0x7f593000be30 comp rx=0 tx=0).stop 2024-09-10T07:43:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 -- 172.21.15.99:0/3020091923 shutdown_connections 2024-09-10T07:43:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f591806be30 0x7f591806e2f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59380cccf0 0x7f5938148150 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59380afde0 0x7f5938146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 --2- 172.21.15.99:0/3020091923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5938071810 0x7f5938145770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:43:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 -- 172.21.15.99:0/3020091923 >> 172.21.15.99:0/3020091923 conn(0x7f593806bc10 msgr2=0x7f593806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:43:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 -- 172.21.15.99:0/3020091923 shutdown_connections 2024-09-10T07:43:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:43:52.497+0000 7f5937e00640 1 -- 172.21.15.99:0/3020091923 wait complete. 2024-09-10T07:43:52.515 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-10T07:43:52.684 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_mon_report_interval":"5"} 2024-09-10T07:43:52.684 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-10T07:43:52.684 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-10T07:43:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:{"mon_tick_interval":"5"} 2024-09-10T07:43:52.847 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-10T07:43:52.847 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-10T07:43:52.847 DEBUG:teuthology.orchestra.run.smithi099:> stdin-killer -- python3 -c ' 2024-09-10T07:43:52.847 DEBUG:teuthology.orchestra.run.smithi099:> import time 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> import datetime 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> # Write some buffered data through before going full, all should be well 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> print("writing some data through which we expect to succeed") 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> bytes = 0 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(f) 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-10T07:43:52.848 DEBUG:teuthology.orchestra.run.smithi099:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> # buffered IO, the error should always only appear from fsync and not 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> # from write 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> full = False 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> for n in range(0, int(32 * 1.1)): 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> try: 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> except OSError as e: 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> if False: 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> raise 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> else: 2024-09-10T07:43:52.849 DEBUG:teuthology.orchestra.run.smithi099:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> full = True 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> break 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> try: 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> os.fsync(f) 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> print("fsync'"'"'ed successfully") 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> except OSError as e: 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> full = True 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> break 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> else: 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> if n > 32 * 0.9: 2024-09-10T07:43:52.850 DEBUG:teuthology.orchestra.run.smithi099:> # Be cautious in the last region where we expect to hit 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> time.sleep(15.0) 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> if not full: 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> # close() should not raise an error because we already caught it in 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> # since then because all IOs got cancelled on the full flag. 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> print("calling close") 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> os.close(f) 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> print("close() did not raise error") 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-10T07:43:52.851 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-10T07:44:18.163 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:44:18.169 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:44:48.258 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:44:48.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:44:57.675 INFO:teuthology.orchestra.run.smithi099.stdout:writing some data through which we expect to succeed 2024-09-10T07:44:57.675 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-10T07:44:57.675 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.675 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.675 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 1.00 MB 2024-09-10T07:44:57.675 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.675 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.675 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 2.00 MB 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 3.00 MB 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 4.00 MB 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 5.00 MB 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.676 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 6.00 MB 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 7.00 MB 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 8.00 MB 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 9.00 MB 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.677 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 10.00 MB 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 11.00 MB 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 12.00 MB 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 13.00 MB 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 14.00 MB 2024-09-10T07:44:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 15.00 MB 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 16.00 MB 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 17.00 MB 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 18.00 MB 2024-09-10T07:44:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 19.00 MB 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 20.00 MB 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 21.00 MB 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 22.00 MB 2024-09-10T07:44:57.680 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 23.00 MB 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 24.00 MB 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 25.00 MB 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 26.00 MB 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 27.00 MB 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 28.00 MB 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 29.00 MB 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.682 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 30.00 MB 2024-09-10T07:44:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:44:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 31.00 MB 2024-09-10T07:44:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:44:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 32.00 MB 2024-09-10T07:44:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:44:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-10T07:44:57.684 INFO:teuthology.orchestra.run.smithi099.stdout:fsync'ed successfully 2024-09-10T07:44:57.684 INFO:teuthology.orchestra.run.smithi099.stdout:Not full yet after 33.00 MB 2024-09-10T07:44:57.684 INFO:teuthology.orchestra.run.smithi099.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-10T07:44:57.684 INFO:teuthology.orchestra.run.smithi099.stdout:Reached fullness after 33.00 MB 2024-09-10T07:44:57.684 INFO:teuthology.orchestra.run.smithi099.stdout:calling close 2024-09-10T07:44:57.684 INFO:teuthology.orchestra.run.smithi099.stdout:close() did not raise error 2024-09-10T07:44:57.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:44:57.691 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:44:57.691 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:44:57.778 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:44:57.872 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:44:57.872 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:44:57.872 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:44:57.872 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:44:57.909 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:44:57.909 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:44:57.986 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:44:58.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.180+0000 7fa215600640 1 Processor -- start 2024-09-10T07:44:58.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.180+0000 7fa215600640 1 -- start start 2024-09-10T07:44:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa215600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa2100ce070 0x7fa2100b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa215600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa2100cf890 0x7fa2100cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa215600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa21015d880 con 0x7fa21015bfb0 2024-09-10T07:44:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa215600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa2100d0240 con 0x7fa2100cf890 2024-09-10T07:44:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa215600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa2100ce450 con 0x7fa2100ce070 2024-09-10T07:44:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa206000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa21015bfb0 0x7fa21015d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32830/0 (socket says 172.21.15.99:32830) 2024-09-10T07:44:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa206000640 1 -- 172.21.15.99:0/289032534 learned_addr learned my addr 172.21.15.99:0/289032534 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:44:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa20f400640 1 --2- 172.21.15.99:0/289032534 >> v2:172.21.15.99:3300/0 conn(0x7fa2100cf890 0x7fa2100cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa20ea00640 1 --2- 172.21.15.99:0/289032534 >> v2:172.21.15.187:3300/0 conn(0x7fa2100ce070 0x7fa2100b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa20e000640 1 -- 172.21.15.99:0/289032534 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147970335 0 0) 0x7fa21015d880 con 0x7fa21015bfb0 2024-09-10T07:44:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.182+0000 7fa20e000640 1 -- 172.21.15.99:0/289032534 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f4003520 con 0x7fa21015bfb0 2024-09-10T07:44:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.183+0000 7fa20f400640 1 -- 172.21.15.99:0/289032534 >> v2:172.21.15.187:3300/0 conn(0x7fa2100ce070 msgr2=0x7fa2100b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:44:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.183+0000 7fa20f400640 1 --2- 172.21.15.99:0/289032534 >> v2:172.21.15.187:3300/0 conn(0x7fa2100ce070 0x7fa2100b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.183+0000 7fa20f400640 1 -- 172.21.15.99:0/289032534 >> v1:172.21.15.99:6789/0 conn(0x7fa21015bfb0 legacy=0x7fa21015d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.183+0000 7fa20f400640 1 -- 172.21.15.99:0/289032534 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21015c800 con 0x7fa2100cf890 2024-09-10T07:44:58.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.183+0000 7fa20f400640 1 --2- 172.21.15.99:0/289032534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 0x7fa2100cfd00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa21006d030 tx=0x7fa20802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2973b569b1481ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:58.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa20e000640 1 -- 172.21.15.99:0/289032534 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa208007740 con 0x7fa2100cf890 2024-09-10T07:44:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa20e000640 1 -- 172.21.15.99:0/289032534 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2080078e0 con 0x7fa2100cf890 2024-09-10T07:44:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa20e000640 1 -- 172.21.15.99:0/289032534 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa208007c90 con 0x7fa2100cf890 2024-09-10T07:44:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa215600640 1 -- 172.21.15.99:0/289032534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 msgr2=0x7fa2100cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa215600640 1 --2- 172.21.15.99:0/289032534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 0x7fa2100cfd00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa21006d030 tx=0x7fa20802a680 comp rx=0 tx=0).stop 2024-09-10T07:44:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa215600640 1 -- 172.21.15.99:0/289032534 shutdown_connections 2024-09-10T07:44:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa215600640 1 --2- 172.21.15.99:0/289032534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 0x7fa2100cfd00 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa215600640 1 --2- 172.21.15.99:0/289032534 >> v2:172.21.15.187:3300/0 conn(0x7fa2100ce070 0x7fa2100b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa215600640 1 -- 172.21.15.99:0/289032534 >> 172.21.15.99:0/289032534 conn(0x7fa2100b2630 msgr2=0x7fa2100b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa215600640 1 -- 172.21.15.99:0/289032534 shutdown_connections 2024-09-10T07:44:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.184+0000 7fa215600640 1 -- 172.21.15.99:0/289032534 wait complete. 2024-09-10T07:44:58.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.186+0000 7fa215600640 1 Processor -- start 2024-09-10T07:44:58.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.186+0000 7fa215600640 1 -- start start 2024-09-10T07:44:58.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa215600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2100ce070 0x7fa21014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa215600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 0x7fa21014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa215600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa21015bfb0 0x7fa21014fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa215600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa21015c410 con 0x7fa2100cf890 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa215600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa21015cdc0 con 0x7fa2100ce070 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa215600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa21015c590 con 0x7fa21015bfb0 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa206000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 0x7fa21014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa206000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 0x7fa21014f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51792/0 (socket says 172.21.15.99:51792) 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa206000640 1 -- 172.21.15.99:0/381111773 learned_addr learned my addr 172.21.15.99:0/381111773 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa20ea00640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2100ce070 0x7fa21014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.187+0000 7fa20f400640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa21015bfb0 0x7fa21014fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa206000640 1 -- 172.21.15.99:0/381111773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa21015bfb0 msgr2=0x7fa21014fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa206000640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa21015bfb0 0x7fa21014fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa206000640 1 -- 172.21.15.99:0/381111773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2100ce070 msgr2=0x7fa21014c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa206000640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2100ce070 0x7fa21014c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa206000640 1 -- 172.21.15.99:0/381111773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa210151260 con 0x7fa2100cf890 2024-09-10T07:44:58.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa20f400640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa21015bfb0 0x7fa21014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:44:58.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa206000640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 0x7fa21014f7a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c430 tx=0x7fa1f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa207400640 1 -- 172.21.15.99:0/381111773 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8017070 con 0x7fa2100cf890 2024-09-10T07:44:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa207400640 1 -- 172.21.15.99:0/381111773 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f8005ce0 con 0x7fa2100cf890 2024-09-10T07:44:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa207400640 1 -- 172.21.15.99:0/381111773 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80072f0 con 0x7fa2100cf890 2024-09-10T07:44:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa215600640 1 -- 172.21.15.99:0/381111773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa210151b10 con 0x7fa2100cf890 2024-09-10T07:44:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.188+0000 7fa215600640 1 -- 172.21.15.99:0/381111773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2101520d0 con 0x7fa2100cf890 2024-09-10T07:44:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.189+0000 7fa215600640 1 -- 172.21.15.99:0/381111773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2100b5750 con 0x7fa2100cf890 2024-09-10T07:44:58.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.190+0000 7fa207400640 1 -- 172.21.15.99:0/381111773 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1f801a070 con 0x7fa2100cf890 2024-09-10T07:44:58.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.191+0000 7fa207400640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa1ec06be30 0x7fa1ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.191+0000 7fa207400640 1 -- 172.21.15.99:0/381111773 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5738+0+0 (secure 0 0 0) 0x7fa1f808a2b0 con 0x7fa2100cf890 2024-09-10T07:44:58.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.191+0000 7fa20ea00640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa1ec06be30 0x7fa1ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.192+0000 7fa207400640 1 -- 172.21.15.99:0/381111773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=176}) -- 0x7fa1ec0739c0 con 0x7fa2100cf890 2024-09-10T07:44:58.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.192+0000 7fa20ea00640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa1ec06be30 0x7fa1ec06e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa2000079a0 tx=0x7fa200008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:58.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.196+0000 7fa207400640 1 -- 172.21.15.99:0/381111773 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa210151260 con 0x7fa2100cf890 2024-09-10T07:44:58.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.381+0000 7fa215600640 1 -- 172.21.15.99:0/381111773 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa2100d0420 con 0x7fa2100cf890 2024-09-10T07:44:58.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.382+0000 7fa207400640 1 -- 172.21.15.99:0/381111773 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v175) ==== 80+0+0 (secure 0 0 0) 0x7fa1f80585e0 con 0x7fa2100cf890 2024-09-10T07:44:58.381 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:44:58.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 -- 172.21.15.99:0/381111773 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa1ec06be30 msgr2=0x7fa1ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa1ec06be30 0x7fa1ec06e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa2000079a0 tx=0x7fa200008040 comp rx=0 tx=0).stop 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 -- 172.21.15.99:0/381111773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 msgr2=0x7fa21014f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 0x7fa21014f7a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c430 tx=0x7fa1f800c8f0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 -- 172.21.15.99:0/381111773 shutdown_connections 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa21015bfb0 0x7fa21014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa1ec06be30 0x7fa1ec06e2f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2100cf890 0x7fa21014f7a0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 --2- 172.21.15.99:0/381111773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2100ce070 0x7fa21014c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 -- 172.21.15.99:0/381111773 >> 172.21.15.99:0/381111773 conn(0x7fa2100b2630 msgr2=0x7fa210153e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 -- 172.21.15.99:0/381111773 shutdown_connections 2024-09-10T07:44:58.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.384+0000 7fa215600640 1 -- 172.21.15.99:0/381111773 wait complete. 2024-09-10T07:44:58.399 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:44:58.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:44:58.400 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:44:58.465 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:44:58.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:44:58.465 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:44:58.502 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:44:58.503 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:44:58.503 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:44:58.547 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:44:58.547 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:44:58.625 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:44:58.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.781+0000 7fb326400640 1 Processor -- start 2024-09-10T07:44:58.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.781+0000 7fb326400640 1 -- start start 2024-09-10T07:44:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb326400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb32006e040 0x7fb32006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb326400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb3200ce8d0 0x7fb3200ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb326400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb320153e50 con 0x7fb32015db60 2024-09-10T07:44:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb326400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb32015df40 con 0x7fb32006e040 2024-09-10T07:44:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb326400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb32006e9d0 con 0x7fb3200ce8d0 2024-09-10T07:44:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb31f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb32015db60 0x7fb320071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:32838/0 (socket says 172.21.15.99:32838) 2024-09-10T07:44:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb31f400640 1 -- 172.21.15.99:0/3626104855 learned_addr learned my addr 172.21.15.99:0/3626104855 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:44:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb316a00640 1 --2- 172.21.15.99:0/3626104855 >> v2:172.21.15.99:3300/0 conn(0x7fb32006e040 0x7fb32006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb31fe00640 1 --2- 172.21.15.99:0/3626104855 >> v2:172.21.15.187:3300/0 conn(0x7fb3200ce8d0 0x7fb3200ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb31ea00640 1 -- 172.21.15.99:0/3626104855 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563183894 0 0) 0x7fb320153e50 con 0x7fb32015db60 2024-09-10T07:44:58.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.783+0000 7fb31ea00640 1 -- 172.21.15.99:0/3626104855 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb304003520 con 0x7fb32015db60 2024-09-10T07:44:58.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.784+0000 7fb316a00640 1 -- 172.21.15.99:0/3626104855 >> v2:172.21.15.187:3300/0 conn(0x7fb3200ce8d0 msgr2=0x7fb3200ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:44:58.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.784+0000 7fb316a00640 1 --2- 172.21.15.99:0/3626104855 >> v2:172.21.15.187:3300/0 conn(0x7fb3200ce8d0 0x7fb3200ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.784+0000 7fb316a00640 1 -- 172.21.15.99:0/3626104855 >> v1:172.21.15.99:6789/0 conn(0x7fb32015db60 legacy=0x7fb320071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.784+0000 7fb316a00640 1 -- 172.21.15.99:0/3626104855 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb320072ac0 con 0x7fb32006e040 2024-09-10T07:44:58.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.785+0000 7fb316a00640 1 --2- 172.21.15.99:0/3626104855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32006e040 0x7fb32006e490 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fb32006ed50 tx=0x7fb30802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef93557e2559f84d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:58.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.785+0000 7fb31ea00640 1 -- 172.21.15.99:0/3626104855 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308037070 con 0x7fb32006e040 2024-09-10T07:44:58.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.785+0000 7fb31ea00640 1 -- 172.21.15.99:0/3626104855 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb308032440 con 0x7fb32006e040 2024-09-10T07:44:58.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.785+0000 7fb31ea00640 1 -- 172.21.15.99:0/3626104855 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308032810 con 0x7fb32006e040 2024-09-10T07:44:58.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.785+0000 7fb326400640 1 -- 172.21.15.99:0/3626104855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32006e040 msgr2=0x7fb32006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.785+0000 7fb326400640 1 --2- 172.21.15.99:0/3626104855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32006e040 0x7fb32006e490 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fb32006ed50 tx=0x7fb30802a1a0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.785+0000 7fb326400640 1 -- 172.21.15.99:0/3626104855 shutdown_connections 2024-09-10T07:44:58.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.785+0000 7fb326400640 1 --2- 172.21.15.99:0/3626104855 >> v2:172.21.15.187:3300/0 conn(0x7fb3200ce8d0 0x7fb3200ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.785+0000 7fb326400640 1 --2- 172.21.15.99:0/3626104855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32006e040 0x7fb32006e490 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.785+0000 7fb326400640 1 -- 172.21.15.99:0/3626104855 >> 172.21.15.99:0/3626104855 conn(0x7fb3200b2630 msgr2=0x7fb3200b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:58.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.786+0000 7fb326400640 1 -- 172.21.15.99:0/3626104855 shutdown_connections 2024-09-10T07:44:58.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.786+0000 7fb326400640 1 -- 172.21.15.99:0/3626104855 wait complete. 2024-09-10T07:44:58.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.787+0000 7fb326400640 1 Processor -- start 2024-09-10T07:44:58.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.787+0000 7fb326400640 1 -- start start 2024-09-10T07:44:58.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.788+0000 7fb326400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb32006e040 0x7fb32015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.788+0000 7fb326400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3200ce8d0 0x7fb3201e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.788+0000 7fb326400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32015db60 0x7fb3200ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.788+0000 7fb326400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb320073640 con 0x7fb32015db60 2024-09-10T07:44:58.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.788+0000 7fb326400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb320073360 con 0x7fb32006e040 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.788+0000 7fb326400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb32015d1c0 con 0x7fb3200ce8d0 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.788+0000 7fb31fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32015db60 0x7fb3200ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31f400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb32006e040 0x7fb32015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31f400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb32006e040 0x7fb32015b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:34812/0 (socket says 172.21.15.99:34812) 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31f400640 1 -- 172.21.15.99:0/2117444620 learned_addr learned my addr 172.21.15.99:0/2117444620 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb316a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3200ce8d0 0x7fb3201e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31fe00640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32015db60 0x7fb3200ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51814/0 (socket says 172.21.15.99:51814) 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31f400640 1 -- 172.21.15.99:0/2117444620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3200ce8d0 msgr2=0x7fb3201e80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31f400640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3200ce8d0 0x7fb3201e80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31f400640 1 -- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32015db60 msgr2=0x7fb3200ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31f400640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32015db60 0x7fb3200ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31f400640 1 -- 172.21.15.99:0/2117444620 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3200c67f0 con 0x7fb32006e040 2024-09-10T07:44:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31fe00640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32015db60 0x7fb3200ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:44:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.789+0000 7fb31f400640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb32006e040 0x7fb32015b340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c390 tx=0x7fb31000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.790+0000 7fb317e00640 1 -- 172.21.15.99:0/2117444620 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310017070 con 0x7fb32006e040 2024-09-10T07:44:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.790+0000 7fb317e00640 1 -- 172.21.15.99:0/2117444620 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb310005ce0 con 0x7fb32006e040 2024-09-10T07:44:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.790+0000 7fb326400640 1 -- 172.21.15.99:0/2117444620 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3201e8b90 con 0x7fb32006e040 2024-09-10T07:44:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.790+0000 7fb317e00640 1 -- 172.21.15.99:0/2117444620 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3100072f0 con 0x7fb32006e040 2024-09-10T07:44:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.790+0000 7fb326400640 1 -- 172.21.15.99:0/2117444620 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3201e9150 con 0x7fb32006e040 2024-09-10T07:44:58.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.791+0000 7fb326400640 1 -- 172.21.15.99:0/2117444620 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3201e9490 con 0x7fb32006e040 2024-09-10T07:44:58.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.792+0000 7fb317e00640 1 -- 172.21.15.99:0/2117444620 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb31001a070 con 0x7fb32006e040 2024-09-10T07:44:58.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.793+0000 7fb317e00640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2fc06be60 0x7fb2fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:58.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.793+0000 7fb317e00640 1 -- 172.21.15.99:0/2117444620 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5738+0+0 (secure 0 0 0) 0x7fb31008a270 con 0x7fb32006e040 2024-09-10T07:44:58.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.793+0000 7fb316a00640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2fc06be60 0x7fb2fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:58.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.793+0000 7fb317e00640 1 -- 172.21.15.99:0/2117444620 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=176}) -- 0x7fb2fc0739f0 con 0x7fb32006e040 2024-09-10T07:44:58.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.794+0000 7fb316a00640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2fc06be60 0x7fb2fc06e320 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb308034000 tx=0x7fb30802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:58.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.798+0000 7fb317e00640 1 -- 172.21.15.99:0/2117444620 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb310058520 con 0x7fb32006e040 2024-09-10T07:44:58.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.984+0000 7fb326400640 1 -- 172.21.15.99:0/2117444620 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb32006e490 con 0x7fb32006e040 2024-09-10T07:44:58.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.985+0000 7fb317e00640 1 -- 172.21.15.99:0/2117444620 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v175) ==== 80+0+0 (secure 0 0 0) 0x7fb31005c820 con 0x7fb32006e040 2024-09-10T07:44:58.985 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.987+0000 7fb326400640 1 -- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2fc06be60 msgr2=0x7fb2fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.987+0000 7fb326400640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2fc06be60 0x7fb2fc06e320 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb308034000 tx=0x7fb30802e000 comp rx=0 tx=0).stop 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.987+0000 7fb326400640 1 -- 172.21.15.99:0/2117444620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb32006e040 msgr2=0x7fb32015b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.987+0000 7fb326400640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb32006e040 0x7fb32015b340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c390 tx=0x7fb31000c850 comp rx=0 tx=0).stop 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.988+0000 7fb326400640 1 -- 172.21.15.99:0/2117444620 shutdown_connections 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.988+0000 7fb326400640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb2fc06be60 0x7fb2fc06e320 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.988+0000 7fb326400640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb32015db60 0x7fb3200ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.988+0000 7fb326400640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3200ce8d0 0x7fb3201e80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.988+0000 7fb326400640 1 --2- 172.21.15.99:0/2117444620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb32006e040 0x7fb32015b340 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.988+0000 7fb326400640 1 -- 172.21.15.99:0/2117444620 >> 172.21.15.99:0/2117444620 conn(0x7fb3200b2630 msgr2=0x7fb32015fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.988+0000 7fb326400640 1 -- 172.21.15.99:0/2117444620 shutdown_connections 2024-09-10T07:44:58.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:58.988+0000 7fb326400640 1 -- 172.21.15.99:0/2117444620 wait complete. 2024-09-10T07:44:59.004 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:44:59.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:44:59.005 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T07:44:59.071 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:44:59.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:44:59.071 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:44:59.108 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:44:59.108 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:44:59.108 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:44:59.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:44:59.144 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:44:59.145 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:44:59.145 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:44:59.183 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:44:59.184 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:44:59.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.337+0000 7f7212200640 1 Processor -- start 2024-09-10T07:44:59.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.337+0000 7f7212200640 1 -- start start 2024-09-10T07:44:59.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.338+0000 7f7212200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f720c15eab0 0x7f720c0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.338+0000 7f7212200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720c070b40 0x7f720c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.338+0000 7f7212200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f720c0d3710 con 0x7f720c06d260 2024-09-10T07:44:59.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.338+0000 7f7212200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f720c0b6390 con 0x7f720c15eab0 2024-09-10T07:44:59.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.338+0000 7f7212200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f720c0b6670 con 0x7f720c070b40 2024-09-10T07:44:59.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.338+0000 7f7210e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f720c15eab0 0x7f720c0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.338+0000 7f7210e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f720c15eab0 0x7f720c0b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51828/0 (socket says 172.21.15.99:51828) 2024-09-10T07:44:59.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.338+0000 7f7210e00640 1 -- 172.21.15.99:0/588981850 learned_addr learned my addr 172.21.15.99:0/588981850 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:44:59.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.339+0000 7f720be00640 1 --2- 172.21.15.99:0/588981850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720c070b40 0x7f720c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.339+0000 7f7210e00640 1 -- 172.21.15.99:0/588981850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720c070b40 msgr2=0x7f720c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:44:59.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.339+0000 7f7210e00640 1 --2- 172.21.15.99:0/588981850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720c070b40 0x7f720c06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.339+0000 7f7210e00640 1 -- 172.21.15.99:0/588981850 >> v1:172.21.15.187:6789/0 conn(0x7f720c06d260 legacy=0x7f720c0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.339+0000 7f7210e00640 1 -- 172.21.15.99:0/588981850 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720c0b6950 con 0x7f720c15eab0 2024-09-10T07:44:59.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.340+0000 7f7210e00640 1 --2- 172.21.15.99:0/588981850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c15eab0 0x7f720c0b1c40 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f72000098a0 tx=0x7f720002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d8e168360a0b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.340+0000 7f720b400640 1 -- 172.21.15.99:0/588981850 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200037070 con 0x7f720c15eab0 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.340+0000 7f720b400640 1 -- 172.21.15.99:0/588981850 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7200032440 con 0x7f720c15eab0 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.340+0000 7f720b400640 1 -- 172.21.15.99:0/588981850 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200032810 con 0x7f720c15eab0 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.340+0000 7f7212200640 1 -- 172.21.15.99:0/588981850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c15eab0 msgr2=0x7f720c0b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.341+0000 7f7212200640 1 --2- 172.21.15.99:0/588981850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c15eab0 0x7f720c0b1c40 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f72000098a0 tx=0x7f720002a160 comp rx=0 tx=0).stop 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.341+0000 7f7212200640 1 -- 172.21.15.99:0/588981850 shutdown_connections 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.341+0000 7f7212200640 1 --2- 172.21.15.99:0/588981850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720c070b40 0x7f720c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.341+0000 7f7212200640 1 --2- 172.21.15.99:0/588981850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c15eab0 0x7f720c0b1c40 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.341+0000 7f7212200640 1 -- 172.21.15.99:0/588981850 >> 172.21.15.99:0/588981850 conn(0x7f720c0b7cc0 msgr2=0x7f720c0b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.341+0000 7f7212200640 1 -- 172.21.15.99:0/588981850 shutdown_connections 2024-09-10T07:44:59.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.341+0000 7f7212200640 1 -- 172.21.15.99:0/588981850 wait complete. 2024-09-10T07:44:59.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.342+0000 7f7212200640 1 Processor -- start 2024-09-10T07:44:59.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.343+0000 7f7212200640 1 -- start start 2024-09-10T07:44:59.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.343+0000 7f7212200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c06d260 0x7f720c15d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.343+0000 7f7212200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720c070b40 0x7f720c09cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.343+0000 7f7212200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f720c15eab0 0x7f720c0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.343+0000 7f7212200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f720c15ee90 con 0x7f720c06d260 2024-09-10T07:44:59.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.343+0000 7f7212200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f720c0b7860 con 0x7f720c15eab0 2024-09-10T07:44:59.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.343+0000 7f7212200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f720c0a0540 con 0x7f720c070b40 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f7210e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c06d260 0x7f720c15d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f7210e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c06d260 0x7f720c15d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51844/0 (socket says 172.21.15.99:51844) 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f7210e00640 1 -- 172.21.15.99:0/530513247 learned_addr learned my addr 172.21.15.99:0/530513247 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f720be00640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720c070b40 0x7f720c09cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f7211800640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f720c15eab0 0x7f720c0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f7210e00640 1 -- 172.21.15.99:0/530513247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720c070b40 msgr2=0x7f720c09cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f7210e00640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720c070b40 0x7f720c09cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f7210e00640 1 -- 172.21.15.99:0/530513247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f720c15eab0 msgr2=0x7f720c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f7210e00640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f720c15eab0 0x7f720c0cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f7210e00640 1 -- 172.21.15.99:0/530513247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720c0a0820 con 0x7f720c06d260 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.344+0000 7f7210e00640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c06d260 0x7f720c15d770 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f72000098a0 tx=0x7f72000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.345+0000 7f7208c00640 1 -- 172.21.15.99:0/530513247 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200041070 con 0x7f720c06d260 2024-09-10T07:44:59.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.345+0000 7f7208c00640 1 -- 172.21.15.99:0/530513247 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f720003c870 con 0x7f720c06d260 2024-09-10T07:44:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.345+0000 7f7212200640 1 -- 172.21.15.99:0/530513247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720c0cbbc0 con 0x7f720c06d260 2024-09-10T07:44:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.345+0000 7f7208c00640 1 -- 172.21.15.99:0/530513247 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200037040 con 0x7f720c06d260 2024-09-10T07:44:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.345+0000 7f7212200640 1 -- 172.21.15.99:0/530513247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f720c0cc180 con 0x7f720c06d260 2024-09-10T07:44:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.346+0000 7f7212200640 1 -- 172.21.15.99:0/530513247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f720c0d3230 con 0x7f720c06d260 2024-09-10T07:44:59.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.347+0000 7f7208c00640 1 -- 172.21.15.99:0/530513247 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7200044070 con 0x7f720c06d260 2024-09-10T07:44:59.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.348+0000 7f7208c00640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f71ec06be30 0x7f71ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.348+0000 7f7208c00640 1 -- 172.21.15.99:0/530513247 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5738+0+0 (secure 0 0 0) 0x7f72000ab860 con 0x7f720c06d260 2024-09-10T07:44:59.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.348+0000 7f720be00640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f71ec06be30 0x7f71ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.348+0000 7f7208c00640 1 -- 172.21.15.99:0/530513247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=176}) -- 0x7f71ec0739c0 con 0x7f720c06d260 2024-09-10T07:44:59.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.349+0000 7f720be00640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f71ec06be30 0x7f71ec06e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f720c1f1fa0 tx=0x7f71f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:59.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.352+0000 7f7208c00640 1 -- 172.21.15.99:0/530513247 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7200079b00 con 0x7f720c06d260 2024-09-10T07:44:59.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.558+0000 7f7212200640 1 -- 172.21.15.99:0/530513247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f720c0b33b0 con 0x7f720c06d260 2024-09-10T07:44:59.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.558+0000 7f7208c00640 1 -- 172.21.15.99:0/530513247 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5224 (secure 0 0 0) 0x7f720007de00 con 0x7f720c06d260 2024-09-10T07:44:59.558 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:44:59.558 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"btime":"2024-09-10T07:43:45:462569+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/484957916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":484957916},{"type":"v1","addr":"172.21.15.99:6836","nonce":484957916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6967,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/837681918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":837681918},{"type":"v1","addr":"172.21.15.99:6837","nonce":837681918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3241210910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3241210910},{"type":"v1","addr":"172.21.15.187:6834","nonce":3241210910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:43:41.845115+0000","modified":"2024-09-10T07:43:44.869981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/274874285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":274874285},{"type":"v1","addr":"172.21.15.187:6835","nonce":274874285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7494,"qdb_cluster":[7494]},"id":10}]} 2024-09-10T07:44:59.558 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 82 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.560+0000 7f7212200640 1 -- 172.21.15.99:0/530513247 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f71ec06be30 msgr2=0x7f71ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.560+0000 7f7212200640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f71ec06be30 0x7f71ec06e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f720c1f1fa0 tx=0x7f71f8008040 comp rx=0 tx=0).stop 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.560+0000 7f7212200640 1 -- 172.21.15.99:0/530513247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c06d260 msgr2=0x7f720c15d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.560+0000 7f7212200640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c06d260 0x7f720c15d770 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f72000098a0 tx=0x7f72000046c0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.561+0000 7f7212200640 1 -- 172.21.15.99:0/530513247 shutdown_connections 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.561+0000 7f7212200640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f720c15eab0 0x7f720c0cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.561+0000 7f7212200640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f720c070b40 0x7f720c09cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.561+0000 7f7212200640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f71ec06be30 0x7f71ec06e2f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.561+0000 7f7212200640 1 --2- 172.21.15.99:0/530513247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f720c06d260 0x7f720c15d770 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.561+0000 7f7212200640 1 -- 172.21.15.99:0/530513247 >> 172.21.15.99:0/530513247 conn(0x7f720c0b7cc0 msgr2=0x7f720c1611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.561+0000 7f7212200640 1 -- 172.21.15.99:0/530513247 shutdown_connections 2024-09-10T07:44:59.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.561+0000 7f7212200640 1 -- 172.21.15.99:0/530513247 wait complete. 2024-09-10T07:44:59.576 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:44:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.731+0000 7fa110e00640 1 Processor -- start 2024-09-10T07:44:59.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.731+0000 7fa110e00640 1 -- start start 2024-09-10T07:44:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.732+0000 7fa110e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa10c072f40 0x7fa10c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.732+0000 7fa110e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c0ce780 0x7fa10c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.732+0000 7fa110e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10c06e3d0 con 0x7fa10c145290 2024-09-10T07:44:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.732+0000 7fa110e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa10c06efe0 con 0x7fa10c072f40 2024-09-10T07:44:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.732+0000 7fa110e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa10c06e6b0 con 0x7fa10c0ce780 2024-09-10T07:44:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.732+0000 7fa101400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa10c072f40 0x7fa10c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.732+0000 7fa101400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa10c072f40 0x7fa10c06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51852/0 (socket says 172.21.15.99:51852) 2024-09-10T07:44:59.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.732+0000 7fa101400640 1 -- 172.21.15.99:0/3901500571 learned_addr learned my addr 172.21.15.99:0/3901500571 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:44:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.733+0000 7fa10a800640 1 --2- 172.21.15.99:0/3901500571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c0ce780 0x7fa10c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.733+0000 7fa101400640 1 -- 172.21.15.99:0/3901500571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c0ce780 msgr2=0x7fa10c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:44:59.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.733+0000 7fa101400640 1 --2- 172.21.15.99:0/3901500571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c0ce780 0x7fa10c0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.733+0000 7fa101400640 1 -- 172.21.15.99:0/3901500571 >> v1:172.21.15.187:6789/0 conn(0x7fa10c145290 legacy=0x7fa10c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:44:59.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.733+0000 7fa101400640 1 -- 172.21.15.99:0/3901500571 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c06e990 con 0x7fa10c072f40 2024-09-10T07:44:59.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.733+0000 7fa10a800640 1 --2- 172.21.15.99:0/3901500571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c0ce780 0x7fa10c0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:44:59.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.734+0000 7fa101400640 1 --2- 172.21.15.99:0/3901500571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c072f40 0x7fa10c06f470 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa10c06f160 tx=0x7fa0f402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7034a5c16035b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:59.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.734+0000 7fa109400640 1 -- 172.21.15.99:0/3901500571 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4037070 con 0x7fa10c072f40 2024-09-10T07:44:59.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.734+0000 7fa109400640 1 -- 172.21.15.99:0/3901500571 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f4032440 con 0x7fa10c072f40 2024-09-10T07:44:59.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.734+0000 7fa109400640 1 -- 172.21.15.99:0/3901500571 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4032810 con 0x7fa10c072f40 2024-09-10T07:44:59.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.734+0000 7fa110e00640 1 -- 172.21.15.99:0/3901500571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c072f40 msgr2=0x7fa10c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.734+0000 7fa110e00640 1 --2- 172.21.15.99:0/3901500571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c072f40 0x7fa10c06f470 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa10c06f160 tx=0x7fa0f402a200 comp rx=0 tx=0).stop 2024-09-10T07:44:59.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.735+0000 7fa110e00640 1 -- 172.21.15.99:0/3901500571 shutdown_connections 2024-09-10T07:44:59.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.735+0000 7fa110e00640 1 --2- 172.21.15.99:0/3901500571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c0ce780 0x7fa10c0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.735+0000 7fa110e00640 1 --2- 172.21.15.99:0/3901500571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c072f40 0x7fa10c06f470 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.735+0000 7fa110e00640 1 -- 172.21.15.99:0/3901500571 >> 172.21.15.99:0/3901500571 conn(0x7fa10c06bc10 msgr2=0x7fa10c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:59.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.735+0000 7fa110e00640 1 -- 172.21.15.99:0/3901500571 shutdown_connections 2024-09-10T07:44:59.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.735+0000 7fa110e00640 1 -- 172.21.15.99:0/3901500571 wait complete. 2024-09-10T07:44:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.736+0000 7fa110e00640 1 Processor -- start 2024-09-10T07:44:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.736+0000 7fa110e00640 1 -- start start 2024-09-10T07:44:59.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.737+0000 7fa110e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa10c072f40 0x7fa10c0abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.737+0000 7fa110e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c0ce780 0x7fa10c0af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.737+0000 7fa110e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c145290 0x7fa10c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.737+0000 7fa110e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c06df80 con 0x7fa10c0ce780 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.737+0000 7fa110e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c145670 con 0x7fa10c072f40 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.737+0000 7fa110e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa10c06e100 con 0x7fa10c145290 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.737+0000 7fa101400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c0ce780 0x7fa10c0af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa101400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c0ce780 0x7fa10c0af0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51860/0 (socket says 172.21.15.99:51860) 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa101400640 1 -- 172.21.15.99:0/3394020454 learned_addr learned my addr 172.21.15.99:0/3394020454 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa10a800640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c145290 0x7fa10c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa109e00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa10c072f40 0x7fa10c0abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa101400640 1 -- 172.21.15.99:0/3394020454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c145290 msgr2=0x7fa10c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa101400640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c145290 0x7fa10c0aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa101400640 1 -- 172.21.15.99:0/3394020454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa10c072f40 msgr2=0x7fa10c0abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa101400640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa10c072f40 0x7fa10c0abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa101400640 1 -- 172.21.15.99:0/3394020454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c0afaf0 con 0x7fa10c0ce780 2024-09-10T07:44:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa109e00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa10c072f40 0x7fa10c0abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:44:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa101400640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c0ce780 0x7fa10c0af0a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4000c00 tx=0x7fa0f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:59.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.738+0000 7fa102a00640 1 -- 172.21.15.99:0/3394020454 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4041020 con 0x7fa10c0ce780 2024-09-10T07:44:59.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.739+0000 7fa102a00640 1 -- 172.21.15.99:0/3394020454 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f4030970 con 0x7fa10c0ce780 2024-09-10T07:44:59.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.739+0000 7fa102a00640 1 -- 172.21.15.99:0/3394020454 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4037040 con 0x7fa10c0ce780 2024-09-10T07:44:59.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.739+0000 7fa110e00640 1 -- 172.21.15.99:0/3394020454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10c0afdd0 con 0x7fa10c0ce780 2024-09-10T07:44:59.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.739+0000 7fa110e00640 1 -- 172.21.15.99:0/3394020454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10c1423f0 con 0x7fa10c0ce780 2024-09-10T07:44:59.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.740+0000 7fa110e00640 1 -- 172.21.15.99:0/3394020454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10c0b02f0 con 0x7fa10c0ce780 2024-09-10T07:44:59.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.741+0000 7fa102a00640 1 -- 172.21.15.99:0/3394020454 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0f4044020 con 0x7fa10c0ce780 2024-09-10T07:44:59.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.742+0000 7fa102a00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0e806be30 0x7fa0e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:44:59.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.742+0000 7fa102a00640 1 -- 172.21.15.99:0/3394020454 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5738+0+0 (secure 0 0 0) 0x7fa0f40ab810 con 0x7fa10c0ce780 2024-09-10T07:44:59.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.742+0000 7fa109e00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0e806be30 0x7fa0e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:44:59.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.742+0000 7fa102a00640 1 -- 172.21.15.99:0/3394020454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=176}) -- 0x7fa0e80739c0 con 0x7fa10c0ce780 2024-09-10T07:44:59.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.743+0000 7fa109e00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0e806be30 0x7fa0e806e2f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0aee90 tx=0x7fa0fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:44:59.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.746+0000 7fa102a00640 1 -- 172.21.15.99:0/3394020454 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa10c0b02f0 con 0x7fa10c0ce780 2024-09-10T07:44:59.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.954+0000 7fa110e00640 1 -- 172.21.15.99:0/3394020454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa10c071510 con 0x7fa10c0ce780 2024-09-10T07:44:59.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.955+0000 7fa102a00640 1 -- 172.21.15.99:0/3394020454 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5224 (secure 0 0 0) 0x7fa0f404b030 con 0x7fa10c0ce780 2024-09-10T07:44:59.955 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:44:59.955 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"btime":"2024-09-10T07:43:45:462569+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/484957916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":484957916},{"type":"v1","addr":"172.21.15.99:6836","nonce":484957916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6967,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/837681918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":837681918},{"type":"v1","addr":"172.21.15.99:6837","nonce":837681918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3241210910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3241210910},{"type":"v1","addr":"172.21.15.187:6834","nonce":3241210910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:43:41.845115+0000","modified":"2024-09-10T07:43:44.869981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/274874285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":274874285},{"type":"v1","addr":"172.21.15.187:6835","nonce":274874285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7494,"qdb_cluster":[7494]},"id":10}]} 2024-09-10T07:44:59.955 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 82 2024-09-10T07:44:59.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 -- 172.21.15.99:0/3394020454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0e806be30 msgr2=0x7fa0e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0e806be30 0x7fa0e806e2f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0aee90 tx=0x7fa0fc009040 comp rx=0 tx=0).stop 2024-09-10T07:44:59.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 -- 172.21.15.99:0/3394020454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c0ce780 msgr2=0x7fa10c0af0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:44:59.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c0ce780 0x7fa10c0af0a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4000c00 tx=0x7fa0f40046c0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 -- 172.21.15.99:0/3394020454 shutdown_connections 2024-09-10T07:44:59.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa10c145290 0x7fa10c0aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa0e806be30 0x7fa0e806e2f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa10c0ce780 0x7fa10c0af0a0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 --2- 172.21.15.99:0/3394020454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa10c072f40 0x7fa10c0abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:44:59.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 -- 172.21.15.99:0/3394020454 >> 172.21.15.99:0/3394020454 conn(0x7fa10c06bc10 msgr2=0x7fa10c0b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:44:59.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.957+0000 7fa110e00640 1 -- 172.21.15.99:0/3394020454 shutdown_connections 2024-09-10T07:44:59.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:44:59.958+0000 7fa110e00640 1 -- 172.21.15.99:0/3394020454 wait complete. 2024-09-10T07:44:59.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:45:00.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.128+0000 7f60e6c00640 1 Processor -- start 2024-09-10T07:45:00.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.128+0000 7f60e6c00640 1 -- start start 2024-09-10T07:45:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60e6c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f60e0145290 0x7f60e006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60e6c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f60e00ce780 0x7f60e0072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60e6c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60e006e3d0 con 0x7f60e0071510 2024-09-10T07:45:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60e6c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f60e006efe0 con 0x7f60e0145290 2024-09-10T07:45:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60e6c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f60e006e6b0 con 0x7f60e00ce780 2024-09-10T07:45:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60dfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f60e0145290 0x7f60e006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60dfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f60e0145290 0x7f60e006f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60592/0 (socket says 172.21.15.99:60592) 2024-09-10T07:45:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60dfe00640 1 -- 172.21.15.99:0/891145626 learned_addr learned my addr 172.21.15.99:0/891145626 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60dfe00640 1 -- 172.21.15.99:0/891145626 >> v2:172.21.15.187:3300/0 conn(0x7f60e00ce780 msgr2=0x7f60e0072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60df400640 1 --2- 172.21.15.99:0/891145626 >> v2:172.21.15.187:3300/0 conn(0x7f60e00ce780 0x7f60e0072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60dfe00640 1 --2- 172.21.15.99:0/891145626 >> v2:172.21.15.187:3300/0 conn(0x7f60e00ce780 0x7f60e0072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60dfe00640 1 -- 172.21.15.99:0/891145626 >> v1:172.21.15.187:6789/0 conn(0x7f60e0071510 legacy=0x7f60e00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60dfe00640 1 -- 172.21.15.99:0/891145626 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e006e990 con 0x7f60e0145290 2024-09-10T07:45:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.130+0000 7f60df400640 1 --2- 172.21.15.99:0/891145626 >> v2:172.21.15.187:3300/0 conn(0x7f60e00ce780 0x7f60e0072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.131+0000 7f60dfe00640 1 --2- 172.21.15.99:0/891145626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e0145290 0x7f60e006f470 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f60e006d450 tx=0x7f60d002c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac096c2c8d16c805 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60dea00640 1 -- 172.21.15.99:0/891145626 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0033610 con 0x7f60e0145290 2024-09-10T07:45:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60dea00640 1 -- 172.21.15.99:0/891145626 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60d00337b0 con 0x7f60e0145290 2024-09-10T07:45:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60dea00640 1 -- 172.21.15.99:0/891145626 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0033b80 con 0x7f60e0145290 2024-09-10T07:45:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60e6c00640 1 -- 172.21.15.99:0/891145626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e0145290 msgr2=0x7f60e006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60e6c00640 1 --2- 172.21.15.99:0/891145626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e0145290 0x7f60e006f470 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f60e006d450 tx=0x7f60d002c900 comp rx=0 tx=0).stop 2024-09-10T07:45:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60e6c00640 1 -- 172.21.15.99:0/891145626 shutdown_connections 2024-09-10T07:45:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60e6c00640 1 --2- 172.21.15.99:0/891145626 >> v2:172.21.15.187:3300/0 conn(0x7f60e00ce780 0x7f60e0072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60e6c00640 1 --2- 172.21.15.99:0/891145626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e0145290 0x7f60e006f470 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60e6c00640 1 -- 172.21.15.99:0/891145626 >> 172.21.15.99:0/891145626 conn(0x7f60e006bc10 msgr2=0x7f60e006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60e6c00640 1 -- 172.21.15.99:0/891145626 shutdown_connections 2024-09-10T07:45:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.132+0000 7f60e6c00640 1 -- 172.21.15.99:0/891145626 wait complete. 2024-09-10T07:45:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.134+0000 7f60e6c00640 1 Processor -- start 2024-09-10T07:45:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.134+0000 7f60e6c00640 1 -- start start 2024-09-10T07:45:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.135+0000 7f60e6c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60e0071510 0x7f60e0137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.135+0000 7f60e6c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e00ce780 0x7f60e015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.135+0000 7f60e6c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60e0145290 0x7f60e0136ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.135+0000 7f60e6c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f60e006df80 con 0x7f60e00ce780 2024-09-10T07:45:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.135+0000 7f60e6c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f60e0145670 con 0x7f60e0145290 2024-09-10T07:45:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.135+0000 7f60e6c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f60e006e100 con 0x7f60e0071510 2024-09-10T07:45:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.135+0000 7f60df400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e00ce780 0x7f60e015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.135+0000 7f60df400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e00ce780 0x7f60e015b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60604/0 (socket says 172.21.15.99:60604) 2024-09-10T07:45:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.135+0000 7f60df400640 1 -- 172.21.15.99:0/2315842012 learned_addr learned my addr 172.21.15.99:0/2315842012 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60e4c00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60e0145290 0x7f60e0136ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60dfe00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60e0071510 0x7f60e0137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60df400640 1 -- 172.21.15.99:0/2315842012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60e0071510 msgr2=0x7f60e0137ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60df400640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60e0071510 0x7f60e0137ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60df400640 1 -- 172.21.15.99:0/2315842012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60e0145290 msgr2=0x7f60e0136ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60df400640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60e0145290 0x7f60e0136ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60df400640 1 -- 172.21.15.99:0/2315842012 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e0137530 con 0x7f60e00ce780 2024-09-10T07:45:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60e4c00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60e0145290 0x7f60e0136ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60df400640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e00ce780 0x7f60e015b5e0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00c7f0 tx=0x7f60cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60d7e00640 1 -- 172.21.15.99:0/2315842012 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc004230 con 0x7f60e00ce780 2024-09-10T07:45:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60d7e00640 1 -- 172.21.15.99:0/2315842012 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60cc0043d0 con 0x7f60e00ce780 2024-09-10T07:45:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60e6c00640 1 -- 172.21.15.99:0/2315842012 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e0138370 con 0x7f60e00ce780 2024-09-10T07:45:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.136+0000 7f60d7e00640 1 -- 172.21.15.99:0/2315842012 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc007a70 con 0x7f60e00ce780 2024-09-10T07:45:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.137+0000 7f60e6c00640 1 -- 172.21.15.99:0/2315842012 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e0138930 con 0x7f60e00ce780 2024-09-10T07:45:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.137+0000 7f60e6c00640 1 -- 172.21.15.99:0/2315842012 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e006f450 con 0x7f60e00ce780 2024-09-10T07:45:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.138+0000 7f60d7e00640 1 -- 172.21.15.99:0/2315842012 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60cc007c10 con 0x7f60e00ce780 2024-09-10T07:45:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.139+0000 7f60d7e00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f60c006be30 0x7f60c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.139+0000 7f60d7e00640 1 -- 172.21.15.99:0/2315842012 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5738+0+0 (secure 0 0 0) 0x7f60cc08aee0 con 0x7f60e00ce780 2024-09-10T07:45:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.140+0000 7f60dfe00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f60c006be30 0x7f60c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.140+0000 7f60d7e00640 1 -- 172.21.15.99:0/2315842012 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=176}) -- 0x7f60c0073a20 con 0x7f60e00ce780 2024-09-10T07:45:00.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.140+0000 7f60dfe00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f60c006be30 0x7f60c006e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f60d0036000 tx=0x7f60d0009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.143+0000 7f60d7e00640 1 -- 172.21.15.99:0/2315842012 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f60e0137530 con 0x7f60e00ce780 2024-09-10T07:45:00.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.316+0000 7f60e6c00640 1 -- 172.21.15.99:0/2315842012 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60e006ca90 con 0x7f60e00ce780 2024-09-10T07:45:00.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.317+0000 7f60d7e00640 1 -- 172.21.15.99:0/2315842012 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) ==== 74+0+16791 (secure 0 0 0) 0x7f60cc015020 con 0x7f60e00ce780 2024-09-10T07:45:00.317 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:00.318 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":175,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:44:31.804540+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:43:39.625121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-10T07:43:40.843617+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:45:00.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.319+0000 7f60e6c00640 1 -- 172.21.15.99:0/2315842012 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f60c006be30 msgr2=0x7f60c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.319+0000 7f60e6c00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f60c006be30 0x7f60c006e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f60d0036000 tx=0x7f60d0009000 comp rx=0 tx=0).stop 2024-09-10T07:45:00.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.319+0000 7f60e6c00640 1 -- 172.21.15.99:0/2315842012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e00ce780 msgr2=0x7f60e015b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.319+0000 7f60e6c00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e00ce780 0x7f60e015b5e0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00c7f0 tx=0x7f60cc00ccb0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.319+0000 7f60e6c00640 1 -- 172.21.15.99:0/2315842012 shutdown_connections 2024-09-10T07:45:00.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.319+0000 7f60e6c00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60e0145290 0x7f60e0136ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.319+0000 7f60e6c00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f60c006be30 0x7f60c006e2f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.319+0000 7f60e6c00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e00ce780 0x7f60e015b5e0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.319+0000 7f60e6c00640 1 --2- 172.21.15.99:0/2315842012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60e0071510 0x7f60e0137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.319+0000 7f60e6c00640 1 -- 172.21.15.99:0/2315842012 >> 172.21.15.99:0/2315842012 conn(0x7f60e006bc10 msgr2=0x7f60e00b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:00.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.320+0000 7f60e6c00640 1 -- 172.21.15.99:0/2315842012 shutdown_connections 2024-09-10T07:45:00.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.320+0000 7f60e6c00640 1 -- 172.21.15.99:0/2315842012 wait complete. 2024-09-10T07:45:00.335 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:45:00.335 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:00.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.489+0000 7f0fc7200640 1 Processor -- start 2024-09-10T07:45:00.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.489+0000 7f0fc7200640 1 -- start start 2024-09-10T07:45:00.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.490+0000 7f0fc7200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fc815e970 0x7f0fc80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.490+0000 7f0fc7200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0fc80d2680 0x7f0fc80cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.490+0000 7f0fc7200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc80d2bd0 con 0x7f0fc80cfac0 2024-09-10T07:45:00.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.490+0000 7f0fc7200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc80d37e0 con 0x7f0fc815e970 2024-09-10T07:45:00.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.490+0000 7f0fc7200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc80d2eb0 con 0x7f0fc80d2680 2024-09-10T07:45:00.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.490+0000 7f0fc5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fc815e970 0x7f0fc80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.490+0000 7f0fc5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fc815e970 0x7f0fc80d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60610/0 (socket says 172.21.15.99:60610) 2024-09-10T07:45:00.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.490+0000 7f0fc5e00640 1 -- 172.21.15.99:0/3165280195 learned_addr learned my addr 172.21.15.99:0/3165280195 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:00.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.491+0000 7f0fc5400640 1 --2- 172.21.15.99:0/3165280195 >> v2:172.21.15.187:3300/0 conn(0x7f0fc80d2680 0x7f0fc80cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.491+0000 7f0fc5e00640 1 -- 172.21.15.99:0/3165280195 >> v2:172.21.15.187:3300/0 conn(0x7f0fc80d2680 msgr2=0x7f0fc80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:00.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.491+0000 7f0fc5e00640 1 --2- 172.21.15.99:0/3165280195 >> v2:172.21.15.187:3300/0 conn(0x7f0fc80d2680 0x7f0fc80cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.491+0000 7f0fc5e00640 1 -- 172.21.15.99:0/3165280195 >> v1:172.21.15.187:6789/0 conn(0x7f0fc80cfac0 legacy=0x7f0fc80d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.491+0000 7f0fc5e00640 1 -- 172.21.15.99:0/3165280195 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc80d3190 con 0x7f0fc815e970 2024-09-10T07:45:00.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.492+0000 7f0fc5e00640 1 --2- 172.21.15.99:0/3165280195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc815e970 0x7f0fc80d0300 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f0fc809e530 tx=0x7f0fb802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a909260e8d6994 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:00.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.492+0000 7f0fc4a00640 1 -- 172.21.15.99:0/3165280195 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8037070 con 0x7f0fc815e970 2024-09-10T07:45:00.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.492+0000 7f0fc4a00640 1 -- 172.21.15.99:0/3165280195 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb802ae50 con 0x7f0fc815e970 2024-09-10T07:45:00.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.492+0000 7f0fc4a00640 1 -- 172.21.15.99:0/3165280195 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8032860 con 0x7f0fc815e970 2024-09-10T07:45:00.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.493+0000 7f0fc7200640 1 -- 172.21.15.99:0/3165280195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc815e970 msgr2=0x7f0fc80d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.493+0000 7f0fc7200640 1 --2- 172.21.15.99:0/3165280195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc815e970 0x7f0fc80d0300 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f0fc809e530 tx=0x7f0fb802a300 comp rx=0 tx=0).stop 2024-09-10T07:45:00.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.493+0000 7f0fc7200640 1 -- 172.21.15.99:0/3165280195 shutdown_connections 2024-09-10T07:45:00.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.493+0000 7f0fc7200640 1 --2- 172.21.15.99:0/3165280195 >> v2:172.21.15.187:3300/0 conn(0x7f0fc80d2680 0x7f0fc80cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.493+0000 7f0fc7200640 1 --2- 172.21.15.99:0/3165280195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc815e970 0x7f0fc80d0300 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.493+0000 7f0fc7200640 1 -- 172.21.15.99:0/3165280195 >> 172.21.15.99:0/3165280195 conn(0x7f0fc809de00 msgr2=0x7f0fc80d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:00.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.493+0000 7f0fc7200640 1 -- 172.21.15.99:0/3165280195 shutdown_connections 2024-09-10T07:45:00.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.493+0000 7f0fc7200640 1 -- 172.21.15.99:0/3165280195 wait complete. 2024-09-10T07:45:00.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.494+0000 7f0fc7200640 1 Processor -- start 2024-09-10T07:45:00.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.495+0000 7f0fc7200640 1 -- start start 2024-09-10T07:45:00.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.495+0000 7f0fc7200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fc80cfac0 0x7f0fc8159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.495+0000 7f0fc7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc80d2680 0x7f0fc81f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.495+0000 7f0fc7200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fc815e970 0x7f0fc8153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.495+0000 7f0fc7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80d0840 con 0x7f0fc80d2680 2024-09-10T07:45:00.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.495+0000 7f0fc7200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80cff10 con 0x7f0fc80cfac0 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.495+0000 7f0fc7200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc815ed50 con 0x7f0fc815e970 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc80d2680 0x7f0fc81f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc80d2680 0x7f0fc81f45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60618/0 (socket says 172.21.15.99:60618) 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc5400640 1 -- 172.21.15.99:0/100718424 learned_addr learned my addr 172.21.15.99:0/100718424 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc5e00640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fc80cfac0 0x7f0fc8159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc6800640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fc815e970 0x7f0fc8153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc5400640 1 -- 172.21.15.99:0/100718424 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fc815e970 msgr2=0x7f0fc8153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc5400640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fc815e970 0x7f0fc8153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc5400640 1 -- 172.21.15.99:0/100718424 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fc80cfac0 msgr2=0x7f0fc8159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc5400640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fc80cfac0 0x7f0fc8159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc5400640 1 -- 172.21.15.99:0/100718424 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc8154350 con 0x7f0fc80d2680 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc6800640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fc815e970 0x7f0fc8153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:00.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.496+0000 7f0fc5400640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc80d2680 0x7f0fc81f45d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400d800 tx=0x7f0fb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.497+0000 7f0fbe000640 1 -- 172.21.15.99:0/100718424 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400b6c0 con 0x7f0fc80d2680 2024-09-10T07:45:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.497+0000 7f0fbe000640 1 -- 172.21.15.99:0/100718424 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb4019070 con 0x7f0fc80d2680 2024-09-10T07:45:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.497+0000 7f0fbe000640 1 -- 172.21.15.99:0/100718424 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400bac0 con 0x7f0fc80d2680 2024-09-10T07:45:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.497+0000 7f0fc7200640 1 -- 172.21.15.99:0/100718424 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc81547d0 con 0x7f0fc80d2680 2024-09-10T07:45:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.497+0000 7f0fc7200640 1 -- 172.21.15.99:0/100718424 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc80b8ee0 con 0x7f0fc80d2680 2024-09-10T07:45:00.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.498+0000 7f0fc7200640 1 -- 172.21.15.99:0/100718424 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc80cf580 con 0x7f0fc80d2680 2024-09-10T07:45:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.499+0000 7f0fbe000640 1 -- 172.21.15.99:0/100718424 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0fb400bc60 con 0x7f0fc80d2680 2024-09-10T07:45:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.500+0000 7f0fbe000640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0fa806be30 0x7f0fa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.500+0000 7f0fbe000640 1 -- 172.21.15.99:0/100718424 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5738+0+0 (secure 0 0 0) 0x7f0fb408b2b0 con 0x7f0fc80d2680 2024-09-10T07:45:00.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.500+0000 7f0fbe000640 1 -- 172.21.15.99:0/100718424 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=176}) -- 0x7f0fa80739c0 con 0x7f0fc80d2680 2024-09-10T07:45:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.500+0000 7f0fc5e00640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0fa806be30 0x7f0fa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.501+0000 7f0fc5e00640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0fa806be30 0x7f0fa806e2f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8034000 tx=0x7f0fb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:00.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.504+0000 7f0fbe000640 1 -- 172.21.15.99:0/100718424 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0fb4059c40 con 0x7f0fc80d2680 2024-09-10T07:45:00.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.713+0000 7f0fc7200640 1 -- 172.21.15.99:0/100718424 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fc80cb1c0 con 0x7f0fc80d2680 2024-09-10T07:45:00.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.714+0000 7f0fbe000640 1 -- 172.21.15.99:0/100718424 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5224 (secure 0 0 0) 0x7f0fb4059540 con 0x7f0fc80d2680 2024-09-10T07:45:00.714 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:00.714 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"btime":"2024-09-10T07:43:45:462569+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/484957916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":484957916},{"type":"v1","addr":"172.21.15.99:6836","nonce":484957916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6967,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/837681918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":837681918},{"type":"v1","addr":"172.21.15.99:6837","nonce":837681918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3241210910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3241210910},{"type":"v1","addr":"172.21.15.187:6834","nonce":3241210910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:43:41.845115+0000","modified":"2024-09-10T07:43:44.869981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/274874285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":274874285},{"type":"v1","addr":"172.21.15.187:6835","nonce":274874285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7494,"qdb_cluster":[7494]},"id":10}]} 2024-09-10T07:45:00.714 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 82 2024-09-10T07:45:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.716+0000 7f0fc7200640 1 -- 172.21.15.99:0/100718424 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0fa806be30 msgr2=0x7f0fa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.716+0000 7f0fc7200640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0fa806be30 0x7f0fa806e2f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8034000 tx=0x7f0fb802e000 comp rx=0 tx=0).stop 2024-09-10T07:45:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.716+0000 7f0fc7200640 1 -- 172.21.15.99:0/100718424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc80d2680 msgr2=0x7f0fc81f45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.716+0000 7f0fc7200640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc80d2680 0x7f0fc81f45d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400d800 tx=0x7f0fb400dcc0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.716+0000 7f0fc7200640 1 -- 172.21.15.99:0/100718424 shutdown_connections 2024-09-10T07:45:00.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.716+0000 7f0fc7200640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fc815e970 0x7f0fc8153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.716+0000 7f0fc7200640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0fa806be30 0x7f0fa806e2f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.716+0000 7f0fc7200640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fc80d2680 0x7f0fc81f45d0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.716+0000 7f0fc7200640 1 --2- 172.21.15.99:0/100718424 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fc80cfac0 0x7f0fc8159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.716+0000 7f0fc7200640 1 -- 172.21.15.99:0/100718424 >> 172.21.15.99:0/100718424 conn(0x7f0fc809de00 msgr2=0x7f0fc80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.717+0000 7f0fc7200640 1 -- 172.21.15.99:0/100718424 shutdown_connections 2024-09-10T07:45:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.717+0000 7f0fc7200640 1 -- 172.21.15.99:0/100718424 wait complete. 2024-09-10T07:45:00.733 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.887+0000 7fb525600640 1 Processor -- start 2024-09-10T07:45:00.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.887+0000 7fb525600640 1 -- start start 2024-09-10T07:45:00.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb525600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb520072f40 0x7fb52006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb525600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52006e3d0 con 0x7fb520145290 2024-09-10T07:45:00.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb525600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52006e6b0 con 0x7fb5200ce780 2024-09-10T07:45:00.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb525600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb52006efe0 con 0x7fb520072f40 2024-09-10T07:45:00.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb51ea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb520145290 0x7fb520072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38494/0 (socket says 172.21.15.99:38494) 2024-09-10T07:45:00.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb51ea00640 1 -- 172.21.15.99:0/433028698 learned_addr learned my addr 172.21.15.99:0/433028698 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:00.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb51e000640 1 --2- 172.21.15.99:0/433028698 >> v2:172.21.15.99:3300/0 conn(0x7fb520072f40 0x7fb52006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb51d600640 1 -- 172.21.15.99:0/433028698 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2175693151 0 0) 0x7fb52006e3d0 con 0x7fb520145290 2024-09-10T07:45:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb51d600640 1 -- 172.21.15.99:0/433028698 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb504003520 con 0x7fb520145290 2024-09-10T07:45:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb51d600640 1 -- 172.21.15.99:0/433028698 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297925292 0 0) 0x7fb52006e6b0 con 0x7fb5200ce780 2024-09-10T07:45:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb51e000640 1 -- 172.21.15.99:0/433028698 >> v1:172.21.15.187:6789/0 conn(0x7fb5200ce780 legacy=0x7fb5200b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb51e000640 1 -- 172.21.15.99:0/433028698 >> v1:172.21.15.99:6789/0 conn(0x7fb520145290 legacy=0x7fb520072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.889+0000 7fb51e000640 1 -- 172.21.15.99:0/433028698 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52006e990 con 0x7fb520072f40 2024-09-10T07:45:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.890+0000 7fb51e000640 1 --2- 172.21.15.99:0/433028698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520072f40 0x7fb52006f470 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0097a0 tx=0x7fb50c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3f8998cbc9e297 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.891+0000 7fb51d600640 1 -- 172.21.15.99:0/433028698 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c037070 con 0x7fb520072f40 2024-09-10T07:45:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.891+0000 7fb51d600640 1 -- 172.21.15.99:0/433028698 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50c032440 con 0x7fb520072f40 2024-09-10T07:45:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.891+0000 7fb51d600640 1 -- 172.21.15.99:0/433028698 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c032810 con 0x7fb520072f40 2024-09-10T07:45:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.891+0000 7fb525600640 1 -- 172.21.15.99:0/433028698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520072f40 msgr2=0x7fb52006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.891+0000 7fb525600640 1 --2- 172.21.15.99:0/433028698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520072f40 0x7fb52006f470 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0097a0 tx=0x7fb50c02a230 comp rx=0 tx=0).stop 2024-09-10T07:45:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.891+0000 7fb525600640 1 -- 172.21.15.99:0/433028698 shutdown_connections 2024-09-10T07:45:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.891+0000 7fb525600640 1 --2- 172.21.15.99:0/433028698 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520072f40 0x7fb52006f470 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.891+0000 7fb525600640 1 -- 172.21.15.99:0/433028698 >> 172.21.15.99:0/433028698 conn(0x7fb52006bc10 msgr2=0x7fb52006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.891+0000 7fb525600640 1 -- 172.21.15.99:0/433028698 shutdown_connections 2024-09-10T07:45:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.891+0000 7fb525600640 1 -- 172.21.15.99:0/433028698 wait complete. 2024-09-10T07:45:00.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.893+0000 7fb525600640 1 Processor -- start 2024-09-10T07:45:00.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.893+0000 7fb525600640 1 -- start start 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb525600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb520072f40 0x7fb52013c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb525600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5200ce780 0x7fb520143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb525600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520145290 0x7fb5200c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb525600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb52006df80 con 0x7fb520145290 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb525600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb520145670 con 0x7fb5200ce780 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb525600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb52006e100 con 0x7fb520072f40 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb51f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520145290 0x7fb5200c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb51f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520145290 0x7fb5200c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60634/0 (socket says 172.21.15.99:60634) 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb51f400640 1 -- 172.21.15.99:0/2349259347 learned_addr learned my addr 172.21.15.99:0/2349259347 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb51ea00640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb520072f40 0x7fb52013c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb51e000640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5200ce780 0x7fb520143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb51f400640 1 -- 172.21.15.99:0/2349259347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb520072f40 msgr2=0x7fb52013c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb51f400640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb520072f40 0x7fb52013c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb51f400640 1 -- 172.21.15.99:0/2349259347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5200ce780 msgr2=0x7fb520143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.894+0000 7fb51f400640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5200ce780 0x7fb520143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.895+0000 7fb51f400640 1 -- 172.21.15.99:0/2349259347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb520142e00 con 0x7fb520145290 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.895+0000 7fb51f400640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520145290 0x7fb5200c5f90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c4b0 tx=0x7fb51800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.895+0000 7fb516a00640 1 -- 172.21.15.99:0/2349259347 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518005480 con 0x7fb520145290 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.895+0000 7fb516a00640 1 -- 172.21.15.99:0/2349259347 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5180035f0 con 0x7fb520145290 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.895+0000 7fb516a00640 1 -- 172.21.15.99:0/2349259347 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5180039c0 con 0x7fb520145290 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.895+0000 7fb525600640 1 -- 172.21.15.99:0/2349259347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5201430e0 con 0x7fb520145290 2024-09-10T07:45:00.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.895+0000 7fb525600640 1 -- 172.21.15.99:0/2349259347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5201436a0 con 0x7fb520145290 2024-09-10T07:45:00.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.896+0000 7fb525600640 1 -- 172.21.15.99:0/2349259347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5200715a0 con 0x7fb520145290 2024-09-10T07:45:00.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.897+0000 7fb516a00640 1 -- 172.21.15.99:0/2349259347 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb518003b60 con 0x7fb520145290 2024-09-10T07:45:00.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.898+0000 7fb516a00640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50006bfd0 0x7fb50006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:00.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.898+0000 7fb516a00640 1 -- 172.21.15.99:0/2349259347 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5738+0+0 (secure 0 0 0) 0x7fb51808aa90 con 0x7fb520145290 2024-09-10T07:45:00.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.898+0000 7fb516a00640 1 -- 172.21.15.99:0/2349259347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=176}) -- 0x7fb500073b60 con 0x7fb520145290 2024-09-10T07:45:00.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.898+0000 7fb51ea00640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50006bfd0 0x7fb50006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:00.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.899+0000 7fb51ea00640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50006bfd0 0x7fb50006e490 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb510005c00 tx=0x7fb510009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:00.902+0000 7fb516a00640 1 -- 172.21.15.99:0/2349259347 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb518058ca0 con 0x7fb520145290 2024-09-10T07:45:01.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.113+0000 7fb525600640 1 -- 172.21.15.99:0/2349259347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5200b55a0 con 0x7fb520145290 2024-09-10T07:45:01.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.114+0000 7fb516a00640 1 -- 172.21.15.99:0/2349259347 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5224 (secure 0 0 0) 0x7fb51805cfa0 con 0x7fb520145290 2024-09-10T07:45:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:01.114 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":82,"btime":"2024-09-10T07:43:45:462569+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/484957916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":484957916},{"type":"v1","addr":"172.21.15.99:6836","nonce":484957916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6967,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/837681918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":837681918},{"type":"v1","addr":"172.21.15.99:6837","nonce":837681918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3241210910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3241210910},{"type":"v1","addr":"172.21.15.187:6834","nonce":3241210910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:43:41.845115+0000","modified":"2024-09-10T07:43:44.869981+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/274874285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":274874285},{"type":"v1","addr":"172.21.15.187:6835","nonce":274874285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7494,"qdb_cluster":[7494]},"id":10}]} 2024-09-10T07:45:01.114 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 82 2024-09-10T07:45:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 -- 172.21.15.99:0/2349259347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50006bfd0 msgr2=0x7fb50006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50006bfd0 0x7fb50006e490 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb510005c00 tx=0x7fb510009040 comp rx=0 tx=0).stop 2024-09-10T07:45:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 -- 172.21.15.99:0/2349259347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520145290 msgr2=0x7fb5200c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520145290 0x7fb5200c5f90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c4b0 tx=0x7fb51800c970 comp rx=0 tx=0).stop 2024-09-10T07:45:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 -- 172.21.15.99:0/2349259347 shutdown_connections 2024-09-10T07:45:01.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb50006bfd0 0x7fb50006e490 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520145290 0x7fb5200c5f90 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5200ce780 0x7fb520143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 --2- 172.21.15.99:0/2349259347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb520072f40 0x7fb52013c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 -- 172.21.15.99:0/2349259347 >> 172.21.15.99:0/2349259347 conn(0x7fb52006bc10 msgr2=0x7fb5200b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 -- 172.21.15.99:0/2349259347 shutdown_connections 2024-09-10T07:45:01.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.116+0000 7fb525600640 1 -- 172.21.15.99:0/2349259347 wait complete. 2024-09-10T07:45:01.132 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:45:01.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.286+0000 7f4291200640 1 Processor -- start 2024-09-10T07:45:01.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.286+0000 7f4291200640 1 -- start start 2024-09-10T07:45:01.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f4291200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c145290 0x7f428c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f4291200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f428c072f40 0x7f428c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f4291200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428c06e3d0 con 0x7f428c0ce780 2024-09-10T07:45:01.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f4291200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f428c06efe0 con 0x7f428c072f40 2024-09-10T07:45:01.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f4291200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f428c06e6b0 con 0x7f428c145290 2024-09-10T07:45:01.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f4289e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c145290 0x7f428c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f428a800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f428c072f40 0x7f428c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f4281400640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f428c0ce780 0x7f428c072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:35578/0 (socket says 172.21.15.99:35578) 2024-09-10T07:45:01.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f4281400640 1 -- 172.21.15.99:0/3287387246 learned_addr learned my addr 172.21.15.99:0/3287387246 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:01.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f4289e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c145290 0x7f428c06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:45726/0 (socket says 172.21.15.99:45726) 2024-09-10T07:45:01.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.288+0000 7f428a800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f428c072f40 0x7f428c0b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:41838/0 (socket says 172.21.15.99:41838) 2024-09-10T07:45:01.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.289+0000 7f428a800640 1 -- 172.21.15.99:0/3287387246 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c145290 msgr2=0x7f428c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:01.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.289+0000 7f428a800640 1 --2- 172.21.15.99:0/3287387246 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c145290 0x7f428c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.289+0000 7f428a800640 1 -- 172.21.15.99:0/3287387246 >> v1:172.21.15.187:6789/0 conn(0x7f428c0ce780 legacy=0x7f428c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.289+0000 7f428a800640 1 -- 172.21.15.99:0/3287387246 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c06e990 con 0x7f428c072f40 2024-09-10T07:45:01.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.290+0000 7f428a800640 1 --2- 172.21.15.99:0/3287387246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c072f40 0x7f428c0b3930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4284009d90 tx=0x7f428402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f88685bcad5630b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:01.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.290+0000 7f4289400640 1 -- 172.21.15.99:0/3287387246 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4284007740 con 0x7f428c072f40 2024-09-10T07:45:01.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.290+0000 7f4289400640 1 -- 172.21.15.99:0/3287387246 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42840078e0 con 0x7f428c072f40 2024-09-10T07:45:01.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.290+0000 7f4289400640 1 -- 172.21.15.99:0/3287387246 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4284007cb0 con 0x7f428c072f40 2024-09-10T07:45:01.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.290+0000 7f4291200640 1 -- 172.21.15.99:0/3287387246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c072f40 msgr2=0x7f428c0b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.290+0000 7f4291200640 1 --2- 172.21.15.99:0/3287387246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c072f40 0x7f428c0b3930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4284009d90 tx=0x7f428402a660 comp rx=0 tx=0).stop 2024-09-10T07:45:01.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.291+0000 7f4291200640 1 -- 172.21.15.99:0/3287387246 shutdown_connections 2024-09-10T07:45:01.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.291+0000 7f4291200640 1 --2- 172.21.15.99:0/3287387246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c072f40 0x7f428c0b3930 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.291+0000 7f4291200640 1 --2- 172.21.15.99:0/3287387246 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c145290 0x7f428c06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.291+0000 7f4291200640 1 -- 172.21.15.99:0/3287387246 >> 172.21.15.99:0/3287387246 conn(0x7f428c06bc10 msgr2=0x7f428c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:01.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.291+0000 7f4291200640 1 -- 172.21.15.99:0/3287387246 shutdown_connections 2024-09-10T07:45:01.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.291+0000 7f4291200640 1 -- 172.21.15.99:0/3287387246 wait complete. 2024-09-10T07:45:01.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.292+0000 7f4291200640 1 Processor -- start 2024-09-10T07:45:01.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.292+0000 7f4291200640 1 -- start start 2024-09-10T07:45:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.293+0000 7f4291200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f428c072f40 0x7f428c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.293+0000 7f4291200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c0ce780 0x7f428c0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.293+0000 7f4291200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c145290 0x7f428c0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.293+0000 7f4291200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f428c06df80 con 0x7f428c072f40 2024-09-10T07:45:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.293+0000 7f4291200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f428c145670 con 0x7f428c145290 2024-09-10T07:45:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.293+0000 7f4291200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f428c06e100 con 0x7f428c0ce780 2024-09-10T07:45:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.293+0000 7f4289e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f428c072f40 0x7f428c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.293+0000 7f4289e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f428c072f40 0x7f428c15af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60638/0 (socket says 172.21.15.99:60638) 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.293+0000 7f4289e00640 1 -- 172.21.15.99:0/1990410233 learned_addr learned my addr 172.21.15.99:0/1990410233 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4281400640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c0ce780 0x7f428c0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f428a800640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c145290 0x7f428c0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4289e00640 1 -- 172.21.15.99:0/1990410233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c0ce780 msgr2=0x7f428c0b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4289e00640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c0ce780 0x7f428c0b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4289e00640 1 -- 172.21.15.99:0/1990410233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c145290 msgr2=0x7f428c0ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4289e00640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c145290 0x7f428c0ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4289e00640 1 -- 172.21.15.99:0/1990410233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c15d140 con 0x7f428c072f40 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4289e00640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f428c072f40 0x7f428c15af70 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f427c00e9b0 tx=0x7f427c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4282a00640 1 -- 172.21.15.99:0/1990410233 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c017070 con 0x7f428c072f40 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4282a00640 1 -- 172.21.15.99:0/1990410233 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427c00c9a0 con 0x7f428c072f40 2024-09-10T07:45:01.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4282a00640 1 -- 172.21.15.99:0/1990410233 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c00cd90 con 0x7f428c072f40 2024-09-10T07:45:01.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.294+0000 7f4291200640 1 -- 172.21.15.99:0/1990410233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428c15c0a0 con 0x7f428c072f40 2024-09-10T07:45:01.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.295+0000 7f4291200640 1 -- 172.21.15.99:0/1990410233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f428c15c660 con 0x7f428c072f40 2024-09-10T07:45:01.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.296+0000 7f4291200640 1 -- 172.21.15.99:0/1990410233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f428c071510 con 0x7f428c072f40 2024-09-10T07:45:01.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.296+0000 7f4282a00640 1 -- 172.21.15.99:0/1990410233 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f427c01a070 con 0x7f428c072f40 2024-09-10T07:45:01.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.297+0000 7f4282a00640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f426806be30 0x7f426806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.297+0000 7f4282a00640 1 -- 172.21.15.99:0/1990410233 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5738+0+0 (secure 0 0 0) 0x7f427c08aea0 con 0x7f428c072f40 2024-09-10T07:45:01.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.298+0000 7f4281400640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f426806be30 0x7f426806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.298+0000 7f4282a00640 1 -- 172.21.15.99:0/1990410233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=176}) -- 0x7f42680739c0 con 0x7f428c072f40 2024-09-10T07:45:01.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.298+0000 7f4281400640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f426806be30 0x7f426806e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f428c13b1c0 tx=0x7f4274007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:01.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.301+0000 7f4282a00640 1 -- 172.21.15.99:0/1990410233 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f427c059140 con 0x7f428c072f40 2024-09-10T07:45:01.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.480+0000 7f4291200640 1 -- 172.21.15.99:0/1990410233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f428c138080 con 0x7f428c072f40 2024-09-10T07:45:01.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.481+0000 7f4282a00640 1 -- 172.21.15.99:0/1990410233 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) ==== 74+0+16791 (secure 0 0 0) 0x7f427c05d440 con 0x7f428c072f40 2024-09-10T07:45:01.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:01.481 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":175,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:44:31.804540+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:43:39.625121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-10T07:43:40.843617+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:45:01.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 -- 172.21.15.99:0/1990410233 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f426806be30 msgr2=0x7f426806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f426806be30 0x7f426806e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f428c13b1c0 tx=0x7f4274007e80 comp rx=0 tx=0).stop 2024-09-10T07:45:01.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 -- 172.21.15.99:0/1990410233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f428c072f40 msgr2=0x7f428c15af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f428c072f40 0x7f428c15af70 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f427c00e9b0 tx=0x7f427c00ee70 comp rx=0 tx=0).stop 2024-09-10T07:45:01.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 -- 172.21.15.99:0/1990410233 shutdown_connections 2024-09-10T07:45:01.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f428c145290 0x7f428c0ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f428c0ce780 0x7f428c0b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f426806be30 0x7f426806e2f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 --2- 172.21.15.99:0/1990410233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f428c072f40 0x7f428c15af70 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 -- 172.21.15.99:0/1990410233 >> 172.21.15.99:0/1990410233 conn(0x7f428c06bc10 msgr2=0x7f428c0cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 -- 172.21.15.99:0/1990410233 shutdown_connections 2024-09-10T07:45:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.483+0000 7f4291200640 1 -- 172.21.15.99:0/1990410233 wait complete. 2024-09-10T07:45:01.498 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:45:01.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.653+0000 7f74bb400640 1 Processor -- start 2024-09-10T07:45:01.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.653+0000 7f74bb400640 1 -- start start 2024-09-10T07:45:01.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.654+0000 7f74bb400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f74b40b5750 0x7f74b415d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.654+0000 7f74bb400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f74b40cf890 0x7f74b40cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.654+0000 7f74bb400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b415c800 con 0x7f74b40ce070 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.654+0000 7f74bb400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f74b40b5bb0 con 0x7f74b40b5750 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.654+0000 7f74bb400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f74b40d0240 con 0x7f74b40cf890 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.654+0000 7f74b3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f74b40b5750 0x7f74b415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.655+0000 7f74b3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f74b40b5750 0x7f74b415d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60640/0 (socket says 172.21.15.99:60640) 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.655+0000 7f74b3e00640 1 -- 172.21.15.99:0/472272638 learned_addr learned my addr 172.21.15.99:0/472272638 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.655+0000 7f74b9400640 1 --2- 172.21.15.99:0/472272638 >> v2:172.21.15.187:3300/0 conn(0x7f74b40cf890 0x7f74b40cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.655+0000 7f74b3e00640 1 -- 172.21.15.99:0/472272638 >> v2:172.21.15.187:3300/0 conn(0x7f74b40cf890 msgr2=0x7f74b40cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.655+0000 7f74b3e00640 1 --2- 172.21.15.99:0/472272638 >> v2:172.21.15.187:3300/0 conn(0x7f74b40cf890 0x7f74b40cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.655+0000 7f74b3e00640 1 -- 172.21.15.99:0/472272638 >> v1:172.21.15.187:6789/0 conn(0x7f74b40ce070 legacy=0x7f74b415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.655+0000 7f74b3e00640 1 -- 172.21.15.99:0/472272638 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b415cae0 con 0x7f74b40b5750 2024-09-10T07:45:01.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.656+0000 7f74b3e00640 1 --2- 172.21.15.99:0/472272638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40b5750 0x7f74b415d170 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f74b406cfc0 tx=0x7f74a002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79efdc767d282313 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:01.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.656+0000 7f74b3400640 1 -- 172.21.15.99:0/472272638 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0037070 con 0x7f74b40b5750 2024-09-10T07:45:01.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.656+0000 7f74b3400640 1 -- 172.21.15.99:0/472272638 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a0032440 con 0x7f74b40b5750 2024-09-10T07:45:01.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.656+0000 7f74b3400640 1 -- 172.21.15.99:0/472272638 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0032810 con 0x7f74b40b5750 2024-09-10T07:45:01.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.657+0000 7f74bb400640 1 -- 172.21.15.99:0/472272638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40b5750 msgr2=0x7f74b415d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.657+0000 7f74bb400640 1 --2- 172.21.15.99:0/472272638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40b5750 0x7f74b415d170 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f74b406cfc0 tx=0x7f74a002a2a0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.657+0000 7f74bb400640 1 -- 172.21.15.99:0/472272638 shutdown_connections 2024-09-10T07:45:01.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.657+0000 7f74bb400640 1 --2- 172.21.15.99:0/472272638 >> v2:172.21.15.187:3300/0 conn(0x7f74b40cf890 0x7f74b40cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.657+0000 7f74bb400640 1 --2- 172.21.15.99:0/472272638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40b5750 0x7f74b415d170 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.657+0000 7f74bb400640 1 -- 172.21.15.99:0/472272638 >> 172.21.15.99:0/472272638 conn(0x7f74b40b2630 msgr2=0x7f74b40b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:01.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.657+0000 7f74bb400640 1 -- 172.21.15.99:0/472272638 shutdown_connections 2024-09-10T07:45:01.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.657+0000 7f74bb400640 1 -- 172.21.15.99:0/472272638 wait complete. 2024-09-10T07:45:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.659+0000 7f74bb400640 1 Processor -- start 2024-09-10T07:45:01.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.659+0000 7f74bb400640 1 -- start start 2024-09-10T07:45:01.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74bb400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b40b5750 0x7f74b406e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74bb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40ce070 0x7f74b415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74bb400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74b40cf890 0x7f74b4148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74bb400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f74b415d6b0 con 0x7f74b40ce070 2024-09-10T07:45:01.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74bb400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f74b40ce450 con 0x7f74b40cf890 2024-09-10T07:45:01.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74bb400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f74b415d830 con 0x7f74b40b5750 2024-09-10T07:45:01.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40ce070 0x7f74b415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40ce070 0x7f74b415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60646/0 (socket says 172.21.15.99:60646) 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b3e00640 1 -- 172.21.15.99:0/619930535 learned_addr learned my addr 172.21.15.99:0/619930535 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b9400640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74b40cf890 0x7f74b4148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b8a00640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b40b5750 0x7f74b406e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b3e00640 1 -- 172.21.15.99:0/619930535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b40b5750 msgr2=0x7f74b406e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b3e00640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b40b5750 0x7f74b406e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b3e00640 1 -- 172.21.15.99:0/619930535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74b40cf890 msgr2=0x7f74b4148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b3e00640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74b40cf890 0x7f74b4148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b3e00640 1 -- 172.21.15.99:0/619930535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b40b4140 con 0x7f74b40ce070 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.660+0000 7f74b8a00640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b40b5750 0x7f74b406e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:01.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.661+0000 7f74b3e00640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40ce070 0x7f74b415acd0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000c00 tx=0x7f74a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:01.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.661+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0037040 con 0x7f74b40ce070 2024-09-10T07:45:01.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.661+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a0042070 con 0x7f74b40ce070 2024-09-10T07:45:01.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.661+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0030880 con 0x7f74b40ce070 2024-09-10T07:45:01.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.661+0000 7f74bb400640 1 -- 172.21.15.99:0/619930535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b415f9a0 con 0x7f74b40ce070 2024-09-10T07:45:01.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.661+0000 7f74bb400640 1 -- 172.21.15.99:0/619930535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b415e8a0 con 0x7f74b40ce070 2024-09-10T07:45:01.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.662+0000 7f74bb400640 1 -- 172.21.15.99:0/619930535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b40737d0 con 0x7f74b40ce070 2024-09-10T07:45:01.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.663+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74a0030a20 con 0x7f74b40ce070 2024-09-10T07:45:01.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.664+0000 7f74b0c00640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f749406be30 0x7f749406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:01.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.664+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5738+0+0 (secure 0 0 0) 0x7f74a00ab6b0 con 0x7f74b40ce070 2024-09-10T07:45:01.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.664+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=176}) -- 0x7f74940739c0 con 0x7f74b40ce070 2024-09-10T07:45:01.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.664+0000 7f74b8a00640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f749406be30 0x7f749406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:01.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.665+0000 7f74b8a00640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f749406be30 0x7f749406e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f74a8007fd0 tx=0x7f74a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:01.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.668+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74a0079fa0 con 0x7f74b40ce070 2024-09-10T07:45:01.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.811+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 <== mon.0 v2:172.21.15.99:3300/0 7 ==== osd_map(176..176 src has 1..176) ==== 679+0+0 (secure 0 0 0) 0x7f74a00dfd50 con 0x7f74b40ce070 2024-09-10T07:45:01.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.811+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=177}) -- 0x7f7494074520 con 0x7f74b40ce070 2024-09-10T07:45:01.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.879+0000 7f74bb400640 1 -- 172.21.15.99:0/619930535 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f74b40d0420 con 0x7f74b40ce070 2024-09-10T07:45:01.879 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:45:01.879+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:45:01.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.881+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 <== mon.0 v2:172.21.15.99:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v83) ==== 161+0+0 (secure 0 0 0) 0x7f74a00798a0 con 0x7f74b40ce070 2024-09-10T07:45:01.881 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:45:01.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.882+0000 7f74b0c00640 1 -- 172.21.15.99:0/619930535 <== mon.0 v2:172.21.15.99:3300/0 9 ==== osd_map(177..177 src has 1..177) ==== 374+0+0 (secure 0 0 0) 0x7f74a0077940 con 0x7f74b40ce070 2024-09-10T07:45:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.884+0000 7f74bb400640 1 -- 172.21.15.99:0/619930535 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f749406be30 msgr2=0x7f749406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.884+0000 7f74bb400640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f749406be30 0x7f749406e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f74a8007fd0 tx=0x7f74a8009040 comp rx=0 tx=0).stop 2024-09-10T07:45:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.884+0000 7f74bb400640 1 -- 172.21.15.99:0/619930535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40ce070 msgr2=0x7f74b415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.884+0000 7f74bb400640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40ce070 0x7f74b415acd0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000c00 tx=0x7f74a00046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.885+0000 7f74bb400640 1 -- 172.21.15.99:0/619930535 shutdown_connections 2024-09-10T07:45:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.885+0000 7f74bb400640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74b40cf890 0x7f74b4148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.885+0000 7f74bb400640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f749406be30 0x7f749406e2f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.885+0000 7f74bb400640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74b40ce070 0x7f74b415acd0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.885+0000 7f74bb400640 1 --2- 172.21.15.99:0/619930535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74b40b5750 0x7f74b406e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.885+0000 7f74bb400640 1 -- 172.21.15.99:0/619930535 >> 172.21.15.99:0/619930535 conn(0x7f74b40b2630 msgr2=0x7f74b40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.885+0000 7f74bb400640 1 -- 172.21.15.99:0/619930535 shutdown_connections 2024-09-10T07:45:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:01.885+0000 7f74bb400640 1 -- 172.21.15.99:0/619930535 wait complete. 2024-09-10T07:45:01.901 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:45:01.952 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:45:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.058+0000 7f6fa2400640 1 Processor -- start 2024-09-10T07:45:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.058+0000 7f6fa2400640 1 -- start start 2024-09-10T07:45:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.059+0000 7f6fa2400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c15e970 0x7f6f9c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.059+0000 7f6fa2400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6f9c0d2680 0x7f6f9c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.059+0000 7f6fa2400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9c0d2bd0 con 0x7f6f9c0cfac0 2024-09-10T07:45:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.059+0000 7f6fa2400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f6f9c0d37e0 con 0x7f6f9c0d2680 2024-09-10T07:45:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.059+0000 7f6fa2400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c0d2eb0 con 0x7f6f9c15e970 2024-09-10T07:45:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.060+0000 7f6fa1000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c15e970 0x7f6f9c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.060+0000 7f6fa1000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c15e970 0x7f6f9c0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:45752/0 (socket says 172.21.15.99:45752) 2024-09-10T07:45:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.060+0000 7f6fa1000640 1 -- 172.21.15.99:0/774221770 learned_addr learned my addr 172.21.15.99:0/774221770 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.060+0000 7f6f9be00640 1 --2- 172.21.15.99:0/774221770 >> v2:172.21.15.187:3300/0 conn(0x7f6f9c0d2680 0x7f6f9c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.060+0000 7f6fa1000640 1 -- 172.21.15.99:0/774221770 >> v2:172.21.15.187:3300/0 conn(0x7f6f9c0d2680 msgr2=0x7f6f9c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.060+0000 7f6fa1000640 1 --2- 172.21.15.99:0/774221770 >> v2:172.21.15.187:3300/0 conn(0x7f6f9c0d2680 0x7f6f9c0cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.060+0000 7f6fa1000640 1 -- 172.21.15.99:0/774221770 >> v1:172.21.15.187:6789/0 conn(0x7f6f9c0cfac0 legacy=0x7f6f9c0d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.060+0000 7f6fa1000640 1 -- 172.21.15.99:0/774221770 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c0d3190 con 0x7f6f9c15e970 2024-09-10T07:45:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.060+0000 7f6f9b400640 1 -- 172.21.15.99:0/774221770 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2509747319 0 0) 0x7f6f9c0d2bd0 con 0x7f6f9c0cfac0 2024-09-10T07:45:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.061+0000 7f6fa1000640 1 --2- 172.21.15.99:0/774221770 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c15e970 0x7f6f9c0d0300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009870 tx=0x7f6f9002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9846deea4890d707 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.061+0000 7f6f9b400640 1 -- 172.21.15.99:0/774221770 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90037070 con 0x7f6f9c15e970 2024-09-10T07:45:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.061+0000 7f6f9b400640 1 -- 172.21.15.99:0/774221770 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9002ae50 con 0x7f6f9c15e970 2024-09-10T07:45:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.061+0000 7f6f9b400640 1 -- 172.21.15.99:0/774221770 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90032860 con 0x7f6f9c15e970 2024-09-10T07:45:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.062+0000 7f6fa2400640 1 -- 172.21.15.99:0/774221770 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c15e970 msgr2=0x7f6f9c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.062+0000 7f6fa2400640 1 --2- 172.21.15.99:0/774221770 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c15e970 0x7f6f9c0d0300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009870 tx=0x7f6f9002a300 comp rx=0 tx=0).stop 2024-09-10T07:45:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.062+0000 7f6fa2400640 1 -- 172.21.15.99:0/774221770 shutdown_connections 2024-09-10T07:45:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.062+0000 7f6fa2400640 1 --2- 172.21.15.99:0/774221770 >> v2:172.21.15.187:3300/0 conn(0x7f6f9c0d2680 0x7f6f9c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.062+0000 7f6fa2400640 1 --2- 172.21.15.99:0/774221770 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c15e970 0x7f6f9c0d0300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.062+0000 7f6fa2400640 1 -- 172.21.15.99:0/774221770 >> 172.21.15.99:0/774221770 conn(0x7f6f9c09de00 msgr2=0x7f6f9c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.062+0000 7f6fa2400640 1 -- 172.21.15.99:0/774221770 shutdown_connections 2024-09-10T07:45:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.062+0000 7f6fa2400640 1 -- 172.21.15.99:0/774221770 wait complete. 2024-09-10T07:45:02.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.064+0000 7f6fa2400640 1 Processor -- start 2024-09-10T07:45:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.064+0000 7f6fa2400640 1 -- start start 2024-09-10T07:45:02.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6fa2400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c0cfac0 0x7f6f9c1f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6fa2400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0d2680 0x7f6f9c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6fa2400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c15e970 0x7f6f9c0b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6fa2400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c0d0840 con 0x7f6f9c0d2680 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6fa2400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c0cff70 con 0x7f6f9c15e970 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6fa2400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c15ed50 con 0x7f6f9c0cfac0 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6f9be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0d2680 0x7f6f9c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6f9be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0d2680 0x7f6f9c15c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60656/0 (socket says 172.21.15.99:60656) 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6f9be00640 1 -- 172.21.15.99:0/366813853 learned_addr learned my addr 172.21.15.99:0/366813853 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6fa1a00640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c15e970 0x7f6f9c0b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6fa1000640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c0cfac0 0x7f6f9c1f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:02.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6f9be00640 1 -- 172.21.15.99:0/366813853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c0cfac0 msgr2=0x7f6f9c1f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6f9be00640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c0cfac0 0x7f6f9c1f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6f9be00640 1 -- 172.21.15.99:0/366813853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c15e970 msgr2=0x7f6f9c0b8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6f9be00640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c15e970 0x7f6f9c0b8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.065+0000 7f6f9be00640 1 -- 172.21.15.99:0/366813853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c0cbdd0 con 0x7f6f9c0d2680 2024-09-10T07:45:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.066+0000 7f6fa1a00640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c15e970 0x7f6f9c0b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.066+0000 7f6f9be00640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0d2680 0x7f6f9c15c510 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800e9b0 tx=0x7f6f8800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.066+0000 7f6f98c00640 1 -- 172.21.15.99:0/366813853 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88017070 con 0x7f6f9c0d2680 2024-09-10T07:45:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.066+0000 7f6f98c00640 1 -- 172.21.15.99:0/366813853 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8800c9a0 con 0x7f6f9c0d2680 2024-09-10T07:45:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.066+0000 7f6f98c00640 1 -- 172.21.15.99:0/366813853 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800cd70 con 0x7f6f9c0d2680 2024-09-10T07:45:02.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.066+0000 7f6fa2400640 1 -- 172.21.15.99:0/366813853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c0cc0b0 con 0x7f6f9c0d2680 2024-09-10T07:45:02.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.066+0000 7f6fa2400640 1 -- 172.21.15.99:0/366813853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c0cc670 con 0x7f6f9c0d2680 2024-09-10T07:45:02.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.067+0000 7f6fa2400640 1 -- 172.21.15.99:0/366813853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c0cbb60 con 0x7f6f9c0d2680 2024-09-10T07:45:02.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.068+0000 7f6f98c00640 1 -- 172.21.15.99:0/366813853 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f8801a070 con 0x7f6f9c0d2680 2024-09-10T07:45:02.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.069+0000 7f6f98c00640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6f7c06be30 0x7f6f7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:02.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.069+0000 7f6f98c00640 1 -- 172.21.15.99:0/366813853 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5824+0+0 (secure 0 0 0) 0x7f6f8808b300 con 0x7f6f9c0d2680 2024-09-10T07:45:02.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.069+0000 7f6fa1000640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6f7c06be30 0x7f6f7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:02.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.070+0000 7f6fa1000640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6f7c06be30 0x7f6f7c06e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6f90034000 tx=0x7f6f9002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:02.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.074+0000 7f6f98c00640 1 -- 172.21.15.99:0/366813853 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f88059bc0 con 0x7f6f9c0d2680 2024-09-10T07:45:02.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.282+0000 7f6fa2400640 1 -- 172.21.15.99:0/366813853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6f9c0cf580 con 0x7f6f9c0d2680 2024-09-10T07:45:02.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.883+0000 7f6f98c00640 1 -- 172.21.15.99:0/366813853 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v84) ==== 104+0+0 (secure 0 0 0) 0x7f6f880594c0 con 0x7f6f9c0d2680 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 -- 172.21.15.99:0/366813853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6f7c06be30 msgr2=0x7f6f7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6f7c06be30 0x7f6f7c06e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6f90034000 tx=0x7f6f9002e000 comp rx=0 tx=0).stop 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 -- 172.21.15.99:0/366813853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0d2680 msgr2=0x7f6f9c15c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0d2680 0x7f6f9c15c510 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800e9b0 tx=0x7f6f8800ee70 comp rx=0 tx=0).stop 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 -- 172.21.15.99:0/366813853 shutdown_connections 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c15e970 0x7f6f9c0b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f6f7c06be30 0x7f6f7c06e2f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0d2680 0x7f6f9c15c510 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 --2- 172.21.15.99:0/366813853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f9c0cfac0 0x7f6f9c1f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 -- 172.21.15.99:0/366813853 >> 172.21.15.99:0/366813853 conn(0x7f6f9c09de00 msgr2=0x7f6f9c0c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 -- 172.21.15.99:0/366813853 shutdown_connections 2024-09-10T07:45:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:02.887+0000 7f6fa2400640 1 -- 172.21.15.99:0/366813853 wait complete. 2024-09-10T07:45:02.904 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:45:03.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.065+0000 7f1215e00640 1 Processor -- start 2024-09-10T07:45:03.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.065+0000 7f1215e00640 1 -- start start 2024-09-10T07:45:03.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.066+0000 7f1215e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12100ce460 0x7f12100cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:03.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.066+0000 7f1215e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f12100d0420 0x7f121006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:03.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f1215e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121015dfc0 con 0x7f121006eb20 2024-09-10T07:45:03.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f1215e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f121006ef70 con 0x7f12100ce460 2024-09-10T07:45:03.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f1215e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f121015d3b0 con 0x7f12100d0420 2024-09-10T07:45:03.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f120ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f12100ce460 0x7f12100cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:03.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f120f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f121006eb20 0x7f12101605c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38504/0 (socket says 172.21.15.99:38504) 2024-09-10T07:45:03.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f120f400640 1 -- 172.21.15.99:0/1277719328 learned_addr learned my addr 172.21.15.99:0/1277719328 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:03.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f1206000640 1 --2- 172.21.15.99:0/1277719328 >> v2:172.21.15.187:3300/0 conn(0x7f12100d0420 0x7f121006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f120e000640 1 -- 172.21.15.99:0/1277719328 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489882059 0 0) 0x7f121015dfc0 con 0x7f121006eb20 2024-09-10T07:45:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f120ea00640 1 -- 172.21.15.99:0/1277719328 >> v2:172.21.15.187:3300/0 conn(0x7f12100d0420 msgr2=0x7f121006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f120ea00640 1 --2- 172.21.15.99:0/1277719328 >> v2:172.21.15.187:3300/0 conn(0x7f12100d0420 0x7f121006e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f120ea00640 1 -- 172.21.15.99:0/1277719328 >> v1:172.21.15.99:6789/0 conn(0x7f121006eb20 legacy=0x7f12101605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.067+0000 7f120ea00640 1 -- 172.21.15.99:0/1277719328 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121015d690 con 0x7f12100ce460 2024-09-10T07:45:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.068+0000 7f120ea00640 1 --2- 172.21.15.99:0/1277719328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100ce460 0x7f12100cfee0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f12100b36e0 tx=0x7f120002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab890d64b7b22c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:03.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f120e000640 1 -- 172.21.15.99:0/1277719328 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1200037070 con 0x7f12100ce460 2024-09-10T07:45:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f120e000640 1 -- 172.21.15.99:0/1277719328 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1200032440 con 0x7f12100ce460 2024-09-10T07:45:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f120e000640 1 -- 172.21.15.99:0/1277719328 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1200032810 con 0x7f12100ce460 2024-09-10T07:45:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f1215e00640 1 -- 172.21.15.99:0/1277719328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100ce460 msgr2=0x7f12100cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f1215e00640 1 --2- 172.21.15.99:0/1277719328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100ce460 0x7f12100cfee0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f12100b36e0 tx=0x7f120002a1a0 comp rx=0 tx=0).stop 2024-09-10T07:45:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f1215e00640 1 -- 172.21.15.99:0/1277719328 shutdown_connections 2024-09-10T07:45:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f1215e00640 1 --2- 172.21.15.99:0/1277719328 >> v2:172.21.15.187:3300/0 conn(0x7f12100d0420 0x7f121006e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f1215e00640 1 --2- 172.21.15.99:0/1277719328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100ce460 0x7f12100cfee0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f1215e00640 1 -- 172.21.15.99:0/1277719328 >> 172.21.15.99:0/1277719328 conn(0x7f12100b26a0 msgr2=0x7f12100b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f1215e00640 1 -- 172.21.15.99:0/1277719328 shutdown_connections 2024-09-10T07:45:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.069+0000 7f1215e00640 1 -- 172.21.15.99:0/1277719328 wait complete. 2024-09-10T07:45:03.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.071+0000 7f1215e00640 1 Processor -- start 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.071+0000 7f1215e00640 1 -- start start 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f1215e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121006eb20 0x7f12100c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f1215e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12100ce460 0x7f12100af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f1215e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100d0420 0x7f12100afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f1215e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f12100ce840 con 0x7f12100d0420 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f1215e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f121015dc50 con 0x7f121006eb20 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f1215e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f121015cfd0 con 0x7f12100ce460 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f120f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100d0420 0x7f12100afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f120f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100d0420 0x7f12100afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60688/0 (socket says 172.21.15.99:60688) 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f120f400640 1 -- 172.21.15.99:0/2665983652 learned_addr learned my addr 172.21.15.99:0/2665983652 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f120ea00640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121006eb20 0x7f12100c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.072+0000 7f1206000640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12100ce460 0x7f12100af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f120f400640 1 -- 172.21.15.99:0/2665983652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12100ce460 msgr2=0x7f12100af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f120f400640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12100ce460 0x7f12100af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f120f400640 1 -- 172.21.15.99:0/2665983652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121006eb20 msgr2=0x7f12100c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f120f400640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121006eb20 0x7f12100c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f120f400640 1 -- 172.21.15.99:0/2665983652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12101f7a90 con 0x7f12100d0420 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f1206000640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12100ce460 0x7f12100af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f120f400640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100d0420 0x7f12100afdd0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f120800c700 tx=0x7f120800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f1207e00640 1 -- 172.21.15.99:0/2665983652 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208018070 con 0x7f12100d0420 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f1207e00640 1 -- 172.21.15.99:0/2665983652 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120800ce10 con 0x7f12100d0420 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f1207e00640 1 -- 172.21.15.99:0/2665983652 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120800a880 con 0x7f12100d0420 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f1215e00640 1 -- 172.21.15.99:0/2665983652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12101f7d70 con 0x7f12100d0420 2024-09-10T07:45:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.073+0000 7f1215e00640 1 -- 172.21.15.99:0/2665983652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12101f8330 con 0x7f12100d0420 2024-09-10T07:45:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.074+0000 7f1215e00640 1 -- 172.21.15.99:0/2665983652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12100cfee0 con 0x7f12100d0420 2024-09-10T07:45:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.075+0000 7f1207e00640 1 -- 172.21.15.99:0/2665983652 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f120800aa20 con 0x7f12100d0420 2024-09-10T07:45:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.076+0000 7f1207e00640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f11ec06be30 0x7f11ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.076+0000 7f1207e00640 1 -- 172.21.15.99:0/2665983652 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5824+0+0 (secure 0 0 0) 0x7f120808a4a0 con 0x7f12100d0420 2024-09-10T07:45:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.076+0000 7f120ea00640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f11ec06be30 0x7f11ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.077+0000 7f120ea00640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f11ec06be30 0x7f11ec06e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1200034000 tx=0x7f120002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.080+0000 7f1207e00640 1 -- 172.21.15.99:0/2665983652 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1208058710 con 0x7f12100d0420 2024-09-10T07:45:03.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:03.252+0000 7f1215e00640 1 -- 172.21.15.99:0/2665983652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f12100b23c0 con 0x7f12100d0420 2024-09-10T07:45:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.047+0000 7f1207e00640 1 -- 172.21.15.99:0/2665983652 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v178) ==== 181+0+0 (secure 0 0 0) 0x7f120805ca10 con 0x7f12100d0420 2024-09-10T07:45:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:45:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 -- 172.21.15.99:0/2665983652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f11ec06be30 msgr2=0x7f11ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f11ec06be30 0x7f11ec06e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1200034000 tx=0x7f120002e000 comp rx=0 tx=0).stop 2024-09-10T07:45:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 -- 172.21.15.99:0/2665983652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100d0420 msgr2=0x7f12100afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100d0420 0x7f12100afdd0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f120800c700 tx=0x7f120800cbc0 comp rx=0 tx=0).stop 2024-09-10T07:45:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 -- 172.21.15.99:0/2665983652 shutdown_connections 2024-09-10T07:45:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f11ec06be30 0x7f11ec06e2f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12100d0420 0x7f12100afdd0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12100ce460 0x7f12100af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 --2- 172.21.15.99:0/2665983652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f121006eb20 0x7f12100c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:04.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 -- 172.21.15.99:0/2665983652 >> 172.21.15.99:0/2665983652 conn(0x7f12100b26a0 msgr2=0x7f121015f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:04.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 -- 172.21.15.99:0/2665983652 shutdown_connections 2024-09-10T07:45:04.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.051+0000 7f1215e00640 1 -- 172.21.15.99:0/2665983652 wait complete. 2024-09-10T07:45:04.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:45:04.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.229+0000 7fee71400640 1 Processor -- start 2024-09-10T07:45:04.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.229+0000 7fee71400640 1 -- start start 2024-09-10T07:45:04.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.231+0000 7fee71400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fee6c0b7590 0x7fee6c15f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:04.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.231+0000 7fee71400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c160260 con 0x7fee6c06ffb0 2024-09-10T07:45:04.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.231+0000 7fee71400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c06cec0 con 0x7fee6c0b7130 2024-09-10T07:45:04.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.231+0000 7fee71400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fee6c06d1a0 con 0x7fee6c0b7590 2024-09-10T07:45:04.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.231+0000 7fee6be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fee6c06ffb0 0x7fee6c070390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38514/0 (socket says 172.21.15.99:38514) 2024-09-10T07:45:04.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.231+0000 7fee6be00640 1 -- 172.21.15.99:0/1334449322 learned_addr learned my addr 172.21.15.99:0/1334449322 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:04.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.231+0000 7fee70a00640 1 --2- 172.21.15.99:0/1334449322 >> v2:172.21.15.187:3300/0 conn(0x7fee6c0b7590 0x7fee6c15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:04.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.231+0000 7fee6aa00640 1 -- 172.21.15.99:0/1334449322 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779079183 0 0) 0x7fee6c160260 con 0x7fee6c06ffb0 2024-09-10T07:45:04.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.231+0000 7fee6aa00640 1 -- 172.21.15.99:0/1334449322 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee50003520 con 0x7fee6c06ffb0 2024-09-10T07:45:04.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.232+0000 7fee6aa00640 1 -- 172.21.15.99:0/1334449322 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674771853 0 0) 0x7fee6c06cec0 con 0x7fee6c0b7130 2024-09-10T07:45:04.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.232+0000 7fee6aa00640 1 -- 172.21.15.99:0/1334449322 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee6c160260 con 0x7fee6c0b7130 2024-09-10T07:45:04.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.232+0000 7fee70a00640 1 -- 172.21.15.99:0/1334449322 >> v1:172.21.15.187:6789/0 conn(0x7fee6c0b7130 legacy=0x7fee6c15ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:04.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.232+0000 7fee70a00640 1 -- 172.21.15.99:0/1334449322 >> v1:172.21.15.99:6789/0 conn(0x7fee6c06ffb0 legacy=0x7fee6c070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:04.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.232+0000 7fee70a00640 1 -- 172.21.15.99:0/1334449322 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c06d480 con 0x7fee6c0b7590 2024-09-10T07:45:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.233+0000 7fee70a00640 1 --2- 172.21.15.99:0/1334449322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6c0b7590 0x7fee6c15f470 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fee64009d90 tx=0x7fee6402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2a40dd3d682e3d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.233+0000 7fee6aa00640 1 -- 172.21.15.99:0/1334449322 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64007740 con 0x7fee6c0b7590 2024-09-10T07:45:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.233+0000 7fee6aa00640 1 -- 172.21.15.99:0/1334449322 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee640078e0 con 0x7fee6c0b7590 2024-09-10T07:45:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.233+0000 7fee6aa00640 1 -- 172.21.15.99:0/1334449322 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64007c90 con 0x7fee6c0b7590 2024-09-10T07:45:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.233+0000 7fee71400640 1 -- 172.21.15.99:0/1334449322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6c0b7590 msgr2=0x7fee6c15f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.234+0000 7fee71400640 1 --2- 172.21.15.99:0/1334449322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6c0b7590 0x7fee6c15f470 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fee64009d90 tx=0x7fee6402a6f0 comp rx=0 tx=0).stop 2024-09-10T07:45:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.234+0000 7fee71400640 1 -- 172.21.15.99:0/1334449322 shutdown_connections 2024-09-10T07:45:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.234+0000 7fee71400640 1 --2- 172.21.15.99:0/1334449322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6c0b7590 0x7fee6c15f470 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.234+0000 7fee71400640 1 -- 172.21.15.99:0/1334449322 >> 172.21.15.99:0/1334449322 conn(0x7fee6c0b7cc0 msgr2=0x7fee6c0b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.234+0000 7fee71400640 1 -- 172.21.15.99:0/1334449322 shutdown_connections 2024-09-10T07:45:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.234+0000 7fee71400640 1 -- 172.21.15.99:0/1334449322 wait complete. 2024-09-10T07:45:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.235+0000 7fee71400640 1 Processor -- start 2024-09-10T07:45:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.235+0000 7fee71400640 1 -- start start 2024-09-10T07:45:04.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.236+0000 7fee71400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6c06ffb0 0x7fee6c1523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:04.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.236+0000 7fee71400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6c0b7130 0x7fee6c0cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:04.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.236+0000 7fee71400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee6c0b7590 0x7fee6c0a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:04.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.236+0000 7fee71400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c0b6360 con 0x7fee6c0b7590 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.236+0000 7fee71400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c06ec90 con 0x7fee6c06ffb0 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.236+0000 7fee71400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c0b64e0 con 0x7fee6c0b7130 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee70a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee6c0b7590 0x7fee6c0a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee70a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee6c0b7590 0x7fee6c0a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60704/0 (socket says 172.21.15.99:60704) 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee70a00640 1 -- 172.21.15.99:0/744533487 learned_addr learned my addr 172.21.15.99:0/744533487 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee6be00640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6c06ffb0 0x7fee6c1523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee6b400640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6c0b7130 0x7fee6c0cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee70a00640 1 -- 172.21.15.99:0/744533487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6c0b7130 msgr2=0x7fee6c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee70a00640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6c0b7130 0x7fee6c0cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee70a00640 1 -- 172.21.15.99:0/744533487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6c06ffb0 msgr2=0x7fee6c1523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee70a00640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6c06ffb0 0x7fee6c1523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee70a00640 1 -- 172.21.15.99:0/744533487 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c09f460 con 0x7fee6c0b7590 2024-09-10T07:45:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee6b400640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6c0b7130 0x7fee6c0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.237+0000 7fee70a00640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee6c0b7590 0x7fee6c0a0220 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fee6402ace0 tx=0x7fee64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.238+0000 7fee63e00640 1 -- 172.21.15.99:0/744533487 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64040070 con 0x7fee6c0b7590 2024-09-10T07:45:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.238+0000 7fee63e00640 1 -- 172.21.15.99:0/744533487 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee64031c60 con 0x7fee6c0b7590 2024-09-10T07:45:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.238+0000 7fee71400640 1 -- 172.21.15.99:0/744533487 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c09f740 con 0x7fee6c0b7590 2024-09-10T07:45:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.238+0000 7fee63e00640 1 -- 172.21.15.99:0/744533487 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64009450 con 0x7fee6c0b7590 2024-09-10T07:45:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.238+0000 7fee71400640 1 -- 172.21.15.99:0/744533487 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c09fd00 con 0x7fee6c0b7590 2024-09-10T07:45:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.239+0000 7fee71400640 1 -- 172.21.15.99:0/744533487 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6c15fe70 con 0x7fee6c0b7590 2024-09-10T07:45:04.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.240+0000 7fee63e00640 1 -- 172.21.15.99:0/744533487 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee64039040 con 0x7fee6c0b7590 2024-09-10T07:45:04.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.241+0000 7fee63e00640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fee4c06be30 0x7fee4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:04.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.241+0000 7fee63e00640 1 -- 172.21.15.99:0/744533487 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5386+0+0 (secure 0 0 0) 0x7fee640ac100 con 0x7fee6c0b7590 2024-09-10T07:45:04.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.241+0000 7fee6be00640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fee4c06be30 0x7fee4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:04.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.241+0000 7fee6be00640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fee4c06be30 0x7fee4c06e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fee5c000f60 tx=0x7fee5c007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:04.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.245+0000 7fee63e00640 1 -- 172.21.15.99:0/744533487 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee6c15fe70 con 0x7fee6c0b7590 2024-09-10T07:45:04.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:04.424+0000 7fee71400640 1 -- 172.21.15.99:0/744533487 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fee6c070390 con 0x7fee6c0b7590 2024-09-10T07:45:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.053+0000 7fee63e00640 1 -- 172.21.15.99:0/744533487 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v179) ==== 169+0+0 (secure 0 0 0) 0x7fee6407ab50 con 0x7fee6c0b7590 2024-09-10T07:45:05.053 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:45:05.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.056+0000 7fee71400640 1 -- 172.21.15.99:0/744533487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fee4c06be30 msgr2=0x7fee4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.056+0000 7fee71400640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fee4c06be30 0x7fee4c06e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fee5c000f60 tx=0x7fee5c007d70 comp rx=0 tx=0).stop 2024-09-10T07:45:05.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.056+0000 7fee71400640 1 -- 172.21.15.99:0/744533487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee6c0b7590 msgr2=0x7fee6c0a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.056+0000 7fee71400640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee6c0b7590 0x7fee6c0a0220 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fee6402ace0 tx=0x7fee64004a40 comp rx=0 tx=0).stop 2024-09-10T07:45:05.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.057+0000 7fee71400640 1 -- 172.21.15.99:0/744533487 shutdown_connections 2024-09-10T07:45:05.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.057+0000 7fee71400640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fee4c06be30 0x7fee4c06e2f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.057+0000 7fee71400640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee6c0b7590 0x7fee6c0a0220 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.057+0000 7fee71400640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6c0b7130 0x7fee6c0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.057+0000 7fee71400640 1 --2- 172.21.15.99:0/744533487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6c06ffb0 0x7fee6c1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.057+0000 7fee71400640 1 -- 172.21.15.99:0/744533487 >> 172.21.15.99:0/744533487 conn(0x7fee6c0b7cc0 msgr2=0x7fee6c0b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:05.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.057+0000 7fee71400640 1 -- 172.21.15.99:0/744533487 shutdown_connections 2024-09-10T07:45:05.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.057+0000 7fee71400640 1 -- 172.21.15.99:0/744533487 wait complete. 2024-09-10T07:45:05.075 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T07:45:05.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.234+0000 7f0ede400640 1 Processor -- start 2024-09-10T07:45:05.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.234+0000 7f0ede400640 1 -- start start 2024-09-10T07:45:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.235+0000 7f0ede400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0ed80d14e0 0x7f0ed80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.236+0000 7f0ede400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed80b47e0 0x7f0ed80b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.236+0000 7f0ede400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ed80d3270 con 0x7f0ed815ede0 2024-09-10T07:45:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.236+0000 7f0ede400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed80d1e60 con 0x7f0ed80d14e0 2024-09-10T07:45:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.236+0000 7f0ede400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed80d34e0 con 0x7f0ed80b47e0 2024-09-10T07:45:05.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.236+0000 7f0ed7400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0ed815ede0 0x7f0ed80d5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38528/0 (socket says 172.21.15.99:38528) 2024-09-10T07:45:05.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.236+0000 7f0ed7400640 1 -- 172.21.15.99:0/539859864 learned_addr learned my addr 172.21.15.99:0/539859864 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.236+0000 7f0ecea00640 1 --2- 172.21.15.99:0/539859864 >> v2:172.21.15.187:3300/0 conn(0x7f0ed80d14e0 0x7f0ed80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.236+0000 7f0ed7e00640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed80b47e0 0x7f0ed80b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.236+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2302517936 0 0) 0x7f0ed80d3270 con 0x7f0ed815ede0 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.236+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ebc003520 con 0x7f0ed815ede0 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2963758968 0 0) 0x7f0ebc003520 con 0x7f0ed815ede0 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed80b47e0 msgr2=0x7f0ed80b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed80b47e0 0x7f0ed80b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 >> v2:172.21.15.187:3300/0 conn(0x7f0ed80d14e0 msgr2=0x7f0ed80d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 --2- 172.21.15.99:0/539859864 >> v2:172.21.15.187:3300/0 conn(0x7f0ed80d14e0 0x7f0ed80d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed80d37c0 con 0x7f0ed815ede0 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f0ec8001670 con 0x7f0ed815ede0 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 >> v1:172.21.15.99:6789/0 conn(0x7f0ed815ede0 legacy=0x7f0ed80d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ebc0039b0 0x7f0ebc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed80b47e0 0x7f0ebc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ebc004d40 0x7f0ebc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed80d1e60 con 0x7f0ebc004d40 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed80d34e0 con 0x7f0ebc0039b0 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0ebc00ba40 con 0x7f0ed80b47e0 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed7400640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ebc0039b0 0x7f0ebc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed7e00640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ebc004d40 0x7f0ebc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ecea00640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed80b47e0 0x7f0ebc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed7400640 1 -- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed80b47e0 msgr2=0x7f0ebc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed7400640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed80b47e0 0x7f0ebc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed7400640 1 -- 172.21.15.99:0/539859864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ebc004d40 msgr2=0x7f0ebc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed7400640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ebc004d40 0x7f0ebc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.237+0000 7f0ed7400640 1 -- 172.21.15.99:0/539859864 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc003520 con 0x7f0ebc0039b0 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.239+0000 7f0ed7400640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ebc0039b0 0x7f0ebc003dd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800c190 tx=0x7f0ebc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd002743f62698d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.239+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8007c80 con 0x7f0ebc0039b0 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.239+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec8005ad0 con 0x7f0ebc0039b0 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.239+0000 7f0ed6a00640 1 -- 172.21.15.99:0/539859864 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8007070 con 0x7f0ebc0039b0 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.239+0000 7f0ede400640 1 -- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ebc0039b0 msgr2=0x7f0ebc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.239+0000 7f0ede400640 1 --2- 172.21.15.99:0/539859864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ebc0039b0 0x7f0ebc003dd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800c190 tx=0x7f0ebc005830 comp rx=0 tx=0).stop 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.239+0000 7f0ed7e00640 1 -- 172.21.15.99:0/539859864 reap_dead start 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.239+0000 7f0ede400640 1 -- 172.21.15.99:0/539859864 shutdown_connections 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.240+0000 7f0ede400640 1 -- 172.21.15.99:0/539859864 >> 172.21.15.99:0/539859864 conn(0x7f0ed809df30 msgr2=0x7f0ed80d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.240+0000 7f0ede400640 1 -- 172.21.15.99:0/539859864 shutdown_connections 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.240+0000 7f0ede400640 1 -- 172.21.15.99:0/539859864 wait complete. 2024-09-10T07:45:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.241+0000 7f0ede400640 1 Processor -- start 2024-09-10T07:45:05.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.241+0000 7f0ede400640 1 -- start start 2024-09-10T07:45:05.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.242+0000 7f0ede400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ebc0039b0 0x7f0ed80c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.242+0000 7f0ede400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed8161930 0x7f0ed81570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.242+0000 7f0ede400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed8161db0 0x7f0ed8157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.242+0000 7f0ede400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed80d5a10 con 0x7f0ed8161930 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.242+0000 7f0ede400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed815f1c0 con 0x7f0ebc0039b0 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.242+0000 7f0ede400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed80b4020 con 0x7f0ed8161db0 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.242+0000 7f0ecea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed8161930 0x7f0ed81570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.243+0000 7f0ecea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed8161930 0x7f0ed81570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60720/0 (socket says 172.21.15.99:60720) 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.243+0000 7f0ecea00640 1 -- 172.21.15.99:0/1979622590 learned_addr learned my addr 172.21.15.99:0/1979622590 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.243+0000 7f0ed7400640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ebc0039b0 0x7f0ed80c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.243+0000 7f0ed7e00640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed8161db0 0x7f0ed8157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.243+0000 7f0ecea00640 1 -- 172.21.15.99:0/1979622590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed8161db0 msgr2=0x7f0ed8157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.243+0000 7f0ecea00640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed8161db0 0x7f0ed8157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.243+0000 7f0ecea00640 1 -- 172.21.15.99:0/1979622590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ebc0039b0 msgr2=0x7f0ed80c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.243+0000 7f0ecea00640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ebc0039b0 0x7f0ed80c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.243+0000 7f0ecea00640 1 -- 172.21.15.99:0/1979622590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed80ccbf0 con 0x7f0ed8161930 2024-09-10T07:45:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.243+0000 7f0ecea00640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed8161930 0x7f0ed81570f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0011960 tx=0x7f0ec0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.244+0000 7f0ecfe00640 1 -- 172.21.15.99:0/1979622590 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000faf0 con 0x7f0ed8161930 2024-09-10T07:45:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.244+0000 7f0ecfe00640 1 -- 172.21.15.99:0/1979622590 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec000fc90 con 0x7f0ed8161930 2024-09-10T07:45:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.244+0000 7f0ecfe00640 1 -- 172.21.15.99:0/1979622590 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0014440 con 0x7f0ed8161930 2024-09-10T07:45:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.244+0000 7f0ede400640 1 -- 172.21.15.99:0/1979622590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed815f590 con 0x7f0ed8161930 2024-09-10T07:45:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.244+0000 7f0ede400640 1 -- 172.21.15.99:0/1979622590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed80cbe80 con 0x7f0ed8161930 2024-09-10T07:45:05.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.245+0000 7f0ede400640 1 -- 172.21.15.99:0/1979622590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed80d1920 con 0x7f0ed8161930 2024-09-10T07:45:05.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.246+0000 7f0ecfe00640 1 -- 172.21.15.99:0/1979622590 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ec0012040 con 0x7f0ed8161930 2024-09-10T07:45:05.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.247+0000 7f0ecfe00640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0eb406be30 0x7f0eb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.247+0000 7f0ecfe00640 1 -- 172.21.15.99:0/1979622590 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f0ec008b1c0 con 0x7f0ed8161930 2024-09-10T07:45:05.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.247+0000 7f0ed7400640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0eb406be30 0x7f0eb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.248+0000 7f0ed7400640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0eb406be30 0x7f0eb406e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8032000 tx=0x7f0ec8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:05.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.251+0000 7f0ecfe00640 1 -- 172.21.15.99:0/1979622590 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ec0019030 con 0x7f0ed8161930 2024-09-10T07:45:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.430+0000 7f0ede400640 1 -- 172.21.15.99:0/1979622590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f0ed80d0e00 con 0x7f0ed8161930 2024-09-10T07:45:05.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.434+0000 7f0ecfe00640 1 -- 172.21.15.99:0/1979622590 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f0ec0059e60 con 0x7f0ed8161930 2024-09-10T07:45:05.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.436+0000 7f0ede400640 1 -- 172.21.15.99:0/1979622590 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0eb406be30 msgr2=0x7f0eb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.436+0000 7f0ede400640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0eb406be30 0x7f0eb406e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8032000 tx=0x7f0ec8009030 comp rx=0 tx=0).stop 2024-09-10T07:45:05.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.436+0000 7f0ede400640 1 -- 172.21.15.99:0/1979622590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed8161930 msgr2=0x7f0ed81570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.436+0000 7f0ede400640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed8161930 0x7f0ed81570f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0011960 tx=0x7f0ec0011e20 comp rx=0 tx=0).stop 2024-09-10T07:45:05.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.436+0000 7f0ede400640 1 -- 172.21.15.99:0/1979622590 shutdown_connections 2024-09-10T07:45:05.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.436+0000 7f0ede400640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ed8161db0 0x7f0ed8157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.436+0000 7f0ede400640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0eb406be30 0x7f0eb406e2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.436+0000 7f0ede400640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed8161930 0x7f0ed81570f0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.436+0000 7f0ede400640 1 --2- 172.21.15.99:0/1979622590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ebc0039b0 0x7f0ed80c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.436+0000 7f0ede400640 1 -- 172.21.15.99:0/1979622590 >> 172.21.15.99:0/1979622590 conn(0x7f0ed809df30 msgr2=0x7f0ed806cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:05.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.437+0000 7f0ede400640 1 -- 172.21.15.99:0/1979622590 shutdown_connections 2024-09-10T07:45:05.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.437+0000 7f0ede400640 1 -- 172.21.15.99:0/1979622590 wait complete. 2024-09-10T07:45:05.452 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-10T07:45:05.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.606+0000 7fb5e5600640 1 Processor -- start 2024-09-10T07:45:05.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.606+0000 7fb5e5600640 1 -- start start 2024-09-10T07:45:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.607+0000 7fb5e5600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb5e015e970 0x7fb5e00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.607+0000 7fb5e5600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5e00cfc90 0x7fb5e00c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.607+0000 7fb5e5600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e00d2bd0 con 0x7fb5e00d2680 2024-09-10T07:45:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.607+0000 7fb5e5600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e00d37e0 con 0x7fb5e00cfc90 2024-09-10T07:45:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.607+0000 7fb5e5600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e00d2eb0 con 0x7fb5e015e970 2024-09-10T07:45:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5df400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb5e00d2680 0x7fb5e00cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38540/0 (socket says 172.21.15.99:38540) 2024-09-10T07:45:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5df400640 1 -- 172.21.15.99:0/1477350885 learned_addr learned my addr 172.21.15.99:0/1477350885 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5e4c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb5e00cfc90 0x7fb5e00c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5dfe00640 1 --2- 172.21.15.99:0/1477350885 >> v2:172.21.15.187:3300/0 conn(0x7fb5e015e970 0x7fb5e00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5dea00640 1 -- 172.21.15.99:0/1477350885 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571292574 0 0) 0x7fb5e00d2bd0 con 0x7fb5e00d2680 2024-09-10T07:45:05.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5dea00640 1 -- 172.21.15.99:0/1477350885 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5c4003520 con 0x7fb5e00d2680 2024-09-10T07:45:05.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5e4c00640 1 -- 172.21.15.99:0/1477350885 >> v2:172.21.15.187:3300/0 conn(0x7fb5e015e970 msgr2=0x7fb5e00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:05.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5e4c00640 1 --2- 172.21.15.99:0/1477350885 >> v2:172.21.15.187:3300/0 conn(0x7fb5e015e970 0x7fb5e00d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5e4c00640 1 -- 172.21.15.99:0/1477350885 >> v1:172.21.15.99:6789/0 conn(0x7fb5e00d2680 legacy=0x7fb5e00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5e4c00640 1 -- 172.21.15.99:0/1477350885 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e00d3190 con 0x7fb5e00cfc90 2024-09-10T07:45:05.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.608+0000 7fb5dfe00640 1 --2- 172.21.15.99:0/1477350885 >> v2:172.21.15.187:3300/0 conn(0x7fb5e015e970 0x7fb5e00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.609+0000 7fb5e4c00640 1 --2- 172.21.15.99:0/1477350885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e00cfc90 0x7fb5e00c8700 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fb5e006c1c0 tx=0x7fb5d802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c0c7351dab5fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.609+0000 7fb5dea00640 1 -- 172.21.15.99:0/1477350885 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8007740 con 0x7fb5e00cfc90 2024-09-10T07:45:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.609+0000 7fb5dea00640 1 -- 172.21.15.99:0/1477350885 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d80078e0 con 0x7fb5e00cfc90 2024-09-10T07:45:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.609+0000 7fb5dea00640 1 -- 172.21.15.99:0/1477350885 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8007c90 con 0x7fb5e00cfc90 2024-09-10T07:45:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.610+0000 7fb5e5600640 1 -- 172.21.15.99:0/1477350885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e00cfc90 msgr2=0x7fb5e00c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.610+0000 7fb5e5600640 1 --2- 172.21.15.99:0/1477350885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e00cfc90 0x7fb5e00c8700 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fb5e006c1c0 tx=0x7fb5d802a710 comp rx=0 tx=0).stop 2024-09-10T07:45:05.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.610+0000 7fb5e5600640 1 -- 172.21.15.99:0/1477350885 shutdown_connections 2024-09-10T07:45:05.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.610+0000 7fb5e5600640 1 --2- 172.21.15.99:0/1477350885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e00cfc90 0x7fb5e00c8700 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.610+0000 7fb5e5600640 1 --2- 172.21.15.99:0/1477350885 >> v2:172.21.15.187:3300/0 conn(0x7fb5e015e970 0x7fb5e00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.610+0000 7fb5e5600640 1 -- 172.21.15.99:0/1477350885 >> 172.21.15.99:0/1477350885 conn(0x7fb5e009de00 msgr2=0x7fb5e00d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:05.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.610+0000 7fb5e5600640 1 -- 172.21.15.99:0/1477350885 shutdown_connections 2024-09-10T07:45:05.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.610+0000 7fb5e5600640 1 -- 172.21.15.99:0/1477350885 wait complete. 2024-09-10T07:45:05.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.612+0000 7fb5e5600640 1 Processor -- start 2024-09-10T07:45:05.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.612+0000 7fb5e5600640 1 -- start start 2024-09-10T07:45:05.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e5600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5e00cfc90 0x7fb5e0161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e5600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5e00d2680 0x7fb5e0157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e015e970 0x7fb5e015f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e5600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e015ed50 con 0x7fb5e015e970 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e5600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e00d0840 con 0x7fb5e00cfc90 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e5600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e015eed0 con 0x7fb5e00d2680 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e015e970 0x7fb5e015f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e015e970 0x7fb5e015f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60744/0 (socket says 172.21.15.99:60744) 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e4c00640 1 -- 172.21.15.99:0/260839056 learned_addr learned my addr 172.21.15.99:0/260839056 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5dfe00640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5e00cfc90 0x7fb5e0161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5df400640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5e00d2680 0x7fb5e0157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e4c00640 1 -- 172.21.15.99:0/260839056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5e00d2680 msgr2=0x7fb5e0157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e4c00640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5e00d2680 0x7fb5e0157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e4c00640 1 -- 172.21.15.99:0/260839056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5e00cfc90 msgr2=0x7fb5e0161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e4c00640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5e00cfc90 0x7fb5e0161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.613+0000 7fb5e4c00640 1 -- 172.21.15.99:0/260839056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e00cda70 con 0x7fb5e015e970 2024-09-10T07:45:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.614+0000 7fb5e4c00640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e015e970 0x7fb5e015f8c0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009e80 tx=0x7fb5d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.614+0000 7fb5d7e00640 1 -- 172.21.15.99:0/260839056 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8009450 con 0x7fb5e015e970 2024-09-10T07:45:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.614+0000 7fb5d7e00640 1 -- 172.21.15.99:0/260839056 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d8004240 con 0x7fb5e015e970 2024-09-10T07:45:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.614+0000 7fb5d7e00640 1 -- 172.21.15.99:0/260839056 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8004630 con 0x7fb5e015e970 2024-09-10T07:45:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.614+0000 7fb5e5600640 1 -- 172.21.15.99:0/260839056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e00cdd50 con 0x7fb5e015e970 2024-09-10T07:45:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.614+0000 7fb5e5600640 1 -- 172.21.15.99:0/260839056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e00ce5f0 con 0x7fb5e015e970 2024-09-10T07:45:05.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.615+0000 7fb5e5600640 1 -- 172.21.15.99:0/260839056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e00d0300 con 0x7fb5e015e970 2024-09-10T07:45:05.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.616+0000 7fb5d7e00640 1 -- 172.21.15.99:0/260839056 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5d8039040 con 0x7fb5e015e970 2024-09-10T07:45:05.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.617+0000 7fb5d7e00640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5c006be30 0x7fb5c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:05.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.617+0000 7fb5d7e00640 1 -- 172.21.15.99:0/260839056 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7fb5d80abb80 con 0x7fb5e015e970 2024-09-10T07:45:05.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.617+0000 7fb5dfe00640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5c006be30 0x7fb5c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:05.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.618+0000 7fb5dfe00640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5c006be30 0x7fb5c006e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00d5850 tx=0x7fb5d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:05.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.623+0000 7fb5d7e00640 1 -- 172.21.15.99:0/260839056 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5d8040030 con 0x7fb5e015e970 2024-09-10T07:45:05.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:05.858+0000 7fb5e5600640 1 -- 172.21.15.99:0/260839056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) -- 0x7fb5e00cdf20 con 0x7fb5e015e970 2024-09-10T07:45:06.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.056+0000 7fb5d7e00640 1 -- 172.21.15.99:0/260839056 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v506) ==== 131+0+0 (secure 0 0 0) 0x7fb5d807a290 con 0x7fb5e015e970 2024-09-10T07:45:06.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.057+0000 7fb5e5600640 1 -- 172.21.15.99:0/260839056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5c006be30 msgr2=0x7fb5c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.057+0000 7fb5e5600640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5c006be30 0x7fb5c006e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00d5850 tx=0x7fb5d0008040 comp rx=0 tx=0).stop 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.057+0000 7fb5e5600640 1 -- 172.21.15.99:0/260839056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e015e970 msgr2=0x7fb5e015f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.057+0000 7fb5e5600640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e015e970 0x7fb5e015f8c0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009e80 tx=0x7fb5d8004a40 comp rx=0 tx=0).stop 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.058+0000 7fb5e5600640 1 -- 172.21.15.99:0/260839056 shutdown_connections 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.058+0000 7fb5e5600640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb5c006be30 0x7fb5c006e2f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.058+0000 7fb5e5600640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e015e970 0x7fb5e015f8c0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.058+0000 7fb5e5600640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5e00d2680 0x7fb5e0157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.058+0000 7fb5e5600640 1 --2- 172.21.15.99:0/260839056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5e00cfc90 0x7fb5e0161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.058+0000 7fb5e5600640 1 -- 172.21.15.99:0/260839056 >> 172.21.15.99:0/260839056 conn(0x7fb5e009de00 msgr2=0x7fb5e00c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.058+0000 7fb5e5600640 1 -- 172.21.15.99:0/260839056 shutdown_connections 2024-09-10T07:45:06.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.058+0000 7fb5e5600640 1 -- 172.21.15.99:0/260839056 wait complete. 2024-09-10T07:45:06.073 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-10T07:45:06.073 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-10T07:45:06.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:45:06.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.226+0000 7f4b70a00640 1 Processor -- start 2024-09-10T07:45:06.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.227+0000 7f4b70a00640 1 -- start start 2024-09-10T07:45:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b70a00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4b6c145290 0x7f4b6c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b70a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c0ce780 0x7f4b6c072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b70a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4b6c071510 0x7f4b6c072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b70a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6c06efe0 con 0x7f4b6c071510 2024-09-10T07:45:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b70a00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6c06e3d0 con 0x7f4b6c145290 2024-09-10T07:45:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b70a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c06e6b0 con 0x7f4b6c0ce780 2024-09-10T07:45:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b6a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4b6c071510 0x7f4b6c072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b6a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4b6c071510 0x7f4b6c072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60758/0 (socket says 172.21.15.99:60758) 2024-09-10T07:45:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b6a800640 1 -- 172.21.15.99:0/556016191 learned_addr learned my addr 172.21.15.99:0/556016191 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b69e00640 1 --2- 172.21.15.99:0/556016191 >> v2:172.21.15.187:3300/0 conn(0x7f4b6c145290 0x7f4b6c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.228+0000 7f4b61400640 1 --2- 172.21.15.99:0/556016191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c0ce780 0x7f4b6c072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.229+0000 7f4b6a800640 1 -- 172.21.15.99:0/556016191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c0ce780 msgr2=0x7f4b6c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.229+0000 7f4b6a800640 1 --2- 172.21.15.99:0/556016191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c0ce780 0x7f4b6c072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.229+0000 7f4b6a800640 1 -- 172.21.15.99:0/556016191 >> v2:172.21.15.187:3300/0 conn(0x7f4b6c145290 msgr2=0x7f4b6c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.229+0000 7f4b6a800640 1 --2- 172.21.15.99:0/556016191 >> v2:172.21.15.187:3300/0 conn(0x7f4b6c145290 0x7f4b6c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.229+0000 7f4b6a800640 1 -- 172.21.15.99:0/556016191 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c06e990 con 0x7f4b6c071510 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b6a800640 1 --2- 172.21.15.99:0/556016191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c071510 0x7f4b6c072d70 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c075940 tx=0x7f4b6402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d80bf1308ffad0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b69400640 1 -- 172.21.15.99:0/556016191 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64036070 con 0x7f4b6c071510 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b69400640 1 -- 172.21.15.99:0/556016191 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b64031600 con 0x7f4b6c071510 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b69400640 1 -- 172.21.15.99:0/556016191 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b640319d0 con 0x7f4b6c071510 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b70a00640 1 -- 172.21.15.99:0/556016191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c071510 msgr2=0x7f4b6c072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b70a00640 1 --2- 172.21.15.99:0/556016191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c071510 0x7f4b6c072d70 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c075940 tx=0x7f4b6402a6a0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b70a00640 1 -- 172.21.15.99:0/556016191 shutdown_connections 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b70a00640 1 --2- 172.21.15.99:0/556016191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c0ce780 0x7f4b6c072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b70a00640 1 --2- 172.21.15.99:0/556016191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c071510 0x7f4b6c072d70 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b70a00640 1 --2- 172.21.15.99:0/556016191 >> v2:172.21.15.187:3300/0 conn(0x7f4b6c145290 0x7f4b6c06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.230+0000 7f4b70a00640 1 -- 172.21.15.99:0/556016191 >> 172.21.15.99:0/556016191 conn(0x7f4b6c06bc10 msgr2=0x7f4b6c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.231+0000 7f4b70a00640 1 -- 172.21.15.99:0/556016191 shutdown_connections 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.231+0000 7f4b70a00640 1 -- 172.21.15.99:0/556016191 wait complete. 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.232+0000 7f4b70a00640 1 Processor -- start 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.232+0000 7f4b70a00640 1 -- start start 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.233+0000 7f4b70a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c071510 0x7f4b6c15ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.233+0000 7f4b70a00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c0ce780 0x7f4b6c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.233+0000 7f4b70a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c145290 0x7f4b6c13f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.233+0000 7f4b70a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c06df80 con 0x7f4b6c145290 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.233+0000 7f4b70a00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c145670 con 0x7f4b6c0ce780 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.233+0000 7f4b70a00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c06e100 con 0x7f4b6c071510 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.233+0000 7f4b6a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c145290 0x7f4b6c13f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.233+0000 7f4b6a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c145290 0x7f4b6c13f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60762/0 (socket says 172.21.15.99:60762) 2024-09-10T07:45:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.233+0000 7f4b6a800640 1 -- 172.21.15.99:0/2938151752 learned_addr learned my addr 172.21.15.99:0/2938151752 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b61400640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c0ce780 0x7f4b6c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b69e00640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c071510 0x7f4b6c15ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b6a800640 1 -- 172.21.15.99:0/2938151752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c071510 msgr2=0x7f4b6c15ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b6a800640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c071510 0x7f4b6c15ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b6a800640 1 -- 172.21.15.99:0/2938151752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c0ce780 msgr2=0x7f4b6c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b6a800640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c0ce780 0x7f4b6c15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b6a800640 1 -- 172.21.15.99:0/2938151752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c15dba0 con 0x7f4b6c145290 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b61400640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c0ce780 0x7f4b6c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b6a800640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c145290 0x7f4b6c13f1c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4b6402ac90 tx=0x7f4b64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b62a00640 1 -- 172.21.15.99:0/2938151752 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6403f020 con 0x7f4b6c145290 2024-09-10T07:45:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b62a00640 1 -- 172.21.15.99:0/2938151752 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b64037040 con 0x7f4b6c145290 2024-09-10T07:45:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b62a00640 1 -- 172.21.15.99:0/2938151752 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64036070 con 0x7f4b6c145290 2024-09-10T07:45:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.234+0000 7f4b70a00640 1 -- 172.21.15.99:0/2938151752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6c15cb00 con 0x7f4b6c145290 2024-09-10T07:45:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.235+0000 7f4b70a00640 1 -- 172.21.15.99:0/2938151752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6c15d0c0 con 0x7f4b6c145290 2024-09-10T07:45:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.236+0000 7f4b70a00640 1 -- 172.21.15.99:0/2938151752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6c06f470 con 0x7f4b6c145290 2024-09-10T07:45:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.236+0000 7f4b62a00640 1 -- 172.21.15.99:0/2938151752 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b64042020 con 0x7f4b6c145290 2024-09-10T07:45:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.238+0000 7f4b62a00640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4b4806be30 0x7f4b4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.238+0000 7f4b62a00640 1 -- 172.21.15.99:0/2938151752 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f4b640aaf70 con 0x7f4b6c145290 2024-09-10T07:45:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.238+0000 7f4b69e00640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4b4806be30 0x7f4b4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.239+0000 7f4b69e00640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4b4806be30 0x7f4b4806e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0cfc90 tx=0x7f4b5c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.242+0000 7f4b62a00640 1 -- 172.21.15.99:0/2938151752 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b64049030 con 0x7f4b6c145290 2024-09-10T07:45:06.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.416+0000 7f4b70a00640 1 -- 172.21.15.99:0/2938151752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b6c0cf420 con 0x7f4b6c145290 2024-09-10T07:45:06.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.417+0000 7f4b62a00640 1 -- 172.21.15.99:0/2938151752 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) ==== 74+0+13019 (secure 0 0 0) 0x7f4b64079b80 con 0x7f4b6c145290 2024-09-10T07:45:06.417 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:06.417 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":179,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:45:05.049167+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":173,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.187:6835/274874285":"2024-09-11T07:45:01.880757+0000","172.21.15.187:6833/274874285":"2024-09-11T07:45:01.880757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:45:06.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 -- 172.21.15.99:0/2938151752 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4b4806be30 msgr2=0x7f4b4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4b4806be30 0x7f4b4806e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0cfc90 tx=0x7f4b5c009190 comp rx=0 tx=0).stop 2024-09-10T07:45:06.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 -- 172.21.15.99:0/2938151752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c145290 msgr2=0x7f4b6c13f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c145290 0x7f4b6c13f1c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4b6402ac90 tx=0x7f4b64004a40 comp rx=0 tx=0).stop 2024-09-10T07:45:06.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 -- 172.21.15.99:0/2938151752 shutdown_connections 2024-09-10T07:45:06.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4b4806be30 0x7f4b4806e2f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c145290 0x7f4b6c13f1c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c0ce780 0x7f4b6c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 --2- 172.21.15.99:0/2938151752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c071510 0x7f4b6c15ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 -- 172.21.15.99:0/2938151752 >> 172.21.15.99:0/2938151752 conn(0x7f4b6c06bc10 msgr2=0x7f4b6c0b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:06.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 -- 172.21.15.99:0/2938151752 shutdown_connections 2024-09-10T07:45:06.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.419+0000 7f4b70a00640 1 -- 172.21.15.99:0/2938151752 wait complete. 2024-09-10T07:45:06.437 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T07:34:08.744575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T07:45:06.438 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T07:45:06.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.596+0000 7f8e5d000640 1 Processor -- start 2024-09-10T07:45:06.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.596+0000 7f8e5d000640 1 -- start start 2024-09-10T07:45:06.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.596+0000 7f8e5d000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8e5815edb0 0x7f8e5806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.596+0000 7f8e5d000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8e5806c150 0x7f8e5806c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.596+0000 7f8e5d000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5815f190 con 0x7f8e5806cd60 2024-09-10T07:45:06.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.596+0000 7f8e5d000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f8e580b39b0 con 0x7f8e5806c150 2024-09-10T07:45:06.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.596+0000 7f8e5d000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f8e5806d610 con 0x7f8e5815edb0 2024-09-10T07:45:06.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.596+0000 7f8e4fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8e5806c150 0x7f8e5806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.596+0000 7f8e4fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8e5806c150 0x7f8e5806c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60768/0 (socket says 172.21.15.99:60768) 2024-09-10T07:45:06.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.596+0000 7f8e4fe00640 1 -- 172.21.15.99:0/2756064937 learned_addr learned my addr 172.21.15.99:0/2756064937 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:06.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.597+0000 7f8e55e00640 1 --2- 172.21.15.99:0/2756064937 >> v2:172.21.15.187:3300/0 conn(0x7f8e5815edb0 0x7f8e5806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.597+0000 7f8e4fe00640 1 -- 172.21.15.99:0/2756064937 >> v2:172.21.15.187:3300/0 conn(0x7f8e5815edb0 msgr2=0x7f8e5806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:06.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.597+0000 7f8e4fe00640 1 --2- 172.21.15.99:0/2756064937 >> v2:172.21.15.187:3300/0 conn(0x7f8e5815edb0 0x7f8e5806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.597+0000 7f8e4fe00640 1 -- 172.21.15.99:0/2756064937 >> v1:172.21.15.187:6789/0 conn(0x7f8e5806cd60 legacy=0x7f8e581628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.597+0000 7f8e4fe00640 1 -- 172.21.15.99:0/2756064937 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e580b2da0 con 0x7f8e5806c150 2024-09-10T07:45:06.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.598+0000 7f8e4fe00640 1 --2- 172.21.15.99:0/2756064937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806c150 0x7f8e5806c820 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f8e58074240 tx=0x7f8e4002a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdf266b872cdf2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:06.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.598+0000 7f8e55400640 1 -- 172.21.15.99:0/2756064937 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40037070 con 0x7f8e5806c150 2024-09-10T07:45:06.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.598+0000 7f8e55400640 1 -- 172.21.15.99:0/2756064937 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e40032440 con 0x7f8e5806c150 2024-09-10T07:45:06.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.598+0000 7f8e55400640 1 -- 172.21.15.99:0/2756064937 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40032810 con 0x7f8e5806c150 2024-09-10T07:45:06.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.599+0000 7f8e5d000640 1 -- 172.21.15.99:0/2756064937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806c150 msgr2=0x7f8e5806c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.599+0000 7f8e5d000640 1 --2- 172.21.15.99:0/2756064937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806c150 0x7f8e5806c820 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f8e58074240 tx=0x7f8e4002a280 comp rx=0 tx=0).stop 2024-09-10T07:45:06.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.599+0000 7f8e5d000640 1 -- 172.21.15.99:0/2756064937 shutdown_connections 2024-09-10T07:45:06.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.599+0000 7f8e5d000640 1 --2- 172.21.15.99:0/2756064937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806c150 0x7f8e5806c820 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.599+0000 7f8e5d000640 1 --2- 172.21.15.99:0/2756064937 >> v2:172.21.15.187:3300/0 conn(0x7f8e5815edb0 0x7f8e5806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.599+0000 7f8e5d000640 1 -- 172.21.15.99:0/2756064937 >> 172.21.15.99:0/2756064937 conn(0x7f8e580b5fc0 msgr2=0x7f8e580b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:06.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.599+0000 7f8e5d000640 1 -- 172.21.15.99:0/2756064937 shutdown_connections 2024-09-10T07:45:06.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.599+0000 7f8e5d000640 1 -- 172.21.15.99:0/2756064937 wait complete. 2024-09-10T07:45:06.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.600+0000 7f8e5d000640 1 Processor -- start 2024-09-10T07:45:06.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.601+0000 7f8e5d000640 1 -- start start 2024-09-10T07:45:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.601+0000 7f8e5d000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5806c150 0x7f8e5815d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.601+0000 7f8e5d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806cd60 0x7f8e58154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.601+0000 7f8e5d000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e5815edb0 0x7f8e5815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.601+0000 7f8e5d000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8e580b3640 con 0x7f8e5806cd60 2024-09-10T07:45:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.601+0000 7f8e5d000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8e580b3360 con 0x7f8e5815edb0 2024-09-10T07:45:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.601+0000 7f8e5d000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f8e580af1e0 con 0x7f8e5806c150 2024-09-10T07:45:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806cd60 0x7f8e58154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806cd60 0x7f8e58154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60778/0 (socket says 172.21.15.99:60778) 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4fe00640 1 -- 172.21.15.99:0/2434912405 learned_addr learned my addr 172.21.15.99:0/2434912405 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e55e00640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5806c150 0x7f8e5815d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e56800640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e5815edb0 0x7f8e5815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4fe00640 1 -- 172.21.15.99:0/2434912405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5806c150 msgr2=0x7f8e5815d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4fe00640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5806c150 0x7f8e5815d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4fe00640 1 -- 172.21.15.99:0/2434912405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e5815edb0 msgr2=0x7f8e5815b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4fe00640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e5815edb0 0x7f8e5815b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4fe00640 1 -- 172.21.15.99:0/2434912405 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e58155010 con 0x7f8e5806cd60 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e55e00640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5806c150 0x7f8e5815d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e56800640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e5815edb0 0x7f8e5815b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4fe00640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806cd60 0x7f8e58154ad0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f8e40000c00 tx=0x7f8e400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4e000640 1 -- 172.21.15.99:0/2434912405 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40041070 con 0x7f8e5806cd60 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4e000640 1 -- 172.21.15.99:0/2434912405 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4003c870 con 0x7f8e5806cd60 2024-09-10T07:45:06.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e5d000640 1 -- 172.21.15.99:0/2434912405 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5815df00 con 0x7f8e5806cd60 2024-09-10T07:45:06.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e4e000640 1 -- 172.21.15.99:0/2434912405 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40037040 con 0x7f8e5806cd60 2024-09-10T07:45:06.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.603+0000 7f8e5d000640 1 -- 172.21.15.99:0/2434912405 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5815e4c0 con 0x7f8e5806cd60 2024-09-10T07:45:06.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.605+0000 7f8e5d000640 1 -- 172.21.15.99:0/2434912405 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5806c820 con 0x7f8e5806cd60 2024-09-10T07:45:06.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.605+0000 7f8e4e000640 1 -- 172.21.15.99:0/2434912405 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e40044070 con 0x7f8e5806cd60 2024-09-10T07:45:06.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.605+0000 7f8e4e000640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 0x7f8e3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.606+0000 7f8e4e000640 1 -- 172.21.15.99:0/2434912405 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f8e400ab730 con 0x7f8e5806cd60 2024-09-10T07:45:06.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.606+0000 7f8e55e00640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 0x7f8e3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.606+0000 7f8e55e00640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 0x7f8e3406e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8e48006fd0 tx=0x7f8e48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:06.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.610+0000 7f8e4e000640 1 -- 172.21.15.99:0/2434912405 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e4007a4f0 con 0x7f8e5806cd60 2024-09-10T07:45:06.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.787+0000 7f8e5d000640 1 -- 172.21.15.99:0/2434912405 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8e58163110 con 0x7f8e5806cd60 2024-09-10T07:45:06.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.788+0000 7f8e4e000640 1 -- 172.21.15.99:0/2434912405 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) ==== 93+0+10 (secure 0 0 0) 0x7f8e40079df0 con 0x7f8e5806cd60 2024-09-10T07:45:06.786 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-10T07:45:06.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 -- 172.21.15.99:0/2434912405 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 msgr2=0x7f8e3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 0x7f8e3406e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8e48006fd0 tx=0x7f8e48008040 comp rx=0 tx=0).stop 2024-09-10T07:45:06.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 -- 172.21.15.99:0/2434912405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806cd60 msgr2=0x7f8e58154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806cd60 0x7f8e58154ad0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f8e40000c00 tx=0x7f8e400046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 -- 172.21.15.99:0/2434912405 shutdown_connections 2024-09-10T07:45:06.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e5815edb0 0x7f8e5815b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8e3406be30 0x7f8e3406e2f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e5806cd60 0x7f8e58154ad0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 --2- 172.21.15.99:0/2434912405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e5806c150 0x7f8e5815d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 -- 172.21.15.99:0/2434912405 >> 172.21.15.99:0/2434912405 conn(0x7f8e580b5fc0 msgr2=0x7f8e580d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:06.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 -- 172.21.15.99:0/2434912405 shutdown_connections 2024-09-10T07:45:06.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.790+0000 7f8e5d000640 1 -- 172.21.15.99:0/2434912405 wait complete. 2024-09-10T07:45:06.804 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-10T07:45:06.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.959+0000 7fa62cc00640 1 Processor -- start 2024-09-10T07:45:06.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.959+0000 7fa62cc00640 1 -- start start 2024-09-10T07:45:06.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.960+0000 7fa62cc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa628072f40 0x7fa62806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.960+0000 7fa62cc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62806e3d0 con 0x7fa628145290 2024-09-10T07:45:06.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.960+0000 7fa62cc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62806e6b0 con 0x7fa6280ce780 2024-09-10T07:45:06.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.960+0000 7fa62cc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa62806efe0 con 0x7fa628072f40 2024-09-10T07:45:06.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.960+0000 7fa625e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa628145290 0x7fa628072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38548/0 (socket says 172.21.15.99:38548) 2024-09-10T07:45:06.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.960+0000 7fa625e00640 1 -- 172.21.15.99:0/2966689839 learned_addr learned my addr 172.21.15.99:0/2966689839 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:06.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.961+0000 7fa61fe00640 1 --2- 172.21.15.99:0/2966689839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa628072f40 0x7fa62806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.961+0000 7fa625400640 1 -- 172.21.15.99:0/2966689839 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4185872504 0 0) 0x7fa62806e3d0 con 0x7fa628145290 2024-09-10T07:45:06.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.961+0000 7fa625400640 1 -- 172.21.15.99:0/2966689839 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa60c003520 con 0x7fa628145290 2024-09-10T07:45:06.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.961+0000 7fa625400640 1 -- 172.21.15.99:0/2966689839 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186940660 0 0) 0x7fa62806e6b0 con 0x7fa6280ce780 2024-09-10T07:45:06.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.961+0000 7fa625400640 1 -- 172.21.15.99:0/2966689839 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa62806e3d0 con 0x7fa6280ce780 2024-09-10T07:45:06.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.961+0000 7fa61fe00640 1 -- 172.21.15.99:0/2966689839 >> v1:172.21.15.187:6789/0 conn(0x7fa6280ce780 legacy=0x7fa6280b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.961+0000 7fa61fe00640 1 -- 172.21.15.99:0/2966689839 >> v1:172.21.15.99:6789/0 conn(0x7fa628145290 legacy=0x7fa628072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.961+0000 7fa625400640 1 -- 172.21.15.99:0/2966689839 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3869484274 0 0) 0x7fa60c003520 con 0x7fa628145290 2024-09-10T07:45:06.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.961+0000 7fa61fe00640 1 -- 172.21.15.99:0/2966689839 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62806e990 con 0x7fa628072f40 2024-09-10T07:45:06.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.962+0000 7fa61fe00640 1 --2- 172.21.15.99:0/2966689839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa628072f40 0x7fa62806f470 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6100097d0 tx=0x7fa61002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=242714da72facdf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:06.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.963+0000 7fa625400640 1 -- 172.21.15.99:0/2966689839 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa610037070 con 0x7fa628072f40 2024-09-10T07:45:06.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.963+0000 7fa625400640 1 -- 172.21.15.99:0/2966689839 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa610032440 con 0x7fa628072f40 2024-09-10T07:45:06.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.963+0000 7fa625400640 1 -- 172.21.15.99:0/2966689839 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa610032810 con 0x7fa628072f40 2024-09-10T07:45:06.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.963+0000 7fa62cc00640 1 -- 172.21.15.99:0/2966689839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa628072f40 msgr2=0x7fa62806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.963+0000 7fa62cc00640 1 --2- 172.21.15.99:0/2966689839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa628072f40 0x7fa62806f470 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6100097d0 tx=0x7fa61002a210 comp rx=0 tx=0).stop 2024-09-10T07:45:06.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.964+0000 7fa62cc00640 1 -- 172.21.15.99:0/2966689839 shutdown_connections 2024-09-10T07:45:06.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.964+0000 7fa62cc00640 1 --2- 172.21.15.99:0/2966689839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa628072f40 0x7fa62806f470 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.964+0000 7fa62cc00640 1 -- 172.21.15.99:0/2966689839 >> 172.21.15.99:0/2966689839 conn(0x7fa62806bc10 msgr2=0x7fa62806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:06.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.964+0000 7fa62cc00640 1 -- 172.21.15.99:0/2966689839 shutdown_connections 2024-09-10T07:45:06.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.964+0000 7fa62cc00640 1 -- 172.21.15.99:0/2966689839 wait complete. 2024-09-10T07:45:06.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.965+0000 7fa62cc00640 1 Processor -- start 2024-09-10T07:45:06.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.965+0000 7fa62cc00640 1 -- start start 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.966+0000 7fa62cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa628072f40 0x7fa62814d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.966+0000 7fa62cc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6280ce780 0x7fa62814ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.966+0000 7fa62cc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa628145290 0x7fa62815e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.966+0000 7fa62cc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa62806df80 con 0x7fa628072f40 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.966+0000 7fa62cc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa628145670 con 0x7fa628145290 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.966+0000 7fa62cc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa62806e100 con 0x7fa6280ce780 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.966+0000 7fa625e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa628072f40 0x7fa62814d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa625e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa628072f40 0x7fa62814d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60788/0 (socket says 172.21.15.99:60788) 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa625e00640 1 -- 172.21.15.99:0/1300266298 learned_addr learned my addr 172.21.15.99:0/1300266298 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa61fe00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6280ce780 0x7fa62814ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa626800640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa628145290 0x7fa62815e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa625e00640 1 -- 172.21.15.99:0/1300266298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6280ce780 msgr2=0x7fa62814ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa625e00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6280ce780 0x7fa62814ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa625e00640 1 -- 172.21.15.99:0/1300266298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa628145290 msgr2=0x7fa62815e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:06.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa625e00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa628145290 0x7fa62815e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:06.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa625e00640 1 -- 172.21.15.99:0/1300266298 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6281419f0 con 0x7fa628072f40 2024-09-10T07:45:06.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa626800640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa628145290 0x7fa62815e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:06.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.967+0000 7fa625e00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa628072f40 0x7fa62814d070 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fa61800c7b0 tx=0x7fa61800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.968+0000 7fa61e000640 1 -- 172.21.15.99:0/1300266298 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61800ce60 con 0x7fa628072f40 2024-09-10T07:45:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.968+0000 7fa61e000640 1 -- 172.21.15.99:0/1300266298 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa618005ad0 con 0x7fa628072f40 2024-09-10T07:45:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.968+0000 7fa62cc00640 1 -- 172.21.15.99:0/1300266298 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa628141cd0 con 0x7fa628072f40 2024-09-10T07:45:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.968+0000 7fa61e000640 1 -- 172.21.15.99:0/1300266298 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618007070 con 0x7fa628072f40 2024-09-10T07:45:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.968+0000 7fa62cc00640 1 -- 172.21.15.99:0/1300266298 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa628142290 con 0x7fa628072f40 2024-09-10T07:45:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.969+0000 7fa62cc00640 1 -- 172.21.15.99:0/1300266298 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6280715a0 con 0x7fa628072f40 2024-09-10T07:45:06.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.970+0000 7fa61e000640 1 -- 172.21.15.99:0/1300266298 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa618007210 con 0x7fa628072f40 2024-09-10T07:45:06.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.971+0000 7fa61e000640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa60406be30 0x7fa60406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:06.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.971+0000 7fa61e000640 1 -- 172.21.15.99:0/1300266298 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7fa61808a830 con 0x7fa628072f40 2024-09-10T07:45:06.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.971+0000 7fa61fe00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa60406be30 0x7fa60406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:06.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.972+0000 7fa61fe00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa60406be30 0x7fa60406e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa610034000 tx=0x7fa61002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:06.976+0000 7fa61e000640 1 -- 172.21.15.99:0/1300266298 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa618059450 con 0x7fa628072f40 2024-09-10T07:45:07.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:07.217+0000 7fa62cc00640 1 -- 172.21.15.99:0/1300266298 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) -- 0x7fa6281416e0 con 0x7fa628072f40 2024-09-10T07:45:08.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.064+0000 7fa61e000640 1 -- 172.21.15.99:0/1300266298 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v508) ==== 138+0+0 (secure 0 0 0) 0x7fa618058d50 con 0x7fa628072f40 2024-09-10T07:45:08.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.067+0000 7fa62cc00640 1 -- 172.21.15.99:0/1300266298 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa60406be30 msgr2=0x7fa60406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.067+0000 7fa62cc00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa60406be30 0x7fa60406e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa610034000 tx=0x7fa61002e000 comp rx=0 tx=0).stop 2024-09-10T07:45:08.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.067+0000 7fa62cc00640 1 -- 172.21.15.99:0/1300266298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa628072f40 msgr2=0x7fa62814d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.067+0000 7fa62cc00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa628072f40 0x7fa62814d070 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fa61800c7b0 tx=0x7fa61800cc70 comp rx=0 tx=0).stop 2024-09-10T07:45:08.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.067+0000 7fa62cc00640 1 -- 172.21.15.99:0/1300266298 shutdown_connections 2024-09-10T07:45:08.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.067+0000 7fa62cc00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa628145290 0x7fa62815e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.067+0000 7fa62cc00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6280ce780 0x7fa62814ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.067+0000 7fa62cc00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa60406be30 0x7fa60406e2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.067+0000 7fa62cc00640 1 --2- 172.21.15.99:0/1300266298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa628072f40 0x7fa62814d070 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.067+0000 7fa62cc00640 1 -- 172.21.15.99:0/1300266298 >> 172.21.15.99:0/1300266298 conn(0x7fa62806bc10 msgr2=0x7fa62815fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:08.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.068+0000 7fa62cc00640 1 -- 172.21.15.99:0/1300266298 shutdown_connections 2024-09-10T07:45:08.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.068+0000 7fa62cc00640 1 -- 172.21.15.99:0/1300266298 wait complete. 2024-09-10T07:45:08.085 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T07:45:08.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.247+0000 7f9007000640 1 Processor -- start 2024-09-10T07:45:08.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.247+0000 7f9007000640 1 -- start start 2024-09-10T07:45:08.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.248+0000 7f9007000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90000c9710 0x7f90001695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.248+0000 7f9007000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90000d2bd0 con 0x7f90000d2680 2024-09-10T07:45:08.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.248+0000 7f9007000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90000d2eb0 con 0x7f900015e970 2024-09-10T07:45:08.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.248+0000 7f9007000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f90000d37e0 con 0x7f90000c9710 2024-09-10T07:45:08.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.248+0000 7f9005200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f90000d2680 0x7f90000cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38564/0 (socket says 172.21.15.99:38564) 2024-09-10T07:45:08.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.248+0000 7f9005200640 1 -- 172.21.15.99:0/3903231602 learned_addr learned my addr 172.21.15.99:0/3903231602 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:08.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.248+0000 7f9006600640 1 --2- 172.21.15.99:0/3903231602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90000c9710 0x7f90001695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.249+0000 7f8fffe00640 1 -- 172.21.15.99:0/3903231602 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1253474111 0 0) 0x7f90000d2bd0 con 0x7f90000d2680 2024-09-10T07:45:08.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.249+0000 7f8fffe00640 1 -- 172.21.15.99:0/3903231602 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fe8003520 con 0x7f90000d2680 2024-09-10T07:45:08.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.249+0000 7f8fffe00640 1 -- 172.21.15.99:0/3903231602 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777768555 0 0) 0x7f90000d2eb0 con 0x7f900015e970 2024-09-10T07:45:08.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.249+0000 7f8fffe00640 1 -- 172.21.15.99:0/3903231602 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90000d2bd0 con 0x7f900015e970 2024-09-10T07:45:08.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.249+0000 7f9006600640 1 -- 172.21.15.99:0/3903231602 >> v1:172.21.15.187:6789/0 conn(0x7f900015e970 legacy=0x7f90000d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.249+0000 7f9006600640 1 -- 172.21.15.99:0/3903231602 >> v1:172.21.15.99:6789/0 conn(0x7f90000d2680 legacy=0x7f90000cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.249+0000 7f9006600640 1 -- 172.21.15.99:0/3903231602 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90000d3190 con 0x7f90000c9710 2024-09-10T07:45:08.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.250+0000 7f9006600640 1 --2- 172.21.15.99:0/3903231602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90000c9710 0x7f90001695e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009dc0 tx=0x7f8ff802a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e0d8e3f60a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:08.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.250+0000 7f8fffe00640 1 -- 172.21.15.99:0/3903231602 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8007740 con 0x7f90000c9710 2024-09-10T07:45:08.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.250+0000 7f8fffe00640 1 -- 172.21.15.99:0/3903231602 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff80078e0 con 0x7f90000c9710 2024-09-10T07:45:08.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.250+0000 7f8fffe00640 1 -- 172.21.15.99:0/3903231602 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8007cb0 con 0x7f90000c9710 2024-09-10T07:45:08.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.251+0000 7f9007000640 1 -- 172.21.15.99:0/3903231602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90000c9710 msgr2=0x7f90001695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.251+0000 7f9007000640 1 --2- 172.21.15.99:0/3903231602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90000c9710 0x7f90001695e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009dc0 tx=0x7f8ff802a760 comp rx=0 tx=0).stop 2024-09-10T07:45:08.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.251+0000 7f9007000640 1 -- 172.21.15.99:0/3903231602 shutdown_connections 2024-09-10T07:45:08.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.251+0000 7f9007000640 1 --2- 172.21.15.99:0/3903231602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90000c9710 0x7f90001695e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.251+0000 7f9007000640 1 -- 172.21.15.99:0/3903231602 >> 172.21.15.99:0/3903231602 conn(0x7f900009de00 msgr2=0x7f90000d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:08.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.251+0000 7f9007000640 1 -- 172.21.15.99:0/3903231602 shutdown_connections 2024-09-10T07:45:08.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.251+0000 7f9007000640 1 -- 172.21.15.99:0/3903231602 wait complete. 2024-09-10T07:45:08.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.252+0000 7f9007000640 1 Processor -- start 2024-09-10T07:45:08.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.253+0000 7f9007000640 1 -- start start 2024-09-10T07:45:08.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.253+0000 7f9007000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90000c9710 0x7f9000160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.253+0000 7f9007000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90000d2680 0x7f90000ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.253+0000 7f9007000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f900015e970 0x7f9000157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.253+0000 7f9007000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f900015eed0 con 0x7f90000c9710 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.253+0000 7f9007000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f900015ed50 con 0x7f90000d2680 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.253+0000 7f9007000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f90000cfc90 con 0x7f900015e970 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.254+0000 7f9005c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90000c9710 0x7f9000160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.254+0000 7f9005c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90000c9710 0x7f9000160fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60796/0 (socket says 172.21.15.99:60796) 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.254+0000 7f9005c00640 1 -- 172.21.15.99:0/2261600510 learned_addr learned my addr 172.21.15.99:0/2261600510 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.254+0000 7f9005200640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90000d2680 0x7f90000ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.254+0000 7f9006600640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f900015e970 0x7f9000157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.254+0000 7f9005c00640 1 -- 172.21.15.99:0/2261600510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f900015e970 msgr2=0x7f9000157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.254+0000 7f9005c00640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f900015e970 0x7f9000157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.254+0000 7f9005c00640 1 -- 172.21.15.99:0/2261600510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90000d2680 msgr2=0x7f90000ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.254+0000 7f9005c00640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90000d2680 0x7f90000ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.254+0000 7f9005c00640 1 -- 172.21.15.99:0/2261600510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90000cee00 con 0x7f90000c9710 2024-09-10T07:45:08.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.255+0000 7f9005c00640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90000c9710 0x7f9000160fd0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c460 tx=0x7f8ff400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:08.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.255+0000 7f8ffd600640 1 -- 172.21.15.99:0/2261600510 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40052d0 con 0x7f90000c9710 2024-09-10T07:45:08.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.255+0000 7f8ffd600640 1 -- 172.21.15.99:0/2261600510 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4005490 con 0x7f90000c9710 2024-09-10T07:45:08.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.255+0000 7f9007000640 1 -- 172.21.15.99:0/2261600510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90001f8920 con 0x7f90000c9710 2024-09-10T07:45:08.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.255+0000 7f8ffd600640 1 -- 172.21.15.99:0/2261600510 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4012870 con 0x7f90000c9710 2024-09-10T07:45:08.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.255+0000 7f9007000640 1 -- 172.21.15.99:0/2261600510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90001f7b60 con 0x7f90000c9710 2024-09-10T07:45:08.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.256+0000 7f9007000640 1 -- 172.21.15.99:0/2261600510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90000cf580 con 0x7f90000c9710 2024-09-10T07:45:08.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.257+0000 7f8ffd600640 1 -- 172.21.15.99:0/2261600510 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ff4012a10 con 0x7f90000c9710 2024-09-10T07:45:08.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.259+0000 7f8ffd600640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fe006be30 0x7f8fe006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.259+0000 7f8ffd600640 1 -- 172.21.15.99:0/2261600510 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f8ff408a750 con 0x7f90000c9710 2024-09-10T07:45:08.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.259+0000 7f9005200640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fe006be30 0x7f8fe006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.259+0000 7f9005200640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fe006be30 0x7f8fe006e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f90000d0200 tx=0x7f8fec007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.263+0000 7f8ffd600640 1 -- 172.21.15.99:0/2261600510 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ff4059360 con 0x7f90000c9710 2024-09-10T07:45:08.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.442+0000 7f9007000640 1 -- 172.21.15.99:0/2261600510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f90000c9d40 con 0x7f90000c9710 2024-09-10T07:45:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.446+0000 7f8ffd600640 1 -- 172.21.15.99:0/2261600510 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f8ff4058c60 con 0x7f90000c9710 2024-09-10T07:45:08.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.448+0000 7f9007000640 1 -- 172.21.15.99:0/2261600510 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fe006be30 msgr2=0x7f8fe006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.448+0000 7f9007000640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fe006be30 0x7f8fe006e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f90000d0200 tx=0x7f8fec007d30 comp rx=0 tx=0).stop 2024-09-10T07:45:08.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.448+0000 7f9007000640 1 -- 172.21.15.99:0/2261600510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90000c9710 msgr2=0x7f9000160fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.448+0000 7f9007000640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90000c9710 0x7f9000160fd0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c460 tx=0x7f8ff400c920 comp rx=0 tx=0).stop 2024-09-10T07:45:08.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.449+0000 7f9007000640 1 -- 172.21.15.99:0/2261600510 shutdown_connections 2024-09-10T07:45:08.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.449+0000 7f9007000640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f900015e970 0x7f9000157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.449+0000 7f9007000640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90000d2680 0x7f90000ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.449+0000 7f9007000640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f8fe006be30 0x7f8fe006e2f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.449+0000 7f9007000640 1 --2- 172.21.15.99:0/2261600510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90000c9710 0x7f9000160fd0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.449+0000 7f9007000640 1 -- 172.21.15.99:0/2261600510 >> 172.21.15.99:0/2261600510 conn(0x7f900009de00 msgr2=0x7f900006cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:08.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.449+0000 7f9007000640 1 -- 172.21.15.99:0/2261600510 shutdown_connections 2024-09-10T07:45:08.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.449+0000 7f9007000640 1 -- 172.21.15.99:0/2261600510 wait complete. 2024-09-10T07:45:08.464 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:45:08.464 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:45:08.549 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:45:08.650 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:45:08.650 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:08.650 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:08.686 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:45:08.686 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:45:08.686 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:08.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:45:08.723 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:08.723 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:08.763 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:45:08.763 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:45:08.763 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:08.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:45:08.799 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T07:45:08.800 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:08.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.960+0000 7f4230600640 1 Processor -- start 2024-09-10T07:45:08.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.960+0000 7f4230600640 1 -- start start 2024-09-10T07:45:08.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.961+0000 7f4230600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4228072f40 0x7f422806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.961+0000 7f4230600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f42280ce780 0x7f42280b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.961+0000 7f4230600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f422806e3d0 con 0x7f4228145290 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.961+0000 7f4230600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f422806efe0 con 0x7f42280ce780 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.961+0000 7f4230600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f422806e6b0 con 0x7f4228072f40 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.962+0000 7f422d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4228072f40 0x7f422806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.962+0000 7f422e600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f42280ce780 0x7f42280b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.962+0000 7f422d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4228072f40 0x7f422806f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:45876/0 (socket says 172.21.15.99:45876) 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.962+0000 7f422d200640 1 -- 172.21.15.99:0/905663252 learned_addr learned my addr 172.21.15.99:0/905663252 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.962+0000 7f422dc00640 1 --1- 172.21.15.99:0/905663252 >> v1:172.21.15.187:6789/0 conn(0x7f4228145290 0x7f4228072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:35632/0 (socket says 172.21.15.99:35632) 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.962+0000 7f422d200640 1 -- 172.21.15.99:0/905663252 >> v2:172.21.15.187:3300/0 conn(0x7f42280ce780 msgr2=0x7f42280b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.962+0000 7f422d200640 1 --2- 172.21.15.99:0/905663252 >> v2:172.21.15.187:3300/0 conn(0x7f42280ce780 0x7f42280b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.962+0000 7f422d200640 1 -- 172.21.15.99:0/905663252 >> v1:172.21.15.187:6789/0 conn(0x7f4228145290 legacy=0x7f4228072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.962+0000 7f422d200640 1 -- 172.21.15.99:0/905663252 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422806e990 con 0x7f4228072f40 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.963+0000 7f422d200640 1 --2- 172.21.15.99:0/905663252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4228072f40 0x7f422806f470 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f421400bb10 tx=0x7f421402c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=204983ef73c41480 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4227e00640 1 -- 172.21.15.99:0/905663252 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214036020 con 0x7f4228072f40 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4227e00640 1 -- 172.21.15.99:0/905663252 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4214032820 con 0x7f4228072f40 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4227e00640 1 -- 172.21.15.99:0/905663252 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214032bf0 con 0x7f4228072f40 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4230600640 1 -- 172.21.15.99:0/905663252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4228072f40 msgr2=0x7f422806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4230600640 1 --2- 172.21.15.99:0/905663252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4228072f40 0x7f422806f470 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f421400bb10 tx=0x7f421402c920 comp rx=0 tx=0).stop 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4230600640 1 -- 172.21.15.99:0/905663252 shutdown_connections 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4230600640 1 --2- 172.21.15.99:0/905663252 >> v2:172.21.15.187:3300/0 conn(0x7f42280ce780 0x7f42280b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4230600640 1 --2- 172.21.15.99:0/905663252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4228072f40 0x7f422806f470 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4230600640 1 -- 172.21.15.99:0/905663252 >> 172.21.15.99:0/905663252 conn(0x7f422806bc10 msgr2=0x7f422806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4230600640 1 -- 172.21.15.99:0/905663252 shutdown_connections 2024-09-10T07:45:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.964+0000 7f4230600640 1 -- 172.21.15.99:0/905663252 wait complete. 2024-09-10T07:45:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.966+0000 7f4230600640 1 Processor -- start 2024-09-10T07:45:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.966+0000 7f4230600640 1 -- start start 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f4230600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4228072f40 0x7f42280aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f4230600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42280ce780 0x7f422814e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f4230600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4228145290 0x7f42280ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f4230600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f422806df80 con 0x7f4228072f40 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f4230600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4228145670 con 0x7f4228145290 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f4230600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f422806e100 con 0x7f42280ce780 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f422dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4228072f40 0x7f42280aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f422dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4228072f40 0x7f42280aaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60808/0 (socket says 172.21.15.99:60808) 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f422dc00640 1 -- 172.21.15.99:0/3900798664 learned_addr learned my addr 172.21.15.99:0/3900798664 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f422d200640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42280ce780 0x7f422814e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.967+0000 7f422e600640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4228145290 0x7f42280ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f422d200640 1 -- 172.21.15.99:0/3900798664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4228145290 msgr2=0x7f42280ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f422d200640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4228145290 0x7f42280ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f422d200640 1 -- 172.21.15.99:0/3900798664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4228072f40 msgr2=0x7f42280aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f422d200640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4228072f40 0x7f42280aaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f422d200640 1 -- 172.21.15.99:0/3900798664 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42281428f0 con 0x7f42280ce780 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f422dc00640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4228072f40 0x7f42280aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f422d200640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42280ce780 0x7f422814e210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4214034000 tx=0x7f4214004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f4225600640 1 -- 172.21.15.99:0/3900798664 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214042070 con 0x7f42280ce780 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f4225600640 1 -- 172.21.15.99:0/3900798664 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4214031cb0 con 0x7f42280ce780 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f4225600640 1 -- 172.21.15.99:0/3900798664 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214036040 con 0x7f42280ce780 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.968+0000 7f4230600640 1 -- 172.21.15.99:0/3900798664 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4228142bd0 con 0x7f42280ce780 2024-09-10T07:45:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.969+0000 7f4230600640 1 -- 172.21.15.99:0/3900798664 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42280aafd0 con 0x7f42280ce780 2024-09-10T07:45:08.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.969+0000 7f4230600640 1 -- 172.21.15.99:0/3900798664 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4228071510 con 0x7f42280ce780 2024-09-10T07:45:08.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.971+0000 7f4225600640 1 -- 172.21.15.99:0/3900798664 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4214045070 con 0x7f42280ce780 2024-09-10T07:45:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.971+0000 7f4225600640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f420806be60 0x7f420806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.971+0000 7f4225600640 1 -- 172.21.15.99:0/3900798664 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f42140ab600 con 0x7f42280ce780 2024-09-10T07:45:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.972+0000 7f422dc00640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f420806be60 0x7f420806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.972+0000 7f422dc00640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f420806be60 0x7f420806e320 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f421c004e00 tx=0x7f421c007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:08.976+0000 7f4225600640 1 -- 172.21.15.99:0/3900798664 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f421402f070 con 0x7f42280ce780 2024-09-10T07:45:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.182+0000 7f4230600640 1 -- 172.21.15.99:0/3900798664 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f422806ca90 con 0x7f42280ce780 2024-09-10T07:45:09.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.183+0000 7f4225600640 1 -- 172.21.15.99:0/3900798664 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+3911 (secure 0 0 0) 0x7f4214079d60 con 0x7f42280ce780 2024-09-10T07:45:09.182 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:09.182 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":84,"btime":"2024-09-10T07:45:02:882880+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/484957916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":484957916},{"type":"v1","addr":"172.21.15.99:6836","nonce":484957916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6398,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1653730054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1653730054},{"type":"v1","addr":"172.21.15.187:6835","nonce":1653730054}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84},{"gid":6967,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/837681918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":837681918},{"type":"v1","addr":"172.21.15.99:6837","nonce":837681918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":6970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3241210910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3241210910},{"type":"v1","addr":"172.21.15.187:6834","nonce":3241210910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[]} 2024-09-10T07:45:09.182 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 84 2024-09-10T07:45:09.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 -- 172.21.15.99:0/3900798664 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f420806be60 msgr2=0x7f420806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:09.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f420806be60 0x7f420806e320 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f421c004e00 tx=0x7f421c007f10 comp rx=0 tx=0).stop 2024-09-10T07:45:09.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 -- 172.21.15.99:0/3900798664 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42280ce780 msgr2=0x7f422814e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:09.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42280ce780 0x7f422814e210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4214034000 tx=0x7f4214004730 comp rx=0 tx=0).stop 2024-09-10T07:45:09.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 -- 172.21.15.99:0/3900798664 shutdown_connections 2024-09-10T07:45:09.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4228145290 0x7f42280ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:09.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42280ce780 0x7f422814e210 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:09.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f420806be60 0x7f420806e320 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:09.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 --2- 172.21.15.99:0/3900798664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4228072f40 0x7f42280aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:09.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 -- 172.21.15.99:0/3900798664 >> 172.21.15.99:0/3900798664 conn(0x7f422806bc10 msgr2=0x7f42280b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:09.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 -- 172.21.15.99:0/3900798664 shutdown_connections 2024-09-10T07:45:09.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.185+0000 7f4230600640 1 -- 172.21.15.99:0/3900798664 wait complete. 2024-09-10T07:45:09.200 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T07:45:09.200 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T07:45:09.200 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:45:09.200 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:45:09.201 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T07:45:09.201 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T07:45:09.201 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:45:09.201 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:45:09.201 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T07:45:09.201 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T07:45:09.201 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:45:09.202 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:45:09.202 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T07:45:09.202 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T07:45:09.202 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:45:09.202 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:45:09.214 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:45:09.214 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T07:45:09.216 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:45:09.216 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T07:45:09.217 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:45:09.217 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T07:45:09.218 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:45:09.218 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T07:45:09.260 INFO:tasks.ceph.mds.a:Started 2024-09-10T07:45:09.260 DEBUG:teuthology.parallel:result is None 2024-09-10T07:45:09.261 INFO:tasks.ceph.mds.b:Started 2024-09-10T07:45:09.262 DEBUG:teuthology.parallel:result is None 2024-09-10T07:45:09.263 INFO:tasks.ceph.mds.c:Started 2024-09-10T07:45:09.263 DEBUG:teuthology.parallel:result is None 2024-09-10T07:45:09.264 INFO:tasks.ceph.mds.d:Started 2024-09-10T07:45:09.264 DEBUG:teuthology.parallel:result is None 2024-09-10T07:45:09.264 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T07:45:09.391 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2024-09-10T07:45:09.392 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2024-09-10T07:45:09.392 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:45:09.392 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-09-10T07:45:09.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.427+0000 7f9062800640 1 Processor -- start 2024-09-10T07:45:09.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.427+0000 7f9062800640 1 -- start start 2024-09-10T07:45:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.428+0000 7f9062800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f905c0d5790 0x7f905c0d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.428+0000 7f9062800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c0d1630 0x7f905c0d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f9062800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905c0d3cc0 con 0x7f905c15eda0 2024-09-10T07:45:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f9062800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f905c0d5c00 con 0x7f905c0d5790 2024-09-10T07:45:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f9062800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f905c0d09c0 con 0x7f905c0d1630 2024-09-10T07:45:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f905b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f905c15eda0 0x7f905c0d35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38566/0 (socket says 172.21.15.99:38566) 2024-09-10T07:45:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f905b400640 1 -- 172.21.15.99:0/3646799064 learned_addr learned my addr 172.21.15.99:0/3646799064 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f9052a00640 1 --2- 172.21.15.99:0/3646799064 >> v2:172.21.15.187:3300/0 conn(0x7f905c0d5790 0x7f905c0d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f905be00640 1 --2- 172.21.15.99:0/3646799064 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c0d1630 0x7f905c0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f905aa00640 1 -- 172.21.15.99:0/3646799064 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268879412 0 0) 0x7f905c0d3cc0 con 0x7f905c15eda0 2024-09-10T07:45:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f905aa00640 1 -- 172.21.15.99:0/3646799064 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9040003520 con 0x7f905c15eda0 2024-09-10T07:45:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f905be00640 1 -- 172.21.15.99:0/3646799064 >> v2:172.21.15.187:3300/0 conn(0x7f905c0d5790 msgr2=0x7f905c0d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f905be00640 1 --2- 172.21.15.99:0/3646799064 >> v2:172.21.15.187:3300/0 conn(0x7f905c0d5790 0x7f905c0d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f905aa00640 1 -- 172.21.15.99:0/3646799064 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 759115026 0 0) 0x7f9040003520 con 0x7f905c15eda0 2024-09-10T07:45:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f905be00640 1 -- 172.21.15.99:0/3646799064 >> v1:172.21.15.99:6789/0 conn(0x7f905c15eda0 legacy=0x7f905c0d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f905be00640 1 -- 172.21.15.99:0/3646799064 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c0d0bf0 con 0x7f905c0d1630 2024-09-10T07:45:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.429+0000 7f9052a00640 1 --2- 172.21.15.99:0/3646799064 >> v2:172.21.15.187:3300/0 conn(0x7f905c0d5790 0x7f905c0d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.431+0000 7f905be00640 1 --2- 172.21.15.99:0/3646799064 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c0d1630 0x7f905c0d1ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9054009d90 tx=0x7f905402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b481fb82b14a069 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.431+0000 7f905aa00640 1 -- 172.21.15.99:0/3646799064 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c001670 con 0x7f905c0d1630 2024-09-10T07:45:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.431+0000 7f905aa00640 1 -- 172.21.15.99:0/3646799064 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9054007540 con 0x7f905c0d1630 2024-09-10T07:45:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.431+0000 7f905aa00640 1 -- 172.21.15.99:0/3646799064 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054007910 con 0x7f905c0d1630 2024-09-10T07:45:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.431+0000 7f9062800640 1 -- 172.21.15.99:0/3646799064 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c0d1630 msgr2=0x7f905c0d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.431+0000 7f9062800640 1 --2- 172.21.15.99:0/3646799064 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c0d1630 0x7f905c0d1ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9054009d90 tx=0x7f905402a5f0 comp rx=0 tx=0).stop 2024-09-10T07:45:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.432+0000 7f9062800640 1 -- 172.21.15.99:0/3646799064 shutdown_connections 2024-09-10T07:45:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.432+0000 7f9062800640 1 --2- 172.21.15.99:0/3646799064 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c0d1630 0x7f905c0d1ac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.432+0000 7f9062800640 1 --2- 172.21.15.99:0/3646799064 >> v2:172.21.15.187:3300/0 conn(0x7f905c0d5790 0x7f905c0d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.432+0000 7f9062800640 1 -- 172.21.15.99:0/3646799064 >> 172.21.15.99:0/3646799064 conn(0x7f905c09df40 msgr2=0x7f905c0d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.432+0000 7f9062800640 1 -- 172.21.15.99:0/3646799064 shutdown_connections 2024-09-10T07:45:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.432+0000 7f9062800640 1 -- 172.21.15.99:0/3646799064 wait complete. 2024-09-10T07:45:09.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.433+0000 7f9062800640 1 Processor -- start 2024-09-10T07:45:09.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.433+0000 7f9062800640 1 -- start start 2024-09-10T07:45:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.434+0000 7f9062800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f905c0d1630 0x7f905c0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.434+0000 7f9062800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f905c0d5790 0x7f905c1496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.434+0000 7f9062800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c15eda0 0x7f905c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.434+0000 7f9062800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f905c0d3120 con 0x7f905c0d5790 2024-09-10T07:45:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.434+0000 7f9062800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f905c0d2880 con 0x7f905c0d1630 2024-09-10T07:45:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.434+0000 7f9062800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f905c0d2db0 con 0x7f905c15eda0 2024-09-10T07:45:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f9052a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f905c0d5790 0x7f905c1496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f9052a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f905c0d5790 0x7f905c1496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60838/0 (socket says 172.21.15.99:60838) 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f9052a00640 1 -- 172.21.15.99:0/430116707 learned_addr learned my addr 172.21.15.99:0/430116707 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f905b400640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f905c0d1630 0x7f905c0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f905be00640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c15eda0 0x7f905c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f9052a00640 1 -- 172.21.15.99:0/430116707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c15eda0 msgr2=0x7f905c14af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f9052a00640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c15eda0 0x7f905c14af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f9052a00640 1 -- 172.21.15.99:0/430116707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f905c0d1630 msgr2=0x7f905c0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f9052a00640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f905c0d1630 0x7f905c0b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f9052a00640 1 -- 172.21.15.99:0/430116707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c149e90 con 0x7f905c0d5790 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f9052a00640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f905c0d5790 0x7f905c1496e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f904400ebe0 tx=0x7f904400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.435+0000 7f9053e00640 1 -- 172.21.15.99:0/430116707 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044017070 con 0x7f905c0d5790 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.436+0000 7f9053e00640 1 -- 172.21.15.99:0/430116707 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904400cc30 con 0x7f905c0d5790 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.436+0000 7f9053e00640 1 -- 172.21.15.99:0/430116707 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044013470 con 0x7f905c0d5790 2024-09-10T07:45:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.436+0000 7f9062800640 1 -- 172.21.15.99:0/430116707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905c14a170 con 0x7f905c0d5790 2024-09-10T07:45:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.436+0000 7f9062800640 1 -- 172.21.15.99:0/430116707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905c14a730 con 0x7f905c0d5790 2024-09-10T07:45:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.437+0000 7f9062800640 1 -- 172.21.15.99:0/430116707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f905c15f180 con 0x7f905c0d5790 2024-09-10T07:45:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.438+0000 7f9053e00640 1 -- 172.21.15.99:0/430116707 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f904401a070 con 0x7f905c0d5790 2024-09-10T07:45:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.438+0000 7f9053e00640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903806be30 0x7f903806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.439+0000 7f9053e00640 1 -- 172.21.15.99:0/430116707 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f904408ae40 con 0x7f905c0d5790 2024-09-10T07:45:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.439+0000 7f905b400640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903806be30 0x7f903806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.439+0000 7f905b400640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903806be30 0x7f903806e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f904c0011e0 tx=0x7f904c0016d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:09.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.443+0000 7f9053e00640 1 -- 172.21.15.99:0/430116707 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9044059400 con 0x7f905c0d5790 2024-09-10T07:45:09.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:09.629+0000 7f9062800640 1 -- 172.21.15.99:0/430116707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f905c0d2330 con 0x7f905c0d5790 2024-09-10T07:45:10.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.464+0000 7f9053e00640 1 -- 172.21.15.99:0/430116707 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v184) ==== 97+0+0 (secure 0 0 0) 0x7f904405d700 con 0x7f905c0d5790 2024-09-10T07:45:10.463 INFO:teuthology.orchestra.run.smithi099.stderr: removed all blocklist entries 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 -- 172.21.15.99:0/430116707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903806be30 msgr2=0x7f903806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903806be30 0x7f903806e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f904c0011e0 tx=0x7f904c0016d0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 -- 172.21.15.99:0/430116707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f905c0d5790 msgr2=0x7f905c1496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f905c0d5790 0x7f905c1496e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f904400ebe0 tx=0x7f904400c520 comp rx=0 tx=0).stop 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 -- 172.21.15.99:0/430116707 shutdown_connections 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905c15eda0 0x7f905c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f903806be30 0x7f903806e2f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f905c0d5790 0x7f905c1496e0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 --2- 172.21.15.99:0/430116707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f905c0d1630 0x7f905c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 -- 172.21.15.99:0/430116707 >> 172.21.15.99:0/430116707 conn(0x7f905c09df40 msgr2=0x7f905c0b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 -- 172.21.15.99:0/430116707 shutdown_connections 2024-09-10T07:45:10.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.467+0000 7f9062800640 1 -- 172.21.15.99:0/430116707 wait complete. 2024-09-10T07:45:10.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T07:45:10.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.642+0000 7ff0fbc00640 1 Processor -- start 2024-09-10T07:45:10.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.642+0000 7ff0fbc00640 1 -- start start 2024-09-10T07:45:10.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.643+0000 7ff0fbc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff0f4145290 0x7ff0f406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:10.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.643+0000 7ff0fbc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff0f40ce780 0x7ff0f4072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:10.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.643+0000 7ff0fbc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0f4071510 0x7ff0f4072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.643+0000 7ff0fbc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f406efe0 con 0x7ff0f40ce780 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.643+0000 7ff0fbc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f406e3d0 con 0x7ff0f4145290 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.643+0000 7ff0fbc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f406e6b0 con 0x7ff0f4071510 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.643+0000 7ff0f3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff0f40ce780 0x7ff0f4072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.644+0000 7ff0f3e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff0f40ce780 0x7ff0f4072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42076/0 (socket says 172.21.15.99:42076) 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.644+0000 7ff0f3e00640 1 -- 172.21.15.99:0/2777556405 learned_addr learned my addr 172.21.15.99:0/2777556405 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.644+0000 7ff0f9200640 1 --2- 172.21.15.99:0/2777556405 >> v2:172.21.15.187:3300/0 conn(0x7ff0f4145290 0x7ff0f406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.644+0000 7ff0f9c00640 1 --2- 172.21.15.99:0/2777556405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0f4071510 0x7ff0f4072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.644+0000 7ff0f3e00640 1 -- 172.21.15.99:0/2777556405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0f4071510 msgr2=0x7ff0f4072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.644+0000 7ff0f3e00640 1 --2- 172.21.15.99:0/2777556405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0f4071510 0x7ff0f4072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.644+0000 7ff0f3e00640 1 -- 172.21.15.99:0/2777556405 >> v2:172.21.15.187:3300/0 conn(0x7ff0f4145290 msgr2=0x7ff0f406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.644+0000 7ff0f3e00640 1 --2- 172.21.15.99:0/2777556405 >> v2:172.21.15.187:3300/0 conn(0x7ff0f4145290 0x7ff0f406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.644+0000 7ff0f3e00640 1 -- 172.21.15.99:0/2777556405 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f406e990 con 0x7ff0f40ce780 2024-09-10T07:45:10.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.645+0000 7ff0f3e00640 1 --2- 172.21.15.99:0/2777556405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f40ce780 0x7ff0f4072830 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4075940 tx=0x7ff0e002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d904ff7bca31bcf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:10.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.645+0000 7ff0f3400640 1 -- 172.21.15.99:0/2777556405 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0032790 con 0x7ff0f40ce780 2024-09-10T07:45:10.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.645+0000 7ff0f3400640 1 -- 172.21.15.99:0/2777556405 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e0038070 con 0x7ff0f40ce780 2024-09-10T07:45:10.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.645+0000 7ff0f3400640 1 -- 172.21.15.99:0/2777556405 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0032b50 con 0x7ff0f40ce780 2024-09-10T07:45:10.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.646+0000 7ff0fbc00640 1 -- 172.21.15.99:0/2777556405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f40ce780 msgr2=0x7ff0f4072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:10.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.646+0000 7ff0fbc00640 1 --2- 172.21.15.99:0/2777556405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f40ce780 0x7ff0f4072830 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4075940 tx=0x7ff0e002c890 comp rx=0 tx=0).stop 2024-09-10T07:45:10.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.646+0000 7ff0fbc00640 1 -- 172.21.15.99:0/2777556405 shutdown_connections 2024-09-10T07:45:10.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.646+0000 7ff0fbc00640 1 --2- 172.21.15.99:0/2777556405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0f4071510 0x7ff0f4072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.646+0000 7ff0fbc00640 1 --2- 172.21.15.99:0/2777556405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f40ce780 0x7ff0f4072830 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.646+0000 7ff0fbc00640 1 --2- 172.21.15.99:0/2777556405 >> v2:172.21.15.187:3300/0 conn(0x7ff0f4145290 0x7ff0f406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.646+0000 7ff0fbc00640 1 -- 172.21.15.99:0/2777556405 >> 172.21.15.99:0/2777556405 conn(0x7ff0f406bc10 msgr2=0x7ff0f406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:10.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.646+0000 7ff0fbc00640 1 -- 172.21.15.99:0/2777556405 shutdown_connections 2024-09-10T07:45:10.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.646+0000 7ff0fbc00640 1 -- 172.21.15.99:0/2777556405 wait complete. 2024-09-10T07:45:10.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.648+0000 7ff0fbc00640 1 Processor -- start 2024-09-10T07:45:10.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.648+0000 7ff0fbc00640 1 -- start start 2024-09-10T07:45:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0fbc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0f4071510 0x7ff0f415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0fbc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f40ce780 0x7ff0f413e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0fbc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f4145290 0x7ff0f41f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0fbc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f406df80 con 0x7ff0f4145290 2024-09-10T07:45:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0fbc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f4145670 con 0x7ff0f40ce780 2024-09-10T07:45:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0fbc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f406e100 con 0x7ff0f4071510 2024-09-10T07:45:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0f9c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f4145290 0x7ff0f41f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0f9c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f4145290 0x7ff0f41f50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42080/0 (socket says 172.21.15.99:42080) 2024-09-10T07:45:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0f9c00640 1 -- 172.21.15.99:0/4253785798 learned_addr learned my addr 172.21.15.99:0/4253785798 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0f9200640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0f4071510 0x7ff0f415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0f3e00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f40ce780 0x7ff0f413e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0f9c00640 1 -- 172.21.15.99:0/4253785798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0f4071510 msgr2=0x7ff0f415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0f9c00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0f4071510 0x7ff0f415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0f9c00640 1 -- 172.21.15.99:0/4253785798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f40ce780 msgr2=0x7ff0f413e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0f9c00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f40ce780 0x7ff0f413e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.649+0000 7ff0f9c00640 1 -- 172.21.15.99:0/4253785798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f41f5630 con 0x7ff0f4145290 2024-09-10T07:45:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.650+0000 7ff0f9c00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f4145290 0x7ff0f41f50f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009fd0 tx=0x7ff0ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.650+0000 7ff0f0c00640 1 -- 172.21.15.99:0/4253785798 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec014420 con 0x7ff0f4145290 2024-09-10T07:45:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.650+0000 7ff0f0c00640 1 -- 172.21.15.99:0/4253785798 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec019070 con 0x7ff0f4145290 2024-09-10T07:45:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.650+0000 7ff0f0c00640 1 -- 172.21.15.99:0/4253785798 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec014800 con 0x7ff0f4145290 2024-09-10T07:45:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.650+0000 7ff0fbc00640 1 -- 172.21.15.99:0/4253785798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f415b590 con 0x7ff0f4145290 2024-09-10T07:45:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.650+0000 7ff0fbc00640 1 -- 172.21.15.99:0/4253785798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f415d720 con 0x7ff0f4145290 2024-09-10T07:45:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.651+0000 7ff0fbc00640 1 -- 172.21.15.99:0/4253785798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f406f470 con 0x7ff0f4145290 2024-09-10T07:45:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.652+0000 7ff0f0c00640 1 -- 172.21.15.99:0/4253785798 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0ec0149a0 con 0x7ff0f4145290 2024-09-10T07:45:10.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.653+0000 7ff0f0c00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0d406be30 0x7ff0d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:10.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.653+0000 7ff0f0c00640 1 -- 172.21.15.99:0/4253785798 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4857+0+0 (secure 0 0 0) 0x7ff0ec08b3c0 con 0x7ff0f4145290 2024-09-10T07:45:10.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.653+0000 7ff0f9200640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0d406be30 0x7ff0d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:10.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.654+0000 7ff0f9200640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0d406be30 0x7ff0d406e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8006fd0 tx=0x7ff0e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:10.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.657+0000 7ff0f0c00640 1 -- 172.21.15.99:0/4253785798 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0f41f5630 con 0x7ff0f4145290 2024-09-10T07:45:10.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.892+0000 7ff0fbc00640 1 -- 172.21.15.99:0/4253785798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff0f40cfc30 con 0x7ff0f4145290 2024-09-10T07:45:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.892+0000 7ff0f0c00640 1 -- 172.21.15.99:0/4253785798 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7ff0ec05a020 con 0x7ff0f4145290 2024-09-10T07:45:10.891 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:10.891 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_dump": [ 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.a", 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mXjuLGRAAJtf/e/oaD2NmDR9S+uFbHw==", 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.b", 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mbtD9LBAAMj7RLHcTQxi1JktajDVUfQ==", 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.c", 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mWK9TIxAAjOLgqf8YLEu0Jb/yzr9iCw==", 2024-09-10T07:45:10.893 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mds.d", 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mM7TCNhAAZJ0nCBYXDOGf2UBxJ9w2nw==", 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:45:10.894 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.0", 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mrRdeEBAAd4ZcTBlIhQ0rDD6a0IVOFA==", 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.895 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.1", 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mF8miGxAAX/M/DiiUiawkpXLhAizp1A==", 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.2", 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mEVRZJhAABbX2QUmn1y5I+O4FHd+H/w==", 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.896 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.3", 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBh9t9mMxQGMBAAbB+mnEYzD8/g/7EEcoq9WA==", 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.4", 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mFl5TMBAARXiGff8rczup2Q3K0hky/w==", 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.5", 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBk9t9mxvCMOxAAkymLeJnn6OnM5GyWAFiPIw==", 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.898 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.6", 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9m6TmZCRAAFGEfirpNc4mPiPWlB1m3sw==", 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "osd.7", 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBl9t9mUmJsExAAeal//BYMINK0oUxwG2+Tlg==", 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow profile osd", 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile osd", 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.0", 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg==", 2024-09-10T07:45:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow r", 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.1", 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mtZd2EBAATNUb+xJy+r3JjBAgI3ZDIQ==", 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:45:10.901 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.2", 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9mwTANChAA+UwLo0v4VubglMs3WJUv8A==", 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.902 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.3", 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBe9t9myb7jFhAAk7eRXnsESU3YcxVPi10umw==", 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow", 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow r", 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow rw", 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow rwx" 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "client.admin", 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBc9t9m2Fs5JBAAQfJNCUhmbHevYDJWsG/oAg==", 2024-09-10T07:45:10.903 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": "allow *", 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow *", 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.x", 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9msy8GExAA6uwmlJdL3aoPnYJuc3ZN0Q==", 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.904 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: "entity": "mgr.y", 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "AQBd9t9mpI0gChAAdYoYfx76rxOnjmCDbSbjIw==", 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": { 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": "allow *", 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": "allow profile mgr", 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": "allow *" 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:10.905 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:45:10.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 -- 172.21.15.99:0/4253785798 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0d406be30 msgr2=0x7ff0d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0d406be30 0x7ff0d406e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8006fd0 tx=0x7ff0e8008040 comp rx=0 tx=0).stop 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 -- 172.21.15.99:0/4253785798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f4145290 msgr2=0x7ff0f41f50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f4145290 0x7ff0f41f50f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009fd0 tx=0x7ff0ec00e4b0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 -- 172.21.15.99:0/4253785798 shutdown_connections 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff0d406be30 0x7ff0d406e2f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f4145290 0x7ff0f41f50f0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f40ce780 0x7ff0f413e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 --2- 172.21.15.99:0/4253785798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0f4071510 0x7ff0f415e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 -- 172.21.15.99:0/4253785798 >> 172.21.15.99:0/4253785798 conn(0x7ff0f406bc10 msgr2=0x7ff0f40cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 -- 172.21.15.99:0/4253785798 shutdown_connections 2024-09-10T07:45:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:10.895+0000 7ff0fbc00640 1 -- 172.21.15.99:0/4253785798 wait complete. 2024-09-10T07:45:10.910 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T07:45:11.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.065+0000 7fc6bf000640 1 Processor -- start 2024-09-10T07:45:11.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.065+0000 7fc6bf000640 1 -- start start 2024-09-10T07:45:11.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6bf000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc6b80cf4a0 0x7fc6b81662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:11.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6bf000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b815c4f0 con 0x7fc6b8152210 2024-09-10T07:45:11.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6bf000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b815b730 con 0x7fc6b80cf010 2024-09-10T07:45:11.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6bf000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b815ba10 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6b7e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc6b8152210 0x7fc6b8071e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54110/0 (socket says 172.21.15.99:54110) 2024-09-10T07:45:11.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6b7e00640 1 -- 172.21.15.99:0/3628277600 learned_addr learned my addr 172.21.15.99:0/3628277600 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:11.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6bd000640 1 --2- 172.21.15.99:0/3628277600 >> v2:172.21.15.99:3300/0 conn(0x7fc6b80cf4a0 0x7fc6b81662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:11.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6bd000640 1 -- 172.21.15.99:0/3628277600 >> v1:172.21.15.187:6789/0 conn(0x7fc6b80cf010 legacy=0x7fc6b8162ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6b6a00640 1 -- 172.21.15.99:0/3628277600 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493645487 0 0) 0x7fc6b815c4f0 con 0x7fc6b8152210 2024-09-10T07:45:11.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6bd000640 1 -- 172.21.15.99:0/3628277600 >> v1:172.21.15.99:6789/0 conn(0x7fc6b8152210 legacy=0x7fc6b8071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.067+0000 7fc6bd000640 1 -- 172.21.15.99:0/3628277600 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b815bcf0 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.068+0000 7fc6bd000640 1 --2- 172.21.15.99:0/3628277600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 0x7fc6b81662d0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009d90 tx=0x7fc6b002b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7564c73d01178f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:11.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.069+0000 7fc6b6a00640 1 -- 172.21.15.99:0/3628277600 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0007740 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.069+0000 7fc6b6a00640 1 -- 172.21.15.99:0/3628277600 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b00078e0 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.069+0000 7fc6b6a00640 1 -- 172.21.15.99:0/3628277600 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0007cb0 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.069+0000 7fc6bf000640 1 -- 172.21.15.99:0/3628277600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 msgr2=0x7fc6b81662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.069+0000 7fc6bf000640 1 --2- 172.21.15.99:0/3628277600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 0x7fc6b81662d0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009d90 tx=0x7fc6b002b800 comp rx=0 tx=0).stop 2024-09-10T07:45:11.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.069+0000 7fc6bf000640 1 -- 172.21.15.99:0/3628277600 shutdown_connections 2024-09-10T07:45:11.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.069+0000 7fc6bf000640 1 --2- 172.21.15.99:0/3628277600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 0x7fc6b81662d0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:11.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.069+0000 7fc6bf000640 1 -- 172.21.15.99:0/3628277600 >> 172.21.15.99:0/3628277600 conn(0x7fc6b806bc10 msgr2=0x7fc6b806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:11.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.069+0000 7fc6bf000640 1 -- 172.21.15.99:0/3628277600 shutdown_connections 2024-09-10T07:45:11.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.069+0000 7fc6bf000640 1 -- 172.21.15.99:0/3628277600 wait complete. 2024-09-10T07:45:11.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.071+0000 7fc6bf000640 1 Processor -- start 2024-09-10T07:45:11.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.071+0000 7fc6bf000640 1 -- start start 2024-09-10T07:45:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.072+0000 7fc6bf000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6b80cf010 0x7fc6b815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.072+0000 7fc6bf000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 0x7fc6b81526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.072+0000 7fc6bf000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b8152210 0x7fc6b81f8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.072+0000 7fc6bf000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b80cf8d0 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.072+0000 7fc6bf000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b806f380 con 0x7fc6b80cf010 2024-09-10T07:45:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.072+0000 7fc6bf000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b80725a0 con 0x7fc6b8152210 2024-09-10T07:45:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.072+0000 7fc6b7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 0x7fc6b81526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.072+0000 7fc6b7e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6b80cf010 0x7fc6b815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:11.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.072+0000 7fc6bd000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b8152210 0x7fc6b81f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:11.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.072+0000 7fc6b7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 0x7fc6b81526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42106/0 (socket says 172.21.15.99:42106) 2024-09-10T07:45:11.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.073+0000 7fc6b7400640 1 -- 172.21.15.99:0/3638279518 learned_addr learned my addr 172.21.15.99:0/3638279518 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:11.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.073+0000 7fc6b7400640 1 -- 172.21.15.99:0/3638279518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b8152210 msgr2=0x7fc6b81f8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.073+0000 7fc6b7400640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b8152210 0x7fc6b81f8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:11.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.073+0000 7fc6b7400640 1 -- 172.21.15.99:0/3638279518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6b80cf010 msgr2=0x7fc6b815a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.073+0000 7fc6b7400640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6b80cf010 0x7fc6b815a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.073+0000 7fc6b7400640 1 -- 172.21.15.99:0/3638279518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b8153100 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.073+0000 7fc6b7400640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 0x7fc6b81526b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400c480 tx=0x7fc6a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:11.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.076+0000 7fc6afe00640 1 -- 172.21.15.99:0/3638279518 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40052d0 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.076+0000 7fc6bf000640 1 -- 172.21.15.99:0/3638279518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b81533e0 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.076+0000 7fc6afe00640 1 -- 172.21.15.99:0/3638279518 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a4005470 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.076+0000 7fc6afe00640 1 -- 172.21.15.99:0/3638279518 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4012830 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.076+0000 7fc6bf000640 1 -- 172.21.15.99:0/3638279518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b81539a0 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.077+0000 7fc6bf000640 1 -- 172.21.15.99:0/3638279518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b8071e90 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.078+0000 7fc6afe00640 1 -- 172.21.15.99:0/3638279518 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6a40129d0 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.079+0000 7fc6afe00640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc69806be30 0x7fc69806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:11.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.079+0000 7fc6afe00640 1 -- 172.21.15.99:0/3638279518 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4857+0+0 (secure 0 0 0) 0x7fc6a408a660 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.079+0000 7fc6b7e00640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc69806be30 0x7fc69806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:11.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.080+0000 7fc6b7e00640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc69806be30 0x7fc69806e2f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8000f60 tx=0x7fc6a8007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:11.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.083+0000 7fc6afe00640 1 -- 172.21.15.99:0/3638279518 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6a4058d00 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.258+0000 7fc6bf000640 1 -- 172.21.15.99:0/3638279518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc6b815d2b0 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.258+0000 7fc6afe00640 1 -- 172.21.15.99:0/3638279518 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v184) ==== 84+0+65 (secure 0 0 0) 0x7fc6a405d000 con 0x7fc6b80cf4a0 2024-09-10T07:45:11.258 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:11.258 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-09-10T07:45:11.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:11.259 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-09-10T07:45:11.259 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-09-10T07:45:11.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:11.259 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-09-10T07:45:11.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.260+0000 7fc6bf000640 1 -- 172.21.15.99:0/3638279518 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc69806be30 msgr2=0x7fc69806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.260+0000 7fc6bf000640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc69806be30 0x7fc69806e2f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8000f60 tx=0x7fc6a8007e40 comp rx=0 tx=0).stop 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.260+0000 7fc6bf000640 1 -- 172.21.15.99:0/3638279518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 msgr2=0x7fc6b81526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.260+0000 7fc6bf000640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 0x7fc6b81526b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400c480 tx=0x7fc6a400c940 comp rx=0 tx=0).stop 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.261+0000 7fc6bf000640 1 -- 172.21.15.99:0/3638279518 shutdown_connections 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.261+0000 7fc6bf000640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6b8152210 0x7fc6b81f8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.261+0000 7fc6bf000640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc69806be30 0x7fc69806e2f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.261+0000 7fc6bf000640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b80cf4a0 0x7fc6b81526b0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.261+0000 7fc6bf000640 1 --2- 172.21.15.99:0/3638279518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6b80cf010 0x7fc6b815a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.261+0000 7fc6bf000640 1 -- 172.21.15.99:0/3638279518 >> 172.21.15.99:0/3638279518 conn(0x7fc6b806bc10 msgr2=0x7fc6b80b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.261+0000 7fc6bf000640 1 -- 172.21.15.99:0/3638279518 shutdown_connections 2024-09-10T07:45:11.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.261+0000 7fc6bf000640 1 -- 172.21.15.99:0/3638279518 wait complete. 2024-09-10T07:45:11.277 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T07:45:11.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T07:45:11.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.434+0000 7fa863400640 1 Processor -- start 2024-09-10T07:45:11.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.435+0000 7fa863400640 1 -- start start 2024-09-10T07:45:11.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.436+0000 7fa863400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa85c06e5e0 0x7fa85c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:11.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.436+0000 7fa863400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85c15dfc0 con 0x7fa85c15e470 2024-09-10T07:45:11.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.436+0000 7fa863400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85c15d3b0 con 0x7fa85c0ce460 2024-09-10T07:45:11.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.436+0000 7fa863400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa85c06ef80 con 0x7fa85c06e5e0 2024-09-10T07:45:11.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.436+0000 7fa861400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa85c15e470 0x7fa85c15e8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54120/0 (socket says 172.21.15.99:54120) 2024-09-10T07:45:11.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.436+0000 7fa861400640 1 -- 172.21.15.99:0/929798096 learned_addr learned my addr 172.21.15.99:0/929798096 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:11.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.436+0000 7fa853e00640 1 --2- 172.21.15.99:0/929798096 >> v2:172.21.15.187:3300/0 conn(0x7fa85c06e5e0 0x7fa85c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:11.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.437+0000 7fa85be00640 1 -- 172.21.15.99:0/929798096 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075029860 0 0) 0x7fa85c15dfc0 con 0x7fa85c15e470 2024-09-10T07:45:11.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.437+0000 7fa85be00640 1 -- 172.21.15.99:0/929798096 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa840003520 con 0x7fa85c15e470 2024-09-10T07:45:11.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.437+0000 7fa853e00640 1 -- 172.21.15.99:0/929798096 >> v1:172.21.15.187:6789/0 conn(0x7fa85c0ce460 legacy=0x7fa85c0cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.437+0000 7fa853e00640 1 -- 172.21.15.99:0/929798096 >> v1:172.21.15.99:6789/0 conn(0x7fa85c15e470 legacy=0x7fa85c15e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.437+0000 7fa853e00640 1 -- 172.21.15.99:0/929798096 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c15d690 con 0x7fa85c06e5e0 2024-09-10T07:45:11.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.438+0000 7fa853e00640 1 --2- 172.21.15.99:0/929798096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c06e5e0 0x7fa85c06ea40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa8440097a0 tx=0x7fa84402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21512578a7a223ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:11.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.438+0000 7fa85be00640 1 -- 172.21.15.99:0/929798096 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844037070 con 0x7fa85c06e5e0 2024-09-10T07:45:11.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.438+0000 7fa85be00640 1 -- 172.21.15.99:0/929798096 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa844032440 con 0x7fa85c06e5e0 2024-09-10T07:45:11.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.438+0000 7fa85be00640 1 -- 172.21.15.99:0/929798096 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844032810 con 0x7fa85c06e5e0 2024-09-10T07:45:11.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.439+0000 7fa863400640 1 -- 172.21.15.99:0/929798096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c06e5e0 msgr2=0x7fa85c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.439+0000 7fa863400640 1 --2- 172.21.15.99:0/929798096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c06e5e0 0x7fa85c06ea40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa8440097a0 tx=0x7fa84402a230 comp rx=0 tx=0).stop 2024-09-10T07:45:11.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.439+0000 7fa863400640 1 -- 172.21.15.99:0/929798096 shutdown_connections 2024-09-10T07:45:11.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.439+0000 7fa863400640 1 --2- 172.21.15.99:0/929798096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c06e5e0 0x7fa85c06ea40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:11.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.439+0000 7fa863400640 1 -- 172.21.15.99:0/929798096 >> 172.21.15.99:0/929798096 conn(0x7fa85c0b26a0 msgr2=0x7fa85c0b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:11.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.439+0000 7fa863400640 1 -- 172.21.15.99:0/929798096 shutdown_connections 2024-09-10T07:45:11.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.439+0000 7fa863400640 1 -- 172.21.15.99:0/929798096 wait complete. 2024-09-10T07:45:11.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.440+0000 7fa863400640 1 Processor -- start 2024-09-10T07:45:11.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.440+0000 7fa863400640 1 -- start start 2024-09-10T07:45:11.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.441+0000 7fa863400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c06e5e0 0x7fa85c1482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.441+0000 7fa863400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa85c0ce460 0x7fa85c0c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.441+0000 7fa863400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c15e470 0x7fa85c0c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.441+0000 7fa863400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c0ce840 con 0x7fa85c0ce460 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.441+0000 7fa863400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c15dc50 con 0x7fa85c15e470 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.441+0000 7fa863400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa85c0d05f0 con 0x7fa85c06e5e0 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa853e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa85c0ce460 0x7fa85c0c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa853e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa85c0ce460 0x7fa85c0c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42118/0 (socket says 172.21.15.99:42118) 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa853e00640 1 -- 172.21.15.99:0/748087134 learned_addr learned my addr 172.21.15.99:0/748087134 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa860a00640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c06e5e0 0x7fa85c1482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa861400640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c15e470 0x7fa85c0c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa853e00640 1 -- 172.21.15.99:0/748087134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c06e5e0 msgr2=0x7fa85c1482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa853e00640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c06e5e0 0x7fa85c1482e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa853e00640 1 -- 172.21.15.99:0/748087134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c15e470 msgr2=0x7fa85c0c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:11.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa853e00640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c15e470 0x7fa85c0c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:11.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa853e00640 1 -- 172.21.15.99:0/748087134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c0c7c30 con 0x7fa85c0ce460 2024-09-10T07:45:11.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa860a00640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c06e5e0 0x7fa85c1482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:11.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa861400640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c15e470 0x7fa85c0c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:11.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa853e00640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa85c0ce460 0x7fa85c0c73e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fa844035040 tx=0x7fa8440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:11.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa859600640 1 -- 172.21.15.99:0/748087134 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844037040 con 0x7fa85c0ce460 2024-09-10T07:45:11.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.442+0000 7fa859600640 1 -- 172.21.15.99:0/748087134 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa844030500 con 0x7fa85c0ce460 2024-09-10T07:45:11.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.443+0000 7fa863400640 1 -- 172.21.15.99:0/748087134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85c0c7f10 con 0x7fa85c0ce460 2024-09-10T07:45:11.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.443+0000 7fa859600640 1 -- 172.21.15.99:0/748087134 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844030910 con 0x7fa85c0ce460 2024-09-10T07:45:11.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.443+0000 7fa863400640 1 -- 172.21.15.99:0/748087134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa85c0c5c90 con 0x7fa85c0ce460 2024-09-10T07:45:11.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.444+0000 7fa863400640 1 -- 172.21.15.99:0/748087134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa85c15cfd0 con 0x7fa85c0ce460 2024-09-10T07:45:11.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.445+0000 7fa859600640 1 -- 172.21.15.99:0/748087134 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa844044020 con 0x7fa85c0ce460 2024-09-10T07:45:11.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.445+0000 7fa859600640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa83806be30 0x7fa83806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:11.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.446+0000 7fa859600640 1 -- 172.21.15.99:0/748087134 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4857+0+0 (secure 0 0 0) 0x7fa8440aad90 con 0x7fa85c0ce460 2024-09-10T07:45:11.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.446+0000 7fa860a00640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa83806be30 0x7fa83806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:11.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.446+0000 7fa860a00640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa83806be30 0x7fa83806e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000f60 tx=0x7fa84c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:11.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.450+0000 7fa859600640 1 -- 172.21.15.99:0/748087134 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa844079a80 con 0x7fa85c0ce460 2024-09-10T07:45:11.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:11.623+0000 7fa863400640 1 -- 172.21.15.99:0/748087134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa85c071610 con 0x7fa85c0ce460 2024-09-10T07:45:12.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.468+0000 7fa859600640 1 -- 172.21.15.99:0/748087134 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v185) ==== 138+0+0 (secure 0 0 0) 0x7fa844079380 con 0x7fa85c0ce460 2024-09-10T07:45:12.468 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-09-10T07:45:12.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.472+0000 7fa863400640 1 -- 172.21.15.99:0/748087134 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa83806be30 msgr2=0x7fa83806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:12.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.472+0000 7fa863400640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa83806be30 0x7fa83806e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000f60 tx=0x7fa84c009040 comp rx=0 tx=0).stop 2024-09-10T07:45:12.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.472+0000 7fa863400640 1 -- 172.21.15.99:0/748087134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa85c0ce460 msgr2=0x7fa85c0c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:12.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.472+0000 7fa863400640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa85c0ce460 0x7fa85c0c73e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fa844035040 tx=0x7fa8440046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.473+0000 7fa863400640 1 -- 172.21.15.99:0/748087134 shutdown_connections 2024-09-10T07:45:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.473+0000 7fa863400640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c15e470 0x7fa85c0c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.473+0000 7fa863400640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa83806be30 0x7fa83806e2f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.473+0000 7fa863400640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa85c0ce460 0x7fa85c0c73e0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.473+0000 7fa863400640 1 --2- 172.21.15.99:0/748087134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c06e5e0 0x7fa85c1482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.473+0000 7fa863400640 1 -- 172.21.15.99:0/748087134 >> 172.21.15.99:0/748087134 conn(0x7fa85c0b26a0 msgr2=0x7fa85c0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.474+0000 7fa863400640 1 -- 172.21.15.99:0/748087134 shutdown_connections 2024-09-10T07:45:12.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.474+0000 7fa863400640 1 -- 172.21.15.99:0/748087134 wait complete. 2024-09-10T07:45:12.493 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T07:45:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.656+0000 7f9ead200640 1 Processor -- start 2024-09-10T07:45:12.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.656+0000 7f9ead200640 1 -- start start 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9ead200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ea80af9b0 0x7f9ea80ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9ead200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9ea80ce910 0x7f9ea8072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9ead200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea80b02c0 con 0x7f9ea815aff0 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9ead200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea80d0f10 con 0x7f9ea80af9b0 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9ead200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea815b3d0 con 0x7f9ea80ce910 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9e9d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ea80af9b0 0x7f9ea80ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9e9d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ea80af9b0 0x7f9ea80ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42128/0 (socket says 172.21.15.99:42128) 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9e9d400640 1 -- 172.21.15.99:0/4036049650 learned_addr learned my addr 172.21.15.99:0/4036049650 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9ea6800640 1 --2- 172.21.15.99:0/4036049650 >> v2:172.21.15.187:3300/0 conn(0x7f9ea80ce910 0x7f9ea8072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9e9d400640 1 -- 172.21.15.99:0/4036049650 >> v2:172.21.15.187:3300/0 conn(0x7f9ea80ce910 msgr2=0x7f9ea8072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9e9d400640 1 --2- 172.21.15.99:0/4036049650 >> v2:172.21.15.187:3300/0 conn(0x7f9ea80ce910 0x7f9ea8072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9e9d400640 1 -- 172.21.15.99:0/4036049650 >> v1:172.21.15.187:6789/0 conn(0x7f9ea815aff0 legacy=0x7f9ea80d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:12.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.658+0000 7f9e9d400640 1 -- 172.21.15.99:0/4036049650 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea80affe0 con 0x7f9ea80af9b0 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.659+0000 7f9e9d400640 1 --2- 172.21.15.99:0/4036049650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80af9b0 0x7f9ea80ce3d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8071330 tx=0x7f9e9002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139ae6caeee0ed71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ea5400640 1 -- 172.21.15.99:0/4036049650 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90037070 con 0x7f9ea80af9b0 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ea5400640 1 -- 172.21.15.99:0/4036049650 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e90032440 con 0x7f9ea80af9b0 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ea5400640 1 -- 172.21.15.99:0/4036049650 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90032810 con 0x7f9ea80af9b0 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ead200640 1 -- 172.21.15.99:0/4036049650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80af9b0 msgr2=0x7f9ea80ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ead200640 1 --2- 172.21.15.99:0/4036049650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80af9b0 0x7f9ea80ce3d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8071330 tx=0x7f9e9002a1e0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ead200640 1 -- 172.21.15.99:0/4036049650 shutdown_connections 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ead200640 1 --2- 172.21.15.99:0/4036049650 >> v2:172.21.15.187:3300/0 conn(0x7f9ea80ce910 0x7f9ea8072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ead200640 1 --2- 172.21.15.99:0/4036049650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80af9b0 0x7f9ea80ce3d0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ead200640 1 -- 172.21.15.99:0/4036049650 >> 172.21.15.99:0/4036049650 conn(0x7f9ea806bc10 msgr2=0x7f9ea806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ead200640 1 -- 172.21.15.99:0/4036049650 shutdown_connections 2024-09-10T07:45:12.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.660+0000 7f9ead200640 1 -- 172.21.15.99:0/4036049650 wait complete. 2024-09-10T07:45:12.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.662+0000 7f9ead200640 1 Processor -- start 2024-09-10T07:45:12.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.662+0000 7f9ead200640 1 -- start start 2024-09-10T07:45:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9ead200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ea80af9b0 0x7f9ea814f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9ead200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ce910 0x7f9ea81f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9ead200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ea815aff0 0x7f9ea8155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:12.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9ead200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea8071980 con 0x7f9ea80ce910 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9ead200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea8071cf0 con 0x7f9ea80af9b0 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9ead200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea80d12c0 con 0x7f9ea815aff0 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9e9d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ce910 0x7f9ea81f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9ea5e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ea80af9b0 0x7f9ea814f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9e9d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ce910 0x7f9ea81f2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42142/0 (socket says 172.21.15.99:42142) 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9e9d400640 1 -- 172.21.15.99:0/2919464998 learned_addr learned my addr 172.21.15.99:0/2919464998 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.663+0000 7f9ea6800640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ea815aff0 0x7f9ea8155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9e9d400640 1 -- 172.21.15.99:0/2919464998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ea815aff0 msgr2=0x7f9ea8155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9e9d400640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ea815aff0 0x7f9ea8155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9e9d400640 1 -- 172.21.15.99:0/2919464998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ea80af9b0 msgr2=0x7f9ea814f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9e9d400640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ea80af9b0 0x7f9ea814f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9e9d400640 1 -- 172.21.15.99:0/2919464998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea81564b0 con 0x7f9ea80ce910 2024-09-10T07:45:12.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9ea5e00640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ea80af9b0 0x7f9ea814f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:12.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9e9d400640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ce910 0x7f9ea81f2690 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f9e9002a220 tx=0x7f9e900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:12.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9e9ea00640 1 -- 172.21.15.99:0/2919464998 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90037040 con 0x7f9ea80ce910 2024-09-10T07:45:12.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9e9ea00640 1 -- 172.21.15.99:0/2919464998 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e90042070 con 0x7f9ea80ce910 2024-09-10T07:45:12.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9e9ea00640 1 -- 172.21.15.99:0/2919464998 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90030880 con 0x7f9ea80ce910 2024-09-10T07:45:12.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.664+0000 7f9ead200640 1 -- 172.21.15.99:0/2919464998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea81f35f0 con 0x7f9ea80ce910 2024-09-10T07:45:12.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.665+0000 7f9ead200640 1 -- 172.21.15.99:0/2919464998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea81f3030 con 0x7f9ea80ce910 2024-09-10T07:45:12.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.666+0000 7f9ead200640 1 -- 172.21.15.99:0/2919464998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea80ce3d0 con 0x7f9ea80ce910 2024-09-10T07:45:12.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.667+0000 7f9e9ea00640 1 -- 172.21.15.99:0/2919464998 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e90030a20 con 0x7f9ea80ce910 2024-09-10T07:45:12.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.668+0000 7f9e9ea00640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e8406be30 0x7f9e8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:12.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.668+0000 7f9e9ea00640 1 -- 172.21.15.99:0/2919464998 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5227+0+0 (secure 0 0 0) 0x7f9e900ab3f0 con 0x7f9ea80ce910 2024-09-10T07:45:12.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.668+0000 7f9ea5e00640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e8406be30 0x7f9e8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:12.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.669+0000 7f9ea5e00640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e8406be30 0x7f9e8406e2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9e98000f60 tx=0x7f9e98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:12.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.673+0000 7f9e9ea00640 1 -- 172.21.15.99:0/2919464998 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e90079920 con 0x7f9ea80ce910 2024-09-10T07:45:12.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:12.848+0000 7f9ead200640 1 -- 172.21.15.99:0/2919464998 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9ea80cd010 con 0x7f9ea80ce910 2024-09-10T07:45:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.476+0000 7f9e9ea00640 1 -- 172.21.15.99:0/2919464998 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v186) ==== 170+0+0 (secure 0 0 0) 0x7f9e9007dc20 con 0x7f9ea80ce910 2024-09-10T07:45:13.476 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-09-10T07:45:13.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.480+0000 7f9ead200640 1 -- 172.21.15.99:0/2919464998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e8406be30 msgr2=0x7f9e8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:13.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.480+0000 7f9ead200640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e8406be30 0x7f9e8406e2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9e98000f60 tx=0x7f9e98009040 comp rx=0 tx=0).stop 2024-09-10T07:45:13.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.480+0000 7f9ead200640 1 -- 172.21.15.99:0/2919464998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ce910 msgr2=0x7f9ea81f2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:13.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.480+0000 7f9ead200640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ce910 0x7f9ea81f2690 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f9e9002a220 tx=0x7f9e900046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:13.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.480+0000 7f9ead200640 1 -- 172.21.15.99:0/2919464998 shutdown_connections 2024-09-10T07:45:13.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.480+0000 7f9ead200640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ea815aff0 0x7f9ea8155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:13.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.480+0000 7f9ead200640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9e8406be30 0x7f9e8406e2f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:13.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.480+0000 7f9ead200640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ea80ce910 0x7f9ea81f2690 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:13.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.480+0000 7f9ead200640 1 --2- 172.21.15.99:0/2919464998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ea80af9b0 0x7f9ea814f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:13.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.480+0000 7f9ead200640 1 -- 172.21.15.99:0/2919464998 >> 172.21.15.99:0/2919464998 conn(0x7f9ea806bc10 msgr2=0x7f9ea815d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:13.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.481+0000 7f9ead200640 1 -- 172.21.15.99:0/2919464998 shutdown_connections 2024-09-10T07:45:13.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.481+0000 7f9ead200640 1 -- 172.21.15.99:0/2919464998 wait complete. 2024-09-10T07:45:13.507 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T07:45:13.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.667+0000 7f24cf000640 1 Processor -- start 2024-09-10T07:45:13.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.667+0000 7f24cf000640 1 -- start start 2024-09-10T07:45:13.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.668+0000 7f24cf000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c815c580 0x7f24c806d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:13.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.668+0000 7f24cf000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f24c80b5960 0x7f24c806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:13.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.668+0000 7f24cf000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24c806d920 con 0x7f24c815c960 2024-09-10T07:45:13.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.668+0000 7f24cf000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f24c80b3930 con 0x7f24c80b5960 2024-09-10T07:45:13.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.668+0000 7f24cf000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f24c806dc00 con 0x7f24c815c580 2024-09-10T07:45:13.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.669+0000 7f24cdc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c815c580 0x7f24c806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:13.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.669+0000 7f24cdc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c815c580 0x7f24c806d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:34960/0 (socket says 172.21.15.99:34960) 2024-09-10T07:45:13.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.669+0000 7f24cdc00640 1 -- 172.21.15.99:0/3217969644 learned_addr learned my addr 172.21.15.99:0/3217969644 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:13.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.669+0000 7f24ce600640 1 --2- 172.21.15.99:0/3217969644 >> v2:172.21.15.187:3300/0 conn(0x7f24c80b5960 0x7f24c806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:13.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.669+0000 7f24cdc00640 1 -- 172.21.15.99:0/3217969644 >> v2:172.21.15.187:3300/0 conn(0x7f24c80b5960 msgr2=0x7f24c806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:13.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.669+0000 7f24cdc00640 1 --2- 172.21.15.99:0/3217969644 >> v2:172.21.15.187:3300/0 conn(0x7f24c80b5960 0x7f24c806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:13.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.669+0000 7f24cdc00640 1 -- 172.21.15.99:0/3217969644 >> v1:172.21.15.187:6789/0 conn(0x7f24c815c960 legacy=0x7f24c80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:13.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.669+0000 7f24cdc00640 1 -- 172.21.15.99:0/3217969644 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c806dee0 con 0x7f24c815c580 2024-09-10T07:45:13.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.670+0000 7f24cdc00640 1 --2- 172.21.15.99:0/3217969644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c815c580 0x7f24c806d340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009870 tx=0x7f24bc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fcf21d4f0308b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:13.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24c7e00640 1 -- 172.21.15.99:0/3217969644 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc037070 con 0x7f24c815c580 2024-09-10T07:45:13.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24c7e00640 1 -- 172.21.15.99:0/3217969644 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24bc032440 con 0x7f24c815c580 2024-09-10T07:45:13.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24c7e00640 1 -- 172.21.15.99:0/3217969644 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc032810 con 0x7f24c815c580 2024-09-10T07:45:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24cf000640 1 -- 172.21.15.99:0/3217969644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c815c580 msgr2=0x7f24c806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24cf000640 1 --2- 172.21.15.99:0/3217969644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c815c580 0x7f24c806d340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009870 tx=0x7f24bc02a270 comp rx=0 tx=0).stop 2024-09-10T07:45:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24cf000640 1 -- 172.21.15.99:0/3217969644 shutdown_connections 2024-09-10T07:45:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24cf000640 1 --2- 172.21.15.99:0/3217969644 >> v2:172.21.15.187:3300/0 conn(0x7f24c80b5960 0x7f24c806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24cf000640 1 --2- 172.21.15.99:0/3217969644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c815c580 0x7f24c806d340 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24cf000640 1 -- 172.21.15.99:0/3217969644 >> 172.21.15.99:0/3217969644 conn(0x7f24c80b2810 msgr2=0x7f24c80b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24cf000640 1 -- 172.21.15.99:0/3217969644 shutdown_connections 2024-09-10T07:45:13.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.671+0000 7f24cf000640 1 -- 172.21.15.99:0/3217969644 wait complete. 2024-09-10T07:45:13.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.673+0000 7f24cf000640 1 Processor -- start 2024-09-10T07:45:13.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.673+0000 7f24cf000640 1 -- start start 2024-09-10T07:45:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24cf000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c80b5960 0x7f24c8149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24cf000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24c815c580 0x7f24c80cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24cf000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24c81590b0 0x7f24c8148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24cf000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f24c806c150 con 0x7f24c81590b0 2024-09-10T07:45:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24cf000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f24c80b5d60 con 0x7f24c815c580 2024-09-10T07:45:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24cf000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f24c806c2d0 con 0x7f24c80b5960 2024-09-10T07:45:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24ce600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24c81590b0 0x7f24c8148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24ce600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24c81590b0 0x7f24c8148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42154/0 (socket says 172.21.15.99:42154) 2024-09-10T07:45:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24ce600640 1 -- 172.21.15.99:0/814366863 learned_addr learned my addr 172.21.15.99:0/814366863 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24cd200640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24c815c580 0x7f24c80cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.674+0000 7f24cdc00640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c80b5960 0x7f24c8149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.675+0000 7f24ce600640 1 -- 172.21.15.99:0/814366863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c80b5960 msgr2=0x7f24c8149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.675+0000 7f24ce600640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c80b5960 0x7f24c8149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.675+0000 7f24ce600640 1 -- 172.21.15.99:0/814366863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24c815c580 msgr2=0x7f24c80cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.675+0000 7f24ce600640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24c815c580 0x7f24c80cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:13.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.675+0000 7f24ce600640 1 -- 172.21.15.99:0/814366863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c8159a70 con 0x7f24c81590b0 2024-09-10T07:45:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.675+0000 7f24ce600640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24c81590b0 0x7f24c8148fb0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f24c000efc0 tx=0x7f24c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.675+0000 7f24c5600640 1 -- 172.21.15.99:0/814366863 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0018020 con 0x7f24c81590b0 2024-09-10T07:45:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.675+0000 7f24c5600640 1 -- 172.21.15.99:0/814366863 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c0014480 con 0x7f24c81590b0 2024-09-10T07:45:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.675+0000 7f24c5600640 1 -- 172.21.15.99:0/814366863 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0014870 con 0x7f24c81590b0 2024-09-10T07:45:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.675+0000 7f24cf000640 1 -- 172.21.15.99:0/814366863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c8156930 con 0x7f24c81590b0 2024-09-10T07:45:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.676+0000 7f24cf000640 1 -- 172.21.15.99:0/814366863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c80cc630 con 0x7f24c81590b0 2024-09-10T07:45:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.676+0000 7f24cf000640 1 -- 172.21.15.99:0/814366863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24c8156720 con 0x7f24c81590b0 2024-09-10T07:45:13.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.678+0000 7f24c5600640 1 -- 172.21.15.99:0/814366863 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24c0005d10 con 0x7f24c81590b0 2024-09-10T07:45:13.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.678+0000 7f24c5600640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f24a806be30 0x7f24a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:13.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.678+0000 7f24c5600640 1 -- 172.21.15.99:0/814366863 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5609+0+0 (secure 0 0 0) 0x7f24c008bbe0 con 0x7f24c81590b0 2024-09-10T07:45:13.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.679+0000 7f24cdc00640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f24a806be30 0x7f24a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:13.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.679+0000 7f24cdc00640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f24a806be30 0x7f24a806e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f24bc034000 tx=0x7f24bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:13.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.684+0000 7f24c5600640 1 -- 172.21.15.99:0/814366863 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24c0022030 con 0x7f24c81590b0 2024-09-10T07:45:13.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:13.893+0000 7f24cf000640 1 -- 172.21.15.99:0/814366863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f24c806bc10 con 0x7f24c81590b0 2024-09-10T07:45:14.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.479+0000 7f24c5600640 1 -- 172.21.15.99:0/814366863 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v86) ==== 174+0+0 (secure 0 0 0) 0x7f24c0010040 con 0x7f24c81590b0 2024-09-10T07:45:14.479 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 22 and data pool 23 2024-09-10T07:45:14.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.482+0000 7f24cf000640 1 -- 172.21.15.99:0/814366863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f24a806be30 msgr2=0x7f24a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:14.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.482+0000 7f24cf000640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f24a806be30 0x7f24a806e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f24bc034000 tx=0x7f24bc02e000 comp rx=0 tx=0).stop 2024-09-10T07:45:14.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.482+0000 7f24cf000640 1 -- 172.21.15.99:0/814366863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24c81590b0 msgr2=0x7f24c8148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:14.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.482+0000 7f24cf000640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24c81590b0 0x7f24c8148fb0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f24c000efc0 tx=0x7f24c000c490 comp rx=0 tx=0).stop 2024-09-10T07:45:14.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.483+0000 7f24cf000640 1 -- 172.21.15.99:0/814366863 shutdown_connections 2024-09-10T07:45:14.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.483+0000 7f24cf000640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f24a806be30 0x7f24a806e2f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.483+0000 7f24cf000640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24c81590b0 0x7f24c8148fb0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.483+0000 7f24cf000640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24c815c580 0x7f24c80cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.483+0000 7f24cf000640 1 --2- 172.21.15.99:0/814366863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24c80b5960 0x7f24c8149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.483+0000 7f24cf000640 1 -- 172.21.15.99:0/814366863 >> 172.21.15.99:0/814366863 conn(0x7f24c80b2810 msgr2=0x7f24c80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:14.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.485+0000 7f24cf000640 1 -- 172.21.15.99:0/814366863 shutdown_connections 2024-09-10T07:45:14.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.485+0000 7f24cf000640 1 -- 172.21.15.99:0/814366863 wait complete. 2024-09-10T07:45:14.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:45:14.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.668+0000 7fa833200640 1 Processor -- start 2024-09-10T07:45:14.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.668+0000 7fa833200640 1 -- start start 2024-09-10T07:45:14.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.670+0000 7fa833200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82c13fae0 0x7fa82c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:14.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.670+0000 7fa833200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa82c160c50 0x7fa82c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:14.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.670+0000 7fa833200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c142650 con 0x7fa82c142150 2024-09-10T07:45:14.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.670+0000 7fa833200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa82c0ce780 con 0x7fa82c160c50 2024-09-10T07:45:14.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.670+0000 7fa833200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c142930 con 0x7fa82c13fae0 2024-09-10T07:45:14.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.670+0000 7fa831200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa82c160c50 0x7fa82c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:14.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.670+0000 7fa831200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa82c160c50 0x7fa82c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42164/0 (socket says 172.21.15.99:42164) 2024-09-10T07:45:14.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.670+0000 7fa831200640 1 -- 172.21.15.99:0/1299802857 learned_addr learned my addr 172.21.15.99:0/1299802857 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:14.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.670+0000 7fa82be00640 1 --2- 172.21.15.99:0/1299802857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82c13fae0 0x7fa82c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:14.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.671+0000 7fa831200640 1 -- 172.21.15.99:0/1299802857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82c13fae0 msgr2=0x7fa82c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:14.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.671+0000 7fa831200640 1 --2- 172.21.15.99:0/1299802857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82c13fae0 0x7fa82c06f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.671+0000 7fa831200640 1 -- 172.21.15.99:0/1299802857 >> v1:172.21.15.187:6789/0 conn(0x7fa82c142150 legacy=0x7fa82c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:14.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.671+0000 7fa831200640 1 -- 172.21.15.99:0/1299802857 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c142c10 con 0x7fa82c160c50 2024-09-10T07:45:14.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.672+0000 7fa831200640 1 --2- 172.21.15.99:0/1299802857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c160c50 0x7fa82c0cec10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fa824009e50 tx=0x7fa82402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e0448373e580de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:14.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.672+0000 7fa82b400640 1 -- 172.21.15.99:0/1299802857 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824036070 con 0x7fa82c160c50 2024-09-10T07:45:14.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.672+0000 7fa82b400640 1 -- 172.21.15.99:0/1299802857 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa824031600 con 0x7fa82c160c50 2024-09-10T07:45:14.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.672+0000 7fa82b400640 1 -- 172.21.15.99:0/1299802857 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8240319d0 con 0x7fa82c160c50 2024-09-10T07:45:14.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.672+0000 7fa833200640 1 -- 172.21.15.99:0/1299802857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c160c50 msgr2=0x7fa82c0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:14.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.672+0000 7fa833200640 1 --2- 172.21.15.99:0/1299802857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c160c50 0x7fa82c0cec10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fa824009e50 tx=0x7fa82402a680 comp rx=0 tx=0).stop 2024-09-10T07:45:14.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.672+0000 7fa833200640 1 -- 172.21.15.99:0/1299802857 shutdown_connections 2024-09-10T07:45:14.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.672+0000 7fa833200640 1 --2- 172.21.15.99:0/1299802857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c160c50 0x7fa82c0cec10 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.672+0000 7fa833200640 1 --2- 172.21.15.99:0/1299802857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82c13fae0 0x7fa82c06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.672+0000 7fa833200640 1 -- 172.21.15.99:0/1299802857 >> 172.21.15.99:0/1299802857 conn(0x7fa82c06bc10 msgr2=0x7fa82c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:14.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.673+0000 7fa833200640 1 -- 172.21.15.99:0/1299802857 shutdown_connections 2024-09-10T07:45:14.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.673+0000 7fa833200640 1 -- 172.21.15.99:0/1299802857 wait complete. 2024-09-10T07:45:14.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.674+0000 7fa833200640 1 Processor -- start 2024-09-10T07:45:14.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.674+0000 7fa833200640 1 -- start start 2024-09-10T07:45:14.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa833200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa82c13fae0 0x7fa82c145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:14.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa833200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c142150 0x7fa82c15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:14.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa833200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82c160c50 0x7fa82c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:14.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa833200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c06f870 con 0x7fa82c142150 2024-09-10T07:45:14.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa833200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c06f6f0 con 0x7fa82c13fae0 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa833200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c0cf150 con 0x7fa82c160c50 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa823400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c142150 0x7fa82c15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa823400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c142150 0x7fa82c15b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42178/0 (socket says 172.21.15.99:42178) 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa823400640 1 -- 172.21.15.99:0/3963381900 learned_addr learned my addr 172.21.15.99:0/3963381900 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa82be00640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa82c13fae0 0x7fa82c145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.675+0000 7fa831200640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82c160c50 0x7fa82c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.676+0000 7fa823400640 1 -- 172.21.15.99:0/3963381900 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82c160c50 msgr2=0x7fa82c15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.676+0000 7fa823400640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82c160c50 0x7fa82c15bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.676+0000 7fa823400640 1 -- 172.21.15.99:0/3963381900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa82c13fae0 msgr2=0x7fa82c145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.676+0000 7fa823400640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa82c13fae0 0x7fa82c145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.676+0000 7fa823400640 1 -- 172.21.15.99:0/3963381900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c1441a0 con 0x7fa82c142150 2024-09-10T07:45:14.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.676+0000 7fa823400640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c142150 0x7fa82c15b9c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c3a0 tx=0x7fa81400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:14.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.676+0000 7fa828c00640 1 -- 172.21.15.99:0/3963381900 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8140052d0 con 0x7fa82c142150 2024-09-10T07:45:14.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.676+0000 7fa828c00640 1 -- 172.21.15.99:0/3963381900 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa814005490 con 0x7fa82c142150 2024-09-10T07:45:14.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.676+0000 7fa828c00640 1 -- 172.21.15.99:0/3963381900 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814007260 con 0x7fa82c142150 2024-09-10T07:45:14.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.676+0000 7fa833200640 1 -- 172.21.15.99:0/3963381900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c144480 con 0x7fa82c142150 2024-09-10T07:45:14.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.677+0000 7fa833200640 1 -- 172.21.15.99:0/3963381900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c144a40 con 0x7fa82c142150 2024-09-10T07:45:14.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.678+0000 7fa833200640 1 -- 172.21.15.99:0/3963381900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c06f1b0 con 0x7fa82c142150 2024-09-10T07:45:14.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.679+0000 7fa828c00640 1 -- 172.21.15.99:0/3963381900 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa814007400 con 0x7fa82c142150 2024-09-10T07:45:14.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.679+0000 7fa828c00640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa80806be30 0x7fa80806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:14.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.679+0000 7fa828c00640 1 -- 172.21.15.99:0/3963381900 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7fa81408a320 con 0x7fa82c142150 2024-09-10T07:45:14.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.680+0000 7fa82be00640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa80806be30 0x7fa80806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:14.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.680+0000 7fa82be00640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa80806be30 0x7fa80806e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009b40 tx=0x7fa81c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:14.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.684+0000 7fa828c00640 1 -- 172.21.15.99:0/3963381900 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8140585d0 con 0x7fa82c142150 2024-09-10T07:45:14.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.857+0000 7fa833200640 1 -- 172.21.15.99:0/3963381900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa82c160590 con 0x7fa82c142150 2024-09-10T07:45:14.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.859+0000 7fa828c00640 1 -- 172.21.15.99:0/3963381900 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) ==== 74+0+16721 (secure 0 0 0) 0x7fa81405c8d0 con 0x7fa82c142150 2024-09-10T07:45:14.858 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:14.859 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":187,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:45:13.894599+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:45:11.664665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-10T07:45:12.889786+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:45:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 -- 172.21.15.99:0/3963381900 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa80806be30 msgr2=0x7fa80806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa80806be30 0x7fa80806e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009b40 tx=0x7fa81c009190 comp rx=0 tx=0).stop 2024-09-10T07:45:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 -- 172.21.15.99:0/3963381900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c142150 msgr2=0x7fa82c15b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c142150 0x7fa82c15b9c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c3a0 tx=0x7fa81400c860 comp rx=0 tx=0).stop 2024-09-10T07:45:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 -- 172.21.15.99:0/3963381900 shutdown_connections 2024-09-10T07:45:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa82c160c50 0x7fa82c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa80806be30 0x7fa80806e2f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa82c142150 0x7fa82c15b9c0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 --2- 172.21.15.99:0/3963381900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa82c13fae0 0x7fa82c145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:14.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 -- 172.21.15.99:0/3963381900 >> 172.21.15.99:0/3963381900 conn(0x7fa82c06bc10 msgr2=0x7fa82c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 -- 172.21.15.99:0/3963381900 shutdown_connections 2024-09-10T07:45:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:14.861+0000 7fa833200640 1 -- 172.21.15.99:0/3963381900 wait complete. 2024-09-10T07:45:14.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:45:15.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.031+0000 7f782cc00640 1 Processor -- start 2024-09-10T07:45:15.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.032+0000 7f782cc00640 1 -- start start 2024-09-10T07:45:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f782cc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7828152210 0x7f7828071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f782cc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f78280723d0 0x7f78280cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f782cc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78280cf550 0x7f782806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f782cc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f78280cf9c0 con 0x7f78280723d0 2024-09-10T07:45:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f782cc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f782815c4f0 con 0x7f7828152210 2024-09-10T07:45:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f782cc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f782815b730 con 0x7f78280cf550 2024-09-10T07:45:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f7825400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f78280723d0 0x7f78280cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f7825400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f78280723d0 0x7f78280cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42180/0 (socket says 172.21.15.99:42180) 2024-09-10T07:45:15.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f7825400640 1 -- 172.21.15.99:0/3514352279 learned_addr learned my addr 172.21.15.99:0/3514352279 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f7825e00640 1 --2- 172.21.15.99:0/3514352279 >> v2:172.21.15.187:3300/0 conn(0x7f7828152210 0x7f7828071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.033+0000 7f7826800640 1 --2- 172.21.15.99:0/3514352279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78280cf550 0x7f782806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.034+0000 7f7825400640 1 -- 172.21.15.99:0/3514352279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78280cf550 msgr2=0x7f782806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.034+0000 7f7825400640 1 --2- 172.21.15.99:0/3514352279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78280cf550 0x7f782806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.034+0000 7f7825400640 1 -- 172.21.15.99:0/3514352279 >> v2:172.21.15.187:3300/0 conn(0x7f7828152210 msgr2=0x7f7828071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:15.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.034+0000 7f7825400640 1 --2- 172.21.15.99:0/3514352279 >> v2:172.21.15.187:3300/0 conn(0x7f7828152210 0x7f7828071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.034+0000 7f7825400640 1 -- 172.21.15.99:0/3514352279 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782815ba10 con 0x7f78280723d0 2024-09-10T07:45:15.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.035+0000 7f7825400640 1 --2- 172.21.15.99:0/3514352279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 0x7f78280cf010 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f7828075940 tx=0x7f781402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea1fcd17f3519ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.035+0000 7f7824a00640 1 -- 172.21.15.99:0/3514352279 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814037070 con 0x7f78280723d0 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.035+0000 7f7824a00640 1 -- 172.21.15.99:0/3514352279 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7814032440 con 0x7f78280723d0 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.035+0000 7f7824a00640 1 -- 172.21.15.99:0/3514352279 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814032810 con 0x7f78280723d0 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.036+0000 7f782cc00640 1 -- 172.21.15.99:0/3514352279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 msgr2=0x7f78280cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.036+0000 7f782cc00640 1 --2- 172.21.15.99:0/3514352279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 0x7f78280cf010 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f7828075940 tx=0x7f781402a1e0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.036+0000 7f782cc00640 1 -- 172.21.15.99:0/3514352279 shutdown_connections 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.036+0000 7f782cc00640 1 --2- 172.21.15.99:0/3514352279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78280cf550 0x7f782806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.036+0000 7f782cc00640 1 --2- 172.21.15.99:0/3514352279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 0x7f78280cf010 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.036+0000 7f782cc00640 1 --2- 172.21.15.99:0/3514352279 >> v2:172.21.15.187:3300/0 conn(0x7f7828152210 0x7f7828071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.036+0000 7f782cc00640 1 -- 172.21.15.99:0/3514352279 >> 172.21.15.99:0/3514352279 conn(0x7f782806bc10 msgr2=0x7f782806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.036+0000 7f782cc00640 1 -- 172.21.15.99:0/3514352279 shutdown_connections 2024-09-10T07:45:15.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.036+0000 7f782cc00640 1 -- 172.21.15.99:0/3514352279 wait complete. 2024-09-10T07:45:15.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.037+0000 7f782cc00640 1 Processor -- start 2024-09-10T07:45:15.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.038+0000 7f782cc00640 1 -- start start 2024-09-10T07:45:15.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.038+0000 7f782cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 0x7f78280c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.038+0000 7f782cc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78280cf550 0x7f78281f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.038+0000 7f782cc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7828152210 0x7f782813db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.038+0000 7f782cc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f782806f380 con 0x7f78280723d0 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f782cc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f782815bfd0 con 0x7f78280cf550 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f782cc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f78280ce780 con 0x7f7828152210 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f7825e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 0x7f78280c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f7825e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 0x7f78280c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42192/0 (socket says 172.21.15.99:42192) 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f7825e00640 1 -- 172.21.15.99:0/2114159864 learned_addr learned my addr 172.21.15.99:0/2114159864 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f7826800640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7828152210 0x7f782813db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f7825400640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78280cf550 0x7f78281f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f7825e00640 1 -- 172.21.15.99:0/2114159864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7828152210 msgr2=0x7f782813db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f7825e00640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7828152210 0x7f782813db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f7825e00640 1 -- 172.21.15.99:0/2114159864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78280cf550 msgr2=0x7f78281f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:15.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f7825e00640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78280cf550 0x7f78281f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.039+0000 7f7825e00640 1 -- 172.21.15.99:0/2114159864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78280c7450 con 0x7f78280723d0 2024-09-10T07:45:15.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.040+0000 7f7825e00640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 0x7f78280c62b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f781800d5d0 tx=0x7f781800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:15.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.040+0000 7f781e000640 1 -- 172.21.15.99:0/2114159864 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78180125f0 con 0x7f78280723d0 2024-09-10T07:45:15.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.040+0000 7f781e000640 1 -- 172.21.15.99:0/2114159864 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7818019070 con 0x7f78280723d0 2024-09-10T07:45:15.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.040+0000 7f781e000640 1 -- 172.21.15.99:0/2114159864 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78180129f0 con 0x7f78280723d0 2024-09-10T07:45:15.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.040+0000 7f782cc00640 1 -- 172.21.15.99:0/2114159864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78280c6bb0 con 0x7f78280723d0 2024-09-10T07:45:15.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.040+0000 7f782cc00640 1 -- 172.21.15.99:0/2114159864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78280c7170 con 0x7f78280723d0 2024-09-10T07:45:15.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.041+0000 7f782cc00640 1 -- 172.21.15.99:0/2114159864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7828071e90 con 0x7f78280723d0 2024-09-10T07:45:15.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.042+0000 7f781e000640 1 -- 172.21.15.99:0/2114159864 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7818012b90 con 0x7f78280723d0 2024-09-10T07:45:15.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.043+0000 7f781e000640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f780806be60 0x7f780806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.043+0000 7f781e000640 1 -- 172.21.15.99:0/2114159864 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f781808b190 con 0x7f78280723d0 2024-09-10T07:45:15.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.043+0000 7f7825400640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f780806be60 0x7f780806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.044+0000 7f7825400640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f780806be60 0x7f780806e320 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7814034000 tx=0x7f781402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:15.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.047+0000 7f781e000640 1 -- 172.21.15.99:0/2114159864 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7818059450 con 0x7f78280723d0 2024-09-10T07:45:15.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.225+0000 7f782cc00640 1 -- 172.21.15.99:0/2114159864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f782815dd60 con 0x7f78280723d0 2024-09-10T07:45:15.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.226+0000 7f781e000640 1 -- 172.21.15.99:0/2114159864 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) ==== 74+0+16721 (secure 0 0 0) 0x7f781805d750 con 0x7f78280723d0 2024-09-10T07:45:15.226 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:15.226 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":187,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:45:13.894599+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:45:11.664665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-10T07:45:12.889786+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:45:15.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 -- 172.21.15.99:0/2114159864 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f780806be60 msgr2=0x7f780806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f780806be60 0x7f780806e320 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7814034000 tx=0x7f781402e000 comp rx=0 tx=0).stop 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 -- 172.21.15.99:0/2114159864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 msgr2=0x7f78280c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 0x7f78280c62b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f781800d5d0 tx=0x7f781800da90 comp rx=0 tx=0).stop 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 -- 172.21.15.99:0/2114159864 shutdown_connections 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7828152210 0x7f782813db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78280cf550 0x7f78281f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f780806be60 0x7f780806e320 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 --2- 172.21.15.99:0/2114159864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78280723d0 0x7f78280c62b0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 -- 172.21.15.99:0/2114159864 >> 172.21.15.99:0/2114159864 conn(0x7f782806bc10 msgr2=0x7f78280b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 -- 172.21.15.99:0/2114159864 shutdown_connections 2024-09-10T07:45:15.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.229+0000 7f782cc00640 1 -- 172.21.15.99:0/2114159864 wait complete. 2024-09-10T07:45:15.244 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T07:45:15.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.402+0000 7f0c49400640 1 Processor -- start 2024-09-10T07:45:15.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.402+0000 7f0c49400640 1 -- start start 2024-09-10T07:45:15.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.403+0000 7f0c49400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0c4406e280 0x7f0c44073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.403+0000 7f0c49400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c440722d0 con 0x7f0c44071df0 2024-09-10T07:45:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.403+0000 7f0c49400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c440725b0 con 0x7f0c440d1010 2024-09-10T07:45:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.403+0000 7f0c49400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0c440738b0 con 0x7f0c4406e280 2024-09-10T07:45:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.403+0000 7f0c41e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0c44071df0 0x7f0c4406e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54136/0 (socket says 172.21.15.99:54136) 2024-09-10T07:45:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.403+0000 7f0c41e00640 1 -- 172.21.15.99:0/117272335 learned_addr learned my addr 172.21.15.99:0/117272335 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.403+0000 7f0c42800640 1 --2- 172.21.15.99:0/117272335 >> v2:172.21.15.187:3300/0 conn(0x7f0c4406e280 0x7f0c44073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.404+0000 7f0c41400640 1 -- 172.21.15.99:0/117272335 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438033636 0 0) 0x7f0c440722d0 con 0x7f0c44071df0 2024-09-10T07:45:15.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.404+0000 7f0c41400640 1 -- 172.21.15.99:0/117272335 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c28003520 con 0x7f0c44071df0 2024-09-10T07:45:15.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.404+0000 7f0c41400640 1 -- 172.21.15.99:0/117272335 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945880309 0 0) 0x7f0c440725b0 con 0x7f0c440d1010 2024-09-10T07:45:15.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.404+0000 7f0c41400640 1 -- 172.21.15.99:0/117272335 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c440722d0 con 0x7f0c440d1010 2024-09-10T07:45:15.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.404+0000 7f0c42800640 1 -- 172.21.15.99:0/117272335 >> v1:172.21.15.187:6789/0 conn(0x7f0c440d1010 legacy=0x7f0c440ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:15.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.404+0000 7f0c42800640 1 -- 172.21.15.99:0/117272335 >> v1:172.21.15.99:6789/0 conn(0x7f0c44071df0 legacy=0x7f0c4406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:15.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.404+0000 7f0c42800640 1 -- 172.21.15.99:0/117272335 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c44072890 con 0x7f0c4406e280 2024-09-10T07:45:15.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.405+0000 7f0c42800640 1 --2- 172.21.15.99:0/117272335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c4406e280 0x7f0c44073370 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0c340097a0 tx=0x7f0c3402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=526e4bf544c1f09e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:15.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.405+0000 7f0c41400640 1 -- 172.21.15.99:0/117272335 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34037070 con 0x7f0c4406e280 2024-09-10T07:45:15.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.405+0000 7f0c41400640 1 -- 172.21.15.99:0/117272335 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c34032440 con 0x7f0c4406e280 2024-09-10T07:45:15.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.405+0000 7f0c41400640 1 -- 172.21.15.99:0/117272335 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34032810 con 0x7f0c4406e280 2024-09-10T07:45:15.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.406+0000 7f0c49400640 1 -- 172.21.15.99:0/117272335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c4406e280 msgr2=0x7f0c44073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:15.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.406+0000 7f0c49400640 1 --2- 172.21.15.99:0/117272335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c4406e280 0x7f0c44073370 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0c340097a0 tx=0x7f0c3402a230 comp rx=0 tx=0).stop 2024-09-10T07:45:15.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.406+0000 7f0c49400640 1 -- 172.21.15.99:0/117272335 shutdown_connections 2024-09-10T07:45:15.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.406+0000 7f0c49400640 1 --2- 172.21.15.99:0/117272335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c4406e280 0x7f0c44073370 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.406+0000 7f0c49400640 1 -- 172.21.15.99:0/117272335 >> 172.21.15.99:0/117272335 conn(0x7f0c4406bc10 msgr2=0x7f0c4406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:15.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.406+0000 7f0c49400640 1 -- 172.21.15.99:0/117272335 shutdown_connections 2024-09-10T07:45:15.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.406+0000 7f0c49400640 1 -- 172.21.15.99:0/117272335 wait complete. 2024-09-10T07:45:15.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.407+0000 7f0c49400640 1 Processor -- start 2024-09-10T07:45:15.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.408+0000 7f0c49400640 1 -- start start 2024-09-10T07:45:15.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.408+0000 7f0c49400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4406e280 0x7f0c44149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.408+0000 7f0c49400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c44071df0 0x7f0c44145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.408+0000 7f0c49400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c440d1010 0x7f0c441487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.408+0000 7f0c49400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4415db60 con 0x7f0c44071df0 2024-09-10T07:45:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.408+0000 7f0c49400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44072e50 con 0x7f0c440d1010 2024-09-10T07:45:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.408+0000 7f0c49400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0c440d14c0 con 0x7f0c4406e280 2024-09-10T07:45:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.409+0000 7f0c41e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c44071df0 0x7f0c44145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.409+0000 7f0c41e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c44071df0 0x7f0c44145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42200/0 (socket says 172.21.15.99:42200) 2024-09-10T07:45:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.409+0000 7f0c41e00640 1 -- 172.21.15.99:0/1490809492 learned_addr learned my addr 172.21.15.99:0/1490809492 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.409+0000 7f0c42800640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4406e280 0x7f0c44149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.409+0000 7f0c43200640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c440d1010 0x7f0c441487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.409+0000 7f0c41e00640 1 -- 172.21.15.99:0/1490809492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4406e280 msgr2=0x7f0c44149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.409+0000 7f0c41e00640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4406e280 0x7f0c44149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.409+0000 7f0c41e00640 1 -- 172.21.15.99:0/1490809492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c440d1010 msgr2=0x7f0c441487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.409+0000 7f0c41e00640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c440d1010 0x7f0c441487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.409+0000 7f0c41e00640 1 -- 172.21.15.99:0/1490809492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c44146800 con 0x7f0c44071df0 2024-09-10T07:45:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.410+0000 7f0c41e00640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c44071df0 0x7f0c44145ec0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c500 tx=0x7f0c3000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.410+0000 7f0c3aa00640 1 -- 172.21.15.99:0/1490809492 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30017070 con 0x7f0c44071df0 2024-09-10T07:45:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.410+0000 7f0c3aa00640 1 -- 172.21.15.99:0/1490809492 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c30005ce0 con 0x7f0c44071df0 2024-09-10T07:45:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.410+0000 7f0c3aa00640 1 -- 172.21.15.99:0/1490809492 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c300072f0 con 0x7f0c44071df0 2024-09-10T07:45:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.410+0000 7f0c49400640 1 -- 172.21.15.99:0/1490809492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c44146ae0 con 0x7f0c44071df0 2024-09-10T07:45:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.410+0000 7f0c49400640 1 -- 172.21.15.99:0/1490809492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c441470a0 con 0x7f0c44071df0 2024-09-10T07:45:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.411+0000 7f0c49400640 1 -- 172.21.15.99:0/1490809492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c44073370 con 0x7f0c44071df0 2024-09-10T07:45:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.412+0000 7f0c3aa00640 1 -- 172.21.15.99:0/1490809492 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c3001a070 con 0x7f0c44071df0 2024-09-10T07:45:15.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.413+0000 7f0c3aa00640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c2406be30 0x7f0c2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:15.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.413+0000 7f0c3aa00640 1 -- 172.21.15.99:0/1490809492 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f0c3008a1f0 con 0x7f0c44071df0 2024-09-10T07:45:15.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.413+0000 7f0c42800640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c2406be30 0x7f0c2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:15.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.414+0000 7f0c42800640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c2406be30 0x7f0c2406e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0c34034000 tx=0x7f0c3402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:15.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.417+0000 7f0c3aa00640 1 -- 172.21.15.99:0/1490809492 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c30058540 con 0x7f0c44071df0 2024-09-10T07:45:15.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:15.626+0000 7f0c49400640 1 -- 172.21.15.99:0/1490809492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0c440cefc0 con 0x7f0c44071df0 2024-09-10T07:45:16.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.509+0000 7f0c3aa00640 1 -- 172.21.15.99:0/1490809492 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v89) ==== 118+0+0 (secure 0 0 0) 0x7f0c3005c840 con 0x7f0c44071df0 2024-09-10T07:45:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 -- 172.21.15.99:0/1490809492 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c2406be30 msgr2=0x7f0c2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c2406be30 0x7f0c2406e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0c34034000 tx=0x7f0c3402e000 comp rx=0 tx=0).stop 2024-09-10T07:45:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 -- 172.21.15.99:0/1490809492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c44071df0 msgr2=0x7f0c44145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c44071df0 0x7f0c44145ec0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c500 tx=0x7f0c3000c9c0 comp rx=0 tx=0).stop 2024-09-10T07:45:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 -- 172.21.15.99:0/1490809492 shutdown_connections 2024-09-10T07:45:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c440d1010 0x7f0c441487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0c2406be30 0x7f0c2406e2f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c44071df0 0x7f0c44145ec0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 --2- 172.21.15.99:0/1490809492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c4406e280 0x7f0c44149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 -- 172.21.15.99:0/1490809492 >> 172.21.15.99:0/1490809492 conn(0x7f0c4406bc10 msgr2=0x7f0c44074f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.512+0000 7f0c49400640 1 -- 172.21.15.99:0/1490809492 shutdown_connections 2024-09-10T07:45:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.513+0000 7f0c49400640 1 -- 172.21.15.99:0/1490809492 wait complete. 2024-09-10T07:45:16.530 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T07:45:16.530 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T07:45:16.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.689+0000 7f838dc00640 1 Processor -- start 2024-09-10T07:45:16.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.690+0000 7f838dc00640 1 -- start start 2024-09-10T07:45:16.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.691+0000 7f838dc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f83880afa90 0x7f838806f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:16.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.691+0000 7f838dc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f83880d0630 0x7f83880d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:16.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.691+0000 7f838dc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83880b4300 con 0x7f838815b760 2024-09-10T07:45:16.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.691+0000 7f838dc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f83880d0fa0 con 0x7f83880d0630 2024-09-10T07:45:16.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.691+0000 7f838dc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f838806d700 con 0x7f83880afa90 2024-09-10T07:45:16.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.691+0000 7f8387400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f83880d0630 0x7f83880d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:16.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.691+0000 7f8387400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f83880d0630 0x7f83880d0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42206/0 (socket says 172.21.15.99:42206) 2024-09-10T07:45:16.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.691+0000 7f8387400640 1 -- 172.21.15.99:0/3131784902 learned_addr learned my addr 172.21.15.99:0/3131784902 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:16.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.691+0000 7f837e000640 1 --2- 172.21.15.99:0/3131784902 >> v2:172.21.15.187:3300/0 conn(0x7f83880afa90 0x7f838806f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:16.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.692+0000 7f8387400640 1 -- 172.21.15.99:0/3131784902 >> v2:172.21.15.187:3300/0 conn(0x7f83880afa90 msgr2=0x7f838806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:16.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.692+0000 7f8387400640 1 --2- 172.21.15.99:0/3131784902 >> v2:172.21.15.187:3300/0 conn(0x7f83880afa90 0x7f838806f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:16.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.692+0000 7f8387400640 1 -- 172.21.15.99:0/3131784902 >> v1:172.21.15.187:6789/0 conn(0x7f838815b760 legacy=0x7f83880b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:16.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.692+0000 7f8387400640 1 -- 172.21.15.99:0/3131784902 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838806d9e0 con 0x7f83880d0630 2024-09-10T07:45:16.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.693+0000 7f8387400640 1 --2- 172.21.15.99:0/3131784902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880d0630 0x7f83880d0a60 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f83880d1500 tx=0x7f838002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ab3207a818f468 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:16.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.693+0000 7f8386000640 1 -- 172.21.15.99:0/3131784902 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380036070 con 0x7f83880d0630 2024-09-10T07:45:16.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.693+0000 7f8386000640 1 -- 172.21.15.99:0/3131784902 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8380031600 con 0x7f83880d0630 2024-09-10T07:45:16.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.693+0000 7f8386000640 1 -- 172.21.15.99:0/3131784902 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83800319d0 con 0x7f83880d0630 2024-09-10T07:45:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.693+0000 7f838dc00640 1 -- 172.21.15.99:0/3131784902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880d0630 msgr2=0x7f83880d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.693+0000 7f838dc00640 1 --2- 172.21.15.99:0/3131784902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880d0630 0x7f83880d0a60 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f83880d1500 tx=0x7f838002a610 comp rx=0 tx=0).stop 2024-09-10T07:45:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.693+0000 7f838dc00640 1 -- 172.21.15.99:0/3131784902 shutdown_connections 2024-09-10T07:45:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.693+0000 7f838dc00640 1 --2- 172.21.15.99:0/3131784902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880d0630 0x7f83880d0a60 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:16.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.693+0000 7f838dc00640 1 --2- 172.21.15.99:0/3131784902 >> v2:172.21.15.187:3300/0 conn(0x7f83880afa90 0x7f838806f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.693+0000 7f838dc00640 1 -- 172.21.15.99:0/3131784902 >> 172.21.15.99:0/3131784902 conn(0x7f838806bc10 msgr2=0x7f838806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.694+0000 7f838dc00640 1 -- 172.21.15.99:0/3131784902 shutdown_connections 2024-09-10T07:45:16.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.694+0000 7f838dc00640 1 -- 172.21.15.99:0/3131784902 wait complete. 2024-09-10T07:45:16.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.695+0000 7f838dc00640 1 Processor -- start 2024-09-10T07:45:16.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.695+0000 7f838dc00640 1 -- start start 2024-09-10T07:45:16.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.696+0000 7f838dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880afa90 0x7f838815a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:16.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.696+0000 7f838dc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83880d0630 0x7f838815aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:16.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.696+0000 7f838dc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f838815b760 0x7f838815d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:16.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.696+0000 7f838dc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f838815bb40 con 0x7f83880afa90 2024-09-10T07:45:16.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.696+0000 7f838dc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f838806f7d0 con 0x7f838815b760 2024-09-10T07:45:16.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.696+0000 7f838dc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f838815bcc0 con 0x7f83880d0630 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f8386a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880afa90 0x7f838815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f8386a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880afa90 0x7f838815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42216/0 (socket says 172.21.15.99:42216) 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f8386a00640 1 -- 172.21.15.99:0/893723763 learned_addr learned my addr 172.21.15.99:0/893723763 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f8387400640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f838815b760 0x7f838815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f837e000640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83880d0630 0x7f838815aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f8386a00640 1 -- 172.21.15.99:0/893723763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83880d0630 msgr2=0x7f838815aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f8386a00640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83880d0630 0x7f838815aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f8386a00640 1 -- 172.21.15.99:0/893723763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f838815b760 msgr2=0x7f838815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f8386a00640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f838815b760 0x7f838815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f8386a00640 1 -- 172.21.15.99:0/893723763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838815c090 con 0x7f83880afa90 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f837e000640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83880d0630 0x7f838815aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.697+0000 7f8386a00640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880afa90 0x7f838815a540 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f837800c3c0 tx=0x7f837800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.698+0000 7f837f400640 1 -- 172.21.15.99:0/893723763 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780052d0 con 0x7f83880afa90 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.698+0000 7f837f400640 1 -- 172.21.15.99:0/893723763 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8378005490 con 0x7f83880afa90 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.698+0000 7f837f400640 1 -- 172.21.15.99:0/893723763 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378007260 con 0x7f83880afa90 2024-09-10T07:45:16.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.698+0000 7f838dc00640 1 -- 172.21.15.99:0/893723763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838815c370 con 0x7f83880afa90 2024-09-10T07:45:16.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.698+0000 7f838dc00640 1 -- 172.21.15.99:0/893723763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838815c930 con 0x7f83880afa90 2024-09-10T07:45:16.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.699+0000 7f838dc00640 1 -- 172.21.15.99:0/893723763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838806dcc0 con 0x7f83880afa90 2024-09-10T07:45:16.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.700+0000 7f837f400640 1 -- 172.21.15.99:0/893723763 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8378007400 con 0x7f83880afa90 2024-09-10T07:45:16.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.701+0000 7f837f400640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f836406be30 0x7f836406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:16.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.701+0000 7f837f400640 1 -- 172.21.15.99:0/893723763 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f837808a3b0 con 0x7f83880afa90 2024-09-10T07:45:16.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.701+0000 7f837e000640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f836406be30 0x7f836406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:16.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.701+0000 7f837e000640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f836406be30 0x7f836406e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f83881f7f70 tx=0x7f837000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:16.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.705+0000 7f837f400640 1 -- 172.21.15.99:0/893723763 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8378058cc0 con 0x7f83880afa90 2024-09-10T07:45:16.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:16.911+0000 7f838dc00640 1 -- 172.21.15.99:0/893723763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f83880b1610 con 0x7f83880afa90 2024-09-10T07:45:17.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.519+0000 7f837f400640 1 -- 172.21.15.99:0/893723763 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v90) ==== 122+0+0 (secure 0 0 0) 0x7f83780585c0 con 0x7f83880afa90 2024-09-10T07:45:17.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 -- 172.21.15.99:0/893723763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f836406be30 msgr2=0x7f836406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f836406be30 0x7f836406e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f83881f7f70 tx=0x7f837000d040 comp rx=0 tx=0).stop 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 -- 172.21.15.99:0/893723763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880afa90 msgr2=0x7f838815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880afa90 0x7f838815a540 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f837800c3c0 tx=0x7f837800c880 comp rx=0 tx=0).stop 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 -- 172.21.15.99:0/893723763 shutdown_connections 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f838815b760 0x7f838815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83880d0630 0x7f838815aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f836406be30 0x7f836406e2f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 --2- 172.21.15.99:0/893723763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83880afa90 0x7f838815a540 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 -- 172.21.15.99:0/893723763 >> 172.21.15.99:0/893723763 conn(0x7f838806bc10 msgr2=0x7f8388074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 -- 172.21.15.99:0/893723763 shutdown_connections 2024-09-10T07:45:17.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.522+0000 7f838dc00640 1 -- 172.21.15.99:0/893723763 wait complete. 2024-09-10T07:45:17.540 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T07:45:17.540 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:17.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.698+0000 7f031fc00640 1 Processor -- start 2024-09-10T07:45:17.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.698+0000 7f031fc00640 1 -- start start 2024-09-10T07:45:17.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.699+0000 7f031fc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f031813fae0 0x7f031806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:17.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f031fc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0318142650 con 0x7f0318160c50 2024-09-10T07:45:17.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f031fc00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0318142930 con 0x7f0318142150 2024-09-10T07:45:17.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f031fc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f03180ce780 con 0x7f031813fae0 2024-09-10T07:45:17.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f031dc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0318160c50 0x7f03180cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54144/0 (socket says 172.21.15.99:54144) 2024-09-10T07:45:17.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f031dc00640 1 -- 172.21.15.99:0/3332679676 learned_addr learned my addr 172.21.15.99:0/3332679676 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:17.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f031d200640 1 --2- 172.21.15.99:0/3332679676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f031813fae0 0x7f031806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:17.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f0317e00640 1 -- 172.21.15.99:0/3332679676 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496027005 0 0) 0x7f0318142650 con 0x7f0318160c50 2024-09-10T07:45:17.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f0317e00640 1 -- 172.21.15.99:0/3332679676 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02fc003520 con 0x7f0318160c50 2024-09-10T07:45:17.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f0317e00640 1 -- 172.21.15.99:0/3332679676 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1957573833 0 0) 0x7f0318142930 con 0x7f0318142150 2024-09-10T07:45:17.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f0317e00640 1 -- 172.21.15.99:0/3332679676 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0318142650 con 0x7f0318142150 2024-09-10T07:45:17.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f031d200640 1 -- 172.21.15.99:0/3332679676 >> v1:172.21.15.187:6789/0 conn(0x7f0318142150 legacy=0x7f0318160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:17.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f031d200640 1 -- 172.21.15.99:0/3332679676 >> v1:172.21.15.99:6789/0 conn(0x7f0318160c50 legacy=0x7f03180cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:17.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.700+0000 7f031d200640 1 -- 172.21.15.99:0/3332679676 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0318142c10 con 0x7f031813fae0 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.702+0000 7f031d200640 1 --2- 172.21.15.99:0/3332679676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f031813fae0 0x7f031806f1b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f03080097d0 tx=0x7f030802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=194e0a4ebfd5c372 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.702+0000 7f0317e00640 1 -- 172.21.15.99:0/3332679676 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308037070 con 0x7f031813fae0 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.702+0000 7f0317e00640 1 -- 172.21.15.99:0/3332679676 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0308032440 con 0x7f031813fae0 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.702+0000 7f0317e00640 1 -- 172.21.15.99:0/3332679676 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308032810 con 0x7f031813fae0 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.703+0000 7f031fc00640 1 -- 172.21.15.99:0/3332679676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f031813fae0 msgr2=0x7f031806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.703+0000 7f031fc00640 1 --2- 172.21.15.99:0/3332679676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f031813fae0 0x7f031806f1b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f03080097d0 tx=0x7f030802a180 comp rx=0 tx=0).stop 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.703+0000 7f031fc00640 1 -- 172.21.15.99:0/3332679676 shutdown_connections 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.703+0000 7f031fc00640 1 --2- 172.21.15.99:0/3332679676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f031813fae0 0x7f031806f1b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.703+0000 7f031fc00640 1 -- 172.21.15.99:0/3332679676 >> 172.21.15.99:0/3332679676 conn(0x7f031806bc10 msgr2=0x7f031806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.703+0000 7f031fc00640 1 -- 172.21.15.99:0/3332679676 shutdown_connections 2024-09-10T07:45:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.703+0000 7f031fc00640 1 -- 172.21.15.99:0/3332679676 wait complete. 2024-09-10T07:45:17.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.705+0000 7f031fc00640 1 Processor -- start 2024-09-10T07:45:17.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.705+0000 7f031fc00640 1 -- start start 2024-09-10T07:45:17.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.705+0000 7f031fc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f031813fae0 0x7f03181392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:17.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f031fc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0318142150 0x7f0318144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:17.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f031fc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0318160c50 0x7f0318145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:17.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f031fc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f031806f870 con 0x7f0318142150 2024-09-10T07:45:17.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f031fc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f031806f6f0 con 0x7f031813fae0 2024-09-10T07:45:17.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f031fc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f03180cf320 con 0x7f0318160c50 2024-09-10T07:45:17.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f030fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0318142150 0x7f0318144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:17.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f031d200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f031813fae0 0x7f03181392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f030fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0318142150 0x7f0318144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42224/0 (socket says 172.21.15.99:42224) 2024-09-10T07:45:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f030fe00640 1 -- 172.21.15.99:0/48831879 learned_addr learned my addr 172.21.15.99:0/48831879 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f031dc00640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0318160c50 0x7f0318145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f030fe00640 1 -- 172.21.15.99:0/48831879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0318160c50 msgr2=0x7f0318145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f030fe00640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0318160c50 0x7f0318145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f030fe00640 1 -- 172.21.15.99:0/48831879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f031813fae0 msgr2=0x7f03181392f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f030fe00640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f031813fae0 0x7f03181392f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.706+0000 7f030fe00640 1 -- 172.21.15.99:0/48831879 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031813ea30 con 0x7f0318142150 2024-09-10T07:45:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.707+0000 7f030fe00640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0318142150 0x7f0318144d30 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f030000c3e0 tx=0x7f030000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:17.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.707+0000 7f0315600640 1 -- 172.21.15.99:0/48831879 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300017070 con 0x7f0318142150 2024-09-10T07:45:17.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.707+0000 7f0315600640 1 -- 172.21.15.99:0/48831879 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03000052d0 con 0x7f0318142150 2024-09-10T07:45:17.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.707+0000 7f0315600640 1 -- 172.21.15.99:0/48831879 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300003830 con 0x7f0318142150 2024-09-10T07:45:17.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.707+0000 7f031fc00640 1 -- 172.21.15.99:0/48831879 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03181e69b0 con 0x7f0318142150 2024-09-10T07:45:17.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.707+0000 7f031fc00640 1 -- 172.21.15.99:0/48831879 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03181e6f70 con 0x7f0318142150 2024-09-10T07:45:17.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.708+0000 7f031fc00640 1 -- 172.21.15.99:0/48831879 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03181e7170 con 0x7f0318142150 2024-09-10T07:45:17.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.709+0000 7f0315600640 1 -- 172.21.15.99:0/48831879 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f030001a070 con 0x7f0318142150 2024-09-10T07:45:17.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.710+0000 7f0315600640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02f406be30 0x7f02f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:17.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.710+0000 7f0315600640 1 -- 172.21.15.99:0/48831879 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f030008a210 con 0x7f0318142150 2024-09-10T07:45:17.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.710+0000 7f031d200640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02f406be30 0x7f02f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:17.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.711+0000 7f031d200640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02f406be30 0x7f02f406e2f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0308034000 tx=0x7f030802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:17.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.715+0000 7f0315600640 1 -- 172.21.15.99:0/48831879 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03181e7170 con 0x7f0318142150 2024-09-10T07:45:17.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.924+0000 7f031fc00640 1 -- 172.21.15.99:0/48831879 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f031806f1b0 con 0x7f0318142150 2024-09-10T07:45:17.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.925+0000 7f0315600640 1 -- 172.21.15.99:0/48831879 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7f03000584d0 con 0x7f0318142150 2024-09-10T07:45:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:17.925 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":90,"btime":"2024-09-10T07:45:17:511094+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4239870292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4239870292},{"type":"v1","addr":"172.21.15.99:6836","nonce":4239870292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2428750075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2428750075},{"type":"v1","addr":"172.21.15.187:6835","nonce":2428750075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1219809784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1219809784},{"type":"v1","addr":"172.21.15.187:6834","nonce":1219809784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:45:13.894905+0000","modified":"2024-09-10T07:45:16.912907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7276":{"gid":7276,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/256766417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":256766417},{"type":"v1","addr":"172.21.15.99:6837","nonce":256766417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7276,"qdb_cluster":[7276]},"id":11}]} 2024-09-10T07:45:17.925 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 90 2024-09-10T07:45:17.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.927+0000 7f031fc00640 1 -- 172.21.15.99:0/48831879 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02f406be30 msgr2=0x7f02f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:17.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.927+0000 7f031fc00640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02f406be30 0x7f02f406e2f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0308034000 tx=0x7f030802e000 comp rx=0 tx=0).stop 2024-09-10T07:45:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.927+0000 7f031fc00640 1 -- 172.21.15.99:0/48831879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0318142150 msgr2=0x7f0318144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.927+0000 7f031fc00640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0318142150 0x7f0318144d30 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f030000c3e0 tx=0x7f030000c8a0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.927+0000 7f031fc00640 1 -- 172.21.15.99:0/48831879 shutdown_connections 2024-09-10T07:45:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.927+0000 7f031fc00640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0318160c50 0x7f0318145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.927+0000 7f031fc00640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f02f406be30 0x7f02f406e2f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.927+0000 7f031fc00640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0318142150 0x7f0318144d30 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.927+0000 7f031fc00640 1 --2- 172.21.15.99:0/48831879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f031813fae0 0x7f03181392f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.928+0000 7f031fc00640 1 -- 172.21.15.99:0/48831879 >> 172.21.15.99:0/48831879 conn(0x7f031806bc10 msgr2=0x7f031806d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.928+0000 7f031fc00640 1 -- 172.21.15.99:0/48831879 shutdown_connections 2024-09-10T07:45:17.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:17.928+0000 7f031fc00640 1 -- 172.21.15.99:0/48831879 wait complete. 2024-09-10T07:45:17.944 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:45:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.096+0000 7fda90c00640 1 Processor -- start 2024-09-10T07:45:18.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.096+0000 7fda90c00640 1 -- start start 2024-09-10T07:45:18.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.097+0000 7fda90c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 0x7fda8c0d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.097+0000 7fda90c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fda8c0d57a0 0x7fda8c0d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.097+0000 7fda90c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fda8c0d1990 0x7fda8c0cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.097+0000 7fda90c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fda8c0d3b20 con 0x7fda8c0d57a0 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.097+0000 7fda90c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fda8c0b42f0 con 0x7fda8c0d1990 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.097+0000 7fda90c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fda8c0b45d0 con 0x7fda8c15ecc0 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.097+0000 7fda89400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fda8c0d57a0 0x7fda8c0d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.097+0000 7fda89400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fda8c0d57a0 0x7fda8c0d1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42226/0 (socket says 172.21.15.99:42226) 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.097+0000 7fda89400640 1 -- 172.21.15.99:0/3059109008 learned_addr learned my addr 172.21.15.99:0/3059109008 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.098+0000 7fda8a800640 1 --2- 172.21.15.99:0/3059109008 >> v2:172.21.15.187:3300/0 conn(0x7fda8c0d1990 0x7fda8c0cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.098+0000 7fda89e00640 1 --2- 172.21.15.99:0/3059109008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 0x7fda8c0d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.098+0000 7fda89400640 1 -- 172.21.15.99:0/3059109008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 msgr2=0x7fda8c0d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.098+0000 7fda89400640 1 --2- 172.21.15.99:0/3059109008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 0x7fda8c0d3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.098+0000 7fda89400640 1 -- 172.21.15.99:0/3059109008 >> v2:172.21.15.187:3300/0 conn(0x7fda8c0d1990 msgr2=0x7fda8c0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.098+0000 7fda89400640 1 --2- 172.21.15.99:0/3059109008 >> v2:172.21.15.187:3300/0 conn(0x7fda8c0d1990 0x7fda8c0cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.098+0000 7fda89400640 1 -- 172.21.15.99:0/3059109008 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8c0b48b0 con 0x7fda8c0d57a0 2024-09-10T07:45:18.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.099+0000 7fda89400640 1 --2- 172.21.15.99:0/3059109008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 0x7fda8c0d1450 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fda8c08e830 tx=0x7fda7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66eb6080b26d5875 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:18.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.099+0000 7fda88a00640 1 -- 172.21.15.99:0/3059109008 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78037070 con 0x7fda8c0d57a0 2024-09-10T07:45:18.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.099+0000 7fda88a00640 1 -- 172.21.15.99:0/3059109008 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda78032440 con 0x7fda8c0d57a0 2024-09-10T07:45:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.099+0000 7fda88a00640 1 -- 172.21.15.99:0/3059109008 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78032810 con 0x7fda8c0d57a0 2024-09-10T07:45:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.100+0000 7fda90c00640 1 -- 172.21.15.99:0/3059109008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 msgr2=0x7fda8c0d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.100+0000 7fda90c00640 1 --2- 172.21.15.99:0/3059109008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 0x7fda8c0d1450 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fda8c08e830 tx=0x7fda7802a1e0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.100+0000 7fda90c00640 1 -- 172.21.15.99:0/3059109008 shutdown_connections 2024-09-10T07:45:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.100+0000 7fda90c00640 1 --2- 172.21.15.99:0/3059109008 >> v2:172.21.15.187:3300/0 conn(0x7fda8c0d1990 0x7fda8c0cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.100+0000 7fda90c00640 1 --2- 172.21.15.99:0/3059109008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 0x7fda8c0d1450 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.100+0000 7fda90c00640 1 --2- 172.21.15.99:0/3059109008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 0x7fda8c0d3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.100+0000 7fda90c00640 1 -- 172.21.15.99:0/3059109008 >> 172.21.15.99:0/3059109008 conn(0x7fda8c0d4bd0 msgr2=0x7fda8c0d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.100+0000 7fda90c00640 1 -- 172.21.15.99:0/3059109008 shutdown_connections 2024-09-10T07:45:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.100+0000 7fda90c00640 1 -- 172.21.15.99:0/3059109008 wait complete. 2024-09-10T07:45:18.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.101+0000 7fda90c00640 1 Processor -- start 2024-09-10T07:45:18.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.101+0000 7fda90c00640 1 -- start start 2024-09-10T07:45:18.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.102+0000 7fda90c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda8c0d1990 0x7fda8c0b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.102+0000 7fda90c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 0x7fda8c1f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.102+0000 7fda90c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 0x7fda8c0ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.102+0000 7fda90c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fda8c15f220 con 0x7fda8c0d57a0 2024-09-10T07:45:18.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.102+0000 7fda90c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fda8c15f0a0 con 0x7fda8c0d1990 2024-09-10T07:45:18.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.102+0000 7fda90c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fda8c0d36b0 con 0x7fda8c15ecc0 2024-09-10T07:45:18.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda89400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 0x7fda8c1f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda89400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 0x7fda8c1f4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42228/0 (socket says 172.21.15.99:42228) 2024-09-10T07:45:18.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda89400640 1 -- 172.21.15.99:0/1137915776 learned_addr learned my addr 172.21.15.99:0/1137915776 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda89e00640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda8c0d1990 0x7fda8c0b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda8a800640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 0x7fda8c0ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda89400640 1 -- 172.21.15.99:0/1137915776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 msgr2=0x7fda8c0ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda89400640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 0x7fda8c0ba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda89400640 1 -- 172.21.15.99:0/1137915776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda8c0d1990 msgr2=0x7fda8c0b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda89400640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda8c0d1990 0x7fda8c0b7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda89400640 1 -- 172.21.15.99:0/1137915776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8c1e9280 con 0x7fda8c0d57a0 2024-09-10T07:45:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda8a800640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 0x7fda8c0ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.103+0000 7fda89400640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 0x7fda8c1f4ee0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fda7802a220 tx=0x7fda780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.104+0000 7fda82000640 1 -- 172.21.15.99:0/1137915776 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78041020 con 0x7fda8c0d57a0 2024-09-10T07:45:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.104+0000 7fda82000640 1 -- 172.21.15.99:0/1137915776 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda780306c0 con 0x7fda8c0d57a0 2024-09-10T07:45:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.104+0000 7fda82000640 1 -- 172.21.15.99:0/1137915776 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78037040 con 0x7fda8c0d57a0 2024-09-10T07:45:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.104+0000 7fda90c00640 1 -- 172.21.15.99:0/1137915776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8c1e9560 con 0x7fda8c0d57a0 2024-09-10T07:45:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.104+0000 7fda90c00640 1 -- 172.21.15.99:0/1137915776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda8c1f5420 con 0x7fda8c0d57a0 2024-09-10T07:45:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.105+0000 7fda90c00640 1 -- 172.21.15.99:0/1137915776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda8c0d1450 con 0x7fda8c0d57a0 2024-09-10T07:45:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.106+0000 7fda82000640 1 -- 172.21.15.99:0/1137915776 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda78044020 con 0x7fda8c0d57a0 2024-09-10T07:45:18.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.107+0000 7fda82000640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda6c06be30 0x7fda6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.107+0000 7fda82000640 1 -- 172.21.15.99:0/1137915776 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fda780ab740 con 0x7fda8c0d57a0 2024-09-10T07:45:18.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.107+0000 7fda89e00640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda6c06be30 0x7fda6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.107+0000 7fda89e00640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda6c06be30 0x7fda6c06e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fda7c006fd0 tx=0x7fda7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:18.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.111+0000 7fda82000640 1 -- 172.21.15.99:0/1137915776 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda7804b030 con 0x7fda8c0d57a0 2024-09-10T07:45:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.284+0000 7fda90c00640 1 -- 172.21.15.99:0/1137915776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda8c0a2b10 con 0x7fda8c0d57a0 2024-09-10T07:45:18.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.285+0000 7fda82000640 1 -- 172.21.15.99:0/1137915776 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+16708 (secure 0 0 0) 0x7fda7807a050 con 0x7fda8c0d57a0 2024-09-10T07:45:18.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:18.285 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":188,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:45:15.480122+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:45:11.664665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-10T07:45:12.889786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:45:18.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 -- 172.21.15.99:0/1137915776 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda6c06be30 msgr2=0x7fda6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda6c06be30 0x7fda6c06e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fda7c006fd0 tx=0x7fda7c008040 comp rx=0 tx=0).stop 2024-09-10T07:45:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 -- 172.21.15.99:0/1137915776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 msgr2=0x7fda8c1f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 0x7fda8c1f4ee0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fda7802a220 tx=0x7fda780046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 -- 172.21.15.99:0/1137915776 shutdown_connections 2024-09-10T07:45:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda8c15ecc0 0x7fda8c0ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fda6c06be30 0x7fda6c06e2f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda8c0d57a0 0x7fda8c1f4ee0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 --2- 172.21.15.99:0/1137915776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda8c0d1990 0x7fda8c0b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 -- 172.21.15.99:0/1137915776 >> 172.21.15.99:0/1137915776 conn(0x7fda8c0d4bd0 msgr2=0x7fda8c0b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 -- 172.21.15.99:0/1137915776 shutdown_connections 2024-09-10T07:45:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.288+0000 7fda90c00640 1 -- 172.21.15.99:0/1137915776 wait complete. 2024-09-10T07:45:18.303 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:45:18.303 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:45:18.356 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:45:18.360 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:45:18.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.460+0000 7f0b27200640 1 Processor -- start 2024-09-10T07:45:18.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.460+0000 7f0b27200640 1 -- start start 2024-09-10T07:45:18.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.461+0000 7f0b27200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2815e970 0x7f0b280d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.461+0000 7f0b27200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b280d2680 0x7f0b280cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.461+0000 7f0b27200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b280d2bd0 con 0x7f0b280cfac0 2024-09-10T07:45:18.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.461+0000 7f0b27200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f0b280d37e0 con 0x7f0b280d2680 2024-09-10T07:45:18.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.461+0000 7f0b27200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0b280d2eb0 con 0x7f0b2815e970 2024-09-10T07:45:18.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.462+0000 7f0b25400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b280d2680 0x7f0b280cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.462+0000 7f0b26800640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f0b280cfac0 0x7f0b280d0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.99:33846/0 (socket says 172.21.15.99:33846) 2024-09-10T07:45:18.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.462+0000 7f0b26800640 1 -- 172.21.15.99:0/2947734298 learned_addr learned my addr 172.21.15.99:0/2947734298 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:18.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.462+0000 7f0b25e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2815e970 0x7f0b280d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.462+0000 7f0b25e00640 1 -- 172.21.15.99:0/2947734298 >> v2:172.21.15.187:3300/0 conn(0x7f0b280d2680 msgr2=0x7f0b280cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:18.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.462+0000 7f0b25e00640 1 --2- 172.21.15.99:0/2947734298 >> v2:172.21.15.187:3300/0 conn(0x7f0b280d2680 0x7f0b280cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.462+0000 7f0b25e00640 1 -- 172.21.15.99:0/2947734298 >> v1:172.21.15.187:6789/0 conn(0x7f0b280cfac0 legacy=0x7f0b280d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.462+0000 7f0b25e00640 1 -- 172.21.15.99:0/2947734298 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b280d3190 con 0x7f0b2815e970 2024-09-10T07:45:18.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.462+0000 7f0b25400640 1 --2- 172.21.15.99:0/2947734298 >> v2:172.21.15.187:3300/0 conn(0x7f0b280d2680 0x7f0b280cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:18.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.462+0000 7f0b24a00640 1 -- 172.21.15.99:0/2947734298 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225137614 0 0) 0x7f0b280d2bd0 con 0x7f0b280cfac0 2024-09-10T07:45:18.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.463+0000 7f0b25e00640 1 --2- 172.21.15.99:0/2947734298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2815e970 0x7f0b280d0300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b180097a0 tx=0x7f0b1802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4bb3aba0d2ff4ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:18.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.463+0000 7f0b24a00640 1 -- 172.21.15.99:0/2947734298 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18037070 con 0x7f0b2815e970 2024-09-10T07:45:18.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.463+0000 7f0b24a00640 1 -- 172.21.15.99:0/2947734298 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b18032440 con 0x7f0b2815e970 2024-09-10T07:45:18.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.464+0000 7f0b24a00640 1 -- 172.21.15.99:0/2947734298 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18032810 con 0x7f0b2815e970 2024-09-10T07:45:18.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.464+0000 7f0b27200640 1 -- 172.21.15.99:0/2947734298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2815e970 msgr2=0x7f0b280d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.464+0000 7f0b27200640 1 --2- 172.21.15.99:0/2947734298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2815e970 0x7f0b280d0300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b180097a0 tx=0x7f0b1802a210 comp rx=0 tx=0).stop 2024-09-10T07:45:18.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.464+0000 7f0b27200640 1 -- 172.21.15.99:0/2947734298 shutdown_connections 2024-09-10T07:45:18.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.464+0000 7f0b27200640 1 --2- 172.21.15.99:0/2947734298 >> v2:172.21.15.187:3300/0 conn(0x7f0b280d2680 0x7f0b280cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.464+0000 7f0b27200640 1 --2- 172.21.15.99:0/2947734298 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b2815e970 0x7f0b280d0300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.464+0000 7f0b27200640 1 -- 172.21.15.99:0/2947734298 >> 172.21.15.99:0/2947734298 conn(0x7f0b2809de00 msgr2=0x7f0b280d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:18.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.464+0000 7f0b27200640 1 -- 172.21.15.99:0/2947734298 shutdown_connections 2024-09-10T07:45:18.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.464+0000 7f0b27200640 1 -- 172.21.15.99:0/2947734298 wait complete. 2024-09-10T07:45:18.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.466+0000 7f0b27200640 1 Processor -- start 2024-09-10T07:45:18.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.466+0000 7f0b27200640 1 -- start start 2024-09-10T07:45:18.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b27200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b280cfac0 0x7f0b280cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b27200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b280d2680 0x7f0b2815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b27200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2815e970 0x7f0b280b9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b27200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b280d0840 con 0x7f0b280cfac0 2024-09-10T07:45:18.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b27200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0b280cff70 con 0x7f0b2815e970 2024-09-10T07:45:18.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b27200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2815ed50 con 0x7f0b280d2680 2024-09-10T07:45:18.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b25e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b280cfac0 0x7f0b280cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b25e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b280cfac0 0x7f0b280cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42240/0 (socket says 172.21.15.99:42240) 2024-09-10T07:45:18.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b25e00640 1 -- 172.21.15.99:0/1018829481 learned_addr learned my addr 172.21.15.99:0/1018829481 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:18.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b26800640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2815e970 0x7f0b280b9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b25400640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b280d2680 0x7f0b2815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b25e00640 1 -- 172.21.15.99:0/1018829481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b280d2680 msgr2=0x7f0b2815bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b25e00640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b280d2680 0x7f0b2815bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b25e00640 1 -- 172.21.15.99:0/1018829481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2815e970 msgr2=0x7f0b280b9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b25e00640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2815e970 0x7f0b280b9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b25e00640 1 -- 172.21.15.99:0/1018829481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2815c090 con 0x7f0b280cfac0 2024-09-10T07:45:18.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b25400640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b280d2680 0x7f0b2815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:18.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.467+0000 7f0b26800640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2815e970 0x7f0b280b9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:18.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.468+0000 7f0b25e00640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b280cfac0 0x7f0b280cbb80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f0b180098c0 tx=0x7f0b180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:18.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.468+0000 7f0b1e000640 1 -- 172.21.15.99:0/1018829481 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18037040 con 0x7f0b280cfac0 2024-09-10T07:45:18.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.468+0000 7f0b1e000640 1 -- 172.21.15.99:0/1018829481 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b18042070 con 0x7f0b280cfac0 2024-09-10T07:45:18.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.468+0000 7f0b27200640 1 -- 172.21.15.99:0/1018829481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b280ccab0 con 0x7f0b280cfac0 2024-09-10T07:45:18.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.468+0000 7f0b1e000640 1 -- 172.21.15.99:0/1018829481 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18030920 con 0x7f0b280cfac0 2024-09-10T07:45:18.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.468+0000 7f0b27200640 1 -- 172.21.15.99:0/1018829481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b280cc4f0 con 0x7f0b280cfac0 2024-09-10T07:45:18.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.469+0000 7f0b27200640 1 -- 172.21.15.99:0/1018829481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b280b5a10 con 0x7f0b280cfac0 2024-09-10T07:45:18.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.470+0000 7f0b1e000640 1 -- 172.21.15.99:0/1018829481 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b18030ac0 con 0x7f0b280cfac0 2024-09-10T07:45:18.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.471+0000 7f0b1e000640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0806be60 0x7f0b0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.471+0000 7f0b1e000640 1 -- 172.21.15.99:0/1018829481 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f0b180ab840 con 0x7f0b280cfac0 2024-09-10T07:45:18.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.471+0000 7f0b25400640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0806be60 0x7f0b0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.472+0000 7f0b25400640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0806be60 0x7f0b0806e320 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0b280ba950 tx=0x7f0b14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:18.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.475+0000 7f0b1e000640 1 -- 172.21.15.99:0/1018829481 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b280b5a10 con 0x7f0b280cfac0 2024-09-10T07:45:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.647+0000 7f0b27200640 1 -- 172.21.15.99:0/1018829481 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b280cf580 con 0x7f0b0806be60 2024-09-10T07:45:18.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.654+0000 7f0b1e000640 1 -- 172.21.15.99:0/1018829481 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242643 (secure 0 0 0) 0x7f0b280cf580 con 0x7f0b0806be60 2024-09-10T07:45:18.656 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:18.712 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.657+0000 7f0b27200640 1 -- 172.21.15.99:0/1018829481 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0806be60 msgr2=0x7f0b0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.657+0000 7f0b27200640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0806be60 0x7f0b0806e320 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0b280ba950 tx=0x7f0b14008040 comp rx=0 tx=0).stop 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.657+0000 7f0b27200640 1 -- 172.21.15.99:0/1018829481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b280cfac0 msgr2=0x7f0b280cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.657+0000 7f0b27200640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b280cfac0 0x7f0b280cbb80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f0b180098c0 tx=0x7f0b180046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.657+0000 7f0b27200640 1 -- 172.21.15.99:0/1018829481 shutdown_connections 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.657+0000 7f0b27200640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b2815e970 0x7f0b280b9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.657+0000 7f0b27200640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b280d2680 0x7f0b2815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.657+0000 7f0b27200640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f0b0806be60 0x7f0b0806e320 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.657+0000 7f0b27200640 1 --2- 172.21.15.99:0/1018829481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b280cfac0 0x7f0b280cbb80 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.657+0000 7f0b27200640 1 -- 172.21.15.99:0/1018829481 >> 172.21.15.99:0/1018829481 conn(0x7f0b2809de00 msgr2=0x7f0b280d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.658+0000 7f0b27200640 1 -- 172.21.15.99:0/1018829481 shutdown_connections 2024-09-10T07:45:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.658+0000 7f0b27200640 1 -- 172.21.15.99:0/1018829481 wait complete. 2024-09-10T07:45:18.716 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":514,"stamp":"2024-09-10T07:45:16.840796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9300,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553199,"statfs":{"total":1600000000,"available":1590476311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.370325"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.482040+0000","last_change":"2024-09-10T07:45:13.482040+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.482040+0000","last_undegraded":"2024-09-10T07:45:13.482040+0000","last_fullsized":"2024-09-10T07:45:13.482040+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485434+0000","last_change":"2024-09-10T07:45:13.485434+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485434+0000","last_undegraded":"2024-09-10T07:45:13.485434+0000","last_fullsized":"2024-09-10T07:45:13.485434+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.483298+0000","last_change":"2024-09-10T07:45:13.483298+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.483298+0000","last_undegraded":"2024-09-10T07:45:13.483298+0000","last_fullsized":"2024-09-10T07:45:13.483298+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.482763+0000","last_change":"2024-09-10T07:45:13.482763+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.482763+0000","last_undegraded":"2024-09-10T07:45:13.482763+0000","last_fullsized":"2024-09-10T07:45:13.482763+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485975+0000","last_change":"2024-09-10T07:45:13.485975+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485975+0000","last_undegraded":"2024-09-10T07:45:13.485975+0000","last_fullsized":"2024-09-10T07:45:13.485975+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.491033+0000","last_change":"2024-09-10T07:45:13.491033+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.491033+0000","last_undegraded":"2024-09-10T07:45:13.491033+0000","last_fullsized":"2024-09-10T07:45:13.491033+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485596+0000","last_change":"2024-09-10T07:45:13.485596+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485596+0000","last_undegraded":"2024-09-10T07:45:13.485596+0000","last_fullsized":"2024-09-10T07:45:13.485596+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.486503+0000","last_change":"2024-09-10T07:45:13.486503+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.486503+0000","last_undegraded":"2024-09-10T07:45:13.486503+0000","last_fullsized":"2024-09-10T07:45:13.486503+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.484410+0000","last_change":"2024-09-10T07:45:13.484410+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.484410+0000","last_undegraded":"2024-09-10T07:45:13.484410+0000","last_fullsized":"2024-09-10T07:45:13.484410+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.484550+0000","last_change":"2024-09-10T07:45:13.484550+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.484550+0000","last_undegraded":"2024-09-10T07:45:13.484550+0000","last_fullsized":"2024-09-10T07:45:13.484550+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485351+0000","last_change":"2024-09-10T07:45:13.485351+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485351+0000","last_undegraded":"2024-09-10T07:45:13.485351+0000","last_fullsized":"2024-09-10T07:45:13.485351+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485066+0000","last_change":"2024-09-10T07:45:13.485066+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485066+0000","last_undegraded":"2024-09-10T07:45:13.485066+0000","last_fullsized":"2024-09-10T07:45:13.485066+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.482744+0000","last_change":"2024-09-10T07:45:13.482744+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.482744+0000","last_undegraded":"2024-09-10T07:45:13.482744+0000","last_fullsized":"2024-09-10T07:45:13.482744+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.481987+0000","last_change":"2024-09-10T07:45:13.481987+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.481987+0000","last_undegraded":"2024-09-10T07:45:13.481987+0000","last_fullsized":"2024-09-10T07:45:13.481987+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.481742+0000","last_change":"2024-09-10T07:45:13.481742+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.481742+0000","last_undegraded":"2024-09-10T07:45:13.481742+0000","last_fullsized":"2024-09-10T07:45:13.481742+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.486653+0000","last_change":"2024-09-10T07:45:13.486653+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.486653+0000","last_undegraded":"2024-09-10T07:45:13.486653+0000","last_fullsized":"2024-09-10T07:45:13.486653+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.488744+0000","last_change":"2024-09-10T07:45:13.488744+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.488744+0000","last_undegraded":"2024-09-10T07:45:13.488744+0000","last_fullsized":"2024-09-10T07:45:13.488744+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485699+0000","last_change":"2024-09-10T07:45:13.485699+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485699+0000","last_undegraded":"2024-09-10T07:45:13.485699+0000","last_fullsized":"2024-09-10T07:45:13.485699+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.489626+0000","last_change":"2024-09-10T07:45:13.489626+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.489626+0000","last_undegraded":"2024-09-10T07:45:13.489626+0000","last_fullsized":"2024-09-10T07:45:13.489626+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.482221+0000","last_change":"2024-09-10T07:45:13.482221+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.482221+0000","last_undegraded":"2024-09-10T07:45:13.482221+0000","last_fullsized":"2024-09-10T07:45:13.482221+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.490718+0000","last_change":"2024-09-10T07:45:13.490718+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.490718+0000","last_undegraded":"2024-09-10T07:45:13.490718+0000","last_fullsized":"2024-09-10T07:45:13.490718+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.484711+0000","last_change":"2024-09-10T07:45:13.484711+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.484711+0000","last_undegraded":"2024-09-10T07:45:13.484711+0000","last_fullsized":"2024-09-10T07:45:13.484711+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.487833+0000","last_change":"2024-09-10T07:45:13.487833+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.487833+0000","last_undegraded":"2024-09-10T07:45:13.487833+0000","last_fullsized":"2024-09-10T07:45:13.487833+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485538+0000","last_change":"2024-09-10T07:45:13.485538+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485538+0000","last_undegraded":"2024-09-10T07:45:13.485538+0000","last_fullsized":"2024-09-10T07:45:13.485538+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.481831+0000","last_change":"2024-09-10T07:45:13.481831+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.481831+0000","last_undegraded":"2024-09-10T07:45:13.481831+0000","last_fullsized":"2024-09-10T07:45:13.481831+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.486377+0000","last_change":"2024-09-10T07:45:13.486377+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.486377+0000","last_undegraded":"2024-09-10T07:45:13.486377+0000","last_fullsized":"2024-09-10T07:45:13.486377+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.482086+0000","last_change":"2024-09-10T07:45:13.482086+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.482086+0000","last_undegraded":"2024-09-10T07:45:13.482086+0000","last_fullsized":"2024-09-10T07:45:13.482086+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485902+0000","last_change":"2024-09-10T07:45:13.485902+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485902+0000","last_undegraded":"2024-09-10T07:45:13.485902+0000","last_fullsized":"2024-09-10T07:45:13.485902+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.481364+0000","last_change":"2024-09-10T07:45:13.481364+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.481364+0000","last_undegraded":"2024-09-10T07:45:13.481364+0000","last_fullsized":"2024-09-10T07:45:13.481364+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.487928+0000","last_change":"2024-09-10T07:45:13.487928+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.487928+0000","last_undegraded":"2024-09-10T07:45:13.487928+0000","last_fullsized":"2024-09-10T07:45:13.487928+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.490923+0000","last_change":"2024-09-10T07:45:13.490923+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.490923+0000","last_undegraded":"2024-09-10T07:45:13.490923+0000","last_fullsized":"2024-09-10T07:45:13.490923+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.488311+0000","last_change":"2024-09-10T07:45:13.488311+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.488311+0000","last_undegraded":"2024-09-10T07:45:13.488311+0000","last_fullsized":"2024-09-10T07:45:13.488311+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.486298+0000","last_change":"2024-09-10T07:45:13.486298+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.486298+0000","last_undegraded":"2024-09-10T07:45:13.486298+0000","last_fullsized":"2024-09-10T07:45:13.486298+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.489993+0000","last_change":"2024-09-10T07:45:13.489879+0000","last_active":"2024-09-10T07:45:13.489993+0000","last_peered":"2024-09-10T07:45:13.489993+0000","last_clean":"2024-09-10T07:45:13.489993+0000","last_became_active":"2024-09-10T07:45:13.489591+0000","last_became_peered":"2024-09-10T07:45:13.489591+0000","last_unstale":"2024-09-10T07:45:13.489993+0000","last_undegraded":"2024-09-10T07:45:13.489993+0000","last_fullsized":"2024-09-10T07:45:13.489993+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:11.977421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.487413+0000","last_change":"2024-09-10T07:45:13.487413+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.487413+0000","last_undegraded":"2024-09-10T07:45:13.487413+0000","last_fullsized":"2024-09-10T07:45:13.487413+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.495651+0000","last_change":"2024-09-10T07:45:13.495211+0000","last_active":"2024-09-10T07:45:13.495651+0000","last_peered":"2024-09-10T07:45:13.495651+0000","last_clean":"2024-09-10T07:45:13.495651+0000","last_became_active":"2024-09-10T07:45:13.494972+0000","last_became_peered":"2024-09-10T07:45:13.494972+0000","last_unstale":"2024-09-10T07:45:13.495651+0000","last_undegraded":"2024-09-10T07:45:13.495651+0000","last_fullsized":"2024-09-10T07:45:13.495651+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:43.318796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.490360+0000","last_change":"2024-09-10T07:45:13.490360+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.490360+0000","last_undegraded":"2024-09-10T07:45:13.490360+0000","last_fullsized":"2024-09-10T07:45:13.490360+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.495081+0000","last_change":"2024-09-10T07:45:13.494848+0000","last_active":"2024-09-10T07:45:13.495081+0000","last_peered":"2024-09-10T07:45:13.495081+0000","last_clean":"2024-09-10T07:45:13.495081+0000","last_became_active":"2024-09-10T07:45:13.494606+0000","last_became_peered":"2024-09-10T07:45:13.494606+0000","last_unstale":"2024-09-10T07:45:13.495081+0000","last_undegraded":"2024-09-10T07:45:13.495081+0000","last_fullsized":"2024-09-10T07:45:13.495081+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:15.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.481452+0000","last_change":"2024-09-10T07:45:13.481452+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.481452+0000","last_undegraded":"2024-09-10T07:45:13.481452+0000","last_fullsized":"2024-09-10T07:45:13.481452+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.488920+0000","last_change":"2024-09-10T07:45:13.488765+0000","last_active":"2024-09-10T07:45:13.488920+0000","last_peered":"2024-09-10T07:45:13.488920+0000","last_clean":"2024-09-10T07:45:13.488920+0000","last_became_active":"2024-09-10T07:45:13.488519+0000","last_became_peered":"2024-09-10T07:45:13.488519+0000","last_unstale":"2024-09-10T07:45:13.488920+0000","last_undegraded":"2024-09-10T07:45:13.488920+0000","last_fullsized":"2024-09-10T07:45:13.488920+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:42.240551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.487607+0000","last_change":"2024-09-10T07:45:13.487607+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.487607+0000","last_undegraded":"2024-09-10T07:45:13.487607+0000","last_fullsized":"2024-09-10T07:45:13.487607+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.492624+0000","last_change":"2024-09-10T07:45:13.491505+0000","last_active":"2024-09-10T07:45:13.492624+0000","last_peered":"2024-09-10T07:45:13.492624+0000","last_clean":"2024-09-10T07:45:13.492624+0000","last_became_active":"2024-09-10T07:45:13.490844+0000","last_became_peered":"2024-09-10T07:45:13.490844+0000","last_unstale":"2024-09-10T07:45:13.492624+0000","last_undegraded":"2024-09-10T07:45:13.492624+0000","last_fullsized":"2024-09-10T07:45:13.492624+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:24.149024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.484581+0000","last_change":"2024-09-10T07:45:13.484581+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.484581+0000","last_undegraded":"2024-09-10T07:45:13.484581+0000","last_fullsized":"2024-09-10T07:45:13.484581+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.494171+0000","last_change":"2024-09-10T07:45:13.491925+0000","last_active":"2024-09-10T07:45:13.494171+0000","last_peered":"2024-09-10T07:45:13.494171+0000","last_clean":"2024-09-10T07:45:13.494171+0000","last_became_active":"2024-09-10T07:45:13.491691+0000","last_became_peered":"2024-09-10T07:45:13.491691+0000","last_unstale":"2024-09-10T07:45:13.494171+0000","last_undegraded":"2024-09-10T07:45:13.494171+0000","last_fullsized":"2024-09-10T07:45:13.494171+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:51.050216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485134+0000","last_change":"2024-09-10T07:45:13.485134+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485134+0000","last_undegraded":"2024-09-10T07:45:13.485134+0000","last_fullsized":"2024-09-10T07:45:13.485134+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.493724+0000","last_change":"2024-09-10T07:45:13.493259+0000","last_active":"2024-09-10T07:45:13.493724+0000","last_peered":"2024-09-10T07:45:13.493724+0000","last_clean":"2024-09-10T07:45:13.493724+0000","last_became_active":"2024-09-10T07:45:13.492627+0000","last_became_peered":"2024-09-10T07:45:13.492627+0000","last_unstale":"2024-09-10T07:45:13.493724+0000","last_undegraded":"2024-09-10T07:45:13.493724+0000","last_fullsized":"2024-09-10T07:45:13.493724+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:10.061030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.488675+0000","last_change":"2024-09-10T07:45:13.488675+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.488675+0000","last_undegraded":"2024-09-10T07:45:13.488675+0000","last_fullsized":"2024-09-10T07:45:13.488675+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.490773+0000","last_change":"2024-09-10T07:45:13.489752+0000","last_active":"2024-09-10T07:45:13.490773+0000","last_peered":"2024-09-10T07:45:13.490773+0000","last_clean":"2024-09-10T07:45:13.490773+0000","last_became_active":"2024-09-10T07:45:13.489485+0000","last_became_peered":"2024-09-10T07:45:13.489485+0000","last_unstale":"2024-09-10T07:45:13.490773+0000","last_undegraded":"2024-09-10T07:45:13.490773+0000","last_fullsized":"2024-09-10T07:45:13.490773+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:42.563576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.488449+0000","last_change":"2024-09-10T07:45:13.488449+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.488449+0000","last_undegraded":"2024-09-10T07:45:13.488449+0000","last_fullsized":"2024-09-10T07:45:13.488449+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.487357+0000","last_change":"2024-09-10T07:45:13.486948+0000","last_active":"2024-09-10T07:45:13.487357+0000","last_peered":"2024-09-10T07:45:13.487357+0000","last_clean":"2024-09-10T07:45:13.487357+0000","last_became_active":"2024-09-10T07:45:13.486724+0000","last_became_peered":"2024-09-10T07:45:13.486724+0000","last_unstale":"2024-09-10T07:45:13.487357+0000","last_undegraded":"2024-09-10T07:45:13.487357+0000","last_fullsized":"2024-09-10T07:45:13.487357+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:50.665908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485699+0000","last_change":"2024-09-10T07:45:13.485699+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485699+0000","last_undegraded":"2024-09-10T07:45:13.485699+0000","last_fullsized":"2024-09-10T07:45:13.485699+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.486455+0000","last_change":"2024-09-10T07:45:13.485371+0000","last_active":"2024-09-10T07:45:13.486455+0000","last_peered":"2024-09-10T07:45:13.486455+0000","last_clean":"2024-09-10T07:45:13.486455+0000","last_became_active":"2024-09-10T07:45:13.485149+0000","last_became_peered":"2024-09-10T07:45:13.485149+0000","last_unstale":"2024-09-10T07:45:13.486455+0000","last_undegraded":"2024-09-10T07:45:13.486455+0000","last_fullsized":"2024-09-10T07:45:13.486455+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:42.348803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.487067+0000","last_change":"2024-09-10T07:45:13.487067+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.487067+0000","last_undegraded":"2024-09-10T07:45:13.487067+0000","last_fullsized":"2024-09-10T07:45:13.487067+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.494731+0000","last_change":"2024-09-10T07:45:13.494393+0000","last_active":"2024-09-10T07:45:13.494731+0000","last_peered":"2024-09-10T07:45:13.494731+0000","last_clean":"2024-09-10T07:45:13.494731+0000","last_became_active":"2024-09-10T07:45:13.493207+0000","last_became_peered":"2024-09-10T07:45:13.493207+0000","last_unstale":"2024-09-10T07:45:13.494731+0000","last_undegraded":"2024-09-10T07:45:13.494731+0000","last_fullsized":"2024-09-10T07:45:13.494731+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:01.821030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.488040+0000","last_change":"2024-09-10T07:45:13.488040+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.488040+0000","last_undegraded":"2024-09-10T07:45:13.488040+0000","last_fullsized":"2024-09-10T07:45:13.488040+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.493267+0000","last_change":"2024-09-10T07:45:13.493134+0000","last_active":"2024-09-10T07:45:13.493267+0000","last_peered":"2024-09-10T07:45:13.493267+0000","last_clean":"2024-09-10T07:45:13.493267+0000","last_became_active":"2024-09-10T07:45:13.492396+0000","last_became_peered":"2024-09-10T07:45:13.492396+0000","last_unstale":"2024-09-10T07:45:13.493267+0000","last_undegraded":"2024-09-10T07:45:13.493267+0000","last_fullsized":"2024-09-10T07:45:13.493267+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:13.291625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485859+0000","last_change":"2024-09-10T07:45:13.485859+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485859+0000","last_undegraded":"2024-09-10T07:45:13.485859+0000","last_fullsized":"2024-09-10T07:45:13.485859+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.488955+0000","last_change":"2024-09-10T07:45:13.488620+0000","last_active":"2024-09-10T07:45:13.488955+0000","last_peered":"2024-09-10T07:45:13.488955+0000","last_clean":"2024-09-10T07:45:13.488955+0000","last_became_active":"2024-09-10T07:45:13.487630+0000","last_became_peered":"2024-09-10T07:45:13.487630+0000","last_unstale":"2024-09-10T07:45:13.488955+0000","last_undegraded":"2024-09-10T07:45:13.488955+0000","last_fullsized":"2024-09-10T07:45:13.488955+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:31.465058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.486210+0000","last_change":"2024-09-10T07:45:13.486210+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.486210+0000","last_undegraded":"2024-09-10T07:45:13.486210+0000","last_fullsized":"2024-09-10T07:45:13.486210+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.495098+0000","last_change":"2024-09-10T07:45:13.494629+0000","last_active":"2024-09-10T07:45:13.495098+0000","last_peered":"2024-09-10T07:45:13.495098+0000","last_clean":"2024-09-10T07:45:13.495098+0000","last_became_active":"2024-09-10T07:45:13.494376+0000","last_became_peered":"2024-09-10T07:45:13.494376+0000","last_unstale":"2024-09-10T07:45:13.495098+0000","last_undegraded":"2024-09-10T07:45:13.495098+0000","last_fullsized":"2024-09-10T07:45:13.495098+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:59.859739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.481707+0000","last_change":"2024-09-10T07:45:13.481707+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.481707+0000","last_undegraded":"2024-09-10T07:45:13.481707+0000","last_fullsized":"2024-09-10T07:45:13.481707+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.494753+0000","last_change":"2024-09-10T07:45:13.494629+0000","last_active":"2024-09-10T07:45:13.494753+0000","last_peered":"2024-09-10T07:45:13.494753+0000","last_clean":"2024-09-10T07:45:13.494753+0000","last_became_active":"2024-09-10T07:45:13.493900+0000","last_became_peered":"2024-09-10T07:45:13.493900+0000","last_unstale":"2024-09-10T07:45:13.494753+0000","last_undegraded":"2024-09-10T07:45:13.494753+0000","last_fullsized":"2024-09-10T07:45:13.494753+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:33.988889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.484736+0000","last_change":"2024-09-10T07:45:13.484736+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.484736+0000","last_undegraded":"2024-09-10T07:45:13.484736+0000","last_fullsized":"2024-09-10T07:45:13.484736+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.496068+0000","last_change":"2024-09-10T07:45:13.495496+0000","last_active":"2024-09-10T07:45:13.496068+0000","last_peered":"2024-09-10T07:45:13.496068+0000","last_clean":"2024-09-10T07:45:13.496068+0000","last_became_active":"2024-09-10T07:45:13.494073+0000","last_became_peered":"2024-09-10T07:45:13.494073+0000","last_unstale":"2024-09-10T07:45:13.496068+0000","last_undegraded":"2024-09-10T07:45:13.496068+0000","last_fullsized":"2024-09-10T07:45:13.496068+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:52.082689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485392+0000","last_change":"2024-09-10T07:45:13.485392+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485392+0000","last_undegraded":"2024-09-10T07:45:13.485392+0000","last_fullsized":"2024-09-10T07:45:13.485392+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.489733+0000","last_change":"2024-09-10T07:45:13.489586+0000","last_active":"2024-09-10T07:45:13.489733+0000","last_peered":"2024-09-10T07:45:13.489733+0000","last_clean":"2024-09-10T07:45:13.489733+0000","last_became_active":"2024-09-10T07:45:13.488127+0000","last_became_peered":"2024-09-10T07:45:13.488127+0000","last_unstale":"2024-09-10T07:45:13.489733+0000","last_undegraded":"2024-09-10T07:45:13.489733+0000","last_fullsized":"2024-09-10T07:45:13.489733+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:13.838124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.484241+0000","last_change":"2024-09-10T07:45:13.484241+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.484241+0000","last_undegraded":"2024-09-10T07:45:13.484241+0000","last_fullsized":"2024-09-10T07:45:13.484241+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.496120+0000","last_change":"2024-09-10T07:45:13.495516+0000","last_active":"2024-09-10T07:45:13.496120+0000","last_peered":"2024-09-10T07:45:13.496120+0000","last_clean":"2024-09-10T07:45:13.496120+0000","last_became_active":"2024-09-10T07:45:13.494631+0000","last_became_peered":"2024-09-10T07:45:13.494631+0000","last_unstale":"2024-09-10T07:45:13.496120+0000","last_undegraded":"2024-09-10T07:45:13.496120+0000","last_fullsized":"2024-09-10T07:45:13.496120+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:49.936196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.486047+0000","last_change":"2024-09-10T07:45:13.486047+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.486047+0000","last_undegraded":"2024-09-10T07:45:13.486047+0000","last_fullsized":"2024-09-10T07:45:13.486047+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.483439+0000","last_change":"2024-09-10T07:45:13.483268+0000","last_active":"2024-09-10T07:45:13.483439+0000","last_peered":"2024-09-10T07:45:13.483439+0000","last_clean":"2024-09-10T07:45:13.483439+0000","last_became_active":"2024-09-10T07:45:13.482729+0000","last_became_peered":"2024-09-10T07:45:13.482729+0000","last_unstale":"2024-09-10T07:45:13.483439+0000","last_undegraded":"2024-09-10T07:45:13.483439+0000","last_fullsized":"2024-09-10T07:45:13.483439+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:16.509011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.480756+0000","last_change":"2024-09-10T07:45:13.480756+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.480756+0000","last_undegraded":"2024-09-10T07:45:13.480756+0000","last_fullsized":"2024-09-10T07:45:13.480756+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.495368+0000","last_change":"2024-09-10T07:45:13.495232+0000","last_active":"2024-09-10T07:45:13.495368+0000","last_peered":"2024-09-10T07:45:13.495368+0000","last_clean":"2024-09-10T07:45:13.495368+0000","last_became_active":"2024-09-10T07:45:13.494644+0000","last_became_peered":"2024-09-10T07:45:13.494644+0000","last_unstale":"2024-09-10T07:45:13.495368+0000","last_undegraded":"2024-09-10T07:45:13.495368+0000","last_fullsized":"2024-09-10T07:45:13.495368+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:58.961602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.487301+0000","last_change":"2024-09-10T07:45:13.487301+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.487301+0000","last_undegraded":"2024-09-10T07:45:13.487301+0000","last_fullsized":"2024-09-10T07:45:13.487301+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.490986+0000","last_change":"2024-09-10T07:45:13.490554+0000","last_active":"2024-09-10T07:45:13.490986+0000","last_peered":"2024-09-10T07:45:13.490986+0000","last_clean":"2024-09-10T07:45:13.490986+0000","last_became_active":"2024-09-10T07:45:13.489801+0000","last_became_peered":"2024-09-10T07:45:13.489801+0000","last_unstale":"2024-09-10T07:45:13.490986+0000","last_undegraded":"2024-09-10T07:45:13.490986+0000","last_fullsized":"2024-09-10T07:45:13.490986+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:20.818607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.481677+0000","last_change":"2024-09-10T07:45:13.481677+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.481677+0000","last_undegraded":"2024-09-10T07:45:13.481677+0000","last_fullsized":"2024-09-10T07:45:13.481677+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.494150+0000","last_change":"2024-09-10T07:45:13.493344+0000","last_active":"2024-09-10T07:45:13.494150+0000","last_peered":"2024-09-10T07:45:13.494150+0000","last_clean":"2024-09-10T07:45:13.494150+0000","last_became_active":"2024-09-10T07:45:13.492879+0000","last_became_peered":"2024-09-10T07:45:13.492879+0000","last_unstale":"2024-09-10T07:45:13.494150+0000","last_undegraded":"2024-09-10T07:45:13.494150+0000","last_fullsized":"2024-09-10T07:45:13.494150+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:12:10.535471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.488203+0000","last_change":"2024-09-10T07:45:13.488203+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.488203+0000","last_undegraded":"2024-09-10T07:45:13.488203+0000","last_fullsized":"2024-09-10T07:45:13.488203+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.496139+0000","last_change":"2024-09-10T07:45:13.496002+0000","last_active":"2024-09-10T07:45:13.496139+0000","last_peered":"2024-09-10T07:45:13.496139+0000","last_clean":"2024-09-10T07:45:13.496139+0000","last_became_active":"2024-09-10T07:45:13.494979+0000","last_became_peered":"2024-09-10T07:45:13.494979+0000","last_unstale":"2024-09-10T07:45:13.496139+0000","last_undegraded":"2024-09-10T07:45:13.496139+0000","last_fullsized":"2024-09-10T07:45:13.496139+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:31.078657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.484579+0000","last_change":"2024-09-10T07:45:13.484579+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.484579+0000","last_undegraded":"2024-09-10T07:45:13.484579+0000","last_fullsized":"2024-09-10T07:45:13.484579+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.495381+0000","last_change":"2024-09-10T07:45:13.495032+0000","last_active":"2024-09-10T07:45:13.495381+0000","last_peered":"2024-09-10T07:45:13.495381+0000","last_clean":"2024-09-10T07:45:13.495381+0000","last_became_active":"2024-09-10T07:45:13.493962+0000","last_became_peered":"2024-09-10T07:45:13.493962+0000","last_unstale":"2024-09-10T07:45:13.495381+0000","last_undegraded":"2024-09-10T07:45:13.495381+0000","last_fullsized":"2024-09-10T07:45:13.495381+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:13.137706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.484396+0000","last_change":"2024-09-10T07:45:13.484396+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.484396+0000","last_undegraded":"2024-09-10T07:45:13.484396+0000","last_fullsized":"2024-09-10T07:45:13.484396+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.490922+0000","last_change":"2024-09-10T07:45:13.490792+0000","last_active":"2024-09-10T07:45:13.490922+0000","last_peered":"2024-09-10T07:45:13.490922+0000","last_clean":"2024-09-10T07:45:13.490922+0000","last_became_active":"2024-09-10T07:45:13.490546+0000","last_became_peered":"2024-09-10T07:45:13.490546+0000","last_unstale":"2024-09-10T07:45:13.490922+0000","last_undegraded":"2024-09-10T07:45:13.490922+0000","last_fullsized":"2024-09-10T07:45:13.490922+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:53.051088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.486711+0000","last_change":"2024-09-10T07:45:13.486711+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.486711+0000","last_undegraded":"2024-09-10T07:45:13.486711+0000","last_fullsized":"2024-09-10T07:45:13.486711+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.493188+0000","last_change":"2024-09-10T07:45:13.493014+0000","last_active":"2024-09-10T07:45:13.493188+0000","last_peered":"2024-09-10T07:45:13.493188+0000","last_clean":"2024-09-10T07:45:13.493188+0000","last_became_active":"2024-09-10T07:45:13.492313+0000","last_became_peered":"2024-09-10T07:45:13.492313+0000","last_unstale":"2024-09-10T07:45:13.493188+0000","last_undegraded":"2024-09-10T07:45:13.493188+0000","last_fullsized":"2024-09-10T07:45:13.493188+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:31.114996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485076+0000","last_change":"2024-09-10T07:45:13.485076+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485076+0000","last_undegraded":"2024-09-10T07:45:13.485076+0000","last_fullsized":"2024-09-10T07:45:13.485076+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.491935+0000","last_change":"2024-09-10T07:45:13.490777+0000","last_active":"2024-09-10T07:45:13.491935+0000","last_peered":"2024-09-10T07:45:13.491935+0000","last_clean":"2024-09-10T07:45:13.491935+0000","last_became_active":"2024-09-10T07:45:13.490461+0000","last_became_peered":"2024-09-10T07:45:13.490461+0000","last_unstale":"2024-09-10T07:45:13.491935+0000","last_undegraded":"2024-09-10T07:45:13.491935+0000","last_fullsized":"2024-09-10T07:45:13.491935+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:31.277228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.484812+0000","last_change":"2024-09-10T07:45:13.484812+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.484812+0000","last_undegraded":"2024-09-10T07:45:13.484812+0000","last_fullsized":"2024-09-10T07:45:13.484812+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.495630+0000","last_change":"2024-09-10T07:45:13.495161+0000","last_active":"2024-09-10T07:45:13.495630+0000","last_peered":"2024-09-10T07:45:13.495630+0000","last_clean":"2024-09-10T07:45:13.495630+0000","last_became_active":"2024-09-10T07:45:13.493415+0000","last_became_peered":"2024-09-10T07:45:13.493415+0000","last_unstale":"2024-09-10T07:45:13.495630+0000","last_undegraded":"2024-09-10T07:45:13.495630+0000","last_fullsized":"2024-09-10T07:45:13.495630+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:39.208434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.490606+0000","last_change":"2024-09-10T07:45:13.490606+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.490606+0000","last_undegraded":"2024-09-10T07:45:13.490606+0000","last_fullsized":"2024-09-10T07:45:13.490606+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.494210+0000","last_change":"2024-09-10T07:45:13.493142+0000","last_active":"2024-09-10T07:45:13.494210+0000","last_peered":"2024-09-10T07:45:13.494210+0000","last_clean":"2024-09-10T07:45:13.494210+0000","last_became_active":"2024-09-10T07:45:13.492895+0000","last_became_peered":"2024-09-10T07:45:13.492895+0000","last_unstale":"2024-09-10T07:45:13.494210+0000","last_undegraded":"2024-09-10T07:45:13.494210+0000","last_fullsized":"2024-09-10T07:45:13.494210+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:54.796078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485941+0000","last_change":"2024-09-10T07:45:13.485941+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485941+0000","last_undegraded":"2024-09-10T07:45:13.485941+0000","last_fullsized":"2024-09-10T07:45:13.485941+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.493743+0000","last_change":"2024-09-10T07:45:13.493413+0000","last_active":"2024-09-10T07:45:13.493743+0000","last_peered":"2024-09-10T07:45:13.493743+0000","last_clean":"2024-09-10T07:45:13.493743+0000","last_became_active":"2024-09-10T07:45:13.493167+0000","last_became_peered":"2024-09-10T07:45:13.493167+0000","last_unstale":"2024-09-10T07:45:13.493743+0000","last_undegraded":"2024-09-10T07:45:13.493743+0000","last_fullsized":"2024-09-10T07:45:13.493743+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:58.647113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.480777+0000","last_change":"2024-09-10T07:45:13.480777+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.480777+0000","last_undegraded":"2024-09-10T07:45:13.480777+0000","last_fullsized":"2024-09-10T07:45:13.480777+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.497141+0000","last_change":"2024-09-10T07:45:13.496896+0000","last_active":"2024-09-10T07:45:13.497141+0000","last_peered":"2024-09-10T07:45:13.497141+0000","last_clean":"2024-09-10T07:45:13.497141+0000","last_became_active":"2024-09-10T07:45:13.496649+0000","last_became_peered":"2024-09-10T07:45:13.496649+0000","last_unstale":"2024-09-10T07:45:13.497141+0000","last_undegraded":"2024-09-10T07:45:13.497141+0000","last_fullsized":"2024-09-10T07:45:13.497141+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:07.990312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-10T07:45:13.485177+0000","last_change":"2024-09-10T07:45:13.485177+0000","last_active":"2024-09-10T07:45:13.470222+0000","last_peered":"2024-09-10T07:45:13.470222+0000","last_clean":"2024-09-10T07:45:13.470222+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T07:45:13.485177+0000","last_undegraded":"2024-09-10T07:45:13.485177+0000","last_fullsized":"2024-09-10T07:45:13.485177+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.495883+0000","last_change":"2024-09-10T07:45:13.495683+0000","last_active":"2024-09-10T07:45:13.495883+0000","last_peered":"2024-09-10T07:45:13.495883+0000","last_clean":"2024-09-10T07:45:13.495883+0000","last_became_active":"2024-09-10T07:45:13.495457+0000","last_became_peered":"2024-09-10T07:45:13.495457+0000","last_unstale":"2024-09-10T07:45:13.495883+0000","last_undegraded":"2024-09-10T07:45:13.495883+0000","last_fullsized":"2024-09-10T07:45:13.495883+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:20.976712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":493,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-10T07:45:13.480714+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:45:13.480714+0000","last_peered":"2024-09-10T07:45:13.480714+0000","last_clean":"2024-09-10T07:45:13.480714+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:45:13.480714+0000","last_undegraded":"2024-09-10T07:45:13.480714+0000","last_fullsized":"2024-09-10T07:45:13.480714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193719,"statfs":{"total":200000000,"available":198369116,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574983,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1022,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194290,"statfs":{"total":200000000,"available":198953209,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1022,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194290,"statfs":{"total":200000000,"available":198953209,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1022,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194290,"statfs":{"total":200000000,"available":198953209,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193719,"statfs":{"total":200000000,"available":198369116,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:45:18.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:45:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.908+0000 7f39c3600640 1 Processor -- start 2024-09-10T07:45:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.909+0000 7f39c3600640 1 -- start start 2024-09-10T07:45:18.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.910+0000 7f39c3600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f39bc145290 0x7f39bc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.910+0000 7f39c3600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce780 0x7f39bc072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.910+0000 7f39c3600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39bc06e3d0 con 0x7f39bc071510 2024-09-10T07:45:18.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.910+0000 7f39c3600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f39bc06efe0 con 0x7f39bc145290 2024-09-10T07:45:18.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.910+0000 7f39c3600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f39bc06e6b0 con 0x7f39bc0ce780 2024-09-10T07:45:18.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.910+0000 7f39c1600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f39bc071510 0x7f39bc0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54160/0 (socket says 172.21.15.99:54160) 2024-09-10T07:45:18.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.910+0000 7f39c1600640 1 -- 172.21.15.99:0/1151541962 learned_addr learned my addr 172.21.15.99:0/1151541962 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:18.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.910+0000 7f39c0c00640 1 --2- 172.21.15.99:0/1151541962 >> v2:172.21.15.187:3300/0 conn(0x7f39bc145290 0x7f39bc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.910+0000 7f39b3e00640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce780 0x7f39bc072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833539361 0 0) 0x7f39bc06e3d0 con 0x7f39bc071510 2024-09-10T07:45:18.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39a0003520 con 0x7f39bc071510 2024-09-10T07:45:18.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 462831184 0 0) 0x7f39a0003520 con 0x7f39bc071510 2024-09-10T07:45:18.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce780 msgr2=0x7f39bc072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:18.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce780 0x7f39bc072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 >> v2:172.21.15.187:3300/0 conn(0x7f39bc145290 msgr2=0x7f39bc06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:18.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 --2- 172.21.15.99:0/1151541962 >> v2:172.21.15.187:3300/0 conn(0x7f39bc145290 0x7f39bc06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc06e990 con 0x7f39bc071510 2024-09-10T07:45:18.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f39b40019f0 con 0x7f39bc071510 2024-09-10T07:45:18.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 >> v1:172.21.15.99:6789/0 conn(0x7f39bc071510 legacy=0x7f39bc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39a00039b0 0x7f39a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce780 0x7f39a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a0004d40 0x7f39a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc06efe0 con 0x7f39a0004d40 2024-09-10T07:45:18.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc06e6b0 con 0x7f39a00039b0 2024-09-10T07:45:18.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f39a000b9c0 con 0x7f39bc0ce780 2024-09-10T07:45:18.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39c1600640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a0004d40 0x7f39a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39b3e00640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce780 0x7f39a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.911+0000 7f39c0c00640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39a00039b0 0x7f39a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.912+0000 7f39c1600640 1 -- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce780 msgr2=0x7f39a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:18.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.912+0000 7f39c1600640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce780 0x7f39a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.912+0000 7f39c1600640 1 -- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39a00039b0 msgr2=0x7f39a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:18.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.912+0000 7f39c1600640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39a00039b0 0x7f39a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.912+0000 7f39c1600640 1 -- 172.21.15.99:0/1151541962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a0003520 con 0x7f39a0004d40 2024-09-10T07:45:18.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.913+0000 7f39c1600640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a0004d40 0x7f39a00051c0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0719c0 tx=0x7f39a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d9dbaaca637294 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:18.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.913+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b400a4c0 con 0x7f39a0004d40 2024-09-10T07:45:18.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.913+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b4031070 con 0x7f39a0004d40 2024-09-10T07:45:18.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.913+0000 7f39bbe00640 1 -- 172.21.15.99:0/1151541962 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4036470 con 0x7f39a0004d40 2024-09-10T07:45:18.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.913+0000 7f39c3600640 1 -- 172.21.15.99:0/1151541962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a0004d40 msgr2=0x7f39a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.913+0000 7f39c3600640 1 --2- 172.21.15.99:0/1151541962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a0004d40 0x7f39a00051c0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0719c0 tx=0x7f39a0005830 comp rx=0 tx=0).stop 2024-09-10T07:45:18.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.913+0000 7f39c1600640 1 -- 172.21.15.99:0/1151541962 reap_dead start 2024-09-10T07:45:18.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.914+0000 7f39c3600640 1 -- 172.21.15.99:0/1151541962 shutdown_connections 2024-09-10T07:45:18.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.914+0000 7f39c3600640 1 -- 172.21.15.99:0/1151541962 >> 172.21.15.99:0/1151541962 conn(0x7f39bc06bc10 msgr2=0x7f39bc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:18.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.914+0000 7f39c3600640 1 -- 172.21.15.99:0/1151541962 shutdown_connections 2024-09-10T07:45:18.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.914+0000 7f39c3600640 1 -- 172.21.15.99:0/1151541962 wait complete. 2024-09-10T07:45:18.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.915+0000 7f39c3600640 1 Processor -- start 2024-09-10T07:45:18.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.915+0000 7f39c3600640 1 -- start start 2024-09-10T07:45:18.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.916+0000 7f39c3600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a0004d40 0x7f39bc15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.916+0000 7f39c3600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39bc0af250 0x7f39bc0af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.916+0000 7f39c3600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc1e3ba0 0x7f39bc1e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.916+0000 7f39c3600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc06df80 con 0x7f39bc0af250 2024-09-10T07:45:18.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.916+0000 7f39c3600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f39bc145670 con 0x7f39bc1e3ba0 2024-09-10T07:45:18.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.916+0000 7f39c3600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f39bc06e100 con 0x7f39a0004d40 2024-09-10T07:45:18.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39bc0af250 0x7f39bc0af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39b3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39bc0af250 0x7f39bc0af6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42260/0 (socket says 172.21.15.99:42260) 2024-09-10T07:45:18.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39b3e00640 1 -- 172.21.15.99:0/278224735 learned_addr learned my addr 172.21.15.99:0/278224735 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:18.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39c0c00640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a0004d40 0x7f39bc15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39c1600640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc1e3ba0 0x7f39bc1e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39b3e00640 1 -- 172.21.15.99:0/278224735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a0004d40 msgr2=0x7f39bc15b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39b3e00640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a0004d40 0x7f39bc15b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39b3e00640 1 -- 172.21.15.99:0/278224735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc1e3ba0 msgr2=0x7f39bc1e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:18.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39b3e00640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc1e3ba0 0x7f39bc1e4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:18.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39b3e00640 1 -- 172.21.15.99:0/278224735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39bc0afdc0 con 0x7f39bc0af250 2024-09-10T07:45:18.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.917+0000 7f39b3e00640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39bc0af250 0x7f39bc0af6b0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f39a4011910 tx=0x7f39a4011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:18.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.918+0000 7f39b9600640 1 -- 172.21.15.99:0/278224735 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a400f9d0 con 0x7f39bc0af250 2024-09-10T07:45:18.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.918+0000 7f39b9600640 1 -- 172.21.15.99:0/278224735 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a400fb70 con 0x7f39bc0af250 2024-09-10T07:45:18.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.918+0000 7f39b9600640 1 -- 172.21.15.99:0/278224735 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4014440 con 0x7f39bc0af250 2024-09-10T07:45:18.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.918+0000 7f39c3600640 1 -- 172.21.15.99:0/278224735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39bc0b00a0 con 0x7f39bc0af250 2024-09-10T07:45:18.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.918+0000 7f39c3600640 1 -- 172.21.15.99:0/278224735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39bc1e15b0 con 0x7f39bc0af250 2024-09-10T07:45:18.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.919+0000 7f39c3600640 1 -- 172.21.15.99:0/278224735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39bc06f470 con 0x7f39bc0af250 2024-09-10T07:45:18.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.920+0000 7f39b9600640 1 -- 172.21.15.99:0/278224735 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39a4012040 con 0x7f39bc0af250 2024-09-10T07:45:18.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.920+0000 7f39b9600640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f399806be60 0x7f399806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:18.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.921+0000 7f39b9600640 1 -- 172.21.15.99:0/278224735 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f39a408b3e0 con 0x7f39bc0af250 2024-09-10T07:45:18.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.921+0000 7f39c0c00640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f399806be60 0x7f399806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:18.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.921+0000 7f39c0c00640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f399806be60 0x7f399806e320 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009bc0 tx=0x7f39ac009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:18.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:18.925+0000 7f39b9600640 1 -- 172.21.15.99:0/278224735 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39a4019030 con 0x7f39bc0af250 2024-09-10T07:45:19.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.096+0000 7f39c3600640 1 -- 172.21.15.99:0/278224735 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39bc0cf390 con 0x7f399806be60 2024-09-10T07:45:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.102+0000 7f39b9600640 1 -- 172.21.15.99:0/278224735 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247999 (secure 0 0 0) 0x7f39bc0cf390 con 0x7f399806be60 2024-09-10T07:45:19.106 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:19.108 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:45:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 -- 172.21.15.99:0/278224735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f399806be60 msgr2=0x7f399806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f399806be60 0x7f399806e320 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009bc0 tx=0x7f39ac009190 comp rx=0 tx=0).stop 2024-09-10T07:45:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 -- 172.21.15.99:0/278224735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39bc0af250 msgr2=0x7f39bc0af6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39bc0af250 0x7f39bc0af6b0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f39a4011910 tx=0x7f39a4011d10 comp rx=0 tx=0).stop 2024-09-10T07:45:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 -- 172.21.15.99:0/278224735 shutdown_connections 2024-09-10T07:45:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc1e3ba0 0x7f39bc1e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f399806be60 0x7f399806e320 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39bc0af250 0x7f39bc0af6b0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 --2- 172.21.15.99:0/278224735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a0004d40 0x7f39bc15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 -- 172.21.15.99:0/278224735 >> 172.21.15.99:0/278224735 conn(0x7f39bc06bc10 msgr2=0x7f39bc1443e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 -- 172.21.15.99:0/278224735 shutdown_connections 2024-09-10T07:45:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.106+0000 7f39c3600640 1 -- 172.21.15.99:0/278224735 wait complete. 2024-09-10T07:45:19.123 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":515,"stamp":"2024-09-10T07:45:18.841140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9437,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553062,"statfs":{"total":1600000000,"available":1590335516,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000980"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.775128+0000","last_change":"2024-09-10T07:45:14.510181+0000","last_active":"2024-09-10T07:45:15.775128+0000","last_peered":"2024-09-10T07:45:15.775128+0000","last_clean":"2024-09-10T07:45:15.775128+0000","last_became_active":"2024-09-10T07:45:14.509613+0000","last_became_peered":"2024-09-10T07:45:14.509613+0000","last_unstale":"2024-09-10T07:45:15.775128+0000","last_undegraded":"2024-09-10T07:45:15.775128+0000","last_fullsized":"2024-09-10T07:45:15.775128+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:22:38.775264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982119+0000","last_change":"2024-09-10T07:45:14.510309+0000","last_active":"2024-09-10T07:45:15.982119+0000","last_peered":"2024-09-10T07:45:15.982119+0000","last_clean":"2024-09-10T07:45:15.982119+0000","last_became_active":"2024-09-10T07:45:14.508680+0000","last_became_peered":"2024-09-10T07:45:14.508680+0000","last_unstale":"2024-09-10T07:45:15.982119+0000","last_undegraded":"2024-09-10T07:45:15.982119+0000","last_fullsized":"2024-09-10T07:45:15.982119+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:21.315450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.486988+0000","last_change":"2024-09-10T07:45:14.502886+0000","last_active":"2024-09-10T07:45:15.486988+0000","last_peered":"2024-09-10T07:45:15.486988+0000","last_clean":"2024-09-10T07:45:15.486988+0000","last_became_active":"2024-09-10T07:45:14.499171+0000","last_became_peered":"2024-09-10T07:45:14.499171+0000","last_unstale":"2024-09-10T07:45:15.486988+0000","last_undegraded":"2024-09-10T07:45:15.486988+0000","last_fullsized":"2024-09-10T07:45:15.486988+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:39:47.660079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773012+0000","last_change":"2024-09-10T07:45:14.499857+0000","last_active":"2024-09-10T07:45:15.773012+0000","last_peered":"2024-09-10T07:45:15.773012+0000","last_clean":"2024-09-10T07:45:15.773012+0000","last_became_active":"2024-09-10T07:45:14.499526+0000","last_became_peered":"2024-09-10T07:45:14.499526+0000","last_unstale":"2024-09-10T07:45:15.773012+0000","last_undegraded":"2024-09-10T07:45:15.773012+0000","last_fullsized":"2024-09-10T07:45:15.773012+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:07.303284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982172+0000","last_change":"2024-09-10T07:45:14.500933+0000","last_active":"2024-09-10T07:45:15.982172+0000","last_peered":"2024-09-10T07:45:15.982172+0000","last_clean":"2024-09-10T07:45:15.982172+0000","last_became_active":"2024-09-10T07:45:14.499786+0000","last_became_peered":"2024-09-10T07:45:14.499786+0000","last_unstale":"2024-09-10T07:45:15.982172+0000","last_undegraded":"2024-09-10T07:45:15.982172+0000","last_fullsized":"2024-09-10T07:45:15.982172+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:12.094527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981280+0000","last_change":"2024-09-10T07:45:14.490139+0000","last_active":"2024-09-10T07:45:15.981280+0000","last_peered":"2024-09-10T07:45:15.981280+0000","last_clean":"2024-09-10T07:45:15.981280+0000","last_became_active":"2024-09-10T07:45:14.489589+0000","last_became_peered":"2024-09-10T07:45:14.489589+0000","last_unstale":"2024-09-10T07:45:15.981280+0000","last_undegraded":"2024-09-10T07:45:15.981280+0000","last_fullsized":"2024-09-10T07:45:15.981280+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:09.522301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.308865+0000","last_change":"2024-09-10T07:45:14.500613+0000","last_active":"2024-09-10T07:45:16.308865+0000","last_peered":"2024-09-10T07:45:16.308865+0000","last_clean":"2024-09-10T07:45:16.308865+0000","last_became_active":"2024-09-10T07:45:14.500409+0000","last_became_peered":"2024-09-10T07:45:14.500409+0000","last_unstale":"2024-09-10T07:45:16.308865+0000","last_undegraded":"2024-09-10T07:45:16.308865+0000","last_fullsized":"2024-09-10T07:45:16.308865+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:07.463124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982097+0000","last_change":"2024-09-10T07:45:14.501111+0000","last_active":"2024-09-10T07:45:15.982097+0000","last_peered":"2024-09-10T07:45:15.982097+0000","last_clean":"2024-09-10T07:45:15.982097+0000","last_became_active":"2024-09-10T07:45:14.500564+0000","last_became_peered":"2024-09-10T07:45:14.500564+0000","last_unstale":"2024-09-10T07:45:15.982097+0000","last_undegraded":"2024-09-10T07:45:15.982097+0000","last_fullsized":"2024-09-10T07:45:15.982097+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:39.849151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982473+0000","last_change":"2024-09-10T07:45:14.507661+0000","last_active":"2024-09-10T07:45:15.982473+0000","last_peered":"2024-09-10T07:45:15.982473+0000","last_clean":"2024-09-10T07:45:15.982473+0000","last_became_active":"2024-09-10T07:45:14.507393+0000","last_became_peered":"2024-09-10T07:45:14.507393+0000","last_unstale":"2024-09-10T07:45:15.982473+0000","last_undegraded":"2024-09-10T07:45:15.982473+0000","last_fullsized":"2024-09-10T07:45:15.982473+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:30.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982340+0000","last_change":"2024-09-10T07:45:14.501235+0000","last_active":"2024-09-10T07:45:15.982340+0000","last_peered":"2024-09-10T07:45:15.982340+0000","last_clean":"2024-09-10T07:45:15.982340+0000","last_became_active":"2024-09-10T07:45:14.500124+0000","last_became_peered":"2024-09-10T07:45:14.500124+0000","last_unstale":"2024-09-10T07:45:15.982340+0000","last_undegraded":"2024-09-10T07:45:15.982340+0000","last_fullsized":"2024-09-10T07:45:15.982340+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:48.633876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982256+0000","last_change":"2024-09-10T07:45:14.497618+0000","last_active":"2024-09-10T07:45:15.982256+0000","last_peered":"2024-09-10T07:45:15.982256+0000","last_clean":"2024-09-10T07:45:15.982256+0000","last_became_active":"2024-09-10T07:45:14.497360+0000","last_became_peered":"2024-09-10T07:45:14.497360+0000","last_unstale":"2024-09-10T07:45:15.982256+0000","last_undegraded":"2024-09-10T07:45:15.982256+0000","last_fullsized":"2024-09-10T07:45:15.982256+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:17.384073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982325+0000","last_change":"2024-09-10T07:45:14.509032+0000","last_active":"2024-09-10T07:45:15.982325+0000","last_peered":"2024-09-10T07:45:15.982325+0000","last_clean":"2024-09-10T07:45:15.982325+0000","last_became_active":"2024-09-10T07:45:14.508269+0000","last_became_peered":"2024-09-10T07:45:14.508269+0000","last_unstale":"2024-09-10T07:45:15.982325+0000","last_undegraded":"2024-09-10T07:45:15.982325+0000","last_fullsized":"2024-09-10T07:45:15.982325+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:09.832852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.486708+0000","last_change":"2024-09-10T07:45:14.489828+0000","last_active":"2024-09-10T07:45:15.486708+0000","last_peered":"2024-09-10T07:45:15.486708+0000","last_clean":"2024-09-10T07:45:15.486708+0000","last_became_active":"2024-09-10T07:45:14.489554+0000","last_became_peered":"2024-09-10T07:45:14.489554+0000","last_unstale":"2024-09-10T07:45:15.486708+0000","last_undegraded":"2024-09-10T07:45:15.486708+0000","last_fullsized":"2024-09-10T07:45:15.486708+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:04.378977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.487804+0000","last_change":"2024-09-10T07:45:14.506837+0000","last_active":"2024-09-10T07:45:15.487804+0000","last_peered":"2024-09-10T07:45:15.487804+0000","last_clean":"2024-09-10T07:45:15.487804+0000","last_became_active":"2024-09-10T07:45:14.506602+0000","last_became_peered":"2024-09-10T07:45:14.506602+0000","last_unstale":"2024-09-10T07:45:15.487804+0000","last_undegraded":"2024-09-10T07:45:15.487804+0000","last_fullsized":"2024-09-10T07:45:15.487804+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:24.643187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.774935+0000","last_change":"2024-09-10T07:45:14.508811+0000","last_active":"2024-09-10T07:45:15.774935+0000","last_peered":"2024-09-10T07:45:15.774935+0000","last_clean":"2024-09-10T07:45:15.774935+0000","last_became_active":"2024-09-10T07:45:14.508582+0000","last_became_peered":"2024-09-10T07:45:14.508582+0000","last_unstale":"2024-09-10T07:45:15.774935+0000","last_undegraded":"2024-09-10T07:45:15.774935+0000","last_fullsized":"2024-09-10T07:45:15.774935+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:37.273756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.309143+0000","last_change":"2024-09-10T07:45:14.507694+0000","last_active":"2024-09-10T07:45:16.309143+0000","last_peered":"2024-09-10T07:45:16.309143+0000","last_clean":"2024-09-10T07:45:16.309143+0000","last_became_active":"2024-09-10T07:45:14.507476+0000","last_became_peered":"2024-09-10T07:45:14.507476+0000","last_unstale":"2024-09-10T07:45:16.309143+0000","last_undegraded":"2024-09-10T07:45:16.309143+0000","last_fullsized":"2024-09-10T07:45:16.309143+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:14.888598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981304+0000","last_change":"2024-09-10T07:45:14.496003+0000","last_active":"2024-09-10T07:45:15.981304+0000","last_peered":"2024-09-10T07:45:15.981304+0000","last_clean":"2024-09-10T07:45:15.981304+0000","last_became_active":"2024-09-10T07:45:14.495784+0000","last_became_peered":"2024-09-10T07:45:14.495784+0000","last_unstale":"2024-09-10T07:45:15.981304+0000","last_undegraded":"2024-09-10T07:45:15.981304+0000","last_fullsized":"2024-09-10T07:45:15.981304+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:53.983903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483184+0000","last_change":"2024-09-10T07:45:14.490342+0000","last_active":"2024-09-10T07:45:15.483184+0000","last_peered":"2024-09-10T07:45:15.483184+0000","last_clean":"2024-09-10T07:45:15.483184+0000","last_became_active":"2024-09-10T07:45:14.490094+0000","last_became_peered":"2024-09-10T07:45:14.490094+0000","last_unstale":"2024-09-10T07:45:15.483184+0000","last_undegraded":"2024-09-10T07:45:15.483184+0000","last_fullsized":"2024-09-10T07:45:15.483184+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:52.646486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981182+0000","last_change":"2024-09-10T07:45:14.495632+0000","last_active":"2024-09-10T07:45:15.981182+0000","last_peered":"2024-09-10T07:45:15.981182+0000","last_clean":"2024-09-10T07:45:15.981182+0000","last_became_active":"2024-09-10T07:45:14.495410+0000","last_became_peered":"2024-09-10T07:45:14.495410+0000","last_unstale":"2024-09-10T07:45:15.981182+0000","last_undegraded":"2024-09-10T07:45:15.981182+0000","last_fullsized":"2024-09-10T07:45:15.981182+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:46.475011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.486783+0000","last_change":"2024-09-10T07:45:14.504651+0000","last_active":"2024-09-10T07:45:15.486783+0000","last_peered":"2024-09-10T07:45:15.486783+0000","last_clean":"2024-09-10T07:45:15.486783+0000","last_became_active":"2024-09-10T07:45:14.504427+0000","last_became_peered":"2024-09-10T07:45:14.504427+0000","last_unstale":"2024-09-10T07:45:15.486783+0000","last_undegraded":"2024-09-10T07:45:15.486783+0000","last_fullsized":"2024-09-10T07:45:15.486783+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:22.546286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981477+0000","last_change":"2024-09-10T07:45:14.491996+0000","last_active":"2024-09-10T07:45:15.981477+0000","last_peered":"2024-09-10T07:45:15.981477+0000","last_clean":"2024-09-10T07:45:15.981477+0000","last_became_active":"2024-09-10T07:45:14.491633+0000","last_became_peered":"2024-09-10T07:45:14.491633+0000","last_unstale":"2024-09-10T07:45:15.981477+0000","last_undegraded":"2024-09-10T07:45:15.981477+0000","last_fullsized":"2024-09-10T07:45:15.981477+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:18.967346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982432+0000","last_change":"2024-09-10T07:45:14.501207+0000","last_active":"2024-09-10T07:45:15.982432+0000","last_peered":"2024-09-10T07:45:15.982432+0000","last_clean":"2024-09-10T07:45:15.982432+0000","last_became_active":"2024-09-10T07:45:14.500534+0000","last_became_peered":"2024-09-10T07:45:14.500534+0000","last_unstale":"2024-09-10T07:45:15.982432+0000","last_undegraded":"2024-09-10T07:45:15.982432+0000","last_fullsized":"2024-09-10T07:45:15.982432+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:45.705009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981360+0000","last_change":"2024-09-10T07:45:14.501043+0000","last_active":"2024-09-10T07:45:15.981360+0000","last_peered":"2024-09-10T07:45:15.981360+0000","last_clean":"2024-09-10T07:45:15.981360+0000","last_became_active":"2024-09-10T07:45:14.500742+0000","last_became_peered":"2024-09-10T07:45:14.500742+0000","last_unstale":"2024-09-10T07:45:15.981360+0000","last_undegraded":"2024-09-10T07:45:15.981360+0000","last_fullsized":"2024-09-10T07:45:15.981360+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:32.130568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982077+0000","last_change":"2024-09-10T07:45:14.494255+0000","last_active":"2024-09-10T07:45:15.982077+0000","last_peered":"2024-09-10T07:45:15.982077+0000","last_clean":"2024-09-10T07:45:15.982077+0000","last_became_active":"2024-09-10T07:45:14.493564+0000","last_became_peered":"2024-09-10T07:45:14.493564+0000","last_unstale":"2024-09-10T07:45:15.982077+0000","last_undegraded":"2024-09-10T07:45:15.982077+0000","last_fullsized":"2024-09-10T07:45:15.982077+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:00.166980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.486943+0000","last_change":"2024-09-10T07:45:14.499794+0000","last_active":"2024-09-10T07:45:15.486943+0000","last_peered":"2024-09-10T07:45:15.486943+0000","last_clean":"2024-09-10T07:45:15.486943+0000","last_became_active":"2024-09-10T07:45:14.499498+0000","last_became_peered":"2024-09-10T07:45:14.499498+0000","last_unstale":"2024-09-10T07:45:15.486943+0000","last_undegraded":"2024-09-10T07:45:15.486943+0000","last_fullsized":"2024-09-10T07:45:15.486943+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:51.491862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.308965+0000","last_change":"2024-09-10T07:45:14.501270+0000","last_active":"2024-09-10T07:45:16.308965+0000","last_peered":"2024-09-10T07:45:16.308965+0000","last_clean":"2024-09-10T07:45:16.308965+0000","last_became_active":"2024-09-10T07:45:14.501033+0000","last_became_peered":"2024-09-10T07:45:14.501033+0000","last_unstale":"2024-09-10T07:45:16.308965+0000","last_undegraded":"2024-09-10T07:45:16.308965+0000","last_fullsized":"2024-09-10T07:45:16.308965+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:13.105786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.488522+0000","last_change":"2024-09-10T07:45:14.503049+0000","last_active":"2024-09-10T07:45:15.488522+0000","last_peered":"2024-09-10T07:45:15.488522+0000","last_clean":"2024-09-10T07:45:15.488522+0000","last_became_active":"2024-09-10T07:45:14.502795+0000","last_became_peered":"2024-09-10T07:45:14.502795+0000","last_unstale":"2024-09-10T07:45:15.488522+0000","last_undegraded":"2024-09-10T07:45:15.488522+0000","last_fullsized":"2024-09-10T07:45:15.488522+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:47.258051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773132+0000","last_change":"2024-09-10T07:45:14.507485+0000","last_active":"2024-09-10T07:45:15.773132+0000","last_peered":"2024-09-10T07:45:15.773132+0000","last_clean":"2024-09-10T07:45:15.773132+0000","last_became_active":"2024-09-10T07:45:14.507227+0000","last_became_peered":"2024-09-10T07:45:14.507227+0000","last_unstale":"2024-09-10T07:45:15.773132+0000","last_undegraded":"2024-09-10T07:45:15.773132+0000","last_fullsized":"2024-09-10T07:45:15.773132+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:18.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.487977+0000","last_change":"2024-09-10T07:45:14.502192+0000","last_active":"2024-09-10T07:45:15.487977+0000","last_peered":"2024-09-10T07:45:15.487977+0000","last_clean":"2024-09-10T07:45:15.487977+0000","last_became_active":"2024-09-10T07:45:14.501949+0000","last_became_peered":"2024-09-10T07:45:14.501949+0000","last_unstale":"2024-09-10T07:45:15.487977+0000","last_undegraded":"2024-09-10T07:45:15.487977+0000","last_fullsized":"2024-09-10T07:45:15.487977+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:18.534376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.487614+0000","last_change":"2024-09-10T07:45:14.505556+0000","last_active":"2024-09-10T07:45:15.487614+0000","last_peered":"2024-09-10T07:45:15.487614+0000","last_clean":"2024-09-10T07:45:15.487614+0000","last_became_active":"2024-09-10T07:45:14.505268+0000","last_became_peered":"2024-09-10T07:45:14.505268+0000","last_unstale":"2024-09-10T07:45:15.487614+0000","last_undegraded":"2024-09-10T07:45:15.487614+0000","last_fullsized":"2024-09-10T07:45:15.487614+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:22.625475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.487981+0000","last_change":"2024-09-10T07:45:14.499069+0000","last_active":"2024-09-10T07:45:15.487981+0000","last_peered":"2024-09-10T07:45:15.487981+0000","last_clean":"2024-09-10T07:45:15.487981+0000","last_became_active":"2024-09-10T07:45:14.497673+0000","last_became_peered":"2024-09-10T07:45:14.497673+0000","last_unstale":"2024-09-10T07:45:15.487981+0000","last_undegraded":"2024-09-10T07:45:15.487981+0000","last_fullsized":"2024-09-10T07:45:15.487981+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:44.504972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483038+0000","last_change":"2024-09-10T07:45:14.491048+0000","last_active":"2024-09-10T07:45:15.483038+0000","last_peered":"2024-09-10T07:45:15.483038+0000","last_clean":"2024-09-10T07:45:15.483038+0000","last_became_active":"2024-09-10T07:45:14.490602+0000","last_became_peered":"2024-09-10T07:45:14.490602+0000","last_unstale":"2024-09-10T07:45:15.483038+0000","last_undegraded":"2024-09-10T07:45:15.483038+0000","last_fullsized":"2024-09-10T07:45:15.483038+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:09:54.239993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.308716+0000","last_change":"2024-09-10T07:45:14.501435+0000","last_active":"2024-09-10T07:45:16.308716+0000","last_peered":"2024-09-10T07:45:16.308716+0000","last_clean":"2024-09-10T07:45:16.308716+0000","last_became_active":"2024-09-10T07:45:14.501214+0000","last_became_peered":"2024-09-10T07:45:14.501214+0000","last_unstale":"2024-09-10T07:45:16.308716+0000","last_undegraded":"2024-09-10T07:45:16.308716+0000","last_fullsized":"2024-09-10T07:45:16.308716+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:42.730650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"187'4","reported_seq":18,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.774908+0000","last_change":"2024-09-10T07:45:13.489879+0000","last_active":"2024-09-10T07:45:15.774908+0000","last_peered":"2024-09-10T07:45:15.774908+0000","last_clean":"2024-09-10T07:45:15.774908+0000","last_became_active":"2024-09-10T07:45:13.489591+0000","last_became_peered":"2024-09-10T07:45:13.489591+0000","last_unstale":"2024-09-10T07:45:15.774908+0000","last_undegraded":"2024-09-10T07:45:15.774908+0000","last_fullsized":"2024-09-10T07:45:15.774908+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:47.234103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.487264+0000","last_change":"2024-09-10T07:45:14.499902+0000","last_active":"2024-09-10T07:45:15.487264+0000","last_peered":"2024-09-10T07:45:15.487264+0000","last_clean":"2024-09-10T07:45:15.487264+0000","last_became_active":"2024-09-10T07:45:14.498476+0000","last_became_peered":"2024-09-10T07:45:14.498476+0000","last_unstale":"2024-09-10T07:45:15.487264+0000","last_undegraded":"2024-09-10T07:45:15.487264+0000","last_fullsized":"2024-09-10T07:45:15.487264+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:26.651971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"187'1","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.486776+0000","last_change":"2024-09-10T07:45:13.495211+0000","last_active":"2024-09-10T07:45:15.486776+0000","last_peered":"2024-09-10T07:45:15.486776+0000","last_clean":"2024-09-10T07:45:15.486776+0000","last_became_active":"2024-09-10T07:45:13.494972+0000","last_became_peered":"2024-09-10T07:45:13.494972+0000","last_unstale":"2024-09-10T07:45:15.486776+0000","last_undegraded":"2024-09-10T07:45:15.486776+0000","last_fullsized":"2024-09-10T07:45:15.486776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:14.069679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981629+0000","last_change":"2024-09-10T07:45:14.506318+0000","last_active":"2024-09-10T07:45:15.981629+0000","last_peered":"2024-09-10T07:45:15.981629+0000","last_clean":"2024-09-10T07:45:15.981629+0000","last_became_active":"2024-09-10T07:45:14.506067+0000","last_became_peered":"2024-09-10T07:45:14.506067+0000","last_unstale":"2024-09-10T07:45:15.981629+0000","last_undegraded":"2024-09-10T07:45:15.981629+0000","last_fullsized":"2024-09-10T07:45:15.981629+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:28.433885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"187'2","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773524+0000","last_change":"2024-09-10T07:45:13.494848+0000","last_active":"2024-09-10T07:45:15.773524+0000","last_peered":"2024-09-10T07:45:15.773524+0000","last_clean":"2024-09-10T07:45:15.773524+0000","last_became_active":"2024-09-10T07:45:13.494606+0000","last_became_peered":"2024-09-10T07:45:13.494606+0000","last_unstale":"2024-09-10T07:45:15.773524+0000","last_undegraded":"2024-09-10T07:45:15.773524+0000","last_fullsized":"2024-09-10T07:45:15.773524+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:11:23.633570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.487102+0000","last_change":"2024-09-10T07:45:14.494870+0000","last_active":"2024-09-10T07:45:15.487102+0000","last_peered":"2024-09-10T07:45:15.487102+0000","last_clean":"2024-09-10T07:45:15.487102+0000","last_became_active":"2024-09-10T07:45:14.494506+0000","last_became_peered":"2024-09-10T07:45:14.494506+0000","last_unstale":"2024-09-10T07:45:15.487102+0000","last_undegraded":"2024-09-10T07:45:15.487102+0000","last_fullsized":"2024-09-10T07:45:15.487102+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:32.852840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"187'2","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773139+0000","last_change":"2024-09-10T07:45:13.488765+0000","last_active":"2024-09-10T07:45:15.773139+0000","last_peered":"2024-09-10T07:45:15.773139+0000","last_clean":"2024-09-10T07:45:15.773139+0000","last_became_active":"2024-09-10T07:45:13.488519+0000","last_became_peered":"2024-09-10T07:45:13.488519+0000","last_unstale":"2024-09-10T07:45:15.773139+0000","last_undegraded":"2024-09-10T07:45:15.773139+0000","last_fullsized":"2024-09-10T07:45:15.773139+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:38.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.308718+0000","last_change":"2024-09-10T07:45:14.490905+0000","last_active":"2024-09-10T07:45:16.308718+0000","last_peered":"2024-09-10T07:45:16.308718+0000","last_clean":"2024-09-10T07:45:16.308718+0000","last_became_active":"2024-09-10T07:45:14.490457+0000","last_became_peered":"2024-09-10T07:45:14.490457+0000","last_unstale":"2024-09-10T07:45:16.308718+0000","last_undegraded":"2024-09-10T07:45:16.308718+0000","last_fullsized":"2024-09-10T07:45:16.308718+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:41.621870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"187'1","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.488761+0000","last_change":"2024-09-10T07:45:13.491505+0000","last_active":"2024-09-10T07:45:15.488761+0000","last_peered":"2024-09-10T07:45:15.488761+0000","last_clean":"2024-09-10T07:45:15.488761+0000","last_became_active":"2024-09-10T07:45:13.490844+0000","last_became_peered":"2024-09-10T07:45:13.490844+0000","last_unstale":"2024-09-10T07:45:15.488761+0000","last_undegraded":"2024-09-10T07:45:15.488761+0000","last_fullsized":"2024-09-10T07:45:15.488761+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:24.980063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773013+0000","last_change":"2024-09-10T07:45:14.503805+0000","last_active":"2024-09-10T07:45:15.773013+0000","last_peered":"2024-09-10T07:45:15.773013+0000","last_clean":"2024-09-10T07:45:15.773013+0000","last_became_active":"2024-09-10T07:45:14.502715+0000","last_became_peered":"2024-09-10T07:45:14.502715+0000","last_unstale":"2024-09-10T07:45:15.773013+0000","last_undegraded":"2024-09-10T07:45:15.773013+0000","last_fullsized":"2024-09-10T07:45:15.773013+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:14.288769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"187'1","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773236+0000","last_change":"2024-09-10T07:45:13.491925+0000","last_active":"2024-09-10T07:45:15.773236+0000","last_peered":"2024-09-10T07:45:15.773236+0000","last_clean":"2024-09-10T07:45:15.773236+0000","last_became_active":"2024-09-10T07:45:13.491691+0000","last_became_peered":"2024-09-10T07:45:13.491691+0000","last_unstale":"2024-09-10T07:45:15.773236+0000","last_undegraded":"2024-09-10T07:45:15.773236+0000","last_fullsized":"2024-09-10T07:45:15.773236+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:26.522888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773174+0000","last_change":"2024-09-10T07:45:14.508355+0000","last_active":"2024-09-10T07:45:15.773174+0000","last_peered":"2024-09-10T07:45:15.773174+0000","last_clean":"2024-09-10T07:45:15.773174+0000","last_became_active":"2024-09-10T07:45:14.508109+0000","last_became_peered":"2024-09-10T07:45:14.508109+0000","last_unstale":"2024-09-10T07:45:15.773174+0000","last_undegraded":"2024-09-10T07:45:15.773174+0000","last_fullsized":"2024-09-10T07:45:15.773174+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:38.703654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982329+0000","last_change":"2024-09-10T07:45:13.493259+0000","last_active":"2024-09-10T07:45:15.982329+0000","last_peered":"2024-09-10T07:45:15.982329+0000","last_clean":"2024-09-10T07:45:15.982329+0000","last_became_active":"2024-09-10T07:45:13.492627+0000","last_became_peered":"2024-09-10T07:45:13.492627+0000","last_unstale":"2024-09-10T07:45:15.982329+0000","last_undegraded":"2024-09-10T07:45:15.982329+0000","last_fullsized":"2024-09-10T07:45:15.982329+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:47.075207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981349+0000","last_change":"2024-09-10T07:45:14.489805+0000","last_active":"2024-09-10T07:45:15.981349+0000","last_peered":"2024-09-10T07:45:15.981349+0000","last_clean":"2024-09-10T07:45:15.981349+0000","last_became_active":"2024-09-10T07:45:14.489577+0000","last_became_peered":"2024-09-10T07:45:14.489577+0000","last_unstale":"2024-09-10T07:45:15.981349+0000","last_undegraded":"2024-09-10T07:45:15.981349+0000","last_fullsized":"2024-09-10T07:45:15.981349+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:57.155637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.308781+0000","last_change":"2024-09-10T07:45:13.489752+0000","last_active":"2024-09-10T07:45:16.308781+0000","last_peered":"2024-09-10T07:45:16.308781+0000","last_clean":"2024-09-10T07:45:16.308781+0000","last_became_active":"2024-09-10T07:45:13.489485+0000","last_became_peered":"2024-09-10T07:45:13.489485+0000","last_unstale":"2024-09-10T07:45:16.308781+0000","last_undegraded":"2024-09-10T07:45:16.308781+0000","last_fullsized":"2024-09-10T07:45:16.308781+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:42.994710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483157+0000","last_change":"2024-09-10T07:45:14.500523+0000","last_active":"2024-09-10T07:45:15.483157+0000","last_peered":"2024-09-10T07:45:15.483157+0000","last_clean":"2024-09-10T07:45:15.483157+0000","last_became_active":"2024-09-10T07:45:14.500251+0000","last_became_peered":"2024-09-10T07:45:14.500251+0000","last_unstale":"2024-09-10T07:45:15.483157+0000","last_undegraded":"2024-09-10T07:45:15.483157+0000","last_fullsized":"2024-09-10T07:45:15.483157+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:34.429632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981476+0000","last_change":"2024-09-10T07:45:13.486948+0000","last_active":"2024-09-10T07:45:15.981476+0000","last_peered":"2024-09-10T07:45:15.981476+0000","last_clean":"2024-09-10T07:45:15.981476+0000","last_became_active":"2024-09-10T07:45:13.486724+0000","last_became_peered":"2024-09-10T07:45:13.486724+0000","last_unstale":"2024-09-10T07:45:15.981476+0000","last_undegraded":"2024-09-10T07:45:15.981476+0000","last_fullsized":"2024-09-10T07:45:15.981476+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:21.542351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483442+0000","last_change":"2024-09-10T07:45:14.502685+0000","last_active":"2024-09-10T07:45:15.483442+0000","last_peered":"2024-09-10T07:45:15.483442+0000","last_clean":"2024-09-10T07:45:15.483442+0000","last_became_active":"2024-09-10T07:45:14.502354+0000","last_became_peered":"2024-09-10T07:45:14.502354+0000","last_unstale":"2024-09-10T07:45:15.483442+0000","last_undegraded":"2024-09-10T07:45:15.483442+0000","last_fullsized":"2024-09-10T07:45:15.483442+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:43.237794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"187'3","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981502+0000","last_change":"2024-09-10T07:45:13.485371+0000","last_active":"2024-09-10T07:45:15.981502+0000","last_peered":"2024-09-10T07:45:15.981502+0000","last_clean":"2024-09-10T07:45:15.981502+0000","last_became_active":"2024-09-10T07:45:13.485149+0000","last_became_peered":"2024-09-10T07:45:13.485149+0000","last_unstale":"2024-09-10T07:45:15.981502+0000","last_undegraded":"2024-09-10T07:45:15.981502+0000","last_fullsized":"2024-09-10T07:45:15.981502+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:04.617073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.487410+0000","last_change":"2024-09-10T07:45:14.500241+0000","last_active":"2024-09-10T07:45:15.487410+0000","last_peered":"2024-09-10T07:45:15.487410+0000","last_clean":"2024-09-10T07:45:15.487410+0000","last_became_active":"2024-09-10T07:45:14.498901+0000","last_became_peered":"2024-09-10T07:45:14.498901+0000","last_unstale":"2024-09-10T07:45:15.487410+0000","last_undegraded":"2024-09-10T07:45:15.487410+0000","last_fullsized":"2024-09-10T07:45:15.487410+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:39.451951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"187'6","reported_seq":20,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.486879+0000","last_change":"2024-09-10T07:45:13.494393+0000","last_active":"2024-09-10T07:45:15.486879+0000","last_peered":"2024-09-10T07:45:15.486879+0000","last_clean":"2024-09-10T07:45:15.486879+0000","last_became_active":"2024-09-10T07:45:13.493207+0000","last_became_peered":"2024-09-10T07:45:13.493207+0000","last_unstale":"2024-09-10T07:45:15.486879+0000","last_undegraded":"2024-09-10T07:45:15.486879+0000","last_fullsized":"2024-09-10T07:45:15.486879+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:56.962040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483296+0000","last_change":"2024-09-10T07:45:14.494476+0000","last_active":"2024-09-10T07:45:15.483296+0000","last_peered":"2024-09-10T07:45:15.483296+0000","last_clean":"2024-09-10T07:45:15.483296+0000","last_became_active":"2024-09-10T07:45:14.494196+0000","last_became_peered":"2024-09-10T07:45:14.494196+0000","last_unstale":"2024-09-10T07:45:15.483296+0000","last_undegraded":"2024-09-10T07:45:15.483296+0000","last_fullsized":"2024-09-10T07:45:15.483296+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:34.490220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"187'2","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773638+0000","last_change":"2024-09-10T07:45:13.493134+0000","last_active":"2024-09-10T07:45:15.773638+0000","last_peered":"2024-09-10T07:45:15.773638+0000","last_clean":"2024-09-10T07:45:15.773638+0000","last_became_active":"2024-09-10T07:45:13.492396+0000","last_became_peered":"2024-09-10T07:45:13.492396+0000","last_unstale":"2024-09-10T07:45:15.773638+0000","last_undegraded":"2024-09-10T07:45:15.773638+0000","last_fullsized":"2024-09-10T07:45:15.773638+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:05.965991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.308710+0000","last_change":"2024-09-10T07:45:14.489903+0000","last_active":"2024-09-10T07:45:16.308710+0000","last_peered":"2024-09-10T07:45:16.308710+0000","last_clean":"2024-09-10T07:45:16.308710+0000","last_became_active":"2024-09-10T07:45:14.489057+0000","last_became_peered":"2024-09-10T07:45:14.489057+0000","last_unstale":"2024-09-10T07:45:16.308710+0000","last_undegraded":"2024-09-10T07:45:16.308710+0000","last_fullsized":"2024-09-10T07:45:16.308710+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:09.687062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483379+0000","last_change":"2024-09-10T07:45:13.488620+0000","last_active":"2024-09-10T07:45:15.483379+0000","last_peered":"2024-09-10T07:45:15.483379+0000","last_clean":"2024-09-10T07:45:15.483379+0000","last_became_active":"2024-09-10T07:45:13.487630+0000","last_became_peered":"2024-09-10T07:45:13.487630+0000","last_unstale":"2024-09-10T07:45:15.483379+0000","last_undegraded":"2024-09-10T07:45:15.483379+0000","last_fullsized":"2024-09-10T07:45:15.483379+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:59.801524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.772948+0000","last_change":"2024-09-10T07:45:14.506190+0000","last_active":"2024-09-10T07:45:15.772948+0000","last_peered":"2024-09-10T07:45:15.772948+0000","last_clean":"2024-09-10T07:45:15.772948+0000","last_became_active":"2024-09-10T07:45:14.505562+0000","last_became_peered":"2024-09-10T07:45:14.505562+0000","last_unstale":"2024-09-10T07:45:15.772948+0000","last_undegraded":"2024-09-10T07:45:15.772948+0000","last_fullsized":"2024-09-10T07:45:15.772948+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:15.072637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773231+0000","last_change":"2024-09-10T07:45:13.494629+0000","last_active":"2024-09-10T07:45:15.773231+0000","last_peered":"2024-09-10T07:45:15.773231+0000","last_clean":"2024-09-10T07:45:15.773231+0000","last_became_active":"2024-09-10T07:45:13.494376+0000","last_became_peered":"2024-09-10T07:45:13.494376+0000","last_unstale":"2024-09-10T07:45:15.773231+0000","last_undegraded":"2024-09-10T07:45:15.773231+0000","last_fullsized":"2024-09-10T07:45:15.773231+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:11.902760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.488662+0000","last_change":"2024-09-10T07:45:14.491967+0000","last_active":"2024-09-10T07:45:15.488662+0000","last_peered":"2024-09-10T07:45:15.488662+0000","last_clean":"2024-09-10T07:45:15.488662+0000","last_became_active":"2024-09-10T07:45:14.491313+0000","last_became_peered":"2024-09-10T07:45:14.491313+0000","last_unstale":"2024-09-10T07:45:15.488662+0000","last_undegraded":"2024-09-10T07:45:15.488662+0000","last_fullsized":"2024-09-10T07:45:15.488662+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:05.501694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"187'8","reported_seq":22,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.487631+0000","last_change":"2024-09-10T07:45:13.494629+0000","last_active":"2024-09-10T07:45:15.487631+0000","last_peered":"2024-09-10T07:45:15.487631+0000","last_clean":"2024-09-10T07:45:15.487631+0000","last_became_active":"2024-09-10T07:45:13.493900+0000","last_became_peered":"2024-09-10T07:45:13.493900+0000","last_unstale":"2024-09-10T07:45:15.487631+0000","last_undegraded":"2024-09-10T07:45:15.487631+0000","last_fullsized":"2024-09-10T07:45:15.487631+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:37.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773442+0000","last_change":"2024-09-10T07:45:14.505772+0000","last_active":"2024-09-10T07:45:15.773442+0000","last_peered":"2024-09-10T07:45:15.773442+0000","last_clean":"2024-09-10T07:45:15.773442+0000","last_became_active":"2024-09-10T07:45:14.505499+0000","last_became_peered":"2024-09-10T07:45:14.505499+0000","last_unstale":"2024-09-10T07:45:15.773442+0000","last_undegraded":"2024-09-10T07:45:15.773442+0000","last_fullsized":"2024-09-10T07:45:15.773442+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:16.353775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"187'1","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.488253+0000","last_change":"2024-09-10T07:45:13.495496+0000","last_active":"2024-09-10T07:45:15.488253+0000","last_peered":"2024-09-10T07:45:15.488253+0000","last_clean":"2024-09-10T07:45:15.488253+0000","last_became_active":"2024-09-10T07:45:13.494073+0000","last_became_peered":"2024-09-10T07:45:13.494073+0000","last_unstale":"2024-09-10T07:45:15.488253+0000","last_undegraded":"2024-09-10T07:45:15.488253+0000","last_fullsized":"2024-09-10T07:45:15.488253+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:32.253708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483078+0000","last_change":"2024-09-10T07:45:14.498251+0000","last_active":"2024-09-10T07:45:15.483078+0000","last_peered":"2024-09-10T07:45:15.483078+0000","last_clean":"2024-09-10T07:45:15.483078+0000","last_became_active":"2024-09-10T07:45:14.497977+0000","last_became_peered":"2024-09-10T07:45:14.497977+0000","last_unstale":"2024-09-10T07:45:15.483078+0000","last_undegraded":"2024-09-10T07:45:15.483078+0000","last_fullsized":"2024-09-10T07:45:15.483078+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:53.285682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"187'2","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.487326+0000","last_change":"2024-09-10T07:45:13.489586+0000","last_active":"2024-09-10T07:45:15.487326+0000","last_peered":"2024-09-10T07:45:15.487326+0000","last_clean":"2024-09-10T07:45:15.487326+0000","last_became_active":"2024-09-10T07:45:13.488127+0000","last_became_peered":"2024-09-10T07:45:13.488127+0000","last_unstale":"2024-09-10T07:45:15.487326+0000","last_undegraded":"2024-09-10T07:45:15.487326+0000","last_fullsized":"2024-09-10T07:45:15.487326+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:32.171191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773174+0000","last_change":"2024-09-10T07:45:14.503030+0000","last_active":"2024-09-10T07:45:15.773174+0000","last_peered":"2024-09-10T07:45:15.773174+0000","last_clean":"2024-09-10T07:45:15.773174+0000","last_became_active":"2024-09-10T07:45:14.502285+0000","last_became_peered":"2024-09-10T07:45:14.502285+0000","last_unstale":"2024-09-10T07:45:15.773174+0000","last_undegraded":"2024-09-10T07:45:15.773174+0000","last_fullsized":"2024-09-10T07:45:15.773174+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:55.100210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"187'1","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.775224+0000","last_change":"2024-09-10T07:45:13.495516+0000","last_active":"2024-09-10T07:45:15.775224+0000","last_peered":"2024-09-10T07:45:15.775224+0000","last_clean":"2024-09-10T07:45:15.775224+0000","last_became_active":"2024-09-10T07:45:13.494631+0000","last_became_peered":"2024-09-10T07:45:13.494631+0000","last_unstale":"2024-09-10T07:45:15.775224+0000","last_undegraded":"2024-09-10T07:45:15.775224+0000","last_fullsized":"2024-09-10T07:45:15.775224+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:52.291494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.309278+0000","last_change":"2024-09-10T07:45:14.500705+0000","last_active":"2024-09-10T07:45:16.309278+0000","last_peered":"2024-09-10T07:45:16.309278+0000","last_clean":"2024-09-10T07:45:16.309278+0000","last_became_active":"2024-09-10T07:45:14.500361+0000","last_became_peered":"2024-09-10T07:45:14.500361+0000","last_unstale":"2024-09-10T07:45:16.309278+0000","last_undegraded":"2024-09-10T07:45:16.309278+0000","last_fullsized":"2024-09-10T07:45:16.309278+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:27.183315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.774735+0000","last_change":"2024-09-10T07:45:13.483268+0000","last_active":"2024-09-10T07:45:15.774735+0000","last_peered":"2024-09-10T07:45:15.774735+0000","last_clean":"2024-09-10T07:45:15.774735+0000","last_became_active":"2024-09-10T07:45:13.482729+0000","last_became_peered":"2024-09-10T07:45:13.482729+0000","last_unstale":"2024-09-10T07:45:15.774735+0000","last_undegraded":"2024-09-10T07:45:15.774735+0000","last_fullsized":"2024-09-10T07:45:15.774735+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:26.795427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.488135+0000","last_change":"2024-09-10T07:45:14.489824+0000","last_active":"2024-09-10T07:45:15.488135+0000","last_peered":"2024-09-10T07:45:15.488135+0000","last_clean":"2024-09-10T07:45:15.488135+0000","last_became_active":"2024-09-10T07:45:14.489376+0000","last_became_peered":"2024-09-10T07:45:14.489376+0000","last_unstale":"2024-09-10T07:45:15.488135+0000","last_undegraded":"2024-09-10T07:45:15.488135+0000","last_fullsized":"2024-09-10T07:45:15.488135+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:24.008947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"187'2","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773295+0000","last_change":"2024-09-10T07:45:13.495232+0000","last_active":"2024-09-10T07:45:15.773295+0000","last_peered":"2024-09-10T07:45:15.773295+0000","last_clean":"2024-09-10T07:45:15.773295+0000","last_became_active":"2024-09-10T07:45:13.494644+0000","last_became_peered":"2024-09-10T07:45:13.494644+0000","last_unstale":"2024-09-10T07:45:15.773295+0000","last_undegraded":"2024-09-10T07:45:15.773295+0000","last_fullsized":"2024-09-10T07:45:15.773295+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:27.310440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.308891+0000","last_change":"2024-09-10T07:45:14.506613+0000","last_active":"2024-09-10T07:45:16.308891+0000","last_peered":"2024-09-10T07:45:16.308891+0000","last_clean":"2024-09-10T07:45:16.308891+0000","last_became_active":"2024-09-10T07:45:14.506377+0000","last_became_peered":"2024-09-10T07:45:14.506377+0000","last_unstale":"2024-09-10T07:45:16.308891+0000","last_undegraded":"2024-09-10T07:45:16.308891+0000","last_fullsized":"2024-09-10T07:45:16.308891+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:17.009251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.774996+0000","last_change":"2024-09-10T07:45:13.490554+0000","last_active":"2024-09-10T07:45:15.774996+0000","last_peered":"2024-09-10T07:45:15.774996+0000","last_clean":"2024-09-10T07:45:15.774996+0000","last_became_active":"2024-09-10T07:45:13.489801+0000","last_became_peered":"2024-09-10T07:45:13.489801+0000","last_unstale":"2024-09-10T07:45:15.774996+0000","last_undegraded":"2024-09-10T07:45:15.774996+0000","last_fullsized":"2024-09-10T07:45:15.774996+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:15.251708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.774967+0000","last_change":"2024-09-10T07:45:14.511285+0000","last_active":"2024-09-10T07:45:15.774967+0000","last_peered":"2024-09-10T07:45:15.774967+0000","last_clean":"2024-09-10T07:45:15.774967+0000","last_became_active":"2024-09-10T07:45:14.511063+0000","last_became_peered":"2024-09-10T07:45:14.511063+0000","last_unstale":"2024-09-10T07:45:15.774967+0000","last_undegraded":"2024-09-10T07:45:15.774967+0000","last_fullsized":"2024-09-10T07:45:15.774967+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:00.856056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773734+0000","last_change":"2024-09-10T07:45:13.493344+0000","last_active":"2024-09-10T07:45:15.773734+0000","last_peered":"2024-09-10T07:45:15.773734+0000","last_clean":"2024-09-10T07:45:15.773734+0000","last_became_active":"2024-09-10T07:45:13.492879+0000","last_became_peered":"2024-09-10T07:45:13.492879+0000","last_unstale":"2024-09-10T07:45:15.773734+0000","last_undegraded":"2024-09-10T07:45:15.773734+0000","last_fullsized":"2024-09-10T07:45:15.773734+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:36.713878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981474+0000","last_change":"2024-09-10T07:45:14.503062+0000","last_active":"2024-09-10T07:45:15.981474+0000","last_peered":"2024-09-10T07:45:15.981474+0000","last_clean":"2024-09-10T07:45:15.981474+0000","last_became_active":"2024-09-10T07:45:14.501929+0000","last_became_peered":"2024-09-10T07:45:14.501929+0000","last_unstale":"2024-09-10T07:45:15.981474+0000","last_undegraded":"2024-09-10T07:45:15.981474+0000","last_fullsized":"2024-09-10T07:45:15.981474+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:04.570724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.775284+0000","last_change":"2024-09-10T07:45:13.496002+0000","last_active":"2024-09-10T07:45:15.775284+0000","last_peered":"2024-09-10T07:45:15.775284+0000","last_clean":"2024-09-10T07:45:15.775284+0000","last_became_active":"2024-09-10T07:45:13.494979+0000","last_became_peered":"2024-09-10T07:45:13.494979+0000","last_unstale":"2024-09-10T07:45:15.775284+0000","last_undegraded":"2024-09-10T07:45:15.775284+0000","last_fullsized":"2024-09-10T07:45:15.775284+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:11.549651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483344+0000","last_change":"2024-09-10T07:45:14.505847+0000","last_active":"2024-09-10T07:45:15.483344+0000","last_peered":"2024-09-10T07:45:15.483344+0000","last_clean":"2024-09-10T07:45:15.483344+0000","last_became_active":"2024-09-10T07:45:14.505623+0000","last_became_peered":"2024-09-10T07:45:14.505623+0000","last_unstale":"2024-09-10T07:45:15.483344+0000","last_undegraded":"2024-09-10T07:45:15.483344+0000","last_fullsized":"2024-09-10T07:45:15.483344+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:33.148336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"187'2","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483474+0000","last_change":"2024-09-10T07:45:13.495032+0000","last_active":"2024-09-10T07:45:15.483474+0000","last_peered":"2024-09-10T07:45:15.483474+0000","last_clean":"2024-09-10T07:45:15.483474+0000","last_became_active":"2024-09-10T07:45:13.493962+0000","last_became_peered":"2024-09-10T07:45:13.493962+0000","last_unstale":"2024-09-10T07:45:15.483474+0000","last_undegraded":"2024-09-10T07:45:15.483474+0000","last_fullsized":"2024-09-10T07:45:15.483474+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:04.488277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.308984+0000","last_change":"2024-09-10T07:45:14.507790+0000","last_active":"2024-09-10T07:45:16.308984+0000","last_peered":"2024-09-10T07:45:16.308984+0000","last_clean":"2024-09-10T07:45:16.308984+0000","last_became_active":"2024-09-10T07:45:14.507130+0000","last_became_peered":"2024-09-10T07:45:14.507130+0000","last_unstale":"2024-09-10T07:45:16.308984+0000","last_undegraded":"2024-09-10T07:45:16.308984+0000","last_fullsized":"2024-09-10T07:45:16.308984+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:00.803478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"188'1","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.487079+0000","last_change":"2024-09-10T07:45:13.490792+0000","last_active":"2024-09-10T07:45:15.487079+0000","last_peered":"2024-09-10T07:45:15.487079+0000","last_clean":"2024-09-10T07:45:15.487079+0000","last_became_active":"2024-09-10T07:45:13.490546+0000","last_became_peered":"2024-09-10T07:45:13.490546+0000","last_unstale":"2024-09-10T07:45:15.487079+0000","last_undegraded":"2024-09-10T07:45:15.487079+0000","last_fullsized":"2024-09-10T07:45:15.487079+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:25.048231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.981613+0000","last_change":"2024-09-10T07:45:14.503359+0000","last_active":"2024-09-10T07:45:15.981613+0000","last_peered":"2024-09-10T07:45:15.981613+0000","last_clean":"2024-09-10T07:45:15.981613+0000","last_became_active":"2024-09-10T07:45:14.502778+0000","last_became_peered":"2024-09-10T07:45:14.502778+0000","last_unstale":"2024-09-10T07:45:15.981613+0000","last_undegraded":"2024-09-10T07:45:15.981613+0000","last_fullsized":"2024-09-10T07:45:15.981613+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:34.398191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982537+0000","last_change":"2024-09-10T07:45:13.493014+0000","last_active":"2024-09-10T07:45:15.982537+0000","last_peered":"2024-09-10T07:45:15.982537+0000","last_clean":"2024-09-10T07:45:15.982537+0000","last_became_active":"2024-09-10T07:45:13.492313+0000","last_became_peered":"2024-09-10T07:45:13.492313+0000","last_unstale":"2024-09-10T07:45:15.982537+0000","last_undegraded":"2024-09-10T07:45:15.982537+0000","last_fullsized":"2024-09-10T07:45:15.982537+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:51.297538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483245+0000","last_change":"2024-09-10T07:45:14.506474+0000","last_active":"2024-09-10T07:45:15.483245+0000","last_peered":"2024-09-10T07:45:15.483245+0000","last_clean":"2024-09-10T07:45:15.483245+0000","last_became_active":"2024-09-10T07:45:14.506246+0000","last_became_peered":"2024-09-10T07:45:14.506246+0000","last_unstale":"2024-09-10T07:45:15.483245+0000","last_undegraded":"2024-09-10T07:45:15.483245+0000","last_fullsized":"2024-09-10T07:45:15.483245+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:49.883495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483224+0000","last_change":"2024-09-10T07:45:13.490777+0000","last_active":"2024-09-10T07:45:15.483224+0000","last_peered":"2024-09-10T07:45:15.483224+0000","last_clean":"2024-09-10T07:45:15.483224+0000","last_became_active":"2024-09-10T07:45:13.490461+0000","last_became_peered":"2024-09-10T07:45:13.490461+0000","last_unstale":"2024-09-10T07:45:15.483224+0000","last_undegraded":"2024-09-10T07:45:15.483224+0000","last_fullsized":"2024-09-10T07:45:15.483224+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:41.375970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483351+0000","last_change":"2024-09-10T07:45:14.490855+0000","last_active":"2024-09-10T07:45:15.483351+0000","last_peered":"2024-09-10T07:45:15.483351+0000","last_clean":"2024-09-10T07:45:15.483351+0000","last_became_active":"2024-09-10T07:45:14.490283+0000","last_became_peered":"2024-09-10T07:45:14.490283+0000","last_unstale":"2024-09-10T07:45:15.483351+0000","last_undegraded":"2024-09-10T07:45:15.483351+0000","last_fullsized":"2024-09-10T07:45:15.483351+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:24.822625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.488560+0000","last_change":"2024-09-10T07:45:13.495161+0000","last_active":"2024-09-10T07:45:15.488560+0000","last_peered":"2024-09-10T07:45:15.488560+0000","last_clean":"2024-09-10T07:45:15.488560+0000","last_became_active":"2024-09-10T07:45:13.493415+0000","last_became_peered":"2024-09-10T07:45:13.493415+0000","last_unstale":"2024-09-10T07:45:15.488560+0000","last_undegraded":"2024-09-10T07:45:15.488560+0000","last_fullsized":"2024-09-10T07:45:15.488560+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:38.286040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.488132+0000","last_change":"2024-09-10T07:45:14.498037+0000","last_active":"2024-09-10T07:45:15.488132+0000","last_peered":"2024-09-10T07:45:15.488132+0000","last_clean":"2024-09-10T07:45:15.488132+0000","last_became_active":"2024-09-10T07:45:14.496466+0000","last_became_peered":"2024-09-10T07:45:14.496466+0000","last_unstale":"2024-09-10T07:45:15.488132+0000","last_undegraded":"2024-09-10T07:45:15.488132+0000","last_fullsized":"2024-09-10T07:45:15.488132+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:07.243300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.773284+0000","last_change":"2024-09-10T07:45:13.493142+0000","last_active":"2024-09-10T07:45:15.773284+0000","last_peered":"2024-09-10T07:45:15.773284+0000","last_clean":"2024-09-10T07:45:15.773284+0000","last_became_active":"2024-09-10T07:45:13.492895+0000","last_became_peered":"2024-09-10T07:45:13.492895+0000","last_unstale":"2024-09-10T07:45:15.773284+0000","last_undegraded":"2024-09-10T07:45:15.773284+0000","last_fullsized":"2024-09-10T07:45:15.773284+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:06.996866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:16.308900+0000","last_change":"2024-09-10T07:45:14.508866+0000","last_active":"2024-09-10T07:45:16.308900+0000","last_peered":"2024-09-10T07:45:16.308900+0000","last_clean":"2024-09-10T07:45:16.308900+0000","last_became_active":"2024-09-10T07:45:14.508088+0000","last_became_peered":"2024-09-10T07:45:14.508088+0000","last_unstale":"2024-09-10T07:45:16.308900+0000","last_undegraded":"2024-09-10T07:45:16.308900+0000","last_fullsized":"2024-09-10T07:45:16.308900+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:14.046338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.982387+0000","last_change":"2024-09-10T07:45:13.493413+0000","last_active":"2024-09-10T07:45:15.982387+0000","last_peered":"2024-09-10T07:45:15.982387+0000","last_clean":"2024-09-10T07:45:15.982387+0000","last_became_active":"2024-09-10T07:45:13.493167+0000","last_became_peered":"2024-09-10T07:45:13.493167+0000","last_unstale":"2024-09-10T07:45:15.982387+0000","last_undegraded":"2024-09-10T07:45:15.982387+0000","last_fullsized":"2024-09-10T07:45:15.982387+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:27.055126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.486897+0000","last_change":"2024-09-10T07:45:14.495269+0000","last_active":"2024-09-10T07:45:15.486897+0000","last_peered":"2024-09-10T07:45:15.486897+0000","last_clean":"2024-09-10T07:45:15.486897+0000","last_became_active":"2024-09-10T07:45:14.494569+0000","last_became_peered":"2024-09-10T07:45:14.494569+0000","last_unstale":"2024-09-10T07:45:15.486897+0000","last_undegraded":"2024-09-10T07:45:15.486897+0000","last_fullsized":"2024-09-10T07:45:15.486897+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:58.024337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.486971+0000","last_change":"2024-09-10T07:45:13.496896+0000","last_active":"2024-09-10T07:45:15.486971+0000","last_peered":"2024-09-10T07:45:15.486971+0000","last_clean":"2024-09-10T07:45:15.486971+0000","last_became_active":"2024-09-10T07:45:13.496649+0000","last_became_peered":"2024-09-10T07:45:13.496649+0000","last_unstale":"2024-09-10T07:45:15.486971+0000","last_undegraded":"2024-09-10T07:45:15.486971+0000","last_fullsized":"2024-09-10T07:45:15.486971+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:25.667827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.483214+0000","last_change":"2024-09-10T07:45:14.501021+0000","last_active":"2024-09-10T07:45:15.483214+0000","last_peered":"2024-09-10T07:45:15.483214+0000","last_clean":"2024-09-10T07:45:15.483214+0000","last_became_active":"2024-09-10T07:45:14.499853+0000","last_became_peered":"2024-09-10T07:45:14.499853+0000","last_unstale":"2024-09-10T07:45:15.483214+0000","last_undegraded":"2024-09-10T07:45:15.483214+0000","last_fullsized":"2024-09-10T07:45:15.483214+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:13.470222+0000","last_clean_scrub_stamp":"2024-09-10T07:45:13.470222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:13.580691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.488387+0000","last_change":"2024-09-10T07:45:13.495683+0000","last_active":"2024-09-10T07:45:15.488387+0000","last_peered":"2024-09-10T07:45:15.488387+0000","last_clean":"2024-09-10T07:45:15.488387+0000","last_became_active":"2024-09-10T07:45:13.495457+0000","last_became_peered":"2024-09-10T07:45:13.495457+0000","last_unstale":"2024-09-10T07:45:15.488387+0000","last_undegraded":"2024-09-10T07:45:15.488387+0000","last_fullsized":"2024-09-10T07:45:15.488387+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:45:12.466311+0000","last_clean_scrub_stamp":"2024-09-10T07:45:12.466311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:59.833959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":497,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T07:45:15.775089+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:45:15.775089+0000","last_peered":"2024-09-10T07:45:15.775089+0000","last_clean":"2024-09-10T07:45:15.775089+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:45:15.775089+0000","last_undegraded":"2024-09-10T07:45:15.775089+0000","last_fullsized":"2024-09-10T07:45:15.775089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1613,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193698,"statfs":{"total":200000000,"available":198347412,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194277,"statfs":{"total":200000000,"available":198940112,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194276,"statfs":{"total":200000000,"available":198939530,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1036,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194275,"statfs":{"total":200000000,"available":198938452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194277,"statfs":{"total":200000000,"available":198940100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194277,"statfs":{"total":200000000,"available":198940044,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1035,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194277,"statfs":{"total":200000000,"available":198940100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1611,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193700,"statfs":{"total":200000000,"available":198349766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:45:19.127 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:45:19.128 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T07:45:19.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.324+0000 7f4cf9800640 1 Processor -- start 2024-09-10T07:45:19.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.324+0000 7f4cf9800640 1 -- start start 2024-09-10T07:45:19.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.325+0000 7f4cf9800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4cf4073370 0x7f4cf40ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf9800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf4073820 con 0x7f4cf406e280 2024-09-10T07:45:19.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf9800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf40722d0 con 0x7f4cf4071df0 2024-09-10T07:45:19.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf9800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf40d1720 con 0x7f4cf4073370 2024-09-10T07:45:19.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf2a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4cf406e280 0x7f4cf406e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54170/0 (socket says 172.21.15.99:54170) 2024-09-10T07:45:19.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf2a00640 1 -- 172.21.15.99:0/2897871708 learned_addr learned my addr 172.21.15.99:0/2897871708 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:19.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf3400640 1 --2- 172.21.15.99:0/2897871708 >> v2:172.21.15.99:3300/0 conn(0x7f4cf4073370 0x7f4cf40ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf2000640 1 -- 172.21.15.99:0/2897871708 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140954184 0 0) 0x7f4cf4073820 con 0x7f4cf406e280 2024-09-10T07:45:19.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf2000640 1 -- 172.21.15.99:0/2897871708 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd8003520 con 0x7f4cf406e280 2024-09-10T07:45:19.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf2000640 1 -- 172.21.15.99:0/2897871708 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031680340 0 0) 0x7f4cf40722d0 con 0x7f4cf4071df0 2024-09-10T07:45:19.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf2000640 1 -- 172.21.15.99:0/2897871708 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf4073820 con 0x7f4cf4071df0 2024-09-10T07:45:19.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.326+0000 7f4cf3400640 1 -- 172.21.15.99:0/2897871708 >> v1:172.21.15.187:6789/0 conn(0x7f4cf4071df0 legacy=0x7f4cf40d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.327+0000 7f4cf3400640 1 -- 172.21.15.99:0/2897871708 >> v1:172.21.15.99:6789/0 conn(0x7f4cf406e280 legacy=0x7f4cf406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.327+0000 7f4cf3400640 1 -- 172.21.15.99:0/2897871708 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf40725b0 con 0x7f4cf4073370 2024-09-10T07:45:19.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.327+0000 7f4cf3400640 1 --2- 172.21.15.99:0/2897871708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf4073370 0x7f4cf40ce3d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009d90 tx=0x7f4cec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97c019492ab4478 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:19.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.328+0000 7f4cf2000640 1 -- 172.21.15.99:0/2897871708 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec007740 con 0x7f4cf4073370 2024-09-10T07:45:19.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.328+0000 7f4cf2000640 1 -- 172.21.15.99:0/2897871708 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cec0078e0 con 0x7f4cf4073370 2024-09-10T07:45:19.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.328+0000 7f4cf2000640 1 -- 172.21.15.99:0/2897871708 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec007c90 con 0x7f4cf4073370 2024-09-10T07:45:19.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.328+0000 7f4cf9800640 1 -- 172.21.15.99:0/2897871708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf4073370 msgr2=0x7f4cf40ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.328+0000 7f4cf9800640 1 --2- 172.21.15.99:0/2897871708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf4073370 0x7f4cf40ce3d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009d90 tx=0x7f4cec02a6f0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.328+0000 7f4cf9800640 1 -- 172.21.15.99:0/2897871708 shutdown_connections 2024-09-10T07:45:19.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.328+0000 7f4cf9800640 1 --2- 172.21.15.99:0/2897871708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf4073370 0x7f4cf40ce3d0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.328+0000 7f4cf9800640 1 -- 172.21.15.99:0/2897871708 >> 172.21.15.99:0/2897871708 conn(0x7f4cf406bc10 msgr2=0x7f4cf406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:19.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.328+0000 7f4cf9800640 1 -- 172.21.15.99:0/2897871708 shutdown_connections 2024-09-10T07:45:19.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.328+0000 7f4cf9800640 1 -- 172.21.15.99:0/2897871708 wait complete. 2024-09-10T07:45:19.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.330+0000 7f4cf9800640 1 Processor -- start 2024-09-10T07:45:19.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.330+0000 7f4cf9800640 1 -- start start 2024-09-10T07:45:19.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cf9800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf406e280 0x7f4cf41e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cf9800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cf4071df0 0x7f4cf415b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cf9800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cf4073370 0x7f4cf40cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cf9800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf4072e50 con 0x7f4cf406e280 2024-09-10T07:45:19.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cf9800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf4072b70 con 0x7f4cf4073370 2024-09-10T07:45:19.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cf9800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf415db60 con 0x7f4cf4071df0 2024-09-10T07:45:19.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cf2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf406e280 0x7f4cf41e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cf2a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf406e280 0x7f4cf41e4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42276/0 (socket says 172.21.15.99:42276) 2024-09-10T07:45:19.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cf2a00640 1 -- 172.21.15.99:0/2869887018 learned_addr learned my addr 172.21.15.99:0/2869887018 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:19.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cea000640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cf4071df0 0x7f4cf415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.331+0000 7f4cf3400640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cf4073370 0x7f4cf40cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.332+0000 7f4cf2a00640 1 -- 172.21.15.99:0/2869887018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cf4071df0 msgr2=0x7f4cf415b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.332+0000 7f4cf2a00640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cf4071df0 0x7f4cf415b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.332+0000 7f4cf2a00640 1 -- 172.21.15.99:0/2869887018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cf4073370 msgr2=0x7f4cf40cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.332+0000 7f4cf2a00640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cf4073370 0x7f4cf40cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.332+0000 7f4cf2a00640 1 -- 172.21.15.99:0/2869887018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf415bb70 con 0x7f4cf406e280 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.332+0000 7f4cf2a00640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf406e280 0x7f4cf41e4fc0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c500 tx=0x7f4ce400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.332+0000 7f4ceb400640 1 -- 172.21.15.99:0/2869887018 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4017070 con 0x7f4cf406e280 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.332+0000 7f4ceb400640 1 -- 172.21.15.99:0/2869887018 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce4005ce0 con 0x7f4cf406e280 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.332+0000 7f4ceb400640 1 -- 172.21.15.99:0/2869887018 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4007310 con 0x7f4cf406e280 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.332+0000 7f4cf9800640 1 -- 172.21.15.99:0/2869887018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf415be50 con 0x7f4cf406e280 2024-09-10T07:45:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.333+0000 7f4cf9800640 1 -- 172.21.15.99:0/2869887018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf4141510 con 0x7f4cf406e280 2024-09-10T07:45:19.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.334+0000 7f4cf9800640 1 -- 172.21.15.99:0/2869887018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf4141710 con 0x7f4cf406e280 2024-09-10T07:45:19.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.335+0000 7f4ceb400640 1 -- 172.21.15.99:0/2869887018 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ce401a070 con 0x7f4cf406e280 2024-09-10T07:45:19.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.335+0000 7f4ceb400640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4cd006be30 0x7f4cd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.335+0000 7f4ceb400640 1 -- 172.21.15.99:0/2869887018 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f4ce408a2a0 con 0x7f4cf406e280 2024-09-10T07:45:19.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.336+0000 7f4cea000640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4cd006be30 0x7f4cd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.336+0000 7f4cea000640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4cd006be30 0x7f4cd006e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40d00f0 tx=0x7f4cdc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:19.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.340+0000 7f4ceb400640 1 -- 172.21.15.99:0/2869887018 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ce40586c0 con 0x7f4cf406e280 2024-09-10T07:45:19.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.578+0000 7f4cf9800640 1 -- 172.21.15.99:0/2869887018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4cf415c020 con 0x7f4cf406e280 2024-09-10T07:45:19.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.580+0000 7f4ceb400640 1 -- 172.21.15.99:0/2869887018 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7f4cf415c020 con 0x7f4cf406e280 2024-09-10T07:45:19.580 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T07:45:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBe9t9mHnawAxAAETzie/66/zCb7LhrOrW7Qg== 2024-09-10T07:45:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: caps mds = "allow" 2024-09-10T07:45:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: caps mon = "allow r" 2024-09-10T07:45:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T07:45:19.580 INFO:teuthology.orchestra.run.smithi099.stderr:updated caps for client.0 2024-09-10T07:45:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.582+0000 7f4cf9800640 1 -- 172.21.15.99:0/2869887018 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4cd006be30 msgr2=0x7f4cd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.582+0000 7f4cf9800640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4cd006be30 0x7f4cd006e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40d00f0 tx=0x7f4cdc009040 comp rx=0 tx=0).stop 2024-09-10T07:45:19.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.583+0000 7f4cf9800640 1 -- 172.21.15.99:0/2869887018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf406e280 msgr2=0x7f4cf41e4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.583+0000 7f4cf9800640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf406e280 0x7f4cf41e4fc0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c500 tx=0x7f4ce400c9c0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.583+0000 7f4cf9800640 1 -- 172.21.15.99:0/2869887018 shutdown_connections 2024-09-10T07:45:19.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.583+0000 7f4cf9800640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cf4073370 0x7f4cf40cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.583+0000 7f4cf9800640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cf4071df0 0x7f4cf415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.583+0000 7f4cf9800640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4cd006be30 0x7f4cd006e2f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.583+0000 7f4cf9800640 1 --2- 172.21.15.99:0/2869887018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf406e280 0x7f4cf41e4fc0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.583+0000 7f4cf9800640 1 -- 172.21.15.99:0/2869887018 >> 172.21.15.99:0/2869887018 conn(0x7f4cf406bc10 msgr2=0x7f4cf415f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:19.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.583+0000 7f4cf9800640 1 -- 172.21.15.99:0/2869887018 shutdown_connections 2024-09-10T07:45:19.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.583+0000 7f4cf9800640 1 -- 172.21.15.99:0/2869887018 wait complete. 2024-09-10T07:45:19.599 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:19.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.752+0000 7f9a79400640 1 Processor -- start 2024-09-10T07:45:19.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.752+0000 7f9a79400640 1 -- start start 2024-09-10T07:45:19.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.753+0000 7f9a79400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740d2680 0x7f9a740cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.753+0000 7f9a79400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a740d2bd0 con 0x7f9a7415e970 2024-09-10T07:45:19.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.753+0000 7f9a79400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a740d2eb0 con 0x7f9a740cfac0 2024-09-10T07:45:19.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.753+0000 7f9a79400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9a740d37e0 con 0x7f9a740d2680 2024-09-10T07:45:19.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.753+0000 7f9a73e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9a7415e970 0x7f9a740d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54178/0 (socket says 172.21.15.99:54178) 2024-09-10T07:45:19.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.753+0000 7f9a73e00640 1 -- 172.21.15.99:0/3566520981 learned_addr learned my addr 172.21.15.99:0/3566520981 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:19.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.753+0000 7f9a73400640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740d2680 0x7f9a740cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324650794 0 0) 0x7f9a740d2bd0 con 0x7f9a7415e970 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a58003520 con 0x7f9a7415e970 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2703087964 0 0) 0x7f9a58003520 con 0x7f9a7415e970 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740d2680 msgr2=0x7f9a740cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740d2680 0x7f9a740cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 >> v1:172.21.15.187:6789/0 conn(0x7f9a740cfac0 legacy=0x7f9a740c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a740d3190 con 0x7f9a7415e970 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f9a640019f0 con 0x7f9a7415e970 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 >> v1:172.21.15.99:6789/0 conn(0x7f9a7415e970 legacy=0x7f9a740d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740d2680 0x7f9a580039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a58003f20 0x7f9a58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 0x7f9a580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9a740d37e0 con 0x7f9a58004d40 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5800ba20 con 0x7f9a58003f20 2024-09-10T07:45:19.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5800bc20 con 0x7f9a740d2680 2024-09-10T07:45:19.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a78a00640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 0x7f9a580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a73400640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a58003f20 0x7f9a58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.754+0000 7f9a73e00640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740d2680 0x7f9a580039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.755+0000 7f9a78a00640 1 -- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740d2680 msgr2=0x7f9a580039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:19.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.755+0000 7f9a78a00640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740d2680 0x7f9a580039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.755+0000 7f9a78a00640 1 -- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a58003f20 msgr2=0x7f9a58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:19.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.755+0000 7f9a78a00640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a58003f20 0x7f9a58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.755+0000 7f9a78a00640 1 -- 172.21.15.99:0/3566520981 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a58003520 con 0x7f9a58004d40 2024-09-10T07:45:19.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.756+0000 7f9a78a00640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 0x7f9a580051c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c001860 tx=0x7f9a58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c965b231c19835e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:19.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.756+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c037070 con 0x7f9a58004d40 2024-09-10T07:45:19.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.756+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c02abf0 con 0x7f9a58004d40 2024-09-10T07:45:19.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.756+0000 7f9a72a00640 1 -- 172.21.15.99:0/3566520981 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c001430 con 0x7f9a58004d40 2024-09-10T07:45:19.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.757+0000 7f9a79400640 1 -- 172.21.15.99:0/3566520981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 msgr2=0x7f9a580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.757+0000 7f9a79400640 1 --2- 172.21.15.99:0/3566520981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 0x7f9a580051c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c001860 tx=0x7f9a58005830 comp rx=0 tx=0).stop 2024-09-10T07:45:19.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.757+0000 7f9a78a00640 1 -- 172.21.15.99:0/3566520981 reap_dead start 2024-09-10T07:45:19.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.757+0000 7f9a79400640 1 -- 172.21.15.99:0/3566520981 shutdown_connections 2024-09-10T07:45:19.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.757+0000 7f9a79400640 1 -- 172.21.15.99:0/3566520981 >> 172.21.15.99:0/3566520981 conn(0x7f9a7409de00 msgr2=0x7f9a740d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:19.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.757+0000 7f9a79400640 1 -- 172.21.15.99:0/3566520981 shutdown_connections 2024-09-10T07:45:19.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.757+0000 7f9a79400640 1 -- 172.21.15.99:0/3566520981 wait complete. 2024-09-10T07:45:19.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.758+0000 7f9a79400640 1 Processor -- start 2024-09-10T07:45:19.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.759+0000 7f9a79400640 1 -- start start 2024-09-10T07:45:19.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.759+0000 7f9a79400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 0x7f9a740ba4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.759+0000 7f9a79400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740a1280 0x7f9a7409e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.759+0000 7f9a79400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a740a1700 0x7f9a7409ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.759+0000 7f9a79400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7415ed50 con 0x7f9a58004d40 2024-09-10T07:45:19.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.759+0000 7f9a79400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9a740cff70 con 0x7f9a740a1700 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.759+0000 7f9a79400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7415eed0 con 0x7f9a740a1280 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 0x7f9a740ba4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 0x7f9a740ba4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42298/0 (socket says 172.21.15.99:42298) 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73e00640 1 -- 172.21.15.99:0/1334892938 learned_addr learned my addr 172.21.15.99:0/1334892938 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73400640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740a1280 0x7f9a7409e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a78a00640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a740a1700 0x7f9a7409ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73e00640 1 -- 172.21.15.99:0/1334892938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740a1280 msgr2=0x7f9a7409e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73e00640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740a1280 0x7f9a7409e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73e00640 1 -- 172.21.15.99:0/1334892938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a740a1700 msgr2=0x7f9a7409ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73e00640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a740a1700 0x7f9a7409ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73e00640 1 -- 172.21.15.99:0/1334892938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a740a1c70 con 0x7f9a58004d40 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73400640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740a1280 0x7f9a7409e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a78a00640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a740a1700 0x7f9a7409ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a73e00640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 0x7f9a740ba4e0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f9a64007a50 tx=0x7f9a6400a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:19.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.760+0000 7f9a6be00640 1 -- 172.21.15.99:0/1334892938 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a640133f0 con 0x7f9a58004d40 2024-09-10T07:45:19.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.761+0000 7f9a6be00640 1 -- 172.21.15.99:0/1334892938 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a64018070 con 0x7f9a58004d40 2024-09-10T07:45:19.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.761+0000 7f9a6be00640 1 -- 172.21.15.99:0/1334892938 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a640137d0 con 0x7f9a58004d40 2024-09-10T07:45:19.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.761+0000 7f9a79400640 1 -- 172.21.15.99:0/1334892938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a740a1f50 con 0x7f9a58004d40 2024-09-10T07:45:19.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.761+0000 7f9a79400640 1 -- 172.21.15.99:0/1334892938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a740ce2f0 con 0x7f9a58004d40 2024-09-10T07:45:19.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.762+0000 7f9a79400640 1 -- 172.21.15.99:0/1334892938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a740cf580 con 0x7f9a58004d40 2024-09-10T07:45:19.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.763+0000 7f9a6be00640 1 -- 172.21.15.99:0/1334892938 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a64013b80 con 0x7f9a58004d40 2024-09-10T07:45:19.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.764+0000 7f9a6be00640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9a5406be60 0x7f9a5406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:19.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.764+0000 7f9a6be00640 1 -- 172.21.15.99:0/1334892938 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f9a6408bae0 con 0x7f9a58004d40 2024-09-10T07:45:19.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.764+0000 7f9a73400640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9a5406be60 0x7f9a5406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:19.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.765+0000 7f9a73400640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9a5406be60 0x7f9a5406e320 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9a740cafe0 tx=0x7f9a60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:19.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.768+0000 7f9a6be00640 1 -- 172.21.15.99:0/1334892938 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a64001a30 con 0x7f9a58004d40 2024-09-10T07:45:19.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.975+0000 7f9a79400640 1 -- 172.21.15.99:0/1334892938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a740b8220 con 0x7f9a58004d40 2024-09-10T07:45:19.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.976+0000 7f9a6be00640 1 -- 172.21.15.99:0/1334892938 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7f9a6405a3f0 con 0x7f9a58004d40 2024-09-10T07:45:19.975 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:19.976 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":90,"btime":"2024-09-10T07:45:17:511094+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4239870292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4239870292},{"type":"v1","addr":"172.21.15.99:6836","nonce":4239870292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2428750075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2428750075},{"type":"v1","addr":"172.21.15.187:6835","nonce":2428750075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1219809784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1219809784},{"type":"v1","addr":"172.21.15.187:6834","nonce":1219809784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:45:13.894905+0000","modified":"2024-09-10T07:45:16.912907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7276":{"gid":7276,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/256766417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":256766417},{"type":"v1","addr":"172.21.15.99:6837","nonce":256766417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7276,"qdb_cluster":[7276]},"id":11}]} 2024-09-10T07:45:19.976 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 90 2024-09-10T07:45:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 -- 172.21.15.99:0/1334892938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9a5406be60 msgr2=0x7f9a5406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9a5406be60 0x7f9a5406e320 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9a740cafe0 tx=0x7f9a60008040 comp rx=0 tx=0).stop 2024-09-10T07:45:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 -- 172.21.15.99:0/1334892938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 msgr2=0x7f9a740ba4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 0x7f9a740ba4e0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f9a64007a50 tx=0x7f9a6400a730 comp rx=0 tx=0).stop 2024-09-10T07:45:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 -- 172.21.15.99:0/1334892938 shutdown_connections 2024-09-10T07:45:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a740a1700 0x7f9a7409ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a740a1280 0x7f9a7409e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9a5406be60 0x7f9a5406e320 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 --2- 172.21.15.99:0/1334892938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a58004d40 0x7f9a740ba4e0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:19.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 -- 172.21.15.99:0/1334892938 >> 172.21.15.99:0/1334892938 conn(0x7f9a7409de00 msgr2=0x7f9a741610b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:19.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 -- 172.21.15.99:0/1334892938 shutdown_connections 2024-09-10T07:45:19.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:19.978+0000 7f9a79400640 1 -- 172.21.15.99:0/1334892938 wait complete. 2024-09-10T07:45:20.075 INFO:tasks.ceph.mds.c.smithi099.stderr:2024-09-10T07:45:20.075+0000 7f7573800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:45:20.396 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T07:45:13.894905+0000', 'modified': '2024-09-10T07:45:16.912907+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7276': {'gid': 7276, 'name': 'c', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6837/256766417', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6835', 'nonce': 256766417}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 256766417}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7276, 'qdb_cluster': [7276]} 2024-09-10T07:45:20.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T07:45:20.397 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T07:45:20.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.555+0000 7f3d07000640 1 Processor -- start 2024-09-10T07:45:20.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.555+0000 7f3d07000640 1 -- start start 2024-09-10T07:45:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.556+0000 7f3d07000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 0x7f3d000d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.556+0000 7f3d07000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3d000d51a0 0x7f3d000d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.556+0000 7f3d07000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d000cf740 con 0x7f3d0015ed10 2024-09-10T07:45:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.556+0000 7f3d07000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f3d000d2d70 con 0x7f3d000d51a0 2024-09-10T07:45:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.556+0000 7f3d07000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3d000d3990 con 0x7f3d000d3070 2024-09-10T07:45:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.556+0000 7f3d05200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3d0015ed10 0x7f3d000d2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47200/0 (socket says 172.21.15.99:47200) 2024-09-10T07:45:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.556+0000 7f3d05200640 1 -- 172.21.15.99:0/1070118288 learned_addr learned my addr 172.21.15.99:0/1070118288 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.556+0000 7f3d06600640 1 --2- 172.21.15.99:0/1070118288 >> v2:172.21.15.187:3300/0 conn(0x7f3d000d51a0 0x7f3d000d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.556+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1070118288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 0x7f3d000d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.557+0000 7f3cffe00640 1 -- 172.21.15.99:0/1070118288 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237513136 0 0) 0x7f3d000cf740 con 0x7f3d0015ed10 2024-09-10T07:45:20.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.557+0000 7f3cffe00640 1 -- 172.21.15.99:0/1070118288 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ce8003520 con 0x7f3d0015ed10 2024-09-10T07:45:20.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.557+0000 7f3d05c00640 1 -- 172.21.15.99:0/1070118288 >> v2:172.21.15.187:3300/0 conn(0x7f3d000d51a0 msgr2=0x7f3d000d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:20.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.557+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1070118288 >> v2:172.21.15.187:3300/0 conn(0x7f3d000d51a0 0x7f3d000d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.557+0000 7f3d05c00640 1 -- 172.21.15.99:0/1070118288 >> v1:172.21.15.99:6789/0 conn(0x7f3d0015ed10 legacy=0x7f3d000d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.557+0000 7f3d05c00640 1 -- 172.21.15.99:0/1070118288 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d000d5910 con 0x7f3d000d3070 2024-09-10T07:45:20.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.557+0000 7f3d06600640 1 --2- 172.21.15.99:0/1070118288 >> v2:172.21.15.187:3300/0 conn(0x7f3d000d51a0 0x7f3d000d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:20.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.558+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1070118288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 0x7f3d000d3450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009d90 tx=0x7f3cf402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9695fe0e4899b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:20.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.558+0000 7f3cffe00640 1 -- 172.21.15.99:0/1070118288 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4007740 con 0x7f3d000d3070 2024-09-10T07:45:20.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.558+0000 7f3cffe00640 1 -- 172.21.15.99:0/1070118288 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf40078e0 con 0x7f3d000d3070 2024-09-10T07:45:20.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.558+0000 7f3cffe00640 1 -- 172.21.15.99:0/1070118288 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4007cb0 con 0x7f3d000d3070 2024-09-10T07:45:20.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.559+0000 7f3d07000640 1 -- 172.21.15.99:0/1070118288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 msgr2=0x7f3d000d3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.559+0000 7f3d07000640 1 --2- 172.21.15.99:0/1070118288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 0x7f3d000d3450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009d90 tx=0x7f3cf402a6f0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.559+0000 7f3d07000640 1 -- 172.21.15.99:0/1070118288 shutdown_connections 2024-09-10T07:45:20.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.559+0000 7f3d07000640 1 --2- 172.21.15.99:0/1070118288 >> v2:172.21.15.187:3300/0 conn(0x7f3d000d51a0 0x7f3d000d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.559+0000 7f3d07000640 1 --2- 172.21.15.99:0/1070118288 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 0x7f3d000d3450 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.559+0000 7f3d07000640 1 -- 172.21.15.99:0/1070118288 >> 172.21.15.99:0/1070118288 conn(0x7f3d0009dd60 msgr2=0x7f3d000d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.559+0000 7f3d07000640 1 -- 172.21.15.99:0/1070118288 shutdown_connections 2024-09-10T07:45:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.559+0000 7f3d07000640 1 -- 172.21.15.99:0/1070118288 wait complete. 2024-09-10T07:45:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.561+0000 7f3d07000640 1 Processor -- start 2024-09-10T07:45:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.561+0000 7f3d07000640 1 -- start start 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d07000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 0x7f3d000b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d07000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015ed10 0x7f3d000ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d07000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d0015d1d0 0x7f3d000b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d07000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3d000cfcc0 con 0x7f3d0015ed10 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d07000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3d000cf9e0 con 0x7f3d0015d1d0 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d07000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3d000d0720 con 0x7f3d000d3070 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d05200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015ed10 0x7f3d000ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d05200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015ed10 0x7f3d000ce720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60942/0 (socket says 172.21.15.99:60942) 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d05200640 1 -- 172.21.15.99:0/1729576147 learned_addr learned my addr 172.21.15.99:0/1729576147 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 0x7f3d000b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d06600640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d0015d1d0 0x7f3d000b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.562+0000 7f3d05200640 1 -- 172.21.15.99:0/1729576147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 msgr2=0x7f3d000b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.563+0000 7f3d05200640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 0x7f3d000b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.563+0000 7f3d05200640 1 -- 172.21.15.99:0/1729576147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d0015d1d0 msgr2=0x7f3d000b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.563+0000 7f3d05200640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d0015d1d0 0x7f3d000b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.563+0000 7f3d05200640 1 -- 172.21.15.99:0/1729576147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d000cc4e0 con 0x7f3d0015ed10 2024-09-10T07:45:20.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.563+0000 7f3d05200640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015ed10 0x7f3d000ce720 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00c430 tx=0x7f3cec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:20.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.563+0000 7f3cfd600640 1 -- 172.21.15.99:0/1729576147 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec017070 con 0x7f3d0015ed10 2024-09-10T07:45:20.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.563+0000 7f3cfd600640 1 -- 172.21.15.99:0/1729576147 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cec005ce0 con 0x7f3d0015ed10 2024-09-10T07:45:20.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.563+0000 7f3d07000640 1 -- 172.21.15.99:0/1729576147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d000b7f50 con 0x7f3d0015ed10 2024-09-10T07:45:20.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.563+0000 7f3cfd600640 1 -- 172.21.15.99:0/1729576147 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec007310 con 0x7f3d0015ed10 2024-09-10T07:45:20.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.563+0000 7f3d07000640 1 -- 172.21.15.99:0/1729576147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d000b8510 con 0x7f3d0015ed10 2024-09-10T07:45:20.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.565+0000 7f3cfd600640 1 -- 172.21.15.99:0/1729576147 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3cec01a070 con 0x7f3d0015ed10 2024-09-10T07:45:20.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.566+0000 7f3cfd600640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3ce006be30 0x7f3ce006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.566+0000 7f3cfd600640 1 -- 172.21.15.99:0/1729576147 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f3cec08a180 con 0x7f3d0015ed10 2024-09-10T07:45:20.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.567+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3ce006be30 0x7f3ce006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.567+0000 7f3d0b48a740 1 Processor -- start 2024-09-10T07:45:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.567+0000 7f3d0b48a740 1 -- start start 2024-09-10T07:45:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.567+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3ce006be30 0x7f3ce006e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4034000 tx=0x7f3cf402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 0x55fc8493a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f2660 0x55fc848f5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f6630 0x55fc848ef720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55fc848533b0 con 0x55fc848f6630 2024-09-10T07:45:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55fc84858410 con 0x55fc848f4ea0 2024-09-10T07:45:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55fc84800620 con 0x55fc848f2660 2024-09-10T07:45:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d06600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f6630 0x55fc848ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d05200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f2660 0x55fc848f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d06600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f6630 0x55fc848ef720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60944/0 (socket says 172.21.15.99:60944) 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d06600640 1 -- 172.21.15.99:0/593464134 learned_addr learned my addr 172.21.15.99:0/593464134 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d05c00640 1 --2- 172.21.15.99:0/593464134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 0x55fc8493a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d06600640 1 -- 172.21.15.99:0/593464134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f2660 msgr2=0x55fc848f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.568+0000 7f3d06600640 1 --2- 172.21.15.99:0/593464134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f2660 0x55fc848f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.569+0000 7f3d06600640 1 -- 172.21.15.99:0/593464134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 msgr2=0x55fc8493a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.569+0000 7f3d06600640 1 --2- 172.21.15.99:0/593464134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 0x55fc8493a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.569+0000 7f3d06600640 1 -- 172.21.15.99:0/593464134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc8456b2d0 con 0x55fc848f6630 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.569+0000 7f3d05200640 1 --2- 172.21.15.99:0/593464134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f2660 0x55fc848f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.569+0000 7f3d06600640 1 --2- 172.21.15.99:0/593464134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f6630 0x55fc848ef720 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009b10 tx=0x7f3cf80112c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3743af439f2f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.569+0000 7f3cf2000640 1 -- 172.21.15.99:0/593464134 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8011d90 con 0x55fc848f6630 2024-09-10T07:45:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.569+0000 7f3cf2000640 1 -- 172.21.15.99:0/593464134 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf8014440 con 0x55fc848f6630 2024-09-10T07:45:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.569+0000 7f3cf2000640 1 -- 172.21.15.99:0/593464134 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8014810 con 0x55fc848f6630 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.570+0000 7f3d0b48a740 1 -- 172.21.15.99:0/593464134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f6630 msgr2=0x55fc848ef720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.570+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/593464134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f6630 0x55fc848ef720 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009b10 tx=0x7f3cf80112c0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.570+0000 7f3d0b48a740 1 -- 172.21.15.99:0/593464134 shutdown_connections 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.570+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/593464134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f6630 0x55fc848ef720 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.570+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/593464134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f2660 0x55fc848f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.570+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/593464134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 0x55fc8493a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.570+0000 7f3d0b48a740 1 -- 172.21.15.99:0/593464134 >> 172.21.15.99:0/593464134 conn(0x55fc848f18f0 msgr2=0x55fc84939b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.570+0000 7f3d0b48a740 1 -- 172.21.15.99:0/593464134 shutdown_connections 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.570+0000 7f3d0b48a740 1 -- 172.21.15.99:0/593464134 wait complete. 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.570+0000 7f3d0b48a740 1 -- start start 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.571+0000 7f3d0b48a740 1 Processor -- start 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f4ea0 0x55fc8491f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f6630 0x55fc8491c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55fc84813780 con 0x55fc848f37a0 2024-09-10T07:45:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55fc848543d0 con 0x55fc848f6630 2024-09-10T07:45:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55fc848f0d90 con 0x55fc848f4ea0 2024-09-10T07:45:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d0b48a740 10 client.0 _ll_register_callbacks cb 0x55fc848515d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:45:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d06600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d06600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60948/0 (socket says 172.21.15.99:60948) 2024-09-10T07:45:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d06600640 1 -- 172.21.15.99:0/1392931867 learned_addr learned my addr 172.21.15.99:0/1392931867 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f4ea0 0x55fc8491f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d05200640 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f6630 0x55fc8491c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d06600640 1 -- 172.21.15.99:0/1392931867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f4ea0 msgr2=0x55fc8491f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d06600640 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f4ea0 0x55fc8491f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d06600640 1 -- 172.21.15.99:0/1392931867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f6630 msgr2=0x55fc8491c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d06600640 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f6630 0x55fc8491c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.572+0000 7f3d06600640 1 -- 172.21.15.99:0/1392931867 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc846356b0 con 0x55fc848f37a0 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3d06600640 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f3c20 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8014b70 tx=0x7f3cf8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caf05bdba89fd20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3ce6a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3ce6a00640 1 -- 172.21.15.99:0/1392931867 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8009700 con 0x55fc848f37a0 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1392931867 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cf8014440 con 0x55fc848f37a0 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3ce6a00640 1 -- 172.21.15.99:0/1392931867 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f3cf8014cd0 con 0x55fc848f37a0 2024-09-10T07:45:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3ce6a00640 1 -- 172.21.15.99:0/1392931867 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f3cf8030050 con 0x55fc848f37a0 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3d0b48a740 10 client.7896 fetch_fsmap learned FSMap version 90 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1392931867 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x55fc84914080 con 0x55fc848f37a0 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3ce6a00640 1 -- 172.21.15.99:0/1392931867 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf8014440 con 0x55fc848f37a0 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3ce6a00640 1 -- 172.21.15.99:0/1392931867 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7f3cf8033020 con 0x55fc848f37a0 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3d0b48a740 10 client.7896 fetch_fsmap finished waiting for FSMap version 90 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3d0b48a740 10 client.7896 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.573+0000 7f3d0b48a740 20 client.7896 populate_metadata read hostname 'smithi099' 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.574+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.99:6835/256766417,v1:172.21.15.99:6837/256766417] conn(0x55fc849147a0 0x55fc84914b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.574+0000 7f3d0b48a740 4 client.7896 mds_command: new command op to 7276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.574+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1392931867 --> [v2:172.21.15.99:6835/256766417,v1:172.21.15.99:6837/256766417] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc84865b40 con 0x55fc849147a0 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.574+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.99:6835/256766417,v1:172.21.15.99:6837/256766417] conn(0x55fc849147a0 0x55fc84914b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.574+0000 7f3ce6a00640 10 client.7896 ms_handle_connect on v2:172.21.15.99:6835/256766417 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.574+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.99:6835/256766417,v1:172.21.15.99:6837/256766417] conn(0x55fc849147a0 0x55fc84914b80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c59bf10feb9496c server_cookie=117088df20920100 in_seq=0 out_seq=0 2024-09-10T07:45:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.575+0000 7f3ce6a00640 1 -- 172.21.15.99:0/1392931867 <== mds.0 v2:172.21.15.99:6835/256766417 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc84865b40 con 0x55fc849147a0 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.575+0000 7f3ce6a00640 10 client.7896 handle_command_reply: tid=0 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.575+0000 7f3d0b48a740 1 client.7896 shutdown 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1392931867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 msgr2=0x55fc848f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f3c20 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8014b70 tx=0x7f3cf8004730 comp rx=0 tx=0).stop 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1392931867 shutdown_connections 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.99:6835/256766417,v1:172.21.15.99:6837/256766417] conn(0x55fc849147a0 0x55fc84914b80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f3c20 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f6630 0x55fc8491c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/1392931867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f4ea0 0x55fc8491f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3ce6a00640 0 client.7896 ms_handle_reset on v2:172.21.15.99:6835/256766417 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1392931867 >> 172.21.15.99:0/1392931867 conn(0x55fc848f2660 msgr2=0x55fc84939150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1392931867 shutdown_connections 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1392931867 wait complete. 2024-09-10T07:45:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.576+0000 7f3d0b48a740 20 client.7896 trim_cache size 0 max 16384 2024-09-10T07:45:20.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.594+0000 7f3d0b48a740 1 Processor -- start 2024-09-10T07:45:20.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.594+0000 7f3d0b48a740 1 -- start start 2024-09-10T07:45:20.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.595+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.595+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f4ea0 0x55fc849535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.595+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f6630 0x55fc84953af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.595+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00200f20 con 0x55fc848f37a0 2024-09-10T07:45:20.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.595+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0006d670 con 0x55fc848f6630 2024-09-10T07:45:20.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.595+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0006d020 con 0x55fc848f4ea0 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.595+0000 7f3d05c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.595+0000 7f3d05c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60960/0 (socket says 172.21.15.99:60960) 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.595+0000 7f3d05c00640 1 -- 172.21.15.99:0/1249383788 learned_addr learned my addr 172.21.15.99:0/1249383788 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3d05200640 1 --2- 172.21.15.99:0/1249383788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f4ea0 0x55fc849535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3d06600640 1 --2- 172.21.15.99:0/1249383788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f6630 0x55fc84953af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3d05c00640 1 -- 172.21.15.99:0/1249383788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f4ea0 msgr2=0x55fc849535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1249383788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f4ea0 0x55fc849535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3d05c00640 1 -- 172.21.15.99:0/1249383788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f6630 msgr2=0x55fc84953af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1249383788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f6630 0x55fc84953af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3d05c00640 1 -- 172.21.15.99:0/1249383788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc84818510 con 0x55fc848f37a0 2024-09-10T07:45:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3d05c00640 1 --2- 172.21.15.99:0/1249383788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f2df0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009bd0 tx=0x7f3cf402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8613eb74f3775fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:20.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3cf1600640 1 -- 172.21.15.99:0/1249383788 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4055440 con 0x55fc848f37a0 2024-09-10T07:45:20.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3cf1600640 1 -- 172.21.15.99:0/1249383788 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf40555e0 con 0x55fc848f37a0 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.596+0000 7f3cf1600640 1 -- 172.21.15.99:0/1249383788 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40559b0 con 0x55fc848f37a0 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.597+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1249383788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 msgr2=0x55fc848f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.597+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/1249383788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f2df0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009bd0 tx=0x7f3cf402e000 comp rx=0 tx=0).stop 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.597+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1249383788 shutdown_connections 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.597+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/1249383788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f6630 0x55fc84953af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.597+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/1249383788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f4ea0 0x55fc849535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.597+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/1249383788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc848f2df0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.597+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1249383788 >> 172.21.15.99:0/1249383788 conn(0x55fc848f2660 msgr2=0x55fc84939150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.597+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1249383788 shutdown_connections 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.597+0000 7f3d0b48a740 1 -- 172.21.15.99:0/1249383788 wait complete. 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.597+0000 7f3d0b48a740 1 -- start start 2024-09-10T07:45:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.598+0000 7f3d0b48a740 1 Processor -- start 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc849196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 0x55fc849b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d0b48a740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f6630 0x55fc84953b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55fc848efb80 con 0x55fc848f37a0 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55fc8491e580 con 0x55fc848f4ea0 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d0b48a740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x55fc8481ae90 con 0x55fc848f6630 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d0b48a740 10 client.0 _ll_register_callbacks cb 0x7f3cf8009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d05c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc849196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d05c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc849196a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60976/0 (socket says 172.21.15.99:60976) 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d05c00640 1 -- 172.21.15.99:0/7962600 learned_addr learned my addr 172.21.15.99:0/7962600 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d06600640 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f6630 0x55fc84953b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d05200640 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 0x55fc849b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d05c00640 1 -- 172.21.15.99:0/7962600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f6630 msgr2=0x55fc84953b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d05c00640 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f6630 0x55fc84953b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d05c00640 1 -- 172.21.15.99:0/7962600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 msgr2=0x55fc849b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d05c00640 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 0x55fc849b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d05c00640 1 -- 172.21.15.99:0/7962600 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc8495ded0 con 0x55fc848f37a0 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.599+0000 7f3d05200640 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 0x55fc849b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3d05c00640 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc849196a0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4007910 tx=0x7f3cf4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e131645d5ea65302 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3ce6a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3ce6a00640 1 -- 172.21.15.99:0/7962600 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4062020 con 0x55fc848f37a0 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3ce6a00640 1 -- 172.21.15.99:0/7962600 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f3cf4003990 con 0x55fc848f37a0 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3d0b48a740 1 -- 172.21.15.99:0/7962600 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cf40555e0 con 0x55fc848f37a0 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3ce6a00640 1 -- 172.21.15.99:0/7962600 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f3cf406c050 con 0x55fc848f37a0 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3d0b48a740 10 client.7902 fetch_fsmap learned FSMap version 90 2024-09-10T07:45:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3d0b48a740 1 -- 172.21.15.99:0/7962600 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x55fc849b8d30 con 0x55fc848f37a0 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3ce6a00640 1 -- 172.21.15.99:0/7962600 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf40555e0 con 0x55fc848f37a0 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3ce6a00640 1 -- 172.21.15.99:0/7962600 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7f3cf406f020 con 0x55fc848f37a0 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3d0b48a740 10 client.7902 fetch_fsmap finished waiting for FSMap version 90 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3d0b48a740 10 client.7902 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3d0b48a740 20 client.7902 populate_metadata read hostname 'smithi099' 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.99:6835/256766417,v1:172.21.15.99:6837/256766417] conn(0x55fc8494c500 0x55fc84935d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3d0b48a740 4 client.7902 mds_command: new command op to 7276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.600+0000 7f3d0b48a740 1 -- 172.21.15.99:0/7962600 --> [v2:172.21.15.99:6835/256766417,v1:172.21.15.99:6837/256766417] -- command(tid 0: {"prefix": "status"}) -- 0x55fc8485fe90 con 0x55fc8494c500 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.601+0000 7f3d05200640 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.99:6835/256766417,v1:172.21.15.99:6837/256766417] conn(0x55fc8494c500 0x55fc84935d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.601+0000 7f3d05200640 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.99:6835/256766417,v1:172.21.15.99:6837/256766417] conn(0x55fc8494c500 0x55fc84935d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e4cb17b20fef7f0 server_cookie=594c1c88c29bbccc in_seq=0 out_seq=0 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.601+0000 7f3ce6a00640 10 client.7902 ms_handle_connect on v2:172.21.15.99:6835/256766417 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.601+0000 7f3ce6a00640 1 -- 172.21.15.99:0/7962600 <== mds.0 v2:172.21.15.99:6835/256766417 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fc8485fe90 con 0x55fc8494c500 2024-09-10T07:45:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.601+0000 7f3ce6a00640 10 client.7902 handle_command_reply: tid=0 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.601+0000 7f3d0b48a740 1 client.7902 shutdown 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 1 -- 172.21.15.99:0/7962600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 msgr2=0x55fc849196a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc849196a0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4007910 tx=0x7f3cf4004ab0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 1 -- 172.21.15.99:0/7962600 shutdown_connections 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.99:6835/256766417,v1:172.21.15.99:6837/256766417] conn(0x55fc8494c500 0x55fc84935d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55fc848f6630 0x55fc84953b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fc848f4ea0 0x55fc849b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 1 --2- 172.21.15.99:0/7962600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fc848f37a0 0x55fc849196a0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3ce6a00640 0 client.7902 ms_handle_reset on v2:172.21.15.99:6835/256766417 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 1 -- 172.21.15.99:0/7962600 >> 172.21.15.99:0/7962600 conn(0x55fc848f2660 msgr2=0x55fc8491bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 1 -- 172.21.15.99:0/7962600 shutdown_connections 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 1 -- 172.21.15.99:0/7962600 wait complete. 2024-09-10T07:45:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d0b48a740 20 client.7902 trim_cache size 0 max 16384 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 7276, 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 6.1207115600000002, 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 90, 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 188, 2024-09-10T07:45:20.606 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 188, 2024-09-10T07:45:20.607 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 11.205274226 2024-09-10T07:45:20.607 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d07000640 1 -- 172.21.15.99:0/1729576147 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3ce006be30 msgr2=0x7f3ce006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d07000640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3ce006be30 0x7f3ce006e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4034000 tx=0x7f3cf402f000 comp rx=0 tx=0).stop 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d07000640 1 -- 172.21.15.99:0/1729576147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015ed10 msgr2=0x7f3d000ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.602+0000 7f3d07000640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015ed10 0x7f3d000ce720 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00c430 tx=0x7f3cec00c8f0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.603+0000 7f3d07000640 1 -- 172.21.15.99:0/1729576147 shutdown_connections 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.603+0000 7f3d07000640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d0015d1d0 0x7f3d000b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.603+0000 7f3d07000640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3ce006be30 0x7f3ce006e2f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.603+0000 7f3d07000640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015ed10 0x7f3d000ce720 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.603+0000 7f3d07000640 1 --2- 172.21.15.99:0/1729576147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d000d3070 0x7f3d000b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.603+0000 7f3d07000640 1 -- 172.21.15.99:0/1729576147 >> 172.21.15.99:0/1729576147 conn(0x7f3d0009dd60 msgr2=0x7f3d0015d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.603+0000 7f3d07000640 1 -- 172.21.15.99:0/1729576147 shutdown_connections 2024-09-10T07:45:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.603+0000 7f3d07000640 1 -- 172.21.15.99:0/1729576147 wait complete. 2024-09-10T07:45:20.618 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:45:20.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.771+0000 7f064f200640 1 Processor -- start 2024-09-10T07:45:20.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.771+0000 7f064f200640 1 -- start start 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.772+0000 7f064f200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0648145290 0x7f064806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f064f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06480ce780 0x7f0648072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f064f200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064806e3d0 con 0x7f0648071510 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f064f200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f064806efe0 con 0x7f06480ce780 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f064f200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f064806e6b0 con 0x7f0648145290 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f0647400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06480ce780 0x7f0648072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f0647400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06480ce780 0x7f0648072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60978/0 (socket says 172.21.15.99:60978) 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f0647400640 1 -- 172.21.15.99:0/1427472786 learned_addr learned my addr 172.21.15.99:0/1427472786 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f0647e00640 1 --2- 172.21.15.99:0/1427472786 >> v2:172.21.15.187:3300/0 conn(0x7f0648145290 0x7f064806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f0647400640 1 -- 172.21.15.99:0/1427472786 >> v2:172.21.15.187:3300/0 conn(0x7f0648145290 msgr2=0x7f064806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f0647400640 1 --2- 172.21.15.99:0/1427472786 >> v2:172.21.15.187:3300/0 conn(0x7f0648145290 0x7f064806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f0647400640 1 -- 172.21.15.99:0/1427472786 >> v1:172.21.15.187:6789/0 conn(0x7f0648071510 legacy=0x7f06480b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.773+0000 7f0647400640 1 -- 172.21.15.99:0/1427472786 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064806e990 con 0x7f06480ce780 2024-09-10T07:45:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.774+0000 7f0647400640 1 --2- 172.21.15.99:0/1427472786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 0x7f0648072830 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f0648075940 tx=0x7f063402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3b19687319941b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f0646a00640 1 -- 172.21.15.99:0/1427472786 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634037070 con 0x7f06480ce780 2024-09-10T07:45:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f0646a00640 1 -- 172.21.15.99:0/1427472786 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0634032440 con 0x7f06480ce780 2024-09-10T07:45:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f0646a00640 1 -- 172.21.15.99:0/1427472786 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634032810 con 0x7f06480ce780 2024-09-10T07:45:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f064f200640 1 -- 172.21.15.99:0/1427472786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 msgr2=0x7f0648072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f064f200640 1 --2- 172.21.15.99:0/1427472786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 0x7f0648072830 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f0648075940 tx=0x7f063402a270 comp rx=0 tx=0).stop 2024-09-10T07:45:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f064f200640 1 -- 172.21.15.99:0/1427472786 shutdown_connections 2024-09-10T07:45:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f064f200640 1 --2- 172.21.15.99:0/1427472786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 0x7f0648072830 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f064f200640 1 --2- 172.21.15.99:0/1427472786 >> v2:172.21.15.187:3300/0 conn(0x7f0648145290 0x7f064806f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f064f200640 1 -- 172.21.15.99:0/1427472786 >> 172.21.15.99:0/1427472786 conn(0x7f064806bc10 msgr2=0x7f064806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f064f200640 1 -- 172.21.15.99:0/1427472786 shutdown_connections 2024-09-10T07:45:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.775+0000 7f064f200640 1 -- 172.21.15.99:0/1427472786 wait complete. 2024-09-10T07:45:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.777+0000 7f064f200640 1 Processor -- start 2024-09-10T07:45:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.777+0000 7f064f200640 1 -- start start 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f064f200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0648071510 0x7f064815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f064f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 0x7f0648142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f064f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0648145290 0x7f0648140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f064f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f064806df80 con 0x7f06480ce780 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f064f200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0648145670 con 0x7f0648071510 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f064f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f064806e100 con 0x7f0648145290 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f0647400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 0x7f0648142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f0647400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 0x7f0648142050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60982/0 (socket says 172.21.15.99:60982) 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f0647400640 1 -- 172.21.15.99:0/1743106489 learned_addr learned my addr 172.21.15.99:0/1743106489 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f0647e00640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0648071510 0x7f064815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f064d200640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0648145290 0x7f0648140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f0647400640 1 -- 172.21.15.99:0/1743106489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0648145290 msgr2=0x7f0648140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f0647400640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0648145290 0x7f0648140130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f0647400640 1 -- 172.21.15.99:0/1743106489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0648071510 msgr2=0x7f064815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.778+0000 7f0647400640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0648071510 0x7f064815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.779+0000 7f0647400640 1 -- 172.21.15.99:0/1743106489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0648142a30 con 0x7f06480ce780 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.779+0000 7f064d200640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0648145290 0x7f0648140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.779+0000 7f0647400640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 0x7f0648142050 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f063402a2b0 tx=0x7f06340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.779+0000 7f063fe00640 1 -- 172.21.15.99:0/1743106489 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634041020 con 0x7f06480ce780 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.779+0000 7f063fe00640 1 -- 172.21.15.99:0/1743106489 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06340306c0 con 0x7f06480ce780 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.779+0000 7f064f200640 1 -- 172.21.15.99:0/1743106489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0648142d10 con 0x7f06480ce780 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.779+0000 7f063fe00640 1 -- 172.21.15.99:0/1743106489 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634037040 con 0x7f06480ce780 2024-09-10T07:45:20.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.779+0000 7f064f200640 1 -- 172.21.15.99:0/1743106489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06481432d0 con 0x7f06480ce780 2024-09-10T07:45:20.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.780+0000 7f064f200640 1 -- 172.21.15.99:0/1743106489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f064806f470 con 0x7f06480ce780 2024-09-10T07:45:20.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.781+0000 7f063fe00640 1 -- 172.21.15.99:0/1743106489 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0634044020 con 0x7f06480ce780 2024-09-10T07:45:20.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.782+0000 7f063fe00640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f062806be30 0x7f062806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:20.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.782+0000 7f063fe00640 1 -- 172.21.15.99:0/1743106489 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f06340ab750 con 0x7f06480ce780 2024-09-10T07:45:20.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.782+0000 7f0647e00640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f062806be30 0x7f062806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:20.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.783+0000 7f0647e00640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f062806be30 0x7f062806e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0638006fd0 tx=0x7f0638008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:20.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.787+0000 7f063fe00640 1 -- 172.21.15.99:0/1743106489 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f063404b030 con 0x7f06480ce780 2024-09-10T07:45:20.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.994+0000 7f064f200640 1 -- 172.21.15.99:0/1743106489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06480b4c90 con 0x7f06480ce780 2024-09-10T07:45:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.994+0000 7f063fe00640 1 -- 172.21.15.99:0/1743106489 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) ==== 53+0+73 (secure 0 0 0) 0x7f063407a060 con 0x7f06480ce780 2024-09-10T07:45:20.994 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:45:20.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.996+0000 7f064f200640 1 -- 172.21.15.99:0/1743106489 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f062806be30 msgr2=0x7f062806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.996+0000 7f064f200640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f062806be30 0x7f062806e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0638006fd0 tx=0x7f0638008040 comp rx=0 tx=0).stop 2024-09-10T07:45:20.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.996+0000 7f064f200640 1 -- 172.21.15.99:0/1743106489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 msgr2=0x7f0648142050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.996+0000 7f064f200640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 0x7f0648142050 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f063402a2b0 tx=0x7f06340046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.997+0000 7f064f200640 1 -- 172.21.15.99:0/1743106489 shutdown_connections 2024-09-10T07:45:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.997+0000 7f064f200640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0648145290 0x7f0648140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.997+0000 7f064f200640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f062806be30 0x7f062806e2f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.997+0000 7f064f200640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06480ce780 0x7f0648142050 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.997+0000 7f064f200640 1 --2- 172.21.15.99:0/1743106489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0648071510 0x7f064815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.997+0000 7f064f200640 1 -- 172.21.15.99:0/1743106489 >> 172.21.15.99:0/1743106489 conn(0x7f064806bc10 msgr2=0x7f06480b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.997+0000 7f064f200640 1 -- 172.21.15.99:0/1743106489 shutdown_connections 2024-09-10T07:45:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:20.997+0000 7f064f200640 1 -- 172.21.15.99:0/1743106489 wait complete. 2024-09-10T07:45:21.012 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:45:21.012 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:45:21.012 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-10T07:45:21.012 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T07:45:21.012 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T07:45:21.012 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:45:21.012 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:45:21.012 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:45:21.012 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:45:21.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:21.013 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-10T07:45:21.048 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:45:21.048 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:45:21.048 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:45:21.048 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:21.048 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-10T07:45:21.048 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:21.048 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:45:21.048 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:45:21.048 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42107sec preferred_lft 42107sec 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff 2024-09-10T07:45:21.049 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::b8d5:caff:fe58:b974/64 scope link 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:e2:0a:6c:f5:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::40e2:aff:fe6c:f59e/64 scope link 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 1e:1f:52:95:9f:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::1c1f:52ff:fe95:9fbe/64 scope link 2024-09-10T07:45:21.050 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:21.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:21.051 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:45:21.144 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-10T07:45:21.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:21.148 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-10T07:45:21.184 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-10T07:45:21.184 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:45:21.184 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:45:21.185 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:45:21.185 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:45:21.185 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:45:21.185 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-10T07:45:21.185 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:45:21.185 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:45:21.185 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:45:21.185 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-10T07:45:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:45:21.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:45:21.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:21.381 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:45:21.416 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:45:21.417 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:45:21.417 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:45:21.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:21.417 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-10T07:45:21.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:45:21.515 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T07:45:21.552 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T07:45:21.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:45:21.552 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:45:21.627 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T07:45:21.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:21.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:45:21.755 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:45:21.755 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:45:21.781 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:45:21.782 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:45:21.782 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:45:21.782 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with new device syntax: 0@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:45:21.782 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:45:21.783 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T07:45:21.783 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:45:21.783 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:45:21.783 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:45:21.783 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:45:21.786 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:45:21.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:21.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T07:45:21.842 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:45:21.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:45:21.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:45:21.937 INFO:teuthology.orchestra.run.smithi099.stdout:client7911 2024-09-10T07:45:21.938 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:21.938 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:21.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T07:45:22.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.169+0000 7f41d9e00640 1 Processor -- start 2024-09-10T07:45:22.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.169+0000 7f41d9e00640 1 -- start start 2024-09-10T07:45:22.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.170+0000 7f41d9e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41d415ede0 0x7f41d40afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:22.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.170+0000 7f41d9e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d40b0200 con 0x7f41d40b4ac0 2024-09-10T07:45:22.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.170+0000 7f41d9e00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d40aec20 con 0x7f41d40cf830 2024-09-10T07:45:22.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.170+0000 7f41d9e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f41d40aef00 con 0x7f41d415ede0 2024-09-10T07:45:22.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d3400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f41d40b4ac0 0x7f41d4071960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47212/0 (socket says 172.21.15.99:47212) 2024-09-10T07:45:22.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d3400640 1 -- 172.21.15.99:0/1116218359 learned_addr learned my addr 172.21.15.99:0/1116218359 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:22.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d2a00640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41d415ede0 0x7f41d40afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:22.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200621063 0 0) 0x7f41d40b0200 con 0x7f41d40b4ac0 2024-09-10T07:45:22.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41b8003520 con 0x7f41d40b4ac0 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1460697748 0 0) 0x7f41b8003520 con 0x7f41d40b4ac0 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41d415ede0 msgr2=0x7f41d40afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41d415ede0 0x7f41d40afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 >> v1:172.21.15.187:6789/0 conn(0x7f41d40cf830 legacy=0x7f41d40b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d40af1e0 con 0x7f41d40b4ac0 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f41cc0019f0 con 0x7f41d40b4ac0 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 >> v1:172.21.15.99:6789/0 conn(0x7f41d40b4ac0 legacy=0x7f41d4071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41d415ede0 0x7f41b80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41b8003f20 0x7f41b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41b8004d40 0x7f41b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f41d40aef00 con 0x7f41b8003f20 2024-09-10T07:45:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f41b800ba20 con 0x7f41b8004d40 2024-09-10T07:45:22.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.171+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f41b800bc20 con 0x7f41d415ede0 2024-09-10T07:45:22.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.172+0000 7f41d2000640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41b8003f20 0x7f41b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:22.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.172+0000 7f41d2a00640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41d415ede0 0x7f41b80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:22.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.172+0000 7f41d3400640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41b8004d40 0x7f41b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:22.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.172+0000 7f41d2000640 1 -- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41d415ede0 msgr2=0x7f41b80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:22.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.172+0000 7f41d2000640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41d415ede0 0x7f41b80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.172+0000 7f41d2000640 1 -- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41b8004d40 msgr2=0x7f41b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:22.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.172+0000 7f41d2000640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41b8004d40 0x7f41b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.172+0000 7f41d2000640 1 -- 172.21.15.99:0/1116218359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b8003520 con 0x7f41b8003f20 2024-09-10T07:45:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.173+0000 7f41d2000640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41b8003f20 0x7f41b8004800 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f41c0001830 tx=0x7f41b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcb1de94105d652 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.173+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0037070 con 0x7f41b8003f20 2024-09-10T07:45:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.173+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c002ab00 con 0x7f41b8003f20 2024-09-10T07:45:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.173+0000 7f41d1600640 1 -- 172.21.15.99:0/1116218359 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0001430 con 0x7f41b8003f20 2024-09-10T07:45:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.174+0000 7f41d9e00640 1 -- 172.21.15.99:0/1116218359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41b8003f20 msgr2=0x7f41b8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.174+0000 7f41d9e00640 1 --2- 172.21.15.99:0/1116218359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41b8003f20 0x7f41b8004800 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f41c0001830 tx=0x7f41b8005830 comp rx=0 tx=0).stop 2024-09-10T07:45:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.174+0000 7f41d3400640 1 -- 172.21.15.99:0/1116218359 reap_dead start 2024-09-10T07:45:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.174+0000 7f41d9e00640 1 -- 172.21.15.99:0/1116218359 shutdown_connections 2024-09-10T07:45:22.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.174+0000 7f41d9e00640 1 -- 172.21.15.99:0/1116218359 >> 172.21.15.99:0/1116218359 conn(0x7f41d406bc10 msgr2=0x7f41d406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:22.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.174+0000 7f41d9e00640 1 -- 172.21.15.99:0/1116218359 shutdown_connections 2024-09-10T07:45:22.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.174+0000 7f41d9e00640 1 -- 172.21.15.99:0/1116218359 wait complete. 2024-09-10T07:45:22.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.176+0000 7f41d9e00640 1 Processor -- start 2024-09-10T07:45:22.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.176+0000 7f41d9e00640 1 -- start start 2024-09-10T07:45:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d9e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41b8003f20 0x7f41d4149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d9e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41d4152d60 0x7f41d41531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41d406e710 0x7f41d406eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d9e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f41d40ae840 con 0x7f41d406e710 2024-09-10T07:45:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d9e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f41d40af7a0 con 0x7f41d4152d60 2024-09-10T07:45:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d9e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f41d40ae9c0 con 0x7f41b8003f20 2024-09-10T07:45:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41d406e710 0x7f41d406eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41d406e710 0x7f41d406eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32772/0 (socket says 172.21.15.99:32772) 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d3400640 1 -- 172.21.15.99:0/507134808 learned_addr learned my addr 172.21.15.99:0/507134808 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d2000640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41d4152d60 0x7f41d41531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.177+0000 7f41d2a00640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41b8003f20 0x7f41d4149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41d3400640 1 -- 172.21.15.99:0/507134808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41b8003f20 msgr2=0x7f41d4149380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41d3400640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41b8003f20 0x7f41d4149380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41d3400640 1 -- 172.21.15.99:0/507134808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41d4152d60 msgr2=0x7f41d41531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41d3400640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41d4152d60 0x7f41d41531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41d3400640 1 -- 172.21.15.99:0/507134808 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d41538d0 con 0x7f41d406e710 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41d3400640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41d406e710 0x7f41d406eb90 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f41d40cebf0 tx=0x7f41cc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41cb400640 1 -- 172.21.15.99:0/507134808 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00ec10 con 0x7f41d406e710 2024-09-10T07:45:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41cb400640 1 -- 172.21.15.99:0/507134808 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc00edd0 con 0x7f41d406e710 2024-09-10T07:45:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41d9e00640 1 -- 172.21.15.99:0/507134808 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d4153bb0 con 0x7f41d406e710 2024-09-10T07:45:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41cb400640 1 -- 172.21.15.99:0/507134808 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc014670 con 0x7f41d406e710 2024-09-10T07:45:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.178+0000 7f41d9e00640 1 -- 172.21.15.99:0/507134808 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d4154170 con 0x7f41d406e710 2024-09-10T07:45:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.179+0000 7f41d9e00640 1 -- 172.21.15.99:0/507134808 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d40cfc70 con 0x7f41d406e710 2024-09-10T07:45:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.180+0000 7f41cb400640 1 -- 172.21.15.99:0/507134808 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41cc014810 con 0x7f41d406e710 2024-09-10T07:45:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.181+0000 7f41cb400640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41b406be60 0x7f41b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.181+0000 7f41cb400640 1 -- 172.21.15.99:0/507134808 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f41cc08abf0 con 0x7f41d406e710 2024-09-10T07:45:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.181+0000 7f41d2a00640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41b406be60 0x7f41b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.182+0000 7f41d2a00640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41b406be60 0x7f41b406e320 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009bc0 tx=0x7f41c4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.186+0000 7f41cb400640 1 -- 172.21.15.99:0/507134808 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41cc058eb0 con 0x7f41d406e710 2024-09-10T07:45:22.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.392+0000 7f41d9e00640 1 -- 172.21.15.99:0/507134808 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f41d415b870 con 0x7f41d406e710 2024-09-10T07:45:22.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.392+0000 7f41cb400640 1 -- 172.21.15.99:0/507134808 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) ==== 53+0+73 (secure 0 0 0) 0x7f41cc05d1b0 con 0x7f41d406e710 2024-09-10T07:45:22.392 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T07:45:22.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 -- 172.21.15.99:0/507134808 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41b406be60 msgr2=0x7f41b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:22.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41b406be60 0x7f41b406e320 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009bc0 tx=0x7f41c4009190 comp rx=0 tx=0).stop 2024-09-10T07:45:22.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 -- 172.21.15.99:0/507134808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41d406e710 msgr2=0x7f41d406eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:22.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41d406e710 0x7f41d406eb90 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f41d40cebf0 tx=0x7f41cc00e530 comp rx=0 tx=0).stop 2024-09-10T07:45:22.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 -- 172.21.15.99:0/507134808 shutdown_connections 2024-09-10T07:45:22.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f41b406be60 0x7f41b406e320 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41d406e710 0x7f41d406eb90 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41d4152d60 0x7f41d41531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 --2- 172.21.15.99:0/507134808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f41b8003f20 0x7f41d4149380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 -- 172.21.15.99:0/507134808 >> 172.21.15.99:0/507134808 conn(0x7f41d406bc10 msgr2=0x7f41d40b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.394+0000 7f41d9e00640 1 -- 172.21.15.99:0/507134808 shutdown_connections 2024-09-10T07:45:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:22.395+0000 7f41d9e00640 1 -- 172.21.15.99:0/507134808 wait complete. 2024-09-10T07:45:22.410 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T07:45:22.410 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T07:45:22.410 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2024-09-10T07:45:22.411 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T07:45:22.411 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T07:45:22.411 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T07:45:22.411 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T07:45:22.411 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T07:45:22.411 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:45:22.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:22.411 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2024-09-10T07:45:22.452 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T07:45:22.452 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T07:45:22.452 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T07:45:22.452 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:45:22.453 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42102sec preferred_lft 42102sec 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link noprefixroute 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c4c:90ff:fee0:3ee3/64 scope link 2024-09-10T07:45:22.454 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:22.455 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:45:22.455 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:d6:5c:68:b4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:45:22.455 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcd6:5cff:fe68:b45e/64 scope link 2024-09-10T07:45:22.455 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:22.455 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T07:45:22.455 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 86:a0:e5:75:1d:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:45:22.455 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::84a0:e5ff:fe75:1d2e/64 scope link 2024-09-10T07:45:22.455 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2024-09-10T07:45:22.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:22.456 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T07:45:22.553 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-10T07:45:22.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:22.556 DEBUG:teuthology.orchestra.run.smithi187:> route 2024-09-10T07:45:22.593 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2024-09-10T07:45:22.594 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T07:45:22.594 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T07:45:22.594 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T07:45:22.594 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T07:45:22.594 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T07:45:22.594 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2024-09-10T07:45:22.594 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T07:45:22.594 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T07:45:22.594 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T07:45:22.595 DEBUG:teuthology.orchestra.run.smithi187:> ') 2024-09-10T07:45:22.711 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:45:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T07:45:22.783 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:45:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:45:22.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:22.791 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:45:22.826 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:45:22.826 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:45:22.826 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:45:22.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:22.827 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2024-09-10T07:45:22.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:45:22.923 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T07:45:22.958 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T07:45:22.958 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T07:45:22.958 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:45:23.033 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T07:45:23.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:23.033 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:45:23.161 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:45:23.161 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:45:23.188 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T07:45:23.188 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T07:45:23.188 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.99:3300,172.21.15.187:3300,172.21.15.187:3301" 2024-09-10T07:45:23.188 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@d4ff4b75-2329-4b44-969c-780f31c4e94e.cephfs=/ 2024-09-10T07:45:23.188 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.99:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2024-09-10T07:45:23.189 INFO:teuthology.orchestra.run.smithi187.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T07:45:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: You just mounted a file system that supports labels which does not 2024-09-10T07:45:23.189 INFO:teuthology.orchestra.run.smithi187.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T07:45:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T07:45:23.190 INFO:teuthology.orchestra.run.smithi187.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T07:45:23.193 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T07:45:23.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:23.193 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T07:45:23.248 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T07:45:23.326 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:45:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T07:45:23.329 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-10T07:45:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T07:45:23.337 INFO:teuthology.orchestra.run.smithi187.stdout:client7414 2024-09-10T07:45:23.338 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:45:23.338 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:23.374 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:23.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.536+0000 7fc5c8c00640 1 Processor -- start 2024-09-10T07:45:23.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.536+0000 7fc5c8c00640 1 -- start start 2024-09-10T07:45:23.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5c8c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc5c4145290 0x7fc5c406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:23.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5c8c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5c40ce780 0x7fc5c4072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:23.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5c8c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5c4071510 0x7fc5c4072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:23.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5c8c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c406efe0 con 0x7fc5c40ce780 2024-09-10T07:45:23.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5c8c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c406e3d0 con 0x7fc5c4145290 2024-09-10T07:45:23.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5c8c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c406e6b0 con 0x7fc5c4071510 2024-09-10T07:45:23.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5b9400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5c40ce780 0x7fc5c4072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:23.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5c1e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc5c4145290 0x7fc5c406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:23.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5b9400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5c40ce780 0x7fc5c4072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32780/0 (socket says 172.21.15.99:32780) 2024-09-10T07:45:23.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5b9400640 1 -- 172.21.15.99:0/1624617822 learned_addr learned my addr 172.21.15.99:0/1624617822 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:23.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.537+0000 7fc5c2800640 1 --2- 172.21.15.99:0/1624617822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5c4071510 0x7fc5c4072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:23.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.538+0000 7fc5b9400640 1 -- 172.21.15.99:0/1624617822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5c4071510 msgr2=0x7fc5c4072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:23.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.538+0000 7fc5b9400640 1 --2- 172.21.15.99:0/1624617822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5c4071510 0x7fc5c4072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.538+0000 7fc5b9400640 1 -- 172.21.15.99:0/1624617822 >> v2:172.21.15.187:3300/0 conn(0x7fc5c4145290 msgr2=0x7fc5c406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:23.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.538+0000 7fc5b9400640 1 --2- 172.21.15.99:0/1624617822 >> v2:172.21.15.187:3300/0 conn(0x7fc5c4145290 0x7fc5c406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.538+0000 7fc5b9400640 1 -- 172.21.15.99:0/1624617822 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c406e990 con 0x7fc5c40ce780 2024-09-10T07:45:23.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.538+0000 7fc5c1e00640 1 --2- 172.21.15.99:0/1624617822 >> v2:172.21.15.187:3300/0 conn(0x7fc5c4145290 0x7fc5c406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:23.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.539+0000 7fc5b9400640 1 --2- 172.21.15.99:0/1624617822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c40ce780 0x7fc5c4072830 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4075940 tx=0x7fc5ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f18efa27fffbb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.539+0000 7fc5c1400640 1 -- 172.21.15.99:0/1624617822 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac037070 con 0x7fc5c40ce780 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.539+0000 7fc5c1400640 1 -- 172.21.15.99:0/1624617822 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ac032440 con 0x7fc5c40ce780 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.539+0000 7fc5c1400640 1 -- 172.21.15.99:0/1624617822 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac032810 con 0x7fc5c40ce780 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.540+0000 7fc5c8c00640 1 -- 172.21.15.99:0/1624617822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c40ce780 msgr2=0x7fc5c4072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.540+0000 7fc5c8c00640 1 --2- 172.21.15.99:0/1624617822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c40ce780 0x7fc5c4072830 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4075940 tx=0x7fc5ac02a1e0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.540+0000 7fc5c8c00640 1 -- 172.21.15.99:0/1624617822 shutdown_connections 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.540+0000 7fc5c8c00640 1 --2- 172.21.15.99:0/1624617822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5c4071510 0x7fc5c4072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.540+0000 7fc5c8c00640 1 --2- 172.21.15.99:0/1624617822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c40ce780 0x7fc5c4072830 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.540+0000 7fc5c8c00640 1 --2- 172.21.15.99:0/1624617822 >> v2:172.21.15.187:3300/0 conn(0x7fc5c4145290 0x7fc5c406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.540+0000 7fc5c8c00640 1 -- 172.21.15.99:0/1624617822 >> 172.21.15.99:0/1624617822 conn(0x7fc5c406bc10 msgr2=0x7fc5c406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.540+0000 7fc5c8c00640 1 -- 172.21.15.99:0/1624617822 shutdown_connections 2024-09-10T07:45:23.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.540+0000 7fc5c8c00640 1 -- 172.21.15.99:0/1624617822 wait complete. 2024-09-10T07:45:23.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.542+0000 7fc5c8c00640 1 Processor -- start 2024-09-10T07:45:23.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.542+0000 7fc5c8c00640 1 -- start start 2024-09-10T07:45:23.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5c8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c4071510 0x7fc5c40adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:23.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5c8c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5c40ce780 0x7fc5c40af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:23.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5c8c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5c4145290 0x7fc5c413dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:23.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5c8c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c406df80 con 0x7fc5c4071510 2024-09-10T07:45:23.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5c8c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c4145670 con 0x7fc5c40ce780 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5c8c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c406e100 con 0x7fc5c4145290 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5c1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c4071510 0x7fc5c40adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5c1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c4071510 0x7fc5c40adaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32788/0 (socket says 172.21.15.99:32788) 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5c1e00640 1 -- 172.21.15.99:0/3273719853 learned_addr learned my addr 172.21.15.99:0/3273719853 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5b9400640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5c40ce780 0x7fc5c40af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.543+0000 7fc5c2800640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5c4145290 0x7fc5c413dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5c1e00640 1 -- 172.21.15.99:0/3273719853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5c4145290 msgr2=0x7fc5c413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5c1e00640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5c4145290 0x7fc5c413dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5c1e00640 1 -- 172.21.15.99:0/3273719853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5c40ce780 msgr2=0x7fc5c40af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5c1e00640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5c40ce780 0x7fc5c40af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5c1e00640 1 -- 172.21.15.99:0/3273719853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c40aad80 con 0x7fc5c4071510 2024-09-10T07:45:23.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5c1e00640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c4071510 0x7fc5c40adaa0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400ec10 tx=0x7fc5b400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:23.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5baa00640 1 -- 172.21.15.99:0/3273719853 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4017070 con 0x7fc5c4071510 2024-09-10T07:45:23.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5baa00640 1 -- 172.21.15.99:0/3273719853 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b400cc30 con 0x7fc5c4071510 2024-09-10T07:45:23.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5c8c00640 1 -- 172.21.15.99:0/3273719853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c40b00e0 con 0x7fc5c4071510 2024-09-10T07:45:23.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5baa00640 1 -- 172.21.15.99:0/3273719853 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4013470 con 0x7fc5c4071510 2024-09-10T07:45:23.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.544+0000 7fc5c8c00640 1 -- 172.21.15.99:0/3273719853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c41537d0 con 0x7fc5c4071510 2024-09-10T07:45:23.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.546+0000 7fc5c8c00640 1 -- 172.21.15.99:0/3273719853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c406f470 con 0x7fc5c4071510 2024-09-10T07:45:23.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.546+0000 7fc5baa00640 1 -- 172.21.15.99:0/3273719853 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5b401a070 con 0x7fc5c4071510 2024-09-10T07:45:23.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.547+0000 7fc5baa00640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc5a006be60 0x7fc5a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:23.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.547+0000 7fc5baa00640 1 -- 172.21.15.99:0/3273719853 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fc5b408ad40 con 0x7fc5c4071510 2024-09-10T07:45:23.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.547+0000 7fc5b9400640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc5a006be60 0x7fc5a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:23.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.548+0000 7fc5b9400640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc5a006be60 0x7fc5a006e320 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac034000 tx=0x7fc5ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:23.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.552+0000 7fc5baa00640 1 -- 172.21.15.99:0/3273719853 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5b4059000 con 0x7fc5c4071510 2024-09-10T07:45:23.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.756+0000 7fc5c8c00640 1 -- 172.21.15.99:0/3273719853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5c40b58c0 con 0x7fc5c4071510 2024-09-10T07:45:23.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.756+0000 7fc5baa00640 1 -- 172.21.15.99:0/3273719853 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7fc5b405d300 con 0x7fc5c4071510 2024-09-10T07:45:23.756 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:23.756 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":90,"btime":"2024-09-10T07:45:17:511094+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4239870292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4239870292},{"type":"v1","addr":"172.21.15.99:6836","nonce":4239870292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2428750075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2428750075},{"type":"v1","addr":"172.21.15.187:6835","nonce":2428750075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1219809784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1219809784},{"type":"v1","addr":"172.21.15.187:6834","nonce":1219809784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:45:13.894905+0000","modified":"2024-09-10T07:45:16.912907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7276":{"gid":7276,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/256766417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":256766417},{"type":"v1","addr":"172.21.15.99:6837","nonce":256766417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7276,"qdb_cluster":[7276]},"id":11}]} 2024-09-10T07:45:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 90 2024-09-10T07:45:23.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 -- 172.21.15.99:0/3273719853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc5a006be60 msgr2=0x7fc5a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc5a006be60 0x7fc5a006e320 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac034000 tx=0x7fc5ac02e000 comp rx=0 tx=0).stop 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 -- 172.21.15.99:0/3273719853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c4071510 msgr2=0x7fc5c40adaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c4071510 0x7fc5c40adaa0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400ec10 tx=0x7fc5b400c520 comp rx=0 tx=0).stop 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 -- 172.21.15.99:0/3273719853 shutdown_connections 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5c4145290 0x7fc5c413dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5c40ce780 0x7fc5c40af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc5a006be60 0x7fc5a006e320 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 --2- 172.21.15.99:0/3273719853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5c4071510 0x7fc5c40adaa0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 -- 172.21.15.99:0/3273719853 >> 172.21.15.99:0/3273719853 conn(0x7fc5c406bc10 msgr2=0x7fc5c40b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 -- 172.21.15.99:0/3273719853 shutdown_connections 2024-09-10T07:45:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:23.759+0000 7fc5c8c00640 1 -- 172.21.15.99:0/3273719853 wait complete. 2024-09-10T07:45:23.774 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-10T07:45:23.952 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":7276,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.4580267419999995,"mdsmap_epoch":90,"osdmap_epoch":188,"osdmap_epoch_barrier":188,"uptime":14.542591432} 2024-09-10T07:45:23.952 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 7276, "mdsmap_epoch": 90, "osdmap_epoch": 188, "osdmap_epoch_barrier": 188, "rank_uptime": 9.458026742, "state": "up:active", "uptime": 14.542591432, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:45:23.953 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-10T07:45:24.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.110+0000 7fcbaf400640 1 Processor -- start 2024-09-10T07:45:24.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.110+0000 7fcbaf400640 1 -- start start 2024-09-10T07:45:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.111+0000 7fcbaf400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcba815ed00 0x7fcba80d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.111+0000 7fcbaf400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba80d1a90 0x7fcba80b8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.111+0000 7fcbaf400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcba80d3880 con 0x7fcba80d2000 2024-09-10T07:45:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.111+0000 7fcbaf400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fcba80b7b90 con 0x7fcba815ed00 2024-09-10T07:45:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.111+0000 7fcbaf400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcba80b7e70 con 0x7fcba80d1a90 2024-09-10T07:45:24.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.111+0000 7fcbaca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcba815ed00 0x7fcba80d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.111+0000 7fcbaca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcba815ed00 0x7fcba80d31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32792/0 (socket says 172.21.15.99:32792) 2024-09-10T07:45:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.111+0000 7fcbaca00640 1 -- 172.21.15.99:0/723905558 learned_addr learned my addr 172.21.15.99:0/723905558 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.112+0000 7fcbad400640 1 --2- 172.21.15.99:0/723905558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba80d1a90 0x7fcba80b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.112+0000 7fcbaca00640 1 -- 172.21.15.99:0/723905558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba80d1a90 msgr2=0x7fcba80b8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.112+0000 7fcbaca00640 1 --2- 172.21.15.99:0/723905558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba80d1a90 0x7fcba80b8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.112+0000 7fcbaca00640 1 -- 172.21.15.99:0/723905558 >> v1:172.21.15.187:6789/0 conn(0x7fcba80d2000 legacy=0x7fcba80d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.112+0000 7fcbaca00640 1 -- 172.21.15.99:0/723905558 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba80b8150 con 0x7fcba815ed00 2024-09-10T07:45:24.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.112+0000 7fcbad400640 1 --2- 172.21.15.99:0/723905558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba80d1a90 0x7fcba80b8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:24.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.113+0000 7fcbaca00640 1 --2- 172.21.15.99:0/723905558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba815ed00 0x7fcba80d31f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009870 tx=0x7fcb9802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f43f079cddca30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:24.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.113+0000 7fcba7e00640 1 -- 172.21.15.99:0/723905558 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98037070 con 0x7fcba815ed00 2024-09-10T07:45:24.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.113+0000 7fcba7e00640 1 -- 172.21.15.99:0/723905558 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb98032440 con 0x7fcba815ed00 2024-09-10T07:45:24.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.113+0000 7fcba7e00640 1 -- 172.21.15.99:0/723905558 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98032810 con 0x7fcba815ed00 2024-09-10T07:45:24.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.114+0000 7fcbaf400640 1 -- 172.21.15.99:0/723905558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba815ed00 msgr2=0x7fcba80d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:24.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.114+0000 7fcbaf400640 1 --2- 172.21.15.99:0/723905558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba815ed00 0x7fcba80d31f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009870 tx=0x7fcb9802a250 comp rx=0 tx=0).stop 2024-09-10T07:45:24.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.114+0000 7fcbaf400640 1 -- 172.21.15.99:0/723905558 shutdown_connections 2024-09-10T07:45:24.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.114+0000 7fcbaf400640 1 --2- 172.21.15.99:0/723905558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba80d1a90 0x7fcba80b8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:24.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.114+0000 7fcbaf400640 1 --2- 172.21.15.99:0/723905558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba815ed00 0x7fcba80d31f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:24.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.114+0000 7fcbaf400640 1 -- 172.21.15.99:0/723905558 >> 172.21.15.99:0/723905558 conn(0x7fcba80d4c10 msgr2=0x7fcba80d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:24.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.114+0000 7fcbaf400640 1 -- 172.21.15.99:0/723905558 shutdown_connections 2024-09-10T07:45:24.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.114+0000 7fcbaf400640 1 -- 172.21.15.99:0/723905558 wait complete. 2024-09-10T07:45:24.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.115+0000 7fcbaf400640 1 Processor -- start 2024-09-10T07:45:24.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.116+0000 7fcbaf400640 1 -- start start 2024-09-10T07:45:24.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.116+0000 7fcbaf400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcba80d1a90 0x7fcba8157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.116+0000 7fcbaf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba80d2000 0x7fcba8160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.116+0000 7fcbaf400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba815ed00 0x7fcba80ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.116+0000 7fcbaf400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcba815f0e0 con 0x7fcba80d2000 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.116+0000 7fcbaf400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcba80d2490 con 0x7fcba80d1a90 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.116+0000 7fcbaf400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcba815f260 con 0x7fcba815ed00 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcb9fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba80d2000 0x7fcba8160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcb9fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba80d2000 0x7fcba8160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32804/0 (socket says 172.21.15.99:32804) 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcb9fe00640 1 -- 172.21.15.99:0/1220836138 learned_addr learned my addr 172.21.15.99:0/1220836138 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcbaca00640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcba80d1a90 0x7fcba8157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcbad400640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba815ed00 0x7fcba80ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcb9fe00640 1 -- 172.21.15.99:0/1220836138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba815ed00 msgr2=0x7fcba80ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcb9fe00640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba815ed00 0x7fcba80ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:24.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcb9fe00640 1 -- 172.21.15.99:0/1220836138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcba80d1a90 msgr2=0x7fcba8157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:24.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcb9fe00640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcba80d1a90 0x7fcba8157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:24.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcb9fe00640 1 -- 172.21.15.99:0/1220836138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba80c9510 con 0x7fcba80d2000 2024-09-10T07:45:24.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.117+0000 7fcb9fe00640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba80d2000 0x7fcba8160260 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000c400 tx=0x7fcb9000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:24.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.118+0000 7fcba5600640 1 -- 172.21.15.99:0/1220836138 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb900052d0 con 0x7fcba80d2000 2024-09-10T07:45:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.118+0000 7fcba5600640 1 -- 172.21.15.99:0/1220836138 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb90005490 con 0x7fcba80d2000 2024-09-10T07:45:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.118+0000 7fcba5600640 1 -- 172.21.15.99:0/1220836138 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90007260 con 0x7fcba80d2000 2024-09-10T07:45:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.118+0000 7fcbaf400640 1 -- 172.21.15.99:0/1220836138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba8160bd0 con 0x7fcba80d2000 2024-09-10T07:45:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.118+0000 7fcbaf400640 1 -- 172.21.15.99:0/1220836138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba81576a0 con 0x7fcba80d2000 2024-09-10T07:45:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.119+0000 7fcbaf400640 1 -- 172.21.15.99:0/1220836138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba80c9970 con 0x7fcba80d2000 2024-09-10T07:45:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.120+0000 7fcba5600640 1 -- 172.21.15.99:0/1220836138 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb90007400 con 0x7fcba80d2000 2024-09-10T07:45:24.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.120+0000 7fcba5600640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb8406be30 0x7fcb8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:24.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.121+0000 7fcba5600640 1 -- 172.21.15.99:0/1220836138 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fcb9008a300 con 0x7fcba80d2000 2024-09-10T07:45:24.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.121+0000 7fcbaca00640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb8406be30 0x7fcb8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:24.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.121+0000 7fcbaca00640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb8406be30 0x7fcb8406e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcb98034000 tx=0x7fcb9802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:24.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.125+0000 7fcba5600640 1 -- 172.21.15.99:0/1220836138 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb90058650 con 0x7fcba80d2000 2024-09-10T07:45:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.295+0000 7fcbaf400640 1 -- 172.21.15.99:0/1220836138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7fcba806c8d0 con 0x7fcba80d2000 2024-09-10T07:45:24.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.542+0000 7fcba5600640 1 -- 172.21.15.99:0/1220836138 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v189) ==== 181+0+0 (secure 0 0 0) 0x7fcb9005c950 con 0x7fcba80d2000 2024-09-10T07:45:24.542 INFO:teuthology.orchestra.run.smithi099.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-10T07:45:24.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.545+0000 7fcbaf400640 1 -- 172.21.15.99:0/1220836138 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb8406be30 msgr2=0x7fcb8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:24.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.545+0000 7fcbaf400640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb8406be30 0x7fcb8406e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcb98034000 tx=0x7fcb9802e000 comp rx=0 tx=0).stop 2024-09-10T07:45:24.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.545+0000 7fcbaf400640 1 -- 172.21.15.99:0/1220836138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba80d2000 msgr2=0x7fcba8160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:24.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.545+0000 7fcbaf400640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba80d2000 0x7fcba8160260 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000c400 tx=0x7fcb9000c8c0 comp rx=0 tx=0).stop 2024-09-10T07:45:24.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.545+0000 7fcbaf400640 1 -- 172.21.15.99:0/1220836138 shutdown_connections 2024-09-10T07:45:24.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.545+0000 7fcbaf400640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcba815ed00 0x7fcba80ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:24.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.545+0000 7fcbaf400640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcb8406be30 0x7fcb8406e2f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:24.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.545+0000 7fcbaf400640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcba80d2000 0x7fcba8160260 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:24.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.545+0000 7fcbaf400640 1 --2- 172.21.15.99:0/1220836138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcba80d1a90 0x7fcba8157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:24.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.545+0000 7fcbaf400640 1 -- 172.21.15.99:0/1220836138 >> 172.21.15.99:0/1220836138 conn(0x7fcba80d4c10 msgr2=0x7fcba80b9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:24.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.546+0000 7fcbaf400640 1 -- 172.21.15.99:0/1220836138 shutdown_connections 2024-09-10T07:45:24.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:24.546+0000 7fcbaf400640 1 -- 172.21.15.99:0/1220836138 wait complete. 2024-09-10T07:45:24.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-10T07:45:24.729 INFO:teuthology.orchestra.run.smithi099.stdout:{"osd_mon_report_interval":"5"} 2024-09-10T07:45:24.729 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-10T07:45:24.729 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-10T07:45:24.729 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:24.730 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:24.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:24.765 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-10T07:45:24.979 INFO:teuthology.orchestra.run.smithi099.stderr:16+0 records in 2024-09-10T07:45:24.979 INFO:teuthology.orchestra.run.smithi099.stderr:16+0 records out 2024-09-10T07:45:24.979 INFO:teuthology.orchestra.run.smithi099.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.132713 s, 126 MB/s 2024-09-10T07:45:24.980 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:24.980 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:25.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:25.016 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-10T07:45:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:17+0 records in 2024-09-10T07:45:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:17+0 records out 2024-09-10T07:45:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.126689 s, 141 MB/s 2024-09-10T07:45:25.220 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-10T07:45:25.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:45:25.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.373+0000 7ff560000640 1 Processor -- start 2024-09-10T07:45:25.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.373+0000 7ff560000640 1 -- start start 2024-09-10T07:45:25.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.374+0000 7ff560000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff5580ce780 0x7ff55806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:25.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.374+0000 7ff560000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55806e3d0 con 0x7ff558145290 2024-09-10T07:45:25.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.374+0000 7ff560000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55806e6b0 con 0x7ff558072f40 2024-09-10T07:45:25.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.374+0000 7ff560000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff55806efe0 con 0x7ff5580ce780 2024-09-10T07:45:25.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.374+0000 7ff55d600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff558145290 0x7ff558072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47224/0 (socket says 172.21.15.99:47224) 2024-09-10T07:45:25.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.374+0000 7ff55d600640 1 -- 172.21.15.99:0/2473806744 learned_addr learned my addr 172.21.15.99:0/2473806744 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:25.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff55e000640 1 --2- 172.21.15.99:0/2473806744 >> v2:172.21.15.187:3300/0 conn(0x7ff5580ce780 0x7ff55806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:25.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 801009172 0 0) 0x7ff55806e3d0 con 0x7ff558145290 2024-09-10T07:45:25.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff540003520 con 0x7ff558145290 2024-09-10T07:45:25.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1447543113 0 0) 0x7ff540003520 con 0x7ff558145290 2024-09-10T07:45:25.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 >> v2:172.21.15.187:3300/0 conn(0x7ff5580ce780 msgr2=0x7ff55806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:25.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 --2- 172.21.15.99:0/2473806744 >> v2:172.21.15.187:3300/0 conn(0x7ff5580ce780 0x7ff55806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:25.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 >> v1:172.21.15.187:6789/0 conn(0x7ff558072f40 legacy=0x7ff5580b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:25.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55806e990 con 0x7ff558145290 2024-09-10T07:45:25.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7ff54c001670 con 0x7ff558145290 2024-09-10T07:45:25.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 >> v1:172.21.15.99:6789/0 conn(0x7ff558145290 legacy=0x7ff558072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:25.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5400039b0 0x7ff540003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff540004800 0x7ff540004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5400051c0 0x7ff54000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff55806efe0 con 0x7ff5400039b0 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff54000c010 con 0x7ff5400051c0 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.375+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff54000c210 con 0x7ff540004800 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.376+0000 7ff55d600640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5400039b0 0x7ff540003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.376+0000 7ff55e000640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5400051c0 0x7ff54000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.376+0000 7ff55cc00640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff540004800 0x7ff540004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.376+0000 7ff55d600640 1 -- 172.21.15.99:0/2473806744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff540004800 msgr2=0x7ff540004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.376+0000 7ff55d600640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff540004800 0x7ff540004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.376+0000 7ff55d600640 1 -- 172.21.15.99:0/2473806744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5400051c0 msgr2=0x7ff54000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.376+0000 7ff55d600640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5400051c0 0x7ff54000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.376+0000 7ff55d600640 1 -- 172.21.15.99:0/2473806744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff540003520 con 0x7ff5400039b0 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.376+0000 7ff55e000640 1 -- 172.21.15.99:0/2473806744 reap_dead start 2024-09-10T07:45:25.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.376+0000 7ff55cc00640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff540004800 0x7ff540004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:25.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.377+0000 7ff55d600640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5400039b0 0x7ff540003d90 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff54c007c20 tx=0x7ff540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bab79093e823de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:25.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.377+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c007c60 con 0x7ff5400039b0 2024-09-10T07:45:25.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.377+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c005ad0 con 0x7ff5400039b0 2024-09-10T07:45:25.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.377+0000 7ff557e00640 1 -- 172.21.15.99:0/2473806744 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c007070 con 0x7ff5400039b0 2024-09-10T07:45:25.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.378+0000 7ff560000640 1 -- 172.21.15.99:0/2473806744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5400039b0 msgr2=0x7ff540003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:25.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.378+0000 7ff560000640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5400039b0 0x7ff540003d90 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff54c007c20 tx=0x7ff540005830 comp rx=0 tx=0).stop 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.378+0000 7ff560000640 1 -- 172.21.15.99:0/2473806744 shutdown_connections 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.378+0000 7ff560000640 1 --2- 172.21.15.99:0/2473806744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5400039b0 0x7ff540003d90 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.378+0000 7ff560000640 1 -- 172.21.15.99:0/2473806744 >> 172.21.15.99:0/2473806744 conn(0x7ff55806bc10 msgr2=0x7ff55806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.378+0000 7ff560000640 1 -- 172.21.15.99:0/2473806744 shutdown_connections 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.378+0000 7ff560000640 1 -- 172.21.15.99:0/2473806744 wait complete. 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.380+0000 7ff560000640 1 Processor -- start 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.380+0000 7ff560000640 1 -- start start 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff560000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5400039b0 0x7ff558140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff560000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff55815e5e0 0x7ff55813bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff560000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff55815ea60 0x7ff55813c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff560000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff55806df80 con 0x7ff55815ea60 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff560000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff558145670 con 0x7ff5400039b0 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff560000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff55806e100 con 0x7ff55815e5e0 2024-09-10T07:45:25.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff55815ea60 0x7ff55813c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff55815ea60 0x7ff55813c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32822/0 (socket says 172.21.15.99:32822) 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55e000640 1 -- 172.21.15.99:0/3396353009 learned_addr learned my addr 172.21.15.99:0/3396353009 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55d600640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5400039b0 0x7ff558140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55cc00640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff55815e5e0 0x7ff55813bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55e000640 1 -- 172.21.15.99:0/3396353009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff55815e5e0 msgr2=0x7ff55813bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55e000640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff55815e5e0 0x7ff55813bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55e000640 1 -- 172.21.15.99:0/3396353009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5400039b0 msgr2=0x7ff558140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55e000640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5400039b0 0x7ff558140680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55e000640 1 -- 172.21.15.99:0/3396353009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55815c040 con 0x7ff55815ea60 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.381+0000 7ff55cc00640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff55815e5e0 0x7ff55813bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.382+0000 7ff55e000640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff55815ea60 0x7ff55813c2c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff5580685b0 tx=0x7ff55000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.382+0000 7ff555600640 1 -- 172.21.15.99:0/3396353009 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55000fe10 con 0x7ff55815ea60 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.382+0000 7ff555600640 1 -- 172.21.15.99:0/3396353009 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff55001d070 con 0x7ff55815ea60 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.382+0000 7ff555600640 1 -- 172.21.15.99:0/3396353009 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550015670 con 0x7ff55815ea60 2024-09-10T07:45:25.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.382+0000 7ff560000640 1 -- 172.21.15.99:0/3396353009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff558143ae0 con 0x7ff55815ea60 2024-09-10T07:45:25.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.382+0000 7ff560000640 1 -- 172.21.15.99:0/3396353009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5581440a0 con 0x7ff55815ea60 2024-09-10T07:45:25.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.383+0000 7ff560000640 1 -- 172.21.15.99:0/3396353009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff558071d60 con 0x7ff55815ea60 2024-09-10T07:45:25.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.384+0000 7ff555600640 1 -- 172.21.15.99:0/3396353009 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff550015810 con 0x7ff55815ea60 2024-09-10T07:45:25.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.385+0000 7ff555600640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff53806be30 0x7ff53806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:25.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.385+0000 7ff555600640 1 -- 172.21.15.99:0/3396353009 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7ff55008b720 con 0x7ff55815ea60 2024-09-10T07:45:25.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.385+0000 7ff55d600640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff53806be30 0x7ff53806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:25.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.386+0000 7ff55d600640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff53806be30 0x7ff53806e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff54c035000 tx=0x7ff54c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:25.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.389+0000 7ff555600640 1 -- 172.21.15.99:0/3396353009 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff550010040 con 0x7ff55815ea60 2024-09-10T07:45:25.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.568+0000 7ff560000640 1 -- 172.21.15.99:0/3396353009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7ff55815c210 con 0x7ff55815ea60 2024-09-10T07:45:25.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.570+0000 7ff555600640 1 -- 172.21.15.99:0/3396353009 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) ==== 81+0+34246 (secure 0 0 0) 0x7ff55005a0d0 con 0x7ff55815ea60 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 189, 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:45:24.541883+0000", 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:45:25.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 23, 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:45:25.571 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:25.572 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:25.573 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:25.574 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:25.576 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:45:25.577 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 22, 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:11.664665+0000", 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:25.578 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:45:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "187", 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:25.580 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:25.581 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:25.582 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:25.583 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 23, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:12.889786+0000", 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "189", 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:25.587 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:25.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:25.589 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:45:25.590 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:25.591 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:25.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.594 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:45:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.595 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:25.596 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:25.597 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:45:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.600 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:45:25.601 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:25.602 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:25.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.606 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:25.607 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.608 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.609 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:25.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:45:25.612 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:25.613 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:25.615 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:25.616 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:45:25.617 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:25.618 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.619 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.620 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:25.621 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:45:25.622 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:25.623 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:25.624 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:45:25.627 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:25.628 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.629 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:45:25.630 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:25.631 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:25.633 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:25.634 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:25.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:25.636 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:25.637 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:25.638 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:45:25.639 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:45:25.640 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:45:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:45:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:45:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:45:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:45:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:45:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:45:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:45:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:45:25.641 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:25.641 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:45:25.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.572+0000 7ff560000640 1 -- 172.21.15.99:0/3396353009 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff53806be30 msgr2=0x7ff53806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:25.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.572+0000 7ff560000640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff53806be30 0x7ff53806e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff54c035000 tx=0x7ff54c030000 comp rx=0 tx=0).stop 2024-09-10T07:45:25.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.572+0000 7ff560000640 1 -- 172.21.15.99:0/3396353009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff55815ea60 msgr2=0x7ff55813c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:25.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.572+0000 7ff560000640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff55815ea60 0x7ff55813c2c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff5580685b0 tx=0x7ff55000f580 comp rx=0 tx=0).stop 2024-09-10T07:45:25.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.573+0000 7ff560000640 1 -- 172.21.15.99:0/3396353009 shutdown_connections 2024-09-10T07:45:25.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.573+0000 7ff560000640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff53806be30 0x7ff53806e2f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:25.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.573+0000 7ff560000640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff55815ea60 0x7ff55813c2c0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:25.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.573+0000 7ff560000640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff55815e5e0 0x7ff55813bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:25.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.573+0000 7ff560000640 1 --2- 172.21.15.99:0/3396353009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5400039b0 0x7ff558140680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:25.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.573+0000 7ff560000640 1 -- 172.21.15.99:0/3396353009 >> 172.21.15.99:0/3396353009 conn(0x7ff55806bc10 msgr2=0x7ff5580b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:25.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.573+0000 7ff560000640 1 -- 172.21.15.99:0/3396353009 shutdown_connections 2024-09-10T07:45:25.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:25.573+0000 7ff560000640 1 -- 172.21.15.99:0/3396353009 wait complete. 2024-09-10T07:45:25.644 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:45:30.645 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:45:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.809+0000 7f3c04c00640 1 Processor -- start 2024-09-10T07:45:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.809+0000 7f3c04c00640 1 -- start start 2024-09-10T07:45:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.810+0000 7f3c04c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c0015e970 0x7f3c000d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.810+0000 7f3c04c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3c000d2680 0x7f3c000cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.810+0000 7f3c04c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3c000cfac0 0x7f3c000d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.810+0000 7f3c04c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f3c000d37e0 con 0x7f3c000cfac0 2024-09-10T07:45:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.810+0000 7f3c04c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f3c000d2bd0 con 0x7f3c000d2680 2024-09-10T07:45:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.810+0000 7f3c04c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3c000d2eb0 con 0x7f3c0015e970 2024-09-10T07:45:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.810+0000 7f3bffe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3c000cfac0 0x7f3c000d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.811+0000 7f3bffe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3c000cfac0 0x7f3c000d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38228/0 (socket says 172.21.15.99:38228) 2024-09-10T07:45:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.811+0000 7f3bffe00640 1 -- 172.21.15.99:0/3028044241 learned_addr learned my addr 172.21.15.99:0/3028044241 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.811+0000 7f3bff400640 1 --2- 172.21.15.99:0/3028044241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c0015e970 0x7f3c000d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.811+0000 7f3bfea00640 1 --2- 172.21.15.99:0/3028044241 >> v2:172.21.15.187:3300/0 conn(0x7f3c000d2680 0x7f3c000cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.811+0000 7f3bffe00640 1 -- 172.21.15.99:0/3028044241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c0015e970 msgr2=0x7f3c000d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.811+0000 7f3bffe00640 1 --2- 172.21.15.99:0/3028044241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c0015e970 0x7f3c000d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.811+0000 7f3bffe00640 1 -- 172.21.15.99:0/3028044241 >> v2:172.21.15.187:3300/0 conn(0x7f3c000d2680 msgr2=0x7f3c000cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.811+0000 7f3bffe00640 1 --2- 172.21.15.99:0/3028044241 >> v2:172.21.15.187:3300/0 conn(0x7f3c000d2680 0x7f3c000cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.811+0000 7f3bffe00640 1 -- 172.21.15.99:0/3028044241 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c000d3190 con 0x7f3c000cfac0 2024-09-10T07:45:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.812+0000 7f3bffe00640 1 --2- 172.21.15.99:0/3028044241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 0x7f3c000d0ff0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f3c0008dd70 tx=0x7f3bf802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666e5b08147febd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.812+0000 7f3bfe000640 1 -- 172.21.15.99:0/3028044241 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8036070 con 0x7f3c000cfac0 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.812+0000 7f3bfe000640 1 -- 172.21.15.99:0/3028044241 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf8031600 con 0x7f3c000cfac0 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.812+0000 7f3bfe000640 1 -- 172.21.15.99:0/3028044241 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80319d0 con 0x7f3c000cfac0 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.813+0000 7f3c04c00640 1 -- 172.21.15.99:0/3028044241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 msgr2=0x7f3c000d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.813+0000 7f3c04c00640 1 --2- 172.21.15.99:0/3028044241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 0x7f3c000d0ff0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f3c0008dd70 tx=0x7f3bf802a730 comp rx=0 tx=0).stop 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.813+0000 7f3c04c00640 1 -- 172.21.15.99:0/3028044241 shutdown_connections 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.813+0000 7f3c04c00640 1 --2- 172.21.15.99:0/3028044241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 0x7f3c000d0ff0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.813+0000 7f3c04c00640 1 --2- 172.21.15.99:0/3028044241 >> v2:172.21.15.187:3300/0 conn(0x7f3c000d2680 0x7f3c000cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.813+0000 7f3c04c00640 1 --2- 172.21.15.99:0/3028044241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c0015e970 0x7f3c000d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.813+0000 7f3c04c00640 1 -- 172.21.15.99:0/3028044241 >> 172.21.15.99:0/3028044241 conn(0x7f3c0009de00 msgr2=0x7f3c000d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.813+0000 7f3c04c00640 1 -- 172.21.15.99:0/3028044241 shutdown_connections 2024-09-10T07:45:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.813+0000 7f3c04c00640 1 -- 172.21.15.99:0/3028044241 wait complete. 2024-09-10T07:45:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.815+0000 7f3c04c00640 1 Processor -- start 2024-09-10T07:45:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.815+0000 7f3c04c00640 1 -- start start 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.815+0000 7f3c04c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 0x7f3c000b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.815+0000 7f3c04c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c000d2680 0x7f3c000cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3c04c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c0015e970 0x7f3c000cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3c04c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3c000d0840 con 0x7f3c000cfac0 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3c04c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3c000cff70 con 0x7f3c000d2680 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3c04c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0015ed50 con 0x7f3c0015e970 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3bff400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 0x7f3c000b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3bff400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 0x7f3c000b92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38234/0 (socket says 172.21.15.99:38234) 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3bff400640 1 -- 172.21.15.99:0/1638842121 learned_addr learned my addr 172.21.15.99:0/1638842121 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3bfea00640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c000d2680 0x7f3c000cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3bffe00640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c0015e970 0x7f3c000cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3bff400640 1 -- 172.21.15.99:0/1638842121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c0015e970 msgr2=0x7f3c000cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3bff400640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c0015e970 0x7f3c000cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3bff400640 1 -- 172.21.15.99:0/1638842121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c000d2680 msgr2=0x7f3c000cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3bff400640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c000d2680 0x7f3c000cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.816+0000 7f3bff400640 1 -- 172.21.15.99:0/1638842121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0015f1e0 con 0x7f3c000cfac0 2024-09-10T07:45:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.817+0000 7f3bff400640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 0x7f3c000b92e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000d830 tx=0x7f3bf000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.817+0000 7f3bf7400640 1 -- 172.21.15.99:0/1638842121 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000b6c0 con 0x7f3c000cfac0 2024-09-10T07:45:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.817+0000 7f3bf7400640 1 -- 172.21.15.99:0/1638842121 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0019070 con 0x7f3c000cfac0 2024-09-10T07:45:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.817+0000 7f3bf7400640 1 -- 172.21.15.99:0/1638842121 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000ba80 con 0x7f3c000cfac0 2024-09-10T07:45:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.817+0000 7f3c04c00640 1 -- 172.21.15.99:0/1638842121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0015f480 con 0x7f3c000cfac0 2024-09-10T07:45:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.817+0000 7f3c04c00640 1 -- 172.21.15.99:0/1638842121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c000b9820 con 0x7f3c000cfac0 2024-09-10T07:45:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.818+0000 7f3c04c00640 1 -- 172.21.15.99:0/1638842121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c000cf580 con 0x7f3c000cfac0 2024-09-10T07:45:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.819+0000 7f3bf7400640 1 -- 172.21.15.99:0/1638842121 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bf001e460 con 0x7f3c000cfac0 2024-09-10T07:45:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.820+0000 7f3bf7400640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3be006be30 0x7f3be006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.820+0000 7f3bf7400640 1 -- 172.21.15.99:0/1638842121 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5709+0+0 (secure 0 0 0) 0x7f3bf008b460 con 0x7f3c000cfac0 2024-09-10T07:45:30.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.820+0000 7f3bfea00640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3be006be30 0x7f3be006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:30.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.821+0000 7f3bfea00640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3be006be30 0x7f3be006e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3c000ba930 tx=0x7f3bec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:30.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:30.824+0000 7f3bf7400640 1 -- 172.21.15.99:0/1638842121 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3bf0059690 con 0x7f3c000cfac0 2024-09-10T07:45:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.002+0000 7f3c04c00640 1 -- 172.21.15.99:0/1638842121 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f3c0006c460 con 0x7f3c000cfac0 2024-09-10T07:45:31.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.003+0000 7f3bf7400640 1 -- 172.21.15.99:0/1638842121 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) ==== 81+0+34246 (secure 0 0 0) 0x7f3bf005d990 con 0x7f3c000cfac0 2024-09-10T07:45:31.003 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:31.003 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 189, 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:45:24.541883+0000", 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:45:31.004 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 23, 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:45:31.005 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:31.006 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:31.007 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:31.008 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:31.009 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:31.010 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:45:31.011 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 22, 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:11.664665+0000", 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:31.012 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:45:31.013 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "187", 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:31.014 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:31.015 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:31.016 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:31.017 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 23, 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:12.889786+0000", 2024-09-10T07:45:31.018 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:31.019 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "189", 2024-09-10T07:45:31.020 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:31.021 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:31.022 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.023 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:31.024 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:31.025 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:31.026 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.027 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.027 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:31.027 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.027 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.027 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:45:31.027 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:31.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:31.030 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:31.031 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.032 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.033 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:45:31.035 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:31.036 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:45:31.037 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:31.038 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.039 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.040 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:31.041 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.042 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.043 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.044 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:45:31.046 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:31.047 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:31.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.049 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:31.050 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:45:31.051 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.052 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:31.053 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:31.055 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:31.056 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:45:31.057 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:31.058 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:45:31.059 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.060 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.061 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.062 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:31.064 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:31.065 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.067 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:45:31.068 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:31.069 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.070 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:31.071 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:31.072 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:45:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:45:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:45:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:45:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:31.077 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:45:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 -- 172.21.15.99:0/1638842121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3be006be30 msgr2=0x7f3be006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3be006be30 0x7f3be006e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3c000ba930 tx=0x7f3bec008040 comp rx=0 tx=0).stop 2024-09-10T07:45:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 -- 172.21.15.99:0/1638842121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 msgr2=0x7f3c000b92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 0x7f3c000b92e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000d830 tx=0x7f3bf000dcf0 comp rx=0 tx=0).stop 2024-09-10T07:45:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 -- 172.21.15.99:0/1638842121 shutdown_connections 2024-09-10T07:45:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c0015e970 0x7f3c000cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c000d2680 0x7f3c000cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f3be006be30 0x7f3be006e2f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 --2- 172.21.15.99:0/1638842121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c000cfac0 0x7f3c000b92e0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 -- 172.21.15.99:0/1638842121 >> 172.21.15.99:0/1638842121 conn(0x7f3c0009de00 msgr2=0x7f3c000c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 -- 172.21.15.99:0/1638842121 shutdown_connections 2024-09-10T07:45:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:31.006+0000 7f3c04c00640 1 -- 172.21.15.99:0/1638842121 wait complete. 2024-09-10T07:45:31.079 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:45:36.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:45:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.244+0000 7fa5e1e00640 1 Processor -- start 2024-09-10T07:45:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.244+0000 7fa5e1e00640 1 -- start start 2024-09-10T07:45:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.245+0000 7fa5e1e00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa5dc0cf010 0x7fa5dc0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.245+0000 7fa5e1e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa5dc162ba0 0x7fa5dc164f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.245+0000 7fa5e1e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5dc15c4f0 con 0x7fa5dc152210 2024-09-10T07:45:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.245+0000 7fa5e1e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa5dc15b730 con 0x7fa5dc162ba0 2024-09-10T07:45:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.245+0000 7fa5e1e00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa5dc15ba10 con 0x7fa5dc0cf010 2024-09-10T07:45:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.245+0000 7fa5daa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa5dc152210 0x7fa5dc071e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38356/0 (socket says 172.21.15.99:38356) 2024-09-10T07:45:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.245+0000 7fa5daa00640 1 -- 172.21.15.99:0/650879049 learned_addr learned my addr 172.21.15.99:0/650879049 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:36.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.245+0000 7fa5db400640 1 --2- 172.21.15.99:0/650879049 >> v2:172.21.15.99:3300/0 conn(0x7fa5dc162ba0 0x7fa5dc164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:36.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.246+0000 7fa5da000640 1 --2- 172.21.15.99:0/650879049 >> v2:172.21.15.187:3300/0 conn(0x7fa5dc0cf010 0x7fa5dc0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:36.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.246+0000 7fa5db400640 1 -- 172.21.15.99:0/650879049 >> v2:172.21.15.187:3300/0 conn(0x7fa5dc0cf010 msgr2=0x7fa5dc0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:36.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.246+0000 7fa5db400640 1 --2- 172.21.15.99:0/650879049 >> v2:172.21.15.187:3300/0 conn(0x7fa5dc0cf010 0x7fa5dc0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:36.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.246+0000 7fa5db400640 1 -- 172.21.15.99:0/650879049 >> v1:172.21.15.99:6789/0 conn(0x7fa5dc152210 legacy=0x7fa5dc071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:36.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.246+0000 7fa5db400640 1 -- 172.21.15.99:0/650879049 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc15bcf0 con 0x7fa5dc162ba0 2024-09-10T07:45:36.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.246+0000 7fa5d9600640 1 -- 172.21.15.99:0/650879049 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805327543 0 0) 0x7fa5dc15c4f0 con 0x7fa5dc152210 2024-09-10T07:45:36.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.247+0000 7fa5db400640 1 --2- 172.21.15.99:0/650879049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc162ba0 0x7fa5dc164f90 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0cfbd0 tx=0x7fa5d402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6ad32496ed5579 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:36.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.247+0000 7fa5d9600640 1 -- 172.21.15.99:0/650879049 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4007740 con 0x7fa5dc162ba0 2024-09-10T07:45:36.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.247+0000 7fa5d9600640 1 -- 172.21.15.99:0/650879049 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d40078e0 con 0x7fa5dc162ba0 2024-09-10T07:45:36.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.247+0000 7fa5d9600640 1 -- 172.21.15.99:0/650879049 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4007cb0 con 0x7fa5dc162ba0 2024-09-10T07:45:36.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.248+0000 7fa5e1e00640 1 -- 172.21.15.99:0/650879049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc162ba0 msgr2=0x7fa5dc164f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:36.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.248+0000 7fa5e1e00640 1 --2- 172.21.15.99:0/650879049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc162ba0 0x7fa5dc164f90 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0cfbd0 tx=0x7fa5d402a680 comp rx=0 tx=0).stop 2024-09-10T07:45:36.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.248+0000 7fa5e1e00640 1 -- 172.21.15.99:0/650879049 shutdown_connections 2024-09-10T07:45:36.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.248+0000 7fa5e1e00640 1 --2- 172.21.15.99:0/650879049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc162ba0 0x7fa5dc164f90 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:36.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.248+0000 7fa5e1e00640 1 --2- 172.21.15.99:0/650879049 >> v2:172.21.15.187:3300/0 conn(0x7fa5dc0cf010 0x7fa5dc0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:36.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.248+0000 7fa5e1e00640 1 -- 172.21.15.99:0/650879049 >> 172.21.15.99:0/650879049 conn(0x7fa5dc06bc10 msgr2=0x7fa5dc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:36.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.248+0000 7fa5e1e00640 1 -- 172.21.15.99:0/650879049 shutdown_connections 2024-09-10T07:45:36.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.248+0000 7fa5e1e00640 1 -- 172.21.15.99:0/650879049 wait complete. 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.249+0000 7fa5e1e00640 1 Processor -- start 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.250+0000 7fa5e1e00640 1 -- start start 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.250+0000 7fa5e1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc0cf010 0x7fa5dc14e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.250+0000 7fa5e1e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5dc152210 0x7fa5dc143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.250+0000 7fa5e1e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5dc162ba0 0x7fa5dc162190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5e1e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc0725a0 con 0x7fa5dc0cf010 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5e1e00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc06f380 con 0x7fa5dc152210 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5e1e00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa5dc06e6c0 con 0x7fa5dc162ba0 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5daa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc0cf010 0x7fa5dc14e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5daa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc0cf010 0x7fa5dc14e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38254/0 (socket says 172.21.15.99:38254) 2024-09-10T07:45:36.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5daa00640 1 -- 172.21.15.99:0/2138914954 learned_addr learned my addr 172.21.15.99:0/2138914954 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:36.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5da000640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5dc152210 0x7fa5dc143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:36.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5db400640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5dc162ba0 0x7fa5dc162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:36.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5daa00640 1 -- 172.21.15.99:0/2138914954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5dc162ba0 msgr2=0x7fa5dc162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:36.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5daa00640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5dc162ba0 0x7fa5dc162190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:36.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5daa00640 1 -- 172.21.15.99:0/2138914954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5dc152210 msgr2=0x7fa5dc143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:36.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5daa00640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5dc152210 0x7fa5dc143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:36.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5daa00640 1 -- 172.21.15.99:0/2138914954 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc15c460 con 0x7fa5dc0cf010 2024-09-10T07:45:36.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5da000640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5dc152210 0x7fa5dc143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:36.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.251+0000 7fa5daa00640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc0cf010 0x7fa5dc14e470 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c4d0 tx=0x7fa5cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:36.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.252+0000 7fa5d3400640 1 -- 172.21.15.99:0/2138914954 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc018070 con 0x7fa5dc0cf010 2024-09-10T07:45:36.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.252+0000 7fa5d3400640 1 -- 172.21.15.99:0/2138914954 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5cc007500 con 0x7fa5dc0cf010 2024-09-10T07:45:36.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.252+0000 7fa5d3400640 1 -- 172.21.15.99:0/2138914954 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc004a20 con 0x7fa5dc0cf010 2024-09-10T07:45:36.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.252+0000 7fa5e1e00640 1 -- 172.21.15.99:0/2138914954 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5dc15c740 con 0x7fa5dc0cf010 2024-09-10T07:45:36.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.252+0000 7fa5e1e00640 1 -- 172.21.15.99:0/2138914954 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5dc15cd00 con 0x7fa5dc0cf010 2024-09-10T07:45:36.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.253+0000 7fa5e1e00640 1 -- 172.21.15.99:0/2138914954 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5dc0cf4a0 con 0x7fa5dc0cf010 2024-09-10T07:45:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.254+0000 7fa5d3400640 1 -- 172.21.15.99:0/2138914954 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5cc004bc0 con 0x7fa5dc0cf010 2024-09-10T07:45:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.255+0000 7fa5d3400640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5bc06be30 0x7fa5bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.255+0000 7fa5d3400640 1 -- 172.21.15.99:0/2138914954 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 5709+0+0 (secure 0 0 0) 0x7fa5cc08a190 con 0x7fa5dc0cf010 2024-09-10T07:45:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.255+0000 7fa5da000640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5bc06be30 0x7fa5bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:36.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.255+0000 7fa5d3400640 1 -- 172.21.15.99:0/2138914954 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=191}) -- 0x7fa5bc073960 con 0x7fa5dc0cf010 2024-09-10T07:45:36.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.256+0000 7fa5da000640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5bc06be30 0x7fa5bc06e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc144ab0 tx=0x7fa5c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:36.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.259+0000 7fa5d3400640 1 -- 172.21.15.99:0/2138914954 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5cc058b30 con 0x7fa5dc0cf010 2024-09-10T07:45:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.433+0000 7fa5e1e00640 1 -- 172.21.15.99:0/2138914954 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fa5dc0cf970 con 0x7fa5dc0cf010 2024-09-10T07:45:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.434+0000 7fa5d3400640 1 -- 172.21.15.99:0/2138914954 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v190) ==== 81+0+34265 (secure 0 0 0) 0x7fa5cc058430 con 0x7fa5dc0cf010 2024-09-10T07:45:36.434 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:36.434 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 190, 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:45:31.817072+0000", 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:45:36.435 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:45:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:45:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:45:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:45:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:45:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:45:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:45:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 23, 2024-09-10T07:45:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:45:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:36.437 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:45:36.438 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:36.439 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:36.440 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:36.441 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:45:36.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.443 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 22, 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:11.664665+0000", 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:36.444 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:36.445 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "187", 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:36.446 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:36.447 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:36.448 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:45:36.449 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 23, 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:12.889786+0000", 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1027, 2024-09-10T07:45:36.450 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:45:36.451 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "190", 2024-09-10T07:45:36.452 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:36.453 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:36.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:36.455 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:45:36.456 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:36.457 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.460 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:36.462 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:36.463 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:45:36.464 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.465 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.466 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:36.469 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.470 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.473 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:36.474 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:36.476 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.477 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.478 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.479 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:36.480 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.481 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.482 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:45:36.485 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:36.486 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.490 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:36.492 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.493 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:36.494 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:36.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:36.496 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:36.497 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:36.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:45:36.502 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:36.503 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:36.504 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:36.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:36.506 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:36.507 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:45:36.509 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:36.511 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:45:36.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 -- 172.21.15.99:0/2138914954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5bc06be30 msgr2=0x7fa5bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:36.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5bc06be30 0x7fa5bc06e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc144ab0 tx=0x7fa5c8008040 comp rx=0 tx=0).stop 2024-09-10T07:45:36.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 -- 172.21.15.99:0/2138914954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc0cf010 msgr2=0x7fa5dc14e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:36.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc0cf010 0x7fa5dc14e470 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c4d0 tx=0x7fa5cc00c990 comp rx=0 tx=0).stop 2024-09-10T07:45:36.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 -- 172.21.15.99:0/2138914954 shutdown_connections 2024-09-10T07:45:36.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5dc162ba0 0x7fa5dc162190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:36.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5dc152210 0x7fa5dc143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:36.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa5bc06be30 0x7fa5bc06e2f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:36.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 --2- 172.21.15.99:0/2138914954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5dc0cf010 0x7fa5dc14e470 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:36.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 -- 172.21.15.99:0/2138914954 >> 172.21.15.99:0/2138914954 conn(0x7fa5dc06bc10 msgr2=0x7fa5dc0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:36.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 -- 172.21.15.99:0/2138914954 shutdown_connections 2024-09-10T07:45:36.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:36.437+0000 7fa5e1e00640 1 -- 172.21.15.99:0/2138914954 wait complete. 2024-09-10T07:45:36.514 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-10T07:45:36.515 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:36.515 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:36.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:36.550 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-10T07:45:36.939 INFO:teuthology.orchestra.run.smithi099.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-10T07:45:36.939 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records in 2024-09-10T07:45:36.939 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records out 2024-09-10T07:45:36.939 INFO:teuthology.orchestra.run.smithi099.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.309556 s, 169 MB/s 2024-09-10T07:45:36.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:45:36.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:45:37.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.094+0000 7ff576600640 1 Processor -- start 2024-09-10T07:45:37.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.094+0000 7ff576600640 1 -- start start 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.095+0000 7ff576600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff5700d1ab0 0x7ff5700b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.095+0000 7ff576600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5700d3240 0x7ff5700b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.095+0000 7ff576600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5700b7a90 con 0x7ff57015ef50 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.095+0000 7ff576600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff5700d3740 con 0x7ff5700d1ab0 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.095+0000 7ff576600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff5700d3a20 con 0x7ff5700d3240 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.096+0000 7ff566a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff5700d1ab0 0x7ff5700b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.096+0000 7ff566a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff5700d1ab0 0x7ff5700b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38264/0 (socket says 172.21.15.99:38264) 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.096+0000 7ff566a00640 1 -- 172.21.15.99:0/2252760852 learned_addr learned my addr 172.21.15.99:0/2252760852 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.096+0000 7ff56fe00640 1 --2- 172.21.15.99:0/2252760852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5700d3240 0x7ff5700b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.096+0000 7ff566a00640 1 -- 172.21.15.99:0/2252760852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5700d3240 msgr2=0x7ff5700b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.096+0000 7ff566a00640 1 --2- 172.21.15.99:0/2252760852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5700d3240 0x7ff5700b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.096+0000 7ff566a00640 1 -- 172.21.15.99:0/2252760852 >> v1:172.21.15.187:6789/0 conn(0x7ff57015ef50 legacy=0x7ff5700d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.096+0000 7ff566a00640 1 -- 172.21.15.99:0/2252760852 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5700b7d00 con 0x7ff5700d1ab0 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.097+0000 7ff566a00640 1 --2- 172.21.15.99:0/2252760852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d1ab0 0x7ff5700b8500 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ff558009870 tx=0x7ff55802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7433b19b0ad5673e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.097+0000 7ff56ea00640 1 -- 172.21.15.99:0/2252760852 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff558037070 con 0x7ff5700d1ab0 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.097+0000 7ff56ea00640 1 -- 172.21.15.99:0/2252760852 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff558032440 con 0x7ff5700d1ab0 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.097+0000 7ff56ea00640 1 -- 172.21.15.99:0/2252760852 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff558032810 con 0x7ff5700d1ab0 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.098+0000 7ff576600640 1 -- 172.21.15.99:0/2252760852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d1ab0 msgr2=0x7ff5700b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.098+0000 7ff576600640 1 --2- 172.21.15.99:0/2252760852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d1ab0 0x7ff5700b8500 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ff558009870 tx=0x7ff55802a1c0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.098+0000 7ff576600640 1 -- 172.21.15.99:0/2252760852 shutdown_connections 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.098+0000 7ff576600640 1 --2- 172.21.15.99:0/2252760852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5700d3240 0x7ff5700b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.098+0000 7ff576600640 1 --2- 172.21.15.99:0/2252760852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d1ab0 0x7ff5700b8500 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.098+0000 7ff576600640 1 -- 172.21.15.99:0/2252760852 >> 172.21.15.99:0/2252760852 conn(0x7ff5700d4c60 msgr2=0x7ff5700d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.098+0000 7ff576600640 1 -- 172.21.15.99:0/2252760852 shutdown_connections 2024-09-10T07:45:37.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.098+0000 7ff576600640 1 -- 172.21.15.99:0/2252760852 wait complete. 2024-09-10T07:45:37.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.100+0000 7ff576600640 1 Processor -- start 2024-09-10T07:45:37.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.100+0000 7ff576600640 1 -- start start 2024-09-10T07:45:37.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff576600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5700d1ab0 0x7ff57015e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff576600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d3240 0x7ff5700b9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff576600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57015ef50 0x7ff5700ba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff576600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff5700d21a0 con 0x7ff5700d3240 2024-09-10T07:45:37.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff576600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff5700d2020 con 0x7ff5700d1ab0 2024-09-10T07:45:37.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff576600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff5700d5780 con 0x7ff57015ef50 2024-09-10T07:45:37.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff566a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d3240 0x7ff5700b9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff566a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d3240 0x7ff5700b9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38278/0 (socket says 172.21.15.99:38278) 2024-09-10T07:45:37.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff566a00640 1 -- 172.21.15.99:0/1739214794 learned_addr learned my addr 172.21.15.99:0/1739214794 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:37.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff56f400640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5700d1ab0 0x7ff57015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff56fe00640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57015ef50 0x7ff5700ba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff566a00640 1 -- 172.21.15.99:0/1739214794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57015ef50 msgr2=0x7ff5700ba0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff566a00640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57015ef50 0x7ff5700ba0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff566a00640 1 -- 172.21.15.99:0/1739214794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5700d1ab0 msgr2=0x7ff57015e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff566a00640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5700d1ab0 0x7ff57015e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff566a00640 1 -- 172.21.15.99:0/1739214794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5700c82f0 con 0x7ff5700d3240 2024-09-10T07:45:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.101+0000 7ff56f400640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5700d1ab0 0x7ff57015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.102+0000 7ff566a00640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d3240 0x7ff5700b9ba0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff558000c00 tx=0x7ff5580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.102+0000 7ff567e00640 1 -- 172.21.15.99:0/1739214794 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff558037040 con 0x7ff5700d3240 2024-09-10T07:45:37.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.102+0000 7ff567e00640 1 -- 172.21.15.99:0/1739214794 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff558042070 con 0x7ff5700d3240 2024-09-10T07:45:37.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.102+0000 7ff567e00640 1 -- 172.21.15.99:0/1739214794 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff558030880 con 0x7ff5700d3240 2024-09-10T07:45:37.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.102+0000 7ff576600640 1 -- 172.21.15.99:0/1739214794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5700c85d0 con 0x7ff5700d3240 2024-09-10T07:45:37.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.102+0000 7ff576600640 1 -- 172.21.15.99:0/1739214794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5700cb0e0 con 0x7ff5700d3240 2024-09-10T07:45:37.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.103+0000 7ff576600640 1 -- 172.21.15.99:0/1739214794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5700d13a0 con 0x7ff5700d3240 2024-09-10T07:45:37.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.104+0000 7ff567e00640 1 -- 172.21.15.99:0/1739214794 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff55802ad10 con 0x7ff5700d3240 2024-09-10T07:45:37.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.105+0000 7ff567e00640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff54c06be30 0x7ff54c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.105+0000 7ff567e00640 1 -- 172.21.15.99:0/1739214794 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 5709+0+0 (secure 0 0 0) 0x7ff5580ab380 con 0x7ff5700d3240 2024-09-10T07:45:37.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.105+0000 7ff56f400640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff54c06be30 0x7ff54c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.105+0000 7ff567e00640 1 -- 172.21.15.99:0/1739214794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=191}) -- 0x7ff54c073960 con 0x7ff5700d3240 2024-09-10T07:45:37.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.106+0000 7ff56f400640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff54c06be30 0x7ff54c06e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff57015e880 tx=0x7ff560009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.110+0000 7ff567e00640 1 -- 172.21.15.99:0/1739214794 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff558079c90 con 0x7ff5700d3240 2024-09-10T07:45:37.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.283+0000 7ff576600640 1 -- 172.21.15.99:0/1739214794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7ff5700cabd0 con 0x7ff5700d3240 2024-09-10T07:45:37.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.284+0000 7ff567e00640 1 -- 172.21.15.99:0/1739214794 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v190) ==== 81+0+34265 (secure 0 0 0) 0x7ff558079590 con 0x7ff5700d3240 2024-09-10T07:45:37.284 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:37.284 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:45:37.284 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 190, 2024-09-10T07:45:37.284 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:45:37.284 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:45:31.817072+0000", 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:45:37.285 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 23, 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.286 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:37.287 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:37.288 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:37.289 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:37.290 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:37.291 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:37.292 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 22, 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:11.664665+0000", 2024-09-10T07:45:37.293 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:37.294 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.295 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "187", 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:37.296 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:37.297 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:37.298 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:45:37.299 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 23, 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:12.889786+0000", 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1027, 2024-09-10T07:45:37.300 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:45:37.301 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.302 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "190", 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:37.303 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:37.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:45:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:37.306 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:37.307 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:37.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:45:37.309 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:45:37.310 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.311 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:45:37.312 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:37.313 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:37.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:37.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:45:37.316 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.317 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:45:37.318 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:37.319 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:37.320 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.321 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:37.324 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:37.325 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.326 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.328 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.329 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:37.330 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.332 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:37.336 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:45:37.341 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:37.342 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:37.348 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.349 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.350 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:37.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:45:37.352 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:37.353 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:37.355 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:37.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:37.357 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:37.358 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:45:37.359 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:45:37.360 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:45:37.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:37.361 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:45:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 -- 172.21.15.99:0/1739214794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff54c06be30 msgr2=0x7ff54c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff54c06be30 0x7ff54c06e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff57015e880 tx=0x7ff560009040 comp rx=0 tx=0).stop 2024-09-10T07:45:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 -- 172.21.15.99:0/1739214794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d3240 msgr2=0x7ff5700b9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d3240 0x7ff5700b9ba0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff558000c00 tx=0x7ff5580046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 -- 172.21.15.99:0/1739214794 shutdown_connections 2024-09-10T07:45:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff57015ef50 0x7ff5700ba0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff54c06be30 0x7ff54c06e2f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5700d3240 0x7ff5700b9ba0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 --2- 172.21.15.99:0/1739214794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5700d1ab0 0x7ff57015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 -- 172.21.15.99:0/1739214794 >> 172.21.15.99:0/1739214794 conn(0x7ff5700d4c60 msgr2=0x7ff5700b8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 -- 172.21.15.99:0/1739214794 shutdown_connections 2024-09-10T07:45:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.286+0000 7ff576600640 1 -- 172.21.15.99:0/1739214794 wait complete. 2024-09-10T07:45:37.364 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.520+0000 7f640e800640 1 Processor -- start 2024-09-10T07:45:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.520+0000 7f640e800640 1 -- start start 2024-09-10T07:45:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.521+0000 7f640e800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f640813fae0 0x7f640806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.521+0000 7f640e800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6408142150 0x7f6408160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.521+0000 7f640e800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6408160a80 0x7f640815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.521+0000 7f640e800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f64080ce780 con 0x7f6408160a80 2024-09-10T07:45:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.521+0000 7f640e800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f6408142650 con 0x7f640813fae0 2024-09-10T07:45:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.521+0000 7f640e800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6408142930 con 0x7f6408142150 2024-09-10T07:45:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.522+0000 7f6407e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6408160a80 0x7f640815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.522+0000 7f6407e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6408160a80 0x7f640815cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38286/0 (socket says 172.21.15.99:38286) 2024-09-10T07:45:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.522+0000 7f6407e00640 1 -- 172.21.15.99:0/1079816871 learned_addr learned my addr 172.21.15.99:0/1079816871 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.522+0000 7f6407400640 1 --2- 172.21.15.99:0/1079816871 >> v2:172.21.15.187:3300/0 conn(0x7f640813fae0 0x7f640806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.522+0000 7f63fea00640 1 --2- 172.21.15.99:0/1079816871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6408142150 0x7f6408160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.522+0000 7f6407e00640 1 -- 172.21.15.99:0/1079816871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6408142150 msgr2=0x7f6408160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.522+0000 7f6407e00640 1 --2- 172.21.15.99:0/1079816871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6408142150 0x7f6408160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.522+0000 7f6407e00640 1 -- 172.21.15.99:0/1079816871 >> v2:172.21.15.187:3300/0 conn(0x7f640813fae0 msgr2=0x7f640806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.522+0000 7f6407e00640 1 --2- 172.21.15.99:0/1079816871 >> v2:172.21.15.187:3300/0 conn(0x7f640813fae0 0x7f640806f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.522+0000 7f6407e00640 1 -- 172.21.15.99:0/1079816871 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6408142c10 con 0x7f6408160a80 2024-09-10T07:45:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.523+0000 7f6407e00640 1 --2- 172.21.15.99:0/1079816871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408160a80 0x7f640815cf50 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f6408050590 tx=0x7f640002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f29dc4a4dd62b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f6406a00640 1 -- 172.21.15.99:0/1079816871 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400036070 con 0x7f6408160a80 2024-09-10T07:45:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f6406a00640 1 -- 172.21.15.99:0/1079816871 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6400031600 con 0x7f6408160a80 2024-09-10T07:45:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f6406a00640 1 -- 172.21.15.99:0/1079816871 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64000319d0 con 0x7f6408160a80 2024-09-10T07:45:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f640e800640 1 -- 172.21.15.99:0/1079816871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408160a80 msgr2=0x7f640815cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f640e800640 1 --2- 172.21.15.99:0/1079816871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408160a80 0x7f640815cf50 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f6408050590 tx=0x7f640002a610 comp rx=0 tx=0).stop 2024-09-10T07:45:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f640e800640 1 -- 172.21.15.99:0/1079816871 shutdown_connections 2024-09-10T07:45:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f640e800640 1 --2- 172.21.15.99:0/1079816871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6408142150 0x7f6408160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f640e800640 1 --2- 172.21.15.99:0/1079816871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408160a80 0x7f640815cf50 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f640e800640 1 --2- 172.21.15.99:0/1079816871 >> v2:172.21.15.187:3300/0 conn(0x7f640813fae0 0x7f640806f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f640e800640 1 -- 172.21.15.99:0/1079816871 >> 172.21.15.99:0/1079816871 conn(0x7f640806bc10 msgr2=0x7f640806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f640e800640 1 -- 172.21.15.99:0/1079816871 shutdown_connections 2024-09-10T07:45:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.524+0000 7f640e800640 1 -- 172.21.15.99:0/1079816871 wait complete. 2024-09-10T07:45:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.526+0000 7f640e800640 1 Processor -- start 2024-09-10T07:45:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.526+0000 7f640e800640 1 -- start start 2024-09-10T07:45:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.527+0000 7f640e800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640813fae0 0x7f6408139a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.527+0000 7f640e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408142150 0x7f640815f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.527+0000 7f640e800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6408160a80 0x7f640815fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.527+0000 7f640e800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f640806f870 con 0x7f6408142150 2024-09-10T07:45:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.527+0000 7f640e800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f640806f6f0 con 0x7f6408160a80 2024-09-10T07:45:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.527+0000 7f640e800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f640815d490 con 0x7f640813fae0 2024-09-10T07:45:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.527+0000 7f63fea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408142150 0x7f640815f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.527+0000 7f63fea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408142150 0x7f640815f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38288/0 (socket says 172.21.15.99:38288) 2024-09-10T07:45:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.527+0000 7f63fea00640 1 -- 172.21.15.99:0/4178060486 learned_addr learned my addr 172.21.15.99:0/4178060486 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.527+0000 7f6407400640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640813fae0 0x7f6408139a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f6407e00640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6408160a80 0x7f640815fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f63fea00640 1 -- 172.21.15.99:0/4178060486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640813fae0 msgr2=0x7f6408139a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f63fea00640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640813fae0 0x7f6408139a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f63fea00640 1 -- 172.21.15.99:0/4178060486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6408160a80 msgr2=0x7f640815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f63fea00640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6408160a80 0x7f640815fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f63fea00640 1 -- 172.21.15.99:0/4178060486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64081f8f30 con 0x7f6408142150 2024-09-10T07:45:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f63fea00640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408142150 0x7f640815f600 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f63f000e8b0 tx=0x7f63f000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f63ffe00640 1 -- 172.21.15.99:0/4178060486 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0017070 con 0x7f6408142150 2024-09-10T07:45:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f63ffe00640 1 -- 172.21.15.99:0/4178060486 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f000c940 con 0x7f6408142150 2024-09-10T07:45:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f640e800640 1 -- 172.21.15.99:0/4178060486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640815eac0 con 0x7f6408142150 2024-09-10T07:45:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f63ffe00640 1 -- 172.21.15.99:0/4178060486 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f000cd10 con 0x7f6408142150 2024-09-10T07:45:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.528+0000 7f640e800640 1 -- 172.21.15.99:0/4178060486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640815f080 con 0x7f6408142150 2024-09-10T07:45:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.529+0000 7f640e800640 1 -- 172.21.15.99:0/4178060486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6408160540 con 0x7f6408142150 2024-09-10T07:45:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.530+0000 7f63ffe00640 1 -- 172.21.15.99:0/4178060486 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63f001a070 con 0x7f6408142150 2024-09-10T07:45:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.531+0000 7f63ffe00640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f63e406be30 0x7f63e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.531+0000 7f63ffe00640 1 -- 172.21.15.99:0/4178060486 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 5709+0+0 (secure 0 0 0) 0x7f63f008ae60 con 0x7f6408142150 2024-09-10T07:45:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.531+0000 7f6407400640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f63e406be30 0x7f63e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.531+0000 7f63ffe00640 1 -- 172.21.15.99:0/4178060486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=191}) -- 0x7f63e4073960 con 0x7f6408142150 2024-09-10T07:45:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.532+0000 7f6407400640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f63e406be30 0x7f63e406e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009a50 tx=0x7f63f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.535+0000 7f63ffe00640 1 -- 172.21.15.99:0/4178060486 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63f0059800 con 0x7f6408142150 2024-09-10T07:45:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.740+0000 7f640e800640 1 -- 172.21.15.99:0/4178060486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f640813a890 con 0x7f6408142150 2024-09-10T07:45:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.741+0000 7f63ffe00640 1 -- 172.21.15.99:0/4178060486 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7f63f0059100 con 0x7f6408142150 2024-09-10T07:45:37.741 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:37.741 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":90,"btime":"2024-09-10T07:45:17:511094+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4239870292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4239870292},{"type":"v1","addr":"172.21.15.99:6836","nonce":4239870292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2428750075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2428750075},{"type":"v1","addr":"172.21.15.187:6835","nonce":2428750075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1219809784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1219809784},{"type":"v1","addr":"172.21.15.187:6834","nonce":1219809784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:45:13.894905+0000","modified":"2024-09-10T07:45:16.912907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7276":{"gid":7276,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/256766417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":256766417},{"type":"v1","addr":"172.21.15.99:6837","nonce":256766417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7276,"qdb_cluster":[7276]},"id":11}]} 2024-09-10T07:45:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 90 2024-09-10T07:45:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 -- 172.21.15.99:0/4178060486 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f63e406be30 msgr2=0x7f63e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f63e406be30 0x7f63e406e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009a50 tx=0x7f63f8008040 comp rx=0 tx=0).stop 2024-09-10T07:45:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 -- 172.21.15.99:0/4178060486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408142150 msgr2=0x7f640815f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408142150 0x7f640815f600 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f63f000e8b0 tx=0x7f63f000ed70 comp rx=0 tx=0).stop 2024-09-10T07:45:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 -- 172.21.15.99:0/4178060486 shutdown_connections 2024-09-10T07:45:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6408160a80 0x7f640815fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f63e406be30 0x7f63e406e2f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6408142150 0x7f640815f600 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 --2- 172.21.15.99:0/4178060486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640813fae0 0x7f6408139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 -- 172.21.15.99:0/4178060486 >> 172.21.15.99:0/4178060486 conn(0x7f640806bc10 msgr2=0x7f640813e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.743+0000 7f640e800640 1 -- 172.21.15.99:0/4178060486 shutdown_connections 2024-09-10T07:45:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:37.744+0000 7f640e800640 1 -- 172.21.15.99:0/4178060486 wait complete. 2024-09-10T07:45:37.759 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-10T07:45:37.934 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":7276,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":23.440722423,"mdsmap_epoch":90,"osdmap_epoch":190,"osdmap_epoch_barrier":190,"uptime":28.525287562999999} 2024-09-10T07:45:37.934 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 7276, "mdsmap_epoch": 90, "osdmap_epoch": 190, "osdmap_epoch_barrier": 190, "rank_uptime": 23.440722423, "state": "up:active", "uptime": 28.525287563, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:45:37.934 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T07:45:37.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:37.934 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-10T07:45:37.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:37.972 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-10T07:45:38.066 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:45:38.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.220+0000 7fdc0e000640 1 Processor -- start 2024-09-10T07:45:38.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.220+0000 7fdc0e000640 1 -- start start 2024-09-10T07:45:38.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdc0e000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc08072f40 0x7fdc0806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:38.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdc0e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 0x7fdc080b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:38.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdc0e000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc0806e3d0 con 0x7fdc08145290 2024-09-10T07:45:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdc0e000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0806efe0 con 0x7fdc08072f40 2024-09-10T07:45:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdc0e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0806e6b0 con 0x7fdc080ce780 2024-09-10T07:45:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdbfea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc08072f40 0x7fdc0806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdbfea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc08072f40 0x7fdc0806f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38298/0 (socket says 172.21.15.99:38298) 2024-09-10T07:45:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdbfea00640 1 -- 172.21.15.99:0/302318150 learned_addr learned my addr 172.21.15.99:0/302318150 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdc07e00640 1 --2- 172.21.15.99:0/302318150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 0x7fdc080b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:38.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdbfea00640 1 -- 172.21.15.99:0/302318150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 msgr2=0x7fdc080b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:38.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdbfea00640 1 --2- 172.21.15.99:0/302318150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 0x7fdc080b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:38.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdbfea00640 1 -- 172.21.15.99:0/302318150 >> v1:172.21.15.187:6789/0 conn(0x7fdc08145290 legacy=0x7fdc08072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:38.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdbfea00640 1 -- 172.21.15.99:0/302318150 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0806e990 con 0x7fdc08072f40 2024-09-10T07:45:38.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.222+0000 7fdc07e00640 1 --2- 172.21.15.99:0/302318150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 0x7fdc080b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:38.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.223+0000 7fdbfea00640 1 --2- 172.21.15.99:0/302318150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08072f40 0x7fdc0806f470 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fdc0806f160 tx=0x7fdbf002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d1879304f52a71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:38.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.223+0000 7fdc06a00640 1 -- 172.21.15.99:0/302318150 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0037070 con 0x7fdc08072f40 2024-09-10T07:45:38.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.224+0000 7fdc06a00640 1 -- 172.21.15.99:0/302318150 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf0032440 con 0x7fdc08072f40 2024-09-10T07:45:38.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.224+0000 7fdc06a00640 1 -- 172.21.15.99:0/302318150 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0032810 con 0x7fdc08072f40 2024-09-10T07:45:38.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.224+0000 7fdc0e000640 1 -- 172.21.15.99:0/302318150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08072f40 msgr2=0x7fdc0806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:38.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.224+0000 7fdc0e000640 1 --2- 172.21.15.99:0/302318150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08072f40 0x7fdc0806f470 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fdc0806f160 tx=0x7fdbf002a250 comp rx=0 tx=0).stop 2024-09-10T07:45:38.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.224+0000 7fdc0e000640 1 -- 172.21.15.99:0/302318150 shutdown_connections 2024-09-10T07:45:38.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.224+0000 7fdc0e000640 1 --2- 172.21.15.99:0/302318150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 0x7fdc080b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:38.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.224+0000 7fdc0e000640 1 --2- 172.21.15.99:0/302318150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08072f40 0x7fdc0806f470 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:38.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.224+0000 7fdc0e000640 1 -- 172.21.15.99:0/302318150 >> 172.21.15.99:0/302318150 conn(0x7fdc0806bc10 msgr2=0x7fdc0806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:38.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.224+0000 7fdc0e000640 1 -- 172.21.15.99:0/302318150 shutdown_connections 2024-09-10T07:45:38.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.224+0000 7fdc0e000640 1 -- 172.21.15.99:0/302318150 wait complete. 2024-09-10T07:45:38.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.226+0000 7fdc0e000640 1 Processor -- start 2024-09-10T07:45:38.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.226+0000 7fdc0e000640 1 -- start start 2024-09-10T07:45:38.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdc0e000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc08072f40 0x7fdc0813b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:38.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdc0e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 0x7fdc0813c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:38.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdc0e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08145290 0x7fdc080b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:38.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdc0e000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0806df80 con 0x7fdc08145290 2024-09-10T07:45:38.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdc0e000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdc08145670 con 0x7fdc08072f40 2024-09-10T07:45:38.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdc0e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0806e100 con 0x7fdc080ce780 2024-09-10T07:45:38.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdc07e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08145290 0x7fdc080b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:38.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdc07e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08145290 0x7fdc080b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38302/0 (socket says 172.21.15.99:38302) 2024-09-10T07:45:38.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdc07e00640 1 -- 172.21.15.99:0/1245762062 learned_addr learned my addr 172.21.15.99:0/1245762062 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:38.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdbfea00640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 0x7fdc0813c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:38.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.227+0000 7fdc07400640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc08072f40 0x7fdc0813b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:38.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdc07e00640 1 -- 172.21.15.99:0/1245762062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 msgr2=0x7fdc0813c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:38.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdc07e00640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 0x7fdc0813c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:38.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdc07e00640 1 -- 172.21.15.99:0/1245762062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc08072f40 msgr2=0x7fdc0813b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:38.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdc07e00640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc08072f40 0x7fdc0813b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:38.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdc07e00640 1 -- 172.21.15.99:0/1245762062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc080b3a60 con 0x7fdc08145290 2024-09-10T07:45:38.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdc07e00640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08145290 0x7fdc080b4b00 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fdc00007ef0 tx=0x7fdc0000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:38.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdbffe00640 1 -- 172.21.15.99:0/1245762062 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0001a070 con 0x7fdc08145290 2024-09-10T07:45:38.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdbffe00640 1 -- 172.21.15.99:0/1245762062 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc00015600 con 0x7fdc08145290 2024-09-10T07:45:38.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdbffe00640 1 -- 172.21.15.99:0/1245762062 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc000159f0 con 0x7fdc08145290 2024-09-10T07:45:38.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdc0e000640 1 -- 172.21.15.99:0/1245762062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc080b3d40 con 0x7fdc08145290 2024-09-10T07:45:38.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.228+0000 7fdc0e000640 1 -- 172.21.15.99:0/1245762062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc080b4300 con 0x7fdc08145290 2024-09-10T07:45:38.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.229+0000 7fdc0e000640 1 -- 172.21.15.99:0/1245762062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc08071510 con 0x7fdc08145290 2024-09-10T07:45:38.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.230+0000 7fdbffe00640 1 -- 172.21.15.99:0/1245762062 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc0001d070 con 0x7fdc08145290 2024-09-10T07:45:38.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.231+0000 7fdbffe00640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbe406be30 0x7fdbe406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:38.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.231+0000 7fdbffe00640 1 -- 172.21.15.99:0/1245762062 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 5709+0+0 (secure 0 0 0) 0x7fdc0008b110 con 0x7fdc08145290 2024-09-10T07:45:38.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.231+0000 7fdc07400640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbe406be30 0x7fdbe406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:38.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.231+0000 7fdbffe00640 1 -- 172.21.15.99:0/1245762062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=191}) -- 0x7fdbe4073960 con 0x7fdc08145290 2024-09-10T07:45:38.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.232+0000 7fdc07400640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbe406be30 0x7fdbe406e2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8001780 tx=0x7fdbf8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:38.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.235+0000 7fdbffe00640 1 -- 172.21.15.99:0/1245762062 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc00010070 con 0x7fdc08145290 2024-09-10T07:45:38.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.411+0000 7fdc0e000640 1 -- 172.21.15.99:0/1245762062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fdc080729b0 con 0x7fdc08145290 2024-09-10T07:45:38.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.412+0000 7fdbffe00640 1 -- 172.21.15.99:0/1245762062 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v190) ==== 81+0+34265 (secure 0 0 0) 0x7fdc00059460 con 0x7fdc08145290 2024-09-10T07:45:38.412 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 190, 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:45:31.817072+0000", 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:45:38.413 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 23, 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:45:38.414 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:38.415 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:38.416 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:45:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:45:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:45:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:45:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:45:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:38.417 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:38.418 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:38.419 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:38.420 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:38.421 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:45:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:45:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:45:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:38.422 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 22, 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:11.664665+0000", 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:38.423 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:45:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:45:38.424 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "187", 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:38.425 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:38.426 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:38.427 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:45:38.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:38.429 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 23, 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:12.889786+0000", 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1027, 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:38.430 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:45:38.431 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "190", 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:38.432 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:38.433 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:38.434 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.435 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:38.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:38.437 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.438 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.439 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:38.443 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.444 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:38.448 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:45:38.449 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:45:38.450 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.451 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.452 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:45:38.453 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:38.454 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.455 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.456 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:38.459 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:38.460 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.461 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.464 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:38.465 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:38.468 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:38.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.471 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:38.472 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:45:38.474 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.475 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:38.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:38.477 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:38.478 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.479 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.480 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:38.483 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:38.485 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:38.486 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:38.488 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:45:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:38.489 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:45:38.490 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:45:38.491 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:45:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:45:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:45:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:45:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:45:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:45:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:45:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:45:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:45:38.492 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:38.492 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:45:38.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.414+0000 7fdc0e000640 1 -- 172.21.15.99:0/1245762062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbe406be30 msgr2=0x7fdbe406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:38.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.414+0000 7fdc0e000640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbe406be30 0x7fdbe406e2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8001780 tx=0x7fdbf8009040 comp rx=0 tx=0).stop 2024-09-10T07:45:38.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.415+0000 7fdc0e000640 1 -- 172.21.15.99:0/1245762062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08145290 msgr2=0x7fdc080b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:38.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.415+0000 7fdc0e000640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08145290 0x7fdc080b4b00 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fdc00007ef0 tx=0x7fdc0000d4a0 comp rx=0 tx=0).stop 2024-09-10T07:45:38.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.415+0000 7fdc0e000640 1 -- 172.21.15.99:0/1245762062 shutdown_connections 2024-09-10T07:45:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.415+0000 7fdc0e000640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fdbe406be30 0x7fdbe406e2f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.415+0000 7fdc0e000640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc08145290 0x7fdc080b4b00 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.415+0000 7fdc0e000640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc080ce780 0x7fdc0813c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.415+0000 7fdc0e000640 1 --2- 172.21.15.99:0/1245762062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc08072f40 0x7fdc0813b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.415+0000 7fdc0e000640 1 -- 172.21.15.99:0/1245762062 >> 172.21.15.99:0/1245762062 conn(0x7fdc0806bc10 msgr2=0x7fdc08141ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.415+0000 7fdc0e000640 1 -- 172.21.15.99:0/1245762062 shutdown_connections 2024-09-10T07:45:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:38.415+0000 7fdc0e000640 1 -- 172.21.15.99:0/1245762062 wait complete. 2024-09-10T07:45:38.496 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:45:43.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:45:43.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.663+0000 7f4cc6600640 1 Processor -- start 2024-09-10T07:45:43.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.663+0000 7f4cc6600640 1 -- start start 2024-09-10T07:45:43.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.664+0000 7f4cc6600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4cc0152210 0x7f4cc0071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:43.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.664+0000 7f4cc6600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4cc00723d0 0x7f4cc00cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:43.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.664+0000 7f4cc6600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc00cf970 con 0x7f4cc00cf550 2024-09-10T07:45:43.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.664+0000 7f4cc6600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc015c4f0 con 0x7f4cc00723d0 2024-09-10T07:45:43.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.664+0000 7f4cc6600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc015b730 con 0x7f4cc0152210 2024-09-10T07:45:43.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.664+0000 7f4cbea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4cc00723d0 0x7f4cc00cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.665+0000 7f4cbea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4cc00723d0 0x7f4cc00cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44584/0 (socket says 172.21.15.99:44584) 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.665+0000 7f4cbfe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4cc00cf550 0x7f4cc006d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59684/0 (socket says 172.21.15.99:59684) 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.665+0000 7f4cbea00640 1 -- 172.21.15.99:0/919624627 learned_addr learned my addr 172.21.15.99:0/919624627 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.665+0000 7f4cbf400640 1 --2- 172.21.15.99:0/919624627 >> v2:172.21.15.187:3300/0 conn(0x7f4cc0152210 0x7f4cc0071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.665+0000 7f4cbea00640 1 -- 172.21.15.99:0/919624627 >> v2:172.21.15.187:3300/0 conn(0x7f4cc0152210 msgr2=0x7f4cc0071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.665+0000 7f4cbea00640 1 --2- 172.21.15.99:0/919624627 >> v2:172.21.15.187:3300/0 conn(0x7f4cc0152210 0x7f4cc0071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.665+0000 7f4cbea00640 1 -- 172.21.15.99:0/919624627 >> v1:172.21.15.99:6789/0 conn(0x7f4cc00cf550 legacy=0x7f4cc006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.665+0000 7f4cbea00640 1 -- 172.21.15.99:0/919624627 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc015ba10 con 0x7f4cc00723d0 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.665+0000 7f4cbe000640 1 -- 172.21.15.99:0/919624627 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1791628714 0 0) 0x7f4cc00cf970 con 0x7f4cc00cf550 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.666+0000 7f4cbea00640 1 --2- 172.21.15.99:0/919624627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00723d0 0x7f4cc00cf010 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0075940 tx=0x7f4cac02b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e9cbfc44f8371a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.666+0000 7f4cbe000640 1 -- 172.21.15.99:0/919624627 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac00b040 con 0x7f4cc00723d0 2024-09-10T07:45:43.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.666+0000 7f4cbe000640 1 -- 172.21.15.99:0/919624627 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cac02be50 con 0x7f4cc00723d0 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.666+0000 7f4cbe000640 1 -- 172.21.15.99:0/919624627 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac030930 con 0x7f4cc00723d0 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.667+0000 7f4cc6600640 1 -- 172.21.15.99:0/919624627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00723d0 msgr2=0x7f4cc00cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.667+0000 7f4cc6600640 1 --2- 172.21.15.99:0/919624627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00723d0 0x7f4cc00cf010 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0075940 tx=0x7f4cac02b630 comp rx=0 tx=0).stop 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.667+0000 7f4cc6600640 1 -- 172.21.15.99:0/919624627 shutdown_connections 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.667+0000 7f4cc6600640 1 --2- 172.21.15.99:0/919624627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00723d0 0x7f4cc00cf010 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.667+0000 7f4cc6600640 1 --2- 172.21.15.99:0/919624627 >> v2:172.21.15.187:3300/0 conn(0x7f4cc0152210 0x7f4cc0071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.667+0000 7f4cc6600640 1 -- 172.21.15.99:0/919624627 >> 172.21.15.99:0/919624627 conn(0x7f4cc006bc10 msgr2=0x7f4cc006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.667+0000 7f4cc6600640 1 -- 172.21.15.99:0/919624627 shutdown_connections 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.667+0000 7f4cc6600640 1 -- 172.21.15.99:0/919624627 wait complete. 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.668+0000 7f4cc6600640 1 Processor -- start 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.669+0000 7f4cc6600640 1 -- start start 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.669+0000 7f4cc6600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cc00723d0 0x7f4cc00ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:43.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.669+0000 7f4cc6600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00cf550 0x7f4cc014e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.669+0000 7f4cc6600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cc0152210 0x7f4cc00ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.669+0000 7f4cc6600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc006f380 con 0x7f4cc00cf550 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.669+0000 7f4cc6600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc015bfd0 con 0x7f4cc0152210 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.669+0000 7f4cc6600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc00ce780 con 0x7f4cc00723d0 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00cf550 0x7f4cc014e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00cf550 0x7f4cc014e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44588/0 (socket says 172.21.15.99:44588) 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbea00640 1 -- 172.21.15.99:0/2204969714 learned_addr learned my addr 172.21.15.99:0/2204969714 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbfe00640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cc0152210 0x7f4cc00ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbf400640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cc00723d0 0x7f4cc00ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbea00640 1 -- 172.21.15.99:0/2204969714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cc00723d0 msgr2=0x7f4cc00ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbea00640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cc00723d0 0x7f4cc00ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbea00640 1 -- 172.21.15.99:0/2204969714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cc0152210 msgr2=0x7f4cc00ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:43.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbea00640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cc0152210 0x7f4cc00ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbea00640 1 -- 172.21.15.99:0/2204969714 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc00ac910 con 0x7f4cc00cf550 2024-09-10T07:45:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbfe00640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cc0152210 0x7f4cc00ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbf400640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cc00723d0 0x7f4cc00ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.670+0000 7f4cbea00640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00cf550 0x7f4cc014e4f0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00a1c0 tx=0x7f4cac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.671+0000 7f4cb7400640 1 -- 172.21.15.99:0/2204969714 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac03f070 con 0x7f4cc00cf550 2024-09-10T07:45:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.671+0000 7f4cb7400640 1 -- 172.21.15.99:0/2204969714 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cac03b840 con 0x7f4cc00cf550 2024-09-10T07:45:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.671+0000 7f4cc6600640 1 -- 172.21.15.99:0/2204969714 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc00abd90 con 0x7f4cc00cf550 2024-09-10T07:45:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.671+0000 7f4cb7400640 1 -- 172.21.15.99:0/2204969714 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac03bbf0 con 0x7f4cc00cf550 2024-09-10T07:45:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.671+0000 7f4cc6600640 1 -- 172.21.15.99:0/2204969714 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc00ac350 con 0x7f4cc00cf550 2024-09-10T07:45:43.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.672+0000 7f4cc6600640 1 -- 172.21.15.99:0/2204969714 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc0071e90 con 0x7f4cc00cf550 2024-09-10T07:45:43.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.673+0000 7f4cb7400640 1 -- 172.21.15.99:0/2204969714 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cac042070 con 0x7f4cc00cf550 2024-09-10T07:45:43.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.673+0000 7f4cb7400640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ca006be60 0x7f4ca006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:43.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.674+0000 7f4cb7400640 1 -- 172.21.15.99:0/2204969714 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 5709+0+0 (secure 0 0 0) 0x7f4cac0ab700 con 0x7f4cc00cf550 2024-09-10T07:45:43.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.674+0000 7f4cb7400640 1 -- 172.21.15.99:0/2204969714 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=191}) -- 0x7f4ca0073990 con 0x7f4cc00cf550 2024-09-10T07:45:43.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.674+0000 7f4cbf400640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ca006be60 0x7f4ca006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:43.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.674+0000 7f4cbf400640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ca006be60 0x7f4ca006e320 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0006fd0 tx=0x7f4cb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:43.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.678+0000 7f4cb7400640 1 -- 172.21.15.99:0/2204969714 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cac07a0a0 con 0x7f4cc00cf550 2024-09-10T07:45:43.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.852+0000 7f4cc6600640 1 -- 172.21.15.99:0/2204969714 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f4cc015e3a0 con 0x7f4cc00cf550 2024-09-10T07:45:43.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.853+0000 7f4cb7400640 1 -- 172.21.15.99:0/2204969714 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v190) ==== 81+0+34265 (secure 0 0 0) 0x7f4cac0799a0 con 0x7f4cc00cf550 2024-09-10T07:45:43.853 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 190, 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:45:31.817072+0000", 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:45:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 23, 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:45:43.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:43.856 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:43.857 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:43.858 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:43.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:43.860 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:43.861 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 22, 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:11.664665+0000", 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:43.862 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:43.863 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "187", 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:43.864 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:43.865 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:43.866 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:45:43.867 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 23, 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:12.889786+0000", 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1027, 2024-09-10T07:45:43.868 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:45:43.869 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "190", 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:43.870 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:43.871 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:43.872 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.873 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:43.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:43.875 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:45:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.877 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:45:43.878 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:45:43.879 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.882 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:43.883 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:43.884 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.885 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:43.886 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:43.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:43.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:45:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:45:43.891 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:43.892 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:43.893 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:43.894 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:43.895 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:45:43.896 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:45:43.902 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:43.903 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.904 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.905 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:43.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:43.908 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:43.909 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.910 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:43.914 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.915 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:43.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:45:43.917 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:45:43.918 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:45:43.919 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:43.920 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:43.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:43.922 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:43.923 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:43.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:43.925 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:45:43.926 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:45:43.927 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:45:43.928 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:45:43.928 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:45:43.928 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:45:43.928 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:45:43.928 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:45:43.928 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:45:43.928 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:43.928 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.855+0000 7f4cc6600640 1 -- 172.21.15.99:0/2204969714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ca006be60 msgr2=0x7f4ca006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.855+0000 7f4cc6600640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ca006be60 0x7f4ca006e320 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0006fd0 tx=0x7f4cb0008040 comp rx=0 tx=0).stop 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.855+0000 7f4cc6600640 1 -- 172.21.15.99:0/2204969714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00cf550 msgr2=0x7f4cc014e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.855+0000 7f4cc6600640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00cf550 0x7f4cc014e4f0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00a1c0 tx=0x7f4cac0046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.856+0000 7f4cc6600640 1 -- 172.21.15.99:0/2204969714 shutdown_connections 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.856+0000 7f4cc6600640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4cc0152210 0x7f4cc00ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.856+0000 7f4cc6600640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4ca006be60 0x7f4ca006e320 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.856+0000 7f4cc6600640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc00cf550 0x7f4cc014e4f0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.856+0000 7f4cc6600640 1 --2- 172.21.15.99:0/2204969714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4cc00723d0 0x7f4cc00ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.856+0000 7f4cc6600640 1 -- 172.21.15.99:0/2204969714 >> 172.21.15.99:0/2204969714 conn(0x7f4cc006bc10 msgr2=0x7f4cc0150610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.856+0000 7f4cc6600640 1 -- 172.21.15.99:0/2204969714 shutdown_connections 2024-09-10T07:45:43.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:43.856+0000 7f4cc6600640 1 -- 172.21.15.99:0/2204969714 wait complete. 2024-09-10T07:45:43.931 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-10T07:45:48.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:45:48.460 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:45:48.932 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:45:49.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.095+0000 7fb496200640 1 Processor -- start 2024-09-10T07:45:49.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.095+0000 7fb496200640 1 -- start start 2024-09-10T07:45:49.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb496200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490072f40 0x7fb49006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb496200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb4900ce780 0x7fb4900b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb496200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb49006e3d0 con 0x7fb490145290 2024-09-10T07:45:49.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb496200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fb49006efe0 con 0x7fb4900ce780 2024-09-10T07:45:49.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb496200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb49006e6b0 con 0x7fb490072f40 2024-09-10T07:45:49.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb486a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490072f40 0x7fb49006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb486a00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490072f40 0x7fb49006f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:58172/0 (socket says 172.21.15.99:58172) 2024-09-10T07:45:49.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb486a00640 1 -- 172.21.15.99:0/3429602363 learned_addr learned my addr 172.21.15.99:0/3429602363 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:49.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb48fe00640 1 --2- 172.21.15.99:0/3429602363 >> v2:172.21.15.187:3300/0 conn(0x7fb4900ce780 0x7fb4900b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb486a00640 1 -- 172.21.15.99:0/3429602363 >> v2:172.21.15.187:3300/0 conn(0x7fb4900ce780 msgr2=0x7fb4900b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:49.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb486a00640 1 --2- 172.21.15.99:0/3429602363 >> v2:172.21.15.187:3300/0 conn(0x7fb4900ce780 0x7fb4900b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb486a00640 1 -- 172.21.15.99:0/3429602363 >> v1:172.21.15.187:6789/0 conn(0x7fb490145290 legacy=0x7fb490072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.097+0000 7fb486a00640 1 -- 172.21.15.99:0/3429602363 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49006e990 con 0x7fb490072f40 2024-09-10T07:45:49.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.098+0000 7fb486a00640 1 --2- 172.21.15.99:0/3429602363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490072f40 0x7fb49006f470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb478009870 tx=0x7fb47802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff78b5af1de12b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:49.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb48ea00640 1 -- 172.21.15.99:0/3429602363 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb478037070 con 0x7fb490072f40 2024-09-10T07:45:49.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb48ea00640 1 -- 172.21.15.99:0/3429602363 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb478032440 con 0x7fb490072f40 2024-09-10T07:45:49.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb48ea00640 1 -- 172.21.15.99:0/3429602363 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb478032810 con 0x7fb490072f40 2024-09-10T07:45:49.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb496200640 1 -- 172.21.15.99:0/3429602363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490072f40 msgr2=0x7fb49006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb496200640 1 --2- 172.21.15.99:0/3429602363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490072f40 0x7fb49006f470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb478009870 tx=0x7fb47802a250 comp rx=0 tx=0).stop 2024-09-10T07:45:49.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb496200640 1 -- 172.21.15.99:0/3429602363 shutdown_connections 2024-09-10T07:45:49.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb496200640 1 --2- 172.21.15.99:0/3429602363 >> v2:172.21.15.187:3300/0 conn(0x7fb4900ce780 0x7fb4900b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb496200640 1 --2- 172.21.15.99:0/3429602363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490072f40 0x7fb49006f470 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb496200640 1 -- 172.21.15.99:0/3429602363 >> 172.21.15.99:0/3429602363 conn(0x7fb49006bc10 msgr2=0x7fb49006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:49.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb496200640 1 -- 172.21.15.99:0/3429602363 shutdown_connections 2024-09-10T07:45:49.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.099+0000 7fb496200640 1 -- 172.21.15.99:0/3429602363 wait complete. 2024-09-10T07:45:49.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.101+0000 7fb496200640 1 Processor -- start 2024-09-10T07:45:49.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.101+0000 7fb496200640 1 -- start start 2024-09-10T07:45:49.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb496200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb490072f40 0x7fb4901e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb496200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4900ce780 0x7fb4901f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb496200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490145290 0x7fb4901f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb496200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb49006df80 con 0x7fb4900ce780 2024-09-10T07:45:49.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb496200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb490145670 con 0x7fb490072f40 2024-09-10T07:45:49.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb496200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fb49006e100 con 0x7fb490145290 2024-09-10T07:45:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb486a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4900ce780 0x7fb4901f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb486a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4900ce780 0x7fb4901f7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44592/0 (socket says 172.21.15.99:44592) 2024-09-10T07:45:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb486a00640 1 -- 172.21.15.99:0/4116699950 learned_addr learned my addr 172.21.15.99:0/4116699950 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb48fe00640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490145290 0x7fb4901f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.102+0000 7fb48f400640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb490072f40 0x7fb4901e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.103+0000 7fb486a00640 1 -- 172.21.15.99:0/4116699950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490145290 msgr2=0x7fb4901f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.103+0000 7fb486a00640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490145290 0x7fb4901f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.103+0000 7fb486a00640 1 -- 172.21.15.99:0/4116699950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb490072f40 msgr2=0x7fb4901e7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.103+0000 7fb486a00640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb490072f40 0x7fb4901e7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.103+0000 7fb486a00640 1 -- 172.21.15.99:0/4116699950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4901f4ad0 con 0x7fb4900ce780 2024-09-10T07:45:49.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.103+0000 7fb486a00640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4900ce780 0x7fb4901f7fb0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fb478000c00 tx=0x7fb4780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:49.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.103+0000 7fb487e00640 1 -- 172.21.15.99:0/4116699950 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb478037040 con 0x7fb4900ce780 2024-09-10T07:45:49.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.103+0000 7fb487e00640 1 -- 172.21.15.99:0/4116699950 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb478042070 con 0x7fb4900ce780 2024-09-10T07:45:49.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.103+0000 7fb496200640 1 -- 172.21.15.99:0/4116699950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4901f8800 con 0x7fb4900ce780 2024-09-10T07:45:49.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.103+0000 7fb487e00640 1 -- 172.21.15.99:0/4116699950 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb478030880 con 0x7fb4900ce780 2024-09-10T07:45:49.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.104+0000 7fb496200640 1 -- 172.21.15.99:0/4116699950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4901f84f0 con 0x7fb4900ce780 2024-09-10T07:45:49.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.104+0000 7fb496200640 1 -- 172.21.15.99:0/4116699950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb490071510 con 0x7fb4900ce780 2024-09-10T07:45:49.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.105+0000 7fb487e00640 1 -- 172.21.15.99:0/4116699950 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb478030a20 con 0x7fb4900ce780 2024-09-10T07:45:49.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.106+0000 7fb487e00640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb46c06be30 0x7fb46c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.106+0000 7fb487e00640 1 -- 172.21.15.99:0/4116699950 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7fb4780ab5b0 con 0x7fb4900ce780 2024-09-10T07:45:49.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.106+0000 7fb48f400640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb46c06be30 0x7fb46c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.107+0000 7fb48f400640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb46c06be30 0x7fb46c06e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb480001780 tx=0x7fb480009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:49.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.111+0000 7fb487e00640 1 -- 172.21.15.99:0/4116699950 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb478079900 con 0x7fb4900ce780 2024-09-10T07:45:49.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.283+0000 7fb496200640 1 -- 172.21.15.99:0/4116699950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fb4900b2060 con 0x7fb4900ce780 2024-09-10T07:45:49.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.285+0000 7fb487e00640 1 -- 172.21.15.99:0/4116699950 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v191) ==== 81+0+34246 (secure 0 0 0) 0x7fb47807dc00 con 0x7fb4900ce780 2024-09-10T07:45:49.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:49.285 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:45:49.286 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 191, 2024-09-10T07:45:49.286 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:45:49.286 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:45:49.286 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:45:46.820422+0000", 2024-09-10T07:45:49.286 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:45:49.286 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:45:49.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:45:49.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:45:49.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:45:49.286 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 23, 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:45:49.287 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:49.288 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:45:49.289 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:49.290 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:49.291 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:49.292 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:49.293 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 22, 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:11.664665+0000", 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:49.295 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:49.296 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "187", 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:49.298 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:49.299 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 23, 2024-09-10T07:45:49.301 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:12.889786+0000", 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:49.302 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:49.303 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "191", 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:49.304 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:49.305 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:49.306 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.307 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.309 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:45:49.311 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:45:49.312 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.313 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.315 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.316 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.318 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.319 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:49.320 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.321 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.323 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.324 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.325 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.326 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:45:49.327 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.328 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:45:49.331 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.332 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:45:49.335 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:45:49.336 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.337 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.338 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:45:49.339 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:45:49.340 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.341 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.343 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.344 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.345 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.346 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.347 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.348 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.350 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.351 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.353 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:45:49.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.356 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.357 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.358 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.359 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.360 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.361 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:45:49.362 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:45:49.363 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:45:49.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.364 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:45:49.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 -- 172.21.15.99:0/4116699950 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb46c06be30 msgr2=0x7fb46c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb46c06be30 0x7fb46c06e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb480001780 tx=0x7fb480009040 comp rx=0 tx=0).stop 2024-09-10T07:45:49.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 -- 172.21.15.99:0/4116699950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4900ce780 msgr2=0x7fb4901f7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4900ce780 0x7fb4901f7fb0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fb478000c00 tx=0x7fb4780046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 -- 172.21.15.99:0/4116699950 shutdown_connections 2024-09-10T07:45:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb490145290 0x7fb4901f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fb46c06be30 0x7fb46c06e2f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4900ce780 0x7fb4901f7fb0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 --2- 172.21.15.99:0/4116699950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb490072f40 0x7fb4901e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 -- 172.21.15.99:0/4116699950 >> 172.21.15.99:0/4116699950 conn(0x7fb49006bc10 msgr2=0x7fb4900b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 -- 172.21.15.99:0/4116699950 shutdown_connections 2024-09-10T07:45:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.288+0000 7fb496200640 1 -- 172.21.15.99:0/4116699950 wait complete. 2024-09-10T07:45:49.367 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-10T07:45:49.367 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-10T07:45:49.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.521+0000 7f7092600640 1 Processor -- start 2024-09-10T07:45:49.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.521+0000 7f7092600640 1 -- start start 2024-09-10T07:45:49.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.523+0000 7f7092600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f708c152210 0x7f708c071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.523+0000 7f7092600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f708c15c4f0 con 0x7f708c0cee90 2024-09-10T07:45:49.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.523+0000 7f7092600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f708c15b730 con 0x7f708c0723d0 2024-09-10T07:45:49.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.523+0000 7f7092600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f708c0cf9c0 con 0x7f708c152210 2024-09-10T07:45:49.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.523+0000 7f708be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f708c0cee90 0x7f708c0cf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59698/0 (socket says 172.21.15.99:59698) 2024-09-10T07:45:49.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.523+0000 7f708be00640 1 -- 172.21.15.99:0/3042705598 learned_addr learned my addr 172.21.15.99:0/3042705598 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:49.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.523+0000 7f708b400640 1 --2- 172.21.15.99:0/3042705598 >> v2:172.21.15.187:3300/0 conn(0x7f708c152210 0x7f708c071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.523+0000 7f708aa00640 1 -- 172.21.15.99:0/3042705598 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258053669 0 0) 0x7f708c15c4f0 con 0x7f708c0cee90 2024-09-10T07:45:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.523+0000 7f708aa00640 1 -- 172.21.15.99:0/3042705598 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7070003520 con 0x7f708c0cee90 2024-09-10T07:45:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.524+0000 7f708aa00640 1 -- 172.21.15.99:0/3042705598 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841569719 0 0) 0x7f708c15b730 con 0x7f708c0723d0 2024-09-10T07:45:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.524+0000 7f708aa00640 1 -- 172.21.15.99:0/3042705598 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f708c15c4f0 con 0x7f708c0723d0 2024-09-10T07:45:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.524+0000 7f708aa00640 1 -- 172.21.15.99:0/3042705598 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2722362206 0 0) 0x7f7070003520 con 0x7f708c0cee90 2024-09-10T07:45:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.524+0000 7f708b400640 1 -- 172.21.15.99:0/3042705598 >> v1:172.21.15.187:6789/0 conn(0x7f708c0723d0 legacy=0x7f708c0ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.524+0000 7f708b400640 1 -- 172.21.15.99:0/3042705598 >> v1:172.21.15.99:6789/0 conn(0x7f708c0cee90 legacy=0x7f708c0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.524+0000 7f708b400640 1 -- 172.21.15.99:0/3042705598 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c15ba10 con 0x7f708c152210 2024-09-10T07:45:49.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.525+0000 7f708b400640 1 --2- 172.21.15.99:0/3042705598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c152210 0x7f708c071e90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f707c0097a0 tx=0x7f707c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=200c1e7f771c71e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:49.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.525+0000 7f708aa00640 1 -- 172.21.15.99:0/3042705598 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c037070 con 0x7f708c152210 2024-09-10T07:45:49.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.525+0000 7f708aa00640 1 -- 172.21.15.99:0/3042705598 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707c02ac50 con 0x7f708c152210 2024-09-10T07:45:49.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.525+0000 7f708aa00640 1 -- 172.21.15.99:0/3042705598 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70840019f0 con 0x7f708c152210 2024-09-10T07:45:49.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.525+0000 7f7092600640 1 -- 172.21.15.99:0/3042705598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c152210 msgr2=0x7f708c071e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.525+0000 7f7092600640 1 --2- 172.21.15.99:0/3042705598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c152210 0x7f708c071e90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f707c0097a0 tx=0x7f707c02a1c0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.526+0000 7f7092600640 1 -- 172.21.15.99:0/3042705598 shutdown_connections 2024-09-10T07:45:49.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.526+0000 7f7092600640 1 --2- 172.21.15.99:0/3042705598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c152210 0x7f708c071e90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.526+0000 7f7092600640 1 -- 172.21.15.99:0/3042705598 >> 172.21.15.99:0/3042705598 conn(0x7f708c06bc10 msgr2=0x7f708c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:49.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.526+0000 7f7092600640 1 -- 172.21.15.99:0/3042705598 shutdown_connections 2024-09-10T07:45:49.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.526+0000 7f7092600640 1 -- 172.21.15.99:0/3042705598 wait complete. 2024-09-10T07:45:49.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.527+0000 7f7092600640 1 Processor -- start 2024-09-10T07:45:49.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.527+0000 7f7092600640 1 -- start start 2024-09-10T07:45:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.528+0000 7f7092600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0723d0 0x7f708c149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.528+0000 7f7092600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0cee90 0x7f708c145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.528+0000 7f7092600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c152210 0x7f708c143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.528+0000 7f7092600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f708c06f380 con 0x7f708c0723d0 2024-09-10T07:45:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.528+0000 7f7092600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f708c15bfd0 con 0x7f708c152210 2024-09-10T07:45:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.528+0000 7f7092600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f708c06d6b0 con 0x7f708c0cee90 2024-09-10T07:45:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.528+0000 7f708b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0723d0 0x7f708c149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.528+0000 7f708b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0723d0 0x7f708c149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44598/0 (socket says 172.21.15.99:44598) 2024-09-10T07:45:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.528+0000 7f708b400640 1 -- 172.21.15.99:0/3123741062 learned_addr learned my addr 172.21.15.99:0/3123741062 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f708be00640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c152210 0x7f708c143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f7082a00640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0cee90 0x7f708c145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f708b400640 1 -- 172.21.15.99:0/3123741062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0cee90 msgr2=0x7f708c145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f708b400640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0cee90 0x7f708c145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f708b400640 1 -- 172.21.15.99:0/3123741062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c152210 msgr2=0x7f708c143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f708b400640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c152210 0x7f708c143b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f708b400640 1 -- 172.21.15.99:0/3123741062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c1527e0 con 0x7f708c0723d0 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f708be00640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c152210 0x7f708c143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f708b400640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0723d0 0x7f708c149880 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f707c0098c0 tx=0x7f707c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f7083e00640 1 -- 172.21.15.99:0/3123741062 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c041070 con 0x7f708c0723d0 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f7083e00640 1 -- 172.21.15.99:0/3123741062 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707c03c460 con 0x7f708c0723d0 2024-09-10T07:45:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.529+0000 7f7092600640 1 -- 172.21.15.99:0/3123741062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708c152ac0 con 0x7f708c0723d0 2024-09-10T07:45:49.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.530+0000 7f7083e00640 1 -- 172.21.15.99:0/3123741062 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c037040 con 0x7f708c0723d0 2024-09-10T07:45:49.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.530+0000 7f7092600640 1 -- 172.21.15.99:0/3123741062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708c153360 con 0x7f708c0723d0 2024-09-10T07:45:49.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.531+0000 7f7092600640 1 -- 172.21.15.99:0/3123741062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708c0ce780 con 0x7f708c0723d0 2024-09-10T07:45:49.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.532+0000 7f7083e00640 1 -- 172.21.15.99:0/3123741062 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f707c044070 con 0x7f708c0723d0 2024-09-10T07:45:49.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.532+0000 7f7083e00640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 0x7f706806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.533+0000 7f7083e00640 1 -- 172.21.15.99:0/3123741062 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7f707c0ab370 con 0x7f708c0723d0 2024-09-10T07:45:49.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.533+0000 7f7082a00640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 0x7f706806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.533+0000 7f7082a00640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 0x7f706806e2f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f708c06e580 tx=0x7f7074009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:49.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.537+0000 7f7083e00640 1 -- 172.21.15.99:0/3123741062 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f708c0ce780 con 0x7f708c0723d0 2024-09-10T07:45:49.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.709+0000 7f7092600640 1 -- 172.21.15.99:0/3123741062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f708c071e90 con 0x7f708c0723d0 2024-09-10T07:45:49.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.710+0000 7f7083e00640 1 -- 172.21.15.99:0/3123741062 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v191) ==== 81+0+34246 (secure 0 0 0) 0x7f707c079ed0 con 0x7f708c0723d0 2024-09-10T07:45:49.710 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:49.710 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:45:49.710 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 191, 2024-09-10T07:45:49.710 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", 2024-09-10T07:45:49.710 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T07:34:01.909153+0000", 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T07:45:46.820422+0000", 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T07:34:08.146072+0000", 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T07:34:05.134938+0000", 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5799936, 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:49.711 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.69999998807907104, 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 23, 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.712 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:34:08.744575+0000", 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:49.713 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:49.714 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "113", 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:49.716 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:49.717 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T07:45:49.718 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 22, 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_metadata", 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:11.664665+0000", 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:49.719 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:49.720 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.721 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "187", 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:49.722 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:49.723 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:49.724 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4, 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 16, 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_priority": 5 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": "cephfs" 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.725 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 2, 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 2, 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.726 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 23, 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "cephfs_data", 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T07:45:12.889786+0000", 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T07:45:49.727 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T07:45:49.728 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "191", 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T07:45:49.729 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 33554432, 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T07:45:49.730 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T07:45:49.731 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 64, 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: "target_size_ratio": 0.89999997615814209 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs": { 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: "data": "cephfs" 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.732 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.3799999952316284, 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.3799999952316284, 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T07:45:49.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.734 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.735 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T07:45:49.738 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 687905162 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/687905162", 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/687905162", 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/687905162", 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/687905162", 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.740 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.741 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.741 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T07:45:49.741 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.741 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.742 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 452352031 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6812/452352031", 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6816/452352031", 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6824/452352031", 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6820/452352031", 2024-09-10T07:45:49.745 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T07:45:49.748 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T07:45:49.749 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.750 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 229492178 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/229492178", 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6813/229492178", 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6825/229492178", 2024-09-10T07:45:49.751 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6819/229492178", 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.752 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.753 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T07:45:49.754 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.755 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.756 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1992812983 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6823/1992812983", 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1992812983", 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1992812983", 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1992812983", 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.758 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6824", 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6825", 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6826", 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6827", 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6830", 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6831", 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6828", 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6829", 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3032215980 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6825/3032215980", 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6827/3032215980", 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6831/3032215980", 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6829/3032215980", 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.763 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.764 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6800", 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6801", 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6802", 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6803", 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6806", 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6807", 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.767 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6804", 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6805", 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3936971942 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.768 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6801/3936971942", 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6803/3936971942", 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6807/3936971942", 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6805/3936971942", 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.769 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.770 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6808", 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6809", 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.771 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6810", 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6812", 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.772 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6819", 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6822", 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6815", 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6817", 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2894508630 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6809/2894508630", 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6812/2894508630", 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6822/2894508630", 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6817/2894508630", 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T07:45:49.775 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 186, 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.776 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6811", 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6813", 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6814", 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6816", 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.778 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6821", 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6823", 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.779 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6818", 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.187:6820", 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 303826834 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.187:6813/303826834", 2024-09-10T07:45:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.187:6816/303826834", 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.187:6823/303826834", 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.187:6820/303826834", 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T07:45:49.781 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.318966+0000", 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.782 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.412508+0000", 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.410090+0000", 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.351224+0000", 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.784 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.407331+0000", 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.339907+0000", 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.371532+0000", 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T07:34:06.352303+0000", 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T07:45:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T07:45:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T07:45:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T07:45:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T07:45:49.790 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:45:49.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 -- 172.21.15.99:0/3123741062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 msgr2=0x7f706806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 0x7f706806e2f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f708c06e580 tx=0x7f7074009040 comp rx=0 tx=0).stop 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 -- 172.21.15.99:0/3123741062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0723d0 msgr2=0x7f708c149880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0723d0 0x7f708c149880 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f707c0098c0 tx=0x7f707c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 -- 172.21.15.99:0/3123741062 shutdown_connections 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f708c152210 0x7f708c143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f708c0cee90 0x7f708c145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f706806be30 0x7f706806e2f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 --2- 172.21.15.99:0/3123741062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f708c0723d0 0x7f708c149880 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 -- 172.21.15.99:0/3123741062 >> 172.21.15.99:0/3123741062 conn(0x7f708c06bc10 msgr2=0x7f708c15c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 -- 172.21.15.99:0/3123741062 shutdown_connections 2024-09-10T07:45:49.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.713+0000 7f7092600640 1 -- 172.21.15.99:0/3123741062 wait complete. 2024-09-10T07:45:49.796 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:49.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.950+0000 7f44f8200640 1 Processor -- start 2024-09-10T07:45:49.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.950+0000 7f44f8200640 1 -- start start 2024-09-10T07:45:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f8200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f44f00d1ab0 0x7f44f00b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f8200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f00d3240 0x7f44f00b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f8200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f00b7a90 con 0x7f44f015ef50 2024-09-10T07:45:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f8200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f44f00d3740 con 0x7f44f00d1ab0 2024-09-10T07:45:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f8200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f44f00d3a20 con 0x7f44f00d3240 2024-09-10T07:45:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f4e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f44f00d1ab0 0x7f44f00b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f4e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f44f00d1ab0 0x7f44f00b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46922/0 (socket says 172.21.15.99:46922) 2024-09-10T07:45:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f4e00640 1 -- 172.21.15.99:0/309508525 learned_addr learned my addr 172.21.15.99:0/309508525 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f6200640 1 --2- 172.21.15.99:0/309508525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f00d3240 0x7f44f00b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f4e00640 1 -- 172.21.15.99:0/309508525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f00d3240 msgr2=0x7f44f00b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:49.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f4e00640 1 --2- 172.21.15.99:0/309508525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f00d3240 0x7f44f00b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f4e00640 1 -- 172.21.15.99:0/309508525 >> v1:172.21.15.187:6789/0 conn(0x7f44f015ef50 legacy=0x7f44f00d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f4e00640 1 -- 172.21.15.99:0/309508525 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f00b7d00 con 0x7f44f00d1ab0 2024-09-10T07:45:49.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.952+0000 7f44f6200640 1 --2- 172.21.15.99:0/309508525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f00d3240 0x7f44f00b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:49.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.953+0000 7f44f4e00640 1 --2- 172.21.15.99:0/309508525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 0x7f44f00b8500 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009870 tx=0x7f44dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb326591468e524d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:49.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44efe00640 1 -- 172.21.15.99:0/309508525 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc037070 con 0x7f44f00d1ab0 2024-09-10T07:45:49.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44efe00640 1 -- 172.21.15.99:0/309508525 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44dc032440 con 0x7f44f00d1ab0 2024-09-10T07:45:49.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44efe00640 1 -- 172.21.15.99:0/309508525 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc032810 con 0x7f44f00d1ab0 2024-09-10T07:45:49.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44f8200640 1 -- 172.21.15.99:0/309508525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 msgr2=0x7f44f00b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44f8200640 1 --2- 172.21.15.99:0/309508525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 0x7f44f00b8500 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009870 tx=0x7f44dc02a1e0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44f8200640 1 -- 172.21.15.99:0/309508525 shutdown_connections 2024-09-10T07:45:49.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44f8200640 1 --2- 172.21.15.99:0/309508525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f00d3240 0x7f44f00b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44f8200640 1 --2- 172.21.15.99:0/309508525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 0x7f44f00b8500 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44f8200640 1 -- 172.21.15.99:0/309508525 >> 172.21.15.99:0/309508525 conn(0x7f44f00d4c60 msgr2=0x7f44f00d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:49.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44f8200640 1 -- 172.21.15.99:0/309508525 shutdown_connections 2024-09-10T07:45:49.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.954+0000 7f44f8200640 1 -- 172.21.15.99:0/309508525 wait complete. 2024-09-10T07:45:49.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.956+0000 7f44f8200640 1 Processor -- start 2024-09-10T07:45:49.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.956+0000 7f44f8200640 1 -- start start 2024-09-10T07:45:49.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.957+0000 7f44f8200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 0x7f44f0155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.957+0000 7f44f8200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f00d3240 0x7f44f00c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.957+0000 7f44f8200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f015ef50 0x7f44f00ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.957+0000 7f44f8200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00d21a0 con 0x7f44f00d1ab0 2024-09-10T07:45:49.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.957+0000 7f44f8200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00d2020 con 0x7f44f00d3240 2024-09-10T07:45:49.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.957+0000 7f44f8200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f44f00d5780 con 0x7f44f015ef50 2024-09-10T07:45:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.957+0000 7f44f5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 0x7f44f0155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.957+0000 7f44f5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 0x7f44f0155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46936/0 (socket says 172.21.15.99:46936) 2024-09-10T07:45:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.957+0000 7f44f5800640 1 -- 172.21.15.99:0/522963500 learned_addr learned my addr 172.21.15.99:0/522963500 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44f5800640 1 -- 172.21.15.99:0/522963500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f015ef50 msgr2=0x7f44f00ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44f5800640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f015ef50 0x7f44f00ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44f5800640 1 -- 172.21.15.99:0/522963500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f00d3240 msgr2=0x7f44f00c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44f5800640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f00d3240 0x7f44f00c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44f5800640 1 -- 172.21.15.99:0/522963500 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f0161940 con 0x7f44f00d1ab0 2024-09-10T07:45:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44f5800640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 0x7f44f0155c30 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f44e400c3f0 tx=0x7f44e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44ed600640 1 -- 172.21.15.99:0/522963500 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e40052d0 con 0x7f44f00d1ab0 2024-09-10T07:45:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44ed600640 1 -- 172.21.15.99:0/522963500 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e4005490 con 0x7f44f00d1ab0 2024-09-10T07:45:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44ed600640 1 -- 172.21.15.99:0/522963500 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e4007260 con 0x7f44f00d1ab0 2024-09-10T07:45:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44f8200640 1 -- 172.21.15.99:0/522963500 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f00c8a10 con 0x7f44f00d1ab0 2024-09-10T07:45:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.958+0000 7f44f8200640 1 -- 172.21.15.99:0/522963500 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f00c8fd0 con 0x7f44f00d1ab0 2024-09-10T07:45:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.959+0000 7f44f8200640 1 -- 172.21.15.99:0/522963500 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f00d13a0 con 0x7f44f00d1ab0 2024-09-10T07:45:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.960+0000 7f44ed600640 1 -- 172.21.15.99:0/522963500 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44e4007400 con 0x7f44f00d1ab0 2024-09-10T07:45:49.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.961+0000 7f44ed600640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d006be30 0x7f44d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:49.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.961+0000 7f44ed600640 1 -- 172.21.15.99:0/522963500 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7f44e408a3f0 con 0x7f44f00d1ab0 2024-09-10T07:45:49.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.961+0000 7f44f4e00640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d006be30 0x7f44d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:49.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.962+0000 7f44f4e00640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d006be30 0x7f44d006e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f44dc034000 tx=0x7f44dc02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:49.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:49.966+0000 7f44ed600640 1 -- 172.21.15.99:0/522963500 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44e4058d00 con 0x7f44f00d1ab0 2024-09-10T07:45:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.173+0000 7f44f8200640 1 -- 172.21.15.99:0/522963500 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44f00c91a0 con 0x7f44f00d1ab0 2024-09-10T07:45:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.174+0000 7f44ed600640 1 -- 172.21.15.99:0/522963500 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7f44e4058600 con 0x7f44f00d1ab0 2024-09-10T07:45:50.174 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:50.174 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":90,"btime":"2024-09-10T07:45:17:511094+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4239870292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4239870292},{"type":"v1","addr":"172.21.15.99:6836","nonce":4239870292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2428750075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2428750075},{"type":"v1","addr":"172.21.15.187:6835","nonce":2428750075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1219809784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1219809784},{"type":"v1","addr":"172.21.15.187:6834","nonce":1219809784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:45:13.894905+0000","modified":"2024-09-10T07:45:16.912907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7276":{"gid":7276,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/256766417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":256766417},{"type":"v1","addr":"172.21.15.99:6837","nonce":256766417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7276,"qdb_cluster":[7276]},"id":11}]} 2024-09-10T07:45:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 90 2024-09-10T07:45:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 -- 172.21.15.99:0/522963500 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d006be30 msgr2=0x7f44d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d006be30 0x7f44d006e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f44dc034000 tx=0x7f44dc02c000 comp rx=0 tx=0).stop 2024-09-10T07:45:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 -- 172.21.15.99:0/522963500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 msgr2=0x7f44f0155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 0x7f44f0155c30 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f44e400c3f0 tx=0x7f44e400c8b0 comp rx=0 tx=0).stop 2024-09-10T07:45:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 -- 172.21.15.99:0/522963500 shutdown_connections 2024-09-10T07:45:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44f015ef50 0x7f44f00ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f00d3240 0x7f44f00c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f44d006be30 0x7f44d006e2f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 --2- 172.21.15.99:0/522963500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f00d1ab0 0x7f44f0155c30 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 -- 172.21.15.99:0/522963500 >> 172.21.15.99:0/522963500 conn(0x7f44f00d4c60 msgr2=0x7f44f015c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 -- 172.21.15.99:0/522963500 shutdown_connections 2024-09-10T07:45:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:50.176+0000 7f44f8200640 1 -- 172.21.15.99:0/522963500 wait complete. 2024-09-10T07:45:50.192 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-10T07:45:50.368 INFO:teuthology.orchestra.run.smithi099.stdout:{"cluster_fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","whoami":0,"id":7276,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.874175813000001,"mdsmap_epoch":90,"osdmap_epoch":191,"osdmap_epoch_barrier":190,"uptime":40.958741619999998} 2024-09-10T07:45:50.368 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "d4ff4b75-2329-4b44-969c-780f31c4e94e", "fs_name": "cephfs", "id": 7276, "mdsmap_epoch": 90, "osdmap_epoch": 191, "osdmap_epoch_barrier": 190, "rank_uptime": 35.874175813, "state": "up:active", "uptime": 40.95874162, "want_state": "up:active", "whoami": 0 } 2024-09-10T07:45:50.368 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-10T07:45:50.368 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:50.368 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:50.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:50.404 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-10T07:45:50.836 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records in 2024-09-10T07:45:50.837 INFO:teuthology.orchestra.run.smithi099.stderr:50+0 records out 2024-09-10T07:45:50.837 INFO:teuthology.orchestra.run.smithi099.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.354006 s, 148 MB/s 2024-09-10T07:45:50.838 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T07:45:50.838 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:45:50.924 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T07:45:51.015 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T07:45:51.015 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:45:51.015 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:51.015 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:51.051 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:51.051 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:51.127 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:45:51.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.322+0000 7fa585800640 1 Processor -- start 2024-09-10T07:45:51.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.322+0000 7fa585800640 1 -- start start 2024-09-10T07:45:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.323+0000 7fa585800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5800ce070 0x7fa5800b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.324+0000 7fa585800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa58015d880 con 0x7fa5800cf890 2024-09-10T07:45:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.324+0000 7fa585800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa58015c800 con 0x7fa58015bfb0 2024-09-10T07:45:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.324+0000 7fa585800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa5800ce450 con 0x7fa5800ce070 2024-09-10T07:45:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.324+0000 7fa57f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa5800cf890 0x7fa58006e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50770/0 (socket says 172.21.15.99:50770) 2024-09-10T07:45:51.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.324+0000 7fa57f400640 1 -- 172.21.15.99:0/4243758327 learned_addr learned my addr 172.21.15.99:0/4243758327 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.324+0000 7fa57ea00640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5800ce070 0x7fa5800b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.324+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3447785185 0 0) 0x7fa58015d880 con 0x7fa5800cf890 2024-09-10T07:45:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.324+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa564003520 con 0x7fa5800cf890 2024-09-10T07:45:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742133205 0 0) 0x7fa58015c800 con 0x7fa58015bfb0 2024-09-10T07:45:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa58015d880 con 0x7fa58015bfb0 2024-09-10T07:45:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2522276607 0 0) 0x7fa564003520 con 0x7fa5800cf890 2024-09-10T07:45:51.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5800ce070 msgr2=0x7fa5800b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5800ce070 0x7fa5800b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 >> v1:172.21.15.187:6789/0 conn(0x7fa58015bfb0 legacy=0x7fa58015d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58015cae0 con 0x7fa5800cf890 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7fa5780019f0 con 0x7fa5800cf890 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 >> v1:172.21.15.99:6789/0 conn(0x7fa5800cf890 legacy=0x7fa58006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa564003b70 0x7fa564003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 0x7fa564004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5640051c0 0x7fa56400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800ce450 con 0x7fa564004800 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa56400e1f0 con 0x7fa564003b70 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa56400e3f0 con 0x7fa5640051c0 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57ea00640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5800ce070 0x7fa5800b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa576000640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 0x7fa564004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57f400640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5640051c0 0x7fa56400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa57ea00640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa564003b70 0x7fa564003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa576000640 1 -- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5640051c0 msgr2=0x7fa56400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa576000640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5640051c0 0x7fa56400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.325+0000 7fa576000640 1 -- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa564003b70 msgr2=0x7fa564003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.326+0000 7fa576000640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa564003b70 0x7fa564003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.326+0000 7fa576000640 1 -- 172.21.15.99:0/4243758327 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa564003520 con 0x7fa564004800 2024-09-10T07:45:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.326+0000 7fa576000640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 0x7fa564004c80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa568001890 tx=0x7fa564005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abeb5c6b2256b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.327+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5680014e0 con 0x7fa564004800 2024-09-10T07:45:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.327+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5680052f0 con 0x7fa564004800 2024-09-10T07:45:51.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.327+0000 7fa57e000640 1 -- 172.21.15.99:0/4243758327 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56802ac60 con 0x7fa564004800 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.327+0000 7fa585800640 1 -- 172.21.15.99:0/4243758327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 msgr2=0x7fa564004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.327+0000 7fa585800640 1 --2- 172.21.15.99:0/4243758327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 0x7fa564004c80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa568001890 tx=0x7fa564005830 comp rx=0 tx=0).stop 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.327+0000 7fa57f400640 1 -- 172.21.15.99:0/4243758327 reap_dead start 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.327+0000 7fa585800640 1 -- 172.21.15.99:0/4243758327 shutdown_connections 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.327+0000 7fa585800640 1 -- 172.21.15.99:0/4243758327 >> 172.21.15.99:0/4243758327 conn(0x7fa5800b2630 msgr2=0x7fa5800b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.327+0000 7fa585800640 1 -- 172.21.15.99:0/4243758327 shutdown_connections 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.327+0000 7fa585800640 1 -- 172.21.15.99:0/4243758327 wait complete. 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.329+0000 7fa585800640 1 Processor -- start 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.329+0000 7fa585800640 1 -- start start 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.330+0000 7fa585800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 0x7fa580141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.330+0000 7fa585800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5801536c0 0x7fa580145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.330+0000 7fa585800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa580143960 0x7fa580143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.330+0000 7fa585800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa58015c590 con 0x7fa564004800 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.330+0000 7fa585800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa58015c410 con 0x7fa5801536c0 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.330+0000 7fa585800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa58006e790 con 0x7fa580143960 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.330+0000 7fa57ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 0x7fa580141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.330+0000 7fa57ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 0x7fa580141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46954/0 (socket says 172.21.15.99:46954) 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.330+0000 7fa57ea00640 1 -- 172.21.15.99:0/4226825259 learned_addr learned my addr 172.21.15.99:0/4226825259 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.330+0000 7fa57f400640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa580143960 0x7fa580143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa576000640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5801536c0 0x7fa580145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa57ea00640 1 -- 172.21.15.99:0/4226825259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa580143960 msgr2=0x7fa580143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa57ea00640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa580143960 0x7fa580143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa57ea00640 1 -- 172.21.15.99:0/4226825259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5801536c0 msgr2=0x7fa580145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa57ea00640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5801536c0 0x7fa580145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa57ea00640 1 -- 172.21.15.99:0/4226825259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5801428c0 con 0x7fa564004800 2024-09-10T07:45:51.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa57f400640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa580143960 0x7fa580143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa57ea00640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 0x7fa580141d80 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fa5700119d0 tx=0x7fa570011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa577400640 1 -- 172.21.15.99:0/4226825259 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57000fb50 con 0x7fa564004800 2024-09-10T07:45:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa577400640 1 -- 172.21.15.99:0/4226825259 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa57000fcf0 con 0x7fa564004800 2024-09-10T07:45:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa577400640 1 -- 172.21.15.99:0/4226825259 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57000fea0 con 0x7fa564004800 2024-09-10T07:45:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa585800640 1 -- 172.21.15.99:0/4226825259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa580142ba0 con 0x7fa564004800 2024-09-10T07:45:51.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.331+0000 7fa585800640 1 -- 172.21.15.99:0/4226825259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa580143160 con 0x7fa564004800 2024-09-10T07:45:51.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.332+0000 7fa585800640 1 -- 172.21.15.99:0/4226825259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5800b5750 con 0x7fa564004800 2024-09-10T07:45:51.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.333+0000 7fa577400640 1 -- 172.21.15.99:0/4226825259 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa570012040 con 0x7fa564004800 2024-09-10T07:45:51.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.334+0000 7fa577400640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa55c06be30 0x7fa55c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.334+0000 7fa577400640 1 -- 172.21.15.99:0/4226825259 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7fa57008b6c0 con 0x7fa564004800 2024-09-10T07:45:51.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.334+0000 7fa576000640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa55c06be30 0x7fa55c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.335+0000 7fa576000640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa55c06be30 0x7fa55c06e2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa568032000 tx=0x7fa56802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:51.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.338+0000 7fa577400640 1 -- 172.21.15.99:0/4226825259 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa570019030 con 0x7fa564004800 2024-09-10T07:45:51.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.520+0000 7fa585800640 1 -- 172.21.15.99:0/4226825259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa5800d0420 con 0x7fa564004800 2024-09-10T07:45:51.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.521+0000 7fa577400640 1 -- 172.21.15.99:0/4226825259 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v191) ==== 80+0+0 (secure 0 0 0) 0x7fa5700598f0 con 0x7fa564004800 2024-09-10T07:45:51.519 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:45:51.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 -- 172.21.15.99:0/4226825259 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa55c06be30 msgr2=0x7fa55c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa55c06be30 0x7fa55c06e2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa568032000 tx=0x7fa56802e000 comp rx=0 tx=0).stop 2024-09-10T07:45:51.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 -- 172.21.15.99:0/4226825259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 msgr2=0x7fa580141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 0x7fa580141d80 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fa5700119d0 tx=0x7fa570011e90 comp rx=0 tx=0).stop 2024-09-10T07:45:51.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 -- 172.21.15.99:0/4226825259 shutdown_connections 2024-09-10T07:45:51.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa580143960 0x7fa580143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5801536c0 0x7fa580145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa55c06be30 0x7fa55c06e2f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 --2- 172.21.15.99:0/4226825259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa564004800 0x7fa580141d80 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 -- 172.21.15.99:0/4226825259 >> 172.21.15.99:0/4226825259 conn(0x7fa5800b2630 msgr2=0x7fa5800b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:51.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 -- 172.21.15.99:0/4226825259 shutdown_connections 2024-09-10T07:45:51.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.523+0000 7fa585800640 1 -- 172.21.15.99:0/4226825259 wait complete. 2024-09-10T07:45:51.538 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T07:45:51.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:51.538 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T07:45:51.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:45:51.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:51.632 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T07:45:51.680 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:45:51.681 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:45:51.681 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:51.717 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:45:51.717 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:51.793 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T07:45:51.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.948+0000 7f625a800640 1 Processor -- start 2024-09-10T07:45:51.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.949+0000 7f625a800640 1 -- start start 2024-09-10T07:45:51.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.950+0000 7f625a800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f625415db60 0x7f6254071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.950+0000 7f625a800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62540724d0 0x7f625406e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.950+0000 7f625a800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6254153e50 con 0x7f625406e580 2024-09-10T07:45:51.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.950+0000 7f625a800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f625415df40 con 0x7f625415db60 2024-09-10T07:45:51.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.950+0000 7f625a800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f625406e9b0 con 0x7f62540724d0 2024-09-10T07:45:51.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.950+0000 7f6253e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f625406e580 0x7f6254160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50776/0 (socket says 172.21.15.99:50776) 2024-09-10T07:45:51.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.950+0000 7f6253e00640 1 -- 172.21.15.99:0/3312144386 learned_addr learned my addr 172.21.15.99:0/3312144386 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:51.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.950+0000 7f624aa00640 1 --2- 172.21.15.99:0/3312144386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62540724d0 0x7f625406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.950+0000 7f6253400640 1 --2- 172.21.15.99:0/3312144386 >> v2:172.21.15.187:3300/0 conn(0x7f625415db60 0x7f6254071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.951+0000 7f6252a00640 1 -- 172.21.15.99:0/3312144386 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504076454 0 0) 0x7f6254153e50 con 0x7f625406e580 2024-09-10T07:45:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.951+0000 7f6252a00640 1 -- 172.21.15.99:0/3312144386 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6238003520 con 0x7f625406e580 2024-09-10T07:45:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.951+0000 7f624aa00640 1 -- 172.21.15.99:0/3312144386 >> v2:172.21.15.187:3300/0 conn(0x7f625415db60 msgr2=0x7f6254071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:51.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.951+0000 7f624aa00640 1 --2- 172.21.15.99:0/3312144386 >> v2:172.21.15.187:3300/0 conn(0x7f625415db60 0x7f6254071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.951+0000 7f624aa00640 1 -- 172.21.15.99:0/3312144386 >> v1:172.21.15.99:6789/0 conn(0x7f625406e580 legacy=0x7f6254160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.951+0000 7f624aa00640 1 -- 172.21.15.99:0/3312144386 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6254072ac0 con 0x7f62540724d0 2024-09-10T07:45:51.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.952+0000 7f624aa00640 1 --2- 172.21.15.99:0/3312144386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62540724d0 0x7f625406e040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f623c0097a0 tx=0x7f623c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=143cc532727a2e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:51.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.952+0000 7f6252a00640 1 -- 172.21.15.99:0/3312144386 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c037070 con 0x7f62540724d0 2024-09-10T07:45:51.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.952+0000 7f6252a00640 1 -- 172.21.15.99:0/3312144386 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f623c032440 con 0x7f62540724d0 2024-09-10T07:45:51.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.952+0000 7f6252a00640 1 -- 172.21.15.99:0/3312144386 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c0327f0 con 0x7f62540724d0 2024-09-10T07:45:51.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.952+0000 7f625a800640 1 -- 172.21.15.99:0/3312144386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62540724d0 msgr2=0x7f625406e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.952+0000 7f625a800640 1 --2- 172.21.15.99:0/3312144386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62540724d0 0x7f625406e040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f623c0097a0 tx=0x7f623c02a180 comp rx=0 tx=0).stop 2024-09-10T07:45:51.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.953+0000 7f625a800640 1 -- 172.21.15.99:0/3312144386 shutdown_connections 2024-09-10T07:45:51.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.953+0000 7f625a800640 1 --2- 172.21.15.99:0/3312144386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62540724d0 0x7f625406e040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.953+0000 7f625a800640 1 --2- 172.21.15.99:0/3312144386 >> v2:172.21.15.187:3300/0 conn(0x7f625415db60 0x7f6254071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.953+0000 7f625a800640 1 -- 172.21.15.99:0/3312144386 >> 172.21.15.99:0/3312144386 conn(0x7f62540b2630 msgr2=0x7f62540b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:51.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.953+0000 7f625a800640 1 -- 172.21.15.99:0/3312144386 shutdown_connections 2024-09-10T07:45:51.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.953+0000 7f625a800640 1 -- 172.21.15.99:0/3312144386 wait complete. 2024-09-10T07:45:51.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.954+0000 7f625a800640 1 Processor -- start 2024-09-10T07:45:51.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.954+0000 7f625a800640 1 -- start start 2024-09-10T07:45:51.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.955+0000 7f625a800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f625406e580 0x7f625414c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.955+0000 7f625a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62540724d0 0x7f625415c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.955+0000 7f625a800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f625415db60 0x7f62540b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.955+0000 7f625a800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6254073360 con 0x7f62540724d0 2024-09-10T07:45:51.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.955+0000 7f625a800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6254073080 con 0x7f625415db60 2024-09-10T07:45:51.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.955+0000 7f625a800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f6254073640 con 0x7f625406e580 2024-09-10T07:45:51.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f6253400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f625406e580 0x7f625414c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f6253e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f625415db60 0x7f62540b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f6253400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f625406e580 0x7f625414c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:53830/0 (socket says 172.21.15.99:53830) 2024-09-10T07:45:51.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f6253400640 1 -- 172.21.15.99:0/1349354078 learned_addr learned my addr 172.21.15.99:0/1349354078 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:51.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f624aa00640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62540724d0 0x7f625415c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f624aa00640 1 -- 172.21.15.99:0/1349354078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f625406e580 msgr2=0x7f625414c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f624aa00640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f625406e580 0x7f625414c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f624aa00640 1 -- 172.21.15.99:0/1349354078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f625415db60 msgr2=0x7f62540b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:51.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f624aa00640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f625415db60 0x7f62540b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:51.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f624aa00640 1 -- 172.21.15.99:0/1349354078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62540b3ad0 con 0x7f62540724d0 2024-09-10T07:45:51.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f6253400640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f625406e580 0x7f625414c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:51.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.956+0000 7f6253e00640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f625415db60 0x7f62540b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:51.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.957+0000 7f624aa00640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62540724d0 0x7f625415c150 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f623c031000 tx=0x7f623c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:51.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.958+0000 7f624be00640 1 -- 172.21.15.99:0/1349354078 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c037040 con 0x7f62540724d0 2024-09-10T07:45:51.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.958+0000 7f624be00640 1 -- 172.21.15.99:0/1349354078 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f623c004230 con 0x7f62540724d0 2024-09-10T07:45:51.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.958+0000 7f624be00640 1 -- 172.21.15.99:0/1349354078 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c006e10 con 0x7f62540724d0 2024-09-10T07:45:51.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.958+0000 7f625a800640 1 -- 172.21.15.99:0/1349354078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62540b5040 con 0x7f62540724d0 2024-09-10T07:45:51.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.958+0000 7f625a800640 1 -- 172.21.15.99:0/1349354078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62540b4020 con 0x7f62540724d0 2024-09-10T07:45:51.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.959+0000 7f625a800640 1 -- 172.21.15.99:0/1349354078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625415d250 con 0x7f62540724d0 2024-09-10T07:45:51.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.960+0000 7f624be00640 1 -- 172.21.15.99:0/1349354078 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f623c03a070 con 0x7f62540724d0 2024-09-10T07:45:51.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.961+0000 7f624be00640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f623006be60 0x7f623006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:51.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.962+0000 7f624be00640 1 -- 172.21.15.99:0/1349354078 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7f623c0ab140 con 0x7f62540724d0 2024-09-10T07:45:51.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.962+0000 7f6253400640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f623006be60 0x7f623006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:51.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.962+0000 7f6253400640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f623006be60 0x7f623006e320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6244009f50 tx=0x7f6244009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:51.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:51.966+0000 7f624be00640 1 -- 172.21.15.99:0/1349354078 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f623c041030 con 0x7f62540724d0 2024-09-10T07:45:52.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.150+0000 7f625a800640 1 -- 172.21.15.99:0/1349354078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f62541605a0 con 0x7f62540724d0 2024-09-10T07:45:52.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.150+0000 7f624be00640 1 -- 172.21.15.99:0/1349354078 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v191) ==== 80+0+0 (secure 0 0 0) 0x7f623c079490 con 0x7f62540724d0 2024-09-10T07:45:52.149 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-09-10T07:45:52.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 -- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f623006be60 msgr2=0x7f623006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f623006be60 0x7f623006e320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6244009f50 tx=0x7f6244009190 comp rx=0 tx=0).stop 2024-09-10T07:45:52.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 -- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62540724d0 msgr2=0x7f625415c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62540724d0 0x7f625415c150 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f623c031000 tx=0x7f623c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 -- 172.21.15.99:0/1349354078 shutdown_connections 2024-09-10T07:45:52.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f625415db60 0x7f62540b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f623006be60 0x7f623006e320 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62540724d0 0x7f625415c150 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 --2- 172.21.15.99:0/1349354078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f625406e580 0x7f625414c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 -- 172.21.15.99:0/1349354078 >> 172.21.15.99:0/1349354078 conn(0x7f62540b2630 msgr2=0x7f625415e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:52.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 -- 172.21.15.99:0/1349354078 shutdown_connections 2024-09-10T07:45:52.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.152+0000 7f625a800640 1 -- 172.21.15.99:0/1349354078 wait complete. 2024-09-10T07:45:52.168 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T07:45:52.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:52.168 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T07:45:52.229 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:45:52.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:52.230 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T07:45:52.266 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:45:52.267 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:52.267 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:52.303 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:45:52.304 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T07:45:52.304 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:45:52.304 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:52.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:45:52.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:52.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.497+0000 7fbe0e200640 1 Processor -- start 2024-09-10T07:45:52.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.497+0000 7fbe0e200640 1 -- start start 2024-09-10T07:45:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.498+0000 7fbe0e200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbe080d2680 0x7fbe080cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.498+0000 7fbe0e200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080cfac0 0x7fbe080c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.498+0000 7fbe0e200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe080d2bd0 con 0x7fbe0815e970 2024-09-10T07:45:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.498+0000 7fbe0e200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbe080d37e0 con 0x7fbe080d2680 2024-09-10T07:45:52.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.498+0000 7fbe0e200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbe080d2eb0 con 0x7fbe080cfac0 2024-09-10T07:45:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.499+0000 7fbdffe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbe080d2680 0x7fbe080cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.499+0000 7fbe0ce00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbe0815e970 0x7fbe080d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50790/0 (socket says 172.21.15.99:50790) 2024-09-10T07:45:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.499+0000 7fbe0ce00640 1 -- 172.21.15.99:0/1164339447 learned_addr learned my addr 172.21.15.99:0/1164339447 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.499+0000 7fbe0d800640 1 --2- 172.21.15.99:0/1164339447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080cfac0 0x7fbe080c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.499+0000 7fbdffe00640 1 -- 172.21.15.99:0/1164339447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080cfac0 msgr2=0x7fbe080c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.499+0000 7fbdffe00640 1 --2- 172.21.15.99:0/1164339447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080cfac0 0x7fbe080c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.499+0000 7fbdffe00640 1 -- 172.21.15.99:0/1164339447 >> v1:172.21.15.99:6789/0 conn(0x7fbe0815e970 legacy=0x7fbe080d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.499+0000 7fbdffe00640 1 -- 172.21.15.99:0/1164339447 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe080d3190 con 0x7fbe080d2680 2024-09-10T07:45:52.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.499+0000 7fbe07e00640 1 -- 172.21.15.99:0/1164339447 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 45741183 0 0) 0x7fbe080d2bd0 con 0x7fbe0815e970 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.500+0000 7fbdffe00640 1 --2- 172.21.15.99:0/1164339447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe080d2680 0x7fbe080cf580 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00097a0 tx=0x7fbdf002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90d676f79d15373 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.500+0000 7fbe07e00640 1 -- 172.21.15.99:0/1164339447 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0037070 con 0x7fbe080d2680 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.500+0000 7fbe07e00640 1 -- 172.21.15.99:0/1164339447 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf0032440 con 0x7fbe080d2680 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.500+0000 7fbe07e00640 1 -- 172.21.15.99:0/1164339447 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0032810 con 0x7fbe080d2680 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.501+0000 7fbe0e200640 1 -- 172.21.15.99:0/1164339447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe080d2680 msgr2=0x7fbe080cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.501+0000 7fbe0e200640 1 --2- 172.21.15.99:0/1164339447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe080d2680 0x7fbe080cf580 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00097a0 tx=0x7fbdf002a210 comp rx=0 tx=0).stop 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.501+0000 7fbe0e200640 1 -- 172.21.15.99:0/1164339447 shutdown_connections 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.501+0000 7fbe0e200640 1 --2- 172.21.15.99:0/1164339447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080cfac0 0x7fbe080c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.501+0000 7fbe0e200640 1 --2- 172.21.15.99:0/1164339447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe080d2680 0x7fbe080cf580 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.501+0000 7fbe0e200640 1 -- 172.21.15.99:0/1164339447 >> 172.21.15.99:0/1164339447 conn(0x7fbe0809de00 msgr2=0x7fbe080d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:52.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.501+0000 7fbe0e200640 1 -- 172.21.15.99:0/1164339447 shutdown_connections 2024-09-10T07:45:52.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.501+0000 7fbe0e200640 1 -- 172.21.15.99:0/1164339447 wait complete. 2024-09-10T07:45:52.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.503+0000 7fbe0e200640 1 Processor -- start 2024-09-10T07:45:52.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.503+0000 7fbe0e200640 1 -- start start 2024-09-10T07:45:52.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0e200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe080cfac0 0x7fbe081f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0e200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080d2680 0x7fbe080ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0815e970 0x7fbe08157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0815ed50 con 0x7fbe0815e970 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0e200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbe080cff50 con 0x7fbe080cfac0 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0e200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0815eed0 con 0x7fbe080d2680 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0815e970 0x7fbe08157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbdffe00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080d2680 0x7fbe080ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0815e970 0x7fbe08157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46992/0 (socket says 172.21.15.99:46992) 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0d800640 1 -- 172.21.15.99:0/2425500104 learned_addr learned my addr 172.21.15.99:0/2425500104 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0ce00640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe080cfac0 0x7fbe081f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbdffe00640 1 -- 172.21.15.99:0/2425500104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe080cfac0 msgr2=0x7fbe081f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbdffe00640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe080cfac0 0x7fbe081f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbdffe00640 1 -- 172.21.15.99:0/2425500104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0815e970 msgr2=0x7fbe08157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbdffe00640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0815e970 0x7fbe08157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbdffe00640 1 -- 172.21.15.99:0/2425500104 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe080cd1c0 con 0x7fbe080d2680 2024-09-10T07:45:52.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.504+0000 7fbe0d800640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0815e970 0x7fbe08157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:45:52.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.505+0000 7fbdffe00640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080d2680 0x7fbe080ce660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0031000 tx=0x7fbdf00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:52.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.505+0000 7fbe05600640 1 -- 172.21.15.99:0/2425500104 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0037050 con 0x7fbe080d2680 2024-09-10T07:45:52.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.505+0000 7fbe05600640 1 -- 172.21.15.99:0/2425500104 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf0038040 con 0x7fbe080d2680 2024-09-10T07:45:52.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.505+0000 7fbe05600640 1 -- 172.21.15.99:0/2425500104 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0004450 con 0x7fbe080d2680 2024-09-10T07:45:52.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.505+0000 7fbe0e200640 1 -- 172.21.15.99:0/2425500104 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe080cc400 con 0x7fbe080d2680 2024-09-10T07:45:52.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.505+0000 7fbe0e200640 1 -- 172.21.15.99:0/2425500104 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe080cc9c0 con 0x7fbe080d2680 2024-09-10T07:45:52.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.506+0000 7fbe0e200640 1 -- 172.21.15.99:0/2425500104 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe080cf580 con 0x7fbe080d2680 2024-09-10T07:45:52.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.507+0000 7fbe05600640 1 -- 172.21.15.99:0/2425500104 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdf003c6d0 con 0x7fbe080d2680 2024-09-10T07:45:52.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.508+0000 7fbe05600640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbde406be30 0x7fbde406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.508+0000 7fbe05600640 1 -- 172.21.15.99:0/2425500104 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7fbdf00ab670 con 0x7fbe080d2680 2024-09-10T07:45:52.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.508+0000 7fbe0ce00640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbde406be30 0x7fbde406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.509+0000 7fbe0ce00640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbde406be30 0x7fbde406e2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8007fd0 tx=0x7fbdf8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:52.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.513+0000 7fbe05600640 1 -- 172.21.15.99:0/2425500104 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbdf00799c0 con 0x7fbe080d2680 2024-09-10T07:45:52.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.720+0000 7fbe0e200640 1 -- 172.21.15.99:0/2425500104 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe080d0d00 con 0x7fbe080d2680 2024-09-10T07:45:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.720+0000 7fbe05600640 1 -- 172.21.15.99:0/2425500104 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7fbdf007dcc0 con 0x7fbe080d2680 2024-09-10T07:45:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:52.719 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":90,"btime":"2024-09-10T07:45:17:511094+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4239870292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4239870292},{"type":"v1","addr":"172.21.15.99:6836","nonce":4239870292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2428750075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2428750075},{"type":"v1","addr":"172.21.15.187:6835","nonce":2428750075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1219809784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1219809784},{"type":"v1","addr":"172.21.15.187:6834","nonce":1219809784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:45:13.894905+0000","modified":"2024-09-10T07:45:16.912907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7276":{"gid":7276,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/256766417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":256766417},{"type":"v1","addr":"172.21.15.99:6837","nonce":256766417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7276,"qdb_cluster":[7276]},"id":11}]} 2024-09-10T07:45:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 90 2024-09-10T07:45:52.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 -- 172.21.15.99:0/2425500104 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbde406be30 msgr2=0x7fbde406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbde406be30 0x7fbde406e2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8007fd0 tx=0x7fbdf8007de0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 -- 172.21.15.99:0/2425500104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080d2680 msgr2=0x7fbe080ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080d2680 0x7fbe080ce660 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0031000 tx=0x7fbdf00046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 -- 172.21.15.99:0/2425500104 shutdown_connections 2024-09-10T07:45:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbde406be30 0x7fbde406e2f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0815e970 0x7fbe08157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe080d2680 0x7fbe080ce660 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 --2- 172.21.15.99:0/2425500104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe080cfac0 0x7fbe081f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 -- 172.21.15.99:0/2425500104 >> 172.21.15.99:0/2425500104 conn(0x7fbe0809de00 msgr2=0x7fbe080c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 -- 172.21.15.99:0/2425500104 shutdown_connections 2024-09-10T07:45:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.723+0000 7fbe0e200640 1 -- 172.21.15.99:0/2425500104 wait complete. 2024-09-10T07:45:52.738 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:52.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.892+0000 7fbb59400640 1 Processor -- start 2024-09-10T07:45:52.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.892+0000 7fbb59400640 1 -- start start 2024-09-10T07:45:52.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.893+0000 7fbb59400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbb5415eab0 0x7fbb540b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.893+0000 7fbb59400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbb54070b40 0x7fbb5406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.893+0000 7fbb59400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb540d3710 con 0x7fbb5406d260 2024-09-10T07:45:52.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.893+0000 7fbb59400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fbb540b6390 con 0x7fbb54070b40 2024-09-10T07:45:52.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.893+0000 7fbb59400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fbb540b6670 con 0x7fbb5415eab0 2024-09-10T07:45:52.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.893+0000 7fbb58a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbb5406d260 0x7fbb540b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50806/0 (socket says 172.21.15.99:50806) 2024-09-10T07:45:52.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.893+0000 7fbb58a00640 1 -- 172.21.15.99:0/831057524 learned_addr learned my addr 172.21.15.99:0/831057524 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:52.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.893+0000 7fbb4b400640 1 --2- 172.21.15.99:0/831057524 >> v2:172.21.15.99:3300/0 conn(0x7fbb54070b40 0x7fbb5406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.894+0000 7fbb53e00640 1 --2- 172.21.15.99:0/831057524 >> v2:172.21.15.187:3300/0 conn(0x7fbb5415eab0 0x7fbb540b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.894+0000 7fbb4b400640 1 -- 172.21.15.99:0/831057524 >> v2:172.21.15.187:3300/0 conn(0x7fbb5415eab0 msgr2=0x7fbb540b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:52.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.894+0000 7fbb4b400640 1 --2- 172.21.15.99:0/831057524 >> v2:172.21.15.187:3300/0 conn(0x7fbb5415eab0 0x7fbb540b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.894+0000 7fbb4b400640 1 -- 172.21.15.99:0/831057524 >> v1:172.21.15.99:6789/0 conn(0x7fbb5406d260 legacy=0x7fbb540b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.894+0000 7fbb4b400640 1 -- 172.21.15.99:0/831057524 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb540b6950 con 0x7fbb54070b40 2024-09-10T07:45:52.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.894+0000 7fbb53400640 1 -- 172.21.15.99:0/831057524 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2398574033 0 0) 0x7fbb540d3710 con 0x7fbb5406d260 2024-09-10T07:45:52.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.894+0000 7fbb53e00640 1 --2- 172.21.15.99:0/831057524 >> v2:172.21.15.187:3300/0 conn(0x7fbb5415eab0 0x7fbb540b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:52.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.895+0000 7fbb4b400640 1 --2- 172.21.15.99:0/831057524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb54070b40 0x7fbb5406cd20 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fbb540b8900 tx=0x7fbb3c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5559303b4ffb50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:52.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.895+0000 7fbb53400640 1 -- 172.21.15.99:0/831057524 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c037070 con 0x7fbb54070b40 2024-09-10T07:45:52.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.895+0000 7fbb53400640 1 -- 172.21.15.99:0/831057524 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3c02add0 con 0x7fbb54070b40 2024-09-10T07:45:52.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.895+0000 7fbb53400640 1 -- 172.21.15.99:0/831057524 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c032660 con 0x7fbb54070b40 2024-09-10T07:45:52.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.896+0000 7fbb59400640 1 -- 172.21.15.99:0/831057524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb54070b40 msgr2=0x7fbb5406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.896+0000 7fbb59400640 1 --2- 172.21.15.99:0/831057524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb54070b40 0x7fbb5406cd20 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fbb540b8900 tx=0x7fbb3c02a080 comp rx=0 tx=0).stop 2024-09-10T07:45:52.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.896+0000 7fbb59400640 1 -- 172.21.15.99:0/831057524 shutdown_connections 2024-09-10T07:45:52.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.896+0000 7fbb59400640 1 --2- 172.21.15.99:0/831057524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb54070b40 0x7fbb5406cd20 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.896+0000 7fbb59400640 1 --2- 172.21.15.99:0/831057524 >> v2:172.21.15.187:3300/0 conn(0x7fbb5415eab0 0x7fbb540b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.896+0000 7fbb59400640 1 -- 172.21.15.99:0/831057524 >> 172.21.15.99:0/831057524 conn(0x7fbb540b7cc0 msgr2=0x7fbb540b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:52.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.896+0000 7fbb59400640 1 -- 172.21.15.99:0/831057524 shutdown_connections 2024-09-10T07:45:52.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.896+0000 7fbb59400640 1 -- 172.21.15.99:0/831057524 wait complete. 2024-09-10T07:45:52.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.898+0000 7fbb59400640 1 Processor -- start 2024-09-10T07:45:52.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.898+0000 7fbb59400640 1 -- start start 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb59400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5406d260 0x7fbb5414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb59400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb54070b40 0x7fbb54159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb59400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb5415eab0 0x7fbb5409cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb59400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5415ee90 con 0x7fbb5406d260 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb59400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbb540b7860 con 0x7fbb54070b40 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb59400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5414c070 con 0x7fbb5415eab0 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb53e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5406d260 0x7fbb5414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb53e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5406d260 0x7fbb5414b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47014/0 (socket says 172.21.15.99:47014) 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb53e00640 1 -- 172.21.15.99:0/3020650393 learned_addr learned my addr 172.21.15.99:0/3020650393 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb4b400640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb54070b40 0x7fbb54159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb58a00640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb5415eab0 0x7fbb5409cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb53e00640 1 -- 172.21.15.99:0/3020650393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb5415eab0 msgr2=0x7fbb5409cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb53e00640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb5415eab0 0x7fbb5409cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb53e00640 1 -- 172.21.15.99:0/3020650393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb54070b40 msgr2=0x7fbb54159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:52.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb53e00640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb54070b40 0x7fbb54159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:52.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.899+0000 7fbb53e00640 1 -- 172.21.15.99:0/3020650393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5414c350 con 0x7fbb5406d260 2024-09-10T07:45:52.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.900+0000 7fbb53e00640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5406d260 0x7fbb5414b3c0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400d7d0 tx=0x7fbb4400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:52.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.900+0000 7fbb50c00640 1 -- 172.21.15.99:0/3020650393 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44004030 con 0x7fbb5406d260 2024-09-10T07:45:52.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.900+0000 7fbb50c00640 1 -- 172.21.15.99:0/3020650393 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb440041d0 con 0x7fbb5406d260 2024-09-10T07:45:52.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.900+0000 7fbb59400640 1 -- 172.21.15.99:0/3020650393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5414c630 con 0x7fbb5406d260 2024-09-10T07:45:52.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.900+0000 7fbb50c00640 1 -- 172.21.15.99:0/3020650393 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44009640 con 0x7fbb5406d260 2024-09-10T07:45:52.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.900+0000 7fbb59400640 1 -- 172.21.15.99:0/3020650393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5414cbf0 con 0x7fbb5406d260 2024-09-10T07:45:52.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.901+0000 7fbb59400640 1 -- 172.21.15.99:0/3020650393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb540d3230 con 0x7fbb5406d260 2024-09-10T07:45:52.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.902+0000 7fbb50c00640 1 -- 172.21.15.99:0/3020650393 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb440097e0 con 0x7fbb5406d260 2024-09-10T07:45:52.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.903+0000 7fbb50c00640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbb3006be60 0x7fbb3006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:52.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.903+0000 7fbb50c00640 1 -- 172.21.15.99:0/3020650393 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7fbb4408af80 con 0x7fbb5406d260 2024-09-10T07:45:52.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.903+0000 7fbb4b400640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbb3006be60 0x7fbb3006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:52.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.904+0000 7fbb4b400640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbb3006be60 0x7fbb3006e320 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c034000 tx=0x7fbb3c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:52.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:52.907+0000 7fbb50c00640 1 -- 172.21.15.99:0/3020650393 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb440592e0 con 0x7fbb5406d260 2024-09-10T07:45:53.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.116+0000 7fbb59400640 1 -- 172.21.15.99:0/3020650393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb5415e2d0 con 0x7fbb5406d260 2024-09-10T07:45:53.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.116+0000 7fbb50c00640 1 -- 172.21.15.99:0/3020650393 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7fbb4405d5e0 con 0x7fbb5406d260 2024-09-10T07:45:53.115 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:53.115 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":90,"btime":"2024-09-10T07:45:17:511094+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4239870292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4239870292},{"type":"v1","addr":"172.21.15.99:6836","nonce":4239870292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2428750075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2428750075},{"type":"v1","addr":"172.21.15.187:6835","nonce":2428750075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1219809784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1219809784},{"type":"v1","addr":"172.21.15.187:6834","nonce":1219809784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:45:13.894905+0000","modified":"2024-09-10T07:45:16.912907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7276":{"gid":7276,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/256766417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":256766417},{"type":"v1","addr":"172.21.15.99:6837","nonce":256766417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7276,"qdb_cluster":[7276]},"id":11}]} 2024-09-10T07:45:53.115 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 90 2024-09-10T07:45:53.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.118+0000 7fbb59400640 1 -- 172.21.15.99:0/3020650393 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbb3006be60 msgr2=0x7fbb3006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.118+0000 7fbb59400640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbb3006be60 0x7fbb3006e320 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c034000 tx=0x7fbb3c02e000 comp rx=0 tx=0).stop 2024-09-10T07:45:53.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.118+0000 7fbb59400640 1 -- 172.21.15.99:0/3020650393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5406d260 msgr2=0x7fbb5414b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.118+0000 7fbb59400640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5406d260 0x7fbb5414b3c0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400d7d0 tx=0x7fbb4400dc90 comp rx=0 tx=0).stop 2024-09-10T07:45:53.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.118+0000 7fbb59400640 1 -- 172.21.15.99:0/3020650393 shutdown_connections 2024-09-10T07:45:53.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.118+0000 7fbb59400640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb5415eab0 0x7fbb5409cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.118+0000 7fbb59400640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb54070b40 0x7fbb54159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.118+0000 7fbb59400640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fbb3006be60 0x7fbb3006e320 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.118+0000 7fbb59400640 1 --2- 172.21.15.99:0/3020650393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5406d260 0x7fbb5414b3c0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.119+0000 7fbb59400640 1 -- 172.21.15.99:0/3020650393 >> 172.21.15.99:0/3020650393 conn(0x7fbb540b7cc0 msgr2=0x7fbb5406fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:53.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.119+0000 7fbb59400640 1 -- 172.21.15.99:0/3020650393 shutdown_connections 2024-09-10T07:45:53.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.119+0000 7fbb59400640 1 -- 172.21.15.99:0/3020650393 wait complete. 2024-09-10T07:45:53.133 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:45:53.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.286+0000 7f8887400640 1 Processor -- start 2024-09-10T07:45:53.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.286+0000 7f8887400640 1 -- start start 2024-09-10T07:45:53.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8887400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8880145290 0x7f888006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8887400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88800ce780 0x7f8880072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8887400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8880071510 0x7f8880072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8887400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f888006efe0 con 0x7f8880145290 2024-09-10T07:45:53.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8887400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f888006e3d0 con 0x7f88800ce780 2024-09-10T07:45:53.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8887400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f888006e6b0 con 0x7f8880071510 2024-09-10T07:45:53.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8884a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8880145290 0x7f888006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8884a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8880145290 0x7f888006f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47030/0 (socket says 172.21.15.99:47030) 2024-09-10T07:45:53.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8884a00640 1 -- 172.21.15.99:0/2534224811 learned_addr learned my addr 172.21.15.99:0/2534224811 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:53.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f887fe00640 1 --2- 172.21.15.99:0/2534224811 >> v2:172.21.15.187:3300/0 conn(0x7f88800ce780 0x7f8880072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8885400640 1 --2- 172.21.15.99:0/2534224811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8880071510 0x7f8880072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8884a00640 1 -- 172.21.15.99:0/2534224811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8880071510 msgr2=0x7f8880072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:53.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8884a00640 1 --2- 172.21.15.99:0/2534224811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8880071510 0x7f8880072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8884a00640 1 -- 172.21.15.99:0/2534224811 >> v2:172.21.15.187:3300/0 conn(0x7f88800ce780 msgr2=0x7f8880072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:53.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8884a00640 1 --2- 172.21.15.99:0/2534224811 >> v2:172.21.15.187:3300/0 conn(0x7f88800ce780 0x7f8880072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f8884a00640 1 -- 172.21.15.99:0/2534224811 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888006e990 con 0x7f8880145290 2024-09-10T07:45:53.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.288+0000 7f887fe00640 1 --2- 172.21.15.99:0/2534224811 >> v2:172.21.15.187:3300/0 conn(0x7f88800ce780 0x7f8880072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:53.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.289+0000 7f8884a00640 1 --2- 172.21.15.99:0/2534224811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880145290 0x7f888006f470 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f888006d450 tx=0x7f887402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4a79c43dd8dc27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:53.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f887f400640 1 -- 172.21.15.99:0/2534224811 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874032790 con 0x7f8880145290 2024-09-10T07:45:53.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f887f400640 1 -- 172.21.15.99:0/2534224811 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8874038070 con 0x7f8880145290 2024-09-10T07:45:53.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f887f400640 1 -- 172.21.15.99:0/2534224811 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874032b50 con 0x7f8880145290 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f8887400640 1 -- 172.21.15.99:0/2534224811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880145290 msgr2=0x7f888006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f8887400640 1 --2- 172.21.15.99:0/2534224811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880145290 0x7f888006f470 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f888006d450 tx=0x7f887402c890 comp rx=0 tx=0).stop 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f8887400640 1 -- 172.21.15.99:0/2534224811 shutdown_connections 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f8887400640 1 --2- 172.21.15.99:0/2534224811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8880071510 0x7f8880072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f8887400640 1 --2- 172.21.15.99:0/2534224811 >> v2:172.21.15.187:3300/0 conn(0x7f88800ce780 0x7f8880072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f8887400640 1 --2- 172.21.15.99:0/2534224811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880145290 0x7f888006f470 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f8887400640 1 -- 172.21.15.99:0/2534224811 >> 172.21.15.99:0/2534224811 conn(0x7f888006bc10 msgr2=0x7f888006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f8887400640 1 -- 172.21.15.99:0/2534224811 shutdown_connections 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.290+0000 7f8887400640 1 -- 172.21.15.99:0/2534224811 wait complete. 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.292+0000 7f8887400640 1 Processor -- start 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.292+0000 7f8887400640 1 -- start start 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f8887400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880071510 0x7f888015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f8887400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88800ce780 0x7f88801f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f8887400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8880145290 0x7f88801f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f8887400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f888006df80 con 0x7f8880071510 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f8887400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8880145670 con 0x7f8880145290 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f8887400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f888006e100 con 0x7f88800ce780 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f8884a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880071510 0x7f888015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f8884a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880071510 0x7f888015b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47040/0 (socket says 172.21.15.99:47040) 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f8884a00640 1 -- 172.21.15.99:0/2736428813 learned_addr learned my addr 172.21.15.99:0/2736428813 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f8885400640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8880145290 0x7f88801f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.293+0000 7f887fe00640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88800ce780 0x7f88801f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f8884a00640 1 -- 172.21.15.99:0/2736428813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88800ce780 msgr2=0x7f88801f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f8884a00640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88800ce780 0x7f88801f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f8884a00640 1 -- 172.21.15.99:0/2736428813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8880145290 msgr2=0x7f88801f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f8884a00640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8880145290 0x7f88801f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f8884a00640 1 -- 172.21.15.99:0/2736428813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88801e7000 con 0x7f8880071510 2024-09-10T07:45:53.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f8884a00640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880071510 0x7f888015b450 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f887400b2c0 tx=0x7f8874004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:53.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f887cc00640 1 -- 172.21.15.99:0/2736428813 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874043070 con 0x7f8880071510 2024-09-10T07:45:53.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f887cc00640 1 -- 172.21.15.99:0/2736428813 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887403c620 con 0x7f8880071510 2024-09-10T07:45:53.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f887cc00640 1 -- 172.21.15.99:0/2736428813 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887403c9f0 con 0x7f8880071510 2024-09-10T07:45:53.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f8887400640 1 -- 172.21.15.99:0/2736428813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88801e72a0 con 0x7f8880071510 2024-09-10T07:45:53.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.294+0000 7f8887400640 1 -- 172.21.15.99:0/2736428813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88801e7860 con 0x7f8880071510 2024-09-10T07:45:53.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.296+0000 7f8887400640 1 -- 172.21.15.99:0/2736428813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f888006f470 con 0x7f8880071510 2024-09-10T07:45:53.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.296+0000 7f887cc00640 1 -- 172.21.15.99:0/2736428813 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8874046070 con 0x7f8880071510 2024-09-10T07:45:53.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.297+0000 7f887cc00640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f886006be30 0x7f886006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.298+0000 7f887cc00640 1 -- 172.21.15.99:0/2736428813 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7f88740ab460 con 0x7f8880071510 2024-09-10T07:45:53.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.298+0000 7f887fe00640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f886006be30 0x7f886006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.298+0000 7f887fe00640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f886006be30 0x7f886006e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f888013dbc0 tx=0x7f886c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:53.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.302+0000 7f887cc00640 1 -- 172.21.15.99:0/2736428813 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88740797b0 con 0x7f8880071510 2024-09-10T07:45:53.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.476+0000 7f8887400640 1 -- 172.21.15.99:0/2736428813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8880075620 con 0x7f8880071510 2024-09-10T07:45:53.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.477+0000 7f887cc00640 1 -- 172.21.15.99:0/2736428813 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+16715 (secure 0 0 0) 0x7f887407dab0 con 0x7f8880071510 2024-09-10T07:45:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:53.476 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":191,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:45:46.820422+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:45:11.664665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-10T07:45:12.889786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 -- 172.21.15.99:0/2736428813 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f886006be30 msgr2=0x7f886006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f886006be30 0x7f886006e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f888013dbc0 tx=0x7f886c008040 comp rx=0 tx=0).stop 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 -- 172.21.15.99:0/2736428813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880071510 msgr2=0x7f888015b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880071510 0x7f888015b450 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f887400b2c0 tx=0x7f8874004730 comp rx=0 tx=0).stop 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 -- 172.21.15.99:0/2736428813 shutdown_connections 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8880145290 0x7f88801f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88800ce780 0x7f88801f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f886006be30 0x7f886006e2f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 --2- 172.21.15.99:0/2736428813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8880071510 0x7f888015b450 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 -- 172.21.15.99:0/2736428813 >> 172.21.15.99:0/2736428813 conn(0x7f888006bc10 msgr2=0x7f8880072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:53.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 -- 172.21.15.99:0/2736428813 shutdown_connections 2024-09-10T07:45:53.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.479+0000 7f8887400640 1 -- 172.21.15.99:0/2736428813 wait complete. 2024-09-10T07:45:53.494 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:45:53.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:53.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.646+0000 7f03bfa00640 1 Processor -- start 2024-09-10T07:45:53.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.647+0000 7f03bfa00640 1 -- start start 2024-09-10T07:45:53.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.648+0000 7f03bfa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f03b815ede0 0x7f03b80afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.648+0000 7f03bfa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cf830 0x7f03b80b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.648+0000 7f03bfa00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b80b0200 con 0x7f03b80cfc70 2024-09-10T07:45:53.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.648+0000 7f03bfa00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f03b80aec20 con 0x7f03b815ede0 2024-09-10T07:45:53.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.648+0000 7f03bfa00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f03b80aef00 con 0x7f03b80cf830 2024-09-10T07:45:53.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.648+0000 7f03bda00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f03b80cfc70 0x7f03b8071960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50814/0 (socket says 172.21.15.99:50814) 2024-09-10T07:45:53.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.648+0000 7f03bd000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f03b815ede0 0x7f03b80afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.648+0000 7f03bda00640 1 -- 172.21.15.99:0/3380233194 learned_addr learned my addr 172.21.15.99:0/3380233194 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:53.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.648+0000 7f03afe00640 1 --2- 172.21.15.99:0/3380233194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cf830 0x7f03b80b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.649+0000 7f03b7e00640 1 -- 172.21.15.99:0/3380233194 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923527089 0 0) 0x7f03b80b0200 con 0x7f03b80cfc70 2024-09-10T07:45:53.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.649+0000 7f03b7e00640 1 -- 172.21.15.99:0/3380233194 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f039c003520 con 0x7f03b80cfc70 2024-09-10T07:45:53.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.649+0000 7f03bd000640 1 -- 172.21.15.99:0/3380233194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cf830 msgr2=0x7f03b80b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:53.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.649+0000 7f03bd000640 1 --2- 172.21.15.99:0/3380233194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cf830 0x7f03b80b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.649+0000 7f03bd000640 1 -- 172.21.15.99:0/3380233194 >> v1:172.21.15.99:6789/0 conn(0x7f03b80cfc70 legacy=0x7f03b8071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.649+0000 7f03bd000640 1 -- 172.21.15.99:0/3380233194 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b80af1e0 con 0x7f03b815ede0 2024-09-10T07:45:53.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.650+0000 7f03bd000640 1 --2- 172.21.15.99:0/3380233194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b815ede0 0x7f03b80afcc0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097a0 tx=0x7f03a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a5a675f213e9b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:53.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.650+0000 7f03b7e00640 1 -- 172.21.15.99:0/3380233194 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8037070 con 0x7f03b815ede0 2024-09-10T07:45:53.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.650+0000 7f03b7e00640 1 -- 172.21.15.99:0/3380233194 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a8032440 con 0x7f03b815ede0 2024-09-10T07:45:53.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.650+0000 7f03b7e00640 1 -- 172.21.15.99:0/3380233194 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8032810 con 0x7f03b815ede0 2024-09-10T07:45:53.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.650+0000 7f03bfa00640 1 -- 172.21.15.99:0/3380233194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b815ede0 msgr2=0x7f03b80afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.650+0000 7f03bfa00640 1 --2- 172.21.15.99:0/3380233194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b815ede0 0x7f03b80afcc0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097a0 tx=0x7f03a802a180 comp rx=0 tx=0).stop 2024-09-10T07:45:53.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.650+0000 7f03bfa00640 1 -- 172.21.15.99:0/3380233194 shutdown_connections 2024-09-10T07:45:53.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.650+0000 7f03bfa00640 1 --2- 172.21.15.99:0/3380233194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cf830 0x7f03b80b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.650+0000 7f03bfa00640 1 --2- 172.21.15.99:0/3380233194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b815ede0 0x7f03b80afcc0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.650+0000 7f03bfa00640 1 -- 172.21.15.99:0/3380233194 >> 172.21.15.99:0/3380233194 conn(0x7f03b806bc10 msgr2=0x7f03b806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:53.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.651+0000 7f03bfa00640 1 -- 172.21.15.99:0/3380233194 shutdown_connections 2024-09-10T07:45:53.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.651+0000 7f03bfa00640 1 -- 172.21.15.99:0/3380233194 wait complete. 2024-09-10T07:45:53.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.652+0000 7f03bfa00640 1 Processor -- start 2024-09-10T07:45:53.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.652+0000 7f03bfa00640 1 -- start start 2024-09-10T07:45:53.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.653+0000 7f03bfa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b80cf830 0x7f03b81463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.653+0000 7f03bfa00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cfc70 0x7f03b81ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.653+0000 7f03bfa00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03b815ede0 0x7f03b81ea810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.653+0000 7f03bfa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f03b80ae840 con 0x7f03b80cf830 2024-09-10T07:45:53.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.653+0000 7f03bfa00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f03b80af7a0 con 0x7f03b815ede0 2024-09-10T07:45:53.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.653+0000 7f03bfa00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f03b80ae9c0 con 0x7f03b80cfc70 2024-09-10T07:45:53.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.653+0000 7f03bd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b80cf830 0x7f03b81463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.653+0000 7f03bd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b80cf830 0x7f03b81463e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47066/0 (socket says 172.21.15.99:47066) 2024-09-10T07:45:53.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.653+0000 7f03bd000640 1 -- 172.21.15.99:0/767680312 learned_addr learned my addr 172.21.15.99:0/767680312 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03bd000640 1 -- 172.21.15.99:0/767680312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cfc70 msgr2=0x7f03b81ea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03afe00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cfc70 0x7f03b81ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03bda00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03b815ede0 0x7f03b81ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03bd000640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cfc70 0x7f03b81ea2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03bd000640 1 -- 172.21.15.99:0/767680312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03b815ede0 msgr2=0x7f03b81ea810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03bd000640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03b815ede0 0x7f03b81ea810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03bd000640 1 -- 172.21.15.99:0/767680312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b8146d40 con 0x7f03b80cf830 2024-09-10T07:45:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03afe00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cfc70 0x7f03b81ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03bda00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03b815ede0 0x7f03b81ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:53.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03bd000640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b80cf830 0x7f03b81463e0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097a0 tx=0x7f03a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:53.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03b5600640 1 -- 172.21.15.99:0/767680312 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8041070 con 0x7f03b80cf830 2024-09-10T07:45:53.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03b5600640 1 -- 172.21.15.99:0/767680312 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a803c870 con 0x7f03b80cf830 2024-09-10T07:45:53.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03b5600640 1 -- 172.21.15.99:0/767680312 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8037040 con 0x7f03b80cf830 2024-09-10T07:45:53.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.654+0000 7f03bfa00640 1 -- 172.21.15.99:0/767680312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b8146fb0 con 0x7f03b80cf830 2024-09-10T07:45:53.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.655+0000 7f03bfa00640 1 -- 172.21.15.99:0/767680312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b8146920 con 0x7f03b80cf830 2024-09-10T07:45:53.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.656+0000 7f03bfa00640 1 -- 172.21.15.99:0/767680312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b80afcc0 con 0x7f03b80cf830 2024-09-10T07:45:53.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.656+0000 7f03b5600640 1 -- 172.21.15.99:0/767680312 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03a8044070 con 0x7f03b80cf830 2024-09-10T07:45:53.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.658+0000 7f03b5600640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f039406be30 0x7f039406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:53.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.658+0000 7f03b5600640 1 -- 172.21.15.99:0/767680312 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7f03a80ab9c0 con 0x7f03b80cf830 2024-09-10T07:45:53.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.658+0000 7f03afe00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f039406be30 0x7f039406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:53.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.659+0000 7f03afe00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f039406be30 0x7f039406e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f03b81e7890 tx=0x7f03a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:53.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.662+0000 7f03b5600640 1 -- 172.21.15.99:0/767680312 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03a807a480 con 0x7f03b80cf830 2024-09-10T07:45:53.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.873+0000 7f03bfa00640 1 -- 172.21.15.99:0/767680312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03b80ccd40 con 0x7f03b80cf830 2024-09-10T07:45:53.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.873+0000 7f03b5600640 1 -- 172.21.15.99:0/767680312 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7f03a8079d80 con 0x7f03b80cf830 2024-09-10T07:45:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:53.872 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":90,"btime":"2024-09-10T07:45:17:511094+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4239870292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4239870292},{"type":"v1","addr":"172.21.15.99:6836","nonce":4239870292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2428750075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2428750075},{"type":"v1","addr":"172.21.15.187:6835","nonce":2428750075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1219809784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1219809784},{"type":"v1","addr":"172.21.15.187:6834","nonce":1219809784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:45:13.894905+0000","modified":"2024-09-10T07:45:16.912907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7276":{"gid":7276,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/256766417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":256766417},{"type":"v1","addr":"172.21.15.99:6837","nonce":256766417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7276,"qdb_cluster":[7276]},"id":11}]} 2024-09-10T07:45:53.872 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 90 2024-09-10T07:45:53.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.875+0000 7f03bfa00640 1 -- 172.21.15.99:0/767680312 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f039406be30 msgr2=0x7f039406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.875+0000 7f03bfa00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f039406be30 0x7f039406e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f03b81e7890 tx=0x7f03a0008040 comp rx=0 tx=0).stop 2024-09-10T07:45:53.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.875+0000 7f03bfa00640 1 -- 172.21.15.99:0/767680312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b80cf830 msgr2=0x7f03b81463e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:53.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.875+0000 7f03bfa00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b80cf830 0x7f03b81463e0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097a0 tx=0x7f03a80046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.876+0000 7f03bfa00640 1 -- 172.21.15.99:0/767680312 shutdown_connections 2024-09-10T07:45:53.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.876+0000 7f03bfa00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03b815ede0 0x7f03b81ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.876+0000 7f03bfa00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03b80cfc70 0x7f03b81ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.876+0000 7f03bfa00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f039406be30 0x7f039406e2f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.876+0000 7f03bfa00640 1 --2- 172.21.15.99:0/767680312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b80cf830 0x7f03b81463e0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:53.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.876+0000 7f03bfa00640 1 -- 172.21.15.99:0/767680312 >> 172.21.15.99:0/767680312 conn(0x7f03b806bc10 msgr2=0x7f03b80b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:53.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.876+0000 7f03bfa00640 1 -- 172.21.15.99:0/767680312 shutdown_connections 2024-09-10T07:45:53.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:53.876+0000 7f03bfa00640 1 -- 172.21.15.99:0/767680312 wait complete. 2024-09-10T07:45:53.890 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:45:54.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.045+0000 7f287d600640 1 Processor -- start 2024-09-10T07:45:54.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.045+0000 7f287d600640 1 -- start start 2024-09-10T07:45:54.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f287d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f287813fae0 0x7f287806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f287d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 0x7f28780cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f287d600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2878142650 con 0x7f2878142150 2024-09-10T07:45:54.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f287d600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f28780ce780 con 0x7f287813fae0 2024-09-10T07:45:54.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f287d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2878142930 con 0x7f2878160c50 2024-09-10T07:45:54.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f286fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2878142150 0x7f2878160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50816/0 (socket says 172.21.15.99:50816) 2024-09-10T07:45:54.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f286fe00640 1 -- 172.21.15.99:0/4169586656 learned_addr learned my addr 172.21.15.99:0/4169586656 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:54.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f2876a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f287813fae0 0x7f287806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f2877400640 1 --2- 172.21.15.99:0/4169586656 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 0x7f28780cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f2876a00640 1 -- 172.21.15.99:0/4169586656 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 msgr2=0x7f28780cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:54.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f2876a00640 1 --2- 172.21.15.99:0/4169586656 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 0x7f28780cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f2876a00640 1 -- 172.21.15.99:0/4169586656 >> v1:172.21.15.99:6789/0 conn(0x7f2878142150 legacy=0x7f2878160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f2876000640 1 -- 172.21.15.99:0/4169586656 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 265330849 0 0) 0x7f2878142650 con 0x7f2878142150 2024-09-10T07:45:54.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f2876a00640 1 -- 172.21.15.99:0/4169586656 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2878142c10 con 0x7f287813fae0 2024-09-10T07:45:54.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.047+0000 7f2877400640 1 --2- 172.21.15.99:0/4169586656 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 0x7f28780cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:54.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.048+0000 7f2876a00640 1 --2- 172.21.15.99:0/4169586656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f287813fae0 0x7f287806f1b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f28680097a0 tx=0x7f286802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8462da46dac297 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:54.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f2876000640 1 -- 172.21.15.99:0/4169586656 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868037070 con 0x7f287813fae0 2024-09-10T07:45:54.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f2876000640 1 -- 172.21.15.99:0/4169586656 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f286802ae50 con 0x7f287813fae0 2024-09-10T07:45:54.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f2876000640 1 -- 172.21.15.99:0/4169586656 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868032660 con 0x7f287813fae0 2024-09-10T07:45:54.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f287d600640 1 -- 172.21.15.99:0/4169586656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f287813fae0 msgr2=0x7f287806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f287d600640 1 --2- 172.21.15.99:0/4169586656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f287813fae0 0x7f287806f1b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f28680097a0 tx=0x7f286802a100 comp rx=0 tx=0).stop 2024-09-10T07:45:54.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f287d600640 1 -- 172.21.15.99:0/4169586656 shutdown_connections 2024-09-10T07:45:54.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f287d600640 1 --2- 172.21.15.99:0/4169586656 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 0x7f28780cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f287d600640 1 --2- 172.21.15.99:0/4169586656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f287813fae0 0x7f287806f1b0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f287d600640 1 -- 172.21.15.99:0/4169586656 >> 172.21.15.99:0/4169586656 conn(0x7f287806bc10 msgr2=0x7f287806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:54.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f287d600640 1 -- 172.21.15.99:0/4169586656 shutdown_connections 2024-09-10T07:45:54.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.049+0000 7f287d600640 1 -- 172.21.15.99:0/4169586656 wait complete. 2024-09-10T07:45:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.051+0000 7f287d600640 1 Processor -- start 2024-09-10T07:45:54.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.051+0000 7f287d600640 1 -- start start 2024-09-10T07:45:54.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f287d600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f287813fae0 0x7f28781443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f287d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2878142150 0x7f2878141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f287d600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 0x7f2878072ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f287d600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f287806f870 con 0x7f2878142150 2024-09-10T07:45:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f287d600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f287806f6f0 con 0x7f287813fae0 2024-09-10T07:45:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f287d600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f28780cf150 con 0x7f2878160c50 2024-09-10T07:45:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f286fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2878142150 0x7f2878141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f286fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2878142150 0x7f2878141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47074/0 (socket says 172.21.15.99:47074) 2024-09-10T07:45:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f286fe00640 1 -- 172.21.15.99:0/629022328 learned_addr learned my addr 172.21.15.99:0/629022328 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f2876a00640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f287813fae0 0x7f28781443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.052+0000 7f2877400640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 0x7f2878072ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f286fe00640 1 -- 172.21.15.99:0/629022328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 msgr2=0x7f2878072ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f286fe00640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 0x7f2878072ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f286fe00640 1 -- 172.21.15.99:0/629022328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f287813fae0 msgr2=0x7f28781443c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f286fe00640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f287813fae0 0x7f28781443c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f286fe00640 1 -- 172.21.15.99:0/629022328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2878143340 con 0x7f2878142150 2024-09-10T07:45:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f286fe00640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2878142150 0x7f2878141180 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f286000c4d0 tx=0x7f286000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f286ea00640 1 -- 172.21.15.99:0/629022328 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860018070 con 0x7f2878142150 2024-09-10T07:45:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f286ea00640 1 -- 172.21.15.99:0/629022328 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2860007500 con 0x7f2878142150 2024-09-10T07:45:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f286ea00640 1 -- 172.21.15.99:0/629022328 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860004a20 con 0x7f2878142150 2024-09-10T07:45:54.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f287d600640 1 -- 172.21.15.99:0/629022328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2878143620 con 0x7f2878142150 2024-09-10T07:45:54.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.053+0000 7f287d600640 1 -- 172.21.15.99:0/629022328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2878143be0 con 0x7f2878142150 2024-09-10T07:45:54.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.054+0000 7f287d600640 1 -- 172.21.15.99:0/629022328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2878076190 con 0x7f2878142150 2024-09-10T07:45:54.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.055+0000 7f286ea00640 1 -- 172.21.15.99:0/629022328 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f286001b070 con 0x7f2878142150 2024-09-10T07:45:54.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.056+0000 7f286ea00640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f285406be30 0x7f285406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.056+0000 7f286ea00640 1 -- 172.21.15.99:0/629022328 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7f286008a140 con 0x7f2878142150 2024-09-10T07:45:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.056+0000 7f2876a00640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f285406be30 0x7f285406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.057+0000 7f2876a00640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f285406be30 0x7f285406e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2868034000 tx=0x7f286802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.060+0000 7f286ea00640 1 -- 172.21.15.99:0/629022328 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2878076190 con 0x7f2878142150 2024-09-10T07:45:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.268+0000 7f287d600640 1 -- 172.21.15.99:0/629022328 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f287806f1b0 con 0x7f2878142150 2024-09-10T07:45:54.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.269+0000 7f286ea00640 1 -- 172.21.15.99:0/629022328 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5230 (secure 0 0 0) 0x7f2860058490 con 0x7f2878142150 2024-09-10T07:45:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:54.267 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":90,"btime":"2024-09-10T07:45:17:511094+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4239870292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4239870292},{"type":"v1","addr":"172.21.15.99:6836","nonce":4239870292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2428750075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2428750075},{"type":"v1","addr":"172.21.15.187:6835","nonce":2428750075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1219809784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1219809784},{"type":"v1","addr":"172.21.15.187:6834","nonce":1219809784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T07:45:13.894905+0000","modified":"2024-09-10T07:45:16.912907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7276":{"gid":7276,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6837/256766417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":256766417},{"type":"v1","addr":"172.21.15.99:6837","nonce":256766417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7276,"qdb_cluster":[7276]},"id":11}]} 2024-09-10T07:45:54.268 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 90 2024-09-10T07:45:54.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 -- 172.21.15.99:0/629022328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f285406be30 msgr2=0x7f285406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f285406be30 0x7f285406e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2868034000 tx=0x7f286802e000 comp rx=0 tx=0).stop 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 -- 172.21.15.99:0/629022328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2878142150 msgr2=0x7f2878141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2878142150 0x7f2878141180 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f286000c4d0 tx=0x7f286000c990 comp rx=0 tx=0).stop 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 -- 172.21.15.99:0/629022328 shutdown_connections 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2878160c50 0x7f2878072ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f285406be30 0x7f285406e2f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2878142150 0x7f2878141180 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 --2- 172.21.15.99:0/629022328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f287813fae0 0x7f28781443c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 -- 172.21.15.99:0/629022328 >> 172.21.15.99:0/629022328 conn(0x7f287806bc10 msgr2=0x7f28780cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 -- 172.21.15.99:0/629022328 shutdown_connections 2024-09-10T07:45:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.271+0000 7f287d600640 1 -- 172.21.15.99:0/629022328 wait complete. 2024-09-10T07:45:54.285 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:45:54.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.440+0000 7f550a800640 1 Processor -- start 2024-09-10T07:45:54.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.440+0000 7f550a800640 1 -- start start 2024-09-10T07:45:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.441+0000 7f550a800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040c9710 0x7f55041695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.441+0000 7f550a800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55040d2bd0 con 0x7f55040d2680 2024-09-10T07:45:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.441+0000 7f550a800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55040d2eb0 con 0x7f550415e970 2024-09-10T07:45:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.441+0000 7f550a800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f55040d37e0 con 0x7f55040c9710 2024-09-10T07:45:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.441+0000 7f5508a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f55040d2680 0x7f55040cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50830/0 (socket says 172.21.15.99:50830) 2024-09-10T07:45:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.441+0000 7f5508a00640 1 -- 172.21.15.99:0/2359470345 learned_addr learned my addr 172.21.15.99:0/2359470345 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5509e00640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040c9710 0x7f55041695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1740243031 0 0) 0x7f55040d2bd0 con 0x7f55040d2680 2024-09-10T07:45:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54ec003520 con 0x7f55040d2680 2024-09-10T07:45:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 627733396 0 0) 0x7f54ec003520 con 0x7f55040d2680 2024-09-10T07:45:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040c9710 msgr2=0x7f55041695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040c9710 0x7f55041695e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 >> v1:172.21.15.187:6789/0 conn(0x7f550415e970 legacy=0x7f55040d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55040d3190 con 0x7f55040d2680 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f54f0001670 con 0x7f55040d2680 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 >> v1:172.21.15.99:6789/0 conn(0x7f55040d2680 legacy=0x7f55040cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040c9710 0x7f54ec0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ec003f20 0x7f54ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54ec004d40 0x7f54ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f55040d37e0 con 0x7f54ec003f20 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec00ba20 con 0x7f54ec004d40 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.442+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f54ec00bc20 con 0x7f55040c9710 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.443+0000 7f5508a00640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ec003f20 0x7f54ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.443+0000 7f5509400640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040c9710 0x7f54ec0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.443+0000 7f5509e00640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54ec004d40 0x7f54ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.443+0000 7f5508a00640 1 -- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040c9710 msgr2=0x7f54ec0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.443+0000 7f5508a00640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040c9710 0x7f54ec0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.443+0000 7f5508a00640 1 -- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54ec004d40 msgr2=0x7f54ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:54.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.443+0000 7f5508a00640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54ec004d40 0x7f54ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.443+0000 7f5508a00640 1 -- 172.21.15.99:0/2359470345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec003520 con 0x7f54ec003f20 2024-09-10T07:45:54.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.444+0000 7f5508a00640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ec003f20 0x7f54ec004800 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c240 tx=0x7f54ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d754d456a9f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:54.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.444+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f0007d10 con 0x7f54ec003f20 2024-09-10T07:45:54.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.444+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f0005ad0 con 0x7f54ec003f20 2024-09-10T07:45:54.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.444+0000 7f5503e00640 1 -- 172.21.15.99:0/2359470345 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f0007070 con 0x7f54ec003f20 2024-09-10T07:45:54.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.445+0000 7f550a800640 1 -- 172.21.15.99:0/2359470345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ec003f20 msgr2=0x7f54ec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.445+0000 7f550a800640 1 --2- 172.21.15.99:0/2359470345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ec003f20 0x7f54ec004800 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c240 tx=0x7f54ec005830 comp rx=0 tx=0).stop 2024-09-10T07:45:54.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.445+0000 7f5509e00640 1 -- 172.21.15.99:0/2359470345 reap_dead start 2024-09-10T07:45:54.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.445+0000 7f550a800640 1 -- 172.21.15.99:0/2359470345 shutdown_connections 2024-09-10T07:45:54.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.445+0000 7f550a800640 1 -- 172.21.15.99:0/2359470345 >> 172.21.15.99:0/2359470345 conn(0x7f550409de00 msgr2=0x7f55040d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:54.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.445+0000 7f550a800640 1 -- 172.21.15.99:0/2359470345 shutdown_connections 2024-09-10T07:45:54.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.445+0000 7f550a800640 1 -- 172.21.15.99:0/2359470345 wait complete. 2024-09-10T07:45:54.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.447+0000 7f550a800640 1 Processor -- start 2024-09-10T07:45:54.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.447+0000 7f550a800640 1 -- start start 2024-09-10T07:45:54.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f550a800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54ec003f20 0x7f550414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f550a800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040cbcd0 0x7f55040cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f550a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5504160c40 0x7f55041610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f550a800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f550415eed0 con 0x7f5504160c40 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f550a800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f550415ed50 con 0x7f54ec003f20 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f550a800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f55040cfc90 con 0x7f55040cbcd0 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f5509e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5504160c40 0x7f55041610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f5509e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5504160c40 0x7f55041610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47084/0 (socket says 172.21.15.99:47084) 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f5509e00640 1 -- 172.21.15.99:0/1475961183 learned_addr learned my addr 172.21.15.99:0/1475961183 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f5509e00640 1 -- 172.21.15.99:0/1475961183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040cbcd0 msgr2=0x7f55040cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f5509e00640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040cbcd0 0x7f55040cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f5509e00640 1 -- 172.21.15.99:0/1475961183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54ec003f20 msgr2=0x7f550414aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f5509e00640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54ec003f20 0x7f550414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.448+0000 7f5509e00640 1 -- 172.21.15.99:0/1475961183 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550414b3f0 con 0x7f5504160c40 2024-09-10T07:45:54.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.449+0000 7f5509e00640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5504160c40 0x7f55041610c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f55040c9ba0 tx=0x7f54fc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:54.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.449+0000 7f5501600640 1 -- 172.21.15.99:0/1475961183 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc019070 con 0x7f5504160c40 2024-09-10T07:45:54.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.449+0000 7f5501600640 1 -- 172.21.15.99:0/1475961183 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54fc011e90 con 0x7f5504160c40 2024-09-10T07:45:54.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.449+0000 7f550a800640 1 -- 172.21.15.99:0/1475961183 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550415fba0 con 0x7f5504160c40 2024-09-10T07:45:54.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.449+0000 7f5501600640 1 -- 172.21.15.99:0/1475961183 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc003bd0 con 0x7f5504160c40 2024-09-10T07:45:54.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.449+0000 7f550a800640 1 -- 172.21.15.99:0/1475961183 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5504160160 con 0x7f5504160c40 2024-09-10T07:45:54.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.450+0000 7f550a800640 1 -- 172.21.15.99:0/1475961183 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55040cf580 con 0x7f5504160c40 2024-09-10T07:45:54.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.451+0000 7f5501600640 1 -- 172.21.15.99:0/1475961183 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54fc01c070 con 0x7f5504160c40 2024-09-10T07:45:54.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.452+0000 7f5501600640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e406be30 0x7f54e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.452+0000 7f5501600640 1 -- 172.21.15.99:0/1475961183 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7f54fc08b8b0 con 0x7f5504160c40 2024-09-10T07:45:54.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.452+0000 7f5509400640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e406be30 0x7f54e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.453+0000 7f5509400640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e406be30 0x7f54e406e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f54f8001900 tx=0x7f54f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:54.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.456+0000 7f5501600640 1 -- 172.21.15.99:0/1475961183 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f550414b3f0 con 0x7f5504160c40 2024-09-10T07:45:54.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.636+0000 7f550a800640 1 -- 172.21.15.99:0/1475961183 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f550406d780 con 0x7f5504160c40 2024-09-10T07:45:54.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.637+0000 7f5501600640 1 -- 172.21.15.99:0/1475961183 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+16715 (secure 0 0 0) 0x7f54fc010040 con 0x7f5504160c40 2024-09-10T07:45:54.636 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:45:54.637 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":191,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:45:46.820422+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-10T07:45:11.664665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-10T07:45:12.889786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:45:54.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 -- 172.21.15.99:0/1475961183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e406be30 msgr2=0x7f54e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e406be30 0x7f54e406e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f54f8001900 tx=0x7f54f8009040 comp rx=0 tx=0).stop 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 -- 172.21.15.99:0/1475961183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5504160c40 msgr2=0x7f55041610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5504160c40 0x7f55041610c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f55040c9ba0 tx=0x7f54fc00f580 comp rx=0 tx=0).stop 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 -- 172.21.15.99:0/1475961183 shutdown_connections 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f54e406be30 0x7f54e406e2f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5504160c40 0x7f55041610c0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55040cbcd0 0x7f55040cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 --2- 172.21.15.99:0/1475961183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54ec003f20 0x7f550414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 -- 172.21.15.99:0/1475961183 >> 172.21.15.99:0/1475961183 conn(0x7f550409de00 msgr2=0x7f55040d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 -- 172.21.15.99:0/1475961183 shutdown_connections 2024-09-10T07:45:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.640+0000 7f550a800640 1 -- 172.21.15.99:0/1475961183 wait complete. 2024-09-10T07:45:54.655 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T07:45:54.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.808+0000 7f04ff800640 1 Processor -- start 2024-09-10T07:45:54.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.808+0000 7f04ff800640 1 -- start start 2024-09-10T07:45:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.809+0000 7f04ff800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f04f814cc40 0x7f04f80ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.809+0000 7f04ff800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f806e180 0x7f04f806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.809+0000 7f04ff800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f80716b0 con 0x7f04f80b47d0 2024-09-10T07:45:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.809+0000 7f04ff800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f04f806eb30 con 0x7f04f814cc40 2024-09-10T07:45:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.810+0000 7f04ff800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f04f80cecc0 con 0x7f04f806e180 2024-09-10T07:45:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.810+0000 7f04efe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f04f80b47d0 0x7f04f80b5680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50840/0 (socket says 172.21.15.99:50840) 2024-09-10T07:45:54.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.810+0000 7f04efe00640 1 -- 172.21.15.99:0/2543685100 learned_addr learned my addr 172.21.15.99:0/2543685100 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.810+0000 7f04fd800640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f806e180 0x7f04f806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.810+0000 7f04fce00640 1 --2- 172.21.15.99:0/2543685100 >> v2:172.21.15.187:3300/0 conn(0x7f04f814cc40 0x7f04f80ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.810+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4276351096 0 0) 0x7f04f80716b0 con 0x7f04f80b47d0 2024-09-10T07:45:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.810+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04dc003520 con 0x7f04f80b47d0 2024-09-10T07:45:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 431966490 0 0) 0x7f04dc003520 con 0x7f04f80b47d0 2024-09-10T07:45:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f806e180 msgr2=0x7f04f806e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f806e180 0x7f04f806e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 >> v2:172.21.15.187:3300/0 conn(0x7f04f814cc40 msgr2=0x7f04f80ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 --2- 172.21.15.99:0/2543685100 >> v2:172.21.15.187:3300/0 conn(0x7f04f814cc40 0x7f04f80ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f8071990 con 0x7f04f80b47d0 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f04e0001670 con 0x7f04f80b47d0 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 >> v1:172.21.15.99:6789/0 conn(0x7f04f80b47d0 legacy=0x7f04f80b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04dc0039b0 0x7f04dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f806e180 0x7f04dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04dc004d40 0x7f04dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f04f806eb30 con 0x7f04dc004d40 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f04f80cecc0 con 0x7f04dc0039b0 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f04dc00b9c0 con 0x7f04f806e180 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04fd800640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04dc004d40 0x7f04dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04fce00640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04dc0039b0 0x7f04dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04efe00640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f806e180 0x7f04dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04fd800640 1 -- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f806e180 msgr2=0x7f04dc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:54.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04fd800640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f806e180 0x7f04dc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04fd800640 1 -- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04dc0039b0 msgr2=0x7f04dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:54.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04fd800640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04dc0039b0 0x7f04dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.811+0000 7f04fd800640 1 -- 172.21.15.99:0/2543685100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04dc003520 con 0x7f04dc004d40 2024-09-10T07:45:54.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.812+0000 7f04fd800640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04dc004d40 0x7f04dc0051c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009fc0 tx=0x7f04dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0767a8542f4cf5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:54.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.813+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0009c10 con 0x7f04dc004d40 2024-09-10T07:45:54.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.813+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f0036070 con 0x7f04dc004d40 2024-09-10T07:45:54.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.813+0000 7f04f7e00640 1 -- 172.21.15.99:0/2543685100 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0031880 con 0x7f04dc004d40 2024-09-10T07:45:54.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.813+0000 7f04ff800640 1 -- 172.21.15.99:0/2543685100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04dc004d40 msgr2=0x7f04dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.813+0000 7f04ff800640 1 --2- 172.21.15.99:0/2543685100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04dc004d40 0x7f04dc0051c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009fc0 tx=0x7f04dc005830 comp rx=0 tx=0).stop 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.813+0000 7f04fd800640 1 -- 172.21.15.99:0/2543685100 reap_dead start 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.813+0000 7f04ff800640 1 -- 172.21.15.99:0/2543685100 shutdown_connections 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.813+0000 7f04ff800640 1 -- 172.21.15.99:0/2543685100 >> 172.21.15.99:0/2543685100 conn(0x7f04f80b2630 msgr2=0x7f04f80b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.813+0000 7f04ff800640 1 -- 172.21.15.99:0/2543685100 shutdown_connections 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.813+0000 7f04ff800640 1 -- 172.21.15.99:0/2543685100 wait complete. 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.815+0000 7f04ff800640 1 Processor -- start 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.815+0000 7f04ff800640 1 -- start start 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.816+0000 7f04ff800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04f81f9080 0x7f04f80c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.816+0000 7f04ff800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f81f9460 0x7f04f81f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.816+0000 7f04ff800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f81fa380 0x7f04f81fa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.816+0000 7f04ff800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f04f806e5f0 con 0x7f04f81fa380 2024-09-10T07:45:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.816+0000 7f04ff800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f04f8071f50 con 0x7f04f81f9080 2024-09-10T07:45:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.816+0000 7f04ff800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f04f806e770 con 0x7f04f81f9460 2024-09-10T07:45:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.816+0000 7f04fd800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f81fa380 0x7f04f81fa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.816+0000 7f04fd800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f81fa380 0x7f04f81fa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47104/0 (socket says 172.21.15.99:47104) 2024-09-10T07:45:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.816+0000 7f04fd800640 1 -- 172.21.15.99:0/2226929101 learned_addr learned my addr 172.21.15.99:0/2226929101 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:54.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04efe00640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f81f9460 0x7f04f81f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04fce00640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04f81f9080 0x7f04f80c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04fd800640 1 -- 172.21.15.99:0/2226929101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f81f9460 msgr2=0x7f04f81f98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04fd800640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f81f9460 0x7f04f81f98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04fd800640 1 -- 172.21.15.99:0/2226929101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04f81f9080 msgr2=0x7f04f80c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04fd800640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04f81f9080 0x7f04f80c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04fd800640 1 -- 172.21.15.99:0/2226929101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f80ad260 con 0x7f04f81fa380 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04efe00640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f81f9460 0x7f04f81f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04fce00640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04f81f9080 0x7f04f80c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04fd800640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f81fa380 0x7f04f81fa830 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f04f000e230 tx=0x7f04f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04f5600640 1 -- 172.21.15.99:0/2226929101 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0009c10 con 0x7f04f81fa380 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04f5600640 1 -- 172.21.15.99:0/2226929101 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f0031d30 con 0x7f04f81fa380 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04f5600640 1 -- 172.21.15.99:0/2226929101 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0003bd0 con 0x7f04f81fa380 2024-09-10T07:45:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.817+0000 7f04ff800640 1 -- 172.21.15.99:0/2226929101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f80c64d0 con 0x7f04f81fa380 2024-09-10T07:45:54.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.818+0000 7f04ff800640 1 -- 172.21.15.99:0/2226929101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f80ad7c0 con 0x7f04f81fa380 2024-09-10T07:45:54.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.818+0000 7f04ff800640 1 -- 172.21.15.99:0/2226929101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f80ae160 con 0x7f04f81fa380 2024-09-10T07:45:54.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.819+0000 7f04f5600640 1 -- 172.21.15.99:0/2226929101 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f04f0005d10 con 0x7f04f81fa380 2024-09-10T07:45:54.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.821+0000 7f04f5600640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f04d406be30 0x7f04d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:54.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.821+0000 7f04f5600640 1 -- 172.21.15.99:0/2226929101 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5709+0+0 (secure 0 0 0) 0x7f04f00ac130 con 0x7f04f81fa380 2024-09-10T07:45:54.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.821+0000 7f04fce00640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f04d406be30 0x7f04d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:54.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.822+0000 7f04fce00640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f04d406be30 0x7f04d406e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009b30 tx=0x7f04e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:54.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:54.825+0000 7f04f5600640 1 -- 172.21.15.99:0/2226929101 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04f80ae160 con 0x7f04f81fa380 2024-09-10T07:45:55.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.034+0000 7f04ff800640 1 -- 172.21.15.99:0/2226929101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f04f80ce780 con 0x7f04f81fa380 2024-09-10T07:45:55.035 INFO:tasks.ceph.mon.a.smithi099.stderr:2024-09-10T07:45:55.035+0000 7f6525600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T07:45:55.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.037+0000 7f04f5600640 1 -- 172.21.15.99:0/2226929101 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v91) ==== 161+0+0 (secure 0 0 0) 0x7f04f80ad260 con 0x7f04f81fa380 2024-09-10T07:45:55.036 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T07:45:55.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.041+0000 7f04ff800640 1 -- 172.21.15.99:0/2226929101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f04d406be30 msgr2=0x7f04d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:55.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.041+0000 7f04ff800640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f04d406be30 0x7f04d406e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009b30 tx=0x7f04e8008040 comp rx=0 tx=0).stop 2024-09-10T07:45:55.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.041+0000 7f04ff800640 1 -- 172.21.15.99:0/2226929101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f81fa380 msgr2=0x7f04f81fa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:55.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.041+0000 7f04ff800640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f81fa380 0x7f04f81fa830 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f04f000e230 tx=0x7f04f0009750 comp rx=0 tx=0).stop 2024-09-10T07:45:55.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.042+0000 7f04ff800640 1 -- 172.21.15.99:0/2226929101 shutdown_connections 2024-09-10T07:45:55.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.042+0000 7f04ff800640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f04d406be30 0x7f04d406e2f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:55.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.042+0000 7f04ff800640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f81fa380 0x7f04f81fa830 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:55.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.042+0000 7f04ff800640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04f81f9460 0x7f04f81f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:55.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.042+0000 7f04ff800640 1 --2- 172.21.15.99:0/2226929101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04f81f9080 0x7f04f80c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:55.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.042+0000 7f04ff800640 1 -- 172.21.15.99:0/2226929101 >> 172.21.15.99:0/2226929101 conn(0x7f04f80b2630 msgr2=0x7f04f80b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:55.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.043+0000 7f04ff800640 1 -- 172.21.15.99:0/2226929101 shutdown_connections 2024-09-10T07:45:55.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.043+0000 7f04ff800640 1 -- 172.21.15.99:0/2226929101 wait complete. 2024-09-10T07:45:55.051 INFO:tasks.ceph.mds.c.smithi099.stderr: -9618> 2024-09-10T07:45:20.075+0000 7f7573800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T07:45:55.060 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T07:45:55.116 INFO:tasks.ceph.mds.c.smithi099.stdout:starting mds.c at 2024-09-10T07:45:55.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.218+0000 7fd905400640 1 Processor -- start 2024-09-10T07:45:55.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.218+0000 7fd905400640 1 -- start start 2024-09-10T07:45:55.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.219+0000 7fd905400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd9001623c0 0x7fd9000b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:55.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.219+0000 7fd905400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 0x7fd9000d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:55.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.219+0000 7fd905400640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9000d3700 con 0x7fd9000d0a50 2024-09-10T07:45:55.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.219+0000 7fd905400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd9000d21a0 con 0x7fd9001623c0 2024-09-10T07:45:55.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.219+0000 7fd905400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd9000d0080 con 0x7fd9000d56b0 2024-09-10T07:45:55.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.220+0000 7fd8f5e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 0x7fd9000d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.220+0000 7fd8fe800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd9001623c0 0x7fd9000b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.220+0000 7fd8f5e00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 0x7fd9000d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:53984/0 (socket says 172.21.15.99:53984) 2024-09-10T07:45:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.220+0000 7fd8f5e00640 1 -- 172.21.15.99:0/299716114 learned_addr learned my addr 172.21.15.99:0/299716114 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.220+0000 7fd8f5e00640 1 -- 172.21.15.99:0/299716114 >> v2:172.21.15.187:3300/0 conn(0x7fd9001623c0 msgr2=0x7fd9000b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.220+0000 7fd8f5e00640 1 --2- 172.21.15.99:0/299716114 >> v2:172.21.15.187:3300/0 conn(0x7fd9001623c0 0x7fd9000b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.220+0000 7fd8f5e00640 1 -- 172.21.15.99:0/299716114 >> v1:172.21.15.187:6789/0 conn(0x7fd9000d0a50 legacy=0x7fd9000d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.220+0000 7fd8f5e00640 1 -- 172.21.15.99:0/299716114 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9000cfa70 con 0x7fd9000d56b0 2024-09-10T07:45:55.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.221+0000 7fd8f5e00640 1 --2- 172.21.15.99:0/299716114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 0x7fd9000d0510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009870 tx=0x7fd8e802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe680a4cc7759b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:55.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.221+0000 7fd8fde00640 1 -- 172.21.15.99:0/299716114 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8037070 con 0x7fd9000d56b0 2024-09-10T07:45:55.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.221+0000 7fd8fde00640 1 -- 172.21.15.99:0/299716114 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e8032440 con 0x7fd9000d56b0 2024-09-10T07:45:55.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.221+0000 7fd8fde00640 1 -- 172.21.15.99:0/299716114 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8032810 con 0x7fd9000d56b0 2024-09-10T07:45:55.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.222+0000 7fd905400640 1 -- 172.21.15.99:0/299716114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 msgr2=0x7fd9000d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:55.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.222+0000 7fd905400640 1 --2- 172.21.15.99:0/299716114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 0x7fd9000d0510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009870 tx=0x7fd8e802a270 comp rx=0 tx=0).stop 2024-09-10T07:45:55.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.222+0000 7fd905400640 1 -- 172.21.15.99:0/299716114 shutdown_connections 2024-09-10T07:45:55.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.222+0000 7fd905400640 1 --2- 172.21.15.99:0/299716114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 0x7fd9000d0510 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:55.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.222+0000 7fd905400640 1 --2- 172.21.15.99:0/299716114 >> v2:172.21.15.187:3300/0 conn(0x7fd9001623c0 0x7fd9000b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:55.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.222+0000 7fd905400640 1 -- 172.21.15.99:0/299716114 >> 172.21.15.99:0/299716114 conn(0x7fd90009df30 msgr2=0x7fd9000d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:55.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.222+0000 7fd905400640 1 -- 172.21.15.99:0/299716114 shutdown_connections 2024-09-10T07:45:55.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.222+0000 7fd905400640 1 -- 172.21.15.99:0/299716114 wait complete. 2024-09-10T07:45:55.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.224+0000 7fd905400640 1 Processor -- start 2024-09-10T07:45:55.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.224+0000 7fd905400640 1 -- start start 2024-09-10T07:45:55.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd905400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 0x7fd9000b8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:55.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd905400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9001623c0 0x7fd90015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:55.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd905400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd900156250 0x7fd9000b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:55.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd905400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001627a0 con 0x7fd9001623c0 2024-09-10T07:45:55.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd905400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd9000cfd10 con 0x7fd900156250 2024-09-10T07:45:55.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd905400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd9000d3c80 con 0x7fd9000d56b0 2024-09-10T07:45:55.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd8f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9001623c0 0x7fd90015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:55.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd8f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9001623c0 0x7fd90015ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47112/0 (socket says 172.21.15.99:47112) 2024-09-10T07:45:55.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd8f5e00640 1 -- 172.21.15.99:0/231899669 learned_addr learned my addr 172.21.15.99:0/231899669 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:55.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd8fe800640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 0x7fd9000b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:55.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.225+0000 7fd8ff200640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd900156250 0x7fd9000b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:55.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd8f5e00640 1 -- 172.21.15.99:0/231899669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 msgr2=0x7fd9000b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:55.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd8f5e00640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 0x7fd9000b8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:55.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd8f5e00640 1 -- 172.21.15.99:0/231899669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd900156250 msgr2=0x7fd9000b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:55.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd8f5e00640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd900156250 0x7fd9000b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:55.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd8f5e00640 1 -- 172.21.15.99:0/231899669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90015f380 con 0x7fd9001623c0 2024-09-10T07:45:55.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd8f5e00640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9001623c0 0x7fd90015ee40 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8000c00 tx=0x7fd8e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:55.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd8f7400640 1 -- 172.21.15.99:0/231899669 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8037040 con 0x7fd9001623c0 2024-09-10T07:45:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd8f7400640 1 -- 172.21.15.99:0/231899669 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e8042070 con 0x7fd9001623c0 2024-09-10T07:45:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd905400640 1 -- 172.21.15.99:0/231899669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9000ba4c0 con 0x7fd9001623c0 2024-09-10T07:45:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd8f7400640 1 -- 172.21.15.99:0/231899669 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8030880 con 0x7fd9001623c0 2024-09-10T07:45:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.226+0000 7fd905400640 1 -- 172.21.15.99:0/231899669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9000b7d40 con 0x7fd9001623c0 2024-09-10T07:45:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.227+0000 7fd905400640 1 -- 172.21.15.99:0/231899669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9000d0510 con 0x7fd9001623c0 2024-09-10T07:45:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.228+0000 7fd8f7400640 1 -- 172.21.15.99:0/231899669 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8e8030a20 con 0x7fd9001623c0 2024-09-10T07:45:55.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.229+0000 7fd8f7400640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd8dc06be30 0x7fd8dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:55.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.229+0000 7fd8f7400640 1 -- 172.21.15.99:0/231899669 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5795+0+0 (secure 0 0 0) 0x7fd8e80ab670 con 0x7fd9001623c0 2024-09-10T07:45:55.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.229+0000 7fd8fe800640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd8dc06be30 0x7fd8dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:55.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.230+0000 7fd8fe800640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd8dc06be30 0x7fd8dc06e2f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0011340 tx=0x7fd8f000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.233+0000 7fd8f7400640 1 -- 172.21.15.99:0/231899669 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8e80798d0 con 0x7fd9001623c0 2024-09-10T07:45:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:55.442+0000 7fd905400640 1 -- 172.21.15.99:0/231899669 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd900161b70 con 0x7fd9001623c0 2024-09-10T07:45:56.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.039+0000 7fd8f7400640 1 -- 172.21.15.99:0/231899669 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v92) ==== 104+0+0 (secure 0 0 0) 0x7fd8e807dbd0 con 0x7fd9001623c0 2024-09-10T07:45:56.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 -- 172.21.15.99:0/231899669 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd8dc06be30 msgr2=0x7fd8dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd8dc06be30 0x7fd8dc06e2f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0011340 tx=0x7fd8f000b040 comp rx=0 tx=0).stop 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 -- 172.21.15.99:0/231899669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9001623c0 msgr2=0x7fd90015ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9001623c0 0x7fd90015ee40 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8000c00 tx=0x7fd8e80046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 -- 172.21.15.99:0/231899669 shutdown_connections 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd900156250 0x7fd9000b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd8dc06be30 0x7fd8dc06e2f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9001623c0 0x7fd90015ee40 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 --2- 172.21.15.99:0/231899669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9000d56b0 0x7fd9000b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 -- 172.21.15.99:0/231899669 >> 172.21.15.99:0/231899669 conn(0x7fd90009df30 msgr2=0x7fd9000b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 -- 172.21.15.99:0/231899669 shutdown_connections 2024-09-10T07:45:56.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.042+0000 7fd905400640 1 -- 172.21.15.99:0/231899669 wait complete. 2024-09-10T07:45:56.059 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T07:45:56.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.220+0000 7f5905c00640 1 Processor -- start 2024-09-10T07:45:56.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.220+0000 7f5905c00640 1 -- start start 2024-09-10T07:45:56.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.221+0000 7f5905c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f590015edc0 0x7f59000b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:56.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.221+0000 7f5905c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59000b3c90 0x7f59000d2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:56.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.221+0000 7f5905c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59000d3080 0x7f59000d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:56.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.221+0000 7f5905c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f59000d3a30 con 0x7f59000d3080 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.221+0000 7f5905c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f59000d0310 con 0x7f590015edc0 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.221+0000 7f5905c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f59000d05d0 con 0x7f59000b3c90 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.221+0000 7f58ff400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59000d3080 0x7f59000d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.222+0000 7f58ff400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f59000d3080 0x7f59000d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47118/0 (socket says 172.21.15.99:47118) 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.222+0000 7f58ff400640 1 -- 172.21.15.99:0/3144849986 learned_addr learned my addr 172.21.15.99:0/3144849986 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.222+0000 7f58f7e00640 1 --2- 172.21.15.99:0/3144849986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59000b3c90 0x7f59000d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.222+0000 7f58fea00640 1 --2- 172.21.15.99:0/3144849986 >> v2:172.21.15.187:3300/0 conn(0x7f590015edc0 0x7f59000b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.222+0000 7f58ff400640 1 -- 172.21.15.99:0/3144849986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59000b3c90 msgr2=0x7f59000d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.222+0000 7f58ff400640 1 --2- 172.21.15.99:0/3144849986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59000b3c90 0x7f59000d2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.222+0000 7f58ff400640 1 -- 172.21.15.99:0/3144849986 >> v2:172.21.15.187:3300/0 conn(0x7f590015edc0 msgr2=0x7f59000b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.222+0000 7f58ff400640 1 --2- 172.21.15.99:0/3144849986 >> v2:172.21.15.187:3300/0 conn(0x7f590015edc0 0x7f59000b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.222+0000 7f58ff400640 1 -- 172.21.15.99:0/3144849986 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59000d08b0 con 0x7f59000d3080 2024-09-10T07:45:56.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.223+0000 7f58ff400640 1 --2- 172.21.15.99:0/3144849986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 0x7f59000d34f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f590008d430 tx=0x7f58f802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9808713944638e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.223+0000 7f58fe000640 1 -- 172.21.15.99:0/3144849986 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8036070 con 0x7f59000d3080 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.223+0000 7f58fe000640 1 -- 172.21.15.99:0/3144849986 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f8031600 con 0x7f59000d3080 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.223+0000 7f58fe000640 1 -- 172.21.15.99:0/3144849986 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80319d0 con 0x7f59000d3080 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.224+0000 7f5905c00640 1 -- 172.21.15.99:0/3144849986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 msgr2=0x7f59000d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.224+0000 7f5905c00640 1 --2- 172.21.15.99:0/3144849986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 0x7f59000d34f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f590008d430 tx=0x7f58f802a6a0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.224+0000 7f5905c00640 1 -- 172.21.15.99:0/3144849986 shutdown_connections 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.224+0000 7f5905c00640 1 --2- 172.21.15.99:0/3144849986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59000b3c90 0x7f59000d2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.224+0000 7f5905c00640 1 --2- 172.21.15.99:0/3144849986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 0x7f59000d34f0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.224+0000 7f5905c00640 1 --2- 172.21.15.99:0/3144849986 >> v2:172.21.15.187:3300/0 conn(0x7f590015edc0 0x7f59000b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.224+0000 7f5905c00640 1 -- 172.21.15.99:0/3144849986 >> 172.21.15.99:0/3144849986 conn(0x7f59000d4c60 msgr2=0x7f59000d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.224+0000 7f5905c00640 1 -- 172.21.15.99:0/3144849986 shutdown_connections 2024-09-10T07:45:56.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.224+0000 7f5905c00640 1 -- 172.21.15.99:0/3144849986 wait complete. 2024-09-10T07:45:56.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.225+0000 7f5905c00640 1 Processor -- start 2024-09-10T07:45:56.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.226+0000 7f5905c00640 1 -- start start 2024-09-10T07:45:56.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.226+0000 7f5905c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59000b3c90 0x7f5900152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:56.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.226+0000 7f5905c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 0x7f59001524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:56.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f5905c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f590015edc0 0x7f59001f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:56.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f5905c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f59000d2d70 con 0x7f59000d3080 2024-09-10T07:45:56.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f5905c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f59000d1310 con 0x7f590015edc0 2024-09-10T07:45:56.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f5905c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f59000d1810 con 0x7f59000b3c90 2024-09-10T07:45:56.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f58f7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 0x7f59001524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:56.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f58f7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 0x7f59001524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47126/0 (socket says 172.21.15.99:47126) 2024-09-10T07:45:56.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f58f7e00640 1 -- 172.21.15.99:0/1320524614 learned_addr learned my addr 172.21.15.99:0/1320524614 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:56.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f58fea00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59000b3c90 0x7f5900152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:56.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f58ff400640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f590015edc0 0x7f59001f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:56.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f58f7e00640 1 -- 172.21.15.99:0/1320524614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59000b3c90 msgr2=0x7f5900152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:56.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f58f7e00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59000b3c90 0x7f5900152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f58f7e00640 1 -- 172.21.15.99:0/1320524614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f590015edc0 msgr2=0x7f59001f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:56.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f58f7e00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f590015edc0 0x7f59001f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.227+0000 7f58f7e00640 1 -- 172.21.15.99:0/1320524614 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59001534d0 con 0x7f59000d3080 2024-09-10T07:45:56.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.228+0000 7f58f7e00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 0x7f59001524f0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f58e800d830 tx=0x7f58e800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:56.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.228+0000 7f58f6a00640 1 -- 172.21.15.99:0/1320524614 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8018020 con 0x7f59000d3080 2024-09-10T07:45:56.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.228+0000 7f58f6a00640 1 -- 172.21.15.99:0/1320524614 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e8009660 con 0x7f59000d3080 2024-09-10T07:45:56.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.228+0000 7f58f6a00640 1 -- 172.21.15.99:0/1320524614 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8009a30 con 0x7f59000d3080 2024-09-10T07:45:56.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.228+0000 7f5905c00640 1 -- 172.21.15.99:0/1320524614 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5900160bd0 con 0x7f59000d3080 2024-09-10T07:45:56.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.228+0000 7f5905c00640 1 -- 172.21.15.99:0/1320524614 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5900161190 con 0x7f59000d3080 2024-09-10T07:45:56.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.229+0000 7f5905c00640 1 -- 172.21.15.99:0/1320524614 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59000d34f0 con 0x7f59000d3080 2024-09-10T07:45:56.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.230+0000 7f58f6a00640 1 -- 172.21.15.99:0/1320524614 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58e801b020 con 0x7f59000d3080 2024-09-10T07:45:56.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.231+0000 7f58f6a00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58dc06be30 0x7f58dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:56.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.231+0000 7f58f6a00640 1 -- 172.21.15.99:0/1320524614 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5795+0+0 (secure 0 0 0) 0x7f58e808b290 con 0x7f59000d3080 2024-09-10T07:45:56.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.231+0000 7f58fea00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58dc06be30 0x7f58dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:56.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.232+0000 7f58fea00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58dc06be30 0x7f58dc06e2f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f58f00079a0 tx=0x7f58f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:56.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.235+0000 7f58f6a00640 1 -- 172.21.15.99:0/1320524614 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58e8022030 con 0x7f59000d3080 2024-09-10T07:45:56.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.406+0000 7f5905c00640 1 -- 172.21.15.99:0/1320524614 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f59000cfce0 con 0x7f59000d3080 2024-09-10T07:45:56.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.823+0000 7f58f6a00640 1 -- 172.21.15.99:0/1320524614 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v193) ==== 181+0+0 (secure 0 0 0) 0x7f58e80594f0 con 0x7f59000d3080 2024-09-10T07:45:56.823 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-09-10T07:45:56.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.825+0000 7f5905c00640 1 -- 172.21.15.99:0/1320524614 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58dc06be30 msgr2=0x7f58dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:56.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.825+0000 7f5905c00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58dc06be30 0x7f58dc06e2f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f58f00079a0 tx=0x7f58f0008040 comp rx=0 tx=0).stop 2024-09-10T07:45:56.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.825+0000 7f5905c00640 1 -- 172.21.15.99:0/1320524614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 msgr2=0x7f59001524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:56.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.825+0000 7f5905c00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 0x7f59001524f0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f58e800d830 tx=0x7f58e800dcf0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.825+0000 7f5905c00640 1 -- 172.21.15.99:0/1320524614 shutdown_connections 2024-09-10T07:45:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.825+0000 7f5905c00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f590015edc0 0x7f59001f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.825+0000 7f5905c00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f58dc06be30 0x7f58dc06e2f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.825+0000 7f5905c00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59000d3080 0x7f59001524f0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.825+0000 7f5905c00640 1 --2- 172.21.15.99:0/1320524614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59000b3c90 0x7f5900152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.826+0000 7f5905c00640 1 -- 172.21.15.99:0/1320524614 >> 172.21.15.99:0/1320524614 conn(0x7f59000d4c60 msgr2=0x7f59000b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.826+0000 7f5905c00640 1 -- 172.21.15.99:0/1320524614 shutdown_connections 2024-09-10T07:45:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:56.826+0000 7f5905c00640 1 -- 172.21.15.99:0/1320524614 wait complete. 2024-09-10T07:45:56.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T07:45:57.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.004+0000 7f9edd200640 1 Processor -- start 2024-09-10T07:45:57.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.004+0000 7f9edd200640 1 -- start start 2024-09-10T07:45:57.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9edd200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ed8148600 0x7f9ed815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:57.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9edd200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9ed80b5580 0x7f9ed80b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:57.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9edd200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed815fa40 con 0x7f9ed80afd90 2024-09-10T07:45:57.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9edd200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed80b5ed0 con 0x7f9ed8148600 2024-09-10T07:45:57.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9edd200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed815fd20 con 0x7f9ed80b5580 2024-09-10T07:45:57.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9ed5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ed8148600 0x7f9ed815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:57.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9ecd400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9ed80afd90 0x7f9ed8071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50864/0 (socket says 172.21.15.99:50864) 2024-09-10T07:45:57.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9ecd400640 1 -- 172.21.15.99:0/1428200483 learned_addr learned my addr 172.21.15.99:0/1428200483 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:57.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9ed6800640 1 --2- 172.21.15.99:0/1428200483 >> v2:172.21.15.187:3300/0 conn(0x7f9ed80b5580 0x7f9ed80b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:57.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9ed5e00640 1 -- 172.21.15.99:0/1428200483 >> v2:172.21.15.187:3300/0 conn(0x7f9ed80b5580 msgr2=0x7f9ed80b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9ed5e00640 1 --2- 172.21.15.99:0/1428200483 >> v2:172.21.15.187:3300/0 conn(0x7f9ed80b5580 0x7f9ed80b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9ed5e00640 1 -- 172.21.15.99:0/1428200483 >> v1:172.21.15.99:6789/0 conn(0x7f9ed80afd90 legacy=0x7f9ed8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9ed5e00640 1 -- 172.21.15.99:0/1428200483 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed80b4d80 con 0x7f9ed8148600 2024-09-10T07:45:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.006+0000 7f9ed6800640 1 --2- 172.21.15.99:0/1428200483 >> v2:172.21.15.187:3300/0 conn(0x7f9ed80b5580 0x7f9ed80b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:45:57.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.007+0000 7f9ed5e00640 1 --2- 172.21.15.99:0/1428200483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed8148600 0x7f9ed815f0a0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80cd290 tx=0x7f9ec802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4c920f3ce13a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:57.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9ed5400640 1 -- 172.21.15.99:0/1428200483 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8037070 con 0x7f9ed8148600 2024-09-10T07:45:57.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9ed5400640 1 -- 172.21.15.99:0/1428200483 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec8032440 con 0x7f9ed8148600 2024-09-10T07:45:57.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9ed5400640 1 -- 172.21.15.99:0/1428200483 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec802ae60 con 0x7f9ed8148600 2024-09-10T07:45:57.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9edd200640 1 -- 172.21.15.99:0/1428200483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed8148600 msgr2=0x7f9ed815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:57.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9edd200640 1 --2- 172.21.15.99:0/1428200483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed8148600 0x7f9ed815f0a0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80cd290 tx=0x7f9ec802a110 comp rx=0 tx=0).stop 2024-09-10T07:45:57.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9edd200640 1 -- 172.21.15.99:0/1428200483 shutdown_connections 2024-09-10T07:45:57.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9edd200640 1 --2- 172.21.15.99:0/1428200483 >> v2:172.21.15.187:3300/0 conn(0x7f9ed80b5580 0x7f9ed80b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9edd200640 1 --2- 172.21.15.99:0/1428200483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed8148600 0x7f9ed815f0a0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9edd200640 1 -- 172.21.15.99:0/1428200483 >> 172.21.15.99:0/1428200483 conn(0x7f9ed80b26a0 msgr2=0x7f9ed80b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9edd200640 1 -- 172.21.15.99:0/1428200483 shutdown_connections 2024-09-10T07:45:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.008+0000 7f9edd200640 1 -- 172.21.15.99:0/1428200483 wait complete. 2024-09-10T07:45:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.010+0000 7f9edd200640 1 Processor -- start 2024-09-10T07:45:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.010+0000 7f9edd200640 1 -- start start 2024-09-10T07:45:57.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9edd200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed80afd90 0x7f9ed8143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9edd200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed80b5580 0x7f9ed80ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9edd200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ed8148600 0x7f9ed81390d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9edd200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed8071c80 con 0x7f9ed80afd90 2024-09-10T07:45:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9edd200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed8160000 con 0x7f9ed80b5580 2024-09-10T07:45:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9edd200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed80cef90 con 0x7f9ed8148600 2024-09-10T07:45:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9ed5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed80afd90 0x7f9ed8143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9ed5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed80afd90 0x7f9ed8143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47130/0 (socket says 172.21.15.99:47130) 2024-09-10T07:45:57.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9ed5e00640 1 -- 172.21.15.99:0/3350641125 learned_addr learned my addr 172.21.15.99:0/3350641125 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:57.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9ed5e00640 1 -- 172.21.15.99:0/3350641125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ed8148600 msgr2=0x7f9ed81390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:57.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9ed5e00640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ed8148600 0x7f9ed81390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:57.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9ed5e00640 1 -- 172.21.15.99:0/3350641125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed80b5580 msgr2=0x7f9ed80ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:57.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9ed5e00640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed80b5580 0x7f9ed80ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:57.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.011+0000 7f9ed5e00640 1 -- 172.21.15.99:0/3350641125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed80cf270 con 0x7f9ed80afd90 2024-09-10T07:45:57.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.012+0000 7f9ed5e00640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed80afd90 0x7f9ed8143530 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8009890 tx=0x7f9ec80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:57.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.012+0000 7f9ecea00640 1 -- 172.21.15.99:0/3350641125 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8037040 con 0x7f9ed80afd90 2024-09-10T07:45:57.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.012+0000 7f9ecea00640 1 -- 172.21.15.99:0/3350641125 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec8042070 con 0x7f9ed80afd90 2024-09-10T07:45:57.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.012+0000 7f9edd200640 1 -- 172.21.15.99:0/3350641125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed80cf550 con 0x7f9ed80afd90 2024-09-10T07:45:57.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.012+0000 7f9ecea00640 1 -- 172.21.15.99:0/3350641125 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8030a50 con 0x7f9ed80afd90 2024-09-10T07:45:57.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.012+0000 7f9edd200640 1 -- 172.21.15.99:0/3350641125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed80cfb10 con 0x7f9ed80afd90 2024-09-10T07:45:57.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.013+0000 7f9edd200640 1 -- 172.21.15.99:0/3350641125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed80b5990 con 0x7f9ed80afd90 2024-09-10T07:45:57.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.014+0000 7f9ecea00640 1 -- 172.21.15.99:0/3350641125 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ec8030bf0 con 0x7f9ed80afd90 2024-09-10T07:45:57.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.015+0000 7f9ecea00640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9eb406be30 0x7f9eb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:57.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.015+0000 7f9ecea00640 1 -- 172.21.15.99:0/3350641125 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 5357+0+0 (secure 0 0 0) 0x7f9ec80ac330 con 0x7f9ed80afd90 2024-09-10T07:45:57.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.015+0000 7f9ecea00640 1 -- 172.21.15.99:0/3350641125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=194}) -- 0x7f9eb4072c00 con 0x7f9ed80afd90 2024-09-10T07:45:57.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.015+0000 7f9ecd400640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9eb406be30 0x7f9eb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:57.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.016+0000 7f9ecd400640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9eb406be30 0x7f9eb406e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0005880 tx=0x7f9ec0007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.019+0000 7f9ecea00640 1 -- 172.21.15.99:0/3350641125 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ec807ad90 con 0x7f9ed80afd90 2024-09-10T07:45:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.192+0000 7f9edd200640 1 -- 172.21.15.99:0/3350641125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9ed81617b0 con 0x7f9ed80afd90 2024-09-10T07:45:57.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.974+0000 7f9ecea00640 1 -- 172.21.15.99:0/3350641125 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v194) ==== 169+0+0 (secure 0 0 0) 0x7f9ec807a690 con 0x7f9ed80afd90 2024-09-10T07:45:57.974 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-09-10T07:45:57.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.977+0000 7f9ecea00640 1 -- 172.21.15.99:0/3350641125 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(194..194 src has 1..194) ==== 296+0+0 (secure 0 0 0) 0x7f9ec8078730 con 0x7f9ed80afd90 2024-09-10T07:45:57.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.977+0000 7f9edd200640 1 -- 172.21.15.99:0/3350641125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9eb406be30 msgr2=0x7f9eb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.977+0000 7f9edd200640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9eb406be30 0x7f9eb406e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0005880 tx=0x7f9ec0007a20 comp rx=0 tx=0).stop 2024-09-10T07:45:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.977+0000 7f9edd200640 1 -- 172.21.15.99:0/3350641125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed80afd90 msgr2=0x7f9ed8143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.977+0000 7f9edd200640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed80afd90 0x7f9ed8143530 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8009890 tx=0x7f9ec80046c0 comp rx=0 tx=0).stop 2024-09-10T07:45:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.982+0000 7f9edd200640 1 -- 172.21.15.99:0/3350641125 shutdown_connections 2024-09-10T07:45:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.982+0000 7f9edd200640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ed8148600 0x7f9ed81390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:57.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.982+0000 7f9edd200640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed80b5580 0x7f9ed80ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.982+0000 7f9edd200640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f9eb406be30 0x7f9eb406e2f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.982+0000 7f9edd200640 1 --2- 172.21.15.99:0/3350641125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed80afd90 0x7f9ed8143530 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.982+0000 7f9edd200640 1 -- 172.21.15.99:0/3350641125 >> 172.21.15.99:0/3350641125 conn(0x7f9ed80b26a0 msgr2=0x7f9ed81624d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:57.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.984+0000 7f9edd200640 1 -- 172.21.15.99:0/3350641125 shutdown_connections 2024-09-10T07:45:57.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:57.985+0000 7f9edd200640 1 -- 172.21.15.99:0/3350641125 wait complete. 2024-09-10T07:45:58.006 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T07:45:58.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.163+0000 7f378f200640 1 Processor -- start 2024-09-10T07:45:58.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.163+0000 7f378f200640 1 -- start start 2024-09-10T07:45:58.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.164+0000 7f378f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f37880d0630 0x7f37880d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.164+0000 7f378f200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37880b4300 con 0x7f378815b760 2024-09-10T07:45:58.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.164+0000 7f378f200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37880d0fa0 con 0x7f37880afa90 2024-09-10T07:45:58.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.164+0000 7f378f200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f378806d700 con 0x7f37880d0630 2024-09-10T07:45:58.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.164+0000 7f378d200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f37880d0630 0x7f37880d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.164+0000 7f3787e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f378815b760 0x7f37880b4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50874/0 (socket says 172.21.15.99:50874) 2024-09-10T07:45:58.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.164+0000 7f3787e00640 1 -- 172.21.15.99:0/496046076 learned_addr learned my addr 172.21.15.99:0/496046076 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:58.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.165+0000 7f378d200640 1 -- 172.21.15.99:0/496046076 >> v1:172.21.15.187:6789/0 conn(0x7f37880afa90 legacy=0x7f378806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:58.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.165+0000 7f378d200640 1 -- 172.21.15.99:0/496046076 >> v1:172.21.15.99:6789/0 conn(0x7f378815b760 legacy=0x7f37880b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.165+0000 7f378d200640 1 -- 172.21.15.99:0/496046076 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378806d9e0 con 0x7f37880d0630 2024-09-10T07:45:58.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.165+0000 7f3786a00640 1 -- 172.21.15.99:0/496046076 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592712660 0 0) 0x7f37880b4300 con 0x7f378815b760 2024-09-10T07:45:58.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.166+0000 7f378d200640 1 --2- 172.21.15.99:0/496046076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880d0630 0x7f37880d0a60 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f37780097a0 tx=0x7f377802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb041af909381ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:58.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.166+0000 7f3786a00640 1 -- 172.21.15.99:0/496046076 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778037070 con 0x7f37880d0630 2024-09-10T07:45:58.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.166+0000 7f3786a00640 1 -- 172.21.15.99:0/496046076 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377802adc0 con 0x7f37880d0630 2024-09-10T07:45:58.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.166+0000 7f3786a00640 1 -- 172.21.15.99:0/496046076 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778032660 con 0x7f37880d0630 2024-09-10T07:45:58.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.166+0000 7f378f200640 1 -- 172.21.15.99:0/496046076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880d0630 msgr2=0x7f37880d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.166+0000 7f378f200640 1 --2- 172.21.15.99:0/496046076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880d0630 0x7f37880d0a60 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f37780097a0 tx=0x7f377802a0b0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.167+0000 7f378f200640 1 -- 172.21.15.99:0/496046076 shutdown_connections 2024-09-10T07:45:58.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.167+0000 7f378f200640 1 --2- 172.21.15.99:0/496046076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880d0630 0x7f37880d0a60 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.167+0000 7f378f200640 1 -- 172.21.15.99:0/496046076 >> 172.21.15.99:0/496046076 conn(0x7f378806bc10 msgr2=0x7f378806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:58.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.167+0000 7f378f200640 1 -- 172.21.15.99:0/496046076 shutdown_connections 2024-09-10T07:45:58.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.167+0000 7f378f200640 1 -- 172.21.15.99:0/496046076 wait complete. 2024-09-10T07:45:58.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.168+0000 7f378f200640 1 Processor -- start 2024-09-10T07:45:58.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.168+0000 7f378f200640 1 -- start start 2024-09-10T07:45:58.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.169+0000 7f378f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880afa90 0x7f378814b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.169+0000 7f378f200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37880d0630 0x7f3788156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.169+0000 7f378f200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378815b760 0x7f3788157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.169+0000 7f378f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f378815bcc0 con 0x7f37880afa90 2024-09-10T07:45:58.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.169+0000 7f378f200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f378815bb40 con 0x7f37880d0630 2024-09-10T07:45:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.169+0000 7f378f200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f378806dcc0 con 0x7f378815b760 2024-09-10T07:45:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f3787e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880afa90 0x7f378814b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f3787e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880afa90 0x7f378814b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47134/0 (socket says 172.21.15.99:47134) 2024-09-10T07:45:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f3787e00640 1 -- 172.21.15.99:0/455254866 learned_addr learned my addr 172.21.15.99:0/455254866 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f378d200640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378815b760 0x7f3788157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f3787400640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37880d0630 0x7f3788156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f3787e00640 1 -- 172.21.15.99:0/455254866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378815b760 msgr2=0x7f3788157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f3787e00640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378815b760 0x7f3788157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f3787e00640 1 -- 172.21.15.99:0/455254866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37880d0630 msgr2=0x7f3788156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f3787e00640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37880d0630 0x7f3788156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f3787e00640 1 -- 172.21.15.99:0/455254866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3788155a70 con 0x7f37880afa90 2024-09-10T07:45:58.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f3787e00640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880afa90 0x7f378814b240 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f378000c7c0 tx=0x7f378000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:58.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f377fe00640 1 -- 172.21.15.99:0/455254866 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780018070 con 0x7f37880afa90 2024-09-10T07:45:58.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f377fe00640 1 -- 172.21.15.99:0/455254866 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378000a640 con 0x7f37880afa90 2024-09-10T07:45:58.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.170+0000 7f377fe00640 1 -- 172.21.15.99:0/455254866 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378000aa30 con 0x7f37880afa90 2024-09-10T07:45:58.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.171+0000 7f378f200640 1 -- 172.21.15.99:0/455254866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3788155d50 con 0x7f37880afa90 2024-09-10T07:45:58.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.171+0000 7f378f200640 1 -- 172.21.15.99:0/455254866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3788156310 con 0x7f37880afa90 2024-09-10T07:45:58.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.172+0000 7f378f200640 1 -- 172.21.15.99:0/455254866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37880d0a60 con 0x7f37880afa90 2024-09-10T07:45:58.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.172+0000 7f377fe00640 1 -- 172.21.15.99:0/455254866 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f378000abd0 con 0x7f37880afa90 2024-09-10T07:45:58.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.173+0000 7f377fe00640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376406be30 0x7f376406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.173+0000 7f377fe00640 1 -- 172.21.15.99:0/455254866 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f378008a2b0 con 0x7f37880afa90 2024-09-10T07:45:58.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.174+0000 7f3787400640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376406be30 0x7f376406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.174+0000 7f3787400640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376406be30 0x7f376406e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3788153dd0 tx=0x7f3770009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:58.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.177+0000 7f377fe00640 1 -- 172.21.15.99:0/455254866 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3780058ec0 con 0x7f37880afa90 2024-09-10T07:45:58.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.350+0000 7f378f200640 1 -- 172.21.15.99:0/455254866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f378806c370 con 0x7f37880afa90 2024-09-10T07:45:58.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.354+0000 7f377fe00640 1 -- 172.21.15.99:0/455254866 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f37800587c0 con 0x7f37880afa90 2024-09-10T07:45:58.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 -- 172.21.15.99:0/455254866 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376406be30 msgr2=0x7f376406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376406be30 0x7f376406e2f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3788153dd0 tx=0x7f3770009040 comp rx=0 tx=0).stop 2024-09-10T07:45:58.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 -- 172.21.15.99:0/455254866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880afa90 msgr2=0x7f378814b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880afa90 0x7f378814b240 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f378000c7c0 tx=0x7f378000cc80 comp rx=0 tx=0).stop 2024-09-10T07:45:58.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 -- 172.21.15.99:0/455254866 shutdown_connections 2024-09-10T07:45:58.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f378815b760 0x7f3788157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37880d0630 0x7f3788156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f376406be30 0x7f376406e2f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 --2- 172.21.15.99:0/455254866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37880afa90 0x7f378814b240 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 -- 172.21.15.99:0/455254866 >> 172.21.15.99:0/455254866 conn(0x7f378806bc10 msgr2=0x7f37880b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:58.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 -- 172.21.15.99:0/455254866 shutdown_connections 2024-09-10T07:45:58.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.357+0000 7f378f200640 1 -- 172.21.15.99:0/455254866 wait complete. 2024-09-10T07:45:58.374 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-10T07:45:58.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.527+0000 7f38a0800640 1 Processor -- start 2024-09-10T07:45:58.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.527+0000 7f38a0800640 1 -- start start 2024-09-10T07:45:58.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.528+0000 7f38a0800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389813fae0 0x7f389806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.529+0000 7f38a0800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3898160c50 0x7f38980cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.529+0000 7f38a0800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3898142650 con 0x7f3898142150 2024-09-10T07:45:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.529+0000 7f38a0800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f38980ce780 con 0x7f3898160c50 2024-09-10T07:45:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.529+0000 7f38a0800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f3898142930 con 0x7f389813fae0 2024-09-10T07:45:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.529+0000 7f389d400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3898142150 0x7f3898160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50880/0 (socket says 172.21.15.99:50880) 2024-09-10T07:45:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.529+0000 7f389d400640 1 -- 172.21.15.99:0/2578058126 learned_addr learned my addr 172.21.15.99:0/2578058126 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:45:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.529+0000 7f389e800640 1 --2- 172.21.15.99:0/2578058126 >> v2:172.21.15.187:3300/0 conn(0x7f3898160c50 0x7f38980cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.529+0000 7f389de00640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389813fae0 0x7f389806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.529+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458499384 0 0) 0x7f3898142650 con 0x7f3898142150 2024-09-10T07:45:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.529+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3880003520 con 0x7f3898142150 2024-09-10T07:45:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2664624238 0 0) 0x7f3880003520 con 0x7f3898142150 2024-09-10T07:45:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389813fae0 msgr2=0x7f389806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389813fae0 0x7f389806f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 >> v2:172.21.15.187:3300/0 conn(0x7f3898160c50 msgr2=0x7f38980cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 --2- 172.21.15.99:0/2578058126 >> v2:172.21.15.187:3300/0 conn(0x7f3898160c50 0x7f38980cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3898142c10 con 0x7f3898142150 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f3888001670 con 0x7f3898142150 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 >> v1:172.21.15.99:6789/0 conn(0x7f3898142150 legacy=0x7f3898160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38800039b0 0x7f3880003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3880004800 0x7f3880004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389813fae0 0x7f38800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3898142930 con 0x7f38800039b0 2024-09-10T07:45:58.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f388000b9c0 con 0x7f3880004800 2024-09-10T07:45:58.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f388000bb40 con 0x7f389813fae0 2024-09-10T07:45:58.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389de00640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38800039b0 0x7f3880003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389e800640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389813fae0 0x7f38800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389d400640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3880004800 0x7f3880004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389de00640 1 -- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389813fae0 msgr2=0x7f38800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:58.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389de00640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389813fae0 0x7f38800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389de00640 1 -- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3880004800 msgr2=0x7f3880004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:45:58.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389de00640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3880004800 0x7f3880004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.530+0000 7f389de00640 1 -- 172.21.15.99:0/2578058126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3880003520 con 0x7f38800039b0 2024-09-10T07:45:58.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.531+0000 7f389e800640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389813fae0 0x7f38800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:58.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.531+0000 7f389d400640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3880004800 0x7f3880004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:58.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.531+0000 7f389de00640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38800039b0 0x7f3880003dd0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f388c009af0 tx=0x7f3880005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d7666689ab6bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:58.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.532+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c036070 con 0x7f38800039b0 2024-09-10T07:45:58.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.532+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c031400 con 0x7f38800039b0 2024-09-10T07:45:58.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.532+0000 7f389ca00640 1 -- 172.21.15.99:0/2578058126 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c009690 con 0x7f38800039b0 2024-09-10T07:45:58.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.532+0000 7f38a0800640 1 -- 172.21.15.99:0/2578058126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38800039b0 msgr2=0x7f3880003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.532+0000 7f38a0800640 1 --2- 172.21.15.99:0/2578058126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38800039b0 0x7f3880003dd0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f388c009af0 tx=0x7f3880005830 comp rx=0 tx=0).stop 2024-09-10T07:45:58.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.532+0000 7f389e800640 1 -- 172.21.15.99:0/2578058126 reap_dead start 2024-09-10T07:45:58.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.532+0000 7f38a0800640 1 -- 172.21.15.99:0/2578058126 shutdown_connections 2024-09-10T07:45:58.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.532+0000 7f38a0800640 1 -- 172.21.15.99:0/2578058126 >> 172.21.15.99:0/2578058126 conn(0x7f389806bc10 msgr2=0x7f389806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.532+0000 7f38a0800640 1 -- 172.21.15.99:0/2578058126 shutdown_connections 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.532+0000 7f38a0800640 1 -- 172.21.15.99:0/2578058126 wait complete. 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.534+0000 7f38a0800640 1 Processor -- start 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.534+0000 7f38a0800640 1 -- start start 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.535+0000 7f38a0800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800039b0 0x7f389813fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.535+0000 7f38a0800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3898141540 0x7f3898144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.535+0000 7f38a0800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38981f20e0 0x7f3898072010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.535+0000 7f38a0800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f389806f330 con 0x7f38981f20e0 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.535+0000 7f38a0800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f389806f1b0 con 0x7f3898141540 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.535+0000 7f38a0800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f389806f4b0 con 0x7f38800039b0 2024-09-10T07:45:58.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.535+0000 7f389e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38981f20e0 0x7f3898072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.535+0000 7f389e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38981f20e0 0x7f3898072010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47164/0 (socket says 172.21.15.99:47164) 2024-09-10T07:45:58.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.535+0000 7f389e800640 1 -- 172.21.15.99:0/1031674017 learned_addr learned my addr 172.21.15.99:0/1031674017 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:45:58.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f389d400640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3898141540 0x7f3898144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f389de00640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800039b0 0x7f389813fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f389e800640 1 -- 172.21.15.99:0/1031674017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800039b0 msgr2=0x7f389813fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f389e800640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800039b0 0x7f389813fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f389e800640 1 -- 172.21.15.99:0/1031674017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3898141540 msgr2=0x7f3898144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f389e800640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3898141540 0x7f3898144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f389e800640 1 -- 172.21.15.99:0/1031674017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38980736c0 con 0x7f38981f20e0 2024-09-10T07:45:58.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f389d400640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3898141540 0x7f3898144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:45:58.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f389e800640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38981f20e0 0x7f3898072010 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f38980b39e0 tx=0x7f3894009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:58.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f3892000640 1 -- 172.21.15.99:0/1031674017 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389401a020 con 0x7f38981f20e0 2024-09-10T07:45:58.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f3892000640 1 -- 172.21.15.99:0/1031674017 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894011e60 con 0x7f38981f20e0 2024-09-10T07:45:58.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f38a0800640 1 -- 172.21.15.99:0/1031674017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38981404a0 con 0x7f38981f20e0 2024-09-10T07:45:58.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f3892000640 1 -- 172.21.15.99:0/1031674017 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38940166b0 con 0x7f38981f20e0 2024-09-10T07:45:58.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.536+0000 7f38a0800640 1 -- 172.21.15.99:0/1031674017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3898140a60 con 0x7f38981f20e0 2024-09-10T07:45:58.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.538+0000 7f38a0800640 1 -- 172.21.15.99:0/1031674017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3898160540 con 0x7f38981f20e0 2024-09-10T07:45:58.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.539+0000 7f3892000640 1 -- 172.21.15.99:0/1031674017 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3894005d10 con 0x7f38981f20e0 2024-09-10T07:45:58.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.540+0000 7f3892000640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f387c06be60 0x7f387c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:45:58.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.540+0000 7f3892000640 1 -- 172.21.15.99:0/1031674017 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f389408b7b0 con 0x7f38981f20e0 2024-09-10T07:45:58.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.540+0000 7f389de00640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f387c06be60 0x7f387c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:45:58.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.541+0000 7f389de00640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f387c06be60 0x7f387c06e320 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f388c033000 tx=0x7f388c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:45:58.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.544+0000 7f3892000640 1 -- 172.21.15.99:0/1031674017 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3894024030 con 0x7f38981f20e0 2024-09-10T07:45:58.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.780+0000 7f38a0800640 1 -- 172.21.15.99:0/1031674017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) -- 0x7f38980cfe50 con 0x7f38981f20e0 2024-09-10T07:45:58.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.990+0000 7f3892000640 1 -- 172.21.15.99:0/1031674017 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v550) ==== 135+0+0 (secure 0 0 0) 0x7f389405a450 con 0x7f38981f20e0 2024-09-10T07:45:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 -- 172.21.15.99:0/1031674017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f387c06be60 msgr2=0x7f387c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f387c06be60 0x7f387c06e320 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f388c033000 tx=0x7f388c008030 comp rx=0 tx=0).stop 2024-09-10T07:45:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 -- 172.21.15.99:0/1031674017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38981f20e0 msgr2=0x7f3898072010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:45:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38981f20e0 0x7f3898072010 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f38980b39e0 tx=0x7f3894009f90 comp rx=0 tx=0).stop 2024-09-10T07:45:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 -- 172.21.15.99:0/1031674017 shutdown_connections 2024-09-10T07:45:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f387c06be60 0x7f387c06e320 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38981f20e0 0x7f3898072010 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3898141540 0x7f3898144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 --2- 172.21.15.99:0/1031674017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38800039b0 0x7f389813fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:45:58.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 -- 172.21.15.99:0/1031674017 >> 172.21.15.99:0/1031674017 conn(0x7f389806bc10 msgr2=0x7f38980cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:45:58.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 -- 172.21.15.99:0/1031674017 shutdown_connections 2024-09-10T07:45:58.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:45:58.992+0000 7f38a0800640 1 -- 172.21.15.99:0/1031674017 wait complete. 2024-09-10T07:45:59.008 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-10T07:45:59.008 INFO:tasks.cephfs_test_runner: 2024-09-10T07:45:59.008 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T07:45:59.008 INFO:tasks.cephfs_test_runner:Ran 10 tests in 671.423s 2024-09-10T07:45:59.009 INFO:tasks.cephfs_test_runner: 2024-09-10T07:45:59.009 INFO:tasks.cephfs_test_runner:OK 2024-09-10T07:45:59.009 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-10T07:45:59.019 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T07:45:59.041 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T07:45:59.042 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:59.042 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:59.077 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:45:59.077 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T07:45:59.077 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:59.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052612,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248972k,nr_inodes=812243,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497948k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T07:45:59.152 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:45:59.152 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:59.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:45:59.192 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-10T07:45:59.192 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T07:45:59.270 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T07:45:59.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:59.271 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:45:59.306 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T07:45:59.306 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T07:45:59.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:59.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T07:45:59.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:59.404 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T07:45:59.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:59.668 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-09-10T07:45:59.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:45:59.973 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-10T07:46:00.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:46:00.010 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-09-10T07:46:00.112 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-09-10T07:46:00.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:46:00.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:46:00.115 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:46:00.154 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T07:46:00.154 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T07:46:00.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:46:00.155 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T07:46:00.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:46:00.257 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T07:46:00.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:46:00.534 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2024-09-10T07:46:00.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:46:00.846 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2024-09-10T07:46:00.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T07:46:00.882 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2024-09-10T07:46:00.983 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2024-09-10T07:46:00.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:46:00.985 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T07:46:01.000 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T07:46:01.001 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:46:01.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.162+0000 7f6092200640 1 Processor -- start 2024-09-10T07:46:01.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.162+0000 7f6092200640 1 -- start start 2024-09-10T07:46:01.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.163+0000 7f6092200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c142150 0x7f608c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.163+0000 7f6092200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f608c160a80 0x7f608c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.163+0000 7f6092200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f608c142650 con 0x7f608c13fae0 2024-09-10T07:46:01.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.163+0000 7f6092200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f608c0ce780 con 0x7f608c160a80 2024-09-10T07:46:01.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.163+0000 7f6092200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f608c142930 con 0x7f608c142150 2024-09-10T07:46:01.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.163+0000 7f608be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f608c160a80 0x7f608c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.163+0000 7f608be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f608c160a80 0x7f608c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40354/0 (socket says 172.21.15.99:40354) 2024-09-10T07:46:01.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.163+0000 7f608be00640 1 -- 172.21.15.99:0/2852536378 learned_addr learned my addr 172.21.15.99:0/2852536378 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:01.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.164+0000 7f6082a00640 1 --2- 172.21.15.99:0/2852536378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c142150 0x7f608c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.164+0000 7f608be00640 1 -- 172.21.15.99:0/2852536378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c142150 msgr2=0x7f608c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:01.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.164+0000 7f608be00640 1 --2- 172.21.15.99:0/2852536378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c142150 0x7f608c160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.164+0000 7f608be00640 1 -- 172.21.15.99:0/2852536378 >> v1:172.21.15.187:6789/0 conn(0x7f608c13fae0 legacy=0x7f608c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:01.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.164+0000 7f608be00640 1 -- 172.21.15.99:0/2852536378 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c142c10 con 0x7f608c160a80 2024-09-10T07:46:01.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.164+0000 7f6082a00640 1 --2- 172.21.15.99:0/2852536378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c142150 0x7f608c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:46:01.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.165+0000 7f608be00640 1 --2- 172.21.15.99:0/2852536378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c160a80 0x7f608c0cec10 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f6084009e50 tx=0x7f608402a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c047709c268e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:01.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.165+0000 7f608aa00640 1 -- 172.21.15.99:0/2852536378 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084036070 con 0x7f608c160a80 2024-09-10T07:46:01.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.165+0000 7f608aa00640 1 -- 172.21.15.99:0/2852536378 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6084031600 con 0x7f608c160a80 2024-09-10T07:46:01.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.165+0000 7f608aa00640 1 -- 172.21.15.99:0/2852536378 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60840319d0 con 0x7f608c160a80 2024-09-10T07:46:01.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.165+0000 7f6092200640 1 -- 172.21.15.99:0/2852536378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c160a80 msgr2=0x7f608c0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.165+0000 7f6092200640 1 --2- 172.21.15.99:0/2852536378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c160a80 0x7f608c0cec10 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f6084009e50 tx=0x7f608402a640 comp rx=0 tx=0).stop 2024-09-10T07:46:01.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.166+0000 7f6092200640 1 -- 172.21.15.99:0/2852536378 shutdown_connections 2024-09-10T07:46:01.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.166+0000 7f6092200640 1 --2- 172.21.15.99:0/2852536378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c160a80 0x7f608c0cec10 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.166+0000 7f6092200640 1 --2- 172.21.15.99:0/2852536378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c142150 0x7f608c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.166+0000 7f6092200640 1 -- 172.21.15.99:0/2852536378 >> 172.21.15.99:0/2852536378 conn(0x7f608c06bc10 msgr2=0x7f608c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:01.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.166+0000 7f6092200640 1 -- 172.21.15.99:0/2852536378 shutdown_connections 2024-09-10T07:46:01.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.166+0000 7f6092200640 1 -- 172.21.15.99:0/2852536378 wait complete. 2024-09-10T07:46:01.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.167+0000 7f6092200640 1 Processor -- start 2024-09-10T07:46:01.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.167+0000 7f6092200640 1 -- start start 2024-09-10T07:46:01.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.168+0000 7f6092200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f608c13fae0 0x7f608c1f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.168+0000 7f6092200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c142150 0x7f608c145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.168+0000 7f6092200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c160a80 0x7f608c0b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.168+0000 7f6092200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f608c0cf2d0 con 0x7f608c142150 2024-09-10T07:46:01.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.168+0000 7f6092200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f608c0cf150 con 0x7f608c13fae0 2024-09-10T07:46:01.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.168+0000 7f6092200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f608c0cf450 con 0x7f608c160a80 2024-09-10T07:46:01.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f6082a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c142150 0x7f608c145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f6082a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c142150 0x7f608c145860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40362/0 (socket says 172.21.15.99:40362) 2024-09-10T07:46:01.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f6082a00640 1 -- 172.21.15.99:0/1465670128 learned_addr learned my addr 172.21.15.99:0/1465670128 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:01.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f608b400640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f608c13fae0 0x7f608c1f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f608be00640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c160a80 0x7f608c0b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f6082a00640 1 -- 172.21.15.99:0/1465670128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c160a80 msgr2=0x7f608c0b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f6082a00640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c160a80 0x7f608c0b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f6082a00640 1 -- 172.21.15.99:0/1465670128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f608c13fae0 msgr2=0x7f608c1f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f6082a00640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f608c13fae0 0x7f608c1f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f6082a00640 1 -- 172.21.15.99:0/1465670128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c1435f0 con 0x7f608c142150 2024-09-10T07:46:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.169+0000 7f6082a00640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c142150 0x7f608c145860 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f607400c7f0 tx=0x7f607400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.170+0000 7f6083e00640 1 -- 172.21.15.99:0/1465670128 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074015070 con 0x7f608c142150 2024-09-10T07:46:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.170+0000 7f6083e00640 1 -- 172.21.15.99:0/1465670128 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6074007a30 con 0x7f608c142150 2024-09-10T07:46:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.170+0000 7f6083e00640 1 -- 172.21.15.99:0/1465670128 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074007e20 con 0x7f608c142150 2024-09-10T07:46:01.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.170+0000 7f6092200640 1 -- 172.21.15.99:0/1465670128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608c1438d0 con 0x7f608c142150 2024-09-10T07:46:01.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.170+0000 7f6092200640 1 -- 172.21.15.99:0/1465670128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608c143e90 con 0x7f608c142150 2024-09-10T07:46:01.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.171+0000 7f6092200640 1 -- 172.21.15.99:0/1465670128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f608c160540 con 0x7f608c142150 2024-09-10T07:46:01.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.172+0000 7f6083e00640 1 -- 172.21.15.99:0/1465670128 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6074018070 con 0x7f608c142150 2024-09-10T07:46:01.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.173+0000 7f6083e00640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f606806be30 0x7f606806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.173+0000 7f6083e00640 1 -- 172.21.15.99:0/1465670128 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f607408a7e0 con 0x7f608c142150 2024-09-10T07:46:01.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.173+0000 7f608b400640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f606806be30 0x7f606806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.174+0000 7f608b400640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f606806be30 0x7f606806e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f607c004f60 tx=0x7f607c007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:01.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.177+0000 7f6083e00640 1 -- 172.21.15.99:0/1465670128 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6074058d10 con 0x7f608c142150 2024-09-10T07:46:01.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.345+0000 7f6092200640 1 -- 172.21.15.99:0/1465670128 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f608c15c6c0 con 0x7f606806be30 2024-09-10T07:46:01.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.346+0000 7f6083e00640 1 -- 172.21.15.99:0/1465670128 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12592 (secure 0 0 0) 0x7f608c15c6c0 con 0x7f606806be30 2024-09-10T07:46:01.346 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:46:01.346 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:46:01.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.348+0000 7f6092200640 1 -- 172.21.15.99:0/1465670128 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f606806be30 msgr2=0x7f606806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.348+0000 7f6092200640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f606806be30 0x7f606806e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f607c004f60 tx=0x7f607c007e30 comp rx=0 tx=0).stop 2024-09-10T07:46:01.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.348+0000 7f6092200640 1 -- 172.21.15.99:0/1465670128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c142150 msgr2=0x7f608c145860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.348+0000 7f6092200640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c142150 0x7f608c145860 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f607400c7f0 tx=0x7f607400ccb0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.348+0000 7f6092200640 1 -- 172.21.15.99:0/1465670128 shutdown_connections 2024-09-10T07:46:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.348+0000 7f6092200640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f608c160a80 0x7f608c0b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.348+0000 7f6092200640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f606806be30 0x7f606806e2f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.348+0000 7f6092200640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f608c142150 0x7f608c145860 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.348+0000 7f6092200640 1 --2- 172.21.15.99:0/1465670128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f608c13fae0 0x7f608c1f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.348+0000 7f6092200640 1 -- 172.21.15.99:0/1465670128 >> 172.21.15.99:0/1465670128 conn(0x7f608c06bc10 msgr2=0x7f608c15b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.349+0000 7f6092200640 1 -- 172.21.15.99:0/1465670128 shutdown_connections 2024-09-10T07:46:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.349+0000 7f6092200640 1 -- 172.21.15.99:0/1465670128 wait complete. 2024-09-10T07:46:01.363 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2024-09-10T07:46:00.850163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":17908,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1544591,"statfs":{"total":1600000000,"available":1581661773,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490581,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-132,"num_write_kb":-85087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001185"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":509,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T07:45:57.986801+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:45:57.986801+0000","last_peered":"2024-09-10T07:45:57.986801+0000","last_clean":"2024-09-10T07:45:57.986801+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:45:57.986801+0000","last_undegraded":"2024-09-10T07:45:57.986801+0000","last_fullsized":"2024-09-10T07:45:57.986801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1647,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193664,"statfs":{"total":200000000,"available":198312826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9834,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185478,"statfs":{"total":200000000,"available":189929783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:46:01.364 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:46:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.517+0000 7fd7b6000640 1 Processor -- start 2024-09-10T07:46:01.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.517+0000 7fd7b6000640 1 -- start start 2024-09-10T07:46:01.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.518+0000 7fd7b6000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd7b00d3240 0x7fd7b00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.518+0000 7fd7b6000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b00b7a90 con 0x7fd7b00d1ab0 2024-09-10T07:46:01.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.518+0000 7fd7b6000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b00d3740 con 0x7fd7b015ef50 2024-09-10T07:46:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.518+0000 7fd7b6000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b00d3a20 con 0x7fd7b00d3240 2024-09-10T07:46:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.519+0000 7fd7aea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd7b00d1ab0 0x7fd7b00b8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53034/0 (socket says 172.21.15.99:53034) 2024-09-10T07:46:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.519+0000 7fd7aea00640 1 -- 172.21.15.99:0/170918198 learned_addr learned my addr 172.21.15.99:0/170918198 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:46:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.519+0000 7fd7afe00640 1 --2- 172.21.15.99:0/170918198 >> v2:172.21.15.187:3300/0 conn(0x7fd7b00d3240 0x7fd7b00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.519+0000 7fd7ae000640 1 -- 172.21.15.99:0/170918198 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492623751 0 0) 0x7fd7b00b7a90 con 0x7fd7b00d1ab0 2024-09-10T07:46:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.519+0000 7fd7afe00640 1 -- 172.21.15.99:0/170918198 >> v1:172.21.15.187:6789/0 conn(0x7fd7b015ef50 legacy=0x7fd7b00d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.519+0000 7fd7afe00640 1 -- 172.21.15.99:0/170918198 >> v1:172.21.15.99:6789/0 conn(0x7fd7b00d1ab0 legacy=0x7fd7b00b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.519+0000 7fd7afe00640 1 -- 172.21.15.99:0/170918198 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b00b7d00 con 0x7fd7b00d3240 2024-09-10T07:46:01.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.520+0000 7fd7afe00640 1 --2- 172.21.15.99:0/170918198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7b00d3240 0x7fd7b00b8c10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009d90 tx=0x7fd7a802a580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0ed245bbe2afd64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.521+0000 7fd7ae000640 1 -- 172.21.15.99:0/170918198 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8007740 con 0x7fd7b00d3240 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.521+0000 7fd7ae000640 1 -- 172.21.15.99:0/170918198 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a80078e0 con 0x7fd7b00d3240 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.521+0000 7fd7ae000640 1 -- 172.21.15.99:0/170918198 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8007cb0 con 0x7fd7b00d3240 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.521+0000 7fd7b6000640 1 -- 172.21.15.99:0/170918198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7b00d3240 msgr2=0x7fd7b00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.521+0000 7fd7b6000640 1 --2- 172.21.15.99:0/170918198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7b00d3240 0x7fd7b00b8c10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009d90 tx=0x7fd7a802a580 comp rx=0 tx=0).stop 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.521+0000 7fd7b6000640 1 -- 172.21.15.99:0/170918198 shutdown_connections 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.521+0000 7fd7b6000640 1 --2- 172.21.15.99:0/170918198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7b00d3240 0x7fd7b00b8c10 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.521+0000 7fd7b6000640 1 -- 172.21.15.99:0/170918198 >> 172.21.15.99:0/170918198 conn(0x7fd7b00d4c60 msgr2=0x7fd7b00d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.521+0000 7fd7b6000640 1 -- 172.21.15.99:0/170918198 shutdown_connections 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.521+0000 7fd7b6000640 1 -- 172.21.15.99:0/170918198 wait complete. 2024-09-10T07:46:01.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.523+0000 7fd7b6000640 1 Processor -- start 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.523+0000 7fd7b6000640 1 -- start start 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7b6000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7b00d1ab0 0x7fd7b00cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7b6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7b00d3240 0x7fd7b01f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7b6000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7b015ef50 0x7fd7b0146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7b6000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b00d21a0 con 0x7fd7b00d3240 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7b6000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b00d2020 con 0x7fd7b015ef50 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7b6000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b00d5780 con 0x7fd7b00d1ab0 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7aea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7b00d3240 0x7fd7b01f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7aea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7b00d3240 0x7fd7b01f87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40366/0 (socket says 172.21.15.99:40366) 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7aea00640 1 -- 172.21.15.99:0/4256177167 learned_addr learned my addr 172.21.15.99:0/4256177167 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7afe00640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7b015ef50 0x7fd7b0146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7af400640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7b00d1ab0 0x7fd7b00cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7aea00640 1 -- 172.21.15.99:0/4256177167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7b00d1ab0 msgr2=0x7fd7b00cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7aea00640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7b00d1ab0 0x7fd7b00cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7aea00640 1 -- 172.21.15.99:0/4256177167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7b015ef50 msgr2=0x7fd7b0146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7aea00640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7b015ef50 0x7fd7b0146e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.524+0000 7fd7aea00640 1 -- 172.21.15.99:0/4256177167 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b00ca490 con 0x7fd7b00d3240 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.525+0000 7fd7aea00640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7b00d3240 0x7fd7b01f87e0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00c4d0 tx=0x7fd79c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.525+0000 7fd7a7400640 1 -- 172.21.15.99:0/4256177167 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c018070 con 0x7fd7b00d3240 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.525+0000 7fd7a7400640 1 -- 172.21.15.99:0/4256177167 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79c0074e0 con 0x7fd7b00d3240 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.525+0000 7fd7a7400640 1 -- 172.21.15.99:0/4256177167 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c004a20 con 0x7fd7b00d3240 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.525+0000 7fd7b6000640 1 -- 172.21.15.99:0/4256177167 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b00ca770 con 0x7fd7b00d3240 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.525+0000 7fd7b6000640 1 -- 172.21.15.99:0/4256177167 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b00ca0d0 con 0x7fd7b00d3240 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.526+0000 7fd7b6000640 1 -- 172.21.15.99:0/4256177167 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b00d13a0 con 0x7fd7b00d3240 2024-09-10T07:46:01.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.527+0000 7fd7a7400640 1 -- 172.21.15.99:0/4256177167 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd79c01b070 con 0x7fd7b00d3240 2024-09-10T07:46:01.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.528+0000 7fd7a7400640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd79006be60 0x7fd79006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.528+0000 7fd7a7400640 1 -- 172.21.15.99:0/4256177167 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fd79c089f20 con 0x7fd7b00d3240 2024-09-10T07:46:01.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.528+0000 7fd7af400640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd79006be60 0x7fd79006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.529+0000 7fd7af400640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd79006be60 0x7fd79006e320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0007fd0 tx=0x7fd7a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:01.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.532+0000 7fd7a7400640 1 -- 172.21.15.99:0/4256177167 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd79c058b30 con 0x7fd7b00d3240 2024-09-10T07:46:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.702+0000 7fd7b6000640 1 -- 172.21.15.99:0/4256177167 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd7b015bae0 con 0x7fd79006be60 2024-09-10T07:46:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.703+0000 7fd7a7400640 1 -- 172.21.15.99:0/4256177167 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12592 (secure 0 0 0) 0x7fd7b015bae0 con 0x7fd79006be60 2024-09-10T07:46:01.703 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:46:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:46:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 -- 172.21.15.99:0/4256177167 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd79006be60 msgr2=0x7fd79006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd79006be60 0x7fd79006e320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0007fd0 tx=0x7fd7a0009040 comp rx=0 tx=0).stop 2024-09-10T07:46:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 -- 172.21.15.99:0/4256177167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7b00d3240 msgr2=0x7fd7b01f87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7b00d3240 0x7fd7b01f87e0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00c4d0 tx=0x7fd79c00c990 comp rx=0 tx=0).stop 2024-09-10T07:46:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 -- 172.21.15.99:0/4256177167 shutdown_connections 2024-09-10T07:46:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7b015ef50 0x7fd7b0146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fd79006be60 0x7fd79006e320 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7b00d3240 0x7fd7b01f87e0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 --2- 172.21.15.99:0/4256177167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7b00d1ab0 0x7fd7b00cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 -- 172.21.15.99:0/4256177167 >> 172.21.15.99:0/4256177167 conn(0x7fd7b00d4c60 msgr2=0x7fd7b00b8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 -- 172.21.15.99:0/4256177167 shutdown_connections 2024-09-10T07:46:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.705+0000 7fd7b6000640 1 -- 172.21.15.99:0/4256177167 wait complete. 2024-09-10T07:46:01.720 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2024-09-10T07:46:00.850163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":17908,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1544591,"statfs":{"total":1600000000,"available":1581661773,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490581,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-132,"num_write_kb":-85087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001185"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":509,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T07:45:57.986801+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:45:57.986801+0000","last_peered":"2024-09-10T07:45:57.986801+0000","last_clean":"2024-09-10T07:45:57.986801+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:45:57.986801+0000","last_undegraded":"2024-09-10T07:45:57.986801+0000","last_fullsized":"2024-09-10T07:45:57.986801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1647,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193664,"statfs":{"total":200000000,"available":198312826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9834,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185478,"statfs":{"total":200000000,"available":189929783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:46:01.721 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T07:46:01.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:46:01.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.874+0000 7ff175200640 1 Processor -- start 2024-09-10T07:46:01.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.874+0000 7ff175200640 1 -- start start 2024-09-10T07:46:01.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.875+0000 7ff175200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff1700c9710 0x7ff1701695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.875+0000 7ff175200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1700d2bd0 con 0x7ff17015e970 2024-09-10T07:46:01.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.876+0000 7ff175200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1700d2eb0 con 0x7ff1700d2680 2024-09-10T07:46:01.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.876+0000 7ff175200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ff1700d37e0 con 0x7ff1700c9710 2024-09-10T07:46:01.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.876+0000 7ff16fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff1700c9710 0x7ff1701695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.876+0000 7ff16f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff17015e970 0x7ff1700d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53038/0 (socket says 172.21.15.99:53038) 2024-09-10T07:46:01.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.876+0000 7ff16f400640 1 -- 172.21.15.99:0/1982832689 learned_addr learned my addr 172.21.15.99:0/1982832689 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:46:01.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.876+0000 7ff16fe00640 1 -- 172.21.15.99:0/1982832689 >> v1:172.21.15.187:6789/0 conn(0x7ff1700d2680 legacy=0x7ff1700cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.876+0000 7ff16fe00640 1 -- 172.21.15.99:0/1982832689 >> v1:172.21.15.99:6789/0 conn(0x7ff17015e970 legacy=0x7ff1700d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.876+0000 7ff16fe00640 1 -- 172.21.15.99:0/1982832689 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1700d3190 con 0x7ff1700c9710 2024-09-10T07:46:01.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.876+0000 7ff16e000640 1 -- 172.21.15.99:0/1982832689 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760798294 0 0) 0x7ff1700d2bd0 con 0x7ff17015e970 2024-09-10T07:46:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.877+0000 7ff16fe00640 1 --2- 172.21.15.99:0/1982832689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1700c9710 0x7ff1701695e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7ff1700d3960 tx=0x7ff16802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa5844d268fba24 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.878+0000 7ff16e000640 1 -- 172.21.15.99:0/1982832689 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168037070 con 0x7ff1700c9710 2024-09-10T07:46:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.878+0000 7ff16e000640 1 -- 172.21.15.99:0/1982832689 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff168007740 con 0x7ff1700c9710 2024-09-10T07:46:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.878+0000 7ff16e000640 1 -- 172.21.15.99:0/1982832689 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168007b10 con 0x7ff1700c9710 2024-09-10T07:46:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.878+0000 7ff175200640 1 -- 172.21.15.99:0/1982832689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1700c9710 msgr2=0x7ff1701695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.878+0000 7ff175200640 1 --2- 172.21.15.99:0/1982832689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1700c9710 0x7ff1701695e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7ff1700d3960 tx=0x7ff16802a780 comp rx=0 tx=0).stop 2024-09-10T07:46:01.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.878+0000 7ff175200640 1 -- 172.21.15.99:0/1982832689 shutdown_connections 2024-09-10T07:46:01.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.878+0000 7ff175200640 1 --2- 172.21.15.99:0/1982832689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1700c9710 0x7ff1701695e0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.878+0000 7ff175200640 1 -- 172.21.15.99:0/1982832689 >> 172.21.15.99:0/1982832689 conn(0x7ff17009de00 msgr2=0x7ff1700d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:01.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.878+0000 7ff175200640 1 -- 172.21.15.99:0/1982832689 shutdown_connections 2024-09-10T07:46:01.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.878+0000 7ff175200640 1 -- 172.21.15.99:0/1982832689 wait complete. 2024-09-10T07:46:01.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.880+0000 7ff175200640 1 Processor -- start 2024-09-10T07:46:01.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.880+0000 7ff175200640 1 -- start start 2024-09-10T07:46:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff175200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1700c9710 0x7ff1701583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff175200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1700d2680 0x7ff1701610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff175200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff17015e970 0x7ff17015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff175200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff17015eed0 con 0x7ff17015e970 2024-09-10T07:46:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff175200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff17015ed50 con 0x7ff1700d2680 2024-09-10T07:46:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff175200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff1700cfc90 con 0x7ff1700c9710 2024-09-10T07:46:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff16fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff17015e970 0x7ff17015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff16f400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1700c9710 0x7ff1701583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff16f400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1700c9710 0x7ff1701583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:58442/0 (socket says 172.21.15.99:58442) 2024-09-10T07:46:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff16f400640 1 -- 172.21.15.99:0/3213943970 learned_addr learned my addr 172.21.15.99:0/3213943970 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.881+0000 7ff16ea00640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1700d2680 0x7ff1701610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff16fe00640 1 -- 172.21.15.99:0/3213943970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1700c9710 msgr2=0x7ff1701583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff16fe00640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1700c9710 0x7ff1701583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff16fe00640 1 -- 172.21.15.99:0/3213943970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1700d2680 msgr2=0x7ff1701610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff16fe00640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1700d2680 0x7ff1701610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:01.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff16fe00640 1 -- 172.21.15.99:0/3213943970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff170161750 con 0x7ff17015e970 2024-09-10T07:46:01.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff16fe00640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff17015e970 0x7ff17015d1a0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7ff168031000 tx=0x7ff168004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:01.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff167400640 1 -- 172.21.15.99:0/3213943970 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168042030 con 0x7ff17015e970 2024-09-10T07:46:01.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff167400640 1 -- 172.21.15.99:0/3213943970 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff168007e40 con 0x7ff17015e970 2024-09-10T07:46:01.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff167400640 1 -- 172.21.15.99:0/3213943970 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168037040 con 0x7ff17015e970 2024-09-10T07:46:01.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff175200640 1 -- 172.21.15.99:0/3213943970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1701f4f20 con 0x7ff17015e970 2024-09-10T07:46:01.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.882+0000 7ff175200640 1 -- 172.21.15.99:0/3213943970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1701f54e0 con 0x7ff17015e970 2024-09-10T07:46:01.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.884+0000 7ff175200640 1 -- 172.21.15.99:0/3213943970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1700cf580 con 0x7ff17015e970 2024-09-10T07:46:01.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.884+0000 7ff167400640 1 -- 172.21.15.99:0/3213943970 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff168045070 con 0x7ff17015e970 2024-09-10T07:46:01.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.885+0000 7ff167400640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff15006be30 0x7ff15006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:01.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.885+0000 7ff167400640 1 -- 172.21.15.99:0/3213943970 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7ff1680abb70 con 0x7ff17015e970 2024-09-10T07:46:01.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.885+0000 7ff16f400640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff15006be30 0x7ff15006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:01.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.886+0000 7ff16f400640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff15006be30 0x7ff15006e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff160000f60 tx=0x7ff160007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:01.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:01.890+0000 7ff167400640 1 -- 172.21.15.99:0/3213943970 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff16807a1d0 con 0x7ff17015e970 2024-09-10T07:46:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.061+0000 7ff175200640 1 -- 172.21.15.99:0/3213943970 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1701f5720 con 0x7ff15006be30 2024-09-10T07:46:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.062+0000 7ff167400640 1 -- 172.21.15.99:0/3213943970 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12592 (secure 0 0 0) 0x7ff160004d30 con 0x7ff15006be30 2024-09-10T07:46:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:46:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:46:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.064+0000 7ff175200640 1 -- 172.21.15.99:0/3213943970 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff15006be30 msgr2=0x7ff15006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.064+0000 7ff175200640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff15006be30 0x7ff15006e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff160000f60 tx=0x7ff160007240 comp rx=0 tx=0).stop 2024-09-10T07:46:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.064+0000 7ff175200640 1 -- 172.21.15.99:0/3213943970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff17015e970 msgr2=0x7ff17015d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.064+0000 7ff175200640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff17015e970 0x7ff17015d1a0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7ff168031000 tx=0x7ff168004a40 comp rx=0 tx=0).stop 2024-09-10T07:46:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.065+0000 7ff175200640 1 -- 172.21.15.99:0/3213943970 shutdown_connections 2024-09-10T07:46:02.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.065+0000 7ff175200640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff15006be30 0x7ff15006e2f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.065+0000 7ff175200640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff17015e970 0x7ff17015d1a0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.065+0000 7ff175200640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1700d2680 0x7ff1701610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.065+0000 7ff175200640 1 --2- 172.21.15.99:0/3213943970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1700c9710 0x7ff1701583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.065+0000 7ff175200640 1 -- 172.21.15.99:0/3213943970 >> 172.21.15.99:0/3213943970 conn(0x7ff17009de00 msgr2=0x7ff17006d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:02.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.065+0000 7ff175200640 1 -- 172.21.15.99:0/3213943970 shutdown_connections 2024-09-10T07:46:02.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.065+0000 7ff175200640 1 -- 172.21.15.99:0/3213943970 wait complete. 2024-09-10T07:46:02.080 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2024-09-10T07:46:00.850163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":17908,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1544591,"statfs":{"total":1600000000,"available":1581661773,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490581,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-132,"num_write_kb":-85087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001185"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":509,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T07:45:57.986801+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:45:57.986801+0000","last_peered":"2024-09-10T07:45:57.986801+0000","last_clean":"2024-09-10T07:45:57.986801+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:45:57.986801+0000","last_undegraded":"2024-09-10T07:45:57.986801+0000","last_fullsized":"2024-09-10T07:45:57.986801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1647,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193664,"statfs":{"total":200000000,"available":198312826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9834,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185478,"statfs":{"total":200000000,"available":189929783,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:46:02.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T07:46:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.235+0000 7facaca00640 1 Processor -- start 2024-09-10T07:46:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.235+0000 7facaca00640 1 -- start start 2024-09-10T07:46:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.236+0000 7facaca00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faca815c960 0x7faca806d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.236+0000 7facaca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca806d920 con 0x7faca815c580 2024-09-10T07:46:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.236+0000 7facaca00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca806dc00 con 0x7faca80b5960 2024-09-10T07:46:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.236+0000 7facaca00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7faca80b3930 con 0x7faca815c960 2024-09-10T07:46:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.236+0000 7faca7400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faca815c580 0x7faca80cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53042/0 (socket says 172.21.15.99:53042) 2024-09-10T07:46:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.236+0000 7faca7400640 1 -- 172.21.15.99:0/1372956959 learned_addr learned my addr 172.21.15.99:0/1372956959 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:46:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.236+0000 7fac9ea00640 1 --2- 172.21.15.99:0/1372956959 >> v2:172.21.15.187:3300/0 conn(0x7faca815c960 0x7faca806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.237+0000 7fac9ea00640 1 -- 172.21.15.99:0/1372956959 >> v1:172.21.15.187:6789/0 conn(0x7faca80b5960 legacy=0x7faca806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.237+0000 7fac9ea00640 1 -- 172.21.15.99:0/1372956959 >> v1:172.21.15.99:6789/0 conn(0x7faca815c580 legacy=0x7faca80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.237+0000 7fac9ea00640 1 -- 172.21.15.99:0/1372956959 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca806dee0 con 0x7faca815c960 2024-09-10T07:46:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.237+0000 7faca6a00640 1 -- 172.21.15.99:0/1372956959 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996269499 0 0) 0x7faca806d920 con 0x7faca815c580 2024-09-10T07:46:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.238+0000 7fac9ea00640 1 --2- 172.21.15.99:0/1372956959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faca815c960 0x7faca806d340 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fac900097a0 tx=0x7fac9002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57cd97c196174318 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.238+0000 7faca6a00640 1 -- 172.21.15.99:0/1372956959 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90037070 con 0x7faca815c960 2024-09-10T07:46:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.238+0000 7faca6a00640 1 -- 172.21.15.99:0/1372956959 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac90032440 con 0x7faca815c960 2024-09-10T07:46:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.238+0000 7faca6a00640 1 -- 172.21.15.99:0/1372956959 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90032810 con 0x7faca815c960 2024-09-10T07:46:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.239+0000 7facaca00640 1 -- 172.21.15.99:0/1372956959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faca815c960 msgr2=0x7faca806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.239+0000 7facaca00640 1 --2- 172.21.15.99:0/1372956959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faca815c960 0x7faca806d340 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fac900097a0 tx=0x7fac9002a230 comp rx=0 tx=0).stop 2024-09-10T07:46:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.239+0000 7facaca00640 1 -- 172.21.15.99:0/1372956959 shutdown_connections 2024-09-10T07:46:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.239+0000 7facaca00640 1 --2- 172.21.15.99:0/1372956959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faca815c960 0x7faca806d340 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.239+0000 7facaca00640 1 -- 172.21.15.99:0/1372956959 >> 172.21.15.99:0/1372956959 conn(0x7faca80b2810 msgr2=0x7faca80b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.239+0000 7facaca00640 1 -- 172.21.15.99:0/1372956959 shutdown_connections 2024-09-10T07:46:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.239+0000 7facaca00640 1 -- 172.21.15.99:0/1372956959 wait complete. 2024-09-10T07:46:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.240+0000 7facaca00640 1 Processor -- start 2024-09-10T07:46:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.241+0000 7facaca00640 1 -- start start 2024-09-10T07:46:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.241+0000 7facaca00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faca80b5960 0x7faca81543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.241+0000 7facaca00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faca815c580 0x7faca80cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.241+0000 7facaca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faca8152e20 0x7faca80c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7facaca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7faca806c320 con 0x7faca8152e20 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7facaca00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faca80b5da0 con 0x7faca80b5960 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7facaca00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7faca806c4a0 con 0x7faca815c580 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7faca7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faca8152e20 0x7faca80c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7faca7400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faca80b5960 0x7faca81543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7faca7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faca8152e20 0x7faca80c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40402/0 (socket says 172.21.15.99:40402) 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7faca7e00640 1 -- 172.21.15.99:0/3933064971 learned_addr learned my addr 172.21.15.99:0/3933064971 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7fac9ea00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faca815c580 0x7faca80cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7faca7e00640 1 -- 172.21.15.99:0/3933064971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faca815c580 msgr2=0x7faca80cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7faca7e00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faca815c580 0x7faca80cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7faca7e00640 1 -- 172.21.15.99:0/3933064971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faca80b5960 msgr2=0x7faca81543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7faca7e00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faca80b5960 0x7faca81543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.242+0000 7faca7e00640 1 -- 172.21.15.99:0/3933064971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca814b850 con 0x7faca8152e20 2024-09-10T07:46:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.243+0000 7faca7e00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faca8152e20 0x7faca80c9d60 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7faca000c7d0 tx=0x7faca000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.243+0000 7fac9fe00640 1 -- 172.21.15.99:0/3933064971 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0003b70 con 0x7faca8152e20 2024-09-10T07:46:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.243+0000 7fac9fe00640 1 -- 172.21.15.99:0/3933064971 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca0003d30 con 0x7faca8152e20 2024-09-10T07:46:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.243+0000 7fac9fe00640 1 -- 172.21.15.99:0/3933064971 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca000aa90 con 0x7faca8152e20 2024-09-10T07:46:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.243+0000 7facaca00640 1 -- 172.21.15.99:0/3933064971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca8153320 con 0x7faca8152e20 2024-09-10T07:46:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.243+0000 7facaca00640 1 -- 172.21.15.99:0/3933064971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca81538e0 con 0x7faca8152e20 2024-09-10T07:46:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.244+0000 7facaca00640 1 -- 172.21.15.99:0/3933064971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca806d340 con 0x7faca8152e20 2024-09-10T07:46:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.245+0000 7fac9fe00640 1 -- 172.21.15.99:0/3933064971 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faca000ac30 con 0x7faca8152e20 2024-09-10T07:46:02.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.246+0000 7fac9fe00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac8406be60 0x7fac8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:02.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.246+0000 7fac9fe00640 1 -- 172.21.15.99:0/3933064971 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7faca008a960 con 0x7faca8152e20 2024-09-10T07:46:02.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.246+0000 7faca7400640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac8406be60 0x7fac8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:02.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.247+0000 7faca7400640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac8406be60 0x7fac8406e320 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fac98007f70 tx=0x7fac98007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.250+0000 7fac9fe00640 1 -- 172.21.15.99:0/3933064971 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faca0058fb0 con 0x7faca8152e20 2024-09-10T07:46:02.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.421+0000 7facaca00640 1 -- 172.21.15.99:0/3933064971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faca815f4b0 con 0x7faca8152e20 2024-09-10T07:46:02.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.422+0000 7fac9fe00640 1 -- 172.21.15.99:0/3933064971 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) ==== 74+0+13017 (secure 0 0 0) 0x7faca005d2b0 con 0x7faca8152e20 2024-09-10T07:46:02.422 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:46:02.422 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":194,"fsid":"d4ff4b75-2329-4b44-969c-780f31c4e94e","created":"2024-09-10T07:34:01.909153+0000","modified":"2024-09-10T07:45:57.973606+0000","last_up_change":"2024-09-10T07:34:08.146072+0000","last_in_change":"2024-09-10T07:34:05.134938+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T07:34:08.744575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6801","nonce":687905162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6803","nonce":687905162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6807","nonce":687905162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":687905162},{"type":"v1","addr":"172.21.15.99:6805","nonce":687905162}]},"public_addr":"172.21.15.99:6801/687905162","cluster_addr":"172.21.15.99:6803/687905162","heartbeat_back_addr":"172.21.15.99:6807/687905162","heartbeat_front_addr":"172.21.15.99:6805/687905162","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6812","nonce":452352031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6816","nonce":452352031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6824","nonce":452352031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":452352031},{"type":"v1","addr":"172.21.15.99:6820","nonce":452352031}]},"public_addr":"172.21.15.99:6812/452352031","cluster_addr":"172.21.15.99:6816/452352031","heartbeat_back_addr":"172.21.15.99:6824/452352031","heartbeat_front_addr":"172.21.15.99:6820/452352031","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6809","nonce":229492178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6811","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6813","nonce":229492178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6825","nonce":229492178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6815","nonce":229492178},{"type":"v1","addr":"172.21.15.99:6819","nonce":229492178}]},"public_addr":"172.21.15.99:6809/229492178","cluster_addr":"172.21.15.99:6813/229492178","heartbeat_back_addr":"172.21.15.99:6825/229492178","heartbeat_front_addr":"172.21.15.99:6819/229492178","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6823","nonce":1992812983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6827","nonce":1992812983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6831","nonce":1992812983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1992812983},{"type":"v1","addr":"172.21.15.99:6829","nonce":1992812983}]},"public_addr":"172.21.15.99:6823/1992812983","cluster_addr":"172.21.15.99:6827/1992812983","heartbeat_back_addr":"172.21.15.99:6831/1992812983","heartbeat_front_addr":"172.21.15.99:6829/1992812983","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6825","nonce":3032215980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6827","nonce":3032215980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6831","nonce":3032215980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3032215980},{"type":"v1","addr":"172.21.15.187:6829","nonce":3032215980}]},"public_addr":"172.21.15.187:6825/3032215980","cluster_addr":"172.21.15.187:6827/3032215980","heartbeat_back_addr":"172.21.15.187:6831/3032215980","heartbeat_front_addr":"172.21.15.187:6829/3032215980","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6801","nonce":3936971942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6803","nonce":3936971942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6807","nonce":3936971942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3936971942},{"type":"v1","addr":"172.21.15.187:6805","nonce":3936971942}]},"public_addr":"172.21.15.187:6801/3936971942","cluster_addr":"172.21.15.187:6803/3936971942","heartbeat_back_addr":"172.21.15.187:6807/3936971942","heartbeat_front_addr":"172.21.15.187:6805/3936971942","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6809","nonce":2894508630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6812","nonce":2894508630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6822","nonce":2894508630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6815","nonce":2894508630},{"type":"v1","addr":"172.21.15.187:6817","nonce":2894508630}]},"public_addr":"172.21.15.187:6809/2894508630","cluster_addr":"172.21.15.187:6812/2894508630","heartbeat_back_addr":"172.21.15.187:6822/2894508630","heartbeat_front_addr":"172.21.15.187:6817/2894508630","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6811","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6813","nonce":303826834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6816","nonce":303826834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6823","nonce":303826834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":303826834},{"type":"v1","addr":"172.21.15.187:6820","nonce":303826834}]},"public_addr":"172.21.15.187:6813/303826834","cluster_addr":"172.21.15.187:6816/303826834","heartbeat_back_addr":"172.21.15.187:6823/303826834","heartbeat_front_addr":"172.21.15.187:6820/303826834","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.318966+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.412508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.410090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.351224+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.407331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.339907+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.371532+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T07:34:06.352303+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:6837/256766417":"2024-09-11T07:45:55.036338+0000","172.21.15.99:6835/256766417":"2024-09-11T07:45:55.036338+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T07:46:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.424+0000 7facaca00640 1 -- 172.21.15.99:0/3933064971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac8406be60 msgr2=0x7fac8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.424+0000 7facaca00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac8406be60 0x7fac8406e320 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fac98007f70 tx=0x7fac98007f00 comp rx=0 tx=0).stop 2024-09-10T07:46:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.424+0000 7facaca00640 1 -- 172.21.15.99:0/3933064971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faca8152e20 msgr2=0x7faca80c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.424+0000 7facaca00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faca8152e20 0x7faca80c9d60 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7faca000c7d0 tx=0x7faca000cc90 comp rx=0 tx=0).stop 2024-09-10T07:46:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.424+0000 7facaca00640 1 -- 172.21.15.99:0/3933064971 shutdown_connections 2024-09-10T07:46:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.424+0000 7facaca00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fac8406be60 0x7fac8406e320 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.424+0000 7facaca00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faca8152e20 0x7faca80c9d60 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.424+0000 7facaca00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faca815c580 0x7faca80cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.424+0000 7facaca00640 1 --2- 172.21.15.99:0/3933064971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faca80b5960 0x7faca81543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.425+0000 7facaca00640 1 -- 172.21.15.99:0/3933064971 >> 172.21.15.99:0/3933064971 conn(0x7faca80b2810 msgr2=0x7faca815f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.425+0000 7facaca00640 1 -- 172.21.15.99:0/3933064971 shutdown_connections 2024-09-10T07:46:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:02.425+0000 7facaca00640 1 -- 172.21.15.99:0/3933064971 wait complete. 2024-09-10T07:46:03.441 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T07:46:03.441 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T07:46:03.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.608+0000 7f2260600640 1 Processor -- start 2024-09-10T07:46:03.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.608+0000 7f2260600640 1 -- start start 2024-09-10T07:46:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.609+0000 7f2260600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22581445a0 0x7f22580cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.609+0000 7f2260600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2258072d90 0x7f22580b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.609+0000 7f2260600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22580cd8c0 con 0x7f22580ced50 2024-09-10T07:46:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.609+0000 7f2260600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f225815fdd0 con 0x7f2258072d90 2024-09-10T07:46:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.609+0000 7f2260600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f22580b5f00 con 0x7f22581445a0 2024-09-10T07:46:03.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.610+0000 7f225dc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22581445a0 0x7f22580cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.610+0000 7f225e600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2258072d90 0x7f22580b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.610+0000 7f225e600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2258072d90 0x7f22580b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:55812/0 (socket says 172.21.15.99:55812) 2024-09-10T07:46:03.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.610+0000 7f225dc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22581445a0 0x7f22580cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:58464/0 (socket says 172.21.15.99:58464) 2024-09-10T07:46:03.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.610+0000 7f225e600640 1 -- 172.21.15.99:0/2041510098 learned_addr learned my addr 172.21.15.99:0/2041510098 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:03.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.610+0000 7f225dc00640 1 -- 172.21.15.99:0/2041510098 >> v2:172.21.15.187:3300/0 conn(0x7f2258072d90 msgr2=0x7f22580b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.610+0000 7f225dc00640 1 --2- 172.21.15.99:0/2041510098 >> v2:172.21.15.187:3300/0 conn(0x7f2258072d90 0x7f22580b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.610+0000 7f225dc00640 1 -- 172.21.15.99:0/2041510098 >> v1:172.21.15.187:6789/0 conn(0x7f22580ced50 legacy=0x7f2258072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.610+0000 7f225dc00640 1 -- 172.21.15.99:0/2041510098 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2258160310 con 0x7f22581445a0 2024-09-10T07:46:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.610+0000 7f225e600640 1 --2- 172.21.15.99:0/2041510098 >> v2:172.21.15.187:3300/0 conn(0x7f2258072d90 0x7f22580b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:46:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.611+0000 7f225dc00640 1 --2- 172.21.15.99:0/2041510098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22581445a0 0x7f22580cd380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097a0 tx=0x7f224c02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d80624799674eab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.612+0000 7f2257e00640 1 -- 172.21.15.99:0/2041510098 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c037070 con 0x7f22581445a0 2024-09-10T07:46:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.612+0000 7f2257e00640 1 -- 172.21.15.99:0/2041510098 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c02adb0 con 0x7f22581445a0 2024-09-10T07:46:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.612+0000 7f2257e00640 1 -- 172.21.15.99:0/2041510098 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c032660 con 0x7f22581445a0 2024-09-10T07:46:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.613+0000 7f2260600640 1 -- 172.21.15.99:0/2041510098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22581445a0 msgr2=0x7f22580cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.613+0000 7f2260600640 1 --2- 172.21.15.99:0/2041510098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22581445a0 0x7f22580cd380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097a0 tx=0x7f224c02a060 comp rx=0 tx=0).stop 2024-09-10T07:46:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.613+0000 7f2260600640 1 -- 172.21.15.99:0/2041510098 shutdown_connections 2024-09-10T07:46:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.613+0000 7f2260600640 1 --2- 172.21.15.99:0/2041510098 >> v2:172.21.15.187:3300/0 conn(0x7f2258072d90 0x7f22580b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.613+0000 7f2260600640 1 --2- 172.21.15.99:0/2041510098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22581445a0 0x7f22580cd380 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.613+0000 7f2260600640 1 -- 172.21.15.99:0/2041510098 >> 172.21.15.99:0/2041510098 conn(0x7f22580b26a0 msgr2=0x7f22580b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.613+0000 7f2260600640 1 -- 172.21.15.99:0/2041510098 shutdown_connections 2024-09-10T07:46:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.613+0000 7f2260600640 1 -- 172.21.15.99:0/2041510098 wait complete. 2024-09-10T07:46:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.614+0000 7f2260600640 1 Processor -- start 2024-09-10T07:46:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.614+0000 7f2260600640 1 -- start start 2024-09-10T07:46:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.615+0000 7f2260600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2258072d90 0x7f2258140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.615+0000 7f2260600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22580ced50 0x7f225815ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.615+0000 7f2260600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22581445a0 0x7f2258141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.615+0000 7f2260600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2258144980 con 0x7f2258072d90 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.615+0000 7f2260600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f22580b5c20 con 0x7f22581445a0 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.615+0000 7f2260600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2258144b00 con 0x7f22580ced50 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.615+0000 7f225dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2258072d90 0x7f2258140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.616+0000 7f225dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2258072d90 0x7f2258140eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40416/0 (socket says 172.21.15.99:40416) 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.616+0000 7f225dc00640 1 -- 172.21.15.99:0/3006011824 learned_addr learned my addr 172.21.15.99:0/3006011824 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.616+0000 7f225e600640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22581445a0 0x7f2258141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.616+0000 7f225d200640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22580ced50 0x7f225815ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.616+0000 7f225dc00640 1 -- 172.21.15.99:0/3006011824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22580ced50 msgr2=0x7f225815ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.616+0000 7f225dc00640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22580ced50 0x7f225815ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.616+0000 7f225dc00640 1 -- 172.21.15.99:0/3006011824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22581445a0 msgr2=0x7f2258141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.616+0000 7f225dc00640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22581445a0 0x7f2258141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.616+0000 7f225dc00640 1 -- 172.21.15.99:0/3006011824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2258160a90 con 0x7f2258072d90 2024-09-10T07:46:03.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.616+0000 7f225dc00640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2258072d90 0x7f2258140eb0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f224c0098c0 tx=0x7f224c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:03.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.617+0000 7f2255600640 1 -- 172.21.15.99:0/3006011824 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c041020 con 0x7f2258072d90 2024-09-10T07:46:03.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.617+0000 7f2255600640 1 -- 172.21.15.99:0/3006011824 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c03c670 con 0x7f2258072d90 2024-09-10T07:46:03.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.617+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2258160d70 con 0x7f2258072d90 2024-09-10T07:46:03.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.617+0000 7f2255600640 1 -- 172.21.15.99:0/3006011824 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c037040 con 0x7f2258072d90 2024-09-10T07:46:03.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.617+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2258161330 con 0x7f2258072d90 2024-09-10T07:46:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.618+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2258161710 con 0x7f2258072d90 2024-09-10T07:46:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.619+0000 7f2255600640 1 -- 172.21.15.99:0/3006011824 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f224c044020 con 0x7f2258072d90 2024-09-10T07:46:03.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.619+0000 7f2255600640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f223806be30 0x7f223806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.620+0000 7f2255600640 1 -- 172.21.15.99:0/3006011824 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f224c0ab2b0 con 0x7f2258072d90 2024-09-10T07:46:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.620+0000 7f225d200640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f223806be30 0x7f223806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.620+0000 7f2255600640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] conn(0x7f2238071cf0 0x7f2238074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.620+0000 7f2255600640 1 -- 172.21.15.99:0/3006011824 --> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f224c008eb0 con 0x7f2238071cf0 2024-09-10T07:46:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.620+0000 7f2255600640 1 -- 172.21.15.99:0/3006011824 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f224c0b2050 con 0x7f2258072d90 2024-09-10T07:46:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.620+0000 7f225e600640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] conn(0x7f2238071cf0 0x7f2238074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.621+0000 7f225d200640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f223806be30 0x7f223806e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f225815d090 tx=0x7f2244009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.621+0000 7f225e600640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] conn(0x7f2238071cf0 0x7f2238074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.621+0000 7f2255600640 1 -- 172.21.15.99:0/3006011824 <== osd.0 v2:172.21.15.99:6800/687905162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f224c008eb0 con 0x7f2238071cf0 2024-09-10T07:46:03.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.633+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 --> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2258144ec0 con 0x7f2238071cf0 2024-09-10T07:46:03.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.633+0000 7f2255600640 1 -- 172.21.15.99:0/3006011824 <== osd.0 v2:172.21.15.99:6800/687905162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f2258144ec0 con 0x7f2238071cf0 2024-09-10T07:46:03.633 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:46:03.633 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-10T07:46:03.633 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:46:03.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] conn(0x7f2238071cf0 msgr2=0x7f2238074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f2260600640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:6800/687905162,v1:172.21.15.99:6801/687905162] conn(0x7f2238071cf0 0x7f2238074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f223806be30 msgr2=0x7f223806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f2260600640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f223806be30 0x7f223806e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f225815d090 tx=0x7f2244009040 comp rx=0 tx=0).stop 2024-09-10T07:46:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2258072d90 msgr2=0x7f2258140eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f2260600640 1 --2- 172.21.15.99:0/3006011824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2258072d90 0x7f2258140eb0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f224c0098c0 tx=0x7f224c0046c0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f225e600640 1 -- 172.21.15.99:0/3006011824 reap_dead start 2024-09-10T07:46:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 shutdown_connections 2024-09-10T07:46:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 >> 172.21.15.99:0/3006011824 conn(0x7f22580b26a0 msgr2=0x7f22580cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 shutdown_connections 2024-09-10T07:46:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.634+0000 7f2260600640 1 -- 172.21.15.99:0/3006011824 wait complete. 2024-09-10T07:46:03.648 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T07:46:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.803+0000 7f35c8200640 1 Processor -- start 2024-09-10T07:46:03.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.803+0000 7f35c8200640 1 -- start start 2024-09-10T07:46:03.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.804+0000 7f35c8200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f35c00ce070 0x7f35c00b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.804+0000 7f35c8200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35c00cf890 0x7f35c00cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.804+0000 7f35c8200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c015d880 con 0x7f35c015bfb0 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.804+0000 7f35c8200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f35c00ce450 con 0x7f35c00ce070 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.804+0000 7f35c8200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f35c015c800 con 0x7f35c00cf890 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.804+0000 7f35c5800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f35c00ce070 0x7f35c00b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.805+0000 7f35c4e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f35c015bfb0 0x7f35c015d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53058/0 (socket says 172.21.15.99:53058) 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.805+0000 7f35c5800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f35c00ce070 0x7f35c00b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40420/0 (socket says 172.21.15.99:40420) 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.805+0000 7f35c4e00640 1 -- 172.21.15.99:0/3372965092 learned_addr learned my addr 172.21.15.99:0/3372965092 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.805+0000 7f35c6200640 1 --2- 172.21.15.99:0/3372965092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35c00cf890 0x7f35c00cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.805+0000 7f35c5800640 1 -- 172.21.15.99:0/3372965092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35c00cf890 msgr2=0x7f35c00cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.805+0000 7f35c5800640 1 --2- 172.21.15.99:0/3372965092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35c00cf890 0x7f35c00cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.805+0000 7f35c5800640 1 -- 172.21.15.99:0/3372965092 >> v1:172.21.15.99:6789/0 conn(0x7f35c015bfb0 legacy=0x7f35c015d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.805+0000 7f35c5800640 1 -- 172.21.15.99:0/3372965092 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c015cae0 con 0x7f35c00ce070 2024-09-10T07:46:03.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.805+0000 7f35bfe00640 1 -- 172.21.15.99:0/3372965092 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529662280 0 0) 0x7f35c015d880 con 0x7f35c015bfb0 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.806+0000 7f35c5800640 1 --2- 172.21.15.99:0/3372965092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 0x7f35c00b5750 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f35b40097a0 tx=0x7f35b402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35003dd0f1b48b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.806+0000 7f35bfe00640 1 -- 172.21.15.99:0/3372965092 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4037070 con 0x7f35c00ce070 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.806+0000 7f35bfe00640 1 -- 172.21.15.99:0/3372965092 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b4032440 con 0x7f35c00ce070 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.806+0000 7f35bfe00640 1 -- 172.21.15.99:0/3372965092 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4032810 con 0x7f35c00ce070 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.807+0000 7f35c8200640 1 -- 172.21.15.99:0/3372965092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 msgr2=0x7f35c00b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.807+0000 7f35c8200640 1 --2- 172.21.15.99:0/3372965092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 0x7f35c00b5750 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f35b40097a0 tx=0x7f35b402a180 comp rx=0 tx=0).stop 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.807+0000 7f35c8200640 1 -- 172.21.15.99:0/3372965092 shutdown_connections 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.807+0000 7f35c8200640 1 --2- 172.21.15.99:0/3372965092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35c00cf890 0x7f35c00cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.807+0000 7f35c8200640 1 --2- 172.21.15.99:0/3372965092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 0x7f35c00b5750 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.807+0000 7f35c8200640 1 -- 172.21.15.99:0/3372965092 >> 172.21.15.99:0/3372965092 conn(0x7f35c00b2630 msgr2=0x7f35c00b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.807+0000 7f35c8200640 1 -- 172.21.15.99:0/3372965092 shutdown_connections 2024-09-10T07:46:03.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.807+0000 7f35c8200640 1 -- 172.21.15.99:0/3372965092 wait complete. 2024-09-10T07:46:03.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.808+0000 7f35c8200640 1 Processor -- start 2024-09-10T07:46:03.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.809+0000 7f35c8200640 1 -- start start 2024-09-10T07:46:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.809+0000 7f35c8200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 0x7f35c0150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.809+0000 7f35c8200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c00cf890 0x7f35c0143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.809+0000 7f35c8200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35c015bfb0 0x7f35c00b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.809+0000 7f35c8200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f35c015c590 con 0x7f35c00ce070 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.809+0000 7f35c8200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f35c015c410 con 0x7f35c00cf890 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.809+0000 7f35c8200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f35c006e080 con 0x7f35c015bfb0 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 0x7f35c0150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 0x7f35c0150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40434/0 (socket says 172.21.15.99:40434) 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c5800640 1 -- 172.21.15.99:0/2345231644 learned_addr learned my addr 172.21.15.99:0/2345231644 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c6200640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35c015bfb0 0x7f35c00b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c4e00640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c00cf890 0x7f35c0143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c5800640 1 -- 172.21.15.99:0/2345231644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35c015bfb0 msgr2=0x7f35c00b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c5800640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35c015bfb0 0x7f35c00b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c5800640 1 -- 172.21.15.99:0/2345231644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c00cf890 msgr2=0x7f35c0143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c5800640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c00cf890 0x7f35c0143160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c5800640 1 -- 172.21.15.99:0/2345231644 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c014e5e0 con 0x7f35c00ce070 2024-09-10T07:46:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.810+0000 7f35c5800640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 0x7f35c0150c10 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f35b4035040 tx=0x7f35b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.811+0000 7f35bd600640 1 -- 172.21.15.99:0/2345231644 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4037050 con 0x7f35c00ce070 2024-09-10T07:46:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.811+0000 7f35bd600640 1 -- 172.21.15.99:0/2345231644 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b4038040 con 0x7f35c00ce070 2024-09-10T07:46:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.811+0000 7f35bd600640 1 -- 172.21.15.99:0/2345231644 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4004470 con 0x7f35c00ce070 2024-09-10T07:46:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.811+0000 7f35c8200640 1 -- 172.21.15.99:0/2345231644 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c014dfd0 con 0x7f35c00ce070 2024-09-10T07:46:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.811+0000 7f35c8200640 1 -- 172.21.15.99:0/2345231644 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c00b19f0 con 0x7f35c00ce070 2024-09-10T07:46:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.812+0000 7f35c8200640 1 -- 172.21.15.99:0/2345231644 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c00b5750 con 0x7f35c00ce070 2024-09-10T07:46:03.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.813+0000 7f35bd600640 1 -- 172.21.15.99:0/2345231644 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35b4030900 con 0x7f35c00ce070 2024-09-10T07:46:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.814+0000 7f35bd600640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f35a006be30 0x7f35a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.814+0000 7f35bd600640 1 -- 172.21.15.99:0/2345231644 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f35b40ab760 con 0x7f35c00ce070 2024-09-10T07:46:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.814+0000 7f35c4e00640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f35a006be30 0x7f35a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.815+0000 7f35c4e00640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f35a006be30 0x7f35a006e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f35c00cf760 tx=0x7f35ac007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.818+0000 7f35bd600640 1 -- 172.21.15.99:0/2345231644 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35b407a370 con 0x7f35c00ce070 2024-09-10T07:46:03.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.992+0000 7f35c8200640 1 -- 172.21.15.99:0/2345231644 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f35c00b3f20 con 0x7f35a006be30 2024-09-10T07:46:03.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.992+0000 7f35bd600640 1 -- 172.21.15.99:0/2345231644 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f35c00b3f20 con 0x7f35a006be30 2024-09-10T07:46:03.992 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T07:46:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 -- 172.21.15.99:0/2345231644 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f35a006be30 msgr2=0x7f35a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f35a006be30 0x7f35a006e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f35c00cf760 tx=0x7f35ac007c00 comp rx=0 tx=0).stop 2024-09-10T07:46:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 -- 172.21.15.99:0/2345231644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 msgr2=0x7f35c0150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 0x7f35c0150c10 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f35b4035040 tx=0x7f35b40046c0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 -- 172.21.15.99:0/2345231644 shutdown_connections 2024-09-10T07:46:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35c015bfb0 0x7f35c00b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c00cf890 0x7f35c0143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f35a006be30 0x7f35a006e2f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 --2- 172.21.15.99:0/2345231644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35c00ce070 0x7f35c0150c10 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:03.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 -- 172.21.15.99:0/2345231644 >> 172.21.15.99:0/2345231644 conn(0x7f35c00b2630 msgr2=0x7f35c00b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:03.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 -- 172.21.15.99:0/2345231644 shutdown_connections 2024-09-10T07:46:03.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:03.994+0000 7f35c8200640 1 -- 172.21.15.99:0/2345231644 wait complete. 2024-09-10T07:46:04.011 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T07:46:04.011 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T07:46:04.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.169+0000 7f7e74800640 1 Processor -- start 2024-09-10T07:46:04.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.169+0000 7f7e74800640 1 -- start start 2024-09-10T07:46:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.171+0000 7f7e74800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e6c06e5e0 0x7f7e6c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.171+0000 7f7e74800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e6c15dfc0 con 0x7f7e6c0ce460 2024-09-10T07:46:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.171+0000 7f7e74800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e6c15d3b0 con 0x7f7e6c15e470 2024-09-10T07:46:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.171+0000 7f7e74800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7e6c06ef80 con 0x7f7e6c06e5e0 2024-09-10T07:46:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.171+0000 7f7e71e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7e6c0ce460 0x7f7e6c0cfee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53070/0 (socket says 172.21.15.99:53070) 2024-09-10T07:46:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.171+0000 7f7e71e00640 1 -- 172.21.15.99:0/1957565883 learned_addr learned my addr 172.21.15.99:0/1957565883 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:46:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.171+0000 7f7e71400640 1 --2- 172.21.15.99:0/1957565883 >> v2:172.21.15.187:3300/0 conn(0x7f7e6c06e5e0 0x7f7e6c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.171+0000 7f7e70a00640 1 -- 172.21.15.99:0/1957565883 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4119111691 0 0) 0x7f7e6c15dfc0 con 0x7f7e6c0ce460 2024-09-10T07:46:04.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.171+0000 7f7e70a00640 1 -- 172.21.15.99:0/1957565883 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e54003520 con 0x7f7e6c0ce460 2024-09-10T07:46:04.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.172+0000 7f7e71400640 1 -- 172.21.15.99:0/1957565883 >> v1:172.21.15.187:6789/0 conn(0x7f7e6c15e470 legacy=0x7f7e6c15e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.172+0000 7f7e71400640 1 -- 172.21.15.99:0/1957565883 >> v1:172.21.15.99:6789/0 conn(0x7f7e6c0ce460 legacy=0x7f7e6c0cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.172+0000 7f7e70a00640 1 -- 172.21.15.99:0/1957565883 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3445306786 0 0) 0x7f7e54003520 con 0x7f7e6c0ce460 2024-09-10T07:46:04.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.172+0000 7f7e71400640 1 -- 172.21.15.99:0/1957565883 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6c15d690 con 0x7f7e6c06e5e0 2024-09-10T07:46:04.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.173+0000 7f7e71400640 1 --2- 172.21.15.99:0/1957565883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e6c06e5e0 0x7f7e6c06ea40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0097a0 tx=0x7f7e5c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c69fa3ad1b0e1a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.173+0000 7f7e70a00640 1 -- 172.21.15.99:0/1957565883 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c037070 con 0x7f7e6c06e5e0 2024-09-10T07:46:04.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.173+0000 7f7e70a00640 1 -- 172.21.15.99:0/1957565883 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5c02ac50 con 0x7f7e6c06e5e0 2024-09-10T07:46:04.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.173+0000 7f7e70a00640 1 -- 172.21.15.99:0/1957565883 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60001670 con 0x7f7e6c06e5e0 2024-09-10T07:46:04.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.174+0000 7f7e74800640 1 -- 172.21.15.99:0/1957565883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e6c06e5e0 msgr2=0x7f7e6c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.174+0000 7f7e74800640 1 --2- 172.21.15.99:0/1957565883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e6c06e5e0 0x7f7e6c06ea40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0097a0 tx=0x7f7e5c02a1c0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.174+0000 7f7e74800640 1 -- 172.21.15.99:0/1957565883 shutdown_connections 2024-09-10T07:46:04.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.174+0000 7f7e74800640 1 --2- 172.21.15.99:0/1957565883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e6c06e5e0 0x7f7e6c06ea40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.174+0000 7f7e74800640 1 -- 172.21.15.99:0/1957565883 >> 172.21.15.99:0/1957565883 conn(0x7f7e6c0b26a0 msgr2=0x7f7e6c0b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:04.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.174+0000 7f7e74800640 1 -- 172.21.15.99:0/1957565883 shutdown_connections 2024-09-10T07:46:04.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.174+0000 7f7e74800640 1 -- 172.21.15.99:0/1957565883 wait complete. 2024-09-10T07:46:04.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.175+0000 7f7e74800640 1 Processor -- start 2024-09-10T07:46:04.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.175+0000 7f7e74800640 1 -- start start 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.176+0000 7f7e74800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e6c06e5e0 0x7f7e6c1424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.176+0000 7f7e74800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e6c0ce460 0x7f7e6c158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.176+0000 7f7e74800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e6c15e470 0x7f7e6c154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.176+0000 7f7e74800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c0ce840 con 0x7f7e6c15e470 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.176+0000 7f7e74800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c15dc50 con 0x7f7e6c06e5e0 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.176+0000 7f7e74800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6c0d05f0 con 0x7f7e6c0ce460 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e72800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e6c15e470 0x7f7e6c154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e72800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e6c15e470 0x7f7e6c154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40450/0 (socket says 172.21.15.99:40450) 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e72800640 1 -- 172.21.15.99:0/1020921787 learned_addr learned my addr 172.21.15.99:0/1020921787 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e71e00640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e6c06e5e0 0x7f7e6c1424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e71400640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e6c0ce460 0x7f7e6c158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e72800640 1 -- 172.21.15.99:0/1020921787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e6c0ce460 msgr2=0x7f7e6c158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e72800640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e6c0ce460 0x7f7e6c158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e72800640 1 -- 172.21.15.99:0/1020921787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e6c06e5e0 msgr2=0x7f7e6c1424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e72800640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e6c06e5e0 0x7f7e6c1424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e72800640 1 -- 172.21.15.99:0/1020921787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6c155080 con 0x7f7e6c15e470 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e71e00640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e6c06e5e0 0x7f7e6c1424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e71400640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e6c0ce460 0x7f7e6c158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.177+0000 7f7e72800640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e6c15e470 0x7f7e6c154350 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c6b0 tx=0x7f7e6800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.178+0000 7f7e66000640 1 -- 172.21.15.99:0/1020921787 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68003b70 con 0x7f7e6c15e470 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.178+0000 7f7e66000640 1 -- 172.21.15.99:0/1020921787 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e68003d30 con 0x7f7e6c15e470 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.178+0000 7f7e66000640 1 -- 172.21.15.99:0/1020921787 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68005310 con 0x7f7e6c15e470 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.178+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e6c155360 con 0x7f7e6c15e470 2024-09-10T07:46:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.178+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e6c155920 con 0x7f7e6c15e470 2024-09-10T07:46:04.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.179+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e6c155d00 con 0x7f7e6c15e470 2024-09-10T07:46:04.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.180+0000 7f7e66000640 1 -- 172.21.15.99:0/1020921787 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e680054b0 con 0x7f7e6c15e470 2024-09-10T07:46:04.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.181+0000 7f7e66000640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e5006be30 0x7f7e5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.181+0000 7f7e66000640 1 -- 172.21.15.99:0/1020921787 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f7e6808b490 con 0x7f7e6c15e470 2024-09-10T07:46:04.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.181+0000 7f7e71e00640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e5006be30 0x7f7e5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.181+0000 7f7e66000640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] conn(0x7f7e50071cf0 0x7f7e50074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.181+0000 7f7e66000640 1 -- 172.21.15.99:0/1020921787 --> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e6801fec0 con 0x7f7e50071cf0 2024-09-10T07:46:04.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.181+0000 7f7e66000640 1 -- 172.21.15.99:0/1020921787 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f7e6808b840 con 0x7f7e6c15e470 2024-09-10T07:46:04.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.182+0000 7f7e71400640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] conn(0x7f7e50071cf0 0x7f7e50074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.182+0000 7f7e71e00640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e5006be30 0x7f7e5006e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7e60005880 tx=0x7f7e60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.182+0000 7f7e71400640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] conn(0x7f7e50071cf0 0x7f7e50074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.183+0000 7f7e66000640 1 -- 172.21.15.99:0/1020921787 <== osd.1 v2:172.21.15.99:6810/452352031 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f7e6801fec0 con 0x7f7e50071cf0 2024-09-10T07:46:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.195+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 --> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7e6c1594f0 con 0x7f7e50071cf0 2024-09-10T07:46:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.195+0000 7f7e66000640 1 -- 172.21.15.99:0/1020921787 <== osd.1 v2:172.21.15.99:6810/452352031 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f7e6c1594f0 con 0x7f7e50071cf0 2024-09-10T07:46:04.195 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:46:04.195 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-10T07:46:04.195 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:46:04.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.195+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] conn(0x7f7e50071cf0 msgr2=0x7f7e50074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.195+0000 7f7e74800640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:6810/452352031,v1:172.21.15.99:6812/452352031] conn(0x7f7e50071cf0 0x7f7e50074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.195+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e5006be30 msgr2=0x7f7e5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.196+0000 7f7e74800640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7e5006be30 0x7f7e5006e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7e60005880 tx=0x7f7e60009040 comp rx=0 tx=0).stop 2024-09-10T07:46:04.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.196+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e6c15e470 msgr2=0x7f7e6c154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.196+0000 7f7e74800640 1 --2- 172.21.15.99:0/1020921787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e6c15e470 0x7f7e6c154350 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c6b0 tx=0x7f7e6800cb70 comp rx=0 tx=0).stop 2024-09-10T07:46:04.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.196+0000 7f7e72800640 1 -- 172.21.15.99:0/1020921787 reap_dead start 2024-09-10T07:46:04.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.196+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 shutdown_connections 2024-09-10T07:46:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.196+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 >> 172.21.15.99:0/1020921787 conn(0x7f7e6c0b26a0 msgr2=0x7f7e6c0b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.196+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 shutdown_connections 2024-09-10T07:46:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.196+0000 7f7e74800640 1 -- 172.21.15.99:0/1020921787 wait complete. 2024-09-10T07:46:04.211 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T07:46:04.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.365+0000 7fcf80600640 1 Processor -- start 2024-09-10T07:46:04.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.365+0000 7fcf80600640 1 -- start start 2024-09-10T07:46:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.366+0000 7fcf80600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf7815ee60 0x7fcf7806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.366+0000 7fcf80600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 0x7fcf7806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.366+0000 7fcf80600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf780d19b0 con 0x7fcf7806dc40 2024-09-10T07:46:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.366+0000 7fcf80600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fcf7815f240 con 0x7fcf7815ee60 2024-09-10T07:46:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.366+0000 7fcf80600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcf780d1c90 con 0x7fcf780b5180 2024-09-10T07:46:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.367+0000 7fcf7d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 0x7fcf7806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.367+0000 7fcf7dc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf7815ee60 0x7fcf7806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.367+0000 7fcf7d200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 0x7fcf7806d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:58492/0 (socket says 172.21.15.99:58492) 2024-09-10T07:46:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.367+0000 7fcf7dc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf7815ee60 0x7fcf7806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:55856/0 (socket says 172.21.15.99:55856) 2024-09-10T07:46:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.367+0000 7fcf7d200640 1 -- 172.21.15.99:0/881627375 learned_addr learned my addr 172.21.15.99:0/881627375 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.367+0000 7fcf7d200640 1 -- 172.21.15.99:0/881627375 >> v2:172.21.15.187:3300/0 conn(0x7fcf7815ee60 msgr2=0x7fcf7806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.367+0000 7fcf7d200640 1 --2- 172.21.15.99:0/881627375 >> v2:172.21.15.187:3300/0 conn(0x7fcf7815ee60 0x7fcf7806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.367+0000 7fcf7d200640 1 -- 172.21.15.99:0/881627375 >> v1:172.21.15.187:6789/0 conn(0x7fcf7806dc40 legacy=0x7fcf781628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.367+0000 7fcf7d200640 1 -- 172.21.15.99:0/881627375 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf780d1f70 con 0x7fcf780b5180 2024-09-10T07:46:04.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.368+0000 7fcf7d200640 1 --2- 172.21.15.99:0/881627375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 0x7fcf7806d700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009870 tx=0x7fcf6402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8e4d5cf8b91c753 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.368+0000 7fcf77e00640 1 -- 172.21.15.99:0/881627375 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64037070 con 0x7fcf780b5180 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.368+0000 7fcf77e00640 1 -- 172.21.15.99:0/881627375 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf64032440 con 0x7fcf780b5180 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.368+0000 7fcf77e00640 1 -- 172.21.15.99:0/881627375 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64032810 con 0x7fcf780b5180 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.369+0000 7fcf80600640 1 -- 172.21.15.99:0/881627375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 msgr2=0x7fcf7806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.369+0000 7fcf80600640 1 --2- 172.21.15.99:0/881627375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 0x7fcf7806d700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009870 tx=0x7fcf6402a250 comp rx=0 tx=0).stop 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.369+0000 7fcf80600640 1 -- 172.21.15.99:0/881627375 shutdown_connections 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.369+0000 7fcf80600640 1 --2- 172.21.15.99:0/881627375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 0x7fcf7806d700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.369+0000 7fcf80600640 1 --2- 172.21.15.99:0/881627375 >> v2:172.21.15.187:3300/0 conn(0x7fcf7815ee60 0x7fcf7806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.369+0000 7fcf80600640 1 -- 172.21.15.99:0/881627375 >> 172.21.15.99:0/881627375 conn(0x7fcf780b45f0 msgr2=0x7fcf780b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.369+0000 7fcf80600640 1 -- 172.21.15.99:0/881627375 shutdown_connections 2024-09-10T07:46:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.369+0000 7fcf80600640 1 -- 172.21.15.99:0/881627375 wait complete. 2024-09-10T07:46:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.371+0000 7fcf80600640 1 Processor -- start 2024-09-10T07:46:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.371+0000 7fcf80600640 1 -- start start 2024-09-10T07:46:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf80600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7806dc40 0x7fcf7815c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf80600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 0x7fcf780b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf80600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf7815ee60 0x7fcf780cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf80600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcf780b3940 con 0x7fcf7806dc40 2024-09-10T07:46:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf80600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcf780b37c0 con 0x7fcf7815ee60 2024-09-10T07:46:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf80600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fcf780b3ac0 con 0x7fcf780b5180 2024-09-10T07:46:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf7dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7806dc40 0x7fcf7815c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf7dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7806dc40 0x7fcf7815c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40458/0 (socket says 172.21.15.99:40458) 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf7dc00640 1 -- 172.21.15.99:0/2596746787 learned_addr learned my addr 172.21.15.99:0/2596746787 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf7d200640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 0x7fcf780b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf7e600640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf7815ee60 0x7fcf780cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf7dc00640 1 -- 172.21.15.99:0/2596746787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 msgr2=0x7fcf780b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf7dc00640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 0x7fcf780b8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf7dc00640 1 -- 172.21.15.99:0/2596746787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf7815ee60 msgr2=0x7fcf780cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf7dc00640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf7815ee60 0x7fcf780cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.372+0000 7fcf7dc00640 1 -- 172.21.15.99:0/2596746787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf780b87b0 con 0x7fcf7806dc40 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.373+0000 7fcf7e600640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf7815ee60 0x7fcf780cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.373+0000 7fcf7dc00640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7806dc40 0x7fcf7815c2a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00e870 tx=0x7fcf6c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.373+0000 7fcf75600640 1 -- 172.21.15.99:0/2596746787 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c017070 con 0x7fcf7806dc40 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.373+0000 7fcf75600640 1 -- 172.21.15.99:0/2596746787 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6c00c940 con 0x7fcf7806dc40 2024-09-10T07:46:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.373+0000 7fcf80600640 1 -- 172.21.15.99:0/2596746787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf781e8a40 con 0x7fcf7806dc40 2024-09-10T07:46:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.373+0000 7fcf75600640 1 -- 172.21.15.99:0/2596746787 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00cd30 con 0x7fcf7806dc40 2024-09-10T07:46:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.373+0000 7fcf80600640 1 -- 172.21.15.99:0/2596746787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf781e9000 con 0x7fcf7806dc40 2024-09-10T07:46:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.375+0000 7fcf80600640 1 -- 172.21.15.99:0/2596746787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf7806d700 con 0x7fcf7806dc40 2024-09-10T07:46:04.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.375+0000 7fcf75600640 1 -- 172.21.15.99:0/2596746787 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf6c01a070 con 0x7fcf7806dc40 2024-09-10T07:46:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.376+0000 7fcf75600640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf5806be30 0x7fcf5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.376+0000 7fcf75600640 1 -- 172.21.15.99:0/2596746787 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fcf6c08aa20 con 0x7fcf7806dc40 2024-09-10T07:46:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.376+0000 7fcf7d200640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf5806be30 0x7fcf5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.377+0000 7fcf7d200640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf5806be30 0x7fcf5806e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcf64034000 tx=0x7fcf6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.381+0000 7fcf75600640 1 -- 172.21.15.99:0/2596746787 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf780b87b0 con 0x7fcf7806dc40 2024-09-10T07:46:04.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.553+0000 7fcf80600640 1 -- 172.21.15.99:0/2596746787 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fcf780b8a40 con 0x7fcf5806be30 2024-09-10T07:46:04.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.553+0000 7fcf75600640 1 -- 172.21.15.99:0/2596746787 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcf780b8a40 con 0x7fcf5806be30 2024-09-10T07:46:04.553 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T07:46:04.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.555+0000 7fcf80600640 1 -- 172.21.15.99:0/2596746787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf5806be30 msgr2=0x7fcf5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.555+0000 7fcf80600640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf5806be30 0x7fcf5806e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcf64034000 tx=0x7fcf6402e000 comp rx=0 tx=0).stop 2024-09-10T07:46:04.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.555+0000 7fcf80600640 1 -- 172.21.15.99:0/2596746787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7806dc40 msgr2=0x7fcf7815c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.555+0000 7fcf80600640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7806dc40 0x7fcf7815c2a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00e870 tx=0x7fcf6c00ed30 comp rx=0 tx=0).stop 2024-09-10T07:46:04.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.555+0000 7fcf80600640 1 -- 172.21.15.99:0/2596746787 shutdown_connections 2024-09-10T07:46:04.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.555+0000 7fcf80600640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf7815ee60 0x7fcf780cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.555+0000 7fcf80600640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf780b5180 0x7fcf780b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.555+0000 7fcf80600640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fcf5806be30 0x7fcf5806e2f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.555+0000 7fcf80600640 1 --2- 172.21.15.99:0/2596746787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7806dc40 0x7fcf7815c2a0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.555+0000 7fcf80600640 1 -- 172.21.15.99:0/2596746787 >> 172.21.15.99:0/2596746787 conn(0x7fcf780b45f0 msgr2=0x7fcf7815de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:04.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.556+0000 7fcf80600640 1 -- 172.21.15.99:0/2596746787 shutdown_connections 2024-09-10T07:46:04.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.556+0000 7fcf80600640 1 -- 172.21.15.99:0/2596746787 wait complete. 2024-09-10T07:46:04.570 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T07:46:04.570 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T07:46:04.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.729+0000 7fa3dbc00640 1 Processor -- start 2024-09-10T07:46:04.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.730+0000 7fa3dbc00640 1 -- start start 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3dbc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40ce460 0x7fa3d40cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3dbc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa3d40d0420 0x7fa3d406e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3dbc00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa3d406eb20 0x7fa3d41605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3dbc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d415dfc0 con 0x7fa3d40d0420 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3dbc00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d415d3b0 con 0x7fa3d406eb20 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3dbc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d415d690 con 0x7fa3d40ce460 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3cbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa3d40d0420 0x7fa3d406e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3cbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa3d40d0420 0x7fa3d406e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40470/0 (socket says 172.21.15.99:40470) 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3cbe00640 1 -- 172.21.15.99:0/192876339 learned_addr learned my addr 172.21.15.99:0/192876339 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3d9c00640 1 --2- 172.21.15.99:0/192876339 >> v2:172.21.15.187:3300/0 conn(0x7fa3d406eb20 0x7fa3d41605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3d9200640 1 --2- 172.21.15.99:0/192876339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40ce460 0x7fa3d40cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3cbe00640 1 -- 172.21.15.99:0/192876339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40ce460 msgr2=0x7fa3d40cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:04.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3cbe00640 1 --2- 172.21.15.99:0/192876339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40ce460 0x7fa3d40cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3cbe00640 1 -- 172.21.15.99:0/192876339 >> v2:172.21.15.187:3300/0 conn(0x7fa3d406eb20 msgr2=0x7fa3d41605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:04.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3cbe00640 1 --2- 172.21.15.99:0/192876339 >> v2:172.21.15.187:3300/0 conn(0x7fa3d406eb20 0x7fa3d41605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.731+0000 7fa3cbe00640 1 -- 172.21.15.99:0/192876339 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d415d970 con 0x7fa3d40d0420 2024-09-10T07:46:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.732+0000 7fa3cbe00640 1 --2- 172.21.15.99:0/192876339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40d0420 0x7fa3d406e5e0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4160500 tx=0x7fa3bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5662d3218ad63e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3d3e00640 1 -- 172.21.15.99:0/192876339 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc037070 con 0x7fa3d40d0420 2024-09-10T07:46:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3d3e00640 1 -- 172.21.15.99:0/192876339 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3bc032440 con 0x7fa3d40d0420 2024-09-10T07:46:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3d3e00640 1 -- 172.21.15.99:0/192876339 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc032810 con 0x7fa3d40d0420 2024-09-10T07:46:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3dbc00640 1 -- 172.21.15.99:0/192876339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40d0420 msgr2=0x7fa3d406e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3dbc00640 1 --2- 172.21.15.99:0/192876339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40d0420 0x7fa3d406e5e0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4160500 tx=0x7fa3bc02a1e0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3dbc00640 1 -- 172.21.15.99:0/192876339 shutdown_connections 2024-09-10T07:46:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3dbc00640 1 --2- 172.21.15.99:0/192876339 >> v2:172.21.15.187:3300/0 conn(0x7fa3d406eb20 0x7fa3d41605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3dbc00640 1 --2- 172.21.15.99:0/192876339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40d0420 0x7fa3d406e5e0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3dbc00640 1 --2- 172.21.15.99:0/192876339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40ce460 0x7fa3d40cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3dbc00640 1 -- 172.21.15.99:0/192876339 >> 172.21.15.99:0/192876339 conn(0x7fa3d40b26a0 msgr2=0x7fa3d40b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3dbc00640 1 -- 172.21.15.99:0/192876339 shutdown_connections 2024-09-10T07:46:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.733+0000 7fa3dbc00640 1 -- 172.21.15.99:0/192876339 wait complete. 2024-09-10T07:46:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.735+0000 7fa3dbc00640 1 Processor -- start 2024-09-10T07:46:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.735+0000 7fa3dbc00640 1 -- start start 2024-09-10T07:46:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.736+0000 7fa3dbc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d406eb20 0x7fa3d414f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.736+0000 7fa3dbc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d40ce460 0x7fa3d414dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.736+0000 7fa3dbc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40d0420 0x7fa3d414c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.736+0000 7fa3dbc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d415cfd0 con 0x7fa3d40d0420 2024-09-10T07:46:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.736+0000 7fa3dbc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d40ce840 con 0x7fa3d40ce460 2024-09-10T07:46:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.736+0000 7fa3dbc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d415d150 con 0x7fa3d406eb20 2024-09-10T07:46:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.736+0000 7fa3d9c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40d0420 0x7fa3d414c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d9c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40d0420 0x7fa3d414c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40480/0 (socket says 172.21.15.99:40480) 2024-09-10T07:46:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d9c00640 1 -- 172.21.15.99:0/3164200232 learned_addr learned my addr 172.21.15.99:0/3164200232 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3cbe00640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d40ce460 0x7fa3d414dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d9200640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d406eb20 0x7fa3d414f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d9c00640 1 -- 172.21.15.99:0/3164200232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d406eb20 msgr2=0x7fa3d414f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d9c00640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d406eb20 0x7fa3d414f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d9c00640 1 -- 172.21.15.99:0/3164200232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d40ce460 msgr2=0x7fa3d414dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d9c00640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d40ce460 0x7fa3d414dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d9c00640 1 -- 172.21.15.99:0/3164200232 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d414e5f0 con 0x7fa3d40d0420 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d9200640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d406eb20 0x7fa3d414f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d9c00640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40d0420 0x7fa3d414c200 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc007e60 tx=0x7fa3cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d1600640 1 -- 172.21.15.99:0/3164200232 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc014620 con 0x7fa3d40d0420 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d1600640 1 -- 172.21.15.99:0/3164200232 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3cc019070 con 0x7fa3d40d0420 2024-09-10T07:46:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d414e8d0 con 0x7fa3d40d0420 2024-09-10T07:46:04.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.737+0000 7fa3d1600640 1 -- 172.21.15.99:0/3164200232 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc014a20 con 0x7fa3d40d0420 2024-09-10T07:46:04.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.738+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d40aed60 con 0x7fa3d40d0420 2024-09-10T07:46:04.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.738+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa3d40ae8d0 con 0x7fa3d40d0420 2024-09-10T07:46:04.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.739+0000 7fa3d1600640 1 -- 172.21.15.99:0/3164200232 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3cc014bc0 con 0x7fa3d40d0420 2024-09-10T07:46:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.740+0000 7fa3d1600640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3b006be30 0x7fa3b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.740+0000 7fa3d1600640 1 -- 172.21.15.99:0/3164200232 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fa3cc08b410 con 0x7fa3d40d0420 2024-09-10T07:46:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.741+0000 7fa3d9200640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3b006be30 0x7fa3b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.741+0000 7fa3d1600640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] conn(0x7fa3b0071cf0 0x7fa3b0074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.741+0000 7fa3d1600640 1 -- 172.21.15.99:0/3164200232 --> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3cc006b90 con 0x7fa3b0071cf0 2024-09-10T07:46:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.741+0000 7fa3d1600640 1 -- 172.21.15.99:0/3164200232 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7fa3cc092050 con 0x7fa3d40d0420 2024-09-10T07:46:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.741+0000 7fa3cbe00640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] conn(0x7fa3b0071cf0 0x7fa3b0074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.741+0000 7fa3d9200640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3b006be30 0x7fa3b006e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4006fd0 tx=0x7fa3c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.741+0000 7fa3cbe00640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] conn(0x7fa3b0071cf0 0x7fa3b0074110 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:04.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.742+0000 7fa3d1600640 1 -- 172.21.15.99:0/3164200232 <== osd.2 v2:172.21.15.99:6808/229492178 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fa3cc006b90 con 0x7fa3b0071cf0 2024-09-10T07:46:04.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.754+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 --> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa3d40cfee0 con 0x7fa3b0071cf0 2024-09-10T07:46:04.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.754+0000 7fa3d1600640 1 -- 172.21.15.99:0/3164200232 <== osd.2 v2:172.21.15.99:6808/229492178 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fa3d40cfee0 con 0x7fa3b0071cf0 2024-09-10T07:46:04.849 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:46:04.849 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-10T07:46:04.849 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:46:04.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] conn(0x7fa3b0071cf0 msgr2=0x7fa3b0074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3dbc00640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:6808/229492178,v1:172.21.15.99:6809/229492178] conn(0x7fa3b0071cf0 0x7fa3b0074110 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3b006be30 msgr2=0x7fa3b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3dbc00640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa3b006be30 0x7fa3b006e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4006fd0 tx=0x7fa3c4008040 comp rx=0 tx=0).stop 2024-09-10T07:46:04.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40d0420 msgr2=0x7fa3d414c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:04.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3dbc00640 1 --2- 172.21.15.99:0/3164200232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40d0420 0x7fa3d414c200 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc007e60 tx=0x7fa3cc00e4b0 comp rx=0 tx=0).stop 2024-09-10T07:46:04.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3d9c00640 1 -- 172.21.15.99:0/3164200232 reap_dead start 2024-09-10T07:46:04.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 shutdown_connections 2024-09-10T07:46:04.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 >> 172.21.15.99:0/3164200232 conn(0x7fa3d40b26a0 msgr2=0x7fa3d4071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:04.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 shutdown_connections 2024-09-10T07:46:04.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:04.755+0000 7fa3dbc00640 1 -- 172.21.15.99:0/3164200232 wait complete. 2024-09-10T07:46:04.851 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T07:46:05.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.008+0000 7ffa6d000640 1 Processor -- start 2024-09-10T07:46:05.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.008+0000 7ffa6d000640 1 -- start start 2024-09-10T07:46:05.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.009+0000 7ffa6d000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa6815eda0 0x7ffa680d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.009+0000 7ffa6d000640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ffa680d0480 0x7ffa680d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.009+0000 7ffa6d000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa680d0bf0 con 0x7ffa680d3af0 2024-09-10T07:46:05.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.009+0000 7ffa6d000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7ffa680d2880 con 0x7ffa6815eda0 2024-09-10T07:46:05.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.009+0000 7ffa6d000640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ffa680d3120 con 0x7ffa680d0480 2024-09-10T07:46:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.009+0000 7ffa65e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa6815eda0 0x7ffa680d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.009+0000 7ffa65e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa6815eda0 0x7ffa680d5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40488/0 (socket says 172.21.15.99:40488) 2024-09-10T07:46:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.009+0000 7ffa66800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ffa680d3af0 0x7ffa680d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53084/0 (socket says 172.21.15.99:53084) 2024-09-10T07:46:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.009+0000 7ffa65e00640 1 -- 172.21.15.99:0/1961508075 learned_addr learned my addr 172.21.15.99:0/1961508075 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.009+0000 7ffa65400640 1 --2- 172.21.15.99:0/1961508075 >> v2:172.21.15.187:3300/0 conn(0x7ffa680d0480 0x7ffa680d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.010+0000 7ffa65e00640 1 -- 172.21.15.99:0/1961508075 >> v2:172.21.15.187:3300/0 conn(0x7ffa680d0480 msgr2=0x7ffa680d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.010+0000 7ffa65e00640 1 --2- 172.21.15.99:0/1961508075 >> v2:172.21.15.187:3300/0 conn(0x7ffa680d0480 0x7ffa680d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.010+0000 7ffa65e00640 1 -- 172.21.15.99:0/1961508075 >> v1:172.21.15.99:6789/0 conn(0x7ffa680d3af0 legacy=0x7ffa680d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.010+0000 7ffa65e00640 1 -- 172.21.15.99:0/1961508075 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa680d2ad0 con 0x7ffa6815eda0 2024-09-10T07:46:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.010+0000 7ffa65400640 1 --2- 172.21.15.99:0/1961508075 >> v2:172.21.15.187:3300/0 conn(0x7ffa680d0480 0x7ffa680d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:05.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.011+0000 7ffa65e00640 1 --2- 172.21.15.99:0/1961508075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa6815eda0 0x7ffa680d5790 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7ffa680b7870 tx=0x7ffa5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3692ebd6f527ec6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.011+0000 7ffa64a00640 1 -- 172.21.15.99:0/1961508075 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58037070 con 0x7ffa6815eda0 2024-09-10T07:46:05.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.011+0000 7ffa64a00640 1 -- 172.21.15.99:0/1961508075 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa58032440 con 0x7ffa6815eda0 2024-09-10T07:46:05.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.011+0000 7ffa64a00640 1 -- 172.21.15.99:0/1961508075 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58032810 con 0x7ffa6815eda0 2024-09-10T07:46:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.012+0000 7ffa6d000640 1 -- 172.21.15.99:0/1961508075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa6815eda0 msgr2=0x7ffa680d5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.012+0000 7ffa6d000640 1 --2- 172.21.15.99:0/1961508075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa6815eda0 0x7ffa680d5790 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7ffa680b7870 tx=0x7ffa5802a270 comp rx=0 tx=0).stop 2024-09-10T07:46:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.012+0000 7ffa6d000640 1 -- 172.21.15.99:0/1961508075 shutdown_connections 2024-09-10T07:46:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.012+0000 7ffa6d000640 1 --2- 172.21.15.99:0/1961508075 >> v2:172.21.15.187:3300/0 conn(0x7ffa680d0480 0x7ffa680d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.012+0000 7ffa6d000640 1 --2- 172.21.15.99:0/1961508075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa6815eda0 0x7ffa680d5790 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.012+0000 7ffa6d000640 1 -- 172.21.15.99:0/1961508075 >> 172.21.15.99:0/1961508075 conn(0x7ffa6809df40 msgr2=0x7ffa680d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.012+0000 7ffa6d000640 1 -- 172.21.15.99:0/1961508075 shutdown_connections 2024-09-10T07:46:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.012+0000 7ffa6d000640 1 -- 172.21.15.99:0/1961508075 wait complete. 2024-09-10T07:46:05.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.013+0000 7ffa6d000640 1 Processor -- start 2024-09-10T07:46:05.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.013+0000 7ffa6d000640 1 -- start start 2024-09-10T07:46:05.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.014+0000 7ffa6d000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa680d0480 0x7ffa68162f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.014+0000 7ffa6d000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa6815eda0 0x7ffa680cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.014+0000 7ffa6d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa68159f90 0x7ffa680cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.014+0000 7ffa6d000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6815f180 con 0x7ffa68159f90 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.014+0000 7ffa6d000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680d08f0 con 0x7ffa680d0480 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.014+0000 7ffa6d000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6815f300 con 0x7ffa6815eda0 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa66800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa68159f90 0x7ffa680cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa65e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa680d0480 0x7ffa68162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa65400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa6815eda0 0x7ffa680cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa65e00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa680d0480 0x7ffa68162f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:55910/0 (socket says 172.21.15.99:55910) 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa65e00640 1 -- 172.21.15.99:0/3194003458 learned_addr learned my addr 172.21.15.99:0/3194003458 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa65400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa6815eda0 0x7ffa680cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:58530/0 (socket says 172.21.15.99:58530) 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa66800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa68159f90 0x7ffa680cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40502/0 (socket says 172.21.15.99:40502) 2024-09-10T07:46:05.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa66800640 1 -- 172.21.15.99:0/3194003458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa6815eda0 msgr2=0x7ffa680cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa66800640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa6815eda0 0x7ffa680cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa66800640 1 -- 172.21.15.99:0/3194003458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa680d0480 msgr2=0x7ffa68162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa66800640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa680d0480 0x7ffa68162f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.015+0000 7ffa66800640 1 -- 172.21.15.99:0/3194003458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa68162c00 con 0x7ffa68159f90 2024-09-10T07:46:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.016+0000 7ffa66800640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa68159f90 0x7ffa680cca70 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c690 tx=0x7ffa6000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.016+0000 7ffa5e000640 1 -- 172.21.15.99:0/3194003458 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60018070 con 0x7ffa68159f90 2024-09-10T07:46:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.016+0000 7ffa5e000640 1 -- 172.21.15.99:0/3194003458 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa60004d60 con 0x7ffa68159f90 2024-09-10T07:46:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.016+0000 7ffa5e000640 1 -- 172.21.15.99:0/3194003458 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000a860 con 0x7ffa68159f90 2024-09-10T07:46:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.016+0000 7ffa6d000640 1 -- 172.21.15.99:0/3194003458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6815f920 con 0x7ffa68159f90 2024-09-10T07:46:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.016+0000 7ffa6d000640 1 -- 172.21.15.99:0/3194003458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa68159790 con 0x7ffa68159f90 2024-09-10T07:46:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.017+0000 7ffa6d000640 1 -- 172.21.15.99:0/3194003458 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa680d1100 con 0x7ffa68159f90 2024-09-10T07:46:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.018+0000 7ffa5e000640 1 -- 172.21.15.99:0/3194003458 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa6000aa00 con 0x7ffa68159f90 2024-09-10T07:46:05.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.019+0000 7ffa5e000640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffa4806be30 0x7ffa4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.019+0000 7ffa5e000640 1 -- 172.21.15.99:0/3194003458 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7ffa60089f60 con 0x7ffa68159f90 2024-09-10T07:46:05.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.019+0000 7ffa65e00640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffa4806be30 0x7ffa4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.020+0000 7ffa65e00640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffa4806be30 0x7ffa4806e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ffa58035040 tx=0x7ffa5802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.023+0000 7ffa5e000640 1 -- 172.21.15.99:0/3194003458 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa68162c00 con 0x7ffa68159f90 2024-09-10T07:46:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.196+0000 7ffa6d000640 1 -- 172.21.15.99:0/3194003458 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ffa680d2330 con 0x7ffa4806be30 2024-09-10T07:46:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.196+0000 7ffa5e000640 1 -- 172.21.15.99:0/3194003458 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffa680d2330 con 0x7ffa4806be30 2024-09-10T07:46:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T07:46:05.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.198+0000 7ffa6d000640 1 -- 172.21.15.99:0/3194003458 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffa4806be30 msgr2=0x7ffa4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.198+0000 7ffa6d000640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffa4806be30 0x7ffa4806e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ffa58035040 tx=0x7ffa5802e000 comp rx=0 tx=0).stop 2024-09-10T07:46:05.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.198+0000 7ffa6d000640 1 -- 172.21.15.99:0/3194003458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa68159f90 msgr2=0x7ffa680cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.198+0000 7ffa6d000640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa68159f90 0x7ffa680cca70 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c690 tx=0x7ffa6000cb50 comp rx=0 tx=0).stop 2024-09-10T07:46:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.199+0000 7ffa6d000640 1 -- 172.21.15.99:0/3194003458 shutdown_connections 2024-09-10T07:46:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.199+0000 7ffa6d000640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ffa4806be30 0x7ffa4806e2f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.199+0000 7ffa6d000640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa68159f90 0x7ffa680cca70 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.199+0000 7ffa6d000640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa6815eda0 0x7ffa680cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.199+0000 7ffa6d000640 1 --2- 172.21.15.99:0/3194003458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa680d0480 0x7ffa68162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.199+0000 7ffa6d000640 1 -- 172.21.15.99:0/3194003458 >> 172.21.15.99:0/3194003458 conn(0x7ffa6809df40 msgr2=0x7ffa680b8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.199+0000 7ffa6d000640 1 -- 172.21.15.99:0/3194003458 shutdown_connections 2024-09-10T07:46:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.199+0000 7ffa6d000640 1 -- 172.21.15.99:0/3194003458 wait complete. 2024-09-10T07:46:05.214 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T07:46:05.214 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T07:46:05.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.371+0000 7f4e68200640 1 Processor -- start 2024-09-10T07:46:05.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.372+0000 7f4e68200640 1 -- start start 2024-09-10T07:46:05.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.373+0000 7f4e68200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e6006e5e0 0x7f4e6006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.373+0000 7f4e68200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4e6015e470 0x7f4e6015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.373+0000 7f4e68200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6015dfc0 con 0x7f4e600ce460 2024-09-10T07:46:05.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.373+0000 7f4e68200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f4e6006ef80 con 0x7f4e6015e470 2024-09-10T07:46:05.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.373+0000 7f4e68200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4e6015d3b0 con 0x7f4e6006e5e0 2024-09-10T07:46:05.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.373+0000 7f4e65800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4e600ce460 0x7f4e600cfee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53100/0 (socket says 172.21.15.99:53100) 2024-09-10T07:46:05.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.373+0000 7f4e65800640 1 -- 172.21.15.99:0/3476342677 learned_addr learned my addr 172.21.15.99:0/3476342677 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:46:05.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.373+0000 7f4e66200640 1 --2- 172.21.15.99:0/3476342677 >> v2:172.21.15.187:3300/0 conn(0x7f4e6015e470 0x7f4e6015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.373+0000 7f4e64e00640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e6006e5e0 0x7f4e6006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.373+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301266296 0 0) 0x7f4e6015dfc0 con 0x7f4e600ce460 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e48003520 con 0x7f4e600ce460 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2696495490 0 0) 0x7f4e48003520 con 0x7f4e600ce460 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e6006e5e0 msgr2=0x7f4e6006ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e6006e5e0 0x7f4e6006ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 >> v2:172.21.15.187:3300/0 conn(0x7f4e6015e470 msgr2=0x7f4e6015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 --2- 172.21.15.99:0/3476342677 >> v2:172.21.15.187:3300/0 conn(0x7f4e6015e470 0x7f4e6015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6015d690 con 0x7f4e600ce460 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 262578563 0 0) 0x7f4e540019f0 con 0x7f4e600ce460 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 >> v1:172.21.15.99:6789/0 conn(0x7f4e600ce460 legacy=0x7f4e600cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e480039b0 0x7f4e48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e48004800 0x7f4e48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 0x7f4e4800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6015d3b0 con 0x7f4e480051c0 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4800bf00 con 0x7f4e48004800 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4800c100 con 0x7f4e480039b0 2024-09-10T07:46:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e66200640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 0x7f4e4800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e65800640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e480039b0 0x7f4e48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.374+0000 7f4e64e00640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e48004800 0x7f4e48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.375+0000 7f4e66200640 1 -- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e480039b0 msgr2=0x7f4e48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.375+0000 7f4e66200640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e480039b0 0x7f4e48003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.375+0000 7f4e66200640 1 -- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e48004800 msgr2=0x7f4e48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.375+0000 7f4e66200640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e48004800 0x7f4e48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.375+0000 7f4e66200640 1 -- 172.21.15.99:0/3476342677 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e48003520 con 0x7f4e480051c0 2024-09-10T07:46:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.376+0000 7f4e66200640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 0x7f4e4800b9c0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009ac0 tx=0x7f4e48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a976729398e15427 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.376+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58036070 con 0x7f4e480051c0 2024-09-10T07:46:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.376+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e58031400 con 0x7f4e480051c0 2024-09-10T07:46:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.376+0000 7f4e5fe00640 1 -- 172.21.15.99:0/3476342677 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58009690 con 0x7f4e480051c0 2024-09-10T07:46:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.376+0000 7f4e68200640 1 -- 172.21.15.99:0/3476342677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 msgr2=0x7f4e4800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.376+0000 7f4e68200640 1 --2- 172.21.15.99:0/3476342677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 0x7f4e4800b9c0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009ac0 tx=0x7f4e48005830 comp rx=0 tx=0).stop 2024-09-10T07:46:05.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.376+0000 7f4e66200640 1 -- 172.21.15.99:0/3476342677 reap_dead start 2024-09-10T07:46:05.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.376+0000 7f4e68200640 1 -- 172.21.15.99:0/3476342677 shutdown_connections 2024-09-10T07:46:05.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.376+0000 7f4e68200640 1 -- 172.21.15.99:0/3476342677 >> 172.21.15.99:0/3476342677 conn(0x7f4e600b26a0 msgr2=0x7f4e600b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:05.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.377+0000 7f4e68200640 1 -- 172.21.15.99:0/3476342677 shutdown_connections 2024-09-10T07:46:05.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.377+0000 7f4e68200640 1 -- 172.21.15.99:0/3476342677 wait complete. 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.378+0000 7f4e68200640 1 Processor -- start 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.378+0000 7f4e68200640 1 -- start start 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.379+0000 7f4e68200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 0x7f4e601f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.379+0000 7f4e68200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e600afd90 0x7f4e60148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.379+0000 7f4e68200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e600c7860 0x7f4e600c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.379+0000 7f4e68200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e600ce840 con 0x7f4e480051c0 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.379+0000 7f4e68200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6015dc50 con 0x7f4e600c7860 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.379+0000 7f4e68200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f4e600d05f0 con 0x7f4e600afd90 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.379+0000 7f4e65800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 0x7f4e601f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.379+0000 7f4e65800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 0x7f4e601f2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40528/0 (socket says 172.21.15.99:40528) 2024-09-10T07:46:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.379+0000 7f4e65800640 1 -- 172.21.15.99:0/3704437621 learned_addr learned my addr 172.21.15.99:0/3704437621 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e64e00640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e600afd90 0x7f4e60148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e65800640 1 -- 172.21.15.99:0/3704437621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e600afd90 msgr2=0x7f4e60148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e66200640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e600c7860 0x7f4e600c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e65800640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e600afd90 0x7f4e60148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e65800640 1 -- 172.21.15.99:0/3704437621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e600c7860 msgr2=0x7f4e600c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e65800640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e600c7860 0x7f4e600c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e65800640 1 -- 172.21.15.99:0/3704437621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e60148790 con 0x7f4e480051c0 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e64e00640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e600afd90 0x7f4e60148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e66200640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e600c7860 0x7f4e600c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e65800640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 0x7f4e601f2f20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f4e54007a50 tx=0x7f4e5400a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e5d600640 1 -- 172.21.15.99:0/3704437621 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e540133f0 con 0x7f4e480051c0 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e5d600640 1 -- 172.21.15.99:0/3704437621 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e54018070 con 0x7f4e480051c0 2024-09-10T07:46:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e5d600640 1 -- 172.21.15.99:0/3704437621 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e540137d0 con 0x7f4e480051c0 2024-09-10T07:46:05.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.380+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e600c7020 con 0x7f4e480051c0 2024-09-10T07:46:05.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.381+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e600c6260 con 0x7f4e480051c0 2024-09-10T07:46:05.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.381+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e6015cfd0 con 0x7f4e480051c0 2024-09-10T07:46:05.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.382+0000 7f4e5d600640 1 -- 172.21.15.99:0/3704437621 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e54013970 con 0x7f4e480051c0 2024-09-10T07:46:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.383+0000 7f4e5d600640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e4006be60 0x7f4e4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.383+0000 7f4e5d600640 1 -- 172.21.15.99:0/3704437621 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f4e5408b4a0 con 0x7f4e480051c0 2024-09-10T07:46:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.384+0000 7f4e64e00640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e4006be60 0x7f4e4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.384+0000 7f4e5d600640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] conn(0x7f4e40071d20 0x7f4e40074140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.384+0000 7f4e5d600640 1 -- 172.21.15.99:0/3704437621 --> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e400747f0 con 0x7f4e40071d20 2024-09-10T07:46:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.384+0000 7f4e5d600640 1 -- 172.21.15.99:0/3704437621 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f4e54092050 con 0x7f4e480051c0 2024-09-10T07:46:05.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.384+0000 7f4e66200640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] conn(0x7f4e40071d20 0x7f4e40074140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.384+0000 7f4e64e00640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e4006be60 0x7f4e4006e320 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4e600cd7d0 tx=0x7f4e4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.384+0000 7f4e66200640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] conn(0x7f4e40071d20 0x7f4e40074140 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.385+0000 7f4e5d600640 1 -- 172.21.15.99:0/3704437621 <== osd.3 v2:172.21.15.99:6818/1992812983 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f4e400747f0 con 0x7f4e40071d20 2024-09-10T07:46:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.397+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 --> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4e601607b0 con 0x7f4e40071d20 2024-09-10T07:46:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.397+0000 7f4e5d600640 1 -- 172.21.15.99:0/3704437621 <== osd.3 v2:172.21.15.99:6818/1992812983 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f4e601607b0 con 0x7f4e40071d20 2024-09-10T07:46:05.397 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:46:05.397 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-10T07:46:05.397 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:46:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.397+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] conn(0x7f4e40071d20 msgr2=0x7f4e40074140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.397+0000 7f4e68200640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:6818/1992812983,v1:172.21.15.99:6823/1992812983] conn(0x7f4e40071d20 0x7f4e40074140 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.398+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e4006be60 msgr2=0x7f4e4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.398+0000 7f4e68200640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f4e4006be60 0x7f4e4006e320 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4e600cd7d0 tx=0x7f4e4c008040 comp rx=0 tx=0).stop 2024-09-10T07:46:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.398+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 msgr2=0x7f4e601f2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.398+0000 7f4e68200640 1 --2- 172.21.15.99:0/3704437621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e480051c0 0x7f4e601f2f20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f4e54007a50 tx=0x7f4e5400a6a0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.398+0000 7f4e66200640 1 -- 172.21.15.99:0/3704437621 reap_dead start 2024-09-10T07:46:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.398+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 shutdown_connections 2024-09-10T07:46:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.398+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 >> 172.21.15.99:0/3704437621 conn(0x7f4e600b26a0 msgr2=0x7f4e600b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.398+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 shutdown_connections 2024-09-10T07:46:05.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.398+0000 7f4e68200640 1 -- 172.21.15.99:0/3704437621 wait complete. 2024-09-10T07:46:05.413 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T07:46:05.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.567+0000 7f2c50600640 1 Processor -- start 2024-09-10T07:46:05.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.568+0000 7f2c50600640 1 -- start start 2024-09-10T07:46:05.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c50600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2c480b5750 0x7f2c4815d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c50600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2c480cf890 0x7f2c480cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c50600640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c4815c800 con 0x7f2c480ce070 2024-09-10T07:46:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c50600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f2c480b5bb0 con 0x7f2c480b5750 2024-09-10T07:46:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c50600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f2c480d0240 con 0x7f2c480cf890 2024-09-10T07:46:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c4d200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2c480b5750 0x7f2c4815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c4d200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2c480b5750 0x7f2c4815d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40534/0 (socket says 172.21.15.99:40534) 2024-09-10T07:46:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c4d200640 1 -- 172.21.15.99:0/3784139824 learned_addr learned my addr 172.21.15.99:0/3784139824 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:05.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c4e600640 1 --2- 172.21.15.99:0/3784139824 >> v2:172.21.15.187:3300/0 conn(0x7f2c480cf890 0x7f2c480cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c4d200640 1 -- 172.21.15.99:0/3784139824 >> v2:172.21.15.187:3300/0 conn(0x7f2c480cf890 msgr2=0x7f2c480cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:05.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c4d200640 1 --2- 172.21.15.99:0/3784139824 >> v2:172.21.15.187:3300/0 conn(0x7f2c480cf890 0x7f2c480cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c4d200640 1 -- 172.21.15.99:0/3784139824 >> v1:172.21.15.187:6789/0 conn(0x7f2c480ce070 legacy=0x7f2c4815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.569+0000 7f2c4d200640 1 -- 172.21.15.99:0/3784139824 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4815cae0 con 0x7f2c480b5750 2024-09-10T07:46:05.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.570+0000 7f2c4d200640 1 --2- 172.21.15.99:0/3784139824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480b5750 0x7f2c4815d170 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2c4806cfc0 tx=0x7f2c3402c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9686c6b1faa4eb66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.571+0000 7f2c47e00640 1 -- 172.21.15.99:0/3784139824 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34036020 con 0x7f2c480b5750 2024-09-10T07:46:05.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.571+0000 7f2c47e00640 1 -- 172.21.15.99:0/3784139824 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c34032820 con 0x7f2c480b5750 2024-09-10T07:46:05.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.571+0000 7f2c47e00640 1 -- 172.21.15.99:0/3784139824 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34032bf0 con 0x7f2c480b5750 2024-09-10T07:46:05.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.571+0000 7f2c50600640 1 -- 172.21.15.99:0/3784139824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480b5750 msgr2=0x7f2c4815d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.571+0000 7f2c50600640 1 --2- 172.21.15.99:0/3784139824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480b5750 0x7f2c4815d170 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2c4806cfc0 tx=0x7f2c3402c960 comp rx=0 tx=0).stop 2024-09-10T07:46:05.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.571+0000 7f2c50600640 1 -- 172.21.15.99:0/3784139824 shutdown_connections 2024-09-10T07:46:05.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.571+0000 7f2c50600640 1 --2- 172.21.15.99:0/3784139824 >> v2:172.21.15.187:3300/0 conn(0x7f2c480cf890 0x7f2c480cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.572+0000 7f2c50600640 1 --2- 172.21.15.99:0/3784139824 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480b5750 0x7f2c4815d170 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.572+0000 7f2c50600640 1 -- 172.21.15.99:0/3784139824 >> 172.21.15.99:0/3784139824 conn(0x7f2c480b2630 msgr2=0x7f2c480b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:05.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.572+0000 7f2c50600640 1 -- 172.21.15.99:0/3784139824 shutdown_connections 2024-09-10T07:46:05.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.572+0000 7f2c50600640 1 -- 172.21.15.99:0/3784139824 wait complete. 2024-09-10T07:46:05.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.573+0000 7f2c50600640 1 Processor -- start 2024-09-10T07:46:05.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.573+0000 7f2c50600640 1 -- start start 2024-09-10T07:46:05.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.574+0000 7f2c50600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c480b5750 0x7f2c48149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.574+0000 7f2c50600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480ce070 0x7f2c4814a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.574+0000 7f2c50600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c480cf890 0x7f2c481568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.574+0000 7f2c50600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4815d6b0 con 0x7f2c480ce070 2024-09-10T07:46:05.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.574+0000 7f2c50600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2c480ce450 con 0x7f2c480b5750 2024-09-10T07:46:05.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.574+0000 7f2c50600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4815d830 con 0x7f2c480cf890 2024-09-10T07:46:05.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.574+0000 7f2c4d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480ce070 0x7f2c4814a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480ce070 0x7f2c4814a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40538/0 (socket says 172.21.15.99:40538) 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4d200640 1 -- 172.21.15.99:0/3860291466 learned_addr learned my addr 172.21.15.99:0/3860291466 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4dc00640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c480b5750 0x7f2c48149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4e600640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c480cf890 0x7f2c481568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4d200640 1 -- 172.21.15.99:0/3860291466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c480cf890 msgr2=0x7f2c481568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4d200640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c480cf890 0x7f2c481568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4d200640 1 -- 172.21.15.99:0/3860291466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c480b5750 msgr2=0x7f2c48149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4d200640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c480b5750 0x7f2c48149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4d200640 1 -- 172.21.15.99:0/3860291466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c48158b00 con 0x7f2c480ce070 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4dc00640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c480b5750 0x7f2c48149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c4d200640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480ce070 0x7f2c4814a210 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2c3402c9a0 tx=0x7f2c340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.575+0000 7f2c45600640 1 -- 172.21.15.99:0/3860291466 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34036040 con 0x7f2c480ce070 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.576+0000 7f2c45600640 1 -- 172.21.15.99:0/3860291466 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3403bd60 con 0x7f2c480ce070 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.576+0000 7f2c45600640 1 -- 172.21.15.99:0/3860291466 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34045610 con 0x7f2c480ce070 2024-09-10T07:46:05.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.576+0000 7f2c50600640 1 -- 172.21.15.99:0/3860291466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c48158de0 con 0x7f2c480ce070 2024-09-10T07:46:05.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.576+0000 7f2c50600640 1 -- 172.21.15.99:0/3860291466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c481590c0 con 0x7f2c480ce070 2024-09-10T07:46:05.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.577+0000 7f2c50600640 1 -- 172.21.15.99:0/3860291466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4815d170 con 0x7f2c480ce070 2024-09-10T07:46:05.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.577+0000 7f2c45600640 1 -- 172.21.15.99:0/3860291466 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c3404c060 con 0x7f2c480ce070 2024-09-10T07:46:05.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.578+0000 7f2c45600640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c2806be30 0x7f2c2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.578+0000 7f2c45600640 1 -- 172.21.15.99:0/3860291466 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f2c340adbb0 con 0x7f2c480ce070 2024-09-10T07:46:05.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.579+0000 7f2c4dc00640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c2806be30 0x7f2c2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.579+0000 7f2c4dc00640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c2806be30 0x7f2c2806e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2c4815fc00 tx=0x7f2c3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.583+0000 7f2c45600640 1 -- 172.21.15.99:0/3860291466 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c34040070 con 0x7f2c480ce070 2024-09-10T07:46:05.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.755+0000 7f2c50600640 1 -- 172.21.15.99:0/3860291466 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2c480d0420 con 0x7f2c2806be30 2024-09-10T07:46:05.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.755+0000 7f2c45600640 1 -- 172.21.15.99:0/3860291466 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c480d0420 con 0x7f2c2806be30 2024-09-10T07:46:05.755 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T07:46:05.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 -- 172.21.15.99:0/3860291466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c2806be30 msgr2=0x7f2c2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c2806be30 0x7f2c2806e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2c4815fc00 tx=0x7f2c3c009040 comp rx=0 tx=0).stop 2024-09-10T07:46:05.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 -- 172.21.15.99:0/3860291466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480ce070 msgr2=0x7f2c4814a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480ce070 0x7f2c4814a210 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2c3402c9a0 tx=0x7f2c340046c0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 -- 172.21.15.99:0/3860291466 shutdown_connections 2024-09-10T07:46:05.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c480cf890 0x7f2c481568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2c2806be30 0x7f2c2806e2f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c480ce070 0x7f2c4814a210 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 --2- 172.21.15.99:0/3860291466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c480b5750 0x7f2c48149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 -- 172.21.15.99:0/3860291466 >> 172.21.15.99:0/3860291466 conn(0x7f2c480b2630 msgr2=0x7f2c480715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:05.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 -- 172.21.15.99:0/3860291466 shutdown_connections 2024-09-10T07:46:05.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.757+0000 7f2c50600640 1 -- 172.21.15.99:0/3860291466 wait complete. 2024-09-10T07:46:05.774 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T07:46:05.774 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T07:46:05.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.933+0000 7f7d93400640 1 Processor -- start 2024-09-10T07:46:05.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.933+0000 7f7d93400640 1 -- start start 2024-09-10T07:46:05.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.934+0000 7f7d93400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d8c15ea50 0x7f7d8c0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.934+0000 7f7d93400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7d8c06e5b0 0x7f7d8c15f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.934+0000 7f7d93400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7d8c15fcc0 0x7f7d8c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.934+0000 7f7d93400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c06eb70 con 0x7f7d8c06e5b0 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.934+0000 7f7d93400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c06ee50 con 0x7f7d8c15fcc0 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.934+0000 7f7d93400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c06f130 con 0x7f7d8c15ea50 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d8be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7d8c06e5b0 0x7f7d8c15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d8be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7d8c06e5b0 0x7f7d8c15f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40554/0 (socket says 172.21.15.99:40554) 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d8be00640 1 -- 172.21.15.99:0/3884546410 learned_addr learned my addr 172.21.15.99:0/3884546410 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d90a00640 1 --2- 172.21.15.99:0/3884546410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d8c15ea50 0x7f7d8c0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d91400640 1 --2- 172.21.15.99:0/3884546410 >> v2:172.21.15.187:3300/0 conn(0x7f7d8c15fcc0 0x7f7d8c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d8be00640 1 -- 172.21.15.99:0/3884546410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d8c15ea50 msgr2=0x7f7d8c0708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d8be00640 1 --2- 172.21.15.99:0/3884546410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d8c15ea50 0x7f7d8c0708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d8be00640 1 -- 172.21.15.99:0/3884546410 >> v2:172.21.15.187:3300/0 conn(0x7f7d8c15fcc0 msgr2=0x7f7d8c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d8be00640 1 --2- 172.21.15.99:0/3884546410 >> v2:172.21.15.187:3300/0 conn(0x7f7d8c15fcc0 0x7f7d8c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d8be00640 1 -- 172.21.15.99:0/3884546410 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c15f260 con 0x7f7d8c06e5b0 2024-09-10T07:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.935+0000 7f7d91400640 1 --2- 172.21.15.99:0/3884546410 >> v2:172.21.15.187:3300/0 conn(0x7f7d8c15fcc0 0x7f7d8c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:05.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.936+0000 7f7d8be00640 1 --2- 172.21.15.99:0/3884546410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d8c06e5b0 0x7f7d8c15f780 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b4660 tx=0x7f7d7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae5baf9551929a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.936+0000 7f7d8b400640 1 -- 172.21.15.99:0/3884546410 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78037070 con 0x7f7d8c06e5b0 2024-09-10T07:46:05.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.936+0000 7f7d8b400640 1 -- 172.21.15.99:0/3884546410 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d78032440 con 0x7f7d8c06e5b0 2024-09-10T07:46:05.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.936+0000 7f7d8b400640 1 -- 172.21.15.99:0/3884546410 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78032810 con 0x7f7d8c06e5b0 2024-09-10T07:46:05.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.937+0000 7f7d93400640 1 -- 172.21.15.99:0/3884546410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d8c06e5b0 msgr2=0x7f7d8c15f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.937+0000 7f7d93400640 1 --2- 172.21.15.99:0/3884546410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d8c06e5b0 0x7f7d8c15f780 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b4660 tx=0x7f7d7802a1e0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.937+0000 7f7d93400640 1 -- 172.21.15.99:0/3884546410 shutdown_connections 2024-09-10T07:46:05.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.937+0000 7f7d93400640 1 --2- 172.21.15.99:0/3884546410 >> v2:172.21.15.187:3300/0 conn(0x7f7d8c15fcc0 0x7f7d8c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.937+0000 7f7d93400640 1 --2- 172.21.15.99:0/3884546410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d8c06e5b0 0x7f7d8c15f780 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.937+0000 7f7d93400640 1 --2- 172.21.15.99:0/3884546410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d8c15ea50 0x7f7d8c0708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.937+0000 7f7d93400640 1 -- 172.21.15.99:0/3884546410 >> 172.21.15.99:0/3884546410 conn(0x7f7d8c0b35d0 msgr2=0x7f7d8c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:05.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.937+0000 7f7d93400640 1 -- 172.21.15.99:0/3884546410 shutdown_connections 2024-09-10T07:46:05.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.937+0000 7f7d93400640 1 -- 172.21.15.99:0/3884546410 wait complete. 2024-09-10T07:46:05.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.939+0000 7f7d93400640 1 Processor -- start 2024-09-10T07:46:05.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.939+0000 7f7d93400640 1 -- start start 2024-09-10T07:46:05.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d93400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d8c06e5b0 0x7f7d8c14a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d93400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d8c15ea50 0x7f7d8c149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d93400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d8c0c6b90 0x7f7d8c14baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d93400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c15efb0 con 0x7f7d8c15ea50 2024-09-10T07:46:05.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d93400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c15ee30 con 0x7f7d8c06e5b0 2024-09-10T07:46:05.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d93400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c06c150 con 0x7f7d8c0c6b90 2024-09-10T07:46:05.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d8be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d8c15ea50 0x7f7d8c149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d8be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d8c15ea50 0x7f7d8c149cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40556/0 (socket says 172.21.15.99:40556) 2024-09-10T07:46:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d8be00640 1 -- 172.21.15.99:0/3526910707 learned_addr learned my addr 172.21.15.99:0/3526910707 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d90a00640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d8c06e5b0 0x7f7d8c14a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d8be00640 1 -- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d8c0c6b90 msgr2=0x7f7d8c14baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d8be00640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d8c0c6b90 0x7f7d8c14baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d8be00640 1 -- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d8c06e5b0 msgr2=0x7f7d8c14a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d8be00640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d8c06e5b0 0x7f7d8c14a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d8be00640 1 -- 172.21.15.99:0/3526910707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c14aa50 con 0x7f7d8c15ea50 2024-09-10T07:46:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.940+0000 7f7d90a00640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d8c06e5b0 0x7f7d8c14a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:46:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.941+0000 7f7d8be00640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d8c15ea50 0x7f7d8c149cd0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f7d7802a220 tx=0x7f7d780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.941+0000 7f7d88c00640 1 -- 172.21.15.99:0/3526910707 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78041020 con 0x7f7d8c15ea50 2024-09-10T07:46:05.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.941+0000 7f7d88c00640 1 -- 172.21.15.99:0/3526910707 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d780306c0 con 0x7f7d8c15ea50 2024-09-10T07:46:05.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.941+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c14ad30 con 0x7f7d8c15ea50 2024-09-10T07:46:05.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.941+0000 7f7d88c00640 1 -- 172.21.15.99:0/3526910707 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78037040 con 0x7f7d8c15ea50 2024-09-10T07:46:05.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.941+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c14b2f0 con 0x7f7d8c15ea50 2024-09-10T07:46:05.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.942+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d8c06c4f0 con 0x7f7d8c15ea50 2024-09-10T07:46:05.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.943+0000 7f7d88c00640 1 -- 172.21.15.99:0/3526910707 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d78044020 con 0x7f7d8c15ea50 2024-09-10T07:46:05.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.944+0000 7f7d88c00640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7d6c06be60 0x7f7d6c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.944+0000 7f7d88c00640 1 -- 172.21.15.99:0/3526910707 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f7d780ab850 con 0x7f7d8c15ea50 2024-09-10T07:46:05.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.944+0000 7f7d90a00640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7d6c06be60 0x7f7d6c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.944+0000 7f7d88c00640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] conn(0x7f7d6c071d20 0x7f7d6c074140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:05.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.944+0000 7f7d88c00640 1 -- 172.21.15.99:0/3526910707 --> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d78034e90 con 0x7f7d6c071d20 2024-09-10T07:46:05.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.944+0000 7f7d88c00640 1 -- 172.21.15.99:0/3526910707 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f7d780abc00 con 0x7f7d8c15ea50 2024-09-10T07:46:05.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.945+0000 7f7d90a00640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7d6c06be60 0x7f7d6c06e320 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c006fd0 tx=0x7f7d7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.945+0000 7f7d91400640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] conn(0x7f7d6c071d20 0x7f7d6c074140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:05.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.946+0000 7f7d91400640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] conn(0x7f7d6c071d20 0x7f7d6c074140 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:05.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.947+0000 7f7d88c00640 1 -- 172.21.15.99:0/3526910707 <== osd.4 v2:172.21.15.187:6824/3032215980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f7d78034e90 con 0x7f7d6c071d20 2024-09-10T07:46:05.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.958+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 --> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7d8c161f50 con 0x7f7d6c071d20 2024-09-10T07:46:05.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.959+0000 7f7d88c00640 1 -- 172.21.15.99:0/3526910707 <== osd.4 v2:172.21.15.187:6824/3032215980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f7d8c161f50 con 0x7f7d6c071d20 2024-09-10T07:46:05.959 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:46:05.959 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-10T07:46:05.959 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:46:05.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.959+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] conn(0x7f7d6c071d20 msgr2=0x7f7d6c074140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.959+0000 7f7d93400640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.187:6824/3032215980,v1:172.21.15.187:6825/3032215980] conn(0x7f7d6c071d20 0x7f7d6c074140 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.960+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7d6c06be60 msgr2=0x7f7d6c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.960+0000 7f7d93400640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f7d6c06be60 0x7f7d6c06e320 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c006fd0 tx=0x7f7d7c008040 comp rx=0 tx=0).stop 2024-09-10T07:46:05.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.960+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d8c15ea50 msgr2=0x7f7d8c149cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:05.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.960+0000 7f7d93400640 1 --2- 172.21.15.99:0/3526910707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d8c15ea50 0x7f7d8c149cd0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f7d7802a220 tx=0x7f7d780046c0 comp rx=0 tx=0).stop 2024-09-10T07:46:05.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.960+0000 7f7d91400640 1 -- 172.21.15.99:0/3526910707 reap_dead start 2024-09-10T07:46:05.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.960+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 shutdown_connections 2024-09-10T07:46:05.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.960+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 >> 172.21.15.99:0/3526910707 conn(0x7f7d8c0b35d0 msgr2=0x7f7d8c0b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:05.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.960+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 shutdown_connections 2024-09-10T07:46:05.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:05.960+0000 7f7d93400640 1 -- 172.21.15.99:0/3526910707 wait complete. 2024-09-10T07:46:05.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T07:46:06.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.131+0000 7f035fc00640 1 Processor -- start 2024-09-10T07:46:06.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.131+0000 7f035fc00640 1 -- start start 2024-09-10T07:46:06.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.132+0000 7f035fc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f035815db60 0x7f0358071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.132+0000 7f035fc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03580724d0 0x7f035806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035fc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0358153e50 con 0x7f035806e580 2024-09-10T07:46:06.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035fc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f035815df40 con 0x7f035815db60 2024-09-10T07:46:06.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035fc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f035806e9b0 con 0x7f03580724d0 2024-09-10T07:46:06.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035d200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f035815db60 0x7f0358071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035d200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f035815db60 0x7f0358071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40560/0 (socket says 172.21.15.99:40560) 2024-09-10T07:46:06.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035d200640 1 -- 172.21.15.99:0/2938276932 learned_addr learned my addr 172.21.15.99:0/2938276932 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035dc00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f035806e580 0x7f0358160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53106/0 (socket says 172.21.15.99:53106) 2024-09-10T07:46:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f034fe00640 1 --2- 172.21.15.99:0/2938276932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03580724d0 0x7f035806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035d200640 1 -- 172.21.15.99:0/2938276932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03580724d0 msgr2=0x7f035806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035d200640 1 --2- 172.21.15.99:0/2938276932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03580724d0 0x7f035806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035d200640 1 -- 172.21.15.99:0/2938276932 >> v1:172.21.15.99:6789/0 conn(0x7f035806e580 legacy=0x7f0358160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f035d200640 1 -- 172.21.15.99:0/2938276932 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0358072ac0 con 0x7f035815db60 2024-09-10T07:46:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.133+0000 7f034fe00640 1 --2- 172.21.15.99:0/2938276932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03580724d0 0x7f035806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:06.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.134+0000 7f035d200640 1 --2- 172.21.15.99:0/2938276932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f035815db60 0x7f0358071f90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f03480098a0 tx=0x7f034802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc1dcc4da0456b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:06.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.134+0000 7f0357e00640 1 -- 172.21.15.99:0/2938276932 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348037070 con 0x7f035815db60 2024-09-10T07:46:06.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.135+0000 7f0357e00640 1 -- 172.21.15.99:0/2938276932 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0348032440 con 0x7f035815db60 2024-09-10T07:46:06.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.135+0000 7f0357e00640 1 -- 172.21.15.99:0/2938276932 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348032810 con 0x7f035815db60 2024-09-10T07:46:06.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.135+0000 7f035fc00640 1 -- 172.21.15.99:0/2938276932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f035815db60 msgr2=0x7f0358071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.135+0000 7f035fc00640 1 --2- 172.21.15.99:0/2938276932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f035815db60 0x7f0358071f90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f03480098a0 tx=0x7f034802a2a0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.135+0000 7f035fc00640 1 -- 172.21.15.99:0/2938276932 shutdown_connections 2024-09-10T07:46:06.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.135+0000 7f035fc00640 1 --2- 172.21.15.99:0/2938276932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03580724d0 0x7f035806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.135+0000 7f035fc00640 1 --2- 172.21.15.99:0/2938276932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f035815db60 0x7f0358071f90 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.135+0000 7f035fc00640 1 -- 172.21.15.99:0/2938276932 >> 172.21.15.99:0/2938276932 conn(0x7f03580b2630 msgr2=0x7f03580b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:06.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.135+0000 7f035fc00640 1 -- 172.21.15.99:0/2938276932 shutdown_connections 2024-09-10T07:46:06.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.135+0000 7f035fc00640 1 -- 172.21.15.99:0/2938276932 wait complete. 2024-09-10T07:46:06.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.137+0000 7f035fc00640 1 Processor -- start 2024-09-10T07:46:06.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.137+0000 7f035fc00640 1 -- start start 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f035fc00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f035806e580 0x7f03581e65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f035fc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03580724d0 0x7f03581e6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f035fc00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f035815db60 0x7f03581f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f035fc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0358073360 con 0x7f03580724d0 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f035fc00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f03580730c0 con 0x7f035815db60 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f035fc00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f0358073640 con 0x7f035806e580 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f034fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03580724d0 0x7f03581e6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f034fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03580724d0 0x7f03581e6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40574/0 (socket says 172.21.15.99:40574) 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f034fe00640 1 -- 172.21.15.99:0/1606338652 learned_addr learned my addr 172.21.15.99:0/1606338652 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f035d200640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f035806e580 0x7f03581e65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.138+0000 7f035dc00640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f035815db60 0x7f03581f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f034fe00640 1 -- 172.21.15.99:0/1606338652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f035806e580 msgr2=0x7f03581e65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f034fe00640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f035806e580 0x7f03581e65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f034fe00640 1 -- 172.21.15.99:0/1606338652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f035815db60 msgr2=0x7f03581f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f034fe00640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f035815db60 0x7f03581f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f034fe00640 1 -- 172.21.15.99:0/1606338652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0358152d10 con 0x7f03580724d0 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f034fe00640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03580724d0 0x7f03581e6b10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f034000e7e0 tx=0x7f034000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f0355600640 1 -- 172.21.15.99:0/1606338652 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034000f040 con 0x7f03580724d0 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f0355600640 1 -- 172.21.15.99:0/1606338652 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0340004030 con 0x7f03580724d0 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f035fc00640 1 -- 172.21.15.99:0/1606338652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03581e7050 con 0x7f03580724d0 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f0355600640 1 -- 172.21.15.99:0/1606338652 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340004400 con 0x7f03580724d0 2024-09-10T07:46:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.139+0000 7f035fc00640 1 -- 172.21.15.99:0/1606338652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03581e75e0 con 0x7f03580724d0 2024-09-10T07:46:06.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.140+0000 7f035fc00640 1 -- 172.21.15.99:0/1606338652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0358153b90 con 0x7f03580724d0 2024-09-10T07:46:06.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.141+0000 7f0355600640 1 -- 172.21.15.99:0/1606338652 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f034000c670 con 0x7f03580724d0 2024-09-10T07:46:06.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.142+0000 7f0355600640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f033406be60 0x7f033406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.142+0000 7f0355600640 1 -- 172.21.15.99:0/1606338652 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f034008a850 con 0x7f03580724d0 2024-09-10T07:46:06.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.142+0000 7f035d200640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f033406be60 0x7f033406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.143+0000 7f035d200640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f033406be60 0x7f033406e320 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0348034000 tx=0x7f034802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.146+0000 7f0355600640 1 -- 172.21.15.99:0/1606338652 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0358153b90 con 0x7f03580724d0 2024-09-10T07:46:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.319+0000 7f035fc00640 1 -- 172.21.15.99:0/1606338652 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f035806e040 con 0x7f033406be60 2024-09-10T07:46:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.319+0000 7f0355600640 1 -- 172.21.15.99:0/1606338652 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f035806e040 con 0x7f033406be60 2024-09-10T07:46:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T07:46:06.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.321+0000 7f035fc00640 1 -- 172.21.15.99:0/1606338652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f033406be60 msgr2=0x7f033406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.321+0000 7f035fc00640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f033406be60 0x7f033406e320 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0348034000 tx=0x7f034802e000 comp rx=0 tx=0).stop 2024-09-10T07:46:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.322+0000 7f035fc00640 1 -- 172.21.15.99:0/1606338652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03580724d0 msgr2=0x7f03581e6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.322+0000 7f035fc00640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03580724d0 0x7f03581e6b10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f034000e7e0 tx=0x7f034000eca0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.322+0000 7f035fc00640 1 -- 172.21.15.99:0/1606338652 shutdown_connections 2024-09-10T07:46:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.322+0000 7f035fc00640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f035815db60 0x7f03581f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.322+0000 7f035fc00640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f033406be60 0x7f033406e320 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.322+0000 7f035fc00640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03580724d0 0x7f03581e6b10 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.322+0000 7f035fc00640 1 --2- 172.21.15.99:0/1606338652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f035806e580 0x7f03581e65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.322+0000 7f035fc00640 1 -- 172.21.15.99:0/1606338652 >> 172.21.15.99:0/1606338652 conn(0x7f03580b2630 msgr2=0x7f035806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.322+0000 7f035fc00640 1 -- 172.21.15.99:0/1606338652 shutdown_connections 2024-09-10T07:46:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.322+0000 7f035fc00640 1 -- 172.21.15.99:0/1606338652 wait complete. 2024-09-10T07:46:06.337 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T07:46:06.337 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T07:46:06.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.494+0000 7fc673600640 1 Processor -- start 2024-09-10T07:46:06.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.495+0000 7fc673600640 1 -- start start 2024-09-10T07:46:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc673600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc66c0ce460 0x7fc66c0cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc673600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc66c0d0420 0x7fc66c06e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc673600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c06eb20 0x7fc66c1605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc673600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7fc66c15dfc0 con 0x7fc66c0d0420 2024-09-10T07:46:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc673600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fc66c15d3b0 con 0x7fc66c0ce460 2024-09-10T07:46:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc673600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c15d690 con 0x7fc66c06eb20 2024-09-10T07:46:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc663e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc66c0d0420 0x7fc66c06e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc663e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc66c0d0420 0x7fc66c06e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40586/0 (socket says 172.21.15.99:40586) 2024-09-10T07:46:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc663e00640 1 -- 172.21.15.99:0/2617252646 learned_addr learned my addr 172.21.15.99:0/2617252646 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc671600640 1 --2- 172.21.15.99:0/2617252646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c06eb20 0x7fc66c1605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.496+0000 7fc670c00640 1 --2- 172.21.15.99:0/2617252646 >> v2:172.21.15.187:3300/0 conn(0x7fc66c0ce460 0x7fc66c0cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.497+0000 7fc663e00640 1 -- 172.21.15.99:0/2617252646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c06eb20 msgr2=0x7fc66c1605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.497+0000 7fc663e00640 1 --2- 172.21.15.99:0/2617252646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c06eb20 0x7fc66c1605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.497+0000 7fc663e00640 1 -- 172.21.15.99:0/2617252646 >> v2:172.21.15.187:3300/0 conn(0x7fc66c0ce460 msgr2=0x7fc66c0cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.497+0000 7fc663e00640 1 --2- 172.21.15.99:0/2617252646 >> v2:172.21.15.187:3300/0 conn(0x7fc66c0ce460 0x7fc66c0cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.497+0000 7fc663e00640 1 -- 172.21.15.99:0/2617252646 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c15d970 con 0x7fc66c0d0420 2024-09-10T07:46:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc663e00640 1 --2- 172.21.15.99:0/2617252646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0d0420 0x7fc66c06e5e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc66c076810 tx=0x7fc65402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3120c487f80b1d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc66be00640 1 -- 172.21.15.99:0/2617252646 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654037070 con 0x7fc66c0d0420 2024-09-10T07:46:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc66be00640 1 -- 172.21.15.99:0/2617252646 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc654032440 con 0x7fc66c0d0420 2024-09-10T07:46:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc66be00640 1 -- 172.21.15.99:0/2617252646 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654032810 con 0x7fc66c0d0420 2024-09-10T07:46:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc673600640 1 -- 172.21.15.99:0/2617252646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0d0420 msgr2=0x7fc66c06e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc673600640 1 --2- 172.21.15.99:0/2617252646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0d0420 0x7fc66c06e5e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc66c076810 tx=0x7fc65402a1e0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc673600640 1 -- 172.21.15.99:0/2617252646 shutdown_connections 2024-09-10T07:46:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc673600640 1 --2- 172.21.15.99:0/2617252646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c06eb20 0x7fc66c1605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc673600640 1 --2- 172.21.15.99:0/2617252646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0d0420 0x7fc66c06e5e0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc673600640 1 --2- 172.21.15.99:0/2617252646 >> v2:172.21.15.187:3300/0 conn(0x7fc66c0ce460 0x7fc66c0cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.498+0000 7fc673600640 1 -- 172.21.15.99:0/2617252646 >> 172.21.15.99:0/2617252646 conn(0x7fc66c0b26a0 msgr2=0x7fc66c0b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.499+0000 7fc673600640 1 -- 172.21.15.99:0/2617252646 shutdown_connections 2024-09-10T07:46:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.499+0000 7fc673600640 1 -- 172.21.15.99:0/2617252646 wait complete. 2024-09-10T07:46:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.500+0000 7fc673600640 1 Processor -- start 2024-09-10T07:46:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.500+0000 7fc673600640 1 -- start start 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.501+0000 7fc673600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c06eb20 0x7fc66c1efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.501+0000 7fc673600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c0ce460 0x7fc66c152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.501+0000 7fc673600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0d0420 0x7fc66c0ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.501+0000 7fc673600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c15cfd0 con 0x7fc66c0d0420 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.501+0000 7fc673600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c0ce840 con 0x7fc66c0ce460 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.501+0000 7fc673600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c15d150 con 0x7fc66c06eb20 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.501+0000 7fc671600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0d0420 0x7fc66c0ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.501+0000 7fc671600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0d0420 0x7fc66c0ab830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40592/0 (socket says 172.21.15.99:40592) 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.501+0000 7fc671600640 1 -- 172.21.15.99:0/3248183714 learned_addr learned my addr 172.21.15.99:0/3248183714 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc670c00640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c06eb20 0x7fc66c1efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc663e00640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c0ce460 0x7fc66c152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc671600640 1 -- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c06eb20 msgr2=0x7fc66c1efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc671600640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c06eb20 0x7fc66c1efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc671600640 1 -- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c0ce460 msgr2=0x7fc66c152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc671600640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c0ce460 0x7fc66c152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc671600640 1 -- 172.21.15.99:0/3248183714 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c153590 con 0x7fc66c0d0420 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc671600640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0d0420 0x7fc66c0ab830 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc66400eed0 tx=0x7fc66400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc669600640 1 -- 172.21.15.99:0/3248183714 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664018020 con 0x7fc66c0d0420 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc669600640 1 -- 172.21.15.99:0/3248183714 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc664014400 con 0x7fc66c0d0420 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c152a10 con 0x7fc66c0d0420 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.502+0000 7fc669600640 1 -- 172.21.15.99:0/3248183714 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6640147f0 con 0x7fc66c0d0420 2024-09-10T07:46:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.503+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c152fd0 con 0x7fc66c0d0420 2024-09-10T07:46:06.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.503+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc66c0cfee0 con 0x7fc66c0d0420 2024-09-10T07:46:06.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.504+0000 7fc669600640 1 -- 172.21.15.99:0/3248183714 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc664005d10 con 0x7fc66c0d0420 2024-09-10T07:46:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.505+0000 7fc669600640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc64806be30 0x7fc64806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.505+0000 7fc669600640 1 -- 172.21.15.99:0/3248183714 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fc66408b0e0 con 0x7fc66c0d0420 2024-09-10T07:46:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.505+0000 7fc670c00640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc64806be30 0x7fc64806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.505+0000 7fc669600640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] conn(0x7fc648071cf0 0x7fc648074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.505+0000 7fc669600640 1 -- 172.21.15.99:0/3248183714 --> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc66401fe50 con 0x7fc648071cf0 2024-09-10T07:46:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.506+0000 7fc669600640 1 -- 172.21.15.99:0/3248183714 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7fc664092050 con 0x7fc66c0d0420 2024-09-10T07:46:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.506+0000 7fc663e00640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] conn(0x7fc648071cf0 0x7fc648074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.506+0000 7fc670c00640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc64806be30 0x7fc64806e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009b40 tx=0x7fc65c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.506+0000 7fc663e00640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] conn(0x7fc648071cf0 0x7fc648074110 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:06.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.507+0000 7fc669600640 1 -- 172.21.15.99:0/3248183714 <== osd.5 v2:172.21.15.187:6800/3936971942 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fc66401fe50 con 0x7fc648071cf0 2024-09-10T07:46:06.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.519+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 --> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc66c06e3b0 con 0x7fc648071cf0 2024-09-10T07:46:06.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.520+0000 7fc669600640 1 -- 172.21.15.99:0/3248183714 <== osd.5 v2:172.21.15.187:6800/3936971942 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fc66c06e3b0 con 0x7fc648071cf0 2024-09-10T07:46:06.520 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:46:06.520 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-10T07:46:06.520 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:46:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] conn(0x7fc648071cf0 msgr2=0x7fc648074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc673600640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.187:6800/3936971942,v1:172.21.15.187:6801/3936971942] conn(0x7fc648071cf0 0x7fc648074110 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc64806be30 msgr2=0x7fc64806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc673600640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fc64806be30 0x7fc64806e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009b40 tx=0x7fc65c009190 comp rx=0 tx=0).stop 2024-09-10T07:46:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0d0420 msgr2=0x7fc66c0ab830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc673600640 1 --2- 172.21.15.99:0/3248183714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc66c0d0420 0x7fc66c0ab830 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc66400eed0 tx=0x7fc66400b480 comp rx=0 tx=0).stop 2024-09-10T07:46:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc671600640 1 -- 172.21.15.99:0/3248183714 reap_dead start 2024-09-10T07:46:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 shutdown_connections 2024-09-10T07:46:06.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 >> 172.21.15.99:0/3248183714 conn(0x7fc66c0b26a0 msgr2=0x7fc66c0b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:06.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 shutdown_connections 2024-09-10T07:46:06.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.521+0000 7fc673600640 1 -- 172.21.15.99:0/3248183714 wait complete. 2024-09-10T07:46:06.536 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T07:46:06.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.690+0000 7f2dee800640 1 Processor -- start 2024-09-10T07:46:06.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.690+0000 7f2dee800640 1 -- start start 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.691+0000 7f2dee800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2de815db60 0x7f2de8071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.691+0000 7f2dee800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2de806e750 0x7f2de80ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.691+0000 7f2dee800640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de8153e50 con 0x7f2de80724d0 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.691+0000 7f2dee800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f2de815df40 con 0x7f2de815db60 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.691+0000 7f2dee800640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f2de8072ac0 con 0x7f2de806e750 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.691+0000 7f2de7400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2de815db60 0x7f2de8071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.692+0000 7f2de7400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2de815db60 0x7f2de8071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40600/0 (socket says 172.21.15.99:40600) 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.692+0000 7f2de7400640 1 -- 172.21.15.99:0/4144641927 learned_addr learned my addr 172.21.15.99:0/4144641927 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.692+0000 7f2de7e00640 1 --2- 172.21.15.99:0/4144641927 >> v2:172.21.15.187:3300/0 conn(0x7f2de806e750 0x7f2de80ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.692+0000 7f2de7400640 1 -- 172.21.15.99:0/4144641927 >> v2:172.21.15.187:3300/0 conn(0x7f2de806e750 msgr2=0x7f2de80ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.692+0000 7f2de7400640 1 --2- 172.21.15.99:0/4144641927 >> v2:172.21.15.187:3300/0 conn(0x7f2de806e750 0x7f2de80ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.692+0000 7f2de7400640 1 -- 172.21.15.99:0/4144641927 >> v1:172.21.15.187:6789/0 conn(0x7f2de80724d0 legacy=0x7f2de806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:06.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.692+0000 7f2de7400640 1 -- 172.21.15.99:0/4144641927 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de8072da0 con 0x7f2de815db60 2024-09-10T07:46:06.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.692+0000 7f2de7e00640 1 --2- 172.21.15.99:0/4144641927 >> v2:172.21.15.187:3300/0 conn(0x7f2de806e750 0x7f2de80ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.693+0000 7f2de7400640 1 --2- 172.21.15.99:0/4144641927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de815db60 0x7f2de8071f90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f2de806ed50 tx=0x7f2dd802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9296e179150079e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.693+0000 7f2de6000640 1 -- 172.21.15.99:0/4144641927 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8037070 con 0x7f2de815db60 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.693+0000 7f2de6000640 1 -- 172.21.15.99:0/4144641927 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd8032440 con 0x7f2de815db60 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.693+0000 7f2de6000640 1 -- 172.21.15.99:0/4144641927 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8032810 con 0x7f2de815db60 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.694+0000 7f2dee800640 1 -- 172.21.15.99:0/4144641927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de815db60 msgr2=0x7f2de8071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.694+0000 7f2dee800640 1 --2- 172.21.15.99:0/4144641927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de815db60 0x7f2de8071f90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f2de806ed50 tx=0x7f2dd802a230 comp rx=0 tx=0).stop 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.694+0000 7f2dee800640 1 -- 172.21.15.99:0/4144641927 shutdown_connections 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.694+0000 7f2dee800640 1 --2- 172.21.15.99:0/4144641927 >> v2:172.21.15.187:3300/0 conn(0x7f2de806e750 0x7f2de80ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.694+0000 7f2dee800640 1 --2- 172.21.15.99:0/4144641927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de815db60 0x7f2de8071f90 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.694+0000 7f2dee800640 1 -- 172.21.15.99:0/4144641927 >> 172.21.15.99:0/4144641927 conn(0x7f2de80b2630 msgr2=0x7f2de80b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.694+0000 7f2dee800640 1 -- 172.21.15.99:0/4144641927 shutdown_connections 2024-09-10T07:46:06.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.694+0000 7f2dee800640 1 -- 172.21.15.99:0/4144641927 wait complete. 2024-09-10T07:46:06.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.695+0000 7f2dee800640 1 Processor -- start 2024-09-10T07:46:06.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.696+0000 7f2dee800640 1 -- start start 2024-09-10T07:46:06.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.696+0000 7f2dee800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de806e750 0x7f2de8152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.696+0000 7f2dee800640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2de80724d0 0x7f2de8152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.696+0000 7f2dee800640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de815db60 0x7f2de81f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2dee800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8073640 con 0x7f2de806e750 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2dee800640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8073360 con 0x7f2de815db60 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2dee800640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f2de815d1c0 con 0x7f2de80724d0 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2de7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de806e750 0x7f2de8152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2de7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de806e750 0x7f2de8152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40616/0 (socket says 172.21.15.99:40616) 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2de7400640 1 -- 172.21.15.99:0/2887594850 learned_addr learned my addr 172.21.15.99:0/2887594850 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2de6a00640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2de80724d0 0x7f2de8152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2de7e00640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de815db60 0x7f2de81f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2de7400640 1 -- 172.21.15.99:0/2887594850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2de80724d0 msgr2=0x7f2de8152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2de7400640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2de80724d0 0x7f2de8152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2de7400640 1 -- 172.21.15.99:0/2887594850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de815db60 msgr2=0x7f2de81f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2de7400640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de815db60 0x7f2de81f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.697+0000 7f2de7400640 1 -- 172.21.15.99:0/2887594850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de80ab050 con 0x7f2de806e750 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.698+0000 7f2de7400640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de806e750 0x7f2de8152aa0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8000c00 tx=0x7f2dd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:06.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.698+0000 7f2ddf400640 1 -- 172.21.15.99:0/2887594850 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8041020 con 0x7f2de806e750 2024-09-10T07:46:06.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.698+0000 7f2ddf400640 1 -- 172.21.15.99:0/2887594850 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd8030970 con 0x7f2de806e750 2024-09-10T07:46:06.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.698+0000 7f2dee800640 1 -- 172.21.15.99:0/2887594850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de80ab330 con 0x7f2de806e750 2024-09-10T07:46:06.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.698+0000 7f2ddf400640 1 -- 172.21.15.99:0/2887594850 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8037040 con 0x7f2de806e750 2024-09-10T07:46:06.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.698+0000 7f2dee800640 1 -- 172.21.15.99:0/2887594850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de80aec80 con 0x7f2de806e750 2024-09-10T07:46:06.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.699+0000 7f2dee800640 1 -- 172.21.15.99:0/2887594850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de8071f90 con 0x7f2de806e750 2024-09-10T07:46:06.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.700+0000 7f2ddf400640 1 -- 172.21.15.99:0/2887594850 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2dd8044020 con 0x7f2de806e750 2024-09-10T07:46:06.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.701+0000 7f2ddf400640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2dc806be30 0x7f2dc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:06.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.701+0000 7f2ddf400640 1 -- 172.21.15.99:0/2887594850 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f2dd80ab3a0 con 0x7f2de806e750 2024-09-10T07:46:06.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.701+0000 7f2de6a00640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2dc806be30 0x7f2dc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:06.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.702+0000 7f2de6a00640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2dc806be30 0x7f2dc806e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2de80b1060 tx=0x7f2dd4007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:06.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.705+0000 7f2ddf400640 1 -- 172.21.15.99:0/2887594850 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2dd804b030 con 0x7f2de806e750 2024-09-10T07:46:06.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.882+0000 7f2dee800640 1 -- 172.21.15.99:0/2887594850 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f2de806dc10 con 0x7f2dc806be30 2024-09-10T07:46:06.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.882+0000 7f2ddf400640 1 -- 172.21.15.99:0/2887594850 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2de806dc10 con 0x7f2dc806be30 2024-09-10T07:46:06.882 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T07:46:06.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 -- 172.21.15.99:0/2887594850 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2dc806be30 msgr2=0x7f2dc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2dc806be30 0x7f2dc806e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2de80b1060 tx=0x7f2dd4007e30 comp rx=0 tx=0).stop 2024-09-10T07:46:06.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 -- 172.21.15.99:0/2887594850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de806e750 msgr2=0x7f2de8152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:06.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de806e750 0x7f2de8152aa0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8000c00 tx=0x7f2dd80046c0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 -- 172.21.15.99:0/2887594850 shutdown_connections 2024-09-10T07:46:06.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de815db60 0x7f2de81f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2de80724d0 0x7f2de8152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f2dc806be30 0x7f2dc806e2f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 --2- 172.21.15.99:0/2887594850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2de806e750 0x7f2de8152aa0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 -- 172.21.15.99:0/2887594850 >> 172.21.15.99:0/2887594850 conn(0x7f2de80b2630 msgr2=0x7f2de80b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 -- 172.21.15.99:0/2887594850 shutdown_connections 2024-09-10T07:46:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:06.884+0000 7f2dee800640 1 -- 172.21.15.99:0/2887594850 wait complete. 2024-09-10T07:46:06.900 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T07:46:06.900 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T07:46:07.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.059+0000 7f349b200640 1 Processor -- start 2024-09-10T07:46:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.059+0000 7f349b200640 1 -- start start 2024-09-10T07:46:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.060+0000 7f349b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f349c0d16b0 0x7f349c0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.060+0000 7f349b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f349c0d1ef0 0x7f349c1634f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.060+0000 7f349b200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349c0d56f0 con 0x7f349c0d1a90 2024-09-10T07:46:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.060+0000 7f349b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f349c0d59d0 con 0x7f349c0d1ef0 2024-09-10T07:46:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.060+0000 7f349b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f349c0d0a60 con 0x7f349c0d16b0 2024-09-10T07:46:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.060+0000 7f349a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f349c0d1ef0 0x7f349c1634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.060+0000 7f349a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f349c0d1ef0 0x7f349c1634f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40622/0 (socket says 172.21.15.99:40622) 2024-09-10T07:46:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.060+0000 7f349a800640 1 -- 172.21.15.99:0/3912631845 learned_addr learned my addr 172.21.15.99:0/3912631845 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.060+0000 7f3499400640 1 --1- 172.21.15.99:0/3912631845 >> v1:172.21.15.99:6789/0 conn(0x7f349c0d1a90 0x7f349c162de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53118/0 (socket says 172.21.15.99:53118) 2024-09-10T07:46:07.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.061+0000 7f3499e00640 1 --2- 172.21.15.99:0/3912631845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f349c0d16b0 0x7f349c0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.061+0000 7f349a800640 1 -- 172.21.15.99:0/3912631845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f349c0d16b0 msgr2=0x7f349c0b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:07.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.061+0000 7f349a800640 1 --2- 172.21.15.99:0/3912631845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f349c0d16b0 0x7f349c0b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.061+0000 7f349a800640 1 -- 172.21.15.99:0/3912631845 >> v1:172.21.15.99:6789/0 conn(0x7f349c0d1a90 legacy=0x7f349c162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.061+0000 7f349a800640 1 -- 172.21.15.99:0/3912631845 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c0d31b0 con 0x7f349c0d1ef0 2024-09-10T07:46:07.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.061+0000 7f3498a00640 1 -- 172.21.15.99:0/3912631845 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1563962775 0 0) 0x7f349c0d56f0 con 0x7f349c0d1a90 2024-09-10T07:46:07.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.062+0000 7f349a800640 1 --2- 172.21.15.99:0/3912631845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f349c0d1ef0 0x7f349c1634f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3494009e50 tx=0x7f349402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6b7511bff87a5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.062+0000 7f3498a00640 1 -- 172.21.15.99:0/3912631845 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494036070 con 0x7f349c0d1ef0 2024-09-10T07:46:07.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.062+0000 7f3498a00640 1 -- 172.21.15.99:0/3912631845 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3494031600 con 0x7f349c0d1ef0 2024-09-10T07:46:07.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.062+0000 7f3498a00640 1 -- 172.21.15.99:0/3912631845 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34940319d0 con 0x7f349c0d1ef0 2024-09-10T07:46:07.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.063+0000 7f349b200640 1 -- 172.21.15.99:0/3912631845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f349c0d1ef0 msgr2=0x7f349c1634f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.063+0000 7f349b200640 1 --2- 172.21.15.99:0/3912631845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f349c0d1ef0 0x7f349c1634f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3494009e50 tx=0x7f349402a680 comp rx=0 tx=0).stop 2024-09-10T07:46:07.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.063+0000 7f349b200640 1 -- 172.21.15.99:0/3912631845 shutdown_connections 2024-09-10T07:46:07.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.063+0000 7f349b200640 1 --2- 172.21.15.99:0/3912631845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f349c0d1ef0 0x7f349c1634f0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.063+0000 7f349b200640 1 --2- 172.21.15.99:0/3912631845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f349c0d16b0 0x7f349c0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.063+0000 7f349b200640 1 -- 172.21.15.99:0/3912631845 >> 172.21.15.99:0/3912631845 conn(0x7f349c0d4a30 msgr2=0x7f349c0d4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:07.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.063+0000 7f349b200640 1 -- 172.21.15.99:0/3912631845 shutdown_connections 2024-09-10T07:46:07.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.063+0000 7f349b200640 1 -- 172.21.15.99:0/3912631845 wait complete. 2024-09-10T07:46:07.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.064+0000 7f349b200640 1 Processor -- start 2024-09-10T07:46:07.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.065+0000 7f349b200640 1 -- start start 2024-09-10T07:46:07.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.065+0000 7f349b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f349c0d16b0 0x7f349c1f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.065+0000 7f349b200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f349c0d1a90 0x7f349c0b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.065+0000 7f349b200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f349c0d1ef0 0x7f349c0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.065+0000 7f349b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f349c0d2300 con 0x7f349c0d16b0 2024-09-10T07:46:07.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.065+0000 7f349b200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f349c0d3800 con 0x7f349c0d1ef0 2024-09-10T07:46:07.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.065+0000 7f349b200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f349c163a30 con 0x7f349c0d1a90 2024-09-10T07:46:07.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f3499e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f349c0d16b0 0x7f349c1f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f3499e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f349c0d16b0 0x7f349c1f7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40636/0 (socket says 172.21.15.99:40636) 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f3499e00640 1 -- 172.21.15.99:0/2825485227 learned_addr learned my addr 172.21.15.99:0/2825485227 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f3499e00640 1 -- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f349c0d1a90 msgr2=0x7f349c0b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f3499e00640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f349c0d1a90 0x7f349c0b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f3499e00640 1 -- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f349c0d1ef0 msgr2=0x7f349c0b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f349a800640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f349c0d1ef0 0x7f349c0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f3499e00640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f349c0d1ef0 0x7f349c0b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f3499e00640 1 -- 172.21.15.99:0/2825485227 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c0c9c30 con 0x7f349c0d16b0 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f349a800640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f349c0d1ef0 0x7f349c0b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.066+0000 7f3499e00640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f349c0d16b0 0x7f349c1f7640 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f348c00e870 tx=0x7f348c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.067+0000 7f3492000640 1 -- 172.21.15.99:0/2825485227 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c017070 con 0x7f349c0d16b0 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.067+0000 7f3492000640 1 -- 172.21.15.99:0/2825485227 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c00c940 con 0x7f349c0d16b0 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.067+0000 7f3492000640 1 -- 172.21.15.99:0/2825485227 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c00cd30 con 0x7f349c0d16b0 2024-09-10T07:46:07.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.067+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349c0c9ef0 con 0x7f349c0d16b0 2024-09-10T07:46:07.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.067+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349c0ca4b0 con 0x7f349c0d16b0 2024-09-10T07:46:07.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.068+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f349c0b57a0 con 0x7f349c0d16b0 2024-09-10T07:46:07.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.069+0000 7f3492000640 1 -- 172.21.15.99:0/2825485227 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f348c01a070 con 0x7f349c0d16b0 2024-09-10T07:46:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.069+0000 7f3492000640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f347c06be30 0x7f347c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.070+0000 7f3492000640 1 -- 172.21.15.99:0/2825485227 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f348c08ae90 con 0x7f349c0d16b0 2024-09-10T07:46:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.070+0000 7f3499400640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f347c06be30 0x7f347c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.070+0000 7f3492000640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] conn(0x7f347c071cf0 0x7f347c074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.070+0000 7f3492000640 1 -- 172.21.15.99:0/2825485227 --> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f347c0747c0 con 0x7f347c071cf0 2024-09-10T07:46:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.070+0000 7f3492000640 1 -- 172.21.15.99:0/2825485227 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7f348c08d450 con 0x7f349c0d16b0 2024-09-10T07:46:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.070+0000 7f3499400640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f347c06be30 0x7f347c06e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3488007fd0 tx=0x7f3488007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.071+0000 7f349a800640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] conn(0x7f347c071cf0 0x7f347c074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.071+0000 7f349a800640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] conn(0x7f347c071cf0 0x7f347c074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.072+0000 7f3492000640 1 -- 172.21.15.99:0/2825485227 <== osd.6 v2:172.21.15.187:6808/2894508630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f347c0747c0 con 0x7f347c071cf0 2024-09-10T07:46:07.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.084+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 --> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f349c0b87d0 con 0x7f347c071cf0 2024-09-10T07:46:07.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.084+0000 7f3492000640 1 -- 172.21.15.99:0/2825485227 <== osd.6 v2:172.21.15.187:6808/2894508630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f349c0b87d0 con 0x7f347c071cf0 2024-09-10T07:46:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:46:07.084 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-10T07:46:07.084 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:46:07.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] conn(0x7f347c071cf0 msgr2=0x7f347c074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349b200640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.187:6808/2894508630,v1:172.21.15.187:6809/2894508630] conn(0x7f347c071cf0 0x7f347c074110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f347c06be30 msgr2=0x7f347c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349b200640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f347c06be30 0x7f347c06e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3488007fd0 tx=0x7f3488007920 comp rx=0 tx=0).stop 2024-09-10T07:46:07.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f349c0d16b0 msgr2=0x7f349c1f7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349b200640 1 --2- 172.21.15.99:0/2825485227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f349c0d16b0 0x7f349c1f7640 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f348c00e870 tx=0x7f348c00ed30 comp rx=0 tx=0).stop 2024-09-10T07:46:07.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349a800640 1 -- 172.21.15.99:0/2825485227 reap_dead start 2024-09-10T07:46:07.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 shutdown_connections 2024-09-10T07:46:07.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 >> 172.21.15.99:0/2825485227 conn(0x7f349c0d4a30 msgr2=0x7f349c06cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:07.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 shutdown_connections 2024-09-10T07:46:07.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.085+0000 7f349b200640 1 -- 172.21.15.99:0/2825485227 wait complete. 2024-09-10T07:46:07.100 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T07:46:07.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.254+0000 7ff713200640 1 Processor -- start 2024-09-10T07:46:07.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.254+0000 7ff713200640 1 -- start start 2024-09-10T07:46:07.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.255+0000 7ff713200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff7140d51a0 0x7ff7140d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.255+0000 7ff713200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7140cf740 con 0x7ff71415ed10 2024-09-10T07:46:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.255+0000 7ff713200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7140d5910 con 0x7ff7140d3070 2024-09-10T07:46:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.255+0000 7ff713200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7ff7140d2d70 con 0x7ff7140d51a0 2024-09-10T07:46:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.255+0000 7ff711400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff71415ed10 0x7ff7140d2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53120/0 (socket says 172.21.15.99:53120) 2024-09-10T07:46:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.255+0000 7ff711400640 1 -- 172.21.15.99:0/3156804161 learned_addr learned my addr 172.21.15.99:0/3156804161 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:46:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.256+0000 7ff712800640 1 --2- 172.21.15.99:0/3156804161 >> v2:172.21.15.187:3300/0 conn(0x7ff7140d51a0 0x7ff7140d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.256+0000 7ff710a00640 1 -- 172.21.15.99:0/3156804161 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159545337 0 0) 0x7ff7140cf740 con 0x7ff71415ed10 2024-09-10T07:46:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.256+0000 7ff710a00640 1 -- 172.21.15.99:0/3156804161 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6f8003520 con 0x7ff71415ed10 2024-09-10T07:46:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.256+0000 7ff710a00640 1 -- 172.21.15.99:0/3156804161 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560923084 0 0) 0x7ff7140d5910 con 0x7ff7140d3070 2024-09-10T07:46:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.256+0000 7ff710a00640 1 -- 172.21.15.99:0/3156804161 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7140cf740 con 0x7ff7140d3070 2024-09-10T07:46:07.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.256+0000 7ff710a00640 1 -- 172.21.15.99:0/3156804161 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2135907423 0 0) 0x7ff6f8003520 con 0x7ff71415ed10 2024-09-10T07:46:07.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.256+0000 7ff712800640 1 -- 172.21.15.99:0/3156804161 >> v1:172.21.15.187:6789/0 conn(0x7ff7140d3070 legacy=0x7ff7140d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.256+0000 7ff712800640 1 -- 172.21.15.99:0/3156804161 >> v1:172.21.15.99:6789/0 conn(0x7ff71415ed10 legacy=0x7ff7140d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.256+0000 7ff712800640 1 -- 172.21.15.99:0/3156804161 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7140d5630 con 0x7ff7140d51a0 2024-09-10T07:46:07.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.257+0000 7ff712800640 1 --2- 172.21.15.99:0/3156804161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7140d51a0 0x7ff7140d01e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009d90 tx=0x7ff70c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6de682beb9c0d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.258+0000 7ff710a00640 1 -- 172.21.15.99:0/3156804161 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700001690 con 0x7ff7140d51a0 2024-09-10T07:46:07.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.258+0000 7ff710a00640 1 -- 172.21.15.99:0/3156804161 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70c007540 con 0x7ff7140d51a0 2024-09-10T07:46:07.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.258+0000 7ff710a00640 1 -- 172.21.15.99:0/3156804161 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c007910 con 0x7ff7140d51a0 2024-09-10T07:46:07.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.258+0000 7ff713200640 1 -- 172.21.15.99:0/3156804161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7140d51a0 msgr2=0x7ff7140d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.258+0000 7ff713200640 1 --2- 172.21.15.99:0/3156804161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7140d51a0 0x7ff7140d01e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009d90 tx=0x7ff70c02a710 comp rx=0 tx=0).stop 2024-09-10T07:46:07.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.258+0000 7ff713200640 1 -- 172.21.15.99:0/3156804161 shutdown_connections 2024-09-10T07:46:07.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.258+0000 7ff713200640 1 --2- 172.21.15.99:0/3156804161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7140d51a0 0x7ff7140d01e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.258+0000 7ff713200640 1 -- 172.21.15.99:0/3156804161 >> 172.21.15.99:0/3156804161 conn(0x7ff71409dd60 msgr2=0x7ff7140d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:07.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.258+0000 7ff713200640 1 -- 172.21.15.99:0/3156804161 shutdown_connections 2024-09-10T07:46:07.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.258+0000 7ff713200640 1 -- 172.21.15.99:0/3156804161 wait complete. 2024-09-10T07:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.260+0000 7ff713200640 1 Processor -- start 2024-09-10T07:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.260+0000 7ff713200640 1 -- start start 2024-09-10T07:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff713200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7140d3070 0x7ff71415d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff713200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff71415ed10 0x7ff7140ba290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff713200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7140b8cc0 0x7ff7140b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff713200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff7140d0720 con 0x7ff7140b8cc0 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff713200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff7140cfcc0 con 0x7ff7140d3070 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff713200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff7140d08a0 con 0x7ff71415ed10 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff712800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7140b8cc0 0x7ff7140b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff712800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7140b8cc0 0x7ff7140b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40642/0 (socket says 172.21.15.99:40642) 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff712800640 1 -- 172.21.15.99:0/4058291598 learned_addr learned my addr 172.21.15.99:0/4058291598 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff711e00640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7140d3070 0x7ff71415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff711400640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff71415ed10 0x7ff7140ba290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff712800640 1 -- 172.21.15.99:0/4058291598 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff71415ed10 msgr2=0x7ff7140ba290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff712800640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff71415ed10 0x7ff7140ba290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff712800640 1 -- 172.21.15.99:0/4058291598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7140d3070 msgr2=0x7ff71415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff712800640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7140d3070 0x7ff71415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff712800640 1 -- 172.21.15.99:0/4058291598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7140ba7d0 con 0x7ff7140b8cc0 2024-09-10T07:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.261+0000 7ff711e00640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7140d3070 0x7ff71415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.262+0000 7ff712800640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7140b8cc0 0x7ff7140b6d20 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009d90 tx=0x7ff70c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.262+0000 7ff70a000640 1 -- 172.21.15.99:0/4058291598 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c040070 con 0x7ff7140b8cc0 2024-09-10T07:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.262+0000 7ff70a000640 1 -- 172.21.15.99:0/4058291598 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70c031bc0 con 0x7ff7140b8cc0 2024-09-10T07:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.262+0000 7ff713200640 1 -- 172.21.15.99:0/4058291598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7140b91f0 con 0x7ff7140b8cc0 2024-09-10T07:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.262+0000 7ff70a000640 1 -- 172.21.15.99:0/4058291598 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c007e90 con 0x7ff7140b8cc0 2024-09-10T07:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.262+0000 7ff713200640 1 -- 172.21.15.99:0/4058291598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7140b97b0 con 0x7ff7140b8cc0 2024-09-10T07:46:07.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.263+0000 7ff713200640 1 -- 172.21.15.99:0/4058291598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7140d01e0 con 0x7ff7140b8cc0 2024-09-10T07:46:07.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.264+0000 7ff70a000640 1 -- 172.21.15.99:0/4058291598 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff70c039040 con 0x7ff7140b8cc0 2024-09-10T07:46:07.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.265+0000 7ff70a000640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff6f406be30 0x7ff6f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.266+0000 7ff70a000640 1 -- 172.21.15.99:0/4058291598 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7ff70c0abdd0 con 0x7ff7140b8cc0 2024-09-10T07:46:07.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.266+0000 7ff711e00640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff6f406be30 0x7ff6f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.266+0000 7ff711e00640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff6f406be30 0x7ff6f406e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff704007fd0 tx=0x7ff704009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.270+0000 7ff70a000640 1 -- 172.21.15.99:0/4058291598 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff70c07a420 con 0x7ff7140b8cc0 2024-09-10T07:46:07.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.440+0000 7ff713200640 1 -- 172.21.15.99:0/4058291598 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7ff7140d4870 con 0x7ff6f406be30 2024-09-10T07:46:07.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.441+0000 7ff70a000640 1 -- 172.21.15.99:0/4058291598 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff7140d4870 con 0x7ff6f406be30 2024-09-10T07:46:07.441 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T07:46:07.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 -- 172.21.15.99:0/4058291598 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff6f406be30 msgr2=0x7ff6f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff6f406be30 0x7ff6f406e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff704007fd0 tx=0x7ff704009040 comp rx=0 tx=0).stop 2024-09-10T07:46:07.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 -- 172.21.15.99:0/4058291598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7140b8cc0 msgr2=0x7ff7140b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7140b8cc0 0x7ff7140b6d20 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009d90 tx=0x7ff70c004a40 comp rx=0 tx=0).stop 2024-09-10T07:46:07.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 -- 172.21.15.99:0/4058291598 shutdown_connections 2024-09-10T07:46:07.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff6f406be30 0x7ff6f406e2f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7140b8cc0 0x7ff7140b6d20 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff71415ed10 0x7ff7140ba290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 --2- 172.21.15.99:0/4058291598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7140d3070 0x7ff71415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 -- 172.21.15.99:0/4058291598 >> 172.21.15.99:0/4058291598 conn(0x7ff71409dd60 msgr2=0x7ff7140b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:07.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 -- 172.21.15.99:0/4058291598 shutdown_connections 2024-09-10T07:46:07.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.443+0000 7ff713200640 1 -- 172.21.15.99:0/4058291598 wait complete. 2024-09-10T07:46:07.458 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T07:46:07.459 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T07:46:07.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.616+0000 7fa338400640 1 Processor -- start 2024-09-10T07:46:07.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.616+0000 7fa338400640 1 -- start start 2024-09-10T07:46:07.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.617+0000 7fa338400640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa3300ced50 0x7fa330072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.617+0000 7fa338400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa330144980 0x7fa330072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.617+0000 7fa338400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa330160310 con 0x7fa3301445a0 2024-09-10T07:46:07.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.617+0000 7fa338400640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa3300b4d20 con 0x7fa3300ced50 2024-09-10T07:46:07.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.617+0000 7fa338400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa33015fdd0 con 0x7fa330144980 2024-09-10T07:46:07.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa335a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa3301445a0 0x7fa3300cd380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53126/0 (socket says 172.21.15.99:53126) 2024-09-10T07:46:07.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa335a00640 1 -- 172.21.15.99:0/1216753152 learned_addr learned my addr 172.21.15.99:0/1216753152 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:46:07.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa335000640 1 --2- 172.21.15.99:0/1216753152 >> v2:172.21.15.187:3300/0 conn(0x7fa3300ced50 0x7fa330072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa336400640 1 --2- 172.21.15.99:0/1216753152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa330144980 0x7fa330072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa32fe00640 1 -- 172.21.15.99:0/1216753152 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1507890862 0 0) 0x7fa330160310 con 0x7fa3301445a0 2024-09-10T07:46:07.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa32fe00640 1 -- 172.21.15.99:0/1216753152 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa318003520 con 0x7fa3301445a0 2024-09-10T07:46:07.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa336400640 1 -- 172.21.15.99:0/1216753152 >> v2:172.21.15.187:3300/0 conn(0x7fa3300ced50 msgr2=0x7fa330072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:07.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa336400640 1 --2- 172.21.15.99:0/1216753152 >> v2:172.21.15.187:3300/0 conn(0x7fa3300ced50 0x7fa330072680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa336400640 1 -- 172.21.15.99:0/1216753152 >> v1:172.21.15.99:6789/0 conn(0x7fa3301445a0 legacy=0x7fa3300cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa336400640 1 -- 172.21.15.99:0/1216753152 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa330160030 con 0x7fa330144980 2024-09-10T07:46:07.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.618+0000 7fa335000640 1 --2- 172.21.15.99:0/1216753152 >> v2:172.21.15.187:3300/0 conn(0x7fa3300ced50 0x7fa330072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T07:46:07.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.620+0000 7fa336400640 1 --2- 172.21.15.99:0/1216753152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa330144980 0x7fa330072bc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa328009d90 tx=0x7fa32802a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a74bc89623c4ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.620+0000 7fa32fe00640 1 -- 172.21.15.99:0/1216753152 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328007740 con 0x7fa330144980 2024-09-10T07:46:07.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.620+0000 7fa32fe00640 1 -- 172.21.15.99:0/1216753152 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3280078e0 con 0x7fa330144980 2024-09-10T07:46:07.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.620+0000 7fa32fe00640 1 -- 172.21.15.99:0/1216753152 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa328007cb0 con 0x7fa330144980 2024-09-10T07:46:07.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.620+0000 7fa338400640 1 -- 172.21.15.99:0/1216753152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa330144980 msgr2=0x7fa330072bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.620+0000 7fa338400640 1 --2- 172.21.15.99:0/1216753152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa330144980 0x7fa330072bc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa328009d90 tx=0x7fa32802a530 comp rx=0 tx=0).stop 2024-09-10T07:46:07.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.620+0000 7fa338400640 1 -- 172.21.15.99:0/1216753152 shutdown_connections 2024-09-10T07:46:07.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.620+0000 7fa338400640 1 --2- 172.21.15.99:0/1216753152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa330144980 0x7fa330072bc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.620+0000 7fa338400640 1 --2- 172.21.15.99:0/1216753152 >> v2:172.21.15.187:3300/0 conn(0x7fa3300ced50 0x7fa330072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.620+0000 7fa338400640 1 -- 172.21.15.99:0/1216753152 >> 172.21.15.99:0/1216753152 conn(0x7fa3300b26a0 msgr2=0x7fa3300b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:07.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.621+0000 7fa338400640 1 -- 172.21.15.99:0/1216753152 shutdown_connections 2024-09-10T07:46:07.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.621+0000 7fa338400640 1 -- 172.21.15.99:0/1216753152 wait complete. 2024-09-10T07:46:07.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.622+0000 7fa338400640 1 Processor -- start 2024-09-10T07:46:07.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.622+0000 7fa338400640 1 -- start start 2024-09-10T07:46:07.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa338400640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3300ced50 0x7fa330158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa338400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3301445a0 0x7fa3301f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa338400640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa330144980 0x7fa3301f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa338400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa3300b5c20 con 0x7fa3301445a0 2024-09-10T07:46:07.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa338400640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa3300b5f00 con 0x7fa330144980 2024-09-10T07:46:07.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa338400640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa330144ec0 con 0x7fa3300ced50 2024-09-10T07:46:07.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa335000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3301445a0 0x7fa3301f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa335000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3301445a0 0x7fa3301f5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40656/0 (socket says 172.21.15.99:40656) 2024-09-10T07:46:07.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa335000640 1 -- 172.21.15.99:0/1488586101 learned_addr learned my addr 172.21.15.99:0/1488586101 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa335a00640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3300ced50 0x7fa330158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.623+0000 7fa336400640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa330144980 0x7fa3301f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa335000640 1 -- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3300ced50 msgr2=0x7fa330158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa335000640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3300ced50 0x7fa330158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa335000640 1 -- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa330144980 msgr2=0x7fa3301f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa335000640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa330144980 0x7fa3301f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa335000640 1 -- 172.21.15.99:0/1488586101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3301f41f0 con 0x7fa3301445a0 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa335000640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3301445a0 0x7fa3301f5290 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00ebe0 tx=0x7fa31c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa32d600640 1 -- 172.21.15.99:0/1488586101 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c017070 con 0x7fa3301445a0 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa32d600640 1 -- 172.21.15.99:0/1488586101 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa31c00cc30 con 0x7fa3301445a0 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3301f44d0 con 0x7fa3301445a0 2024-09-10T07:46:07.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa32d600640 1 -- 172.21.15.99:0/1488586101 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c013470 con 0x7fa3301445a0 2024-09-10T07:46:07.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.624+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3301f4a90 con 0x7fa3301445a0 2024-09-10T07:46:07.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.625+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa3300cd380 con 0x7fa3301445a0 2024-09-10T07:46:07.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.626+0000 7fa32d600640 1 -- 172.21.15.99:0/1488586101 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa31c01a070 con 0x7fa3301445a0 2024-09-10T07:46:07.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.627+0000 7fa32d600640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa31006be30 0x7fa31006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.627+0000 7fa32d600640 1 -- 172.21.15.99:0/1488586101 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fa31c08aef0 con 0x7fa3301445a0 2024-09-10T07:46:07.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.627+0000 7fa32d600640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] conn(0x7fa310071cf0 0x7fa310074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.627+0000 7fa335a00640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa31006be30 0x7fa31006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.627+0000 7fa32d600640 1 -- 172.21.15.99:0/1488586101 --> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3100747c0 con 0x7fa310071cf0 2024-09-10T07:46:07.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.627+0000 7fa32d600640 1 -- 172.21.15.99:0/1488586101 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=194) ==== 24+0+0 (secure 0 0 0) 0x7fa31c08d510 con 0x7fa3301445a0 2024-09-10T07:46:07.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.628+0000 7fa336400640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] conn(0x7fa310071cf0 0x7fa310074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.628+0000 7fa335a00640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa31006be30 0x7fa31006e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa324005880 tx=0x7fa324009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.628+0000 7fa336400640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] conn(0x7fa310071cf0 0x7fa310074110 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.629+0000 7fa32d600640 1 -- 172.21.15.99:0/1488586101 <== osd.7 v2:172.21.15.187:6811/303826834 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fa3100747c0 con 0x7fa310071cf0 2024-09-10T07:46:07.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.641+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 --> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa330141840 con 0x7fa310071cf0 2024-09-10T07:46:07.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa32d600640 1 -- 172.21.15.99:0/1488586101 <== osd.7 v2:172.21.15.187:6811/303826834 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fa330141840 con 0x7fa310071cf0 2024-09-10T07:46:07.641 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T07:46:07.641 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-10T07:46:07.642 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T07:46:07.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] conn(0x7fa310071cf0 msgr2=0x7fa310074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa338400640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.187:6811/303826834,v1:172.21.15.187:6813/303826834] conn(0x7fa310071cf0 0x7fa310074110 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa31006be30 msgr2=0x7fa31006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa338400640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa31006be30 0x7fa31006e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa324005880 tx=0x7fa324009040 comp rx=0 tx=0).stop 2024-09-10T07:46:07.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3301445a0 msgr2=0x7fa3301f5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa338400640 1 --2- 172.21.15.99:0/1488586101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3301445a0 0x7fa3301f5290 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00ebe0 tx=0x7fa31c00c520 comp rx=0 tx=0).stop 2024-09-10T07:46:07.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa336400640 1 -- 172.21.15.99:0/1488586101 reap_dead start 2024-09-10T07:46:07.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 shutdown_connections 2024-09-10T07:46:07.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 >> 172.21.15.99:0/1488586101 conn(0x7fa3300b26a0 msgr2=0x7fa3300b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:07.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 shutdown_connections 2024-09-10T07:46:07.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.642+0000 7fa338400640 1 -- 172.21.15.99:0/1488586101 wait complete. 2024-09-10T07:46:07.656 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T07:46:07.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.812+0000 7f933ac00640 1 Processor -- start 2024-09-10T07:46:07.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.812+0000 7f933ac00640 1 -- start start 2024-09-10T07:46:07.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.813+0000 7f933ac00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933406c320 0x7f9334169610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.813+0000 7f933ac00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93340af450 con 0x7f93340aefe0 2024-09-10T07:46:07.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.813+0000 7f933ac00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93340af6c0 con 0x7f933415e8b0 2024-09-10T07:46:07.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.813+0000 7f933ac00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f93340b02d0 con 0x7f933406c320 2024-09-10T07:46:07.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.813+0000 7f9338e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f93340aefe0 0x7f933406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:53130/0 (socket says 172.21.15.99:53130) 2024-09-10T07:46:07.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.813+0000 7f9338e00640 1 -- 172.21.15.99:0/73453348 learned_addr learned my addr 172.21.15.99:0/73453348 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:46:07.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.813+0000 7f933a200640 1 --2- 172.21.15.99:0/73453348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933406c320 0x7f9334169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.814+0000 7f9333e00640 1 -- 172.21.15.99:0/73453348 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954150783 0 0) 0x7f93340af450 con 0x7f93340aefe0 2024-09-10T07:46:07.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.814+0000 7f9333e00640 1 -- 172.21.15.99:0/73453348 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f931c003520 con 0x7f93340aefe0 2024-09-10T07:46:07.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.814+0000 7f9333e00640 1 -- 172.21.15.99:0/73453348 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230655437 0 0) 0x7f93340af6c0 con 0x7f933415e8b0 2024-09-10T07:46:07.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.814+0000 7f9333e00640 1 -- 172.21.15.99:0/73453348 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93340af450 con 0x7f933415e8b0 2024-09-10T07:46:07.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.814+0000 7f933a200640 1 -- 172.21.15.99:0/73453348 >> v1:172.21.15.187:6789/0 conn(0x7f933415e8b0 legacy=0x7f93340b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.814+0000 7f933a200640 1 -- 172.21.15.99:0/73453348 >> v1:172.21.15.99:6789/0 conn(0x7f93340aefe0 legacy=0x7f933406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.814+0000 7f933a200640 1 -- 172.21.15.99:0/73453348 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93340af9a0 con 0x7f933406c320 2024-09-10T07:46:07.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.815+0000 7f933a200640 1 --2- 172.21.15.99:0/73453348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933406c320 0x7f9334169610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f932c009dc0 tx=0x7f932c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4b676229b349407 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.815+0000 7f9333e00640 1 -- 172.21.15.99:0/73453348 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c007740 con 0x7f933406c320 2024-09-10T07:46:07.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.815+0000 7f9333e00640 1 -- 172.21.15.99:0/73453348 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f932c0078e0 con 0x7f933406c320 2024-09-10T07:46:07.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.815+0000 7f9333e00640 1 -- 172.21.15.99:0/73453348 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c007cb0 con 0x7f933406c320 2024-09-10T07:46:07.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.816+0000 7f933ac00640 1 -- 172.21.15.99:0/73453348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933406c320 msgr2=0x7f9334169610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.816+0000 7f933ac00640 1 --2- 172.21.15.99:0/73453348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933406c320 0x7f9334169610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f932c009dc0 tx=0x7f932c02a6d0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.816+0000 7f933ac00640 1 -- 172.21.15.99:0/73453348 shutdown_connections 2024-09-10T07:46:07.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.816+0000 7f933ac00640 1 --2- 172.21.15.99:0/73453348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933406c320 0x7f9334169610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.816+0000 7f933ac00640 1 -- 172.21.15.99:0/73453348 >> 172.21.15.99:0/73453348 conn(0x7f9334067f80 msgr2=0x7f933406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:07.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.816+0000 7f933ac00640 1 -- 172.21.15.99:0/73453348 shutdown_connections 2024-09-10T07:46:07.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.816+0000 7f933ac00640 1 -- 172.21.15.99:0/73453348 wait complete. 2024-09-10T07:46:07.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.818+0000 7f933ac00640 1 Processor -- start 2024-09-10T07:46:07.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.818+0000 7f933ac00640 1 -- start start 2024-09-10T07:46:07.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f933ac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f933406c320 0x7f9334161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f933ac00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93340aefe0 0x7f93340b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f933ac00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933415e8b0 0x7f9334147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f933ac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f933415ec90 con 0x7f933406c320 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f933ac00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f93340aff60 con 0x7f93340aefe0 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f933ac00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f933415ee10 con 0x7f933415e8b0 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f9339800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f933406c320 0x7f9334161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f9339800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f933406c320 0x7f9334161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40666/0 (socket says 172.21.15.99:40666) 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f9339800640 1 -- 172.21.15.99:0/2513915786 learned_addr learned my addr 172.21.15.99:0/2513915786 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f9338e00640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93340aefe0 0x7f93340b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f9339800640 1 -- 172.21.15.99:0/2513915786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933415e8b0 msgr2=0x7f9334147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f9339800640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933415e8b0 0x7f9334147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f9339800640 1 -- 172.21.15.99:0/2513915786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93340aefe0 msgr2=0x7f93340b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f9339800640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93340aefe0 0x7f93340b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.819+0000 7f9339800640 1 -- 172.21.15.99:0/2513915786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9334161860 con 0x7f933406c320 2024-09-10T07:46:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.820+0000 7f9339800640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f933406c320 0x7f9334161030 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f932800c530 tx=0x7f932800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.820+0000 7f9331600640 1 -- 172.21.15.99:0/2513915786 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93280052d0 con 0x7f933406c320 2024-09-10T07:46:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.820+0000 7f9331600640 1 -- 172.21.15.99:0/2513915786 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9328005490 con 0x7f933406c320 2024-09-10T07:46:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.820+0000 7f933ac00640 1 -- 172.21.15.99:0/2513915786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9334161b40 con 0x7f933406c320 2024-09-10T07:46:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.820+0000 7f9331600640 1 -- 172.21.15.99:0/2513915786 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328012870 con 0x7f933406c320 2024-09-10T07:46:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.820+0000 7f933ac00640 1 -- 172.21.15.99:0/2513915786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9334148670 con 0x7f933406c320 2024-09-10T07:46:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.821+0000 7f933ac00640 1 -- 172.21.15.99:0/2513915786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933406fa00 con 0x7f933406c320 2024-09-10T07:46:07.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.822+0000 7f9331600640 1 -- 172.21.15.99:0/2513915786 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9328012a10 con 0x7f933406c320 2024-09-10T07:46:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.823+0000 7f9331600640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f931406be30 0x7f931406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.823+0000 7f9331600640 1 -- 172.21.15.99:0/2513915786 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f932808a7a0 con 0x7f933406c320 2024-09-10T07:46:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.823+0000 7f9338e00640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f931406be30 0x7f931406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.824+0000 7f9338e00640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f931406be30 0x7f931406e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f933415b580 tx=0x7f9320009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:07.828+0000 7f9331600640 1 -- 172.21.15.99:0/2513915786 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9328059440 con 0x7f933406c320 2024-09-10T07:46:08.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.003+0000 7f933ac00640 1 -- 172.21.15.99:0/2513915786 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f933415caf0 con 0x7f931406be30 2024-09-10T07:46:08.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.003+0000 7f9331600640 1 -- 172.21.15.99:0/2513915786 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f933415caf0 con 0x7f931406be30 2024-09-10T07:46:08.003 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T07:46:08.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 -- 172.21.15.99:0/2513915786 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f931406be30 msgr2=0x7f931406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:08.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f931406be30 0x7f931406e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f933415b580 tx=0x7f9320009040 comp rx=0 tx=0).stop 2024-09-10T07:46:08.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 -- 172.21.15.99:0/2513915786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f933406c320 msgr2=0x7f9334161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:08.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f933406c320 0x7f9334161030 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f932800c530 tx=0x7f932800c9f0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 -- 172.21.15.99:0/2513915786 shutdown_connections 2024-09-10T07:46:08.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f933415e8b0 0x7f9334147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93340aefe0 0x7f93340b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f931406be30 0x7f931406e2f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 --2- 172.21.15.99:0/2513915786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f933406c320 0x7f9334161030 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 -- 172.21.15.99:0/2513915786 >> 172.21.15.99:0/2513915786 conn(0x7f9334067f80 msgr2=0x7f933415ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:08.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 -- 172.21.15.99:0/2513915786 shutdown_connections 2024-09-10T07:46:08.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.005+0000 7f933ac00640 1 -- 172.21.15.99:0/2513915786 wait complete. 2024-09-10T07:46:08.022 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:46:08.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.175+0000 7fa9b4c00640 1 Processor -- start 2024-09-10T07:46:08.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.175+0000 7fa9b4c00640 1 -- start start 2024-09-10T07:46:08.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.176+0000 7fa9b4c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b015ef80 0x7fa9b00b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.176+0000 7fa9b4c00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa9b00cfae0 0x7fa9b00cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.176+0000 7fa9b4c00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9b00cd1a0 con 0x7fa9b006d730 2024-09-10T07:46:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.176+0000 7fa9b4c00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7fa9b00cd7d0 con 0x7fa9b00cfae0 2024-09-10T07:46:08.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.176+0000 7fa9b4c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b006dc30 con 0x7fa9b015ef80 2024-09-10T07:46:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.177+0000 7fa9ae800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa9b00cfae0 0x7fa9b00cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.177+0000 7fa9ade00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b015ef80 0x7fa9b00b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.177+0000 7fa9ae800640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa9b00cfae0 0x7fa9b00cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.99:56104/0 (socket says 172.21.15.99:56104) 2024-09-10T07:46:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.177+0000 7fa9ade00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b015ef80 0x7fa9b00b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.99:58674/0 (socket says 172.21.15.99:58674) 2024-09-10T07:46:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.177+0000 7fa9ae800640 1 -- 172.21.15.99:0/3719200227 learned_addr learned my addr 172.21.15.99:0/3719200227 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.177+0000 7fa9ade00640 1 -- 172.21.15.99:0/3719200227 >> v2:172.21.15.187:3300/0 conn(0x7fa9b00cfae0 msgr2=0x7fa9b00cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.177+0000 7fa9ade00640 1 --2- 172.21.15.99:0/3719200227 >> v2:172.21.15.187:3300/0 conn(0x7fa9b00cfae0 0x7fa9b00cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.177+0000 7fa9ade00640 1 -- 172.21.15.99:0/3719200227 >> v1:172.21.15.187:6789/0 conn(0x7fa9b006d730 legacy=0x7fa9b00cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:08.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.177+0000 7fa9ade00640 1 -- 172.21.15.99:0/3719200227 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b006df10 con 0x7fa9b015ef80 2024-09-10T07:46:08.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.178+0000 7fa9ade00640 1 --2- 172.21.15.99:0/3719200227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b015ef80 0x7fa9b00b5220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009d90 tx=0x7fa9a002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ab895192da782ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:08.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9aca00640 1 -- 172.21.15.99:0/3719200227 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0007740 con 0x7fa9b015ef80 2024-09-10T07:46:08.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9aca00640 1 -- 172.21.15.99:0/3719200227 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9a00078e0 con 0x7fa9b015ef80 2024-09-10T07:46:08.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9aca00640 1 -- 172.21.15.99:0/3719200227 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0007cb0 con 0x7fa9b015ef80 2024-09-10T07:46:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9b4c00640 1 -- 172.21.15.99:0/3719200227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b015ef80 msgr2=0x7fa9b00b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9b4c00640 1 --2- 172.21.15.99:0/3719200227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b015ef80 0x7fa9b00b5220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009d90 tx=0x7fa9a002a660 comp rx=0 tx=0).stop 2024-09-10T07:46:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9b4c00640 1 -- 172.21.15.99:0/3719200227 shutdown_connections 2024-09-10T07:46:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9b4c00640 1 --2- 172.21.15.99:0/3719200227 >> v2:172.21.15.187:3300/0 conn(0x7fa9b00cfae0 0x7fa9b00cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9b4c00640 1 --2- 172.21.15.99:0/3719200227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b015ef80 0x7fa9b00b5220 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9b4c00640 1 -- 172.21.15.99:0/3719200227 >> 172.21.15.99:0/3719200227 conn(0x7fa9b00b4700 msgr2=0x7fa9b00b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:08.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9b4c00640 1 -- 172.21.15.99:0/3719200227 shutdown_connections 2024-09-10T07:46:08.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.179+0000 7fa9b4c00640 1 -- 172.21.15.99:0/3719200227 wait complete. 2024-09-10T07:46:08.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.181+0000 7fa9b4c00640 1 Processor -- start 2024-09-10T07:46:08.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.181+0000 7fa9b4c00640 1 -- start start 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9b4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b006d730 0x7fa9b0157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9b4c00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b00cfae0 0x7fa9b00c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9b4c00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9b015ef80 0x7fa9b00cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9b4c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b00d0120 con 0x7fa9b006d730 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9b4c00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b015f360 con 0x7fa9b015ef80 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9b4c00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b00ce1a0 con 0x7fa9b00cfae0 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9ade00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b006d730 0x7fa9b0157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9ade00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b006d730 0x7fa9b0157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40680/0 (socket says 172.21.15.99:40680) 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9ade00640 1 -- 172.21.15.99:0/1113507158 learned_addr learned my addr 172.21.15.99:0/1113507158 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9ae800640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9b015ef80 0x7fa9b00cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:08.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.182+0000 7fa9ad400640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b00cfae0 0x7fa9b00c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9ade00640 1 -- 172.21.15.99:0/1113507158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b00cfae0 msgr2=0x7fa9b00c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9ade00640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b00cfae0 0x7fa9b00c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9ade00640 1 -- 172.21.15.99:0/1113507158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9b015ef80 msgr2=0x7fa9b00cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9ade00640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9b015ef80 0x7fa9b00cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9ade00640 1 -- 172.21.15.99:0/1113507158 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b00c96b0 con 0x7fa9b006d730 2024-09-10T07:46:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9ade00640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b006d730 0x7fa9b0157bf0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009eb0 tx=0x7fa9a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9a6000640 1 -- 172.21.15.99:0/1113507158 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a003f070 con 0x7fa9b006d730 2024-09-10T07:46:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9a6000640 1 -- 172.21.15.99:0/1113507158 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9a0031c40 con 0x7fa9b006d730 2024-09-10T07:46:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9b4c00640 1 -- 172.21.15.99:0/1113507158 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b00c80d0 con 0x7fa9b006d730 2024-09-10T07:46:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9a6000640 1 -- 172.21.15.99:0/1113507158 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0009450 con 0x7fa9b006d730 2024-09-10T07:46:08.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.183+0000 7fa9b4c00640 1 -- 172.21.15.99:0/1113507158 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b00c8690 con 0x7fa9b006d730 2024-09-10T07:46:08.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.184+0000 7fa9b4c00640 1 -- 172.21.15.99:0/1113507158 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b00cdc60 con 0x7fa9b006d730 2024-09-10T07:46:08.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.185+0000 7fa9a6000640 1 -- 172.21.15.99:0/1113507158 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9a0044460 con 0x7fa9b006d730 2024-09-10T07:46:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.186+0000 7fa9a6000640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa99006be30 0x7fa99006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.187+0000 7fa9a6000640 1 -- 172.21.15.99:0/1113507158 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7fa9a00ac2e0 con 0x7fa9b006d730 2024-09-10T07:46:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.187+0000 7fa9ad400640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa99006be30 0x7fa99006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:08.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.187+0000 7fa9ad400640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa99006be30 0x7fa99006e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa9b01f8270 tx=0x7fa99c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:08.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.191+0000 7fa9a6000640 1 -- 172.21.15.99:0/1113507158 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9a007af90 con 0x7fa9b006d730 2024-09-10T07:46:08.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.361+0000 7fa9b4c00640 1 -- 172.21.15.99:0/1113507158 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9b00c8fc0 con 0x7fa99006be30 2024-09-10T07:46:08.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.362+0000 7fa9a6000640 1 -- 172.21.15.99:0/1113507158 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12579 (secure 0 0 0) 0x7fa9b00c8fc0 con 0x7fa99006be30 2024-09-10T07:46:08.362 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:46:08.362 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 -- 172.21.15.99:0/1113507158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa99006be30 msgr2=0x7fa99006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa99006be30 0x7fa99006e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa9b01f8270 tx=0x7fa99c009040 comp rx=0 tx=0).stop 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 -- 172.21.15.99:0/1113507158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b006d730 msgr2=0x7fa9b0157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b006d730 0x7fa9b0157bf0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009eb0 tx=0x7fa9a0004a40 comp rx=0 tx=0).stop 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 -- 172.21.15.99:0/1113507158 shutdown_connections 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9b015ef80 0x7fa9b00cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9b00cfae0 0x7fa9b00c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7fa99006be30 0x7fa99006e2f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 --2- 172.21.15.99:0/1113507158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b006d730 0x7fa9b0157bf0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 -- 172.21.15.99:0/1113507158 >> 172.21.15.99:0/1113507158 conn(0x7fa9b00b4700 msgr2=0x7fa9b00cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:08.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 -- 172.21.15.99:0/1113507158 shutdown_connections 2024-09-10T07:46:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:08.364+0000 7fa9b4c00640 1 -- 172.21.15.99:0/1113507158 wait complete. 2024-09-10T07:46:08.379 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":545,"stamp":"2024-09-10T07:46:06.851194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9721,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552778,"statfs":{"total":1600000000,"available":1590044816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001739"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":509,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T07:45:57.986801+0000","last_change":"2024-09-10T07:34:10.367179+0000","last_active":"2024-09-10T07:45:57.986801+0000","last_peered":"2024-09-10T07:45:57.986801+0000","last_clean":"2024-09-10T07:45:57.986801+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:45:57.986801+0000","last_undegraded":"2024-09-10T07:45:57.986801+0000","last_fullsized":"2024-09-10T07:45:57.986801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T07:34:09.160052+0000","last_clean_scrub_stamp":"2024-09-10T07:34:09.160052+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.346583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1647,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193664,"statfs":{"total":200000000,"available":198312826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1647,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193664,"statfs":{"total":200000000,"available":198312826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:46:08.383 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T07:34:09.160052+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=7, tm_min=34, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=7, tm_min=46, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T07:46:08.383 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T07:46:18.554 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:46:18.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:46:28.384 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T07:46:28.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.550+0000 7f976e600640 1 Processor -- start 2024-09-10T07:46:28.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.550+0000 7f976e600640 1 -- start start 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.551+0000 7f976e600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f976813fae0 0x7f976806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.551+0000 7f976e600640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9768142150 0x7f9768160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.551+0000 7f976e600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9768160a80 0x7f976815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.551+0000 7f976e600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f97680ce780 con 0x7f976813fae0 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f976e600640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f9768142650 con 0x7f9768142150 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f976e600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f9768142930 con 0x7f9768160a80 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f9767400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f976813fae0 0x7f976806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f9767400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f976813fae0 0x7f976806f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46240/0 (socket says 172.21.15.99:46240) 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f9767400640 1 -- 172.21.15.99:0/3145355102 learned_addr learned my addr 172.21.15.99:0/3145355102 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f975ea00640 1 --2- 172.21.15.99:0/3145355102 >> v2:172.21.15.187:3300/0 conn(0x7f9768142150 0x7f9768160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f9767e00640 1 --2- 172.21.15.99:0/3145355102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9768160a80 0x7f976815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f9767400640 1 -- 172.21.15.99:0/3145355102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9768160a80 msgr2=0x7f976815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:28.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f9767400640 1 --2- 172.21.15.99:0/3145355102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9768160a80 0x7f976815cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f9767400640 1 -- 172.21.15.99:0/3145355102 >> v2:172.21.15.187:3300/0 conn(0x7f9768142150 msgr2=0x7f9768160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:28.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f9767400640 1 --2- 172.21.15.99:0/3145355102 >> v2:172.21.15.187:3300/0 conn(0x7f9768142150 0x7f9768160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f9767400640 1 -- 172.21.15.99:0/3145355102 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9768142c10 con 0x7f976813fae0 2024-09-10T07:46:28.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.552+0000 7f9767e00640 1 --2- 172.21.15.99:0/3145355102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9768160a80 0x7f976815cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:28.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.553+0000 7f9767400640 1 --2- 172.21.15.99:0/3145355102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f976813fae0 0x7f976806f1b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9768075560 tx=0x7f975802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979c53b152066cde server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:28.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f9766a00640 1 -- 172.21.15.99:0/3145355102 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758037070 con 0x7f976813fae0 2024-09-10T07:46:28.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f9766a00640 1 -- 172.21.15.99:0/3145355102 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9758032440 con 0x7f976813fae0 2024-09-10T07:46:28.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f9766a00640 1 -- 172.21.15.99:0/3145355102 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758032810 con 0x7f976813fae0 2024-09-10T07:46:28.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f976e600640 1 -- 172.21.15.99:0/3145355102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f976813fae0 msgr2=0x7f976806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:28.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f976e600640 1 --2- 172.21.15.99:0/3145355102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f976813fae0 0x7f976806f1b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9768075560 tx=0x7f975802a140 comp rx=0 tx=0).stop 2024-09-10T07:46:28.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f976e600640 1 -- 172.21.15.99:0/3145355102 shutdown_connections 2024-09-10T07:46:28.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f976e600640 1 --2- 172.21.15.99:0/3145355102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9768160a80 0x7f976815cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f976e600640 1 --2- 172.21.15.99:0/3145355102 >> v2:172.21.15.187:3300/0 conn(0x7f9768142150 0x7f9768160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f976e600640 1 --2- 172.21.15.99:0/3145355102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f976813fae0 0x7f976806f1b0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f976e600640 1 -- 172.21.15.99:0/3145355102 >> 172.21.15.99:0/3145355102 conn(0x7f976806bc10 msgr2=0x7f976806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:28.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f976e600640 1 -- 172.21.15.99:0/3145355102 shutdown_connections 2024-09-10T07:46:28.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.554+0000 7f976e600640 1 -- 172.21.15.99:0/3145355102 wait complete. 2024-09-10T07:46:28.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.556+0000 7f976e600640 1 Processor -- start 2024-09-10T07:46:28.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.556+0000 7f976e600640 1 -- start start 2024-09-10T07:46:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f976e600640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f976813fae0 0x7f97680b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f976e600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9768142150 0x7f976813f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f976e600640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9768160a80 0x7f97681442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f976e600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f976806f870 con 0x7f9768142150 2024-09-10T07:46:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f976e600640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f976806f6f0 con 0x7f9768160a80 2024-09-10T07:46:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f976e600640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f976815d490 con 0x7f976813fae0 2024-09-10T07:46:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f975ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9768142150 0x7f976813f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f975ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9768142150 0x7f976813f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46256/0 (socket says 172.21.15.99:46256) 2024-09-10T07:46:28.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f975ea00640 1 -- 172.21.15.99:0/1998065545 learned_addr learned my addr 172.21.15.99:0/1998065545 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f9767e00640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9768160a80 0x7f97681442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.557+0000 7f9767400640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f976813fae0 0x7f97680b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.558+0000 7f975ea00640 1 -- 172.21.15.99:0/1998065545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f976813fae0 msgr2=0x7f97680b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.558+0000 7f975ea00640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f976813fae0 0x7f97680b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.558+0000 7f975ea00640 1 -- 172.21.15.99:0/1998065545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9768160a80 msgr2=0x7f97681442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.558+0000 7f975ea00640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9768160a80 0x7f97681442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.558+0000 7f975ea00640 1 -- 172.21.15.99:0/1998065545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9768144b70 con 0x7f9768142150 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.558+0000 7f975ea00640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9768142150 0x7f976813f0c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f975000e890 tx=0x7f975000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.558+0000 7f975fe00640 1 -- 172.21.15.99:0/1998065545 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9750017070 con 0x7f9768142150 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.558+0000 7f975fe00640 1 -- 172.21.15.99:0/1998065545 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f975000c940 con 0x7f9768142150 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.558+0000 7f976e600640 1 -- 172.21.15.99:0/1998065545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9768144e50 con 0x7f9768142150 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.558+0000 7f975fe00640 1 -- 172.21.15.99:0/1998065545 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975000cd10 con 0x7f9768142150 2024-09-10T07:46:28.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.559+0000 7f976e600640 1 -- 172.21.15.99:0/1998065545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97681456f0 con 0x7f9768142150 2024-09-10T07:46:28.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.560+0000 7f976e600640 1 -- 172.21.15.99:0/1998065545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9768160540 con 0x7f9768142150 2024-09-10T07:46:28.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.560+0000 7f975fe00640 1 -- 172.21.15.99:0/1998065545 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f975001a070 con 0x7f9768142150 2024-09-10T07:46:28.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.562+0000 7f975fe00640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f974406be30 0x7f974406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.562+0000 7f975fe00640 1 -- 172.21.15.99:0/1998065545 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f975008ae50 con 0x7f9768142150 2024-09-10T07:46:28.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.562+0000 7f9767400640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f974406be30 0x7f974406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.563+0000 7f9767400640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f974406be30 0x7f974406e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9758034000 tx=0x7f975802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:28.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.566+0000 7f975fe00640 1 -- 172.21.15.99:0/1998065545 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9750059410 con 0x7f9768142150 2024-09-10T07:46:28.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.735+0000 7f976e600640 1 -- 172.21.15.99:0/1998065545 --> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f976813f600 con 0x7f974406be30 2024-09-10T07:46:28.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.736+0000 7f975fe00640 1 -- 172.21.15.99:0/1998065545 <== mgr.4100 v2:172.21.15.99:6832/3417513811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12567 (secure 0 0 0) 0x7f976813f600 con 0x7f974406be30 2024-09-10T07:46:28.735 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:46:28.736 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T07:46:28.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 -- 172.21.15.99:0/1998065545 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f974406be30 msgr2=0x7f974406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:28.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f974406be30 0x7f974406e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9758034000 tx=0x7f975802e000 comp rx=0 tx=0).stop 2024-09-10T07:46:28.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 -- 172.21.15.99:0/1998065545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9768142150 msgr2=0x7f976813f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:28.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9768142150 0x7f976813f0c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f975000e890 tx=0x7f975000ed50 comp rx=0 tx=0).stop 2024-09-10T07:46:28.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 -- 172.21.15.99:0/1998065545 shutdown_connections 2024-09-10T07:46:28.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9768160a80 0x7f97681442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f974406be30 0x7f974406e2f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9768142150 0x7f976813f0c0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 --2- 172.21.15.99:0/1998065545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f976813fae0 0x7f97680b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 -- 172.21.15.99:0/1998065545 >> 172.21.15.99:0/1998065545 conn(0x7f976806bc10 msgr2=0x7f9768071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:28.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 -- 172.21.15.99:0/1998065545 shutdown_connections 2024-09-10T07:46:28.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.738+0000 7f976e600640 1 -- 172.21.15.99:0/1998065545 wait complete. 2024-09-10T07:46:28.753 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":555,"stamp":"2024-09-10T07:46:26.854561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9721,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552778,"statfs":{"total":1600000000,"available":1590044816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002045"},"pg_stats":[{"pgid":"1.0","version":"194'119","reported_seq":521,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T07:46:08.097822+0000","last_change":"2024-09-10T07:46:08.097822+0000","last_active":"2024-09-10T07:46:08.097822+0000","last_peered":"2024-09-10T07:46:08.097822+0000","last_clean":"2024-09-10T07:46:08.097822+0000","last_became_active":"2024-09-10T07:34:10.366961+0000","last_became_peered":"2024-09-10T07:34:10.366961+0000","last_unstale":"2024-09-10T07:46:08.097822+0000","last_undegraded":"2024-09-10T07:46:08.097822+0000","last_fullsized":"2024-09-10T07:46:08.097822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'119","last_scrub_stamp":"2024-09-10T07:46:08.097748+0000","last_deep_scrub":"194'119","last_deep_scrub_stamp":"2024-09-10T07:46:08.097748+0000","last_clean_scrub_stamp":"2024-09-10T07:46:08.097748+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:48.195998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1647,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193664,"statfs":{"total":200000000,"available":198312826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194241,"statfs":{"total":200000000,"available":198903194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574997,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1647,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193664,"statfs":{"total":200000000,"available":198312826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-10T07:46:28.755 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T07:46:28.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.904+0000 7ff32e000640 1 Processor -- start 2024-09-10T07:46:28.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.904+0000 7ff32e000640 1 -- start start 2024-09-10T07:46:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff32e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 0x7ff3280ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff32e000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff328073820 con 0x7ff328071df0 2024-09-10T07:46:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff32e000640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3280722d0 con 0x7ff32806e280 2024-09-10T07:46:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff32e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff3280d1720 con 0x7ff328073370 2024-09-10T07:46:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff31fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff328071df0 0x7ff3280d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57856/0 (socket says 172.21.15.99:57856) 2024-09-10T07:46:28.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff31fe00640 1 -- 172.21.15.99:0/555299500 learned_addr learned my addr 172.21.15.99:0/555299500 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-10T07:46:28.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff327e00640 1 --2- 172.21.15.99:0/555299500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 0x7ff3280ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff326a00640 1 -- 172.21.15.99:0/555299500 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1226194472 0 0) 0x7ff328073820 con 0x7ff328071df0 2024-09-10T07:46:28.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff326a00640 1 -- 172.21.15.99:0/555299500 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff30c003520 con 0x7ff328071df0 2024-09-10T07:46:28.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff327e00640 1 -- 172.21.15.99:0/555299500 >> v1:172.21.15.187:6789/0 conn(0x7ff32806e280 legacy=0x7ff32806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:28.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff327e00640 1 -- 172.21.15.99:0/555299500 >> v1:172.21.15.99:6789/0 conn(0x7ff328071df0 legacy=0x7ff3280d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:28.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.906+0000 7ff327e00640 1 -- 172.21.15.99:0/555299500 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3280725b0 con 0x7ff328073370 2024-09-10T07:46:28.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.908+0000 7ff327e00640 1 --2- 172.21.15.99:0/555299500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 0x7ff3280ce3d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff320009dc0 tx=0x7ff32002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12191e2315aef355 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:28.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.908+0000 7ff326a00640 1 -- 172.21.15.99:0/555299500 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320007740 con 0x7ff328073370 2024-09-10T07:46:28.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.908+0000 7ff326a00640 1 -- 172.21.15.99:0/555299500 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200078e0 con 0x7ff328073370 2024-09-10T07:46:28.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.908+0000 7ff326a00640 1 -- 172.21.15.99:0/555299500 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320007cb0 con 0x7ff328073370 2024-09-10T07:46:28.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.908+0000 7ff32e000640 1 -- 172.21.15.99:0/555299500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 msgr2=0x7ff3280ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:28.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.908+0000 7ff32e000640 1 --2- 172.21.15.99:0/555299500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 0x7ff3280ce3d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff320009dc0 tx=0x7ff32002a6d0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.909+0000 7ff32e000640 1 -- 172.21.15.99:0/555299500 shutdown_connections 2024-09-10T07:46:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.909+0000 7ff32e000640 1 --2- 172.21.15.99:0/555299500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 0x7ff3280ce3d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.909+0000 7ff32e000640 1 -- 172.21.15.99:0/555299500 >> 172.21.15.99:0/555299500 conn(0x7ff32806bc10 msgr2=0x7ff32806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.909+0000 7ff32e000640 1 -- 172.21.15.99:0/555299500 shutdown_connections 2024-09-10T07:46:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.909+0000 7ff32e000640 1 -- 172.21.15.99:0/555299500 wait complete. 2024-09-10T07:46:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.910+0000 7ff32e000640 1 Processor -- start 2024-09-10T07:46:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.910+0000 7ff32e000640 1 -- start start 2024-09-10T07:46:28.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.911+0000 7ff32e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff32806e280 0x7ff32815f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.911+0000 7ff32e000640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff328071df0 0x7ff3280b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.911+0000 7ff32e000640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 0x7ff3281f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.911+0000 7ff32e000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff328072e50 con 0x7ff32806e280 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.911+0000 7ff32e000640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff328072b70 con 0x7ff328071df0 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.911+0000 7ff32e000640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7ff32815db60 con 0x7ff328073370 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.911+0000 7ff327400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff32806e280 0x7ff32815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff327400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff32806e280 0x7ff32815f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46260/0 (socket says 172.21.15.99:46260) 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff327400640 1 -- 172.21.15.99:0/2316295025 learned_addr learned my addr 172.21.15.99:0/2316295025 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff31fe00640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff328071df0 0x7ff3280b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff327e00640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 0x7ff3281f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff327400640 1 -- 172.21.15.99:0/2316295025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 msgr2=0x7ff3281f83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff327400640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 0x7ff3281f83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff327400640 1 -- 172.21.15.99:0/2316295025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff328071df0 msgr2=0x7ff3280b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff327400640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff328071df0 0x7ff3280b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff327400640 1 -- 172.21.15.99:0/2316295025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3280b42d0 con 0x7ff32806e280 2024-09-10T07:46:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff31fe00640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff328071df0 0x7ff3280b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff327400640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff32806e280 0x7ff32815f180 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7ff31800c400 tx=0x7ff31800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.912+0000 7ff31f400640 1 -- 172.21.15.99:0/2316295025 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180052d0 con 0x7ff32806e280 2024-09-10T07:46:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.913+0000 7ff31f400640 1 -- 172.21.15.99:0/2316295025 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff318005490 con 0x7ff32806e280 2024-09-10T07:46:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.913+0000 7ff32e000640 1 -- 172.21.15.99:0/2316295025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3280b4880 con 0x7ff32806e280 2024-09-10T07:46:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.913+0000 7ff31f400640 1 -- 172.21.15.99:0/2316295025 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318007260 con 0x7ff32806e280 2024-09-10T07:46:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.913+0000 7ff32e000640 1 -- 172.21.15.99:0/2316295025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3280b4e40 con 0x7ff32806e280 2024-09-10T07:46:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.914+0000 7ff32e000640 1 -- 172.21.15.99:0/2316295025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32806e660 con 0x7ff32806e280 2024-09-10T07:46:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.915+0000 7ff31f400640 1 -- 172.21.15.99:0/2316295025 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff318007400 con 0x7ff32806e280 2024-09-10T07:46:28.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.915+0000 7ff31f400640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff30406be30 0x7ff30406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:28.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.916+0000 7ff31f400640 1 -- 172.21.15.99:0/2316295025 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7ff31808a190 con 0x7ff32806e280 2024-09-10T07:46:28.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.916+0000 7ff31fe00640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff30406be30 0x7ff30406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:28.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.916+0000 7ff31fe00640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff30406be30 0x7ff30406e2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff3280b3d20 tx=0x7ff310009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:28.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:28.920+0000 7ff31f400640 1 -- 172.21.15.99:0/2316295025 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3280b42d0 con 0x7ff32806e280 2024-09-10T07:46:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.094+0000 7ff32e000640 1 -- 172.21.15.99:0/2316295025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ff3280b0a20 con 0x7ff32806e280 2024-09-10T07:46:29.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.097+0000 7ff31f400640 1 -- 172.21.15.99:0/2316295025 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) ==== 123+0+0 (secure 0 0 0) 0x7ff318058da0 con 0x7ff32806e280 2024-09-10T07:46:29.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.098+0000 7ff31f400640 1 -- 172.21.15.99:0/2316295025 <== mon.0 v2:172.21.15.99:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff3180586a0 con 0x7ff32806e280 2024-09-10T07:46:29.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 -- 172.21.15.99:0/2316295025 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff30406be30 msgr2=0x7ff30406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:29.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff30406be30 0x7ff30406e2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff3280b3d20 tx=0x7ff310009040 comp rx=0 tx=0).stop 2024-09-10T07:46:29.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 -- 172.21.15.99:0/2316295025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff32806e280 msgr2=0x7ff32815f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:29.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff32806e280 0x7ff32815f180 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7ff31800c400 tx=0x7ff31800c8c0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 -- 172.21.15.99:0/2316295025 shutdown_connections 2024-09-10T07:46:29.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff328073370 0x7ff3281f83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff328071df0 0x7ff3280b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7ff30406be30 0x7ff30406e2f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 --2- 172.21.15.99:0/2316295025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff32806e280 0x7ff32815f180 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 -- 172.21.15.99:0/2316295025 >> 172.21.15.99:0/2316295025 conn(0x7ff32806bc10 msgr2=0x7ff3280ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:29.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.100+0000 7ff32e000640 1 -- 172.21.15.99:0/2316295025 shutdown_connections 2024-09-10T07:46:29.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.101+0000 7ff32e000640 1 -- 172.21.15.99:0/2316295025 wait complete. 2024-09-10T07:46:29.116 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T07:46:29.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T07:46:29.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.269+0000 7f95a1200640 1 Processor -- start 2024-09-10T07:46:29.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.269+0000 7f95a1200640 1 -- start start 2024-09-10T07:46:29.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f95a1200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f959c142150 0x7f959c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:29.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f95a1200640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f959c160a80 0x7f959c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:29.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f95a1200640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c142650 con 0x7f959c13fae0 2024-09-10T07:46:29.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f95a1200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 -- 0x7f959c0ce780 con 0x7f959c142150 2024-09-10T07:46:29.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f95a1200640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 -- 0x7f959c142930 con 0x7f959c160a80 2024-09-10T07:46:29.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f9591400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f959c142150 0x7f959c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:29.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f9591400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f959c142150 0x7f959c160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46276/0 (socket says 172.21.15.99:46276) 2024-09-10T07:46:29.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f9591400640 1 -- 172.21.15.99:0/413784 learned_addr learned my addr 172.21.15.99:0/413784 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:29.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f959a800640 1 --2- 172.21.15.99:0/413784 >> v2:172.21.15.187:3300/0 conn(0x7f959c160a80 0x7f959c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:29.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f9591400640 1 -- 172.21.15.99:0/413784 >> v2:172.21.15.187:3300/0 conn(0x7f959c160a80 msgr2=0x7f959c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T07:46:29.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f9591400640 1 --2- 172.21.15.99:0/413784 >> v2:172.21.15.187:3300/0 conn(0x7f959c160a80 0x7f959c0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f9591400640 1 -- 172.21.15.99:0/413784 >> v1:172.21.15.187:6789/0 conn(0x7f959c13fae0 legacy=0x7f959c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:29.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f9591400640 1 -- 172.21.15.99:0/413784 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c142c10 con 0x7f959c142150 2024-09-10T07:46:29.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.271+0000 7f959a800640 1 --2- 172.21.15.99:0/413784 >> v2:172.21.15.187:3300/0 conn(0x7f959c160a80 0x7f959c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T07:46:29.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.272+0000 7f9591400640 1 --2- 172.21.15.99:0/413784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c142150 0x7f959c160540 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f959c0b39c0 tx=0x7f958402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea95d024f8d4dc75 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:29.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f9599400640 1 -- 172.21.15.99:0/413784 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584037070 con 0x7f959c142150 2024-09-10T07:46:29.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f9599400640 1 -- 172.21.15.99:0/413784 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9584032440 con 0x7f959c142150 2024-09-10T07:46:29.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f9599400640 1 -- 172.21.15.99:0/413784 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584032830 con 0x7f959c142150 2024-09-10T07:46:29.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f95a1200640 1 -- 172.21.15.99:0/413784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c142150 msgr2=0x7f959c160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:29.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f95a1200640 1 --2- 172.21.15.99:0/413784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c142150 0x7f959c160540 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f959c0b39c0 tx=0x7f958402a1e0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f95a1200640 1 -- 172.21.15.99:0/413784 shutdown_connections 2024-09-10T07:46:29.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f95a1200640 1 --2- 172.21.15.99:0/413784 >> v2:172.21.15.187:3300/0 conn(0x7f959c160a80 0x7f959c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f95a1200640 1 --2- 172.21.15.99:0/413784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c142150 0x7f959c160540 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f95a1200640 1 -- 172.21.15.99:0/413784 >> 172.21.15.99:0/413784 conn(0x7f959c06bc10 msgr2=0x7f959c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:29.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f95a1200640 1 -- 172.21.15.99:0/413784 shutdown_connections 2024-09-10T07:46:29.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.273+0000 7f95a1200640 1 -- 172.21.15.99:0/413784 wait complete. 2024-09-10T07:46:29.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.275+0000 7f95a1200640 1 Processor -- start 2024-09-10T07:46:29.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.275+0000 7f95a1200640 1 -- start start 2024-09-10T07:46:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f95a1200640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959c13fae0 0x7f959c143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f95a1200640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f959c142150 0x7f959c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f95a1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c160a80 0x7f959c13ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f95a1200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f959c0cf2d0 con 0x7f959c160a80 2024-09-10T07:46:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f95a1200640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f959c0cf150 con 0x7f959c142150 2024-09-10T07:46:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f95a1200640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 -- 0x7f959c0cf450 con 0x7f959c13fae0 2024-09-10T07:46:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f959a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c160a80 0x7f959c13ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f959a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c160a80 0x7f959c13ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46284/0 (socket says 172.21.15.99:46284) 2024-09-10T07:46:29.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f959a800640 1 -- 172.21.15.99:0/1368019741 learned_addr learned my addr 172.21.15.99:0/1368019741 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f9599e00640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959c13fae0 0x7f959c143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f9591400640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f959c142150 0x7f959c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f959a800640 1 -- 172.21.15.99:0/1368019741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959c13fae0 msgr2=0x7f959c143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f959a800640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959c13fae0 0x7f959c143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f959a800640 1 -- 172.21.15.99:0/1368019741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f959c142150 msgr2=0x7f959c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.276+0000 7f959a800640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f959c142150 0x7f959c15eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.277+0000 7f959a800640 1 -- 172.21.15.99:0/1368019741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c143be0 con 0x7f959c160a80 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.277+0000 7f959a800640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c160a80 0x7f959c13ed20 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f9594007df0 tx=0x7f959400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.277+0000 7f9592a00640 1 -- 172.21.15.99:0/1368019741 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959401a070 con 0x7f959c160a80 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.277+0000 7f9592a00640 1 -- 172.21.15.99:0/1368019741 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9594003990 con 0x7f959c160a80 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.277+0000 7f9592a00640 1 -- 172.21.15.99:0/1368019741 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594003da0 con 0x7f959c160a80 2024-09-10T07:46:29.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.277+0000 7f95a1200640 1 -- 172.21.15.99:0/1368019741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959c143ec0 con 0x7f959c160a80 2024-09-10T07:46:29.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.277+0000 7f95a1200640 1 -- 172.21.15.99:0/1368019741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c144480 con 0x7f959c160a80 2024-09-10T07:46:29.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.278+0000 7f95a1200640 1 -- 172.21.15.99:0/1368019741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959c160540 con 0x7f959c160a80 2024-09-10T07:46:29.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.279+0000 7f9592a00640 1 -- 172.21.15.99:0/1368019741 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f959401d070 con 0x7f959c160a80 2024-09-10T07:46:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.280+0000 7f9592a00640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957806be30 0x7f957806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:46:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.280+0000 7f9592a00640 1 -- 172.21.15.99:0/1368019741 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 4943+0+0 (secure 0 0 0) 0x7f959408aeb0 con 0x7f959c160a80 2024-09-10T07:46:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.280+0000 7f9599e00640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957806be30 0x7f957806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:46:29.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.281+0000 7f9599e00640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957806be30 0x7f957806e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f958c001780 tx=0x7f958c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:46:29.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.284+0000 7f9592a00640 1 -- 172.21.15.99:0/1368019741 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9594010070 con 0x7f959c160a80 2024-09-10T07:46:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.494+0000 7f95a1200640 1 -- 172.21.15.99:0/1368019741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f959c15e400 con 0x7f959c160a80 2024-09-10T07:46:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.495+0000 7f9592a00640 1 -- 172.21.15.99:0/1368019741 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+3917 (secure 0 0 0) 0x7f95940593e0 con 0x7f959c160a80 2024-09-10T07:46:29.495 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T07:46:29.495 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":92,"btime":"2024-09-10T07:45:56:038392+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6461,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6836/4239870292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4239870292},{"type":"v1","addr":"172.21.15.99:6836","nonce":4239870292}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":6464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2428750075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2428750075},{"type":"v1","addr":"172.21.15.187:6835","nonce":2428750075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1219809784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1219809784},{"type":"v1","addr":"172.21.15.187:6834","nonce":1219809784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/3966217650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6835","nonce":3966217650},{"type":"v1","addr":"172.21.15.99:6837","nonce":3966217650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[]} 2024-09-10T07:46:29.495 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 92 2024-09-10T07:46:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 -- 172.21.15.99:0/1368019741 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957806be30 msgr2=0x7f957806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957806be30 0x7f957806e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f958c001780 tx=0x7f958c009040 comp rx=0 tx=0).stop 2024-09-10T07:46:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 -- 172.21.15.99:0/1368019741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c160a80 msgr2=0x7f959c13ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:46:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c160a80 0x7f959c13ed20 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f9594007df0 tx=0x7f959400d4a0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 -- 172.21.15.99:0/1368019741 shutdown_connections 2024-09-10T07:46:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.99:6832/3417513811,v1:172.21.15.99:6833/3417513811] conn(0x7f957806be30 0x7f957806e2f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f959c160a80 0x7f959c13ed20 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f959c142150 0x7f959c15eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 --2- 172.21.15.99:0/1368019741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959c13fae0 0x7f959c143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:46:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 -- 172.21.15.99:0/1368019741 >> 172.21.15.99:0/1368019741 conn(0x7f959c06bc10 msgr2=0x7f959c15b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:46:29.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 -- 172.21.15.99:0/1368019741 shutdown_connections 2024-09-10T07:46:29.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T07:46:29.497+0000 7f95a1200640 1 -- 172.21.15.99:0/1368019741 wait complete. 2024-09-10T07:46:29.512 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-10T07:46:29.512 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T07:46:29.513 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T07:46:29.513 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:29.526 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T07:46:29.526 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T07:46:29.526 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:29.581 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T07:46:29.581 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T07:46:29.581 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:29.598 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T07:46:29.598 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T07:46:29.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:29.655 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T07:46:29.655 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T07:46:29.656 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T07:46:29.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:29.697 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T07:46:29.697 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T07:46:29.698 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:29.746 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T07:46:29.746 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T07:46:29.746 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:29.801 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T07:46:29.802 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T07:46:29.802 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:29.839 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T07:46:29.839 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T07:46:29.840 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:29.879 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T07:46:29.880 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T07:46:29.880 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:29.957 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T07:46:29.957 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T07:46:29.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:30.043 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T07:46:30.043 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T07:46:30.043 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:30.084 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T07:46:30.084 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T07:46:30.084 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T07:46:30.084 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:30.150 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T07:46:30.150 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T07:46:30.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:30.212 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T07:46:30.212 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T07:46:30.213 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T07:46:30.213 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:30.234 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T07:46:30.234 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T07:46:30.234 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:30.252 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T07:46:30.253 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T07:46:30.253 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T07:46:30.312 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T07:46:30.313 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T07:46:30.313 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2024-09-10T07:46:30.397 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:46:30.397 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T07:46:30.613 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:46:30.613 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T07:46:30.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:46:30.710 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T07:46:30.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:46:30.835 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T07:46:30.970 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:46:30.971 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T07:46:31.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:46:31.216 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T07:46:31.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:46:31.317 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T07:46:31.467 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:46:31.468 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T07:46:31.593 INFO:tasks.ceph:Archiving mon data... 2024-09-10T07:46:31.594 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866/data/mon.a.tgz 2024-09-10T07:46:31.595 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-10T07:46:31.630 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.goU5n22UFI 2024-09-10T07:46:31.630 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.goU5n22UFI 2024-09-10T07:46:31.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.goU5n22UFI 2024-09-10T07:46:31.927 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.goU5n22UFI is 454KB 2024-09-10T07:46:32.018 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.goU5n22UFI 2024-09-10T07:46:32.052 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866/data/mon.b.tgz 2024-09-10T07:46:32.053 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-09-10T07:46:32.088 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.JR3dO6jVl1 2024-09-10T07:46:32.089 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.JR3dO6jVl1 2024-09-10T07:46:32.292 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.JR3dO6jVl1 2024-09-10T07:46:32.386 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.JR3dO6jVl1 is 471KB 2024-09-10T07:46:32.475 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.JR3dO6jVl1 2024-09-10T07:46:32.510 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866/data/mon.c.tgz 2024-09-10T07:46:32.511 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-09-10T07:46:32.585 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.46qzX4D3X7 2024-09-10T07:46:32.585 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.46qzX4D3X7 2024-09-10T07:46:32.774 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.46qzX4D3X7 2024-09-10T07:46:32.868 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.46qzX4D3X7 is 471KB 2024-09-10T07:46:32.958 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.46qzX4D3X7 2024-09-10T07:46:32.993 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T07:46:32.993 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T07:46:32.998 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T07:46:33.126 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T07:46:33.161 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T07:46:33.161 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T07:46:33.163 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866/remote/smithi099/crash 2024-09-10T07:46:33.163 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T07:46:33.222 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866/remote/smithi187/crash 2024-09-10T07:46:33.223 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T07:46:33.276 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T07:46:33.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:46:33.281 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T07:46:33.387 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T07:46:33.442 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T07:46:33.497 INFO:tasks.ceph:Compressing logs... 2024-09-10T07:46:33.497 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T07:46:33.501 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T07:46:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T07:46:33.552 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57012.log 2024-09-10T07:46:33.553 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52128.log 2024-09-10T07:46:33.553 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42867.log 2024-09-10T07:46:33.554 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57012.log.gz 2024-09-10T07:46:33.554 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46832.log 2024-09-10T07:46:33.555 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52128.log.gz 2024-09-10T07:46:33.556 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31540.log 2024-09-10T07:46:33.556 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44382.log 2024-09-10T07:46:33.556 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42867.log.gz 2024-09-10T07:46:33.556 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46217.log 2024-09-10T07:46:33.558 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46832.log.gz 2024-09-10T07:46:33.558 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35766.log 2024-09-10T07:46:33.558 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44382.log.gz 2024-09-10T07:46:33.559 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46217.log: gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46217.log.gz -- 2024-09-10T07:46:33.559 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.54460.log 2024-09-10T07:46:33.559 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33905.log 2024-09-10T07:46:33.559 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.31540.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T07:46:33.559 INFO:teuthology.orchestra.run.smithi187.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31540.log.gz 2024-09-10T07:46:33.559 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.33905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33905.log.gz 2024-09-10T07:46:33.560 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31460.log 2024-09-10T07:46:33.560 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T07:46:33.560 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.31460.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31460.log.gz 2024-09-10T07:46:33.560 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31375.log 2024-09-10T07:46:33.562 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T07:46:33.562 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.31375.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.31375.log.gz --verbose 2024-09-10T07:46:33.562 INFO:teuthology.orchestra.run.smithi187.stderr: -- /var/log/ceph/ceph.audit.log 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41835.log 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35766.log.gz 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60820.log 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54460.log.gz 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51370.log 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41835.log.gz 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40758.log 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60820.log.gz 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36486.log 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51370.log.gz 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46745.log 2024-09-10T07:46:33.564 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40758.log.gz 2024-09-10T07:46:33.569 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47351.log 2024-09-10T07:46:33.569 INFO:teuthology.orchestra.run.smithi099.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36486.log.gz 2024-09-10T07:46:33.569 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33507.log 2024-09-10T07:46:33.569 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46745.log.gz 2024-09-10T07:46:33.569 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51767.log 2024-09-10T07:46:33.569 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33507.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47351.log.gz 2024-09-10T07:46:33.569 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52433.log 2024-09-10T07:46:33.569 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33507.log.gz 2024-09-10T07:46:33.569 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54671.log 2024-09-10T07:46:33.570 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51767.log.gz 2024-09-10T07:46:33.570 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52433.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52433.log.gz 2024-09-10T07:46:33.570 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32200.log 2024-09-10T07:46:33.572 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.32848.log 2024-09-10T07:46:33.572 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36458.log 2024-09-10T07:46:33.572 INFO:teuthology.orchestra.run.smithi187.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T07:46:33.572 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.3.32848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.32848.log.gz 2024-09-10T07:46:33.572 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35978.log 2024-09-10T07:46:33.572 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.36458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33414.log 2024-09-10T07:46:33.572 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36458.log.gz 2024-09-10T07:46:33.572 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.35978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35978.log.gz 2024-09-10T07:46:33.572 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31329.log 2024-09-10T07:46:33.573 INFO:teuthology.orchestra.run.smithi187.stderr: 94.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T07:46:33.573 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.33414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31580.log 2024-09-10T07:46:33.573 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33414.log.gz 2024-09-10T07:46:33.573 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.31329.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31329.log.gz 2024-09-10T07:46:33.573 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T07:46:33.573 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.31580.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31580.log.gz 2024-09-10T07:46:33.573 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34413.log 2024-09-10T07:46:33.573 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.38094.log 2024-09-10T07:46:33.573 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.34413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34413.log.gz 2024-09-10T07:46:33.575 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51328.log 2024-09-10T07:46:33.575 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54671.log.gz 2024-09-10T07:46:33.575 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46622.log 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32200.log.gz 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33504.log 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51328.log.gz 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46622.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.41152.log -- replaced with /var/log/ceph/ceph-client.admin.46622.log.gz 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46542.log 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33504.log.gz 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57903.log 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41152.log.gz 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55576.log 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46542.log.gz 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57903.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57903.log.gzgzip 2024-09-10T07:46:33.576 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61662.log 2024-09-10T07:46:33.581 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32415.log 2024-09-10T07:46:33.581 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.38094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38094.log.gz 2024-09-10T07:46:33.581 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T07:46:33.581 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.32415.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T07:46:33.581 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32415.log.gz 2024-09-10T07:46:33.581 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34941.log 2024-09-10T07:46:33.581 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T07:46:33.581 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.34941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34941.log.gz 2024-09-10T07:46:33.581 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T07:46:33.581 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T07:46:33.584 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61393.log 2024-09-10T07:46:33.584 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55576.log.gz 2024-09-10T07:46:33.584 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50745.log 2024-09-10T07:46:33.584 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61662.log.gz 2024-09-10T07:46:33.584 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44888.log 2024-09-10T07:46:33.584 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61393.log.gz 2024-09-10T07:46:33.584 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50745.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50745.log.gz 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56657.log 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33178.log 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44888.log.gz 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52048.log 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56657.log.gz 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48951.log 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33178.log.gz 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63149.log 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52048.log.gz 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36442.log 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48951.log.gz 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42461.log 2024-09-10T07:46:33.585 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63149.log.gz 2024-09-10T07:46:33.586 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37539.log 2024-09-10T07:46:33.586 INFO:teuthology.orchestra.run.smithi187.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T07:46:33.586 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.37539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37539.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31420.log 2024-09-10T07:46:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53719.log 2024-09-10T07:46:33.588 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36442.log.gz 2024-09-10T07:46:33.589 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36923.log 2024-09-10T07:46:33.589 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42461.log.gz 2024-09-10T07:46:33.589 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36965.log 2024-09-10T07:46:33.589 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53719.log.gz 2024-09-10T07:46:33.589 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52923.log 2024-09-10T07:46:33.589 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36923.log.gz 2024-09-10T07:46:33.589 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54798.log 2024-09-10T07:46:33.589 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36965.log.gz 2024-09-10T07:46:33.590 INFO:teuthology.orchestra.run.smithi187.stderr: 2024-09-10T07:46:33.590 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T07:46:33.590 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.31420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36958.log 2024-09-10T07:46:33.590 INFO:teuthology.orchestra.run.smithi187.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31420.log.gz 2024-09-10T07:46:33.591 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52923.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52923.log.gz 2024-09-10T07:46:33.591 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63065.log 2024-09-10T07:46:33.591 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45965.log 2024-09-10T07:46:33.591 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54798.log.gz 2024-09-10T07:46:33.591 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49828.log 2024-09-10T07:46:33.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63065.log.gz 2024-09-10T07:46:33.592 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31289.log 2024-09-10T07:46:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57735.log 2024-09-10T07:46:33.593 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45965.log.gz 2024-09-10T07:46:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49828.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49828.log.gz 2024-09-10T07:46:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54148.log 2024-09-10T07:46:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59419.log 2024-09-10T07:46:33.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57735.log.gz 2024-09-10T07:46:33.595 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.31289.log: /var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.1.36958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36958.log.gz 2024-09-10T07:46:33.595 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35477.log 2024-09-10T07:46:33.595 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31500.log 2024-09-10T07:46:33.596 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46385.log 2024-09-10T07:46:33.596 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54148.log.gz 2024-09-10T07:46:33.596 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59983.log 2024-09-10T07:46:33.596 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59419.log.gz 2024-09-10T07:46:33.597 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46385.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46385.log.gz 2024-09-10T07:46:33.597 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44506.log 2024-09-10T07:46:33.598 INFO:teuthology.orchestra.run.smithi187.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31289.log.gz 2024-09-10T07:46:33.598 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.35477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35477.log.gz 2024-09-10T07:46:33.600 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36839.log 2024-09-10T07:46:33.600 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59983.log.gz 2024-09-10T07:46:33.600 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52475.log 2024-09-10T07:46:33.600 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44506.log.gz 2024-09-10T07:46:33.600 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60758.log 2024-09-10T07:46:33.600 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36839.log.gz 2024-09-10T07:46:33.600 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52475.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52475.log.gz 2024-09-10T07:46:33.600 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42549.log 2024-09-10T07:46:33.601 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.31500.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31500.log.gz 2024-09-10T07:46:33.602 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49870.log 2024-09-10T07:46:33.602 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60758.log.gz 2024-09-10T07:46:33.602 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60025.log 2024-09-10T07:46:33.602 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42549.log.gz 2024-09-10T07:46:33.602 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53864.log 2024-09-10T07:46:33.603 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49870.log.gz 2024-09-10T07:46:33.603 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60025.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60025.log.gzgzip 2024-09-10T07:46:33.603 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T07:46:33.604 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46343.log 2024-09-10T07:46:33.604 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53864.log.gz 2024-09-10T07:46:33.604 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62075.log 2024-09-10T07:46:33.605 INFO:teuthology.orchestra.run.smithi187.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T07:46:33.605 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40800.log 2024-09-10T07:46:33.606 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46343.log.gz 2024-09-10T07:46:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44720.log 2024-09-10T07:46:33.606 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62075.log.gz 2024-09-10T07:46:33.607 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51641.log 2024-09-10T07:46:33.607 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40800.log.gz 2024-09-10T07:46:33.608 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44720.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44720.log.gz 2024-09-10T07:46:33.608 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40301.log 2024-09-10T07:46:33.609 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38918.log 2024-09-10T07:46:33.610 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51641.log.gz 2024-09-10T07:46:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40301.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.40301.log.gz 2024-09-10T07:46:33.610 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50543.log 2024-09-10T07:46:33.611 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49120.log 2024-09-10T07:46:33.612 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38918.log.gz 2024-09-10T07:46:33.612 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50543.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50543.log.gz 2024-09-10T07:46:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36018.log 2024-09-10T07:46:33.613 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60383.log 2024-09-10T07:46:33.614 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49120.log.gz 2024-09-10T07:46:33.614 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36018.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36018.log.gz 2024-09-10T07:46:33.615 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61762.log 2024-09-10T07:46:33.615 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37635.log 2024-09-10T07:46:33.616 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61762.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60383.log.gz 2024-09-10T07:46:33.617 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61762.log.gz 2024-09-10T07:46:33.617 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44207.log 2024-09-10T07:46:33.618 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39197.log 2024-09-10T07:46:33.618 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37635.log.gz 2024-09-10T07:46:33.619 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40587.log 2024-09-10T07:46:33.619 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44207.log.gz 2024-09-10T07:46:33.619 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44972.log 2024-09-10T07:46:33.620 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39197.log.gz 2024-09-10T07:46:33.620 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53190.log 2024-09-10T07:46:33.621 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40587.log.gz 2024-09-10T07:46:33.621 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42419.log 2024-09-10T07:46:33.621 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44972.log.gz 2024-09-10T07:46:33.622 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41210.log 2024-09-10T07:46:33.622 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53190.log.gz 2024-09-10T07:46:33.623 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32667.log 2024-09-10T07:46:33.623 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42419.log.gz 2024-09-10T07:46:33.624 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61435.log 2024-09-10T07:46:33.624 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41210.log.gz 2024-09-10T07:46:33.625 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32751.log 88.5% 2024-09-10T07:46:33.625 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32667.log.gz 2024-09-10T07:46:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56886.log 2024-09-10T07:46:33.626 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61435.log.gz 2024-09-10T07:46:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32751.log: gzip -5 88.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.32751.log.gz 2024-09-10T07:46:33.627 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.51809.log 2024-09-10T07:46:33.628 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42194.log 2024-09-10T07:46:33.628 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56886.log.gz 2024-09-10T07:46:33.628 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41751.log 2024-09-10T07:46:33.629 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51809.log.gz 2024-09-10T07:46:33.629 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2024-09-10T07:46:33.629 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42194.log.gz 2024-09-10T07:46:33.630 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41751.log: gzip -5 --verbose 89.1% -- -- replaced with /var/log/ceph/ceph-client.admin.41751.log.gz /var/log/ceph/ceph-client.admin.38792.log 2024-09-10T07:46:33.630 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:33.631 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48581.log 2024-09-10T07:46:33.631 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2024-09-10T07:46:33.632 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38792.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph.tmp-client.admin.29816.log -- replaced with /var/log/ceph/ceph-client.admin.38792.log.gz 2024-09-10T07:46:33.632 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:33.633 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36357.log 2024-09-10T07:46:33.633 INFO:teuthology.orchestra.run.smithi099.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48581.log.gz 2024-09-10T07:46:33.634 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.tmp-client.admin.29816.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29816.log.gz 2024-09-10T07:46:33.634 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57651.log 2024-09-10T07:46:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36357.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36357.log.gz 2024-09-10T07:46:33.635 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49916.log 2024-09-10T07:46:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58422.log 2024-09-10T07:46:33.636 INFO:teuthology.orchestra.run.smithi099.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57651.log.gz 2024-09-10T07:46:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59941.log 2024-09-10T07:46:33.637 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49916.log.gz 2024-09-10T07:46:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44464.log 2024-09-10T07:46:33.638 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58422.log.gz 2024-09-10T07:46:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57987.log 2024-09-10T07:46:33.639 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59941.log.gz 2024-09-10T07:46:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44464.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44464.log.gz 2024-09-10T07:46:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35521.log 2024-09-10T07:46:33.641 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41522.log 2024-09-10T07:46:33.641 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57987.log.gz 2024-09-10T07:46:33.641 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61249.log 2024-09-10T07:46:33.642 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35521.log.gz 2024-09-10T07:46:33.642 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32583.log 2024-09-10T07:46:33.642 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41522.log.gz 2024-09-10T07:46:33.643 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46007.log 2024-09-10T07:46:33.643 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61249.log.gz 2024-09-10T07:46:33.644 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32583.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32583.log.gz 2024-09-10T07:46:33.645 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63023.log 2024-09-10T07:46:33.645 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57521.log 2024-09-10T07:46:33.646 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46007.log.gz 2024-09-10T07:46:33.646 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63023.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.60948.log -- replaced with /var/log/ceph/ceph-client.admin.63023.log.gz 2024-09-10T07:46:33.646 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:33.647 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42675.log 2024-09-10T07:46:33.648 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57521.log.gz 2024-09-10T07:46:33.648 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53422.log 2024-09-10T07:46:33.649 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60948.log.gz 2024-09-10T07:46:33.649 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52773.log 2024-09-10T07:46:33.650 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42675.log.gz 2024-09-10T07:46:33.650 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57437.log 2024-09-10T07:46:33.650 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53422.log.gz 2024-09-10T07:46:33.651 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54629.log 2024-09-10T07:46:33.651 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52773.log.gz 2024-09-10T07:46:33.652 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.34944.log 2024-09-10T07:46:33.653 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57437.log.gz 2024-09-10T07:46:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50084.log 2024-09-10T07:46:33.654 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54629.log.gz 2024-09-10T07:46:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.2.34944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.34944.log.gz 2024-09-10T07:46:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54973.log 2024-09-10T07:46:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57355.log 2024-09-10T07:46:33.656 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50084.log.gz 2024-09-10T07:46:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54973.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.54973.log.gz 2024-09-10T07:46:33.657 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44103.log 2024-09-10T07:46:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54893.log 2024-09-10T07:46:33.658 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57355.log.gz 2024-09-10T07:46:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62645.log 2024-09-10T07:46:33.659 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44103.log.gz 2024-09-10T07:46:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39884.log 2024-09-10T07:46:33.660 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54893.log.gz 2024-09-10T07:46:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62771.log 2024-09-10T07:46:33.661 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62645.log.gz 2024-09-10T07:46:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58873.log 2024-09-10T07:46:33.662 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39884.log.gz 2024-09-10T07:46:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33185.log 2024-09-10T07:46:33.662 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62771.log.gz 2024-09-10T07:46:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60716.log 2024-09-10T07:46:33.663 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58873.log.gz 2024-09-10T07:46:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44019.log 2024-09-10T07:46:33.664 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33185.log.gz 2024-09-10T07:46:33.665 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49204.log 2024-09-10T07:46:33.665 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60716.log.gz 2024-09-10T07:46:33.666 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32709.log 2024-09-10T07:46:33.666 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44019.log.gz 2024-09-10T07:46:33.667 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45473.log 2024-09-10T07:46:33.667 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49204.log.gz 2024-09-10T07:46:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58915.log 2024-09-10T07:46:33.668 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32709.log.gz 2024-09-10T07:46:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38605.log 2024-09-10T07:46:33.669 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45473.log.gz 2024-09-10T07:46:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61888.log 2024-09-10T07:46:33.670 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58915.log.gz 2024-09-10T07:46:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43832.log 2024-09-10T07:46:33.670 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38605.log.gz 2024-09-10T07:46:33.671 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48807.log 2024-09-10T07:46:33.671 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61888.log.gz 2024-09-10T07:46:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56573.log 87.8% 2024-09-10T07:46:33.672 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43832.log.gz 2024-09-10T07:46:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49691.log 2024-09-10T07:46:33.673 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48807.log.gz 2024-09-10T07:46:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56573.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.56573.log.gz --verbose 2024-09-10T07:46:33.674 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.61032.log 2024-09-10T07:46:33.675 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39022.log 2024-09-10T07:46:33.675 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49691.log.gz 2024-09-10T07:46:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61032.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61032.log.gz 2024-09-10T07:46:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59802.log 2024-09-10T07:46:33.677 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39278.log 2024-09-10T07:46:33.677 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39022.log.gz 2024-09-10T07:46:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36400.log 2024-09-10T07:46:33.678 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59802.log.gz 2024-09-10T07:46:33.678 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46703.log 2024-09-10T07:46:33.679 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39278.log.gz 2024-09-10T07:46:33.679 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50464.log 2024-09-10T07:46:33.680 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36400.log.gz 2024-09-10T07:46:33.680 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40180.log 2024-09-10T07:46:33.680 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46703.log.gz 2024-09-10T07:46:33.681 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.50464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50464.log.gz 2024-09-10T07:46:33.681 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62159.log 2024-09-10T07:46:33.682 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.40180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40180.log.gz 2024-09-10T07:46:33.682 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47726.log 2024-09-10T07:46:33.683 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62159.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.62519.log -- replaced with /var/log/ceph/ceph-client.admin.62159.log.gz 2024-09-10T07:46:33.683 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:33.684 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57861.log 2024-09-10T07:46:33.684 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47726.log.gz 2024-09-10T07:46:33.685 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62519.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.62981.log -- replaced with /var/log/ceph/ceph-client.admin.62519.log.gz 2024-09-10T07:46:33.685 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51893.log 2024-09-10T07:46:33.686 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57861.log.gz 2024-09-10T07:46:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53581.log 2024-09-10T07:46:33.687 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62981.log.gz 2024-09-10T07:46:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62393.log 2024-09-10T07:46:33.688 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51893.log.gz 2024-09-10T07:46:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61291.log 2024-09-10T07:46:33.689 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53581.log.gz 2024-09-10T07:46:33.689 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41336.log 2024-09-10T07:46:33.690 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62393.log.gz 2024-09-10T07:46:33.690 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54587.log 2024-09-10T07:46:33.691 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61291.log.gz 2024-09-10T07:46:33.691 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31620.log 2024-09-10T07:46:33.691 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41336.log.gz 2024-09-10T07:46:33.692 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35120.log 2024-09-10T07:46:33.692 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54587.log.gz 2024-09-10T07:46:33.693 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33169.log 2024-09-10T07:46:33.693 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31620.log.gz 2024-09-10T07:46:33.694 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50210.log 2024-09-10T07:46:33.694 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35120.log.gz 2024-09-10T07:46:33.695 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33184.log 2024-09-10T07:46:33.695 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33169.log.gz 2024-09-10T07:46:33.696 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33801.log 2024-09-10T07:46:33.697 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50210.log.gz 2024-09-10T07:46:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33184.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33184.log.gz 2024-09-10T07:46:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45721.log 2024-09-10T07:46:33.698 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33801.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33801.log.gz 2024-09-10T07:46:33.698 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32284.log 2024-09-10T07:46:33.699 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57609.log 2024-09-10T07:46:33.699 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45721.log.gz 2024-09-10T07:46:33.700 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39362.log 2024-09-10T07:46:33.700 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32284.log.gz 2024-09-10T07:46:33.701 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41294.log 2024-09-10T07:46:33.701 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57609.log.gz 2024-09-10T07:46:33.702 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32835.log 2024-09-10T07:46:33.702 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39362.log.gz 2024-09-10T07:46:33.703 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43772.log 2024-09-10T07:46:33.703 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41294.log.gz 2024-09-10T07:46:33.704 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2024-09-10T07:46:33.704 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32835.log.gz 2024-09-10T07:46:33.705 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2024-09-10T07:46:33.705 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43772.log.gz 2024-09-10T07:46:33.706 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40259.log 2024-09-10T07:46:33.706 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2024-09-10T07:46:33.707 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59209.log 2024-09-10T07:46:33.707 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2024-09-10T07:46:33.708 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40259.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T07:46:33.708 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40259.log.gz 2024-09-10T07:46:33.709 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63305.log 2024-09-10T07:46:33.709 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59209.log.gz 2024-09-10T07:46:33.709 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48681.log 2024-09-10T07:46:33.710 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63305.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63305.log.gz 2024-09-10T07:46:33.711 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49246.log 2024-09-10T07:46:33.711 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56970.log 2024-09-10T07:46:33.712 INFO:teuthology.orchestra.run.smithi099.stderr: 89.8% 88.3%/var/log/ceph/ceph-client.admin.49246.log: -- replaced with /var/log/ceph/ceph-client.admin.48681.log.gz -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T07:46:33.712 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:33.713 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46301.log 2024-09-10T07:46:33.713 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49246.log.gz 2024-09-10T07:46:33.713 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32793.log 2024-09-10T07:46:33.714 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56970.log.gz 2024-09-10T07:46:33.715 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54358.log 2024-09-10T07:46:33.715 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46301.log.gz 2024-09-10T07:46:33.716 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48503.log 2024-09-10T07:46:33.716 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32793.log.gz 2024-09-10T07:46:33.717 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54358.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.54358.log.gz 2024-09-10T07:46:33.717 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44061.log 2024-09-10T07:46:33.717 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41565.log 2024-09-10T07:46:33.717 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48503.log.gz 2024-09-10T07:46:33.718 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61972.log 2024-09-10T07:46:33.718 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44061.log.gz 2024-09-10T07:46:33.719 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58999.log 2024-09-10T07:46:33.719 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41565.log.gz 2024-09-10T07:46:33.720 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63345.log 2024-09-10T07:46:33.720 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61972.log.gz 2024-09-10T07:46:33.721 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57180.log 2024-09-10T07:46:33.721 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58999.log.gz 2024-09-10T07:46:33.722 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47015.log 2024-09-10T07:46:33.722 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63345.log.gz 2024-09-10T07:46:33.723 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37176.log 2024-09-10T07:46:33.723 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57180.log.gz 2024-09-10T07:46:33.724 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43875.log 2024-09-10T07:46:33.724 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47015.log.gz 2024-09-10T07:46:33.725 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43176.log 2024-09-10T07:46:33.725 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37176.log.gz 2024-09-10T07:46:33.725 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43875.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43875.log.gz 2024-09-10T07:46:33.726 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2024-09-10T07:46:33.727 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50276.log 2024-09-10T07:46:33.727 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43176.log.gz 2024-09-10T07:46:33.727 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43646.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2024-09-10T07:46:33.728 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.45881.log 2024-09-10T07:46:33.728 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54274.log 2024-09-10T07:46:33.729 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50276.log.gz 2024-09-10T07:46:33.729 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36654.log 2024-09-10T07:46:33.729 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45881.log.gz 2024-09-10T07:46:33.730 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48849.log 2024-09-10T07:46:33.730 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54274.log.gz 2024-09-10T07:46:33.731 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36654.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36654.log.gz 2024-09-10T07:46:33.731 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61153.log 2024-09-10T07:46:33.732 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62855.log 2024-09-10T07:46:33.732 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48849.log.gz 2024-09-10T07:46:33.733 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56615.log 2024-09-10T07:46:33.733 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61153.log.gz 2024-09-10T07:46:33.734 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38395.log 2024-09-10T07:46:33.734 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62855.log.gz 2024-09-10T07:46:33.735 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56615.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56615.log.gz 2024-09-10T07:46:33.735 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53677.log 2024-09-10T07:46:33.736 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44145.log 2024-09-10T07:46:33.736 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38395.log.gz 2024-09-10T07:46:33.737 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60257.log 2024-09-10T07:46:33.737 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53677.log.gz 2024-09-10T07:46:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33509.log 2024-09-10T07:46:33.738 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44145.log.gz 2024-09-10T07:46:33.739 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47684.log 2024-09-10T07:46:33.739 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60257.log.gz 2024-09-10T07:46:33.739 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33173.log 2024-09-10T07:46:33.740 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33509.log.gz 2024-09-10T07:46:33.740 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42072.log 2024-09-10T07:46:33.740 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47684.log.gz 2024-09-10T07:46:33.741 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33173.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.33173.log.gz 2024-09-10T07:46:33.741 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58089.log 2024-09-10T07:46:33.742 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55702.log 2024-09-10T07:46:33.742 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42072.log.gz 2024-09-10T07:46:33.743 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49483.log 2024-09-10T07:46:33.743 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.58089.log.gz 2024-09-10T07:46:33.744 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59760.log 2024-09-10T07:46:33.745 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55702.log.gz 2024-09-10T07:46:33.745 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49483.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49483.log.gz 2024-09-10T07:46:33.745 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63107.log 2024-09-10T07:46:33.746 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40926.log 2024-09-10T07:46:33.746 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59760.log.gz 2024-09-10T07:46:33.747 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52292.log 2024-09-10T07:46:33.747 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63107.log.gz 2024-09-10T07:46:33.748 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49288.log 2024-09-10T07:46:33.748 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40926.log.gz 2024-09-10T07:46:33.749 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35348.log 2024-09-10T07:46:33.749 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52292.log.gz 2024-09-10T07:46:33.750 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49036.log 2024-09-10T07:46:33.750 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49288.log.gz 2024-09-10T07:46:33.751 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53822.log 2024-09-10T07:46:33.751 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35348.log.gz 2024-09-10T07:46:33.752 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36528.log 2024-09-10T07:46:33.752 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49036.log.gz 2024-09-10T07:46:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36612.log 2024-09-10T07:46:33.753 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53822.log.gz 2024-09-10T07:46:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33519.log 2024-09-10T07:46:33.753 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36528.log.gz 2024-09-10T07:46:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50000.log 2024-09-10T07:46:33.754 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36612.log.gz 2024-09-10T07:46:33.755 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33519.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33519.log.gz 2024-09-10T07:46:33.755 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39502.log 2024-09-10T07:46:33.756 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35264.log 2024-09-10T07:46:33.756 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50000.log.gz 2024-09-10T07:46:33.757 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57777.log 2024-09-10T07:46:33.757 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39502.log.gz 2024-09-10T07:46:33.758 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37134.log 2024-09-10T07:46:33.758 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35264.log.gz 2024-09-10T07:46:33.758 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46091.log 88.0% 2024-09-10T07:46:33.759 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57777.log.gz 2024-09-10T07:46:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59041.log 2024-09-10T07:46:33.760 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37134.log.gz 2024-09-10T07:46:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46091.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46091.log.gz 2024-09-10T07:46:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52815.log 2024-09-10T07:46:33.761 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56783.log 2024-09-10T07:46:33.762 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59041.log.gz 2024-09-10T07:46:33.762 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2024-09-10T07:46:33.762 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52815.log.gz 2024-09-10T07:46:33.763 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62435.log 2024-09-10T07:46:33.763 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56783.log.gz 2024-09-10T07:46:33.764 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33003.log 2024-09-10T07:46:33.764 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2024-09-10T07:46:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38563.log 2024-09-10T07:46:33.765 INFO:teuthology.orchestra.run.smithi099.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62435.log.gz 2024-09-10T07:46:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33003.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.33003.log.gz /var/log/ceph/ceph-client.admin.58029.log 2024-09-10T07:46:33.766 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46876.log 2024-09-10T07:46:33.767 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38563.log.gz 2024-09-10T07:46:33.768 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42326.log 2024-09-10T07:46:33.768 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58029.log.gz 2024-09-10T07:46:33.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46049.log 2024-09-10T07:46:33.769 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46876.log.gz 2024-09-10T07:46:33.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42326.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.42326.log.gz --verbose 2024-09-10T07:46:33.769 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.31352.log 2024-09-10T07:46:33.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38295.log 2024-09-10T07:46:33.770 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46049.log.gz 2024-09-10T07:46:33.771 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47937.log 2024-09-10T07:46:33.771 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31352.log.gz 2024-09-10T07:46:33.772 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40470.log 2024-09-10T07:46:33.772 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38295.log.gz 2024-09-10T07:46:33.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56928.log 2024-09-10T07:46:33.773 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47937.log.gz 2024-09-10T07:46:33.774 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47183.log 2024-09-10T07:46:33.774 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40470.log.gz 2024-09-10T07:46:33.775 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34011.log 2024-09-10T07:46:33.775 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56928.log.gz 2024-09-10T07:46:33.776 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50168.log 2024-09-10T07:46:33.776 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47183.log.gz 2024-09-10T07:46:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36102.log 2024-09-10T07:46:33.777 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34011.log.gz 2024-09-10T07:46:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45431.log 2024-09-10T07:46:33.778 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50168.log.gz 2024-09-10T07:46:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54012.log 2024-09-10T07:46:33.779 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36102.log.gz 2024-09-10T07:46:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41897.log 2024-09-10T07:46:33.780 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz 2024-09-10T07:46:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59556.log 2024-09-10T07:46:33.781 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54012.log.gz 2024-09-10T07:46:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59461.log 2024-09-10T07:46:33.782 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41897.log.gz 2024-09-10T07:46:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59556.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59556.log.gz 2024-09-10T07:46:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40884.log 2024-09-10T07:46:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59461.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59461.log.gz -5 2024-09-10T07:46:33.783 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35306.log 2024-09-10T07:46:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40884.log: gzip -5 88.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.40884.log.gz 2024-09-10T07:46:33.784 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.37812.log 2024-09-10T07:46:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57693.log 2024-09-10T07:46:33.785 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35306.log.gz 2024-09-10T07:46:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54755.log 2024-09-10T07:46:33.786 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37812.log.gz 2024-09-10T07:46:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37514.log 2024-09-10T07:46:33.787 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57693.log.gz 2024-09-10T07:46:33.788 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54755.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.54755.log.gz /var/log/ceph/ceph-client.admin.61720.log 2024-09-10T07:46:33.788 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:33.789 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.37514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37514.log.gz 2024-09-10T07:46:33.789 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44762.log 2024-09-10T07:46:33.790 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61720.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.61720.log.gz /var/log/ceph/ceph-client.admin.46973.log 2024-09-10T07:46:33.790 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:33.791 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56843.log 2024-09-10T07:46:33.791 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44762.log.gz 2024-09-10T07:46:33.792 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49162.log 2024-09-10T07:46:33.792 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46973.log.gz 2024-09-10T07:46:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56843.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T07:46:33.793 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56843.log.gz 2024-09-10T07:46:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49162.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49162.log.gzgzip 2024-09-10T07:46:33.793 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42801.log 2024-09-10T07:46:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42591.log 2024-09-10T07:46:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38750.log 2024-09-10T07:46:33.796 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.42801.log.gz 2024-09-10T07:46:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39800.log 2024-09-10T07:46:33.797 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42591.log.gz 2024-09-10T07:46:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2024-09-10T07:46:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39800.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38750.log.gz 2024-09-10T07:46:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56157.log 2024-09-10T07:46:33.799 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39800.log.gz 2024-09-10T07:46:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43688.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2024-09-10T07:46:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32004.log 2024-09-10T07:46:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48270.log 2024-09-10T07:46:33.801 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56157.log.gz 2024-09-10T07:46:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41625.log 2024-09-10T07:46:33.802 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32004.log.gz 2024-09-10T07:46:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31864.log 2024-09-10T07:46:33.803 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48270.log.gz 2024-09-10T07:46:33.805 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35892.log 2024-09-10T07:46:33.805 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41625.log.gz 2024-09-10T07:46:33.806 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31864.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31864.log.gz 2024-09-10T07:46:33.806 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61584.log 2024-09-10T07:46:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37260.log 2024-09-10T07:46:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61584.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35892.log.gz 2024-09-10T07:46:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51683.log 2024-09-10T07:46:33.808 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61584.log.gz 2024-09-10T07:46:33.809 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39716.log 2024-09-10T07:46:33.809 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.37260.log.gz 2024-09-10T07:46:33.810 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57819.log 2024-09-10T07:46:33.811 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51683.log.gz 2024-09-10T07:46:33.811 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58506.log 2024-09-10T07:46:33.811 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39716.log.gz 2024-09-10T07:46:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41074.log 2024-09-10T07:46:33.813 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57819.log.gz 2024-09-10T07:46:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45643.log 2024-09-10T07:46:33.814 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58506.log.gz 2024-09-10T07:46:33.815 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55097.log 2024-09-10T07:46:33.815 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45643.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41074.log.gz 2024-09-10T07:46:33.816 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35850.log 2024-09-10T07:46:33.816 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45643.log.gz 2024-09-10T07:46:33.817 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55097.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55097.log.gz 2024-09-10T07:46:33.817 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53294.log 2024-09-10T07:46:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45098.log/var/log/ceph/ceph-client.admin.35850.log: 2024-09-10T07:46:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53294.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35850.log.gz 2024-09-10T07:46:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47309.log 2024-09-10T07:46:33.819 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53294.log.gz 2024-09-10T07:46:33.820 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36144.log 2024-09-10T07:46:33.820 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45098.log.gz 2024-09-10T07:46:33.821 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58773.log 2024-09-10T07:46:33.822 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47309.log.gz 2024-09-10T07:46:33.822 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33717.log 2024-09-10T07:46:33.823 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36144.log.gz 2024-09-10T07:46:33.823 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51228.log 2024-09-10T07:46:33.824 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58773.log.gz 2024-09-10T07:46:33.824 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52605.log 2024-09-10T07:46:33.825 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33717.log: /var/log/ceph/ceph-client.admin.51228.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33717.log.gz 2024-09-10T07:46:33.826 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37218.log 2024-09-10T07:46:33.826 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51228.log.gz 2024-09-10T07:46:33.827 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52605.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52605.log.gz 2024-09-10T07:46:33.827 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49605.log 2024-09-10T07:46:33.828 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51496.log 2024-09-10T07:46:33.828 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49605.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37218.log.gz 2024-09-10T07:46:33.829 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49605.log.gz 2024-09-10T07:46:33.829 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61804.log 2024-09-10T07:46:33.830 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60113.log 2024-09-10T07:46:33.830 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51496.log.gz 2024-09-10T07:46:33.831 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61804.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61804.log.gz 2024-09-10T07:46:33.832 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50648.log 2024-09-10T07:46:33.832 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52338.log 2024-09-10T07:46:33.833 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60113.log.gz 2024-09-10T07:46:33.834 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56531.log 2024-09-10T07:46:33.834 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50648.log.gz 2024-09-10T07:46:33.835 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52338.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52338.log.gz 2024-09-10T07:46:33.835 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35222.log 2024-09-10T07:46:33.836 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41252.log 2024-09-10T07:46:33.836 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56531.log.gz 2024-09-10T07:46:33.837 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58957.log 2024-09-10T07:46:33.837 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35222.log.gz 2024-09-10T07:46:33.838 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41252.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55660.log 2024-09-10T07:46:33.838 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41252.log.gz 2024-09-10T07:46:33.839 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47099.log 2024-09-10T07:46:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55660.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58957.log.gz 2024-09-10T07:46:33.840 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55660.log.gz 2024-09-10T07:46:33.840 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T07:46:33.841 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48312.log 2024-09-10T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47099.log.gz 2024-09-10T07:46:33.842 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48765.log 2024-09-10T07:46:33.843 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33759.log 2024-09-10T07:46:33.844 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48312.log.gz 2024-09-10T07:46:33.845 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59890.log 2024-09-10T07:46:33.845 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48765.log.gz 2024-09-10T07:46:33.846 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39632.log 2024-09-10T07:46:33.846 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33759.log.gz 2024-09-10T07:46:33.847 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51150.log 2024-09-10T07:46:33.847 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59890.log.gz 2024-09-10T07:46:33.849 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57945.log 2024-09-10T07:46:33.849 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39632.log.gz 2024-09-10T07:46:33.850 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38960.log 2024-09-10T07:46:33.850 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51150.log.gz 2024-09-10T07:46:33.850 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37049.log 2024-09-10T07:46:33.851 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57945.log.gz 2024-09-10T07:46:33.852 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43134.log 2024-09-10T07:46:33.852 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38960.log.gz 2024-09-10T07:46:33.853 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62201.log 2024-09-10T07:46:33.854 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37049.log.gz 2024-09-10T07:46:33.854 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-09-10T07:46:33.855 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43134.log.gz 2024-09-10T07:46:33.856 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59125.log 2024-09-10T07:46:33.856 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62201.log.gz 2024-09-10T07:46:33.857 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36267.log 2024-09-10T07:46:33.857 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gz 2024-09-10T07:46:33.858 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52208.log 2024-09-10T07:46:33.858 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59125.log.gz 2024-09-10T07:46:33.859 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36267.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36267.log.gz 2024-09-10T07:46:33.860 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36740.log 2024-09-10T07:46:33.861 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48723.log 2024-09-10T07:46:33.861 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52208.log.gz 2024-09-10T07:46:33.862 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51412.log 2024-09-10T07:46:33.862 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36740.log.gz 2024-09-10T07:46:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48723.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48723.log.gz 2024-09-10T07:46:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48891.log 2024-09-10T07:46:33.865 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51412.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51412.log.gz 2024-09-10T07:46:33.865 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32877.log 2024-09-10T07:46:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37715.log 2024-09-10T07:46:33.866 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48891.log.gz 2024-09-10T07:46:33.868 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34149.log 2024-09-10T07:46:33.868 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32877.log.gz 2024-09-10T07:46:33.868 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54503.log 2024-09-10T07:46:33.869 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37715.log.gz 2024-09-10T07:46:33.870 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35808.log 2024-09-10T07:46:33.870 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34149.log.gz 2024-09-10T07:46:33.871 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33517.log 2024-09-10T07:46:33.871 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54503.log.gz 2024-09-10T07:46:33.872 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32242.log 2024-09-10T07:46:33.872 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35808.log.gz 2024-09-10T07:46:33.873 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32499.log 2024-09-10T07:46:33.873 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33517.log.gz 2024-09-10T07:46:33.875 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35689.log 2024-09-10T07:46:33.875 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32242.log.gz 2024-09-10T07:46:33.876 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55492.log 2024-09-10T07:46:33.876 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32499.log.gz 2024-09-10T07:46:33.877 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52250.log 2024-09-10T07:46:33.877 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35689.log.gz 2024-09-10T07:46:33.878 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43520.log 2024-09-10T07:46:33.878 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55492.log.gz 2024-09-10T07:46:33.879 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36696.log 2024-09-10T07:46:33.879 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52250.log.gz 2024-09-10T07:46:33.880 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53779.log 2024-09-10T07:46:33.881 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43520.log.gz 2024-09-10T07:46:33.882 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49563.log 2024-09-10T07:46:33.882 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36696.log.gz 2024-09-10T07:46:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53779.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T07:46:33.883 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53779.log.gz 2024-09-10T07:46:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39586.log 2024-09-10T07:46:33.884 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49563.log.gz 2024-09-10T07:46:33.885 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62561.log 2024-09-10T07:46:33.886 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36784.log 2024-09-10T07:46:33.887 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39586.log.gz 2024-09-10T07:46:33.888 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60198.log 2024-09-10T07:46:33.888 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62561.log.gz 2024-09-10T07:46:33.889 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36784.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36784.log.gz 2024-09-10T07:46:33.890 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36881.log 2024-09-10T07:46:33.890 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60198.log.gz 2024-09-10T07:46:33.891 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48015.log 2024-09-10T07:46:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39451.log 2024-09-10T07:46:33.892 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36881.log.gz 2024-09-10T07:46:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48015.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48015.log.gz 2024-09-10T07:46:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39451.log: -- /var/log/ceph/ceph-client.0.45352.log 2024-09-10T07:46:33.895 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39451.log.gz 2024-09-10T07:46:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45923.log 2024-09-10T07:46:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.45352.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47267.log 2024-09-10T07:46:33.897 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.45352.log.gz 2024-09-10T07:46:33.898 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43562.log 2024-09-10T07:46:33.898 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45923.log.gz 2024-09-10T07:46:33.899 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47267.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47267.log.gz 2024-09-10T07:46:33.900 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57479.log 2024-09-10T07:46:33.901 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43562.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38479.log 2024-09-10T07:46:33.901 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43562.log.gz 2024-09-10T07:46:33.902 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41667.log 2024-09-10T07:46:33.902 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57479.log.gz 2024-09-10T07:46:33.904 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45822.log 2024-09-10T07:46:33.904 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38479.log.gz 2024-09-10T07:46:33.905 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33927.log 2024-09-10T07:46:33.905 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41667.log.gz 2024-09-10T07:46:33.906 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32100.log 2024-09-10T07:46:33.906 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45822.log.gz 2024-09-10T07:46:33.907 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61930.log 2024-09-10T07:46:33.907 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33927.log.gz 2024-09-10T07:46:33.909 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32100.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32100.log.gz 2024-09-10T07:46:33.909 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.61930.log: /var/log/ceph/ceph-client.admin.37854.log 2024-09-10T07:46:33.910 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61930.log.gz 2024-09-10T07:46:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59335.log 2024-09-10T07:46:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37896.log 2024-09-10T07:46:33.912 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37854.log.gz 2024-09-10T07:46:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59335.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59335.log.gz 2024-09-10T07:46:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48228.log 2024-09-10T07:46:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37896.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37896.log.gz 2024-09-10T07:46:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32415.log 2024-09-10T07:46:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41793.log 2024-09-10T07:46:33.916 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48228.log.gz 2024-09-10T07:46:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32415.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32415.log.gz 2024-09-10T07:46:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5/var/log/ceph/ceph-client.admin.41793.log: --verbose -- /var/log/ceph/ceph-client.admin.51725.log 2024-09-10T07:46:33.919 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41793.log.gz 2024-09-10T07:46:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56473.log 2024-09-10T07:46:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43384.log 2024-09-10T07:46:33.921 INFO:teuthology.orchestra.run.smithi187.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T07:46:33.921 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51725.log.gz 2024-09-10T07:46:33.922 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56473.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56473.log.gzgzip 2024-09-10T07:46:33.922 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33177.log 2024-09-10T07:46:33.923 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57565.log 2024-09-10T07:46:33.923 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43384.log.gz 2024-09-10T07:46:33.925 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55362.log 2024-09-10T07:46:33.925 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33177.log.gz 2024-09-10T07:46:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38708.log 2024-09-10T07:46:33.926 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57565.log.gz 2024-09-10T07:46:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55362.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T07:46:33.927 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55362.log.gz 2024-09-10T07:46:33.928 INFO:teuthology.orchestra.run.smithi187.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T07:46:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38708.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38708.log.gz 2024-09-10T07:46:33.929 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51454.log 2024-09-10T07:46:33.930 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51598.log 2024-09-10T07:46:33.931 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51454.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51454.log.gz 2024-09-10T07:46:33.933 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.admin.51598.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61111.log 2024-09-10T07:46:33.933 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51598.log.gz 2024-09-10T07:46:33.934 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60637.log 2024-09-10T07:46:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61111.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61111.log.gz 2024-09-10T07:46:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40512.log 2024-09-10T07:46:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.60637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60637.log.gz 2024-09-10T07:46:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54190.log 2024-09-10T07:46:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40512.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40512.log.gz 2024-09-10T07:46:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38353.log 2024-09-10T07:46:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54190.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54190.log.gz 2024-09-10T07:46:33.941 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60341.log 2024-09-10T07:46:33.942 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38353.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38353.log.gz 2024-09-10T07:46:33.943 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58343.log 2024-09-10T07:46:33.944 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60341.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60341.log.gz 2024-09-10T07:46:33.944 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62813.log 2024-09-10T07:46:33.945 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.58343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58343.log.gz 2024-09-10T07:46:33.946 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59636.log 2024-09-10T07:46:33.947 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62813.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62813.log.gz 2024-09-10T07:46:33.948 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42236.log 2024-09-10T07:46:33.949 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59636.log.gz 2024-09-10T07:46:33.949 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54713.log 2024-09-10T07:46:33.951 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42236.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42236.log.gz 2024-09-10T07:46:33.951 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48057.log 2024-09-10T07:46:33.952 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54713.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54713.log.gz 2024-09-10T07:46:33.953 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T07:46:33.954 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48057.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48057.log.gz 2024-09-10T07:46:33.955 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50926.log 2024-09-10T07:46:33.958 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.50926.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50926.log.gz 2024-09-10T07:46:33.959 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47605.log 2024-09-10T07:46:33.959 INFO:teuthology.orchestra.run.smithi099.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T07:46:33.960 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50586.log 2024-09-10T07:46:33.961 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.47605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47605.log.gz 2024-09-10T07:46:33.962 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63387.log 2024-09-10T07:46:33.963 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50586.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50586.log.gz 2024-09-10T07:46:33.964 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61351.log 2024-09-10T07:46:33.965 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63387.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63387.log.gz 2024-09-10T07:46:33.966 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.61351.log: /var/log/ceph/ceph-client.admin.46447.log 2024-09-10T07:46:33.966 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61351.log.gz 2024-09-10T07:46:33.967 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60071.log 2024-09-10T07:46:33.969 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46447.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46447.log.gz 2024-09-10T07:46:33.969 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37993.log/var/log/ceph/ceph-client.admin.60071.log: 2024-09-10T07:46:33.970 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60071.log.gz 2024-09-10T07:46:33.971 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46259.log 2024-09-10T07:46:33.973 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37993.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37993.log.gz 2024-09-10T07:46:33.973 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40629.log/var/log/ceph/ceph-client.admin.46259.log: 2024-09-10T07:46:33.974 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46259.log.gz 2024-09-10T07:46:33.974 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53464.log 2024-09-10T07:46:33.976 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40629.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40629.log.gz 2024-09-10T07:46:33.977 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.53464.log: /var/log/ceph/ceph-client.admin.38437.log 2024-09-10T07:46:33.977 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53464.log.gz 2024-09-10T07:46:33.977 INFO:teuthology.orchestra.run.smithi187.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T07:46:33.978 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49647.log 2024-09-10T07:46:33.979 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38437.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38437.log.gz 2024-09-10T07:46:33.980 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42759.log/var/log/ceph/ceph-client.admin.49647.log: 2024-09-10T07:46:33.981 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49647.log.gz 2024-09-10T07:46:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57096.log 2024-09-10T07:46:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42759.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42759.log.gz 2024-09-10T07:46:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.57096.log: /var/log/ceph/ceph-client.admin.56699.log 2024-09-10T07:46:33.984 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57096.log.gz 2024-09-10T07:46:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46927.log 2024-09-10T07:46:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56699.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56699.log.gz 2024-09-10T07:46:33.987 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56095.log 2024-09-10T07:46:33.988 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46927.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46927.log.gz 2024-09-10T07:46:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49078.log 2024-09-10T07:46:33.990 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56095.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56095.log.gz 2024-09-10T07:46:33.990 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49958.log 2024-09-10T07:46:33.991 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49078.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49078.log.gz 2024-09-10T07:46:33.992 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49786.log 2024-09-10T07:46:33.993 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49958.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49958.log.gz 2024-09-10T07:46:33.995 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46133.log/var/log/ceph/ceph-client.admin.49786.log: 2024-09-10T07:46:33.995 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49786.log.gz 2024-09-10T07:46:33.996 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49383.log 2024-09-10T07:46:33.997 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46133.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46133.log.gz 2024-09-10T07:46:33.998 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.49383.log: /var/log/ceph/ceph-client.admin.51538.log 2024-09-10T07:46:33.999 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49383.log.gz 2024-09-10T07:46:33.999 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32329.log 2024-09-10T07:46:34.001 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51538.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51538.log.gz 2024-09-10T07:46:34.002 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.32329.log: -- /var/log/ceph/ceph-client.admin.41992.log 2024-09-10T07:46:34.003 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32329.log.gz 2024-09-10T07:46:34.003 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38834.log 2024-09-10T07:46:34.004 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41992.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41992.log.gz 2024-09-10T07:46:34.005 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38217.log 2024-09-10T07:46:34.006 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38834.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38834.log.gz 2024-09-10T07:46:34.007 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37326.log 2024-09-10T07:46:34.008 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38217.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38217.log.gz 2024-09-10T07:46:34.009 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39544.log/var/log/ceph/ceph-client.admin.37326.log: 2024-09-10T07:46:34.009 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37326.log.gz 2024-09-10T07:46:34.010 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54545.log 2024-09-10T07:46:34.011 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39544.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39544.log.gz 2024-09-10T07:46:34.012 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62687.log 2024-09-10T07:46:34.013 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54545.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54545.log.gz 2024-09-10T07:46:34.014 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35599.log 2024-09-10T07:46:34.015 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz 2024-09-10T07:46:34.016 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36060.log 2024-09-10T07:46:34.017 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35599.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35599.log.gz 2024-09-10T07:46:34.017 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42507.log 2024-09-10T07:46:34.019 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36060.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36060.log.gz 2024-09-10T07:46:34.019 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42507.log: /var/log/ceph/ceph-client.0.43055.log 2024-09-10T07:46:34.020 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42507.log.gz 2024-09-10T07:46:34.021 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56053.log 2024-09-10T07:46:34.022 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.43055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43055.log.gz 2024-09-10T07:46:34.023 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55278.log 2024-09-10T07:46:34.023 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56053.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56053.log.gz 2024-09-10T07:46:34.024 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55408.log 2024-09-10T07:46:34.025 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55278.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55278.log.gz 2024-09-10T07:46:34.027 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55408.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55408.log.gz 2024-09-10T07:46:34.027 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33183.log 2024-09-10T07:46:34.028 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55183.log 2024-09-10T07:46:34.030 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33183.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33183.log.gz 2024-09-10T07:46:34.030 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48994.log 2024-09-10T07:46:34.031 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55183.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55183.log.gz 2024-09-10T07:46:34.032 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62117.log 2024-09-10T07:46:34.033 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48994.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48994.log.gz 2024-09-10T07:46:34.034 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37091.log/var/log/ceph/ceph-client.admin.62117.log: 2024-09-10T07:46:34.035 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62117.log.gz 2024-09-10T07:46:34.035 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62603.log 2024-09-10T07:46:34.037 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37091.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37091.log.gz 2024-09-10T07:46:34.038 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50829.log 2024-09-10T07:46:34.038 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62603.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62603.log.gz 2024-09-10T07:46:34.039 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44302.log 2024-09-10T07:46:34.040 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50829.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50829.log.gz 2024-09-10T07:46:34.041 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59083.log 2024-09-10T07:46:34.042 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44302.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44302.log.gz 2024-09-10T07:46:34.043 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51935.log 2024-09-10T07:46:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59083.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59083.log.gz 2024-09-10T07:46:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2024-09-10T07:46:34.046 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51935.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51935.log.gz 2024-09-10T07:46:34.046 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33180.log 2024-09-10T07:46:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42633.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2024-09-10T07:46:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48186.log 2024-09-10T07:46:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33180.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33180.log.gz 2024-09-10T07:46:34.051 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48186.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48186.log.gz 2024-09-10T07:46:34.051 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44846.log 2024-09-10T07:46:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55450.log 2024-09-10T07:46:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44846.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44846.log.gz 2024-09-10T07:46:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.admin.55450.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59846.log 2024-09-10T07:46:34.055 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55450.log.gz 2024-09-10T07:46:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39992.log 2024-09-10T07:46:34.057 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59846.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59846.log.gz 2024-09-10T07:46:34.058 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56395.log 2024-09-10T07:46:34.059 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39992.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39992.log.gz 2024-09-10T07:46:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37007.log 2024-09-10T07:46:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56395.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56395.log.gz 2024-09-10T07:46:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53539.log 2024-09-10T07:46:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37007.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37007.log.gz 2024-09-10T07:46:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34639.log 2024-09-10T07:46:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53539.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53539.log.gz 2024-09-10T07:46:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60299.log 2024-09-10T07:46:34.066 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34639.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34639.log.gz 2024-09-10T07:46:34.067 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33843.log/var/log/ceph/ceph-client.admin.60299.log: 2024-09-10T07:46:34.068 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60299.log.gz 2024-09-10T07:46:34.069 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42282.log 2024-09-10T07:46:34.070 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33843.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33843.log.gz 2024-09-10T07:46:34.071 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63191.log 2024-09-10T07:46:34.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42282.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42282.log.gz 2024-09-10T07:46:34.072 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59251.log 2024-09-10T07:46:34.073 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63191.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.63191.log.gz 2024-09-10T07:46:34.075 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59251.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59251.log.gz 2024-09-10T07:46:34.075 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63233.log 2024-09-10T07:46:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-09-10T07:46:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63233.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63233.log.gz 2024-09-10T07:46:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.36186.log: -- /var/log/ceph/ceph-client.admin.35078.log 2024-09-10T07:46:34.079 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2024-09-10T07:46:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44804.log 2024-09-10T07:46:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35078.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35078.log.gz 2024-09-10T07:46:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38876.log 2024-09-10T07:46:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44804.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44804.log.gz 2024-09-10T07:46:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46175.log 2024-09-10T07:46:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38876.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38876.log.gz 2024-09-10T07:46:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62939.log 2024-09-10T07:46:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46175.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46175.log.gz 2024-09-10T07:46:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62939.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62939.log.gz 2024-09-10T07:46:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57054.log 2024-09-10T07:46:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52647.log 2024-09-10T07:46:34.091 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57054.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57054.log.gz 2024-09-10T07:46:34.092 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.52647.log: -- /var/log/ceph/ceph-client.admin.53232.log 2024-09-10T07:46:34.092 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52647.log.gz 2024-09-10T07:46:34.093 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35410.log 2024-09-10T07:46:34.095 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53232.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53232.log.gz 2024-09-10T07:46:34.095 INFO:teuthology.orchestra.run.smithi099.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T07:46:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59377.log/var/log/ceph/ceph-client.admin.35410.log: 2024-09-10T07:46:34.096 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35410.log.gz 2024-09-10T07:46:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55768.log 2024-09-10T07:46:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60990.log 2024-09-10T07:46:34.098 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59377.log.gz 2024-09-10T07:46:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55768.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.55768.log.gz 2024-09-10T07:46:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60990.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60990.log.gz 2024-09-10T07:46:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47877.log 2024-09-10T07:46:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43917.log 2024-09-10T07:46:34.105 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44548.log 2024-09-10T07:46:34.105 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47877.log.gz 2024-09-10T07:46:34.105 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43917.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43917.log.gz 2024-09-10T07:46:34.106 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44548.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44548.log.gz 2024-09-10T07:46:34.106 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54232.log 2024-09-10T07:46:34.107 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40842.log 2024-09-10T07:46:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58155.log 2024-09-10T07:46:34.109 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54232.log.gz 2024-09-10T07:46:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40842.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40842.log.gz 2024-09-10T07:46:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43462.log 2024-09-10T07:46:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52689.log 2024-09-10T07:46:34.112 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58155.log.gz 2024-09-10T07:46:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39842.log 2024-09-10T07:46:34.113 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43462.log.gz 2024-09-10T07:46:34.114 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52689.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52689.log.gz 2024-09-10T07:46:34.114 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44678.log 2024-09-10T07:46:34.116 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41709.log 2024-09-10T07:46:34.116 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39842.log.gz 2024-09-10T07:46:34.117 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44678.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44678.log.gz 2024-09-10T07:46:34.118 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.admin.41709.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54090.log 2024-09-10T07:46:34.118 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41709.log.gz 2024-09-10T07:46:34.119 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55139.log 2024-09-10T07:46:34.121 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60449.log 2024-09-10T07:46:34.121 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54090.log.gz 2024-09-10T07:46:34.122 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32457.log 2024-09-10T07:46:34.122 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55139.log.gz 2024-09-10T07:46:34.123 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60449.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60449.log.gz 2024-09-10T07:46:34.123 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33969.log 2024-09-10T07:46:34.125 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58464.log 2024-09-10T07:46:34.125 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32457.log.gz 2024-09-10T07:46:34.126 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50126.log 2024-09-10T07:46:34.126 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33969.log.gz 2024-09-10T07:46:34.127 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58464.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58464.log.gz 2024-09-10T07:46:34.128 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50126.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50126.log.gz 2024-09-10T07:46:34.129 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58831.log 2024-09-10T07:46:34.130 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51851.log 2024-09-10T07:46:34.132 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58831.log.gz 2024-09-10T07:46:34.132 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:34.133 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51851.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51851.log.gz 2024-09-10T07:46:34.133 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54400.log 2024-09-10T07:46:34.133 INFO:teuthology.orchestra.run.smithi099.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T07:46:34.134 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35934.log 2024-09-10T07:46:34.135 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2024-09-10T07:46:34.135 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54400.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54400.log.gz 2024-09-10T07:46:34.136 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-09-10T07:46:34.137 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35976.log 2024-09-10T07:46:34.137 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35934.log.gz 2024-09-10T07:46:34.138 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39758.log 2024-09-10T07:46:34.138 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-09-10T07:46:34.139 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33516.log 2024-09-10T07:46:34.139 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35976.log.gz 2024-09-10T07:46:34.140 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39758.log: gzip -5 --verbose 87.3% -- /var/log/ceph/ceph-client.admin.57275.log -- replaced with /var/log/ceph/ceph-client.admin.39758.log.gz 2024-09-10T07:46:34.140 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:34.141 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32625.log 2024-09-10T07:46:34.141 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33516.log.gz 2024-09-10T07:46:34.142 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52517.log 2024-09-10T07:46:34.142 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57275.log.gz 2024-09-10T07:46:34.143 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44592.log 2024-09-10T07:46:34.143 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32625.log.gz 2024-09-10T07:46:34.144 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52517.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52517.log.gz 2024-09-10T07:46:34.144 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41462.log 2024-09-10T07:46:34.145 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58695.log 2024-09-10T07:46:34.146 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41462.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44592.log.gz 2024-09-10T07:46:34.146 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42377.log 2024-09-10T07:46:34.146 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41462.log.gz 2024-09-10T07:46:34.147 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50787.log 2024-09-10T07:46:34.148 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58695.log.gz 2024-09-10T07:46:34.149 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42377.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42377.log.gz 2024-09-10T07:46:34.149 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56741.log 2024-09-10T07:46:34.150 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45779.log 2024-09-10T07:46:34.150 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50787.log.gz 2024-09-10T07:46:34.151 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56741.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56741.log.gz 2024-09-10T07:46:34.151 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62477.log 2024-09-10T07:46:34.151 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44930.log 2024-09-10T07:46:34.153 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45779.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45779.log.gz 2024-09-10T07:46:34.153 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62477.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62477.log.gz 2024-09-10T07:46:34.153 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55055.log 2024-09-10T07:46:34.154 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36570.log 2024-09-10T07:46:34.154 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44930.log.gz 2024-09-10T07:46:34.155 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55055.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55055.log.gz 2024-09-10T07:46:34.155 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42717.log 2024-09-10T07:46:34.156 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.admin.36570.log: -5 --verbose -- /var/log/ceph/ceph-client.0.34486.log 2024-09-10T07:46:34.156 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36570.log.gz 2024-09-10T07:46:34.157 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46787.log 2024-09-10T07:46:34.157 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42717.log.gz 2024-09-10T07:46:34.158 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.34486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45164.log 2024-09-10T07:46:34.158 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34486.log.gz 2024-09-10T07:46:34.159 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46787.log: gzip -5 --verbose 89.3% -- -- replaced with /var/log/ceph/ceph-client.admin.46787.log.gz /var/log/ceph/ceph-client.admin.62897.log 2024-09-10T07:46:34.159 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:34.160 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42152.log 2024-09-10T07:46:34.161 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45164.log.gz 2024-09-10T07:46:34.161 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41378.log 2024-09-10T07:46:34.162 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62897.log.gz 2024-09-10T07:46:34.162 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49735.log 2024-09-10T07:46:34.163 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42152.log.gz 2024-09-10T07:46:34.164 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41378.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50042.log 2024-09-10T07:46:34.164 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41378.log.gz 2024-09-10T07:46:34.165 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55227.log 2024-09-10T07:46:34.165 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49735.log.gz 2024-09-10T07:46:34.166 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62729.log 2024-09-10T07:46:34.166 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50042.log.gz 2024-09-10T07:46:34.167 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60155.log 2024-09-10T07:46:34.167 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55227.log.gz 2024-09-10T07:46:34.168 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62729.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62729.log.gz -5 2024-09-10T07:46:34.168 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39320.log 2024-09-10T07:46:34.170 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43604.log 2024-09-10T07:46:34.170 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60155.log.gz 2024-09-10T07:46:34.171 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32541.log 2024-09-10T07:46:34.171 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39320.log.gz 2024-09-10T07:46:34.171 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39926.log 2024-09-10T07:46:34.172 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43604.log.gz 2024-09-10T07:46:34.173 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55320.log 2024-09-10T07:46:34.173 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32541.log.gz 2024-09-10T07:46:34.174 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32961.log 2024-09-10T07:46:34.174 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39926.log.gz 2024-09-10T07:46:34.175 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55961.log 2024-09-10T07:46:34.176 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55320.log.gz 2024-09-10T07:46:34.176 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32961.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32961.log.gz 2024-09-10T07:46:34.176 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52857.log 2024-09-10T07:46:34.177 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.55961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33521.log 2024-09-10T07:46:34.177 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55961.log.gz 2024-09-10T07:46:34.178 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59718.log 2024-09-10T07:46:34.179 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52857.log.gz 2024-09-10T07:46:34.179 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62030.log 2024-09-10T07:46:34.179 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33521.log.gz 2024-09-10T07:46:34.180 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32919.log 2024-09-10T07:46:34.181 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59718.log.gz 2024-09-10T07:46:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53111.log 2024-09-10T07:46:34.182 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62030.log.gz 2024-09-10T07:46:34.183 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32919.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32919.log.gz 2024-09-10T07:46:34.183 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39407.log 2024-09-10T07:46:34.183 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.53111.log: /var/log/ceph/ceph-client.admin.47057.log 2024-09-10T07:46:34.184 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53111.log.gz 2024-09-10T07:46:34.185 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39407.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39117.log 2024-09-10T07:46:34.185 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39407.log.gz 2024-09-10T07:46:34.186 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47057.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T07:46:34.186 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47057.log.gz 2024-09-10T07:46:34.187 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41420.log 2024-09-10T07:46:34.187 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39117.log.gz 2024-09-10T07:46:34.188 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52731.log 2024-09-10T07:46:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61846.log 2024-09-10T07:46:34.190 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41420.log.gz 2024-09-10T07:46:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39674.log 2024-09-10T07:46:34.191 INFO:teuthology.orchestra.run.smithi099.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52731.log.gz 2024-09-10T07:46:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61846.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61846.log.gz 2024-09-10T07:46:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59167.log 2024-09-10T07:46:34.194 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39674.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48639.log 2024-09-10T07:46:34.194 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39674.log.gz 2024-09-10T07:46:34.195 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59167.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T07:46:34.196 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59167.log.gz 2024-09-10T07:46:34.196 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48639.log: gzip -5 --verbose -- 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48639.log.gz 2024-09-10T07:46:34.197 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.52382.log 2024-09-10T07:46:34.198 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59293.log 2024-09-10T07:46:34.199 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52382.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52382.log.gz 2024-09-10T07:46:34.200 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38665.log 2024-09-10T07:46:34.200 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59293.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59293.log.gz 2024-09-10T07:46:34.201 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38521.log 2024-09-10T07:46:34.202 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38665.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38665.log.gz 2024-09-10T07:46:34.203 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35180.log 2024-09-10T07:46:34.204 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38521.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38521.log.gz 2024-09-10T07:46:34.205 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47417.log 2024-09-10T07:46:34.206 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35180.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35180.log.gz 2024-09-10T07:46:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43977.log 2024-09-10T07:46:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47417.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47417.log.gz 2024-09-10T07:46:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54316.log 2024-09-10T07:46:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43977.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43977.log.gz 2024-09-10T07:46:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37593.log/var/log/ceph/ceph-client.admin.54316.log: 2024-09-10T07:46:34.211 INFO:teuthology.orchestra.run.smithi099.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54316.log.gz 2024-09-10T07:46:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55618.log 2024-09-10T07:46:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37593.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37593.log.gz 2024-09-10T07:46:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57138.log 2024-09-10T07:46:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55618.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55618.log.gz 2024-09-10T07:46:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32373.log 2024-09-10T07:46:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57138.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57138.log.gz 2024-09-10T07:46:34.218 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33520.log 2024-09-10T07:46:34.218 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32373.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32373.log.gz 2024-09-10T07:46:34.219 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51286.log 2024-09-10T07:46:34.220 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33520.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33520.log.gz 2024-09-10T07:46:34.221 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5/var/log/ceph/ceph-client.admin.51286.log: --verbose -- /var/log/ceph/ceph-client.admin.55534.log 2024-09-10T07:46:34.222 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51286.log.gz 2024-09-10T07:46:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47225.log 2024-09-10T07:46:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55534.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55534.log.gz 2024-09-10T07:46:34.225 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.47225.log: /var/log/ceph/ceph-client.admin.52563.log 2024-09-10T07:46:34.225 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47225.log.gz 2024-09-10T07:46:34.227 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52563.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52563.log.gz 2024-09-10T07:46:34.362 INFO:teuthology.orchestra.run.smithi187.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T07:46:34.391 INFO:teuthology.orchestra.run.smithi099.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T07:46:34.411 INFO:teuthology.orchestra.run.smithi187.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T07:46:34.463 INFO:teuthology.orchestra.run.smithi187.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T07:46:34.521 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T07:46:34.538 INFO:teuthology.orchestra.run.smithi187.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T07:46:34.541 INFO:teuthology.orchestra.run.smithi187.stderr: 2024-09-10T07:46:34.541 INFO:teuthology.orchestra.run.smithi187.stderr:real 0m1.007s 2024-09-10T07:46:34.541 INFO:teuthology.orchestra.run.smithi187.stderr:user 0m4.241s 2024-09-10T07:46:34.541 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m0.479s 2024-09-10T07:46:34.660 INFO:teuthology.orchestra.run.smithi099.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T07:46:34.713 INFO:teuthology.orchestra.run.smithi099.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T07:46:34.879 INFO:teuthology.orchestra.run.smithi099.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T07:46:35.024 INFO:teuthology.orchestra.run.smithi099.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T07:46:35.027 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T07:46:35.027 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m1.498s 2024-09-10T07:46:35.027 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m5.198s 2024-09-10T07:46:35.027 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m1.733s 2024-09-10T07:46:35.028 INFO:tasks.ceph:Archiving logs... 2024-09-10T07:46:35.029 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866/remote/smithi099/log 2024-09-10T07:46:35.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T07:46:36.202 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866/remote/smithi187/log 2024-09-10T07:46:36.203 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T07:46:36.776 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T07:46:36.785 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T07:46:36.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T07:46:36.790 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T07:46:36.900 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T07:46:36.909 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T07:46:36.909 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T07:46:36.913 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T07:46:36.943 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-10T07:46:36.947 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: ntpq: command not found 2024-09-10T07:46:36.950 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T07:46:36.951 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-10T07:46:36.951 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +2082us[+2127us] +/- 61ms 2024-09-10T07:46:36.951 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 +2178us[+2178us] +/- 54ms 2024-09-10T07:46:36.951 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -7987us[-7987us] +/- 101ms 2024-09-10T07:46:36.951 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:46:36.953 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T07:46:36.953 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2024-09-10T07:46:36.954 INFO:teuthology.orchestra.run.smithi187.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +2108us[+2126us] +/- 61ms 2024-09-10T07:46:36.954 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 +2197us[+2197us] +/- 54ms 2024-09-10T07:46:36.954 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -7951us[-7951us] +/- 101ms 2024-09-10T07:46:36.954 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:46:36.955 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T07:46:36.970 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T07:46:36.970 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T07:46:37.034 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T07:46:37.167 DEBUG:teuthology.orchestra.run.smithi187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T07:46:37.284 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T07:46:37.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:46:37.345 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T07:46:37.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:46:37.405 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T07:46:37.415 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T07:46:37.424 INFO:teuthology.task.internal:Duration was 1166.055153 seconds 2024-09-10T07:46:37.424 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T07:46:37.432 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T07:46:37.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T07:46:37.437 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T07:46:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T07:46:37.524 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T07:46:37.885 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T07:46:37.885 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T07:46:37.885 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T07:46:37.935 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2024-09-10T07:46:37.935 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T07:46:37.984 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T07:46:37.984 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T07:46:37.988 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T07:46:38.047 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T07:46:38.047 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T07:46:38.051 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T07:46:38.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T07:46:38.225 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T07:46:38.225 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T07:46:38.281 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T07:46:38.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T07:46:38.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T07:46:38.350 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T07:46:38.416 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-09-10T07:46:38.420 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2024-09-10T07:46:38.449 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T07:46:38.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:46:38.483 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T07:46:38.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:46:38.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T07:46:38.526 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T07:46:38.527 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866/remote/smithi099 2024-09-10T07:46:38.527 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T07:46:38.592 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898866/remote/smithi187 2024-09-10T07:46:38.592 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T07:46:38.655 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T07:46:38.656 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T07:46:38.660 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T07:46:38.695 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T07:46:38.706 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T07:46:38.707 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T07:46:38.715 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T07:46:38.716 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T07:46:38.735 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T07:46:38.766 INFO:teuthology.orchestra.run.smithi099.stdout: 393251 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 07:46 /home/ubuntu/cephtest 2024-09-10T07:46:38.770 INFO:teuthology.orchestra.run.smithi187.stdout: 393574 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 07:46 /home/ubuntu/cephtest 2024-09-10T07:46:38.772 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T07:46:38.782 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T07:46:38.809 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-full} duration: 1166.0551533699036 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-10T07:46:38.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T07:46:38.894 INFO:teuthology.run:pass